-- Logs begin at Thu 2022-07-28 02:13:22 UTC, end at Thu 2022-07-28 05:21:52 UTC. -- Jul 28 03:24:36.607902 n-d-826756-3 systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 03:24:36.621791 n-d-826756-3 devstack@n-api.service[104085]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 03:24:36.623816 n-d-826756-3 devstack@n-api.service[104085]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 03:24:36 2022] *** Jul 28 03:24:36.623816 n-d-826756-3 devstack@n-api.service[104085]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 03:24:36.623816 n-d-826756-3 devstack@n-api.service[104085]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 03:24:36.623816 n-d-826756-3 devstack@n-api.service[104085]: nodename: n-d-826756-3 Jul 28 03:24:36.623816 n-d-826756-3 devstack@n-api.service[104085]: machine: x86_64 Jul 28 03:24:36.623816 n-d-826756-3 devstack@n-api.service[104085]: clock source: unix Jul 28 03:24:36.623816 n-d-826756-3 devstack@n-api.service[104085]: pcre jit disabled Jul 28 03:24:36.623816 n-d-826756-3 devstack@n-api.service[104085]: detected number of CPU cores: 4 Jul 28 03:24:36.623816 n-d-826756-3 devstack@n-api.service[104085]: current working directory: / Jul 28 03:24:36.623816 n-d-826756-3 devstack@n-api.service[104085]: detected binary path: /usr/bin/uwsgi-core Jul 28 03:24:36.623816 n-d-826756-3 devstack@n-api.service[104085]: your processes number limit is 47680 Jul 28 03:24:36.623816 n-d-826756-3 devstack@n-api.service[104085]: your memory page size is 4096 bytes Jul 28 03:24:36.624668 n-d-826756-3 devstack@n-api.service[104085]: detected max file descriptor number: 2048 Jul 28 03:24:36.624668 n-d-826756-3 devstack@n-api.service[104085]: lock engine: pthread robust mutexes Jul 28 03:24:36.624668 n-d-826756-3 devstack@n-api.service[104085]: thunder lock: enabled Jul 28 03:24:36.624668 n-d-826756-3 devstack@n-api.service[104085]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 03:24:36.624668 n-d-826756-3 devstack@n-api.service[104085]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 03:24:36.662617 n-d-826756-3 devstack@n-api.service[104085]: Python main interpreter initialized at 0x564b710049c0 Jul 28 03:24:36.662617 n-d-826756-3 devstack@n-api.service[104085]: python threads support enabled Jul 28 03:24:36.662617 n-d-826756-3 devstack@n-api.service[104085]: your server socket listen backlog is limited to 100 connections Jul 28 03:24:36.662617 n-d-826756-3 devstack@n-api.service[104085]: your mercy for graceful operations on workers is 90 seconds Jul 28 03:24:36.662978 n-d-826756-3 devstack@n-api.service[104085]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 03:24:36.662978 n-d-826756-3 devstack@n-api.service[104085]: *** Operational MODE: preforking *** Jul 28 03:24:36.663275 n-d-826756-3 devstack@n-api.service[104085]: *** uWSGI is running in multiple interpreter mode *** Jul 28 03:24:36.663275 n-d-826756-3 devstack@n-api.service[104085]: spawned uWSGI master process (pid: 104085) Jul 28 03:24:36.663483 n-d-826756-3 systemd[1]: Started Devstack devstack@n-api.service. Jul 28 03:24:36.664932 n-d-826756-3 devstack@n-api.service[104085]: spawned uWSGI worker 1 (pid: 104086, cores: 1) Jul 28 03:24:36.664932 n-d-826756-3 devstack@n-api.service[104085]: spawned uWSGI worker 2 (pid: 104087, cores: 1) Jul 28 03:24:36.664932 n-d-826756-3 devstack@n-api.service[104085]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 03:24:37.318544 n-d-826756-3 devstack@n-api.service[104087]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 03:24:37.319117 n-d-826756-3 devstack@n-api.service[104086]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 03:24:38.382225 n-d-826756-3 devstack@n-api.service[104087]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:24:38.382225 n-d-826756-3 devstack@n-api.service[104087]: from cryptography.utils import int_from_bytes Jul 28 03:24:38.382810 n-d-826756-3 devstack@n-api.service[104087]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:24:38.382810 n-d-826756-3 devstack@n-api.service[104087]: from cryptography.utils import int_from_bytes Jul 28 03:24:38.383102 n-d-826756-3 devstack@n-api.service[104086]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:24:38.383102 n-d-826756-3 devstack@n-api.service[104086]: from cryptography.utils import int_from_bytes Jul 28 03:24:38.383552 n-d-826756-3 devstack@n-api.service[104086]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:24:38.383552 n-d-826756-3 devstack@n-api.service[104086]: from cryptography.utils import int_from_bytes Jul 28 03:24:41.036928 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:24:41.037512 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:24:41.037709 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:24:41.038070 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:24:41.038317 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:24:41.038706 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.039027 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.039344 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.039664 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.039988 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.040292 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.040627 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.040935 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.041260 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.041515 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.041864 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.042185 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826756-3 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.042485 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.042788 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.043094 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.043185 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:24:41.043535 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.043614 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:24:41.043682 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.043939 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:24:41.044027 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.044292 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.044397 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:24:41.044583 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:24:41.044807 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.044978 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.046121 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.046256 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.046372 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.046490 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.046595 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.046704 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.046808 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.046919 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.047029 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.047132 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.047242 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.047359 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.047463 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.047580 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.047691 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.047805 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.047908 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.048010 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.048149 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.048280 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.048418 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826756-3 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.048551 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826756-3 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.048675 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.048804 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.048932 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.049053 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.049253 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.049384 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.049587 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.049711 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.049832 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.049951 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.050180 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.050335 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.050547 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.050700 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.050874 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.051087 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.051282 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.051466 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.052405 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.052597 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.052750 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.052898 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.053051 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.053211 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.053343 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.053463 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.053625 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.053762 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.053883 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.054002 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.054127 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.054247 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.054410 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.054539 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.054660 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.054788 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.054917 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.054917 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.055171 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826756-3 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.055293 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.055423 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.055544 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.055736 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.055859 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.055979 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.056107 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.056232 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.056392 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.056517 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.056637 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.056758 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.056934 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.057071 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.057207 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.057329 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.057594 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.057801 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.058001 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.058148 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.058303 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.058303 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.058565 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.058687 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.058814 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.058943 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.058943 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.059180 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.059329 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.059519 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.059642 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.059780 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.059899 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.060031 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.060189 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.060312 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.060624 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.060815 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.061019 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.061195 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.061329 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.061465 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.061599 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.061841 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.062014 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.062145 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.062281 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.062412 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.062689 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.062865 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.063033 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.063174 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.063344 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.063652 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.063844 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.063991 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.064116 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.064247 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.064402 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.064543 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.064667 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.064870 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.065056 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.065197 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.065323 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.065462 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.065588 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.065714 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.065835 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.065955 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.066085 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.066241 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.066369 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.066574 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.066751 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.066882 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.067028 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.067151 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.067273 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.067429 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.067564 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.067756 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.067946 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.068089 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.068215 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.068431 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.068575 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.068707 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.068839 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.068961 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.069173 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.069361 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.069511 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.069719 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.069865 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.070000 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.070122 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.070243 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.070371 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.070500 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.070621 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.070744 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.070907 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.071039 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.071253 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.071446 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.071579 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.071715 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.071839 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.071959 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.072115 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.072254 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.072467 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.072659 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.072796 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.072923 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.073044 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.073175 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.073417 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.073593 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.073725 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.073861 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.074009 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.074148 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.074342 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.074518 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.074650 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.074784 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.074924 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.075128 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.075252 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.075371 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.075491 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.075610 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.075784 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.075916 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.076110 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.076286 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.076472 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.076597 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.076739 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.076862 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.076985 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.077105 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.077304 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.077491 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.077635 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.077760 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.077881 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.078002 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.078133 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.078262 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.078467 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.078654 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.078786 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.079018 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.079147 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.079278 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.079415 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.079544 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.079665 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.079878 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.080013 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.080138 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.080267 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.080426 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.080552 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.080680 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.080846 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.080986 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.081159 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.081290 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.081488 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.081674 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.081807 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.081949 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.082071 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.082194 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.082392 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.082578 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.082759 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.082902 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.083025 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.083165 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.083290 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.083418 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.083538 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.083668 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.083864 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.084040 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.084182 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.084309 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.084488 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.084622 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.084745 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.084866 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.085067 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.085254 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.085404 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.085540 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.085663 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.085784 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.085904 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.086060 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.086201 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.086376 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.086507 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.086717 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.086893 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.087044 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.087181 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.087304 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.087425 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.087650 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.087818 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.087970 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.088099 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.088295 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.088499 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:24:41.088730 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.088879 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.089036 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.089178 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.089301 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.089421 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.089604 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.089732 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.089904 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.090058 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.090223 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.090323 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.090555 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.090652 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.090866 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.090961 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.091180 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.091280 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.091486 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.091586 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.091794 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.091890 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.092101 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.092211 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.092434 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.092550 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.092762 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.093084 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.093178 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.093413 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.093500 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.093722 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.093818 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.094037 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.094197 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.094326 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.094455 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.094641 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.094767 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.094949 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.095081 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.095255 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.095386 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.095561 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.095686 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.095863 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.095987 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.096165 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.096290 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.096510 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.096636 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.096782 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.096907 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.097083 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.097208 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.097404 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.097536 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.097728 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.097879 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.098034 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.098166 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.098368 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.098492 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.098666 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.098788 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.098974 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.099107 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.099279 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.099410 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.099584 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.100134 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.100260 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.100436 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.100561 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.100682 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.100852 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.100975 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.101152 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.101290 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.101471 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.101607 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.101776 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.101901 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.102078 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.102203 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.102396 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.102527 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.102697 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.102819 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.102997 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.103121 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.103304 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.103427 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.103610 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.103734 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.103914 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.104038 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.104219 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.104342 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.104738 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.104860 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.104860 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.105084 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.105211 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.105333 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.105461 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.105591 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.105797 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.105920 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.106131 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.106254 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.106442 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.106579 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.106761 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.106908 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.107112 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.107307 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.107512 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.107728 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.107925 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.108123 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.108312 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.108535 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.108722 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.108934 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.109128 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.109324 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.109530 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.109741 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.109966 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.110189 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.110472 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.110664 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.110851 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.111045 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.111264 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.111464 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.111665 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.111665 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.112040 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.112242 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.112494 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.112672 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.112798 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.112919 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.113039 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.113160 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.113291 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.113413 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.113533 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.113654 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.113654 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.113891 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.114013 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.114133 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.114254 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.114254 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.114479 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.114613 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.114613 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.114850 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.114977 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.114977 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.115211 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.115340 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.115460 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.115580 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.115699 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.115821 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.115939 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.116068 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.116188 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.116308 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.116523 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.116846 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.116983 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.117160 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.117437 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.117560 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.117777 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.118039 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.118164 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.118384 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.118602 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.118725 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.118996 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.119147 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.119306 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.119464 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.119789 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.119912 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.120240 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.120503 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.120636 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.120916 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.121065 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.121238 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.121552 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.121689 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.121869 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.122181 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.122306 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.122495 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.122762 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.122895 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.123088 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.123296 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.123421 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.123614 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.123745 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.123924 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.124049 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.124242 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.124419 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.124578 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.124765 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.124903 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.125096 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.125376 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.125507 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.125695 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.125818 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.126041 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.126243 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.126375 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.126662 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.126823 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.126982 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.127300 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.127431 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.127626 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.127941 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.128071 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.128272 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.128590 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.128715 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.default_format = luks {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.128918 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.129212 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.129336 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.129544 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.129706 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.129854 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.130069 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.130194 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.130408 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.130561 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.130755 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.130883 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.131067 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.131197 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.131392 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.131517 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.131715 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.131838 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.132042 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.132165 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.132372 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.132499 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.132716 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.132837 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.133042 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.133176 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.133360 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.133495 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.133680 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.133801 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.133995 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.134118 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.134311 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.134434 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.134627 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.134751 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.134951 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.135080 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.135264 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.135387 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.135594 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.135717 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.135908 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.136043 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.136225 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.136374 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.136573 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.136694 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.136889 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.137024 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.137219 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.default_format = luks {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.137349 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.137573 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.137696 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.137818 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.137937 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.138139 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.138263 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.138448 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.138578 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.138758 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.138890 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.139073 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.139197 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.139381 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.139504 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.139690 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.139814 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.140002 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.140287 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.140548 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.140693 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.140905 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.141032 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.141152 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.141288 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.141418 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.141539 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.141668 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.141790 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.141909 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.142107 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.142238 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.142426 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.142559 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.142758 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.142881 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.143083 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.143216 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.143398 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.143522 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.143721 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.143844 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.144044 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.144168 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.144374 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.144501 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.144677 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.144803 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.145005 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.145138 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.145319 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.145444 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.145627 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.145759 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.145934 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.146059 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.146238 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.146580 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.146711 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.146946 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.147084 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.147295 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.147418 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.147552 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.147674 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.147819 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.148004 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.148136 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.148334 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.148514 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.148696 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.148819 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.149059 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.149199 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.149382 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.149516 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.149726 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.149904 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.150029 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.150648 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.150792 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.150936 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.151150 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.151150 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.151825 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.151953 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.152086 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.152208 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.152330 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.152479 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.152600 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.152733 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.152856 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.152983 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.153285 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.153409 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.153599 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.153733 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.153911 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.154222 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.154344 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.154545 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.154700 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.154857 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.155175 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.155335 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.155486 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.156131 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.156266 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.156420 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.156545 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.157069 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.157203 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.157325 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.157524 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.157648 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.157779 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.157900 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.158021 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.158235 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.158367 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.158696 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.158839 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.159041 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.159346 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.159471 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.159707 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.159871 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.160027 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.160150 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.160372 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.161017 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.161166 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.161166 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.161489 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.161611 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.161732 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.161852 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.161974 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.162108 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.162228 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.162348 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.162469 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.162589 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.162723 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.162845 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.163012 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.163136 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.163329 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.163453 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.163945 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.164075 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.164075 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.164312 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.164852 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.164990 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.165123 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.165123 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.165360 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.165480 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.165602 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.165722 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.165851 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.165981 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.166104 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.166224 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.166345 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.166465 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.166637 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.166782 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.166958 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.167114 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.167276 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.167460 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.167587 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.167770 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.167903 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.168078 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.168203 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.168432 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.168566 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.168741 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.168866 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.169048 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.169190 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.169354 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.169479 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.169668 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.169800 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.169979 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.170113 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.170310 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.170433 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.170625 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.170746 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.170938 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.171082 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.171251 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.171389 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.171573 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.171695 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.171858 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.171998 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.172165 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.172294 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.172494 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.172630 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.172808 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.172942 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.173120 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.173249 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.173427 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.173552 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.173732 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.173857 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.174047 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.174172 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.174365 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.174498 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.174669 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.174794 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.175537 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.175670 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.175856 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.175975 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.176097 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.176202 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.176305 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.176305 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.176586 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.176689 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.176802 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.176907 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.177016 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.177128 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.177232 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.177348 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.177453 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.177679 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.177869 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.177979 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.178184 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.178304 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.178495 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.178606 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.178805 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.178916 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.179154 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.179289 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.179462 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.179586 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.179774 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.179957 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.180103 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.180241 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.180452 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.180569 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.180762 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.180864 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.181078 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.181169 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.181386 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.181474 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.181693 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.181795 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.182000 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.182089 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.182312 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.182418 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.182676 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.182773 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.182985 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.183079 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.183290 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.183392 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.183599 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.183694 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.183907 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.183996 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.184231 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.184318 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.184569 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.184657 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.184876 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.184974 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.185181 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.185278 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.185485 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.185610 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.185831 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.185918 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.186140 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.186227 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.186509 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.186610 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.186816 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.186910 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.187128 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.187215 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.187445 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.187540 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.187759 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.187852 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.188074 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.188163 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.188409 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.188512 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.188719 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.188807 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.189037 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.189123 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.189353 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.189460 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.189665 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.189761 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.189974 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.190092 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.190279 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.190404 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.190603 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.190735 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.190918 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.191054 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.191238 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.191366 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.191559 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.191685 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.191884 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.191982 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.192207 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.192296 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.192543 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.192644 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.192857 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.193094 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.193182 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.193416 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.193507 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.193738 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.193832 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.194052 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.194159 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.194369 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.194456 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.194685 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.194779 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.195001 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.195095 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.195317 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.195412 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.195627 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.195713 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.195938 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.196054 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.196253 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.196392 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.196593 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.196697 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.196903 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.197015 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.197229 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.197316 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.197545 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.197651 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.197854 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.197941 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.198192 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.198281 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.198501 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.198604 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.198818 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.198913 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.199125 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.199212 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.199498 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.199604 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.199807 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.199894 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.200130 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.200217 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.200490 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.200583 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.200806 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.200906 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.201122 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.201209 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.201441 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.201628 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.201758 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.201885 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.202078 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.202200 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.202500 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.202589 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.202817 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.202908 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.203132 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.203219 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.203446 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.203534 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.203755 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.203852 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.204061 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.204157 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.204404 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.204505 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.204734 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.204820 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.205041 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.205136 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.205349 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.205442 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.205654 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.205769 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.205980 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.206099 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.206285 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.206427 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.206607 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.206744 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.207027 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.207115 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.207341 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.207477 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.207648 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.207803 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.208067 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.208155 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.208456 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.208568 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.208714 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.208810 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.209037 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.209132 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.209359 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.209473 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.209679 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.209768 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.209985 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.210071 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.210290 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.210378 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.210604 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.210698 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.210913 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.210999 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.211231 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.211320 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.211543 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.211638 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.211856 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.211977 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.212161 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.212256 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.212499 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.212597 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.212823 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.212924 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.213129 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.213216 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.213450 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.213543 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.213855 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.213963 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.214183 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.214285 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.214510 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.214607 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.214818 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.214919 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.215143 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.215238 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.215458 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.215546 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.215764 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.215859 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.216071 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.216158 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.216397 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.216501 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.216706 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.216802 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.217031 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.217118 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.217338 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.217425 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.217653 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.217742 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.217967 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.218054 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.218279 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.218366 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.218585 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.218673 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.218889 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.218978 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.219212 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.219307 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.219519 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.219615 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.219842 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.219929 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.220156 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.220256 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.220502 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.220592 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.220821 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.220908 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.221129 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.221232 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.221453 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.221542 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.221765 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.221853 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.222071 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.222171 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.222376 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.222464 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.222684 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.222771 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.223010 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.223108 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.223332 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.223419 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.223637 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.223727 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.223965 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.224064 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.224274 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.224417 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.224967 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.225062 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.225285 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.225375 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.225591 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.225679 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.225934 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.226029 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.226242 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.226328 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.226566 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.226654 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.226874 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.226962 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.227181 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.227269 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.227494 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.227582 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.227808 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.227913 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.228113 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.228201 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.228438 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.228529 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.228752 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.228855 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.229054 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.229141 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.229387 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.229475 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.229692 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.229788 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.230017 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.230105 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.230322 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.230416 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.230632 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.230727 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.230940 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.231027 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.231244 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.231379 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.231550 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.231639 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.231854 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.232100 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.232189 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.232459 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.232628 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.232781 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.232869 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.233099 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.233189 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.233416 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.233512 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.233734 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.233829 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.234053 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.234151 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.234365 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.234462 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.234681 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.234769 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.234996 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.235083 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.235313 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.235408 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.235626 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.235720 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.235943 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.236038 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.236260 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.236400 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.236604 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.236714 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.236917 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.237058 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.237236 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.237379 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.237551 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.237698 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.237871 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.238027 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.238382 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.238482 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.238701 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.238789 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.239011 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.239108 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.239329 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.239417 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.239643 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.239733 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.239959 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.240054 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.240274 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.240382 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.240615 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.240701 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.240928 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.241016 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.241243 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.241338 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.241555 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.241641 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.241869 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.241966 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.242184 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.242271 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.242498 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.242585 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.242825 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.242913 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.243143 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.243229 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.243461 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.243605 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.243777 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.243866 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.244097 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.244207 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.244448 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.244557 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.244800 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.245024 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.245201 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.245345 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.245518 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.245682 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.245840 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.246009 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.246157 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.246336 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.246473 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.246656 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.246788 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.246974 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.247106 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.247305 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.247423 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.247614 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.247737 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.247924 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.248050 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.248240 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.248377 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.248580 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.248689 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.248888 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.249020 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.249214 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.249357 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.249527 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.249684 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.249849 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.249985 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.250155 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.250301 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.250470 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.250628 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.251018 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.251150 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.251375 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.251471 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.251693 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.251782 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.252020 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.252118 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.252447 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.252538 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.252773 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.252874 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.253092 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.253231 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.253435 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.253522 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.253723 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.253811 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.254030 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.254125 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.254348 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.254446 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.254659 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.254746 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.254964 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.255130 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.255267 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.255363 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.255581 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.255668 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.255886 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.255973 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.256190 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.256276 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.256528 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.256618 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.256838 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.257068 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.257201 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.257418 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.257506 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.257738 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.257835 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.258043 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.258130 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.258357 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.258446 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.258660 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.258757 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.258967 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.259062 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.259272 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.259359 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.259581 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.259675 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.259888 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.259975 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.260192 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.260281 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.260557 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.260648 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.260867 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.260981 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.261182 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.261278 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.261490 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.261578 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.261825 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.261911 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.262130 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.262218 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.262445 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.262533 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.262748 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.262834 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.263053 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.263148 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.263367 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.263453 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.263673 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.263760 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.263976 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.264071 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.264290 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.264430 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.264623 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.264711 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.264926 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.265026 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.265231 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.265318 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.265535 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.265795 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.265883 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.266134 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.266221 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.266443 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.266529 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.266753 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.266853 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.267065 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.267159 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.267371 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.267458 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.267686 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.267785 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.268024 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.268110 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.268378 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.268480 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.268690 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.268791 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.268995 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.269082 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.269312 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.269400 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.269623 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.269719 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.269948 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.270035 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.270262 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.270355 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.270573 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.270659 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.270886 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.270981 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.271200 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.271286 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.271511 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.271743 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.271830 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.272080 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.272173 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.272424 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.272527 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.272745 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.272835 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.273064 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.273153 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.273371 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.273464 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.273677 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.273764 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.273982 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.274072 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.274309 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.274399 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.274620 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.274707 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.274933 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.275020 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.275243 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.275337 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.275551 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.275637 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.275857 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.275944 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.276191 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.276279 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.276557 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.276646 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.276868 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.276973 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.277180 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.277276 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.277491 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.277802 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.277897 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.278112 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.278200 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.278421 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.278509 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.278735 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.278876 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.279046 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.279141 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.279391 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.279480 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.279711 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.279807 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.280028 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.280123 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.280384 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.280476 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.280685 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.280786 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.280997 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.281085 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.281307 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.281394 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.281617 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.281713 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.281925 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.282020 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.282242 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.282338 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.282554 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.282641 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.282861 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.282949 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.283166 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.283260 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.283567 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.283876 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.284009 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.284203 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.284291 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.284548 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.284718 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.284864 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.284952 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.285175 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.285262 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.285481 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.285570 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.285787 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.285875 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.286092 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.286179 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.286401 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.286497 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.286706 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.286794 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.287080 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.287181 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.287341 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.287430 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.287647 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.287735 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.287953 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.288048 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.288256 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.288345 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.288592 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.288692 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.288899 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.288995 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.289203 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.289293 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.289510 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.289604 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.289816 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.289913 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.290120 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.290207 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.290424 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.290510 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.290740 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.290836 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] os_brick.lock_path = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.291045 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.291133 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.capabilities = [21] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.291350 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.291438 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.group = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.291655 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.helper_command = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.291741 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.291984 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.292071 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.292296 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.292401 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.thread_pool_size = 4 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.292628 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.292717 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.user = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.292943 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.293031 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.293260 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.293347 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.293567 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.293656 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.293875 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.293964 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.294181 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.294279 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.294490 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.294577 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.294794 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.294887 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.295098 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.295195 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.295402 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.295490 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.295706 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.295802 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.296008 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.296105 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.296336 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.296453 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.296670 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] os_brick.lock_path = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.296757 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.296980 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.297075 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.capabilities = [21] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.297285 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.group = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.297372 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.297590 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.helper_command = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.297677 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.297907 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.298006 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.298221 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.thread_pool_size = 4 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.298309 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.298525 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.user = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.298613 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.298842 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.298930 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.299161 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.299278 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.299482 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.299612 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.299795 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.299933 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.300117 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.300253 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.300447 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.300601 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.300771 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.300933 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.301092 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.301247 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.301406 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.301563 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.301718 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.301875 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.302053 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.302188 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.302364 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.302505 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.302675 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.302823 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.302986 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.303136 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.303297 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.303451 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.303608 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.303772 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.303919 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.304089 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.304270 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.304451 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.304585 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.304785 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.304887 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.305100 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.305197 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.305427 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.305515 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.305756 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.305844 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.306105 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.306202 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.306416 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.306502 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.306747 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.306834 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.307059 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.307157 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.307390 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.307509 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.307738 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.307833 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.308044 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.308138 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.308290 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:24:41.308415 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.308681 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.308991 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.309303 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.309620 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.309937 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.310263 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.310588 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.310902 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.311227 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.311551 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.311901 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.312216 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.312578 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.312907 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.313224 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.313538 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.313845 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:24:41.314088 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104086) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:24:41.368903 n-d-826756-3 devstack@n-api.service[104087]: INFO dbcounter [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] Registered counter for database nova_api Jul 28 03:24:41.373867 n-d-826756-3 devstack@n-api.service[104086]: INFO dbcounter [None req-44424def-0d17-48e8-a346-aee37d662699 None None] Registered counter for database nova_api Jul 28 03:24:41.390928 n-d-826756-3 devstack@n-api.service[104087]: DEBUG oslo_db.sqlalchemy.engines [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:24:41.393844 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_db.sqlalchemy.engines [None req-44424def-0d17-48e8-a346-aee37d662699 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104086) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:24:41.398851 n-d-826756-3 devstack@n-api.service[104087]: DEBUG dbcounter [-] [104087] Writer thread running {{(pid=104087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:24:41.400529 n-d-826756-3 devstack@n-api.service[104086]: DEBUG dbcounter [-] [104086] Writer thread running {{(pid=104086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:24:41.457615 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.context [None req-44424def-0d17-48e8-a346-aee37d662699 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8b3e198-f422-4bf1-ae6c-bd38905d4b84(cell1) {{(pid=104086) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:24:41.457950 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.context [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8b3e198-f422-4bf1-ae6c-bd38905d4b84(cell1) {{(pid=104087) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:24:41.462152 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_concurrency.lockutils [None req-44424def-0d17-48e8-a346-aee37d662699 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:24:41.462287 n-d-826756-3 devstack@n-api.service[104087]: DEBUG oslo_concurrency.lockutils [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:24:41.463762 n-d-826756-3 devstack@n-api.service[104087]: DEBUG oslo_concurrency.lockutils [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:24:41.463989 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_concurrency.lockutils [None req-44424def-0d17-48e8-a346-aee37d662699 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:24:41.464570 n-d-826756-3 devstack@n-api.service[104087]: DEBUG oslo_concurrency.lockutils [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:24:41.464723 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_concurrency.lockutils [None req-44424def-0d17-48e8-a346-aee37d662699 None None] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:24:41.466582 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_concurrency.lockutils [None req-44424def-0d17-48e8-a346-aee37d662699 None None] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:24:41.466730 n-d-826756-3 devstack@n-api.service[104087]: DEBUG oslo_concurrency.lockutils [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104087) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:24:41.468598 n-d-826756-3 devstack@n-api.service[104086]: INFO dbcounter [None req-44424def-0d17-48e8-a346-aee37d662699 None None] Registered counter for database nova_cell0 Jul 28 03:24:41.469136 n-d-826756-3 devstack@n-api.service[104087]: INFO dbcounter [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] Registered counter for database nova_cell0 Jul 28 03:24:41.472498 n-d-826756-3 devstack@n-api.service[104086]: INFO dbcounter [None req-44424def-0d17-48e8-a346-aee37d662699 None None] Registered counter for database nova_cell1 Jul 28 03:24:41.473326 n-d-826756-3 devstack@n-api.service[104087]: INFO dbcounter [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] Registered counter for database nova_cell1 Jul 28 03:24:41.481106 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_db.sqlalchemy.engines [None req-44424def-0d17-48e8-a346-aee37d662699 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104086) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:24:41.482702 n-d-826756-3 devstack@n-api.service[104087]: DEBUG oslo_db.sqlalchemy.engines [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:24:41.485483 n-d-826756-3 devstack@n-api.service[104087]: DEBUG oslo_db.sqlalchemy.engines [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:24:41.485978 n-d-826756-3 devstack@n-api.service[104086]: DEBUG dbcounter [-] [104086] Writer thread running {{(pid=104086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:24:41.487466 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_db.sqlalchemy.engines [None req-44424def-0d17-48e8-a346-aee37d662699 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104086) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:24:41.489995 n-d-826756-3 devstack@n-api.service[104087]: DEBUG dbcounter [-] [104087] Writer thread running {{(pid=104087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:24:41.623440 n-d-826756-3 devstack@n-api.service[104086]: DEBUG dbcounter [-] [104086] Writer thread running {{(pid=104086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:24:41.632677 n-d-826756-3 devstack@n-api.service[104086]: INFO dbcounter [None req-44424def-0d17-48e8-a346-aee37d662699 None None] Registered counter for database nova_cell0 Jul 28 03:24:41.633874 n-d-826756-3 devstack@n-api.service[104087]: DEBUG dbcounter [-] [104087] Writer thread running {{(pid=104087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:24:41.642073 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_db.sqlalchemy.engines [None req-44424def-0d17-48e8-a346-aee37d662699 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104086) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:24:41.644899 n-d-826756-3 devstack@n-api.service[104087]: INFO dbcounter [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] Registered counter for database nova_cell0 Jul 28 03:24:41.646762 n-d-826756-3 devstack@n-api.service[104086]: DEBUG dbcounter [-] [104086] Writer thread running {{(pid=104086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:24:41.654018 n-d-826756-3 devstack@n-api.service[104087]: DEBUG oslo_db.sqlalchemy.engines [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:24:41.659163 n-d-826756-3 devstack@n-api.service[104087]: DEBUG dbcounter [-] [104087] Writer thread running {{(pid=104087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:24:41.981638 n-d-826756-3 devstack@n-api.service[104086]: WARNING keystonemiddleware.auth_token [None req-44424def-0d17-48e8-a346-aee37d662699 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:24:41.987380 n-d-826756-3 devstack@n-api.service[104087]: WARNING keystonemiddleware.auth_token [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:24:41.989207 n-d-826756-3 devstack@n-api.service[104086]: WARNING keystonemiddleware.auth_token [None req-44424def-0d17-48e8-a346-aee37d662699 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:24:41.994892 n-d-826756-3 devstack@n-api.service[104087]: WARNING keystonemiddleware.auth_token [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:24:42.328756 n-d-826756-3 devstack@n-api.service[104086]: WARNING keystonemiddleware.auth_token [None req-44424def-0d17-48e8-a346-aee37d662699 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:24:42.334787 n-d-826756-3 devstack@n-api.service[104086]: WARNING keystonemiddleware.auth_token [None req-44424def-0d17-48e8-a346-aee37d662699 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:24:42.339441 n-d-826756-3 devstack@n-api.service[104087]: WARNING keystonemiddleware.auth_token [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:24:42.340081 n-d-826756-3 devstack@n-api.service[104086]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564b710049c0 pid: 104086 (default app) Jul 28 03:24:42.342223 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-44424def-0d17-48e8-a346-aee37d662699 None None] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:24:42.343420 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-44424def-0d17-48e8-a346-aee37d662699 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001755 Jul 28 03:24:42.343842 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Thu Jul 28 03:24:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:24:42.345435 n-d-826756-3 devstack@n-api.service[104087]: WARNING keystonemiddleware.auth_token [None req-9e01fc15-2636-4bfa-9ed4-0c7fcafc727b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:24:42.351258 n-d-826756-3 devstack@n-api.service[104087]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564b710049c0 pid: 104087 (default app) Jul 28 03:25:57.902828 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-44424def-0d17-48e8-a346-aee37d662699 None None] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:25:57.904619 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-44424def-0d17-48e8-a346-aee37d662699 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002088 Jul 28 03:25:57.905360 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 03:25:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:25:57.917171 n-d-826756-3 devstack@n-api.service[104087]: DEBUG dbcounter [-] [104087] Writing DB stats nova_api:SELECT=3 {{(pid=104087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:25:57.918685 n-d-826756-3 devstack@n-api.service[104087]: DEBUG dbcounter [-] [104087] Writing DB stats nova_cell0:SELECT=3 {{(pid=104087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:25:57.919691 n-d-826756-3 devstack@n-api.service[104087]: DEBUG dbcounter [-] [104087] Writing DB stats nova_cell1:SELECT=3 {{(pid=104087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:25:57.920413 n-d-826756-3 devstack@n-api.service[104087]: DEBUG dbcounter [-] [104087] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:25:58.772702 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-76bb1cf8-893d-41a1-858a-7c8e3dc9c3a3 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:25:58.805649 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-76bb1cf8-893d-41a1-858a-7c8e3dc9c3a3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.893722 Jul 28 03:25:58.806452 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jul 28 03:25:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:26:00.979599 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-44424def-0d17-48e8-a346-aee37d662699 None None] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:00.980702 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-44424def-0d17-48e8-a346-aee37d662699 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 28 03:26:00.981161 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 03:26:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:01.447921 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-1ad5b488-fd14-4c8f-8cfa-b9645c6f7b53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "disk": 1, "swap": 0, "name": "cirros256", "ram": 256}} {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:01.467672 n-d-826756-3 devstack@n-api.service[104087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:26:01.467672 n-d-826756-3 devstack@n-api.service[104087]: warnings.warn(msg) Jul 28 03:26:01.496131 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-1ad5b488-fd14-4c8f-8cfa-b9645c6f7b53 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.507952 Jul 28 03:26:01.504007 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 03:26:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:26:01.511074 n-d-826756-3 devstack@n-api.service[104086]: DEBUG dbcounter [-] [104086] Writing DB stats nova_api:SELECT=3 {{(pid=104086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:26:01.512172 n-d-826756-3 devstack@n-api.service[104086]: DEBUG dbcounter [-] [104086] Writing DB stats nova_cell1:SELECT=3 {{(pid=104086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:26:01.513045 n-d-826756-3 devstack@n-api.service[104086]: DEBUG dbcounter [-] [104086] Writing DB stats nova_cell0:SELECT=3 {{(pid=104086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:26:01.514135 n-d-826756-3 devstack@n-api.service[104086]: DEBUG dbcounter [-] [104086] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:26:01.719694 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-a44fe562-49b8-4234-bfd6-2e01bc55eddb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:01.724294 n-d-826756-3 devstack@n-api.service[104086]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:26:01.724294 n-d-826756-3 devstack@n-api.service[104086]: warnings.warn(msg) Jul 28 03:26:01.792946 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-a44fe562-49b8-4234-bfd6-2e01bc55eddb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287304 Jul 28 03:26:01.793902 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 28 03:26:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:26:04.005361 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-1ad5b488-fd14-4c8f-8cfa-b9645c6f7b53 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:04.007807 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-1ad5b488-fd14-4c8f-8cfa-b9645c6f7b53 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002851 Jul 28 03:26:04.011140 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 03:26:04 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:04.722308 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-db108ff8-c342-4fe2-a3c9-1bf179fe9eb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:04.741651 n-d-826756-3 devstack@n-api.service[104086]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:26:04.741651 n-d-826756-3 devstack@n-api.service[104086]: warnings.warn(msg) Jul 28 03:26:04.778251 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-db108ff8-c342-4fe2-a3c9-1bf179fe9eb3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.763668 Jul 28 03:26:04.784433 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 03:26:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:26:04.793512 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-25f029bb-b4a5-4e35-a4ca-405f70357d47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:04.796541 n-d-826756-3 devstack@n-api.service[104087]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:26:04.796541 n-d-826756-3 devstack@n-api.service[104087]: warnings.warn(msg) Jul 28 03:26:04.834901 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-25f029bb-b4a5-4e35-a4ca-405f70357d47 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045215 Jul 28 03:26:04.835567 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 28 03:26:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:26:07.213001 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-db108ff8-c342-4fe2-a3c9-1bf179fe9eb3 admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:07.213001 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-db108ff8-c342-4fe2-a3c9-1bf179fe9eb3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Jul 28 03:26:07.213001 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 03:26:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:07.874565 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-92832787-5df0-47ed-bcfb-0a8b2b75d75b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "disk": 10}} {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:07.898328 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-92832787-5df0-47ed-bcfb-0a8b2b75d75b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.679501 Jul 28 03:26:07.904720 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 03:26:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:26:07.911897 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-9ece405e-3b57-4423-a50f-886030c8c9d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:07.939074 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-9ece405e-3b57-4423-a50f-886030c8c9d3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030906 Jul 28 03:26:07.940325 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 28 03:26:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:26:10.270095 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-92832787-5df0-47ed-bcfb-0a8b2b75d75b admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:10.271083 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-92832787-5df0-47ed-bcfb-0a8b2b75d75b admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 28 03:26:10.271468 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 03:26:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:10.634700 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-8399726a-19af-4c82-b740-3086695df28d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "id": "d3", "ram": 2048}} {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:10.655116 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-8399726a-19af-4c82-b740-3086695df28d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.377370 Jul 28 03:26:10.655713 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 03:26:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:26:10.668061 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-2b725bcd-cd0a-464a-8d7c-26526194dd28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:10.695081 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-2b725bcd-cd0a-464a-8d7c-26526194dd28 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030654 Jul 28 03:26:10.695887 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 28 03:26:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:26:12.953144 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-8399726a-19af-4c82-b740-3086695df28d admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:12.954520 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-8399726a-19af-4c82-b740-3086695df28d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jul 28 03:26:12.954698 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 03:26:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:13.446138 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-a43209e5-4d0f-4df5-98d6-4f58fd0fd50b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:13.466617 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-a43209e5-4d0f-4df5-98d6-4f58fd0fd50b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506021 Jul 28 03:26:13.467177 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 03:26:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:26:13.479389 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-f55b1eea-2757-43f1-9f91-7cb3278863fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:13.504509 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-f55b1eea-2757-43f1-9f91-7cb3278863fc admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029101 Jul 28 03:26:13.505180 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jul 28 03:26:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:26:15.920869 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-a43209e5-4d0f-4df5-98d6-4f58fd0fd50b admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:15.923456 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-a43209e5-4d0f-4df5-98d6-4f58fd0fd50b admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003077 Jul 28 03:26:15.924333 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 03:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:16.373163 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-2ead59be-f54e-470d-ba51-284f9c769a4e admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:16.401137 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-2ead59be-f54e-470d-ba51-284f9c769a4e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.468595 Jul 28 03:26:16.404818 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jul 28 03:26:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:26:18.789625 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-a43209e5-4d0f-4df5-98d6-4f58fd0fd50b admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:18.790640 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-a43209e5-4d0f-4df5-98d6-4f58fd0fd50b admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 28 03:26:18.791041 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 03:26:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:19.223587 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-c97a036c-9217-4e4e-81c9-84fd3c764f01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:19.248699 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-c97a036c-9217-4e4e-81c9-84fd3c764f01 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.451581 Jul 28 03:26:19.249311 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 03:26:18 2022] POST /compute/v2.1/flavors => generated 402 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:26:19.263288 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-e7677db6-0ca3-4759-b4d7-78310b3f94fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:19.294199 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-e7677db6-0ca3-4759-b4d7-78310b3f94fb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036165 Jul 28 03:26:19.295116 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 28 03:26:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:26:21.468032 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-c97a036c-9217-4e4e-81c9-84fd3c764f01 admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:21.469136 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-c97a036c-9217-4e4e-81c9-84fd3c764f01 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 Jul 28 03:26:21.469737 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 03:26:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:21.929410 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-d401935d-66fe-41de-b6ce-80808fbe76bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:21.949853 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-d401935d-66fe-41de-b6ce-80808fbe76bd admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.473961 Jul 28 03:26:21.950450 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 03:26:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:26:21.963072 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-845b3929-9cff-4d21-bd23-618b364cfd5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:21.990169 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-845b3929-9cff-4d21-bd23-618b364cfd5d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030921 Jul 28 03:26:21.990770 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 28 03:26:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:26:24.233510 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-d401935d-66fe-41de-b6ce-80808fbe76bd admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:24.234540 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-d401935d-66fe-41de-b6ce-80808fbe76bd admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 28 03:26:24.235114 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 03:26:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:24.773147 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-2d7e73d1-ecd8-4498-bde1-9ed2f2f67e89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:24.792992 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-2d7e73d1-ecd8-4498-bde1-9ed2f2f67e89 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.552212 Jul 28 03:26:24.793559 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 03:26:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:26:24.805620 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-8e346040-8899-4019-867e-72f5bdee9e4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:24.831805 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-8e346040-8899-4019-867e-72f5bdee9e4b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029964 Jul 28 03:26:24.832583 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 28 03:26:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:26:27.000554 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-2d7e73d1-ecd8-4498-bde1-9ed2f2f67e89 admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:27.001553 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-2d7e73d1-ecd8-4498-bde1-9ed2f2f67e89 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 28 03:26:27.001955 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 03:26:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:27.417002 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-f30b094a-d73c-4e2f-8d58-fd50e37a0b6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "ram": 8192}} {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:27.436566 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-f30b094a-d73c-4e2f-8d58-fd50e37a0b6c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.425248 Jul 28 03:26:27.437102 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 03:26:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:26:27.449140 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-c0f84c71-c5e4-495d-8a7c-d59041ad5356 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:27.475653 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-c0f84c71-c5e4-495d-8a7c-d59041ad5356 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030192 Jul 28 03:26:27.486360 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 28 03:26:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:26:29.652904 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-f30b094a-d73c-4e2f-8d58-fd50e37a0b6c admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:29.654000 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-f30b094a-d73c-4e2f-8d58-fd50e37a0b6c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Jul 28 03:26:29.654425 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 03:26:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:30.125975 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-5ea3d8d9-32db-4a53-b044-013e66ec18d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:30.147190 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-5ea3d8d9-32db-4a53-b044-013e66ec18d8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.486804 Jul 28 03:26:30.148013 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jul 28 03:26:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:26:30.163718 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-e97b6820-05f0-40c2-9d16-7f6bd2a954b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:26:30.168644 n-d-826756-3 devstack@n-api.service[104087]: DEBUG dbcounter [-] [104087] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:26:30.191872 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-e97b6820-05f0-40c2-9d16-7f6bd2a954b6 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031855 Jul 28 03:26:30.192578 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jul 28 03:26:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:26:53.999193 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-5ea3d8d9-32db-4a53-b044-013e66ec18d8 admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:54.000271 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-5ea3d8d9-32db-4a53-b044-013e66ec18d8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 28 03:26:54.000709 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 03:26:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:54.404639 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-eb22ca3d-98c7-4567-a955-ccb2029ebfc1 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:54.423262 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-eb22ca3d-98c7-4567-a955-ccb2029ebfc1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.416446 Jul 28 03:26:54.423786 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jul 28 03:26:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:26:55.495026 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-5ea3d8d9-32db-4a53-b044-013e66ec18d8 admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:55.496186 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-5ea3d8d9-32db-4a53-b044-013e66ec18d8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 28 03:26:55.496621 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 03:26:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:56.076499 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-d2e8905f-72f7-4d8e-a30d-e90be52ce2fb admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:56.082426 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.wsgi [None req-d2e8905f-72f7-4d8e-a30d-e90be52ce2fb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-d2e8905f-72f7-4d8e-a30d-e90be52ce2fb admin admin] Request method failure captured: Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: Accept: application/json Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: Accept-Encoding: gzip, deflate Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: Connection: keep-alive Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: Content-Length: 0 Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: Host: 10.222.0.48 Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: Openstack-Api-Version: compute 2.90 Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: Openstack-System-Scope: None Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: User-Agent: python-novaclient Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: X-Auth-Token: gAAAAABi4gH_pQ-GdOIUrDVRv0vQXRMrx1oyFTgosu-CG8iQzAaBuE2I5I5FPNkhwjZpb-S-MjBRMf7AMdohLklUPuFt8aMKlGP-cgb37I3j0n0BkeAaeQbBibe-vu4gCtfx0-jKjNN_tuKJOUsYdJynDG2r8olMoo5dr7JcmW1bKEBB2yN_lEo Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: X-Domain-Id: None Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: X-Domain-Name: None Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: X-Identity-Status: Confirmed Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: X-Is-Admin-Project: True Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: X-Project-Domain-Id: default Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: X-Project-Domain-Name: Default Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: X-Project-Id: 6e22fadfd96e4d73a855bf124b64e682 Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: X-Project-Name: admin Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: X-Role: reader,admin,member Jul 28 03:26:56.085743 n-d-826756-3 devstack@n-api.service[104087]: X-Roles: reader,admin,member Jul 28 03:26:56.087472 n-d-826756-3 devstack@n-api.service[104087]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e22fadfd96e4d73a855bf124b64e682"}]}] Jul 28 03:26:56.087472 n-d-826756-3 devstack@n-api.service[104087]: X-Tenant: admin Jul 28 03:26:56.087472 n-d-826756-3 devstack@n-api.service[104087]: X-Tenant-Id: 6e22fadfd96e4d73a855bf124b64e682 Jul 28 03:26:56.087472 n-d-826756-3 devstack@n-api.service[104087]: X-Tenant-Name: admin Jul 28 03:26:56.087472 n-d-826756-3 devstack@n-api.service[104087]: X-User: admin Jul 28 03:26:56.087472 n-d-826756-3 devstack@n-api.service[104087]: X-User-Domain-Id: default Jul 28 03:26:56.087472 n-d-826756-3 devstack@n-api.service[104087]: X-User-Domain-Name: Default Jul 28 03:26:56.087472 n-d-826756-3 devstack@n-api.service[104087]: X-User-Id: f754ea01079a4d76b2cb03f0daea1554 Jul 28 03:26:56.087472 n-d-826756-3 devstack@n-api.service[104087]: X-User-Name: admin Jul 28 03:26:56.087472 n-d-826756-3 devstack@n-api.service[104087]: method: > Jul 28 03:26:56.087472 n-d-826756-3 devstack@n-api.service[104087]: exception: Flavor 42 could not be found. Jul 28 03:26:56.087472 n-d-826756-3 devstack@n-api.service[104087]: action_args: {'id': '42'} Jul 28 03:26:56.087472 n-d-826756-3 devstack@n-api.service[104087]: {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:26:56.087472 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:26:56.088453 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:56.090020 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-d2e8905f-72f7-4d8e-a30d-e90be52ce2fb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:26:56.091324 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-d2e8905f-72f7-4d8e-a30d-e90be52ce2fb admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.417017 Jul 28 03:26:56.091324 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jul 28 03:26:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 418 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:26:56.097307 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-c68af915-950d-4549-9275-2b1ad38e5270 admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:56.101571 n-d-826756-3 devstack@n-api.service[104086]: DEBUG dbcounter [-] [104086] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:26:56.122002 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-c68af915-950d-4549-9275-2b1ad38e5270 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028504 Jul 28 03:26:56.122556 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 28 03:26:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:26:56.138976 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-e68b02f8-e6cb-4c8f-82ae-80887eb6abd5 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:56.163088 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-e68b02f8-e6cb-4c8f-82ae-80887eb6abd5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027785 Jul 28 03:26:56.163626 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 28 03:26:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:26:56.174174 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-a57edd7d-50ab-4ad1-8a2d-4cbc7fc7fc44 admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:56.180488 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.wsgi [None req-a57edd7d-50ab-4ad1-8a2d-4cbc7fc7fc44 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-a57edd7d-50ab-4ad1-8a2d-4cbc7fc7fc44 admin admin] Request method failure captured: Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: Accept: application/json Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: Accept-Encoding: gzip, deflate Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: Connection: keep-alive Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: Content-Length: 0 Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: Host: 10.222.0.48 Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: Openstack-Api-Version: compute 2.90 Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: Openstack-System-Scope: None Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: User-Agent: python-novaclient Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: X-Auth-Token: gAAAAABi4gH_pQ-GdOIUrDVRv0vQXRMrx1oyFTgosu-CG8iQzAaBuE2I5I5FPNkhwjZpb-S-MjBRMf7AMdohLklUPuFt8aMKlGP-cgb37I3j0n0BkeAaeQbBibe-vu4gCtfx0-jKjNN_tuKJOUsYdJynDG2r8olMoo5dr7JcmW1bKEBB2yN_lEo Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: X-Domain-Id: None Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: X-Domain-Name: None Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: X-Identity-Status: Confirmed Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: X-Is-Admin-Project: True Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: X-Project-Domain-Id: default Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: X-Project-Domain-Name: Default Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: X-Project-Id: 6e22fadfd96e4d73a855bf124b64e682 Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: X-Project-Name: admin Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: X-Role: reader,admin,member Jul 28 03:26:56.183900 n-d-826756-3 devstack@n-api.service[104086]: X-Roles: reader,admin,member Jul 28 03:26:56.185532 n-d-826756-3 devstack@n-api.service[104086]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e22fadfd96e4d73a855bf124b64e682"}]}] Jul 28 03:26:56.185532 n-d-826756-3 devstack@n-api.service[104086]: X-Tenant: admin Jul 28 03:26:56.185532 n-d-826756-3 devstack@n-api.service[104086]: X-Tenant-Id: 6e22fadfd96e4d73a855bf124b64e682 Jul 28 03:26:56.185532 n-d-826756-3 devstack@n-api.service[104086]: X-Tenant-Name: admin Jul 28 03:26:56.185532 n-d-826756-3 devstack@n-api.service[104086]: X-User: admin Jul 28 03:26:56.185532 n-d-826756-3 devstack@n-api.service[104086]: X-User-Domain-Id: default Jul 28 03:26:56.185532 n-d-826756-3 devstack@n-api.service[104086]: X-User-Domain-Name: Default Jul 28 03:26:56.185532 n-d-826756-3 devstack@n-api.service[104086]: X-User-Id: f754ea01079a4d76b2cb03f0daea1554 Jul 28 03:26:56.185532 n-d-826756-3 devstack@n-api.service[104086]: X-User-Name: admin Jul 28 03:26:56.185532 n-d-826756-3 devstack@n-api.service[104086]: method: > Jul 28 03:26:56.185532 n-d-826756-3 devstack@n-api.service[104086]: exception: Flavor 42 could not be found. Jul 28 03:26:56.185532 n-d-826756-3 devstack@n-api.service[104086]: action_args: {'id': '42'} Jul 28 03:26:56.185532 n-d-826756-3 devstack@n-api.service[104086]: {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:26:56.185532 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:26:56.186404 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:56.187862 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-a57edd7d-50ab-4ad1-8a2d-4cbc7fc7fc44 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:26:56.189115 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-a57edd7d-50ab-4ad1-8a2d-4cbc7fc7fc44 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015591 Jul 28 03:26:56.189115 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jul 28 03:26:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 03:26:57.153607 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-e68b02f8-e6cb-4c8f-82ae-80887eb6abd5 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:57.154619 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-e68b02f8-e6cb-4c8f-82ae-80887eb6abd5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 28 03:26:57.154990 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 03:26:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:57.728936 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-1e22a935-7cce-4a18-89ce-f36dafb79eab admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:57.737095 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.wsgi [None req-1e22a935-7cce-4a18-89ce-f36dafb79eab admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-1e22a935-7cce-4a18-89ce-f36dafb79eab admin admin] Request method failure captured: Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: Accept: application/json Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: Accept-Encoding: gzip, deflate Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: Connection: keep-alive Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: Content-Length: 0 Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: Host: 10.222.0.48 Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: Openstack-Api-Version: compute 2.90 Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: Openstack-System-Scope: None Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: User-Agent: python-novaclient Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: X-Auth-Token: gAAAAABi4gIBXa5pJjB1RKC-uCFuxaI1FIyx5L59z31TT25AjumW4pysOGiLjy7yMEom0SwU9NF5v6_5mwXzkQnwDt-ZJHjGtSzNPQxdNdAPNdTDen2nrryxlr2z6IAqP8j8gjWqiZ9iJ4PPpg4G1gcoDTzz7hYwlxX1ICC42lucR69P_JLOroI Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: X-Domain-Id: None Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: X-Domain-Name: None Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: X-Identity-Status: Confirmed Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: X-Is-Admin-Project: True Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: X-Project-Domain-Id: default Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: X-Project-Domain-Name: Default Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: X-Project-Id: 6e22fadfd96e4d73a855bf124b64e682 Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: X-Project-Name: admin Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: X-Role: reader,admin,member Jul 28 03:26:57.739316 n-d-826756-3 devstack@n-api.service[104086]: X-Roles: reader,admin,member Jul 28 03:26:57.740982 n-d-826756-3 devstack@n-api.service[104086]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e22fadfd96e4d73a855bf124b64e682"}]}] Jul 28 03:26:57.740982 n-d-826756-3 devstack@n-api.service[104086]: X-Tenant: admin Jul 28 03:26:57.740982 n-d-826756-3 devstack@n-api.service[104086]: X-Tenant-Id: 6e22fadfd96e4d73a855bf124b64e682 Jul 28 03:26:57.740982 n-d-826756-3 devstack@n-api.service[104086]: X-Tenant-Name: admin Jul 28 03:26:57.740982 n-d-826756-3 devstack@n-api.service[104086]: X-User: admin Jul 28 03:26:57.740982 n-d-826756-3 devstack@n-api.service[104086]: X-User-Domain-Id: default Jul 28 03:26:57.740982 n-d-826756-3 devstack@n-api.service[104086]: X-User-Domain-Name: Default Jul 28 03:26:57.740982 n-d-826756-3 devstack@n-api.service[104086]: X-User-Id: f754ea01079a4d76b2cb03f0daea1554 Jul 28 03:26:57.740982 n-d-826756-3 devstack@n-api.service[104086]: X-User-Name: admin Jul 28 03:26:57.740982 n-d-826756-3 devstack@n-api.service[104086]: method: > Jul 28 03:26:57.740982 n-d-826756-3 devstack@n-api.service[104086]: exception: Flavor 84 could not be found. Jul 28 03:26:57.740982 n-d-826756-3 devstack@n-api.service[104086]: action_args: {'id': '84'} Jul 28 03:26:57.740982 n-d-826756-3 devstack@n-api.service[104086]: {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:26:57.740982 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:26:57.741981 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:57.743325 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-1e22a935-7cce-4a18-89ce-f36dafb79eab admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:26:57.744675 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-1e22a935-7cce-4a18-89ce-f36dafb79eab admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.446791 Jul 28 03:26:57.744675 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jul 28 03:26:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 448 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:26:57.750654 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-11801b3e-46a2-4607-870d-da4ad6980bc9 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:57.765883 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-11801b3e-46a2-4607-870d-da4ad6980bc9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018833 Jul 28 03:26:57.766367 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 28 03:26:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:26:57.775792 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-d306781f-746f-4ebf-91a3-7493d1cf6ea5 admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:57.792399 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-d306781f-746f-4ebf-91a3-7493d1cf6ea5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020026 Jul 28 03:26:57.792978 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 28 03:26:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:26:57.805221 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-d58d8dae-5937-4394-bcc9-4649ff302ca9 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:57.811936 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.wsgi [None req-d58d8dae-5937-4394-bcc9-4649ff302ca9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-d58d8dae-5937-4394-bcc9-4649ff302ca9 admin admin] Request method failure captured: Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: Accept: application/json Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: Accept-Encoding: gzip, deflate Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: Connection: keep-alive Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: Content-Length: 0 Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: Host: 10.222.0.48 Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: Openstack-Api-Version: compute 2.90 Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: Openstack-System-Scope: None Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: User-Agent: python-novaclient Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: X-Auth-Token: gAAAAABi4gIBXa5pJjB1RKC-uCFuxaI1FIyx5L59z31TT25AjumW4pysOGiLjy7yMEom0SwU9NF5v6_5mwXzkQnwDt-ZJHjGtSzNPQxdNdAPNdTDen2nrryxlr2z6IAqP8j8gjWqiZ9iJ4PPpg4G1gcoDTzz7hYwlxX1ICC42lucR69P_JLOroI Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: X-Domain-Id: None Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: X-Domain-Name: None Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: X-Identity-Status: Confirmed Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: X-Is-Admin-Project: True Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: X-Project-Domain-Id: default Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: X-Project-Domain-Name: Default Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: X-Project-Id: 6e22fadfd96e4d73a855bf124b64e682 Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: X-Project-Name: admin Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: X-Role: reader,admin,member Jul 28 03:26:57.813536 n-d-826756-3 devstack@n-api.service[104087]: X-Roles: reader,admin,member Jul 28 03:26:57.814899 n-d-826756-3 devstack@n-api.service[104087]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e22fadfd96e4d73a855bf124b64e682"}]}] Jul 28 03:26:57.814899 n-d-826756-3 devstack@n-api.service[104087]: X-Tenant: admin Jul 28 03:26:57.814899 n-d-826756-3 devstack@n-api.service[104087]: X-Tenant-Id: 6e22fadfd96e4d73a855bf124b64e682 Jul 28 03:26:57.814899 n-d-826756-3 devstack@n-api.service[104087]: X-Tenant-Name: admin Jul 28 03:26:57.814899 n-d-826756-3 devstack@n-api.service[104087]: X-User: admin Jul 28 03:26:57.814899 n-d-826756-3 devstack@n-api.service[104087]: X-User-Domain-Id: default Jul 28 03:26:57.814899 n-d-826756-3 devstack@n-api.service[104087]: X-User-Domain-Name: Default Jul 28 03:26:57.814899 n-d-826756-3 devstack@n-api.service[104087]: X-User-Id: f754ea01079a4d76b2cb03f0daea1554 Jul 28 03:26:57.814899 n-d-826756-3 devstack@n-api.service[104087]: X-User-Name: admin Jul 28 03:26:57.814899 n-d-826756-3 devstack@n-api.service[104087]: method: > Jul 28 03:26:57.814899 n-d-826756-3 devstack@n-api.service[104087]: exception: Flavor 84 could not be found. Jul 28 03:26:57.814899 n-d-826756-3 devstack@n-api.service[104087]: action_args: {'id': '84'} Jul 28 03:26:57.814899 n-d-826756-3 devstack@n-api.service[104087]: {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:26:57.814899 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:26:57.815733 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:57.816871 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-d58d8dae-5937-4394-bcc9-4649ff302ca9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:26:57.817932 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-d58d8dae-5937-4394-bcc9-4649ff302ca9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015801 Jul 28 03:26:57.817932 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jul 28 03:26:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:26:58.806590 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-d306781f-746f-4ebf-91a3-7493d1cf6ea5 admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:58.807600 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-d306781f-746f-4ebf-91a3-7493d1cf6ea5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 28 03:26:58.807997 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 03:26:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:26:59.377569 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-1badf93c-182b-43f6-82f6-8f5caf13f9b8 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:59.383382 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.wsgi [None req-1badf93c-182b-43f6-82f6-8f5caf13f9b8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-1badf93c-182b-43f6-82f6-8f5caf13f9b8 admin admin] Request method failure captured: Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: Accept: application/json Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: Accept-Encoding: gzip, deflate Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: Connection: keep-alive Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: Content-Length: 0 Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: Host: 10.222.0.48 Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: Openstack-Api-Version: compute 2.90 Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: Openstack-System-Scope: None Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: User-Agent: python-novaclient Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: X-Auth-Token: gAAAAABi4gICJJD9D0o489FQb9a_DUHbTiDna8Nx1mBZcJnDJCTej2o6Af5QcUUvynIxuWxnpQ5AQql2fbF4AesWEHQeMsWxgrmT7rla9GlkGhGa0klbEfjAXInAIy7u-DvliRcHOaDRJPU2MeWBWMOD3oulOO332vHM9SfFgWoNsbhnlHVP5Ng Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: X-Domain-Id: None Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: X-Domain-Name: None Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: X-Identity-Status: Confirmed Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: X-Is-Admin-Project: True Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: X-Project-Domain-Id: default Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: X-Project-Domain-Name: Default Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: X-Project-Id: 6e22fadfd96e4d73a855bf124b64e682 Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: X-Project-Name: admin Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: X-Role: reader,admin,member Jul 28 03:26:59.384950 n-d-826756-3 devstack@n-api.service[104087]: X-Roles: reader,admin,member Jul 28 03:26:59.386704 n-d-826756-3 devstack@n-api.service[104087]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e22fadfd96e4d73a855bf124b64e682"}]}] Jul 28 03:26:59.386704 n-d-826756-3 devstack@n-api.service[104087]: X-Tenant: admin Jul 28 03:26:59.386704 n-d-826756-3 devstack@n-api.service[104087]: X-Tenant-Id: 6e22fadfd96e4d73a855bf124b64e682 Jul 28 03:26:59.386704 n-d-826756-3 devstack@n-api.service[104087]: X-Tenant-Name: admin Jul 28 03:26:59.386704 n-d-826756-3 devstack@n-api.service[104087]: X-User: admin Jul 28 03:26:59.386704 n-d-826756-3 devstack@n-api.service[104087]: X-User-Domain-Id: default Jul 28 03:26:59.386704 n-d-826756-3 devstack@n-api.service[104087]: X-User-Domain-Name: Default Jul 28 03:26:59.386704 n-d-826756-3 devstack@n-api.service[104087]: X-User-Id: f754ea01079a4d76b2cb03f0daea1554 Jul 28 03:26:59.386704 n-d-826756-3 devstack@n-api.service[104087]: X-User-Name: admin Jul 28 03:26:59.386704 n-d-826756-3 devstack@n-api.service[104087]: method: > Jul 28 03:26:59.386704 n-d-826756-3 devstack@n-api.service[104087]: exception: Flavor 451 could not be found. Jul 28 03:26:59.386704 n-d-826756-3 devstack@n-api.service[104087]: action_args: {'id': '451'} Jul 28 03:26:59.386704 n-d-826756-3 devstack@n-api.service[104087]: {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:26:59.386704 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:26:59.387686 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: ERROR nova.api.openstack.wsgi Jul 28 03:26:59.388969 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-1badf93c-182b-43f6-82f6-8f5caf13f9b8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104087) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:26:59.390264 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-1badf93c-182b-43f6-82f6-8f5caf13f9b8 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.437240 Jul 28 03:26:59.390264 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 28 03:26:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 439 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:26:59.396231 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-fb66036b-9174-4ac3-b83c-f7b70c82f585 admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:59.411048 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-fb66036b-9174-4ac3-b83c-f7b70c82f585 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018444 Jul 28 03:26:59.411583 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 28 03:26:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:26:59.421076 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-0b8d997e-5c77-4bfc-b591-aedb6d0d4833 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:59.435834 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-0b8d997e-5c77-4bfc-b591-aedb6d0d4833 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018399 Jul 28 03:26:59.436342 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jul 28 03:26:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:26:59.445574 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-795238a7-2dc3-4d37-b2fe-b921e1a4b774 admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:26:59.451106 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.wsgi [None req-795238a7-2dc3-4d37-b2fe-b921e1a4b774 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-795238a7-2dc3-4d37-b2fe-b921e1a4b774 admin admin] Request method failure captured: Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: Accept: application/json Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: Accept-Encoding: gzip, deflate Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: Connection: keep-alive Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: Content-Length: 0 Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: Host: 10.222.0.48 Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: Openstack-Api-Version: compute 2.90 Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: Openstack-System-Scope: None Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: User-Agent: python-novaclient Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: X-Auth-Token: gAAAAABi4gICJJD9D0o489FQb9a_DUHbTiDna8Nx1mBZcJnDJCTej2o6Af5QcUUvynIxuWxnpQ5AQql2fbF4AesWEHQeMsWxgrmT7rla9GlkGhGa0klbEfjAXInAIy7u-DvliRcHOaDRJPU2MeWBWMOD3oulOO332vHM9SfFgWoNsbhnlHVP5Ng Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: X-Domain-Id: None Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: X-Domain-Name: None Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: X-Identity-Status: Confirmed Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: X-Is-Admin-Project: True Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: X-Project-Domain-Id: default Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: X-Project-Domain-Name: Default Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: X-Project-Id: 6e22fadfd96e4d73a855bf124b64e682 Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: X-Project-Name: admin Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: X-Role: reader,admin,member Jul 28 03:26:59.452633 n-d-826756-3 devstack@n-api.service[104086]: X-Roles: reader,admin,member Jul 28 03:26:59.454208 n-d-826756-3 devstack@n-api.service[104086]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6e22fadfd96e4d73a855bf124b64e682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e22fadfd96e4d73a855bf124b64e682"}]}] Jul 28 03:26:59.454208 n-d-826756-3 devstack@n-api.service[104086]: X-Tenant: admin Jul 28 03:26:59.454208 n-d-826756-3 devstack@n-api.service[104086]: X-Tenant-Id: 6e22fadfd96e4d73a855bf124b64e682 Jul 28 03:26:59.454208 n-d-826756-3 devstack@n-api.service[104086]: X-Tenant-Name: admin Jul 28 03:26:59.454208 n-d-826756-3 devstack@n-api.service[104086]: X-User: admin Jul 28 03:26:59.454208 n-d-826756-3 devstack@n-api.service[104086]: X-User-Domain-Id: default Jul 28 03:26:59.454208 n-d-826756-3 devstack@n-api.service[104086]: X-User-Domain-Name: Default Jul 28 03:26:59.454208 n-d-826756-3 devstack@n-api.service[104086]: X-User-Id: f754ea01079a4d76b2cb03f0daea1554 Jul 28 03:26:59.454208 n-d-826756-3 devstack@n-api.service[104086]: X-User-Name: admin Jul 28 03:26:59.454208 n-d-826756-3 devstack@n-api.service[104086]: method: > Jul 28 03:26:59.454208 n-d-826756-3 devstack@n-api.service[104086]: exception: Flavor 451 could not be found. Jul 28 03:26:59.454208 n-d-826756-3 devstack@n-api.service[104086]: action_args: {'id': '451'} Jul 28 03:26:59.454208 n-d-826756-3 devstack@n-api.service[104086]: {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:26:59.454208 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:26:59.455139 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: ERROR nova.api.openstack.wsgi Jul 28 03:26:59.456278 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-795238a7-2dc3-4d37-b2fe-b921e1a4b774 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104086) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:26:59.457347 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-795238a7-2dc3-4d37-b2fe-b921e1a4b774 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011957 Jul 28 03:26:59.457347 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 28 03:26:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 03:27:00.425762 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-0b8d997e-5c77-4bfc-b591-aedb6d0d4833 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:27:00.426778 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-0b8d997e-5c77-4bfc-b591-aedb6d0d4833 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 28 03:27:00.427175 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 03:27:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:27:01.004757 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-1e42122a-786b-4f8e-9752-d25e1ed61139 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:27:01.032795 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-1e42122a-786b-4f8e-9752-d25e1ed61139 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.465435 Jul 28 03:27:01.033380 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jul 28 03:27:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:27:02.021722 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-0b8d997e-5c77-4bfc-b591-aedb6d0d4833 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:27:02.023252 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-0b8d997e-5c77-4bfc-b591-aedb6d0d4833 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002259 Jul 28 03:27:02.023844 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 03:27:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:27:02.556702 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-e8c6af40-dd41-4cba-9130-2d12a1d30233 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:27:02.584885 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-e8c6af40-dd41-4cba-9130-2d12a1d30233 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.425478 Jul 28 03:27:02.585467 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jul 28 03:27:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:27:03.559542 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-0b8d997e-5c77-4bfc-b591-aedb6d0d4833 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:27:03.560589 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-0b8d997e-5c77-4bfc-b591-aedb6d0d4833 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 28 03:27:03.560979 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 03:27:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:27:04.115867 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-cb660d7a-79f3-4f46-9d0f-19c4e25c20e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:27:04.138641 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-cb660d7a-79f3-4f46-9d0f-19c4e25c20e9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.442339 Jul 28 03:27:04.139194 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jul 28 03:27:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:27:05.110481 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-0b8d997e-5c77-4bfc-b591-aedb6d0d4833 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:27:05.111508 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-0b8d997e-5c77-4bfc-b591-aedb6d0d4833 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 28 03:27:05.111904 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 03:27:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:27:05.644453 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-fa4713e1-6f6b-47c4-b91b-500c6ab72330 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:27:05.668400 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-fa4713e1-6f6b-47c4-b91b-500c6ab72330 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.421186 Jul 28 03:27:05.668971 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jul 28 03:27:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:27:06.653483 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-0b8d997e-5c77-4bfc-b591-aedb6d0d4833 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:27:06.654498 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-0b8d997e-5c77-4bfc-b591-aedb6d0d4833 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 28 03:27:06.654896 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 03:27:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:27:07.216341 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-ff204004-c54c-4698-99df-a7ab0e5633f5 admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:27:07.237559 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-ff204004-c54c-4698-99df-a7ab0e5633f5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.443367 Jul 28 03:27:07.238188 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Thu Jul 28 03:27:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:27:58.981266 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-0b8d997e-5c77-4bfc-b591-aedb6d0d4833 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:27:58.982294 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-0b8d997e-5c77-4bfc-b591-aedb6d0d4833 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Jul 28 03:27:58.982698 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jul 28 03:27:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:27:58.993347 n-d-826756-3 devstack@n-api.service[104086]: DEBUG dbcounter [-] [104086] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:27:59.408928 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-94aa61db-8fa8-480f-bc02-758a90765a2b admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:27:59.432673 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-94aa61db-8fa8-480f-bc02-758a90765a2b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.443955 Jul 28 03:27:59.433213 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jul 28 03:27:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:27:59.455438 n-d-826756-3 devstack@n-api.service[104087]: DEBUG dbcounter [-] [104087] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=104087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:27:59.459199 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-fbef83d1-7f99-42f4-8997-24f010280de6 admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:27:59.467515 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-fbef83d1-7f99-42f4-8997-24f010280de6 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013533 Jul 28 03:27:59.468079 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Thu Jul 28 03:27:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:27:59.482517 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-0e3bebc0-7ca1-429e-9214-66d8a3791ee1 admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:27:59.490326 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-0e3bebc0-7ca1-429e-9214-66d8a3791ee1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013664 Jul 28 03:27:59.490816 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Thu Jul 28 03:27:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:27:59.502113 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-39efb97c-0be0-42d2-9747-66b2c045cb8f admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:27:59.510078 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-39efb97c-0be0-42d2-9747-66b2c045cb8f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011510 Jul 28 03:27:59.510592 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Thu Jul 28 03:27:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:27:59.521944 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-83a89bb4-1424-40d2-b6ff-203406e71a7d admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:27:59.530150 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-83a89bb4-1424-40d2-b6ff-203406e71a7d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011708 Jul 28 03:27:59.530682 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Thu Jul 28 03:27:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:33:26.725127 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-39efb97c-0be0-42d2-9747-66b2c045cb8f admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:33:26.726150 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-39efb97c-0be0-42d2-9747-66b2c045cb8f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001858 Jul 28 03:33:26.726546 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 03:33:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:33:26.867074 n-d-826756-3 devstack@n-api.service[104086]: DEBUG dbcounter [-] [104086] Writing DB stats nova_api:SELECT=6 {{(pid=104086) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:33:27.020529 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-2c8f8b26-da61-4b61-aac3-9e446110c007 admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:33:27.022904 n-d-826756-3 devstack@n-api.service[104086]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:33:27.022904 n-d-826756-3 devstack@n-api.service[104086]: warnings.warn(msg) Jul 28 03:33:27.024122 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_concurrency.lockutils [None req-2c8f8b26-da61-4b61-aac3-9e446110c007 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:33:27.024592 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_concurrency.lockutils [None req-2c8f8b26-da61-4b61-aac3-9e446110c007 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:33:27.025382 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_concurrency.lockutils [None req-2c8f8b26-da61-4b61-aac3-9e446110c007 admin admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:33:27.025805 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_concurrency.lockutils [None req-2c8f8b26-da61-4b61-aac3-9e446110c007 admin admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:33:27.067971 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-2c8f8b26-da61-4b61-aac3-9e446110c007 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1215 microversion: 2.90 time: 0.202238 Jul 28 03:33:27.068776 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 28 03:33:26 2022] GET /compute/v2.1/os-services => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:33:27.907419 n-d-826756-3 devstack@n-api.service[104087]: DEBUG nova.api.openstack.wsgi [None req-39efb97c-0be0-42d2-9747-66b2c045cb8f admin admin] Calling method '>' {{(pid=104087) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:33:27.908468 n-d-826756-3 devstack@n-api.service[104087]: INFO nova.api.openstack.requestlog [None req-39efb97c-0be0-42d2-9747-66b2c045cb8f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 28 03:33:27.908862 n-d-826756-3 devstack@n-api.service[104087]: [pid: 104087|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jul 28 03:33:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:33:28.108920 n-d-826756-3 devstack@n-api.service[104086]: DEBUG nova.api.openstack.wsgi [None req-1537e4ae-bb8e-4389-9e88-721154f692ae admin admin] Calling method '>' {{(pid=104086) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:33:28.111405 n-d-826756-3 devstack@n-api.service[104086]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:33:28.111405 n-d-826756-3 devstack@n-api.service[104086]: warnings.warn(msg) Jul 28 03:33:28.112628 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_concurrency.lockutils [None req-1537e4ae-bb8e-4389-9e88-721154f692ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:33:28.113063 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_concurrency.lockutils [None req-1537e4ae-bb8e-4389-9e88-721154f692ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:33:28.114362 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_concurrency.lockutils [None req-1537e4ae-bb8e-4389-9e88-721154f692ae admin admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:33:28.114795 n-d-826756-3 devstack@n-api.service[104086]: DEBUG oslo_concurrency.lockutils [None req-1537e4ae-bb8e-4389-9e88-721154f692ae admin admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104086) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:33:28.137005 n-d-826756-3 devstack@n-api.service[104086]: INFO nova.api.openstack.requestlog [None req-1537e4ae-bb8e-4389-9e88-721154f692ae admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.086651 Jul 28 03:33:28.137547 n-d-826756-3 devstack@n-api.service[104086]: [pid: 104086|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 28 03:33:28 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:34:11.934373 n-d-826756-3 devstack@n-api.service[104085]: Thu Jul 28 03:34:11 2022 - graceful shutdown triggered... Jul 28 03:34:11.934471 n-d-826756-3 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 03:34:11.935639 n-d-826756-3 devstack@n-api.service[104087]: Gracefully killing worker 2 (pid: 104087)... Jul 28 03:34:11.936359 n-d-826756-3 devstack@n-api.service[104086]: Gracefully killing worker 1 (pid: 104086)... Jul 28 03:34:12.936406 n-d-826756-3 devstack@n-api.service[104085]: worker 1 buried after 1 seconds Jul 28 03:34:12.936406 n-d-826756-3 devstack@n-api.service[104085]: worker 2 buried after 1 seconds Jul 28 03:34:12.936406 n-d-826756-3 devstack@n-api.service[104085]: goodbye to uWSGI. Jul 28 03:34:12.938255 n-d-826756-3 systemd[1]: devstack@n-api.service: Succeeded. Jul 28 03:34:12.939196 n-d-826756-3 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 03:34:12.943224 n-d-826756-3 systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 03:34:12.966201 n-d-826756-3 devstack@n-api.service[126057]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 03:34:12.989384 n-d-826756-3 devstack@n-api.service[126057]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 03:34:12 2022] *** Jul 28 03:34:12.989384 n-d-826756-3 devstack@n-api.service[126057]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 03:34:12.989384 n-d-826756-3 devstack@n-api.service[126057]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 03:34:12.989384 n-d-826756-3 devstack@n-api.service[126057]: nodename: n-d-826756-3 Jul 28 03:34:12.989384 n-d-826756-3 devstack@n-api.service[126057]: machine: x86_64 Jul 28 03:34:12.989384 n-d-826756-3 devstack@n-api.service[126057]: clock source: unix Jul 28 03:34:12.989384 n-d-826756-3 devstack@n-api.service[126057]: pcre jit disabled Jul 28 03:34:12.989384 n-d-826756-3 devstack@n-api.service[126057]: detected number of CPU cores: 4 Jul 28 03:34:12.989384 n-d-826756-3 devstack@n-api.service[126057]: current working directory: / Jul 28 03:34:12.989384 n-d-826756-3 devstack@n-api.service[126057]: detected binary path: /usr/bin/uwsgi-core Jul 28 03:34:12.989384 n-d-826756-3 devstack@n-api.service[126057]: your processes number limit is 47680 Jul 28 03:34:12.989384 n-d-826756-3 devstack@n-api.service[126057]: your memory page size is 4096 bytes Jul 28 03:34:12.989384 n-d-826756-3 devstack@n-api.service[126057]: detected max file descriptor number: 2048 Jul 28 03:34:12.989384 n-d-826756-3 devstack@n-api.service[126057]: lock engine: pthread robust mutexes Jul 28 03:34:12.990404 n-d-826756-3 devstack@n-api.service[126057]: thunder lock: enabled Jul 28 03:34:12.990404 n-d-826756-3 devstack@n-api.service[126057]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 03:34:12.990404 n-d-826756-3 devstack@n-api.service[126057]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 03:34:13.035885 n-d-826756-3 devstack@n-api.service[126057]: Python main interpreter initialized at 0x55aa8710c9c0 Jul 28 03:34:13.035885 n-d-826756-3 devstack@n-api.service[126057]: python threads support enabled Jul 28 03:34:13.035885 n-d-826756-3 devstack@n-api.service[126057]: your server socket listen backlog is limited to 100 connections Jul 28 03:34:13.035885 n-d-826756-3 devstack@n-api.service[126057]: your mercy for graceful operations on workers is 90 seconds Jul 28 03:34:13.036343 n-d-826756-3 devstack@n-api.service[126057]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 03:34:13.036343 n-d-826756-3 devstack@n-api.service[126057]: *** Operational MODE: preforking *** Jul 28 03:34:13.036671 n-d-826756-3 devstack@n-api.service[126057]: *** uWSGI is running in multiple interpreter mode *** Jul 28 03:34:13.036671 n-d-826756-3 devstack@n-api.service[126057]: spawned uWSGI master process (pid: 126057) Jul 28 03:34:13.037455 n-d-826756-3 devstack@n-api.service[126057]: spawned uWSGI worker 1 (pid: 126071, cores: 1) Jul 28 03:34:13.037629 n-d-826756-3 systemd[1]: Started Devstack devstack@n-api.service. Jul 28 03:34:13.037819 n-d-826756-3 devstack@n-api.service[126057]: spawned uWSGI worker 2 (pid: 126072, cores: 1) Jul 28 03:34:13.037973 n-d-826756-3 devstack@n-api.service[126057]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 03:34:13.689664 n-d-826756-3 devstack@n-api.service[126072]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 03:34:13.698363 n-d-826756-3 devstack@n-api.service[126071]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 03:34:14.839890 n-d-826756-3 devstack@n-api.service[126071]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:34:14.839890 n-d-826756-3 devstack@n-api.service[126071]: from cryptography.utils import int_from_bytes Jul 28 03:34:14.840669 n-d-826756-3 devstack@n-api.service[126071]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:34:14.840669 n-d-826756-3 devstack@n-api.service[126071]: from cryptography.utils import int_from_bytes Jul 28 03:34:14.873195 n-d-826756-3 devstack@n-api.service[126072]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:34:14.873195 n-d-826756-3 devstack@n-api.service[126072]: from cryptography.utils import int_from_bytes Jul 28 03:34:14.873870 n-d-826756-3 devstack@n-api.service[126072]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:34:14.873870 n-d-826756-3 devstack@n-api.service[126072]: from cryptography.utils import int_from_bytes Jul 28 03:34:17.350356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:34:17.350937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:34:17.351236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:34:17.351427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:34:17.351700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:34:17.352092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.352460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.352781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.353095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.353426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.353733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.354050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.354350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.354673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.354934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.355243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.355563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826756-3 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.355879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.356180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.356508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.356827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.357125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.357432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.357733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.358233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.358700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.359001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.359313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.359667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.359980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.360270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.360620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.360927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.361260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.361566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.361996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826756-3 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.362318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.362638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.362949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.363720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.363720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.364004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.364324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.364668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.364979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.365302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.365617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.365935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.366253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.366552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.366857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.367163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.367477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.367778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.368078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.368326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.368653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.368973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.369291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.369613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.369863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.370109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.370433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.370752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.371065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.371375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.371677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.371980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.372292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.372627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.372935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.373238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.373556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.373869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.374188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.374490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.374814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.375214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.375463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.375767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.376104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.376448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.376756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.377069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.377386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.377690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.377991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.378292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.378608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.378930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.379249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.379528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.379828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.380130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.380469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.380776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.381079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.381385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.381686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.381985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.382293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.382590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.382890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.383189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.383490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.383794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.384096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.384426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.384740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.385057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.385355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.385656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.385955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.386256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.386575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.386877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.387178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.387494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.387795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.388096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.388436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.388741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.389045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.389361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.389655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.389955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.390268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.390569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.390869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.391168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.391468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.391769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.392066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.392387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.392681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.392978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.393293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.393609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.393914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.394215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.394519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.394836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.395193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.395519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.395857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.396166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.396520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.396850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.397162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.397471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.397782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.398103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.398410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.398718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.399027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.399349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.399663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.399988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.400299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.400635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.400950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.401258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.401569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.401894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.402208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.402515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.402847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.403195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.403559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.403822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.404144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.404476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.404794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.405102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.405420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.405741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.406048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.406360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.406670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.406988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.407280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.407584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.407889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.408221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.408554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.408868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.409174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.409487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.409795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.410168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.410410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.410758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.411061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.411363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.411694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.411977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.412295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.412646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.412951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.413290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.413616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.413898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.414209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.414517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.414825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.415131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.415437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.415737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.416059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.416382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.416689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.417009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.417312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.417618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.417930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.418240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.418544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.418851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.419156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.419475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.419785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.420090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.420452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.420791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.421093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.421415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.421735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.422063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.422364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.422670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.422973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.423276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.423577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.423886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.424188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.424510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.424821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.425122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.425421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.425744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.426045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.426387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.426683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.426984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.427321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.427622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.427962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.428298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.428634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.428954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.429262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.429574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.429881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.430190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.430498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.430804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.431120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.431427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.431742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.432051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.432382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.432693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.433008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.433344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.433684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.434019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.434347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.434664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.434982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.435289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.435602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.435909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.436216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.436553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.436861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.437173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.437478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.437790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.438097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.438418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.438723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.439035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.439337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.439645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.439972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.440302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.440648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.default_format = luks {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.440957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.441264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.441582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.441960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.442272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.442580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.442881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.443183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.443492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.443802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.444111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.444416 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:34:17.444919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.445087 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:34:17.445275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.445275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.445509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:34:17.445644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.445744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:34:17.445832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.445936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:34:17.446024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.446200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.446300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.446516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.446609 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.446824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.446926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.447148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.447254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.447466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.447580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.447768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.447872 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.448070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.448164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.448416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.448540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.448725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.448838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.448991 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.449109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.449306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.449400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.449606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.449709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-826756-3 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.449941 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.450044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.450247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.450341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.450547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.450641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.450864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.450967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.451170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.451271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.451474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.451619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.451784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.451886 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.452092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.452289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.452446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.452641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.452753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.452951 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.453090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.453268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.453362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.453622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.453742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.453929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.454026 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.454234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.454331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.454540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.454642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.454854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.454957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.455157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.455248 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.455464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.455571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.455770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.455870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-826756-3 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.456072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.456197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.456393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.456544 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.456713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.456965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.457368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.457484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.457709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.457805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.458071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.458172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.458442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.458784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.458941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.459084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.459272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.459416 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.459648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.459753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.460050 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.460142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.460392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.460500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.460702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.460817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.461015 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.461115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.461326 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.461428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.461632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.461739 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.461940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.462047 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.462245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.462345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.462482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.462611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.462795 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.462922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.463122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.463241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.463430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.463543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.463733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.463863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.463999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.464108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.464249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.464342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.464588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.464697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.464911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.465013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.465231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.465325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.465540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.465642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.465844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.465945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.466150 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.466249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.466459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.466554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.466759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.466850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.467061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.467162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.467363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.467456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.467686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.467790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.467989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.468092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.468315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.468440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.468649 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.468744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.468972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.469119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.469286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.469394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.469591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.469684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.469903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.470008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.470206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.470298 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.470509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.470601 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.470813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.470920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.471124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.471224 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.471431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.471533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.471734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.471835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.472041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.472135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.472378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.472485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.472676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.472778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.472988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.473155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.473673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.473771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.473948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.474083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.474237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.474343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.474547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.474652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.474869 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.474965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.475177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.475270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.475478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.475569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.475785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.475880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.476089 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.476194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.476411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.476507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.476722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.476824 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.477023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.477117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.477353 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.477484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.477630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.477730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.477931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.478024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.478232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.478407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.478537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.478636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.478844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.478949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.479149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.479303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.479470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.479572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.479776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.479867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.480077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.480178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.480410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.480505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.480706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.480809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.481012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.481157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.481321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.481460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.481626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.481721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.481948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.482039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.482253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.482363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.482553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.482689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.482860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.482964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.483163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.483279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.483460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.483561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.483759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.483859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.484061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.484210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.484370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.484478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.484681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.484777 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.484987 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.485115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.485287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.485379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.485588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.485680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.485892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.485985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.486198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.486358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.486488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.486624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.486767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.486905 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.487066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.487169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.487375 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.487475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.487692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.487793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.488053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.488153 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.488392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.488492 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.488807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.488916 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.489031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.489133 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.489341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.489478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:34:17.489648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.489750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.489958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.490101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.490259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.490398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.490580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.490710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.490887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.490982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.491199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.491301 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.491501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.491593 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.491801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.491902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.492121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.492222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.492461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.492571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.492779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.492923 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.493100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.493210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.493425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.493529 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.493745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.493846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.494047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.494143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.494356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.494461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.494665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.494757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.494979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.495073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.495287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.495379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.495594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.495688 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.495902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.495995 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.496214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.496315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.496548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.496654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.496859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.496952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.497169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.497262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.497474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.497576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.497791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.498014 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.498123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.498259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.498390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.498498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.498714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.498807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.499024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.499117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.499329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.499436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.499636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.499729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.499939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.500030 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.500246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.500340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.500573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.500666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.500897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.501041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.501211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.501306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.501524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.501624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.501835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.501928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.502148 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.502250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.502486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.502586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.502798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.502891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.503111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.503214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.503426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.503566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.503904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.504036 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.504227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.504441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.504535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.504628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.504794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.504901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.505101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.505202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.505401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.505502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.505709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.505855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.506055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.506159 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.506376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.506470 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.506701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.506848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.507019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.507119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.507339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.507443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.507643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.507753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.507975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.508076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.508340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.508674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.508993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.509304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.509621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.509936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.510244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.510574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.510684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.510887 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.510993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.511196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.511296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.511694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.511812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.512010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.512144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.512322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.512454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.512689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.512795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.513001 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.513106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.513324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.513432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.513677 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.513783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.513990 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.514092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.514307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.514429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.514623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.514727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.514933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.515037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.515262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.515374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.515580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.515676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.515890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.515993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.516217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.516321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.516564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.516652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.516872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.516966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.517202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.517346 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.517559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.517666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.517866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.517970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.518176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.518285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.518485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.518580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.518800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.518896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.519112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.519213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.519442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.519543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.519753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.519966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.520143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.520271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.520424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.520606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.520709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.520936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.521046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.521251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.521345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.521559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.521706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.521868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.521972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.522178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.522272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.522483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.522574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.522804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.522898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.523109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.523210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.523434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.523527 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.523750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.523854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.524070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.524199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.524439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.524683 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.524843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.524997 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.525098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.525185 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.525349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.525467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.525616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.525711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.525919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.526021 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.526223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.526317 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.526545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.526677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.526860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.526972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.527172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.527287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.527502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.527604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.527814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.527924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.528130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.528239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.528459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.528590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.528781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.528882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.529111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.529214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.529430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.529523 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.529747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.529848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.530058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.530223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.530378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.530521 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.530671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.530842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.530998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.531138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.531278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.531423 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.531571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.531719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.531893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.532032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.532173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.532320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.532545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.532636 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.532736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.532830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.533036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.533134 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.533341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.533444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.533663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.533786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.533974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.534070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.534279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.534400 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.534610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.534715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.534933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.535079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.535310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.535458 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.535724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.535842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.default_format = luks {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.535985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.536113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.536315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.536482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.536681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.536809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.536978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.537104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.537285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.537410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.537598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.537721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.537907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.538026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.538217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.538343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.538529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.538661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.538847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.538973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.539140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.539489 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.539606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.539705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.539801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.540001 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.540106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.540321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.540513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.540658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.540756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.540969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.541079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.541277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.541533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.541642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.541864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.541966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.542179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.542277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.542490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.542591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.542802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.542911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.543116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.543219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.543425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.543518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.543732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.543835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.544041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.544152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.544378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.544487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.544777 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.545086 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.545434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.545766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.546057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.546259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.546623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.546745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.546976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.547341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.547683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.547864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.548037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.548235 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.548445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.548596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.548750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.548911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.549071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.549253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.549394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.549591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.549717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.549935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.550037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.550220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.550343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.550601 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.550708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.550971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.551081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.551343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.551475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.551658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.551843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.551977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.552075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.552281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.552444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.552626 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.552791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.552937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.553039 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.553244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.553336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.553557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.553665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.553880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.553978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.554212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.554519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.554613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.554845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.554956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.555158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.555297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.555480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.555581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.555813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.556006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.556133 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.556324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.556479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.556685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.556849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.557002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.557168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.557323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.557479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.557641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.557794 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.557959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.558107 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.558286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.558418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.558589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.558735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.558894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.559046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.559206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.559356 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.559517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.559652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.559821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.559966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.560141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.560276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.560477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.560615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.560780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.560926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.561099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.561234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.561409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.561553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.561861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.561962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.562175 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.562276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.562499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.562622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.562810 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.562918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.563122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.563225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.563429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.563532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.563736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.563831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.564043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.564139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.564407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.564519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.564719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.564813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.565037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.565140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.565346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.565439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.565650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.565751 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.565955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.566049 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.566264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.566359 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.566572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.566664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.566929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.567071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.567240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.567359 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.567543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.567640 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.567855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.567955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.568158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.568249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.568486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.568580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.568792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.568897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.569101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.569242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.569402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.569504 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.569705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.569807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.570007 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.570099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.570308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.570408 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.570613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.570720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.570911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.571010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.571218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.571322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.571511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.571609 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.571814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.571907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.572115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.572208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.572461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.572560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.572771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.572877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.573085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.573185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.573383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.573476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.573685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.573789 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.573991 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.574126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.574297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.574425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.574603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.574698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.574914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.575035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.575221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.575323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.575524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.575618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.575849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.576222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.576505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.576659 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.576858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.577796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.577958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.578056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.578133 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.578213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.578286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.578358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.578438 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.578520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.578601 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.578861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.578959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.579035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.579118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.579300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.579398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.579615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.579740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.579914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.580219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.580564 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.580679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.580876 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.580982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.581237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.581403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.581485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.581648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.581846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.581952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.582215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.582343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.582659 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.582770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.582897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.583030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.583354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.583551 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.583680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.583977 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.584132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.584363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.584697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.584794 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.585023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.585267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.585439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.585751 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.585905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.586957 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.586957 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.587224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.587364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.587364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.587640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.587734 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.587734 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.587996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.588142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.588241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.588452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.588598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.588944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.589031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.589258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.589554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.589717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.589892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.590095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.590253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.590557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.590746 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.590919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.591082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.591252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.591417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.591571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.591719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.591873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.592037 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.592209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.592394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.592554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.592716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.592923 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.593094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.593256 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.593413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.593579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.593775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.593925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.594083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.594248 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.594369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.594546 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.594630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.594884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.595046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.595203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.595368 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.595521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.595708 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.595859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.596030 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.596168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.596457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.596552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.596803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.596967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.597108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.597254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.597401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.597548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.597715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.597849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.598053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.598203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.598724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.598862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.599040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.599184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.599380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.599532 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.599692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.599839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.600004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.600142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.600322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.600600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.600711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.600893 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.601043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.601194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.601350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.601517 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.601672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.601771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.601867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.602048 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.602154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.602457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.602568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.602770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.602893 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.603075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.603183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.603389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.603514 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.603693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.603819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.604003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.604178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.604308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.604479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.604647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.604784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.604955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.605084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.605263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.605356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.605570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.605662 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.605895 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.606008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.606203 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.606296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] os_brick.lock_path = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.606534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.capabilities = [21] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.606669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.606843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.group = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.606944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.607151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.helper_command = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.607258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.607475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.607582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.607790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.thread_pool_size = 4 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.607953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.608103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.user = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.608266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.608446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.608608 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.608769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.608935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.609096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.609259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.609411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.609588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.609736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.609896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.610052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.610212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.610385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.610528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.610713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.610857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.611035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.611182 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.611348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.611479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.611684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.611798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.611999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.612098 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.612315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.612513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.612682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.612783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.612995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.613095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.613310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.613440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.613710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.613812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.614059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.614232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.614386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.614551 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.614697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.614885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.615027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.615219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.615347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.615530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.615669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.615839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.615974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.616153 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.616291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.616491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.616664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.616796 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.616980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.617121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.617292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.617430 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.617606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.617745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.617920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.618059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.618234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.618373 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.618564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.618684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.618878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.618979 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.619192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.619305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.619509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.619600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.619831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.619984 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.620160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.620274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.620520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.620625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.620835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.647018 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.647332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.647520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.647692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.647854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.649227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.649380 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.649539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.649828 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.650129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.650309 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.650553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.651671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.652036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.652312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.652592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.652758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.652972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.653108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.653235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126071) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:34:17.653360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.653360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.653360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.653360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.653360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.653360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.653360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.653360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.654480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.654480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.654480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.654480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.654480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.654480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.654480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.654480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.655698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.655698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.655698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.655698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.655698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.655698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.655698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.655698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.656696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.656696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.656696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.656696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.656696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.656696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.656696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.656696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.657771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.657771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.657771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.657771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.657771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.657771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.657771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.657771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.658763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.658763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.658763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.658763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.658763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.658763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.658763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.658763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.659676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.659676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.659676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.659676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.659676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.659676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.659676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.659676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.660758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.660758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.660758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.660758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.660758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.660758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.660758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.661574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.661574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.661574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.661574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.661574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.661574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.661574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.662424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.662424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.662424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.662424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.662424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.662424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.662424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.662424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.663510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.663510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.663510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.663510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.663510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.663510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.663510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.663510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.665253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.665253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.665253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.665253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.665253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.665253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.665253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.665253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.666333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.666333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.666333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.666333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.666333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.666333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.666333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.666333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.667482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.667482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.667482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.667482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.667482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.667482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.667482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.667482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.668444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.668444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.668444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.668444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.668444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.668444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.668444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.669257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.669257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.669257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.669614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.669883 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.670194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.670499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.670820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.671114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.671420 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.671728 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.672036 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.672384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.672677 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.672991 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.673298 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.673611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.673935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.674745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.675076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.675645 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.676125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.676715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.677200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.677602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.677942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.678268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.678585 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.678945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.679272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.679839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.680180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.680537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.681067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.681414 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.681561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.681888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.682375 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.682760 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.683069 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.683443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.683973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.684299 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.684694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.684959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.685296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.685706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.686116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.686343 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.686757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.687154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.687485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.687854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.688182 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.688663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.688899 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.689222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.689547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.689873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.690192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.690509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.690826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.691172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.691461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.691830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.692151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.692483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.692920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.693237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.693564 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.693889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.694204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.694531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.694858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.695172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.695496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.695811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.696224 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.696508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.696647 n-d-826756-3 devstack@n-api.service[126071]: INFO dbcounter [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] Registered counter for database nova_api Jul 28 03:34:17.696843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.697172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.697487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.697795 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.698104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.698418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.698807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.699056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.699365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.699673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.699986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.700295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.700625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.700934 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.701280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.701550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.701853 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.702161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.702468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.702775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.703082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.703388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.703698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.704005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.704310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.704644 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.704952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.705261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.705593 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.705907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] os_brick.lock_path = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.706273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.capabilities = [21] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.706534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.group = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.706945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.helper_command = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.707311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.707732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.thread_pool_size = 4 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.708116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] privsep_osbrick.user = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.708477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.708827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.709279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.709436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.709794 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.710115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.710442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.710769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.711091 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.711406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.712800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.712800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.712800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.712800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.713654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.713654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.713654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.714213 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.714213 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.714590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.714829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.715140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.715488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.715782 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.716096 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.716453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.716774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.717064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.717396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.717777 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.717996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.718164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_db.sqlalchemy.engines [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:34:17.718342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.718622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.718988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.719251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.719571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.719902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.720233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.720569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.720900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.721227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.721583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.721898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.722256 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.722585 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.722903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.723254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.723907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:34:17.724155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:34:17.725742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writer thread running {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:34:17.784476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.context [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8b3e198-f422-4bf1-ae6c-bd38905d4b84(cell1) {{(pid=126071) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:34:17.786517 n-d-826756-3 devstack@n-api.service[126072]: INFO dbcounter [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] Registered counter for database nova_api Jul 28 03:34:17.788751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:34:17.790373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:34:17.791172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:34:17.793213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:34:17.795277 n-d-826756-3 devstack@n-api.service[126071]: INFO dbcounter [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] Registered counter for database nova_cell0 Jul 28 03:34:17.799393 n-d-826756-3 devstack@n-api.service[126071]: INFO dbcounter [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] Registered counter for database nova_cell1 Jul 28 03:34:17.807559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_db.sqlalchemy.engines [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:34:17.809613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_db.sqlalchemy.engines [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:34:17.810709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_db.sqlalchemy.engines [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:34:17.815530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writer thread running {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:34:17.819867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writer thread running {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:34:17.820219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writer thread running {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:34:17.875222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.context [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8b3e198-f422-4bf1-ae6c-bd38905d4b84(cell1) {{(pid=126072) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:34:17.879610 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:34:17.881753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:34:17.882684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:34:17.884823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:34:17.886932 n-d-826756-3 devstack@n-api.service[126072]: INFO dbcounter [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] Registered counter for database nova_cell0 Jul 28 03:34:17.890968 n-d-826756-3 devstack@n-api.service[126072]: INFO dbcounter [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] Registered counter for database nova_cell1 Jul 28 03:34:17.899781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_db.sqlalchemy.engines [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:34:17.900924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_db.sqlalchemy.engines [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:34:17.907922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writer thread running {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:34:17.909237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writer thread running {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:34:17.971711 n-d-826756-3 devstack@n-api.service[126071]: INFO dbcounter [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] Registered counter for database nova_cell0 Jul 28 03:34:17.979251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_db.sqlalchemy.engines [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126071) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:34:17.984116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writer thread running {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:34:18.060216 n-d-826756-3 devstack@n-api.service[126072]: INFO dbcounter [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] Registered counter for database nova_cell0 Jul 28 03:34:18.069267 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_db.sqlalchemy.engines [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:34:18.074491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writer thread running {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:34:18.308840 n-d-826756-3 devstack@n-api.service[126071]: WARNING keystonemiddleware.auth_token [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:34:18.316395 n-d-826756-3 devstack@n-api.service[126071]: WARNING keystonemiddleware.auth_token [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:34:18.394222 n-d-826756-3 devstack@n-api.service[126072]: WARNING keystonemiddleware.auth_token [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:34:18.401977 n-d-826756-3 devstack@n-api.service[126072]: WARNING keystonemiddleware.auth_token [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:34:18.661716 n-d-826756-3 devstack@n-api.service[126071]: WARNING keystonemiddleware.auth_token [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:34:18.667808 n-d-826756-3 devstack@n-api.service[126071]: WARNING keystonemiddleware.auth_token [None req-26efe5c9-817e-4e4c-8fee-2bdc90f3cb3b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:34:18.673990 n-d-826756-3 devstack@n-api.service[126071]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aa8710c9c0 pid: 126071 (default app) Jul 28 03:34:18.750381 n-d-826756-3 devstack@n-api.service[126072]: WARNING keystonemiddleware.auth_token [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:34:18.757136 n-d-826756-3 devstack@n-api.service[126072]: WARNING keystonemiddleware.auth_token [None req-31cc8962-0783-4ea5-bbd0-c983b8607610 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:34:18.763456 n-d-826756-3 devstack@n-api.service[126072]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aa8710c9c0 pid: 126072 (default app) Jul 28 03:35:02.836335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:02.838159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:02.839332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:02.840074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:04.091107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9fde486-b5fd-44f0-9e3a-fc51b6f2b942 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Calling method '.version_select at 0x7ffa76fc9040>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:04.092643 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:04.092643 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:04.101346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9fde486-b5fd-44f0-9e3a-fc51b6f2b942 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8b3e198-f422-4bf1-ae6c-bd38905d4b84(cell1) {{(pid=126071) load_cells /opt/stack/nova/nova/compute/api.py:307}} Jul 28 03:35:04.102430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9fde486-b5fd-44f0-9e3a-fc51b6f2b942 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:04.102898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9fde486-b5fd-44f0-9e3a-fc51b6f2b942 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:04.131121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9fde486-b5fd-44f0-9e3a-fc51b6f2b942 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:04.131611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9fde486-b5fd-44f0-9e3a-fc51b6f2b942 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:04.149037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9fde486-b5fd-44f0-9e3a-fc51b6f2b942 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:04.149478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9fde486-b5fd-44f0-9e3a-fc51b6f2b942 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:04.155782 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9fde486-b5fd-44f0-9e3a-fc51b6f2b942 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.330002 Jul 28 03:35:04.163045 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1/1] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:04.173043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:04.174656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:04.175685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:04.177239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:04.400881 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c62f7655-acda-4975-93c9-c80f2f924e72 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Calling method '.version_select at 0x7ffa77002b80>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:04.402528 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:04.402528 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:04.412580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c62f7655-acda-4975-93c9-c80f2f924e72 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a8b3e198-f422-4bf1-ae6c-bd38905d4b84(cell1) {{(pid=126072) load_cells /opt/stack/nova/nova/compute/api.py:307}} Jul 28 03:35:04.413409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c62f7655-acda-4975-93c9-c80f2f924e72 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:04.413846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c62f7655-acda-4975-93c9-c80f2f924e72 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:04.449008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c62f7655-acda-4975-93c9-c80f2f924e72 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:04.449466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c62f7655-acda-4975-93c9-c80f2f924e72 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:04.488024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c62f7655-acda-4975-93c9-c80f2f924e72 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:04.488510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c62f7655-acda-4975-93c9-c80f2f924e72 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:04.497212 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c62f7655-acda-4975-93c9-c80f2f924e72 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h1-826756-3/servers" status: 200 len: 104 microversion: 2.1 time: 0.331588 Jul 28 03:35:04.498699 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1/2] 10.222.0.48 () {58 vars in 1212 bytes} [Thu Jul 28 03:35:04 2022] GET /compute/v2.1/os-hypervisors/n-h1-826756-3/servers => generated 104 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:04.510368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8db2c391-07e2-49b0-a830-0234531171df tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Calling method '.version_select at 0x7ffa76f885e0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:04.511340 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:04.511340 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:04.512575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8db2c391-07e2-49b0-a830-0234531171df tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:04.512981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8db2c391-07e2-49b0-a830-0234531171df tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:04.527703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8db2c391-07e2-49b0-a830-0234531171df tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:04.528148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8db2c391-07e2-49b0-a830-0234531171df tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:04.542850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8db2c391-07e2-49b0-a830-0234531171df tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:04.543436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8db2c391-07e2-49b0-a830-0234531171df tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:04.549622 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8db2c391-07e2-49b0-a830-0234531171df tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043469 Jul 28 03:35:04.550647 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:04.560637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a86cbe8f-802c-4bc2-9480-7df107c9cf06 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Calling method '.version_select at 0x7ffa76f46d30>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:04.561441 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:04.561441 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:04.562606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a86cbe8f-802c-4bc2-9480-7df107c9cf06 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:04.563211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a86cbe8f-802c-4bc2-9480-7df107c9cf06 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:04.576004 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a86cbe8f-802c-4bc2-9480-7df107c9cf06 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:04.576594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a86cbe8f-802c-4bc2-9480-7df107c9cf06 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:04.582644 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a86cbe8f-802c-4bc2-9480-7df107c9cf06 tempest-HypervisorAdminUnderV252Test-1154866201 tempest-HypervisorAdminUnderV252Test-1154866201-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h1-826756-3/search" status: 200 len: 104 microversion: 2.1 time: 0.025718 Jul 28 03:35:04.583316 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1209 bytes} [Thu Jul 28 03:35:04 2022] GET /compute/v2.1/os-hypervisors/n-h1-826756-3/search => generated 104 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:05.196518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6ae69159-6e46-41de-a664-a91e1def92a9 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '.version_select at 0x7ffa76eeb790>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:05.197413 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:05.197413 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:05.207120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ae69159-6e46-41de-a664-a91e1def92a9 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:05.207120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ae69159-6e46-41de-a664-a91e1def92a9 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:05.215285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ae69159-6e46-41de-a664-a91e1def92a9 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:05.215728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ae69159-6e46-41de-a664-a91e1def92a9 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:05.226677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ae69159-6e46-41de-a664-a91e1def92a9 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:05.227092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ae69159-6e46-41de-a664-a91e1def92a9 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:05.233324 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6ae69159-6e46-41de-a664-a91e1def92a9 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.588481 Jul 28 03:35:05.234063 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3/5] 10.222.0.48 () {58 vars in 1167 bytes} [Thu Jul 28 03:35:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:05.253613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-12d9a938-3afc-4147-b667-ff74f718440b tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-170876827", "name": "tempest-test_aggregate-1428806320"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:05.292666 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:05.292666 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:05.302861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.aggregate [None req-12d9a938-3afc-4147-b667-ff74f718440b tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Generated uuid 3f8d1790-f12d-4773-8de2-b6d30be0adec for aggregate {{(pid=126072) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:05.383273 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-12d9a938-3afc-4147-b667-ff74f718440b tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.134385 Jul 28 03:35:05.384962 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 3/6] 10.222.0.48 () {60 vars in 1165 bytes} [Thu Jul 28 03:35:05 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:35:05.396765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-378aa80b-34f0-4957-a7f2-d59449bc5008 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:05.397930 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:05.397930 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:05.415400 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-378aa80b-34f0-4957-a7f2-d59449bc5008 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.022157 Jul 28 03:35:05.415400 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1143 bytes} [Thu Jul 28 03:35:05 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:35:05.429987 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-293ebe54-e40d-4525-968c-73b58323fa1f tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-3"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:05.432752 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:05.432752 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:05.441093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-293ebe54-e40d-4525-968c-73b58323fa1f tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:05.441736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-293ebe54-e40d-4525-968c-73b58323fa1f tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:05.800738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-09f77259-0757-4971-a7c5-01cf0df17767 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:05.804990 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:05.804990 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:05.806563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09f77259-0757-4971-a7c5-01cf0df17767 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:05.806889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09f77259-0757-4971-a7c5-01cf0df17767 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:05.807680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09f77259-0757-4971-a7c5-01cf0df17767 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:05.808079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09f77259-0757-4971-a7c5-01cf0df17767 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:05.854962 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-09f77259-0757-4971-a7c5-01cf0df17767 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 401 microversion: 2.1 time: 0.533380 Jul 28 03:35:05.856755 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1176 bytes} [Thu Jul 28 03:35:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 401 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:06.004422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7fdc1afd-75d6-4bfe-84c9-392a7c264f2a tempest-AZAdminV2TestJSON-1765924309 tempest-AZAdminV2TestJSON-1765924309-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:06.006095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fdc1afd-75d6-4bfe-84c9-392a7c264f2a tempest-AZAdminV2TestJSON-1765924309 tempest-AZAdminV2TestJSON-1765924309-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:06.006533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fdc1afd-75d6-4bfe-84c9-392a7c264f2a tempest-AZAdminV2TestJSON-1765924309 tempest-AZAdminV2TestJSON-1765924309-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:06.007330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fdc1afd-75d6-4bfe-84c9-392a7c264f2a tempest-AZAdminV2TestJSON-1765924309 tempest-AZAdminV2TestJSON-1765924309-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:06.007743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fdc1afd-75d6-4bfe-84c9-392a7c264f2a tempest-AZAdminV2TestJSON-1765924309 tempest-AZAdminV2TestJSON-1765924309-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:06.036321 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7fdc1afd-75d6-4bfe-84c9-392a7c264f2a tempest-AZAdminV2TestJSON-1765924309 tempest-AZAdminV2TestJSON-1765924309-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone" status: 200 len: 189 microversion: 2.1 time: 0.174706 Jul 28 03:35:06.037650 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5/9] 10.222.0.48 () {58 vars in 1164 bytes} [Thu Jul 28 03:35:05 2022] GET /compute/v2.1/os-availability-zone => generated 189 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:06.103707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-154423e3-9a2f-4594-88e1-7c5072f09c5e tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Calling method '.version_select at 0x7ffa778005e0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:06.106389 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:06.106389 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:06.107889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-154423e3-9a2f-4594-88e1-7c5072f09c5e tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:06.108525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-154423e3-9a2f-4594-88e1-7c5072f09c5e tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:06.130618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-154423e3-9a2f-4594-88e1-7c5072f09c5e tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:06.131603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-154423e3-9a2f-4594-88e1-7c5072f09c5e tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:06.144616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-154423e3-9a2f-4594-88e1-7c5072f09c5e tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:06.145235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-154423e3-9a2f-4594-88e1-7c5072f09c5e tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:06.152382 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-154423e3-9a2f-4594-88e1-7c5072f09c5e tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.113455 Jul 28 03:35:06.153423 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 6/10] 10.222.0.48 () {60 vars in 1208 bytes} [Thu Jul 28 03:35:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:35:06.231622 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-293ebe54-e40d-4525-968c-73b58323fa1f tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.1 time: 0.802963 Jul 28 03:35:06.237079 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 5/11] 10.222.0.48 () {60 vars in 1191 bytes} [Thu Jul 28 03:35:05 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:35:06.376429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e7156a3c-a0e6-4a88-b8e1-191984f38dfe tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2002745749", "id": 1257795394, "os-flavor-access:is_public": "False"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:06.405418 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:06.405418 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:06.447518 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e7156a3c-a0e6-4a88-b8e1-191984f38dfe tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.292801 Jul 28 03:35:06.456516 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 7/12] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:35:06 2022] POST /compute/v2.1/flavors => generated 431 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:06.456516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-27982b12-50f8-48be-93dc-03e96a310311 tempest-AZAdminV2TestJSON-1765924309 tempest-AZAdminV2TestJSON-1765924309-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:06.456516 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:06.456516 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:06.456516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27982b12-50f8-48be-93dc-03e96a310311 tempest-AZAdminV2TestJSON-1765924309 tempest-AZAdminV2TestJSON-1765924309-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:06.457305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27982b12-50f8-48be-93dc-03e96a310311 tempest-AZAdminV2TestJSON-1765924309 tempest-AZAdminV2TestJSON-1765924309-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:06.457305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27982b12-50f8-48be-93dc-03e96a310311 tempest-AZAdminV2TestJSON-1765924309 tempest-AZAdminV2TestJSON-1765924309-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:06.457508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27982b12-50f8-48be-93dc-03e96a310311 tempest-AZAdminV2TestJSON-1765924309 tempest-AZAdminV2TestJSON-1765924309-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:06.482540 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-27982b12-50f8-48be-93dc-03e96a310311 tempest-AZAdminV2TestJSON-1765924309 tempest-AZAdminV2TestJSON-1765924309-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 700 microversion: 2.1 time: 0.032800 Jul 28 03:35:06.483151 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 8/13] 10.222.0.48 () {58 vars in 1185 bytes} [Thu Jul 28 03:35:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 700 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:06.555153 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-523884e5-67cd-4d2a-9bca-d3c9263f270b tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Calling method '.version_select at 0x7ffa75541ca0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:06.558977 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:06.558977 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:06.560510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-523884e5-67cd-4d2a-9bca-d3c9263f270b tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:06.561101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-523884e5-67cd-4d2a-9bca-d3c9263f270b tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:06.582239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-523884e5-67cd-4d2a-9bca-d3c9263f270b tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:06.582837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-523884e5-67cd-4d2a-9bca-d3c9263f270b tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:06.595588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-523884e5-67cd-4d2a-9bca-d3c9263f270b tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:06.596196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-523884e5-67cd-4d2a-9bca-d3c9263f270b tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:06.609440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-523884e5-67cd-4d2a-9bca-d3c9263f270b tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:06.610055 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-523884e5-67cd-4d2a-9bca-d3c9263f270b tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:06.622056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-523884e5-67cd-4d2a-9bca-d3c9263f270b tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:06.622496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-523884e5-67cd-4d2a-9bca-d3c9263f270b tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:06.628636 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-523884e5-67cd-4d2a-9bca-d3c9263f270b tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1571 microversion: 2.53 time: 0.390221 Jul 28 03:35:06.629224 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 6/14] 10.222.0.48 () {60 vars in 1243 bytes} [Thu Jul 28 03:35:06 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1571 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:35:06.719954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc587d8e-a50a-4190-9a31-a5dd28026507 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2092612499", "id": 1480907571, "os-flavor-access:is_public": "False"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:06.723416 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:06.723416 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:06.744387 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc587d8e-a50a-4190-9a31-a5dd28026507 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.259981 Jul 28 03:35:06.744965 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 9/15] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:35:06 2022] POST /compute/v2.1/flavors => generated 439 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:06.749381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f0448cb0-3abc-4900-9a31-98e72ccbe144 tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0d118f5ee1fb492cab25c878b62024a6"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:06.752848 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:06.752848 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:07.082173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1901979536", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "availability_zone": "tempest-test_az-170876827"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:07.121339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:07.121785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:07.122711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:07.123268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:07.192077 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f0448cb0-3abc-4900-9a31-98e72ccbe144 tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1257795394/action" status: 200 len: 97 microversion: 2.1 time: 0.446044 Jul 28 03:35:07.192833 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 10/16] 10.222.0.48 () {60 vars in 1200 bytes} [Thu Jul 28 03:35:06 2022] POST /compute/v2.1/flavors/1257795394/action => generated 97 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:35:07.200074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15e2b674-0710-41c3-a83c-794304f09f0c tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Calling method '.version_select at 0x7ffa76e59e50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:07.202943 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:07.202943 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:07.204136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e2b674-0710-41c3-a83c-794304f09f0c tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:07.204777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e2b674-0710-41c3-a83c-794304f09f0c tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:07.221003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e2b674-0710-41c3-a83c-794304f09f0c tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:07.222235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e2b674-0710-41c3-a83c-794304f09f0c tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:07.261204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e2b674-0710-41c3-a83c-794304f09f0c tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:07.261840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e2b674-0710-41c3-a83c-794304f09f0c tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:07.276636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e2b674-0710-41c3-a83c-794304f09f0c tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:07.277354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e2b674-0710-41c3-a83c-794304f09f0c tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:07.293887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e2b674-0710-41c3-a83c-794304f09f0c tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:07.294730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e2b674-0710-41c3-a83c-794304f09f0c tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:07.302583 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15e2b674-0710-41c3-a83c-794304f09f0c tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 265 microversion: 2.53 time: 0.108703 Jul 28 03:35:07.309886 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 11/17] 10.222.0.48 () {60 vars in 1222 bytes} [Thu Jul 28 03:35:07 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 265 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:35:07.314376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c3dce4db-f594-42b1-a2cd-2d2fb8a57d4e tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "529ff36f6af64266b9eea870c808319d"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:07.317674 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:07.317674 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:07.555357 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c3dce4db-f594-42b1-a2cd-2d2fb8a57d4e tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1480907571/action" status: 200 len: 97 microversion: 2.1 time: 0.245504 Jul 28 03:35:07.555971 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 12/18] 10.222.0.48 () {60 vars in 1200 bytes} [Thu Jul 28 03:35:07 2022] POST /compute/v2.1/flavors/1480907571/action => generated 97 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:35:07.633059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:35:07.680729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e293d26f-8129-46cc-8950-55ca095be50e tempest-FlavorsAccessTestJSON-782730978 tempest-FlavorsAccessTestJSON-782730978-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:07.716036 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e293d26f-8129-46cc-8950-55ca095be50e tempest-FlavorsAccessTestJSON-782730978 tempest-FlavorsAccessTestJSON-782730978-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.158876 Jul 28 03:35:07.716866 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 13/19] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:07 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:07.723097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ee71c54a-b075-41af-8e4f-7384e23be7da tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Calling method '.version_select at 0x7ffa76d828b0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:07.725846 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:07.725846 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:07.727100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee71c54a-b075-41af-8e4f-7384e23be7da tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:07.727544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee71c54a-b075-41af-8e4f-7384e23be7da tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:07.747000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee71c54a-b075-41af-8e4f-7384e23be7da tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:07.747449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee71c54a-b075-41af-8e4f-7384e23be7da tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:07.754190 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ee71c54a-b075-41af-8e4f-7384e23be7da tempest-HypervisorAdminV253TestBase-1250269203 tempest-HypervisorAdminV253TestBase-1250269203-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/2ebc1bcb-db7c-44bb-9679-1ffe92db0563" status: 200 len: 791 microversion: 2.53 time: 0.036184 Jul 28 03:35:07.766978 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 14/20] 10.222.0.48 () {60 vars in 1298 bytes} [Thu Jul 28 03:35:07 2022] GET /compute/v2.1/os-hypervisors/2ebc1bcb-db7c-44bb-9679-1ffe92db0563 => generated 791 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:35:07.773673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-547e7620-30b5-4812-8f7a-5d20fcc1d3c4 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "529ff36f6af64266b9eea870c808319d"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:07.775427 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:07.775427 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:08.110331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:35:08.110560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:35:08.111079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:35:08.111670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:35:08.112313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:35:08.135253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:08.136843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:08.138772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:08.139424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:08.179889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Getting quotas for project ca65d6c53c5846c8903fdb9b5de86168. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:35:08.190850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Getting quotas for user 4338dd1a28ac4bb9a75c143f57e74f2e and project ca65d6c53c5846c8903fdb9b5de86168. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:35:08.205921 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:35:08.210425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:35:08.241039 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-547e7620-30b5-4812-8f7a-5d20fcc1d3c4 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 529ff36f6af64266b9eea870c808319d combination. Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-547e7620-30b5-4812-8f7a-5d20fcc1d3c4 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Request method failure captured: Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/flavors/1480907571/action HTTP/1.1 Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 67 Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPoxe_7vn_48hgeP5fMeUuXSBjSKIW-fUrukCves72ORxDC5wmr0nY3RW2t0c3cyPvnHWqt7UJxji55ZjpbPth4Bbk3pOx8iYJI3j_70ujTS0eXHc-J-Lp-GTPW-NLU3WWhsCi_Oad0o7uw8imE9YQvxZIMuz5K-oahCUffDsczgoU Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 06de38a1cf3d4d05a25a1e3d4b9d5ee1 Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1175530009 Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:35:08.260827 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:35:08.262252 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06de38a1cf3d4d05a25a1e3d4b9d5ee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06de38a1cf3d4d05a25a1e3d4b9d5ee1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06de38a1cf3d4d05a25a1e3d4b9d5ee1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06de38a1cf3d4d05a25a1e3d4b9d5ee1"}]}] Jul 28 03:35:08.262252 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1175530009 Jul 28 03:35:08.262252 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 06de38a1cf3d4d05a25a1e3d4b9d5ee1 Jul 28 03:35:08.262252 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1175530009 Jul 28 03:35:08.262252 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin Jul 28 03:35:08.262252 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:08.262252 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:08.262252 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24f793807a5f466d8ad33805d32443c7 Jul 28 03:35:08.262252 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin Jul 28 03:35:08.262252 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:35:08.262252 n-d-826756-3 devstack@n-api.service[126071]: {"addTenantAccess": {"tenant": "529ff36f6af64266b9eea870c808319d"}} Jul 28 03:35:08.262252 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: exception: Flavor access already exists for flavor 16 and project 529ff36f6af64266b9eea870c808319d combination. Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1480907571', 'body': {'addTenantAccess': {'tenant': '529ff36f6af64266b9eea870c808319d'}}} Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result.read() Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 03:35:08.262991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-529ff36f6af64266b9eea870c808319d' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi session.flush() Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 03:35:08.264085 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 03:35:08.265696 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 03:35:08.267207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result.read() Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-529ff36f6af64266b9eea870c808319d' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 28, 3, 35, 8, 233770), 'updated_at': None, 'flavor_id': 16, 'project_id': '529ff36f6af64266b9eea870c808319d'}] Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:08.268340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 529ff36f6af64266b9eea870c808319d combination. Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:08.269405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 529ff36f6af64266b9eea870c808319d combination. Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:08.272806 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:08.274126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 529ff36f6af64266b9eea870c808319d combination. Jul 28 03:35:08.274126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:08.283314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-547e7620-30b5-4812-8f7a-5d20fcc1d3c4 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 529ff36f6af64266b9eea870c808319d combination. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:08.287862 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-547e7620-30b5-4812-8f7a-5d20fcc1d3c4 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1480907571/action" status: 409 len: 152 microversion: 2.1 time: 0.516758 Jul 28 03:35:08.293233 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 15/21] 10.222.0.48 () {60 vars in 1200 bytes} [Thu Jul 28 03:35:07 2022] POST /compute/v2.1/flavors/1480907571/action => generated 152 bytes in 525 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:35:08.296076 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bd9c76aa-056f-48ce-8551-6596f2355785 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.665591 Jul 28 03:35:08.299086 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 7/22] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:35:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:35:08.305590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abd80192-5858-476a-8400-a031ffc96ee6 tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0d118f5ee1fb492cab25c878b62024a6"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:08.310972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ee63622b-4a50-4083-b2a9-abaa79fef0c8 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "529ff36f6af64266b9eea870c808319d"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:08.311343 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:08.311343 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:08.313623 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:08.313623 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:08.630638 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ee63622b-4a50-4083-b2a9-abaa79fef0c8 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1480907571/action" status: 200 len: 21 microversion: 2.1 time: 0.330019 Jul 28 03:35:08.638791 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 8/23] 10.222.0.48 () {60 vars in 1200 bytes} [Thu Jul 28 03:35:08 2022] POST /compute/v2.1/flavors/1480907571/action => generated 21 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:35:08.645901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fa1237d0-c644-46a9-84a4-6caf6b7e97e5 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:08.646860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fa1237d0-c644-46a9-84a4-6caf6b7e97e5 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:08.766963 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-abd80192-5858-476a-8400-a031ffc96ee6 tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1257795394/action" status: 200 len: 21 microversion: 2.1 time: 0.472191 Jul 28 03:35:08.769053 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 16/24] 10.222.0.48 () {60 vars in 1200 bytes} [Thu Jul 28 03:35:08 2022] POST /compute/v2.1/flavors/1257795394/action => generated 21 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:35:08.775249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e3cbebe5-30a3-4de7-8bab-3dfc7801c09f tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:08.776586 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:08.776586 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:08.783476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fa1237d0-c644-46a9-84a4-6caf6b7e97e5 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:08.804003 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fa1237d0-c644-46a9-84a4-6caf6b7e97e5 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1242 microversion: 2.1 time: 0.163315 Jul 28 03:35:08.805616 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 9/25] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:08 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:08.809087 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e3cbebe5-30a3-4de7-8bab-3dfc7801c09f tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1480907571" status: 202 len: 0 microversion: 2.1 time: 0.038701 Jul 28 03:35:08.810088 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 17/26] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:35:08 2022] DELETE /compute/v2.1/flavors/1480907571 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:35:08.810759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-29bc92a8-34db-46fe-a618-5a174e55b0d1 tempest-FlavorsAccessTestJSON-782730978 tempest-FlavorsAccessTestJSON-782730978-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:08.829358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97e1d709-8d28-4a9f-9d22-09802b92a383 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:08.845005 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-29bc92a8-34db-46fe-a618-5a174e55b0d1 tempest-FlavorsAccessTestJSON-782730978 tempest-FlavorsAccessTestJSON-782730978-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038070 Jul 28 03:35:08.845970 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 10/27] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:08.865686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4ee6bdf7-af3c-4ca3-bb2f-28041092ba53 tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:08.866716 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:08.866716 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:08.874156 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-97e1d709-8d28-4a9f-9d22-09802b92a383 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054048 Jul 28 03:35:08.874756 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 18/28] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:08.893984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1e7bc923-9b0b-4cf3-a931-7d7b8258d0cd tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1070773394", "id": 945611655, "os-flavor-access:is_public": "True"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:08.896766 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:08.896766 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:08.921201 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1e7bc923-9b0b-4cf3-a931-7d7b8258d0cd tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.030992 Jul 28 03:35:08.922155 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4ee6bdf7-af3c-4ca3-bb2f-28041092ba53 tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1257795394" status: 202 len: 0 microversion: 2.1 time: 0.060054 Jul 28 03:35:08.922955 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 11/29] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:35:08 2022] DELETE /compute/v2.1/flavors/1257795394 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:35:08.929603 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 19/30] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:35:08 2022] POST /compute/v2.1/flavors => generated 435 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:35:08.932228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a75ea3e1-b0c8-4c23-bdeb-7acfa1be01e9 tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:08.934800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-563b2561-da4f-408e-be9f-1e2b61b90085 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:08.935693 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:08.935693 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:08.942984 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-563b2561-da4f-408e-be9f-1e2b61b90085 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-563b2561-da4f-408e-be9f-1e2b61b90085 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Request method failure captured: Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/flavors/945611655/os-flavor-access HTTP/1.1 Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPoxe_7vn_48hgeP5fMeUuXSBjSKIW-fUrukCves72ORxDC5wmr0nY3RW2t0c3cyPvnHWqt7UJxji55ZjpbPth4Bbk3pOx8iYJI3j_70ujTS0eXHc-J-Lp-GTPW-NLU3WWhsCi_Oad0o7uw8imE9YQvxZIMuz5K-oahCUffDsczgoU Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 06de38a1cf3d4d05a25a1e3d4b9d5ee1 Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1175530009 Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:35:08.944430 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:35:08.945557 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06de38a1cf3d4d05a25a1e3d4b9d5ee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06de38a1cf3d4d05a25a1e3d4b9d5ee1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06de38a1cf3d4d05a25a1e3d4b9d5ee1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06de38a1cf3d4d05a25a1e3d4b9d5ee1"}]}] Jul 28 03:35:08.945557 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1175530009 Jul 28 03:35:08.945557 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 06de38a1cf3d4d05a25a1e3d4b9d5ee1 Jul 28 03:35:08.945557 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1175530009 Jul 28 03:35:08.945557 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin Jul 28 03:35:08.945557 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:08.945557 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:08.945557 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24f793807a5f466d8ad33805d32443c7 Jul 28 03:35:08.945557 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin Jul 28 03:35:08.945557 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:35:08.945557 n-d-826756-3 devstack@n-api.service[126071]: exception: Access list not available for public flavors. Jul 28 03:35:08.945557 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'flavor_id': '945611655'} Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 28 03:35:08.946187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:08.947193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-563b2561-da4f-408e-be9f-1e2b61b90085 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:08.947193 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-563b2561-da4f-408e-be9f-1e2b61b90085 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/945611655/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.015350 Jul 28 03:35:08.947193 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 20/31] 10.222.0.48 () {58 vars in 1206 bytes} [Thu Jul 28 03:35:08 2022] GET /compute/v2.1/flavors/945611655/os-flavor-access => generated 91 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:35:08.954571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6b3a463b-4262-4981-a29d-f4bd36f71db5 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:08.967745 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a75ea3e1-b0c8-4c23-bdeb-7acfa1be01e9 tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5416 microversion: 2.1 time: 0.040249 Jul 28 03:35:08.968340 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 12/32] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:08 2022] GET /compute/v2.1/flavors/detail => generated 5416 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:35:08.977698 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6b3a463b-4262-4981-a29d-f4bd36f71db5 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/945611655" status: 202 len: 0 microversion: 2.1 time: 0.026366 Jul 28 03:35:08.978206 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 21/33] 10.222.0.48 () {58 vars in 1158 bytes} [Thu Jul 28 03:35:08 2022] DELETE /compute/v2.1/flavors/945611655 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:35:08.988926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-49ba69fb-8d40-4a5c-adb8-a718a6cef76e tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:08.990516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1e98352a-1685-49b2-b0ca-b9dd0fa47a82 tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1907780499", "id": 1913374955, "os-flavor-access:is_public": "False"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:09.014984 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-49ba69fb-8d40-4a5c-adb8-a718a6cef76e tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031893 Jul 28 03:35:09.015895 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 13/34] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:09.016906 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1e98352a-1685-49b2-b0ca-b9dd0fa47a82 tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.031507 Jul 28 03:35:09.017647 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 22/35] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:35:08 2022] POST /compute/v2.1/flavors => generated 431 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:09.029011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d8f204ac-c339-424a-8188-ef07cd843fdb tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:09.029993 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:09.029993 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:09.043300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fab89da1-c040-4f50-a9b6-cc63e0495620 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-741955575", "id": 1879348684, "os-flavor-access:is_public": "False"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:09.049606 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d8f204ac-c339-424a-8188-ef07cd843fdb tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1913374955/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.024455 Jul 28 03:35:09.056032 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 14/36] 10.222.0.48 () {58 vars in 1209 bytes} [Thu Jul 28 03:35:09 2022] GET /compute/v2.1/flavors/1913374955/os-flavor-access => generated 21 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:35:09.056314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:DELETE=7 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:09.061406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4709740a-aaa7-49af-a329-1110087d8dcd tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:09.076907 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fab89da1-c040-4f50-a9b6-cc63e0495620 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.038728 Jul 28 03:35:09.078038 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 23/37] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:35:09 2022] POST /compute/v2.1/flavors => generated 438 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:35:09.083223 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4709740a-aaa7-49af-a329-1110087d8dcd tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1913374955" status: 202 len: 0 microversion: 2.1 time: 0.025679 Jul 28 03:35:09.084062 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 15/38] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:35:09 2022] DELETE /compute/v2.1/flavors/1913374955 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:35:09.093668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0d1d7814-42a1-4488-81eb-144f0dd214c9 tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:09.114297 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0d1d7814-42a1-4488-81eb-144f0dd214c9 tempest-FlavorsAccessTestJSON-1799953541 tempest-FlavorsAccessTestJSON-1799953541-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024608 Jul 28 03:35:09.114885 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 16/39] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:09.468951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-accf407f-6abb-4811-a37f-78253352327f tempest-FlavorsAccessNegativeTestJSON-507037772 tempest-FlavorsAccessNegativeTestJSON-507037772-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "529ff36f6af64266b9eea870c808319d"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:09.472312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-accf407f-6abb-4811-a37f-78253352327f tempest-FlavorsAccessNegativeTestJSON-507037772 tempest-FlavorsAccessNegativeTestJSON-507037772-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'cfb0e2fefae948f2b74645c46b0c5cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ff36f6af64266b9eea870c808319d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-accf407f-6abb-4811-a37f-78253352327f tempest-FlavorsAccessNegativeTestJSON-507037772 tempest-FlavorsAccessNegativeTestJSON-507037772-project] Request method failure captured: Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/flavors/1879348684/action HTTP/1.1 Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 67 Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPmYzk_D-eEpacrglW8z1VKW1RCwto7UxjBMv6nYvy4SFDjbY8WMQ8tDCRR73vBa5U-u6JYAF4LVLlQqfO8GRBn93YCb8chtQpig3Gxbbrn2aR6X-Wk6QIe0Nh3Yg5_ZJVGSwTTGEOK0StrP8bN5wJKVBrMVUUha8U-MuxavKUZf1g Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 529ff36f6af64266b9eea870c808319d Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-507037772 Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:35:09.475878 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:35:09.477274 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/529ff36f6af64266b9eea870c808319d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/529ff36f6af64266b9eea870c808319d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_529ff36f6af64266b9eea870c808319d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/529ff36f6af64266b9eea870c808319d"}]}] Jul 28 03:35:09.477274 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-507037772 Jul 28 03:35:09.477274 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 529ff36f6af64266b9eea870c808319d Jul 28 03:35:09.477274 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-507037772 Jul 28 03:35:09.477274 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FlavorsAccessNegativeTestJSON-507037772-project Jul 28 03:35:09.477274 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:09.477274 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:09.477274 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: cfb0e2fefae948f2b74645c46b0c5cce Jul 28 03:35:09.477274 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-507037772-project Jul 28 03:35:09.477274 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:35:09.477274 n-d-826756-3 devstack@n-api.service[126071]: {"addTenantAccess": {"tenant": "529ff36f6af64266b9eea870c808319d"}} Jul 28 03:35:09.477274 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1879348684', 'body': {'addTenantAccess': {'tenant': '529ff36f6af64266b9eea870c808319d'}}} Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:09.478026 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 28 03:35:09.479165 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:09.480339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-accf407f-6abb-4811-a37f-78253352327f tempest-FlavorsAccessNegativeTestJSON-507037772 tempest-FlavorsAccessNegativeTestJSON-507037772-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:09.480339 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-accf407f-6abb-4811-a37f-78253352327f tempest-FlavorsAccessNegativeTestJSON-507037772 tempest-FlavorsAccessNegativeTestJSON-507037772-project] 10.222.0.48 "POST /compute/v2.1/flavors/1879348684/action" status: 403 len: 130 microversion: 2.1 time: 0.389331 Jul 28 03:35:09.480339 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 24/40] 10.222.0.48 () {60 vars in 1200 bytes} [Thu Jul 28 03:35:09 2022] POST /compute/v2.1/flavors/1879348684/action => generated 130 bytes in 390 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:09.488085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-02eb5176-4e16-4967-8c19-d74c58abb0d2 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:09.502760 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:DELETE=10 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:09.511013 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-02eb5176-4e16-4967-8c19-d74c58abb0d2 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1879348684" status: 202 len: 0 microversion: 2.1 time: 0.026747 Jul 28 03:35:09.511787 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 17/41] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:35:09 2022] DELETE /compute/v2.1/flavors/1879348684 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:35:09.521216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3931d1a-a663-404d-b070-f367f5ce66bc tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:09.544812 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d3931d1a-a663-404d-b070-f367f5ce66bc tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027344 Jul 28 03:35:09.545818 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 25/42] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:09.565587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7d49fc95-f791-4abd-85e1-c107a16bb1f8 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-58854336", "id": 186005145, "os-flavor-access:is_public": "False"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:09.569348 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:09.569348 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:09.590198 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7d49fc95-f791-4abd-85e1-c107a16bb1f8 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.028327 Jul 28 03:35:09.592443 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 18/43] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:35:09 2022] POST /compute/v2.1/flavors => generated 434 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:09.603273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4cc4215e-6b09-4da9-bcf7-1a6718a77bd9 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "529ff36f6af64266b9eea870c808319d"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:09.825464 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-546019c0-f4cd-4055-b519-7ee9a61b5c58 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:09.826067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-546019c0-f4cd-4055-b519-7ee9a61b5c58 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:09.910360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-546019c0-f4cd-4055-b519-7ee9a61b5c58 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:09.919265 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-546019c0-f4cd-4055-b519-7ee9a61b5c58 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1242 microversion: 2.1 time: 0.097786 Jul 28 03:35:09.920463 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 19/44] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:09 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:35:10.086809 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4cc4215e-6b09-4da9-bcf7-1a6718a77bd9 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/186005145/action" status: 200 len: 96 microversion: 2.1 time: 0.487514 Jul 28 03:35:10.087748 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 26/45] 10.222.0.48 () {60 vars in 1197 bytes} [Thu Jul 28 03:35:09 2022] POST /compute/v2.1/flavors/186005145/action => generated 96 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:35:10.103445 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1fe3b6ef-27fa-4978-966f-3c025144846e tempest-FlavorsAccessNegativeTestJSON-507037772 tempest-FlavorsAccessNegativeTestJSON-507037772-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "529ff36f6af64266b9eea870c808319d"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:10.107109 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:10.107109 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:10.109291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1fe3b6ef-27fa-4978-966f-3c025144846e tempest-FlavorsAccessNegativeTestJSON-507037772 tempest-FlavorsAccessNegativeTestJSON-507037772-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'cfb0e2fefae948f2b74645c46b0c5cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529ff36f6af64266b9eea870c808319d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1fe3b6ef-27fa-4978-966f-3c025144846e tempest-FlavorsAccessNegativeTestJSON-507037772 tempest-FlavorsAccessNegativeTestJSON-507037772-project] Request method failure captured: Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/flavors/186005145/action HTTP/1.1 Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 70 Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gPmYzk_D-eEpacrglW8z1VKW1RCwto7UxjBMv6nYvy4SFDjbY8WMQ8tDCRR73vBa5U-u6JYAF4LVLlQqfO8GRBn93YCb8chtQpig3Gxbbrn2aR6X-Wk6QIe0Nh3Yg5_ZJVGSwTTGEOK0StrP8bN5wJKVBrMVUUha8U-MuxavKUZf1g Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 529ff36f6af64266b9eea870c808319d Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-507037772 Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:35:10.119042 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:35:10.120487 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/529ff36f6af64266b9eea870c808319d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/529ff36f6af64266b9eea870c808319d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_529ff36f6af64266b9eea870c808319d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/529ff36f6af64266b9eea870c808319d"}]}] Jul 28 03:35:10.120487 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-507037772 Jul 28 03:35:10.120487 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 529ff36f6af64266b9eea870c808319d Jul 28 03:35:10.120487 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-507037772 Jul 28 03:35:10.120487 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-FlavorsAccessNegativeTestJSON-507037772-project Jul 28 03:35:10.120487 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:10.120487 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:10.120487 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: cfb0e2fefae948f2b74645c46b0c5cce Jul 28 03:35:10.120487 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-507037772-project Jul 28 03:35:10.120487 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:35:10.120487 n-d-826756-3 devstack@n-api.service[126072]: {"removeTenantAccess": {"tenant": "529ff36f6af64266b9eea870c808319d"}} Jul 28 03:35:10.120487 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '186005145', 'body': {'removeTenantAccess': {'tenant': '529ff36f6af64266b9eea870c808319d'}}} Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can( Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:10.121540 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 28 03:35:10.122544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:10.123584 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1fe3b6ef-27fa-4978-966f-3c025144846e tempest-FlavorsAccessNegativeTestJSON-507037772 tempest-FlavorsAccessNegativeTestJSON-507037772-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:10.123584 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1fe3b6ef-27fa-4978-966f-3c025144846e tempest-FlavorsAccessNegativeTestJSON-507037772 tempest-FlavorsAccessNegativeTestJSON-507037772-project] 10.222.0.48 "POST /compute/v2.1/flavors/186005145/action" status: 403 len: 133 microversion: 2.1 time: 0.026271 Jul 28 03:35:10.123584 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 20/46] 10.222.0.48 () {60 vars in 1197 bytes} [Thu Jul 28 03:35:10 2022] POST /compute/v2.1/flavors/186005145/action => generated 133 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:10.132452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c5231c86-effe-4271-b943-fcd3d4ed193e tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "529ff36f6af64266b9eea870c808319d"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:10.685586 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c5231c86-effe-4271-b943-fcd3d4ed193e tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/186005145/action" status: 200 len: 21 microversion: 2.1 time: 0.557003 Jul 28 03:35:10.686354 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 27/47] 10.222.0.48 () {60 vars in 1197 bytes} [Thu Jul 28 03:35:10 2022] POST /compute/v2.1/flavors/186005145/action => generated 21 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:35:10.696088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2b1ad98b-07d4-4377-b725-c7b99862f875 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:10.716580 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2b1ad98b-07d4-4377-b725-c7b99862f875 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/186005145" status: 202 len: 0 microversion: 2.1 time: 0.023771 Jul 28 03:35:10.717372 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 28/48] 10.222.0.48 () {58 vars in 1158 bytes} [Thu Jul 28 03:35:10 2022] DELETE /compute/v2.1/flavors/186005145 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:35:10.726852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1ab8fbf1-340a-464b-8c5f-b73920ceed19 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:10.747025 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1ab8fbf1-340a-464b-8c5f-b73920ceed19 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023649 Jul 28 03:35:10.747609 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 29/49] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:35:10.768561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ffd7fad8-b28a-4946-a855-cf861a8d3658 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-794418404", "id": 1924038663, "os-flavor-access:is_public": "False"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:10.796964 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ffd7fad8-b28a-4946-a855-cf861a8d3658 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.033155 Jul 28 03:35:10.808651 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 30/50] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:35:10 2022] POST /compute/v2.1/flavors => generated 438 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 28 03:35:10.820920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59ea1dbf-b2c3-4c88-962b-7fd1ebee86dd tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3db0f943ab964efa9c8fba336b22d171"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:11.005299 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-831e59a2-b705-40bd-9d8e-cc6cf83487f7 tempest-HypervisorAdminV228Test-806812756 tempest-HypervisorAdminV228Test-806812756-project-admin] Calling method '.version_select at 0x7ffa776e5e50>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:11.008011 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:11.008011 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:11.009299 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-831e59a2-b705-40bd-9d8e-cc6cf83487f7 tempest-HypervisorAdminV228Test-806812756 tempest-HypervisorAdminV228Test-806812756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:11.009750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-831e59a2-b705-40bd-9d8e-cc6cf83487f7 tempest-HypervisorAdminV228Test-806812756 tempest-HypervisorAdminV228Test-806812756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:11.050417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-831e59a2-b705-40bd-9d8e-cc6cf83487f7 tempest-HypervisorAdminV228Test-806812756 tempest-HypervisorAdminV228Test-806812756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:11.051016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-831e59a2-b705-40bd-9d8e-cc6cf83487f7 tempest-HypervisorAdminV228Test-806812756 tempest-HypervisorAdminV228Test-806812756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:11.068856 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-831e59a2-b705-40bd-9d8e-cc6cf83487f7 tempest-HypervisorAdminV228Test-806812756 tempest-HypervisorAdminV228Test-806812756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:11.069307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-831e59a2-b705-40bd-9d8e-cc6cf83487f7 tempest-HypervisorAdminV228Test-806812756 tempest-HypervisorAdminV228Test-806812756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:11.076932 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-831e59a2-b705-40bd-9d8e-cc6cf83487f7 tempest-HypervisorAdminV228Test-806812756 tempest-HypervisorAdminV228Test-806812756-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.402399 Jul 28 03:35:11.077559 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 21/51] 10.222.0.48 () {60 vars in 1187 bytes} [Thu Jul 28 03:35:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:35:11.082692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f49a7e5b-54eb-4065-9ae2-353f6d2f2c8c tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:11.083873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f49a7e5b-54eb-4065-9ae2-353f6d2f2c8c tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:11.093975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f49a7e5b-54eb-4065-9ae2-353f6d2f2c8c tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:11.094422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f49a7e5b-54eb-4065-9ae2-353f6d2f2c8c tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:11.095199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f49a7e5b-54eb-4065-9ae2-353f6d2f2c8c tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:11.095636 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f49a7e5b-54eb-4065-9ae2-353f6d2f2c8c tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:11.402264 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-59ea1dbf-b2c3-4c88-962b-7fd1ebee86dd tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] HTTP exception thrown: Flavor access not found for 21 / 3db0f943ab964efa9c8fba336b22d171 combination. Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59ea1dbf-b2c3-4c88-962b-7fd1ebee86dd tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Request method failure captured: Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/flavors/1924038663/action HTTP/1.1 Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 70 Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPoxe_7vn_48hgeP5fMeUuXSBjSKIW-fUrukCves72ORxDC5wmr0nY3RW2t0c3cyPvnHWqt7UJxji55ZjpbPth4Bbk3pOx8iYJI3j_70ujTS0eXHc-J-Lp-GTPW-NLU3WWhsCi_Oad0o7uw8imE9YQvxZIMuz5K-oahCUffDsczgoU Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 06de38a1cf3d4d05a25a1e3d4b9d5ee1 Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1175530009 Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:35:11.404622 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:35:11.405921 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/06de38a1cf3d4d05a25a1e3d4b9d5ee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06de38a1cf3d4d05a25a1e3d4b9d5ee1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_06de38a1cf3d4d05a25a1e3d4b9d5ee1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/06de38a1cf3d4d05a25a1e3d4b9d5ee1"}]}] Jul 28 03:35:11.405921 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1175530009 Jul 28 03:35:11.405921 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 06de38a1cf3d4d05a25a1e3d4b9d5ee1 Jul 28 03:35:11.405921 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1175530009 Jul 28 03:35:11.405921 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin Jul 28 03:35:11.405921 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:11.405921 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:11.405921 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24f793807a5f466d8ad33805d32443c7 Jul 28 03:35:11.405921 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin Jul 28 03:35:11.405921 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:35:11.405921 n-d-826756-3 devstack@n-api.service[126071]: {"removeTenantAccess": {"tenant": "3db0f943ab964efa9c8fba336b22d171"}} Jul 28 03:35:11.405921 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: exception: Flavor access not found for 21 / 3db0f943ab964efa9c8fba336b22d171 combination. Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1924038663', 'body': {'removeTenantAccess': {'tenant': '3db0f943ab964efa9c8fba336b22d171'}}} Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 28 03:35:11.406521 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 21 / 3db0f943ab964efa9c8fba336b22d171 combination. Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 21 / 3db0f943ab964efa9c8fba336b22d171 combination. Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:11.407400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:11.408402 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:11.408402 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:11.408402 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:11.408402 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:11.408402 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 21 / 3db0f943ab964efa9c8fba336b22d171 combination. Jul 28 03:35:11.408402 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:11.410187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59ea1dbf-b2c3-4c88-962b-7fd1ebee86dd tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Returning 404 to user: Flavor access not found for 21 / 3db0f943ab964efa9c8fba336b22d171 combination. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:11.414952 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59ea1dbf-b2c3-4c88-962b-7fd1ebee86dd tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1924038663/action" status: 404 len: 124 microversion: 2.1 time: 0.597385 Jul 28 03:35:11.423783 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 31/52] 10.222.0.48 () {60 vars in 1200 bytes} [Thu Jul 28 03:35:10 2022] POST /compute/v2.1/flavors/1924038663/action => generated 124 bytes in 607 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:35:11.429777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0fd815ab-2b31-4cf7-8162-f30de19394f8 tempest-HypervisorAdminV228Test-806812756 tempest-HypervisorAdminV228Test-806812756-project-admin] Calling method '.version_select at 0x7ffa76b3ee50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:11.430864 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:11.430864 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:11.435302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fd815ab-2b31-4cf7-8162-f30de19394f8 tempest-HypervisorAdminV228Test-806812756 tempest-HypervisorAdminV228Test-806812756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:11.436025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fd815ab-2b31-4cf7-8162-f30de19394f8 tempest-HypervisorAdminV228Test-806812756 tempest-HypervisorAdminV228Test-806812756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:11.450562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f49a7e5b-54eb-4065-9ae2-353f6d2f2c8c tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:11.458170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fd815ab-2b31-4cf7-8162-f30de19394f8 tempest-HypervisorAdminV228Test-806812756 tempest-HypervisorAdminV228Test-806812756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:11.458938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fd815ab-2b31-4cf7-8162-f30de19394f8 tempest-HypervisorAdminV228Test-806812756 tempest-HypervisorAdminV228Test-806812756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:11.466153 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0fd815ab-2b31-4cf7-8162-f30de19394f8 tempest-HypervisorAdminV228Test-806812756 tempest-HypervisorAdminV228Test-806812756-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.040958 Jul 28 03:35:11.467375 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 32/53] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 28 03:35:11 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:35:11.472103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ef99cebc-f0d0-45b8-84f9-60ea2a3390a5 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:11.473517 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:11.473517 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:11.481692 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f49a7e5b-54eb-4065-9ae2-353f6d2f2c8c tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1296 microversion: 2.1 time: 0.401047 Jul 28 03:35:11.482322 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 22/54] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:11 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1296 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:11.494780 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ef99cebc-f0d0-45b8-84f9-60ea2a3390a5 tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1924038663" status: 202 len: 0 microversion: 2.1 time: 0.025862 Jul 28 03:35:11.495782 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 33/55] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:35:11 2022] DELETE /compute/v2.1/flavors/1924038663 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:35:11.507272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7df4a9a5-7873-43ff-8e93-b8ee9f9779ca tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:11.543900 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7df4a9a5-7873-43ff-8e93-b8ee9f9779ca tempest-FlavorsAccessNegativeTestJSON-1175530009 tempest-FlavorsAccessNegativeTestJSON-1175530009-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042894 Jul 28 03:35:11.544748 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 23/56] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:12.503098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c84d6671-71cb-44bf-af6c-bf7d0dd3b690 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:12.503845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c84d6671-71cb-44bf-af6c-bf7d0dd3b690 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:12.551816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c84d6671-71cb-44bf-af6c-bf7d0dd3b690 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:12.552336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c84d6671-71cb-44bf-af6c-bf7d0dd3b690 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:12.564188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c84d6671-71cb-44bf-af6c-bf7d0dd3b690 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:12.569599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c84d6671-71cb-44bf-af6c-bf7d0dd3b690 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:14.886069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c84d6671-71cb-44bf-af6c-bf7d0dd3b690 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:14.928783 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c84d6671-71cb-44bf-af6c-bf7d0dd3b690 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1338 microversion: 2.1 time: 2.429714 Jul 28 03:35:14.953492 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 34/57] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:12 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1338 bytes in 2455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:15.587385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-55e52941-9f6c-4bd6-8a44-9b7fc4de16af tempest-AZAdminNegativeTestJSON-1035750979 tempest-AZAdminNegativeTestJSON-1035750979-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:15.588107 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:15.588107 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:15.589311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-55e52941-9f6c-4bd6-8a44-9b7fc4de16af tempest-AZAdminNegativeTestJSON-1035750979 tempest-AZAdminNegativeTestJSON-1035750979-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '858890caef3d4317a75033ac87dc1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9f8a36cfaf8477a9d06d8dce757fb63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-55e52941-9f6c-4bd6-8a44-9b7fc4de16af tempest-AZAdminNegativeTestJSON-1035750979 tempest-AZAdminNegativeTestJSON-1035750979-project] Request method failure captured: Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gPvy6Ez3PyxDGHfgKYMVcJRq1LvErycfZS6FtRh_1SsAJLm4Mv7_LoPFk6w_7cNeu7kur8FW0AMRFY-ddseDgnUVb7u0kd8puiiCYnW7YUIa4FXCUSKn1HSnQxrX7nj2yXdRemek2jz1UQnlOiaKK4RPuYbtRyoZo58jUEGIsSk-mU Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: f9f8a36cfaf8477a9d06d8dce757fb63 Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1035750979 Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:35:15.591588 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:35:15.592963 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9f8a36cfaf8477a9d06d8dce757fb63"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9f8a36cfaf8477a9d06d8dce757fb63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9f8a36cfaf8477a9d06d8dce757fb63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9f8a36cfaf8477a9d06d8dce757fb63"}]}] Jul 28 03:35:15.592963 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AZAdminNegativeTestJSON-1035750979 Jul 28 03:35:15.592963 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: f9f8a36cfaf8477a9d06d8dce757fb63 Jul 28 03:35:15.592963 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1035750979 Jul 28 03:35:15.592963 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AZAdminNegativeTestJSON-1035750979-project Jul 28 03:35:15.592963 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:15.592963 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:15.592963 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 858890caef3d4317a75033ac87dc1475 Jul 28 03:35:15.592963 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AZAdminNegativeTestJSON-1035750979-project Jul 28 03:35:15.592963 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:35:15.592963 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 28 03:35:15.592963 n-d-826756-3 devstack@n-api.service[126072]: action_args: {} Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:15.594034 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:15.595238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-55e52941-9f6c-4bd6-8a44-9b7fc4de16af tempest-AZAdminNegativeTestJSON-1035750979 tempest-AZAdminNegativeTestJSON-1035750979-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:15.596193 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-55e52941-9f6c-4bd6-8a44-9b7fc4de16af tempest-AZAdminNegativeTestJSON-1035750979 tempest-AZAdminNegativeTestJSON-1035750979-project] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.963097 Jul 28 03:35:15.596193 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 24/58] 10.222.0.48 () {58 vars in 1185 bytes} [Thu Jul 28 03:35:14 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 965 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:35:15.959771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bac34e60-3fa2-4938-87cb-efb30000a91d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:15.960724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bac34e60-3fa2-4938-87cb-efb30000a91d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:16.000254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bac34e60-3fa2-4938-87cb-efb30000a91d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:16.000943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bac34e60-3fa2-4938-87cb-efb30000a91d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:16.002632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bac34e60-3fa2-4938-87cb-efb30000a91d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:16.005346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bac34e60-3fa2-4938-87cb-efb30000a91d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:16.314134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bac34e60-3fa2-4938-87cb-efb30000a91d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:16.328430 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bac34e60-3fa2-4938-87cb-efb30000a91d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1338 microversion: 2.1 time: 0.370498 Jul 28 03:35:16.348151 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 35/59] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:15 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1338 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:16.466202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:17.005064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-45c6c620-985d-45a3-a6c4-0d3017e2897f req-20b8f0d2-381b-4f17-bdd3-6f89f85bd6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bf11ab4-3b13-4117-8ba1-7c0b07894e8c", "tag": "b399c7ad-618d-44ee-99a1-588947b24810"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:17.041358 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-45c6c620-985d-45a3-a6c4-0d3017e2897f req-20b8f0d2-381b-4f17-bdd3-6f89f85bd6a5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:17.041801 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-45c6c620-985d-45a3-a6c4-0d3017e2897f req-20b8f0d2-381b-4f17-bdd3-6f89f85bd6a5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:17.107148 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-45c6c620-985d-45a3-a6c4-0d3017e2897f req-20b8f0d2-381b-4f17-bdd3-6f89f85bd6a5 service nova] Creating event network-changed:b399c7ad-618d-44ee-99a1-588947b24810 for instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c on n-h1-826756-3 Jul 28 03:35:17.109157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-45c6c620-985d-45a3-a6c4-0d3017e2897f req-20b8f0d2-381b-4f17-bdd3-6f89f85bd6a5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 03:35:17.113415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2522c88a-fd6d-4d2d-884b-f4236a4ffeb1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:17.117147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2522c88a-fd6d-4d2d-884b-f4236a4ffeb1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:17.121273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2522c88a-fd6d-4d2d-884b-f4236a4ffeb1 None None] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:17.122786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2522c88a-fd6d-4d2d-884b-f4236a4ffeb1 None None] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:17.149388 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.compute.rpcapi [None req-2522c88a-fd6d-4d2d-884b-f4236a4ffeb1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 03:35:17.155220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2522c88a-fd6d-4d2d-884b-f4236a4ffeb1 None None] Releasing lock "compute-rpcapi-router" {{(pid=126072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 03:35:17.212745 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2522c88a-fd6d-4d2d-884b-f4236a4ffeb1 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.082069 Jul 28 03:35:17.213859 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 25/60] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:35:17.356809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-307de06e-ffd5-40dd-a3e4-bb77df3742b1 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:17.357813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-307de06e-ffd5-40dd-a3e4-bb77df3742b1 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:17.371187 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-307de06e-ffd5-40dd-a3e4-bb77df3742b1 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:17.376866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-307de06e-ffd5-40dd-a3e4-bb77df3742b1 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:17.378089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a369b440-79bd-4b72-9377-59a69971f1e8 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Calling method '.version_select at 0x7ffa76b6d5e0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:17.379056 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:17.379056 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:17.379444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-307de06e-ffd5-40dd-a3e4-bb77df3742b1 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:17.380102 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-307de06e-ffd5-40dd-a3e4-bb77df3742b1 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:17.380314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a369b440-79bd-4b72-9377-59a69971f1e8 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:17.382824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a369b440-79bd-4b72-9377-59a69971f1e8 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:17.425973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a369b440-79bd-4b72-9377-59a69971f1e8 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:17.426423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a369b440-79bd-4b72-9377-59a69971f1e8 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:17.463566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a369b440-79bd-4b72-9377-59a69971f1e8 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:17.464263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a369b440-79bd-4b72-9377-59a69971f1e8 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:17.473494 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a369b440-79bd-4b72-9377-59a69971f1e8 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.084943 Jul 28 03:35:17.478385 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 36/61] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:35:18.206073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f36bcef8-8646-4fb7-a344-550f6645215d tempest-HypervisorAdminNegativeUnderV252Test-1231857518 tempest-HypervisorAdminNegativeUnderV252Test-1231857518-project] Calling method '.version_select at 0x7ffa76a96160>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:18.208072 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:18.208072 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:18.210127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f36bcef8-8646-4fb7-a344-550f6645215d tempest-HypervisorAdminNegativeUnderV252Test-1231857518 tempest-HypervisorAdminNegativeUnderV252Test-1231857518-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '76101493d52044aab0b358da7dd4ce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a3ae4b6c864fe3a85ce7dad0721bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f36bcef8-8646-4fb7-a344-550f6645215d tempest-HypervisorAdminNegativeUnderV252Test-1231857518 tempest-HypervisorAdminNegativeUnderV252Test-1231857518-project] Request method failure captured: Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-hypervisors/n-h1-826756-3/search HTTP/1.1 Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPw79ysJj2Qc5uG1Tkt8hU8DlopK_GHzXktaDz7q6rb8yzjNUQi01y1V7358HcDyVZyzetOC317rg6OHsLCq1Vf7SOQlF9qY7JitubwHQaKL59czu0BTd_agKsPIsEzXa3S1ZDmcvESTII7tJYn3WqJlP7QPRrMxH_Y5mSc-ggC-0g Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 38a3ae4b6c864fe3a85ce7dad0721bfe Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1231857518 Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:35:18.213840 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:35:18.215249 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/38a3ae4b6c864fe3a85ce7dad0721bfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/38a3ae4b6c864fe3a85ce7dad0721bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_38a3ae4b6c864fe3a85ce7dad0721bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/38a3ae4b6c864fe3a85ce7dad0721bfe"}]}] Jul 28 03:35:18.215249 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1231857518 Jul 28 03:35:18.215249 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 38a3ae4b6c864fe3a85ce7dad0721bfe Jul 28 03:35:18.215249 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1231857518 Jul 28 03:35:18.215249 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1231857518-project Jul 28 03:35:18.215249 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:18.215249 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:18.215249 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 76101493d52044aab0b358da7dd4ce10 Jul 28 03:35:18.215249 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1231857518-project Jul 28 03:35:18.215249 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:35:18.215249 n-d-826756-3 devstack@n-api.service[126071]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 28 03:35:18.215249 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'n-h1-826756-3'} Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:18.215979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 28 03:35:18.217406 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:18.224201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f36bcef8-8646-4fb7-a344-550f6645215d tempest-HypervisorAdminNegativeUnderV252Test-1231857518 tempest-HypervisorAdminNegativeUnderV252Test-1231857518-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:18.225900 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f36bcef8-8646-4fb7-a344-550f6645215d tempest-HypervisorAdminNegativeUnderV252Test-1231857518 tempest-HypervisorAdminNegativeUnderV252Test-1231857518-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/n-h1-826756-3/search" status: 403 len: 117 microversion: 2.1 time: 0.740920 Jul 28 03:35:18.228423 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 37/62] 10.222.0.48 () {58 vars in 1209 bytes} [Thu Jul 28 03:35:17 2022] GET /compute/v2.1/os-hypervisors/n-h1-826756-3/search => generated 117 bytes in 745 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:18.258690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15669d0e-9f17-4f73-9254-3cbf07658596 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Calling method '.version_select at 0x7ffa76a45040>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:18.263783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15669d0e-9f17-4f73-9254-3cbf07658596 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:18.264206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15669d0e-9f17-4f73-9254-3cbf07658596 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:18.309975 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-15669d0e-9f17-4f73-9254-3cbf07658596 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15669d0e-9f17-4f73-9254-3cbf07658596 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Request method failure captured: Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gP0hMLa5tgKKhifF5hxozDNQ6cz1zlhsEm3kj_JbvQykZuuAu35Tg3WOpyOyefmq2H9KA642zlDfNPlYEL96Veb6jMFzf469nOaBD3gj_FmVwWT0KdNMiiCEXcWrJ-eJ1EriksRD7e7t0s1XVZfj8-V5VjwAk6mE4BDuHSIbLQnA8M Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: fcfbc35e14bc4b4eb0abf796fa5bd04b Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1313780092 Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:35:18.318197 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:35:18.319836 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fcfbc35e14bc4b4eb0abf796fa5bd04b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fcfbc35e14bc4b4eb0abf796fa5bd04b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fcfbc35e14bc4b4eb0abf796fa5bd04b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fcfbc35e14bc4b4eb0abf796fa5bd04b"}]}] Jul 28 03:35:18.319836 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1313780092 Jul 28 03:35:18.319836 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: fcfbc35e14bc4b4eb0abf796fa5bd04b Jul 28 03:35:18.319836 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1313780092 Jul 28 03:35:18.319836 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin Jul 28 03:35:18.319836 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:18.319836 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:18.319836 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: f2f784b64ed44e0287b6bf529ee492a6 Jul 28 03:35:18.319836 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin Jul 28 03:35:18.319836 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:35:18.319836 n-d-826756-3 devstack@n-api.service[126071]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 28 03:35:18.319836 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:18.320710 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:18.321976 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:18.321976 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:18.321976 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:18.321976 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 28 03:35:18.321976 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:18.323058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15669d0e-9f17-4f73-9254-3cbf07658596 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:18.333883 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15669d0e-9f17-4f73-9254-3cbf07658596 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.099787 Jul 28 03:35:18.335259 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 38/63] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 03:35:18 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:18.343722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-815efdf7-1403-4295-ae22-6bc4264c6b2c tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Calling method '.version_select at 0x7ffa76a968b0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:18.349449 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:18.349449 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:18.351405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-815efdf7-1403-4295-ae22-6bc4264c6b2c tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:18.355624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-815efdf7-1403-4295-ae22-6bc4264c6b2c tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:18.411313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-815efdf7-1403-4295-ae22-6bc4264c6b2c tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:18.421573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-815efdf7-1403-4295-ae22-6bc4264c6b2c tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:18.463896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-815efdf7-1403-4295-ae22-6bc4264c6b2c tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:18.464648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-815efdf7-1403-4295-ae22-6bc4264c6b2c tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:18.488800 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-815efdf7-1403-4295-ae22-6bc4264c6b2c tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.148156 Jul 28 03:35:18.493863 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 39/64] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:18.511365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d772b66-5d9e-4402-9fb3-0f2d2ea4835c tempest-HypervisorAdminNegativeUnderV252Test-1231857518 tempest-HypervisorAdminNegativeUnderV252Test-1231857518-project] Calling method '.version_select at 0x7ffa76b63b80>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:18.517310 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:18.517310 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:18.522544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7d772b66-5d9e-4402-9fb3-0f2d2ea4835c tempest-HypervisorAdminNegativeUnderV252Test-1231857518 tempest-HypervisorAdminNegativeUnderV252Test-1231857518-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '76101493d52044aab0b358da7dd4ce10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38a3ae4b6c864fe3a85ce7dad0721bfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d772b66-5d9e-4402-9fb3-0f2d2ea4835c tempest-HypervisorAdminNegativeUnderV252Test-1231857518 tempest-HypervisorAdminNegativeUnderV252Test-1231857518-project] Request method failure captured: Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPw79ysJj2Qc5uG1Tkt8hU8DlopK_GHzXktaDz7q6rb8yzjNUQi01y1V7358HcDyVZyzetOC317rg6OHsLCq1Vf7SOQlF9qY7JitubwHQaKL59czu0BTd_agKsPIsEzXa3S1ZDmcvESTII7tJYn3WqJlP7QPRrMxH_Y5mSc-ggC-0g Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 38a3ae4b6c864fe3a85ce7dad0721bfe Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1231857518 Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:35:18.524603 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:35:18.525698 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/38a3ae4b6c864fe3a85ce7dad0721bfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/38a3ae4b6c864fe3a85ce7dad0721bfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_38a3ae4b6c864fe3a85ce7dad0721bfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/38a3ae4b6c864fe3a85ce7dad0721bfe"}]}] Jul 28 03:35:18.525698 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1231857518 Jul 28 03:35:18.525698 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 38a3ae4b6c864fe3a85ce7dad0721bfe Jul 28 03:35:18.525698 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1231857518 Jul 28 03:35:18.525698 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1231857518-project Jul 28 03:35:18.525698 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:18.525698 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:18.525698 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 76101493d52044aab0b358da7dd4ce10 Jul 28 03:35:18.525698 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1231857518-project Jul 28 03:35:18.525698 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:35:18.525698 n-d-826756-3 devstack@n-api.service[126071]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 28 03:35:18.525698 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1'} Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:18.526415 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 28 03:35:18.527349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:18.541450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d772b66-5d9e-4402-9fb3-0f2d2ea4835c tempest-HypervisorAdminNegativeUnderV252Test-1231857518 tempest-HypervisorAdminNegativeUnderV252Test-1231857518-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:18.543393 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d772b66-5d9e-4402-9fb3-0f2d2ea4835c tempest-HypervisorAdminNegativeUnderV252Test-1231857518 tempest-HypervisorAdminNegativeUnderV252Test-1231857518-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.042760 Jul 28 03:35:18.553151 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 40/65] 10.222.0.48 () {58 vars in 1176 bytes} [Thu Jul 28 03:35:18 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:35:18.562636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-960f679b-c4e0-42ae-b487-6e7cdaa46555 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Calling method '.version_select at 0x7ffa76a459d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:18.565334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-960f679b-c4e0-42ae-b487-6e7cdaa46555 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:18.569104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-960f679b-c4e0-42ae-b487-6e7cdaa46555 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:18.594025 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-960f679b-c4e0-42ae-b487-6e7cdaa46555 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] HTTP exception thrown: No hypervisor matching '6b985639-0d39-4689-86a4-97d2ef9ea85a' could be found. Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-960f679b-c4e0-42ae-b487-6e7cdaa46555 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Request method failure captured: Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-hypervisors/6b985639-0d39-4689-86a4-97d2ef9ea85a/servers HTTP/1.1 Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gP0hMLa5tgKKhifF5hxozDNQ6cz1zlhsEm3kj_JbvQykZuuAu35Tg3WOpyOyefmq2H9KA642zlDfNPlYEL96Veb6jMFzf469nOaBD3gj_FmVwWT0KdNMiiCEXcWrJ-eJ1EriksRD7e7t0s1XVZfj8-V5VjwAk6mE4BDuHSIbLQnA8M Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: fcfbc35e14bc4b4eb0abf796fa5bd04b Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1313780092 Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:35:18.595794 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:35:18.597094 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fcfbc35e14bc4b4eb0abf796fa5bd04b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fcfbc35e14bc4b4eb0abf796fa5bd04b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fcfbc35e14bc4b4eb0abf796fa5bd04b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fcfbc35e14bc4b4eb0abf796fa5bd04b"}]}] Jul 28 03:35:18.597094 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1313780092 Jul 28 03:35:18.597094 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: fcfbc35e14bc4b4eb0abf796fa5bd04b Jul 28 03:35:18.597094 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1313780092 Jul 28 03:35:18.597094 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin Jul 28 03:35:18.597094 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:18.597094 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:18.597094 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: f2f784b64ed44e0287b6bf529ee492a6 Jul 28 03:35:18.597094 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin Jul 28 03:35:18.597094 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:35:18.597094 n-d-826756-3 devstack@n-api.service[126071]: exception: No hypervisor matching '6b985639-0d39-4689-86a4-97d2ef9ea85a' could be found. Jul 28 03:35:18.597094 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '6b985639-0d39-4689-86a4-97d2ef9ea85a'} Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '6b985639-0d39-4689-86a4-97d2ef9ea85a' could be found. Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:18.598160 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:18.599093 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:18.599093 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:18.599093 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:18.599093 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:18.599093 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '6b985639-0d39-4689-86a4-97d2ef9ea85a' could be found. Jul 28 03:35:18.599093 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:18.609364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-960f679b-c4e0-42ae-b487-6e7cdaa46555 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] Returning 404 to user: No hypervisor matching '6b985639-0d39-4689-86a4-97d2ef9ea85a' could be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:18.610663 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-960f679b-c4e0-42ae-b487-6e7cdaa46555 tempest-HypervisorAdminNegativeUnderV252Test-1313780092 tempest-HypervisorAdminNegativeUnderV252Test-1313780092-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/6b985639-0d39-4689-86a4-97d2ef9ea85a/servers" status: 404 len: 123 microversion: 2.1 time: 0.051945 Jul 28 03:35:18.617189 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 41/66] 10.222.0.48 () {58 vars in 1281 bytes} [Thu Jul 28 03:35:18 2022] GET /compute/v2.1/os-hypervisors/6b985639-0d39-4689-86a4-97d2ef9ea85a/servers => generated 123 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:35:19.086963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-307de06e-ffd5-40dd-a3e4-bb77df3742b1 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:19.106541 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-307de06e-ffd5-40dd-a3e4-bb77df3742b1 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1338 microversion: 2.1 time: 1.752491 Jul 28 03:35:19.125284 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 26/67] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:17 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1338 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:35:20.155341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce2db0ca-fc21-4438-bacc-737220e9dab9 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:20.156045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ce2db0ca-fc21-4438-bacc-737220e9dab9 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:20.174647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce2db0ca-fc21-4438-bacc-737220e9dab9 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:20.175424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce2db0ca-fc21-4438-bacc-737220e9dab9 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:20.176538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce2db0ca-fc21-4438-bacc-737220e9dab9 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:20.177151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce2db0ca-fc21-4438-bacc-737220e9dab9 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:20.635877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ce2db0ca-fc21-4438-bacc-737220e9dab9 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:20.653774 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce2db0ca-fc21-4438-bacc-737220e9dab9 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1338 microversion: 2.1 time: 0.505501 Jul 28 03:35:20.655725 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 42/68] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:20 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1338 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:21.521814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=10 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:21.678693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ea468b8f-736d-4d2f-86cc-ab79c2166085 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:21.679366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ea468b8f-736d-4d2f-86cc-ab79c2166085 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:21.700912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea468b8f-736d-4d2f-86cc-ab79c2166085 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:21.704884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea468b8f-736d-4d2f-86cc-ab79c2166085 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:21.705898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea468b8f-736d-4d2f-86cc-ab79c2166085 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:21.709560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea468b8f-736d-4d2f-86cc-ab79c2166085 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:22.481512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b15d2ea2-d0b2-4095-bfbd-e8e791bd3bf1 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Calling method '.version_select at 0x7ffa7538e3a0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:22.482876 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:22.482876 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:22.485038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b15d2ea2-d0b2-4095-bfbd-e8e791bd3bf1 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '4ee071c335f148679eb44526c42de63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bc4266cbe74be5baa0887d4aeaaf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b15d2ea2-d0b2-4095-bfbd-e8e791bd3bf1 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Request method failure captured: Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gP2pKSKc2UNPRexe2_l0E91fAOFghOppSNNKw8ybYNQU8pzGKRs9qstd-vtDQgiBlfrRYxzVun4u35MZmPpaOWT8wKRHM7CEFDhuTCpfkiq5RD-NTgyrQn-CpN6oKwCaGcTArAxFX4YM5bPqz82RLVmKSuztjbXPjUSHmeiM9UXd7o Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: e4bc4266cbe74be5baa0887d4aeaaf82 Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:35:22.487130 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:35:22.488298 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e4bc4266cbe74be5baa0887d4aeaaf82"}]}] Jul 28 03:35:22.488298 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:22.488298 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: e4bc4266cbe74be5baa0887d4aeaaf82 Jul 28 03:35:22.488298 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:22.488298 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HypervisorAdminNegativeTestJSON-1037939622-project Jul 28 03:35:22.488298 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:22.488298 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:22.488298 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 4ee071c335f148679eb44526c42de63a Jul 28 03:35:22.488298 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622-project Jul 28 03:35:22.488298 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:35:22.488298 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 28 03:35:22.488298 n-d-826756-3 devstack@n-api.service[126072]: action_args: {} Jul 28 03:35:22.488298 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:22.489117 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 28 03:35:22.490277 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:22.492618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b15d2ea2-d0b2-4095-bfbd-e8e791bd3bf1 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:22.501135 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b15d2ea2-d0b2-4095-bfbd-e8e791bd3bf1 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.985122 Jul 28 03:35:22.504599 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 27/69] 10.222.0.48 () {58 vars in 1167 bytes} [Thu Jul 28 03:35:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 989 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:35:22.517891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-53d6efb8-3892-429e-9a58-824b701ee19d tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Calling method '.version_select at 0x7ffa7532adc0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:22.519611 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:22.519611 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:22.531469 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-53d6efb8-3892-429e-9a58-824b701ee19d tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '4ee071c335f148679eb44526c42de63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bc4266cbe74be5baa0887d4aeaaf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-53d6efb8-3892-429e-9a58-824b701ee19d tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Request method failure captured: Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gP2pKSKc2UNPRexe2_l0E91fAOFghOppSNNKw8ybYNQU8pzGKRs9qstd-vtDQgiBlfrRYxzVun4u35MZmPpaOWT8wKRHM7CEFDhuTCpfkiq5RD-NTgyrQn-CpN6oKwCaGcTArAxFX4YM5bPqz82RLVmKSuztjbXPjUSHmeiM9UXd7o Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: e4bc4266cbe74be5baa0887d4aeaaf82 Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:35:22.535747 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:35:22.537010 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e4bc4266cbe74be5baa0887d4aeaaf82"}]}] Jul 28 03:35:22.537010 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:22.537010 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: e4bc4266cbe74be5baa0887d4aeaaf82 Jul 28 03:35:22.537010 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:22.537010 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HypervisorAdminNegativeTestJSON-1037939622-project Jul 28 03:35:22.537010 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:22.537010 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:22.537010 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 4ee071c335f148679eb44526c42de63a Jul 28 03:35:22.537010 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622-project Jul 28 03:35:22.537010 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:35:22.537010 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 28 03:35:22.537010 n-d-826756-3 devstack@n-api.service[126072]: action_args: {} Jul 28 03:35:22.537010 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:22.537735 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 28 03:35:22.538723 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:22.545192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-53d6efb8-3892-429e-9a58-824b701ee19d tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:22.546063 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-53d6efb8-3892-429e-9a58-824b701ee19d tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.035543 Jul 28 03:35:22.550765 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 28/70] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:22 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:22.567434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-153156d5-3dbe-4a84-a1fc-4ac6805b7afa tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Calling method '.version_select at 0x7ffa752c1c10>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:22.570069 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:22.570069 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:22.574404 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-153156d5-3dbe-4a84-a1fc-4ac6805b7afa tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '4ee071c335f148679eb44526c42de63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bc4266cbe74be5baa0887d4aeaaf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-153156d5-3dbe-4a84-a1fc-4ac6805b7afa tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Request method failure captured: Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gP2pKSKc2UNPRexe2_l0E91fAOFghOppSNNKw8ybYNQU8pzGKRs9qstd-vtDQgiBlfrRYxzVun4u35MZmPpaOWT8wKRHM7CEFDhuTCpfkiq5RD-NTgyrQn-CpN6oKwCaGcTArAxFX4YM5bPqz82RLVmKSuztjbXPjUSHmeiM9UXd7o Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: e4bc4266cbe74be5baa0887d4aeaaf82 Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:35:22.579931 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:35:22.581337 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e4bc4266cbe74be5baa0887d4aeaaf82"}]}] Jul 28 03:35:22.581337 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:22.581337 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: e4bc4266cbe74be5baa0887d4aeaaf82 Jul 28 03:35:22.581337 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:22.581337 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HypervisorAdminNegativeTestJSON-1037939622-project Jul 28 03:35:22.581337 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:22.581337 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:22.581337 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 4ee071c335f148679eb44526c42de63a Jul 28 03:35:22.581337 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622-project Jul 28 03:35:22.581337 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:35:22.581337 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 28 03:35:22.581337 n-d-826756-3 devstack@n-api.service[126072]: action_args: {} Jul 28 03:35:22.581337 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:22.582209 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 28 03:35:22.583445 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:22.586849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-153156d5-3dbe-4a84-a1fc-4ac6805b7afa tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:22.589462 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-153156d5-3dbe-4a84-a1fc-4ac6805b7afa tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.032779 Jul 28 03:35:22.592313 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 29/71] 10.222.0.48 () {58 vars in 1179 bytes} [Thu Jul 28 03:35:22 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:35:22.843793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ea468b8f-736d-4d2f-86cc-ab79c2166085 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:22.855617 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ea468b8f-736d-4d2f-86cc-ab79c2166085 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1338 microversion: 2.1 time: 1.182289 Jul 28 03:35:22.859457 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 43/72] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:21 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1338 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:35:23.019636 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5d960d14-a1ca-49eb-9bc3-808c414b9442 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Calling method '.version_select at 0x7ffa75312160>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:23.021958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d960d14-a1ca-49eb-9bc3-808c414b9442 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:23.022644 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d960d14-a1ca-49eb-9bc3-808c414b9442 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:23.076000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d960d14-a1ca-49eb-9bc3-808c414b9442 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:23.076534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d960d14-a1ca-49eb-9bc3-808c414b9442 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:23.113702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d960d14-a1ca-49eb-9bc3-808c414b9442 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:23.115125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d960d14-a1ca-49eb-9bc3-808c414b9442 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:23.128118 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5d960d14-a1ca-49eb-9bc3-808c414b9442 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.526070 Jul 28 03:35:23.129518 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 30/73] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:23.145858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7c68f5e8-5b47-4d45-acdb-151465d53a20 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Calling method '.version_select at 0x7ffa753125e0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:23.147214 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:23.147214 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:23.148618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7c68f5e8-5b47-4d45-acdb-151465d53a20 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '4ee071c335f148679eb44526c42de63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bc4266cbe74be5baa0887d4aeaaf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7c68f5e8-5b47-4d45-acdb-151465d53a20 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Request method failure captured: Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gP2pKSKc2UNPRexe2_l0E91fAOFghOppSNNKw8ybYNQU8pzGKRs9qstd-vtDQgiBlfrRYxzVun4u35MZmPpaOWT8wKRHM7CEFDhuTCpfkiq5RD-NTgyrQn-CpN6oKwCaGcTArAxFX4YM5bPqz82RLVmKSuztjbXPjUSHmeiM9UXd7o Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: e4bc4266cbe74be5baa0887d4aeaaf82 Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:35:23.150665 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:35:23.151816 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e4bc4266cbe74be5baa0887d4aeaaf82"}]}] Jul 28 03:35:23.151816 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:23.151816 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: e4bc4266cbe74be5baa0887d4aeaaf82 Jul 28 03:35:23.151816 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:23.151816 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HypervisorAdminNegativeTestJSON-1037939622-project Jul 28 03:35:23.151816 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:23.151816 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:23.151816 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 4ee071c335f148679eb44526c42de63a Jul 28 03:35:23.151816 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622-project Jul 28 03:35:23.151816 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:35:23.151816 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 28 03:35:23.151816 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '1'} Jul 28 03:35:23.151816 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:23.152534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 28 03:35:23.158230 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.159303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7c68f5e8-5b47-4d45-acdb-151465d53a20 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:23.159303 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7c68f5e8-5b47-4d45-acdb-151465d53a20 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.011751 Jul 28 03:35:23.159930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d8dfa9d-7477-45fb-bf12-1f429bad1071 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Calling method '.version_select at 0x7ffa76a45820>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:23.160154 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 31/74] 10.222.0.48 () {58 vars in 1173 bytes} [Thu Jul 28 03:35:23 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:23.160374 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:23.160374 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:23.161710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d8dfa9d-7477-45fb-bf12-1f429bad1071 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:23.162742 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eddcefaa-46eb-47f5-9adb-75b8649bfc84 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Calling method '.version_select at 0x7ffa753eb430>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:23.162857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d8dfa9d-7477-45fb-bf12-1f429bad1071 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:23.164972 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-eddcefaa-46eb-47f5-9adb-75b8649bfc84 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] HTTP exception thrown: Hypervisor with ID 'f0a70857-ecd6-4b77-9f94-6c235ce56356' could not be found. Jul 28 03:35:23.168741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d8dfa9d-7477-45fb-bf12-1f429bad1071 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:23.169066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d8dfa9d-7477-45fb-bf12-1f429bad1071 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eddcefaa-46eb-47f5-9adb-75b8649bfc84 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Request method failure captured: Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-hypervisors/f0a70857-ecd6-4b77-9f94-6c235ce56356/uptime HTTP/1.1 Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gP5fax0wy35fWXbd0NDF99-_B9lTftroQtNPqAqRd58zsgme3DYPv1EdYWvMpua29v_BGagI4iZ6YiJHzpYm3vZblddlxQcELsyeGJ6HwRgnalgnwEq1UYMfZw6LrlvgC486hCfqkvNJfGenOlvqvNLO-DlKXBJBPyxIPpucNmcPVs Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: eb1eda5bc08446edaa25d3755bd2c756 Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-859256795 Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:35:23.181677 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:35:23.182994 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/eb1eda5bc08446edaa25d3755bd2c756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb1eda5bc08446edaa25d3755bd2c756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_eb1eda5bc08446edaa25d3755bd2c756"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb1eda5bc08446edaa25d3755bd2c756"}]}] Jul 28 03:35:23.182994 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-859256795 Jul 28 03:35:23.182994 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: eb1eda5bc08446edaa25d3755bd2c756 Jul 28 03:35:23.182994 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-859256795 Jul 28 03:35:23.182994 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin Jul 28 03:35:23.182994 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:23.182994 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:23.182994 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 80f64ca1441543ad8842dcc8e08ce3bf Jul 28 03:35:23.182994 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin Jul 28 03:35:23.182994 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:35:23.182994 n-d-826756-3 devstack@n-api.service[126072]: exception: Hypervisor with ID 'f0a70857-ecd6-4b77-9f94-6c235ce56356' could not be found. Jul 28 03:35:23.182994 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'f0a70857-ecd6-4b77-9f94-6c235ce56356'} Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f0a70857-ecd6-4b77-9f94-6c235ce56356' Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 28 03:35:23.183667 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f0a70857-ecd6-4b77-9f94-6c235ce56356' could not be found. Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:23.184835 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.187153 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:23.187153 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:23.187153 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:23.187153 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:23.187153 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:23.187153 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f0a70857-ecd6-4b77-9f94-6c235ce56356' could not be found. Jul 28 03:35:23.187153 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.187153 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eddcefaa-46eb-47f5-9adb-75b8649bfc84 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Returning 404 to user: Hypervisor with ID 'f0a70857-ecd6-4b77-9f94-6c235ce56356' could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:23.187153 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-eddcefaa-46eb-47f5-9adb-75b8649bfc84 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/f0a70857-ecd6-4b77-9f94-6c235ce56356/uptime" status: 404 len: 123 microversion: 2.1 time: 0.025572 Jul 28 03:35:23.191965 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 32/75] 10.222.0.48 () {58 vars in 1278 bytes} [Thu Jul 28 03:35:23 2022] GET /compute/v2.1/os-hypervisors/f0a70857-ecd6-4b77-9f94-6c235ce56356/uptime => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:23.200573 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-948a515d-1af4-417f-af55-e832457273ca tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Calling method '.version_select at 0x7ffa753eb820>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:23.204316 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:23.204316 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:23.209530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-948a515d-1af4-417f-af55-e832457273ca tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:23.212749 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-948a515d-1af4-417f-af55-e832457273ca tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:23.217996 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d8dfa9d-7477-45fb-bf12-1f429bad1071 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.171259 Jul 28 03:35:23.219680 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 44/76] 10.222.0.48 () {58 vars in 1128 bytes} [Thu Jul 28 03:35:23 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:23.235912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-986b168b-a743-4c8a-95c7-753e7e1c74ed tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Calling method '.version_select at 0x7ffa76b633a0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:23.238216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-948a515d-1af4-417f-af55-e832457273ca tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:23.238923 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-948a515d-1af4-417f-af55-e832457273ca tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:23.243341 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:23.243341 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:23.248269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-986b168b-a743-4c8a-95c7-753e7e1c74ed tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:23.248745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-986b168b-a743-4c8a-95c7-753e7e1c74ed tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:23.249553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-986b168b-a743-4c8a-95c7-753e7e1c74ed tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:23.253531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-986b168b-a743-4c8a-95c7-753e7e1c74ed tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:23.262781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-948a515d-1af4-417f-af55-e832457273ca tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:23.263446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-948a515d-1af4-417f-af55-e832457273ca tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:23.272467 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-948a515d-1af4-417f-af55-e832457273ca tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.079313 Jul 28 03:35:23.274218 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 33/77] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:35:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:23.288423 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-03154b64-2e70-4f66-9bec-0a24b3fbd675 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Calling method '.version_select at 0x7ffa75312310>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:23.289047 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-986b168b-a743-4c8a-95c7-753e7e1c74ed tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.060796 Jul 28 03:35:23.289277 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:23.289277 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:23.290388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-03154b64-2e70-4f66-9bec-0a24b3fbd675 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '4ee071c335f148679eb44526c42de63a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bc4266cbe74be5baa0887d4aeaaf82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:23.290532 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 45/78] 10.222.0.48 () {58 vars in 1139 bytes} [Thu Jul 28 03:35:23 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-03154b64-2e70-4f66-9bec-0a24b3fbd675 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Request method failure captured: Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gP2pKSKc2UNPRexe2_l0E91fAOFghOppSNNKw8ybYNQU8pzGKRs9qstd-vtDQgiBlfrRYxzVun4u35MZmPpaOWT8wKRHM7CEFDhuTCpfkiq5RD-NTgyrQn-CpN6oKwCaGcTArAxFX4YM5bPqz82RLVmKSuztjbXPjUSHmeiM9UXd7o Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: e4bc4266cbe74be5baa0887d4aeaaf82 Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:35:23.292617 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:35:23.294002 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e4bc4266cbe74be5baa0887d4aeaaf82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e4bc4266cbe74be5baa0887d4aeaaf82"}]}] Jul 28 03:35:23.294002 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:23.294002 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: e4bc4266cbe74be5baa0887d4aeaaf82 Jul 28 03:35:23.294002 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622 Jul 28 03:35:23.294002 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HypervisorAdminNegativeTestJSON-1037939622-project Jul 28 03:35:23.294002 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:23.294002 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:23.294002 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 4ee071c335f148679eb44526c42de63a Jul 28 03:35:23.294002 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1037939622-project Jul 28 03:35:23.294002 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:35:23.294002 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 28 03:35:23.294002 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '1'} Jul 28 03:35:23.294002 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:23.294804 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 28 03:35:23.295938 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.299059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-03154b64-2e70-4f66-9bec-0a24b3fbd675 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:23.300400 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-03154b64-2e70-4f66-9bec-0a24b3fbd675 tempest-HypervisorAdminNegativeTestJSON-1037939622 tempest-HypervisorAdminNegativeTestJSON-1037939622-project] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.017934 Jul 28 03:35:23.303728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-88095318-c22c-4e3d-984e-4904fd1ea363 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Calling method '.version_select at 0x7ffa76b3e940>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:23.306800 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 34/79] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:35:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:23.311866 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:23.311866 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:23.313621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6318c937-e6f3-4418-a97c-12e5b100fea9 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Calling method '.version_select at 0x7ffa7538ea60>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:23.313729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88095318-c22c-4e3d-984e-4904fd1ea363 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:23.314404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88095318-c22c-4e3d-984e-4904fd1ea363 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:23.315373 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-6318c937-e6f3-4418-a97c-12e5b100fea9 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] HTTP exception thrown: Hypervisor with ID '0334b9d8-1dc5-47ae-af70-e21e410b358d' could not be found. Jul 28 03:35:23.315569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88095318-c22c-4e3d-984e-4904fd1ea363 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:23.316133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88095318-c22c-4e3d-984e-4904fd1ea363 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6318c937-e6f3-4418-a97c-12e5b100fea9 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Request method failure captured: Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-hypervisors/0334b9d8-1dc5-47ae-af70-e21e410b358d HTTP/1.1 Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gP5fax0wy35fWXbd0NDF99-_B9lTftroQtNPqAqRd58zsgme3DYPv1EdYWvMpua29v_BGagI4iZ6YiJHzpYm3vZblddlxQcELsyeGJ6HwRgnalgnwEq1UYMfZw6LrlvgC486hCfqkvNJfGenOlvqvNLO-DlKXBJBPyxIPpucNmcPVs Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: eb1eda5bc08446edaa25d3755bd2c756 Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-859256795 Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:35:23.317693 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:35:23.318941 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/eb1eda5bc08446edaa25d3755bd2c756"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb1eda5bc08446edaa25d3755bd2c756"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_eb1eda5bc08446edaa25d3755bd2c756"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/eb1eda5bc08446edaa25d3755bd2c756"}]}] Jul 28 03:35:23.318941 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-859256795 Jul 28 03:35:23.318941 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: eb1eda5bc08446edaa25d3755bd2c756 Jul 28 03:35:23.318941 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-859256795 Jul 28 03:35:23.318941 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin Jul 28 03:35:23.318941 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:23.318941 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:23.318941 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 80f64ca1441543ad8842dcc8e08ce3bf Jul 28 03:35:23.318941 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin Jul 28 03:35:23.318941 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:35:23.318941 n-d-826756-3 devstack@n-api.service[126072]: exception: Hypervisor with ID '0334b9d8-1dc5-47ae-af70-e21e410b358d' could not be found. Jul 28 03:35:23.318941 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '0334b9d8-1dc5-47ae-af70-e21e410b358d'} Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '0334b9d8-1dc5-47ae-af70-e21e410b358d' Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 28 03:35:23.319570 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 03:35:23.320688 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '0334b9d8-1dc5-47ae-af70-e21e410b358d' could not be found. Jul 28 03:35:23.321758 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.321758 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:23.321758 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.321758 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:23.321758 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:23.321758 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:23.321758 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:23.321758 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:23.321758 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '0334b9d8-1dc5-47ae-af70-e21e410b358d' could not be found. Jul 28 03:35:23.321758 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:23.321758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6318c937-e6f3-4418-a97c-12e5b100fea9 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] Returning 404 to user: Hypervisor with ID '0334b9d8-1dc5-47ae-af70-e21e410b358d' could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:23.321758 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6318c937-e6f3-4418-a97c-12e5b100fea9 tempest-HypervisorAdminNegativeTestJSON-859256795 tempest-HypervisorAdminNegativeTestJSON-859256795-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/0334b9d8-1dc5-47ae-af70-e21e410b358d" status: 404 len: 123 microversion: 2.1 time: 0.010815 Jul 28 03:35:23.324496 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 35/80] 10.222.0.48 () {58 vars in 1257 bytes} [Thu Jul 28 03:35:23 2022] GET /compute/v2.1/os-hypervisors/0334b9d8-1dc5-47ae-af70-e21e410b358d => generated 123 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:23.352301 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-88095318-c22c-4e3d-984e-4904fd1ea363 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.052476 Jul 28 03:35:23.359766 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 46/81] 10.222.0.48 () {58 vars in 1145 bytes} [Thu Jul 28 03:35:23 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:35:23.880944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fdb3591b-2bb2-4cae-98d9-b6c0336a3e6d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:23.881571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fdb3591b-2bb2-4cae-98d9-b6c0336a3e6d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:23.893273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fdb3591b-2bb2-4cae-98d9-b6c0336a3e6d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:23.893738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fdb3591b-2bb2-4cae-98d9-b6c0336a3e6d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:23.896722 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fdb3591b-2bb2-4cae-98d9-b6c0336a3e6d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:23.897407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fdb3591b-2bb2-4cae-98d9-b6c0336a3e6d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:24.151528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fdb3591b-2bb2-4cae-98d9-b6c0336a3e6d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:24.169438 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fdb3591b-2bb2-4cae-98d9-b6c0336a3e6d tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1338 microversion: 2.1 time: 0.293879 Jul 28 03:35:24.181894 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 36/82] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:23 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1338 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:25.201086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e340405c-d9c7-4694-a0f2-abb68f4974bf tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:25.201686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e340405c-d9c7-4694-a0f2-abb68f4974bf tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:25.208609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e340405c-d9c7-4694-a0f2-abb68f4974bf tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:25.209272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e340405c-d9c7-4694-a0f2-abb68f4974bf tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:25.210039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e340405c-d9c7-4694-a0f2-abb68f4974bf tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:25.210449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e340405c-d9c7-4694-a0f2-abb68f4974bf tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:25.378606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e340405c-d9c7-4694-a0f2-abb68f4974bf tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:25.388040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:25.391077 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e340405c-d9c7-4694-a0f2-abb68f4974bf tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1338 microversion: 2.1 time: 0.194231 Jul 28 03:35:25.391853 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 47/83] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:25 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1338 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:26.416892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-24763a5a-7709-431f-a4c7-ae45fd14c3fa tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:26.417980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-24763a5a-7709-431f-a4c7-ae45fd14c3fa tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:26.434705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24763a5a-7709-431f-a4c7-ae45fd14c3fa tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:26.435150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24763a5a-7709-431f-a4c7-ae45fd14c3fa tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:26.435929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24763a5a-7709-431f-a4c7-ae45fd14c3fa tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:26.436664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24763a5a-7709-431f-a4c7-ae45fd14c3fa tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:26.635972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1240185362", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:26.730042 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:35:26.764462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-24763a5a-7709-431f-a4c7-ae45fd14c3fa tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:26.772211 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-24763a5a-7709-431f-a4c7-ae45fd14c3fa tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1338 microversion: 2.1 time: 0.361576 Jul 28 03:35:26.772827 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 48/84] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:26 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1338 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:26.902484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b5b3415-e530-4be2-a1e0-15150dbd33c8 tempest-QuotaClassesAdminTestJSON-861392703 tempest-QuotaClassesAdminTestJSON-861392703-project-admin] Calling method '.version_select at 0x7ffa769f7790>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:26.903713 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:26.903713 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:26.937954 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3b5b3415-e530-4be2-a1e0-15150dbd33c8 tempest-QuotaClassesAdminTestJSON-861392703 tempest-QuotaClassesAdminTestJSON-861392703-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.163749 Jul 28 03:35:26.939211 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 49/85] 10.222.0.48 () {58 vars in 1185 bytes} [Thu Jul 28 03:35:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:26.952962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-56ff4f67-fa23-4d24-a633-3af278e17d9e tempest-QuotaClassesAdminTestJSON-861392703 tempest-QuotaClassesAdminTestJSON-861392703-project-admin] Action: 'update', calling method: .version_select at 0x7ffa769f7280>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:26.962656 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:26.962656 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:27.023640 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:35:27.024067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:35:27.025368 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:35:27.025784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:35:27.026283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:35:27.048385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:27.049207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:27.050267 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:27.050794 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:27.084882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Getting quotas for project ac0afebe20824fd0898e22cbfaf03ba5. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:35:27.090792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Getting quotas for user 75b0c48126914b959b5926d24a5f8a82 and project ac0afebe20824fd0898e22cbfaf03ba5. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:35:27.106375 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:35:27.108747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:35:27.169171 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-30475156-01a0-4598-81f2-b5964e4b0149 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.993200 Jul 28 03:35:27.170286 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 37/86] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:35:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:35:27.181747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:DELETE=8,nova_api:UPDATE=5 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:27.187241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0c09a2af-e3e3-4ae9-993c-f134e064dca7 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:27.188167 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0c09a2af-e3e3-4ae9-993c-f134e064dca7 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:27.434849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0c09a2af-e3e3-4ae9-993c-f134e064dca7 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:27.451900 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0c09a2af-e3e3-4ae9-993c-f134e064dca7 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1220 microversion: 2.1 time: 0.271014 Jul 28 03:35:27.453395 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 38/87] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:27 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1220 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:27.710323 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-56ff4f67-fa23-4d24-a633-3af278e17d9e tempest-QuotaClassesAdminTestJSON-861392703 tempest-QuotaClassesAdminTestJSON-861392703-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.760288 Jul 28 03:35:27.714312 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 50/88] 10.222.0.48 () {60 vars in 1206 bytes} [Thu Jul 28 03:35:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:27.724633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5721143b-a5df-412e-b4ca-741c91df3822 tempest-QuotaClassesAdminTestJSON-861392703 tempest-QuotaClassesAdminTestJSON-861392703-project-admin] Calling method '.version_select at 0x7ffa7538eee0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:27.725472 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:27.725472 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:27.742244 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5721143b-a5df-412e-b4ca-741c91df3822 tempest-QuotaClassesAdminTestJSON-861392703 tempest-QuotaClassesAdminTestJSON-861392703-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.021758 Jul 28 03:35:27.743164 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 39/89] 10.222.0.48 () {58 vars in 1185 bytes} [Thu Jul 28 03:35:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:27.758661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e5b6c52-9895-40cd-bf68-626060a06be6 tempest-QuotaClassesAdminTestJSON-861392703 tempest-QuotaClassesAdminTestJSON-861392703-project-admin] Action: 'update', calling method: .version_select at 0x7ffa76aae1f0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:27.806705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5db37df3-f47d-45cc-95a6-8c83e7d2e953 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:27.807331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5db37df3-f47d-45cc-95a6-8c83e7d2e953 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:27.831973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5db37df3-f47d-45cc-95a6-8c83e7d2e953 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:27.834869 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5db37df3-f47d-45cc-95a6-8c83e7d2e953 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:27.837065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5db37df3-f47d-45cc-95a6-8c83e7d2e953 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:27.838350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5db37df3-f47d-45cc-95a6-8c83e7d2e953 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:28.017850 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e5b6c52-9895-40cd-bf68-626060a06be6 tempest-QuotaClassesAdminTestJSON-861392703 tempest-QuotaClassesAdminTestJSON-861392703-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.265222 Jul 28 03:35:28.020337 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 51/90] 10.222.0.48 () {60 vars in 1206 bytes} [Thu Jul 28 03:35:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:28.128860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5db37df3-f47d-45cc-95a6-8c83e7d2e953 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:28.138915 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5db37df3-f47d-45cc-95a6-8c83e7d2e953 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1338 microversion: 2.1 time: 0.344552 Jul 28 03:35:28.139844 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 40/91] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:27 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1338 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:28.476468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9119e50a-2dc9-4176-977d-c04a27aea72b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:28.477085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9119e50a-2dc9-4176-977d-c04a27aea72b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:28.615855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9119e50a-2dc9-4176-977d-c04a27aea72b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:28.637300 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9119e50a-2dc9-4176-977d-c04a27aea72b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1220 microversion: 2.1 time: 0.165065 Jul 28 03:35:28.638691 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 52/92] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:28 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1220 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:29.161568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6367d8f5-4758-4b8b-9acc-740053ec7f9b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:29.162807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6367d8f5-4758-4b8b-9acc-740053ec7f9b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:29.172817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6367d8f5-4758-4b8b-9acc-740053ec7f9b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:29.177265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6367d8f5-4758-4b8b-9acc-740053ec7f9b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:29.178361 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6367d8f5-4758-4b8b-9acc-740053ec7f9b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:29.178987 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6367d8f5-4758-4b8b-9acc-740053ec7f9b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:29.413320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6367d8f5-4758-4b8b-9acc-740053ec7f9b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:29.425526 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6367d8f5-4758-4b8b-9acc-740053ec7f9b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1338 microversion: 2.1 time: 0.266594 Jul 28 03:35:29.426568 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 41/93] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:29 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1338 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:29.661401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3c186cad-f901-41f3-8179-f1bf0893d38c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:29.663746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3c186cad-f901-41f3-8179-f1bf0893d38c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:29.673578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c186cad-f901-41f3-8179-f1bf0893d38c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:29.675124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c186cad-f901-41f3-8179-f1bf0893d38c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:29.676226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c186cad-f901-41f3-8179-f1bf0893d38c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:29.677077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c186cad-f901-41f3-8179-f1bf0893d38c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:29.785653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3c186cad-f901-41f3-8179-f1bf0893d38c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:29.798412 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3c186cad-f901-41f3-8179-f1bf0893d38c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1272 microversion: 2.1 time: 0.144082 Jul 28 03:35:29.799884 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 53/94] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:29 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1272 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:30.448374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b0954c2e-c76e-4696-93d3-659b319e3382 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:30.449254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b0954c2e-c76e-4696-93d3-659b319e3382 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:30.464834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0954c2e-c76e-4696-93d3-659b319e3382 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:30.465689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0954c2e-c76e-4696-93d3-659b319e3382 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:30.466720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0954c2e-c76e-4696-93d3-659b319e3382 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:30.470627 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0954c2e-c76e-4696-93d3-659b319e3382 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:30.831447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bd454c25-2aeb-436c-8e93-f52680b69ea6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:30.833921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bd454c25-2aeb-436c-8e93-f52680b69ea6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:30.853880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd454c25-2aeb-436c-8e93-f52680b69ea6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:30.856136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd454c25-2aeb-436c-8e93-f52680b69ea6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:30.857885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd454c25-2aeb-436c-8e93-f52680b69ea6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:30.859677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd454c25-2aeb-436c-8e93-f52680b69ea6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:31.139175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bd454c25-2aeb-436c-8e93-f52680b69ea6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:31.160962 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bd454c25-2aeb-436c-8e93-f52680b69ea6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1278 microversion: 2.1 time: 0.344155 Jul 28 03:35:31.173147 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 54/95] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:30 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1278 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:31.720214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b0954c2e-c76e-4696-93d3-659b319e3382 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:31.748561 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b0954c2e-c76e-4696-93d3-659b319e3382 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1338 microversion: 2.1 time: 1.304939 Jul 28 03:35:31.749177 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 42/96] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:30 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1338 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:32.183693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2f02977-43b3-4b1a-9406-7b983df67ed2 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:32.184328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d2f02977-43b3-4b1a-9406-7b983df67ed2 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:32.193258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2f02977-43b3-4b1a-9406-7b983df67ed2 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:32.194018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2f02977-43b3-4b1a-9406-7b983df67ed2 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:32.195395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2f02977-43b3-4b1a-9406-7b983df67ed2 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:32.196063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2f02977-43b3-4b1a-9406-7b983df67ed2 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:32.415566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d2f02977-43b3-4b1a-9406-7b983df67ed2 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:32.430596 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d2f02977-43b3-4b1a-9406-7b983df67ed2 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1278 microversion: 2.1 time: 0.251008 Jul 28 03:35:32.434062 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 55/97] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:32 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1278 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:32.797526 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ebee5f14-2fd3-4b2b-a2c7-992727df99ac tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:32.799976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ebee5f14-2fd3-4b2b-a2c7-992727df99ac tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:32.823129 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebee5f14-2fd3-4b2b-a2c7-992727df99ac tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:32.823995 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebee5f14-2fd3-4b2b-a2c7-992727df99ac tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:32.827030 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebee5f14-2fd3-4b2b-a2c7-992727df99ac tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:32.829619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebee5f14-2fd3-4b2b-a2c7-992727df99ac tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:32.949102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-75e4b91c-a107-459d-9054-277c13681f95 req-6f2ee6f0-4d40-4dc8-8542-492832c5c6ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf11ab4-3b13-4117-8ba1-7c0b07894e8c", "name": "network-vif-plugged", "status": "completed", "tag": "b399c7ad-618d-44ee-99a1-588947b24810"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:32.987674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-75e4b91c-a107-459d-9054-277c13681f95 req-6f2ee6f0-4d40-4dc8-8542-492832c5c6ef service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:32.988105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-75e4b91c-a107-459d-9054-277c13681f95 req-6f2ee6f0-4d40-4dc8-8542-492832c5c6ef service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:33.086604 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-75e4b91c-a107-459d-9054-277c13681f95 req-6f2ee6f0-4d40-4dc8-8542-492832c5c6ef service nova] Creating event network-vif-plugged:b399c7ad-618d-44ee-99a1-588947b24810 for instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c on n-h1-826756-3 Jul 28 03:35:33.088608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-75e4b91c-a107-459d-9054-277c13681f95 req-6f2ee6f0-4d40-4dc8-8542-492832c5c6ef service nova] Acquired lock "compute-rpcapi-router" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 03:35:33.097710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a610e3fb-cf71-409e-ac78-ff592bf65a67 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:33.103297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a610e3fb-cf71-409e-ac78-ff592bf65a67 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:33.110557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a610e3fb-cf71-409e-ac78-ff592bf65a67 None None] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:33.112306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a610e3fb-cf71-409e-ac78-ff592bf65a67 None None] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:33.182587 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.compute.rpcapi [None req-a610e3fb-cf71-409e-ac78-ff592bf65a67 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 03:35:33.184558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a610e3fb-cf71-409e-ac78-ff592bf65a67 None None] Releasing lock "compute-rpcapi-router" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 03:35:33.246542 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a610e3fb-cf71-409e-ac78-ff592bf65a67 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.459284 Jul 28 03:35:33.247919 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 56/98] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:33.464336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a1f4cad6-c1ca-49b2-84ba-07aadc4eb7e4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:33.465554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a1f4cad6-c1ca-49b2-84ba-07aadc4eb7e4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:33.485862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1f4cad6-c1ca-49b2-84ba-07aadc4eb7e4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:33.489472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1f4cad6-c1ca-49b2-84ba-07aadc4eb7e4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:33.489954 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ebee5f14-2fd3-4b2b-a2c7-992727df99ac tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:33.493894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1f4cad6-c1ca-49b2-84ba-07aadc4eb7e4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:33.498615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1f4cad6-c1ca-49b2-84ba-07aadc4eb7e4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:33.505315 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ebee5f14-2fd3-4b2b-a2c7-992727df99ac tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1338 microversion: 2.1 time: 0.729927 Jul 28 03:35:33.506141 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 43/99] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:32 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1338 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:33.686551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a1f4cad6-c1ca-49b2-84ba-07aadc4eb7e4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:33.704668 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a1f4cad6-c1ca-49b2-84ba-07aadc4eb7e4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1278 microversion: 2.1 time: 0.245854 Jul 28 03:35:33.722366 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 57/100] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:33 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:34.535209 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-83f305d5-2ef2-4710-aae0-e6edeae11c36 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:34.537538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-83f305d5-2ef2-4710-aae0-e6edeae11c36 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:34.549692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83f305d5-2ef2-4710-aae0-e6edeae11c36 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:34.550441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83f305d5-2ef2-4710-aae0-e6edeae11c36 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:34.551855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83f305d5-2ef2-4710-aae0-e6edeae11c36 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:34.552693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83f305d5-2ef2-4710-aae0-e6edeae11c36 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:34.604631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=95 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:34.730631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4c90d78-0cf3-4f2b-809d-34213dd9172c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:34.731247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4c90d78-0cf3-4f2b-809d-34213dd9172c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:34.745778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c90d78-0cf3-4f2b-809d-34213dd9172c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:34.747110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c90d78-0cf3-4f2b-809d-34213dd9172c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:34.757621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c90d78-0cf3-4f2b-809d-34213dd9172c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:34.758524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c90d78-0cf3-4f2b-809d-34213dd9172c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:34.892822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a4c90d78-0cf3-4f2b-809d-34213dd9172c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:34.905276 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4c90d78-0cf3-4f2b-809d-34213dd9172c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1278 microversion: 2.1 time: 0.179199 Jul 28 03:35:34.906418 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 58/101] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:34 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:35.202417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-83f305d5-2ef2-4710-aae0-e6edeae11c36 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:35.212849 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-83f305d5-2ef2-4710-aae0-e6edeae11c36 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1338 microversion: 2.1 time: 0.686390 Jul 28 03:35:35.213452 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 44/102] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:34 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1338 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:35.346086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-461fef25-a3b9-4217-b0f8-d3e5faafa6e5 tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:35.349685 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:35.349685 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:35.351519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-461fef25-a3b9-4217-b0f8-d3e5faafa6e5 tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:35.352189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-461fef25-a3b9-4217-b0f8-d3e5faafa6e5 tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:35.353215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-461fef25-a3b9-4217-b0f8-d3e5faafa6e5 tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:35.353844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-461fef25-a3b9-4217-b0f8-d3e5faafa6e5 tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:35.393320 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-461fef25-a3b9-4217-b0f8-d3e5faafa6e5 tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.372774 Jul 28 03:35:35.394925 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 59/103] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:35:35 2022] GET /compute/v2.1/os-services => generated 965 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:35:35.417826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-132077b2-7151-4540-a95a-447f5cf7d3de tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:35.422657 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:35.422657 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:35.425258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-132077b2-7151-4540-a95a-447f5cf7d3de tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:35.427230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-132077b2-7151-4540-a95a-447f5cf7d3de tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:35.428059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-132077b2-7151-4540-a95a-447f5cf7d3de tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:35.429094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-132077b2-7151-4540-a95a-447f5cf7d3de tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:35.433600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=9 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:35.458379 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-132077b2-7151-4540-a95a-447f5cf7d3de tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-826756-3" status: 200 len: 578 microversion: 2.1 time: 0.052165 Jul 28 03:35:35.467261 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 45/104] 10.222.0.48 () {58 vars in 1172 bytes} [Thu Jul 28 03:35:35 2022] GET /compute/v2.1/os-services?host=n-d-826756-3 => generated 578 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:35.474548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a579ac1-6b65-4e73-9b83-43450df3529c tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:35.477630 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:35.477630 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:35.479265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a579ac1-6b65-4e73-9b83-43450df3529c tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:35.480103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a579ac1-6b65-4e73-9b83-43450df3529c tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:35.481790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a579ac1-6b65-4e73-9b83-43450df3529c tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:35.482387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a579ac1-6b65-4e73-9b83-43450df3529c tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:35.533011 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a579ac1-6b65-4e73-9b83-43450df3529c tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 401 microversion: 2.1 time: 0.063400 Jul 28 03:35:35.534038 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 60/105] 10.222.0.48 () {58 vars in 1176 bytes} [Thu Jul 28 03:35:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 401 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:35.553352 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c23644d3-1400-4e5f-8771-00d7080f44f0 tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:35.557680 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:35.557680 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:35.560116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c23644d3-1400-4e5f-8771-00d7080f44f0 tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:35.560799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c23644d3-1400-4e5f-8771-00d7080f44f0 tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:35.561788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c23644d3-1400-4e5f-8771-00d7080f44f0 tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:35.562364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c23644d3-1400-4e5f-8771-00d7080f44f0 tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:35.622985 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c23644d3-1400-4e5f-8771-00d7080f44f0 tempest-ServicesAdminTestJSON-1985026569 tempest-ServicesAdminTestJSON-1985026569-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 965 microversion: 2.1 time: 0.073989 Jul 28 03:35:35.632471 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 46/106] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:35:35 2022] GET /compute/v2.1/os-services => generated 965 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:35.934518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15c7ed75-c917-494e-8623-83faec3f76f3 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:35.935282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15c7ed75-c917-494e-8623-83faec3f76f3 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:35.966260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15c7ed75-c917-494e-8623-83faec3f76f3 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:35.977236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15c7ed75-c917-494e-8623-83faec3f76f3 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:35.983142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15c7ed75-c917-494e-8623-83faec3f76f3 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:35.984417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15c7ed75-c917-494e-8623-83faec3f76f3 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:36.233922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-15c7ed75-c917-494e-8623-83faec3f76f3 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:36.241472 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39c93c6c-97f1-4ca2-bac0-17fca21df253 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:36.243337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-39c93c6c-97f1-4ca2-bac0-17fca21df253 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:36.245410 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15c7ed75-c917-494e-8623-83faec3f76f3 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1278 microversion: 2.1 time: 0.316299 Jul 28 03:35:36.246750 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 61/107] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:35 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1278 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:36.256482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39c93c6c-97f1-4ca2-bac0-17fca21df253 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:36.257279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39c93c6c-97f1-4ca2-bac0-17fca21df253 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:36.258272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39c93c6c-97f1-4ca2-bac0-17fca21df253 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:36.258918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39c93c6c-97f1-4ca2-bac0-17fca21df253 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:36.571056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-39c93c6c-97f1-4ca2-bac0-17fca21df253 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:36.591662 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-39c93c6c-97f1-4ca2-bac0-17fca21df253 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1488 microversion: 2.1 time: 0.358899 Jul 28 03:35:36.595290 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 47/108] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:36 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1488 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:36.625229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ec153835-877e-48f4-a86c-e2dc11ed9db4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:36.625756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ec153835-877e-48f4-a86c-e2dc11ed9db4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:36.632631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec153835-877e-48f4-a86c-e2dc11ed9db4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:36.633277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec153835-877e-48f4-a86c-e2dc11ed9db4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:36.634457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec153835-877e-48f4-a86c-e2dc11ed9db4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:36.635035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec153835-877e-48f4-a86c-e2dc11ed9db4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:37.266599 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-20d4e37b-ff18-49ff-a093-c0d7bf585408 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:37.267456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-20d4e37b-ff18-49ff-a093-c0d7bf585408 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:37.279805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20d4e37b-ff18-49ff-a093-c0d7bf585408 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:37.281133 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20d4e37b-ff18-49ff-a093-c0d7bf585408 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:37.282945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20d4e37b-ff18-49ff-a093-c0d7bf585408 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:37.288998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20d4e37b-ff18-49ff-a093-c0d7bf585408 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:37.711902 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ec153835-877e-48f4-a86c-e2dc11ed9db4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1639 microversion: 2.1 time: 1.091581 Jul 28 03:35:37.728521 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 62/109] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:36 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1639 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:37.740559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e3b4208d-f98f-474e-a7fb-637d0b4bda02 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:37.741395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=10 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:37.742926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e3b4208d-f98f-474e-a7fb-637d0b4bda02 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:37.755293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3b4208d-f98f-474e-a7fb-637d0b4bda02 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:37.756306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3b4208d-f98f-474e-a7fb-637d0b4bda02 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:37.757433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3b4208d-f98f-474e-a7fb-637d0b4bda02 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:37.759762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3b4208d-f98f-474e-a7fb-637d0b4bda02 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:37.827949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e3b4208d-f98f-474e-a7fb-637d0b4bda02 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:35:37.930124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-20d4e37b-ff18-49ff-a093-c0d7bf585408 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:37.941906 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-20d4e37b-ff18-49ff-a093-c0d7bf585408 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1320 microversion: 2.1 time: 0.679403 Jul 28 03:35:37.942696 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 48/110] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:37 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1320 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:35:38.079913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=72,nova_api:UPDATE=20 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:38.094125 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e3b4208d-f98f-474e-a7fb-637d0b4bda02 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 204 len: 0 microversion: 2.1 time: 0.356187 Jul 28 03:35:38.100595 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 63/111] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:35:37 2022] DELETE /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:35:38.108564 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3455fb03-ecc2-44e6-9137-137e1b0f8687 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:38.109403 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3455fb03-ecc2-44e6-9137-137e1b0f8687 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:38.115836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3455fb03-ecc2-44e6-9137-137e1b0f8687 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:38.116527 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3455fb03-ecc2-44e6-9137-137e1b0f8687 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:38.117454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3455fb03-ecc2-44e6-9137-137e1b0f8687 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:38.118032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3455fb03-ecc2-44e6-9137-137e1b0f8687 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:38.369384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3455fb03-ecc2-44e6-9137-137e1b0f8687 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:38.383151 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3455fb03-ecc2-44e6-9137-137e1b0f8687 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1494 microversion: 2.1 time: 0.278416 Jul 28 03:35:38.383756 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 49/112] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:38 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1494 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:38.963662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2c5ee4c5-9dc7-40d6-bbec-2f00a0c156dd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:38.964979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2c5ee4c5-9dc7-40d6-bbec-2f00a0c156dd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:38.971209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=44,nova_cell0:UPDATE=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:38.973270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c5ee4c5-9dc7-40d6-bbec-2f00a0c156dd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:38.973857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c5ee4c5-9dc7-40d6-bbec-2f00a0c156dd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:38.974770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c5ee4c5-9dc7-40d6-bbec-2f00a0c156dd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:38.975346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c5ee4c5-9dc7-40d6-bbec-2f00a0c156dd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:39.251624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2c5ee4c5-9dc7-40d6-bbec-2f00a0c156dd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:39.262254 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2c5ee4c5-9dc7-40d6-bbec-2f00a0c156dd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1320 microversion: 2.1 time: 0.302665 Jul 28 03:35:39.263527 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 64/113] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:38 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:39.409480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cd20b2de-f9d3-4466-aa7e-70579213452e tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:39.410166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cd20b2de-f9d3-4466-aa7e-70579213452e tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:39.461538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd20b2de-f9d3-4466-aa7e-70579213452e tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:39.461538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd20b2de-f9d3-4466-aa7e-70579213452e tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:39.462248 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd20b2de-f9d3-4466-aa7e-70579213452e tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:39.462411 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd20b2de-f9d3-4466-aa7e-70579213452e tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:40.284576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1eeeeadd-9c6a-472f-a7ec-f3b30ce7ae52 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:40.285091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1eeeeadd-9c6a-472f-a7ec-f3b30ce7ae52 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:40.295207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1eeeeadd-9c6a-472f-a7ec-f3b30ce7ae52 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:40.296800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1eeeeadd-9c6a-472f-a7ec-f3b30ce7ae52 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:40.299787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1eeeeadd-9c6a-472f-a7ec-f3b30ce7ae52 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:40.300880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1eeeeadd-9c6a-472f-a7ec-f3b30ce7ae52 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:40.624310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd20b2de-f9d3-4466-aa7e-70579213452e tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:40.640221 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cd20b2de-f9d3-4466-aa7e-70579213452e tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1494 microversion: 2.1 time: 1.239800 Jul 28 03:35:40.642011 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 50/114] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:39 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1494 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:40.751763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1eeeeadd-9c6a-472f-a7ec-f3b30ce7ae52 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:40.762856 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1eeeeadd-9c6a-472f-a7ec-f3b30ce7ae52 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1320 microversion: 2.1 time: 0.482732 Jul 28 03:35:40.763461 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 65/115] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:40 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1320 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:35:41.663191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d6349ce-4a7e-4f34-847a-9a91ba04c49b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:41.665945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d6349ce-4a7e-4f34-847a-9a91ba04c49b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:41.674454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d6349ce-4a7e-4f34-847a-9a91ba04c49b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:41.674895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d6349ce-4a7e-4f34-847a-9a91ba04c49b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:41.683355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d6349ce-4a7e-4f34-847a-9a91ba04c49b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:41.684264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d6349ce-4a7e-4f34-847a-9a91ba04c49b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:41.900322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-aa8f573e-f51f-4a6a-aba3-6f5f93a3c536 req-85d0589d-c738-4733-85fa-61c30b27ab86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ad9cea2-a559-4ca1-9d39-e089112bdde7", "tag": "f4637ada-07a2-4d6f-a424-6111d91c080a"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:41.921442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:41.930798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-aa8f573e-f51f-4a6a-aba3-6f5f93a3c536 req-85d0589d-c738-4733-85fa-61c30b27ab86 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:41.931291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-aa8f573e-f51f-4a6a-aba3-6f5f93a3c536 req-85d0589d-c738-4733-85fa-61c30b27ab86 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:41.960949 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-aa8f573e-f51f-4a6a-aba3-6f5f93a3c536 req-85d0589d-c738-4733-85fa-61c30b27ab86 service nova] Creating event network-changed:f4637ada-07a2-4d6f-a424-6111d91c080a for instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 on n-h2-826756-3 Jul 28 03:35:41.981130 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-aa8f573e-f51f-4a6a-aba3-6f5f93a3c536 req-85d0589d-c738-4733-85fa-61c30b27ab86 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.424250 Jul 28 03:35:41.982188 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 51/116] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:41.993736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fbfbdbe2-e0f9-4579-a93e-327ef8eeebd9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:41.994430 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fbfbdbe2-e0f9-4579-a93e-327ef8eeebd9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:42.014069 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fbfbdbe2-e0f9-4579-a93e-327ef8eeebd9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:42.014514 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fbfbdbe2-e0f9-4579-a93e-327ef8eeebd9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:42.021033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fbfbdbe2-e0f9-4579-a93e-327ef8eeebd9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:42.021866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fbfbdbe2-e0f9-4579-a93e-327ef8eeebd9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:42.211058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7d6349ce-4a7e-4f34-847a-9a91ba04c49b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4338dd1a28ac4bb9a75c143f57e74f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca65d6c53c5846c8903fdb9b5de86168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:42.221178 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d6349ce-4a7e-4f34-847a-9a91ba04c49b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 200 len: 1494 microversion: 2.1 time: 0.562395 Jul 28 03:35:42.221773 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 66/117] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:41 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 1494 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:42.470637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fbfbdbe2-e0f9-4579-a93e-327ef8eeebd9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:42.485942 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fbfbdbe2-e0f9-4579-a93e-327ef8eeebd9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1320 microversion: 2.1 time: 0.502437 Jul 28 03:35:42.486886 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 52/118] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:41 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1320 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:42.555874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-e2e9f656-dd42-4445-beb3-6a8e68953a00 req-a36df963-6fd5-430a-a2da-b157c4416d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf11ab4-3b13-4117-8ba1-7c0b07894e8c", "name": "network-vif-deleted", "tag": "b399c7ad-618d-44ee-99a1-588947b24810"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:42.575827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2123645010", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:42.577615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e2e9f656-dd42-4445-beb3-6a8e68953a00 req-a36df963-6fd5-430a-a2da-b157c4416d81 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:42.580457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e2e9f656-dd42-4445-beb3-6a8e68953a00 req-a36df963-6fd5-430a-a2da-b157c4416d81 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:42.609928 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-e2e9f656-dd42-4445-beb3-6a8e68953a00 req-a36df963-6fd5-430a-a2da-b157c4416d81 service nova] Creating event network-vif-deleted:b399c7ad-618d-44ee-99a1-588947b24810 for instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c on n-h1-826756-3 Jul 28 03:35:42.622800 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-e2e9f656-dd42-4445-beb3-6a8e68953a00 req-a36df963-6fd5-430a-a2da-b157c4416d81 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076451 Jul 28 03:35:42.623574 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 53/119] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:35:42.722171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:35:43.245242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7da1c001-caaa-4d7c-89d5-a8fd2029c6dc tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:43.245939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7da1c001-caaa-4d7c-89d5-a8fd2029c6dc tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:43.259369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7da1c001-caaa-4d7c-89d5-a8fd2029c6dc tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:43.260095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7da1c001-caaa-4d7c-89d5-a8fd2029c6dc tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:43.263442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7da1c001-caaa-4d7c-89d5-a8fd2029c6dc tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:43.264035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7da1c001-caaa-4d7c-89d5-a8fd2029c6dc tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:43.287860 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-7da1c001-caaa-4d7c-89d5-a8fd2029c6dc tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] HTTP exception thrown: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7da1c001-caaa-4d7c-89d5-a8fd2029c6dc tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Request method failure captured: Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c HTTP/1.1 Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gPm8iJ6-xUKDCwO89mPSoiU4oLHv-51Yew0_pLt9SxB2o9MGlSsZi0Iq1f-8RMIwzLmpEd1eR3q599bd-tZwaOa6baOdBdMp0LhP63w2gNyFPymKwrKuwM4-km3kKOeXn9JYM9XcsFHt578-R_IH391X0yTmC5sFDi9mse3ezhgB7Y Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ca65d6c53c5846c8903fdb9b5de86168 Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AggregatesAdminTestJSON-2079868474 Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:35:43.292784 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:35:43.294210 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca65d6c53c5846c8903fdb9b5de86168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca65d6c53c5846c8903fdb9b5de86168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca65d6c53c5846c8903fdb9b5de86168"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca65d6c53c5846c8903fdb9b5de86168"}]}] Jul 28 03:35:43.294210 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AggregatesAdminTestJSON-2079868474 Jul 28 03:35:43.294210 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ca65d6c53c5846c8903fdb9b5de86168 Jul 28 03:35:43.294210 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2079868474 Jul 28 03:35:43.294210 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AggregatesAdminTestJSON-2079868474-project Jul 28 03:35:43.294210 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:43.294210 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:43.294210 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 4338dd1a28ac4bb9a75c143f57e74f2e Jul 28 03:35:43.294210 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AggregatesAdminTestJSON-2079868474-project Jul 28 03:35:43.294210 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:35:43.294210 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:43.294210 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '8bf11ab4-3b13-4117-8ba1-7c0b07894e8c'} Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:43.295038 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:43.296299 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:43.298691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7da1c001-caaa-4d7c-89d5-a8fd2029c6dc tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Returning 404 to user: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:43.299693 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7da1c001-caaa-4d7c-89d5-a8fd2029c6dc tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 404 len: 111 microversion: 2.1 time: 0.058816 Jul 28 03:35:43.300735 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 54/120] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:43 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:35:43.309770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7f2e19a5-544c-45ed-a281-67f6cac4ea21 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-3"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:43.313247 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:43.313247 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:43.323713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f2e19a5-544c-45ed-a281-67f6cac4ea21 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:43.324635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f2e19a5-544c-45ed-a281-67f6cac4ea21 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:43.329666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:35:43.330086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:35:43.330554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:35:43.331124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:35:43.331702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:35:43.570137 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7f2e19a5-544c-45ed-a281-67f6cac4ea21 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 0.264232 Jul 28 03:35:43.582163 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 55/121] 10.222.0.48 () {60 vars in 1191 bytes} [Thu Jul 28 03:35:43 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:35:43.588686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c3a1bbf8-1306-4822-a64f-d5eb55f83e16 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:43.589577 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c3a1bbf8-1306-4822-a64f-d5eb55f83e16 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:43.594032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:43.594535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:43.595677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:43.596144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:43.598280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3a1bbf8-1306-4822-a64f-d5eb55f83e16 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:43.598950 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3a1bbf8-1306-4822-a64f-d5eb55f83e16 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:43.600545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3a1bbf8-1306-4822-a64f-d5eb55f83e16 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:43.601164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3a1bbf8-1306-4822-a64f-d5eb55f83e16 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:43.662325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Getting quotas for project 8a83c47312474b3c87c42e684ed32f29. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:35:43.670413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Getting quotas for user 985e4523bd004cd288f0fcddb9233262 and project 8a83c47312474b3c87c42e684ed32f29. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:35:43.696786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:35:43.704595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:35:43.783727 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1fef7a0d-5f26-4931-92ec-349c3b46ab5c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.476983 Jul 28 03:35:43.787044 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 67/122] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:35:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:35:43.799660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-308817e8-4f34-47ef-9ab6-f12c9b87261a tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:43.800988 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:43.800988 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:43.891931 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-308817e8-4f34-47ef-9ab6-f12c9b87261a tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.103225 Jul 28 03:35:43.898886 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 68/123] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:35:43 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:43.927752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d8ea625d-254a-455c-ac00-0df2edb62a24 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:43.932798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d8ea625d-254a-455c-ac00-0df2edb62a24 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:43.972471 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c3a1bbf8-1306-4822-a64f-d5eb55f83e16 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:43.998680 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c3a1bbf8-1306-4822-a64f-d5eb55f83e16 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1320 microversion: 2.1 time: 0.411971 Jul 28 03:35:44.000473 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 56/124] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:43 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1320 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:44.016432 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b2392801-74ee-4a9d-9293-461841c30917 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-392580784"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:44.018508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d8ea625d-254a-455c-ac00-0df2edb62a24 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:44.023257 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:44.023257 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:44.024739 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.aggregate [None req-b2392801-74ee-4a9d-9293-461841c30917 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Generated uuid b3b09ff7-a382-4833-9fe3-6874045cfd7f for aggregate {{(pid=126072) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:44.034802 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d8ea625d-254a-455c-ac00-0df2edb62a24 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1214 microversion: 2.1 time: 0.136304 Jul 28 03:35:44.035762 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 69/125] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:43 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:44.101620 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b2392801-74ee-4a9d-9293-461841c30917 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.093047 Jul 28 03:35:44.128753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-905fe41e-268f-4047-9c9c-2ca42c4d13d4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:44.132329 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:44.132329 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:44.134976 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 57/126] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:44 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:44.162431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-905fe41e-268f-4047-9c9c-2ca42c4d13d4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:44.163255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-905fe41e-268f-4047-9c9c-2ca42c4d13d4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:44.654830 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-905fe41e-268f-4047-9c9c-2ca42c4d13d4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.542103 Jul 28 03:35:44.655993 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 70/127] 10.222.0.48 () {60 vars in 1191 bytes} [Thu Jul 28 03:35:44 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:44.671090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cf67ab6b-2be1-4240-b930-17ce7cb3e0ad tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:44.673803 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:44.673803 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:44.698548 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cf67ab6b-2be1-4240-b930-17ce7cb3e0ad tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.034491 Jul 28 03:35:44.699932 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 58/128] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Jul 28 03:35:44 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:44.712386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a44c57a8-4c6c-42a3-8365-655663411738 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:44.715513 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:44.715513 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:44.731362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a44c57a8-4c6c-42a3-8365-655663411738 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:44.733980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a44c57a8-4c6c-42a3-8365-655663411738 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:44.770536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:44.950942 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a44c57a8-4c6c-42a3-8365-655663411738 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.243225 Jul 28 03:35:44.960486 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 71/129] 10.222.0.48 () {60 vars in 1191 bytes} [Thu Jul 28 03:35:44 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:44.963998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2f70aaa3-fb1a-4d4a-bdec-a93af34be4ec tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:44.965682 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:44.965682 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:45.018012 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2f70aaa3-fb1a-4d4a-bdec-a93af34be4ec tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.057319 Jul 28 03:35:45.018645 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 59/130] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:35:44 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:45.028659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-070f2b35-18e2-42eb-a0bc-d3ef82914fb8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:45.029827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-070f2b35-18e2-42eb-a0bc-d3ef82914fb8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:45.041267 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c72e0a71-1559-45aa-9200-4457c068723f tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1064801516"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:45.051598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-070f2b35-18e2-42eb-a0bc-d3ef82914fb8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:45.052568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-070f2b35-18e2-42eb-a0bc-d3ef82914fb8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:45.054019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-070f2b35-18e2-42eb-a0bc-d3ef82914fb8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:45.057046 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:45.057046 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:45.059723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.aggregate [None req-c72e0a71-1559-45aa-9200-4457c068723f tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Generated uuid 923d0580-3c23-4f38-bb32-c824299328d8 for aggregate {{(pid=126072) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:45.059974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-070f2b35-18e2-42eb-a0bc-d3ef82914fb8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:45.103198 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c72e0a71-1559-45aa-9200-4457c068723f tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.066991 Jul 28 03:35:45.104926 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 60/131] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:45 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:45.113500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ed246c99-206e-403a-ab6c-dad5b2ee07c4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:45.116067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ed246c99-206e-403a-ab6c-dad5b2ee07c4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:45.127160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed246c99-206e-403a-ab6c-dad5b2ee07c4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:45.128042 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed246c99-206e-403a-ab6c-dad5b2ee07c4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:45.129065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed246c99-206e-403a-ab6c-dad5b2ee07c4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:45.129721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed246c99-206e-403a-ab6c-dad5b2ee07c4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:45.217484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ed246c99-206e-403a-ab6c-dad5b2ee07c4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:45.231146 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ed246c99-206e-403a-ab6c-dad5b2ee07c4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1266 microversion: 2.1 time: 0.124303 Jul 28 03:35:45.233051 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 61/132] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:45 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:45.241167 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-70d2f587-bc12-4ad5-b5fa-64d6a2bec1ce tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-3"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:45.245111 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:45.245111 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:45.259211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70d2f587-bc12-4ad5-b5fa-64d6a2bec1ce tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:45.261327 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70d2f587-bc12-4ad5-b5fa-64d6a2bec1ce tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:45.458021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-070f2b35-18e2-42eb-a0bc-d3ef82914fb8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:45.481699 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-070f2b35-18e2-42eb-a0bc-d3ef82914fb8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1320 microversion: 2.1 time: 0.457971 Jul 28 03:35:45.482617 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 72/133] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:45 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1320 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:45.531806 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-70d2f587-bc12-4ad5-b5fa-64d6a2bec1ce tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.297095 Jul 28 03:35:45.533546 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 62/134] 10.222.0.48 () {60 vars in 1191 bytes} [Thu Jul 28 03:35:45 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:45.547491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4567311c-73a1-4fd3-bc6f-5c6cb7650918 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:45.548444 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:45.548444 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:45.573274 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4567311c-73a1-4fd3-bc6f-5c6cb7650918 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.032537 Jul 28 03:35:45.576415 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 73/135] 10.222.0.48 () {58 vars in 1143 bytes} [Thu Jul 28 03:35:45 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:45.584475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:45.588263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2d8d445b-a3db-4c9e-87ac-848e341276e6 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-3"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:45.591656 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:45.591656 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:45.629866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d8d445b-a3db-4c9e-87ac-848e341276e6 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:45.630316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d8d445b-a3db-4c9e-87ac-848e341276e6 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:45.844574 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2d8d445b-a3db-4c9e-87ac-848e341276e6 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.258861 Jul 28 03:35:45.848437 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 63/136] 10.222.0.48 () {60 vars in 1191 bytes} [Thu Jul 28 03:35:45 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:45.859838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-120b9772-cc4f-4907-9954-38d2686ccc9f tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:45.861590 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:45.861590 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:45.909397 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-120b9772-cc4f-4907-9954-38d2686ccc9f tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.052262 Jul 28 03:35:45.924565 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 74/137] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:35:45 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:45.933661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-79cf36d8-8c18-4593-842a-eebf90c5d617 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-195713589"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:45.941109 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:45.941109 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:45.942207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.aggregate [None req-79cf36d8-8c18-4593-842a-eebf90c5d617 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Generated uuid 59ba5115-03b7-45ff-bd9a-980d95317115 for aggregate {{(pid=126072) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:45.998523 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-79cf36d8-8c18-4593-842a-eebf90c5d617 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.072743 Jul 28 03:35:45.999403 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 64/138] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:45 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:35:46.023412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-248f9385-7cf6-4409-8242-0437dce32d06 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:46.028269 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:46.028269 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:46.045589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-248f9385-7cf6-4409-8242-0437dce32d06 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:46.046937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-248f9385-7cf6-4409-8242-0437dce32d06 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:46.220279 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-248f9385-7cf6-4409-8242-0437dce32d06 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.209816 Jul 28 03:35:46.228847 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 75/139] 10.222.0.48 () {60 vars in 1191 bytes} [Thu Jul 28 03:35:46 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:46.234498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e9d11d28-a9ff-4b32-9dfb-423c2830b8b0 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-3"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:46.237979 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:46.237979 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:46.252300 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e9d11d28-a9ff-4b32-9dfb-423c2830b8b0 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:46.253007 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e9d11d28-a9ff-4b32-9dfb-423c2830b8b0 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:46.259450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6661380f-b5c6-49e9-99e6-b58fa66c2953 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:46.260190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6661380f-b5c6-49e9-99e6-b58fa66c2953 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:46.267338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6661380f-b5c6-49e9-99e6-b58fa66c2953 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:46.268177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6661380f-b5c6-49e9-99e6-b58fa66c2953 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:46.269052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6661380f-b5c6-49e9-99e6-b58fa66c2953 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:46.269490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6661380f-b5c6-49e9-99e6-b58fa66c2953 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:46.400169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6661380f-b5c6-49e9-99e6-b58fa66c2953 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:46.411857 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e9d11d28-a9ff-4b32-9dfb-423c2830b8b0 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.182247 Jul 28 03:35:46.412492 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 65/140] 10.222.0.48 () {60 vars in 1191 bytes} [Thu Jul 28 03:35:46 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:35:46.416622 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6661380f-b5c6-49e9-99e6-b58fa66c2953 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1272 microversion: 2.1 time: 0.162069 Jul 28 03:35:46.424135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-15e6aac9-6b14-43e3-bc4a-4e479e851880 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:46.426667 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 76/141] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:46 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:46.427319 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:46.427319 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:46.469949 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-15e6aac9-6b14-43e3-bc4a-4e479e851880 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.049708 Jul 28 03:35:46.470845 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 66/142] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:35:46 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:46.481058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ec12970b-44db-4e9e-acd5-138f5c692db4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1501114596"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:46.484039 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:46.484039 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:46.485286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.aggregate [None req-ec12970b-44db-4e9e-acd5-138f5c692db4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Generated uuid b682c755-aaef-42b1-aa26-cf35ef126862 for aggregate {{(pid=126071) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:46.506329 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f8998a8f-0350-4b7c-ba26-e8a8dc45a233 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:46.507554 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f8998a8f-0350-4b7c-ba26-e8a8dc45a233 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:46.518184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f8998a8f-0350-4b7c-ba26-e8a8dc45a233 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:46.519078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f8998a8f-0350-4b7c-ba26-e8a8dc45a233 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:46.522861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f8998a8f-0350-4b7c-ba26-e8a8dc45a233 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:46.523535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f8998a8f-0350-4b7c-ba26-e8a8dc45a233 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:46.558699 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ec12970b-44db-4e9e-acd5-138f5c692db4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.081282 Jul 28 03:35:46.559919 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 77/143] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:46.564999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc488af9-fe08-4655-b298-26093b590ed6 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2098626361"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:46.574261 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:46.574261 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:46.575339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.aggregate [None req-dc488af9-fe08-4655-b298-26093b590ed6 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Generated uuid c80730be-d876-40e9-80ba-54a1b54607f7 for aggregate {{(pid=126071) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:46.620283 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc488af9-fe08-4655-b298-26093b590ed6 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058970 Jul 28 03:35:46.620939 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 78/144] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:46 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:46.627929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c8a07deb-2200-491b-997d-96766085c2cf tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:46.628836 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:46.628836 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:46.695089 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c8a07deb-2200-491b-997d-96766085c2cf tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.073043 Jul 28 03:35:46.696438 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 79/145] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:35:46 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:46.701816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-869faed3-8cb1-4fd3-85d7-1b6677c062a5 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:46.704703 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:46.704703 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:46.730811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-869faed3-8cb1-4fd3-85d7-1b6677c062a5 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:46.731254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-869faed3-8cb1-4fd3-85d7-1b6677c062a5 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:46.958835 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-869faed3-8cb1-4fd3-85d7-1b6677c062a5 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 242 microversion: 2.1 time: 0.260596 Jul 28 03:35:46.959867 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 80/146] 10.222.0.48 () {60 vars in 1191 bytes} [Thu Jul 28 03:35:46 2022] POST /compute/v2.1/os-aggregates/6/action => generated 242 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:46.966309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a0e00de3-59f8-45eb-ac51-308d733cd5a3 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:46.967591 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:46.967591 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:46.986692 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-a0e00de3-59f8-45eb-ac51-308d733cd5a3 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a0e00de3-59f8-45eb-ac51-308d733cd5a3 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Request method failure captured: Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPoi5B-R6lY-rxWr1EBPS8Yb8VC17GzBVE15IXUtCXihl6o46VeTByz9sWtpZOkOZeQCNXsCOEJowNjOwtD7n_CFgXskaOfV0BbS4Q17S8YhExmPkOYS28egYM0kMs-KUiQxEdzANFFed1pS3-sboPI9EJ78erLVFmZAzsFAkhY2T4 Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 5453c503557e477d9882d981b6979712 Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AggregatesAdminTestJSON-332443637 Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:35:46.996853 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:35:46.998465 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5453c503557e477d9882d981b6979712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5453c503557e477d9882d981b6979712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5453c503557e477d9882d981b6979712"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5453c503557e477d9882d981b6979712"}]}] Jul 28 03:35:46.998465 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AggregatesAdminTestJSON-332443637 Jul 28 03:35:46.998465 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 5453c503557e477d9882d981b6979712 Jul 28 03:35:46.998465 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-332443637 Jul 28 03:35:46.998465 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AggregatesAdminTestJSON-332443637-project-admin Jul 28 03:35:46.998465 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:46.998465 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:46.998465 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d209067803464329bd75239b349aab1b Jul 28 03:35:46.998465 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AggregatesAdminTestJSON-332443637-project-admin Jul 28 03:35:46.998465 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:35:46.998465 n-d-826756-3 devstack@n-api.service[126071]: exception: Aggregate 5 could not be found. Jul 28 03:35:46.998465 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '5'} Jul 28 03:35:46.998465 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6461, in get_aggregate Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:46.999389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 28 03:35:47.000670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.004979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a0e00de3-59f8-45eb-ac51-308d733cd5a3 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:47.006313 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a0e00de3-59f8-45eb-ac51-308d733cd5a3 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.044673 Jul 28 03:35:47.008095 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 81/147] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Jul 28 03:35:46 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:35:47.014495 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f8998a8f-0350-4b7c-ba26-e8a8dc45a233 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:47.030107 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f8998a8f-0350-4b7c-ba26-e8a8dc45a233 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1320 microversion: 2.1 time: 0.530125 Jul 28 03:35:47.030982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e159e4e1-ff58-4680-9621-3ec08d9f1b45 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:47.033545 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 67/148] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:46 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1320 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:47.042259 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.042259 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:47.045410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8eb4ca0e-5c2a-451c-b62e-ee4457d295fb tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:47.047180 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.047180 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.065308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e159e4e1-ff58-4680-9621-3ec08d9f1b45 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:47.066625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e159e4e1-ff58-4680-9621-3ec08d9f1b45 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:47.077694 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-8eb4ca0e-5c2a-451c-b62e-ee4457d295fb tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8eb4ca0e-5c2a-451c-b62e-ee4457d295fb tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Request method failure captured: Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gPoi5B-R6lY-rxWr1EBPS8Yb8VC17GzBVE15IXUtCXihl6o46VeTByz9sWtpZOkOZeQCNXsCOEJowNjOwtD7n_CFgXskaOfV0BbS4Q17S8YhExmPkOYS28egYM0kMs-KUiQxEdzANFFed1pS3-sboPI9EJ78erLVFmZAzsFAkhY2T4 Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 5453c503557e477d9882d981b6979712 Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AggregatesAdminTestJSON-332443637 Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:35:47.082488 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:35:47.083811 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5453c503557e477d9882d981b6979712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5453c503557e477d9882d981b6979712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5453c503557e477d9882d981b6979712"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5453c503557e477d9882d981b6979712"}]}] Jul 28 03:35:47.083811 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AggregatesAdminTestJSON-332443637 Jul 28 03:35:47.083811 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 5453c503557e477d9882d981b6979712 Jul 28 03:35:47.083811 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-332443637 Jul 28 03:35:47.083811 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AggregatesAdminTestJSON-332443637-project-admin Jul 28 03:35:47.083811 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:47.083811 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:47.083811 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: d209067803464329bd75239b349aab1b Jul 28 03:35:47.083811 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AggregatesAdminTestJSON-332443637-project-admin Jul 28 03:35:47.083811 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:35:47.083811 n-d-826756-3 devstack@n-api.service[126072]: exception: Aggregate 5 could not be found. Jul 28 03:35:47.083811 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '5'} Jul 28 03:35:47.083811 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6514, in delete_aggregate Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:35:47.084596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.085843 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:47.087205 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:47.087205 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:47.087205 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:47.087205 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jul 28 03:35:47.087205 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.087205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8eb4ca0e-5c2a-451c-b62e-ee4457d295fb tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:47.087205 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8eb4ca0e-5c2a-451c-b62e-ee4457d295fb tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.048698 Jul 28 03:35:47.094235 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 68/149] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:35:47 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:35:47.104046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-13cca236-87c5-4201-a1be-ab714cdeb309 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1924641796", "name": "tempest-test_aggregate-1665056830"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:47.108327 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.108327 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.110164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.aggregate [None req-13cca236-87c5-4201-a1be-ab714cdeb309 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Generated uuid 64e81b03-75ac-413c-8075-4ae2776f7dd9 for aggregate {{(pid=126072) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:47.121569 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e159e4e1-ff58-4680-9621-3ec08d9f1b45 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h1-826756-3. Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e159e4e1-ff58-4680-9621-3ec08d9f1b45 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Request method failure captured: Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 39 Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPpQr9BAFw4TZGeh-soncQn6lFQ0p3om8cd--ZwiVMDNmKB8E8bTJ0zwlalfTGl8W9j5Z-A46wIN9BmwDSijxvbdZWYYbPcJkSWB3QsprbfG7mZsrWvsVgBPudwOqvMhr1_LkiLLqcHWXsjiAMzqgWJenMQ2-ujzIIlgHAMYLafutQ Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:35:47.129655 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:35:47.131220 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}] Jul 28 03:35:47.131220 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:47.131220 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:47.131220 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:47.131220 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:47.131220 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:47.131220 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:47.131220 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 3ded6de5177d4666b9b9f3be738cdd0d Jul 28 03:35:47.131220 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:47.131220 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:35:47.131220 n-d-826756-3 devstack@n-api.service[126071]: {"add_host": {"host": "n-h1-826756-3"}} Jul 28 03:35:47.131220 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:35:47.131220 n-d-826756-3 devstack@n-api.service[126071]: exception: Aggregate 6 already has host n-h1-826756-3. Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h1-826756-3'}}} Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result.read() Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 03:35:47.132106 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-826756-3-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi session.flush() Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 03:35:47.133680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 03:35:47.135365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 03:35:47.137070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result.read() Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-826756-3-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 28, 3, 35, 47, 108321), 'updated_at': None, 'host': 'n-h1-826756-3', 'aggregate_id': 6}] Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.138334 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6638, in add_host_to_aggregate Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h1-826756-3. Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.141639 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h1-826756-3. Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:47.143655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:47.146109 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h1-826756-3. Jul 28 03:35:47.146109 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.146109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e159e4e1-ff58-4680-9621-3ec08d9f1b45 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Returning 409 to user: Aggregate 6 already has host n-h1-826756-3. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:47.148114 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e159e4e1-ff58-4680-9621-3ec08d9f1b45 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.138123 Jul 28 03:35:47.151176 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 82/150] 10.222.0.48 () {60 vars in 1191 bytes} [Thu Jul 28 03:35:47 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 28 03:35:47.162483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-920d2ea2-c0b1-404f-a063-8ca3eec49da5 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:47.165696 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.165696 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:47.178072 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-13cca236-87c5-4201-a1be-ab714cdeb309 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.078685 Jul 28 03:35:47.180597 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 69/151] 10.222.0.48 () {60 vars in 1165 bytes} [Thu Jul 28 03:35:47 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:47.192225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-920d2ea2-c0b1-404f-a063-8ca3eec49da5 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:47.193063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-920d2ea2-c0b1-404f-a063-8ca3eec49da5 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:47.203826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ad575a37-38de-41e2-b48e-7bfd6439bb0b tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:47.205120 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.205120 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.272867 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ad575a37-38de-41e2-b48e-7bfd6439bb0b tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.067574 Jul 28 03:35:47.280649 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 70/152] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:35:47 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:47.289274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e97c4ae0-8ab6-42b1-9569-37b7e020a069 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:47.291363 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.291363 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.299509 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-e97c4ae0-8ab6-42b1-9569-37b7e020a069 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e97c4ae0-8ab6-42b1-9569-37b7e020a069 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Request method failure captured: Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gPoi5B-R6lY-rxWr1EBPS8Yb8VC17GzBVE15IXUtCXihl6o46VeTByz9sWtpZOkOZeQCNXsCOEJowNjOwtD7n_CFgXskaOfV0BbS4Q17S8YhExmPkOYS28egYM0kMs-KUiQxEdzANFFed1pS3-sboPI9EJ78erLVFmZAzsFAkhY2T4 Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 5453c503557e477d9882d981b6979712 Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AggregatesAdminTestJSON-332443637 Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:35:47.302915 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:35:47.304111 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5453c503557e477d9882d981b6979712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5453c503557e477d9882d981b6979712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5453c503557e477d9882d981b6979712"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5453c503557e477d9882d981b6979712"}]}] Jul 28 03:35:47.304111 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AggregatesAdminTestJSON-332443637 Jul 28 03:35:47.304111 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 5453c503557e477d9882d981b6979712 Jul 28 03:35:47.304111 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-332443637 Jul 28 03:35:47.304111 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AggregatesAdminTestJSON-332443637-project-admin Jul 28 03:35:47.304111 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:47.304111 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:47.304111 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: d209067803464329bd75239b349aab1b Jul 28 03:35:47.304111 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AggregatesAdminTestJSON-332443637-project-admin Jul 28 03:35:47.304111 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:35:47.304111 n-d-826756-3 devstack@n-api.service[126072]: exception: Aggregate 7 could not be found. Jul 28 03:35:47.304111 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '7'} Jul 28 03:35:47.304111 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6461, in get_aggregate Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.305001 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 28 03:35:47.306025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.309033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e97c4ae0-8ab6-42b1-9569-37b7e020a069 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:47.310212 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e97c4ae0-8ab6-42b1-9569-37b7e020a069 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.028280 Jul 28 03:35:47.311307 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 71/153] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Jul 28 03:35:47 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:35:47.321213 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d4beda4b-6f2f-421a-a01f-d3dbb9d66a91 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:47.322990 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.322990 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.336756 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-d4beda4b-6f2f-421a-a01f-d3dbb9d66a91 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d4beda4b-6f2f-421a-a01f-d3dbb9d66a91 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Request method failure captured: Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gPoi5B-R6lY-rxWr1EBPS8Yb8VC17GzBVE15IXUtCXihl6o46VeTByz9sWtpZOkOZeQCNXsCOEJowNjOwtD7n_CFgXskaOfV0BbS4Q17S8YhExmPkOYS28egYM0kMs-KUiQxEdzANFFed1pS3-sboPI9EJ78erLVFmZAzsFAkhY2T4 Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 5453c503557e477d9882d981b6979712 Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AggregatesAdminTestJSON-332443637 Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:35:47.339261 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:35:47.341229 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5453c503557e477d9882d981b6979712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5453c503557e477d9882d981b6979712"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5453c503557e477d9882d981b6979712"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5453c503557e477d9882d981b6979712"}]}] Jul 28 03:35:47.341229 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AggregatesAdminTestJSON-332443637 Jul 28 03:35:47.341229 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 5453c503557e477d9882d981b6979712 Jul 28 03:35:47.341229 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-332443637 Jul 28 03:35:47.341229 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AggregatesAdminTestJSON-332443637-project-admin Jul 28 03:35:47.341229 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:47.341229 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:47.341229 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: d209067803464329bd75239b349aab1b Jul 28 03:35:47.341229 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AggregatesAdminTestJSON-332443637-project-admin Jul 28 03:35:47.341229 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:35:47.341229 n-d-826756-3 devstack@n-api.service[126072]: exception: Aggregate 7 could not be found. Jul 28 03:35:47.341229 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '7'} Jul 28 03:35:47.341229 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6514, in delete_aggregate Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:35:47.342377 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:47.343415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:47.344553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:47.344553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:47.344553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:47.344553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jul 28 03:35:47.344553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:47.347201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d4beda4b-6f2f-421a-a01f-d3dbb9d66a91 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:47.348189 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d4beda4b-6f2f-421a-a01f-d3dbb9d66a91 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.031805 Jul 28 03:35:47.349688 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 72/154] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:35:47 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:35:47.359775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-97e8f600-9ab2-43f0-ad5b-f0a6db3ac75f tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1819075740"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:47.375938 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.375938 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.378561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.aggregate [None req-97e8f600-9ab2-43f0-ad5b-f0a6db3ac75f tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Generated uuid 7512debe-110e-4f44-9236-48b7d0f3d6b5 for aggregate {{(pid=126072) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:47.414769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:DELETE=7 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:47.421703 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-97e8f600-9ab2-43f0-ad5b-f0a6db3ac75f tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067082 Jul 28 03:35:47.422928 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 73/155] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:47.436016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8ca26f8d-36dc-488e-b9c9-b7abce138eca tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:47.438279 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.438279 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.449629 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-920d2ea2-c0b1-404f-a063-8ca3eec49da5 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.293910 Jul 28 03:35:47.453120 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 83/156] 10.222.0.48 () {60 vars in 1191 bytes} [Thu Jul 28 03:35:47 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:47.456543 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8ca26f8d-36dc-488e-b9c9-b7abce138eca tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.026054 Jul 28 03:35:47.459578 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 74/157] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Jul 28 03:35:47 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:35:47.466030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d8d5719e-8b98-4198-96e0-e117600500ed tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:47.467907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0d740243-b8e9-44b8-8985-eb381f149a41 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:47.468953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d8d5719e-8b98-4198-96e0-e117600500ed tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:47.472863 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.472863 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.486875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8d5719e-8b98-4198-96e0-e117600500ed tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:47.497516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8d5719e-8b98-4198-96e0-e117600500ed tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:47.499678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8d5719e-8b98-4198-96e0-e117600500ed tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:47.501892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8d5719e-8b98-4198-96e0-e117600500ed tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:47.507838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=10,nova_api:INSERT=7 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:47.533155 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0d740243-b8e9-44b8-8985-eb381f149a41 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.072289 Jul 28 03:35:47.534398 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 75/158] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:35:47 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:47.547324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-53874c86-3173-4f84-bab2-d942ff5b0b46 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:47.557729 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.557729 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.605898 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-53874c86-3173-4f84-bab2-d942ff5b0b46 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.070211 Jul 28 03:35:47.609103 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 76/159] 10.222.0.48 () {60 vars in 1191 bytes} [Thu Jul 28 03:35:47 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:47.616841 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1b22b793-63e8-4517-94b3-abc37022a746 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1665537492"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:47.623097 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.623097 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.624144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.aggregate [None req-1b22b793-63e8-4517-94b3-abc37022a746 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Generated uuid 39bd4251-7633-4381-a6e3-0db09d9ffa00 for aggregate {{(pid=126072) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:47.673226 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1b22b793-63e8-4517-94b3-abc37022a746 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062698 Jul 28 03:35:47.673873 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 77/160] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:47.690057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0575f79e-8645-467c-a1ce-ab0716688faf tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Calling method '.version_select at 0x7ffa75166b80>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:47.693356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d8d5719e-8b98-4198-96e0-e117600500ed tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:47.698108 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.698108 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.699511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0575f79e-8645-467c-a1ce-ab0716688faf tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:47.699959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0575f79e-8645-467c-a1ce-ab0716688faf tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:47.700789 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0575f79e-8645-467c-a1ce-ab0716688faf tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:47.701216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0575f79e-8645-467c-a1ce-ab0716688faf tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:47.708490 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d8d5719e-8b98-4198-96e0-e117600500ed tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1272 microversion: 2.1 time: 0.253925 Jul 28 03:35:47.709223 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 84/161] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:47 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1272 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:47.717676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f9f1f96f-51e2-4666-b494-6af4ee5b3a8c tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:47.718665 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.718665 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:47.742173 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f9f1f96f-51e2-4666-b494-6af4ee5b3a8c tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.030509 Jul 28 03:35:47.749641 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 85/162] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Jul 28 03:35:47 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:47.765953 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0575f79e-8645-467c-a1ce-ab0716688faf tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.084203 Jul 28 03:35:47.766861 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 78/163] 10.222.0.48 () {58 vars in 1128 bytes} [Thu Jul 28 03:35:47 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:47.777065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-04fd3b84-dddb-4e1b-8d76-3fcf4165ba7f tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:47.778198 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.778198 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.806350 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-04fd3b84-dddb-4e1b-8d76-3fcf4165ba7f tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.036833 Jul 28 03:35:47.807407 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 79/164] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:35:47 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:47.814756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fca43a7a-8dbd-4e4d-896c-d215dbd5b528 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Calling method '.version_select at 0x7ffa751663a0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:47.817543 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.817543 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.818988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fca43a7a-8dbd-4e4d-896c-d215dbd5b528 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:47.819432 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fca43a7a-8dbd-4e4d-896c-d215dbd5b528 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:47.820258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fca43a7a-8dbd-4e4d-896c-d215dbd5b528 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:47.833841 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fca43a7a-8dbd-4e4d-896c-d215dbd5b528 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:47.874329 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fca43a7a-8dbd-4e4d-896c-d215dbd5b528 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.059161 Jul 28 03:35:47.875914 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 80/165] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 03:35:47 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:47.895336 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3cf7b510-0663-4b1d-a57a-cacc106a3adc tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1258621673", "availability_zone": "tempest-test_az-1285831359"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:47.899293 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.899293 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.900826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.aggregate [None req-3cf7b510-0663-4b1d-a57a-cacc106a3adc tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Generated uuid 6a8fd068-5056-47a4-a508-09854b04558f for aggregate {{(pid=126072) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:47.944327 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3cf7b510-0663-4b1d-a57a-cacc106a3adc tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.066895 Jul 28 03:35:47.952764 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 81/166] 10.222.0.48 () {60 vars in 1165 bytes} [Thu Jul 28 03:35:47 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:47.952764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4a68be7c-e7ec-454a-ba1f-a897b882190e tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Calling method '.version_select at 0x7ffa75166dc0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:47.955169 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:47.955169 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:47.956571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a68be7c-e7ec-454a-ba1f-a897b882190e tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:47.957189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a68be7c-e7ec-454a-ba1f-a897b882190e tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:47.958180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a68be7c-e7ec-454a-ba1f-a897b882190e tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:47.958888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a68be7c-e7ec-454a-ba1f-a897b882190e tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:47.998628 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4a68be7c-e7ec-454a-ba1f-a897b882190e tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.049360 Jul 28 03:35:48.001955 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 82/167] 10.222.0.48 () {58 vars in 1128 bytes} [Thu Jul 28 03:35:47 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:48.011818 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-90fbc580-ee95-4c61-b2fd-bf1f34db4a0b tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-664378193"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:48.017269 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:48.017269 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:48.022197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.aggregate [None req-90fbc580-ee95-4c61-b2fd-bf1f34db4a0b tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Generated uuid 06d85287-db20-43d8-af58-a4b745f11f6c for aggregate {{(pid=126072) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:48.061487 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-90fbc580-ee95-4c61-b2fd-bf1f34db4a0b tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.056244 Jul 28 03:35:48.062295 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 83/168] 10.222.0.48 () {62 vars in 1205 bytes} [Thu Jul 28 03:35:48 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:35:48.076244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-49e21a1c-dde7-49cd-b640-1bcd3ce8eea8 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1258621673_new", "availability_zone": "tempest-test_az-1285831359_new"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:48.125047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1eb05a3d-e3e8-4e74-a0a6-cb609dc8dbb1 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:48.129817 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:48.129817 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:48.132155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1eb05a3d-e3e8-4e74-a0a6-cb609dc8dbb1 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'ce2111f438e042bf8c40cbbbf57b064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23456cb2ff40b1a5c36f154b7035a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1eb05a3d-e3e8-4e74-a0a6-cb609dc8dbb1 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Request method failure captured: Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 39 Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPmLQhJtNUtB9W86OgamFbwDZPFdKbBNbpSxoKKePV-ThSl2KNkYLYlSiIf8ZN8nxu_XqNA3CyUrhY9R6-pVt39juNg4Ekxsq_5Ac8LM-3N9svV3CUabSp_FrY91d4mpV4LrwrYzl2NLQ6Ezw-nzANI9NYB9nlaQo8oe19Nc8qPy0c Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ca23456cb2ff40b1a5c36f154b7035a2 Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:35:48.142000 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:35:48.143473 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca23456cb2ff40b1a5c36f154b7035a2"}]}] Jul 28 03:35:48.143473 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:48.143473 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ca23456cb2ff40b1a5c36f154b7035a2 Jul 28 03:35:48.143473 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:48.143473 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AggregatesAdminNegativeTestJSON-1781367841-project Jul 28 03:35:48.143473 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:48.143473 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:48.143473 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ce2111f438e042bf8c40cbbbf57b064e Jul 28 03:35:48.143473 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841-project Jul 28 03:35:48.143473 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:35:48.143473 n-d-826756-3 devstack@n-api.service[126071]: {"add_host": {"host": "n-h1-826756-3"}} Jul 28 03:35:48.143473 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:35:48.143473 n-d-826756-3 devstack@n-api.service[126071]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h1-826756-3'}}} Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:48.144238 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 28 03:35:48.145316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:48.150824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1eb05a3d-e3e8-4e74-a0a6-cb609dc8dbb1 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:48.152027 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1eb05a3d-e3e8-4e74-a0a6-cb609dc8dbb1 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.400178 Jul 28 03:35:48.153228 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 86/169] 10.222.0.48 () {60 vars in 1191 bytes} [Thu Jul 28 03:35:47 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 403 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:48.158936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-49f69872-8ad1-41d0-892e-c3aaaeebb3f2 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Calling method '.version_select at 0x7ffa74ea4a60>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:48.161073 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:48.161073 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:48.173340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49f69872-8ad1-41d0-892e-c3aaaeebb3f2 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:48.174676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49f69872-8ad1-41d0-892e-c3aaaeebb3f2 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:48.194008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49f69872-8ad1-41d0-892e-c3aaaeebb3f2 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:48.194657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49f69872-8ad1-41d0-892e-c3aaaeebb3f2 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:48.227846 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-49f69872-8ad1-41d0-892e-c3aaaeebb3f2 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-h1-826756-3" status: 200 len: 467 microversion: 2.1 time: 0.073277 Jul 28 03:35:48.229222 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 87/170] 10.222.0.48 () {58 vars in 1170 bytes} [Thu Jul 28 03:35:48 2022] GET /compute/v2.1/os-hosts/n-h1-826756-3 => generated 467 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:48.238001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a1a17d76-fadd-4392-96d0-e6caedc5188e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:48.239038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a1a17d76-fadd-4392-96d0-e6caedc5188e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:48.247817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1a17d76-fadd-4392-96d0-e6caedc5188e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:48.248595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1a17d76-fadd-4392-96d0-e6caedc5188e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:48.249758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1a17d76-fadd-4392-96d0-e6caedc5188e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:48.250444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1a17d76-fadd-4392-96d0-e6caedc5188e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:48.386500 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:48.386500 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:48.432427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-49e21a1c-dde7-49cd-b640-1bcd3ce8eea8 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:48.434176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-49e21a1c-dde7-49cd-b640-1bcd3ce8eea8 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:48.487531 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-49e21a1c-dde7-49cd-b640-1bcd3ce8eea8 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 337 microversion: 2.1 time: 0.416316 Jul 28 03:35:48.490244 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 84/171] 10.222.0.48 () {60 vars in 1173 bytes} [Thu Jul 28 03:35:48 2022] PUT /compute/v2.1/os-aggregates/10 => generated 337 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:48.510013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8b1ed928-3c72-49ac-8600-20b11f0e0a9d tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-951767313"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:48.517156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a1a17d76-fadd-4392-96d0-e6caedc5188e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:48.517595 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:48.517595 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:48.530259 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a1a17d76-fadd-4392-96d0-e6caedc5188e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1320 microversion: 2.1 time: 0.299677 Jul 28 03:35:48.537298 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 88/172] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:48 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:48.543467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c8d19c9-3c3f-4a65-8b4e-f7e40f723efd tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:48.544814 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:48.544814 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:48.592449 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8b1ed928-3c72-49ac-8600-20b11f0e0a9d tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 299 microversion: 2.41 time: 0.098714 Jul 28 03:35:48.593514 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 85/173] 10.222.0.48 () {62 vars in 1213 bytes} [Thu Jul 28 03:35:48 2022] PUT /compute/v2.1/os-aggregates/11 => generated 299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:35:48.605387 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c8d19c9-3c3f-4a65-8b4e-f7e40f723efd tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.066560 Jul 28 03:35:48.607762 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 89/174] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:35:48 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:48.622539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94e01cdd-3af3-4f46-9581-869e894f5c89 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:48.624275 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:48.624275 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:48.633819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7cd3abcc-4a89-4ba6-ae6a-7df89e72a5b5 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Calling method '.version_select at 0x7ffa751f7c10>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:48.638344 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:48.638344 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:48.650618 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-94e01cdd-3af3-4f46-9581-869e894f5c89 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 578 microversion: 2.1 time: 0.041030 Jul 28 03:35:48.656276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cd3abcc-4a89-4ba6-ae6a-7df89e72a5b5 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:48.666706 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 90/175] 10.222.0.48 () {58 vars in 1143 bytes} [Thu Jul 28 03:35:48 2022] GET /compute/v2.1/os-aggregates => generated 578 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:48.667163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cd3abcc-4a89-4ba6-ae6a-7df89e72a5b5 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:48.693454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b2c3f30-d564-4e98-93d6-581439293a9a tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:48.694177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cd3abcc-4a89-4ba6-ae6a-7df89e72a5b5 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:48.695287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cd3abcc-4a89-4ba6-ae6a-7df89e72a5b5 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:48.696283 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:48.696283 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:48.721183 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b2c3f30-d564-4e98-93d6-581439293a9a tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 299 microversion: 2.41 time: 0.053872 Jul 28 03:35:48.731581 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 91/176] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jul 28 03:35:48 2022] GET /compute/v2.1/os-aggregates/11 => generated 299 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:35:48.739322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-309d0cd4-6b3d-49d8-a4b6-cbd2e2d15644 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1544087740"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:48.745885 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:48.745885 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:48.747410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.aggregate [None req-309d0cd4-6b3d-49d8-a4b6-cbd2e2d15644 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Generated uuid 5a3ae61d-774b-4271-9907-684264bdd234 for aggregate {{(pid=126071) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:48.776289 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7cd3abcc-4a89-4ba6-ae6a-7df89e72a5b5 tempest-HostsAdminTestJSON-1745239690 tempest-HostsAdminTestJSON-1745239690-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-h2-826756-3" status: 200 len: 467 microversion: 2.1 time: 0.161226 Jul 28 03:35:48.781123 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 86/177] 10.222.0.48 () {58 vars in 1170 bytes} [Thu Jul 28 03:35:48 2022] GET /compute/v2.1/os-hosts/n-h2-826756-3 => generated 467 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:48.789022 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-309d0cd4-6b3d-49d8-a4b6-cbd2e2d15644 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.055649 Jul 28 03:35:48.795738 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 92/178] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:48 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:48.795931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-03e5a58f-ffd9-4499-9720-45277fc87627 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:48.796545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-03e5a58f-ffd9-4499-9720-45277fc87627 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:48.800528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8fa02eff-7573-4ccb-8349-5881787da0d4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:48.803104 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:48.803104 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:48.807229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03e5a58f-ffd9-4499-9720-45277fc87627 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:48.808162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03e5a58f-ffd9-4499-9720-45277fc87627 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:48.810832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03e5a58f-ffd9-4499-9720-45277fc87627 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:48.811289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03e5a58f-ffd9-4499-9720-45277fc87627 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:48.859809 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8fa02eff-7573-4ccb-8349-5881787da0d4 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.075942 Jul 28 03:35:48.860803 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 87/179] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 03:35:48 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:48.870935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2947049b-d682-42b3-9059-76bd318c9ba3 tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-3"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:48.881492 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:48.881492 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:48.900496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2947049b-d682-42b3-9059-76bd318c9ba3 tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:48.904878 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2947049b-d682-42b3-9059-76bd318c9ba3 tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:48.928337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-03e5a58f-ffd9-4499-9720-45277fc87627 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:48.939041 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-03e5a58f-ffd9-4499-9720-45277fc87627 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1272 microversion: 2.1 time: 0.147466 Jul 28 03:35:48.940392 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 93/180] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:48 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1272 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:48.945415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6b03653c-902b-40b5-861f-e9f875a50320 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2146118799"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:48.949470 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:48.949470 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:48.967223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b03653c-902b-40b5-861f-e9f875a50320 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:48.967651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b03653c-902b-40b5-861f-e9f875a50320 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:48.975877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=15 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:49.001615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b03653c-902b-40b5-861f-e9f875a50320 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:49.005452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b03653c-902b-40b5-861f-e9f875a50320 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:49.028546 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-6b03653c-902b-40b5-861f-e9f875a50320 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2146118799 could not be found. Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6b03653c-902b-40b5-861f-e9f875a50320 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Request method failure captured: Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 58 Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPpQr9BAFw4TZGeh-soncQn6lFQ0p3om8cd--ZwiVMDNmKB8E8bTJ0zwlalfTGl8W9j5Z-A46wIN9BmwDSijxvbdZWYYbPcJkSWB3QsprbfG7mZsrWvsVgBPudwOqvMhr1_LkiLLqcHWXsjiAMzqgWJenMQ2-ujzIIlgHAMYLafutQ Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:35:49.030907 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:35:49.032563 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}] Jul 28 03:35:49.032563 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:49.032563 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:49.032563 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:49.032563 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:49.032563 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:49.032563 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:49.032563 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 3ded6de5177d4666b9b9f3be738cdd0d Jul 28 03:35:49.032563 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:49.032563 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:35:49.032563 n-d-826756-3 devstack@n-api.service[126071]: {"add_host": {"host": "tempest-nonexist_host-2146118799"}} Jul 28 03:35:49.032563 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:35:49.032563 n-d-826756-3 devstack@n-api.service[126071]: exception: Compute host tempest-nonexist_host-2146118799 could not be found. Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-2146118799'}}} Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in _get_service_in_cell_by_host Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2146118799' is not mapped to any cell Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.033422 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6061, in _find_service_in_cell Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6618, in add_host_to_aggregate Jul 28 03:35:49.034697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6001, in _get_service_in_cell_by_host Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2146118799 could not be found. Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2146118799 could not be found. Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.035975 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.037183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.037183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.037183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.037183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:49.037183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:49.037183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2146118799 could not be found. Jul 28 03:35:49.037183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.037183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6b03653c-902b-40b5-861f-e9f875a50320 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2146118799 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:49.037183 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6b03653c-902b-40b5-861f-e9f875a50320 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 111 microversion: 2.1 time: 0.091415 Jul 28 03:35:49.043702 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 94/181] 10.222.0.48 () {60 vars in 1194 bytes} [Thu Jul 28 03:35:48 2022] POST /compute/v2.1/os-aggregates/12/action => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:49.059328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06b0b99e-8893-4065-8e80-31f6f875cf44 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-571274622"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:49.062003 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:49.062003 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:49.062991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.aggregate [None req-06b0b99e-8893-4065-8e80-31f6f875cf44 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Generated uuid 84152cc0-9a45-4047-b5a5-45b4db3c2be0 for aggregate {{(pid=126071) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:49.101992 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-06b0b99e-8893-4065-8e80-31f6f875cf44 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057050 Jul 28 03:35:49.103260 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 95/182] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:49.112406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d6c012be-447b-4650-a3a4-7f27f0b98046 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:49.113192 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:49.113192 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:49.158767 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d6c012be-447b-4650-a3a4-7f27f0b98046 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.050245 Jul 28 03:35:49.159451 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 96/183] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 03:35:49 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:49.168506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c6bc163b-14da-4600-81d9-9c6ffd7e96a8 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:49.179966 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:49.179966 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:49.189586 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c6bc163b-14da-4600-81d9-9c6ffd7e96a8 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 483 microversion: 2.1 time: 0.024560 Jul 28 03:35:49.190112 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 97/184] 10.222.0.48 () {58 vars in 1143 bytes} [Thu Jul 28 03:35:49 2022] GET /compute/v2.1/os-aggregates => generated 483 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:49.199184 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2947049b-d682-42b3-9059-76bd318c9ba3 tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 314 microversion: 2.41 time: 0.337001 Jul 28 03:35:49.200299 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 88/185] 10.222.0.48 () {62 vars in 1235 bytes} [Thu Jul 28 03:35:48 2022] POST /compute/v2.1/os-aggregates/11/action => generated 314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:35:49.200935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2ac1169-ec85-41cd-a598-e9cf080f9d6e tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:49.212949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-af9388c7-7234-48be-86a5-fb0c1e1a7185 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:49.214433 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:49.214433 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2ac1169-ec85-41cd-a598-e9cf080f9d6e tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Request method failure captured: Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 283 Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPpQr9BAFw4TZGeh-soncQn6lFQ0p3om8cd--ZwiVMDNmKB8E8bTJ0zwlalfTGl8W9j5Z-A46wIN9BmwDSijxvbdZWYYbPcJkSWB3QsprbfG7mZsrWvsVgBPudwOqvMhr1_LkiLLqcHWXsjiAMzqgWJenMQ2-ujzIIlgHAMYLafutQ Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:35:49.220393 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:35:49.222157 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}] Jul 28 03:35:49.222157 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:49.222157 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:49.222157 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:49.222157 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:49.222157 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:49.222157 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:49.222157 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 3ded6de5177d4666b9b9f3be738cdd0d Jul 28 03:35:49.222157 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:49.222157 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:35:49.222157 n-d-826756-3 devstack@n-api.service[126071]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 28 03:35:49.222801 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:35:49.222801 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:35:49.222801 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 28 03:35:49.222801 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:49.222801 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.222801 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:35:49.222801 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:35:49.222801 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:35:49.222801 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:35:49.222801 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:35:49.222801 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:35:49.223505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:35:49.224525 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:35:49.224525 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:35:49.224525 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:35:49.224525 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:35:49.224525 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:35:49.224525 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.224525 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.224525 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.224525 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.224525 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.224525 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.224525 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:35:49.224525 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:35:49.225225 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:35:49.225225 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.226770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2ac1169-ec85-41cd-a598-e9cf080f9d6e tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:49.227722 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d2ac1169-ec85-41cd-a598-e9cf080f9d6e tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.036602 Jul 28 03:35:49.233351 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 98/186] 10.222.0.48 () {60 vars in 1165 bytes} [Thu Jul 28 03:35:49 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:35:49.244453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e02e24cd-38ee-4a6f-8da5-8edd226803a9 tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:49.248467 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:49.248467 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:49.258078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e02e24cd-38ee-4a6f-8da5-8edd226803a9 tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:49.262620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e02e24cd-38ee-4a6f-8da5-8edd226803a9 tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:49.280335 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-af9388c7-7234-48be-86a5-fb0c1e1a7185 tempest-AggregatesAdminTestJSON-332443637 tempest-AggregatesAdminTestJSON-332443637-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.078108 Jul 28 03:35:49.280952 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 89/187] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 03:35:49 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:49.300599 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-59505563-1d92-4ae7-81a3-89b4a9b31d08 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-59505563-1d92-4ae7-81a3-89b4a9b31d08 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Request method failure captured: Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 27 Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gPpQr9BAFw4TZGeh-soncQn6lFQ0p3om8cd--ZwiVMDNmKB8E8bTJ0zwlalfTGl8W9j5Z-A46wIN9BmwDSijxvbdZWYYbPcJkSWB3QsprbfG7mZsrWvsVgBPudwOqvMhr1_LkiLLqcHWXsjiAMzqgWJenMQ2-ujzIIlgHAMYLafutQ Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:35:49.311722 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:35:49.312893 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}] Jul 28 03:35:49.312893 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:49.312893 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:49.312893 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:49.312893 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:49.312893 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:49.312893 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:49.312893 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 3ded6de5177d4666b9b9f3be738cdd0d Jul 28 03:35:49.312893 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:49.312893 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:35:49.312893 n-d-826756-3 devstack@n-api.service[126072]: {"aggregate": {"name": ""}} Jul 28 03:35:49.312893 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:35:49.312893 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi '' Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:49.313928 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 28 03:35:49.315137 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.316177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-59505563-1d92-4ae7-81a3-89b4a9b31d08 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:49.316177 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-59505563-1d92-4ae7-81a3-89b4a9b31d08 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.029446 Jul 28 03:35:49.320125 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 90/188] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:49 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:35:49.327026 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9502979e-6812-4271-9b4e-08e98db71515 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:49.327747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9502979e-6812-4271-9b4e-08e98db71515 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:49.347516 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9502979e-6812-4271-9b4e-08e98db71515 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:49.347988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9502979e-6812-4271-9b4e-08e98db71515 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:49.349073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9502979e-6812-4271-9b4e-08e98db71515 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:49.366883 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9502979e-6812-4271-9b4e-08e98db71515 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:49.444994 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-9502979e-6812-4271-9b4e-08e98db71515 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] HTTP exception thrown: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9502979e-6812-4271-9b4e-08e98db71515 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Request method failure captured: Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c HTTP/1.1 Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gPm8iJ6-xUKDCwO89mPSoiU4oLHv-51Yew0_pLt9SxB2o9MGlSsZi0Iq1f-8RMIwzLmpEd1eR3q599bd-tZwaOa6baOdBdMp0LhP63w2gNyFPymKwrKuwM4-km3kKOeXn9JYM9XcsFHt578-R_IH391X0yTmC5sFDi9mse3ezhgB7Y Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ca65d6c53c5846c8903fdb9b5de86168 Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AggregatesAdminTestJSON-2079868474 Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:35:49.461176 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:35:49.462663 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca65d6c53c5846c8903fdb9b5de86168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca65d6c53c5846c8903fdb9b5de86168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca65d6c53c5846c8903fdb9b5de86168"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca65d6c53c5846c8903fdb9b5de86168"}]}] Jul 28 03:35:49.462663 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AggregatesAdminTestJSON-2079868474 Jul 28 03:35:49.462663 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ca65d6c53c5846c8903fdb9b5de86168 Jul 28 03:35:49.462663 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2079868474 Jul 28 03:35:49.462663 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AggregatesAdminTestJSON-2079868474-project Jul 28 03:35:49.462663 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:49.462663 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:49.462663 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 4338dd1a28ac4bb9a75c143f57e74f2e Jul 28 03:35:49.462663 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AggregatesAdminTestJSON-2079868474-project Jul 28 03:35:49.462663 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:35:49.462663 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:49.462663 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '8bf11ab4-3b13-4117-8ba1-7c0b07894e8c'} Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:49.463553 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:49.465269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.466631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9502979e-6812-4271-9b4e-08e98db71515 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Returning 404 to user: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:49.466631 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9502979e-6812-4271-9b4e-08e98db71515 tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 404 len: 111 microversion: 2.1 time: 0.141751 Jul 28 03:35:49.467716 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 91/189] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:35:49 2022] DELETE /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:49.476988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7507453e-e601-4a6c-82d4-5db69cb8ceb2 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1058950582"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:49.480900 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:49.480900 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:49.482273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7507453e-e601-4a6c-82d4-5db69cb8ceb2 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'ce2111f438e042bf8c40cbbbf57b064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23456cb2ff40b1a5c36f154b7035a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7507453e-e601-4a6c-82d4-5db69cb8ceb2 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Request method failure captured: Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 60 Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gPmLQhJtNUtB9W86OgamFbwDZPFdKbBNbpSxoKKePV-ThSl2KNkYLYlSiIf8ZN8nxu_XqNA3CyUrhY9R6-pVt39juNg4Ekxsq_5Ac8LM-3N9svV3CUabSp_FrY91d4mpV4LrwrYzl2NLQ6Ezw-nzANI9NYB9nlaQo8oe19Nc8qPy0c Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ca23456cb2ff40b1a5c36f154b7035a2 Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:35:49.484441 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:35:49.486353 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca23456cb2ff40b1a5c36f154b7035a2"}]}] Jul 28 03:35:49.486353 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:49.486353 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ca23456cb2ff40b1a5c36f154b7035a2 Jul 28 03:35:49.486353 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:49.486353 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AggregatesAdminNegativeTestJSON-1781367841-project Jul 28 03:35:49.486353 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:49.486353 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:49.486353 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ce2111f438e042bf8c40cbbbf57b064e Jul 28 03:35:49.486353 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841-project Jul 28 03:35:49.486353 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:35:49.486353 n-d-826756-3 devstack@n-api.service[126072]: {"aggregate": {"name": "tempest-test_aggregate-1058950582"}} Jul 28 03:35:49.486353 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:35:49.486353 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1058950582'}}} Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:49.487807 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:49.489859 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 28 03:35:49.491245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.492523 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7507453e-e601-4a6c-82d4-5db69cb8ceb2 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:49.495722 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7507453e-e601-4a6c-82d4-5db69cb8ceb2 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.024009 Jul 28 03:35:49.504655 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 92/190] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:49 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:49.505342 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e02e24cd-38ee-4a6f-8da5-8edd226803a9 tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 299 microversion: 2.41 time: 0.270224 Jul 28 03:35:49.506394 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 99/191] 10.222.0.48 () {62 vars in 1235 bytes} [Thu Jul 28 03:35:49 2022] POST /compute/v2.1/os-aggregates/11/action => generated 299 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:35:49.511321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-648c8a7e-80aa-49be-b6f8-cc9993127236 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-143896798"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:49.515028 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:49.515028 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:49.517435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6e9e0817-2899-40f0-8e33-91bf21bf025b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:49.518581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.aggregate [None req-648c8a7e-80aa-49be-b6f8-cc9993127236 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Generated uuid 47146ad7-6ae5-4956-a43d-35a709c1f940 for aggregate {{(pid=126071) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:49.520766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6e9e0817-2899-40f0-8e33-91bf21bf025b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] [instance: 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:49.555561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e9e0817-2899-40f0-8e33-91bf21bf025b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:49.557902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e9e0817-2899-40f0-8e33-91bf21bf025b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:49.560407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e9e0817-2899-40f0-8e33-91bf21bf025b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:49.563415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e9e0817-2899-40f0-8e33-91bf21bf025b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:49.574130 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-648c8a7e-80aa-49be-b6f8-cc9993127236 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.066501 Jul 28 03:35:49.574866 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 100/192] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:49.585642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-20cbced5-df14-4091-b76e-3b798574a21e tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:49.586529 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:49.586529 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:49.587355 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:49.616656 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-6e9e0817-2899-40f0-8e33-91bf21bf025b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] HTTP exception thrown: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6e9e0817-2899-40f0-8e33-91bf21bf025b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Request method failure captured: Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c HTTP/1.1 Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gPm8iJ6-xUKDCwO89mPSoiU4oLHv-51Yew0_pLt9SxB2o9MGlSsZi0Iq1f-8RMIwzLmpEd1eR3q599bd-tZwaOa6baOdBdMp0LhP63w2gNyFPymKwrKuwM4-km3kKOeXn9JYM9XcsFHt578-R_IH391X0yTmC5sFDi9mse3ezhgB7Y Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ca65d6c53c5846c8903fdb9b5de86168 Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AggregatesAdminTestJSON-2079868474 Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:35:49.621432 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:35:49.623176 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca65d6c53c5846c8903fdb9b5de86168"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca65d6c53c5846c8903fdb9b5de86168"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca65d6c53c5846c8903fdb9b5de86168"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca65d6c53c5846c8903fdb9b5de86168"}]}] Jul 28 03:35:49.623176 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AggregatesAdminTestJSON-2079868474 Jul 28 03:35:49.623176 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ca65d6c53c5846c8903fdb9b5de86168 Jul 28 03:35:49.623176 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2079868474 Jul 28 03:35:49.623176 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AggregatesAdminTestJSON-2079868474-project Jul 28 03:35:49.623176 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:49.623176 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:49.623176 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 4338dd1a28ac4bb9a75c143f57e74f2e Jul 28 03:35:49.623176 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AggregatesAdminTestJSON-2079868474-project Jul 28 03:35:49.623176 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:35:49.623176 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:49.623176 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '8bf11ab4-3b13-4117-8ba1-7c0b07894e8c'} Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:49.624211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. Jul 28 03:35:49.627848 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.630742 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6e9e0817-2899-40f0-8e33-91bf21bf025b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] Returning 404 to user: Instance 8bf11ab4-3b13-4117-8ba1-7c0b07894e8c could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:49.632033 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-20cbced5-df14-4091-b76e-3b798574a21e tempest-AggregatesAdminTestV241-902427474 tempest-AggregatesAdminTestV241-902427474-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.41 time: 0.056026 Jul 28 03:35:49.635381 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 101/193] 10.222.0.48 () {60 vars in 1196 bytes} [Thu Jul 28 03:35:49 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:49.636318 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6e9e0817-2899-40f0-8e33-91bf21bf025b tempest-AggregatesAdminTestJSON-2079868474 tempest-AggregatesAdminTestJSON-2079868474-project] 10.222.0.48 "GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c" status: 404 len: 111 microversion: 2.1 time: 0.127461 Jul 28 03:35:49.640932 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 93/194] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:49 2022] GET /compute/v2.1/servers/8bf11ab4-3b13-4117-8ba1-7c0b07894e8c => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:49.648621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6ec7151e-a38e-4139-ac10-0aa39dda50a3 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-143896798"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:49.659006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af9e455e-3c64-4df9-a195-7cf08597a30e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:49.661385 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:49.661385 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:49.663219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-af9e455e-3c64-4df9-a195-7cf08597a30e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:49.664619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.aggregate [None req-6ec7151e-a38e-4139-ac10-0aa39dda50a3 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Generated uuid 2dfb91df-9f27-4094-8ba0-5f532fc0be9f for aggregate {{(pid=126072) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:49.675270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af9e455e-3c64-4df9-a195-7cf08597a30e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:49.675896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af9e455e-3c64-4df9-a195-7cf08597a30e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:49.676863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af9e455e-3c64-4df9-a195-7cf08597a30e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:49.677446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af9e455e-3c64-4df9-a195-7cf08597a30e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:49.689574 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-6ec7151e-a38e-4139-ac10-0aa39dda50a3 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-143896798 already exists. Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6ec7151e-a38e-4139-ac10-0aa39dda50a3 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Request method failure captured: Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 59 Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gPpQr9BAFw4TZGeh-soncQn6lFQ0p3om8cd--ZwiVMDNmKB8E8bTJ0zwlalfTGl8W9j5Z-A46wIN9BmwDSijxvbdZWYYbPcJkSWB3QsprbfG7mZsrWvsVgBPudwOqvMhr1_LkiLLqcHWXsjiAMzqgWJenMQ2-ujzIIlgHAMYLafutQ Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:35:49.694972 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:35:49.696495 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}] Jul 28 03:35:49.696495 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:49.696495 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:49.696495 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:49.696495 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:49.696495 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:49.696495 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:49.696495 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 3ded6de5177d4666b9b9f3be738cdd0d Jul 28 03:35:49.696495 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:49.696495 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:35:49.696495 n-d-826756-3 devstack@n-api.service[126072]: {"aggregate": {"name": "tempest-test_aggregate-143896798"}} Jul 28 03:35:49.696495 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:35:49.696495 n-d-826756-3 devstack@n-api.service[126072]: exception: Aggregate tempest-test_aggregate-143896798 already exists. Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-143896798'}}} Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6455, in create_aggregate Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 28 03:35:49.697353 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-143896798 already exists. Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:49.698639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 28 03:35:49.699943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 28 03:35:49.699943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-143896798 already exists. Jul 28 03:35:49.699943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.699943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.699943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.699943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.699943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.699943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.699943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:49.699943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:49.699943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-143896798 already exists. Jul 28 03:35:49.699943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.702852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6ec7151e-a38e-4139-ac10-0aa39dda50a3 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-143896798 already exists. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:49.703863 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6ec7151e-a38e-4139-ac10-0aa39dda50a3 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.065662 Jul 28 03:35:49.707150 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 94/195] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:49 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:35:49.719930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-16d47481-488d-40ba-8e56-dbf2c3fa5397 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:49.731130 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:49.731130 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:49.811796 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-16d47481-488d-40ba-8e56-dbf2c3fa5397 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.099844 Jul 28 03:35:49.824181 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 95/196] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 03:35:49 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 28 03:35:49.841300 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e7f6bc44-2650-4fba-8403-db190cbefc4a tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1327999724"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:49.849870 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:49.849870 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:49.869607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.aggregate [None req-e7f6bc44-2650-4fba-8403-db190cbefc4a tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Generated uuid dc486fa0-5e5e-4a54-af7f-18bab6ad6ad7 for aggregate {{(pid=126072) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:49.938466 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e7f6bc44-2650-4fba-8403-db190cbefc4a tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.112623 Jul 28 03:35:49.947253 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 96/197] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:49 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:49.970651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b0a82f97-650c-4bca-a5fb-59b578efca88 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:49.978982 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:49.978982 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:49.984403 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b0a82f97-650c-4bca-a5fb-59b578efca88 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'ce2111f438e042bf8c40cbbbf57b064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23456cb2ff40b1a5c36f154b7035a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b0a82f97-650c-4bca-a5fb-59b578efca88 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Request method failure captured: Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gPmLQhJtNUtB9W86OgamFbwDZPFdKbBNbpSxoKKePV-ThSl2KNkYLYlSiIf8ZN8nxu_XqNA3CyUrhY9R6-pVt39juNg4Ekxsq_5Ac8LM-3N9svV3CUabSp_FrY91d4mpV4LrwrYzl2NLQ6Ezw-nzANI9NYB9nlaQo8oe19Nc8qPy0c Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ca23456cb2ff40b1a5c36f154b7035a2 Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:35:49.994802 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:35:49.996701 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca23456cb2ff40b1a5c36f154b7035a2"}]}] Jul 28 03:35:49.996701 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:49.996701 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ca23456cb2ff40b1a5c36f154b7035a2 Jul 28 03:35:49.996701 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:49.996701 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AggregatesAdminNegativeTestJSON-1781367841-project Jul 28 03:35:49.996701 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:49.996701 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:49.996701 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ce2111f438e042bf8c40cbbbf57b064e Jul 28 03:35:49.996701 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841-project Jul 28 03:35:49.996701 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:35:49.996701 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 28 03:35:49.996701 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '15'} Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:49.998054 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 28 03:35:49.999703 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.004582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b0a82f97-650c-4bca-a5fb-59b578efca88 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:50.005838 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b0a82f97-650c-4bca-a5fb-59b578efca88 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.053620 Jul 28 03:35:50.006553 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 97/198] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 03:35:49 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:50.039212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f2d2e70b-174a-4f65-8b74-c1e766f8c58c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:50.050587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f2d2e70b-174a-4f65-8b74-c1e766f8c58c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:50.076763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2d2e70b-174a-4f65-8b74-c1e766f8c58c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:50.078070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2d2e70b-174a-4f65-8b74-c1e766f8c58c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:50.079095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2d2e70b-174a-4f65-8b74-c1e766f8c58c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:50.080040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2d2e70b-174a-4f65-8b74-c1e766f8c58c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:50.348195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-af9e455e-3c64-4df9-a195-7cf08597a30e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:50.357829 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-af9e455e-3c64-4df9-a195-7cf08597a30e tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1320 microversion: 2.1 time: 0.720361 Jul 28 03:35:50.358433 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 102/199] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:49 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1320 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:50.374149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-87e6546b-38f7-4faf-bf40-5d07e6302421 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:50.375207 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:50.375207 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:50.425003 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-87e6546b-38f7-4faf-bf40-5d07e6302421 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.065436 Jul 28 03:35:50.426149 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 103/200] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 03:35:50 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:50.436504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94cc9f66-9aab-4535-bf37-9f4caf316c94 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:50.438157 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:50.438157 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:50.471297 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-94cc9f66-9aab-4535-bf37-9f4caf316c94 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94cc9f66-9aab-4535-bf37-9f4caf316c94 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Request method failure captured: Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPpQr9BAFw4TZGeh-soncQn6lFQ0p3om8cd--ZwiVMDNmKB8E8bTJ0zwlalfTGl8W9j5Z-A46wIN9BmwDSijxvbdZWYYbPcJkSWB3QsprbfG7mZsrWvsVgBPudwOqvMhr1_LkiLLqcHWXsjiAMzqgWJenMQ2-ujzIIlgHAMYLafutQ Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:35:50.473956 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:35:50.475612 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}] Jul 28 03:35:50.475612 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:50.475612 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:50.475612 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:50.475612 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:50.475612 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:50.475612 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:50.475612 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 3ded6de5177d4666b9b9f3be738cdd0d Jul 28 03:35:50.475612 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:50.475612 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:35:50.475612 n-d-826756-3 devstack@n-api.service[126071]: exception: Aggregate -1 could not be found. Jul 28 03:35:50.475612 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '-1'} Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6514, in delete_aggregate Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 03:35:50.476542 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.477872 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:50.479275 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:50.479275 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:50.479275 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:50.479275 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:50.479275 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 28 03:35:50.479275 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.480687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94cc9f66-9aab-4535-bf37-9f4caf316c94 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:50.481744 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-94cc9f66-9aab-4535-bf37-9f4caf316c94 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.049970 Jul 28 03:35:50.482855 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 104/201] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 03:35:50 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 03:35:50.497551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ea940747-7a88-41bb-9242-60a37ace3c58 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1884274376"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:50.500710 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:50.500710 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:50.502159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.aggregate [None req-ea940747-7a88-41bb-9242-60a37ace3c58 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Generated uuid 788eec49-b6a0-4f92-bb6a-ffc5c6fcfc97 for aggregate {{(pid=126071) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:50.541974 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ea940747-7a88-41bb-9242-60a37ace3c58 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.048174 Jul 28 03:35:50.542938 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 105/202] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:50 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:50.555720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-53846c64-20e5-41ea-88ee-0dc4d5cd23f3 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:50.556946 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:50.556946 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:50.558101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-53846c64-20e5-41ea-88ee-0dc4d5cd23f3 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'ce2111f438e042bf8c40cbbbf57b064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23456cb2ff40b1a5c36f154b7035a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-53846c64-20e5-41ea-88ee-0dc4d5cd23f3 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Request method failure captured: Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPmLQhJtNUtB9W86OgamFbwDZPFdKbBNbpSxoKKePV-ThSl2KNkYLYlSiIf8ZN8nxu_XqNA3CyUrhY9R6-pVt39juNg4Ekxsq_5Ac8LM-3N9svV3CUabSp_FrY91d4mpV4LrwrYzl2NLQ6Ezw-nzANI9NYB9nlaQo8oe19Nc8qPy0c Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ca23456cb2ff40b1a5c36f154b7035a2 Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:35:50.569018 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:35:50.570558 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca23456cb2ff40b1a5c36f154b7035a2"}]}] Jul 28 03:35:50.570558 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:50.570558 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ca23456cb2ff40b1a5c36f154b7035a2 Jul 28 03:35:50.570558 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:50.570558 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AggregatesAdminNegativeTestJSON-1781367841-project Jul 28 03:35:50.570558 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:50.570558 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:50.570558 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ce2111f438e042bf8c40cbbbf57b064e Jul 28 03:35:50.570558 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841-project Jul 28 03:35:50.570558 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:35:50.570558 n-d-826756-3 devstack@n-api.service[126071]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 28 03:35:50.570558 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '16'} Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:50.571412 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 28 03:35:50.572486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.575065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-53846c64-20e5-41ea-88ee-0dc4d5cd23f3 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:50.576209 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-53846c64-20e5-41ea-88ee-0dc4d5cd23f3 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] 10.222.0.48 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.025430 Jul 28 03:35:50.577608 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 106/203] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:35:50 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:50.589852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b43758c-0037-4da8-8114-9d1fd5bc3df1 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:50.591057 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:50.591057 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:50.628179 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5b43758c-0037-4da8-8114-9d1fd5bc3df1 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.045933 Jul 28 03:35:50.630313 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 107/204] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 03:35:50 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 28 03:35:50.650326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c2486aba-5e75-4a9b-a3db-d37e3efdc966 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:50.651223 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:50.651223 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:50.658411 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-c2486aba-5e75-4a9b-a3db-d37e3efdc966 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c2486aba-5e75-4a9b-a3db-d37e3efdc966 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Request method failure captured: Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPpQr9BAFw4TZGeh-soncQn6lFQ0p3om8cd--ZwiVMDNmKB8E8bTJ0zwlalfTGl8W9j5Z-A46wIN9BmwDSijxvbdZWYYbPcJkSWB3QsprbfG7mZsrWvsVgBPudwOqvMhr1_LkiLLqcHWXsjiAMzqgWJenMQ2-ujzIIlgHAMYLafutQ Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:35:50.660030 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:35:50.661267 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}] Jul 28 03:35:50.661267 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:50.661267 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:50.661267 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:50.661267 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:50.661267 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:50.661267 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:50.661267 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 3ded6de5177d4666b9b9f3be738cdd0d Jul 28 03:35:50.661267 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:50.661267 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:35:50.661267 n-d-826756-3 devstack@n-api.service[126071]: exception: Aggregate -1 could not be found. Jul 28 03:35:50.661267 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '-1'} Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6461, in get_aggregate Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:50.662063 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 28 03:35:50.663464 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.671464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c2486aba-5e75-4a9b-a3db-d37e3efdc966 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:50.671464 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c2486aba-5e75-4a9b-a3db-d37e3efdc966 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.023211 Jul 28 03:35:50.671464 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 108/205] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:35:50 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:35:50.676227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0dff1efb-b927-4707-888f-f5d9b3e961e1 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:50.678207 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:50.678207 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:50.679906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0dff1efb-b927-4707-888f-f5d9b3e961e1 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'ce2111f438e042bf8c40cbbbf57b064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23456cb2ff40b1a5c36f154b7035a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0dff1efb-b927-4707-888f-f5d9b3e961e1 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Request method failure captured: Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPmLQhJtNUtB9W86OgamFbwDZPFdKbBNbpSxoKKePV-ThSl2KNkYLYlSiIf8ZN8nxu_XqNA3CyUrhY9R6-pVt39juNg4Ekxsq_5Ac8LM-3N9svV3CUabSp_FrY91d4mpV4LrwrYzl2NLQ6Ezw-nzANI9NYB9nlaQo8oe19Nc8qPy0c Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ca23456cb2ff40b1a5c36f154b7035a2 Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:35:50.681915 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:35:50.683281 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca23456cb2ff40b1a5c36f154b7035a2"}]}] Jul 28 03:35:50.683281 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:50.683281 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ca23456cb2ff40b1a5c36f154b7035a2 Jul 28 03:35:50.683281 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:50.683281 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AggregatesAdminNegativeTestJSON-1781367841-project Jul 28 03:35:50.683281 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:50.683281 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:50.683281 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ce2111f438e042bf8c40cbbbf57b064e Jul 28 03:35:50.683281 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841-project Jul 28 03:35:50.683281 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:35:50.683281 n-d-826756-3 devstack@n-api.service[126071]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 28 03:35:50.683281 n-d-826756-3 devstack@n-api.service[126071]: action_args: {} Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:50.683964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 28 03:35:50.684974 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:50.687973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0dff1efb-b927-4707-888f-f5d9b3e961e1 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:50.689279 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0dff1efb-b927-4707-888f-f5d9b3e961e1 tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.020040 Jul 28 03:35:50.695959 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 109/206] 10.222.0.48 () {58 vars in 1143 bytes} [Thu Jul 28 03:35:50 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:35:50.703121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-82824ca4-e745-40b1-88d4-6b8cac4b6b62 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-111254636"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:50.707395 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:50.707395 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:50.708761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.aggregate [None req-82824ca4-e745-40b1-88d4-6b8cac4b6b62 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Generated uuid 4543b854-a619-47b2-af01-4d88bbe0b3b3 for aggregate {{(pid=126071) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:50.748537 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-82824ca4-e745-40b1-88d4-6b8cac4b6b62 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049975 Jul 28 03:35:50.759779 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 110/207] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:50.766808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb3c0f31-d87a-467e-81f7-5d0dd8d73aa3 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:50.770818 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:50.770818 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:50.785378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb3c0f31-d87a-467e-81f7-5d0dd8d73aa3 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:50.786212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb3c0f31-d87a-467e-81f7-5d0dd8d73aa3 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:50.969129 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb3c0f31-d87a-467e-81f7-5d0dd8d73aa3 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.207371 Jul 28 03:35:50.978844 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 111/208] 10.222.0.48 () {60 vars in 1194 bytes} [Thu Jul 28 03:35:50 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:50.985909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-21ede95c-9a91-4310-b889-5baabe02074b tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:50.990498 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:50.990498 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:50.995769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-21ede95c-9a91-4310-b889-5baabe02074b tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'ce2111f438e042bf8c40cbbbf57b064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca23456cb2ff40b1a5c36f154b7035a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-21ede95c-9a91-4310-b889-5baabe02074b tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Request method failure captured: Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 42 Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gPmLQhJtNUtB9W86OgamFbwDZPFdKbBNbpSxoKKePV-ThSl2KNkYLYlSiIf8ZN8nxu_XqNA3CyUrhY9R6-pVt39juNg4Ekxsq_5Ac8LM-3N9svV3CUabSp_FrY91d4mpV4LrwrYzl2NLQ6Ezw-nzANI9NYB9nlaQo8oe19Nc8qPy0c Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ca23456cb2ff40b1a5c36f154b7035a2 Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:35:50.997540 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:35:50.999083 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca23456cb2ff40b1a5c36f154b7035a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca23456cb2ff40b1a5c36f154b7035a2"}]}] Jul 28 03:35:50.999083 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:50.999083 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ca23456cb2ff40b1a5c36f154b7035a2 Jul 28 03:35:50.999083 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841 Jul 28 03:35:50.999083 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AggregatesAdminNegativeTestJSON-1781367841-project Jul 28 03:35:50.999083 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:35:50.999083 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:35:50.999083 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ce2111f438e042bf8c40cbbbf57b064e Jul 28 03:35:50.999083 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1781367841-project Jul 28 03:35:50.999083 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:35:50.999083 n-d-826756-3 devstack@n-api.service[126071]: {"remove_host": {"host": "n-h1-826756-3"}} Jul 28 03:35:50.999083 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:35:50.999083 n-d-826756-3 devstack@n-api.service[126071]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-826756-3'}}} Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:51.000126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 28 03:35:51.003144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:35:51.005267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-21ede95c-9a91-4310-b889-5baabe02074b tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:51.005267 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-21ede95c-9a91-4310-b889-5baabe02074b tempest-AggregatesAdminNegativeTestJSON-1781367841 tempest-AggregatesAdminNegativeTestJSON-1781367841-project] 10.222.0.48 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.018761 Jul 28 03:35:51.005267 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 112/209] 10.222.0.48 () {60 vars in 1194 bytes} [Thu Jul 28 03:35:50 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:35:51.018722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ab428679-0782-4475-8c4d-ade7b41fab0e tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:51.045784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab428679-0782-4475-8c4d-ade7b41fab0e tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:51.046247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab428679-0782-4475-8c4d-ade7b41fab0e tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:51.276604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f2d2e70b-174a-4f65-8b74-c1e766f8c58c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:51.289799 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ab428679-0782-4475-8c4d-ade7b41fab0e tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.276053 Jul 28 03:35:51.293355 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 113/210] 10.222.0.48 () {60 vars in 1194 bytes} [Thu Jul 28 03:35:51 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:51.307080 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f2d2e70b-174a-4f65-8b74-c1e766f8c58c tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1314 microversion: 2.1 time: 1.290801 Jul 28 03:35:51.309476 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 98/211] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:50 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1314 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:51.317038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fd7c9643-7688-4592-bf18-a186bd8c9308 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:51.318188 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:51.318188 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:35:51.325952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:DELETE=13,nova_api:SELECT=81,nova_api:INSERT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:51.366375 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fd7c9643-7688-4592-bf18-a186bd8c9308 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.061305 Jul 28 03:35:51.371364 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 114/212] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 03:35:51 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:51.380162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-de11e4d8-87cc-4d00-9058-b26195391c24 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1702991869"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:51.382988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f3baa05c-263f-4798-80fb-589c1975aa70 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:51.384971 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:51.384971 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:51.387863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.aggregate [None req-de11e4d8-87cc-4d00-9058-b26195391c24 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Generated uuid 64f06e34-bbe3-4c90-8b1f-7fd27a729e72 for aggregate {{(pid=126072) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 03:35:51.388423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f3baa05c-263f-4798-80fb-589c1975aa70 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:51.399529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3baa05c-263f-4798-80fb-589c1975aa70 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:51.401440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=80,nova_api:INSERT=8,nova_api:UPDATE=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:51.403620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3baa05c-263f-4798-80fb-589c1975aa70 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:51.407543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3baa05c-263f-4798-80fb-589c1975aa70 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:51.408326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3baa05c-263f-4798-80fb-589c1975aa70 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:51.464416 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-de11e4d8-87cc-4d00-9058-b26195391c24 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.090984 Jul 28 03:35:51.466590 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 99/213] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 03:35:51 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:51.491652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-003bc284-f0a4-420f-af6d-6db3560ee0cf tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:51.501099 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:51.501099 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:51.525930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-003bc284-f0a4-420f-af6d-6db3560ee0cf tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:51.526574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-003bc284-f0a4-420f-af6d-6db3560ee0cf tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:51.535672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-003bc284-f0a4-420f-af6d-6db3560ee0cf tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:51.536649 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-003bc284-f0a4-420f-af6d-6db3560ee0cf tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:51.546512 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.compute.aggregates [None req-003bc284-f0a4-420f-af6d-6db3560ee0cf tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 28 03:35:51.547362 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-003bc284-f0a4-420f-af6d-6db3560ee0cf tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-003bc284-f0a4-420f-af6d-6db3560ee0cf tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Request method failure captured: Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 42 Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gPpQr9BAFw4TZGeh-soncQn6lFQ0p3om8cd--ZwiVMDNmKB8E8bTJ0zwlalfTGl8W9j5Z-A46wIN9BmwDSijxvbdZWYYbPcJkSWB3QsprbfG7mZsrWvsVgBPudwOqvMhr1_LkiLLqcHWXsjiAMzqgWJenMQ2-ujzIIlgHAMYLafutQ Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:35:51.550766 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:35:51.551964 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_56d115920fbc4aec8bce148fd7e9cb83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56d115920fbc4aec8bce148fd7e9cb83"}]}] Jul 28 03:35:51.551964 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:51.551964 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 56d115920fbc4aec8bce148fd7e9cb83 Jul 28 03:35:51.551964 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084 Jul 28 03:35:51.551964 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:51.551964 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:35:51.551964 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:35:51.551964 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 3ded6de5177d4666b9b9f3be738cdd0d Jul 28 03:35:51.551964 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin Jul 28 03:35:51.551964 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:35:51.551964 n-d-826756-3 devstack@n-api.service[126072]: {"remove_host": {"host": "nonexist_host"}} Jul 28 03:35:51.551964 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:35:51.551964 n-d-826756-3 devstack@n-api.service[126072]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5993, in _get_service_in_cell_by_host Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Jul 28 03:35:51.552724 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6061, in _find_service_in_cell Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6680, in remove_host_from_aggregate Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 28 03:35:51.553762 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6001, in _get_service_in_cell_by_host Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:51.554805 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:35:51.555908 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:35:51.555908 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:35:51.555908 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:35:51.555908 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:35:51.555908 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 28 03:35:51.555908 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:35:51.559051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-003bc284-f0a4-420f-af6d-6db3560ee0cf tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:35:51.560178 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-003bc284-f0a4-420f-af6d-6db3560ee0cf tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.075064 Jul 28 03:35:51.564381 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 100/214] 10.222.0.48 () {60 vars in 1194 bytes} [Thu Jul 28 03:35:51 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:35:51.569907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3d90057c-0a9c-4063-bac9-6fca3e8a79c8 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:51.570900 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:35:51.570900 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:35:51.604202 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3d90057c-0a9c-4063-bac9-6fca3e8a79c8 tempest-AggregatesAdminNegativeTestJSON-1756111084 tempest-AggregatesAdminNegativeTestJSON-1756111084-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.038347 Jul 28 03:35:51.605168 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 101/215] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 03:35:51 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:35:51.812799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f3baa05c-263f-4798-80fb-589c1975aa70 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:51.825507 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f3baa05c-263f-4798-80fb-589c1975aa70 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1320 microversion: 2.1 time: 0.446435 Jul 28 03:35:51.829905 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 115/216] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:51 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1320 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:52.336632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1fc244aa-7f38-4469-8da7-568bd035fff4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:52.337874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1fc244aa-7f38-4469-8da7-568bd035fff4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:52.353047 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1fc244aa-7f38-4469-8da7-568bd035fff4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:52.354718 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1fc244aa-7f38-4469-8da7-568bd035fff4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:52.357198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1fc244aa-7f38-4469-8da7-568bd035fff4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:52.359254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1fc244aa-7f38-4469-8da7-568bd035fff4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:52.443417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f2c12101-f216-495d-a867-48b6cd385442 req-fa54784f-d00f-4d9c-ad6e-15aa309fcefe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad9cea2-a559-4ca1-9d39-e089112bdde7", "name": "network-vif-plugged", "status": "completed", "tag": "f4637ada-07a2-4d6f-a424-6111d91c080a"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:52.468884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f2c12101-f216-495d-a867-48b6cd385442 req-fa54784f-d00f-4d9c-ad6e-15aa309fcefe service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:52.472499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f2c12101-f216-495d-a867-48b6cd385442 req-fa54784f-d00f-4d9c-ad6e-15aa309fcefe service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:52.520015 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f2c12101-f216-495d-a867-48b6cd385442 req-fa54784f-d00f-4d9c-ad6e-15aa309fcefe service nova] Creating event network-vif-plugged:f4637ada-07a2-4d6f-a424-6111d91c080a for instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 on n-h2-826756-3 Jul 28 03:35:52.536618 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f2c12101-f216-495d-a867-48b6cd385442 req-fa54784f-d00f-4d9c-ad6e-15aa309fcefe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097191 Jul 28 03:35:52.540161 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 116/217] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:35:52.661273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0efd7848-ac7d-4b25-8637-b4fb28ba7da2 req-9637e0d4-15ee-4ffc-a8b7-9ab36a91ddd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5379308-b878-4613-9545-17da5acd5bc1", "tag": "8e644a67-03d3-44d0-b877-8cc29c05f1d1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:52.706989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0efd7848-ac7d-4b25-8637-b4fb28ba7da2 req-9637e0d4-15ee-4ffc-a8b7-9ab36a91ddd1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:52.708808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0efd7848-ac7d-4b25-8637-b4fb28ba7da2 req-9637e0d4-15ee-4ffc-a8b7-9ab36a91ddd1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:52.745880 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0efd7848-ac7d-4b25-8637-b4fb28ba7da2 req-9637e0d4-15ee-4ffc-a8b7-9ab36a91ddd1 service nova] Creating event network-changed:8e644a67-03d3-44d0-b877-8cc29c05f1d1 for instance b5379308-b878-4613-9545-17da5acd5bc1 on n-h1-826756-3 Jul 28 03:35:52.757006 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0efd7848-ac7d-4b25-8637-b4fb28ba7da2 req-9637e0d4-15ee-4ffc-a8b7-9ab36a91ddd1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110114 Jul 28 03:35:52.761484 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 117/218] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:35:52.880568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fd4d7a64-6eb6-4a0b-a2ca-28ca0d0ed2b0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:52.883035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fd4d7a64-6eb6-4a0b-a2ca-28ca0d0ed2b0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:52.901320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd4d7a64-6eb6-4a0b-a2ca-28ca0d0ed2b0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:52.902558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd4d7a64-6eb6-4a0b-a2ca-28ca0d0ed2b0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:52.904596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd4d7a64-6eb6-4a0b-a2ca-28ca0d0ed2b0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:52.905909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd4d7a64-6eb6-4a0b-a2ca-28ca0d0ed2b0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:52.906499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1fc244aa-7f38-4469-8da7-568bd035fff4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:52.930348 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1fc244aa-7f38-4469-8da7-568bd035fff4 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1314 microversion: 2.1 time: 0.604223 Jul 28 03:35:52.930940 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 102/219] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:52 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:53.976662 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8ef71ea6-038a-40f3-ba74-bf7eb2b1a318 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:53.977405 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8ef71ea6-038a-40f3-ba74-bf7eb2b1a318 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:53.995018 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8ef71ea6-038a-40f3-ba74-bf7eb2b1a318 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:53.995462 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8ef71ea6-038a-40f3-ba74-bf7eb2b1a318 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:53.996242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8ef71ea6-038a-40f3-ba74-bf7eb2b1a318 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:54.003882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8ef71ea6-038a-40f3-ba74-bf7eb2b1a318 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:54.025260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:54.535410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8ef71ea6-038a-40f3-ba74-bf7eb2b1a318 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:54.548600 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8ef71ea6-038a-40f3-ba74-bf7eb2b1a318 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1314 microversion: 2.1 time: 0.586490 Jul 28 03:35:54.549080 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 103/220] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:53 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:35:54.868559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fd4d7a64-6eb6-4a0b-a2ca-28ca0d0ed2b0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:54.881295 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fd4d7a64-6eb6-4a0b-a2ca-28ca0d0ed2b0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1320 microversion: 2.1 time: 2.029764 Jul 28 03:35:54.882115 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 118/221] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:52 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1320 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:55.580901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b3f268b8-97cd-4513-b703-51ea5bcf6148 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:55.581803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b3f268b8-97cd-4513-b703-51ea5bcf6148 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:55.635748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3f268b8-97cd-4513-b703-51ea5bcf6148 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:55.651172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3f268b8-97cd-4513-b703-51ea5bcf6148 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:55.652698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3f268b8-97cd-4513-b703-51ea5bcf6148 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:55.657232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3f268b8-97cd-4513-b703-51ea5bcf6148 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:55.908306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-21c83049-0811-4906-8c3f-52f51d6f99d1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:55.910374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-21c83049-0811-4906-8c3f-52f51d6f99d1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:55.931683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21c83049-0811-4906-8c3f-52f51d6f99d1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:55.932859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21c83049-0811-4906-8c3f-52f51d6f99d1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:55.949329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21c83049-0811-4906-8c3f-52f51d6f99d1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:55.953194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21c83049-0811-4906-8c3f-52f51d6f99d1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:56.054675 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b3f268b8-97cd-4513-b703-51ea5bcf6148 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:56.067151 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b3f268b8-97cd-4513-b703-51ea5bcf6148 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1314 microversion: 2.1 time: 0.500287 Jul 28 03:35:56.072465 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 104/222] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:55 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:56.551586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-21c83049-0811-4906-8c3f-52f51d6f99d1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:56.568633 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-21c83049-0811-4906-8c3f-52f51d6f99d1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1320 microversion: 2.1 time: 0.662057 Jul 28 03:35:56.569662 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 119/223] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:55 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1320 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:57.093754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-183f6c65-d8be-4199-9149-705b53a4175d tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:57.095250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-183f6c65-d8be-4199-9149-705b53a4175d tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:57.111787 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-183f6c65-d8be-4199-9149-705b53a4175d tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:57.112917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-183f6c65-d8be-4199-9149-705b53a4175d tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:57.114022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-183f6c65-d8be-4199-9149-705b53a4175d tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:57.115764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-183f6c65-d8be-4199-9149-705b53a4175d tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:57.595082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6659459a-a025-4454-b27a-618aa193451c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:57.595739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6659459a-a025-4454-b27a-618aa193451c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:57.612143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6659459a-a025-4454-b27a-618aa193451c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:57.613943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6659459a-a025-4454-b27a-618aa193451c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:57.617332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6659459a-a025-4454-b27a-618aa193451c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:57.620437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6659459a-a025-4454-b27a-618aa193451c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:57.813620 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-183f6c65-d8be-4199-9149-705b53a4175d tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:57.834575 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-183f6c65-d8be-4199-9149-705b53a4175d tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1314 microversion: 2.1 time: 0.743081 Jul 28 03:35:57.835216 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 105/224] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:57 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:58.248324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6659459a-a025-4454-b27a-618aa193451c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:58.264635 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6659459a-a025-4454-b27a-618aa193451c tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1470 microversion: 2.1 time: 0.674949 Jul 28 03:35:58.296807 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 120/225] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:57 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1470 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:58.858094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ffdaa964-f0a3-4cc3-93ad-1dae271f4bac tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:58.858706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ffdaa964-f0a3-4cc3-93ad-1dae271f4bac tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:58.861633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b6f83549-7b44-401d-85c7-2ae7c7d3c500 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:58.862529 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b6f83549-7b44-401d-85c7-2ae7c7d3c500 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:58.866524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffdaa964-f0a3-4cc3-93ad-1dae271f4bac tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:58.866974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffdaa964-f0a3-4cc3-93ad-1dae271f4bac tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:58.867753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffdaa964-f0a3-4cc3-93ad-1dae271f4bac tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:58.868190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffdaa964-f0a3-4cc3-93ad-1dae271f4bac tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:58.882074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:58.884113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6f83549-7b44-401d-85c7-2ae7c7d3c500 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:58.884888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6f83549-7b44-401d-85c7-2ae7c7d3c500 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:58.887198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6f83549-7b44-401d-85c7-2ae7c7d3c500 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:58.887641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6f83549-7b44-401d-85c7-2ae7c7d3c500 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:59.001084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:35:59.055825 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b6f83549-7b44-401d-85c7-2ae7c7d3c500 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:35:59.155361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ffdaa964-f0a3-4cc3-93ad-1dae271f4bac tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:59.168940 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ffdaa964-f0a3-4cc3-93ad-1dae271f4bac tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1314 microversion: 2.1 time: 0.314461 Jul 28 03:35:59.180294 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 121/226] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:58 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:35:59.243490 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b6f83549-7b44-401d-85c7-2ae7c7d3c500 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 204 len: 0 microversion: 2.1 time: 0.943168 Jul 28 03:35:59.244177 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 106/227] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:35:58 2022] DELETE /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 0 bytes in 947 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:35:59.255071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4cd4f11-afe0-400b-a8fc-29696ad62c3a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:35:59.255729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e4cd4f11-afe0-400b-a8fc-29696ad62c3a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:35:59.269914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4cd4f11-afe0-400b-a8fc-29696ad62c3a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:59.271211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4cd4f11-afe0-400b-a8fc-29696ad62c3a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:59.273022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4cd4f11-afe0-400b-a8fc-29696ad62c3a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:59.273472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4cd4f11-afe0-400b-a8fc-29696ad62c3a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:59.849425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e4cd4f11-afe0-400b-a8fc-29696ad62c3a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:35:59.872784 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e4cd4f11-afe0-400b-a8fc-29696ad62c3a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1476 microversion: 2.1 time: 0.618042 Jul 28 03:35:59.877777 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 122/228] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:35:59 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1476 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:35:59.896904 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-847950a3-59be-4bde-828d-44b4f404b551 req-d1c79f5d-ea42-48fe-83a5-515032f518b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5379308-b878-4613-9545-17da5acd5bc1", "name": "network-vif-plugged", "status": "completed", "tag": "8e644a67-03d3-44d0-b877-8cc29c05f1d1"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:35:59.941930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-847950a3-59be-4bde-828d-44b4f404b551 req-d1c79f5d-ea42-48fe-83a5-515032f518b9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:35:59.942378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-847950a3-59be-4bde-828d-44b4f404b551 req-d1c79f5d-ea42-48fe-83a5-515032f518b9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:35:59.969581 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-847950a3-59be-4bde-828d-44b4f404b551 req-d1c79f5d-ea42-48fe-83a5-515032f518b9 service nova] Creating event network-vif-plugged:8e644a67-03d3-44d0-b877-8cc29c05f1d1 for instance b5379308-b878-4613-9545-17da5acd5bc1 on n-h1-826756-3 Jul 28 03:35:59.983790 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-847950a3-59be-4bde-828d-44b4f404b551 req-d1c79f5d-ea42-48fe-83a5-515032f518b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090373 Jul 28 03:35:59.986600 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 107/229] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:00.204400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-866b4748-e4aa-4ffc-ac24-838fd2f511e8 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:00.205954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-866b4748-e4aa-4ffc-ac24-838fd2f511e8 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:00.226944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-866b4748-e4aa-4ffc-ac24-838fd2f511e8 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:00.228056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-866b4748-e4aa-4ffc-ac24-838fd2f511e8 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:00.229358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-866b4748-e4aa-4ffc-ac24-838fd2f511e8 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:00.230035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-866b4748-e4aa-4ffc-ac24-838fd2f511e8 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:00.467332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-866b4748-e4aa-4ffc-ac24-838fd2f511e8 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:00.479636 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-866b4748-e4aa-4ffc-ac24-838fd2f511e8 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1314 microversion: 2.1 time: 0.280272 Jul 28 03:36:00.493300 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 123/230] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:00 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:00.905908 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f0ba9deb-0350-46ed-add3-c9ea303e7ab9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:00.907248 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f0ba9deb-0350-46ed-add3-c9ea303e7ab9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:00.918667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f0ba9deb-0350-46ed-add3-c9ea303e7ab9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:00.926057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f0ba9deb-0350-46ed-add3-c9ea303e7ab9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:00.927064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f0ba9deb-0350-46ed-add3-c9ea303e7ab9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:00.928663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f0ba9deb-0350-46ed-add3-c9ea303e7ab9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:01.207655 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f0ba9deb-0350-46ed-add3-c9ea303e7ab9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:01.217984 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f0ba9deb-0350-46ed-add3-c9ea303e7ab9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 200 len: 1476 microversion: 2.1 time: 0.318114 Jul 28 03:36:01.223525 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 108/231] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:00 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 1476 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:01.508608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e310caf0-2d0f-492c-a737-be5ea4ce957f tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:01.510280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e310caf0-2d0f-492c-a737-be5ea4ce957f tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:01.522535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e310caf0-2d0f-492c-a737-be5ea4ce957f tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:01.523401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e310caf0-2d0f-492c-a737-be5ea4ce957f tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:01.524646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e310caf0-2d0f-492c-a737-be5ea4ce957f tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:01.525329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e310caf0-2d0f-492c-a737-be5ea4ce957f tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:01.819465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-cda4081a-0a38-41db-a147-7d8501f61305 req-d367113e-fb5b-44b0-b316-09a233710141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad9cea2-a559-4ca1-9d39-e089112bdde7", "name": "network-vif-deleted", "tag": "f4637ada-07a2-4d6f-a424-6111d91c080a"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:01.825806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=8 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:01.834315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e310caf0-2d0f-492c-a737-be5ea4ce957f tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:01.844200 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e310caf0-2d0f-492c-a737-be5ea4ce957f tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1464 microversion: 2.1 time: 0.342956 Jul 28 03:36:01.845250 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 124/232] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:01 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1464 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:01.857809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-cda4081a-0a38-41db-a147-7d8501f61305 req-d367113e-fb5b-44b0-b316-09a233710141 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:01.858483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-cda4081a-0a38-41db-a147-7d8501f61305 req-d367113e-fb5b-44b0-b316-09a233710141 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:01.892572 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-cda4081a-0a38-41db-a147-7d8501f61305 req-d367113e-fb5b-44b0-b316-09a233710141 service nova] Creating event network-vif-deleted:f4637ada-07a2-4d6f-a424-6111d91c080a for instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 on n-h2-826756-3 Jul 28 03:36:01.909214 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-cda4081a-0a38-41db-a147-7d8501f61305 req-d367113e-fb5b-44b0-b316-09a233710141 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092896 Jul 28 03:36:01.910294 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 109/233] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:02.686016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-33ebf508-20a9-47a2-b2c0-4912cd5277e9 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Calling method '.version_select at 0x7ffa74fe9d30>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:02.689498 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:02.689498 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:36:02.694557 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33ebf508-20a9-47a2-b2c0-4912cd5277e9 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:02.695545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33ebf508-20a9-47a2-b2c0-4912cd5277e9 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:02.699288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33ebf508-20a9-47a2-b2c0-4912cd5277e9 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:02.700322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33ebf508-20a9-47a2-b2c0-4912cd5277e9 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:02.764131 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-33ebf508-20a9-47a2-b2c0-4912cd5277e9 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.849395 Jul 28 03:36:02.768585 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 110/234] 10.222.0.48 () {58 vars in 1128 bytes} [Thu Jul 28 03:36:01 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:02.774610 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b540b273-3291-4bd0-8d09-10a982d83efd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:02.777484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b540b273-3291-4bd0-8d09-10a982d83efd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:02.784873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b540b273-3291-4bd0-8d09-10a982d83efd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:02.785691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b540b273-3291-4bd0-8d09-10a982d83efd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:02.786677 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b540b273-3291-4bd0-8d09-10a982d83efd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:02.787311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b540b273-3291-4bd0-8d09-10a982d83efd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:02.804866 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-b540b273-3291-4bd0-8d09-10a982d83efd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] HTTP exception thrown: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b540b273-3291-4bd0-8d09-10a982d83efd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Request method failure captured: Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 HTTP/1.1 Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gP8yzbDoKfRnQWQubF2qBgW_PqSO95_lLXhB1xsrIHXTTnqS-fi_1lnmSbvbJCP3e9U1ivGq1DV8740P0XUyeaMtG274NruMOw3_WQc4mDdgDrCCZKcRHV8o1lrJAkJlKLZUjVmZFFUpb9WUXeIVrE8r-pzI80egf4sin9B5C_DboM Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ac0afebe20824fd0898e22cbfaf03ba5 Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:36:02.817282 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:36:02.818913 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac0afebe20824fd0898e22cbfaf03ba5"}]}] Jul 28 03:36:02.818913 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:02.818913 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ac0afebe20824fd0898e22cbfaf03ba5 Jul 28 03:36:02.818913 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:02.818913 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersAdminTestJSON-280990268-project Jul 28 03:36:02.818913 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:02.818913 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:02.818913 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 75b0c48126914b959b5926d24a5f8a82 Jul 28 03:36:02.818913 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersAdminTestJSON-280990268-project Jul 28 03:36:02.818913 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:36:02.818913 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:02.818913 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '2ad9cea2-a559-4ca1-9d39-e089112bdde7'} Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:02.819628 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:02.821151 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:02.825486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b540b273-3291-4bd0-8d09-10a982d83efd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Returning 404 to user: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:02.830992 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b540b273-3291-4bd0-8d09-10a982d83efd tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 404 len: 111 microversion: 2.1 time: 0.060023 Jul 28 03:36:02.832064 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 111/235] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:02 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:02.950083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1bc30b69-90eb-4282-bca9-cbc3743c15a1 tempest-TenantUsagesTestJSON-1115366057 tempest-TenantUsagesTestJSON-1115366057-project-admin] Calling method '.version_select at 0x7ffa7695df70>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:02.986667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1bc30b69-90eb-4282-bca9-cbc3743c15a1 tempest-TenantUsagesTestJSON-1115366057 tempest-TenantUsagesTestJSON-1115366057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:02.988836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1bc30b69-90eb-4282-bca9-cbc3743c15a1 tempest-TenantUsagesTestJSON-1115366057 tempest-TenantUsagesTestJSON-1115366057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:03.022691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1bc30b69-90eb-4282-bca9-cbc3743c15a1 tempest-TenantUsagesTestJSON-1115366057 tempest-TenantUsagesTestJSON-1115366057-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:03.023603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1bc30b69-90eb-4282-bca9-cbc3743c15a1 tempest-TenantUsagesTestJSON-1115366057 tempest-TenantUsagesTestJSON-1115366057-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:03.066533 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1bc30b69-90eb-4282-bca9-cbc3743c15a1 tempest-TenantUsagesTestJSON-1115366057 tempest-TenantUsagesTestJSON-1115366057-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/8a83c47312474b3c87c42e684ed32f29?start=2022-07-27T03%3A36%3A01.860517&end=2022-07-29T03%3A36%3A01.860517" status: 200 len: 695 microversion: 2.1 time: 1.201132 Jul 28 03:36:03.067916 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 125/236] 10.222.0.48 () {58 vars in 1412 bytes} [Thu Jul 28 03:36:01 2022] GET /compute/v2.1/os-simple-tenant-usage/8a83c47312474b3c87c42e684ed32f29?start=2022-07-27T03%3A36%3A01.860517&end=2022-07-29T03%3A36%3A01.860517 => generated 695 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:03.106544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-facbaf53-6044-481f-9bd0-6e0a89102ec2 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '.version_select at 0x7ffa74eff3a0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:03.142795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-facbaf53-6044-481f-9bd0-6e0a89102ec2 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:03.143255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-facbaf53-6044-481f-9bd0-6e0a89102ec2 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:03.166981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-facbaf53-6044-481f-9bd0-6e0a89102ec2 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:03.167328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-facbaf53-6044-481f-9bd0-6e0a89102ec2 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:03.192828 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-facbaf53-6044-481f-9bd0-6e0a89102ec2 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/8a83c47312474b3c87c42e684ed32f29?start=2022-07-27T03%3A36%3A01.860517&end=2022-07-29T03%3A36%3A01.860517" status: 200 len: 695 microversion: 2.1 time: 0.093253 Jul 28 03:36:03.197458 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 126/237] 10.222.0.48 () {58 vars in 1412 bytes} [Thu Jul 28 03:36:03 2022] GET /compute/v2.1/os-simple-tenant-usage/8a83c47312474b3c87c42e684ed32f29?start=2022-07-27T03%3A36%3A01.860517&end=2022-07-29T03%3A36%3A01.860517 => generated 695 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:03.208910 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bac056ee-d0ac-4d6f-9140-a452b12e53c0 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Calling method '.version_select at 0x7ffa74fe9160>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:03.210257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a328397-8f23-4d08-a5c8-5347b95b4cd5 tempest-TenantUsagesTestJSON-1115366057 tempest-TenantUsagesTestJSON-1115366057-project-admin] Calling method '.version_select at 0x7ffa74fac160>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:03.212745 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:03.212745 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:36:03.224822 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bac056ee-d0ac-4d6f-9140-a452b12e53c0 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'c666530a48474ea98862e278bc7b7a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a249acd7b85e4c7b945444aaa3d459e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bac056ee-d0ac-4d6f-9140-a452b12e53c0 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Request method failure captured: Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gQf1hS-9gWSrBfYTXY5GJNtiE8FGEJhqJdiEv9Q7zpEgcEsHp2pcoMgxHNcLCc4v8aahdamVoVU73adhIzUswxFgn7VfV4aecCOToXXFFYwT1yGvaW5ZfMzpkjGJAvFNiwYKCIT06e_JGIyxMIPyTAFAbykWTyjRohLlyHw-aoNHto Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: a249acd7b85e4c7b945444aaa3d459e7 Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:36:03.236228 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:36:03.237923 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a249acd7b85e4c7b945444aaa3d459e7"}]}] Jul 28 03:36:03.237923 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:03.237923 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: a249acd7b85e4c7b945444aaa3d459e7 Jul 28 03:36:03.237923 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:03.237923 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HostsAdminNegativeTestJSON-1741651678-project Jul 28 03:36:03.237923 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:03.237923 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:03.237923 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: c666530a48474ea98862e278bc7b7a7b Jul 28 03:36:03.237923 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1741651678-project Jul 28 03:36:03.237923 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:36:03.237923 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 28 03:36:03.237923 n-d-826756-3 devstack@n-api.service[126072]: action_args: {} Jul 28 03:36:03.237923 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:36:03.238676 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 28 03:36:03.239757 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:03.242792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a328397-8f23-4d08-a5c8-5347b95b4cd5 tempest-TenantUsagesTestJSON-1115366057 tempest-TenantUsagesTestJSON-1115366057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:03.247876 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bac056ee-d0ac-4d6f-9140-a452b12e53c0 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:03.249058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a328397-8f23-4d08-a5c8-5347b95b4cd5 tempest-TenantUsagesTestJSON-1115366057 tempest-TenantUsagesTestJSON-1115366057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:03.250160 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bac056ee-d0ac-4d6f-9140-a452b12e53c0 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] 10.222.0.48 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.416912 Jul 28 03:36:03.257154 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 112/238] 10.222.0.48 () {58 vars in 1128 bytes} [Thu Jul 28 03:36:02 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 424 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:03.282419 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1344809725", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:03.304008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a328397-8f23-4d08-a5c8-5347b95b4cd5 tempest-TenantUsagesTestJSON-1115366057 tempest-TenantUsagesTestJSON-1115366057-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:03.304008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a328397-8f23-4d08-a5c8-5347b95b4cd5 tempest-TenantUsagesTestJSON-1115366057 tempest-TenantUsagesTestJSON-1115366057-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:03.404731 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4a328397-8f23-4d08-a5c8-5347b95b4cd5 tempest-TenantUsagesTestJSON-1115366057 tempest-TenantUsagesTestJSON-1115366057-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-27T03%3A36%3A01.860517&end=2022-07-29T03%3A36%3A01.860517&detailed=1" status: 200 len: 2116 microversion: 2.1 time: 0.198293 Jul 28 03:36:03.413837 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 127/239] 10.222.0.48 () {58 vars in 1335 bytes} [Thu Jul 28 03:36:03 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-27T03%3A36%3A01.860517&end=2022-07-29T03%3A36%3A01.860517&detailed=1 => generated 2116 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:36:03.423166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:36:03.433278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a3e46b1-8f3d-4ff0-ae1b-b186d8a85235 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Calling method '.version_select at 0x7ffa74efff70>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:03.437482 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:03.437482 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:03.451815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9a3e46b1-8f3d-4ff0-ae1b-b186d8a85235 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'c666530a48474ea98862e278bc7b7a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a249acd7b85e4c7b945444aaa3d459e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a3e46b1-8f3d-4ff0-ae1b-b186d8a85235 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Request method failure captured: Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-hosts/n-d-826756-3/reboot HTTP/1.1 Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gQf1hS-9gWSrBfYTXY5GJNtiE8FGEJhqJdiEv9Q7zpEgcEsHp2pcoMgxHNcLCc4v8aahdamVoVU73adhIzUswxFgn7VfV4aecCOToXXFFYwT1yGvaW5ZfMzpkjGJAvFNiwYKCIT06e_JGIyxMIPyTAFAbykWTyjRohLlyHw-aoNHto Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a249acd7b85e4c7b945444aaa3d459e7 Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:36:03.458699 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:36:03.459869 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a249acd7b85e4c7b945444aaa3d459e7"}]}] Jul 28 03:36:03.459869 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:03.459869 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a249acd7b85e4c7b945444aaa3d459e7 Jul 28 03:36:03.459869 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:03.459869 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-HostsAdminNegativeTestJSON-1741651678-project Jul 28 03:36:03.459869 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:36:03.459869 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:36:03.459869 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: c666530a48474ea98862e278bc7b7a7b Jul 28 03:36:03.459869 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1741651678-project Jul 28 03:36:03.459869 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:36:03.459869 n-d-826756-3 devstack@n-api.service[126071]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 28 03:36:03.459869 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'n-d-826756-3'} Jul 28 03:36:03.459869 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:36:03.460995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 28 03:36:03.462014 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:03.462913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a3e46b1-8f3d-4ff0-ae1b-b186d8a85235 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:03.462913 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9a3e46b1-8f3d-4ff0-ae1b-b186d8a85235 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-826756-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.043945 Jul 28 03:36:03.469526 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 128/240] 10.222.0.48 () {58 vars in 1188 bytes} [Thu Jul 28 03:36:03 2022] GET /compute/v2.1/os-hosts/n-d-826756-3/reboot => generated 111 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:03.477381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1bf81453-6366-4665-8e08-18941137bd73 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:03.477888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1bf81453-6366-4665-8e08-18941137bd73 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:03.495588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1bf81453-6366-4665-8e08-18941137bd73 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:03.498062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1bf81453-6366-4665-8e08-18941137bd73 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:03.499183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1bf81453-6366-4665-8e08-18941137bd73 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:03.499925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1bf81453-6366-4665-8e08-18941137bd73 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:03.564441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1bf81453-6366-4665-8e08-18941137bd73 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:36:03.708263 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1bf81453-6366-4665-8e08-18941137bd73 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 204 len: 0 microversion: 2.1 time: 0.238855 Jul 28 03:36:03.713037 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 129/241] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:36:03 2022] DELETE /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:36:03.726468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3cce562e-b396-4541-b812-0d2184427d05 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Calling method '.version_select at 0x7ffa74e4f040>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:03.728757 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:03.728757 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:03.744474 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-3cce562e-b396-4541-b812-0d2184427d05 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3cce562e-b396-4541-b812-0d2184427d05 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Request method failure captured: Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gQhAbp_2UcntqxPdNXqe43qMrBSo8IZ4XJ5bA_gVXpu_ahvEVQ3haN_jL9RhA9XwldeA5516WNZdlvqgZSC1QreifjX_ZRsYw35e26dwJ_hDRZ-omIIgbJHPaQFP9d7sBJBHj8CC03179jOQZJNrBL5aOKp45rE9d5W8anngTcexAk Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:36:03.745147 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:36:03.746427 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}] Jul 28 03:36:03.746427 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:03.746427 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:03.746427 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:03.746427 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:03.746427 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:36:03.746427 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:36:03.746427 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ef775697170841f1a5a8437d0a3f8af0 Jul 28 03:36:03.746427 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:03.746427 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:36:03.746427 n-d-826756-3 devstack@n-api.service[126071]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:03.746427 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'nonexistent_hostname'} Jul 28 03:36:03.746427 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5984, in targeted Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:36:03.747167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 28 03:36:03.748220 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:36:03.749290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:03.749290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:03.749290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:03.749290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:03.749290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:03.749290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:03.749290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:03.749290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:03.749290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:03.749290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:03.749290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:03.749290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3cce562e-b396-4541-b812-0d2184427d05 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:03.749290 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3cce562e-b396-4541-b812-0d2184427d05 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.033560 Jul 28 03:36:03.749290 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 130/242] 10.222.0.48 () {58 vars in 1212 bytes} [Thu Jul 28 03:36:03 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:36:03.754915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b82c7ea-cec3-4b2f-bdff-a8b64f2c2be7 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:03.755873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b82c7ea-cec3-4b2f-bdff-a8b64f2c2be7 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:03.776451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b82c7ea-cec3-4b2f-bdff-a8b64f2c2be7 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:03.777320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b82c7ea-cec3-4b2f-bdff-a8b64f2c2be7 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:03.782247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b82c7ea-cec3-4b2f-bdff-a8b64f2c2be7 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:03.783283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b82c7ea-cec3-4b2f-bdff-a8b64f2c2be7 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:04.028160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:36:04.029632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:36:04.030166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:36:04.030736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:36:04.031347 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:36:04.073502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:04.073502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:04.074518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:04.075170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:04.124996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b82c7ea-cec3-4b2f-bdff-a8b64f2c2be7 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:04.125893 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Getting quotas for project ac0afebe20824fd0898e22cbfaf03ba5. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:36:04.133461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Getting quotas for user 75b0c48126914b959b5926d24a5f8a82 and project ac0afebe20824fd0898e22cbfaf03ba5. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:36:04.138331 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b82c7ea-cec3-4b2f-bdff-a8b64f2c2be7 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1470 microversion: 2.1 time: 0.388463 Jul 28 03:36:04.139206 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 131/243] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:03 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1470 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:04.147648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3499f512-31d2-4aad-882d-12996b1d226f tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Calling method '.version_select at 0x7ffa74ea4ee0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:04.149384 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:04.149384 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:04.153536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3499f512-31d2-4aad-882d-12996b1d226f tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'c666530a48474ea98862e278bc7b7a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a249acd7b85e4c7b945444aaa3d459e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:04.153906 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:36:04.157052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3499f512-31d2-4aad-882d-12996b1d226f tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Request method failure captured: Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-hosts/n-d-826756-3 HTTP/1.1 Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gQf1hS-9gWSrBfYTXY5GJNtiE8FGEJhqJdiEv9Q7zpEgcEsHp2pcoMgxHNcLCc4v8aahdamVoVU73adhIzUswxFgn7VfV4aecCOToXXFFYwT1yGvaW5ZfMzpkjGJAvFNiwYKCIT06e_JGIyxMIPyTAFAbykWTyjRohLlyHw-aoNHto Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a249acd7b85e4c7b945444aaa3d459e7 Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:36:04.158428 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:36:04.159896 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a249acd7b85e4c7b945444aaa3d459e7"}]}] Jul 28 03:36:04.159896 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:04.159896 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a249acd7b85e4c7b945444aaa3d459e7 Jul 28 03:36:04.159896 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:04.159896 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-HostsAdminNegativeTestJSON-1741651678-project Jul 28 03:36:04.159896 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:36:04.159896 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:36:04.159896 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: c666530a48474ea98862e278bc7b7a7b Jul 28 03:36:04.159896 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1741651678-project Jul 28 03:36:04.159896 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:36:04.159896 n-d-826756-3 devstack@n-api.service[126071]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 28 03:36:04.159896 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'n-d-826756-3'} Jul 28 03:36:04.159896 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:36:04.160729 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 28 03:36:04.161730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.167568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3499f512-31d2-4aad-882d-12996b1d226f tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:04.167568 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3499f512-31d2-4aad-882d-12996b1d226f tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-826756-3" status: 403 len: 109 microversion: 2.1 time: 0.021528 Jul 28 03:36:04.167568 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 132/244] 10.222.0.48 () {58 vars in 1167 bytes} [Thu Jul 28 03:36:04 2022] GET /compute/v2.1/os-hosts/n-d-826756-3 => generated 109 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:04.253564 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5c09e152-7950-46b2-ba6f-878239d2fcc4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.992096 Jul 28 03:36:04.261157 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 113/245] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:36:04.268801 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bb69ebbf-1dbc-41f8-a8ba-66af5aa7a69e tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Calling method '.version_select at 0x7ffa7504bb80>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:04.270064 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:04.270064 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:36:04.276795 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-bb69ebbf-1dbc-41f8-a8ba-66af5aa7a69e tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bb69ebbf-1dbc-41f8-a8ba-66af5aa7a69e tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Request method failure captured: Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gQhAbp_2UcntqxPdNXqe43qMrBSo8IZ4XJ5bA_gVXpu_ahvEVQ3haN_jL9RhA9XwldeA5516WNZdlvqgZSC1QreifjX_ZRsYw35e26dwJ_hDRZ-omIIgbJHPaQFP9d7sBJBHj8CC03179jOQZJNrBL5aOKp45rE9d5W8anngTcexAk Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:36:04.279565 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:36:04.280811 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}] Jul 28 03:36:04.280811 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.280811 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:04.280811 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.280811 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:04.280811 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:04.280811 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:04.280811 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ef775697170841f1a5a8437d0a3f8af0 Jul 28 03:36:04.280811 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:04.280811 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:36:04.280811 n-d-826756-3 devstack@n-api.service[126072]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.280811 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'nonexistent_hostname'} Jul 28 03:36:04.280811 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.281577 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.282596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.285025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bb69ebbf-1dbc-41f8-a8ba-66af5aa7a69e tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:04.286109 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bb69ebbf-1dbc-41f8-a8ba-66af5aa7a69e tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023664 Jul 28 03:36:04.293297 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 114/246] 10.222.0.48 () {58 vars in 1191 bytes} [Thu Jul 28 03:36:04 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:36:04.299610 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d0574115-0d72-4f1f-98d0-7c787bc44ec7 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:04.300922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d0574115-0d72-4f1f-98d0-7c787bc44ec7 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:04.363404 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d0574115-0d72-4f1f-98d0-7c787bc44ec7 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:04.372046 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d0574115-0d72-4f1f-98d0-7c787bc44ec7 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1220 microversion: 2.1 time: 0.077214 Jul 28 03:36:04.373504 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 115/247] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:04 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1220 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:04.384957 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-20becccb-222b-4bb3-84ba-e7be86b28c06 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Calling method '.version_select at 0x7ffa750d0a60>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:04.386048 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:04.386048 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:36:04.387383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-20becccb-222b-4bb3-84ba-e7be86b28c06 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'c666530a48474ea98862e278bc7b7a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a249acd7b85e4c7b945444aaa3d459e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-20becccb-222b-4bb3-84ba-e7be86b28c06 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Request method failure captured: Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-hosts/n-d-826756-3/shutdown HTTP/1.1 Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gQf1hS-9gWSrBfYTXY5GJNtiE8FGEJhqJdiEv9Q7zpEgcEsHp2pcoMgxHNcLCc4v8aahdamVoVU73adhIzUswxFgn7VfV4aecCOToXXFFYwT1yGvaW5ZfMzpkjGJAvFNiwYKCIT06e_JGIyxMIPyTAFAbykWTyjRohLlyHw-aoNHto Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: a249acd7b85e4c7b945444aaa3d459e7 Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:36:04.389218 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:36:04.390396 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a249acd7b85e4c7b945444aaa3d459e7"}]}] Jul 28 03:36:04.390396 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:04.390396 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: a249acd7b85e4c7b945444aaa3d459e7 Jul 28 03:36:04.390396 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:04.390396 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HostsAdminNegativeTestJSON-1741651678-project Jul 28 03:36:04.390396 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:04.390396 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:04.390396 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: c666530a48474ea98862e278bc7b7a7b Jul 28 03:36:04.390396 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1741651678-project Jul 28 03:36:04.390396 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:36:04.390396 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 28 03:36:04.390396 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'n-d-826756-3'} Jul 28 03:36:04.390396 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:36:04.391245 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 28 03:36:04.392249 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.397714 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-20becccb-222b-4bb3-84ba-e7be86b28c06 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:04.405836 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-20becccb-222b-4bb3-84ba-e7be86b28c06 tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-826756-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.024227 Jul 28 03:36:04.417772 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 116/248] 10.222.0.48 () {58 vars in 1194 bytes} [Thu Jul 28 03:36:04 2022] GET /compute/v2.1/os-hosts/n-d-826756-3/shutdown => generated 113 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:04.423352 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5c72a2f7-d61e-46ba-a053-689dc7acba5f tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Calling method '.version_select at 0x7ffa7504bf70>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:04.434665 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-5c72a2f7-d61e-46ba-a053-689dc7acba5f tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5c72a2f7-d61e-46ba-a053-689dc7acba5f tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Request method failure captured: Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gQhAbp_2UcntqxPdNXqe43qMrBSo8IZ4XJ5bA_gVXpu_ahvEVQ3haN_jL9RhA9XwldeA5516WNZdlvqgZSC1QreifjX_ZRsYw35e26dwJ_hDRZ-omIIgbJHPaQFP9d7sBJBHj8CC03179jOQZJNrBL5aOKp45rE9d5W8anngTcexAk Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:36:04.436640 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:36:04.437960 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}] Jul 28 03:36:04.437960 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.437960 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:04.437960 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.437960 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:04.437960 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:04.437960 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:04.437960 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ef775697170841f1a5a8437d0a3f8af0 Jul 28 03:36:04.437960 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:04.437960 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:36:04.437960 n-d-826756-3 devstack@n-api.service[126072]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.437960 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'nonexistent_hostname'} Jul 28 03:36:04.437960 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5984, in targeted Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:36:04.438651 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 28 03:36:04.439674 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:36:04.440712 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.440712 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.440712 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.440712 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.440712 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.440712 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.440712 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.440712 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:04.440712 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:04.440712 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.440712 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.443903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5c72a2f7-d61e-46ba-a053-689dc7acba5f tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:04.445369 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5c72a2f7-d61e-46ba-a053-689dc7acba5f tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.025717 Jul 28 03:36:04.455235 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 117/249] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 03:36:04 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:36:04.465016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-18e50244-8cfb-4338-b3ce-04f0ca858aea tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Calling method '.version_select at 0x7ffa7504b8b0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:04.466095 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:04.466095 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:36:04.480884 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-18e50244-8cfb-4338-b3ce-04f0ca858aea tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'c666530a48474ea98862e278bc7b7a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a249acd7b85e4c7b945444aaa3d459e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-18e50244-8cfb-4338-b3ce-04f0ca858aea tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Request method failure captured: Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-hosts/n-d-826756-3/startup HTTP/1.1 Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gQf1hS-9gWSrBfYTXY5GJNtiE8FGEJhqJdiEv9Q7zpEgcEsHp2pcoMgxHNcLCc4v8aahdamVoVU73adhIzUswxFgn7VfV4aecCOToXXFFYwT1yGvaW5ZfMzpkjGJAvFNiwYKCIT06e_JGIyxMIPyTAFAbykWTyjRohLlyHw-aoNHto Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: a249acd7b85e4c7b945444aaa3d459e7 Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:36:04.482827 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:36:04.484261 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a249acd7b85e4c7b945444aaa3d459e7"}]}] Jul 28 03:36:04.484261 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:04.484261 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: a249acd7b85e4c7b945444aaa3d459e7 Jul 28 03:36:04.484261 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:04.484261 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HostsAdminNegativeTestJSON-1741651678-project Jul 28 03:36:04.484261 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:04.484261 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:04.484261 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: c666530a48474ea98862e278bc7b7a7b Jul 28 03:36:04.484261 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1741651678-project Jul 28 03:36:04.484261 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:36:04.484261 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 28 03:36:04.484261 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'n-d-826756-3'} Jul 28 03:36:04.484261 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:36:04.485289 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 28 03:36:04.486541 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.488711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-18e50244-8cfb-4338-b3ce-04f0ca858aea tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:04.489700 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-18e50244-8cfb-4338-b3ce-04f0ca858aea tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] 10.222.0.48 "GET /compute/v2.1/os-hosts/n-d-826756-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.033289 Jul 28 03:36:04.508080 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 118/250] 10.222.0.48 () {58 vars in 1191 bytes} [Thu Jul 28 03:36:04 2022] GET /compute/v2.1/os-hosts/n-d-826756-3/startup => generated 110 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:04.514097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aec78d6f-5938-4228-a880-99778257c20f tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Calling method '.version_select at 0x7ffa750d0280>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:04.527238 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-aec78d6f-5938-4228-a880-99778257c20f tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aec78d6f-5938-4228-a880-99778257c20f tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Request method failure captured: Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gQhAbp_2UcntqxPdNXqe43qMrBSo8IZ4XJ5bA_gVXpu_ahvEVQ3haN_jL9RhA9XwldeA5516WNZdlvqgZSC1QreifjX_ZRsYw35e26dwJ_hDRZ-omIIgbJHPaQFP9d7sBJBHj8CC03179jOQZJNrBL5aOKp45rE9d5W8anngTcexAk Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:36:04.529407 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:36:04.531546 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}] Jul 28 03:36:04.531546 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.531546 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:04.531546 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.531546 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:04.531546 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:04.531546 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:04.531546 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ef775697170841f1a5a8437d0a3f8af0 Jul 28 03:36:04.531546 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:04.531546 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:36:04.531546 n-d-826756-3 devstack@n-api.service[126072]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.531546 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'nonexistent_hostname'} Jul 28 03:36:04.531546 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5984, in targeted Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:36:04.532595 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 28 03:36:04.533836 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:36:04.535081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.535081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.535081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.535081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.535081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.535081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.535081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.535081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:04.535081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:04.535081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.535081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.537021 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aec78d6f-5938-4228-a880-99778257c20f tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:04.538584 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aec78d6f-5938-4228-a880-99778257c20f tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.028488 Jul 28 03:36:04.545964 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 119/251] 10.222.0.48 () {58 vars in 1215 bytes} [Thu Jul 28 03:36:04 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:36:04.553256 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6d56bdcc-dcc5-4b0b-ad66-1abb0ab77700 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74f7a790>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6d56bdcc-dcc5-4b0b-ad66-1abb0ab77700 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Request method failure captured: Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: request: PUT /compute/v2.1/os-hosts/n-d-826756-3 HTTP/1.1 Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 51 Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gQhAbp_2UcntqxPdNXqe43qMrBSo8IZ4XJ5bA_gVXpu_ahvEVQ3haN_jL9RhA9XwldeA5516WNZdlvqgZSC1QreifjX_ZRsYw35e26dwJ_hDRZ-omIIgbJHPaQFP9d7sBJBHj8CC03179jOQZJNrBL5aOKp45rE9d5W8anngTcexAk Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:36:04.557986 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:36:04.559327 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}] Jul 28 03:36:04.559327 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.559327 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:04.559327 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.559327 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:04.559327 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:04.559327 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:04.559327 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ef775697170841f1a5a8437d0a3f8af0 Jul 28 03:36:04.559327 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:04.559327 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:36:04.559327 n-d-826756-3 devstack@n-api.service[126072]: {"status": "enable", "maintenance_mode": "invalid"} Jul 28 03:36:04.559327 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:36:04.559327 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'n-d-826756-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'disable', Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'Enable', Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'Disable', Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance: Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'invalid' Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.560160 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.561994 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.563415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.563415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:36:04.563415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:36:04.563415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 03:36:04.563415 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.565826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6d56bdcc-dcc5-4b0b-ad66-1abb0ab77700 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:04.566240 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6d56bdcc-dcc5-4b0b-ad66-1abb0ab77700 tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-826756-3" status: 400 len: 199 microversion: 2.1 time: 0.018486 Jul 28 03:36:04.573203 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 120/252] 10.222.0.48 () {60 vars in 1187 bytes} [Thu Jul 28 03:36:04 2022] PUT /compute/v2.1/os-hosts/n-d-826756-3 => generated 199 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:36:04.579769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a2326c2b-a98d-46bd-90bd-591659f2204f tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74f7ae50>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a2326c2b-a98d-46bd-90bd-591659f2204f tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Request method failure captured: Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: request: PUT /compute/v2.1/os-hosts/n-d-826756-3 HTTP/1.1 Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 51 Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gQhAbp_2UcntqxPdNXqe43qMrBSo8IZ4XJ5bA_gVXpu_ahvEVQ3haN_jL9RhA9XwldeA5516WNZdlvqgZSC1QreifjX_ZRsYw35e26dwJ_hDRZ-omIIgbJHPaQFP9d7sBJBHj8CC03179jOQZJNrBL5aOKp45rE9d5W8anngTcexAk Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:36:04.585571 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:36:04.586887 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}] Jul 28 03:36:04.586887 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.586887 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:04.586887 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.586887 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:04.586887 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:04.586887 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:04.586887 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ef775697170841f1a5a8437d0a3f8af0 Jul 28 03:36:04.586887 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:04.586887 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:36:04.586887 n-d-826756-3 devstack@n-api.service[126072]: {"status": "invalid", "maintenance_mode": "enable"} Jul 28 03:36:04.586887 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:36:04.586887 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'n-d-826756-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'disable', Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'Enable', Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'Disable', Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance: Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'invalid' Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.587635 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.589090 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.590079 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.590079 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:36:04.590079 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:36:04.590079 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 28 03:36:04.590079 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.591308 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a2326c2b-a98d-46bd-90bd-591659f2204f tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:04.592616 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a2326c2b-a98d-46bd-90bd-591659f2204f tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-826756-3" status: 400 len: 189 microversion: 2.1 time: 0.018145 Jul 28 03:36:04.600415 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 121/253] 10.222.0.48 () {60 vars in 1187 bytes} [Thu Jul 28 03:36:04 2022] PUT /compute/v2.1/os-hosts/n-d-826756-3 => generated 189 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:36:04.606670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cceb0b76-5e5c-407e-95a0-d31b3ab870cb tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Action: 'update', calling method: .version_select at 0x7ffa74fab4c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:04.610585 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:04.610585 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:36:04.612143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cceb0b76-5e5c-407e-95a0-d31b3ab870cb tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'c666530a48474ea98862e278bc7b7a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a249acd7b85e4c7b945444aaa3d459e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cceb0b76-5e5c-407e-95a0-d31b3ab870cb tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Request method failure captured: Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: request: PUT /compute/v2.1/os-hosts/n-d-826756-3 HTTP/1.1 Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 50 Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gQf1hS-9gWSrBfYTXY5GJNtiE8FGEJhqJdiEv9Q7zpEgcEsHp2pcoMgxHNcLCc4v8aahdamVoVU73adhIzUswxFgn7VfV4aecCOToXXFFYwT1yGvaW5ZfMzpkjGJAvFNiwYKCIT06e_JGIyxMIPyTAFAbykWTyjRohLlyHw-aoNHto Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: a249acd7b85e4c7b945444aaa3d459e7 Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:36:04.617533 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:36:04.619045 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a249acd7b85e4c7b945444aaa3d459e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a249acd7b85e4c7b945444aaa3d459e7"}]}] Jul 28 03:36:04.619045 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:04.619045 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: a249acd7b85e4c7b945444aaa3d459e7 Jul 28 03:36:04.619045 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1741651678 Jul 28 03:36:04.619045 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HostsAdminNegativeTestJSON-1741651678-project Jul 28 03:36:04.619045 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:04.619045 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:04.619045 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: c666530a48474ea98862e278bc7b7a7b Jul 28 03:36:04.619045 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1741651678-project Jul 28 03:36:04.619045 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:36:04.619045 n-d-826756-3 devstack@n-api.service[126072]: {"status": "enable", "maintenance_mode": "enable"} Jul 28 03:36:04.619045 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:36:04.619045 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 28 03:36:04.619045 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'n-d-826756-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:36:04.619983 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 28 03:36:04.621307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.623978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cceb0b76-5e5c-407e-95a0-d31b3ab870cb tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:04.630470 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cceb0b76-5e5c-407e-95a0-d31b3ab870cb tempest-HostsAdminNegativeTestJSON-1741651678 tempest-HostsAdminNegativeTestJSON-1741651678-project] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-826756-3" status: 403 len: 111 microversion: 2.1 time: 0.023826 Jul 28 03:36:04.638438 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 122/254] 10.222.0.48 () {60 vars in 1187 bytes} [Thu Jul 28 03:36:04 2022] PUT /compute/v2.1/os-hosts/n-d-826756-3 => generated 111 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:04.648821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-410dd5b3-fe65-4530-8341-83e42c497b9a tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74fab940>, body: {"status": null, "maintenance_mode": null} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-410dd5b3-fe65-4530-8341-83e42c497b9a tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Request method failure captured: Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: request: PUT /compute/v2.1/os-hosts/n-d-826756-3 HTTP/1.1 Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 42 Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gQhAbp_2UcntqxPdNXqe43qMrBSo8IZ4XJ5bA_gVXpu_ahvEVQ3haN_jL9RhA9XwldeA5516WNZdlvqgZSC1QreifjX_ZRsYw35e26dwJ_hDRZ-omIIgbJHPaQFP9d7sBJBHj8CC03179jOQZJNrBL5aOKp45rE9d5W8anngTcexAk Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:36:04.653168 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:36:04.654622 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}] Jul 28 03:36:04.654622 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.654622 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:04.654622 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.654622 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:04.654622 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:04.654622 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:04.654622 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ef775697170841f1a5a8437d0a3f8af0 Jul 28 03:36:04.654622 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:04.654622 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:36:04.654622 n-d-826756-3 devstack@n-api.service[126072]: {"status": null, "maintenance_mode": null} Jul 28 03:36:04.654622 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:36:04.654622 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 28 03:36:04.654622 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'n-d-826756-3', 'body': {'status': None, 'maintenance_mode': None}} Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'disable', Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'Enable', Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'Disable', Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance: Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi None Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.655527 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.657496 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.658706 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:36:04.658706 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:36:04.658706 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 28 03:36:04.658706 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.661905 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-410dd5b3-fe65-4530-8341-83e42c497b9a tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:04.662944 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-410dd5b3-fe65-4530-8341-83e42c497b9a tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/n-d-826756-3" status: 400 len: 127 microversion: 2.1 time: 0.022109 Jul 28 03:36:04.670546 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 123/255] 10.222.0.48 () {60 vars in 1187 bytes} [Thu Jul 28 03:36:04 2022] PUT /compute/v2.1/os-hosts/n-d-826756-3 => generated 127 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:36:04.678312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-419377a8-c157-49da-b5d5-f2e5ca3ae5ab tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74f7aca0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:04.683400 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.hosts [None req-419377a8-c157-49da-b5d5-f2e5ca3ae5ab tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Enabling host nonexistent_hostname. Jul 28 03:36:04.698214 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-419377a8-c157-49da-b5d5-f2e5ca3ae5ab tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-419377a8-c157-49da-b5d5-f2e5ca3ae5ab tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Request method failure captured: Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 50 Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gQhAbp_2UcntqxPdNXqe43qMrBSo8IZ4XJ5bA_gVXpu_ahvEVQ3haN_jL9RhA9XwldeA5516WNZdlvqgZSC1QreifjX_ZRsYw35e26dwJ_hDRZ-omIIgbJHPaQFP9d7sBJBHj8CC03179jOQZJNrBL5aOKp45rE9d5W8anngTcexAk Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:36:04.700460 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:36:04.701942 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b9c628cacc874f4ea4f2f13135289355"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9c628cacc874f4ea4f2f13135289355"}]}] Jul 28 03:36:04.701942 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.701942 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: b9c628cacc874f4ea4f2f13135289355 Jul 28 03:36:04.701942 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-604450921 Jul 28 03:36:04.701942 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:04.701942 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:04.701942 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:04.701942 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ef775697170841f1a5a8437d0a3f8af0 Jul 28 03:36:04.701942 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-HostsAdminNegativeTestJSON-604450921-project-admin Jul 28 03:36:04.701942 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:36:04.701942 n-d-826756-3 devstack@n-api.service[126072]: {"status": "enable", "maintenance_mode": "enable"} Jul 28 03:36:04.701942 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:36:04.701942 n-d-826756-3 devstack@n-api.service[126072]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.701942 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5984, in targeted Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 28 03:36:04.702847 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:36:04.704077 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 28 03:36:04.705458 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 28 03:36:04.705458 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 28 03:36:04.705458 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:36:04.705458 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.705458 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.705458 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:04.705458 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.705458 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:04.705458 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:04.705458 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:04.705458 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:04.705458 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:04.705458 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 28 03:36:04.705458 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:04.708126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-419377a8-c157-49da-b5d5-f2e5ca3ae5ab tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:04.709117 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-419377a8-c157-49da-b5d5-f2e5ca3ae5ab tempest-HostsAdminNegativeTestJSON-604450921 tempest-HostsAdminNegativeTestJSON-604450921-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.037235 Jul 28 03:36:04.717393 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 124/256] 10.222.0.48 () {60 vars in 1211 bytes} [Thu Jul 28 03:36:04 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:36:05.169271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b355ae01-ad1f-4d4d-a5dd-4b94a53853f3 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:05.171827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b355ae01-ad1f-4d4d-a5dd-4b94a53853f3 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:05.185393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b355ae01-ad1f-4d4d-a5dd-4b94a53853f3 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:05.189960 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b355ae01-ad1f-4d4d-a5dd-4b94a53853f3 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:05.195283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b355ae01-ad1f-4d4d-a5dd-4b94a53853f3 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:05.196284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b355ae01-ad1f-4d4d-a5dd-4b94a53853f3 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:05.317500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-84d78493-09af-4e28-8fbb-3f2010c632dc tempest-FlavorMetadataValidation-623938166 tempest-FlavorMetadataValidation-623938166-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1815415936", "id": 1700158382, "os-flavor-access:is_public": "True"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:05.320670 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:05.320670 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:05.430008 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-84d78493-09af-4e28-8fbb-3f2010c632dc tempest-FlavorMetadataValidation-623938166 tempest-FlavorMetadataValidation-623938166-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 1.264125 Jul 28 03:36:05.432102 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 133/257] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:36:04 2022] POST /compute/v2.1/flavors => generated 471 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:05.457647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7ff0765b-3274-4e9f-a111-fa70f1f4dd1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:05.458701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7ff0765b-3274-4e9f-a111-fa70f1f4dd1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:05.636406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7ff0765b-3274-4e9f-a111-fa70f1f4dd1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:05.650977 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7ff0765b-3274-4e9f-a111-fa70f1f4dd1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1220 microversion: 2.1 time: 0.214262 Jul 28 03:36:05.654527 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 134/258] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:05 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1220 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:05.682759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a216ae5f-7208-41b0-ae7b-89c63d2526a9 tempest-FlavorMetadataValidation-623938166 tempest-FlavorMetadataValidation-623938166-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:05.691392 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:05.691392 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:05.988671 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a216ae5f-7208-41b0-ae7b-89c63d2526a9 tempest-FlavorMetadataValidation-623938166 tempest-FlavorMetadataValidation-623938166-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1700158382/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.329495 Jul 28 03:36:05.994194 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 135/259] 10.222.0.48 () {62 vars in 1265 bytes} [Thu Jul 28 03:36:05 2022] POST /compute/v2.1/flavors/1700158382/os-extra_specs => generated 62 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:06.572687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7273619e-e56d-4011-87b3-caea04bdbff5 tempest-QuotaClassesAdmin257Test-1120762673 tempest-QuotaClassesAdmin257Test-1120762673-project-admin] Calling method '.version_select at 0x7ffa74effb80>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:06.573531 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:06.573531 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:06.588173 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7273619e-e56d-4011-87b3-caea04bdbff5 tempest-QuotaClassesAdmin257Test-1120762673 tempest-QuotaClassesAdmin257Test-1120762673-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.596482 Jul 28 03:36:06.589139 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 136/260] 10.222.0.48 () {60 vars in 1226 bytes} [Thu Jul 28 03:36:05 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:06.819051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b355ae01-ad1f-4d4d-a5dd-4b94a53853f3 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:06.838740 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b355ae01-ad1f-4d4d-a5dd-4b94a53853f3 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1470 microversion: 2.1 time: 1.673176 Jul 28 03:36:06.842438 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 125/261] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:05 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1470 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:06.863298 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c8c26ebf-5134-43d9-85ca-7e247458e405 tempest-FlavorMetadataValidation-623938166 tempest-FlavorMetadataValidation-623938166-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:06.866837 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:06.866837 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:36:06.894992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-520896f1-4dfd-47f1-bdc0-c7ea6bbf409b tempest-FlavorsV255TestJSON-174148712 tempest-FlavorsV255TestJSON-174148712-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1963749563", "id": 387470149, "os-flavor-access:is_public": "True"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:06.941959 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c8c26ebf-5134-43d9-85ca-7e247458e405 tempest-FlavorMetadataValidation-623938166 tempest-FlavorMetadataValidation-623938166-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1700158382" status: 202 len: 0 microversion: 2.86 time: 0.093417 Jul 28 03:36:06.942601 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 126/262] 10.222.0.48 () {60 vars in 1202 bytes} [Thu Jul 28 03:36:06 2022] DELETE /compute/v2.1/flavors/1700158382 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:36:06.947833 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:06.947833 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:06.949484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6b6b4f1d-38f2-4a03-b802-0bd9129d40a8 tempest-QuotaClassesAdmin257Test-1120762673 tempest-QuotaClassesAdmin257Test-1120762673-project-admin] Action: 'update', calling method: .version_select at 0x7ffa7504bee0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:06.961131 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:06.961131 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:36:06.985866 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-520896f1-4dfd-47f1-bdc0-c7ea6bbf409b tempest-FlavorsV255TestJSON-174148712 tempest-FlavorsV255TestJSON-174148712-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.385190 Jul 28 03:36:06.993732 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 137/263] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:36:06 2022] POST /compute/v2.1/flavors => generated 446 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:07.010877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-77cb64fe-5ee4-467a-9ec7-264044f46f5d tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:07.011813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-77cb64fe-5ee4-467a-9ec7-264044f46f5d tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:07.029355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77cb64fe-5ee4-467a-9ec7-264044f46f5d tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:07.030734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77cb64fe-5ee4-467a-9ec7-264044f46f5d tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:07.043947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77cb64fe-5ee4-467a-9ec7-264044f46f5d tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:07.044700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77cb64fe-5ee4-467a-9ec7-264044f46f5d tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:07.227518 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6b6b4f1d-38f2-4a03-b802-0bd9129d40a8 tempest-QuotaClassesAdmin257Test-1120762673 tempest-QuotaClassesAdmin257Test-1120762673-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.283818 Jul 28 03:36:07.228729 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 127/264] 10.222.0.48 () {62 vars in 1247 bytes} [Thu Jul 28 03:36:06 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:07.240621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b6cb91f6-9843-4db6-bb58-b68a678f5508 tempest-FlavorMetadataValidation-623938166 tempest-FlavorMetadataValidation-623938166-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:07.287357 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b6cb91f6-9843-4db6-bb58-b68a678f5508 tempest-FlavorMetadataValidation-623938166 tempest-FlavorMetadataValidation-623938166-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 6231 microversion: 2.86 time: 0.057259 Jul 28 03:36:07.297518 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 128/265] 10.222.0.48 () {60 vars in 1187 bytes} [Thu Jul 28 03:36:07 2022] GET /compute/v2.1/flavors/detail => generated 6231 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:36:07.461095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-77cb64fe-5ee4-467a-9ec7-264044f46f5d tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:07.473384 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-77cb64fe-5ee4-467a-9ec7-264044f46f5d tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1280 microversion: 2.1 time: 0.474816 Jul 28 03:36:07.483554 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 138/266] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:06 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1280 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:07.498434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5fa8803c-4ff0-48ac-8eb3-6b450069d58a tempest-QuotaClassesAdmin257Test-1120762673 tempest-QuotaClassesAdmin257Test-1120762673-project-admin] Calling method '.version_select at 0x7ffa74e5e160>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:07.500661 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:07.500661 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:07.519205 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5fa8803c-4ff0-48ac-8eb3-6b450069d58a tempest-QuotaClassesAdmin257Test-1120762673 tempest-QuotaClassesAdmin257Test-1120762673-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.033866 Jul 28 03:36:07.520475 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 139/267] 10.222.0.48 () {60 vars in 1226 bytes} [Thu Jul 28 03:36:07 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:07.526828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e5ff75e6-1125-44b9-81b9-ac26916b15e4 req-2f677f3d-389b-4d15-8195-575a2aa19031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5379308-b878-4613-9545-17da5acd5bc1", "name": "network-vif-deleted", "tag": "8e644a67-03d3-44d0-b877-8cc29c05f1d1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:07.550258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e5ff75e6-1125-44b9-81b9-ac26916b15e4 req-2f677f3d-389b-4d15-8195-575a2aa19031 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:07.551087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e5ff75e6-1125-44b9-81b9-ac26916b15e4 req-2f677f3d-389b-4d15-8195-575a2aa19031 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:07.566240 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e5ff75e6-1125-44b9-81b9-ac26916b15e4 req-2f677f3d-389b-4d15-8195-575a2aa19031 service nova] Creating event network-vif-deleted:8e644a67-03d3-44d0-b877-8cc29c05f1d1 for instance b5379308-b878-4613-9545-17da5acd5bc1 on n-h1-826756-3 Jul 28 03:36:07.572639 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e5ff75e6-1125-44b9-81b9-ac26916b15e4 req-2f677f3d-389b-4d15-8195-575a2aa19031 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050268 Jul 28 03:36:07.573741 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 140/268] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:07.584516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7149bc5d-da9d-46f5-a426-616be3155160 tempest-QuotaClassesAdmin257Test-1120762673 tempest-QuotaClassesAdmin257Test-1120762673-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74ea4550>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:07.600298 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:07.600298 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:07.747565 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7149bc5d-da9d-46f5-a426-616be3155160 tempest-QuotaClassesAdmin257Test-1120762673 tempest-QuotaClassesAdmin257Test-1120762673-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.171571 Jul 28 03:36:07.751012 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 141/269] 10.222.0.48 () {62 vars in 1247 bytes} [Thu Jul 28 03:36:07 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:07.805503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4684a0a0-72a3-4167-9658-efe223f11475 tempest-FlavorsV255TestJSON-183228375 tempest-FlavorsV255TestJSON-183228375-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:07.821915 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=5,nova_api:UPDATE=8,nova_api:INSERT=5 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:07.829192 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4684a0a0-72a3-4167-9658-efe223f11475 tempest-FlavorsV255TestJSON-183228375 tempest-FlavorsV255TestJSON-183228375-project] 10.222.0.48 "GET /compute/v2.1/flavors/387470149" status: 200 len: 446 microversion: 2.55 time: 0.528764 Jul 28 03:36:07.845757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1cf6ff56-da26-4d32-8ce1-f509e4675dd4 tempest-FlavorsV255TestJSON-174148712 tempest-FlavorsV255TestJSON-174148712-project-admin] Action: 'update', calling method: .version_select at 0x7ffa773809d0>, body: {"flavor": {"description": "new"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:07.855346 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 129/270] 10.222.0.48 () {60 vars in 1196 bytes} [Thu Jul 28 03:36:07 2022] GET /compute/v2.1/flavors/387470149 => generated 446 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:07.876043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-550bcfb4-859f-4d70-90ac-5bde55e4b7f5 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:07.876454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-550bcfb4-859f-4d70-90ac-5bde55e4b7f5 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:07.896060 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:07.896060 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:07.918000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-550bcfb4-859f-4d70-90ac-5bde55e4b7f5 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:07.918515 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-550bcfb4-859f-4d70-90ac-5bde55e4b7f5 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:07.924456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-550bcfb4-859f-4d70-90ac-5bde55e4b7f5 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:07.924974 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-550bcfb4-859f-4d70-90ac-5bde55e4b7f5 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:08.014046 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1cf6ff56-da26-4d32-8ce1-f509e4675dd4 tempest-FlavorsV255TestJSON-174148712 tempest-FlavorsV255TestJSON-174148712-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/387470149" status: 200 len: 447 microversion: 2.55 time: 0.172915 Jul 28 03:36:08.030038 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 142/271] 10.222.0.48 () {62 vars in 1216 bytes} [Thu Jul 28 03:36:07 2022] PUT /compute/v2.1/flavors/387470149 => generated 447 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:08.070134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca491a90-4680-4037-a8fc-d795f89d7207 tempest-FlavorsV255TestJSON-183228375 tempest-FlavorsV255TestJSON-183228375-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:08.101909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-550bcfb4-859f-4d70-90ac-5bde55e4b7f5 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:08.105502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-550bcfb4-859f-4d70-90ac-5bde55e4b7f5 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:08.107698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-550bcfb4-859f-4d70-90ac-5bde55e4b7f5 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lazy-loading 'fault' on Instance uuid b5379308-b878-4613-9545-17da5acd5bc1 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:36:08.174460 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca491a90-4680-4037-a8fc-d795f89d7207 tempest-FlavorsV255TestJSON-183228375 tempest-FlavorsV255TestJSON-183228375-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.127179 Jul 28 03:36:08.177905 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 143/272] 10.222.0.48 () {60 vars in 1187 bytes} [Thu Jul 28 03:36:08 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:36:08.215050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ea2af960-60a0-40cb-85b1-be1da506b720 tempest-FlavorsV255TestJSON-183228375 tempest-FlavorsV255TestJSON-183228375-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:08.235523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=2,nova_api:UPDATE=9,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:08.284797 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ea2af960-60a0-40cb-85b1-be1da506b720 tempest-FlavorsV255TestJSON-183228375 tempest-FlavorsV255TestJSON-183228375-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.078840 Jul 28 03:36:08.297698 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 144/273] 10.222.0.48 () {60 vars in 1166 bytes} [Thu Jul 28 03:36:08 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:36:08.304559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ddd9076-6de0-43ff-ab55-da7fcfe11d33 tempest-FlavorsV255TestJSON-174148712 tempest-FlavorsV255TestJSON-174148712-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:08.305249 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:08.305249 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:08.332776 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ddd9076-6de0-43ff-ab55-da7fcfe11d33 tempest-FlavorsV255TestJSON-174148712 tempest-FlavorsV255TestJSON-174148712-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/387470149" status: 202 len: 0 microversion: 2.55 time: 0.033779 Jul 28 03:36:08.337150 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 145/274] 10.222.0.48 () {60 vars in 1199 bytes} [Thu Jul 28 03:36:08 2022] DELETE /compute/v2.1/flavors/387470149 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:36:08.349045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f50deaef-6140-4b82-b0d3-f1dd2e7a17b3 tempest-FlavorsV255TestJSON-174148712 tempest-FlavorsV255TestJSON-174148712-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:08.433532 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-550bcfb4-859f-4d70-90ac-5bde55e4b7f5 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e4523bd004cd288f0fcddb9233262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a83c47312474b3c87c42e684ed32f29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:08.446547 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f50deaef-6140-4b82-b0d3-f1dd2e7a17b3 tempest-FlavorsV255TestJSON-174148712 tempest-FlavorsV255TestJSON-174148712-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.106471 Jul 28 03:36:08.457592 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 146/275] 10.222.0.48 () {60 vars in 1187 bytes} [Thu Jul 28 03:36:08 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:36:08.466344 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-550bcfb4-859f-4d70-90ac-5bde55e4b7f5 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 200 len: 1304 microversion: 2.1 time: 0.588901 Jul 28 03:36:08.469391 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 130/276] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:07 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 1304 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:08.503920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4241633-72d5-4eb1-9b20-39c40836be53 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:08.504867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4241633-72d5-4eb1-9b20-39c40836be53 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:08.533420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4241633-72d5-4eb1-9b20-39c40836be53 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:08.533910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4241633-72d5-4eb1-9b20-39c40836be53 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:08.538940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4241633-72d5-4eb1-9b20-39c40836be53 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:08.539423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4241633-72d5-4eb1-9b20-39c40836be53 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:08.817555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f4241633-72d5-4eb1-9b20-39c40836be53 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:08.827031 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4241633-72d5-4eb1-9b20-39c40836be53 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1278 microversion: 2.1 time: 0.331060 Jul 28 03:36:08.827882 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 147/277] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:08 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1278 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:09.497766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3b90d579-fb23-463a-a4af-5f9e4d33a876 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:09.498369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3b90d579-fb23-463a-a4af-5f9e4d33a876 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] [instance: b5379308-b878-4613-9545-17da5acd5bc1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:09.511893 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b90d579-fb23-463a-a4af-5f9e4d33a876 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:09.512780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b90d579-fb23-463a-a4af-5f9e4d33a876 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:09.513716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b90d579-fb23-463a-a4af-5f9e4d33a876 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:09.514297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b90d579-fb23-463a-a4af-5f9e4d33a876 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:09.543759 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-3b90d579-fb23-463a-a4af-5f9e4d33a876 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] HTTP exception thrown: Instance b5379308-b878-4613-9545-17da5acd5bc1 could not be found. Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3b90d579-fb23-463a-a4af-5f9e4d33a876 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Request method failure captured: Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 HTTP/1.1 Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gQM-XNuvWEoHDGJj5iFBb4eRz1Zt7f_8wxr8wy6WoXVPzs6HUvoFPtvvjCG5TQ80W6yzqKqY33UJGwcM1invp8d_buI_Ahs9B57xOy0M6W8TJo-RrVcMswkJGZj4GB9UXa5Ty5dLljB6lm9gv00Ly6ch5wk3A4jCOLPTkUK5aLSPaI Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 8a83c47312474b3c87c42e684ed32f29 Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-TenantUsagesTestJSON-637223359 Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:36:09.545768 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:36:09.547286 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8a83c47312474b3c87c42e684ed32f29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8a83c47312474b3c87c42e684ed32f29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8a83c47312474b3c87c42e684ed32f29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8a83c47312474b3c87c42e684ed32f29"}]}] Jul 28 03:36:09.547286 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-TenantUsagesTestJSON-637223359 Jul 28 03:36:09.547286 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 8a83c47312474b3c87c42e684ed32f29 Jul 28 03:36:09.547286 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-TenantUsagesTestJSON-637223359 Jul 28 03:36:09.547286 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-TenantUsagesTestJSON-637223359-project Jul 28 03:36:09.547286 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:09.547286 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:09.547286 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 985e4523bd004cd288f0fcddb9233262 Jul 28 03:36:09.547286 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-TenantUsagesTestJSON-637223359-project Jul 28 03:36:09.547286 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:36:09.547286 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance b5379308-b878-4613-9545-17da5acd5bc1 could not be found. Jul 28 03:36:09.547286 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'b5379308-b878-4613-9545-17da5acd5bc1'} Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5379308-b878-4613-9545-17da5acd5bc1 could not be found. Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:09.548098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5379308-b878-4613-9545-17da5acd5bc1 could not be found. Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5379308-b878-4613-9545-17da5acd5bc1 could not be found. Jul 28 03:36:09.549510 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:09.553893 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3b90d579-fb23-463a-a4af-5f9e4d33a876 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] Returning 404 to user: Instance b5379308-b878-4613-9545-17da5acd5bc1 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:09.555119 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3b90d579-fb23-463a-a4af-5f9e4d33a876 tempest-TenantUsagesTestJSON-637223359 tempest-TenantUsagesTestJSON-637223359-project] 10.222.0.48 "GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1" status: 404 len: 111 microversion: 2.1 time: 0.061152 Jul 28 03:36:09.557172 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 131/278] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:09 2022] GET /compute/v2.1/servers/b5379308-b878-4613-9545-17da5acd5bc1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:09.865236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d83d79ae-b10e-4cf1-bf10-4ff69c1823f5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:09.867413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d83d79ae-b10e-4cf1-bf10-4ff69c1823f5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:09.875388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d83d79ae-b10e-4cf1-bf10-4ff69c1823f5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:09.880199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d83d79ae-b10e-4cf1-bf10-4ff69c1823f5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:09.883267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d83d79ae-b10e-4cf1-bf10-4ff69c1823f5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:09.883852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d83d79ae-b10e-4cf1-bf10-4ff69c1823f5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:10.246548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d83d79ae-b10e-4cf1-bf10-4ff69c1823f5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:10.262846 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d83d79ae-b10e-4cf1-bf10-4ff69c1823f5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1278 microversion: 2.1 time: 0.400338 Jul 28 03:36:10.266483 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 148/279] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:09 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1278 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:11.292872 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b42b4c71-5167-46e2-9fbe-0c40a79b8b7a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:11.294244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b42b4c71-5167-46e2-9fbe-0c40a79b8b7a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:11.301860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b42b4c71-5167-46e2-9fbe-0c40a79b8b7a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:11.302446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b42b4c71-5167-46e2-9fbe-0c40a79b8b7a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:11.303335 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b42b4c71-5167-46e2-9fbe-0c40a79b8b7a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:11.303826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b42b4c71-5167-46e2-9fbe-0c40a79b8b7a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:12.139115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b42b4c71-5167-46e2-9fbe-0c40a79b8b7a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:12.176385 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b42b4c71-5167-46e2-9fbe-0c40a79b8b7a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1320 microversion: 2.1 time: 0.881418 Jul 28 03:36:12.185147 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 132/280] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:11 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1320 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:13.211174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74c5857e-5130-41fc-8def-6f5545211e25 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:13.211782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74c5857e-5130-41fc-8def-6f5545211e25 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:13.227181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74c5857e-5130-41fc-8def-6f5545211e25 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:13.227627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74c5857e-5130-41fc-8def-6f5545211e25 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:13.228441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74c5857e-5130-41fc-8def-6f5545211e25 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:13.228875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74c5857e-5130-41fc-8def-6f5545211e25 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:13.286006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:14.201463 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-04929035-06b5-40b7-bc76-d9c305613ba7 req-3c81bdf2-b433-442c-a9ef-c969a91a97d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b20cc49-3727-41d6-9379-45a8738ae7b1", "tag": "ea813944-1334-4265-bd42-a6746a168e8f"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:14.232519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:14.235930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-04929035-06b5-40b7-bc76-d9c305613ba7 req-3c81bdf2-b433-442c-a9ef-c969a91a97d5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:14.236837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-04929035-06b5-40b7-bc76-d9c305613ba7 req-3c81bdf2-b433-442c-a9ef-c969a91a97d5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:14.273476 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-04929035-06b5-40b7-bc76-d9c305613ba7 req-3c81bdf2-b433-442c-a9ef-c969a91a97d5 service nova] Creating event network-changed:ea813944-1334-4265-bd42-a6746a168e8f for instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 on n-h2-826756-3 Jul 28 03:36:14.279525 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-04929035-06b5-40b7-bc76-d9c305613ba7 req-3c81bdf2-b433-442c-a9ef-c969a91a97d5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082045 Jul 28 03:36:14.280746 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 133/281] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:36:14.367314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-74c5857e-5130-41fc-8def-6f5545211e25 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:14.379854 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74c5857e-5130-41fc-8def-6f5545211e25 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1320 microversion: 2.1 time: 1.170298 Jul 28 03:36:14.379854 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 149/282] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:13 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1320 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:15.403344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9fdd9559-cef6-4d2b-bdbf-ac67ca11c7a0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:15.404126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9fdd9559-cef6-4d2b-bdbf-ac67ca11c7a0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:15.417224 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9fdd9559-cef6-4d2b-bdbf-ac67ca11c7a0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:15.417755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9fdd9559-cef6-4d2b-bdbf-ac67ca11c7a0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:15.418608 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9fdd9559-cef6-4d2b-bdbf-ac67ca11c7a0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:15.425265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9fdd9559-cef6-4d2b-bdbf-ac67ca11c7a0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:15.639659 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9fdd9559-cef6-4d2b-bdbf-ac67ca11c7a0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:15.651922 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9fdd9559-cef6-4d2b-bdbf-ac67ca11c7a0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1320 microversion: 2.1 time: 0.253097 Jul 28 03:36:15.654249 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 134/283] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:15 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1320 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:36:16.674916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40f2eed8-dc71-4546-88f7-1e65d504888b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:16.676257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40f2eed8-dc71-4546-88f7-1e65d504888b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:16.691618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40f2eed8-dc71-4546-88f7-1e65d504888b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:16.693644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40f2eed8-dc71-4546-88f7-1e65d504888b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:16.695062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40f2eed8-dc71-4546-88f7-1e65d504888b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:16.697067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40f2eed8-dc71-4546-88f7-1e65d504888b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:17.112153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40f2eed8-dc71-4546-88f7-1e65d504888b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:17.129596 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40f2eed8-dc71-4546-88f7-1e65d504888b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1320 microversion: 2.1 time: 0.459748 Jul 28 03:36:17.148571 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 150/284] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:16 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1320 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:18.159419 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ab79cc04-7122-43c8-a131-d59045c1e6ae tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:18.160789 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ab79cc04-7122-43c8-a131-d59045c1e6ae tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:18.169650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=16,nova_cell0:UPDATE=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:18.175500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ab79cc04-7122-43c8-a131-d59045c1e6ae tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:18.179142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ab79cc04-7122-43c8-a131-d59045c1e6ae tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:18.183650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ab79cc04-7122-43c8-a131-d59045c1e6ae tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:18.184197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ab79cc04-7122-43c8-a131-d59045c1e6ae tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:18.623075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ab79cc04-7122-43c8-a131-d59045c1e6ae tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:18.626227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:18.646965 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ab79cc04-7122-43c8-a131-d59045c1e6ae tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1320 microversion: 2.1 time: 0.489005 Jul 28 03:36:18.650904 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 135/285] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:18 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1320 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:19.150068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:19.669576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7950d29c-b923-4f04-b938-cbb2a419fbc1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:19.670157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7950d29c-b923-4f04-b938-cbb2a419fbc1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:19.679809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7950d29c-b923-4f04-b938-cbb2a419fbc1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:19.680253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7950d29c-b923-4f04-b938-cbb2a419fbc1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:19.681050 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7950d29c-b923-4f04-b938-cbb2a419fbc1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:19.681466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7950d29c-b923-4f04-b938-cbb2a419fbc1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:19.992862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7950d29c-b923-4f04-b938-cbb2a419fbc1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:20.007361 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7950d29c-b923-4f04-b938-cbb2a419fbc1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1320 microversion: 2.1 time: 0.341432 Jul 28 03:36:20.008829 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 136/286] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:19 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1320 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:36:20.191324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86e64e7b-a88c-4fb8-bd18-2cda8df5c06b tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Calling method '.version_select at 0x7ffa74facb80>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:20.192208 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:20.192208 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:20.194739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86e64e7b-a88c-4fb8-bd18-2cda8df5c06b tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.195549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86e64e7b-a88c-4fb8-bd18-2cda8df5c06b tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.238939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86e64e7b-a88c-4fb8-bd18-2cda8df5c06b tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.240621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86e64e7b-a88c-4fb8-bd18-2cda8df5c06b tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.255365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86e64e7b-a88c-4fb8-bd18-2cda8df5c06b tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.259254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86e64e7b-a88c-4fb8-bd18-2cda8df5c06b tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.269488 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-86e64e7b-a88c-4fb8-bd18-2cda8df5c06b tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.124751 Jul 28 03:36:20.271174 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 151/287] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:36:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:20.292705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3a7c874-f905-4605-9134-8fabf0f731b7 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Calling method '.version_select at 0x7ffa74d884c0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:20.296146 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:20.296146 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:20.298789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a7c874-f905-4605-9134-8fabf0f731b7 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.300467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a7c874-f905-4605-9134-8fabf0f731b7 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.329643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a7c874-f905-4605-9134-8fabf0f731b7 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.331260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a7c874-f905-4605-9134-8fabf0f731b7 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.354649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a7c874-f905-4605-9134-8fabf0f731b7 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.355703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a7c874-f905-4605-9134-8fabf0f731b7 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.364947 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3a7c874-f905-4605-9134-8fabf0f731b7 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.080714 Jul 28 03:36:20.366898 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 152/288] 10.222.0.48 () {58 vars in 1167 bytes} [Thu Jul 28 03:36:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:20.409581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e785a7c6-d74b-4c89-b4ce-3947045ebd80 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Calling method '.version_select at 0x7ffa74e4fe50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:20.415145 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:20.415145 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:20.421217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e785a7c6-d74b-4c89-b4ce-3947045ebd80 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.423348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e785a7c6-d74b-4c89-b4ce-3947045ebd80 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.481515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e785a7c6-d74b-4c89-b4ce-3947045ebd80 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.482215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e785a7c6-d74b-4c89-b4ce-3947045ebd80 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.522990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e785a7c6-d74b-4c89-b4ce-3947045ebd80 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.525354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e785a7c6-d74b-4c89-b4ce-3947045ebd80 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.540498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:20.547404 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e785a7c6-d74b-4c89-b4ce-3947045ebd80 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.157256 Jul 28 03:36:20.550489 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 153/289] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:36:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:20.561066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7728fd32-03de-4548-8489-c2ba0cec4505 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Calling method '.version_select at 0x7ffa74facf70>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:20.562173 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:20.562173 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:20.566553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7728fd32-03de-4548-8489-c2ba0cec4505 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.567451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7728fd32-03de-4548-8489-c2ba0cec4505 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.594546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7728fd32-03de-4548-8489-c2ba0cec4505 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.597258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7728fd32-03de-4548-8489-c2ba0cec4505 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.609699 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7728fd32-03de-4548-8489-c2ba0cec4505 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.051382 Jul 28 03:36:20.611412 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 154/290] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:36:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:20.634493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d66d9ad-c09e-41f1-b9ef-fda5b3470ed2 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Calling method '.version_select at 0x7ffa74e4f670>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:20.638746 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:20.638746 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:20.642215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d66d9ad-c09e-41f1-b9ef-fda5b3470ed2 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.643613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d66d9ad-c09e-41f1-b9ef-fda5b3470ed2 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.703733 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5d66d9ad-c09e-41f1-b9ef-fda5b3470ed2 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.078446 Jul 28 03:36:20.705185 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 155/291] 10.222.0.48 () {58 vars in 1179 bytes} [Thu Jul 28 03:36:20 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:20.720592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-42d0a62c-528b-4d68-9f33-60208327a2c3 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Calling method '.version_select at 0x7ffa76d36e50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:20.723921 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:20.723921 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:20.728949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42d0a62c-528b-4d68-9f33-60208327a2c3 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.729575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42d0a62c-528b-4d68-9f33-60208327a2c3 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.774859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42d0a62c-528b-4d68-9f33-60208327a2c3 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.775537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42d0a62c-528b-4d68-9f33-60208327a2c3 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.803692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42d0a62c-528b-4d68-9f33-60208327a2c3 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.804443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42d0a62c-528b-4d68-9f33-60208327a2c3 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.835288 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-42d0a62c-528b-4d68-9f33-60208327a2c3 tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.119342 Jul 28 03:36:20.836589 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 156/292] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:36:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:36:20.850946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83a4095b-fff4-427c-861d-603e28ddb83d tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Calling method '.version_select at 0x7ffa74fac0d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:20.858268 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:20.858268 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:20.862739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83a4095b-fff4-427c-861d-603e28ddb83d tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.865246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83a4095b-fff4-427c-861d-603e28ddb83d tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.914292 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b0e0198d-4f86-4282-8c68-b63623a75acd tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Action: 'create', calling method: .version_select at 0x7ffa74f39820>, body: {"keypair": {"name": "tempest-keypair-1358260524", "type": "ssh", "user_id": "c0d1ac0a686646bc8834a66c9384580a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQhXKErBMNF4gWHoftTN+EPXQqdbGFmIvEJKKYVjbmuqcZSemJ3+vHR4EAKHh+YAxWmtOvjQgFaCxBj73zXvoDyRebXGfbiCDiUv6vobhuSY8Elb/MTjJtzsCOxegC9hA=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:20.917971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83a4095b-fff4-427c-861d-603e28ddb83d tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.919891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83a4095b-fff4-427c-861d-603e28ddb83d tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.951716 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-83a4095b-fff4-427c-861d-603e28ddb83d tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.106389 Jul 28 03:36:20.954602 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 157/293] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:36:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:20.977989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-10cc3076-1c93-4c11-8cee-a271629fc43c tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Calling method '.version_select at 0x7ffa76b5f310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:20.978814 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:20.978814 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:20.988716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10cc3076-1c93-4c11-8cee-a271629fc43c tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:20.989198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10cc3076-1c93-4c11-8cee-a271629fc43c tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:20.998612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-b0e0198d-4f86-4282-8c68-b63623a75acd tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Getting quotas for project 44125310d0e141b2a7f22d3f93e8df02. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:36:21.011786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-b0e0198d-4f86-4282-8c68-b63623a75acd tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Getting quotas for user d76d7b3ea0d24f758abe43d2f0c465fa and project 44125310d0e141b2a7f22d3f93e8df02. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:36:21.036435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10cc3076-1c93-4c11-8cee-a271629fc43c tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:21.036435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10cc3076-1c93-4c11-8cee-a271629fc43c tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:21.056710 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-10cc3076-1c93-4c11-8cee-a271629fc43c tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.087896 Jul 28 03:36:21.059388 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 158/294] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:36:20 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:21.074128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d06a5d8d-b64a-484f-94d7-0793c99189c0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:21.075587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d06a5d8d-b64a-484f-94d7-0793c99189c0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:21.100459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d06a5d8d-b64a-484f-94d7-0793c99189c0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:21.100459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d06a5d8d-b64a-484f-94d7-0793c99189c0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:21.106171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d06a5d8d-b64a-484f-94d7-0793c99189c0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:21.106171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d06a5d8d-b64a-484f-94d7-0793c99189c0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:21.110994 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b0e0198d-4f86-4282-8c68-b63623a75acd tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 1.099523 Jul 28 03:36:21.112388 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 137/295] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Jul 28 03:36:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1102 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 03:36:21.119121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0bf6c77e-a880-47d6-824a-c50e8e5749ab tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Calling method '.version_select at 0x7ffa74fabee0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:21.120497 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:21.120497 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:36:21.124722 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0bf6c77e-a880-47d6-824a-c50e8e5749ab tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:21.126297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0bf6c77e-a880-47d6-824a-c50e8e5749ab tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:21.172817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0bf6c77e-a880-47d6-824a-c50e8e5749ab tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:21.178746 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0bf6c77e-a880-47d6-824a-c50e8e5749ab tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:21.209660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0bf6c77e-a880-47d6-824a-c50e8e5749ab tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:21.212812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0bf6c77e-a880-47d6-824a-c50e8e5749ab tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:21.255500 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0bf6c77e-a880-47d6-824a-c50e8e5749ab tempest-HypervisorAdminTestJSON-866514527 tempest-HypervisorAdminTestJSON-866514527-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.141581 Jul 28 03:36:21.260115 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 138/296] 10.222.0.48 () {58 vars in 1173 bytes} [Thu Jul 28 03:36:21 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:21.265849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d8a1c06f-a13e-44c6-a7ac-d21d4d8fb3e0 tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Action: 'create', calling method: .version_select at 0x7ffa74f7a550>, body: {"keypair": {"name": "tempest-keypair-176691663", "type": "ssh", "user_id": "c0d1ac0a686646bc8834a66c9384580a", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvWTgCWRsfXjYsTjVedHYRD7LpiDeQhJJUgLMulc8ha1aTaKhMF7+f1M8IORbxHx+Nadmo+2fDy9qIBDYHZ1z/OZ/byga6VQmb6mf7YkNSpSPEwBdA7GzUq+DP8/JR2SA=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:21.315741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-d8a1c06f-a13e-44c6-a7ac-d21d4d8fb3e0 tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Getting quotas for project 44125310d0e141b2a7f22d3f93e8df02. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:36:21.330051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-d8a1c06f-a13e-44c6-a7ac-d21d4d8fb3e0 tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Getting quotas for user d76d7b3ea0d24f758abe43d2f0c465fa and project 44125310d0e141b2a7f22d3f93e8df02. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:36:21.391420 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d8a1c06f-a13e-44c6-a7ac-d21d4d8fb3e0 tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.129633 Jul 28 03:36:21.392394 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 139/297] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Jul 28 03:36:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 03:36:21.414803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c457001a-048c-4679-8c7c-9b6d40edd153 tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Calling method '.version_select at 0x7ffa74f55af0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:21.453235 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c457001a-048c-4679-8c7c-9b6d40edd153 tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1358260524?user_id=c0d1ac0a686646bc8834a66c9384580a" status: 200 len: 512 microversion: 2.10 time: 0.047705 Jul 28 03:36:21.454326 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 140/298] 10.222.0.48 () {60 vars in 1340 bytes} [Thu Jul 28 03:36:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1358260524?user_id=c0d1ac0a686646bc8834a66c9384580a => generated 512 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:21.472806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c69ed83c-209e-4733-9ea2-8df17e215a05 tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Action: 'create', calling method: .version_select at 0x7ffa7504bee0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-783481938", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhWjeep1+ux7XAgdg9xf1f4WahhmURsju/IsjELKL7G0Xo8XRFtWr3rhYj/0XdAU3qtCLSSCE87QCkh7Ku3ELt1f41tk9eUeusZTP23bemZMcqpjSpBmfIdOQHXH7UxwQ=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:21.535523 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-c69ed83c-209e-4733-9ea2-8df17e215a05 tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Getting quotas for project 44125310d0e141b2a7f22d3f93e8df02. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:36:21.561730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-c69ed83c-209e-4733-9ea2-8df17e215a05 tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Getting quotas for user d76d7b3ea0d24f758abe43d2f0c465fa and project 44125310d0e141b2a7f22d3f93e8df02. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:36:21.565793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d06a5d8d-b64a-484f-94d7-0793c99189c0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:21.591231 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d06a5d8d-b64a-484f-94d7-0793c99189c0 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1320 microversion: 2.1 time: 0.526680 Jul 28 03:36:21.607342 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 159/299] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:21 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1320 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:21.645610 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c69ed83c-209e-4733-9ea2-8df17e215a05 tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.178901 Jul 28 03:36:21.648472 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 141/300] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Jul 28 03:36:21 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 182 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 03:36:21.660600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ab7c5bd-5d9e-4823-bb65-5e99d06bf83e tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Calling method '.version_select at 0x7ffa74fac1f0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:21.665209 n-d-826756-3 devstack@n-api.service[126071]: WARNING oslo_db.sqlalchemy.utils [None req-2ab7c5bd-5d9e-4823-bb65-5e99d06bf83e tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 03:36:21.688443 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ab7c5bd-5d9e-4823-bb65-5e99d06bf83e tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] 10.222.0.48 "GET /compute/v2.1/os-keypairs?user_id=c0d1ac0a686646bc8834a66c9384580a" status: 200 len: 725 microversion: 2.10 time: 0.030982 Jul 28 03:36:21.697892 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 160/301] 10.222.0.48 () {60 vars in 1259 bytes} [Thu Jul 28 03:36:21 2022] GET /compute/v2.1/os-keypairs?user_id=c0d1ac0a686646bc8834a66c9384580a => generated 725 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:21.703171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-faa17a89-d5c5-4335-b73d-035d0e40bca3 tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Calling method '.version_select at 0x7ffa74f6bc10>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:21.760143 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-faa17a89-d5c5-4335-b73d-035d0e40bca3 tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-783481938" status: 204 len: 0 microversion: 2.10 time: 0.062314 Jul 28 03:36:21.766117 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 142/302] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jul 28 03:36:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-783481938 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:36:21.772140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9dc68aa-5903-4a8e-a03a-bd6d1dfeb66f tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Calling method '.version_select at 0x7ffa74d88a60>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:21.828432 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9dc68aa-5903-4a8e-a03a-bd6d1dfeb66f tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-176691663?user_id=c0d1ac0a686646bc8834a66c9384580a" status: 204 len: 0 microversion: 2.10 time: 0.060622 Jul 28 03:36:21.832428 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 161/303] 10.222.0.48 () {60 vars in 1340 bytes} [Thu Jul 28 03:36:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-176691663?user_id=c0d1ac0a686646bc8834a66c9384580a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:36:21.837666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bde8aed7-4fd7-45e2-a470-67b2455543ed tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] Calling method '.version_select at 0x7ffa74ef0430>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:21.883855 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bde8aed7-4fd7-45e2-a470-67b2455543ed tempest-KeyPairsV210TestJSON-1944696105 tempest-KeyPairsV210TestJSON-1944696105-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358260524?user_id=c0d1ac0a686646bc8834a66c9384580a" status: 204 len: 0 microversion: 2.10 time: 0.047906 Jul 28 03:36:21.884781 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 143/304] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:36:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358260524?user_id=c0d1ac0a686646bc8834a66c9384580a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:36:22.615095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a10d165b-c870-4af5-9380-71d74bb2cca1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:22.616498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a10d165b-c870-4af5-9380-71d74bb2cca1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:22.623700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a10d165b-c870-4af5-9380-71d74bb2cca1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:22.624514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a10d165b-c870-4af5-9380-71d74bb2cca1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:22.625603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a10d165b-c870-4af5-9380-71d74bb2cca1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:22.626270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a10d165b-c870-4af5-9380-71d74bb2cca1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:22.989855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a10d165b-c870-4af5-9380-71d74bb2cca1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:23.001103 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a10d165b-c870-4af5-9380-71d74bb2cca1 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1320 microversion: 2.1 time: 0.388969 Jul 28 03:36:23.012552 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 162/305] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:22 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1320 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:36:23.558689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1475e1bf-0f71-45c4-9792-4d872a867594 tempest-FlavorsV261TestJSON-1307670487 tempest-FlavorsV261TestJSON-1307670487-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1093055458", "id": 944954635, "os-flavor-access:is_public": "True"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:23.561692 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:23.561692 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:36:23.623955 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1475e1bf-0f71-45c4-9792-4d872a867594 tempest-FlavorsV261TestJSON-1307670487 tempest-FlavorsV261TestJSON-1307670487-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.505962 Jul 28 03:36:23.626859 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 144/306] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:36:23 2022] POST /compute/v2.1/flavors => generated 465 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:23.985935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e2df818e-1360-4d3c-bcfe-7c40b9cdff54 tempest-FlavorsV261TestJSON-57768331 tempest-FlavorsV261TestJSON-57768331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:24.023453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e817fd2f-e0f3-47b6-8980-e3b22b2582b4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:24.024413 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e817fd2f-e0f3-47b6-8980-e3b22b2582b4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:24.032648 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e2df818e-1360-4d3c-bcfe-7c40b9cdff54 tempest-FlavorsV261TestJSON-57768331 tempest-FlavorsV261TestJSON-57768331-project] 10.222.0.48 "GET /compute/v2.1/flavors/944954635" status: 200 len: 465 microversion: 2.61 time: 0.397116 Jul 28 03:36:24.046031 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 163/307] 10.222.0.48 () {60 vars in 1196 bytes} [Thu Jul 28 03:36:23 2022] GET /compute/v2.1/flavors/944954635 => generated 465 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:24.057367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e817fd2f-e0f3-47b6-8980-e3b22b2582b4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:24.062450 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e817fd2f-e0f3-47b6-8980-e3b22b2582b4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:24.063450 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e817fd2f-e0f3-47b6-8980-e3b22b2582b4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:24.068569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e817fd2f-e0f3-47b6-8980-e3b22b2582b4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:24.070688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0afab9d2-953f-4e3d-b037-3614943f15e3 tempest-FlavorsV261TestJSON-1307670487 tempest-FlavorsV261TestJSON-1307670487-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:24.091465 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:24.091465 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:24.184639 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0afab9d2-953f-4e3d-b037-3614943f15e3 tempest-FlavorsV261TestJSON-1307670487 tempest-FlavorsV261TestJSON-1307670487-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/944954635" status: 200 len: 466 microversion: 2.61 time: 0.124738 Jul 28 03:36:24.185242 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 164/308] 10.222.0.48 () {62 vars in 1216 bytes} [Thu Jul 28 03:36:24 2022] PUT /compute/v2.1/flavors/944954635 => generated 466 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:24.203038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bc7a0a68-04cb-4b96-8fad-f0c072d6f16b tempest-FlavorsV261TestJSON-57768331 tempest-FlavorsV261TestJSON-57768331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:24.263160 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bc7a0a68-04cb-4b96-8fad-f0c072d6f16b tempest-FlavorsV261TestJSON-57768331 tempest-FlavorsV261TestJSON-57768331-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.067023 Jul 28 03:36:24.264008 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 165/309] 10.222.0.48 () {60 vars in 1187 bytes} [Thu Jul 28 03:36:24 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:36:24.287418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3dd7252a-ba3d-4d2b-a951-8172d6369719 tempest-FlavorsV261TestJSON-57768331 tempest-FlavorsV261TestJSON-57768331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:24.326152 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3dd7252a-ba3d-4d2b-a951-8172d6369719 tempest-FlavorsV261TestJSON-57768331 tempest-FlavorsV261TestJSON-57768331-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.043141 Jul 28 03:36:24.332194 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 166/310] 10.222.0.48 () {60 vars in 1166 bytes} [Thu Jul 28 03:36:24 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:36:24.351907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f926fdf5-5d9a-4461-909a-e9f6cff94537 tempest-FlavorsV261TestJSON-1307670487 tempest-FlavorsV261TestJSON-1307670487-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:24.353083 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:24.353083 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:24.382944 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f926fdf5-5d9a-4461-909a-e9f6cff94537 tempest-FlavorsV261TestJSON-1307670487 tempest-FlavorsV261TestJSON-1307670487-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/944954635" status: 202 len: 0 microversion: 2.61 time: 0.037166 Jul 28 03:36:24.384031 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 167/311] 10.222.0.48 () {60 vars in 1199 bytes} [Thu Jul 28 03:36:24 2022] DELETE /compute/v2.1/flavors/944954635 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:36:24.395728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7bdfa861-1fe8-4698-b617-2b0b2e303652 tempest-FlavorsV261TestJSON-1307670487 tempest-FlavorsV261TestJSON-1307670487-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:24.457094 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7bdfa861-1fe8-4698-b617-2b0b2e303652 tempest-FlavorsV261TestJSON-1307670487 tempest-FlavorsV261TestJSON-1307670487-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.060405 Jul 28 03:36:24.461574 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 168/312] 10.222.0.48 () {60 vars in 1187 bytes} [Thu Jul 28 03:36:24 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:36:25.045249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e817fd2f-e0f3-47b6-8980-e3b22b2582b4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:25.055854 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e817fd2f-e0f3-47b6-8980-e3b22b2582b4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1320 microversion: 2.1 time: 1.036458 Jul 28 03:36:25.059442 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 145/313] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:24 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1320 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:25.279374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d5fb6ca1-9751-48ad-ae0e-28756d42145a tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74e5ef70>, body: {"quota_set": {"ram": "5120"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:25.393234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-e16f3a1b-1e26-4ce1-9ca7-686cbfafe94a req-eda21bbe-2c36-44ce-bcf3-5771c3f98257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b20cc49-3727-41d6-9379-45a8738ae7b1", "name": "network-vif-plugged", "status": "completed", "tag": "ea813944-1334-4265-bd42-a6746a168e8f"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:25.415515 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e16f3a1b-1e26-4ce1-9ca7-686cbfafe94a req-eda21bbe-2c36-44ce-bcf3-5771c3f98257 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:25.421427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e16f3a1b-1e26-4ce1-9ca7-686cbfafe94a req-eda21bbe-2c36-44ce-bcf3-5771c3f98257 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:25.440835 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-e16f3a1b-1e26-4ce1-9ca7-686cbfafe94a req-eda21bbe-2c36-44ce-bcf3-5771c3f98257 service nova] Creating event network-vif-plugged:ea813944-1334-4265-bd42-a6746a168e8f for instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 on n-h2-826756-3 Jul 28 03:36:25.463104 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-e16f3a1b-1e26-4ce1-9ca7-686cbfafe94a req-eda21bbe-2c36-44ce-bcf3-5771c3f98257 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072314 Jul 28 03:36:25.464626 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 146/314] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:36:26.080974 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b9b9d529-5ec9-46fc-8d31-fb84d15e9145 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:26.081874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b9b9d529-5ec9-46fc-8d31-fb84d15e9145 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:26.095948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9b9d529-5ec9-46fc-8d31-fb84d15e9145 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:26.103170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9b9d529-5ec9-46fc-8d31-fb84d15e9145 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:26.106835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9b9d529-5ec9-46fc-8d31-fb84d15e9145 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:26.109056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9b9d529-5ec9-46fc-8d31-fb84d15e9145 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:26.582907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5fb6ca1-9751-48ad-ae0e-28756d42145a tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:26.584757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5fb6ca1-9751-48ad-ae0e-28756d42145a tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:26.599255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5fb6ca1-9751-48ad-ae0e-28756d42145a tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:26.601435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5fb6ca1-9751-48ad-ae0e-28756d42145a tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:26.962624 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d5fb6ca1-9751-48ad-ae0e-28756d42145a tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/90cd82e25bca45b48f5f210fc3499987" status: 200 len: 240 microversion: 2.36 time: 2.499188 Jul 28 03:36:26.984110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b9b9d529-5ec9-46fc-8d31-fb84d15e9145 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:26.990308 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 169/315] 10.222.0.48 () {62 vars in 1303 bytes} [Thu Jul 28 03:36:24 2022] PUT /compute/v2.1/os-quota-sets/90cd82e25bca45b48f5f210fc3499987 => generated 240 bytes in 2504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:27.027422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-379808f7-ee96-4eab-9f14-9bb9d86cbf10 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Calling method '.version_select at 0x7ffa74e4fe50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:27.031127 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b9b9d529-5ec9-46fc-8d31-fb84d15e9145 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1320 microversion: 2.1 time: 0.946529 Jul 28 03:36:27.031832 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 147/316] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:26 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1320 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:36:27.462400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-379808f7-ee96-4eab-9f14-9bb9d86cbf10 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:27.462891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-379808f7-ee96-4eab-9f14-9bb9d86cbf10 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:27.469626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-379808f7-ee96-4eab-9f14-9bb9d86cbf10 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:27.470080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-379808f7-ee96-4eab-9f14-9bb9d86cbf10 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:27.558060 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-379808f7-ee96-4eab-9f14-9bb9d86cbf10 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/90cd82e25bca45b48f5f210fc3499987/detail" status: 200 len: 672 microversion: 2.36 time: 0.559828 Jul 28 03:36:27.568233 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 170/317] 10.222.0.48 () {60 vars in 1304 bytes} [Thu Jul 28 03:36:26 2022] GET /compute/v2.1/os-quota-sets/90cd82e25bca45b48f5f210fc3499987/detail => generated 672 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:28.055683 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3dd1110c-3827-468b-88f7-4980862228d8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:28.057278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3dd1110c-3827-468b-88f7-4980862228d8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:28.069264 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3dd1110c-3827-468b-88f7-4980862228d8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:28.069630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3dd1110c-3827-468b-88f7-4980862228d8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:28.070442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3dd1110c-3827-468b-88f7-4980862228d8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:28.070941 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3dd1110c-3827-468b-88f7-4980862228d8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:28.450048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-25799ce0-6ad1-436b-8388-0a37634d71a4 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74d88a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:29.024440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3dd1110c-3827-468b-88f7-4980862228d8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:29.036756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25799ce0-6ad1-436b-8388-0a37634d71a4 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:29.043105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25799ce0-6ad1-436b-8388-0a37634d71a4 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:29.046390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25799ce0-6ad1-436b-8388-0a37634d71a4 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:29.047087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25799ce0-6ad1-436b-8388-0a37634d71a4 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:29.062350 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3dd1110c-3827-468b-88f7-4980862228d8 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1469 microversion: 2.1 time: 1.007970 Jul 28 03:36:29.066286 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 148/318] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:28 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1469 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:29.091337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-17e2b42f-3228-470b-89b4-5bfcba2ac679 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:29.101651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-17e2b42f-3228-470b-89b4-5bfcba2ac679 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:29.125210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-17e2b42f-3228-470b-89b4-5bfcba2ac679 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:29.127952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-17e2b42f-3228-470b-89b4-5bfcba2ac679 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:29.132484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-17e2b42f-3228-470b-89b4-5bfcba2ac679 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:29.133942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-17e2b42f-3228-470b-89b4-5bfcba2ac679 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:29.173742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=7,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:29.191387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25799ce0-6ad1-436b-8388-0a37634d71a4 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:29.195105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25799ce0-6ad1-436b-8388-0a37634d71a4 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:29.197686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25799ce0-6ad1-436b-8388-0a37634d71a4 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:29.203114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25799ce0-6ad1-436b-8388-0a37634d71a4 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:29.469860 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-25799ce0-6ad1-436b-8388-0a37634d71a4 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/90cd82e25bca45b48f5f210fc3499987?user_id=e8658edf32ce4912b2a758ec542cdd39" status: 200 len: 240 microversion: 2.36 time: 1.026084 Jul 28 03:36:29.478330 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 171/319] 10.222.0.48 () {62 vars in 1384 bytes} [Thu Jul 28 03:36:28 2022] PUT /compute/v2.1/os-quota-sets/90cd82e25bca45b48f5f210fc3499987?user_id=e8658edf32ce4912b2a758ec542cdd39 => generated 240 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:29.499619 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-17e2b42f-3228-470b-89b4-5bfcba2ac679 tempest-DeleteServersAdminTestJSON-959499756 tempest-DeleteServersAdminTestJSON-959499756-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1/action" status: 202 len: 0 microversion: 2.1 time: 0.417656 Jul 28 03:36:29.500935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-89095119-92ed-4cb4-93a9-72fe6a0a6961 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] Calling method '.version_select at 0x7ffa74cb2ee0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:29.503751 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 149/320] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:36:29 2022] POST /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:36:29.537386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-df468528-31c6-462e-9101-9068e52932d6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:29.542177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-df468528-31c6-462e-9101-9068e52932d6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:29.573305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df468528-31c6-462e-9101-9068e52932d6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:29.573827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df468528-31c6-462e-9101-9068e52932d6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:29.580171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df468528-31c6-462e-9101-9068e52932d6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:29.583811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df468528-31c6-462e-9101-9068e52932d6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:29.737141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df468528-31c6-462e-9101-9068e52932d6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:29.743890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df468528-31c6-462e-9101-9068e52932d6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:29.745877 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-df468528-31c6-462e-9101-9068e52932d6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lazy-loading 'fault' on Instance uuid 7b20cc49-3727-41d6-9379-45a8738ae7b1 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:36:30.386555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-df468528-31c6-462e-9101-9068e52932d6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:30.404486 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-df468528-31c6-462e-9101-9068e52932d6 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1452 microversion: 2.1 time: 0.890982 Jul 28 03:36:30.418354 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 150/321] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:29 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1452 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:30.440214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-742f7bdf-230e-4e58-830f-d50d8de8eb47 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:30.441247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-742f7bdf-230e-4e58-830f-d50d8de8eb47 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:30.456665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-742f7bdf-230e-4e58-830f-d50d8de8eb47 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:30.457948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-742f7bdf-230e-4e58-830f-d50d8de8eb47 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:30.463881 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-742f7bdf-230e-4e58-830f-d50d8de8eb47 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:30.464766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-742f7bdf-230e-4e58-830f-d50d8de8eb47 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:30.567849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-742f7bdf-230e-4e58-830f-d50d8de8eb47 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:36:30.612206 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-89095119-92ed-4cb4-93a9-72fe6a0a6961 tempest-QuotasAdminTestV236-1480466278 tempest-QuotasAdminTestV236-1480466278-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/90cd82e25bca45b48f5f210fc3499987?user_id=e8658edf32ce4912b2a758ec542cdd39" status: 200 len: 282 microversion: 2.36 time: 1.125213 Jul 28 03:36:30.614695 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 172/322] 10.222.0.48 () {60 vars in 1364 bytes} [Thu Jul 28 03:36:29 2022] GET /compute/v2.1/os-quota-sets/90cd82e25bca45b48f5f210fc3499987?user_id=e8658edf32ce4912b2a758ec542cdd39 => generated 282 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:36:30.975415 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-742f7bdf-230e-4e58-830f-d50d8de8eb47 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 204 len: 0 microversion: 2.1 time: 0.549769 Jul 28 03:36:30.975934 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 151/323] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:36:30 2022] DELETE /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:36:30.986091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2d4cbf76-863a-457d-958a-1bbc61e17621 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:30.986987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2d4cbf76-863a-457d-958a-1bbc61e17621 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:31.001287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d4cbf76-863a-457d-958a-1bbc61e17621 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:31.003573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d4cbf76-863a-457d-958a-1bbc61e17621 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:31.006201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d4cbf76-863a-457d-958a-1bbc61e17621 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:31.006860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d4cbf76-863a-457d-958a-1bbc61e17621 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:31.097320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d4cbf76-863a-457d-958a-1bbc61e17621 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:31.098052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d4cbf76-863a-457d-958a-1bbc61e17621 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:31.098748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-2d4cbf76-863a-457d-958a-1bbc61e17621 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lazy-loading 'fault' on Instance uuid 7b20cc49-3727-41d6-9379-45a8738ae7b1 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:36:31.789640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2d4cbf76-863a-457d-958a-1bbc61e17621 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:31.816284 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2d4cbf76-863a-457d-958a-1bbc61e17621 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1458 microversion: 2.1 time: 0.832386 Jul 28 03:36:31.820631 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 173/324] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:30 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1458 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:32.847302 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a7e60de2-72ce-465f-b466-91aecaa3fa81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:32.848908 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a7e60de2-72ce-465f-b466-91aecaa3fa81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:32.860186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=12 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:32.871944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7e60de2-72ce-465f-b466-91aecaa3fa81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:32.872750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7e60de2-72ce-465f-b466-91aecaa3fa81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:32.882200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7e60de2-72ce-465f-b466-91aecaa3fa81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:32.883775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7e60de2-72ce-465f-b466-91aecaa3fa81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:33.029864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7e60de2-72ce-465f-b466-91aecaa3fa81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:33.031447 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7e60de2-72ce-465f-b466-91aecaa3fa81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:33.031768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-a7e60de2-72ce-465f-b466-91aecaa3fa81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lazy-loading 'fault' on Instance uuid 7b20cc49-3727-41d6-9379-45a8738ae7b1 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:36:33.971425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a7e60de2-72ce-465f-b466-91aecaa3fa81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:33.981447 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a7e60de2-72ce-465f-b466-91aecaa3fa81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1458 microversion: 2.1 time: 1.143139 Jul 28 03:36:34.003755 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 152/325] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:32 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1458 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:34.869780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1617420677", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:34.999910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:36:35.010940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-254a1ba0-e81c-4979-a9a3-cb6d06fbaf1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:35.011563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-254a1ba0-e81c-4979-a9a3-cb6d06fbaf1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:35.029003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-254a1ba0-e81c-4979-a9a3-cb6d06fbaf1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:35.029714 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-254a1ba0-e81c-4979-a9a3-cb6d06fbaf1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:35.030602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-254a1ba0-e81c-4979-a9a3-cb6d06fbaf1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:35.031074 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-254a1ba0-e81c-4979-a9a3-cb6d06fbaf1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:35.155623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:35.178124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-254a1ba0-e81c-4979-a9a3-cb6d06fbaf1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:35.178624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-254a1ba0-e81c-4979-a9a3-cb6d06fbaf1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:35.179135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-254a1ba0-e81c-4979-a9a3-cb6d06fbaf1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lazy-loading 'fault' on Instance uuid 7b20cc49-3727-41d6-9379-45a8738ae7b1 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:36:35.649565 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-254a1ba0-e81c-4979-a9a3-cb6d06fbaf1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:35.662965 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-254a1ba0-e81c-4979-a9a3-cb6d06fbaf1b tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1458 microversion: 2.1 time: 0.656573 Jul 28 03:36:35.668682 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 153/326] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:35 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1458 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:35.985203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:36:35.986317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:36:35.987522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:36:35.988178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:36:35.988907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:36:36.031462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:36.044853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:36.057263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:36.057738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:36.129210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Getting quotas for project f789a557bafc402e9033f2b73493669f. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:36:36.152252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Getting quotas for user f4f10aaf7ad44ec696037ab9052bcbdd and project f789a557bafc402e9033f2b73493669f. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:36:36.226244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:36:36.246084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:36:36.346231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b1295eb3-4e7f-41ea-a40c-7179b9b2f59c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'create', calling method: .version_select at 0x7ffa74edc550>, body: {"keypair": {"name": "tempest-keypair-450577607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOQzLbRN6cDYB2dRTInpK63WI4qH5L9l62X4p2nza2R0uuGpiipjRXVoDlu4XOpuqC4wx0ysuLy0jI0k7TtteBUTcZosWKUTyy8TSk/irvr7S3hbk7IPViZv03qeJqwPg=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:36.366232 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d356059e-8059-4644-8d1b-a8858c3d9495 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.378549 Jul 28 03:36:36.373697 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 174/327] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:36:36.389505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4df1da1b-affa-4455-953e-7388ca2cbc03 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:36.390025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4df1da1b-affa-4455-953e-7388ca2cbc03 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:36.437783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-b1295eb3-4e7f-41ea-a40c-7179b9b2f59c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Getting quotas for project b7bee0b59b0b43ce80623b7aca24111a. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:36:36.494554 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-b1295eb3-4e7f-41ea-a40c-7179b9b2f59c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Getting quotas for user 26b9a63a13e1420aa3b7f299456c65e6 and project b7bee0b59b0b43ce80623b7aca24111a. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:36:36.650029 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b1295eb3-4e7f-41ea-a40c-7179b9b2f59c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.979886 Jul 28 03:36:36.653516 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 154/328] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:36:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:36.685571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-20c42dba-b39e-4722-9dde-08ac01a183d5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:36.686563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4df1da1b-affa-4455-953e-7388ca2cbc03 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:36.689099 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-20c42dba-b39e-4722-9dde-08ac01a183d5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:36.695871 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4df1da1b-affa-4455-953e-7388ca2cbc03 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1223 microversion: 2.1 time: 0.320745 Jul 28 03:36:36.714741 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 175/329] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:36 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1223 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:36.739967 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20c42dba-b39e-4722-9dde-08ac01a183d5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:36.746111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20c42dba-b39e-4722-9dde-08ac01a183d5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:36.752176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20c42dba-b39e-4722-9dde-08ac01a183d5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:36.756054 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20c42dba-b39e-4722-9dde-08ac01a183d5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:36.884726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20c42dba-b39e-4722-9dde-08ac01a183d5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:36.888324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20c42dba-b39e-4722-9dde-08ac01a183d5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:36.889037 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-20c42dba-b39e-4722-9dde-08ac01a183d5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lazy-loading 'fault' on Instance uuid 7b20cc49-3727-41d6-9379-45a8738ae7b1 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:36:36.998496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-20c42dba-b39e-4722-9dde-08ac01a183d5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:37.010864 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-20c42dba-b39e-4722-9dde-08ac01a183d5 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1416 microversion: 2.1 time: 0.329494 Jul 28 03:36:37.015222 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 155/330] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:36 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1416 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:37.719755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0219563f-745e-48f5-8cff-132c02d29e27 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:37.720465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0219563f-745e-48f5-8cff-132c02d29e27 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:37.733860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0219563f-745e-48f5-8cff-132c02d29e27 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:37.744873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0219563f-745e-48f5-8cff-132c02d29e27 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:37.745935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0219563f-745e-48f5-8cff-132c02d29e27 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:37.753312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0219563f-745e-48f5-8cff-132c02d29e27 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:37.870619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:38.090351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0219563f-745e-48f5-8cff-132c02d29e27 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:38.108312 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0219563f-745e-48f5-8cff-132c02d29e27 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1219 microversion: 2.1 time: 0.392146 Jul 28 03:36:38.111568 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 156/331] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:37 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1219 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:36:38.136790 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-18c72924-63cc-4103-bdee-a9742242a68a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:38.139798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-18c72924-63cc-4103-bdee-a9742242a68a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:38.157661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18c72924-63cc-4103-bdee-a9742242a68a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:38.160933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18c72924-63cc-4103-bdee-a9742242a68a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:38.163687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18c72924-63cc-4103-bdee-a9742242a68a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:38.165745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18c72924-63cc-4103-bdee-a9742242a68a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:38.259120 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18c72924-63cc-4103-bdee-a9742242a68a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:38.264408 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18c72924-63cc-4103-bdee-a9742242a68a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:38.265162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-18c72924-63cc-4103-bdee-a9742242a68a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lazy-loading 'fault' on Instance uuid 7b20cc49-3727-41d6-9379-45a8738ae7b1 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:36:38.300661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d3f2be1-fd98-4d9a-a592-f90122aed31b tempest-InstanceUsageAuditLogNegativeTestJSON-264293753 tempest-InstanceUsageAuditLogNegativeTestJSON-264293753-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:38.302255 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:38.302255 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:38.308431 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-6d3f2be1-fd98-4d9a-a592-f90122aed31b tempest-InstanceUsageAuditLogNegativeTestJSON-264293753 tempest-InstanceUsageAuditLogNegativeTestJSON-264293753-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d3f2be1-fd98-4d9a-a592-f90122aed31b tempest-InstanceUsageAuditLogNegativeTestJSON-264293753 tempest-InstanceUsageAuditLogNegativeTestJSON-264293753-project-admin] Request method failure captured: Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRFsDGPlHaJitaALYjku9RFkxS_V2d3HgI7UqI8PE4l6bUMUoWdpwni6ekvGRHmCI3YokgKXyBmPmW8VA6knUVCLFC5SdohBM384PYWBhdOOTw7qxpE23Edyr-M4b97SoelIqJb1fnPP6D8Bs206JSgxGDjd8ccU6ZS4ySx1MllDEs Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: e05afb20109145cfa1473db8d6713959 Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-264293753 Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:36:38.326156 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:36:38.327992 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e05afb20109145cfa1473db8d6713959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e05afb20109145cfa1473db8d6713959"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e05afb20109145cfa1473db8d6713959"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e05afb20109145cfa1473db8d6713959"}]}] Jul 28 03:36:38.327992 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-264293753 Jul 28 03:36:38.327992 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: e05afb20109145cfa1473db8d6713959 Jul 28 03:36:38.327992 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-264293753 Jul 28 03:36:38.327992 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-264293753-project-admin Jul 28 03:36:38.327992 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:36:38.327992 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:36:38.327992 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: b5c06c68b560454dbc721a8dc9d1ba4d Jul 28 03:36:38.327992 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-264293753-project-admin Jul 28 03:36:38.327992 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:36:38.327992 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid timestamp for date invalid_time Jul 28 03:36:38.327992 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'invalid_time'} Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:38.328830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 28 03:36:38.330308 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 28 03:36:38.330308 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 28 03:36:38.330308 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:38.330308 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:38.330308 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:38.330308 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:38.330308 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:38.330308 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:38.330308 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:38.330308 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:38.330308 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 28 03:36:38.330308 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:38.333499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d3f2be1-fd98-4d9a-a592-f90122aed31b tempest-InstanceUsageAuditLogNegativeTestJSON-264293753 tempest-InstanceUsageAuditLogNegativeTestJSON-264293753-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:38.334575 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d3f2be1-fd98-4d9a-a592-f90122aed31b tempest-InstanceUsageAuditLogNegativeTestJSON-264293753 tempest-InstanceUsageAuditLogNegativeTestJSON-264293753-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.643809 Jul 28 03:36:38.337497 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 176/332] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Jul 28 03:36:37 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 647 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:36:38.735715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-18c72924-63cc-4103-bdee-a9742242a68a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:38.758528 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-18c72924-63cc-4103-bdee-a9742242a68a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1416 microversion: 2.1 time: 0.630000 Jul 28 03:36:38.760837 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 157/333] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:38 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1416 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:38.788317 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-b1b6476a-5c8d-416e-b92d-6860c868d740 req-3d503f4b-8de8-445a-aaac-1e4416f4dd2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b20cc49-3727-41d6-9379-45a8738ae7b1", "name": "network-vif-deleted", "tag": "ea813944-1334-4265-bd42-a6746a168e8f"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:38.830619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b1b6476a-5c8d-416e-b92d-6860c868d740 req-3d503f4b-8de8-445a-aaac-1e4416f4dd2f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:38.831167 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b1b6476a-5c8d-416e-b92d-6860c868d740 req-3d503f4b-8de8-445a-aaac-1e4416f4dd2f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:38.906922 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-b1b6476a-5c8d-416e-b92d-6860c868d740 req-3d503f4b-8de8-445a-aaac-1e4416f4dd2f service nova] Creating event network-vif-deleted:ea813944-1334-4265-bd42-a6746a168e8f for instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 on n-h2-826756-3 Jul 28 03:36:38.924534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-53c9a910-c45d-452a-badc-1a115457bc7b tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 tempest-InstanceUsageAuditLogNegativeTestJSON-54177588-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:38.926308 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:38.926308 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:38.928331 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-b1b6476a-5c8d-416e-b92d-6860c868d740 req-3d503f4b-8de8-445a-aaac-1e4416f4dd2f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151866 Jul 28 03:36:38.928603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-53c9a910-c45d-452a-badc-1a115457bc7b tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 tempest-InstanceUsageAuditLogNegativeTestJSON-54177588-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '0cebceb7e65441e3ac79b80ee8348655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716e4138e65f4a2ab6383b60df4be579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:38.931734 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 158/334] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-53c9a910-c45d-452a-badc-1a115457bc7b tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 tempest-InstanceUsageAuditLogNegativeTestJSON-54177588-project] Request method failure captured: Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRDfdldrT-YwTom186TWFgDwbdjtiqDAlV2PcV_6Vl25gEjZDUgrITAH2vEsJhvHVMH4QTnyRhOQQj-2JHiM8uS5gUDomTt-SPgb2hcOz3KcwuRp39bb0z-NCxI8I5oaHljKRSSX5JOhF2YNK-OUQnSknTS8HKpNzSERt3_-3_TPS8 Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 716e4138e65f4a2ab6383b60df4be579 Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:36:38.932110 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:36:38.933842 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/716e4138e65f4a2ab6383b60df4be579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/716e4138e65f4a2ab6383b60df4be579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_716e4138e65f4a2ab6383b60df4be579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/716e4138e65f4a2ab6383b60df4be579"}]}] Jul 28 03:36:38.933842 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 Jul 28 03:36:38.933842 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 716e4138e65f4a2ab6383b60df4be579 Jul 28 03:36:38.933842 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 Jul 28 03:36:38.933842 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-54177588-project Jul 28 03:36:38.933842 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:36:38.933842 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:36:38.933842 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0cebceb7e65441e3ac79b80ee8348655 Jul 28 03:36:38.933842 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-54177588-project Jul 28 03:36:38.933842 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:36:38.933842 n-d-826756-3 devstack@n-api.service[126071]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: action_args: {} Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:36:38.934847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 28 03:36:38.936931 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:38.940657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-53c9a910-c45d-452a-badc-1a115457bc7b tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 tempest-InstanceUsageAuditLogNegativeTestJSON-54177588-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:38.942622 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-53c9a910-c45d-452a-badc-1a115457bc7b tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 tempest-InstanceUsageAuditLogNegativeTestJSON-54177588-project] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.601907 Jul 28 03:36:38.943864 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 177/335] 10.222.0.48 () {58 vars in 1185 bytes} [Thu Jul 28 03:36:38 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 604 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:36:38.954756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-75720e64-02ae-4270-b580-70e2b207d48d tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 tempest-InstanceUsageAuditLogNegativeTestJSON-54177588-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:38.957971 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:38.957971 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:36:38.959641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-75720e64-02ae-4270-b580-70e2b207d48d tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 tempest-InstanceUsageAuditLogNegativeTestJSON-54177588-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '0cebceb7e65441e3ac79b80ee8348655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '716e4138e65f4a2ab6383b60df4be579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-75720e64-02ae-4270-b580-70e2b207d48d tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 tempest-InstanceUsageAuditLogNegativeTestJSON-54177588-project] Request method failure captured: Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28%2003:36:38 HTTP/1.1 Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gRDfdldrT-YwTom186TWFgDwbdjtiqDAlV2PcV_6Vl25gEjZDUgrITAH2vEsJhvHVMH4QTnyRhOQQj-2JHiM8uS5gUDomTt-SPgb2hcOz3KcwuRp39bb0z-NCxI8I5oaHljKRSSX5JOhF2YNK-OUQnSknTS8HKpNzSERt3_-3_TPS8 Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 716e4138e65f4a2ab6383b60df4be579 Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:36:38.966678 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:36:38.968194 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/716e4138e65f4a2ab6383b60df4be579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/716e4138e65f4a2ab6383b60df4be579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_716e4138e65f4a2ab6383b60df4be579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/716e4138e65f4a2ab6383b60df4be579"}]}] Jul 28 03:36:38.968194 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 Jul 28 03:36:38.968194 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 716e4138e65f4a2ab6383b60df4be579 Jul 28 03:36:38.968194 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 Jul 28 03:36:38.968194 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-54177588-project Jul 28 03:36:38.968194 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:38.968194 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:38.968194 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 0cebceb7e65441e3ac79b80ee8348655 Jul 28 03:36:38.968194 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-54177588-project Jul 28 03:36:38.968194 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:36:38.968194 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '2022-07-28 03:36:38'} Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:36:38.968993 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 28 03:36:38.970403 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:38.973433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-75720e64-02ae-4270-b580-70e2b207d48d tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 tempest-InstanceUsageAuditLogNegativeTestJSON-54177588-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:38.976318 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-75720e64-02ae-4270-b580-70e2b207d48d tempest-InstanceUsageAuditLogNegativeTestJSON-54177588 tempest-InstanceUsageAuditLogNegativeTestJSON-54177588-project] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28 03:36:38" status: 403 len: 128 microversion: 2.1 time: 0.026400 Jul 28 03:36:38.978528 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 159/336] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 03:36:38 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28%2003%3A36%3A38 => generated 128 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:39.136842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-21c8b9e2-c2b7-472b-acc3-f4ef09e87a33 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:39.137631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-21c8b9e2-c2b7-472b-acc3-f4ef09e87a33 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:39.170764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21c8b9e2-c2b7-472b-acc3-f4ef09e87a33 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:39.171311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21c8b9e2-c2b7-472b-acc3-f4ef09e87a33 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:39.172109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21c8b9e2-c2b7-472b-acc3-f4ef09e87a33 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:39.172585 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21c8b9e2-c2b7-472b-acc3-f4ef09e87a33 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:39.446927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-21c8b9e2-c2b7-472b-acc3-f4ef09e87a33 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:39.459235 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-21c8b9e2-c2b7-472b-acc3-f4ef09e87a33 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1281 microversion: 2.1 time: 0.325646 Jul 28 03:36:39.460793 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 160/337] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:39 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1281 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:39.501928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a13f75fe-27a2-4278-b8ff-82576f44139d tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:39.533040 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a13f75fe-27a2-4278-b8ff-82576f44139d tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.544994 Jul 28 03:36:39.537750 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 178/338] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:36:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:39.725122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ae8251a5-505c-422c-9f4f-56fc2335dca4 tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1569409424", "id": 545521223, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:39.728994 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:39.728994 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:36:39.779591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1757129e-9c9d-45ea-970b-a28c1c64964a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:39.780864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1757129e-9c9d-45ea-970b-a28c1c64964a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:39.793822 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ae8251a5-505c-422c-9f4f-56fc2335dca4 tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.236968 Jul 28 03:36:39.798750 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 161/339] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:39 2022] POST /compute/v2.1/flavors => generated 422 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:39.814829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1757129e-9c9d-45ea-970b-a28c1c64964a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:39.815520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1757129e-9c9d-45ea-970b-a28c1c64964a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:39.820405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1757129e-9c9d-45ea-970b-a28c1c64964a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:39.822890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1757129e-9c9d-45ea-970b-a28c1c64964a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:39.827664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f630d8e7-0cc9-49bc-a6a1-e74b0951935f tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:39.876088 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f630d8e7-0cc9-49bc-a6a1-e74b0951935f tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.064436 Jul 28 03:36:39.878684 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 162/340] 10.222.0.48 () {58 vars in 1182 bytes} [Thu Jul 28 03:36:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:36:39.892650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f3ee9553-3ae3-4e0c-b92d-e472d22e8de6 tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-196249247", "id": 2001455220, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:39.932048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1757129e-9c9d-45ea-970b-a28c1c64964a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:39.932682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1757129e-9c9d-45ea-970b-a28c1c64964a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:39.933148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-1757129e-9c9d-45ea-970b-a28c1c64964a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lazy-loading 'fault' on Instance uuid 7b20cc49-3727-41d6-9379-45a8738ae7b1 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:36:39.954401 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f3ee9553-3ae3-4e0c-b92d-e472d22e8de6 tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.071105 Jul 28 03:36:39.965169 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 163/341] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:39 2022] POST /compute/v2.1/flavors => generated 424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:39.992522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-663aa60b-9244-407b-9687-33b4b41215cf tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:40.029381 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-663aa60b-9244-407b-9687-33b4b41215cf tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.060613 Jul 28 03:36:40.036553 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 164/342] 10.222.0.48 () {58 vars in 1182 bytes} [Thu Jul 28 03:36:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:36:40.045209 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e39e5553-badf-4e74-b170-04ecf8f131bf tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Action: 'create', calling method: .version_select at 0x7ffa750d09d0>, body: {"keypair": {"name": "tempest-keypair-315226568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxnVoQJ/oV3xKxiNnOFiQl9m/VdNpIZV72BDGJANPhFT9RpHm+LhNLMwHe9MtFKCYVNXuFWG7eaqYlno1mIIA9Vh562w6lXryPCTc5DqhPYxEtQMvYXEUJAq1dcwHsCuw=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:40.092799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-e39e5553-badf-4e74-b170-04ecf8f131bf tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Getting quotas for project edc92b66c7414566a24bf7f67535fd94. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:36:40.106133 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-e39e5553-badf-4e74-b170-04ecf8f131bf tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Getting quotas for user d876dd26de70496cbca6b3c066d72170 and project edc92b66c7414566a24bf7f67535fd94. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:36:40.166475 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e39e5553-badf-4e74-b170-04ecf8f131bf tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126271 Jul 28 03:36:40.168024 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 165/343] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:36:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:36:40.444281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1757129e-9c9d-45ea-970b-a28c1c64964a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75b0c48126914b959b5926d24a5f8a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac0afebe20824fd0898e22cbfaf03ba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:40.455596 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1757129e-9c9d-45ea-970b-a28c1c64964a tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 200 len: 1310 microversion: 2.1 time: 0.680093 Jul 28 03:36:40.458338 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 179/344] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:39 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 1310 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:36:40.485228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aba71b56-ad2a-4521-bce7-d38635c0ff02 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:40.486086 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-aba71b56-ad2a-4521-bce7-d38635c0ff02 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:40.500419 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aba71b56-ad2a-4521-bce7-d38635c0ff02 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:40.503784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aba71b56-ad2a-4521-bce7-d38635c0ff02 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:40.504965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aba71b56-ad2a-4521-bce7-d38635c0ff02 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:40.506100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aba71b56-ad2a-4521-bce7-d38635c0ff02 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:40.676446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-aba71b56-ad2a-4521-bce7-d38635c0ff02 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:40.686114 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aba71b56-ad2a-4521-bce7-d38635c0ff02 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1281 microversion: 2.1 time: 0.205213 Jul 28 03:36:40.689973 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 166/345] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:40 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1281 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:41.487565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-492ba3bb-e671-4a74-bca5-bd730a7380a4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:41.489968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-492ba3bb-e671-4a74-bca5-bd730a7380a4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:41.525785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-492ba3bb-e671-4a74-bca5-bd730a7380a4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:41.535718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-492ba3bb-e671-4a74-bca5-bd730a7380a4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:41.537966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-492ba3bb-e671-4a74-bca5-bd730a7380a4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:41.539860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-492ba3bb-e671-4a74-bca5-bd730a7380a4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:41.597173 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-492ba3bb-e671-4a74-bca5-bd730a7380a4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] HTTP exception thrown: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-492ba3bb-e671-4a74-bca5-bd730a7380a4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Request method failure captured: Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 HTTP/1.1 Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gP8yzbDoKfRnQWQubF2qBgW_PqSO95_lLXhB1xsrIHXTTnqS-fi_1lnmSbvbJCP3e9U1ivGq1DV8740P0XUyeaMtG274NruMOw3_WQc4mDdgDrCCZKcRHV8o1lrJAkJlKLZUjVmZFFUpb9WUXeIVrE8r-pzI80egf4sin9B5C_DboM Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ac0afebe20824fd0898e22cbfaf03ba5 Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:36:41.613364 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:36:41.614687 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac0afebe20824fd0898e22cbfaf03ba5"}]}] Jul 28 03:36:41.614687 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:41.614687 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ac0afebe20824fd0898e22cbfaf03ba5 Jul 28 03:36:41.614687 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:41.614687 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-DeleteServersAdminTestJSON-280990268-project Jul 28 03:36:41.614687 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:36:41.614687 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:36:41.614687 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 75b0c48126914b959b5926d24a5f8a82 Jul 28 03:36:41.614687 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-DeleteServersAdminTestJSON-280990268-project Jul 28 03:36:41.614687 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:36:41.614687 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.614687 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '7b20cc49-3727-41d6-9379-45a8738ae7b1'} Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:41.615356 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.616553 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.620300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-492ba3bb-e671-4a74-bca5-bd730a7380a4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Returning 404 to user: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:41.621219 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-492ba3bb-e671-4a74-bca5-bd730a7380a4 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 404 len: 111 microversion: 2.1 time: 0.147690 Jul 28 03:36:41.621809 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 180/346] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:41 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:41.641490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1f4c3541-c0c8-4190-9fba-391ce065b9ed tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:41.642170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1f4c3541-c0c8-4190-9fba-391ce065b9ed tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:41.658392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f4c3541-c0c8-4190-9fba-391ce065b9ed tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:41.658851 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f4c3541-c0c8-4190-9fba-391ce065b9ed tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:41.663081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f4c3541-c0c8-4190-9fba-391ce065b9ed tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:41.663759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f4c3541-c0c8-4190-9fba-391ce065b9ed tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:41.695371 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-1f4c3541-c0c8-4190-9fba-391ce065b9ed tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] HTTP exception thrown: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1f4c3541-c0c8-4190-9fba-391ce065b9ed tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Request method failure captured: Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 HTTP/1.1 Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gP8yzbDoKfRnQWQubF2qBgW_PqSO95_lLXhB1xsrIHXTTnqS-fi_1lnmSbvbJCP3e9U1ivGq1DV8740P0XUyeaMtG274NruMOw3_WQc4mDdgDrCCZKcRHV8o1lrJAkJlKLZUjVmZFFUpb9WUXeIVrE8r-pzI80egf4sin9B5C_DboM Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ac0afebe20824fd0898e22cbfaf03ba5 Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:36:41.699613 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:36:41.701117 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac0afebe20824fd0898e22cbfaf03ba5"}]}] Jul 28 03:36:41.701117 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:41.701117 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ac0afebe20824fd0898e22cbfaf03ba5 Jul 28 03:36:41.701117 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:41.701117 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersAdminTestJSON-280990268-project Jul 28 03:36:41.701117 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:41.701117 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:41.701117 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 75b0c48126914b959b5926d24a5f8a82 Jul 28 03:36:41.701117 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersAdminTestJSON-280990268-project Jul 28 03:36:41.701117 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:36:41.701117 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.701117 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '7b20cc49-3727-41d6-9379-45a8738ae7b1'} Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:41.701968 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.703319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.710595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2c5ccd3b-bd43-423e-81fe-08bc1899f092 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:41.711451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2c5ccd3b-bd43-423e-81fe-08bc1899f092 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:41.718613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1f4c3541-c0c8-4190-9fba-391ce065b9ed tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Returning 404 to user: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:41.720675 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1f4c3541-c0c8-4190-9fba-391ce065b9ed tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 404 len: 111 microversion: 2.1 time: 0.086669 Jul 28 03:36:41.721947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c5ccd3b-bd43-423e-81fe-08bc1899f092 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:41.722296 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 167/347] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:36:41 2022] DELETE /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:36:41.725811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c5ccd3b-bd43-423e-81fe-08bc1899f092 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:41.726872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c5ccd3b-bd43-423e-81fe-08bc1899f092 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:41.727505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c5ccd3b-bd43-423e-81fe-08bc1899f092 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:41.730728 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-04101df8-dd69-4f6e-8411-b3f561994c81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:41.731465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-04101df8-dd69-4f6e-8411-b3f561994c81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 7b20cc49-3727-41d6-9379-45a8738ae7b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:41.739455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04101df8-dd69-4f6e-8411-b3f561994c81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:41.740336 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04101df8-dd69-4f6e-8411-b3f561994c81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:41.741433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04101df8-dd69-4f6e-8411-b3f561994c81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:41.741974 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04101df8-dd69-4f6e-8411-b3f561994c81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:41.766072 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-04101df8-dd69-4f6e-8411-b3f561994c81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] HTTP exception thrown: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-04101df8-dd69-4f6e-8411-b3f561994c81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Request method failure captured: Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 HTTP/1.1 Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gP8yzbDoKfRnQWQubF2qBgW_PqSO95_lLXhB1xsrIHXTTnqS-fi_1lnmSbvbJCP3e9U1ivGq1DV8740P0XUyeaMtG274NruMOw3_WQc4mDdgDrCCZKcRHV8o1lrJAkJlKLZUjVmZFFUpb9WUXeIVrE8r-pzI80egf4sin9B5C_DboM Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ac0afebe20824fd0898e22cbfaf03ba5 Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:36:41.769067 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:36:41.770357 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac0afebe20824fd0898e22cbfaf03ba5"}]}] Jul 28 03:36:41.770357 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:41.770357 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ac0afebe20824fd0898e22cbfaf03ba5 Jul 28 03:36:41.770357 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:41.770357 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersAdminTestJSON-280990268-project Jul 28 03:36:41.770357 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:41.770357 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:41.770357 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 75b0c48126914b959b5926d24a5f8a82 Jul 28 03:36:41.770357 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersAdminTestJSON-280990268-project Jul 28 03:36:41.770357 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:36:41.770357 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.770357 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '7b20cc49-3727-41d6-9379-45a8738ae7b1'} Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:41.771239 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. Jul 28 03:36:41.772321 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.776953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-04101df8-dd69-4f6e-8411-b3f561994c81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Returning 404 to user: Instance 7b20cc49-3727-41d6-9379-45a8738ae7b1 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:41.779405 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-04101df8-dd69-4f6e-8411-b3f561994c81 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1" status: 404 len: 111 microversion: 2.1 time: 0.052835 Jul 28 03:36:41.780659 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 168/348] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:41 2022] GET /compute/v2.1/servers/7b20cc49-3727-41d6-9379-45a8738ae7b1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:41.791746 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-80e89222-4205-441b-8f7e-8345be6178a9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:41.792735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-80e89222-4205-441b-8f7e-8345be6178a9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:41.801264 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-80e89222-4205-441b-8f7e-8345be6178a9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:41.802197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-80e89222-4205-441b-8f7e-8345be6178a9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:41.803322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-80e89222-4205-441b-8f7e-8345be6178a9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:41.803969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-80e89222-4205-441b-8f7e-8345be6178a9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:41.854085 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-80e89222-4205-441b-8f7e-8345be6178a9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] HTTP exception thrown: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-80e89222-4205-441b-8f7e-8345be6178a9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Request method failure captured: Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 HTTP/1.1 Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gP8yzbDoKfRnQWQubF2qBgW_PqSO95_lLXhB1xsrIHXTTnqS-fi_1lnmSbvbJCP3e9U1ivGq1DV8740P0XUyeaMtG274NruMOw3_WQc4mDdgDrCCZKcRHV8o1lrJAkJlKLZUjVmZFFUpb9WUXeIVrE8r-pzI80egf4sin9B5C_DboM Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ac0afebe20824fd0898e22cbfaf03ba5 Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:36:41.856427 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:36:41.857980 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac0afebe20824fd0898e22cbfaf03ba5"}]}] Jul 28 03:36:41.857980 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:41.857980 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ac0afebe20824fd0898e22cbfaf03ba5 Jul 28 03:36:41.857980 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:41.857980 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersAdminTestJSON-280990268-project Jul 28 03:36:41.857980 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:41.857980 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:41.857980 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 75b0c48126914b959b5926d24a5f8a82 Jul 28 03:36:41.857980 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersAdminTestJSON-280990268-project Jul 28 03:36:41.857980 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:36:41.857980 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:41.857980 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '2ad9cea2-a559-4ca1-9d39-e089112bdde7'} Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:41.858865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:41.860197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:41.862149 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-80e89222-4205-441b-8f7e-8345be6178a9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Returning 404 to user: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:41.864404 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-80e89222-4205-441b-8f7e-8345be6178a9 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 404 len: 111 microversion: 2.1 time: 0.079314 Jul 28 03:36:41.865488 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 169/349] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:36:41 2022] DELETE /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:41.876983 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-86f25148-d35e-4b3f-b1ca-d4318aa42158 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:41.877958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-86f25148-d35e-4b3f-b1ca-d4318aa42158 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] [instance: 2ad9cea2-a559-4ca1-9d39-e089112bdde7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:41.923013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86f25148-d35e-4b3f-b1ca-d4318aa42158 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:41.925076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86f25148-d35e-4b3f-b1ca-d4318aa42158 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:41.928197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86f25148-d35e-4b3f-b1ca-d4318aa42158 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:41.929427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86f25148-d35e-4b3f-b1ca-d4318aa42158 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:42.016577 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-86f25148-d35e-4b3f-b1ca-d4318aa42158 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] HTTP exception thrown: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-86f25148-d35e-4b3f-b1ca-d4318aa42158 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Request method failure captured: Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 HTTP/1.1 Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gP8yzbDoKfRnQWQubF2qBgW_PqSO95_lLXhB1xsrIHXTTnqS-fi_1lnmSbvbJCP3e9U1ivGq1DV8740P0XUyeaMtG274NruMOw3_WQc4mDdgDrCCZKcRHV8o1lrJAkJlKLZUjVmZFFUpb9WUXeIVrE8r-pzI80egf4sin9B5C_DboM Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ac0afebe20824fd0898e22cbfaf03ba5 Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:36:42.025833 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:36:42.027051 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ac0afebe20824fd0898e22cbfaf03ba5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ac0afebe20824fd0898e22cbfaf03ba5"}]}] Jul 28 03:36:42.027051 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:42.027051 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ac0afebe20824fd0898e22cbfaf03ba5 Jul 28 03:36:42.027051 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-280990268 Jul 28 03:36:42.027051 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersAdminTestJSON-280990268-project Jul 28 03:36:42.027051 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:42.027051 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:42.027051 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 75b0c48126914b959b5926d24a5f8a82 Jul 28 03:36:42.027051 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersAdminTestJSON-280990268-project Jul 28 03:36:42.027051 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:36:42.027051 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:42.027051 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '2ad9cea2-a559-4ca1-9d39-e089112bdde7'} Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:42.027719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. Jul 28 03:36:42.028826 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:42.032779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2c5ccd3b-bd43-423e-81fe-08bc1899f092 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:42.033760 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-86f25148-d35e-4b3f-b1ca-d4318aa42158 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] Returning 404 to user: Instance 2ad9cea2-a559-4ca1-9d39-e089112bdde7 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:42.035411 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-86f25148-d35e-4b3f-b1ca-d4318aa42158 tempest-DeleteServersAdminTestJSON-280990268 tempest-DeleteServersAdminTestJSON-280990268-project] 10.222.0.48 "GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7" status: 404 len: 111 microversion: 2.1 time: 0.164292 Jul 28 03:36:42.039733 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 170/350] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:41 2022] GET /compute/v2.1/servers/2ad9cea2-a559-4ca1-9d39-e089112bdde7 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:42.048198 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2c5ccd3b-bd43-423e-81fe-08bc1899f092 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1281 microversion: 2.1 time: 0.341471 Jul 28 03:36:42.054789 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 181/351] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:41 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1281 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:43.078333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a27bec8e-c90b-4416-8968-f6cb3c09066b tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:43.080786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a27bec8e-c90b-4416-8968-f6cb3c09066b tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:43.103464 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a27bec8e-c90b-4416-8968-f6cb3c09066b tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:43.113629 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a27bec8e-c90b-4416-8968-f6cb3c09066b tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:43.116426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a27bec8e-c90b-4416-8968-f6cb3c09066b tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:43.118988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a27bec8e-c90b-4416-8968-f6cb3c09066b tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:44.400307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a27bec8e-c90b-4416-8968-f6cb3c09066b tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:44.414173 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a27bec8e-c90b-4416-8968-f6cb3c09066b tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1323 microversion: 2.1 time: 1.340683 Jul 28 03:36:44.418984 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 171/352] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:43 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1323 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:45.042197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-48d68dd2-ff2d-459a-a5ba-8afdd528a1cb tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Calling method '.version_select at 0x7ffa74cd2160>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:45.166816 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-48d68dd2-ff2d-459a-a5ba-8afdd528a1cb tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa" status: 200 len: 371 microversion: 2.1 time: 0.487146 Jul 28 03:36:45.176397 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 182/353] 10.222.0.48 () {58 vars in 1242 bytes} [Thu Jul 28 03:36:44 2022] GET /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa => generated 371 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:45.186270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c84a0d77-2c61-4df3-a666-04e327c0fa8d tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74fe9ca0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:45.412251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c84a0d77-2c61-4df3-a666-04e327c0fa8d tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:45.414035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c84a0d77-2c61-4df3-a666-04e327c0fa8d tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:45.417160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c84a0d77-2c61-4df3-a666-04e327c0fa8d tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:45.417600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c84a0d77-2c61-4df3-a666-04e327c0fa8d tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:45.580807 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c84a0d77-2c61-4df3-a666-04e327c0fa8d tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa" status: 200 len: 328 microversion: 2.1 time: 0.398259 Jul 28 03:36:45.581648 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 172/354] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Jul 28 03:36:45 2022] PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa => generated 328 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:45.597341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1f9b7d0d-f338-43e6-b9ff-d94992070b2c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:45.598215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1f9b7d0d-f338-43e6-b9ff-d94992070b2c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:45.605131 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f9b7d0d-f338-43e6-b9ff-d94992070b2c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:45.605969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f9b7d0d-f338-43e6-b9ff-d94992070b2c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:45.607024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f9b7d0d-f338-43e6-b9ff-d94992070b2c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:45.607619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f9b7d0d-f338-43e6-b9ff-d94992070b2c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:45.631729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0471511a-9264-4827-bee3-0d6d343dd3de tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Action: 'create', calling method: .version_select at 0x7ffa74c38670>, body: {"keypair": {"name": "tempest-keypair-713113740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrEoMRdLJA7h8peGYtCLzPdALcV/uaOlNYrKemucrexO+fmDLEunkxSZvhNzYuvnIoPuyrctbov30/fdGsqLUvppnLsS18G/Cb+z3vdhh0h2i0BhMQ3+0knlEmJEXaUpA=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:45.692152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-0471511a-9264-4827-bee3-0d6d343dd3de tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Getting quotas for project dc91ad107318444881db8af480262a29. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:36:45.709083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-0471511a-9264-4827-bee3-0d6d343dd3de tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Getting quotas for user d3843d34282c4e319380ec87b584e2c4 and project dc91ad107318444881db8af480262a29. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:36:45.784023 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0471511a-9264-4827-bee3-0d6d343dd3de tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.553438 Jul 28 03:36:45.784820 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 183/355] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:36:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:46.091480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=11 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:46.341800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1f9b7d0d-f338-43e6-b9ff-d94992070b2c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:46.352655 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1f9b7d0d-f338-43e6-b9ff-d94992070b2c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1323 microversion: 2.1 time: 0.765669 Jul 28 03:36:46.353588 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 173/356] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:45 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1323 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:46.434631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-257293588", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:46.541246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:36:47.272229 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-d335b1c5-c839-4f15-aa75-12898861e431 req-9b2f3621-3435-499a-948a-d00daef815ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a6c0641-21b5-4a87-ac26-d9b74f116b0c", "tag": "1dd75d2b-9387-419a-a9a5-65ee8be3d026"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:47.295449 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-d335b1c5-c839-4f15-aa75-12898861e431 req-9b2f3621-3435-499a-948a-d00daef815ae service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:47.295947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-d335b1c5-c839-4f15-aa75-12898861e431 req-9b2f3621-3435-499a-948a-d00daef815ae service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:47.334034 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-d335b1c5-c839-4f15-aa75-12898861e431 req-9b2f3621-3435-499a-948a-d00daef815ae service nova] Creating event network-changed:1dd75d2b-9387-419a-a9a5-65ee8be3d026 for instance 4a6c0641-21b5-4a87-ac26-d9b74f116b0c on n-h1-826756-3 Jul 28 03:36:47.350525 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-d335b1c5-c839-4f15-aa75-12898861e431 req-9b2f3621-3435-499a-948a-d00daef815ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080633 Jul 28 03:36:47.351472 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 174/357] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:47.377304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3067890f-95fc-4bc9-8935-c254d2e9a98a tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:47.378245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3067890f-95fc-4bc9-8935-c254d2e9a98a tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:47.391495 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3067890f-95fc-4bc9-8935-c254d2e9a98a tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:47.392390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3067890f-95fc-4bc9-8935-c254d2e9a98a tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:47.393399 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3067890f-95fc-4bc9-8935-c254d2e9a98a tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:47.394070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3067890f-95fc-4bc9-8935-c254d2e9a98a tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:48.028622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:36:48.029354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:36:48.030295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:36:48.031013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:36:48.033122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:36:48.064244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:48.072660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:48.077163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:48.078491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:48.161540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Getting quotas for project 8052cf5858c84dcba5dca212d4b651aa. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:36:48.187691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Getting quotas for user d1416bee2d7d4060958ddde8279caed8 and project 8052cf5858c84dcba5dca212d4b651aa. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:36:48.208258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.utils [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] cores quota exceeded for 8052cf5858c84dcba5dca212d4b651aa, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126071) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 28 03:36:48.209370 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Request method failure captured: Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 144 Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRKQEzQQbXDwM7U8tnANgMAi7ikkWYzHf8uMO3IPFzBYrkUHslFsIvsS1eXpzgNKw0YUET490cu1FHxLyWt1ZKG5r6Tedo8YB733iKzhUHecc4vvPEoLRpqdP5OsabsIBbIpNjjzNPNrUdOjlcCKT4j6xZb36g_7F0gUAWdSnXc4oQ Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 8052cf5858c84dcba5dca212d4b651aa Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-QuotasAdminNegativeTest-178957704 Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:36:48.249393 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:36:48.250875 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8052cf5858c84dcba5dca212d4b651aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8052cf5858c84dcba5dca212d4b651aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8052cf5858c84dcba5dca212d4b651aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8052cf5858c84dcba5dca212d4b651aa"}]}] Jul 28 03:36:48.250875 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-QuotasAdminNegativeTest-178957704 Jul 28 03:36:48.250875 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 8052cf5858c84dcba5dca212d4b651aa Jul 28 03:36:48.250875 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-178957704 Jul 28 03:36:48.250875 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-QuotasAdminNegativeTest-178957704-project Jul 28 03:36:48.250875 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:36:48.250875 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:36:48.250875 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d1416bee2d7d4060958ddde8279caed8 Jul 28 03:36:48.250875 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-QuotasAdminNegativeTest-178957704-project Jul 28 03:36:48.250875 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:36:48.250875 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-257293588", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} Jul 28 03:36:48.250875 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-257293588', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452'}}} Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 28 03:36:48.251668 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2195, in create Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1722, in _create_instance Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1351, in _provision_instances Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:48.252847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:48.254056 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:48.255384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:48.255384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:48.255384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:48.255384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:48.255384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 28 03:36:48.255384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:48.259484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:48.261795 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-09e8bbdc-f69f-4a00-ab97-f236bf1b4ce6 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.296643 Jul 28 03:36:48.261795 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 184/358] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:45 2022] POST /compute/v2.1/servers => generated 111 bytes in 2298 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:48.270342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-863132349", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f76c85a0-c616-4cd2-a4d5-29a90d49abe8"}], "security_groups": [{"name": "tempest-securitygroup--1160278648"}], "key_name": "tempest-keypair-450577607", "user_data": "}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:48.716823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3067890f-95fc-4bc9-8935-c254d2e9a98a tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:48.726230 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3067890f-95fc-4bc9-8935-c254d2e9a98a tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1323 microversion: 2.1 time: 1.354559 Jul 28 03:36:48.739555 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 175/359] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:47 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1323 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:48.744979 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1a917ab4-dd85-4abd-84e0-2c86d6a7fa3f tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74f55940>, body: {"quota_set": {"cores": 20}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:48.955937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] validate_networks() for [('f76c85a0-c616-4cd2-a4d5-29a90d49abe8', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:36:49.205627 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1a917ab4-dd85-4abd-84e0-2c86d6a7fa3f tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:49.213461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1a917ab4-dd85-4abd-84e0-2c86d6a7fa3f tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:49.216615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1a917ab4-dd85-4abd-84e0-2c86d6a7fa3f tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:49.217529 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1a917ab4-dd85-4abd-84e0-2c86d6a7fa3f tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:49.350082 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1a917ab4-dd85-4abd-84e0-2c86d6a7fa3f tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa" status: 200 len: 329 microversion: 2.1 time: 0.607508 Jul 28 03:36:49.365440 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 176/360] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Jul 28 03:36:48 2022] PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa => generated 329 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:49.377362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0a956615-d82f-4f71-acdc-69a20d6edfc8 tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Calling method '.version_select at 0x7ffa74e831f0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:49.873927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:49.914050 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0a956615-d82f-4f71-acdc-69a20d6edfc8 tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa" status: 200 len: 371 microversion: 2.1 time: 0.546780 Jul 28 03:36:49.923206 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 177/361] 10.222.0.48 () {58 vars in 1242 bytes} [Thu Jul 28 03:36:49 2022] GET /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa => generated 371 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:36:49.934591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-47981cbd-6c8c-4f91-83e5-56118810ebe2 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:49.937055 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-47981cbd-6c8c-4f91-83e5-56118810ebe2 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:49.960758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47981cbd-6c8c-4f91-83e5-56118810ebe2 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:49.961693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47981cbd-6c8c-4f91-83e5-56118810ebe2 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:49.962514 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47981cbd-6c8c-4f91-83e5-56118810ebe2 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:49.966435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47981cbd-6c8c-4f91-83e5-56118810ebe2 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:50.682293 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-47981cbd-6c8c-4f91-83e5-56118810ebe2 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:50.701307 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-47981cbd-6c8c-4f91-83e5-56118810ebe2 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1323 microversion: 2.1 time: 0.769362 Jul 28 03:36:50.704255 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 178/362] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:49 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1323 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:50.736284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-780320248", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "2001455220", "adminPass": "***", "networks": [{"uuid": "67e2a5ef-0a64-48ab-9bf4-5c1f6e20fc9a"}], "security_groups": [{"name": "tempest-securitygroup--115380769"}], "key_name": "tempest-keypair-315226568", "user_data": "}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:51.053492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:36:51.055073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:36:51.056017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:36:51.059912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:36:51.060602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:36:51.081759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=47 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:51.087023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:51.087650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:51.090235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:51.091613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:51.123068 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] validate_networks() for [('67e2a5ef-0a64-48ab-9bf4-5c1f6e20fc9a', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:36:51.134030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=70 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:51.156869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Getting quotas for project b7bee0b59b0b43ce80623b7aca24111a. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:36:51.163729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Getting quotas for user 26b9a63a13e1420aa3b7f299456c65e6 and project b7bee0b59b0b43ce80623b7aca24111a. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:36:51.177896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:36:51.182506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:36:51.222639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:51.276592 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b7a2871-49e8-478c-b1ab-d893c0f30e58 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.008381 Jul 28 03:36:51.285057 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 185/363] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 3022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:36:51.290782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17609571-ab34-4ed9-ac46-eaba494e618e tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74d88b80>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:51.594986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17609571-ab34-4ed9-ac46-eaba494e618e tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:51.595434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17609571-ab34-4ed9-ac46-eaba494e618e tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:51.596793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17609571-ab34-4ed9-ac46-eaba494e618e tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:51.598786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17609571-ab34-4ed9-ac46-eaba494e618e tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:51.674883 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-17609571-ab34-4ed9-ac46-eaba494e618e tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa" status: 200 len: 328 microversion: 2.1 time: 0.388356 Jul 28 03:36:51.680690 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 186/364] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Jul 28 03:36:51 2022] PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa => generated 328 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:51.698835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4fef4d6a-545c-4147-ae3f-c3445d36090d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:51.701398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4fef4d6a-545c-4147-ae3f-c3445d36090d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:51.876699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4fef4d6a-545c-4147-ae3f-c3445d36090d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:51.885559 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4fef4d6a-545c-4147-ae3f-c3445d36090d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1237 microversion: 2.1 time: 0.203207 Jul 28 03:36:51.889339 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 187/365] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:51 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1237 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:52.493741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-08b4f20e-c224-4b90-93f0-bec3435b0e03 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2017216666", "id": 587511577, "os-flavor-access:is_public": "True"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:52.497189 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:52.497189 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:52.539028 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-08b4f20e-c224-4b90-93f0-bec3435b0e03 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.648171 Jul 28 03:36:52.542555 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 188/366] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:51 2022] POST /compute/v2.1/flavors => generated 427 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:52.563816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7513507e-fbb0-4b33-ab4a-183b7081e49c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:52.565738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7513507e-fbb0-4b33-ab4a-183b7081e49c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:52.595060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7513507e-fbb0-4b33-ab4a-183b7081e49c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:52.598569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7513507e-fbb0-4b33-ab4a-183b7081e49c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:52.599589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7513507e-fbb0-4b33-ab4a-183b7081e49c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:52.602947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7513507e-fbb0-4b33-ab4a-183b7081e49c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:53.155666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:36:53.156205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:36:53.156691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:36:53.157106 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:36:53.157512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:36:53.173869 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:53.174613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:53.175657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:53.176364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:53.202860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7513507e-fbb0-4b33-ab4a-183b7081e49c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:53.208868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Getting quotas for project edc92b66c7414566a24bf7f67535fd94. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:36:53.216250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Getting quotas for user d876dd26de70496cbca6b3c066d72170 and project edc92b66c7414566a24bf7f67535fd94. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:36:53.221912 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7513507e-fbb0-4b33-ab4a-183b7081e49c tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1323 microversion: 2.1 time: 0.676232 Jul 28 03:36:53.222835 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 189/367] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:52 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1323 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:53.240622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1582351420", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:53.271364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:36:53.274038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:36:53.333966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:36:53.423600 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2796b348-6e0f-4168-ad70-e6938feb2c9a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.716136 Jul 28 03:36:53.424401 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 179/368] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 2719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:36:53.440713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bab700a6-399d-4df4-b996-e3db1ee4dc92 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:53.441965 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:53.441965 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:36:53.470284 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bab700a6-399d-4df4-b996-e3db1ee4dc92 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/587511577" status: 202 len: 0 microversion: 2.1 time: 0.043607 Jul 28 03:36:53.472513 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 180/369] 10.222.0.48 () {58 vars in 1158 bytes} [Thu Jul 28 03:36:53 2022] DELETE /compute/v2.1/flavors/587511577 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:36:53.478819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-83de7aa4-c8b9-4cdc-a82f-d89c37b10566 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:53.479803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-83de7aa4-c8b9-4cdc-a82f-d89c37b10566 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:53.494633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83de7aa4-c8b9-4cdc-a82f-d89c37b10566 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:53.495423 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83de7aa4-c8b9-4cdc-a82f-d89c37b10566 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:53.496507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83de7aa4-c8b9-4cdc-a82f-d89c37b10566 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:53.497201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83de7aa4-c8b9-4cdc-a82f-d89c37b10566 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:53.613436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-83de7aa4-c8b9-4cdc-a82f-d89c37b10566 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:53.624224 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-83de7aa4-c8b9-4cdc-a82f-d89c37b10566 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1295 microversion: 2.1 time: 0.149653 Jul 28 03:36:53.625470 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 181/370] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:53 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1295 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:53.630851 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-821442247", "imageRef": "146a7130-4c48-4d9b-828a-c6ca9ac48f21", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "eeaa7e0c-ce21-4183-8267-843d2904d3e6"}], "security_groups": [{"name": "tempest-securitygroup--692374126"}], "key_name": "tempest-keypair-713113740", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:53.798201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] validate_networks() for [('eeaa7e0c-ce21-4183-8267-843d2904d3e6', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:36:54.132921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:36:54.134142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:36:54.134788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:36:54.135418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:36:54.136004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:36:54.152952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:54.159490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:54.160711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:54.161315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:54.193098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Getting quotas for project 8052cf5858c84dcba5dca212d4b651aa. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:36:54.199845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Getting quotas for user d1416bee2d7d4060958ddde8279caed8 and project 8052cf5858c84dcba5dca212d4b651aa. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:36:54.214873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.utils [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] instances quota exceeded for 8052cf5858c84dcba5dca212d4b651aa, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126071) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 28 03:36:54.216078 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Request method failure captured: Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 145 Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRKQEzQQbXDwM7U8tnANgMAi7ikkWYzHf8uMO3IPFzBYrkUHslFsIvsS1eXpzgNKw0YUET490cu1FHxLyWt1ZKG5r6Tedo8YB733iKzhUHecc4vvPEoLRpqdP5OsabsIBbIpNjjzNPNrUdOjlcCKT4j6xZb36g_7F0gUAWdSnXc4oQ Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 8052cf5858c84dcba5dca212d4b651aa Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-QuotasAdminNegativeTest-178957704 Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:36:54.218668 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:36:54.219995 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8052cf5858c84dcba5dca212d4b651aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8052cf5858c84dcba5dca212d4b651aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8052cf5858c84dcba5dca212d4b651aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8052cf5858c84dcba5dca212d4b651aa"}]}] Jul 28 03:36:54.219995 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-QuotasAdminNegativeTest-178957704 Jul 28 03:36:54.219995 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 8052cf5858c84dcba5dca212d4b651aa Jul 28 03:36:54.219995 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-178957704 Jul 28 03:36:54.219995 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-QuotasAdminNegativeTest-178957704-project Jul 28 03:36:54.219995 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:36:54.219995 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:36:54.219995 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d1416bee2d7d4060958ddde8279caed8 Jul 28 03:36:54.219995 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-QuotasAdminNegativeTest-178957704-project Jul 28 03:36:54.219995 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:36:54.219995 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1582351420", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} Jul 28 03:36:54.219995 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1582351420', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452'}}} Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 28 03:36:54.221405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2195, in create Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1722, in _create_instance Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1351, in _provision_instances Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:54.222403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:54.223537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:54.226556 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:54.226556 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:54.226556 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:54.226556 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:54.226556 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 28 03:36:54.226556 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:36:54.226556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:54.226556 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-05b1cc08-acef-478d-86a5-333d55580638 tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.998471 Jul 28 03:36:54.228090 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 190/371] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:53 2022] POST /compute/v2.1/servers => generated 119 bytes in 1004 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:54.232825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ec1fe48-16d8-4dc7-9d37-be24c43e76b2 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:54.233446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5ec1fe48-16d8-4dc7-9d37-be24c43e76b2 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:54.245684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ec1fe48-16d8-4dc7-9d37-be24c43e76b2 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:54.246421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ec1fe48-16d8-4dc7-9d37-be24c43e76b2 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:54.247698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ec1fe48-16d8-4dc7-9d37-be24c43e76b2 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:54.248582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ec1fe48-16d8-4dc7-9d37-be24c43e76b2 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:54.406994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:36:54.408171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:36:54.408825 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:36:54.409431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:36:54.410017 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:36:54.422144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:54.424099 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:54.425263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:54.425937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:54.485166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ec1fe48-16d8-4dc7-9d37-be24c43e76b2 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:54.495690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Getting quotas for project dc91ad107318444881db8af480262a29. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:36:54.511593 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ec1fe48-16d8-4dc7-9d37-be24c43e76b2 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1267 microversion: 2.1 time: 0.282989 Jul 28 03:36:54.512188 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 191/372] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:54 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:54.517325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Getting quotas for user d3843d34282c4e319380ec87b584e2c4 and project dc91ad107318444881db8af480262a29. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:36:54.533791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-04795e49-e792-4126-adb4-319c3b730b4b tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:54.543545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:36:54.546520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='146a7130-4c48-4d9b-828a-c6ca9ac48f21',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:36:54.586674 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-04795e49-e792-4126-adb4-319c3b730b4b tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.066977 Jul 28 03:36:54.587692 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 192/373] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:36:54 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:54.607706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-decc43ae-21d8-4f8e-8c62-fa92a6456dae tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74c38670>, body: {"quota_set": {"instances": 10}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:54.610062 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d7de9de6-1ca9-402c-a911-54a865349d6e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.983372 Jul 28 03:36:54.618193 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 182/374] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:36:54.623339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1b14c0fa-7e46-41a5-a2b5-5e12b177f515 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:54.624112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1b14c0fa-7e46-41a5-a2b5-5e12b177f515 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:54.632750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b14c0fa-7e46-41a5-a2b5-5e12b177f515 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:54.646803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b14c0fa-7e46-41a5-a2b5-5e12b177f515 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:54.648173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b14c0fa-7e46-41a5-a2b5-5e12b177f515 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:54.650164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b14c0fa-7e46-41a5-a2b5-5e12b177f515 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:54.905252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-decc43ae-21d8-4f8e-8c62-fa92a6456dae tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:54.908926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-decc43ae-21d8-4f8e-8c62-fa92a6456dae tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:54.910123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-decc43ae-21d8-4f8e-8c62-fa92a6456dae tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:54.911032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-decc43ae-21d8-4f8e-8c62-fa92a6456dae tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:55.063690 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-decc43ae-21d8-4f8e-8c62-fa92a6456dae tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa" status: 200 len: 329 microversion: 2.1 time: 0.459580 Jul 28 03:36:55.073849 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 193/375] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Jul 28 03:36:54 2022] PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa => generated 329 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:55.073849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4203bb13-79ce-4199-8234-edeaa41e2fcf tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2137024295", "id": 813762221, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:55.085572 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:55.085572 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:55.120562 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4203bb13-79ce-4199-8234-edeaa41e2fcf tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.051225 Jul 28 03:36:55.122904 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 194/376] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:55 2022] POST /compute/v2.1/flavors => generated 414 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:55.136016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e35c0cd6-0d5e-4e55-9f74-0e4624ae19e7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:55.138365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e35c0cd6-0d5e-4e55-9f74-0e4624ae19e7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:55.166199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1b14c0fa-7e46-41a5-a2b5-5e12b177f515 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:55.175187 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1b14c0fa-7e46-41a5-a2b5-5e12b177f515 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1323 microversion: 2.1 time: 0.555736 Jul 28 03:36:55.199440 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 183/377] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:54 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1323 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:55.218722 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9ef971e6-0b24-4981-86a1-e855a3c6b601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:55.224165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9ef971e6-0b24-4981-86a1-e855a3c6b601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:55.253865 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9ef971e6-0b24-4981-86a1-e855a3c6b601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:55.261291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9ef971e6-0b24-4981-86a1-e855a3c6b601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:55.269258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9ef971e6-0b24-4981-86a1-e855a3c6b601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:55.274727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9ef971e6-0b24-4981-86a1-e855a3c6b601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:55.353494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e35c0cd6-0d5e-4e55-9f74-0e4624ae19e7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:55.367536 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e35c0cd6-0d5e-4e55-9f74-0e4624ae19e7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1244 microversion: 2.1 time: 0.237963 Jul 28 03:36:55.371796 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 195/378] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:55 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1244 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:55.384395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd713ffb-1483-4fee-8879-b458ff57b148 tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Calling method '.version_select at 0x7ffa74bc6f70>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:55.524769 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd713ffb-1483-4fee-8879-b458ff57b148 tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa" status: 200 len: 371 microversion: 2.1 time: 0.150513 Jul 28 03:36:55.537893 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 196/379] 10.222.0.48 () {58 vars in 1242 bytes} [Thu Jul 28 03:36:55 2022] GET /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa => generated 371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:55.549233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17dbbf34-0f7e-465a-b59c-d107ea349cd3 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:55.600701 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-17dbbf34-0f7e-465a-b59c-d107ea349cd3 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.060998 Jul 28 03:36:55.602704 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 197/380] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:36:55 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:55.614140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed799e25-56ab-4147-8c23-3aa209d2fb91 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:55.615945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed799e25-56ab-4147-8c23-3aa209d2fb91 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:55.631288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed799e25-56ab-4147-8c23-3aa209d2fb91 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:55.631808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed799e25-56ab-4147-8c23-3aa209d2fb91 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:55.632637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed799e25-56ab-4147-8c23-3aa209d2fb91 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:55.635949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed799e25-56ab-4147-8c23-3aa209d2fb91 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:55.827523 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9ef971e6-0b24-4981-86a1-e855a3c6b601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:55.853040 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9ef971e6-0b24-4981-86a1-e855a3c6b601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1295 microversion: 2.1 time: 0.643335 Jul 28 03:36:55.854267 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 184/381] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:55 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1295 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:55.864109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-899c0365-147a-4a47-9a06-81159b836b68 tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Action: 'update', calling method: .version_select at 0x7ffa7504bf70>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:55.896033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed799e25-56ab-4147-8c23-3aa209d2fb91 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:55.905725 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed799e25-56ab-4147-8c23-3aa209d2fb91 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1321 microversion: 2.1 time: 0.301188 Jul 28 03:36:55.922935 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 198/382] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:55 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:55.930632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c7d8002e-bb2b-4905-aa80-215a68ffa4ef tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:55.938547 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:55.938547 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:55.987257 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c7d8002e-bb2b-4905-aa80-215a68ffa4ef tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/813762221" status: 202 len: 0 microversion: 2.1 time: 0.062636 Jul 28 03:36:55.988198 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 199/383] 10.222.0.48 () {58 vars in 1158 bytes} [Thu Jul 28 03:36:55 2022] DELETE /compute/v2.1/flavors/813762221 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:36:55.996642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-25cb3dc8-bd75-4473-95b6-51682e20741d tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:56.060812 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-25cb3dc8-bd75-4473-95b6-51682e20741d tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.067986 Jul 28 03:36:56.066367 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 200/384] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:36:55 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:56.088852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-899c0365-147a-4a47-9a06-81159b836b68 tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:56.090323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-899c0365-147a-4a47-9a06-81159b836b68 tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:56.094386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-899c0365-147a-4a47-9a06-81159b836b68 tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:56.097207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-899c0365-147a-4a47-9a06-81159b836b68 tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:56.099816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2feb4e7f-116c-4547-bd53-2373e2f652a5 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-154309741", "id": 2077965987, "os-flavor-access:is_public": "True"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:56.124328 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:56.124328 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:56.160331 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2feb4e7f-116c-4547-bd53-2373e2f652a5 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.074488 Jul 28 03:36:56.167717 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 201/385] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:56 2022] POST /compute/v2.1/flavors => generated 428 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:56.177386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-453737e3-288b-4732-aa89-95d38f6ee596 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:56.207780 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-453737e3-288b-4732-aa89-95d38f6ee596 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/2077965987" status: 202 len: 0 microversion: 2.1 time: 0.038728 Jul 28 03:36:56.212773 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 202/386] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:36:56 2022] DELETE /compute/v2.1/flavors/2077965987 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:36:56.238508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-26ce7a8a-4182-42d1-b509-f3d78df2d2bc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:56.239163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-26ce7a8a-4182-42d1-b509-f3d78df2d2bc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:56.270642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26ce7a8a-4182-42d1-b509-f3d78df2d2bc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:56.271815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26ce7a8a-4182-42d1-b509-f3d78df2d2bc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:56.278553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26ce7a8a-4182-42d1-b509-f3d78df2d2bc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:56.279306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26ce7a8a-4182-42d1-b509-f3d78df2d2bc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:56.343949 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-899c0365-147a-4a47-9a06-81159b836b68 tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa" status: 200 len: 325 microversion: 2.1 time: 0.488142 Jul 28 03:36:56.348269 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 185/387] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Jul 28 03:36:55 2022] PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa => generated 325 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:56.374122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3c29cde2-a72b-4589-b38d-207a841f4a5d tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:56.443102 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3c29cde2-a72b-4589-b38d-207a841f4a5d tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.089337 Jul 28 03:36:56.445498 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 186/388] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:36:56 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:56.452060 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4ee6df59-43a9-40e2-b6e5-e13f3f4c73e0 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:56.453125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4ee6df59-43a9-40e2-b6e5-e13f3f4c73e0 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:56.469908 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ee6df59-43a9-40e2-b6e5-e13f3f4c73e0 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:56.471290 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ee6df59-43a9-40e2-b6e5-e13f3f4c73e0 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:56.472361 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ee6df59-43a9-40e2-b6e5-e13f3f4c73e0 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:56.473104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ee6df59-43a9-40e2-b6e5-e13f3f4c73e0 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:56.614435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4ee6df59-43a9-40e2-b6e5-e13f3f4c73e0 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:56.624933 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4ee6df59-43a9-40e2-b6e5-e13f3f4c73e0 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1296 microversion: 2.1 time: 0.177930 Jul 28 03:36:56.629422 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 187/389] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:56 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1296 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:56.635214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aac1ae0a-b640-4827-a31c-22b28eac2e8c tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-416754393", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:56.641908 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:56.641908 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:36:56.667173 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aac1ae0a-b640-4827-a31c-22b28eac2e8c tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.035648 Jul 28 03:36:56.669391 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 188/390] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:56 2022] POST /compute/v2.1/flavors => generated 506 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:56.675393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-c2715614-0c2d-4e55-b8b4-540bfe639a2d req-d2a63832-2725-4d4f-b7e4-1c2957a529ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6c0641-21b5-4a87-ac26-d9b74f116b0c", "name": "network-vif-plugged", "status": "completed", "tag": "1dd75d2b-9387-419a-a9a5-65ee8be3d026"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:56.688976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c2715614-0c2d-4e55-b8b4-540bfe639a2d req-d2a63832-2725-4d4f-b7e4-1c2957a529ca service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:56.689342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c2715614-0c2d-4e55-b8b4-540bfe639a2d req-d2a63832-2725-4d4f-b7e4-1c2957a529ca service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:56.702949 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-c2715614-0c2d-4e55-b8b4-540bfe639a2d req-d2a63832-2725-4d4f-b7e4-1c2957a529ca service nova] Creating event network-vif-plugged:1dd75d2b-9387-419a-a9a5-65ee8be3d026 for instance 4a6c0641-21b5-4a87-ac26-d9b74f116b0c on n-h1-826756-3 Jul 28 03:36:56.709516 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-c2715614-0c2d-4e55-b8b4-540bfe639a2d req-d2a63832-2725-4d4f-b7e4-1c2957a529ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038011 Jul 28 03:36:56.710965 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 189/391] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:56.718879 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-271231666", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:56.780495 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:36:57.100569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-26ce7a8a-4182-42d1-b509-f3d78df2d2bc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:57.113013 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-26ce7a8a-4182-42d1-b509-f3d78df2d2bc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1323 microversion: 2.1 time: 0.899068 Jul 28 03:36:57.129116 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 203/392] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:56 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1323 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:57.138215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90945688-7a2a-41a6-8189-22f8f3718182 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:57.170632 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:57.170632 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:57.214711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:57.238004 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90945688-7a2a-41a6-8189-22f8f3718182 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/248c5bdc-40e3-4797-94fa-7ccddd1f080c" status: 202 len: 0 microversion: 2.1 time: 0.106757 Jul 28 03:36:57.243739 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 204/393] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:36:57 2022] DELETE /compute/v2.1/flavors/248c5bdc-40e3-4797-94fa-7ccddd1f080c => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:36:57.250929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eebced25-012d-4319-a22e-b538e11d1425 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:57.252096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eebced25-012d-4319-a22e-b538e11d1425 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:57.267159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eebced25-012d-4319-a22e-b538e11d1425 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:57.267963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eebced25-012d-4319-a22e-b538e11d1425 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:57.269288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eebced25-012d-4319-a22e-b538e11d1425 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:57.271401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eebced25-012d-4319-a22e-b538e11d1425 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:58.049292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eebced25-012d-4319-a22e-b538e11d1425 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:58.068276 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eebced25-012d-4319-a22e-b538e11d1425 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1363 microversion: 2.1 time: 0.821585 Jul 28 03:36:58.070399 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 205/394] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:57 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1363 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:58.085678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f5396281-a257-45fb-909e-6d5c87f2b784 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:58.086893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f5396281-a257-45fb-909e-6d5c87f2b784 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:58.114993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5396281-a257-45fb-909e-6d5c87f2b784 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:58.116889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5396281-a257-45fb-909e-6d5c87f2b784 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:58.119354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5396281-a257-45fb-909e-6d5c87f2b784 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:58.121662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5396281-a257-45fb-909e-6d5c87f2b784 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:58.459372 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:36:58.459864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:36:58.460334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:36:58.489130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:36:58.489853 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:36:58.502302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f5396281-a257-45fb-909e-6d5c87f2b784 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:58.517694 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f5396281-a257-45fb-909e-6d5c87f2b784 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1321 microversion: 2.1 time: 0.444307 Jul 28 03:36:58.521306 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 206/395] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:58 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1321 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:58.546314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-984e1c8c-c176-4a01-bc86-e8c6e633287b tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:58.546540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:58.546806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:58.547588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:58.548014 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:58.631698 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-984e1c8c-c176-4a01-bc86-e8c6e633287b tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.102050 Jul 28 03:36:58.640414 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 207/396] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:36:58 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:58.652717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e125b49-a2ba-420d-b566-a46087e9d959 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:58.664445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4e125b49-a2ba-420d-b566-a46087e9d959 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:58.689775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e125b49-a2ba-420d-b566-a46087e9d959 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:58.690650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e125b49-a2ba-420d-b566-a46087e9d959 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:58.691672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e125b49-a2ba-420d-b566-a46087e9d959 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:58.696009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e125b49-a2ba-420d-b566-a46087e9d959 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:58.710415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Getting quotas for project 8052cf5858c84dcba5dca212d4b651aa. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:36:58.747277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Getting quotas for user d1416bee2d7d4060958ddde8279caed8 and project 8052cf5858c84dcba5dca212d4b651aa. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:36:58.848875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.utils [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] ram quota exceeded for 8052cf5858c84dcba5dca212d4b651aa, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=126072) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 28 03:36:58.849846 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Request method failure captured: Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 144 Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gRKQEzQQbXDwM7U8tnANgMAi7ikkWYzHf8uMO3IPFzBYrkUHslFsIvsS1eXpzgNKw0YUET490cu1FHxLyWt1ZKG5r6Tedo8YB733iKzhUHecc4vvPEoLRpqdP5OsabsIBbIpNjjzNPNrUdOjlcCKT4j6xZb36g_7F0gUAWdSnXc4oQ Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 8052cf5858c84dcba5dca212d4b651aa Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-QuotasAdminNegativeTest-178957704 Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:36:58.865848 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:36:58.867524 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8052cf5858c84dcba5dca212d4b651aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8052cf5858c84dcba5dca212d4b651aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8052cf5858c84dcba5dca212d4b651aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8052cf5858c84dcba5dca212d4b651aa"}]}] Jul 28 03:36:58.867524 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-QuotasAdminNegativeTest-178957704 Jul 28 03:36:58.867524 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 8052cf5858c84dcba5dca212d4b651aa Jul 28 03:36:58.867524 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-178957704 Jul 28 03:36:58.867524 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-QuotasAdminNegativeTest-178957704-project Jul 28 03:36:58.867524 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:36:58.867524 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:36:58.867524 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: d1416bee2d7d4060958ddde8279caed8 Jul 28 03:36:58.867524 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-QuotasAdminNegativeTest-178957704-project Jul 28 03:36:58.867524 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:36:58.867524 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-271231666", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} Jul 28 03:36:58.867524 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-271231666', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452'}}} Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 28 03:36:58.868493 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2195, in create Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1722, in _create_instance Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1351, in _provision_instances Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:58.871466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:58.873557 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:36:58.875219 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:36:58.875219 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:36:58.875219 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:36:58.875219 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:36:58.875219 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 28 03:36:58.875219 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:36:58.892219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:36:58.894104 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e8223581-104c-4961-b239-b4285fe9298d tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 2.180540 Jul 28 03:36:58.901762 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 190/397] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:56 2022] POST /compute/v2.1/servers => generated 110 bytes in 2190 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:36:58.932525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b63ee413-56dc-4306-8e52-8ff0902e0022 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:58.934216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b63ee413-56dc-4306-8e52-8ff0902e0022 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:58.961101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b63ee413-56dc-4306-8e52-8ff0902e0022 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:58.961685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b63ee413-56dc-4306-8e52-8ff0902e0022 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:58.963700 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b63ee413-56dc-4306-8e52-8ff0902e0022 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:58.965399 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b63ee413-56dc-4306-8e52-8ff0902e0022 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:59.064218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:36:59.247455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e125b49-a2ba-420d-b566-a46087e9d959 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:36:59.269829 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e125b49-a2ba-420d-b566-a46087e9d959 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1302 microversion: 2.1 time: 0.617800 Jul 28 03:36:59.271146 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 208/398] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:58 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1302 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:36:59.311829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-31575da2-85b3-4e47-9f18-1cd6d5589955 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1198858403", "id": "8b95ebb7-d94d-4a71-8a44-359e6b9d953d", "os-flavor-access:is_public": "True"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:59.348846 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:36:59.348846 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:36:59.402484 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-31575da2-85b3-4e47-9f18-1cd6d5589955 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.129897 Jul 28 03:36:59.409302 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 209/399] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:36:59 2022] POST /compute/v2.1/flavors => generated 507 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:59.431671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-625f7c15-9b7e-47dc-9403-c5e842e002bb tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74bcf430>, body: {"quota_set": {"ram": 51200}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:36:59.614712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-625f7c15-9b7e-47dc-9403-c5e842e002bb tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:59.615298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-625f7c15-9b7e-47dc-9403-c5e842e002bb tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:59.615954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-625f7c15-9b7e-47dc-9403-c5e842e002bb tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:59.616424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-625f7c15-9b7e-47dc-9403-c5e842e002bb tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:59.872723 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-625f7c15-9b7e-47dc-9403-c5e842e002bb tempest-QuotasAdminNegativeTest-2088113206 tempest-QuotasAdminNegativeTest-2088113206-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa" status: 200 len: 329 microversion: 2.1 time: 0.458521 Jul 28 03:36:59.876839 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 210/400] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Jul 28 03:36:59 2022] PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa => generated 329 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:36:59.884710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-487eb679-69d7-4bc1-a236-0cfb4033f489 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:36:59.898446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-487eb679-69d7-4bc1-a236-0cfb4033f489 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:36:59.911715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-487eb679-69d7-4bc1-a236-0cfb4033f489 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:59.912627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-487eb679-69d7-4bc1-a236-0cfb4033f489 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:36:59.914160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-487eb679-69d7-4bc1-a236-0cfb4033f489 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:36:59.914844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-487eb679-69d7-4bc1-a236-0cfb4033f489 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:00.666192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-487eb679-69d7-4bc1-a236-0cfb4033f489 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:00.667060 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b63ee413-56dc-4306-8e52-8ff0902e0022 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:00.681873 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b63ee413-56dc-4306-8e52-8ff0902e0022 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1473 microversion: 2.1 time: 1.778412 Jul 28 03:37:00.683751 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-487eb679-69d7-4bc1-a236-0cfb4033f489 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1363 microversion: 2.1 time: 0.803661 Jul 28 03:37:00.686693 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 191/401] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:58 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1473 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:00.688001 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 211/402] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:36:59 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1363 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:00.697774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-c33bfbfa-183a-41be-ab0a-385eede8b41f req-32183e44-28bb-465c-82ea-cbf1a2fe9cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4b8ffa-dbe6-4e90-a8f5-728addf73aae", "tag": "3931df07-76f1-4feb-a179-d48d42b61b21"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:00.719455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-257aad9c-8e98-4507-8921-adfb986ff1df tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:00.723289 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:00.723289 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:00.735030 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c33bfbfa-183a-41be-ab0a-385eede8b41f req-32183e44-28bb-465c-82ea-cbf1a2fe9cc0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:00.736865 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c33bfbfa-183a-41be-ab0a-385eede8b41f req-32183e44-28bb-465c-82ea-cbf1a2fe9cc0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:00.765843 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-c33bfbfa-183a-41be-ab0a-385eede8b41f req-32183e44-28bb-465c-82ea-cbf1a2fe9cc0 service nova] Creating event network-changed:3931df07-76f1-4feb-a179-d48d42b61b21 for instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae on n-h2-826756-3 Jul 28 03:37:00.785394 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-c33bfbfa-183a-41be-ab0a-385eede8b41f req-32183e44-28bb-465c-82ea-cbf1a2fe9cc0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097157 Jul 28 03:37:00.789428 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 192/403] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:00.798556 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-257aad9c-8e98-4507-8921-adfb986ff1df tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/8b95ebb7-d94d-4a71-8a44-359e6b9d953d" status: 202 len: 0 microversion: 2.1 time: 0.105128 Jul 28 03:37:00.799328 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 212/404] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:37:00 2022] DELETE /compute/v2.1/flavors/8b95ebb7-d94d-4a71-8a44-359e6b9d953d => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:37:00.807161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4c74afa1-4ff5-4006-b319-5489eeebee2f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:00.810375 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4c74afa1-4ff5-4006-b319-5489eeebee2f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:00.814659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c2b9efd-8fae-47a2-b282-e9e11852309c tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Action: 'update', calling method: .version_select at 0x7ffa74c425e0>, body: {"quota_set": {"ram": 0}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:00.822370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1c2b9efd-8fae-47a2-b282-e9e11852309c tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'd1416bee2d7d4060958ddde8279caed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8052cf5858c84dcba5dca212d4b651aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:00.827356 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c74afa1-4ff5-4006-b319-5489eeebee2f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:00.828100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c74afa1-4ff5-4006-b319-5489eeebee2f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:00.829147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c74afa1-4ff5-4006-b319-5489eeebee2f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:00.830535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c74afa1-4ff5-4006-b319-5489eeebee2f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c2b9efd-8fae-47a2-b282-e9e11852309c tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Request method failure captured: Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: request: PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa HTTP/1.1 Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 25 Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRKQEzQQbXDwM7U8tnANgMAi7ikkWYzHf8uMO3IPFzBYrkUHslFsIvsS1eXpzgNKw0YUET490cu1FHxLyWt1ZKG5r6Tedo8YB733iKzhUHecc4vvPEoLRpqdP5OsabsIBbIpNjjzNPNrUdOjlcCKT4j6xZb36g_7F0gUAWdSnXc4oQ Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 8052cf5858c84dcba5dca212d4b651aa Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-QuotasAdminNegativeTest-178957704 Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:37:00.837889 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:37:00.839128 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8052cf5858c84dcba5dca212d4b651aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8052cf5858c84dcba5dca212d4b651aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8052cf5858c84dcba5dca212d4b651aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8052cf5858c84dcba5dca212d4b651aa"}]}] Jul 28 03:37:00.839128 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-QuotasAdminNegativeTest-178957704 Jul 28 03:37:00.839128 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 8052cf5858c84dcba5dca212d4b651aa Jul 28 03:37:00.839128 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-178957704 Jul 28 03:37:00.839128 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-QuotasAdminNegativeTest-178957704-project Jul 28 03:37:00.839128 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:37:00.839128 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:37:00.839128 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d1416bee2d7d4060958ddde8279caed8 Jul 28 03:37:00.839128 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-QuotasAdminNegativeTest-178957704-project Jul 28 03:37:00.839128 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:37:00.839128 n-d-826756-3 devstack@n-api.service[126071]: {"quota_set": {"ram": 0}} Jul 28 03:37:00.839128 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:37:00.839128 n-d-826756-3 devstack@n-api.service[126071]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 28 03:37:00.839128 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8052cf5858c84dcba5dca212d4b651aa', 'body': {'quota_set': {'ram': 0}}} Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:37:00.839942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:00.841514 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:00.842816 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:00.842816 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:00.842816 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:37:00.842816 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:37:00.842816 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 28 03:37:00.842816 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:00.842816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c2b9efd-8fae-47a2-b282-e9e11852309c tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:37:00.848390 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c2b9efd-8fae-47a2-b282-e9e11852309c tempest-QuotasAdminNegativeTest-178957704 tempest-QuotasAdminNegativeTest-178957704-project] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa" status: 403 len: 116 microversion: 2.1 time: 0.038919 Jul 28 03:37:00.855260 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 213/405] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Jul 28 03:37:00 2022] PUT /compute/v2.1/os-quota-sets/8052cf5858c84dcba5dca212d4b651aa => generated 116 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:37:00.882969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-233fa798-80e0-489f-ad20-3e2a0f9dc537 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:00.887757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-233fa798-80e0-489f-ad20-3e2a0f9dc537 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:00.934439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-233fa798-80e0-489f-ad20-3e2a0f9dc537 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:00.937982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-233fa798-80e0-489f-ad20-3e2a0f9dc537 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:00.939122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-233fa798-80e0-489f-ad20-3e2a0f9dc537 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:00.941720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-233fa798-80e0-489f-ad20-3e2a0f9dc537 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:01.357254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-233fa798-80e0-489f-ad20-3e2a0f9dc537 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:01.377926 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-233fa798-80e0-489f-ad20-3e2a0f9dc537 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1302 microversion: 2.1 time: 0.519330 Jul 28 03:37:01.399459 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 214/406] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:00 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1302 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:01.416990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c42419ff-90d8-46b7-9148-93fb3fee5bad tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:01.419892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c42419ff-90d8-46b7-9148-93fb3fee5bad tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:01.433954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c42419ff-90d8-46b7-9148-93fb3fee5bad tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:01.436879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c42419ff-90d8-46b7-9148-93fb3fee5bad tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:01.438657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c42419ff-90d8-46b7-9148-93fb3fee5bad tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:01.441737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c42419ff-90d8-46b7-9148-93fb3fee5bad tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:01.493107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c42419ff-90d8-46b7-9148-93fb3fee5bad tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c42419ff-90d8-46b7-9148-93fb3fee5bad tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Request method failure captured: Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c/diagnostics HTTP/1.1 Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gQ9ucz_LqYyKBHI0m7BE5vSk7LlqXi3WruLAeri7lNBUmdAUeAM4gsyYIfwpNq3GTuRpGrSh8CsWOAWdD9hYXSVl4v_xmkjJCVMD8gTf89D85VzRwCmUBk8fyPTZmYtA4kH3UKh4r-EvDX3pMmOq-c4dNZMakh2uFwENGVXXkwXsvE Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f789a557bafc402e9033f2b73493669f Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1274402357 Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:37:01.504659 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:37:01.506008 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f789a557bafc402e9033f2b73493669f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f789a557bafc402e9033f2b73493669f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f789a557bafc402e9033f2b73493669f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f789a557bafc402e9033f2b73493669f"}]}] Jul 28 03:37:01.506008 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1274402357 Jul 28 03:37:01.506008 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f789a557bafc402e9033f2b73493669f Jul 28 03:37:01.506008 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1274402357 Jul 28 03:37:01.506008 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerDiagnosticsNegativeTest-1274402357-project Jul 28 03:37:01.506008 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:37:01.506008 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:37:01.506008 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: f4f10aaf7ad44ec696037ab9052bcbdd Jul 28 03:37:01.506008 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1274402357-project Jul 28 03:37:01.506008 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:37:01.506008 n-d-826756-3 devstack@n-api.service[126071]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': '4a6c0641-21b5-4a87-ac26-d9b74f116b0c'} Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:37:01.506662 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 28 03:37:01.507784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:01.511054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c42419ff-90d8-46b7-9148-93fb3fee5bad tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:37:01.512198 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c42419ff-90d8-46b7-9148-93fb3fee5bad tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.111313 Jul 28 03:37:01.513061 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 215/407] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:37:01 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c/diagnostics => generated 117 bytes in 113 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:37:01.523683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-39cdcfe2-adf1-4427-96ca-60ef21b8a463 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:01.586025 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-39cdcfe2-adf1-4427-96ca-60ef21b8a463 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.066004 Jul 28 03:37:01.592702 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 216/408] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:01 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:01.603091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b86638c6-e777-4917-8a43-3f95fe32e1e9 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:01.610081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b86638c6-e777-4917-8a43-3f95fe32e1e9 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:01.620094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b86638c6-e777-4917-8a43-3f95fe32e1e9 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:01.621969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b86638c6-e777-4917-8a43-3f95fe32e1e9 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:01.625552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b86638c6-e777-4917-8a43-3f95fe32e1e9 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:01.626130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b86638c6-e777-4917-8a43-3f95fe32e1e9 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:01.681445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b86638c6-e777-4917-8a43-3f95fe32e1e9 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:37:01.886759 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b86638c6-e777-4917-8a43-3f95fe32e1e9 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 204 len: 0 microversion: 2.1 time: 0.291041 Jul 28 03:37:01.887620 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 217/409] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:37:01 2022] DELETE /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:37:01.911919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-10c4a4bd-c209-48a3-9fa1-d6688c8089fa tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-504511647", "id": 381224759, "os-flavor-access:is_public": "True"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:01.926036 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:01.926036 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:01.981761 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-10c4a4bd-c209-48a3-9fa1-d6688c8089fa tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.085178 Jul 28 03:37:01.990014 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 218/410] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:37:01 2022] POST /compute/v2.1/flavors => generated 410 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:01.999690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-579ab7bf-d00d-4f1f-bf78-a24c94f87a69 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:02.001908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-579ab7bf-d00d-4f1f-bf78-a24c94f87a69 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:02.036382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-579ab7bf-d00d-4f1f-bf78-a24c94f87a69 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:02.039006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-579ab7bf-d00d-4f1f-bf78-a24c94f87a69 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:02.043145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-579ab7bf-d00d-4f1f-bf78-a24c94f87a69 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:02.051628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-579ab7bf-d00d-4f1f-bf78-a24c94f87a69 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:02.380708 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4c74afa1-4ff5-4006-b319-5489eeebee2f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:02.399681 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4c74afa1-4ff5-4006-b319-5489eeebee2f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1388 microversion: 2.1 time: 1.608721 Jul 28 03:37:02.400530 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 193/411] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:00 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1388 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:02.405948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-66485164-3fba-4332-8746-3c9d326ed3fe tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:02.413803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-66485164-3fba-4332-8746-3c9d326ed3fe tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:02.423611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66485164-3fba-4332-8746-3c9d326ed3fe tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:02.426302 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66485164-3fba-4332-8746-3c9d326ed3fe tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:02.427434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66485164-3fba-4332-8746-3c9d326ed3fe tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:02.430763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66485164-3fba-4332-8746-3c9d326ed3fe tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:02.439918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-579ab7bf-d00d-4f1f-bf78-a24c94f87a69 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:02.448705 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-579ab7bf-d00d-4f1f-bf78-a24c94f87a69 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1363 microversion: 2.1 time: 0.462043 Jul 28 03:37:02.449676 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 219/412] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:01 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1363 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:02.455526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-428ea63f-5238-4e42-89fe-be71ce74af80 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:02.480753 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-428ea63f-5238-4e42-89fe-be71ce74af80 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/381224759" status: 200 len: 410 microversion: 2.1 time: 0.029662 Jul 28 03:37:02.481423 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 220/413] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 03:37:02 2022] GET /compute/v2.1/flavors/381224759 => generated 410 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:02.488860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ab73d53f-6ffa-43b6-b1c6-ec83853e1004 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:02.489789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ab73d53f-6ffa-43b6-b1c6-ec83853e1004 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:02.498508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab73d53f-6ffa-43b6-b1c6-ec83853e1004 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:02.498963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab73d53f-6ffa-43b6-b1c6-ec83853e1004 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:02.499852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab73d53f-6ffa-43b6-b1c6-ec83853e1004 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:02.500298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab73d53f-6ffa-43b6-b1c6-ec83853e1004 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:02.662625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ab73d53f-6ffa-43b6-b1c6-ec83853e1004 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:02.683284 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ab73d53f-6ffa-43b6-b1c6-ec83853e1004 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1302 microversion: 2.1 time: 0.199791 Jul 28 03:37:02.683934 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 221/414] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:02 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1302 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:03.307464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3dd67b7c-29ad-40f2-a297-cef77634a5c9 tempest-FlavorsAdminTestJSON-1085444699 tempest-FlavorsAdminTestJSON-1085444699-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:03.390790 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3dd67b7c-29ad-40f2-a297-cef77634a5c9 tempest-FlavorsAdminTestJSON-1085444699 tempest-FlavorsAdminTestJSON-1085444699-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.705642 Jul 28 03:37:03.410363 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 222/415] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:02 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:03.423057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-89b20590-3634-48ca-baef-bfb47350152c tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:03.424621 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:03.424621 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:03.457923 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-89b20590-3634-48ca-baef-bfb47350152c tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/381224759" status: 202 len: 0 microversion: 2.1 time: 0.044908 Jul 28 03:37:03.466093 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 223/416] 10.222.0.48 () {58 vars in 1158 bytes} [Thu Jul 28 03:37:03 2022] DELETE /compute/v2.1/flavors/381224759 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:37:03.473464 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-66485164-3fba-4332-8746-3c9d326ed3fe tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:03.487549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e122c57-2780-4041-91c6-f4459127ad32 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:03.489895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4e122c57-2780-4041-91c6-f4459127ad32 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:03.504907 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-66485164-3fba-4332-8746-3c9d326ed3fe tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1479 microversion: 2.1 time: 1.102998 Jul 28 03:37:03.509451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e122c57-2780-4041-91c6-f4459127ad32 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:03.510247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e122c57-2780-4041-91c6-f4459127ad32 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:03.512613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e122c57-2780-4041-91c6-f4459127ad32 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:03.515017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e122c57-2780-4041-91c6-f4459127ad32 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:03.533224 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 194/417] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:02 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1479 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:03.557001 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-03946d23-8bc9-40f0-8d39-12da6d6774c8 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:03.621820 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-03946d23-8bc9-40f0-8d39-12da6d6774c8 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.086687 Jul 28 03:37:03.634578 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 195/418] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:03 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:03.649754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cb0135c4-7e8b-42fb-b0fe-af21c498401e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:03.650802 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cb0135c4-7e8b-42fb-b0fe-af21c498401e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:03.656072 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:03.678576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cb0135c4-7e8b-42fb-b0fe-af21c498401e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:03.679563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cb0135c4-7e8b-42fb-b0fe-af21c498401e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:03.681328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cb0135c4-7e8b-42fb-b0fe-af21c498401e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:03.682684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cb0135c4-7e8b-42fb-b0fe-af21c498401e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:04.918088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e122c57-2780-4041-91c6-f4459127ad32 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:04.922360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:04.944516 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e122c57-2780-4041-91c6-f4459127ad32 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1388 microversion: 2.1 time: 1.474299 Jul 28 03:37:04.959205 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 224/419] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:03 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1388 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:04.965866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-482e7501-fe6c-4e37-8585-556686d9f334 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-639514430", "id": 2110487727, "os-flavor-access:is_public": "False"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:04.969142 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:04.969142 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:05.023779 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-482e7501-fe6c-4e37-8585-556686d9f334 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.068501 Jul 28 03:37:05.024460 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 225/420] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:37:04 2022] POST /compute/v2.1/flavors => generated 429 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:05.061327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8229a611-f49a-488a-8ac1-8e7ebdc92f8a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:05.061936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8229a611-f49a-488a-8ac1-8e7ebdc92f8a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:05.078304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8229a611-f49a-488a-8ac1-8e7ebdc92f8a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:05.078757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8229a611-f49a-488a-8ac1-8e7ebdc92f8a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:05.079541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8229a611-f49a-488a-8ac1-8e7ebdc92f8a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:05.079975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8229a611-f49a-488a-8ac1-8e7ebdc92f8a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:05.589892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cb0135c4-7e8b-42fb-b0fe-af21c498401e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:05.605204 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cb0135c4-7e8b-42fb-b0fe-af21c498401e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1363 microversion: 2.1 time: 1.969077 Jul 28 03:37:05.620751 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 196/421] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:03 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1363 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:05.637379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-09e38ff3-d5ca-4958-a01a-77bab5e59bc7 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:05.641863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-09e38ff3-d5ca-4958-a01a-77bab5e59bc7 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:05.678633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09e38ff3-d5ca-4958-a01a-77bab5e59bc7 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:05.679076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09e38ff3-d5ca-4958-a01a-77bab5e59bc7 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:05.679864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09e38ff3-d5ca-4958-a01a-77bab5e59bc7 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:05.680309 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09e38ff3-d5ca-4958-a01a-77bab5e59bc7 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:05.767647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8229a611-f49a-488a-8ac1-8e7ebdc92f8a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:05.783654 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8229a611-f49a-488a-8ac1-8e7ebdc92f8a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1369 microversion: 2.1 time: 0.742829 Jul 28 03:37:05.787679 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 226/422] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:05 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1369 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:05.812131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-45e261b7-f78e-4242-a7e9-aca99dd78d25 tempest-FlavorsAdminTestJSON-1085444699 tempest-FlavorsAdminTestJSON-1085444699-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "2110487727"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:05.849031 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-45e261b7-f78e-4242-a7e9-aca99dd78d25 tempest-FlavorsAdminTestJSON-1085444699 tempest-FlavorsAdminTestJSON-1085444699-project] HTTP exception thrown: Flavor 2110487727 could not be found. Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-45e261b7-f78e-4242-a7e9-aca99dd78d25 tempest-FlavorsAdminTestJSON-1085444699 tempest-FlavorsAdminTestJSON-1085444699-project] Request method failure captured: Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 107 Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRSo40epDvT25FcaSmB6Gq-QWg_QXQuWBzG0h8Kes6lpbuLC4mJIim_sg1x-YsbDFInjBo5xcNeRUuVBER78gWP6XtMLOIlBot8XP_5EpPgUNWtpgTuUVmdsxHjmF6sxfGYa9ZjNmyLPnWn1E-iV4jAvhu0VsCa0ECJ1zNqm5GeA58 Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 6f355d1f9f8c45f993649484ee7f2395 Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FlavorsAdminTestJSON-1085444699 Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:37:05.859791 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:37:05.862067 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6f355d1f9f8c45f993649484ee7f2395"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f355d1f9f8c45f993649484ee7f2395"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6f355d1f9f8c45f993649484ee7f2395"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6f355d1f9f8c45f993649484ee7f2395"}]}] Jul 28 03:37:05.862067 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FlavorsAdminTestJSON-1085444699 Jul 28 03:37:05.862067 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 6f355d1f9f8c45f993649484ee7f2395 Jul 28 03:37:05.862067 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1085444699 Jul 28 03:37:05.862067 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FlavorsAdminTestJSON-1085444699-project Jul 28 03:37:05.862067 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:37:05.862067 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:37:05.862067 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 3b2f78ed5d304488a7bae82afd776f00 Jul 28 03:37:05.862067 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FlavorsAdminTestJSON-1085444699-project Jul 28 03:37:05.862067 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:37:05.862067 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "test", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "2110487727"}} Jul 28 03:37:05.862067 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:37:05.862067 n-d-826756-3 devstack@n-api.service[126071]: exception: Flavor 2110487727 could not be found. Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '2110487727'}}} Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2110487727 could not be found. Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:05.863279 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2110487727 could not be found. Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:05.864903 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:05.866677 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:05.866677 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:37:05.866677 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:37:05.866677 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2110487727 could not be found. Jul 28 03:37:05.866677 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:05.866677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-45e261b7-f78e-4242-a7e9-aca99dd78d25 tempest-FlavorsAdminTestJSON-1085444699 tempest-FlavorsAdminTestJSON-1085444699-project] Returning 400 to user: Flavor 2110487727 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:37:05.866677 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-45e261b7-f78e-4242-a7e9-aca99dd78d25 tempest-FlavorsAdminTestJSON-1085444699 tempest-FlavorsAdminTestJSON-1085444699-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.070510 Jul 28 03:37:05.866677 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 227/423] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:37:05 2022] POST /compute/v2.1/servers => generated 81 bytes in 74 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:05.871085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c2ded8fb-5307-4125-8ad2-755cd629fe47 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:05.878151 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:05.878151 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:05.912036 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c2ded8fb-5307-4125-8ad2-755cd629fe47 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/2110487727" status: 202 len: 0 microversion: 2.1 time: 0.044619 Jul 28 03:37:05.913093 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 228/424] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:37:05 2022] DELETE /compute/v2.1/flavors/2110487727 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:37:05.922093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a5de97d-7752-4471-b7eb-87a86ca52dee tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:05.982238 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7a5de97d-7752-4471-b7eb-87a86ca52dee tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.063185 Jul 28 03:37:05.983851 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 229/425] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:05 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:05.989502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f542e4bc-ee75-4e1d-aad3-5bd99a57183a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:05.990423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f542e4bc-ee75-4e1d-aad3-5bd99a57183a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:06.011485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f542e4bc-ee75-4e1d-aad3-5bd99a57183a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:06.013613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f542e4bc-ee75-4e1d-aad3-5bd99a57183a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:06.015441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f542e4bc-ee75-4e1d-aad3-5bd99a57183a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:06.016256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f542e4bc-ee75-4e1d-aad3-5bd99a57183a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:06.766703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-09e38ff3-d5ca-4958-a01a-77bab5e59bc7 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:06.789593 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-09e38ff3-d5ca-4958-a01a-77bab5e59bc7 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1479 microversion: 2.1 time: 1.166106 Jul 28 03:37:06.793035 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 197/426] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:05 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1479 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:06.827357 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ae273839-3a66-45c8-a649-d789cb4b2c33 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-179030160", "id": 1551884083, "os-flavor-access:is_public": "False"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:06.850038 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:06.850038 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:37:06.894729 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ae273839-3a66-45c8-a649-d789cb4b2c33 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.082371 Jul 28 03:37:06.897360 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 198/427] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:37:06 2022] POST /compute/v2.1/flavors => generated 414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:06.911719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-489bd672-0389-4fbe-8aaa-2481fa7380db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:06.918136 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-489bd672-0389-4fbe-8aaa-2481fa7380db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:06.923629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f542e4bc-ee75-4e1d-aad3-5bd99a57183a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:06.938993 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f542e4bc-ee75-4e1d-aad3-5bd99a57183a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1388 microversion: 2.1 time: 0.953453 Jul 28 03:37:06.956731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-489bd672-0389-4fbe-8aaa-2481fa7380db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:06.957113 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 230/428] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:05 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1388 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:06.958116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-489bd672-0389-4fbe-8aaa-2481fa7380db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:06.959330 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-489bd672-0389-4fbe-8aaa-2481fa7380db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:06.963026 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-489bd672-0389-4fbe-8aaa-2481fa7380db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:06.968582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a3bd11c-f51e-4dab-8520-267661a00825 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:06.969750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7a3bd11c-f51e-4dab-8520-267661a00825 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:06.986535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a3bd11c-f51e-4dab-8520-267661a00825 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:06.989603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a3bd11c-f51e-4dab-8520-267661a00825 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:06.990871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a3bd11c-f51e-4dab-8520-267661a00825 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:06.991841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a3bd11c-f51e-4dab-8520-267661a00825 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:07.429102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a3bd11c-f51e-4dab-8520-267661a00825 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:07.443728 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7a3bd11c-f51e-4dab-8520-267661a00825 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1369 microversion: 2.1 time: 0.485298 Jul 28 03:37:07.448647 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 231/429] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:06 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1369 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:07.462270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3c130859-c7e0-4050-8ec7-ed42163a78bc tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-760794471", "id": 2027644487, "os-flavor-access:is_public": "True"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:07.492269 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:07.492269 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:07.559642 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3c130859-c7e0-4050-8ec7-ed42163a78bc tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.105618 Jul 28 03:37:07.561113 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 232/430] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:37:07 2022] POST /compute/v2.1/flavors => generated 413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:07.572298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-28337b8e-acdf-438d-ad09-21f659c3813d req-a251059e-67f5-4259-922f-6a308d545f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d67752-6c63-4b60-9306-007519a62c9d", "tag": "01a26c26-198c-4922-8c18-94f221ad8f7d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:07.594334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:DELETE=10,nova_api:SELECT=83,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:07.605706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-28337b8e-acdf-438d-ad09-21f659c3813d req-a251059e-67f5-4259-922f-6a308d545f47 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:07.607896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-28337b8e-acdf-438d-ad09-21f659c3813d req-a251059e-67f5-4259-922f-6a308d545f47 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:07.638575 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-28337b8e-acdf-438d-ad09-21f659c3813d req-a251059e-67f5-4259-922f-6a308d545f47 service nova] Creating event network-changed:01a26c26-198c-4922-8c18-94f221ad8f7d for instance 40d67752-6c63-4b60-9306-007519a62c9d on n-h1-826756-3 Jul 28 03:37:07.650424 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-28337b8e-acdf-438d-ad09-21f659c3813d req-a251059e-67f5-4259-922f-6a308d545f47 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087856 Jul 28 03:37:07.651209 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 233/431] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:07.656054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9f330834-9a8b-496a-933c-038c0a30a6e6 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:07.704875 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9f330834-9a8b-496a-933c-038c0a30a6e6 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.052382 Jul 28 03:37:07.714581 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 234/432] 10.222.0.48 () {58 vars in 1169 bytes} [Thu Jul 28 03:37:07 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:07.719361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a312b04d-036b-4e7f-b79c-3e8e1323e0f4 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:07.761954 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a312b04d-036b-4e7f-b79c-3e8e1323e0f4 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.044677 Jul 28 03:37:07.765651 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 235/433] 10.222.0.48 () {58 vars in 1177 bytes} [Thu Jul 28 03:37:07 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:07.778489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bfd11741-feec-4792-ac9f-0bc6dd41604b tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:07.804842 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bfd11741-feec-4792-ac9f-0bc6dd41604b tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.031477 Jul 28 03:37:07.815143 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 236/434] 10.222.0.48 () {58 vars in 1171 bytes} [Thu Jul 28 03:37:07 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:37:07.820279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9134703-3893-43ea-8c13-e7ea93db27ce tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:07.822473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9134703-3893-43ea-8c13-e7ea93db27ce tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:07.838733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9134703-3893-43ea-8c13-e7ea93db27ce tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:07.863430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9134703-3893-43ea-8c13-e7ea93db27ce tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:07.864615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9134703-3893-43ea-8c13-e7ea93db27ce tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:07.865254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9134703-3893-43ea-8c13-e7ea93db27ce tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:08.127699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b9134703-3893-43ea-8c13-e7ea93db27ce tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:08.146756 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9134703-3893-43ea-8c13-e7ea93db27ce tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1479 microversion: 2.1 time: 0.329997 Jul 28 03:37:08.163705 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 237/435] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:07 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1479 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:08.179491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4bcfbafb-7efb-4598-b9b1-70e31efc7d57 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:08.203831 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4bcfbafb-7efb-4598-b9b1-70e31efc7d57 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.038159 Jul 28 03:37:08.207523 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 238/436] 10.222.0.48 () {58 vars in 1169 bytes} [Thu Jul 28 03:37:08 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:08.221368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d26983e2-8d0b-40fc-8fb0-7686895b2877 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:08.221908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d26983e2-8d0b-40fc-8fb0-7686895b2877 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:08.240409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d26983e2-8d0b-40fc-8fb0-7686895b2877 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:08.241283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d26983e2-8d0b-40fc-8fb0-7686895b2877 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:08.242298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d26983e2-8d0b-40fc-8fb0-7686895b2877 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:08.244714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d26983e2-8d0b-40fc-8fb0-7686895b2877 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:08.438027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-489bd672-0389-4fbe-8aaa-2481fa7380db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:08.459199 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-489bd672-0389-4fbe-8aaa-2481fa7380db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1363 microversion: 2.1 time: 1.557365 Jul 28 03:37:08.462226 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 199/437] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:06 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1363 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:08.481532 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5d55f2eb-a5ce-4712-9f7e-10a79bce688c tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:08.551261 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5d55f2eb-a5ce-4712-9f7e-10a79bce688c tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6220 microversion: 2.1 time: 0.087968 Jul 28 03:37:08.552804 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 200/438] 10.222.0.48 () {58 vars in 1169 bytes} [Thu Jul 28 03:37:08 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:08.559017 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fa3a1bd8-117a-4fbe-bc2a-e3f1288399dc tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:08.561029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fa3a1bd8-117a-4fbe-bc2a-e3f1288399dc tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:08.571254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa3a1bd8-117a-4fbe-bc2a-e3f1288399dc tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:08.573796 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa3a1bd8-117a-4fbe-bc2a-e3f1288399dc tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:08.575750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa3a1bd8-117a-4fbe-bc2a-e3f1288399dc tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:08.577174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa3a1bd8-117a-4fbe-bc2a-e3f1288399dc tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:08.670412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d26983e2-8d0b-40fc-8fb0-7686895b2877 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:08.671333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=12 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:08.682395 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d26983e2-8d0b-40fc-8fb0-7686895b2877 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1388 microversion: 2.1 time: 0.473729 Jul 28 03:37:08.687327 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 239/439] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:08 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1388 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:08.691810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d1bd6da-0a36-4474-84cd-7aae94ea82e4 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:08.742165 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d1bd6da-0a36-4474-84cd-7aae94ea82e4 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6220 microversion: 2.1 time: 0.053596 Jul 28 03:37:08.742604 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 240/440] 10.222.0.48 () {58 vars in 1175 bytes} [Thu Jul 28 03:37:08 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6220 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:08.765244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b731092-697b-4914-bbb7-7a79f40bfa71 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:08.813208 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5b731092-697b-4914-bbb7-7a79f40bfa71 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6220 microversion: 2.1 time: 0.051713 Jul 28 03:37:08.824383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=52 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:08.827039 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 241/441] 10.222.0.48 () {58 vars in 1173 bytes} [Thu Jul 28 03:37:08 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6220 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:08.847971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e3782a6e-ce1c-4a6a-8edb-3805f2c32f47 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:08.932614 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e3782a6e-ce1c-4a6a-8edb-3805f2c32f47 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6220 microversion: 2.1 time: 0.088388 Jul 28 03:37:08.938825 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 242/442] 10.222.0.48 () {58 vars in 1169 bytes} [Thu Jul 28 03:37:08 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:08.952932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2e990332-ffd3-4e65-a7e7-66c544666413 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:08.957914 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:08.957914 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:09.022022 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2e990332-ffd3-4e65-a7e7-66c544666413 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/2027644487" status: 202 len: 0 microversion: 2.1 time: 0.074051 Jul 28 03:37:09.025006 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 243/443] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:37:08 2022] DELETE /compute/v2.1/flavors/2027644487 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:37:09.037647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-173eaf9b-d673-41e0-88c1-5dcdc7a92f0d tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:09.118031 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-173eaf9b-d673-41e0-88c1-5dcdc7a92f0d tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.089605 Jul 28 03:37:09.126580 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 244/444] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:09 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:09.140414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-781771e3-a464-4361-a9b8-27727939e51c tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:09.216807 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-781771e3-a464-4361-a9b8-27727939e51c tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1551884083" status: 202 len: 0 microversion: 2.1 time: 0.082067 Jul 28 03:37:09.219968 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 245/445] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:37:09 2022] DELETE /compute/v2.1/flavors/1551884083 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:37:09.251207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-763a8aa4-fca9-4184-9035-dcd181dd5d38 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:09.251867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-763a8aa4-fca9-4184-9035-dcd181dd5d38 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:09.285467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-763a8aa4-fca9-4184-9035-dcd181dd5d38 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:09.288427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-763a8aa4-fca9-4184-9035-dcd181dd5d38 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:09.290381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-763a8aa4-fca9-4184-9035-dcd181dd5d38 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:09.290996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-763a8aa4-fca9-4184-9035-dcd181dd5d38 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:09.435296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-763a8aa4-fca9-4184-9035-dcd181dd5d38 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:09.463587 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-763a8aa4-fca9-4184-9035-dcd181dd5d38 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1437 microversion: 2.1 time: 0.234779 Jul 28 03:37:09.491257 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 246/446] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:09 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1437 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:09.503519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4c8cb12-0b89-41b3-b18f-2f893d2c8b5d tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:09.588165 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4c8cb12-0b89-41b3-b18f-2f893d2c8b5d tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.105989 Jul 28 03:37:09.606598 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 247/447] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:09 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:09.632684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-377f0231-d141-4e6e-8138-b702b36c331e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:09.634803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-377f0231-d141-4e6e-8138-b702b36c331e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:09.664519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-377f0231-d141-4e6e-8138-b702b36c331e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:09.666059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-377f0231-d141-4e6e-8138-b702b36c331e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:09.672722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-377f0231-d141-4e6e-8138-b702b36c331e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:09.676005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-377f0231-d141-4e6e-8138-b702b36c331e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:09.697536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:09.846181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=41 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:09.945497 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fa3a1bd8-117a-4fbe-bc2a-e3f1288399dc tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:09.963480 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fa3a1bd8-117a-4fbe-bc2a-e3f1288399dc tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1369 microversion: 2.1 time: 1.408575 Jul 28 03:37:09.964557 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 201/448] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:08 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1369 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:09.975892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0dc136ff-72d5-47a2-9266-3ad0ef43df0e tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1132067980", "id": 1483932263, "os-flavor-access:is_public": "False"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:09.980591 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:09.980591 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:37:10.010499 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0dc136ff-72d5-47a2-9266-3ad0ef43df0e tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.044525 Jul 28 03:37:10.011566 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 202/449] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:37:09 2022] POST /compute/v2.1/flavors => generated 415 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:10.023665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a63f5d2e-b35e-4766-9b51-6c30fba075bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:10.025470 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a63f5d2e-b35e-4766-9b51-6c30fba075bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:10.041956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a63f5d2e-b35e-4766-9b51-6c30fba075bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:10.042691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a63f5d2e-b35e-4766-9b51-6c30fba075bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:10.047094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a63f5d2e-b35e-4766-9b51-6c30fba075bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:10.048977 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a63f5d2e-b35e-4766-9b51-6c30fba075bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:10.359474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-377f0231-d141-4e6e-8138-b702b36c331e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:10.378411 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-377f0231-d141-4e6e-8138-b702b36c331e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1363 microversion: 2.1 time: 0.770078 Jul 28 03:37:10.420748 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 248/450] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:09 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1363 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:10.427415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-32cc25ff-7c5e-444d-8962-49d332fa2a68 req-217531f1-c07c-4d53-a8ae-5ff71510d8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a6c0641-21b5-4a87-ac26-d9b74f116b0c", "name": "network-vif-deleted", "tag": "1dd75d2b-9387-419a-a9a5-65ee8be3d026"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:10.481998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-32cc25ff-7c5e-444d-8962-49d332fa2a68 req-217531f1-c07c-4d53-a8ae-5ff71510d8fe service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:10.482443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-32cc25ff-7c5e-444d-8962-49d332fa2a68 req-217531f1-c07c-4d53-a8ae-5ff71510d8fe service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:10.534001 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-32cc25ff-7c5e-444d-8962-49d332fa2a68 req-217531f1-c07c-4d53-a8ae-5ff71510d8fe service nova] Creating event network-vif-deleted:1dd75d2b-9387-419a-a9a5-65ee8be3d026 for instance 4a6c0641-21b5-4a87-ac26-d9b74f116b0c on n-h1-826756-3 Jul 28 03:37:10.551351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a63f5d2e-b35e-4766-9b51-6c30fba075bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:10.559210 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-32cc25ff-7c5e-444d-8962-49d332fa2a68 req-217531f1-c07c-4d53-a8ae-5ff71510d8fe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137040 Jul 28 03:37:10.559827 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 249/451] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:10.565081 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a63f5d2e-b35e-4766-9b51-6c30fba075bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1388 microversion: 2.1 time: 0.549279 Jul 28 03:37:10.568029 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 203/452] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:10 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1388 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:10.578883 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c0e4833b-2771-4b50-84bc-f1d542ec5335 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:10.581919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c0e4833b-2771-4b50-84bc-f1d542ec5335 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:10.598023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a85fff4-ee21-45e6-8244-f73911ead5f5 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:10.598468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0e4833b-2771-4b50-84bc-f1d542ec5335 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:10.599166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0e4833b-2771-4b50-84bc-f1d542ec5335 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:10.600165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0e4833b-2771-4b50-84bc-f1d542ec5335 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:10.604324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0e4833b-2771-4b50-84bc-f1d542ec5335 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:10.647585 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a85fff4-ee21-45e6-8244-f73911ead5f5 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.086307 Jul 28 03:37:10.669410 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 250/453] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:10 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:10.686630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f36c63d5-fe0b-4105-a7a8-c67a9b798261 req-e9071088-4cb6-4912-97dc-4aa74c1a5ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4b8ffa-dbe6-4e90-a8f5-728addf73aae", "name": "network-vif-plugged", "status": "completed", "tag": "3931df07-76f1-4feb-a179-d48d42b61b21"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:10.696491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0e4833b-2771-4b50-84bc-f1d542ec5335 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:10.696960 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0e4833b-2771-4b50-84bc-f1d542ec5335 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:10.697426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-c0e4833b-2771-4b50-84bc-f1d542ec5335 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lazy-loading 'fault' on Instance uuid 4a6c0641-21b5-4a87-ac26-d9b74f116b0c {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:37:10.715735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f36c63d5-fe0b-4105-a7a8-c67a9b798261 req-e9071088-4cb6-4912-97dc-4aa74c1a5ae1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:10.716178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f36c63d5-fe0b-4105-a7a8-c67a9b798261 req-e9071088-4cb6-4912-97dc-4aa74c1a5ae1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:10.758192 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f36c63d5-fe0b-4105-a7a8-c67a9b798261 req-e9071088-4cb6-4912-97dc-4aa74c1a5ae1 service nova] Creating event network-vif-plugged:3931df07-76f1-4feb-a179-d48d42b61b21 for instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae on n-h2-826756-3 Jul 28 03:37:10.777448 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f36c63d5-fe0b-4105-a7a8-c67a9b798261 req-e9071088-4cb6-4912-97dc-4aa74c1a5ae1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106597 Jul 28 03:37:10.778054 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 251/454] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:10.788096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b1d4ce1-bea1-462d-8e43-6526de9ab554 tempest-FlavorsAdminTestJSON-1085444699 tempest-FlavorsAdminTestJSON-1085444699-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:10.846234 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b1d4ce1-bea1-462d-8e43-6526de9ab554 tempest-FlavorsAdminTestJSON-1085444699 tempest-FlavorsAdminTestJSON-1085444699-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.061726 Jul 28 03:37:10.847103 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 252/455] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:10 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:10.868079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80e2399d-d11d-48d8-a2f4-4e31d8ec2459 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:10.868995 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:10.868995 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:10.899809 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-80e2399d-d11d-48d8-a2f4-4e31d8ec2459 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1483932263" status: 202 len: 0 microversion: 2.1 time: 0.035567 Jul 28 03:37:10.900277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c0e4833b-2771-4b50-84bc-f1d542ec5335 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4f10aaf7ad44ec696037ab9052bcbdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f789a557bafc402e9033f2b73493669f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:10.900814 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 253/456] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:37:10 2022] DELETE /compute/v2.1/flavors/1483932263 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:37:10.912695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-363eb066-8b4f-4e2f-8a50-55a851e13373 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:10.917534 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c0e4833b-2771-4b50-84bc-f1d542ec5335 tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 200 len: 1313 microversion: 2.1 time: 0.347878 Jul 28 03:37:10.938566 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 204/457] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:10 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:10.971253 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-363eb066-8b4f-4e2f-8a50-55a851e13373 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.063839 Jul 28 03:37:10.978121 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 254/458] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:10 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:10.988836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4b8b367a-bc8b-4262-aa24-4e3e042e4460 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:10.990103 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4b8b367a-bc8b-4262-aa24-4e3e042e4460 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:10.999635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dbb30dc0-fee3-4797-b1e3-8e98ae9ff74b tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1945354353", "id": 568327138, "os-flavor-access:is_public": "True"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:11.003138 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:11.003138 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:11.021492 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b8b367a-bc8b-4262-aa24-4e3e042e4460 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:11.027701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b8b367a-bc8b-4262-aa24-4e3e042e4460 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:11.027701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b8b367a-bc8b-4262-aa24-4e3e042e4460 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:11.027701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b8b367a-bc8b-4262-aa24-4e3e042e4460 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:11.063426 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dbb30dc0-fee3-4797-b1e3-8e98ae9ff74b tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.067722 Jul 28 03:37:11.065985 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 255/459] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:37:10 2022] POST /compute/v2.1/flavors => generated 411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:37:11.078789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8b47c067-91a4-4267-b7f9-c7a38b6a0235 tempest-FlavorsAdminTestJSON-1085444699 tempest-FlavorsAdminTestJSON-1085444699-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:11.181963 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8b47c067-91a4-4267-b7f9-c7a38b6a0235 tempest-FlavorsAdminTestJSON-1085444699 tempest-FlavorsAdminTestJSON-1085444699-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.078549 Jul 28 03:37:11.185016 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 256/460] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:11 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:11.210772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d03a4d2a-dc5d-4a9a-a27b-77488a152ce8 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:11.282278 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d03a4d2a-dc5d-4a9a-a27b-77488a152ce8 tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/568327138" status: 202 len: 0 microversion: 2.1 time: 0.075369 Jul 28 03:37:11.283163 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 257/461] 10.222.0.48 () {58 vars in 1158 bytes} [Thu Jul 28 03:37:11 2022] DELETE /compute/v2.1/flavors/568327138 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:37:11.291779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca31e856-348e-4498-841d-3013c3b11b1a tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:11.361249 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca31e856-348e-4498-841d-3013c3b11b1a tempest-FlavorsAdminTestJSON-725559522 tempest-FlavorsAdminTestJSON-725559522-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.073252 Jul 28 03:37:11.362036 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 258/462] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:11 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:11.411679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0b6d3b84-5277-4167-a4b5-3d3635a2b419 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:11.412508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0b6d3b84-5277-4167-a4b5-3d3635a2b419 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:11.423257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b6d3b84-5277-4167-a4b5-3d3635a2b419 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:11.424633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b6d3b84-5277-4167-a4b5-3d3635a2b419 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:11.428063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b6d3b84-5277-4167-a4b5-3d3635a2b419 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:11.432331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b6d3b84-5277-4167-a4b5-3d3635a2b419 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:12.312160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0b6d3b84-5277-4167-a4b5-3d3635a2b419 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:12.329884 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0b6d3b84-5277-4167-a4b5-3d3635a2b419 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1363 microversion: 2.1 time: 0.917445 Jul 28 03:37:12.333533 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 259/463] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:11 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1363 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:12.361205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9795463-063c-4c05-9f6a-6b726e28e94b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:12.367714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9795463-063c-4c05-9f6a-6b726e28e94b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:12.402768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9795463-063c-4c05-9f6a-6b726e28e94b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:12.411280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9795463-063c-4c05-9f6a-6b726e28e94b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:12.414184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9795463-063c-4c05-9f6a-6b726e28e94b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:12.414723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9795463-063c-4c05-9f6a-6b726e28e94b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:12.846146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b9795463-063c-4c05-9f6a-6b726e28e94b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:12.858572 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9795463-063c-4c05-9f6a-6b726e28e94b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1388 microversion: 2.1 time: 0.522930 Jul 28 03:37:12.866669 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 260/464] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:12 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1388 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:12.885554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e5bf5902-028a-48c4-a170-5430f233e4fc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:12.886747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e5bf5902-028a-48c4-a170-5430f233e4fc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] [instance: 4a6c0641-21b5-4a87-ac26-d9b74f116b0c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:12.907277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5bf5902-028a-48c4-a170-5430f233e4fc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:12.908235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5bf5902-028a-48c4-a170-5430f233e4fc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:12.910875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5bf5902-028a-48c4-a170-5430f233e4fc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:12.913698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5bf5902-028a-48c4-a170-5430f233e4fc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:12.964772 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e5bf5902-028a-48c4-a170-5430f233e4fc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] HTTP exception thrown: Instance 4a6c0641-21b5-4a87-ac26-d9b74f116b0c could not be found. Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e5bf5902-028a-48c4-a170-5430f233e4fc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Request method failure captured: Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c HTTP/1.1 Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gQ9ucz_LqYyKBHI0m7BE5vSk7LlqXi3WruLAeri7lNBUmdAUeAM4gsyYIfwpNq3GTuRpGrSh8CsWOAWdD9hYXSVl4v_xmkjJCVMD8gTf89D85VzRwCmUBk8fyPTZmYtA4kH3UKh4r-EvDX3pMmOq-c4dNZMakh2uFwENGVXXkwXsvE Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f789a557bafc402e9033f2b73493669f Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1274402357 Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:37:12.969091 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:37:12.971090 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f789a557bafc402e9033f2b73493669f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f789a557bafc402e9033f2b73493669f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f789a557bafc402e9033f2b73493669f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f789a557bafc402e9033f2b73493669f"}]}] Jul 28 03:37:12.971090 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1274402357 Jul 28 03:37:12.971090 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f789a557bafc402e9033f2b73493669f Jul 28 03:37:12.971090 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1274402357 Jul 28 03:37:12.971090 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerDiagnosticsNegativeTest-1274402357-project Jul 28 03:37:12.971090 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:37:12.971090 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:37:12.971090 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: f4f10aaf7ad44ec696037ab9052bcbdd Jul 28 03:37:12.971090 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1274402357-project Jul 28 03:37:12.971090 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:37:12.971090 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 4a6c0641-21b5-4a87-ac26-d9b74f116b0c could not be found. Jul 28 03:37:12.971090 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '4a6c0641-21b5-4a87-ac26-d9b74f116b0c'} Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6c0641-21b5-4a87-ac26-d9b74f116b0c could not be found. Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:37:12.971979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6c0641-21b5-4a87-ac26-d9b74f116b0c could not be found. Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6c0641-21b5-4a87-ac26-d9b74f116b0c could not be found. Jul 28 03:37:12.974858 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:37:12.979055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e5bf5902-028a-48c4-a170-5430f233e4fc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] Returning 404 to user: Instance 4a6c0641-21b5-4a87-ac26-d9b74f116b0c could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:37:12.980908 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e5bf5902-028a-48c4-a170-5430f233e4fc tempest-ServerDiagnosticsNegativeTest-1274402357 tempest-ServerDiagnosticsNegativeTest-1274402357-project] 10.222.0.48 "GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c" status: 404 len: 111 microversion: 2.1 time: 0.112246 Jul 28 03:37:12.984448 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 261/465] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:12 2022] GET /compute/v2.1/servers/4a6c0641-21b5-4a87-ac26-d9b74f116b0c => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:37:12.997718 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4b8b367a-bc8b-4262-aa24-4e3e042e4460 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:13.024129 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4b8b367a-bc8b-4262-aa24-4e3e042e4460 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1369 microversion: 2.1 time: 2.039912 Jul 28 03:37:13.025662 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 205/466] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:10 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1369 bytes in 2042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:13.385122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-442857d9-9f89-4047-93e0-8ed475cb149b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:13.387106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-208037326", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": "none"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:13.389317 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-442857d9-9f89-4047-93e0-8ed475cb149b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:13.447695 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-442857d9-9f89-4047-93e0-8ed475cb149b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:13.449163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-442857d9-9f89-4047-93e0-8ed475cb149b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:13.453133 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-442857d9-9f89-4047-93e0-8ed475cb149b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:13.454106 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-442857d9-9f89-4047-93e0-8ed475cb149b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:13.563437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:37:13.565126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:37:13.567804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:37:13.570652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:37:13.571304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:37:13.597100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:13.603665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:13.607277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:13.608906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:13.671865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Getting quotas for project d029d41ae3df4c5dbf023c61c23ccdef. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:37:13.684772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Getting quotas for user bf4d1f2094c34a2e9de52f67e41bc313 and project d029d41ae3df4c5dbf023c61c23ccdef. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:37:13.712738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:37:13.716026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:37:13.841409 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7fc159fc-c474-4a6d-af6b-34bb0aab9042 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.858199 Jul 28 03:37:13.850816 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 262/467] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:37:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:37:13.873693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e3f83ea-705a-4a5a-8fe4-fc2027d9f2cf tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:13.906643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e3f83ea-705a-4a5a-8fe4-fc2027d9f2cf tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:13.976210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=12,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:14.611904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e3f83ea-705a-4a5a-8fe4-fc2027d9f2cf tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:14.623551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e3f83ea-705a-4a5a-8fe4-fc2027d9f2cf tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:14.637425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e3f83ea-705a-4a5a-8fe4-fc2027d9f2cf tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:14.666919 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e3f83ea-705a-4a5a-8fe4-fc2027d9f2cf tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "PUT /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1358 microversion: 2.75 time: 0.811310 Jul 28 03:37:14.669649 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 263/468] 10.222.0.48 () {62 vars in 1297 bytes} [Thu Jul 28 03:37:13 2022] PUT /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1358 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:14.674272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-442857d9-9f89-4047-93e0-8ed475cb149b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:14.683673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-96e517e8-d191-4e51-886e-6ba221c0f368 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:14.684314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-96e517e8-d191-4e51-886e-6ba221c0f368 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:14.686525 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-442857d9-9f89-4047-93e0-8ed475cb149b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1363 microversion: 2.1 time: 1.330933 Jul 28 03:37:14.688101 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 206/469] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:13 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1363 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:14.703716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96e517e8-d191-4e51-886e-6ba221c0f368 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:14.704591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96e517e8-d191-4e51-886e-6ba221c0f368 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:14.707020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96e517e8-d191-4e51-886e-6ba221c0f368 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:14.708845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96e517e8-d191-4e51-886e-6ba221c0f368 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:14.710389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3807d084-5c94-4be3-97f2-c068d4cb198a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:14.711293 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3807d084-5c94-4be3-97f2-c068d4cb198a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:14.741276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3807d084-5c94-4be3-97f2-c068d4cb198a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:14.747262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3807d084-5c94-4be3-97f2-c068d4cb198a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:14.748305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3807d084-5c94-4be3-97f2-c068d4cb198a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:14.750111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3807d084-5c94-4be3-97f2-c068d4cb198a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:15.131481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-96e517e8-d191-4e51-886e-6ba221c0f368 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:15.160469 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-96e517e8-d191-4e51-886e-6ba221c0f368 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1388 microversion: 2.1 time: 0.468745 Jul 28 03:37:15.162293 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 264/470] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:14 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1388 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:15.179902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-ace8382e-afd0-439a-9596-b1fc8e7a4987 req-95b1fad9-d4e3-4d23-b45f-bad8db88bf27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8280d682-4608-420d-8bee-48984a6c1a01", "tag": "fd5a933b-cfed-47cd-bae0-70c895f135ea"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:15.229279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ace8382e-afd0-439a-9596-b1fc8e7a4987 req-95b1fad9-d4e3-4d23-b45f-bad8db88bf27 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:15.229872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ace8382e-afd0-439a-9596-b1fc8e7a4987 req-95b1fad9-d4e3-4d23-b45f-bad8db88bf27 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:15.254388 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-ace8382e-afd0-439a-9596-b1fc8e7a4987 req-95b1fad9-d4e3-4d23-b45f-bad8db88bf27 service nova] Creating event network-changed:fd5a933b-cfed-47cd-bae0-70c895f135ea for instance 8280d682-4608-420d-8bee-48984a6c1a01 on n-h2-826756-3 Jul 28 03:37:15.268889 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-ace8382e-afd0-439a-9596-b1fc8e7a4987 req-95b1fad9-d4e3-4d23-b45f-bad8db88bf27 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105010 Jul 28 03:37:15.272954 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 265/471] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:15.281582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2e7e7f52-46bb-4f64-a045-89634c9d85f6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:15.286609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2e7e7f52-46bb-4f64-a045-89634c9d85f6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:15.302235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e7e7f52-46bb-4f64-a045-89634c9d85f6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:15.302910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e7e7f52-46bb-4f64-a045-89634c9d85f6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:15.303780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e7e7f52-46bb-4f64-a045-89634c9d85f6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:15.306643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e7e7f52-46bb-4f64-a045-89634c9d85f6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:15.442078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3807d084-5c94-4be3-97f2-c068d4cb198a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:15.451289 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3807d084-5c94-4be3-97f2-c068d4cb198a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1369 microversion: 2.1 time: 0.761767 Jul 28 03:37:15.460804 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 207/472] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:14 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1369 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:15.633020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2e7e7f52-46bb-4f64-a045-89634c9d85f6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:15.647574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2e7e7f52-46bb-4f64-a045-89634c9d85f6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:15.651036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2e7e7f52-46bb-4f64-a045-89634c9d85f6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:15.664191 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2e7e7f52-46bb-4f64-a045-89634c9d85f6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1410 microversion: 2.75 time: 0.383766 Jul 28 03:37:15.668386 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 266/473] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:15 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1410 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:15.712199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3696ee7f-47c9-4f85-a6f4-8b65d54872b4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:15.713590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3696ee7f-47c9-4f85-a6f4-8b65d54872b4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:15.723170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3696ee7f-47c9-4f85-a6f4-8b65d54872b4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:15.723648 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3696ee7f-47c9-4f85-a6f4-8b65d54872b4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:15.725165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3696ee7f-47c9-4f85-a6f4-8b65d54872b4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:15.725618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3696ee7f-47c9-4f85-a6f4-8b65d54872b4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:16.188590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6c01551a-ea2e-434e-ae4f-2c015d145cb5 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:16.189228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6c01551a-ea2e-434e-ae4f-2c015d145cb5 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:16.212487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c01551a-ea2e-434e-ae4f-2c015d145cb5 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:16.213068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c01551a-ea2e-434e-ae4f-2c015d145cb5 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:16.213940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c01551a-ea2e-434e-ae4f-2c015d145cb5 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:16.214388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c01551a-ea2e-434e-ae4f-2c015d145cb5 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:16.348830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3696ee7f-47c9-4f85-a6f4-8b65d54872b4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:16.379669 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3696ee7f-47c9-4f85-a6f4-8b65d54872b4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1549 microversion: 2.1 time: 0.665841 Jul 28 03:37:16.384243 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 208/474] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:15 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1549 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:16.415538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-09bdd130-afca-446d-bef2-7efc1e81e333 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:16.417039 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-09bdd130-afca-446d-bef2-7efc1e81e333 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:16.449343 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09bdd130-afca-446d-bef2-7efc1e81e333 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:16.452606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09bdd130-afca-446d-bef2-7efc1e81e333 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:16.456208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09bdd130-afca-446d-bef2-7efc1e81e333 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:16.459484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09bdd130-afca-446d-bef2-7efc1e81e333 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:16.893035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6c01551a-ea2e-434e-ae4f-2c015d145cb5 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:16.904431 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6c01551a-ea2e-434e-ae4f-2c015d145cb5 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1388 microversion: 2.1 time: 0.720837 Jul 28 03:37:16.920072 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 267/475] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:16 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1388 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:16.930451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c85115cc-8f04-4e4f-9b1f-c63eddc2f9b2 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:16.931297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c85115cc-8f04-4e4f-9b1f-c63eddc2f9b2 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:16.941768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c85115cc-8f04-4e4f-9b1f-c63eddc2f9b2 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:16.942350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c85115cc-8f04-4e4f-9b1f-c63eddc2f9b2 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:16.943191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c85115cc-8f04-4e4f-9b1f-c63eddc2f9b2 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:16.943775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c85115cc-8f04-4e4f-9b1f-c63eddc2f9b2 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:17.140697 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-09bdd130-afca-446d-bef2-7efc1e81e333 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.736243 Jul 28 03:37:17.141295 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 209/476] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:37:16 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/os-interface => generated 284 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:37:17.155700 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-de93d102-48a2-43be-b6c8-0154d5511ef1 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:17.156651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-de93d102-48a2-43be-b6c8-0154d5511ef1 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:17.174851 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de93d102-48a2-43be-b6c8-0154d5511ef1 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:17.175575 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de93d102-48a2-43be-b6c8-0154d5511ef1 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:17.176479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de93d102-48a2-43be-b6c8-0154d5511ef1 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:17.177011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de93d102-48a2-43be-b6c8-0154d5511ef1 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:17.348212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-de93d102-48a2-43be-b6c8-0154d5511ef1 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:17.357276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-de93d102-48a2-43be-b6c8-0154d5511ef1 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:17.370070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-de93d102-48a2-43be-b6c8-0154d5511ef1 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:17.380095 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-de93d102-48a2-43be-b6c8-0154d5511ef1 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1416 microversion: 2.75 time: 0.237436 Jul 28 03:37:17.386656 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 210/477] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:17 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1416 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:17.598033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c85115cc-8f04-4e4f-9b1f-c63eddc2f9b2 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:17.605844 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c85115cc-8f04-4e4f-9b1f-c63eddc2f9b2 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1369 microversion: 2.1 time: 0.684036 Jul 28 03:37:17.606850 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 268/478] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:16 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1369 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:17.926620 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f738f709-1058-4e9b-a45f-f01888dc45c8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:17.927230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f738f709-1058-4e9b-a45f-f01888dc45c8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:17.943628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f738f709-1058-4e9b-a45f-f01888dc45c8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:17.944081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f738f709-1058-4e9b-a45f-f01888dc45c8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:17.944978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f738f709-1058-4e9b-a45f-f01888dc45c8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:17.945310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f738f709-1058-4e9b-a45f-f01888dc45c8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:18.252450 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f738f709-1058-4e9b-a45f-f01888dc45c8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:18.261040 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f738f709-1058-4e9b-a45f-f01888dc45c8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1388 microversion: 2.1 time: 0.338352 Jul 28 03:37:18.265509 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 211/479] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:17 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1388 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:18.307148 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-9063641f-9e4b-4ac1-8fa1-068df1c6519f req-e9f55bf5-a8a7-4548-b3c0-eb47ff946d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d67752-6c63-4b60-9306-007519a62c9d", "name": "network-vif-plugged", "status": "completed", "tag": "01a26c26-198c-4922-8c18-94f221ad8f7d"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:18.326544 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9063641f-9e4b-4ac1-8fa1-068df1c6519f req-e9f55bf5-a8a7-4548-b3c0-eb47ff946d7e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:18.329643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9063641f-9e4b-4ac1-8fa1-068df1c6519f req-e9f55bf5-a8a7-4548-b3c0-eb47ff946d7e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:18.357439 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-9063641f-9e4b-4ac1-8fa1-068df1c6519f req-e9f55bf5-a8a7-4548-b3c0-eb47ff946d7e service nova] Creating event network-vif-plugged:01a26c26-198c-4922-8c18-94f221ad8f7d for instance 40d67752-6c63-4b60-9306-007519a62c9d on n-h1-826756-3 Jul 28 03:37:18.363554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1290532883", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f61dea9e-b85d-46b5-aa09-70f0225d6c84"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:18.370322 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-9063641f-9e4b-4ac1-8fa1-068df1c6519f req-e9f55bf5-a8a7-4548-b3c0-eb47ff946d7e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066782 Jul 28 03:37:18.371417 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 212/480] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:18.418154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-043ed71a-e8dd-4eaf-8bdc-c5c8eb3a981a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:18.419143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-043ed71a-e8dd-4eaf-8bdc-c5c8eb3a981a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:18.426617 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-043ed71a-e8dd-4eaf-8bdc-c5c8eb3a981a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:18.429062 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-043ed71a-e8dd-4eaf-8bdc-c5c8eb3a981a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:18.430022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-043ed71a-e8dd-4eaf-8bdc-c5c8eb3a981a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:18.433084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-043ed71a-e8dd-4eaf-8bdc-c5c8eb3a981a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:18.469025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:18.476787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] validate_networks() for [('f61dea9e-b85d-46b5-aa09-70f0225d6c84', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:37:18.535454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-043ed71a-e8dd-4eaf-8bdc-c5c8eb3a981a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:18.546662 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-043ed71a-e8dd-4eaf-8bdc-c5c8eb3a981a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:18.548586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-043ed71a-e8dd-4eaf-8bdc-c5c8eb3a981a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:18.554734 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-043ed71a-e8dd-4eaf-8bdc-c5c8eb3a981a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1437 microversion: 2.75 time: 0.140722 Jul 28 03:37:18.570910 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 213/481] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:18 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1437 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:37:18.589584 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:18.592517 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:18.599194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:18.599786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:18.600732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:18.601261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:18.688111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:37:18.688642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:37:18.689442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:37:18.689858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:37:18.690473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:37:18.786985 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:18.807635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:18.808247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:18.811682 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:18.812752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:19.010292 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:19.026649 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:19.029331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:19.037519 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2a3aefe2-5d1c-478f-b743-3fb935ce5f2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "POST /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61/action" status: 202 len: 1494 microversion: 2.75 time: 0.452073 Jul 28 03:37:19.039213 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 214/482] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 03:37:18 2022] POST /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61/action => generated 1494 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 28 03:37:19.046835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-86a171a3-e2f6-48b1-8511-b93aeebeeb8e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:19.047637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-86a171a3-e2f6-48b1-8511-b93aeebeeb8e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:19.067241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86a171a3-e2f6-48b1-8511-b93aeebeeb8e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:19.067981 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86a171a3-e2f6-48b1-8511-b93aeebeeb8e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:19.068991 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86a171a3-e2f6-48b1-8511-b93aeebeeb8e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:19.069755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86a171a3-e2f6-48b1-8511-b93aeebeeb8e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:19.341115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-86a171a3-e2f6-48b1-8511-b93aeebeeb8e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:19.365673 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-86a171a3-e2f6-48b1-8511-b93aeebeeb8e tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1369 microversion: 2.1 time: 0.324396 Jul 28 03:37:19.366880 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 215/483] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:19 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1369 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:19.373563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-310d7dee-e3a9-4da0-85a0-5900569c07ff tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:19.374339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-310d7dee-e3a9-4da0-85a0-5900569c07ff tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:19.382066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-310d7dee-e3a9-4da0-85a0-5900569c07ff tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:19.382519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-310d7dee-e3a9-4da0-85a0-5900569c07ff tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:19.383355 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-310d7dee-e3a9-4da0-85a0-5900569c07ff tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:19.383875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-310d7dee-e3a9-4da0-85a0-5900569c07ff tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:19.643335 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-310d7dee-e3a9-4da0-85a0-5900569c07ff tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:19.660788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-310d7dee-e3a9-4da0-85a0-5900569c07ff tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:19.670421 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-310d7dee-e3a9-4da0-85a0-5900569c07ff tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:19.709861 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-310d7dee-e3a9-4da0-85a0-5900569c07ff tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.341511 Jul 28 03:37:19.716758 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 216/484] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:19 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:19.730830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5ee0d590-7841-4ccc-8fa3-fd8afe9b01cb tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:19.734382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5ee0d590-7841-4ccc-8fa3-fd8afe9b01cb tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:19.756025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5ee0d590-7841-4ccc-8fa3-fd8afe9b01cb tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:19.759267 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5ee0d590-7841-4ccc-8fa3-fd8afe9b01cb tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:19.763344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5ee0d590-7841-4ccc-8fa3-fd8afe9b01cb tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:19.765252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5ee0d590-7841-4ccc-8fa3-fd8afe9b01cb tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:20.051321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5ee0d590-7841-4ccc-8fa3-fd8afe9b01cb tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:20.063895 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5ee0d590-7841-4ccc-8fa3-fd8afe9b01cb tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1388 microversion: 2.1 time: 0.345362 Jul 28 03:37:20.066900 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 217/485] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:19 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1388 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:20.274754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:37:20.275247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:37:20.275983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:37:20.276417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:37:20.277127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:37:20.291569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:20.292700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:20.293934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:20.295109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:20.329139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Getting quotas for project 881125b6bb84430fb4f2e0c6ebf79983. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:37:20.339226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Getting quotas for user c2e3c37253bc408682e9a15c3b5a85ab and project 881125b6bb84430fb4f2e0c6ebf79983. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:37:20.380322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:37:20.383368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:37:20.389432 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-81cd6555-8816-4a02-9540-48cd572ba896 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:20.389432 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-81cd6555-8816-4a02-9540-48cd572ba896 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:20.402121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81cd6555-8816-4a02-9540-48cd572ba896 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:20.403138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81cd6555-8816-4a02-9540-48cd572ba896 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:20.405571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81cd6555-8816-4a02-9540-48cd572ba896 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:20.408111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81cd6555-8816-4a02-9540-48cd572ba896 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:20.552162 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ef072aa6-5fae-476d-8051-a03f1a179a95 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.402555 Jul 28 03:37:20.553202 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 269/486] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:37:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2405 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:37:20.567287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-76415170-60cf-423a-bda5-429957d214c5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:20.568157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-76415170-60cf-423a-bda5-429957d214c5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:20.664492 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-81cd6555-8816-4a02-9540-48cd572ba896 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:20.673817 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-81cd6555-8816-4a02-9540-48cd572ba896 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1369 microversion: 2.1 time: 0.289396 Jul 28 03:37:20.674911 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 218/487] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:20 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1369 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:20.743893 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4ebabb8f-9c46-44b7-bbc3-1b44e615b94f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:20.744706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4ebabb8f-9c46-44b7-bbc3-1b44e615b94f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:20.758496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ebabb8f-9c46-44b7-bbc3-1b44e615b94f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:20.758966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ebabb8f-9c46-44b7-bbc3-1b44e615b94f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:20.759845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ebabb8f-9c46-44b7-bbc3-1b44e615b94f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:20.764243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ebabb8f-9c46-44b7-bbc3-1b44e615b94f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:20.824273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-76415170-60cf-423a-bda5-429957d214c5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:20.841161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-76415170-60cf-423a-bda5-429957d214c5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:20.844583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-76415170-60cf-423a-bda5-429957d214c5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:20.846253 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-76415170-60cf-423a-bda5-429957d214c5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1262 microversion: 2.25 time: 0.284412 Jul 28 03:37:20.849354 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 270/488] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:20 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1262 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:37:20.913678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4ebabb8f-9c46-44b7-bbc3-1b44e615b94f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:20.927431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4ebabb8f-9c46-44b7-bbc3-1b44e615b94f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:20.941210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4ebabb8f-9c46-44b7-bbc3-1b44e615b94f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:20.947322 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4ebabb8f-9c46-44b7-bbc3-1b44e615b94f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.207835 Jul 28 03:37:20.960690 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 219/489] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:20 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:37:21.092090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b6dd2a10-7891-4271-b816-b3e1eb695d7a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:21.092816 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b6dd2a10-7891-4271-b816-b3e1eb695d7a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:21.108047 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6dd2a10-7891-4271-b816-b3e1eb695d7a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:21.108740 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6dd2a10-7891-4271-b816-b3e1eb695d7a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:21.109771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6dd2a10-7891-4271-b816-b3e1eb695d7a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:21.110408 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6dd2a10-7891-4271-b816-b3e1eb695d7a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:21.611974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3be4908e-2f40-4da8-83b2-07d7981bc06e tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:21.629742 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3be4908e-2f40-4da8-83b2-07d7981bc06e tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.622189 Jul 28 03:37:21.630372 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 271/490] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:37:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:21.636617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d6db4d33-a50a-4014-8678-62ecb00df0de req-50178875-123b-4af3-a24c-8b924da58a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4b8ffa-dbe6-4e90-a8f5-728addf73aae", "tag": "3931df07-76f1-4feb-a179-d48d42b61b21"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:21.664637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d6db4d33-a50a-4014-8678-62ecb00df0de req-50178875-123b-4af3-a24c-8b924da58a76 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:21.666511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d6db4d33-a50a-4014-8678-62ecb00df0de req-50178875-123b-4af3-a24c-8b924da58a76 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:21.682341 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-d6db4d33-a50a-4014-8678-62ecb00df0de req-50178875-123b-4af3-a24c-8b924da58a76 service nova] Creating event network-changed:3931df07-76f1-4feb-a179-d48d42b61b21 for instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae on n-h2-826756-3 Jul 28 03:37:21.688232 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d6db4d33-a50a-4014-8678-62ecb00df0de req-50178875-123b-4af3-a24c-8b924da58a76 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056463 Jul 28 03:37:21.695424 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 272/491] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:21.708633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b6dd2a10-7891-4271-b816-b3e1eb695d7a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:21.750046 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b6dd2a10-7891-4271-b816-b3e1eb695d7a tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1586 microversion: 2.1 time: 0.662111 Jul 28 03:37:21.761268 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 220/492] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:21 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1586 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:21.784512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ea0bec99-31f1-4344-8f5c-c5abb69e99f0 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:21.856682 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ea0bec99-31f1-4344-8f5c-c5abb69e99f0 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors" status: 200 len: 3078 microversion: 2.1 time: 0.088407 Jul 28 03:37:21.857970 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 221/493] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 03:37:21 2022] GET /compute/v2.1/flavors => generated 3078 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:21.873936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5d7f48dd-26c7-45bc-94ec-aa5ac745b520 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:21.877506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5d7f48dd-26c7-45bc-94ec-aa5ac745b520 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:21.893917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d7f48dd-26c7-45bc-94ec-aa5ac745b520 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:21.897389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d7f48dd-26c7-45bc-94ec-aa5ac745b520 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:21.899368 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d7f48dd-26c7-45bc-94ec-aa5ac745b520 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:21.899996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d7f48dd-26c7-45bc-94ec-aa5ac745b520 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:22.112848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d8e5e682-ccd7-47df-8f0c-d8264aa65fab tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-232500590", "ram": 512, "vcpus": 1, "disk": 10, "id": 1069984116, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:22.117181 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:22.117181 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:22.168659 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d8e5e682-ccd7-47df-8f0c-d8264aa65fab tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.470069 Jul 28 03:37:22.169628 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 273/494] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:37:21 2022] POST /compute/v2.1/flavors => generated 415 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:22.182457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-32ee563a-9003-4ac0-b627-a47ae01f0cd4 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:22.188902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-32ee563a-9003-4ac0-b627-a47ae01f0cd4 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:22.211394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32ee563a-9003-4ac0-b627-a47ae01f0cd4 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:22.218205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32ee563a-9003-4ac0-b627-a47ae01f0cd4 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:22.221098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32ee563a-9003-4ac0-b627-a47ae01f0cd4 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:22.221882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32ee563a-9003-4ac0-b627-a47ae01f0cd4 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:22.426640 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5d7f48dd-26c7-45bc-94ec-aa5ac745b520 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:22.447132 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5d7f48dd-26c7-45bc-94ec-aa5ac745b520 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1369 microversion: 2.1 time: 0.586018 Jul 28 03:37:22.453241 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 222/495] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:21 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1369 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:22.466367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bec11012-14f5-448f-95c4-15b0da96fbcb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:22.467792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bec11012-14f5-448f-95c4-15b0da96fbcb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:22.484323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bec11012-14f5-448f-95c4-15b0da96fbcb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:22.485566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bec11012-14f5-448f-95c4-15b0da96fbcb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:22.489257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bec11012-14f5-448f-95c4-15b0da96fbcb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:22.489900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bec11012-14f5-448f-95c4-15b0da96fbcb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:22.596022 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-32ee563a-9003-4ac0-b627-a47ae01f0cd4 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.424484 Jul 28 03:37:22.596955 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 274/496] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:37:22 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d/os-interface => generated 284 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:22.602965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4fae9b8-c78f-4940-a9ba-04e548a21ee2 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:22.625190 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4fae9b8-c78f-4940-a9ba-04e548a21ee2 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026456 Jul 28 03:37:22.629025 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 275/497] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:37:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:22.635965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1845a913-3ff6-411f-b390-57c82b3f7c56 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:22.639238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1845a913-3ff6-411f-b390-57c82b3f7c56 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:22.657918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1845a913-3ff6-411f-b390-57c82b3f7c56 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:22.658663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1845a913-3ff6-411f-b390-57c82b3f7c56 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:22.659662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1845a913-3ff6-411f-b390-57c82b3f7c56 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:22.660855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1845a913-3ff6-411f-b390-57c82b3f7c56 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:22.678380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:22.845545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1845a913-3ff6-411f-b390-57c82b3f7c56 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:22.853193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1845a913-3ff6-411f-b390-57c82b3f7c56 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:22.856899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1845a913-3ff6-411f-b390-57c82b3f7c56 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:22.865409 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1845a913-3ff6-411f-b390-57c82b3f7c56 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.234413 Jul 28 03:37:22.867870 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 276/498] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:22 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:22.873899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-84991774-e461-44a4-b9a9-87053fd2dee4 tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:22.877995 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:22.877995 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:22.931290 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-84991774-e461-44a4-b9a9-87053fd2dee4 tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1069984116/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.061720 Jul 28 03:37:22.933539 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 277/499] 10.222.0.48 () {60 vars in 1224 bytes} [Thu Jul 28 03:37:22 2022] POST /compute/v2.1/flavors/1069984116/os-extra_specs => generated 66 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:22.949183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97b347eb-f361-4cde-bcc4-756efacb4ab9 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:22.976923 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-97b347eb-f361-4cde-bcc4-756efacb4ab9 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041357 Jul 28 03:37:22.977865 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 278/500] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:37:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:23.228248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-631f0194-8467-4b48-bbe1-a10ebce4f444 tempest-FlavorsExtraSpecsTestJSON-834511823 tempest-FlavorsExtraSpecsTestJSON-834511823-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.247705 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-631f0194-8467-4b48-bbe1-a10ebce4f444 tempest-FlavorsExtraSpecsTestJSON-834511823 tempest-FlavorsExtraSpecsTestJSON-834511823-project] 10.222.0.48 "GET /compute/v2.1/flavors/1069984116/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.257214 Jul 28 03:37:23.261042 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 279/501] 10.222.0.48 () {58 vars in 1203 bytes} [Thu Jul 28 03:37:22 2022] GET /compute/v2.1/flavors/1069984116/os-extra_specs => generated 66 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:23.271920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-402f06c5-20a4-4d8a-b581-37a0acc08039 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.329125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bec11012-14f5-448f-95c4-15b0da96fbcb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:23.348286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bec11012-14f5-448f-95c4-15b0da96fbcb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:23.352602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bec11012-14f5-448f-95c4-15b0da96fbcb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:23.359036 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-402f06c5-20a4-4d8a-b581-37a0acc08039 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3614 microversion: 2.1 time: 0.096518 Jul 28 03:37:23.360702 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bec11012-14f5-448f-95c4-15b0da96fbcb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1314 microversion: 2.25 time: 0.905578 Jul 28 03:37:23.363950 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 223/502] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:22 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1314 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:23.368938 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-81fa12f5-cba2-46c8-bc43-a51f7a9dd037 tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:23.387049 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 280/503] 10.222.0.48 () {58 vars in 1165 bytes} [Thu Jul 28 03:37:23 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3614 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:23.392474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-439f02ac-8ca4-4c2e-87ba-7ee931a5f2cb tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.395746 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:23.395746 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:37:23.410706 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-439f02ac-8ca4-4c2e-87ba-7ee931a5f2cb tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022411 Jul 28 03:37:23.411680 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 281/504] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:37:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:23.426511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-37ea4f2a-af82-4c63-b77b-436d00907a7d tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.446606 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-81fa12f5-cba2-46c8-bc43-a51f7a9dd037 tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1069984116/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.081234 Jul 28 03:37:23.448998 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 224/505] 10.222.0.48 () {60 vars in 1224 bytes} [Thu Jul 28 03:37:23 2022] POST /compute/v2.1/flavors/1069984116/os-extra_specs => generated 66 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:23.460615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b7f1c403-1f72-430e-b855-112100c2d517 tempest-FlavorsExtraSpecsTestJSON-834511823 tempest-FlavorsExtraSpecsTestJSON-834511823-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.476040 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-37ea4f2a-af82-4c63-b77b-436d00907a7d tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.056015 Jul 28 03:37:23.476928 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 282/506] 10.222.0.48 () {58 vars in 1169 bytes} [Thu Jul 28 03:37:23 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:23.487813 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b7f1c403-1f72-430e-b855-112100c2d517 tempest-FlavorsExtraSpecsTestJSON-834511823 tempest-FlavorsExtraSpecsTestJSON-834511823-project] 10.222.0.48 "GET /compute/v2.1/flavors/1069984116/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.026398 Jul 28 03:37:23.495014 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 225/507] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:37:23 2022] GET /compute/v2.1/flavors/1069984116/os-extra_specs/hw:numa_nodes => generated 22 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:23.496152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-824bffcf-06f0-47e7-8bff-5887927a1667 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.496815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-824bffcf-06f0-47e7-8bff-5887927a1667 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:23.503840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-824bffcf-06f0-47e7-8bff-5887927a1667 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:23.504287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-824bffcf-06f0-47e7-8bff-5887927a1667 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:23.505099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-824bffcf-06f0-47e7-8bff-5887927a1667 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:23.505537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-824bffcf-06f0-47e7-8bff-5887927a1667 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:23.509874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5e7ca7c5-71d0-45f2-af93-d9eaa0a155e7 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.536439 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5e7ca7c5-71d0-45f2-af93-d9eaa0a155e7 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.030517 Jul 28 03:37:23.537692 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 226/508] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:37:23 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:23.549522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a9e3d7e7-92d7-4d5b-b1a5-ef760cca2b2d tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:23.597825 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a9e3d7e7-92d7-4d5b-b1a5-ef760cca2b2d tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1069984116/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.058454 Jul 28 03:37:23.607005 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 227/509] 10.222.0.48 () {60 vars in 1224 bytes} [Thu Jul 28 03:37:23 2022] POST /compute/v2.1/flavors/1069984116/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:23.622468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-01dfdac6-df5e-4859-bf41-41a4b2c2ee7f tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.630790 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:23.634643 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-01dfdac6-df5e-4859-bf41-41a4b2c2ee7f tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025580 Jul 28 03:37:23.635792 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 228/510] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:37:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:23.648422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-30f0f099-1b41-428c-8df1-3c6768dc1987 tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.658198 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-30f0f099-1b41-428c-8df1-3c6768dc1987 tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1069984116/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.020965 Jul 28 03:37:23.659128 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 229/511] 10.222.0.48 () {58 vars in 1203 bytes} [Thu Jul 28 03:37:23 2022] GET /compute/v2.1/flavors/1069984116/os-extra_specs => generated 66 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:23.670276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-27826775-4bcf-4ee9-b4d6-1651dc950b0f tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.712640 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-27826775-4bcf-4ee9-b4d6-1651dc950b0f tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2912 microversion: 2.1 time: 0.047505 Jul 28 03:37:23.713897 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 230/512] 10.222.0.48 () {58 vars in 1167 bytes} [Thu Jul 28 03:37:23 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2912 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:23.735882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aaf53b65-43ad-4e83-b332-83693c1aa96e tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:23.745093 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:23.745093 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:37:23.791103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-824bffcf-06f0-47e7-8bff-5887927a1667 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:23.795357 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aaf53b65-43ad-4e83-b332-83693c1aa96e tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1069984116/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.078805 Jul 28 03:37:23.802425 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 231/513] 10.222.0.48 () {60 vars in 1265 bytes} [Thu Jul 28 03:37:23 2022] PUT /compute/v2.1/flavors/1069984116/os-extra_specs/hw:numa_nodes => generated 22 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:23.812075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-627c1908-dc4f-48e1-b149-68fa614f34d5 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.812287 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-824bffcf-06f0-47e7-8bff-5887927a1667 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1369 microversion: 2.1 time: 0.318043 Jul 28 03:37:23.813302 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 283/514] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:23 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1369 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:23.824628 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-627c1908-dc4f-48e1-b149-68fa614f34d5 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020724 Jul 28 03:37:23.825893 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 232/515] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:37:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:23.839081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e1ad7d57-637c-4813-9977-2565571e4b6d tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.841964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-49c6fa49-c0e3-448f-acf3-3f2d0788607e tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.860114 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e1ad7d57-637c-4813-9977-2565571e4b6d tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1069984116/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.041137 Jul 28 03:37:23.860838 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 284/516] 10.222.0.48 () {58 vars in 1203 bytes} [Thu Jul 28 03:37:23 2022] GET /compute/v2.1/flavors/1069984116/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:23.870239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5183ed82-413c-488a-816e-5e9fb6b3480f tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.871032 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:23.871032 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:23.893365 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-49c6fa49-c0e3-448f-acf3-3f2d0788607e tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1894 microversion: 2.1 time: 0.056082 Jul 28 03:37:23.907495 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 233/517] 10.222.0.48 () {58 vars in 1144 bytes} [Thu Jul 28 03:37:23 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1894 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:23.915705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c6b90782-158f-4319-9ec0-ec454d38434b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.916584 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c6b90782-158f-4319-9ec0-ec454d38434b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:23.936697 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6b90782-158f-4319-9ec0-ec454d38434b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:23.937349 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6b90782-158f-4319-9ec0-ec454d38434b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:23.938927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6b90782-158f-4319-9ec0-ec454d38434b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:23.939741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6b90782-158f-4319-9ec0-ec454d38434b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:23.940020 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5183ed82-413c-488a-816e-5e9fb6b3480f tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1069984116/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.073522 Jul 28 03:37:23.942982 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 285/518] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:37:23 2022] DELETE /compute/v2.1/flavors/1069984116/os-extra_specs/hw:numa_nodes => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 28 03:37:23.956319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1e0bfc50-a969-4ab3-90fe-3570daa705c3 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:23.977980 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1e0bfc50-a969-4ab3-90fe-3570daa705c3 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033626 Jul 28 03:37:23.978966 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 286/519] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:37:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:23.990274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a57b7ed0-1954-4b2d-ab26-9d0c14771c7d tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:24.018608 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a57b7ed0-1954-4b2d-ab26-9d0c14771c7d tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1069984116/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.036435 Jul 28 03:37:24.020947 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 287/520] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:37:23 2022] DELETE /compute/v2.1/flavors/1069984116/os-extra_specs/hw:cpu_policy => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 03:37:24.027783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fce191bc-8ffa-4a7c-9021-4302f9019041 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:24.060919 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fce191bc-8ffa-4a7c-9021-4302f9019041 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.038306 Jul 28 03:37:24.070156 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 288/521] 10.222.0.48 () {58 vars in 1148 bytes} [Thu Jul 28 03:37:24 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:24.070156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6b4351d8-418e-44fa-93b3-d25df06f9fe1 tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:24.081742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:DELETE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:24.088006 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6b4351d8-418e-44fa-93b3-d25df06f9fe1 tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/1069984116/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025031 Jul 28 03:37:24.094125 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 289/522] 10.222.0.48 () {58 vars in 1203 bytes} [Thu Jul 28 03:37:24 2022] GET /compute/v2.1/flavors/1069984116/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:24.099843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-53e3972c-d074-4887-8ffd-5d51a15eba85 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:24.119485 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-53e3972c-d074-4887-8ffd-5d51a15eba85 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.024153 Jul 28 03:37:24.120064 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 290/523] 10.222.0.48 () {58 vars in 1140 bytes} [Thu Jul 28 03:37:24 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:24.131930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-39b6aff3-5033-4451-8076-65776068f47f req-c6eac842-9841-4d16-b663-81fa5431c1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8280d682-4608-420d-8bee-48984a6c1a01", "name": "network-vif-plugged", "status": "completed", "tag": "fd5a933b-cfed-47cd-bae0-70c895f135ea"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:24.135117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c6b90782-158f-4319-9ec0-ec454d38434b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:24.141936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-39b6aff3-5033-4451-8076-65776068f47f req-c6eac842-9841-4d16-b663-81fa5431c1f5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:24.142376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-39b6aff3-5033-4451-8076-65776068f47f req-c6eac842-9841-4d16-b663-81fa5431c1f5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:24.144454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c6b90782-158f-4319-9ec0-ec454d38434b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:24.146146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c6b90782-158f-4319-9ec0-ec454d38434b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:24.151814 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c6b90782-158f-4319-9ec0-ec454d38434b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.243243 Jul 28 03:37:24.152761 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 234/524] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:23 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:24.155189 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-39b6aff3-5033-4451-8076-65776068f47f req-c6eac842-9841-4d16-b663-81fa5431c1f5 service nova] Creating event network-vif-plugged:fd5a933b-cfed-47cd-bae0-70c895f135ea for instance 8280d682-4608-420d-8bee-48984a6c1a01 on n-h2-826756-3 Jul 28 03:37:24.160575 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-39b6aff3-5033-4451-8076-65776068f47f req-c6eac842-9841-4d16-b663-81fa5431c1f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032217 Jul 28 03:37:24.161685 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 291/525] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:24.167207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4d356c8-f532-4547-ad64-a93c1d1c9dc1 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:24.181472 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7bd51af7-d08a-43e3-97cf-2985fe142d6e tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:24.182418 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:24.182418 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:37:24.187537 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d4d356c8-f532-4547-ad64-a93c1d1c9dc1 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024608 Jul 28 03:37:24.194764 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 292/526] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:37:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:24.201894 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7bd51af7-d08a-43e3-97cf-2985fe142d6e tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1069984116" status: 202 len: 0 microversion: 2.1 time: 0.034763 Jul 28 03:37:24.202471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-600110ae-396b-4257-9bb3-138ae61e725c tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:24.202955 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 235/527] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:37:24 2022] DELETE /compute/v2.1/flavors/1069984116 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:37:24.212057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-847365ed-9c8f-43b1-aa1d-74741bd5cad2 tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:24.247924 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-600110ae-396b-4257-9bb3-138ae61e725c tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1541 microversion: 2.1 time: 0.049890 Jul 28 03:37:24.249066 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 293/528] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:24 2022] GET /compute/v2.1/flavors?marker=452 => generated 1541 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:24.262996 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-847365ed-9c8f-43b1-aa1d-74741bd5cad2 tempest-FlavorsExtraSpecsTestJSON-230492622 tempest-FlavorsExtraSpecsTestJSON-230492622-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.055738 Jul 28 03:37:24.264011 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 236/529] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:24 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:24.266200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d938375-fae0-43af-9247-bc07fb815e87 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:24.310084 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5d938375-fae0-43af-9247-bc07fb815e87 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.049269 Jul 28 03:37:24.310971 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 294/530] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:24 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:24.329252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1383c273-9448-4f78-9561-4400caf2d5e2 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:24.338139 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1383c273-9448-4f78-9561-4400caf2d5e2 tempest-FlavorsV2TestJSON-273830152 tempest-FlavorsV2TestJSON-273830152-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012697 Jul 28 03:37:24.350857 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 237/531] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:37:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:24.387674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9364081d-bd7f-4ee1-b6c6-9fed8e688ce1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:24.388442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9364081d-bd7f-4ee1-b6c6-9fed8e688ce1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:24.399370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9364081d-bd7f-4ee1-b6c6-9fed8e688ce1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:24.401007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9364081d-bd7f-4ee1-b6c6-9fed8e688ce1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:24.401842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9364081d-bd7f-4ee1-b6c6-9fed8e688ce1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:24.402417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9364081d-bd7f-4ee1-b6c6-9fed8e688ce1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:24.507211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9364081d-bd7f-4ee1-b6c6-9fed8e688ce1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:24.523470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9364081d-bd7f-4ee1-b6c6-9fed8e688ce1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:24.525373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9364081d-bd7f-4ee1-b6c6-9fed8e688ce1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:24.526906 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9364081d-bd7f-4ee1-b6c6-9fed8e688ce1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1320 microversion: 2.25 time: 0.143407 Jul 28 03:37:24.527802 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 295/532] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:24 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1320 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:24.834879 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b5ac188a-5194-400c-971f-8c1c485c5be7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:24.835528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b5ac188a-5194-400c-971f-8c1c485c5be7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:24.847076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5ac188a-5194-400c-971f-8c1c485c5be7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:24.847590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5ac188a-5194-400c-971f-8c1c485c5be7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:24.848468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5ac188a-5194-400c-971f-8c1c485c5be7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:24.849114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5ac188a-5194-400c-971f-8c1c485c5be7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:25.187863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fc76565d-daae-417f-a767-06ffd338f6cb tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:25.189400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fc76565d-daae-417f-a767-06ffd338f6cb tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:25.207782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc76565d-daae-417f-a767-06ffd338f6cb tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:25.208498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc76565d-daae-417f-a767-06ffd338f6cb tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:25.209850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc76565d-daae-417f-a767-06ffd338f6cb tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:25.210489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc76565d-daae-417f-a767-06ffd338f6cb tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:25.360089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc76565d-daae-417f-a767-06ffd338f6cb tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:25.390000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc76565d-daae-417f-a767-06ffd338f6cb tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:25.395730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc76565d-daae-417f-a767-06ffd338f6cb tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:25.417975 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fc76565d-daae-417f-a767-06ffd338f6cb tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.236410 Jul 28 03:37:25.421236 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 296/533] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:25 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:37:25.552901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d5dbcfe0-4163-4bc5-9f73-c12171debea8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:25.553449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d5dbcfe0-4163-4bc5-9f73-c12171debea8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:25.566591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5dbcfe0-4163-4bc5-9f73-c12171debea8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:25.568342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5dbcfe0-4163-4bc5-9f73-c12171debea8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:25.569644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5dbcfe0-4163-4bc5-9f73-c12171debea8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:25.570289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5dbcfe0-4163-4bc5-9f73-c12171debea8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:25.684918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d5dbcfe0-4163-4bc5-9f73-c12171debea8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:25.696029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d5dbcfe0-4163-4bc5-9f73-c12171debea8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:25.697709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d5dbcfe0-4163-4bc5-9f73-c12171debea8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:25.698878 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d5dbcfe0-4163-4bc5-9f73-c12171debea8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1320 microversion: 2.25 time: 0.151126 Jul 28 03:37:25.718123 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 297/534] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:25 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1320 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:37:26.014488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b5ac188a-5194-400c-971f-8c1c485c5be7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:26.025617 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b5ac188a-5194-400c-971f-8c1c485c5be7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1369 microversion: 2.1 time: 1.195720 Jul 28 03:37:26.027748 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 238/535] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:24 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1369 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:26.458455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e30c6319-1c85-4878-b4ac-f1301848ca66 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:26.459823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e30c6319-1c85-4878-b4ac-f1301848ca66 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:26.471159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30c6319-1c85-4878-b4ac-f1301848ca66 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:26.473933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30c6319-1c85-4878-b4ac-f1301848ca66 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:26.474942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30c6319-1c85-4878-b4ac-f1301848ca66 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:26.475600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30c6319-1c85-4878-b4ac-f1301848ca66 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:26.613890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e30c6319-1c85-4878-b4ac-f1301848ca66 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:26.629204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e30c6319-1c85-4878-b4ac-f1301848ca66 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:26.631077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e30c6319-1c85-4878-b4ac-f1301848ca66 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:26.637249 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e30c6319-1c85-4878-b4ac-f1301848ca66 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.182973 Jul 28 03:37:26.638395 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 298/536] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:26 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:26.732396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7a00909d-5129-4d19-b8d5-a8920c77fdd1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:26.733160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7a00909d-5129-4d19-b8d5-a8920c77fdd1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:26.749805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a00909d-5129-4d19-b8d5-a8920c77fdd1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:26.750368 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a00909d-5129-4d19-b8d5-a8920c77fdd1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:26.753240 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a00909d-5129-4d19-b8d5-a8920c77fdd1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:26.756787 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a00909d-5129-4d19-b8d5-a8920c77fdd1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:27.062535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7a00909d-5129-4d19-b8d5-a8920c77fdd1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:27.094565 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7a00909d-5129-4d19-b8d5-a8920c77fdd1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:27.101706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7a00909d-5129-4d19-b8d5-a8920c77fdd1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:27.103861 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7a00909d-5129-4d19-b8d5-a8920c77fdd1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1320 microversion: 2.25 time: 0.376890 Jul 28 03:37:27.109299 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 239/537] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:26 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1320 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:27.130904 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4da2c7f0-4fa1-42ff-8386-312d6b73aca6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:27.131764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4da2c7f0-4fa1-42ff-8386-312d6b73aca6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:27.143241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4da2c7f0-4fa1-42ff-8386-312d6b73aca6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:27.143836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4da2c7f0-4fa1-42ff-8386-312d6b73aca6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:27.145002 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4da2c7f0-4fa1-42ff-8386-312d6b73aca6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:27.145882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4da2c7f0-4fa1-42ff-8386-312d6b73aca6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:27.384185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e67520a8-bdd7-4d58-83c8-86168893612f tempest-FlavorsV2NegativeTest-1549833252 tempest-FlavorsV2NegativeTest-1549833252-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:27.410167 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e67520a8-bdd7-4d58-83c8-86168893612f tempest-FlavorsV2NegativeTest-1549833252 tempest-FlavorsV2NegativeTest-1549833252-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.594039 Jul 28 03:37:27.411613 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 299/538] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:37:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:27.676381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1cb355b3-281c-4ae8-934b-05ebb8c46ce6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:27.677290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1cb355b3-281c-4ae8-934b-05ebb8c46ce6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:27.691397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cb355b3-281c-4ae8-934b-05ebb8c46ce6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:27.692290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cb355b3-281c-4ae8-934b-05ebb8c46ce6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:27.695118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cb355b3-281c-4ae8-934b-05ebb8c46ce6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:27.696142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cb355b3-281c-4ae8-934b-05ebb8c46ce6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:28.102341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1cb355b3-281c-4ae8-934b-05ebb8c46ce6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:28.121374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1cb355b3-281c-4ae8-934b-05ebb8c46ce6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:28.133794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1cb355b3-281c-4ae8-934b-05ebb8c46ce6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:28.150954 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1cb355b3-281c-4ae8-934b-05ebb8c46ce6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.483093 Jul 28 03:37:28.158189 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 300/539] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:27 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:37:28.175262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5fbeb9f-881d-4027-9d0a-157b689b2825 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:28.177157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b5fbeb9f-881d-4027-9d0a-157b689b2825 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:28.197679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5fbeb9f-881d-4027-9d0a-157b689b2825 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:28.198128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5fbeb9f-881d-4027-9d0a-157b689b2825 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:28.201753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5fbeb9f-881d-4027-9d0a-157b689b2825 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:28.203737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5fbeb9f-881d-4027-9d0a-157b689b2825 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:28.210741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4da2c7f0-4fa1-42ff-8386-312d6b73aca6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:28.230026 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4da2c7f0-4fa1-42ff-8386-312d6b73aca6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1555 microversion: 2.1 time: 1.116032 Jul 28 03:37:28.244884 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 240/540] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:27 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1555 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:28.250975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-785fb661-d9e0-4dab-ac59-9bac1335ad16 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:28.255811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-785fb661-d9e0-4dab-ac59-9bac1335ad16 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:28.277294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-785fb661-d9e0-4dab-ac59-9bac1335ad16 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:28.278409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-785fb661-d9e0-4dab-ac59-9bac1335ad16 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:28.279372 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-785fb661-d9e0-4dab-ac59-9bac1335ad16 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:28.281625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-785fb661-d9e0-4dab-ac59-9bac1335ad16 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:28.581179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b5fbeb9f-881d-4027-9d0a-157b689b2825 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:28.594428 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5fbeb9f-881d-4027-9d0a-157b689b2825 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 200 len: 1586 microversion: 2.1 time: 0.434469 Jul 28 03:37:28.610771 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 301/541] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:28 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 1586 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:28.638442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-511991f7-9ba7-4d47-a34e-4316365d2ffa req-83651f23-c483-4e5e-a5ca-5b91b7e08d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d67752-6c63-4b60-9306-007519a62c9d", "tag": "01a26c26-198c-4922-8c18-94f221ad8f7d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:28.667903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-511991f7-9ba7-4d47-a34e-4316365d2ffa req-83651f23-c483-4e5e-a5ca-5b91b7e08d28 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:28.669595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-511991f7-9ba7-4d47-a34e-4316365d2ffa req-83651f23-c483-4e5e-a5ca-5b91b7e08d28 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:28.680063 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-785fb661-d9e0-4dab-ac59-9bac1335ad16 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:28.688488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:28.698154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-785fb661-d9e0-4dab-ac59-9bac1335ad16 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:28.701340 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-511991f7-9ba7-4d47-a34e-4316365d2ffa req-83651f23-c483-4e5e-a5ca-5b91b7e08d28 service nova] Creating event network-changed:01a26c26-198c-4922-8c18-94f221ad8f7d for instance 40d67752-6c63-4b60-9306-007519a62c9d on n-h1-826756-3 Jul 28 03:37:28.703906 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-785fb661-d9e0-4dab-ac59-9bac1335ad16 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:28.707322 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-785fb661-d9e0-4dab-ac59-9bac1335ad16 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1362 microversion: 2.25 time: 0.472752 Jul 28 03:37:28.710897 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 241/542] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:28 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1362 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:28.731832 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a91ea999-0aa1-451e-be9f-8c60354beeff tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:28.733463 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-511991f7-9ba7-4d47-a34e-4316365d2ffa req-83651f23-c483-4e5e-a5ca-5b91b7e08d28 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121217 Jul 28 03:37:28.734649 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 302/543] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:28.736398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a91ea999-0aa1-451e-be9f-8c60354beeff tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:28.759632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a91ea999-0aa1-451e-be9f-8c60354beeff tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:28.764483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a91ea999-0aa1-451e-be9f-8c60354beeff tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:28.767365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a91ea999-0aa1-451e-be9f-8c60354beeff tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:28.769772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a91ea999-0aa1-451e-be9f-8c60354beeff tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:29.333012 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a91ea999-0aa1-451e-be9f-8c60354beeff tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.619030 Jul 28 03:37:29.333969 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 242/544] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:37:28 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01/os-interface => generated 284 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:29.351787 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5fc924ae-6639-477b-bf47-ca7f1850ca4a tempest-FlavorsV2NegativeTest-1549833252 tempest-FlavorsV2NegativeTest-1549833252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-16364194", "imageRef": "070d39c3-4d76-4577-bc78-c7d40ef8cb4a", "flavorRef": "452"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:29.402492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1272228916", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "4becdb03-f4b9-4bc9-b3de-403ab318d4dd"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:29.499611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-5fc924ae-6639-477b-bf47-ca7f1850ca4a tempest-FlavorsV2NegativeTest-1549833252 tempest-FlavorsV2NegativeTest-1549833252-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:37:29.544111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] validate_networks() for [('4becdb03-f4b9-4bc9-b3de-403ab318d4dd', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:37:30.311041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:30.732420 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-5fc924ae-6639-477b-bf47-ca7f1850ca4a tempest-FlavorsV2NegativeTest-1549833252 tempest-FlavorsV2NegativeTest-1549833252-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5fc924ae-6639-477b-bf47-ca7f1850ca4a tempest-FlavorsV2NegativeTest-1549833252 tempest-FlavorsV2NegativeTest-1549833252-project] Request method failure captured: Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 141 Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gR23fR9dXrCsCUtVjssW4FEt_dATXc6HNJ1nKSMEFo3A_cFzJMUVWyHi1ki3zb_V8B8tSLJccUMgAAmovVSNfZNNzBHbuwCxuqmKB9r8zJJqBL6qHc2IYvE2epxA5NRXqHmlZjdFj8THxSjaM3dwNjPcYGfjUTktPq8KG0vLvNEl_c Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: c8ef8cc6db8b42f6bc733edd8961ff9e Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-FlavorsV2NegativeTest-1549833252 Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:37:30.734918 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:37:30.736545 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8ef8cc6db8b42f6bc733edd8961ff9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8ef8cc6db8b42f6bc733edd8961ff9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8ef8cc6db8b42f6bc733edd8961ff9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8ef8cc6db8b42f6bc733edd8961ff9e"}]}] Jul 28 03:37:30.736545 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-FlavorsV2NegativeTest-1549833252 Jul 28 03:37:30.736545 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: c8ef8cc6db8b42f6bc733edd8961ff9e Jul 28 03:37:30.736545 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1549833252 Jul 28 03:37:30.736545 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-FlavorsV2NegativeTest-1549833252-project Jul 28 03:37:30.736545 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:37:30.736545 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:37:30.736545 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 9b6f37f4256c4e70992ea2f390418ec5 Jul 28 03:37:30.736545 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-FlavorsV2NegativeTest-1549833252-project Jul 28 03:37:30.736545 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:37:30.736545 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-16364194", "imageRef": "070d39c3-4d76-4577-bc78-c7d40ef8cb4a", "flavorRef": "452"}} Jul 28 03:37:30.736545 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:37:30.736545 n-d-826756-3 devstack@n-api.service[126072]: exception: Flavor's memory is too small for requested image. Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-16364194', 'imageRef': '070d39c3-4d76-4577-bc78-c7d40ef8cb4a', 'flavorRef': '452'}}} Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2195, in create Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1713, in _create_instance Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1008, in _checks_for_create_and_rebuild Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 672, in _validate_flavor_image Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 740, in _validate_flavor_image_nostatus Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:30.737516 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:30.738834 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:30.740037 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:30.740037 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:30.740037 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:37:30.740037 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:37:30.740037 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 28 03:37:30.740037 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:30.741129 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5fc924ae-6639-477b-bf47-ca7f1850ca4a tempest-FlavorsV2NegativeTest-1549833252 tempest-FlavorsV2NegativeTest-1549833252-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:37:30.742647 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5fc924ae-6639-477b-bf47-ca7f1850ca4a tempest-FlavorsV2NegativeTest-1549833252 tempest-FlavorsV2NegativeTest-1549833252-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.407358 Jul 28 03:37:30.743736 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 243/545] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:37:29 2022] POST /compute/v2.1/servers => generated 93 bytes in 1409 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:37:30.749773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-79b6e55b-1aad-486d-81a0-b3bf0ebbac2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:30.750488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-79b6e55b-1aad-486d-81a0-b3bf0ebbac2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:30.765667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-79b6e55b-1aad-486d-81a0-b3bf0ebbac2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:30.766283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-79b6e55b-1aad-486d-81a0-b3bf0ebbac2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:30.769593 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-79b6e55b-1aad-486d-81a0-b3bf0ebbac2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:30.770331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-79b6e55b-1aad-486d-81a0-b3bf0ebbac2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:30.830349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=16 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:30.935658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-79b6e55b-1aad-486d-81a0-b3bf0ebbac2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:30.944499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-79b6e55b-1aad-486d-81a0-b3bf0ebbac2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:30.948713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-79b6e55b-1aad-486d-81a0-b3bf0ebbac2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:30.965316 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-79b6e55b-1aad-486d-81a0-b3bf0ebbac2f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.220274 Jul 28 03:37:30.966159 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 244/546] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:30 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:30.979278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a08e434b-d3f8-4564-83f6-4006a07cdf49 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:30.980274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a08e434b-d3f8-4564-83f6-4006a07cdf49 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:30.990052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a08e434b-d3f8-4564-83f6-4006a07cdf49 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:30.990511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a08e434b-d3f8-4564-83f6-4006a07cdf49 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:30.993034 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a08e434b-d3f8-4564-83f6-4006a07cdf49 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:30.993473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a08e434b-d3f8-4564-83f6-4006a07cdf49 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:31.488095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a08e434b-d3f8-4564-83f6-4006a07cdf49 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:31.498910 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a08e434b-d3f8-4564-83f6-4006a07cdf49 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:31.501833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a08e434b-d3f8-4564-83f6-4006a07cdf49 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:31.503640 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a08e434b-d3f8-4564-83f6-4006a07cdf49 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1362 microversion: 2.25 time: 0.536120 Jul 28 03:37:31.504587 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 245/547] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:30 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1362 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:31.510808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-b001200d-2cc2-4851-b40d-9f02b5949f7c req-08731897-e397-42d9-bacc-3c7a8729ee27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712656b5-8470-4486-baf2-1c412846c8fc", "tag": "e54d0f2b-04e3-4f2a-b2ad-ca1a7f88a7e9"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:31.543250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b001200d-2cc2-4851-b40d-9f02b5949f7c req-08731897-e397-42d9-bacc-3c7a8729ee27 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:31.544935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b001200d-2cc2-4851-b40d-9f02b5949f7c req-08731897-e397-42d9-bacc-3c7a8729ee27 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:31.564866 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-b001200d-2cc2-4851-b40d-9f02b5949f7c req-08731897-e397-42d9-bacc-3c7a8729ee27 service nova] Creating event network-changed:e54d0f2b-04e3-4f2a-b2ad-ca1a7f88a7e9 for instance 712656b5-8470-4486-baf2-1c412846c8fc on n-h2-826756-3 Jul 28 03:37:31.573410 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-b001200d-2cc2-4851-b40d-9f02b5949f7c req-08731897-e397-42d9-bacc-3c7a8729ee27 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065871 Jul 28 03:37:31.574739 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 246/548] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:31.588684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:37:31.591988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:37:31.593300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:37:31.596948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:37:31.597615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:37:31.638429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:31.639288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:31.640923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:31.645922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:31.712244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Getting quotas for project 006f4f23380b45fab24edfea5be8f3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:37:31.731801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Getting quotas for user 15947ba65c714e0dbb60fc36afcb9a9c and project 006f4f23380b45fab24edfea5be8f3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:37:31.785866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:37:31.794215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:37:31.858960 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-213005dd-0c1e-4d65-97b9-f8d06cf4f184 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-94233867", "ram": 512, "vcpus": 1, "disk": 10, "id": 1958785939, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:31.863472 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:31.863472 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:37:31.889333 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-213005dd-0c1e-4d65-97b9-f8d06cf4f184 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.312597 Jul 28 03:37:31.902385 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 247/549] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:37:31 2022] POST /compute/v2.1/flavors => generated 414 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:31.996070 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b4242b7f-8777-4c9e-b6dc-9384f2239680 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.260050 Jul 28 03:37:32.002742 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 303/550] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:37:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:37:32.031365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-776eef32-9020-449a-bb56-b8e91590aa7e tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:32.056750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-776eef32-9020-449a-bb56-b8e91590aa7e tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:32.099082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-776eef32-9020-449a-bb56-b8e91590aa7e tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:32.113661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-776eef32-9020-449a-bb56-b8e91590aa7e tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:32.115657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-776eef32-9020-449a-bb56-b8e91590aa7e tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:32.118347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-776eef32-9020-449a-bb56-b8e91590aa7e tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:32.313442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-776eef32-9020-449a-bb56-b8e91590aa7e tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:32.321691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5003bc8a-a83a-476b-a405-8969ceac81c5 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:32.330668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-776eef32-9020-449a-bb56-b8e91590aa7e tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:32.336161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-776eef32-9020-449a-bb56-b8e91590aa7e tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:32.342861 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-776eef32-9020-449a-bb56-b8e91590aa7e tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.344872 Jul 28 03:37:32.344534 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 304/551] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:31 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:32.352813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93cfe16c-488d-4881-8070-ad382a600348 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:32.359754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93cfe16c-488d-4881-8070-ad382a600348 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:32.369480 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-5003bc8a-a83a-476b-a405-8969ceac81c5 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] HTTP exception thrown: Flavor 1958785939 has no extra specs with key hw:cpu_thread_policy. Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5003bc8a-a83a-476b-a405-8969ceac81c5 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Request method failure captured: Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/flavors/1958785939/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gR5iYiC4LnsyR66CjxhxdwqMPR1s6iaN20NvfehLyn8wihXYJSPNqWdxY2HVPy9FmDTPsuGmuatRZCpfk1IdpfgTFOLmBMbJ9_j0mV_8rb6FSt-X9-19lwb9RLl98gqb92cyiScLgGNh1jPzVBUGr9OEklxp1_c-WN0qH_HtlaOoj0 Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: cc2026234652461087bc1556d9e1f589 Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:37:32.394271 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:37:32.399558 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cc2026234652461087bc1556d9e1f589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cc2026234652461087bc1556d9e1f589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cc2026234652461087bc1556d9e1f589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cc2026234652461087bc1556d9e1f589"}]}] Jul 28 03:37:32.399558 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 Jul 28 03:37:32.399558 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: cc2026234652461087bc1556d9e1f589 Jul 28 03:37:32.399558 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 Jul 28 03:37:32.399558 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project Jul 28 03:37:32.399558 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:37:32.399558 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:37:32.399558 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 5e02e4e4af124ebc991e336976e57e51 Jul 28 03:37:32.399558 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project Jul 28 03:37:32.399558 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:37:32.399558 n-d-826756-3 devstack@n-api.service[126072]: exception: Flavor 1958785939 has no extra specs with key hw:cpu_thread_policy. Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'flavor_id': '1958785939', 'id': 'hw:cpu_thread_policy'} Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1958785939 has no extra specs with key hw:cpu_thread_policy. Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:32.401639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:32.407133 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:32.407133 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:32.407133 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:32.407133 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:37:32.407133 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:37:32.407133 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1958785939 has no extra specs with key hw:cpu_thread_policy. Jul 28 03:37:32.407133 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:32.407133 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5003bc8a-a83a-476b-a405-8969ceac81c5 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Returning 404 to user: Flavor 1958785939 has no extra specs with key hw:cpu_thread_policy. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:37:32.407133 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5003bc8a-a83a-476b-a405-8969ceac81c5 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] 10.222.0.48 "GET /compute/v2.1/flavors/1958785939/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.479037 Jul 28 03:37:32.407133 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 248/552] 10.222.0.48 () {58 vars in 1266 bytes} [Thu Jul 28 03:37:31 2022] GET /compute/v2.1/flavors/1958785939/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 498 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:37:32.416974 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-f2819a0a-a1e5-4ab9-acb6-f23034decf6d req-ee61c752-1c92-4b5b-83f4-e5c11de7bf00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8280d682-4608-420d-8bee-48984a6c1a01", "tag": "fd5a933b-cfed-47cd-bae0-70c895f135ea"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:32.444928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f2819a0a-a1e5-4ab9-acb6-f23034decf6d req-ee61c752-1c92-4b5b-83f4-e5c11de7bf00 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:32.445988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f2819a0a-a1e5-4ab9-acb6-f23034decf6d req-ee61c752-1c92-4b5b-83f4-e5c11de7bf00 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:32.502670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93cfe16c-488d-4881-8070-ad382a600348 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:32.517829 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-f2819a0a-a1e5-4ab9-acb6-f23034decf6d req-ee61c752-1c92-4b5b-83f4-e5c11de7bf00 service nova] Creating event network-changed:fd5a933b-cfed-47cd-bae0-70c895f135ea for instance 8280d682-4608-420d-8bee-48984a6c1a01 on n-h2-826756-3 Jul 28 03:37:32.530370 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-f2819a0a-a1e5-4ab9-acb6-f23034decf6d req-ee61c752-1c92-4b5b-83f4-e5c11de7bf00 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126291 Jul 28 03:37:32.539425 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 249/553] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:32.541471 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93cfe16c-488d-4881-8070-ad382a600348 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1211 microversion: 2.1 time: 0.193498 Jul 28 03:37:32.546251 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 305/554] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:32 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1211 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:32.559469 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8e55b735-1fac-47d7-82ab-0c3f1778e3fe tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:32.567790 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:32.567790 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:37:32.571282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8e55b735-1fac-47d7-82ab-0c3f1778e3fe tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '5e02e4e4af124ebc991e336976e57e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2026234652461087bc1556d9e1f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:32.580181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-928c2cfb-2f58-4487-af47-ec0c7efd8510 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:32.581725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-928c2cfb-2f58-4487-af47-ec0c7efd8510 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8e55b735-1fac-47d7-82ab-0c3f1778e3fe tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Request method failure captured: Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/flavors/1958785939/os-extra_specs HTTP/1.1 Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 66 Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gR5iYiC4LnsyR66CjxhxdwqMPR1s6iaN20NvfehLyn8wihXYJSPNqWdxY2HVPy9FmDTPsuGmuatRZCpfk1IdpfgTFOLmBMbJ9_j0mV_8rb6FSt-X9-19lwb9RLl98gqb92cyiScLgGNh1jPzVBUGr9OEklxp1_c-WN0qH_HtlaOoj0 Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: cc2026234652461087bc1556d9e1f589 Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:37:32.584046 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:37:32.585393 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cc2026234652461087bc1556d9e1f589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cc2026234652461087bc1556d9e1f589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cc2026234652461087bc1556d9e1f589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cc2026234652461087bc1556d9e1f589"}]}] Jul 28 03:37:32.585393 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 Jul 28 03:37:32.585393 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: cc2026234652461087bc1556d9e1f589 Jul 28 03:37:32.585393 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 Jul 28 03:37:32.585393 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project Jul 28 03:37:32.585393 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:37:32.585393 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:37:32.585393 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 5e02e4e4af124ebc991e336976e57e51 Jul 28 03:37:32.585393 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project Jul 28 03:37:32.585393 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:37:32.585393 n-d-826756-3 devstack@n-api.service[126072]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 28 03:37:32.585393 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'flavor_id': '1958785939', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:37:32.586148 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 28 03:37:32.587275 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:32.589344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8e55b735-1fac-47d7-82ab-0c3f1778e3fe tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:37:32.589344 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8e55b735-1fac-47d7-82ab-0c3f1778e3fe tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] 10.222.0.48 "POST /compute/v2.1/flavors/1958785939/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.043150 Jul 28 03:37:32.589344 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 250/555] 10.222.0.48 () {60 vars in 1224 bytes} [Thu Jul 28 03:37:32 2022] POST /compute/v2.1/flavors/1958785939/os-extra_specs => generated 124 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:37:32.612067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-928c2cfb-2f58-4487-af47-ec0c7efd8510 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:32.613108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-61c2c631-1f32-4a8c-b499-5f6b45a5098d tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:32.628499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-928c2cfb-2f58-4487-af47-ec0c7efd8510 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:32.629932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-928c2cfb-2f58-4487-af47-ec0c7efd8510 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:32.630556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-928c2cfb-2f58-4487-af47-ec0c7efd8510 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:32.745487 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-61c2c631-1f32-4a8c-b499-5f6b45a5098d tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1958785939/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.139485 Jul 28 03:37:32.749610 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 251/556] 10.222.0.48 () {60 vars in 1224 bytes} [Thu Jul 28 03:37:32 2022] POST /compute/v2.1/flavors/1958785939/os-extra_specs => generated 66 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:32.775535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ee7c220a-a491-4681-8cf9-f158e5af9de7 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:32.779835 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:32.779835 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:37:32.781361 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ee7c220a-a491-4681-8cf9-f158e5af9de7 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '5e02e4e4af124ebc991e336976e57e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2026234652461087bc1556d9e1f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ee7c220a-a491-4681-8cf9-f158e5af9de7 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Request method failure captured: Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/flavors/1958785939/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gR5iYiC4LnsyR66CjxhxdwqMPR1s6iaN20NvfehLyn8wihXYJSPNqWdxY2HVPy9FmDTPsuGmuatRZCpfk1IdpfgTFOLmBMbJ9_j0mV_8rb6FSt-X9-19lwb9RLl98gqb92cyiScLgGNh1jPzVBUGr9OEklxp1_c-WN0qH_HtlaOoj0 Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: cc2026234652461087bc1556d9e1f589 Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:37:32.783998 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:37:32.785552 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cc2026234652461087bc1556d9e1f589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cc2026234652461087bc1556d9e1f589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cc2026234652461087bc1556d9e1f589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cc2026234652461087bc1556d9e1f589"}]}] Jul 28 03:37:32.785552 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 Jul 28 03:37:32.785552 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: cc2026234652461087bc1556d9e1f589 Jul 28 03:37:32.785552 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 Jul 28 03:37:32.785552 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project Jul 28 03:37:32.785552 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:37:32.785552 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:37:32.785552 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 5e02e4e4af124ebc991e336976e57e51 Jul 28 03:37:32.785552 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project Jul 28 03:37:32.785552 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:37:32.785552 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'flavor_id': '1958785939', 'id': 'hw:numa_nodes'} Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:37:32.786204 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:32.787402 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ee7c220a-a491-4681-8cf9-f158e5af9de7 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:37:32.790407 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ee7c220a-a491-4681-8cf9-f158e5af9de7 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] 10.222.0.48 "DELETE /compute/v2.1/flavors/1958785939/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.022584 Jul 28 03:37:32.791364 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 252/557] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:37:32 2022] DELETE /compute/v2.1/flavors/1958785939/os-extra_specs/hw:numa_nodes => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:37:32.807241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4fce1c4e-7403-45fd-ae3b-26248a96bf33 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:32.864910 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4fce1c4e-7403-45fd-ae3b-26248a96bf33 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors/1958785939/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065148 Jul 28 03:37:32.866622 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 253/558] 10.222.0.48 () {60 vars in 1224 bytes} [Thu Jul 28 03:37:32 2022] POST /compute/v2.1/flavors/1958785939/os-extra_specs => generated 66 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:37:32.889223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b1719206-f5ba-4a57-93fc-a4f344ac8ab6 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:32.909932 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:32.909932 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:37:32.911694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b1719206-f5ba-4a57-93fc-a4f344ac8ab6 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '5e02e4e4af124ebc991e336976e57e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc2026234652461087bc1556d9e1f589', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b1719206-f5ba-4a57-93fc-a4f344ac8ab6 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Request method failure captured: Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: request: PUT /compute/v2.1/flavors/1958785939/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 22 Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gR5iYiC4LnsyR66CjxhxdwqMPR1s6iaN20NvfehLyn8wihXYJSPNqWdxY2HVPy9FmDTPsuGmuatRZCpfk1IdpfgTFOLmBMbJ9_j0mV_8rb6FSt-X9-19lwb9RLl98gqb92cyiScLgGNh1jPzVBUGr9OEklxp1_c-WN0qH_HtlaOoj0 Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: cc2026234652461087bc1556d9e1f589 Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:37:32.914874 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:37:32.916463 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cc2026234652461087bc1556d9e1f589"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cc2026234652461087bc1556d9e1f589"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cc2026234652461087bc1556d9e1f589"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cc2026234652461087bc1556d9e1f589"}]}] Jul 28 03:37:32.916463 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 Jul 28 03:37:32.916463 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: cc2026234652461087bc1556d9e1f589 Jul 28 03:37:32.916463 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 Jul 28 03:37:32.916463 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project Jul 28 03:37:32.916463 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:37:32.916463 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:37:32.916463 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 5e02e4e4af124ebc991e336976e57e51 Jul 28 03:37:32.916463 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project Jul 28 03:37:32.916463 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:37:32.916463 n-d-826756-3 devstack@n-api.service[126072]: {"hw:numa_nodes": "1"} Jul 28 03:37:32.916463 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:37:32.916463 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'flavor_id': '1958785939', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:37:32.917304 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 28 03:37:32.918443 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:32.922481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b1719206-f5ba-4a57-93fc-a4f344ac8ab6 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:37:32.923998 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b1719206-f5ba-4a57-93fc-a4f344ac8ab6 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838 tempest-FlavorsExtraSpecsNegativeTestJSON-936111838-project] 10.222.0.48 "PUT /compute/v2.1/flavors/1958785939/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.048167 Jul 28 03:37:32.928413 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 254/559] 10.222.0.48 () {60 vars in 1265 bytes} [Thu Jul 28 03:37:32 2022] PUT /compute/v2.1/flavors/1958785939/os-extra_specs/hw:numa_nodes => generated 124 bytes in 50 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:37:32.958090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b321d49-6cfb-44d7-9f8c-834c5f15c65e tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:32.990131 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-2b321d49-6cfb-44d7-9f8c-834c5f15c65e tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] HTTP exception thrown: Flavor 1958785939 has no extra specs with key hw:cpu_thread_policy. Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b321d49-6cfb-44d7-9f8c-834c5f15c65e tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] Request method failure captured: Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/flavors/1958785939/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gR72y2p_txyrRNPnrBGnFkJcsVO5CiHLzFGQmdxoa5d2JqXuG5iIQO5mSZSR8wOraQErQ2Db5K83ubKL5bUIVv3kFpYYfO--7CdpLTfvLOTd6s_KI4FP5tbcEtyGzf35brHXcfiJQ7V0Iha-zo5nR8P2cDM6wCUilBNbe8vNyAAfKQ Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 3598c721edce4f4eb593b7e9a0a95821 Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:37:32.999453 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:37:33.002468 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3598c721edce4f4eb593b7e9a0a95821"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3598c721edce4f4eb593b7e9a0a95821"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3598c721edce4f4eb593b7e9a0a95821"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3598c721edce4f4eb593b7e9a0a95821"}]}] Jul 28 03:37:33.002468 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 Jul 28 03:37:33.002468 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 3598c721edce4f4eb593b7e9a0a95821 Jul 28 03:37:33.002468 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 Jul 28 03:37:33.002468 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin Jul 28 03:37:33.002468 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:37:33.002468 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:37:33.002468 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 1d623a404b234f52b5f3cf3382dce329 Jul 28 03:37:33.002468 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin Jul 28 03:37:33.002468 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:37:33.002468 n-d-826756-3 devstack@n-api.service[126072]: exception: Flavor 1958785939 has no extra specs with key hw:cpu_thread_policy. Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'flavor_id': '1958785939', 'id': 'hw:cpu_thread_policy'} Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1958785939 has no extra specs with key hw:cpu_thread_policy. Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:33.003766 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.006409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:33.006409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:33.006409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:33.006409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:37:33.006409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:37:33.006409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1958785939 has no extra specs with key hw:cpu_thread_policy. Jul 28 03:37:33.006409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.009569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b321d49-6cfb-44d7-9f8c-834c5f15c65e tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] Returning 404 to user: Flavor 1958785939 has no extra specs with key hw:cpu_thread_policy. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:37:33.018448 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2b321d49-6cfb-44d7-9f8c-834c5f15c65e tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1958785939/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.074654 Jul 28 03:37:33.021159 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 255/560] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 03:37:32 2022] DELETE /compute/v2.1/flavors/1958785939/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:37:33.034625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-928c2cfb-2f58-4487-af47-ec0c7efd8510 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:33.038279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5f6ad4fe-27d6-40c5-ae99-f3f064241399 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:33.043928 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-5f6ad4fe-27d6-40c5-ae99-f3f064241399 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5f6ad4fe-27d6-40c5-ae99-f3f064241399 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] Request method failure captured: Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: request: PUT /compute/v2.1/flavors/1958785939/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 27 Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gR72y2p_txyrRNPnrBGnFkJcsVO5CiHLzFGQmdxoa5d2JqXuG5iIQO5mSZSR8wOraQErQ2Db5K83ubKL5bUIVv3kFpYYfO--7CdpLTfvLOTd6s_KI4FP5tbcEtyGzf35brHXcfiJQ7V0Iha-zo5nR8P2cDM6wCUilBNbe8vNyAAfKQ Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 3598c721edce4f4eb593b7e9a0a95821 Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:37:33.056017 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:37:33.058521 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3598c721edce4f4eb593b7e9a0a95821"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3598c721edce4f4eb593b7e9a0a95821"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3598c721edce4f4eb593b7e9a0a95821"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3598c721edce4f4eb593b7e9a0a95821"}]}] Jul 28 03:37:33.058521 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 Jul 28 03:37:33.058521 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 3598c721edce4f4eb593b7e9a0a95821 Jul 28 03:37:33.058521 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 Jul 28 03:37:33.058521 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin Jul 28 03:37:33.058521 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:37:33.058521 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:37:33.058521 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 1d623a404b234f52b5f3cf3382dce329 Jul 28 03:37:33.058521 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin Jul 28 03:37:33.058521 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:37:33.058521 n-d-826756-3 devstack@n-api.service[126072]: {"hw:cpu_policy": "shared"} Jul 28 03:37:33.058521 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:37:33.058521 n-d-826756-3 devstack@n-api.service[126072]: exception: Request body and URI mismatch Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'flavor_id': '1958785939', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:33.060317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:33.061533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:37:33.061533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:37:33.061533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 28 03:37:33.061533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.064446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-928c2cfb-2f58-4487-af47-ec0c7efd8510 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:33.064704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5f6ad4fe-27d6-40c5-ae99-f3f064241399 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:37:33.066220 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5f6ad4fe-27d6-40c5-ae99-f3f064241399 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1958785939/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.037513 Jul 28 03:37:33.067142 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 256/561] 10.222.0.48 () {60 vars in 1265 bytes} [Thu Jul 28 03:37:33 2022] PUT /compute/v2.1/flavors/1958785939/os-extra_specs/hw:numa_nodes => generated 73 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 28 03:37:33.076082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-928c2cfb-2f58-4487-af47-ec0c7efd8510 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:33.077967 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-928c2cfb-2f58-4487-af47-ec0c7efd8510 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1362 microversion: 2.25 time: 0.530168 Jul 28 03:37:33.079189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5a2812a5-49d3-4a3d-b528-fbc72cc69744 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:33.083292 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 306/562] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:32 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1362 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5a2812a5-49d3-4a3d-b528-fbc72cc69744 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] Request method failure captured: Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: request: PUT /compute/v2.1/flavors/1958785939/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 49 Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gR72y2p_txyrRNPnrBGnFkJcsVO5CiHLzFGQmdxoa5d2JqXuG5iIQO5mSZSR8wOraQErQ2Db5K83ubKL5bUIVv3kFpYYfO--7CdpLTfvLOTd6s_KI4FP5tbcEtyGzf35brHXcfiJQ7V0Iha-zo5nR8P2cDM6wCUilBNbe8vNyAAfKQ Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 3598c721edce4f4eb593b7e9a0a95821 Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:37:33.089998 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:37:33.091445 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3598c721edce4f4eb593b7e9a0a95821"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3598c721edce4f4eb593b7e9a0a95821"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3598c721edce4f4eb593b7e9a0a95821"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3598c721edce4f4eb593b7e9a0a95821"}]}] Jul 28 03:37:33.091445 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 Jul 28 03:37:33.091445 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 3598c721edce4f4eb593b7e9a0a95821 Jul 28 03:37:33.091445 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 Jul 28 03:37:33.091445 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin Jul 28 03:37:33.091445 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:37:33.091445 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:37:33.091445 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 1d623a404b234f52b5f3cf3382dce329 Jul 28 03:37:33.091445 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin Jul 28 03:37:33.091445 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:37:33.091445 n-d-826756-3 devstack@n-api.service[126072]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 28 03:37:33.091445 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'flavor_id': '1958785939', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance: Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 28 03:37:33.092167 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.093545 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:37:33.095350 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:37:33.095350 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:37:33.095350 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:37:33.095350 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:37:33.095350 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 28 03:37:33.095350 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:37:33.097549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5a2812a5-49d3-4a3d-b528-fbc72cc69744 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:37:33.098782 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5a2812a5-49d3-4a3d-b528-fbc72cc69744 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] 10.222.0.48 "PUT /compute/v2.1/flavors/1958785939/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.026190 Jul 28 03:37:33.100065 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 257/563] 10.222.0.48 () {60 vars in 1265 bytes} [Thu Jul 28 03:37:33 2022] PUT /compute/v2.1/flavors/1958785939/os-extra_specs/hw:numa_nodes => generated 117 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:37:33.111736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d087fe82-996c-467b-a310-fd0513a3967f tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:33.113321 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:33.113321 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:33.154222 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d087fe82-996c-467b-a310-fd0513a3967f tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/1958785939" status: 202 len: 0 microversion: 2.1 time: 0.047237 Jul 28 03:37:33.170168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-21fbb9c3-bb2c-42d1-9620-e39271af1540 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:33.178287 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 307/564] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:37:33 2022] DELETE /compute/v2.1/flavors/1958785939 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:37:33.196967 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-21fbb9c3-bb2c-42d1-9620-e39271af1540 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211 tempest-FlavorsExtraSpecsNegativeTestJSON-717423211-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.034813 Jul 28 03:37:33.197842 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 258/565] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:37:33 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:33.389354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-81db18aa-b9dc-418c-a457-afac862d3011 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:33.390305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-81db18aa-b9dc-418c-a457-afac862d3011 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:33.411397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81db18aa-b9dc-418c-a457-afac862d3011 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:33.411688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81db18aa-b9dc-418c-a457-afac862d3011 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:33.412888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81db18aa-b9dc-418c-a457-afac862d3011 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:33.415463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81db18aa-b9dc-418c-a457-afac862d3011 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:33.571684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8b3e3e71-3d09-4351-ba91-d5c6724e720d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:33.573044 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8b3e3e71-3d09-4351-ba91-d5c6724e720d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:33.600446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b3e3e71-3d09-4351-ba91-d5c6724e720d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:33.601668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b3e3e71-3d09-4351-ba91-d5c6724e720d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:33.611822 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b3e3e71-3d09-4351-ba91-d5c6724e720d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:33.612744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b3e3e71-3d09-4351-ba91-d5c6724e720d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:33.690875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-81db18aa-b9dc-418c-a457-afac862d3011 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:33.723192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-81db18aa-b9dc-418c-a457-afac862d3011 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:33.729380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-81db18aa-b9dc-418c-a457-afac862d3011 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:33.753861 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-81db18aa-b9dc-418c-a457-afac862d3011 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.369862 Jul 28 03:37:33.756101 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 308/566] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:33 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:33.838707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8b3e3e71-3d09-4351-ba91-d5c6724e720d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:33.857013 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8b3e3e71-3d09-4351-ba91-d5c6724e720d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1207 microversion: 2.1 time: 0.292541 Jul 28 03:37:33.860294 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 259/567] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:33 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1207 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:34.115077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b26d38fe-28c9-40d7-ac22-f94939e736e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:34.115677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b26d38fe-28c9-40d7-ac22-f94939e736e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:34.128057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b26d38fe-28c9-40d7-ac22-f94939e736e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:34.128539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b26d38fe-28c9-40d7-ac22-f94939e736e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:34.129474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b26d38fe-28c9-40d7-ac22-f94939e736e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:34.129917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b26d38fe-28c9-40d7-ac22-f94939e736e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:34.700702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b26d38fe-28c9-40d7-ac22-f94939e736e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:34.718993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b26d38fe-28c9-40d7-ac22-f94939e736e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:34.723199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b26d38fe-28c9-40d7-ac22-f94939e736e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:34.725886 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b26d38fe-28c9-40d7-ac22-f94939e736e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1362 microversion: 2.25 time: 0.614746 Jul 28 03:37:34.726921 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 309/568] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:34 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1362 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:34.779885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e61f35bc-6498-480b-895c-401f23debb8d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:34.780574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e61f35bc-6498-480b-895c-401f23debb8d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:34.789324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e61f35bc-6498-480b-895c-401f23debb8d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:34.789835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e61f35bc-6498-480b-895c-401f23debb8d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:34.790547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e61f35bc-6498-480b-895c-401f23debb8d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:34.792083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e61f35bc-6498-480b-895c-401f23debb8d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:34.883192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc040319-2aa0-4ac3-b133-fc456bd5224f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:34.883930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dc040319-2aa0-4ac3-b133-fc456bd5224f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:34.890860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc040319-2aa0-4ac3-b133-fc456bd5224f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:34.891436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc040319-2aa0-4ac3-b133-fc456bd5224f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:34.892153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc040319-2aa0-4ac3-b133-fc456bd5224f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:34.892702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc040319-2aa0-4ac3-b133-fc456bd5224f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:34.925803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e61f35bc-6498-480b-895c-401f23debb8d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:34.937987 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e61f35bc-6498-480b-895c-401f23debb8d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:34.940695 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e61f35bc-6498-480b-895c-401f23debb8d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:34.947699 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e61f35bc-6498-480b-895c-401f23debb8d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.171742 Jul 28 03:37:34.961512 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 260/569] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:34 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:34.979289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dc040319-2aa0-4ac3-b133-fc456bd5224f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:34.990693 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc040319-2aa0-4ac3-b133-fc456bd5224f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1269 microversion: 2.1 time: 0.111213 Jul 28 03:37:34.991640 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 310/570] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:34 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1269 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:35.754831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ae010b3c-bb3b-4bf3-a8fa-dc9392a80e3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:35.756589 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ae010b3c-bb3b-4bf3-a8fa-dc9392a80e3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:35.765755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae010b3c-bb3b-4bf3-a8fa-dc9392a80e3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:35.766193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae010b3c-bb3b-4bf3-a8fa-dc9392a80e3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:35.768005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae010b3c-bb3b-4bf3-a8fa-dc9392a80e3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:35.768659 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae010b3c-bb3b-4bf3-a8fa-dc9392a80e3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:35.977045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7922ea7d-0b3f-4b24-af16-332b4287faee tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:35.978334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7922ea7d-0b3f-4b24-af16-332b4287faee tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:35.987403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7922ea7d-0b3f-4b24-af16-332b4287faee tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:35.988114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7922ea7d-0b3f-4b24-af16-332b4287faee tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:35.989081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7922ea7d-0b3f-4b24-af16-332b4287faee tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:35.991669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7922ea7d-0b3f-4b24-af16-332b4287faee tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:36.045812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ae010b3c-bb3b-4bf3-a8fa-dc9392a80e3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:36.070124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ae010b3c-bb3b-4bf3-a8fa-dc9392a80e3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:36.072164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ae010b3c-bb3b-4bf3-a8fa-dc9392a80e3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:36.079706 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ae010b3c-bb3b-4bf3-a8fa-dc9392a80e3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1362 microversion: 2.25 time: 0.331621 Jul 28 03:37:36.084424 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 261/571] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:35 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:36.102539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fc39506e-bb6d-43ee-8435-f7aa95e6c159 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:36.103549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fc39506e-bb6d-43ee-8435-f7aa95e6c159 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:36.108225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=81,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:36.118868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc39506e-bb6d-43ee-8435-f7aa95e6c159 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:36.119517 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc39506e-bb6d-43ee-8435-f7aa95e6c159 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:36.120514 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc39506e-bb6d-43ee-8435-f7aa95e6c159 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:36.121126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc39506e-bb6d-43ee-8435-f7aa95e6c159 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:36.235146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7922ea7d-0b3f-4b24-af16-332b4287faee tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:36.255773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7922ea7d-0b3f-4b24-af16-332b4287faee tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:36.257506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7922ea7d-0b3f-4b24-af16-332b4287faee tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:36.284807 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7922ea7d-0b3f-4b24-af16-332b4287faee tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.312057 Jul 28 03:37:36.290993 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 311/572] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:35 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:36.559275 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fc39506e-bb6d-43ee-8435-f7aa95e6c159 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:36.575031 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fc39506e-bb6d-43ee-8435-f7aa95e6c159 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1311 microversion: 2.1 time: 0.484761 Jul 28 03:37:36.580110 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 262/573] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:36 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1311 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:37.111637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aef490bc-5ffa-410e-a318-74bb2f780774 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:37.114680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aef490bc-5ffa-410e-a318-74bb2f780774 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:37.134737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aef490bc-5ffa-410e-a318-74bb2f780774 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:37.135314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aef490bc-5ffa-410e-a318-74bb2f780774 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:37.141195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aef490bc-5ffa-410e-a318-74bb2f780774 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:37.144118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aef490bc-5ffa-410e-a318-74bb2f780774 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:37.317436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-75c84bcf-5d3b-41ab-88a8-566273c6c6b9 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:37.318812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-75c84bcf-5d3b-41ab-88a8-566273c6c6b9 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:37.340633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75c84bcf-5d3b-41ab-88a8-566273c6c6b9 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:37.341332 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75c84bcf-5d3b-41ab-88a8-566273c6c6b9 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:37.342326 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75c84bcf-5d3b-41ab-88a8-566273c6c6b9 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:37.342751 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75c84bcf-5d3b-41ab-88a8-566273c6c6b9 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:37.510178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-75c84bcf-5d3b-41ab-88a8-566273c6c6b9 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:37.554468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-75c84bcf-5d3b-41ab-88a8-566273c6c6b9 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:37.562319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-75c84bcf-5d3b-41ab-88a8-566273c6c6b9 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:37.570535 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-75c84bcf-5d3b-41ab-88a8-566273c6c6b9 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.257015 Jul 28 03:37:37.576975 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 263/574] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:37 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:37:37.584683 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-9156e098-037c-497c-ad67-db0bd0736c05 req-e008e7f8-6faf-46ee-8141-03143d5a8466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cda1bf7-ab8a-4567-a8d6-54697a316461", "tag": "c89c0e09-fda3-4512-826c-85a6f08cc121"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:37.631063 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9156e098-037c-497c-ad67-db0bd0736c05 req-e008e7f8-6faf-46ee-8141-03143d5a8466 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:37.631751 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9156e098-037c-497c-ad67-db0bd0736c05 req-e008e7f8-6faf-46ee-8141-03143d5a8466 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:37.664641 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-9156e098-037c-497c-ad67-db0bd0736c05 req-e008e7f8-6faf-46ee-8141-03143d5a8466 service nova] Creating event network-changed:c89c0e09-fda3-4512-826c-85a6f08cc121 for instance 2cda1bf7-ab8a-4567-a8d6-54697a316461 on n-h1-826756-3 Jul 28 03:37:37.676537 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-9156e098-037c-497c-ad67-db0bd0736c05 req-e008e7f8-6faf-46ee-8141-03143d5a8466 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098025 Jul 28 03:37:37.677409 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 264/575] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:37.687110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-736a556c-f7c0-43c6-b32b-e67f04c85746 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:37.697166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-736a556c-f7c0-43c6-b32b-e67f04c85746 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:37.732391 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-736a556c-f7c0-43c6-b32b-e67f04c85746 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:37.734451 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-736a556c-f7c0-43c6-b32b-e67f04c85746 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:37.736808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-736a556c-f7c0-43c6-b32b-e67f04c85746 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:37.741710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-736a556c-f7c0-43c6-b32b-e67f04c85746 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:37.758592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aef490bc-5ffa-410e-a318-74bb2f780774 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:37.774698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aef490bc-5ffa-410e-a318-74bb2f780774 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:37.779327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aef490bc-5ffa-410e-a318-74bb2f780774 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:37.780388 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aef490bc-5ffa-410e-a318-74bb2f780774 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1362 microversion: 2.25 time: 0.677156 Jul 28 03:37:37.785908 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 312/576] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:37 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1362 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:38.158534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-736a556c-f7c0-43c6-b32b-e67f04c85746 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:38.178684 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-736a556c-f7c0-43c6-b32b-e67f04c85746 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1311 microversion: 2.1 time: 0.498872 Jul 28 03:37:38.210785 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 265/577] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:37 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1311 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:38.408765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a133251c-9320-4b39-808a-f5fd816883de req-40ff633e-7fe6-4723-968a-d6295b752c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712656b5-8470-4486-baf2-1c412846c8fc", "name": "network-vif-plugged", "status": "completed", "tag": "e54d0f2b-04e3-4f2a-b2ad-ca1a7f88a7e9"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:38.426090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a133251c-9320-4b39-808a-f5fd816883de req-40ff633e-7fe6-4723-968a-d6295b752c5a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:38.428526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a133251c-9320-4b39-808a-f5fd816883de req-40ff633e-7fe6-4723-968a-d6295b752c5a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:38.478725 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a133251c-9320-4b39-808a-f5fd816883de req-40ff633e-7fe6-4723-968a-d6295b752c5a service nova] Creating event network-vif-plugged:e54d0f2b-04e3-4f2a-b2ad-ca1a7f88a7e9 for instance 712656b5-8470-4486-baf2-1c412846c8fc on n-h2-826756-3 Jul 28 03:37:38.494694 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a133251c-9320-4b39-808a-f5fd816883de req-40ff633e-7fe6-4723-968a-d6295b752c5a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090028 Jul 28 03:37:38.496338 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 313/578] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:38.611918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c5fbad4e-52cb-49f3-a6a5-c2819a5cd11c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:38.613355 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c5fbad4e-52cb-49f3-a6a5-c2819a5cd11c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:38.621228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5fbad4e-52cb-49f3-a6a5-c2819a5cd11c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:38.622104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5fbad4e-52cb-49f3-a6a5-c2819a5cd11c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:38.623135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5fbad4e-52cb-49f3-a6a5-c2819a5cd11c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:38.623634 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5fbad4e-52cb-49f3-a6a5-c2819a5cd11c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:38.763407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c5fbad4e-52cb-49f3-a6a5-c2819a5cd11c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:38.776229 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c5fbad4e-52cb-49f3-a6a5-c2819a5cd11c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:38.778630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c5fbad4e-52cb-49f3-a6a5-c2819a5cd11c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:38.785838 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c5fbad4e-52cb-49f3-a6a5-c2819a5cd11c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.179905 Jul 28 03:37:38.788179 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 266/579] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:38 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:38.813472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3775f210-adee-429d-bf64-ead9c9cdbf01 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:38.814417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3775f210-adee-429d-bf64-ead9c9cdbf01 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:38.837580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3775f210-adee-429d-bf64-ead9c9cdbf01 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:38.838244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3775f210-adee-429d-bf64-ead9c9cdbf01 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:38.839320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3775f210-adee-429d-bf64-ead9c9cdbf01 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:38.839985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3775f210-adee-429d-bf64-ead9c9cdbf01 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:38.896854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:39.205259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3775f210-adee-429d-bf64-ead9c9cdbf01 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:39.216814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3775f210-adee-429d-bf64-ead9c9cdbf01 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:39.218347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3775f210-adee-429d-bf64-ead9c9cdbf01 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:39.219509 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3775f210-adee-429d-bf64-ead9c9cdbf01 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1362 microversion: 2.25 time: 0.413059 Jul 28 03:37:39.220465 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 314/580] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:38 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1362 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:39.224525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bc85c8cf-36bf-482f-b686-be5687439aab tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:39.226647 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bc85c8cf-36bf-482f-b686-be5687439aab tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:39.242026 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc85c8cf-36bf-482f-b686-be5687439aab tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:39.243457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc85c8cf-36bf-482f-b686-be5687439aab tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:39.247678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc85c8cf-36bf-482f-b686-be5687439aab tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:39.248899 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc85c8cf-36bf-482f-b686-be5687439aab tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:39.303738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3775f210-adee-429d-bf64-ead9c9cdbf01 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:39.305565 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3775f210-adee-429d-bf64-ead9c9cdbf01 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002274 Jul 28 03:37:39.306659 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 315/581] 10.222.0.48 () {56 vars in 886 bytes} [Thu Jul 28 03:37:39 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 28 03:37:39.564909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bc85c8cf-36bf-482f-b686-be5687439aab tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:39.587299 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bc85c8cf-36bf-482f-b686-be5687439aab tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1311 microversion: 2.1 time: 0.383655 Jul 28 03:37:39.589048 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 267/582] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:39 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1311 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:39.824863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e8646b9-6c19-4186-9f6f-0df511eaba5b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:39.825530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4e8646b9-6c19-4186-9f6f-0df511eaba5b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:39.836918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e8646b9-6c19-4186-9f6f-0df511eaba5b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:39.837577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e8646b9-6c19-4186-9f6f-0df511eaba5b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:39.849597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e8646b9-6c19-4186-9f6f-0df511eaba5b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:39.850387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e8646b9-6c19-4186-9f6f-0df511eaba5b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:40.100980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e8646b9-6c19-4186-9f6f-0df511eaba5b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:40.122017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e8646b9-6c19-4186-9f6f-0df511eaba5b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:40.125588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e8646b9-6c19-4186-9f6f-0df511eaba5b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:40.135083 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e8646b9-6c19-4186-9f6f-0df511eaba5b tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.313963 Jul 28 03:37:40.136569 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 316/583] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:39 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:40.261455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-19e26a72-0e60-4df4-aead-639988b6ba5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:40.262123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-19e26a72-0e60-4df4-aead-639988b6ba5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:40.272850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-19e26a72-0e60-4df4-aead-639988b6ba5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:40.273455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-19e26a72-0e60-4df4-aead-639988b6ba5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:40.274637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-19e26a72-0e60-4df4-aead-639988b6ba5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:40.275268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-19e26a72-0e60-4df4-aead-639988b6ba5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:40.619818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9cf3de04-4ed9-42d9-b53a-6d00f0b1dd3c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:40.622686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9cf3de04-4ed9-42d9-b53a-6d00f0b1dd3c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:40.657192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cf3de04-4ed9-42d9-b53a-6d00f0b1dd3c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:40.658222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cf3de04-4ed9-42d9-b53a-6d00f0b1dd3c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:40.660784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cf3de04-4ed9-42d9-b53a-6d00f0b1dd3c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:40.664580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cf3de04-4ed9-42d9-b53a-6d00f0b1dd3c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:40.699913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-19e26a72-0e60-4df4-aead-639988b6ba5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:40.725075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-19e26a72-0e60-4df4-aead-639988b6ba5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:40.728119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-19e26a72-0e60-4df4-aead-639988b6ba5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:40.731513 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-19e26a72-0e60-4df4-aead-639988b6ba5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1362 microversion: 2.25 time: 0.472023 Jul 28 03:37:40.733675 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 268/584] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:40 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1362 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:40.956698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9cf3de04-4ed9-42d9-b53a-6d00f0b1dd3c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:40.965597 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9cf3de04-4ed9-42d9-b53a-6d00f0b1dd3c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1311 microversion: 2.1 time: 0.356364 Jul 28 03:37:40.966271 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 317/585] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:40 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1311 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:41.167420 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-40cd1095-1440-4e45-874e-6edbd71f0baa tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:41.169502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-40cd1095-1440-4e45-874e-6edbd71f0baa tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:41.199783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40cd1095-1440-4e45-874e-6edbd71f0baa tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:41.201492 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40cd1095-1440-4e45-874e-6edbd71f0baa tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:41.203028 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40cd1095-1440-4e45-874e-6edbd71f0baa tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:41.204324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40cd1095-1440-4e45-874e-6edbd71f0baa tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:41.324100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-40cd1095-1440-4e45-874e-6edbd71f0baa tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:41.337728 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-40cd1095-1440-4e45-874e-6edbd71f0baa tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:41.339270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-40cd1095-1440-4e45-874e-6edbd71f0baa tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:41.354914 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-40cd1095-1440-4e45-874e-6edbd71f0baa tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.198576 Jul 28 03:37:41.356638 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 269/586] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:41 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:41.773677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2c6d7aa-e81f-482e-a234-a2cfee93b1a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:41.774427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2c6d7aa-e81f-482e-a234-a2cfee93b1a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:41.778361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:41.792196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2c6d7aa-e81f-482e-a234-a2cfee93b1a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:41.794630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2c6d7aa-e81f-482e-a234-a2cfee93b1a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:41.796107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2c6d7aa-e81f-482e-a234-a2cfee93b1a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:41.798324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2c6d7aa-e81f-482e-a234-a2cfee93b1a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:41.999774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-91fd08b6-c47e-4651-8fe0-3c41641395dd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:42.003622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-91fd08b6-c47e-4651-8fe0-3c41641395dd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:42.059706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-91fd08b6-c47e-4651-8fe0-3c41641395dd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:42.065155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-91fd08b6-c47e-4651-8fe0-3c41641395dd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:42.074657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-91fd08b6-c47e-4651-8fe0-3c41641395dd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:42.076279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-91fd08b6-c47e-4651-8fe0-3c41641395dd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:42.246931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b2c6d7aa-e81f-482e-a234-a2cfee93b1a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:42.261873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b2c6d7aa-e81f-482e-a234-a2cfee93b1a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:42.278969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b2c6d7aa-e81f-482e-a234-a2cfee93b1a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:42.280818 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b2c6d7aa-e81f-482e-a234-a2cfee93b1a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1559 microversion: 2.25 time: 0.511778 Jul 28 03:37:42.285370 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 318/587] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:41 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1559 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:42.471617 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-91fd08b6-c47e-4651-8fe0-3c41641395dd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:42.487086 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-91fd08b6-c47e-4651-8fe0-3c41641395dd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1311 microversion: 2.1 time: 0.498631 Jul 28 03:37:42.508812 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 270/588] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:41 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1311 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:42.520578 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-82535380-8008-49fc-a9a7-4d087ba6b62a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:42.523578 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-82535380-8008-49fc-a9a7-4d087ba6b62a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:42.529077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:42.543350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-82535380-8008-49fc-a9a7-4d087ba6b62a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:42.559203 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-82535380-8008-49fc-a9a7-4d087ba6b62a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:42.560846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-82535380-8008-49fc-a9a7-4d087ba6b62a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:42.561448 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-82535380-8008-49fc-a9a7-4d087ba6b62a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:42.708093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-82535380-8008-49fc-a9a7-4d087ba6b62a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:42.725576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-82535380-8008-49fc-a9a7-4d087ba6b62a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:42.730257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-82535380-8008-49fc-a9a7-4d087ba6b62a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:42.740068 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-82535380-8008-49fc-a9a7-4d087ba6b62a tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.229769 Jul 28 03:37:42.742140 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 271/589] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:42 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:42.967994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dda0d9f4-a09d-46e4-a5d0-1f6704fcf9ff tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:42.968657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dda0d9f4-a09d-46e4-a5d0-1f6704fcf9ff tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:42.980220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dda0d9f4-a09d-46e4-a5d0-1f6704fcf9ff tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:42.983360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dda0d9f4-a09d-46e4-a5d0-1f6704fcf9ff tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:42.986628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dda0d9f4-a09d-46e4-a5d0-1f6704fcf9ff tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:42.993043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dda0d9f4-a09d-46e4-a5d0-1f6704fcf9ff tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:43.133519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-602843852", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "25ef7f60-e0d8-490c-a4ac-ff68400c4970"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:43.202759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] validate_networks() for [('25ef7f60-e0d8-490c-a4ac-ff68400c4970', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:37:43.273132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-dda0d9f4-a09d-46e4-a5d0-1f6704fcf9ff tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid 712656b5-8470-4486-baf2-1c412846c8fc {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:37:43.348044 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dda0d9f4-a09d-46e4-a5d0-1f6704fcf9ff tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 2052 microversion: 2.25 time: 1.038692 Jul 28 03:37:43.360622 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 319/590] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:42 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 2052 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:43.371102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-11802028-28e0-4f7c-b676-46c670a5dbe8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:43.371847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-11802028-28e0-4f7c-b676-46c670a5dbe8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:43.381359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11802028-28e0-4f7c-b676-46c670a5dbe8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:43.381750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11802028-28e0-4f7c-b676-46c670a5dbe8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:43.384118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11802028-28e0-4f7c-b676-46c670a5dbe8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:43.389824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11802028-28e0-4f7c-b676-46c670a5dbe8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:43.569984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-11802028-28e0-4f7c-b676-46c670a5dbe8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid 712656b5-8470-4486-baf2-1c412846c8fc {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:37:43.586571 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-11802028-28e0-4f7c-b676-46c670a5dbe8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 2052 microversion: 2.25 time: 0.219355 Jul 28 03:37:43.587483 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 320/591] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:43 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 2052 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:43.603518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0782455-0a2b-4d22-a102-39d898d89e54 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:43.604918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e0782455-0a2b-4d22-a102-39d898d89e54 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:43.617280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0782455-0a2b-4d22-a102-39d898d89e54 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:43.618286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0782455-0a2b-4d22-a102-39d898d89e54 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:43.619402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0782455-0a2b-4d22-a102-39d898d89e54 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:43.619922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0782455-0a2b-4d22-a102-39d898d89e54 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:43.828454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e0782455-0a2b-4d22-a102-39d898d89e54 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:43.831469 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:37:43.837037 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:37:43.837565 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:37:43.837972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:37:43.838301 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e0782455-0a2b-4d22-a102-39d898d89e54 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1311 microversion: 2.1 time: 0.248550 Jul 28 03:37:43.838404 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:37:43.842467 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 321/592] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:43 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1311 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:43.848135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-313e9a0c-3cc9-4339-a0ec-e36269521ce8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:43.850945 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:43.850945 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:43.852183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-313e9a0c-3cc9-4339-a0ec-e36269521ce8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:43.858350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-313e9a0c-3cc9-4339-a0ec-e36269521ce8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:43.859596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-313e9a0c-3cc9-4339-a0ec-e36269521ce8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:43.860039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-313e9a0c-3cc9-4339-a0ec-e36269521ce8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:43.863108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:43.863521 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:43.864303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:43.864762 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:43.873292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:43.892241 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-313e9a0c-3cc9-4339-a0ec-e36269521ce8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.048315 Jul 28 03:37:43.893251 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 322/593] 10.222.0.48 () {60 vars in 1217 bytes} [Thu Jul 28 03:37:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:37:43.897921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a857109-22bb-4d42-a135-46b30e098af3 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:43.898268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Getting quotas for project 84ec6bcd01c4410c8193820cfdd2367c. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:37:43.898525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8a857109-22bb-4d42-a135-46b30e098af3 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:43.905955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a857109-22bb-4d42-a135-46b30e098af3 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:43.906387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a857109-22bb-4d42-a135-46b30e098af3 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:43.907182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a857109-22bb-4d42-a135-46b30e098af3 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:43.907615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a857109-22bb-4d42-a135-46b30e098af3 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:43.908943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Getting quotas for user b17befcacdd14330be582e67c50e2c79 and project 84ec6bcd01c4410c8193820cfdd2367c. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:37:43.934326 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:37:43.936682 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:37:44.000185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a857109-22bb-4d42-a135-46b30e098af3 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:44.013173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a857109-22bb-4d42-a135-46b30e098af3 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:44.017743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a857109-22bb-4d42-a135-46b30e098af3 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:44.026702 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a857109-22bb-4d42-a135-46b30e098af3 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.131974 Jul 28 03:37:44.027078 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d266d19b-fec0-4d55-bd25-f6162049d4dc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008662 Jul 28 03:37:44.027781 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 323/594] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:43 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:44.040064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-33dcba5d-cfd4-44cb-a36b-97282ac71970 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-826756-3", "block_migration": "auto"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:44.041125 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 272/595] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:37:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:37:44.046727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-33dcba5d-cfd4-44cb-a36b-97282ac71970 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:44.056874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-34d003e4-2a8c-4b1f-b5ab-05202e03bef2 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:44.057567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-34d003e4-2a8c-4b1f-b5ab-05202e03bef2 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:44.075181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33dcba5d-cfd4-44cb-a36b-97282ac71970 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:44.076030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33dcba5d-cfd4-44cb-a36b-97282ac71970 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:44.078705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33dcba5d-cfd4-44cb-a36b-97282ac71970 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:44.084076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33dcba5d-cfd4-44cb-a36b-97282ac71970 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:44.227431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-34d003e4-2a8c-4b1f-b5ab-05202e03bef2 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:44.234938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-33dcba5d-cfd4-44cb-a36b-97282ac71970 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'flavor' on Instance uuid 712656b5-8470-4486-baf2-1c412846c8fc {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:37:44.262554 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-34d003e4-2a8c-4b1f-b5ab-05202e03bef2 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1231 microversion: 2.1 time: 0.219599 Jul 28 03:37:44.270371 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 273/596] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:44 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1231 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:44.294201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-86c0e546-98fb-4835-9c86-83b9fea15627 req-01c26033-5c06-41f3-9b32-1fe7e2741f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cda1bf7-ab8a-4567-a8d6-54697a316461", "name": "network-vif-plugged", "status": "completed", "tag": "c89c0e09-fda3-4512-826c-85a6f08cc121"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:44.312705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-33dcba5d-cfd4-44cb-a36b-97282ac71970 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Going to try to live migrate instance to n-h1-826756-3 {{(pid=126071) live_migrate /opt/stack/nova/nova/compute/api.py:5474}} Jul 28 03:37:44.324291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-86c0e546-98fb-4835-9c86-83b9fea15627 req-01c26033-5c06-41f3-9b32-1fe7e2741f89 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:44.325064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-86c0e546-98fb-4835-9c86-83b9fea15627 req-01c26033-5c06-41f3-9b32-1fe7e2741f89 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:44.360475 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-86c0e546-98fb-4835-9c86-83b9fea15627 req-01c26033-5c06-41f3-9b32-1fe7e2741f89 service nova] Creating event network-vif-plugged:c89c0e09-fda3-4512-826c-85a6f08cc121 for instance 2cda1bf7-ab8a-4567-a8d6-54697a316461 on n-h1-826756-3 Jul 28 03:37:44.374022 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-86c0e546-98fb-4835-9c86-83b9fea15627 req-01c26033-5c06-41f3-9b32-1fe7e2741f89 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099349 Jul 28 03:37:44.375997 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 274/597] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:44.875358 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9a43f28a-be60-47d3-bd8d-046d84cb61d9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:44.877435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9a43f28a-be60-47d3-bd8d-046d84cb61d9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:44.894615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a43f28a-be60-47d3-bd8d-046d84cb61d9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:44.895297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a43f28a-be60-47d3-bd8d-046d84cb61d9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:44.896300 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a43f28a-be60-47d3-bd8d-046d84cb61d9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:44.897045 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a43f28a-be60-47d3-bd8d-046d84cb61d9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:44.904133 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:45.109012 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9a43f28a-be60-47d3-bd8d-046d84cb61d9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:45.123294 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9a43f28a-be60-47d3-bd8d-046d84cb61d9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1311 microversion: 2.1 time: 0.262916 Jul 28 03:37:45.124596 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 275/598] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:44 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1311 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:45.321870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1960722382", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:45.397434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:37:45.678928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:37:45.679632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:37:45.680482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:37:45.681201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:37:45.681909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:37:45.697225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:45.697965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:45.699241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:45.700155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:45.734506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Getting quotas for project 391141504bc0471d932aa2799c28721c. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:37:45.744826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Getting quotas for user 07f281c9665e45529130d241ea5f4a84 and project 391141504bc0471d932aa2799c28721c. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:37:45.768449 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:37:45.772754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:37:45.830959 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-18dd0cab-afbb-4470-aea8-19d338b721e0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704370 Jul 28 03:37:45.831973 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 276/599] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:37:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:37:45.840516 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-52855ff7-f383-43ed-90e4-e14d22f94893 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:45.841456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-52855ff7-f383-43ed-90e4-e14d22f94893 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:45.849541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52855ff7-f383-43ed-90e4-e14d22f94893 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:45.850900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52855ff7-f383-43ed-90e4-e14d22f94893 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:45.853298 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52855ff7-f383-43ed-90e4-e14d22f94893 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:45.854087 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52855ff7-f383-43ed-90e4-e14d22f94893 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:46.046612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-52855ff7-f383-43ed-90e4-e14d22f94893 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:46.066096 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-52855ff7-f383-43ed-90e4-e14d22f94893 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:46.067988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-52855ff7-f383-43ed-90e4-e14d22f94893 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:46.077368 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-52855ff7-f383-43ed-90e4-e14d22f94893 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1446 microversion: 2.75 time: 0.243076 Jul 28 03:37:46.093321 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 277/600] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:45 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1446 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:46.097243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-76682dc3-5c92-453f-b296-b9ae10409298 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:46.098075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-76682dc3-5c92-453f-b296-b9ae10409298 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:46.120425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76682dc3-5c92-453f-b296-b9ae10409298 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:46.121076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76682dc3-5c92-453f-b296-b9ae10409298 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:46.122414 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76682dc3-5c92-453f-b296-b9ae10409298 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:46.123024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76682dc3-5c92-453f-b296-b9ae10409298 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:46.345875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-76682dc3-5c92-453f-b296-b9ae10409298 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:46.357887 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-76682dc3-5c92-453f-b296-b9ae10409298 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1291 microversion: 2.1 time: 0.277205 Jul 28 03:37:46.358807 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 278/601] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:46 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1291 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:46.387539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e2d1c321-8123-4062-bb20-2a40a3f8c7eb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:46.388477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e2d1c321-8123-4062-bb20-2a40a3f8c7eb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:46.585140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e2d1c321-8123-4062-bb20-2a40a3f8c7eb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:46.602515 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e2d1c321-8123-4062-bb20-2a40a3f8c7eb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1222 microversion: 2.1 time: 0.240314 Jul 28 03:37:46.606076 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 279/602] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:46 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1222 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:46.613306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7114671a-edd0-4f33-946f-a84033e92a71 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:46.614138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7114671a-edd0-4f33-946f-a84033e92a71 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:46.626551 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7114671a-edd0-4f33-946f-a84033e92a71 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:46.627167 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7114671a-edd0-4f33-946f-a84033e92a71 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:46.628093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7114671a-edd0-4f33-946f-a84033e92a71 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:46.628623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7114671a-edd0-4f33-946f-a84033e92a71 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:47.019787 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7114671a-edd0-4f33-946f-a84033e92a71 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:47.051537 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7114671a-edd0-4f33-946f-a84033e92a71 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1311 microversion: 2.1 time: 0.443064 Jul 28 03:37:47.054007 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 280/603] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:46 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1311 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:47.110428 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8674f135-94f8-4c46-a961-5122cd58878c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:47.111011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8674f135-94f8-4c46-a961-5122cd58878c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:47.120111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8674f135-94f8-4c46-a961-5122cd58878c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:47.120892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8674f135-94f8-4c46-a961-5122cd58878c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:47.122096 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8674f135-94f8-4c46-a961-5122cd58878c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:47.122868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8674f135-94f8-4c46-a961-5122cd58878c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:47.215388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8674f135-94f8-4c46-a961-5122cd58878c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:47.228757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8674f135-94f8-4c46-a961-5122cd58878c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:47.230404 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8674f135-94f8-4c46-a961-5122cd58878c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:47.236682 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8674f135-94f8-4c46-a961-5122cd58878c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1452 microversion: 2.75 time: 0.131837 Jul 28 03:37:47.237700 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 281/604] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:47 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:47.388048 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6a874ce3-a90c-40c5-b23e-a68fcb8c8443 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:47.389898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6a874ce3-a90c-40c5-b23e-a68fcb8c8443 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:47.403602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a874ce3-a90c-40c5-b23e-a68fcb8c8443 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:47.404454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a874ce3-a90c-40c5-b23e-a68fcb8c8443 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:47.405558 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a874ce3-a90c-40c5-b23e-a68fcb8c8443 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:47.406199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a874ce3-a90c-40c5-b23e-a68fcb8c8443 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:47.675594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6a874ce3-a90c-40c5-b23e-a68fcb8c8443 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:47.693405 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6a874ce3-a90c-40c5-b23e-a68fcb8c8443 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1331 microversion: 2.1 time: 0.314790 Jul 28 03:37:47.695458 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 282/605] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:47 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1331 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:47.701351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8a070c63-08af-40a5-b266-7d4dda3a8887 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:47.702930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8a070c63-08af-40a5-b266-7d4dda3a8887 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:47.712623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a070c63-08af-40a5-b266-7d4dda3a8887 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:47.713344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a070c63-08af-40a5-b266-7d4dda3a8887 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:47.714128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a070c63-08af-40a5-b266-7d4dda3a8887 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:47.714558 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a070c63-08af-40a5-b266-7d4dda3a8887 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:47.822347 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8a070c63-08af-40a5-b266-7d4dda3a8887 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:47.839101 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8a070c63-08af-40a5-b266-7d4dda3a8887 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1218 microversion: 2.1 time: 0.140528 Jul 28 03:37:47.840609 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 283/606] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:47 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1218 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:48.079682 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2cac205d-2a98-4b68-810a-33bf6a613184 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:48.081271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2cac205d-2a98-4b68-810a-33bf6a613184 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:48.100243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2cac205d-2a98-4b68-810a-33bf6a613184 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:48.101480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2cac205d-2a98-4b68-810a-33bf6a613184 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:48.104931 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2cac205d-2a98-4b68-810a-33bf6a613184 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:48.105491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2cac205d-2a98-4b68-810a-33bf6a613184 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:48.356492 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2cac205d-2a98-4b68-810a-33bf6a613184 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:48.380614 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2cac205d-2a98-4b68-810a-33bf6a613184 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1493 microversion: 2.1 time: 0.307068 Jul 28 03:37:48.382281 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 284/607] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:48 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1493 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:48.396460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-20c2d7f7-5c8b-476f-97eb-531f7718872f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:48.397668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-20c2d7f7-5c8b-476f-97eb-531f7718872f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:48.418567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20c2d7f7-5c8b-476f-97eb-531f7718872f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:48.419946 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20c2d7f7-5c8b-476f-97eb-531f7718872f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:48.421697 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20c2d7f7-5c8b-476f-97eb-531f7718872f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:48.422533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20c2d7f7-5c8b-476f-97eb-531f7718872f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:48.659449 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-20c2d7f7-5c8b-476f-97eb-531f7718872f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:48.676889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-20c2d7f7-5c8b-476f-97eb-531f7718872f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:48.679523 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-20c2d7f7-5c8b-476f-97eb-531f7718872f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:48.688917 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-20c2d7f7-5c8b-476f-97eb-531f7718872f tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1452 microversion: 2.75 time: 0.300782 Jul 28 03:37:48.690187 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 285/608] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:48 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1452 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:48.784260 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-33dcba5d-cfd4-44cb-a36b-97282ac71970 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc/action" status: 202 len: 0 microversion: 2.25 time: 4.755095 Jul 28 03:37:48.791843 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 324/609] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 03:37:44 2022] POST /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc/action => generated 0 bytes in 4763 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:37:48.803980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c9698a9-1b28-4302-884d-b842e3b4a37e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:48.804643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c9698a9-1b28-4302-884d-b842e3b4a37e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:48.838056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c9698a9-1b28-4302-884d-b842e3b4a37e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:48.838890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c9698a9-1b28-4302-884d-b842e3b4a37e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:48.839932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c9698a9-1b28-4302-884d-b842e3b4a37e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:48.840330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c9698a9-1b28-4302-884d-b842e3b4a37e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:48.914165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dfe637fd-7c3d-4536-b8a8-3af85aca7bbb tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:48.914786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dfe637fd-7c3d-4536-b8a8-3af85aca7bbb tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:48.922541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dfe637fd-7c3d-4536-b8a8-3af85aca7bbb tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:48.923386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dfe637fd-7c3d-4536-b8a8-3af85aca7bbb tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:48.924560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dfe637fd-7c3d-4536-b8a8-3af85aca7bbb tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:48.925160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dfe637fd-7c3d-4536-b8a8-3af85aca7bbb tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:49.087050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7c9698a9-1b28-4302-884d-b842e3b4a37e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:49.097205 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7c9698a9-1b28-4302-884d-b842e3b4a37e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1331 microversion: 2.1 time: 0.299913 Jul 28 03:37:49.097972 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 325/610] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:48 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1331 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:49.103379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b9d415a-85ee-470e-9a5b-44c909327710 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:49.103929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b9d415a-85ee-470e-9a5b-44c909327710 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:49.111852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b9d415a-85ee-470e-9a5b-44c909327710 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:49.112293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b9d415a-85ee-470e-9a5b-44c909327710 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:49.113282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b9d415a-85ee-470e-9a5b-44c909327710 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:49.113718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b9d415a-85ee-470e-9a5b-44c909327710 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:49.283393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b9d415a-85ee-470e-9a5b-44c909327710 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:49.300769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b9d415a-85ee-470e-9a5b-44c909327710 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:49.303144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b9d415a-85ee-470e-9a5b-44c909327710 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:49.306157 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b9d415a-85ee-470e-9a5b-44c909327710 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1569 microversion: 2.25 time: 0.206509 Jul 28 03:37:49.307538 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 326/611] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:49 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:49.335368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-312ac54f-358b-4bca-9147-5998948ea3d6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:49.337449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-312ac54f-358b-4bca-9147-5998948ea3d6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:49.347721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-312ac54f-358b-4bca-9147-5998948ea3d6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:49.348762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-312ac54f-358b-4bca-9147-5998948ea3d6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:49.349960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-312ac54f-358b-4bca-9147-5998948ea3d6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:49.350516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-312ac54f-358b-4bca-9147-5998948ea3d6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:49.459498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-312ac54f-358b-4bca-9147-5998948ea3d6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:49.470716 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-312ac54f-358b-4bca-9147-5998948ea3d6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1280 microversion: 2.1 time: 0.161041 Jul 28 03:37:49.471718 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 327/612] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:49 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1280 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:49.477121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a52407cc-1aa2-446e-b8a0-6b9d2d61f8b6 req-ee51ea2e-2f24-4e41-816a-a9969b6c6984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2393d2a-78ad-4dd9-ad03-d8622acdb71e", "tag": "b6de10ac-a038-41b1-a2ce-0c6183a7eb56"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:49.489942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a52407cc-1aa2-446e-b8a0-6b9d2d61f8b6 req-ee51ea2e-2f24-4e41-816a-a9969b6c6984 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:49.490490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a52407cc-1aa2-446e-b8a0-6b9d2d61f8b6 req-ee51ea2e-2f24-4e41-816a-a9969b6c6984 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:49.519338 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a52407cc-1aa2-446e-b8a0-6b9d2d61f8b6 req-ee51ea2e-2f24-4e41-816a-a9969b6c6984 service nova] Creating event network-changed:b6de10ac-a038-41b1-a2ce-0c6183a7eb56 for instance a2393d2a-78ad-4dd9-ad03-d8622acdb71e on n-h2-826756-3 Jul 28 03:37:49.525677 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a52407cc-1aa2-446e-b8a0-6b9d2d61f8b6 req-ee51ea2e-2f24-4e41-816a-a9969b6c6984 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051981 Jul 28 03:37:49.527309 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 328/613] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:49.720861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df2d68e9-b529-4dce-a6b5-4777ad14530d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:49.721998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-df2d68e9-b529-4dce-a6b5-4777ad14530d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:49.729111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df2d68e9-b529-4dce-a6b5-4777ad14530d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:49.729763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df2d68e9-b529-4dce-a6b5-4777ad14530d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:49.730807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df2d68e9-b529-4dce-a6b5-4777ad14530d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:49.731277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df2d68e9-b529-4dce-a6b5-4777ad14530d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:49.831073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-df2d68e9-b529-4dce-a6b5-4777ad14530d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:49.847154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-df2d68e9-b529-4dce-a6b5-4777ad14530d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:49.850231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-df2d68e9-b529-4dce-a6b5-4777ad14530d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:49.858920 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dfe637fd-7c3d-4536-b8a8-3af85aca7bbb tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1644 microversion: 2.1 time: 1.166769 Jul 28 03:37:49.859660 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-df2d68e9-b529-4dce-a6b5-4777ad14530d tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1437 microversion: 2.75 time: 0.143807 Jul 28 03:37:49.860388 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 329/614] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:49 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1437 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:37:49.861213 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 286/615] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:48 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1644 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:49.897356 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3e9c5b4f-84ec-472a-955d-6aadfe5e01ed tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:49.899216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3e9c5b4f-84ec-472a-955d-6aadfe5e01ed tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:49.911520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e9c5b4f-84ec-472a-955d-6aadfe5e01ed tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:49.912684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e9c5b4f-84ec-472a-955d-6aadfe5e01ed tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:49.914294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e9c5b4f-84ec-472a-955d-6aadfe5e01ed tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:49.915068 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e9c5b4f-84ec-472a-955d-6aadfe5e01ed tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.046520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:50.049540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:50.056436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.056988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.057845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.058356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.138004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:50.155295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:37:50.155715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:37:50.156216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:37:50.156664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:37:50.157077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:37:50.225747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:50.232291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.232756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.233736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.234162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.402032 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3e9c5b4f-84ec-472a-955d-6aadfe5e01ed tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1644 microversion: 2.1 time: 0.511312 Jul 28 03:37:50.404901 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 287/616] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:49 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1644 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:50.413084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f6fb10c7-4a68-4096-b7c5-18534777512b tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:50.413891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f6fb10c7-4a68-4096-b7c5-18534777512b tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:50.421790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:37:50.423920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f6fb10c7-4a68-4096-b7c5-18534777512b tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.424764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f6fb10c7-4a68-4096-b7c5-18534777512b tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.426113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f6fb10c7-4a68-4096-b7c5-18534777512b tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.426884 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f6fb10c7-4a68-4096-b7c5-18534777512b tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.456903 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a867eedc-c8c2-4cb8-941c-795af108d521 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61/action" status: 202 len: 1940 microversion: 2.75 time: 0.575117 Jul 28 03:37:50.457711 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 330/617] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 03:37:49 2022] POST /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61/action => generated 1940 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 28 03:37:50.462708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5e24cc6a-5caa-44af-8f4c-1d4c9c68db46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:50.463403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5e24cc6a-5caa-44af-8f4c-1d4c9c68db46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:50.470605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e24cc6a-5caa-44af-8f4c-1d4c9c68db46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.472387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e24cc6a-5caa-44af-8f4c-1d4c9c68db46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.473298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e24cc6a-5caa-44af-8f4c-1d4c9c68db46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.473866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e24cc6a-5caa-44af-8f4c-1d4c9c68db46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.650084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5e24cc6a-5caa-44af-8f4c-1d4c9c68db46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:50.661937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5e24cc6a-5caa-44af-8f4c-1d4c9c68db46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:50.664170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5e24cc6a-5caa-44af-8f4c-1d4c9c68db46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:50.665481 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5e24cc6a-5caa-44af-8f4c-1d4c9c68db46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1569 microversion: 2.25 time: 0.206771 Jul 28 03:37:50.666953 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 331/618] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:50 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:50.675363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f9f2f87-1844-4ceb-b8b2-2e6b2caaf891 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:50.678625 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:37:50.678625 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:37:50.680664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f9f2f87-1844-4ceb-b8b2-2e6b2caaf891 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.685312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f9f2f87-1844-4ceb-b8b2-2e6b2caaf891 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.686705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f9f2f87-1844-4ceb-b8b2-2e6b2caaf891 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.687571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f9f2f87-1844-4ceb-b8b2-2e6b2caaf891 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.713570 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f9f2f87-1844-4ceb-b8b2-2e6b2caaf891 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045720 Jul 28 03:37:50.714194 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 332/619] 10.222.0.48 () {58 vars in 1176 bytes} [Thu Jul 28 03:37:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:50.720748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca861cb9-ccf9-4c19-a8d8-613066e6a9a7 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:50.721446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca861cb9-ccf9-4c19-a8d8-613066e6a9a7 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:50.733275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca861cb9-ccf9-4c19-a8d8-613066e6a9a7 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.733719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca861cb9-ccf9-4c19-a8d8-613066e6a9a7 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.734490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca861cb9-ccf9-4c19-a8d8-613066e6a9a7 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.734917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca861cb9-ccf9-4c19-a8d8-613066e6a9a7 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.812390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-ca861cb9-ccf9-4c19-a8d8-613066e6a9a7 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:37:50.830434 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca861cb9-ccf9-4c19-a8d8-613066e6a9a7 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.115155 Jul 28 03:37:50.831236 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 333/620] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:50 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:50.835650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b7003428-cd38-4129-bd99-53717fdcafa0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:50.836263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b7003428-cd38-4129-bd99-53717fdcafa0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:50.843164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7003428-cd38-4129-bd99-53717fdcafa0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.843618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7003428-cd38-4129-bd99-53717fdcafa0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.844423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7003428-cd38-4129-bd99-53717fdcafa0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.845223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7003428-cd38-4129-bd99-53717fdcafa0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.917596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b7003428-cd38-4129-bd99-53717fdcafa0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:50.925879 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b7003428-cd38-4129-bd99-53717fdcafa0 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1280 microversion: 2.1 time: 0.093776 Jul 28 03:37:50.926468 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 334/621] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:50 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:50.931223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-de0d5065-73ff-472b-943c-6a9cd59c9989 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826756-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:50.933888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-de0d5065-73ff-472b-943c-6a9cd59c9989 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:50.951156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de0d5065-73ff-472b-943c-6a9cd59c9989 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.951639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de0d5065-73ff-472b-943c-6a9cd59c9989 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.952515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de0d5065-73ff-472b-943c-6a9cd59c9989 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:50.953472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de0d5065-73ff-472b-943c-6a9cd59c9989 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:50.967382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f6fb10c7-4a68-4096-b7c5-18534777512b tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:50.980985 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f6fb10c7-4a68-4096-b7c5-18534777512b tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1331 microversion: 2.1 time: 0.574064 Jul 28 03:37:50.981989 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 288/622] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:50 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1331 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:50.999564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-de0d5065-73ff-472b-943c-6a9cd59c9989 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lazy-loading 'flavor' on Instance uuid 2cda1bf7-ab8a-4567-a8d6-54697a316461 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:37:51.014753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-de0d5065-73ff-472b-943c-6a9cd59c9989 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Going to try to live migrate instance to n-h2-826756-3 {{(pid=126071) live_migrate /opt/stack/nova/nova/compute/api.py:5474}} Jul 28 03:37:51.697228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ad25298f-109e-4441-bfbb-f1523979996a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:51.698799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ad25298f-109e-4441-bfbb-f1523979996a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:51.702890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:51.708595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad25298f-109e-4441-bfbb-f1523979996a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:51.709401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad25298f-109e-4441-bfbb-f1523979996a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:51.710529 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad25298f-109e-4441-bfbb-f1523979996a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:51.711041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad25298f-109e-4441-bfbb-f1523979996a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:52.138466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ad25298f-109e-4441-bfbb-f1523979996a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:52.152615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ad25298f-109e-4441-bfbb-f1523979996a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:52.154811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ad25298f-109e-4441-bfbb-f1523979996a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:52.156779 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ad25298f-109e-4441-bfbb-f1523979996a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1569 microversion: 2.25 time: 0.468290 Jul 28 03:37:52.161153 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 289/623] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:51 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1569 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:37:52.171875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2d89a139-3436-430c-acd9-cf526f43dc8d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:52.175149 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2d89a139-3436-430c-acd9-cf526f43dc8d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:52.183450 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d89a139-3436-430c-acd9-cf526f43dc8d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:52.184033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d89a139-3436-430c-acd9-cf526f43dc8d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:52.185001 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d89a139-3436-430c-acd9-cf526f43dc8d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:52.185874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d89a139-3436-430c-acd9-cf526f43dc8d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:52.631136 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-2d89a139-3436-430c-acd9-cf526f43dc8d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:37:52.703475 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2d89a139-3436-430c-acd9-cf526f43dc8d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.540395 Jul 28 03:37:52.704509 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 290/624] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:52 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:52.716837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-6a2d47f9-48f7-4a02-a1b4-b8522906bd53 req-43918245-4fc2-4ce7-ba12-a62696c118ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712656b5-8470-4486-baf2-1c412846c8fc", "name": "network-vif-unplugged", "status": "completed", "tag": "e54d0f2b-04e3-4f2a-b2ad-ca1a7f88a7e9"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:52.739999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-6a2d47f9-48f7-4a02-a1b4-b8522906bd53 req-43918245-4fc2-4ce7-ba12-a62696c118ad service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:52.740643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-6a2d47f9-48f7-4a02-a1b4-b8522906bd53 req-43918245-4fc2-4ce7-ba12-a62696c118ad service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:52.761742 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-6a2d47f9-48f7-4a02-a1b4-b8522906bd53 req-43918245-4fc2-4ce7-ba12-a62696c118ad service nova] Creating event network-vif-unplugged:e54d0f2b-04e3-4f2a-b2ad-ca1a7f88a7e9 for instance 712656b5-8470-4486-baf2-1c412846c8fc on n-h2-826756-3 Jul 28 03:37:52.768191 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-6a2d47f9-48f7-4a02-a1b4-b8522906bd53 req-43918245-4fc2-4ce7-ba12-a62696c118ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060372 Jul 28 03:37:52.769126 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 291/625] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:52.783086 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-039e8486-682d-4704-b035-58ccfe3d28c4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:52.785336 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-039e8486-682d-4704-b035-58ccfe3d28c4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:52.797329 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-039e8486-682d-4704-b035-58ccfe3d28c4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:52.797883 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-039e8486-682d-4704-b035-58ccfe3d28c4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:52.798763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-039e8486-682d-4704-b035-58ccfe3d28c4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:52.799269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-039e8486-682d-4704-b035-58ccfe3d28c4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:53.420024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-039e8486-682d-4704-b035-58ccfe3d28c4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:53.430782 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-039e8486-682d-4704-b035-58ccfe3d28c4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1322 microversion: 2.1 time: 0.657147 Jul 28 03:37:53.433160 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 292/626] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:52 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1322 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:53.455084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a5d724ed-a6e8-4509-bd20-26bea242c931 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:53.455692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a5d724ed-a6e8-4509-bd20-26bea242c931 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:53.465034 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a5d724ed-a6e8-4509-bd20-26bea242c931 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:53.465845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a5d724ed-a6e8-4509-bd20-26bea242c931 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:53.467538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a5d724ed-a6e8-4509-bd20-26bea242c931 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:53.468590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a5d724ed-a6e8-4509-bd20-26bea242c931 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:53.785941 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-de0d5065-73ff-472b-943c-6a9cd59c9989 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461/action" status: 202 len: 0 microversion: 2.1 time: 2.857900 Jul 28 03:37:53.788866 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 335/627] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:37:50 2022] POST /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461/action => generated 0 bytes in 2862 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:37:53.806928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8c34bb15-2567-433f-ba49-66c815751ada tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:53.808787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8c34bb15-2567-433f-ba49-66c815751ada tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:53.822891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c34bb15-2567-433f-ba49-66c815751ada tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:53.823352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c34bb15-2567-433f-ba49-66c815751ada tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:53.824206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c34bb15-2567-433f-ba49-66c815751ada tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:53.824682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c34bb15-2567-433f-ba49-66c815751ada tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:53.999105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a5d724ed-a6e8-4509-bd20-26bea242c931 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:54.006457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:54.034935 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a5d724ed-a6e8-4509-bd20-26bea242c931 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1331 microversion: 2.1 time: 0.599930 Jul 28 03:37:54.036817 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 293/628] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:53 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1331 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:54.043287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6ff9bf0e-6093-4c13-ab65-5f0c14b9d728 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:54.044883 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6ff9bf0e-6093-4c13-ab65-5f0c14b9d728 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:54.060518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ff9bf0e-6093-4c13-ab65-5f0c14b9d728 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:54.061079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ff9bf0e-6093-4c13-ab65-5f0c14b9d728 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:54.062143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ff9bf0e-6093-4c13-ab65-5f0c14b9d728 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:54.062649 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ff9bf0e-6093-4c13-ab65-5f0c14b9d728 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:54.065997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8c34bb15-2567-433f-ba49-66c815751ada tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:54.084708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8c34bb15-2567-433f-ba49-66c815751ada tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:54.088685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8c34bb15-2567-433f-ba49-66c815751ada tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:54.090279 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8c34bb15-2567-433f-ba49-66c815751ada tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1569 microversion: 2.25 time: 0.298891 Jul 28 03:37:54.091398 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 336/629] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:53 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1569 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:54.098574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e04510e0-cf6c-496c-bb47-6ba43d749ed2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:54.099501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e04510e0-cf6c-496c-bb47-6ba43d749ed2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:54.106217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e04510e0-cf6c-496c-bb47-6ba43d749ed2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:54.107238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e04510e0-cf6c-496c-bb47-6ba43d749ed2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:54.108376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e04510e0-cf6c-496c-bb47-6ba43d749ed2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:54.108975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e04510e0-cf6c-496c-bb47-6ba43d749ed2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:54.265965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-6ff9bf0e-6093-4c13-ab65-5f0c14b9d728 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:37:54.295850 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6ff9bf0e-6093-4c13-ab65-5f0c14b9d728 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.257050 Jul 28 03:37:54.296764 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 294/630] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:54 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:54.465310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fd8a69bd-376d-4827-b92d-d09d0e474746 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:54.466837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fd8a69bd-376d-4827-b92d-d09d0e474746 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:54.478939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd8a69bd-376d-4827-b92d-d09d0e474746 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:54.478939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd8a69bd-376d-4827-b92d-d09d0e474746 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:54.478939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd8a69bd-376d-4827-b92d-d09d0e474746 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:54.480005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd8a69bd-376d-4827-b92d-d09d0e474746 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:54.620105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e04510e0-cf6c-496c-bb47-6ba43d749ed2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:54.635159 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e04510e0-cf6c-496c-bb47-6ba43d749ed2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1503 microversion: 2.1 time: 0.541880 Jul 28 03:37:54.636147 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 337/631] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:54 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1503 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:54.804554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-abaa5a1d-38c4-424c-9e3c-321044dd478b req-3321d33b-2801-4e8a-99e2-8ded5b3c26a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712656b5-8470-4486-baf2-1c412846c8fc", "tag": "e54d0f2b-04e3-4f2a-b2ad-ca1a7f88a7e9"}, {"name": "network-changed", "server_uuid": "a33dc7b6-d97c-4973-b4a3-e576cddcdbb6", "tag": "8c5f10b9-7997-49b9-9d60-54f589aacd7d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:54.821833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-abaa5a1d-38c4-424c-9e3c-321044dd478b req-3321d33b-2801-4e8a-99e2-8ded5b3c26a8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:54.822264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-abaa5a1d-38c4-424c-9e3c-321044dd478b req-3321d33b-2801-4e8a-99e2-8ded5b3c26a8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:54.840592 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-abaa5a1d-38c4-424c-9e3c-321044dd478b req-3321d33b-2801-4e8a-99e2-8ded5b3c26a8 service nova] Creating event network-changed:e54d0f2b-04e3-4f2a-b2ad-ca1a7f88a7e9 for instance 712656b5-8470-4486-baf2-1c412846c8fc on n-h2-826756-3 Jul 28 03:37:54.841488 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-abaa5a1d-38c4-424c-9e3c-321044dd478b req-3321d33b-2801-4e8a-99e2-8ded5b3c26a8 service nova] Creating event network-changed:8c5f10b9-7997-49b9-9d60-54f589aacd7d for instance a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 on n-h1-826756-3 Jul 28 03:37:54.856886 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-abaa5a1d-38c4-424c-9e3c-321044dd478b req-3321d33b-2801-4e8a-99e2-8ded5b3c26a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.056379 Jul 28 03:37:54.859152 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 338/632] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:37:54.860830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fd8a69bd-376d-4827-b92d-d09d0e474746 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:54.877439 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fd8a69bd-376d-4827-b92d-d09d0e474746 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1322 microversion: 2.1 time: 0.416646 Jul 28 03:37:54.879046 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 295/633] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:54 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:55.078428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8c567860-3056-4716-8755-f7819415a6ce tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:55.079356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8c567860-3056-4716-8755-f7819415a6ce tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:55.085868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c567860-3056-4716-8755-f7819415a6ce tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:55.086577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c567860-3056-4716-8755-f7819415a6ce tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:55.087360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c567860-3056-4716-8755-f7819415a6ce tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:55.087785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c567860-3056-4716-8755-f7819415a6ce tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:55.118340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f7becc85-4ee2-4fad-bdd3-5835f925dc47 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:55.119297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f7becc85-4ee2-4fad-bdd3-5835f925dc47 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:55.129719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7becc85-4ee2-4fad-bdd3-5835f925dc47 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:55.130557 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7becc85-4ee2-4fad-bdd3-5835f925dc47 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:55.132480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7becc85-4ee2-4fad-bdd3-5835f925dc47 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:55.134157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7becc85-4ee2-4fad-bdd3-5835f925dc47 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:55.272410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8c567860-3056-4716-8755-f7819415a6ce tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:55.281374 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8c567860-3056-4716-8755-f7819415a6ce tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1331 microversion: 2.1 time: 0.210111 Jul 28 03:37:55.294385 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 339/634] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:55 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1331 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:55.327708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5624775d-e0ed-4978-92cf-69389b4f7dee tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:55.328632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5624775d-e0ed-4978-92cf-69389b4f7dee tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:55.336661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5624775d-e0ed-4978-92cf-69389b4f7dee tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:55.337193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5624775d-e0ed-4978-92cf-69389b4f7dee tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:55.338160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5624775d-e0ed-4978-92cf-69389b4f7dee tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:55.338597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5624775d-e0ed-4978-92cf-69389b4f7dee tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:55.384046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f7becc85-4ee2-4fad-bdd3-5835f925dc47 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:55.393761 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f7becc85-4ee2-4fad-bdd3-5835f925dc47 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:55.395437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f7becc85-4ee2-4fad-bdd3-5835f925dc47 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:55.396894 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f7becc85-4ee2-4fad-bdd3-5835f925dc47 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1569 microversion: 2.25 time: 0.283997 Jul 28 03:37:55.397608 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 296/635] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:55 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1569 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:55.436820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-5624775d-e0ed-4978-92cf-69389b4f7dee tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:37:55.456367 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5624775d-e0ed-4978-92cf-69389b4f7dee tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.133492 Jul 28 03:37:55.456977 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 340/636] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:55 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:55.670461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d1df777a-46ca-4e36-b3f2-8489fabec05b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:55.671487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d1df777a-46ca-4e36-b3f2-8489fabec05b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:55.679094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d1df777a-46ca-4e36-b3f2-8489fabec05b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:55.679524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d1df777a-46ca-4e36-b3f2-8489fabec05b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:55.680501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d1df777a-46ca-4e36-b3f2-8489fabec05b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:55.680937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d1df777a-46ca-4e36-b3f2-8489fabec05b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:55.714253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:55.901200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63f76ea6-a977-40b9-906d-396996c59052 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:55.901980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63f76ea6-a977-40b9-906d-396996c59052 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:55.908633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63f76ea6-a977-40b9-906d-396996c59052 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:55.909093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63f76ea6-a977-40b9-906d-396996c59052 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:55.909886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63f76ea6-a977-40b9-906d-396996c59052 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:55.910324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63f76ea6-a977-40b9-906d-396996c59052 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:55.938560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d1df777a-46ca-4e36-b3f2-8489fabec05b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:55.947237 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d1df777a-46ca-4e36-b3f2-8489fabec05b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1503 microversion: 2.1 time: 0.282397 Jul 28 03:37:55.947989 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 297/637] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:55 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:56.030309 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-a6c08681-17ff-4b26-a907-2457c4b1767f req-0e045ab7-3858-4cb4-8620-b24633776a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cda1bf7-ab8a-4567-a8d6-54697a316461", "name": "network-vif-unplugged", "status": "completed", "tag": "c89c0e09-fda3-4512-826c-85a6f08cc121"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:56.050811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a6c08681-17ff-4b26-a907-2457c4b1767f req-0e045ab7-3858-4cb4-8620-b24633776a2e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:56.052121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a6c08681-17ff-4b26-a907-2457c4b1767f req-0e045ab7-3858-4cb4-8620-b24633776a2e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:56.072713 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-a6c08681-17ff-4b26-a907-2457c4b1767f req-0e045ab7-3858-4cb4-8620-b24633776a2e service nova] Creating event network-vif-unplugged:c89c0e09-fda3-4512-826c-85a6f08cc121 for instance 2cda1bf7-ab8a-4567-a8d6-54697a316461 on n-h1-826756-3 Jul 28 03:37:56.079225 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-a6c08681-17ff-4b26-a907-2457c4b1767f req-0e045ab7-3858-4cb4-8620-b24633776a2e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064308 Jul 28 03:37:56.081615 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 298/638] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:56.211461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63f76ea6-a977-40b9-906d-396996c59052 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:56.222062 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63f76ea6-a977-40b9-906d-396996c59052 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1322 microversion: 2.1 time: 0.324929 Jul 28 03:37:56.223344 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 341/639] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:55 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:56.311063 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b968dec-e5e9-459e-a7c0-9deaae0c6a51 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:56.312725 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2b968dec-e5e9-459e-a7c0-9deaae0c6a51 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:56.322918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b968dec-e5e9-459e-a7c0-9deaae0c6a51 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:56.323482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b968dec-e5e9-459e-a7c0-9deaae0c6a51 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:56.325268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b968dec-e5e9-459e-a7c0-9deaae0c6a51 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:56.325902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b968dec-e5e9-459e-a7c0-9deaae0c6a51 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:56.432096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4dc8ed9f-c867-40dd-a550-b525f5821d8c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:56.433650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4dc8ed9f-c867-40dd-a550-b525f5821d8c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:56.465820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4dc8ed9f-c867-40dd-a550-b525f5821d8c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:56.467144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4dc8ed9f-c867-40dd-a550-b525f5821d8c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:56.469068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4dc8ed9f-c867-40dd-a550-b525f5821d8c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:56.472171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4dc8ed9f-c867-40dd-a550-b525f5821d8c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:56.592559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=16 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:56.760723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2b968dec-e5e9-459e-a7c0-9deaae0c6a51 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:56.773047 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2b968dec-e5e9-459e-a7c0-9deaae0c6a51 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1331 microversion: 2.1 time: 0.471894 Jul 28 03:37:56.773757 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 299/640] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:56 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1331 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:56.780641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ebeef9dc-2c97-4afc-a8e7-22f136104806 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:56.781619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ebeef9dc-2c97-4afc-a8e7-22f136104806 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:56.789219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebeef9dc-2c97-4afc-a8e7-22f136104806 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:56.789668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebeef9dc-2c97-4afc-a8e7-22f136104806 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:56.790604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebeef9dc-2c97-4afc-a8e7-22f136104806 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:56.790898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebeef9dc-2c97-4afc-a8e7-22f136104806 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:56.815028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4dc8ed9f-c867-40dd-a550-b525f5821d8c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:56.829989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4dc8ed9f-c867-40dd-a550-b525f5821d8c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:56.833035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4dc8ed9f-c867-40dd-a550-b525f5821d8c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:56.835696 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4dc8ed9f-c867-40dd-a550-b525f5821d8c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1569 microversion: 2.25 time: 0.414179 Jul 28 03:37:56.837237 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 342/641] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:56 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1569 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:37:56.846688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-74e81be1-c07e-4838-949a-187322580bd1 req-e2f667ea-53c4-41ef-be0e-b85981fd1697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2393d2a-78ad-4dd9-ad03-d8622acdb71e", "name": "network-vif-plugged", "status": "completed", "tag": "b6de10ac-a038-41b1-a2ce-0c6183a7eb56"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:56.859349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-74e81be1-c07e-4838-949a-187322580bd1 req-e2f667ea-53c4-41ef-be0e-b85981fd1697 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:56.860234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-74e81be1-c07e-4838-949a-187322580bd1 req-e2f667ea-53c4-41ef-be0e-b85981fd1697 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:56.881874 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-74e81be1-c07e-4838-949a-187322580bd1 req-e2f667ea-53c4-41ef-be0e-b85981fd1697 service nova] Creating event network-vif-plugged:b6de10ac-a038-41b1-a2ce-0c6183a7eb56 for instance a2393d2a-78ad-4dd9-ad03-d8622acdb71e on n-h2-826756-3 Jul 28 03:37:56.889972 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-74e81be1-c07e-4838-949a-187322580bd1 req-e2f667ea-53c4-41ef-be0e-b85981fd1697 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050755 Jul 28 03:37:56.891434 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 343/642] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:56.926683 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-ebeef9dc-2c97-4afc-a8e7-22f136104806 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:37:56.951096 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ebeef9dc-2c97-4afc-a8e7-22f136104806 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.175497 Jul 28 03:37:56.951699 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 300/643] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:56 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:56.983400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-10023c3e-0934-415c-884e-6a95383efb63 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:56.984508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-10023c3e-0934-415c-884e-6a95383efb63 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:56.997130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10023c3e-0934-415c-884e-6a95383efb63 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:56.998759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10023c3e-0934-415c-884e-6a95383efb63 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:57.000179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10023c3e-0934-415c-884e-6a95383efb63 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:57.002268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10023c3e-0934-415c-884e-6a95383efb63 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:57.011266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:57.255151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7485b35f-8e09-4bed-b8f4-fb5dd3c3fce3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:57.256108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7485b35f-8e09-4bed-b8f4-fb5dd3c3fce3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:57.266247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7485b35f-8e09-4bed-b8f4-fb5dd3c3fce3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:57.267202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7485b35f-8e09-4bed-b8f4-fb5dd3c3fce3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:57.268123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7485b35f-8e09-4bed-b8f4-fb5dd3c3fce3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:57.268759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7485b35f-8e09-4bed-b8f4-fb5dd3c3fce3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:57.355914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-10023c3e-0934-415c-884e-6a95383efb63 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:57.372558 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-10023c3e-0934-415c-884e-6a95383efb63 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1503 microversion: 2.1 time: 0.393581 Jul 28 03:37:57.373579 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 344/644] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:56 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1503 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:57.570810 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7485b35f-8e09-4bed-b8f4-fb5dd3c3fce3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:57.579319 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7485b35f-8e09-4bed-b8f4-fb5dd3c3fce3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1322 microversion: 2.1 time: 0.330986 Jul 28 03:37:57.579905 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 301/645] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:57 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:57.684730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d0df16b4-2494-4f2c-908a-e65b694bf032 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:57.684730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d0df16b4-2494-4f2c-908a-e65b694bf032 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:57.690612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0df16b4-2494-4f2c-908a-e65b694bf032 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:57.691066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0df16b4-2494-4f2c-908a-e65b694bf032 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:57.691895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0df16b4-2494-4f2c-908a-e65b694bf032 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:57.692332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0df16b4-2494-4f2c-908a-e65b694bf032 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:57.720919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d0df16b4-2494-4f2c-908a-e65b694bf032 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:37:57.795025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-55b4ac18-85f0-4230-9d3e-b4c5c486364e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:57.796335 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-55b4ac18-85f0-4230-9d3e-b4c5c486364e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:57.807031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-55b4ac18-85f0-4230-9d3e-b4c5c486364e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:57.807843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-55b4ac18-85f0-4230-9d3e-b4c5c486364e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:57.809344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-55b4ac18-85f0-4230-9d3e-b4c5c486364e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:57.810316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-55b4ac18-85f0-4230-9d3e-b4c5c486364e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:57.823496 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d0df16b4-2494-4f2c-908a-e65b694bf032 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "DELETE /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 204 len: 0 microversion: 2.1 time: 0.144467 Jul 28 03:37:57.829433 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 345/646] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:37:57 2022] DELETE /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:37:57.877390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9f1d8ec3-5e97-4243-a2b4-31e171f0ba64 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:57.879215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9f1d8ec3-5e97-4243-a2b4-31e171f0ba64 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:57.889301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f1d8ec3-5e97-4243-a2b4-31e171f0ba64 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:57.890017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f1d8ec3-5e97-4243-a2b4-31e171f0ba64 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:57.891374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f1d8ec3-5e97-4243-a2b4-31e171f0ba64 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:57.892049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f1d8ec3-5e97-4243-a2b4-31e171f0ba64 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:58.082394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9f1d8ec3-5e97-4243-a2b4-31e171f0ba64 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:58.099318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9f1d8ec3-5e97-4243-a2b4-31e171f0ba64 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:58.101253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9f1d8ec3-5e97-4243-a2b4-31e171f0ba64 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:58.103053 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9f1d8ec3-5e97-4243-a2b4-31e171f0ba64 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1569 microversion: 2.25 time: 0.234040 Jul 28 03:37:58.103808 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 346/647] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:57 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:37:58.110102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc110a2d-fdbc-4ddc-8f7c-31e4a316ffc9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:58.110102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cc110a2d-fdbc-4ddc-8f7c-31e4a316ffc9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:58.117840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc110a2d-fdbc-4ddc-8f7c-31e4a316ffc9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:58.117840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc110a2d-fdbc-4ddc-8f7c-31e4a316ffc9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:58.118567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc110a2d-fdbc-4ddc-8f7c-31e4a316ffc9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:58.119027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc110a2d-fdbc-4ddc-8f7c-31e4a316ffc9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:58.229589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-cc110a2d-fdbc-4ddc-8f7c-31e4a316ffc9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:37:58.255176 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cc110a2d-fdbc-4ddc-8f7c-31e4a316ffc9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.150002 Jul 28 03:37:58.269008 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 347/648] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:58 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:58.277247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-874746733", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "545521223", "adminPass": "***", "networks": [{"uuid": "67e2a5ef-0a64-48ab-9bf4-5c1f6e20fc9a"}], "security_groups": [{"name": "tempest-securitygroup--115380769"}], "key_name": "tempest-keypair-315226568", "user_data": "}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:58.299407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-55b4ac18-85f0-4230-9d3e-b4c5c486364e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:58.308483 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-55b4ac18-85f0-4230-9d3e-b4c5c486364e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1331 microversion: 2.1 time: 0.517733 Jul 28 03:37:58.321390 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 302/649] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:57 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1331 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:58.329146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-2c7d61d6-ddfd-40b3-9b30-744bd36163d6 req-c83ce285-b505-40ec-871e-42a2ff2e6796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cda1bf7-ab8a-4567-a8d6-54697a316461", "tag": "c89c0e09-fda3-4512-826c-85a6f08cc121"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:37:58.340385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-2c7d61d6-ddfd-40b3-9b30-744bd36163d6 req-c83ce285-b505-40ec-871e-42a2ff2e6796 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:58.340862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-2c7d61d6-ddfd-40b3-9b30-744bd36163d6 req-c83ce285-b505-40ec-871e-42a2ff2e6796 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:58.356159 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-2c7d61d6-ddfd-40b3-9b30-744bd36163d6 req-c83ce285-b505-40ec-871e-42a2ff2e6796 service nova] Creating event network-changed:c89c0e09-fda3-4512-826c-85a6f08cc121 for instance 2cda1bf7-ab8a-4567-a8d6-54697a316461 on n-h1-826756-3 Jul 28 03:37:58.365727 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-2c7d61d6-ddfd-40b3-9b30-744bd36163d6 req-c83ce285-b505-40ec-871e-42a2ff2e6796 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041822 Jul 28 03:37:58.366689 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 303/650] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:37:58.397195 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6f412280-0cfd-47c3-a7e9-843b4c07a347 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:58.397912 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6f412280-0cfd-47c3-a7e9-843b4c07a347 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:58.413280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f412280-0cfd-47c3-a7e9-843b4c07a347 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:58.413744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f412280-0cfd-47c3-a7e9-843b4c07a347 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:58.414585 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f412280-0cfd-47c3-a7e9-843b4c07a347 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:58.415029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f412280-0cfd-47c3-a7e9-843b4c07a347 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:58.435040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] validate_networks() for [('67e2a5ef-0a64-48ab-9bf4-5c1f6e20fc9a', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:37:58.596972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6f412280-0cfd-47c3-a7e9-843b4c07a347 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:58.607203 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6f412280-0cfd-47c3-a7e9-843b4c07a347 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1503 microversion: 2.1 time: 0.215140 Jul 28 03:37:58.607960 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 304/651] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:58 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:37:58.614781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-240505d6-9219-4ea5-af7f-4bc2e0bd9569 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:58.615798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-240505d6-9219-4ea5-af7f-4bc2e0bd9569 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:58.622286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-240505d6-9219-4ea5-af7f-4bc2e0bd9569 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:58.623004 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-240505d6-9219-4ea5-af7f-4bc2e0bd9569 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:58.623991 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-240505d6-9219-4ea5-af7f-4bc2e0bd9569 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:58.624625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-240505d6-9219-4ea5-af7f-4bc2e0bd9569 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:58.845976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-240505d6-9219-4ea5-af7f-4bc2e0bd9569 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:58.873836 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-240505d6-9219-4ea5-af7f-4bc2e0bd9569 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1322 microversion: 2.1 time: 0.263786 Jul 28 03:37:58.875048 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 305/652] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:58 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:58.993789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:37:58.994386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:37:58.994955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:37:58.995433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:37:58.995966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:37:59.007287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:59.007816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:59.008719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:59.009234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:59.030830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Getting quotas for project edc92b66c7414566a24bf7f67535fd94. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:37:59.043440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Getting quotas for user d876dd26de70496cbca6b3c066d72170 and project edc92b66c7414566a24bf7f67535fd94. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:37:59.061602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:37:59.064290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:37:59.119580 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6e96e781-c2f4-4c35-9b90-dad4fb350aed tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.848595 Jul 28 03:37:59.120500 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 348/653] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:37:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:37:59.132917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-26b8a4ff-35da-4779-8eea-5032e5876fa7 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:59.133522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-26b8a4ff-35da-4779-8eea-5032e5876fa7 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:59.142439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44160abf-a15a-4e9c-9103-134c7e305725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:59.143889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-44160abf-a15a-4e9c-9103-134c7e305725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:59.149514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:37:59.156937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44160abf-a15a-4e9c-9103-134c7e305725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:59.157474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44160abf-a15a-4e9c-9103-134c7e305725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:59.158460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44160abf-a15a-4e9c-9103-134c7e305725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:59.158953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44160abf-a15a-4e9c-9103-134c7e305725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:59.262704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-26b8a4ff-35da-4779-8eea-5032e5876fa7 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:59.277804 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-26b8a4ff-35da-4779-8eea-5032e5876fa7 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1261 microversion: 2.1 time: 0.149166 Jul 28 03:37:59.305888 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 306/654] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:59 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:59.321875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b849154c-973f-41fb-a72f-20ad54f7126e tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:59.323516 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b849154c-973f-41fb-a72f-20ad54f7126e tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:59.343404 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b849154c-973f-41fb-a72f-20ad54f7126e tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:59.344851 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b849154c-973f-41fb-a72f-20ad54f7126e tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:59.347054 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b849154c-973f-41fb-a72f-20ad54f7126e tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:59.348209 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b849154c-973f-41fb-a72f-20ad54f7126e tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:59.415390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44160abf-a15a-4e9c-9103-134c7e305725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:59.424128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44160abf-a15a-4e9c-9103-134c7e305725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:59.425979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44160abf-a15a-4e9c-9103-134c7e305725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:59.427336 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-44160abf-a15a-4e9c-9103-134c7e305725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1569 microversion: 2.25 time: 0.295466 Jul 28 03:37:59.433121 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 349/655] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:59 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1569 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:59.445336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ee885444-c6d3-4b06-b7b3-bf08b2f32f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:59.454998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ee885444-c6d3-4b06-b7b3-bf08b2f32f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:59.488042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee885444-c6d3-4b06-b7b3-bf08b2f32f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:59.488870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee885444-c6d3-4b06-b7b3-bf08b2f32f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:59.490282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee885444-c6d3-4b06-b7b3-bf08b2f32f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:59.491058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee885444-c6d3-4b06-b7b3-bf08b2f32f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:59.549328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-b849154c-973f-41fb-a72f-20ad54f7126e tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:37:59.582214 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b849154c-973f-41fb-a72f-20ad54f7126e tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.274564 Jul 28 03:37:59.582811 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 307/656] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:37:59 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:37:59.642970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7157879d-5d45-4275-9704-1f2184b1b61b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:37:59.644747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7157879d-5d45-4275-9704-1f2184b1b61b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:37:59.669266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7157879d-5d45-4275-9704-1f2184b1b61b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:59.672318 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7157879d-5d45-4275-9704-1f2184b1b61b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:59.674456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7157879d-5d45-4275-9704-1f2184b1b61b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:37:59.677097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7157879d-5d45-4275-9704-1f2184b1b61b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:37:59.799452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ee885444-c6d3-4b06-b7b3-bf08b2f32f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:37:59.815099 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ee885444-c6d3-4b06-b7b3-bf08b2f32f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1534 microversion: 2.1 time: 0.379297 Jul 28 03:37:59.826210 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 350/657] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:59 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1534 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:37:59.848170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3f9806ff-0d03-4e95-b55d-5f0b622be5bb tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Action: 'create', calling method: .version_select at 0x7ffa74895940>, body: {"pool": "a00943e5-a0eb-4dda-9987-6ff19b962697"} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:00.425968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7157879d-5d45-4275-9704-1f2184b1b61b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:00.452289 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7157879d-5d45-4275-9704-1f2184b1b61b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1503 microversion: 2.1 time: 0.820978 Jul 28 03:38:00.454229 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 308/658] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:37:59 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1503 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:00.465455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bd44296a-5972-4064-9baa-294d110576c6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:00.466771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bd44296a-5972-4064-9baa-294d110576c6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:00.495767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd44296a-5972-4064-9baa-294d110576c6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:00.496981 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd44296a-5972-4064-9baa-294d110576c6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:00.498772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd44296a-5972-4064-9baa-294d110576c6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:00.499702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd44296a-5972-4064-9baa-294d110576c6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:00.944485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bd44296a-5972-4064-9baa-294d110576c6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:00.959014 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bd44296a-5972-4064-9baa-294d110576c6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1322 microversion: 2.1 time: 0.501687 Jul 28 03:38:00.959617 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 309/659] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:00 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1322 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:00.972603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1170687f-d738-4a93-8b9e-082248aa9b9c tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:00.973444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1170687f-d738-4a93-8b9e-082248aa9b9c tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:00.995577 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1170687f-d738-4a93-8b9e-082248aa9b9c tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:00.996035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1170687f-d738-4a93-8b9e-082248aa9b9c tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:00.996864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1170687f-d738-4a93-8b9e-082248aa9b9c tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:00.997804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1170687f-d738-4a93-8b9e-082248aa9b9c tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:01.108415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1170687f-d738-4a93-8b9e-082248aa9b9c tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:01.144725 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1170687f-d738-4a93-8b9e-082248aa9b9c tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1321 microversion: 2.1 time: 0.183545 Jul 28 03:38:01.147910 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 310/660] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:00 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:01.160825 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-83a6567c-a5ff-486e-803b-f4003ec33c0a req-76dc6f91-4cdd-49af-b9c3-3fc91b226160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712656b5-8470-4486-baf2-1c412846c8fc", "name": "network-vif-unplugged", "status": "completed", "tag": "e54d0f2b-04e3-4f2a-b2ad-ca1a7f88a7e9"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:01.181919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-83a6567c-a5ff-486e-803b-f4003ec33c0a req-76dc6f91-4cdd-49af-b9c3-3fc91b226160 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:01.182853 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-83a6567c-a5ff-486e-803b-f4003ec33c0a req-76dc6f91-4cdd-49af-b9c3-3fc91b226160 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:01.198264 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-83a6567c-a5ff-486e-803b-f4003ec33c0a req-76dc6f91-4cdd-49af-b9c3-3fc91b226160 service nova] Creating event network-vif-unplugged:e54d0f2b-04e3-4f2a-b2ad-ca1a7f88a7e9 for instance 712656b5-8470-4486-baf2-1c412846c8fc on n-h2-826756-3 Jul 28 03:38:01.207801 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-83a6567c-a5ff-486e-803b-f4003ec33c0a req-76dc6f91-4cdd-49af-b9c3-3fc91b226160 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055002 Jul 28 03:38:01.209334 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 311/661] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:01.218775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-b8a0f776-12a7-4038-a5a4-79ede1dd252b req-c0cd7d01-32d5-4664-b331-64a60dee80f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33dc7b6-d97c-4973-b4a3-e576cddcdbb6", "name": "network-vif-plugged", "status": "completed", "tag": "8c5f10b9-7997-49b9-9d60-54f589aacd7d"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:01.230582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b8a0f776-12a7-4038-a5a4-79ede1dd252b req-c0cd7d01-32d5-4664-b331-64a60dee80f9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:01.231441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b8a0f776-12a7-4038-a5a4-79ede1dd252b req-c0cd7d01-32d5-4664-b331-64a60dee80f9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:01.245527 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-b8a0f776-12a7-4038-a5a4-79ede1dd252b req-c0cd7d01-32d5-4664-b331-64a60dee80f9 service nova] Creating event network-vif-plugged:8c5f10b9-7997-49b9-9d60-54f589aacd7d for instance a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 on n-h1-826756-3 Jul 28 03:38:01.251520 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-b8a0f776-12a7-4038-a5a4-79ede1dd252b req-c0cd7d01-32d5-4664-b331-64a60dee80f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039388 Jul 28 03:38:01.252563 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 312/662] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:01.260265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ac38a791-74cd-4b8c-94e4-378aa1e9c4fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:01.261558 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ac38a791-74cd-4b8c-94e4-378aa1e9c4fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:01.270109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac38a791-74cd-4b8c-94e4-378aa1e9c4fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:01.270928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac38a791-74cd-4b8c-94e4-378aa1e9c4fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:01.272467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac38a791-74cd-4b8c-94e4-378aa1e9c4fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:01.273247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac38a791-74cd-4b8c-94e4-378aa1e9c4fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:01.281563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:01.795248 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ac38a791-74cd-4b8c-94e4-378aa1e9c4fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:01.812303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ac38a791-74cd-4b8c-94e4-378aa1e9c4fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:01.814657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ac38a791-74cd-4b8c-94e4-378aa1e9c4fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:01.816635 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ac38a791-74cd-4b8c-94e4-378aa1e9c4fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1569 microversion: 2.25 time: 0.562117 Jul 28 03:38:01.818173 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 313/663] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:01 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1569 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:01.828289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b410aada-a2b7-47f2-9617-6b3367e96428 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:01.831006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b410aada-a2b7-47f2-9617-6b3367e96428 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:01.843743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b410aada-a2b7-47f2-9617-6b3367e96428 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:01.844843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b410aada-a2b7-47f2-9617-6b3367e96428 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:01.846443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b410aada-a2b7-47f2-9617-6b3367e96428 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:01.847268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b410aada-a2b7-47f2-9617-6b3367e96428 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:01.964771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-b410aada-a2b7-47f2-9617-6b3367e96428 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:01.992667 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b410aada-a2b7-47f2-9617-6b3367e96428 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.172917 Jul 28 03:38:01.994596 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 314/664] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:01 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:01.999098 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-33fe6548-3bb9-4512-ba97-fb5190ea9722 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:01.999810 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-33fe6548-3bb9-4512-ba97-fb5190ea9722 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:02.006868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33fe6548-3bb9-4512-ba97-fb5190ea9722 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:02.007457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33fe6548-3bb9-4512-ba97-fb5190ea9722 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:02.008524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33fe6548-3bb9-4512-ba97-fb5190ea9722 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:02.008964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33fe6548-3bb9-4512-ba97-fb5190ea9722 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:02.734873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-33fe6548-3bb9-4512-ba97-fb5190ea9722 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:02.769569 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-33fe6548-3bb9-4512-ba97-fb5190ea9722 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1503 microversion: 2.1 time: 0.774304 Jul 28 03:38:02.776523 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 315/665] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:01 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1503 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:02.786098 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c661f274-aac0-43fd-9b49-5b3085d7066f tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:02.788934 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c661f274-aac0-43fd-9b49-5b3085d7066f tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:02.808803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c661f274-aac0-43fd-9b49-5b3085d7066f tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:02.812734 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c661f274-aac0-43fd-9b49-5b3085d7066f tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:02.816126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c661f274-aac0-43fd-9b49-5b3085d7066f tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:02.817776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c661f274-aac0-43fd-9b49-5b3085d7066f tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:03.343634 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c661f274-aac0-43fd-9b49-5b3085d7066f tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:03.352861 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c661f274-aac0-43fd-9b49-5b3085d7066f tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1322 microversion: 2.1 time: 0.572115 Jul 28 03:38:03.358181 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 316/666] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:02 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:03.368776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-88a42561-6282-4bdd-87e6-71cc3ee23db9 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:03.369849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-88a42561-6282-4bdd-87e6-71cc3ee23db9 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:03.387336 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-88a42561-6282-4bdd-87e6-71cc3ee23db9 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:03.387336 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-88a42561-6282-4bdd-87e6-71cc3ee23db9 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:03.388399 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-88a42561-6282-4bdd-87e6-71cc3ee23db9 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:03.390332 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-88a42561-6282-4bdd-87e6-71cc3ee23db9 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:03.537690 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3f9806ff-0d03-4e95-b55d-5f0b622be5bb tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.696050 Jul 28 03:38:03.543648 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-88a42561-6282-4bdd-87e6-71cc3ee23db9 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:03.552589 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 351/667] 10.222.0.48 () {60 vars in 1170 bytes} [Thu Jul 28 03:37:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:03.565163 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-88a42561-6282-4bdd-87e6-71cc3ee23db9 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1319 microversion: 2.1 time: 0.205423 Jul 28 03:38:03.579491 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 317/668] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:03 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:03.579491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-73699804-2007-4dee-9a21-c71fa91b3390 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:03.579491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-73699804-2007-4dee-9a21-c71fa91b3390 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:03.582073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5300edb6-cdd2-4718-8755-ced992d3dba5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:03.583167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5300edb6-cdd2-4718-8755-ced992d3dba5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:03.583936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73699804-2007-4dee-9a21-c71fa91b3390 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:03.584501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73699804-2007-4dee-9a21-c71fa91b3390 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:03.596755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73699804-2007-4dee-9a21-c71fa91b3390 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:03.600189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73699804-2007-4dee-9a21-c71fa91b3390 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:03.605766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5300edb6-cdd2-4718-8755-ced992d3dba5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:03.606652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5300edb6-cdd2-4718-8755-ced992d3dba5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:03.607663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5300edb6-cdd2-4718-8755-ced992d3dba5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:03.612036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5300edb6-cdd2-4718-8755-ced992d3dba5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:03.971372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5300edb6-cdd2-4718-8755-ced992d3dba5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:03.994551 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5300edb6-cdd2-4718-8755-ced992d3dba5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.437370 Jul 28 03:38:03.996329 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 352/669] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:03 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:04.002102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb9df44e-93ed-47a4-8bdc-10c8093eeef6 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:04.003185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eb9df44e-93ed-47a4-8bdc-10c8093eeef6 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:04.011747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb9df44e-93ed-47a4-8bdc-10c8093eeef6 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:04.012849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb9df44e-93ed-47a4-8bdc-10c8093eeef6 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:04.014019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb9df44e-93ed-47a4-8bdc-10c8093eeef6 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:04.014756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb9df44e-93ed-47a4-8bdc-10c8093eeef6 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:04.262759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-73699804-2007-4dee-9a21-c71fa91b3390 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:04.295202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-eb9df44e-93ed-47a4-8bdc-10c8093eeef6 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:04.298549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-73699804-2007-4dee-9a21-c71fa91b3390 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:04.325950 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-73699804-2007-4dee-9a21-c71fa91b3390 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:04.336885 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-73699804-2007-4dee-9a21-c71fa91b3390 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1569 microversion: 2.25 time: 0.762314 Jul 28 03:38:04.340954 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 318/670] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:03 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1569 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:04.392227 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb9df44e-93ed-47a4-8bdc-10c8093eeef6 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.393931 Jul 28 03:38:04.392786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-b7a9f673-0cee-43fe-a7ab-835ed4340bd3 req-4cf7799c-836b-4724-839a-96582058cc7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d67752-6c63-4b60-9306-007519a62c9d", "name": "network-vif-deleted", "tag": "01a26c26-198c-4922-8c18-94f221ad8f7d"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:04.404634 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 353/671] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:03 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:04.416409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d0d5f1c-e361-4190-b75f-95586392ee42 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Action: 'action', calling method: .version_select at 0x7ffa77ce0280>, body: {"addFloatingIp": {"address": "172.25.6.194"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:04.419899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8d0d5f1c-e361-4190-b75f-95586392ee42 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:04.429993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d0d5f1c-e361-4190-b75f-95586392ee42 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:04.432645 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b7a9f673-0cee-43fe-a7ab-835ed4340bd3 req-4cf7799c-836b-4724-839a-96582058cc7c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:04.433947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d0d5f1c-e361-4190-b75f-95586392ee42 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:04.434990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d0d5f1c-e361-4190-b75f-95586392ee42 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:04.435789 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b7a9f673-0cee-43fe-a7ab-835ed4340bd3 req-4cf7799c-836b-4724-839a-96582058cc7c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:04.436479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d0d5f1c-e361-4190-b75f-95586392ee42 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:04.468723 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-b7a9f673-0cee-43fe-a7ab-835ed4340bd3 req-4cf7799c-836b-4724-839a-96582058cc7c service nova] Creating event network-vif-deleted:01a26c26-198c-4922-8c18-94f221ad8f7d for instance 40d67752-6c63-4b60-9306-007519a62c9d on n-h1-826756-3 Jul 28 03:38:04.486159 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-b7a9f673-0cee-43fe-a7ab-835ed4340bd3 req-4cf7799c-836b-4724-839a-96582058cc7c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138639 Jul 28 03:38:04.487055 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 319/672] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:04.506975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ec954b96-f4ac-4d98-98ad-b53cc0596592 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:04.507942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ec954b96-f4ac-4d98-98ad-b53cc0596592 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:04.526679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ec954b96-f4ac-4d98-98ad-b53cc0596592 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:04.527486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ec954b96-f4ac-4d98-98ad-b53cc0596592 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:04.529758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ec954b96-f4ac-4d98-98ad-b53cc0596592 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:04.531146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ec954b96-f4ac-4d98-98ad-b53cc0596592 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:04.623415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d0d5f1c-e361-4190-b75f-95586392ee42 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Acquired lock "refresh_cache-a2393d2a-78ad-4dd9-ad03-d8622acdb71e" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 03:38:05.184119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ec954b96-f4ac-4d98-98ad-b53cc0596592 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:05.199134 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ec954b96-f4ac-4d98-98ad-b53cc0596592 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1503 microversion: 2.1 time: 0.707624 Jul 28 03:38:05.208375 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 320/673] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:04 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1503 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:05.217699 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9d803573-670c-4d1b-a0d0-457ce315b624 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:05.219116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9d803573-670c-4d1b-a0d0-457ce315b624 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:05.232277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d803573-670c-4d1b-a0d0-457ce315b624 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:05.234085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d803573-670c-4d1b-a0d0-457ce315b624 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:05.236212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d803573-670c-4d1b-a0d0-457ce315b624 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:05.237376 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d803573-670c-4d1b-a0d0-457ce315b624 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:05.558252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9d803573-670c-4d1b-a0d0-457ce315b624 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:05.567963 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9d803573-670c-4d1b-a0d0-457ce315b624 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.357644 Jul 28 03:38:05.569630 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 321/674] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:05 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:05.576774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f06c4991-ca78-4c4f-b735-676214b7da0b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:05.577770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f06c4991-ca78-4c4f-b735-676214b7da0b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:05.602197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f06c4991-ca78-4c4f-b735-676214b7da0b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:05.603154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f06c4991-ca78-4c4f-b735-676214b7da0b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:05.604646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f06c4991-ca78-4c4f-b735-676214b7da0b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:05.605984 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f06c4991-ca78-4c4f-b735-676214b7da0b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:05.841873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f06c4991-ca78-4c4f-b735-676214b7da0b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:05.854535 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f06c4991-ca78-4c4f-b735-676214b7da0b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1471 microversion: 2.1 time: 0.283458 Jul 28 03:38:05.868531 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 322/675] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:05 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1471 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:05.879347 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ea54f673-6845-46fa-9c4e-26f75d29fe65 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:05.882418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ea54f673-6845-46fa-9c4e-26f75d29fe65 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:05.891178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea54f673-6845-46fa-9c4e-26f75d29fe65 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:05.891778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea54f673-6845-46fa-9c4e-26f75d29fe65 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:05.893277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea54f673-6845-46fa-9c4e-26f75d29fe65 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:05.893903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea54f673-6845-46fa-9c4e-26f75d29fe65 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:06.422621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ea54f673-6845-46fa-9c4e-26f75d29fe65 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:06.437508 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ea54f673-6845-46fa-9c4e-26f75d29fe65 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1386 microversion: 2.1 time: 0.576098 Jul 28 03:38:06.438906 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 323/676] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:05 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1386 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:06.443772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5f8922f9-02eb-4b82-aa2f-ee8a3719c88b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:06.447239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5f8922f9-02eb-4b82-aa2f-ee8a3719c88b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:06.467951 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5f8922f9-02eb-4b82-aa2f-ee8a3719c88b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:06.471885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5f8922f9-02eb-4b82-aa2f-ee8a3719c88b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:06.472899 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5f8922f9-02eb-4b82-aa2f-ee8a3719c88b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:06.473396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5f8922f9-02eb-4b82-aa2f-ee8a3719c88b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:06.695971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5f8922f9-02eb-4b82-aa2f-ee8a3719c88b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:06.716800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5f8922f9-02eb-4b82-aa2f-ee8a3719c88b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:06.720240 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5f8922f9-02eb-4b82-aa2f-ee8a3719c88b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:06.722532 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5f8922f9-02eb-4b82-aa2f-ee8a3719c88b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1559 microversion: 2.25 time: 0.282277 Jul 28 03:38:06.723578 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 324/677] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:06 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1559 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:06.734015 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dfc4d87a-c9b9-4230-a185-604659081185 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:06.735632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dfc4d87a-c9b9-4230-a185-604659081185 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:06.748435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dfc4d87a-c9b9-4230-a185-604659081185 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:06.749986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dfc4d87a-c9b9-4230-a185-604659081185 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:06.752048 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dfc4d87a-c9b9-4230-a185-604659081185 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:06.753230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dfc4d87a-c9b9-4230-a185-604659081185 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:06.836834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-dfc4d87a-c9b9-4230-a185-604659081185 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:06.858713 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dfc4d87a-c9b9-4230-a185-604659081185 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.133078 Jul 28 03:38:06.859344 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 325/678] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:06 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:06.864665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8b1e13ad-9315-4252-acfd-5ea47c04da89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:06.865279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8b1e13ad-9315-4252-acfd-5ea47c04da89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:06.872024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b1e13ad-9315-4252-acfd-5ea47c04da89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:06.872498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b1e13ad-9315-4252-acfd-5ea47c04da89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:06.873277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b1e13ad-9315-4252-acfd-5ea47c04da89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:06.873923 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b1e13ad-9315-4252-acfd-5ea47c04da89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:07.108411 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8b1e13ad-9315-4252-acfd-5ea47c04da89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:07.119720 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8b1e13ad-9315-4252-acfd-5ea47c04da89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.258954 Jul 28 03:38:07.120721 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 326/679] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:06 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:07.211097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-55e42e7a-4b43-46cd-95f3-240fbe815f04 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:07.212682 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-55e42e7a-4b43-46cd-95f3-240fbe815f04 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] [instance: 52f720fe-a0c0-40f4-a1d9-2b8a5ef559e5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:07.222738 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-55e42e7a-4b43-46cd-95f3-240fbe815f04 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] HTTP exception thrown: Instance 52f720fe-a0c0-40f4-a1d9-2b8a5ef559e5 could not be found. Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-55e42e7a-4b43-46cd-95f3-240fbe815f04 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Request method failure captured: Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/52f720fe-a0c0-40f4-a1d9-2b8a5ef559e5/action HTTP/1.1 Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 15 Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gSIjBY89Jxd5nvAyUxV8IJGlmMT8WSjW9enYw2aPvjaBglR22lsLsimLjP0YBER-Wx_HI7flV-rAAGYvCEVs0vpvpfU1SA6bWZBm8XhQG2IFunRerWZKhlpyFK5p5ltUnZmKTsh1UoxWt4ZZkDXJ64HO7aE_soV04gEO8li9ycM1cI Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: e3a4561560cc4057b0b0b0d65b2a0686 Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:38:07.229898 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:38:07.231743 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3a4561560cc4057b0b0b0d65b2a0686"}]}] Jul 28 03:38:07.231743 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:07.231743 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: e3a4561560cc4057b0b0b0d65b2a0686 Jul 28 03:38:07.231743 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:07.231743 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersAdminNegativeTestJSON-1661675032-project-admin Jul 28 03:38:07.231743 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:38:07.231743 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:38:07.231743 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 000f1f96e5ef4821a8023408850a2972 Jul 28 03:38:07.231743 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1661675032-project-admin Jul 28 03:38:07.231743 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:38:07.231743 n-d-826756-3 devstack@n-api.service[126072]: {"migrate": {}} Jul 28 03:38:07.231743 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:38:07.231743 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 52f720fe-a0c0-40f4-a1d9-2b8a5ef559e5 could not be found. Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '52f720fe-a0c0-40f4-a1d9-2b8a5ef559e5', 'body': {'migrate': {}}} Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52f720fe-a0c0-40f4-a1d9-2b8a5ef559e5 could not be found. Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:38:07.232867 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52f720fe-a0c0-40f4-a1d9-2b8a5ef559e5 could not be found. Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52f720fe-a0c0-40f4-a1d9-2b8a5ef559e5 could not be found. Jul 28 03:38:07.234309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:07.237726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-55e42e7a-4b43-46cd-95f3-240fbe815f04 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Returning 404 to user: Instance 52f720fe-a0c0-40f4-a1d9-2b8a5ef559e5 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:38:07.240179 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-55e42e7a-4b43-46cd-95f3-240fbe815f04 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/52f720fe-a0c0-40f4-a1d9-2b8a5ef559e5/action" status: 404 len: 111 microversion: 2.1 time: 0.117538 Jul 28 03:38:07.240989 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 327/680] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:07 2022] POST /compute/v2.1/servers/52f720fe-a0c0-40f4-a1d9-2b8a5ef559e5/action => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:38:07.247968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9608dd4f-f4d9-4a78-b6fa-17d63d17769f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:07.249250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9608dd4f-f4d9-4a78-b6fa-17d63d17769f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:07.291834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9608dd4f-f4d9-4a78-b6fa-17d63d17769f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:07.293540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9608dd4f-f4d9-4a78-b6fa-17d63d17769f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:07.295579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9608dd4f-f4d9-4a78-b6fa-17d63d17769f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:07.298710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9608dd4f-f4d9-4a78-b6fa-17d63d17769f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:07.461331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-8d0d5f1c-e361-4190-b75f-95586392ee42 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Building network info cache for instance {{(pid=126071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 03:38:07.686460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9608dd4f-f4d9-4a78-b6fa-17d63d17769f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:07.697596 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9608dd4f-f4d9-4a78-b6fa-17d63d17769f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1503 microversion: 2.1 time: 0.455014 Jul 28 03:38:07.709255 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 328/681] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:07 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1503 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:07.722349 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-ef3ef90a-e6db-4a79-874f-b0b84d96c6c0 req-96fd786b-279b-4a5e-9754-fd4181e4407a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd3aa530-0f24-4157-97ab-ea9ab8423ca5", "tag": "9d7f2b85-1892-469a-a4c4-0299eeaba795"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:07.733533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-ef3ef90a-e6db-4a79-874f-b0b84d96c6c0 req-96fd786b-279b-4a5e-9754-fd4181e4407a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:07.734431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-ef3ef90a-e6db-4a79-874f-b0b84d96c6c0 req-96fd786b-279b-4a5e-9754-fd4181e4407a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:07.757073 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-ef3ef90a-e6db-4a79-874f-b0b84d96c6c0 req-96fd786b-279b-4a5e-9754-fd4181e4407a service nova] Creating event network-changed:9d7f2b85-1892-469a-a4c4-0299eeaba795 for instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 on n-h2-826756-3 Jul 28 03:38:07.763563 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-ef3ef90a-e6db-4a79-874f-b0b84d96c6c0 req-96fd786b-279b-4a5e-9754-fd4181e4407a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045763 Jul 28 03:38:07.764397 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 329/682] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:07.769649 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-4d66408f-2b22-4052-9965-c6f8be246979 req-4c1b9650-9f07-41b9-9a92-8a770ad05c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cda1bf7-ab8a-4567-a8d6-54697a316461", "name": "network-vif-unplugged", "status": "completed", "tag": "c89c0e09-fda3-4512-826c-85a6f08cc121"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:07.784485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4d66408f-2b22-4052-9965-c6f8be246979 req-4c1b9650-9f07-41b9-9a92-8a770ad05c7b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:07.784766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4d66408f-2b22-4052-9965-c6f8be246979 req-4c1b9650-9f07-41b9-9a92-8a770ad05c7b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:07.800892 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-4d66408f-2b22-4052-9965-c6f8be246979 req-4c1b9650-9f07-41b9-9a92-8a770ad05c7b service nova] Creating event network-vif-unplugged:c89c0e09-fda3-4512-826c-85a6f08cc121 for instance 2cda1bf7-ab8a-4567-a8d6-54697a316461 on n-h1-826756-3 Jul 28 03:38:07.806711 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-4d66408f-2b22-4052-9965-c6f8be246979 req-4c1b9650-9f07-41b9-9a92-8a770ad05c7b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040942 Jul 28 03:38:07.807748 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 330/683] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:07.816529 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f578ed0a-fb83-4485-aad7-24173d53e6f0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '.version_select at 0x7ffa74b3ee50>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:07.820301 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f578ed0a-fb83-4485-aad7-24173d53e6f0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:07.821160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f578ed0a-fb83-4485-aad7-24173d53e6f0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:07.840084 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f578ed0a-fb83-4485-aad7-24173d53e6f0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1100 microversion: 2.25 time: 0.031236 Jul 28 03:38:07.841042 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 331/684] 10.222.0.48 () {60 vars in 1184 bytes} [Thu Jul 28 03:38:07 2022] GET /compute/v2.1/os-migrations => generated 1100 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:07.850384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ebf75844-29f1-426d-8978-391de5ddf018 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-991892286"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:07.854387 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ebf75844-29f1-426d-8978-391de5ddf018 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:07.862051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebf75844-29f1-426d-8978-391de5ddf018 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:07.862503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebf75844-29f1-426d-8978-391de5ddf018 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:07.863746 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebf75844-29f1-426d-8978-391de5ddf018 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:07.864209 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebf75844-29f1-426d-8978-391de5ddf018 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:07.901305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:08.100908 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ebf75844-29f1-426d-8978-391de5ddf018 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.257022 Jul 28 03:38:08.101948 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 332/685] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:07 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 28 03:38:08.110264 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-347513116", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:08.125528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:08.193936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:38:08.499986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:38:08.501683 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:38:08.502580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:38:08.503493 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:38:08.503997 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:38:08.520002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-8d0d5f1c-e361-4190-b75f-95586392ee42 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Updating instance_info_cache with network_info: [{"id": "b6de10ac-a038-41b1-a2ce-0c6183a7eb56", "address": "fa:16:3e:d9:cd:96", "network": {"id": "25ef7f60-e0d8-490c-a4ac-ff68400c4970", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-290516614-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "84ec6bcd01c4410c8193820cfdd2367c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb6de10ac-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 03:38:08.530510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:08.530510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:08.531434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:08.532079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:08.548475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d0d5f1c-e361-4190-b75f-95586392ee42 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Releasing lock "refresh_cache-a2393d2a-78ad-4dd9-ad03-d8622acdb71e" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 03:38:08.550377 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8d0d5f1c-e361-4190-b75f-95586392ee42 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action" status: 202 len: 0 microversion: 2.1 time: 4.144018 Jul 28 03:38:08.551282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Getting quotas for project 391141504bc0471d932aa2799c28721c. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:38:08.551760 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 354/686] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:04 2022] POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action => generated 0 bytes in 4146 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 03:38:08.557339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Getting quotas for user 07f281c9665e45529130d241ea5f4a84 and project 391141504bc0471d932aa2799c28721c. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:38:08.559007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5c2d038-d159-4959-8623-57cdf671ca50 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:08.560124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b5c2d038-d159-4959-8623-57cdf671ca50 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:08.566908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5c2d038-d159-4959-8623-57cdf671ca50 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:08.567679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5c2d038-d159-4959-8623-57cdf671ca50 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:08.568761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5c2d038-d159-4959-8623-57cdf671ca50 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:08.569430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5c2d038-d159-4959-8623-57cdf671ca50 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:08.574032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:38:08.578636 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:38:08.653940 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-16187c22-c5ca-4c49-b39d-786c654b2fd3 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543689 Jul 28 03:38:08.661114 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 333/687] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:38:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:38:08.666069 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7589caeb-b291-4ec9-b7cf-2143a7ea484f tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:08.666680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7589caeb-b291-4ec9-b7cf-2143a7ea484f tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:08.675131 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7589caeb-b291-4ec9-b7cf-2143a7ea484f tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:08.675569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7589caeb-b291-4ec9-b7cf-2143a7ea484f tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:08.676330 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7589caeb-b291-4ec9-b7cf-2143a7ea484f tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:08.676797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7589caeb-b291-4ec9-b7cf-2143a7ea484f tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:08.798617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b5c2d038-d159-4959-8623-57cdf671ca50 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:08.815518 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5c2d038-d159-4959-8623-57cdf671ca50 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1386 microversion: 2.1 time: 0.262072 Jul 28 03:38:08.816526 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 355/688] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:08 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1386 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:08.845410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f28eb8b7-43ed-457d-96d3-f7e482ec5068 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:08.846460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f28eb8b7-43ed-457d-96d3-f7e482ec5068 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:08.859052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f28eb8b7-43ed-457d-96d3-f7e482ec5068 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:08.859902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f28eb8b7-43ed-457d-96d3-f7e482ec5068 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:08.861142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f28eb8b7-43ed-457d-96d3-f7e482ec5068 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:08.861863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f28eb8b7-43ed-457d-96d3-f7e482ec5068 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:08.874212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-7589caeb-b291-4ec9-b7cf-2143a7ea484f tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid 712656b5-8470-4486-baf2-1c412846c8fc {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:08.920542 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7589caeb-b291-4ec9-b7cf-2143a7ea484f tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 2052 microversion: 2.25 time: 0.257353 Jul 28 03:38:08.923523 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 334/689] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:08 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 2052 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:08.931756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-89dfa756-4508-4429-a003-52a5d0537ab9 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Action: 'create', calling method: .version_select at 0x7ffa74ce7790>, body: {"pool": "a00943e5-a0eb-4dda-9987-6ff19b962697"} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:09.010419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-f28eb8b7-43ed-457d-96d3-f7e482ec5068 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:09.019416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:09.047741 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f28eb8b7-43ed-457d-96d3-f7e482ec5068 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.220661 Jul 28 03:38:09.048532 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 356/690] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:08 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:09.054560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af4f724b-11cd-4cf4-915b-62e283f35dfd tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:09.055344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-af4f724b-11cd-4cf4-915b-62e283f35dfd tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:09.057875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:09.175042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-af4f724b-11cd-4cf4-915b-62e283f35dfd tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:09.194780 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-af4f724b-11cd-4cf4-915b-62e283f35dfd tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1221 microversion: 2.1 time: 0.144481 Jul 28 03:38:09.206786 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 357/691] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:09 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1221 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:09.212937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-38f2030c-a64d-4830-8057-5a398352d215 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:09.213594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-38f2030c-a64d-4830-8057-5a398352d215 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:09.223409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-38f2030c-a64d-4830-8057-5a398352d215 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:09.223864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-38f2030c-a64d-4830-8057-5a398352d215 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:09.225071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-38f2030c-a64d-4830-8057-5a398352d215 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:09.225519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-38f2030c-a64d-4830-8057-5a398352d215 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:09.411547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-38f2030c-a64d-4830-8057-5a398352d215 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:09.427750 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-38f2030c-a64d-4830-8057-5a398352d215 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1503 microversion: 2.1 time: 0.219159 Jul 28 03:38:09.428781 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 358/692] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:09 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1503 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:09.437941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-108940680", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f61dea9e-b85d-46b5-aa09-70f0225d6c84"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:09.509702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] validate_networks() for [('f61dea9e-b85d-46b5-aa09-70f0225d6c84', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:38:10.090709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:38:10.091737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:38:10.092744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:38:10.093346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:38:10.093901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:38:10.113084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:10.113942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:10.115319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:10.116083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:10.145451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Getting quotas for project 881125b6bb84430fb4f2e0c6ebf79983. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:38:10.153979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Getting quotas for user c2e3c37253bc408682e9a15c3b5a85ab and project 881125b6bb84430fb4f2e0c6ebf79983. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:38:10.182697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:38:10.186347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:38:10.301555 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-222d660a-0782-40bf-8ba0-c048aeef5d63 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.871362 Jul 28 03:38:10.302232 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 359/693] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:38:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:38:10.330192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-32a65561-ba0d-490a-9950-c4e9febe3537 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:10.330533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-32a65561-ba0d-490a-9950-c4e9febe3537 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:10.350650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32a65561-ba0d-490a-9950-c4e9febe3537 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:10.351105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32a65561-ba0d-490a-9950-c4e9febe3537 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:10.354836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32a65561-ba0d-490a-9950-c4e9febe3537 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:10.356541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32a65561-ba0d-490a-9950-c4e9febe3537 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:10.403352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:10.687393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-32a65561-ba0d-490a-9950-c4e9febe3537 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:10.707421 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-32a65561-ba0d-490a-9950-c4e9febe3537 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1386 microversion: 2.1 time: 0.403758 Jul 28 03:38:10.721331 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 360/694] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:10 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1386 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:10.750914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f5dcf6a2-c995-4251-88d3-c66db4d9271a req-7518c782-b2ce-414b-a2ef-a835edaaa69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2393d2a-78ad-4dd9-ad03-d8622acdb71e", "tag": "b6de10ac-a038-41b1-a2ce-0c6183a7eb56"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:10.794007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f5dcf6a2-c995-4251-88d3-c66db4d9271a req-7518c782-b2ce-414b-a2ef-a835edaaa69c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:10.795092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f5dcf6a2-c995-4251-88d3-c66db4d9271a req-7518c782-b2ce-414b-a2ef-a835edaaa69c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:11.060319 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f5dcf6a2-c995-4251-88d3-c66db4d9271a req-7518c782-b2ce-414b-a2ef-a835edaaa69c service nova] Creating event network-changed:b6de10ac-a038-41b1-a2ce-0c6183a7eb56 for instance a2393d2a-78ad-4dd9-ad03-d8622acdb71e on n-h2-826756-3 Jul 28 03:38:11.067994 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f5dcf6a2-c995-4251-88d3-c66db4d9271a req-7518c782-b2ce-414b-a2ef-a835edaaa69c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.344044 Jul 28 03:38:11.070009 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 361/695] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:11.082630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5fca94de-e33a-430b-bf72-10d1af6e19ea tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:11.083488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5fca94de-e33a-430b-bf72-10d1af6e19ea tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:11.091507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fca94de-e33a-430b-bf72-10d1af6e19ea tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:11.092383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fca94de-e33a-430b-bf72-10d1af6e19ea tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:11.094021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fca94de-e33a-430b-bf72-10d1af6e19ea tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:11.095159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fca94de-e33a-430b-bf72-10d1af6e19ea tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:11.216966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-5fca94de-e33a-430b-bf72-10d1af6e19ea tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:11.242246 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5fca94de-e33a-430b-bf72-10d1af6e19ea tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.169240 Jul 28 03:38:11.243039 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 362/696] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:11 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:11.253564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-497cab79-3101-4ec7-a5df-e5b5de7d1f52 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:11.253564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-497cab79-3101-4ec7-a5df-e5b5de7d1f52 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:11.262368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-497cab79-3101-4ec7-a5df-e5b5de7d1f52 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:11.262846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-497cab79-3101-4ec7-a5df-e5b5de7d1f52 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:11.263915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-497cab79-3101-4ec7-a5df-e5b5de7d1f52 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:11.264428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-497cab79-3101-4ec7-a5df-e5b5de7d1f52 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:11.344852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-497cab79-3101-4ec7-a5df-e5b5de7d1f52 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:11.362616 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-497cab79-3101-4ec7-a5df-e5b5de7d1f52 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1273 microversion: 2.1 time: 0.117957 Jul 28 03:38:11.364204 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 363/697] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:11 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:11.374015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19be4841-4846-4e05-a271-72a3eee9fc81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:11.375152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-19be4841-4846-4e05-a271-72a3eee9fc81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:11.388097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19be4841-4846-4e05-a271-72a3eee9fc81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:11.389235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19be4841-4846-4e05-a271-72a3eee9fc81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:11.391389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19be4841-4846-4e05-a271-72a3eee9fc81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:11.392578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19be4841-4846-4e05-a271-72a3eee9fc81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:11.476088 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-89dfa756-4508-4429-a003-52a5d0537ab9 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 2.550986 Jul 28 03:38:11.477227 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 335/698] 10.222.0.48 () {60 vars in 1170 bytes} [Thu Jul 28 03:38:08 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 2553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:11.489918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d6c6bda7-328b-4706-add3-6324b7560a83 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:11.495138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d6c6bda7-328b-4706-add3-6324b7560a83 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:11.509706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6c6bda7-328b-4706-add3-6324b7560a83 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:11.510635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6c6bda7-328b-4706-add3-6324b7560a83 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:11.512976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6c6bda7-328b-4706-add3-6324b7560a83 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:11.513439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6c6bda7-328b-4706-add3-6324b7560a83 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:11.528457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19be4841-4846-4e05-a271-72a3eee9fc81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:11.544841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19be4841-4846-4e05-a271-72a3eee9fc81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:11.547023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19be4841-4846-4e05-a271-72a3eee9fc81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:11.548448 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-19be4841-4846-4e05-a271-72a3eee9fc81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1265 microversion: 2.25 time: 0.182504 Jul 28 03:38:11.549354 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 364/699] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:11 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:11.554659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90b4a60d-43ed-4802-b66f-e6bc4dd13a83 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.6"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:11.557214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-90b4a60d-43ed-4802-b66f-e6bc4dd13a83 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:11.564276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90b4a60d-43ed-4802-b66f-e6bc4dd13a83 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:11.565023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90b4a60d-43ed-4802-b66f-e6bc4dd13a83 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:11.566009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90b4a60d-43ed-4802-b66f-e6bc4dd13a83 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:11.566642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90b4a60d-43ed-4802-b66f-e6bc4dd13a83 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:11.600250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90b4a60d-43ed-4802-b66f-e6bc4dd13a83 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Acquired lock "refresh_cache-a2393d2a-78ad-4dd9-ad03-d8622acdb71e" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 03:38:11.872087 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d6c6bda7-328b-4706-add3-6324b7560a83 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:11.885602 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d6c6bda7-328b-4706-add3-6324b7560a83 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1493 microversion: 2.1 time: 0.406359 Jul 28 03:38:11.886569 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 336/700] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:11 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1493 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:11.891871 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3e50a776-bf1b-427e-a23b-3192b389d65b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:11.892838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3e50a776-bf1b-427e-a23b-3192b389d65b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:11.900870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e50a776-bf1b-427e-a23b-3192b389d65b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:11.901282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e50a776-bf1b-427e-a23b-3192b389d65b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:11.902440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e50a776-bf1b-427e-a23b-3192b389d65b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:11.903096 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e50a776-bf1b-427e-a23b-3192b389d65b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:12.253857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3e50a776-bf1b-427e-a23b-3192b389d65b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:12.267763 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3e50a776-bf1b-427e-a23b-3192b389d65b tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1386 microversion: 2.1 time: 0.379585 Jul 28 03:38:12.269116 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 337/701] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:11 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1386 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:12.274692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-038cb44f-4b43-4c2d-a355-bc17c15b486a tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '.version_select at 0x7ffa74c63af0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:12.281157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-038cb44f-4b43-4c2d-a355-bc17c15b486a tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:12.283179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-038cb44f-4b43-4c2d-a355-bc17c15b486a tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:12.308784 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-038cb44f-4b43-4c2d-a355-bc17c15b486a tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 782 microversion: 2.1 time: 0.038123 Jul 28 03:38:12.310124 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 338/702] 10.222.0.48 () {58 vars in 1143 bytes} [Thu Jul 28 03:38:12 2022] GET /compute/v2.1/os-migrations => generated 782 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:12.323426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5d6e7af2-b237-4fc9-af1f-8a46ac2e0dc0 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:12.324207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5d6e7af2-b237-4fc9-af1f-8a46ac2e0dc0 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:12.325364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG neutronclient.v2_0.client [None req-90b4a60d-43ed-4802-b66f-e6bc4dd13a83 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.6 (e40af95e-847b-4d17-bcbf-0b7f694be91e) with port b6de10ac-a038-41b1-a2ce-0c6183a7eb56 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network a00943e5-a0eb-4dda-9987-6ff19b962697.", "detail": ""}} {{(pid=126071) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:38:12.326396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90b4a60d-43ed-4802-b66f-e6bc4dd13a83 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Releasing lock "refresh_cache-a2393d2a-78ad-4dd9-ad03-d8622acdb71e" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 03:38:12.327295 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-90b4a60d-43ed-4802-b66f-e6bc4dd13a83 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.6 (e40af95e-847b-4d17-bcbf-0b7f694be91e) with port b6de10ac-a038-41b1-a2ce-0c6183a7eb56 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network a00943e5-a0eb-4dda-9987-6ff19b962697. Jul 28 03:38:12.327295 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-9c0d20b9-5210-4deb-95d2-429fed3ec7d3'] Jul 28 03:38:12.339802 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d6e7af2-b237-4fc9-af1f-8a46ac2e0dc0 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:12.340320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d6e7af2-b237-4fc9-af1f-8a46ac2e0dc0 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:12.341431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d6e7af2-b237-4fc9-af1f-8a46ac2e0dc0 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:12.342014 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d6e7af2-b237-4fc9-af1f-8a46ac2e0dc0 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90b4a60d-43ed-4802-b66f-e6bc4dd13a83 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Request method failure captured: Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action HTTP/1.1 Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 44 Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gSGA_OPkLHQs__6B3lNyKphnEJIgdf9aMZnZLbYqP-PFVkypmYlCeMn67JTCIyyWJn9vQ-km8Xmztf2Wn-Ga1zH8aQD6QbkpHnpSgODs4fR7zq2Xo42FiJFJQWaaf7fg_YSUSrM7KOEHWOUpY6HrSFKSoO-b2-dgO_T1qQ52tFZPD0 Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 84ec6bcd01c4410c8193820cfdd2367c Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:38:12.355306 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:38:12.358476 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84ec6bcd01c4410c8193820cfdd2367c"}]}] Jul 28 03:38:12.358476 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:12.358476 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 84ec6bcd01c4410c8193820cfdd2367c Jul 28 03:38:12.358476 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:12.358476 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project Jul 28 03:38:12.358476 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:38:12.358476 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:38:12.358476 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: b17befcacdd14330be582e67c50e2c79 Jul 28 03:38:12.358476 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project Jul 28 03:38:12.358476 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:38:12.358476 n-d-826756-3 devstack@n-api.service[126071]: {"addFloatingIp": {"address": "172.25.6.6"}} Jul 28 03:38:12.358476 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: exception: Cannot associate floating IP 172.25.6.6 (e40af95e-847b-4d17-bcbf-0b7f694be91e) with port b6de10ac-a038-41b1-a2ce-0c6183a7eb56 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network a00943e5-a0eb-4dda-9987-6ff19b962697. Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-9c0d20b9-5210-4deb-95d2-429fed3ec7d3'] Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a2393d2a-78ad-4dd9-ad03-d8622acdb71e', 'body': {'addFloatingIp': {'address': '172.25.6.6'}}} Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:38:12.360089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:38:12.362635 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.6 (e40af95e-847b-4d17-bcbf-0b7f694be91e) with port b6de10ac-a038-41b1-a2ce-0c6183a7eb56 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network a00943e5-a0eb-4dda-9987-6ff19b962697. Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c0d20b9-5210-4deb-95d2-429fed3ec7d3'] Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.6 (e40af95e-847b-4d17-bcbf-0b7f694be91e) with port b6de10ac-a038-41b1-a2ce-0c6183a7eb56 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network a00943e5-a0eb-4dda-9987-6ff19b962697. Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c0d20b9-5210-4deb-95d2-429fed3ec7d3'] Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:12.364833 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.6 (e40af95e-847b-4d17-bcbf-0b7f694be91e) with port b6de10ac-a038-41b1-a2ce-0c6183a7eb56 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network a00943e5-a0eb-4dda-9987-6ff19b962697. Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c0d20b9-5210-4deb-95d2-429fed3ec7d3'] Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:12.367042 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:12.369527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:12.369527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:12.369527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:12.369527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:38:12.369527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:38:12.369527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.6 (e40af95e-847b-4d17-bcbf-0b7f694be91e) with port b6de10ac-a038-41b1-a2ce-0c6183a7eb56 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network a00943e5-a0eb-4dda-9987-6ff19b962697. Jul 28 03:38:12.369527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c0d20b9-5210-4deb-95d2-429fed3ec7d3'] Jul 28 03:38:12.369527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:12.373000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90b4a60d-43ed-4802-b66f-e6bc4dd13a83 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Returning 400 to user: Cannot associate floating IP 172.25.6.6 (e40af95e-847b-4d17-bcbf-0b7f694be91e) with port b6de10ac-a038-41b1-a2ce-0c6183a7eb56 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network a00943e5-a0eb-4dda-9987-6ff19b962697. Jul 28 03:38:12.373000 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-9c0d20b9-5210-4deb-95d2-429fed3ec7d3'] {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:38:12.374394 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90b4a60d-43ed-4802-b66f-e6bc4dd13a83 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action" status: 400 len: 379 microversion: 2.1 time: 0.823739 Jul 28 03:38:12.375394 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 365/703] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:11 2022] POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action => generated 379 bytes in 825 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:38:12.390407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d1d62edf-00c6-4001-a2f5-08d1f601ed42 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:12.391028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d1d62edf-00c6-4001-a2f5-08d1f601ed42 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:12.399020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1d62edf-00c6-4001-a2f5-08d1f601ed42 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:12.399577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1d62edf-00c6-4001-a2f5-08d1f601ed42 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:12.400935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1d62edf-00c6-4001-a2f5-08d1f601ed42 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:12.401650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1d62edf-00c6-4001-a2f5-08d1f601ed42 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:12.511144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-d1d62edf-00c6-4001-a2f5-08d1f601ed42 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:12.526722 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5d6e7af2-b237-4fc9-af1f-8a46ac2e0dc0 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1644 microversion: 2.1 time: 0.206769 Jul 28 03:38:12.528505 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 339/704] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:12 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1644 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:12.538527 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d1d62edf-00c6-4001-a2f5-08d1f601ed42 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.160177 Jul 28 03:38:12.549543 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 366/705] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:12 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:12.558493 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f966164e-4890-4c50-a91d-4ef172124b0e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '.version_select at 0x7ffa74b01ca0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:12.571394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d004a37e-70ab-464d-9be8-5712ca6a0360 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:12.572394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d004a37e-70ab-464d-9be8-5712ca6a0360 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:12.589955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d004a37e-70ab-464d-9be8-5712ca6a0360 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:12.592284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d004a37e-70ab-464d-9be8-5712ca6a0360 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:12.594389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d004a37e-70ab-464d-9be8-5712ca6a0360 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:12.595468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d004a37e-70ab-464d-9be8-5712ca6a0360 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:12.768119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d004a37e-70ab-464d-9be8-5712ca6a0360 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:12.782054 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d004a37e-70ab-464d-9be8-5712ca6a0360 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1279 microversion: 2.1 time: 0.222633 Jul 28 03:38:12.784991 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 367/706] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:12 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1279 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:12.789045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05b77039-a7cb-4d28-875f-01a0f6545cf8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:12.789865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-05b77039-a7cb-4d28-875f-01a0f6545cf8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:12.801906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05b77039-a7cb-4d28-875f-01a0f6545cf8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:12.802710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05b77039-a7cb-4d28-875f-01a0f6545cf8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:12.804082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05b77039-a7cb-4d28-875f-01a0f6545cf8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:12.804856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05b77039-a7cb-4d28-875f-01a0f6545cf8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:13.080854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-05b77039-a7cb-4d28-875f-01a0f6545cf8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:13.097494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-05b77039-a7cb-4d28-875f-01a0f6545cf8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:13.100964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-05b77039-a7cb-4d28-875f-01a0f6545cf8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:13.103519 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-05b77039-a7cb-4d28-875f-01a0f6545cf8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1321 microversion: 2.25 time: 0.319200 Jul 28 03:38:13.118698 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 368/707] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:12 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:13.129308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-61645204", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "4becdb03-f4b9-4bc9-b3de-403ab318d4dd"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:13.221859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] validate_networks() for [('4becdb03-f4b9-4bc9-b3de-403ab318d4dd', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:38:14.170686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:38:14.171344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:38:14.172102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:38:14.172819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:38:14.173460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:38:14.202183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:14.203040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:14.205168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:14.209338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:14.263069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Getting quotas for project 006f4f23380b45fab24edfea5be8f3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:38:14.275444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Getting quotas for user 15947ba65c714e0dbb60fc36afcb9a9c and project 006f4f23380b45fab24edfea5be8f3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:38:14.305871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:38:14.309565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:38:14.375302 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1af618e4-541a-4e31-b798-f11c1b3bf01b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.253214 Jul 28 03:38:14.376744 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 369/708] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:38:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:38:14.382421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f2332bae-bce4-419c-a041-59b6ae4d70de tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:14.383699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f2332bae-bce4-419c-a041-59b6ae4d70de tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:14.393150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2332bae-bce4-419c-a041-59b6ae4d70de tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:14.394361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2332bae-bce4-419c-a041-59b6ae4d70de tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:14.395831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2332bae-bce4-419c-a041-59b6ae4d70de tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:14.396620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2332bae-bce4-419c-a041-59b6ae4d70de tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:14.778752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f2332bae-bce4-419c-a041-59b6ae4d70de tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:14.782635 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f966164e-4890-4c50-a91d-4ef172124b0e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/e40af95e-847b-4d17-bcbf-0b7f694be91e" status: 202 len: 0 microversion: 2.1 time: 2.252087 Jul 28 03:38:14.787048 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 340/709] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:38:12 2022] DELETE /compute/v2.1/os-floating-ips/e40af95e-847b-4d17-bcbf-0b7f694be91e => generated 0 bytes in 2255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:14.790263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1f75f8cd-af7f-4c48-9db0-be489e992425 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:14.790700 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f2332bae-bce4-419c-a041-59b6ae4d70de tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1386 microversion: 2.1 time: 0.412467 Jul 28 03:38:14.790879 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1f75f8cd-af7f-4c48-9db0-be489e992425 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:14.791679 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 370/710] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:14 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1386 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:14.805932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80ecfefa-6a74-4709-b80f-206492525abb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:14.808157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-80ecfefa-6a74-4709-b80f-206492525abb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:14.810890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f75f8cd-af7f-4c48-9db0-be489e992425 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:14.811362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f75f8cd-af7f-4c48-9db0-be489e992425 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:14.812202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f75f8cd-af7f-4c48-9db0-be489e992425 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:14.817194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f75f8cd-af7f-4c48-9db0-be489e992425 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:14.832869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80ecfefa-6a74-4709-b80f-206492525abb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:14.834344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80ecfefa-6a74-4709-b80f-206492525abb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:14.836230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80ecfefa-6a74-4709-b80f-206492525abb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:14.837564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80ecfefa-6a74-4709-b80f-206492525abb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:15.051698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-1f75f8cd-af7f-4c48-9db0-be489e992425 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:15.112785 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1f75f8cd-af7f-4c48-9db0-be489e992425 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.326986 Jul 28 03:38:15.117566 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 341/711] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:14 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:15.137224 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9a32db76-d05d-4406-b842-d097bcb94fd2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:15.141520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9a32db76-d05d-4406-b842-d097bcb94fd2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:15.150791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a32db76-d05d-4406-b842-d097bcb94fd2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:15.151543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a32db76-d05d-4406-b842-d097bcb94fd2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:15.152682 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a32db76-d05d-4406-b842-d097bcb94fd2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:15.153287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a32db76-d05d-4406-b842-d097bcb94fd2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:15.365032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9a32db76-d05d-4406-b842-d097bcb94fd2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:15.380544 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9a32db76-d05d-4406-b842-d097bcb94fd2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:15.391730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9a32db76-d05d-4406-b842-d097bcb94fd2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:15.394415 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9a32db76-d05d-4406-b842-d097bcb94fd2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1361 microversion: 2.25 time: 0.273793 Jul 28 03:38:15.397772 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 342/712] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:15 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1361 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:15.414139 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b5a1e2d2-c836-4cf8-976f-ee0ea5afe1b5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:15.414900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b5a1e2d2-c836-4cf8-976f-ee0ea5afe1b5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:15.429121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5a1e2d2-c836-4cf8-976f-ee0ea5afe1b5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:15.430272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5a1e2d2-c836-4cf8-976f-ee0ea5afe1b5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:15.431971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5a1e2d2-c836-4cf8-976f-ee0ea5afe1b5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:15.433085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5a1e2d2-c836-4cf8-976f-ee0ea5afe1b5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:15.478483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-80ecfefa-6a74-4709-b80f-206492525abb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:15.540175 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-80ecfefa-6a74-4709-b80f-206492525abb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1321 microversion: 2.1 time: 0.744399 Jul 28 03:38:15.543250 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 371/713] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:14 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1321 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:15.561002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c836c4a-cc67-43f9-b8e3-1292487e98e1 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Action: 'action', calling method: .version_select at 0x7ffa77afb550>, body: {"removeFloatingIp": {"address": "172.25.6.194"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:15.655890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b5a1e2d2-c836-4cf8-976f-ee0ea5afe1b5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:15.668292 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b5a1e2d2-c836-4cf8-976f-ee0ea5afe1b5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1213 microversion: 2.1 time: 0.268830 Jul 28 03:38:15.669258 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 343/714] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:15 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1213 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:15.678064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-980a536f-1860-4781-b26a-e9937843d626 req-64e4f9d9-a83d-4d3f-9b5a-268d9570c834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd3aa530-0f24-4157-97ab-ea9ab8423ca5", "name": "network-vif-plugged", "status": "completed", "tag": "9d7f2b85-1892-469a-a4c4-0299eeaba795"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:15.701297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-980a536f-1860-4781-b26a-e9937843d626 req-64e4f9d9-a83d-4d3f-9b5a-268d9570c834 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:15.702036 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-980a536f-1860-4781-b26a-e9937843d626 req-64e4f9d9-a83d-4d3f-9b5a-268d9570c834 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:15.718634 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-980a536f-1860-4781-b26a-e9937843d626 req-64e4f9d9-a83d-4d3f-9b5a-268d9570c834 service nova] Creating event network-vif-plugged:9d7f2b85-1892-469a-a4c4-0299eeaba795 for instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 on n-h2-826756-3 Jul 28 03:38:15.731285 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-980a536f-1860-4781-b26a-e9937843d626 req-64e4f9d9-a83d-4d3f-9b5a-268d9570c834 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059257 Jul 28 03:38:15.738178 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 344/715] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:15.820450 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-23936b83-07dd-4df7-bc7d-58e7928b1748 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:15.824231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-23936b83-07dd-4df7-bc7d-58e7928b1748 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:15.847500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23936b83-07dd-4df7-bc7d-58e7928b1748 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:15.848033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23936b83-07dd-4df7-bc7d-58e7928b1748 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:15.858255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23936b83-07dd-4df7-bc7d-58e7928b1748 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:15.859303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23936b83-07dd-4df7-bc7d-58e7928b1748 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:16.189267 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-23936b83-07dd-4df7-bc7d-58e7928b1748 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:16.198359 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-23936b83-07dd-4df7-bc7d-58e7928b1748 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1386 microversion: 2.1 time: 0.387367 Jul 28 03:38:16.212300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c836c4a-cc67-43f9-b8e3-1292487e98e1 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:16.213160 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 345/716] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:15 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1386 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:16.219383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2a7f5f14-4ef8-4b80-bdaa-4bc039558585 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:16.220249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2a7f5f14-4ef8-4b80-bdaa-4bc039558585 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:16.229546 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a7f5f14-4ef8-4b80-bdaa-4bc039558585 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:16.231384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c836c4a-cc67-43f9-b8e3-1292487e98e1 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:16.231979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c836c4a-cc67-43f9-b8e3-1292487e98e1 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:16.232275 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a7f5f14-4ef8-4b80-bdaa-4bc039558585 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:16.233954 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a7f5f14-4ef8-4b80-bdaa-4bc039558585 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:16.234854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c836c4a-cc67-43f9-b8e3-1292487e98e1 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:16.235459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a7f5f14-4ef8-4b80-bdaa-4bc039558585 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:16.237686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c836c4a-cc67-43f9-b8e3-1292487e98e1 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:16.394232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-2a7f5f14-4ef8-4b80-bdaa-4bc039558585 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:16.461457 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2a7f5f14-4ef8-4b80-bdaa-4bc039558585 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.246392 Jul 28 03:38:16.474379 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 346/717] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:16 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:16.487229 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-a789dc1e-8de9-4c27-a91b-70398dd63c70 req-c9a2b654-f8ce-452d-b430-44fca7d9bf96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b228d20-b95a-4077-a833-0c74064590e4", "tag": "3acb121f-372c-4c08-9b11-0c55c56ab25b"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:16.515342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a789dc1e-8de9-4c27-a91b-70398dd63c70 req-c9a2b654-f8ce-452d-b430-44fca7d9bf96 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:16.515877 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a789dc1e-8de9-4c27-a91b-70398dd63c70 req-c9a2b654-f8ce-452d-b430-44fca7d9bf96 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:16.558774 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-a789dc1e-8de9-4c27-a91b-70398dd63c70 req-c9a2b654-f8ce-452d-b430-44fca7d9bf96 service nova] Creating event network-changed:3acb121f-372c-4c08-9b11-0c55c56ab25b for instance 4b228d20-b95a-4077-a833-0c74064590e4 on n-h2-826756-3 Jul 28 03:38:16.576985 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-a789dc1e-8de9-4c27-a91b-70398dd63c70 req-c9a2b654-f8ce-452d-b430-44fca7d9bf96 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100429 Jul 28 03:38:16.577862 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 347/718] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:16.612116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a8c05990-1db1-45cd-85d8-b68457a8ee46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:16.615585 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a8c05990-1db1-45cd-85d8-b68457a8ee46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:16.639023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8c05990-1db1-45cd-85d8-b68457a8ee46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:16.639638 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8c05990-1db1-45cd-85d8-b68457a8ee46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:16.640692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8c05990-1db1-45cd-85d8-b68457a8ee46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:16.641208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8c05990-1db1-45cd-85d8-b68457a8ee46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:17.077084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c836c4a-cc67-43f9-b8e3-1292487e98e1 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Acquired lock "refresh_cache-a2393d2a-78ad-4dd9-ad03-d8622acdb71e" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 03:38:17.322691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a8c05990-1db1-45cd-85d8-b68457a8ee46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:17.345173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a8c05990-1db1-45cd-85d8-b68457a8ee46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:17.354805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a8c05990-1db1-45cd-85d8-b68457a8ee46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:17.357005 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a8c05990-1db1-45cd-85d8-b68457a8ee46 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1361 microversion: 2.25 time: 0.761416 Jul 28 03:38:17.360126 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 348/719] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:16 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1361 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:17.371575 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0e9c6f11-6a82-4918-bebd-a1b7e8bd8b73 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:17.375580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0e9c6f11-6a82-4918-bebd-a1b7e8bd8b73 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:17.391145 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e9c6f11-6a82-4918-bebd-a1b7e8bd8b73 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:17.392137 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e9c6f11-6a82-4918-bebd-a1b7e8bd8b73 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:17.393194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e9c6f11-6a82-4918-bebd-a1b7e8bd8b73 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:17.393940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e9c6f11-6a82-4918-bebd-a1b7e8bd8b73 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:17.742913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0e9c6f11-6a82-4918-bebd-a1b7e8bd8b73 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:17.761047 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0e9c6f11-6a82-4918-bebd-a1b7e8bd8b73 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1321 microversion: 2.1 time: 0.394908 Jul 28 03:38:17.761989 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 349/720] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:17 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:17.770289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9f0d11b6-a2f3-42b8-8ee6-9dac7dadf16e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:17.785742 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9f0d11b6-a2f3-42b8-8ee6-9dac7dadf16e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:17.809531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f0d11b6-a2f3-42b8-8ee6-9dac7dadf16e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:17.810579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f0d11b6-a2f3-42b8-8ee6-9dac7dadf16e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:17.812042 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f0d11b6-a2f3-42b8-8ee6-9dac7dadf16e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:17.816418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f0d11b6-a2f3-42b8-8ee6-9dac7dadf16e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:18.022535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9f0d11b6-a2f3-42b8-8ee6-9dac7dadf16e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:18.036412 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9f0d11b6-a2f3-42b8-8ee6-9dac7dadf16e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1267 microversion: 2.1 time: 0.271181 Jul 28 03:38:18.043913 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 350/721] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:17 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1267 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:18.061112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e20298a1-d2d0-447d-b486-e169be9ac057 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:18.062554 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e20298a1-d2d0-447d-b486-e169be9ac057 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:18.077289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e20298a1-d2d0-447d-b486-e169be9ac057 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:18.078279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e20298a1-d2d0-447d-b486-e169be9ac057 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:18.079673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e20298a1-d2d0-447d-b486-e169be9ac057 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:18.080476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e20298a1-d2d0-447d-b486-e169be9ac057 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:18.541007 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:18.567609 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=8 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:18.824280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e20298a1-d2d0-447d-b486-e169be9ac057 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:18.834854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:18.876231 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e20298a1-d2d0-447d-b486-e169be9ac057 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1386 microversion: 2.1 time: 0.826482 Jul 28 03:38:18.881755 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 351/722] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:18 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1386 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:18.911705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-5ba69ac9-538a-48e2-970b-ab8aa7a115e6 req-a60f7003-977f-425a-bd40-72b4c47ee365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "291f9510-9d09-47ee-bc90-13a457673493", "tag": "e5a92ce3-6306-4cbb-9e4b-5d834b786894"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:18.947907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5ba69ac9-538a-48e2-970b-ab8aa7a115e6 req-a60f7003-977f-425a-bd40-72b4c47ee365 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:18.948411 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5ba69ac9-538a-48e2-970b-ab8aa7a115e6 req-a60f7003-977f-425a-bd40-72b4c47ee365 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:18.985829 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-5ba69ac9-538a-48e2-970b-ab8aa7a115e6 req-a60f7003-977f-425a-bd40-72b4c47ee365 service nova] Creating event network-changed:e5a92ce3-6306-4cbb-9e4b-5d834b786894 for instance 291f9510-9d09-47ee-bc90-13a457673493 on n-h2-826756-3 Jul 28 03:38:19.008935 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-5ba69ac9-538a-48e2-970b-ab8aa7a115e6 req-a60f7003-977f-425a-bd40-72b4c47ee365 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120447 Jul 28 03:38:19.013475 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 352/723] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:19.029554 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-03ce5b2f-51a5-49ae-a53a-a4060969bc06 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:19.034044 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-03ce5b2f-51a5-49ae-a53a-a4060969bc06 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:19.055407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03ce5b2f-51a5-49ae-a53a-a4060969bc06 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:19.056839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03ce5b2f-51a5-49ae-a53a-a4060969bc06 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:19.059492 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03ce5b2f-51a5-49ae-a53a-a4060969bc06 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:19.065094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03ce5b2f-51a5-49ae-a53a-a4060969bc06 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:19.498494 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-03ce5b2f-51a5-49ae-a53a-a4060969bc06 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:19.580417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-1c836c4a-cc67-43f9-b8e3-1292487e98e1 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Building network info cache for instance {{(pid=126071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 03:38:19.602005 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-03ce5b2f-51a5-49ae-a53a-a4060969bc06 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.586285 Jul 28 03:38:19.613496 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 353/724] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:19 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:19.651227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-5b32d495-c08e-4329-81c0-5f798438c3c0 req-e5d52f8f-9d00-425d-90a3-3fd3e0be8816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4b8ffa-dbe6-4e90-a8f5-728addf73aae", "name": "network-vif-plugged", "status": "completed", "tag": "3931df07-76f1-4feb-a179-d48d42b61b21"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:19.720040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5b32d495-c08e-4329-81c0-5f798438c3c0 req-e5d52f8f-9d00-425d-90a3-3fd3e0be8816 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:19.720719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5b32d495-c08e-4329-81c0-5f798438c3c0 req-e5d52f8f-9d00-425d-90a3-3fd3e0be8816 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:19.771963 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-5b32d495-c08e-4329-81c0-5f798438c3c0 req-e5d52f8f-9d00-425d-90a3-3fd3e0be8816 service nova] Creating event network-vif-plugged:3931df07-76f1-4feb-a179-d48d42b61b21 for instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae on n-h2-826756-3 Jul 28 03:38:19.791469 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-5b32d495-c08e-4329-81c0-5f798438c3c0 req-e5d52f8f-9d00-425d-90a3-3fd3e0be8816 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176551 Jul 28 03:38:19.798218 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 354/725] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:19.808705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bc28a553-2a03-4b2b-9d14-aca9653f0bff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:19.809421 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bc28a553-2a03-4b2b-9d14-aca9653f0bff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:19.825805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc28a553-2a03-4b2b-9d14-aca9653f0bff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:19.826651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc28a553-2a03-4b2b-9d14-aca9653f0bff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:19.827651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc28a553-2a03-4b2b-9d14-aca9653f0bff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:19.833391 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc28a553-2a03-4b2b-9d14-aca9653f0bff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:20.184583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bc28a553-2a03-4b2b-9d14-aca9653f0bff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:20.206329 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bc28a553-2a03-4b2b-9d14-aca9653f0bff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:20.209466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bc28a553-2a03-4b2b-9d14-aca9653f0bff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:20.211046 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bc28a553-2a03-4b2b-9d14-aca9653f0bff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1361 microversion: 2.25 time: 0.411573 Jul 28 03:38:20.212185 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 355/726] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:19 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1361 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:20.227772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-94eff115-dd8c-49d9-a581-0a21ce13f916 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:20.242395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-94eff115-dd8c-49d9-a581-0a21ce13f916 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:20.253304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-94eff115-dd8c-49d9-a581-0a21ce13f916 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:20.253744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-94eff115-dd8c-49d9-a581-0a21ce13f916 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:20.255909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-94eff115-dd8c-49d9-a581-0a21ce13f916 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:20.257433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-94eff115-dd8c-49d9-a581-0a21ce13f916 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:20.608569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-94eff115-dd8c-49d9-a581-0a21ce13f916 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:20.623988 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-94eff115-dd8c-49d9-a581-0a21ce13f916 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1321 microversion: 2.1 time: 0.408667 Jul 28 03:38:20.624948 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 356/727] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:20 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:20.631566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2e4de9ef-7b59-4861-8cf9-94af8e858a81 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:20.632190 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2e4de9ef-7b59-4861-8cf9-94af8e858a81 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:20.647029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2e4de9ef-7b59-4861-8cf9-94af8e858a81 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:20.648650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2e4de9ef-7b59-4861-8cf9-94af8e858a81 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:20.649111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2e4de9ef-7b59-4861-8cf9-94af8e858a81 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:20.649549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2e4de9ef-7b59-4861-8cf9-94af8e858a81 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:20.742712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-1c836c4a-cc67-43f9-b8e3-1292487e98e1 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Updating instance_info_cache with network_info: [{"id": "b6de10ac-a038-41b1-a2ce-0c6183a7eb56", "address": "fa:16:3e:d9:cd:96", "network": {"id": "25ef7f60-e0d8-490c-a4ac-ff68400c4970", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-290516614-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "84ec6bcd01c4410c8193820cfdd2367c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb6de10ac-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 03:38:20.763572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c836c4a-cc67-43f9-b8e3-1292487e98e1 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Releasing lock "refresh_cache-a2393d2a-78ad-4dd9-ad03-d8622acdb71e" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 03:38:20.764842 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c836c4a-cc67-43f9-b8e3-1292487e98e1 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action" status: 202 len: 0 microversion: 2.1 time: 5.220183 Jul 28 03:38:20.765624 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 372/728] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:15 2022] POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action => generated 0 bytes in 5222 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 03:38:20.774704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d89d365-1c6f-47aa-8449-5cdcf471ca9f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:20.809113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6d89d365-1c6f-47aa-8449-5cdcf471ca9f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:20.819515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d89d365-1c6f-47aa-8449-5cdcf471ca9f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:20.820241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d89d365-1c6f-47aa-8449-5cdcf471ca9f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:20.821261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d89d365-1c6f-47aa-8449-5cdcf471ca9f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:20.821879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d89d365-1c6f-47aa-8449-5cdcf471ca9f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:21.129907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2e4de9ef-7b59-4861-8cf9-94af8e858a81 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:21.158004 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2e4de9ef-7b59-4861-8cf9-94af8e858a81 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1309 microversion: 2.1 time: 0.531873 Jul 28 03:38:21.162845 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 357/729] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:20 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1309 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:21.187687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dc1f7612-6786-4c43-93f5-0bda9c71f09d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:21.188767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dc1f7612-6786-4c43-93f5-0bda9c71f09d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:21.200760 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc1f7612-6786-4c43-93f5-0bda9c71f09d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:21.201349 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc1f7612-6786-4c43-93f5-0bda9c71f09d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:21.202418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc1f7612-6786-4c43-93f5-0bda9c71f09d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:21.203136 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc1f7612-6786-4c43-93f5-0bda9c71f09d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:21.205214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6d89d365-1c6f-47aa-8449-5cdcf471ca9f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:21.240621 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d89d365-1c6f-47aa-8449-5cdcf471ca9f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1584 microversion: 2.1 time: 0.473019 Jul 28 03:38:21.244825 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 373/730] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:20 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1584 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:21.257690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c3dcb852-c16c-4718-a583-befb0d0f9b42 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '.version_select at 0x7ffa74887790>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:21.476441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-dc1f7612-6786-4c43-93f5-0bda9c71f09d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:21.514633 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dc1f7612-6786-4c43-93f5-0bda9c71f09d tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1927 microversion: 2.75 time: 0.350167 Jul 28 03:38:21.517925 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 358/731] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:21 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1927 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:21.524144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-1ea072fd-8641-43bf-8e21-f5197e09ee47 req-d76e5954-ac49-4018-8a58-9917f52b29b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2393d2a-78ad-4dd9-ad03-d8622acdb71e", "tag": "b6de10ac-a038-41b1-a2ce-0c6183a7eb56"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:21.535393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1ea072fd-8641-43bf-8e21-f5197e09ee47 req-d76e5954-ac49-4018-8a58-9917f52b29b9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:21.536002 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1ea072fd-8641-43bf-8e21-f5197e09ee47 req-d76e5954-ac49-4018-8a58-9917f52b29b9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:21.550376 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-1ea072fd-8641-43bf-8e21-f5197e09ee47 req-d76e5954-ac49-4018-8a58-9917f52b29b9 service nova] Creating event network-changed:b6de10ac-a038-41b1-a2ce-0c6183a7eb56 for instance a2393d2a-78ad-4dd9-ad03-d8622acdb71e on n-h2-826756-3 Jul 28 03:38:21.560108 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-1ea072fd-8641-43bf-8e21-f5197e09ee47 req-d76e5954-ac49-4018-8a58-9917f52b29b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040727 Jul 28 03:38:21.563469 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 359/732] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:21.569483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2d851d9f-56dc-438e-8af2-42f0f49e685b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:21.572495 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2d851d9f-56dc-438e-8af2-42f0f49e685b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:21.584183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d851d9f-56dc-438e-8af2-42f0f49e685b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:21.589015 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d851d9f-56dc-438e-8af2-42f0f49e685b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:21.589907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d851d9f-56dc-438e-8af2-42f0f49e685b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:21.590496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d851d9f-56dc-438e-8af2-42f0f49e685b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:22.084022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2d851d9f-56dc-438e-8af2-42f0f49e685b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:22.104611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2d851d9f-56dc-438e-8af2-42f0f49e685b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:22.109318 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2d851d9f-56dc-438e-8af2-42f0f49e685b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:22.111337 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2d851d9f-56dc-438e-8af2-42f0f49e685b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1361 microversion: 2.25 time: 0.546227 Jul 28 03:38:22.127206 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 360/733] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:21 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1361 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:22.137834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2660a71a-ce6d-43d7-bdcb-acee9fafed6f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:22.139152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2660a71a-ce6d-43d7-bdcb-acee9fafed6f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:22.152197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2660a71a-ce6d-43d7-bdcb-acee9fafed6f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:22.153343 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2660a71a-ce6d-43d7-bdcb-acee9fafed6f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:22.154955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2660a71a-ce6d-43d7-bdcb-acee9fafed6f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:22.155911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2660a71a-ce6d-43d7-bdcb-acee9fafed6f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:22.523631 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2660a71a-ce6d-43d7-bdcb-acee9fafed6f tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.390672 Jul 28 03:38:22.524762 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 361/734] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:38:22 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5/os-interface => generated 284 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:22.535827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3393c032-648c-47d0-832d-887a2c7a6f92 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:22.537169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3393c032-648c-47d0-832d-887a2c7a6f92 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:22.555894 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3393c032-648c-47d0-832d-887a2c7a6f92 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:22.595020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3393c032-648c-47d0-832d-887a2c7a6f92 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:22.595020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3393c032-648c-47d0-832d-887a2c7a6f92 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:22.625193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3393c032-648c-47d0-832d-887a2c7a6f92 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:23.173744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3393c032-648c-47d0-832d-887a2c7a6f92 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:23.199466 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3393c032-648c-47d0-832d-887a2c7a6f92 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1321 microversion: 2.1 time: 0.672927 Jul 28 03:38:23.200410 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 362/735] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:22 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1321 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:23.226253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7a1aabf5-5ca1-46b7-9eef-8d2fb5a8f521 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:23.227725 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7a1aabf5-5ca1-46b7-9eef-8d2fb5a8f521 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:23.242304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a1aabf5-5ca1-46b7-9eef-8d2fb5a8f521 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:23.243509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a1aabf5-5ca1-46b7-9eef-8d2fb5a8f521 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:23.246576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a1aabf5-5ca1-46b7-9eef-8d2fb5a8f521 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:23.247253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a1aabf5-5ca1-46b7-9eef-8d2fb5a8f521 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:23.484700 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7a1aabf5-5ca1-46b7-9eef-8d2fb5a8f521 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:23.507115 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7a1aabf5-5ca1-46b7-9eef-8d2fb5a8f521 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1309 microversion: 2.1 time: 0.305277 Jul 28 03:38:23.507915 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 363/736] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:23 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1309 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:23.526155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-9b650f8e-4cd4-436e-881c-013dd2fe2aae req-e630c69b-b86d-47d8-a89d-693c9e5ec43a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24", "tag": "341becb1-9ad4-4e21-893d-15bc21d8044e"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:23.548189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9b650f8e-4cd4-436e-881c-013dd2fe2aae req-e630c69b-b86d-47d8-a89d-693c9e5ec43a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:23.549480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9b650f8e-4cd4-436e-881c-013dd2fe2aae req-e630c69b-b86d-47d8-a89d-693c9e5ec43a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:23.580829 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-9b650f8e-4cd4-436e-881c-013dd2fe2aae req-e630c69b-b86d-47d8-a89d-693c9e5ec43a service nova] Creating event network-changed:341becb1-9ad4-4e21-893d-15bc21d8044e for instance fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 on n-h1-826756-3 Jul 28 03:38:23.594326 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-9b650f8e-4cd4-436e-881c-013dd2fe2aae req-e630c69b-b86d-47d8-a89d-693c9e5ec43a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076103 Jul 28 03:38:23.602313 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 364/737] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:23.618248 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-24de293b-4291-428d-9295-bb4cd8bbc9e9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:23.623823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-24de293b-4291-428d-9295-bb4cd8bbc9e9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:23.643182 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24de293b-4291-428d-9295-bb4cd8bbc9e9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:23.644410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24de293b-4291-428d-9295-bb4cd8bbc9e9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:23.646207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24de293b-4291-428d-9295-bb4cd8bbc9e9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:23.647228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24de293b-4291-428d-9295-bb4cd8bbc9e9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:23.759367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-24de293b-4291-428d-9295-bb4cd8bbc9e9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:23.806620 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-24de293b-4291-428d-9295-bb4cd8bbc9e9 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1933 microversion: 2.75 time: 0.200507 Jul 28 03:38:23.815264 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 365/738] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:23 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1933 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:23.821907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-481a502a-9c66-4549-b128-f6fa2d1ba599 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:23.822901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-481a502a-9c66-4549-b128-f6fa2d1ba599 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:23.844725 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-481a502a-9c66-4549-b128-f6fa2d1ba599 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:23.845591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-481a502a-9c66-4549-b128-f6fa2d1ba599 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:23.846669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-481a502a-9c66-4549-b128-f6fa2d1ba599 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:23.848795 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-481a502a-9c66-4549-b128-f6fa2d1ba599 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:24.113740 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c3dcb852-c16c-4718-a583-befb0d0f9b42 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/53aebda7-d8cb-4447-970c-9c8c37c8a352" status: 202 len: 0 microversion: 2.1 time: 2.866286 Jul 28 03:38:24.120331 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 374/739] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:38:21 2022] DELETE /compute/v2.1/os-floating-ips/53aebda7-d8cb-4447-970c-9c8c37c8a352 => generated 0 bytes in 2874 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:24.129757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f317873-8bff-4b35-be0f-5b65b8931074 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f317873-8bff-4b35-be0f-5b65b8931074 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Request method failure captured: Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action HTTP/1.1 Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 34 Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gSGA_OPkLHQs__6B3lNyKphnEJIgdf9aMZnZLbYqP-PFVkypmYlCeMn67JTCIyyWJn9vQ-km8Xmztf2Wn-Ga1zH8aQD6QbkpHnpSgODs4fR7zq2Xo42FiJFJQWaaf7fg_YSUSrM7KOEHWOUpY6HrSFKSoO-b2-dgO_T1qQ52tFZPD0 Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 84ec6bcd01c4410c8193820cfdd2367c Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:38:24.144738 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:38:24.146283 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84ec6bcd01c4410c8193820cfdd2367c"}]}] Jul 28 03:38:24.146283 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:24.146283 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 84ec6bcd01c4410c8193820cfdd2367c Jul 28 03:38:24.146283 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:24.146283 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project Jul 28 03:38:24.146283 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:38:24.146283 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:38:24.146283 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: b17befcacdd14330be582e67c50e2c79 Jul 28 03:38:24.146283 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project Jul 28 03:38:24.146283 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:38:24.146283 n-d-826756-3 devstack@n-api.service[126071]: {"addFloatingIp": {"address": ""}} Jul 28 03:38:24.146283 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:38:24.146283 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a2393d2a-78ad-4dd9-ad03-d8622acdb71e', 'body': {'addFloatingIp': {'address': ''}}} Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi '' Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:38:24.147166 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:38:24.148626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:38:24.149787 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 28 03:38:24.149787 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:24.149787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f317873-8bff-4b35-be0f-5b65b8931074 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:38:24.149787 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6f317873-8bff-4b35-be0f-5b65b8931074 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action" status: 400 len: 142 microversion: 2.1 time: 0.024981 Jul 28 03:38:24.162652 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 375/740] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:24 2022] POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action => generated 142 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:38:24.195462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-120cc601-47a4-41c4-939c-79b5d6442f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:24.214836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-120cc601-47a4-41c4-939c-79b5d6442f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:24.229307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-120cc601-47a4-41c4-939c-79b5d6442f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:24.232630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-120cc601-47a4-41c4-939c-79b5d6442f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:24.235535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-120cc601-47a4-41c4-939c-79b5d6442f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:24.236216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-120cc601-47a4-41c4-939c-79b5d6442f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:24.254372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:24.331672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=14 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:24.367807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-120cc601-47a4-41c4-939c-79b5d6442f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Acquired lock "refresh_cache-a2393d2a-78ad-4dd9-ad03-d8622acdb71e" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 03:38:24.674061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-120cc601-47a4-41c4-939c-79b5d6442f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Releasing lock "refresh_cache-a2393d2a-78ad-4dd9-ad03-d8622acdb71e" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 03:38:24.675020 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-120cc601-47a4-41c4-939c-79b5d6442f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] HTTP exception thrown: floating IP not found Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-120cc601-47a4-41c4-939c-79b5d6442f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Request method failure captured: Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action HTTP/1.1 Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 41 Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gSGA_OPkLHQs__6B3lNyKphnEJIgdf9aMZnZLbYqP-PFVkypmYlCeMn67JTCIyyWJn9vQ-km8Xmztf2Wn-Ga1zH8aQD6QbkpHnpSgODs4fR7zq2Xo42FiJFJQWaaf7fg_YSUSrM7KOEHWOUpY6HrSFKSoO-b2-dgO_T1qQ52tFZPD0 Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 84ec6bcd01c4410c8193820cfdd2367c Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:38:24.678216 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:38:24.679789 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84ec6bcd01c4410c8193820cfdd2367c"}]}] Jul 28 03:38:24.679789 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:24.679789 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 84ec6bcd01c4410c8193820cfdd2367c Jul 28 03:38:24.679789 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:24.679789 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project Jul 28 03:38:24.679789 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:38:24.679789 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:38:24.679789 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: b17befcacdd14330be582e67c50e2c79 Jul 28 03:38:24.679789 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project Jul 28 03:38:24.679789 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:38:24.679789 n-d-826756-3 devstack@n-api.service[126071]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 28 03:38:24.679789 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:38:24.679789 n-d-826756-3 devstack@n-api.service[126071]: exception: floating IP not found Jul 28 03:38:24.679789 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a2393d2a-78ad-4dd9-ad03-d8622acdb71e', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:38:24.680701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 28 03:38:24.681850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:24.683149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-120cc601-47a4-41c4-939c-79b5d6442f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Returning 404 to user: floating IP not found {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:38:24.683149 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-120cc601-47a4-41c4-939c-79b5d6442f4c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action" status: 404 len: 67 microversion: 2.1 time: 0.516700 Jul 28 03:38:24.694131 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 376/741] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:24 2022] POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action => generated 67 bytes in 531 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:38:24.703976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cbc02d33-7c23-4aa3-b8e2-9bf7bfbe4da1 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:24.705236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cbc02d33-7c23-4aa3-b8e2-9bf7bfbe4da1 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:24.735296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbc02d33-7c23-4aa3-b8e2-9bf7bfbe4da1 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:24.740612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbc02d33-7c23-4aa3-b8e2-9bf7bfbe4da1 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:24.750323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbc02d33-7c23-4aa3-b8e2-9bf7bfbe4da1 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:24.751457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbc02d33-7c23-4aa3-b8e2-9bf7bfbe4da1 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:25.011363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-481a502a-9c66-4549-b128-f6fa2d1ba599 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:25.038622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-481a502a-9c66-4549-b128-f6fa2d1ba599 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:25.051531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-481a502a-9c66-4549-b128-f6fa2d1ba599 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:25.056886 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-481a502a-9c66-4549-b128-f6fa2d1ba599 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1361 microversion: 2.25 time: 1.239703 Jul 28 03:38:25.072914 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 366/742] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:23 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1361 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:25.086401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-978e9950-8a4d-4423-9d84-dc6ebf0f720a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:25.087005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-978e9950-8a4d-4423-9d84-dc6ebf0f720a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:25.097234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-978e9950-8a4d-4423-9d84-dc6ebf0f720a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:25.098023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-978e9950-8a4d-4423-9d84-dc6ebf0f720a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:25.099362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-978e9950-8a4d-4423-9d84-dc6ebf0f720a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:25.100053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-978e9950-8a4d-4423-9d84-dc6ebf0f720a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:25.338817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cbc02d33-7c23-4aa3-b8e2-9bf7bfbe4da1 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:25.368585 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cbc02d33-7c23-4aa3-b8e2-9bf7bfbe4da1 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1321 microversion: 2.1 time: 0.672301 Jul 28 03:38:25.370863 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 377/743] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:24 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1321 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:25.405249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a8c132b-a03b-40f0-a200-dc052c512efd tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:25.863881 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-1a8c132b-a03b-40f0-a200-dc052c512efd tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a8c132b-a03b-40f0-a200-dc052c512efd tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Request method failure captured: Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action HTTP/1.1 Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 44 Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gSGA_OPkLHQs__6B3lNyKphnEJIgdf9aMZnZLbYqP-PFVkypmYlCeMn67JTCIyyWJn9vQ-km8Xmztf2Wn-Ga1zH8aQD6QbkpHnpSgODs4fR7zq2Xo42FiJFJQWaaf7fg_YSUSrM7KOEHWOUpY6HrSFKSoO-b2-dgO_T1qQ52tFZPD0 Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 84ec6bcd01c4410c8193820cfdd2367c Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:38:25.867279 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:38:25.871092 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84ec6bcd01c4410c8193820cfdd2367c"}]}] Jul 28 03:38:25.871092 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:25.871092 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 84ec6bcd01c4410c8193820cfdd2367c Jul 28 03:38:25.871092 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:25.871092 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project Jul 28 03:38:25.871092 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:38:25.871092 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:38:25.871092 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: b17befcacdd14330be582e67c50e2c79 Jul 28 03:38:25.871092 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project Jul 28 03:38:25.871092 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:38:25.871092 n-d-826756-3 devstack@n-api.service[126071]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 28 03:38:25.871092 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:38:25.871092 n-d-826756-3 devstack@n-api.service[126071]: exception: Floating IP not found for address 0.0.0.0. Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a2393d2a-78ad-4dd9-ad03-d8622acdb71e', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:38:25.872547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 28 03:38:25.876099 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:25.881313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a8c132b-a03b-40f0-a200-dc052c512efd tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:38:25.881313 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1a8c132b-a03b-40f0-a200-dc052c512efd tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action" status: 404 len: 88 microversion: 2.1 time: 0.504890 Jul 28 03:38:25.884139 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 378/744] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:25 2022] POST /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e/action => generated 88 bytes in 512 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:38:25.919737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-84c69391-f498-418c-b13a-4771ae076e22 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:25.921966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-84c69391-f498-418c-b13a-4771ae076e22 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:25.947553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84c69391-f498-418c-b13a-4771ae076e22 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:25.952312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84c69391-f498-418c-b13a-4771ae076e22 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:25.954184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84c69391-f498-418c-b13a-4771ae076e22 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:25.958441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84c69391-f498-418c-b13a-4771ae076e22 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:25.996743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-978e9950-8a4d-4423-9d84-dc6ebf0f720a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:26.027671 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-978e9950-8a4d-4423-9d84-dc6ebf0f720a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1309 microversion: 2.1 time: 0.952539 Jul 28 03:38:26.035408 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 367/745] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:25 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1309 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:26.048295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-610254de-d2bd-422f-bc49-c725d89af051 req-bd118809-a59c-44c1-b9e7-36f52efb3e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291f9510-9d09-47ee-bc90-13a457673493", "name": "network-vif-plugged", "status": "completed", "tag": "e5a92ce3-6306-4cbb-9e4b-5d834b786894"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:26.074486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-610254de-d2bd-422f-bc49-c725d89af051 req-bd118809-a59c-44c1-b9e7-36f52efb3e22 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:26.075808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-610254de-d2bd-422f-bc49-c725d89af051 req-bd118809-a59c-44c1-b9e7-36f52efb3e22 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:26.091276 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-610254de-d2bd-422f-bc49-c725d89af051 req-bd118809-a59c-44c1-b9e7-36f52efb3e22 service nova] Creating event network-vif-plugged:e5a92ce3-6306-4cbb-9e4b-5d834b786894 for instance 291f9510-9d09-47ee-bc90-13a457673493 on n-h2-826756-3 Jul 28 03:38:26.097717 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-610254de-d2bd-422f-bc49-c725d89af051 req-bd118809-a59c-44c1-b9e7-36f52efb3e22 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061011 Jul 28 03:38:26.099416 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 368/746] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:26.105719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0c061517-75d8-4490-bbe2-3a7e7be15c41 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:26.106908 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0c061517-75d8-4490-bbe2-3a7e7be15c41 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:26.115501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0c061517-75d8-4490-bbe2-3a7e7be15c41 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:26.116219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0c061517-75d8-4490-bbe2-3a7e7be15c41 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:26.117463 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0c061517-75d8-4490-bbe2-3a7e7be15c41 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:26.118049 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0c061517-75d8-4490-bbe2-3a7e7be15c41 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:26.171287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0c061517-75d8-4490-bbe2-3a7e7be15c41 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:38:26.284877 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:26.364495 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0c061517-75d8-4490-bbe2-3a7e7be15c41 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 204 len: 0 microversion: 2.1 time: 0.263457 Jul 28 03:38:26.369326 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 369/747] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:38:26 2022] DELETE /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:38:26.370979 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-066ff447-e107-4495-960a-cf7ad765ed65 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:26.374620 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-066ff447-e107-4495-960a-cf7ad765ed65 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:26.394474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-84c69391-f498-418c-b13a-4771ae076e22 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:26.404745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-066ff447-e107-4495-960a-cf7ad765ed65 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:26.405524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-066ff447-e107-4495-960a-cf7ad765ed65 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:26.406520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-066ff447-e107-4495-960a-cf7ad765ed65 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:26.407306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-066ff447-e107-4495-960a-cf7ad765ed65 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:26.440031 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-84c69391-f498-418c-b13a-4771ae076e22 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1933 microversion: 2.75 time: 0.550386 Jul 28 03:38:26.440660 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 379/748] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:25 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1933 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:26.451846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8aefcaf1-d8e8-4cfc-9664-eb7f445cccbc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:26.467667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8aefcaf1-d8e8-4cfc-9664-eb7f445cccbc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:26.498683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8aefcaf1-d8e8-4cfc-9664-eb7f445cccbc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:26.508104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8aefcaf1-d8e8-4cfc-9664-eb7f445cccbc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:26.508985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8aefcaf1-d8e8-4cfc-9664-eb7f445cccbc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:26.509429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8aefcaf1-d8e8-4cfc-9664-eb7f445cccbc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:26.554990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:27.203033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8aefcaf1-d8e8-4cfc-9664-eb7f445cccbc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:27.219612 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8aefcaf1-d8e8-4cfc-9664-eb7f445cccbc tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1540 microversion: 2.1 time: 0.771182 Jul 28 03:38:27.220693 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 380/749] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:26 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1540 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:27.234731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb1b44e6-addc-4b9c-a937-044e101abcbb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:27.235462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb1b44e6-addc-4b9c-a937-044e101abcbb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:27.259316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb1b44e6-addc-4b9c-a937-044e101abcbb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:27.260146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb1b44e6-addc-4b9c-a937-044e101abcbb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:27.261862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb1b44e6-addc-4b9c-a937-044e101abcbb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:27.262600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb1b44e6-addc-4b9c-a937-044e101abcbb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:27.311928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-066ff447-e107-4495-960a-cf7ad765ed65 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:27.345417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-066ff447-e107-4495-960a-cf7ad765ed65 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:27.370055 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-066ff447-e107-4495-960a-cf7ad765ed65 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:27.373051 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-066ff447-e107-4495-960a-cf7ad765ed65 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1361 microversion: 2.25 time: 1.004845 Jul 28 03:38:27.373665 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 370/750] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:26 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1361 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:27.410112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c0d86af0-bffc-4f56-ac83-364ba0dafd16 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:27.415594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c0d86af0-bffc-4f56-ac83-364ba0dafd16 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:27.424682 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:27.463457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0d86af0-bffc-4f56-ac83-364ba0dafd16 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:27.463914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0d86af0-bffc-4f56-ac83-364ba0dafd16 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:27.473610 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0d86af0-bffc-4f56-ac83-364ba0dafd16 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:27.477429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0d86af0-bffc-4f56-ac83-364ba0dafd16 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:27.833287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb1b44e6-addc-4b9c-a937-044e101abcbb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:27.844506 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb1b44e6-addc-4b9c-a937-044e101abcbb tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1321 microversion: 2.1 time: 0.622183 Jul 28 03:38:27.845112 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 381/751] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:27 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1321 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:27.863494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-15375022-6c68-425a-bc95-54646f7638b0 req-03dcfb6e-8aa4-4a41-b8a0-628426f87d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd3aa530-0f24-4157-97ab-ea9ab8423ca5", "tag": "9d7f2b85-1892-469a-a4c4-0299eeaba795"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:27.890292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-15375022-6c68-425a-bc95-54646f7638b0 req-03dcfb6e-8aa4-4a41-b8a0-628426f87d0f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:27.890739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-15375022-6c68-425a-bc95-54646f7638b0 req-03dcfb6e-8aa4-4a41-b8a0-628426f87d0f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:27.934236 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-15375022-6c68-425a-bc95-54646f7638b0 req-03dcfb6e-8aa4-4a41-b8a0-628426f87d0f service nova] Creating event network-changed:9d7f2b85-1892-469a-a4c4-0299eeaba795 for instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 on n-h2-826756-3 Jul 28 03:38:27.949150 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-15375022-6c68-425a-bc95-54646f7638b0 req-03dcfb6e-8aa4-4a41-b8a0-628426f87d0f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089269 Jul 28 03:38:27.955259 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 382/752] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:27.973108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c8ca87da-869c-43ab-a97c-c3e24cf7fd0e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:27.974084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c8ca87da-869c-43ab-a97c-c3e24cf7fd0e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:27.991878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:28.003627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8ca87da-869c-43ab-a97c-c3e24cf7fd0e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:28.013255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8ca87da-869c-43ab-a97c-c3e24cf7fd0e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:28.014385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8ca87da-869c-43ab-a97c-c3e24cf7fd0e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:28.018207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8ca87da-869c-43ab-a97c-c3e24cf7fd0e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:28.376921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c8ca87da-869c-43ab-a97c-c3e24cf7fd0e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:28.397070 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c8ca87da-869c-43ab-a97c-c3e24cf7fd0e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1309 microversion: 2.1 time: 0.438152 Jul 28 03:38:28.398381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c0d86af0-bffc-4f56-ac83-364ba0dafd16 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:28.398883 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 383/753] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:27 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1309 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:28.407833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-238bbcdd-4551-49db-b679-598b05e5f3c3 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:28.409008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-238bbcdd-4551-49db-b679-598b05e5f3c3 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:28.419348 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c0d86af0-bffc-4f56-ac83-364ba0dafd16 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1584 microversion: 2.1 time: 1.020329 Jul 28 03:38:28.423795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-238bbcdd-4551-49db-b679-598b05e5f3c3 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:28.425203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-238bbcdd-4551-49db-b679-598b05e5f3c3 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:28.425823 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 371/754] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:27 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1584 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:28.426805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-238bbcdd-4551-49db-b679-598b05e5f3c3 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:28.427725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-238bbcdd-4551-49db-b679-598b05e5f3c3 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:28.435932 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f9f100da-87ae-4a6b-8a26-d5fb46a3d230 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:28.436982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f9f100da-87ae-4a6b-8a26-d5fb46a3d230 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:28.447985 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9f100da-87ae-4a6b-8a26-d5fb46a3d230 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:28.448710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9f100da-87ae-4a6b-8a26-d5fb46a3d230 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:28.466323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9f100da-87ae-4a6b-8a26-d5fb46a3d230 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:28.467752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9f100da-87ae-4a6b-8a26-d5fb46a3d230 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:28.752323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-238bbcdd-4551-49db-b679-598b05e5f3c3 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] Lazy-loading 'services' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:28.868001 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-238bbcdd-4551-49db-b679-598b05e5f3c3 tempest-ServersAdmin275Test-118420605 tempest-ServersAdmin275Test-118420605-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1918 microversion: 2.75 time: 0.467129 Jul 28 03:38:28.872408 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 384/755] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:28 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1918 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:28.912311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f68480c8-b7d5-460f-8cff-448bb6d3c360 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:28.916246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f68480c8-b7d5-460f-8cff-448bb6d3c360 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:28.959416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f68480c8-b7d5-460f-8cff-448bb6d3c360 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:28.966657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f68480c8-b7d5-460f-8cff-448bb6d3c360 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:28.968279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f68480c8-b7d5-460f-8cff-448bb6d3c360 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:28.974751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f68480c8-b7d5-460f-8cff-448bb6d3c360 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:29.448221 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f9f100da-87ae-4a6b-8a26-d5fb46a3d230 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:29.462415 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f9f100da-87ae-4a6b-8a26-d5fb46a3d230 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1540 microversion: 2.1 time: 1.035128 Jul 28 03:38:29.488804 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 372/756] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:28 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1540 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:29.514028 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3548a6f1-a4f2-4380-a743-67d3ba6fb970 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:29.515670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3548a6f1-a4f2-4380-a743-67d3ba6fb970 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:29.530260 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3548a6f1-a4f2-4380-a743-67d3ba6fb970 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:29.535899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f68480c8-b7d5-460f-8cff-448bb6d3c360 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:29.542057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3548a6f1-a4f2-4380-a743-67d3ba6fb970 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:29.543528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3548a6f1-a4f2-4380-a743-67d3ba6fb970 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:29.544283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3548a6f1-a4f2-4380-a743-67d3ba6fb970 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:29.625126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f68480c8-b7d5-460f-8cff-448bb6d3c360 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:29.634814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f68480c8-b7d5-460f-8cff-448bb6d3c360 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:29.642382 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f68480c8-b7d5-460f-8cff-448bb6d3c360 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1361 microversion: 2.25 time: 0.768216 Jul 28 03:38:29.662243 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 385/757] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:28 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1361 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:29.683414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15af0426-2d97-4144-ac3e-6627372205ec tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:29.689266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15af0426-2d97-4144-ac3e-6627372205ec tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:29.703100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15af0426-2d97-4144-ac3e-6627372205ec tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:29.703546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15af0426-2d97-4144-ac3e-6627372205ec tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:29.709017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15af0426-2d97-4144-ac3e-6627372205ec tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:29.709507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15af0426-2d97-4144-ac3e-6627372205ec tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:29.801144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15af0426-2d97-4144-ac3e-6627372205ec tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:38:29.955400 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3548a6f1-a4f2-4380-a743-67d3ba6fb970 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:29.980522 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3548a6f1-a4f2-4380-a743-67d3ba6fb970 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1321 microversion: 2.1 time: 0.486178 Jul 28 03:38:29.986374 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 373/758] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:29 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1321 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:29.994051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ae908a84-efc7-4806-830d-ede90a416228 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:29.995170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ae908a84-efc7-4806-830d-ede90a416228 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:30.003582 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15af0426-2d97-4144-ac3e-6627372205ec tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "DELETE /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 204 len: 0 microversion: 2.75 time: 0.338634 Jul 28 03:38:30.009733 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 386/759] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:38:29 2022] DELETE /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:38:30.016343 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae908a84-efc7-4806-830d-ede90a416228 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:30.017590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae908a84-efc7-4806-830d-ede90a416228 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:30.020315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae908a84-efc7-4806-830d-ede90a416228 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:30.021639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae908a84-efc7-4806-830d-ede90a416228 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:30.022837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-82fe25a6-dd30-4cca-b3cf-47048fdc7ee6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:30.023559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-82fe25a6-dd30-4cca-b3cf-47048fdc7ee6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:30.038662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82fe25a6-dd30-4cca-b3cf-47048fdc7ee6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:30.039119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82fe25a6-dd30-4cca-b3cf-47048fdc7ee6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:30.042266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82fe25a6-dd30-4cca-b3cf-47048fdc7ee6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:30.042749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82fe25a6-dd30-4cca-b3cf-47048fdc7ee6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:30.185743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82fe25a6-dd30-4cca-b3cf-47048fdc7ee6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:30.200388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82fe25a6-dd30-4cca-b3cf-47048fdc7ee6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:30.200388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82fe25a6-dd30-4cca-b3cf-47048fdc7ee6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:30.214217 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-82fe25a6-dd30-4cca-b3cf-47048fdc7ee6 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1443 microversion: 2.75 time: 0.197038 Jul 28 03:38:30.222453 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 387/760] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:30 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1443 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:30.499692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9e5f59e2-fdd1-4d79-832b-5b12b939c52e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:30.500492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9e5f59e2-fdd1-4d79-832b-5b12b939c52e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:30.514371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e5f59e2-fdd1-4d79-832b-5b12b939c52e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:30.516412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e5f59e2-fdd1-4d79-832b-5b12b939c52e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:30.516593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e5f59e2-fdd1-4d79-832b-5b12b939c52e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:30.517351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e5f59e2-fdd1-4d79-832b-5b12b939c52e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:30.820559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9e5f59e2-fdd1-4d79-832b-5b12b939c52e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:30.834775 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9e5f59e2-fdd1-4d79-832b-5b12b939c52e tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1540 microversion: 2.1 time: 0.338597 Jul 28 03:38:30.851387 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 388/761] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:30 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1540 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:30.862568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca606ede-e6e5-48cb-82e9-f1cd4af2b515 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:30.864320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca606ede-e6e5-48cb-82e9-f1cd4af2b515 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:30.881236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca606ede-e6e5-48cb-82e9-f1cd4af2b515 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:30.883794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca606ede-e6e5-48cb-82e9-f1cd4af2b515 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:30.886808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca606ede-e6e5-48cb-82e9-f1cd4af2b515 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:30.888096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca606ede-e6e5-48cb-82e9-f1cd4af2b515 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:30.930030 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ae908a84-efc7-4806-830d-ede90a416228 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:30.954274 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ae908a84-efc7-4806-830d-ede90a416228 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1309 microversion: 2.1 time: 0.965181 Jul 28 03:38:30.956108 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 374/762] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:29 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1309 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:31.010824 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a5d50229-cdfa-4784-a9c1-d5cc044bdb1d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:31.014213 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a5d50229-cdfa-4784-a9c1-d5cc044bdb1d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:31.048500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a5d50229-cdfa-4784-a9c1-d5cc044bdb1d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:31.049582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a5d50229-cdfa-4784-a9c1-d5cc044bdb1d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:31.051017 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a5d50229-cdfa-4784-a9c1-d5cc044bdb1d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:31.053255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a5d50229-cdfa-4784-a9c1-d5cc044bdb1d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:31.279362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca606ede-e6e5-48cb-82e9-f1cd4af2b515 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:31.292957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca606ede-e6e5-48cb-82e9-f1cd4af2b515 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:31.296234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca606ede-e6e5-48cb-82e9-f1cd4af2b515 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:31.298286 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca606ede-e6e5-48cb-82e9-f1cd4af2b515 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1361 microversion: 2.25 time: 0.445180 Jul 28 03:38:31.314131 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 389/763] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:30 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1361 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:31.319072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2c54068f-928d-446f-8fb2-9db93d534772 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:31.328721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2c54068f-928d-446f-8fb2-9db93d534772 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:31.340727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c54068f-928d-446f-8fb2-9db93d534772 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:31.341508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c54068f-928d-446f-8fb2-9db93d534772 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:31.342592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c54068f-928d-446f-8fb2-9db93d534772 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:31.344112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c54068f-928d-446f-8fb2-9db93d534772 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:31.446367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a5d50229-cdfa-4784-a9c1-d5cc044bdb1d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:31.464201 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a5d50229-cdfa-4784-a9c1-d5cc044bdb1d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1321 microversion: 2.1 time: 0.461813 Jul 28 03:38:31.478449 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 375/764] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:31 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1321 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:31.506303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2c54068f-928d-446f-8fb2-9db93d534772 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:31.517817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2c54068f-928d-446f-8fb2-9db93d534772 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:31.519502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2c54068f-928d-446f-8fb2-9db93d534772 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:31.524933 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2c54068f-928d-446f-8fb2-9db93d534772 tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1443 microversion: 2.75 time: 0.210238 Jul 28 03:38:31.525896 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 390/765] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:31 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1443 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:31.526843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9e526fe1-b841-4707-ada3-280f6faed45b tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "119e5aae-a6e3-442d-aa26-ae3758503bb7"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:31.529390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9e526fe1-b841-4707-ada3-280f6faed45b tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:31.549787 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e526fe1-b841-4707-ada3-280f6faed45b tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:31.550271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e526fe1-b841-4707-ada3-280f6faed45b tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:31.551058 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e526fe1-b841-4707-ada3-280f6faed45b tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:31.551500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e526fe1-b841-4707-ada3-280f6faed45b tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:31.867341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-18671f67-5688-42e3-b229-e93bc85ff043 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:31.870141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-18671f67-5688-42e3-b229-e93bc85ff043 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:31.895638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18671f67-5688-42e3-b229-e93bc85ff043 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:31.896554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18671f67-5688-42e3-b229-e93bc85ff043 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:31.898102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18671f67-5688-42e3-b229-e93bc85ff043 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:31.898577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18671f67-5688-42e3-b229-e93bc85ff043 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:32.129450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-18671f67-5688-42e3-b229-e93bc85ff043 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:32.140010 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-18671f67-5688-42e3-b229-e93bc85ff043 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1540 microversion: 2.1 time: 0.282740 Jul 28 03:38:32.141186 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 391/766] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:31 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1540 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:32.147022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb8ffffe-8b2e-4df7-bc89-44b5d8d5db22 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:32.147928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb8ffffe-8b2e-4df7-bc89-44b5d8d5db22 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:32.154767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb8ffffe-8b2e-4df7-bc89-44b5d8d5db22 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:32.155468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb8ffffe-8b2e-4df7-bc89-44b5d8d5db22 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:32.156461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb8ffffe-8b2e-4df7-bc89-44b5d8d5db22 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:32.157069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb8ffffe-8b2e-4df7-bc89-44b5d8d5db22 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:32.305636 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9e526fe1-b841-4707-ada3-280f6faed45b tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "POST /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.800473 Jul 28 03:38:32.315644 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 376/767] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 03:38:31 2022] POST /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01/os-volume_attachments => generated 194 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:32.336828 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-659db40b-cfbc-4319-a88b-d72c88ace8f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:32.338806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-659db40b-cfbc-4319-a88b-d72c88ace8f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:32.361819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-659db40b-cfbc-4319-a88b-d72c88ace8f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:32.362276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-659db40b-cfbc-4319-a88b-d72c88ace8f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:32.363066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-659db40b-cfbc-4319-a88b-d72c88ace8f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:32.363498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-659db40b-cfbc-4319-a88b-d72c88ace8f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:32.465478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb8ffffe-8b2e-4df7-bc89-44b5d8d5db22 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:32.478136 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb8ffffe-8b2e-4df7-bc89-44b5d8d5db22 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1309 microversion: 2.1 time: 0.334739 Jul 28 03:38:32.479593 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 392/768] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:32 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1309 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:32.487238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-8f376f7c-362a-416c-ac61-17edab24b43f req-72cbf9d3-2b5a-416b-a24f-69da54a7b13a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2393d2a-78ad-4dd9-ad03-d8622acdb71e", "name": "network-vif-deleted", "tag": "b6de10ac-a038-41b1-a2ce-0c6183a7eb56"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:32.532173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8f376f7c-362a-416c-ac61-17edab24b43f req-72cbf9d3-2b5a-416b-a24f-69da54a7b13a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:32.541725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8f376f7c-362a-416c-ac61-17edab24b43f req-72cbf9d3-2b5a-416b-a24f-69da54a7b13a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:32.597411 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-8f376f7c-362a-416c-ac61-17edab24b43f req-72cbf9d3-2b5a-416b-a24f-69da54a7b13a service nova] Creating event network-vif-deleted:b6de10ac-a038-41b1-a2ce-0c6183a7eb56 for instance a2393d2a-78ad-4dd9-ad03-d8622acdb71e on n-h2-826756-3 Jul 28 03:38:32.618689 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-8f376f7c-362a-416c-ac61-17edab24b43f req-72cbf9d3-2b5a-416b-a24f-69da54a7b13a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137169 Jul 28 03:38:32.619814 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 393/769] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:32.626737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3db44002-62ed-45e4-b384-0e3b1e35e439 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:32.632926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3db44002-62ed-45e4-b384-0e3b1e35e439 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:32.668506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3db44002-62ed-45e4-b384-0e3b1e35e439 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:32.670506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3db44002-62ed-45e4-b384-0e3b1e35e439 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:32.671499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3db44002-62ed-45e4-b384-0e3b1e35e439 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:32.672100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3db44002-62ed-45e4-b384-0e3b1e35e439 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:32.826721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-659db40b-cfbc-4319-a88b-d72c88ace8f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:32.866046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-659db40b-cfbc-4319-a88b-d72c88ace8f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:32.870272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-659db40b-cfbc-4319-a88b-d72c88ace8f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:32.872770 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-659db40b-cfbc-4319-a88b-d72c88ace8f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1558 microversion: 2.25 time: 0.542029 Jul 28 03:38:32.875108 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 377/770] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:32 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1558 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:38:32.885102 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3a846d66-61cb-4bfc-a939-01b64ba5dfed tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:32.888941 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3a846d66-61cb-4bfc-a939-01b64ba5dfed tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:32.901258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a846d66-61cb-4bfc-a939-01b64ba5dfed tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:32.902543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a846d66-61cb-4bfc-a939-01b64ba5dfed tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:32.907448 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a846d66-61cb-4bfc-a939-01b64ba5dfed tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:32.913712 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a846d66-61cb-4bfc-a939-01b64ba5dfed tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:32.980258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3db44002-62ed-45e4-b384-0e3b1e35e439 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:32.990242 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3db44002-62ed-45e4-b384-0e3b1e35e439 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1321 microversion: 2.1 time: 0.369375 Jul 28 03:38:32.991314 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 394/771] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:32 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:32.997181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a54e22d1-71b9-4d7d-8b78-c9323b20b536 req-5e1e3296-e65d-4744-a3c6-491e10c13a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b228d20-b95a-4077-a833-0c74064590e4", "name": "network-vif-plugged", "status": "completed", "tag": "3acb121f-372c-4c08-9b11-0c55c56ab25b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:33.004510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a846d66-61cb-4bfc-a939-01b64ba5dfed tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:33.005312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a846d66-61cb-4bfc-a939-01b64ba5dfed tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:33.006477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-3a846d66-61cb-4bfc-a939-01b64ba5dfed tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lazy-loading 'fault' on Instance uuid 642093bc-1f66-4d3b-99bb-537f604e7c61 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:33.011289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a54e22d1-71b9-4d7d-8b78-c9323b20b536 req-5e1e3296-e65d-4744-a3c6-491e10c13a82 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:33.013041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a54e22d1-71b9-4d7d-8b78-c9323b20b536 req-5e1e3296-e65d-4744-a3c6-491e10c13a82 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:33.027618 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a54e22d1-71b9-4d7d-8b78-c9323b20b536 req-5e1e3296-e65d-4744-a3c6-491e10c13a82 service nova] Creating event network-vif-plugged:3acb121f-372c-4c08-9b11-0c55c56ab25b for instance 4b228d20-b95a-4077-a833-0c74064590e4 on n-h2-826756-3 Jul 28 03:38:33.067124 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a54e22d1-71b9-4d7d-8b78-c9323b20b536 req-5e1e3296-e65d-4744-a3c6-491e10c13a82 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073031 Jul 28 03:38:33.068692 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 395/772] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:33.080473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d0a3ae6d-8a7c-41f4-a581-232853c09ac9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:33.082582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d0a3ae6d-8a7c-41f4-a581-232853c09ac9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:33.090451 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3a846d66-61cb-4bfc-a939-01b64ba5dfed tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:33.101193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0a3ae6d-8a7c-41f4-a581-232853c09ac9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:33.101832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0a3ae6d-8a7c-41f4-a581-232853c09ac9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:33.103902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0a3ae6d-8a7c-41f4-a581-232853c09ac9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:33.105735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0a3ae6d-8a7c-41f4-a581-232853c09ac9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:33.119117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3a846d66-61cb-4bfc-a939-01b64ba5dfed tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:33.123073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3a846d66-61cb-4bfc-a939-01b64ba5dfed tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bf4d1f2094c34a2e9de52f67e41bc313', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd029d41ae3df4c5dbf023c61c23ccdef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:33.136524 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3a846d66-61cb-4bfc-a939-01b64ba5dfed tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 200 len: 1448 microversion: 2.75 time: 0.258784 Jul 28 03:38:33.137914 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 378/773] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:32 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 1448 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:33.171064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ff1d9b30-06f9-49b2-94b3-85b738d014ff tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:33.172338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ff1d9b30-06f9-49b2-94b3-85b738d014ff tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:33.180852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff1d9b30-06f9-49b2-94b3-85b738d014ff tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:33.181579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff1d9b30-06f9-49b2-94b3-85b738d014ff tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:33.182570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff1d9b30-06f9-49b2-94b3-85b738d014ff tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:33.183363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff1d9b30-06f9-49b2-94b3-85b738d014ff tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:33.259958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ff1d9b30-06f9-49b2-94b3-85b738d014ff tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:33.269413 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ff1d9b30-06f9-49b2-94b3-85b738d014ff tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1316 microversion: 2.1 time: 0.103238 Jul 28 03:38:33.270390 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 379/774] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:33 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1316 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:33.329051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-d0a3ae6d-8a7c-41f4-a581-232853c09ac9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid 291f9510-9d09-47ee-bc90-13a457673493 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:33.331609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:33.347546 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d0a3ae6d-8a7c-41f4-a581-232853c09ac9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 2050 microversion: 2.25 time: 0.276562 Jul 28 03:38:33.348830 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 396/775] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:33 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 2050 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:33.399440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f64ad8fd-4966-47c8-a346-4d7d2a2df643 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:33.401453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f64ad8fd-4966-47c8-a346-4d7d2a2df643 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:33.421764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f64ad8fd-4966-47c8-a346-4d7d2a2df643 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:33.423028 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f64ad8fd-4966-47c8-a346-4d7d2a2df643 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:33.425082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f64ad8fd-4966-47c8-a346-4d7d2a2df643 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:33.426212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f64ad8fd-4966-47c8-a346-4d7d2a2df643 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:33.532741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ac21f4ef-8bdc-4426-810c-a3653ef92044 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:33.534936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ac21f4ef-8bdc-4426-810c-a3653ef92044 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:33.577010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac21f4ef-8bdc-4426-810c-a3653ef92044 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:33.580660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac21f4ef-8bdc-4426-810c-a3653ef92044 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:33.595791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac21f4ef-8bdc-4426-810c-a3653ef92044 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:33.597247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac21f4ef-8bdc-4426-810c-a3653ef92044 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:33.776176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-f64ad8fd-4966-47c8-a346-4d7d2a2df643 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid 291f9510-9d09-47ee-bc90-13a457673493 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:33.813011 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f64ad8fd-4966-47c8-a346-4d7d2a2df643 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 2050 microversion: 2.25 time: 0.425681 Jul 28 03:38:33.823723 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 380/776] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:33 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 2050 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:33.855287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2cc8da0f-e862-488a-860a-b528b8bcb9ff tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:33.861708 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:38:33.861708 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:38:33.864211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2cc8da0f-e862-488a-860a-b528b8bcb9ff tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:33.865106 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2cc8da0f-e862-488a-860a-b528b8bcb9ff tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:33.866548 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2cc8da0f-e862-488a-860a-b528b8bcb9ff tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:33.867607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2cc8da0f-e862-488a-860a-b528b8bcb9ff tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:33.935975 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2cc8da0f-e862-488a-860a-b528b8bcb9ff tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.086235 Jul 28 03:38:33.949202 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 381/777] 10.222.0.48 () {60 vars in 1217 bytes} [Thu Jul 28 03:38:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:38:33.958982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d3689838-c49e-43f1-bd36-a598c5e76343 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:33.960177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d3689838-c49e-43f1-bd36-a598c5e76343 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:33.975254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d3689838-c49e-43f1-bd36-a598c5e76343 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:33.976305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d3689838-c49e-43f1-bd36-a598c5e76343 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:33.978018 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d3689838-c49e-43f1-bd36-a598c5e76343 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:33.980038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d3689838-c49e-43f1-bd36-a598c5e76343 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:34.005486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ac21f4ef-8bdc-4426-810c-a3653ef92044 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:34.017100 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ac21f4ef-8bdc-4426-810c-a3653ef92044 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1309 microversion: 2.1 time: 0.513380 Jul 28 03:38:34.019400 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 397/778] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:33 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1309 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:34.038662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-983dcbbb-2418-492b-a7a7-a2ceeaf78c8e tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:34.039863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-983dcbbb-2418-492b-a7a7-a2ceeaf78c8e tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:34.058753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-983dcbbb-2418-492b-a7a7-a2ceeaf78c8e tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:34.059238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-983dcbbb-2418-492b-a7a7-a2ceeaf78c8e tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:34.062394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-983dcbbb-2418-492b-a7a7-a2ceeaf78c8e tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:34.062647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-983dcbbb-2418-492b-a7a7-a2ceeaf78c8e tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:34.149606 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d3689838-c49e-43f1-bd36-a598c5e76343 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493/action" status: 202 len: 0 microversion: 2.25 time: 0.197597 Jul 28 03:38:34.151147 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 382/779] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 03:38:33 2022] POST /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:38:34.164567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-22dd086a-5435-4ad6-8c12-540b4cda9bd5 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:34.167564 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-22dd086a-5435-4ad6-8c12-540b4cda9bd5 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:34.185227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22dd086a-5435-4ad6-8c12-540b4cda9bd5 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:34.188954 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22dd086a-5435-4ad6-8c12-540b4cda9bd5 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:34.198494 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22dd086a-5435-4ad6-8c12-540b4cda9bd5 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:34.200799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22dd086a-5435-4ad6-8c12-540b4cda9bd5 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:34.333357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-983dcbbb-2418-492b-a7a7-a2ceeaf78c8e tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:34.344131 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-983dcbbb-2418-492b-a7a7-a2ceeaf78c8e tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1321 microversion: 2.1 time: 0.322928 Jul 28 03:38:34.345466 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 398/780] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:34 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:34.351062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c09ee965-1fc8-4638-88e8-2a701ff8948c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:34.352166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c09ee965-1fc8-4638-88e8-2a701ff8948c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] [instance: 642093bc-1f66-4d3b-99bb-537f604e7c61] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:34.375382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c09ee965-1fc8-4638-88e8-2a701ff8948c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:34.376173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c09ee965-1fc8-4638-88e8-2a701ff8948c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:34.377564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c09ee965-1fc8-4638-88e8-2a701ff8948c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:34.378629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c09ee965-1fc8-4638-88e8-2a701ff8948c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:34.406725 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-c09ee965-1fc8-4638-88e8-2a701ff8948c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] HTTP exception thrown: Instance 642093bc-1f66-4d3b-99bb-537f604e7c61 could not be found. Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c09ee965-1fc8-4638-88e8-2a701ff8948c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Request method failure captured: Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 HTTP/1.1 Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRm0aWijyhdqk19TOcZDSXj7-eq7XxOqGsS_C-Zl_JYsQ3ojkgG0PU2a0QcxBjcEBrSAShk_F5V--bdEZdx6pFnI_f-UYCYL1eVyBYhMDGYA8u-33HJ4Et9sQLUVPgwbr5Np884C__qiv3bt3kInRgJixesfNUNYmnjciPYV_Vtn_A Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.75 Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: d029d41ae3df4c5dbf023c61c23ccdef Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersAdmin275Test-1624220022 Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:38:34.410238 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:38:34.411765 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d029d41ae3df4c5dbf023c61c23ccdef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d029d41ae3df4c5dbf023c61c23ccdef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d029d41ae3df4c5dbf023c61c23ccdef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d029d41ae3df4c5dbf023c61c23ccdef"}]}] Jul 28 03:38:34.411765 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersAdmin275Test-1624220022 Jul 28 03:38:34.411765 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: d029d41ae3df4c5dbf023c61c23ccdef Jul 28 03:38:34.411765 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersAdmin275Test-1624220022 Jul 28 03:38:34.411765 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersAdmin275Test-1624220022-project Jul 28 03:38:34.411765 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:38:34.411765 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:38:34.411765 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: bf4d1f2094c34a2e9de52f67e41bc313 Jul 28 03:38:34.411765 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersAdmin275Test-1624220022-project Jul 28 03:38:34.411765 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:38:34.411765 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 642093bc-1f66-4d3b-99bb-537f604e7c61 could not be found. Jul 28 03:38:34.411765 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '642093bc-1f66-4d3b-99bb-537f604e7c61'} Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 642093bc-1f66-4d3b-99bb-537f604e7c61 could not be found. Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:38:34.412835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 642093bc-1f66-4d3b-99bb-537f604e7c61 could not be found. Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 642093bc-1f66-4d3b-99bb-537f604e7c61 could not be found. Jul 28 03:38:34.414105 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:34.415219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c09ee965-1fc8-4638-88e8-2a701ff8948c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] Returning 404 to user: Instance 642093bc-1f66-4d3b-99bb-537f604e7c61 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:38:34.415219 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c09ee965-1fc8-4638-88e8-2a701ff8948c tempest-ServersAdmin275Test-1624220022 tempest-ServersAdmin275Test-1624220022-project] 10.222.0.48 "GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61" status: 404 len: 111 microversion: 2.75 time: 0.065593 Jul 28 03:38:34.418650 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 399/781] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:34 2022] GET /compute/v2.1/servers/642093bc-1f66-4d3b-99bb-537f604e7c61 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:38:34.428061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e7ffdd9a-bb77-4a03-847a-eab1fcf31f1c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:34.429553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e7ffdd9a-bb77-4a03-847a-eab1fcf31f1c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:34.436746 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:34.452406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7ffdd9a-bb77-4a03-847a-eab1fcf31f1c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:34.454422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-22dd086a-5435-4ad6-8c12-540b4cda9bd5 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid 291f9510-9d09-47ee-bc90-13a457673493 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:34.455512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7ffdd9a-bb77-4a03-847a-eab1fcf31f1c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:34.457209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7ffdd9a-bb77-4a03-847a-eab1fcf31f1c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:34.459872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7ffdd9a-bb77-4a03-847a-eab1fcf31f1c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:34.541029 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-22dd086a-5435-4ad6-8c12-540b4cda9bd5 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 2055 microversion: 2.25 time: 0.379305 Jul 28 03:38:34.555626 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 383/782] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:34 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 2055 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:34.610205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7ffdd9a-bb77-4a03-847a-eab1fcf31f1c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:34.611944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7ffdd9a-bb77-4a03-847a-eab1fcf31f1c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:34.613609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-e7ffdd9a-bb77-4a03-847a-eab1fcf31f1c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lazy-loading 'fault' on Instance uuid a2393d2a-78ad-4dd9-ad03-d8622acdb71e {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:34.691182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e7ffdd9a-bb77-4a03-847a-eab1fcf31f1c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b17befcacdd14330be582e67c50e2c79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84ec6bcd01c4410c8193820cfdd2367c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:34.711111 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e7ffdd9a-bb77-4a03-847a-eab1fcf31f1c tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 200 len: 1321 microversion: 2.1 time: 0.290150 Jul 28 03:38:34.721150 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 400/783] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:34 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:35.061436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-85a9f94d-4e55-49de-afed-8edd7c71abb9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:35.062580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-85a9f94d-4e55-49de-afed-8edd7c71abb9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:35.087594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-85a9f94d-4e55-49de-afed-8edd7c71abb9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:35.088100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e3554ce3-45f5-44e3-9044-f1c476e7e03c req-3c4cdb30-3b99-4067-ba7e-92f8781268aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24", "name": "network-vif-plugged", "status": "completed", "tag": "341becb1-9ad4-4e21-893d-15bc21d8044e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:35.088456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-85a9f94d-4e55-49de-afed-8edd7c71abb9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:35.089522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-85a9f94d-4e55-49de-afed-8edd7c71abb9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:35.090297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-85a9f94d-4e55-49de-afed-8edd7c71abb9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:35.115233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e3554ce3-45f5-44e3-9044-f1c476e7e03c req-3c4cdb30-3b99-4067-ba7e-92f8781268aa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:35.115674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e3554ce3-45f5-44e3-9044-f1c476e7e03c req-3c4cdb30-3b99-4067-ba7e-92f8781268aa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:35.146497 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e3554ce3-45f5-44e3-9044-f1c476e7e03c req-3c4cdb30-3b99-4067-ba7e-92f8781268aa service nova] Creating event network-vif-plugged:341becb1-9ad4-4e21-893d-15bc21d8044e for instance fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 on n-h1-826756-3 Jul 28 03:38:35.161362 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e3554ce3-45f5-44e3-9044-f1c476e7e03c req-3c4cdb30-3b99-4067-ba7e-92f8781268aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077141 Jul 28 03:38:35.166094 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 401/784] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:35.372417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c40f6203-ba32-45b9-b116-c044dab2fe70 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:35.373446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c40f6203-ba32-45b9-b116-c044dab2fe70 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:35.381442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c40f6203-ba32-45b9-b116-c044dab2fe70 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:35.382173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c40f6203-ba32-45b9-b116-c044dab2fe70 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:35.383175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c40f6203-ba32-45b9-b116-c044dab2fe70 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:35.383772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c40f6203-ba32-45b9-b116-c044dab2fe70 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:35.457194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-85a9f94d-4e55-49de-afed-8edd7c71abb9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:35.484570 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-85a9f94d-4e55-49de-afed-8edd7c71abb9 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1309 microversion: 2.1 time: 0.430621 Jul 28 03:38:35.496094 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 384/785] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:35 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:35.595960 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ed297e1c-4fa8-474a-9811-bf1dba411ba8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:35.597011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ed297e1c-4fa8-474a-9811-bf1dba411ba8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:35.611632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed297e1c-4fa8-474a-9811-bf1dba411ba8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:35.613846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed297e1c-4fa8-474a-9811-bf1dba411ba8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:35.618540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed297e1c-4fa8-474a-9811-bf1dba411ba8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:35.619512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed297e1c-4fa8-474a-9811-bf1dba411ba8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:35.789860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c40f6203-ba32-45b9-b116-c044dab2fe70 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:35.798627 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c40f6203-ba32-45b9-b116-c044dab2fe70 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1321 microversion: 2.1 time: 0.434252 Jul 28 03:38:35.799228 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 402/786] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:35 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:35.814419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-31341753-0a51-4b08-8c3a-6da2e68e8b25 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:35.817342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-31341753-0a51-4b08-8c3a-6da2e68e8b25 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] [instance: a2393d2a-78ad-4dd9-ad03-d8622acdb71e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:35.831689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31341753-0a51-4b08-8c3a-6da2e68e8b25 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:35.832147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31341753-0a51-4b08-8c3a-6da2e68e8b25 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:35.833013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31341753-0a51-4b08-8c3a-6da2e68e8b25 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:35.833459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31341753-0a51-4b08-8c3a-6da2e68e8b25 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:35.879926 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-31341753-0a51-4b08-8c3a-6da2e68e8b25 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] HTTP exception thrown: Instance a2393d2a-78ad-4dd9-ad03-d8622acdb71e could not be found. Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-31341753-0a51-4b08-8c3a-6da2e68e8b25 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Request method failure captured: Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e HTTP/1.1 Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gSGA_OPkLHQs__6B3lNyKphnEJIgdf9aMZnZLbYqP-PFVkypmYlCeMn67JTCIyyWJn9vQ-km8Xmztf2Wn-Ga1zH8aQD6QbkpHnpSgODs4fR7zq2Xo42FiJFJQWaaf7fg_YSUSrM7KOEHWOUpY6HrSFKSoO-b2-dgO_T1qQ52tFZPD0 Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 84ec6bcd01c4410c8193820cfdd2367c Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:38:35.882971 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:38:35.885813 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_84ec6bcd01c4410c8193820cfdd2367c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/84ec6bcd01c4410c8193820cfdd2367c"}]}] Jul 28 03:38:35.885813 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:35.885813 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 84ec6bcd01c4410c8193820cfdd2367c Jul 28 03:38:35.885813 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633 Jul 28 03:38:35.885813 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project Jul 28 03:38:35.885813 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:38:35.885813 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:38:35.885813 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: b17befcacdd14330be582e67c50e2c79 Jul 28 03:38:35.885813 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project Jul 28 03:38:35.885813 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:38:35.885813 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance a2393d2a-78ad-4dd9-ad03-d8622acdb71e could not be found. Jul 28 03:38:35.885813 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a2393d2a-78ad-4dd9-ad03-d8622acdb71e'} Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2393d2a-78ad-4dd9-ad03-d8622acdb71e could not be found. Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:38:35.887365 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2393d2a-78ad-4dd9-ad03-d8622acdb71e could not be found. Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2393d2a-78ad-4dd9-ad03-d8622acdb71e could not be found. Jul 28 03:38:35.889861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:35.893105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-31341753-0a51-4b08-8c3a-6da2e68e8b25 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] Returning 404 to user: Instance a2393d2a-78ad-4dd9-ad03-d8622acdb71e could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:38:35.894393 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-31341753-0a51-4b08-8c3a-6da2e68e8b25 tempest-FloatingIPsAssociationNegativeTestJSON-524018633 tempest-FloatingIPsAssociationNegativeTestJSON-524018633-project] 10.222.0.48 "GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e" status: 404 len: 111 microversion: 2.1 time: 0.088804 Jul 28 03:38:35.896045 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 403/787] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:35 2022] GET /compute/v2.1/servers/a2393d2a-78ad-4dd9-ad03-d8622acdb71e => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:38:35.991599 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-ed297e1c-4fa8-474a-9811-bf1dba411ba8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid 291f9510-9d09-47ee-bc90-13a457673493 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:36.058506 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ed297e1c-4fa8-474a-9811-bf1dba411ba8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 2055 microversion: 2.25 time: 0.466970 Jul 28 03:38:36.063427 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 385/788] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:35 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 2055 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:38:36.522214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6dcec286-3d9f-4c52-82a0-ea2921742923 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:36.523527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6dcec286-3d9f-4c52-82a0-ea2921742923 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:36.544638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dcec286-3d9f-4c52-82a0-ea2921742923 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:36.545088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dcec286-3d9f-4c52-82a0-ea2921742923 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:36.545861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dcec286-3d9f-4c52-82a0-ea2921742923 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:36.546284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dcec286-3d9f-4c52-82a0-ea2921742923 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:36.831159 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6081657c-b7fa-449b-8b8f-01bb9ebc6215 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:36.831872 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6081657c-b7fa-449b-8b8f-01bb9ebc6215 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:36.866580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6081657c-b7fa-449b-8b8f-01bb9ebc6215 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:36.868370 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6081657c-b7fa-449b-8b8f-01bb9ebc6215 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:36.872178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6081657c-b7fa-449b-8b8f-01bb9ebc6215 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:36.873092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6081657c-b7fa-449b-8b8f-01bb9ebc6215 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:37.255487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6081657c-b7fa-449b-8b8f-01bb9ebc6215 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:37.278762 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6081657c-b7fa-449b-8b8f-01bb9ebc6215 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1471 microversion: 2.1 time: 0.462452 Jul 28 03:38:37.288260 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 386/789] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:36 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1471 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:37.297953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-19f98f60-6865-42b3-911f-2981ffe0c4f0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:37.298632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-19f98f60-6865-42b3-911f-2981ffe0c4f0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:37.328313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-19f98f60-6865-42b3-911f-2981ffe0c4f0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:37.329480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-19f98f60-6865-42b3-911f-2981ffe0c4f0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:37.331077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-19f98f60-6865-42b3-911f-2981ffe0c4f0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:37.335239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-19f98f60-6865-42b3-911f-2981ffe0c4f0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:37.473424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6dcec286-3d9f-4c52-82a0-ea2921742923 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:37.491023 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6dcec286-3d9f-4c52-82a0-ea2921742923 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1309 microversion: 2.1 time: 0.973413 Jul 28 03:38:37.511373 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 404/790] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:36 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1309 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:37.523285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c573949-c670-4909-93ec-e191f8eb5f09 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:37.527314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c573949-c670-4909-93ec-e191f8eb5f09 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:37.540079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c573949-c670-4909-93ec-e191f8eb5f09 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:37.545222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c573949-c670-4909-93ec-e191f8eb5f09 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:37.547700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c573949-c670-4909-93ec-e191f8eb5f09 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:37.548655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c573949-c670-4909-93ec-e191f8eb5f09 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:37.611691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-1c573949-c670-4909-93ec-e191f8eb5f09 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lazy-loading 'flavor' on Instance uuid 4b228d20-b95a-4077-a833-0c74064590e4 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:37.634362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-19f98f60-6865-42b3-911f-2981ffe0c4f0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid 291f9510-9d09-47ee-bc90-13a457673493 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:37.653332 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-19f98f60-6865-42b3-911f-2981ffe0c4f0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 2035 microversion: 2.25 time: 0.363210 Jul 28 03:38:37.664986 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 387/791] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:37 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 2035 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:37.677775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-70e24581-169d-46f9-9e57-884e075b0203 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-826756-3", "block_migration": "auto"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:37.682684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-70e24581-169d-46f9-9e57-884e075b0203 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:37.693643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70e24581-169d-46f9-9e57-884e075b0203 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:37.694842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70e24581-169d-46f9-9e57-884e075b0203 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:37.696518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70e24581-169d-46f9-9e57-884e075b0203 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:37.697710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70e24581-169d-46f9-9e57-884e075b0203 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:37.799363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-70e24581-169d-46f9-9e57-884e075b0203 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'flavor' on Instance uuid 291f9510-9d09-47ee-bc90-13a457673493 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:37.805121 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c573949-c670-4909-93ec-e191f8eb5f09 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4/action" status: 202 len: 0 microversion: 2.1 time: 0.288772 Jul 28 03:38:37.812388 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 405/792] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:37 2022] POST /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:37.831695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0cc0e1b5-f7b1-4adc-a1c6-0603887e8391 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:37.839962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0cc0e1b5-f7b1-4adc-a1c6-0603887e8391 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:37.865327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cc0e1b5-f7b1-4adc-a1c6-0603887e8391 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:37.866438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cc0e1b5-f7b1-4adc-a1c6-0603887e8391 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:37.869300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cc0e1b5-f7b1-4adc-a1c6-0603887e8391 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:37.872010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cc0e1b5-f7b1-4adc-a1c6-0603887e8391 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:37.874484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-70e24581-169d-46f9-9e57-884e075b0203 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Going to try to live migrate instance to n-h1-826756-3 {{(pid=126072) live_migrate /opt/stack/nova/nova/compute/api.py:5474}} Jul 28 03:38:39.104620 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0cc0e1b5-f7b1-4adc-a1c6-0603887e8391 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1630 microversion: 2.1 time: 1.287021 Jul 28 03:38:39.105365 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 406/793] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:37 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1630 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:39.110695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f1d4135c-8dff-483c-8e5c-d99202e91f88 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:39.112051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f1d4135c-8dff-483c-8e5c-d99202e91f88 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:39.125724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1d4135c-8dff-483c-8e5c-d99202e91f88 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:39.126178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1d4135c-8dff-483c-8e5c-d99202e91f88 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:39.126960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1d4135c-8dff-483c-8e5c-d99202e91f88 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:39.127395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1d4135c-8dff-483c-8e5c-d99202e91f88 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:39.710951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f1d4135c-8dff-483c-8e5c-d99202e91f88 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:39.750943 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f1d4135c-8dff-483c-8e5c-d99202e91f88 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1491 microversion: 2.1 time: 0.643873 Jul 28 03:38:39.753772 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 407/794] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:39 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1491 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:39.774286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e5571c03-9e62-4b82-bac4-588f815a04f5 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:39.775691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e5571c03-9e62-4b82-bac4-588f815a04f5 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:39.782359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5571c03-9e62-4b82-bac4-588f815a04f5 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:39.782817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5571c03-9e62-4b82-bac4-588f815a04f5 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:39.783605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5571c03-9e62-4b82-bac4-588f815a04f5 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:39.784043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5571c03-9e62-4b82-bac4-588f815a04f5 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:40.579359 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e5571c03-9e62-4b82-bac4-588f815a04f5 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1642 microversion: 2.1 time: 0.804839 Jul 28 03:38:40.586520 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 408/795] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:39 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1642 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:40.598831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c5f327b0-eb18-4f0e-a561-4c34af1da764 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:40.606826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c5f327b0-eb18-4f0e-a561-4c34af1da764 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:40.634379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5f327b0-eb18-4f0e-a561-4c34af1da764 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:40.635660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5f327b0-eb18-4f0e-a561-4c34af1da764 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:40.637152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5f327b0-eb18-4f0e-a561-4c34af1da764 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:40.637824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5f327b0-eb18-4f0e-a561-4c34af1da764 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:40.987218 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-70e24581-169d-46f9-9e57-884e075b0203 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493/action" status: 202 len: 0 microversion: 2.25 time: 3.313694 Jul 28 03:38:40.988602 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 388/796] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 03:38:37 2022] POST /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493/action => generated 0 bytes in 3316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:38:40.996506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-017e145a-970b-433b-ae99-92bd50832c3d tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:40.998829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-017e145a-970b-433b-ae99-92bd50832c3d tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:41.017595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-017e145a-970b-433b-ae99-92bd50832c3d tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:41.019215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-017e145a-970b-433b-ae99-92bd50832c3d tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:41.021317 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-017e145a-970b-433b-ae99-92bd50832c3d tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:41.022467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-017e145a-970b-433b-ae99-92bd50832c3d tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:41.028756 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c5f327b0-eb18-4f0e-a561-4c34af1da764 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1613 microversion: 2.1 time: 0.440112 Jul 28 03:38:41.034368 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 409/797] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:40 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1613 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:41.310998 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-017e145a-970b-433b-ae99-92bd50832c3d tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1642 microversion: 2.1 time: 0.320559 Jul 28 03:38:41.317482 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 389/798] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:40 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1642 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:41.349688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2071334603", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:41.349965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9ec35d78-a526-4b4e-b755-5faac0eba4df tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:41.350524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9ec35d78-a526-4b4e-b755-5faac0eba4df tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:41.362072 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9ec35d78-a526-4b4e-b755-5faac0eba4df tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:41.363253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9ec35d78-a526-4b4e-b755-5faac0eba4df tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:41.364654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9ec35d78-a526-4b4e-b755-5faac0eba4df tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:41.365253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9ec35d78-a526-4b4e-b755-5faac0eba4df tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:41.436476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:38:41.632080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9ec35d78-a526-4b4e-b755-5faac0eba4df tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:41.659237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9ec35d78-a526-4b4e-b755-5faac0eba4df tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:41.664898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9ec35d78-a526-4b4e-b755-5faac0eba4df tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:41.666204 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9ec35d78-a526-4b4e-b755-5faac0eba4df tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1568 microversion: 2.25 time: 0.346522 Jul 28 03:38:41.666805 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 390/799] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:41 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1568 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:41.695575 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0107de9c-4c4e-4c9a-b11e-b960e65bca66 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:41.696164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0107de9c-4c4e-4c9a-b11e-b960e65bca66 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:41.716962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0107de9c-4c4e-4c9a-b11e-b960e65bca66 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:41.717397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0107de9c-4c4e-4c9a-b11e-b960e65bca66 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:41.718192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0107de9c-4c4e-4c9a-b11e-b960e65bca66 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:41.718989 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0107de9c-4c4e-4c9a-b11e-b960e65bca66 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:41.900448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:38:41.901035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:38:41.901324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:38:41.901728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:38:41.902137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:38:41.918935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:41.919385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:41.920178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:41.923167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:41.932829 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-0107de9c-4c4e-4c9a-b11e-b960e65bca66 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] HTTP exception thrown: Cannot 'migrate' instance 4b228d20-b95a-4077-a833-0c74064590e4 while it is in vm_state suspended Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0107de9c-4c4e-4c9a-b11e-b960e65bca66 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Request method failure captured: Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4/action HTTP/1.1 Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 15 Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gSIjBY89Jxd5nvAyUxV8IJGlmMT8WSjW9enYw2aPvjaBglR22lsLsimLjP0YBER-Wx_HI7flV-rAAGYvCEVs0vpvpfU1SA6bWZBm8XhQG2IFunRerWZKhlpyFK5p5ltUnZmKTsh1UoxWt4ZZkDXJ64HO7aE_soV04gEO8li9ycM1cI Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: e3a4561560cc4057b0b0b0d65b2a0686 Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:38:41.938246 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:38:41.939708 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3a4561560cc4057b0b0b0d65b2a0686"}]}] Jul 28 03:38:41.939708 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:41.939708 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: e3a4561560cc4057b0b0b0d65b2a0686 Jul 28 03:38:41.939708 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:41.939708 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersAdminNegativeTestJSON-1661675032-project-admin Jul 28 03:38:41.939708 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:38:41.939708 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:38:41.939708 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 000f1f96e5ef4821a8023408850a2972 Jul 28 03:38:41.939708 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1661675032-project-admin Jul 28 03:38:41.939708 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:38:41.939708 n-d-826756-3 devstack@n-api.service[126072]: {"migrate": {}} Jul 28 03:38:41.939708 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:38:41.939708 n-d-826756-3 devstack@n-api.service[126072]: exception: Cannot 'migrate' instance 4b228d20-b95a-4077-a833-0c74064590e4 while it is in vm_state suspended Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '4b228d20-b95a-4077-a833-0c74064590e4', 'body': {'migrate': {}}} Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 376, in inner Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b228d20-b95a-4077-a833-0c74064590e4 in vm_state suspended. Cannot resize while the instance is in this state. Jul 28 03:38:41.940574 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 4b228d20-b95a-4077-a833-0c74064590e4 while it is in vm_state suspended Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:41.941748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:41.944152 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:41.944152 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:41.944152 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:38:41.944152 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:38:41.944152 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 4b228d20-b95a-4077-a833-0c74064590e4 while it is in vm_state suspended Jul 28 03:38:41.944152 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:41.944152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0107de9c-4c4e-4c9a-b11e-b960e65bca66 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Returning 409 to user: Cannot 'migrate' instance 4b228d20-b95a-4077-a833-0c74064590e4 while it is in vm_state suspended {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:38:41.944152 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0107de9c-4c4e-4c9a-b11e-b960e65bca66 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4/action" status: 409 len: 148 microversion: 2.1 time: 0.271942 Jul 28 03:38:41.950084 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 391/800] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:41 2022] POST /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4/action => generated 148 bytes in 282 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:38:41.955393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8505cf8a-d68e-4bb9-9bc8-89618bae04d5 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:41.958398 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:38:41.958398 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:38:41.960628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8505cf8a-d68e-4bb9-9bc8-89618bae04d5 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:41.961610 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8505cf8a-d68e-4bb9-9bc8-89618bae04d5 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:41.962984 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8505cf8a-d68e-4bb9-9bc8-89618bae04d5 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:41.963654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8505cf8a-d68e-4bb9-9bc8-89618bae04d5 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:41.967642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Getting quotas for project 73bbf29c8c7f4f3385717d49ff9fe5f4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:38:41.977320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Getting quotas for user b4eff140fd7d4ec0ae9fe1a851d272e2 and project 73bbf29c8c7f4f3385717d49ff9fe5f4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:38:41.996508 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8505cf8a-d68e-4bb9-9bc8-89618bae04d5 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045146 Jul 28 03:38:41.998097 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 392/801] 10.222.0.48 () {58 vars in 1176 bytes} [Thu Jul 28 03:38:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:42.004438 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-de8f4522-92c4-4aec-a71f-ba99c1f059f8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:42.005479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-de8f4522-92c4-4aec-a71f-ba99c1f059f8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:42.012989 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de8f4522-92c4-4aec-a71f-ba99c1f059f8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:42.013676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de8f4522-92c4-4aec-a71f-ba99c1f059f8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:42.014604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de8f4522-92c4-4aec-a71f-ba99c1f059f8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:42.015185 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de8f4522-92c4-4aec-a71f-ba99c1f059f8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:42.018110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:38:42.020472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:38:42.163910 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9b06a030-fc46-427e-968f-ec3b85c2279e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116301 Jul 28 03:38:42.164626 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 410/802] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:38:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:38:42.180109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af6c4ea7-8534-4d65-862b-e70df147be86 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af6c4ea7-8534-4d65-862b-e70df147be86 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Request method failure captured: Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6/action HTTP/1.1 Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 39 Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gSIjBY89Jxd5nvAyUxV8IJGlmMT8WSjW9enYw2aPvjaBglR22lsLsimLjP0YBER-Wx_HI7flV-rAAGYvCEVs0vpvpfU1SA6bWZBm8XhQG2IFunRerWZKhlpyFK5p5ltUnZmKTsh1UoxWt4ZZkDXJ64HO7aE_soV04gEO8li9ycM1cI Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: e3a4561560cc4057b0b0b0d65b2a0686 Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:38:42.233775 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:38:42.236170 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3a4561560cc4057b0b0b0d65b2a0686"}]}] Jul 28 03:38:42.236170 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:42.236170 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: e3a4561560cc4057b0b0b0d65b2a0686 Jul 28 03:38:42.236170 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:42.236170 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersAdminNegativeTestJSON-1661675032-project-admin Jul 28 03:38:42.236170 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:38:42.236170 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:38:42.236170 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 000f1f96e5ef4821a8023408850a2972 Jul 28 03:38:42.236170 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1661675032-project-admin Jul 28 03:38:42.236170 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:38:42.236170 n-d-826756-3 devstack@n-api.service[126071]: {"os-resetState": {"state": "invalid"}} Jul 28 03:38:42.236170 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a33dc7b6-d97c-4973-b4a3-e576cddcdbb6', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'invalid' Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:42.237546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:38:42.239690 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 28 03:38:42.240894 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:42.240894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af6c4ea7-8534-4d65-862b-e70df147be86 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:38:42.240894 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-af6c4ea7-8534-4d65-862b-e70df147be86 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6/action" status: 400 len: 144 microversion: 2.1 time: 0.069625 Jul 28 03:38:42.246607 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 411/803] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:42 2022] POST /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6/action => generated 144 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:38:42.264551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e3ffd82b-738d-4dba-ad78-978d22662c88 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:42.265117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e3ffd82b-738d-4dba-ad78-978d22662c88 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:42.285898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3ffd82b-738d-4dba-ad78-978d22662c88 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:42.286365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3ffd82b-738d-4dba-ad78-978d22662c88 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:42.287217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3ffd82b-738d-4dba-ad78-978d22662c88 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:42.288126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3ffd82b-738d-4dba-ad78-978d22662c88 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:42.438985 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e3ffd82b-738d-4dba-ad78-978d22662c88 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24/action" status: 202 len: 0 microversion: 2.1 time: 0.190307 Jul 28 03:38:42.445037 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 412/804] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:42 2022] POST /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:42.454612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f3c94c6-2807-45a1-b835-535851357043 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f3c94c6-2807-45a1-b835-535851357043 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Request method failure captured: Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6/action HTTP/1.1 Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 31 Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gSIjBY89Jxd5nvAyUxV8IJGlmMT8WSjW9enYw2aPvjaBglR22lsLsimLjP0YBER-Wx_HI7flV-rAAGYvCEVs0vpvpfU1SA6bWZBm8XhQG2IFunRerWZKhlpyFK5p5ltUnZmKTsh1UoxWt4ZZkDXJ64HO7aE_soV04gEO8li9ycM1cI Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: e3a4561560cc4057b0b0b0d65b2a0686 Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:38:42.461339 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:38:42.463052 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3a4561560cc4057b0b0b0d65b2a0686"}]}] Jul 28 03:38:42.463052 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:42.463052 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: e3a4561560cc4057b0b0b0d65b2a0686 Jul 28 03:38:42.463052 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:42.463052 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersAdminNegativeTestJSON-1661675032-project-admin Jul 28 03:38:42.463052 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:38:42.463052 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:38:42.463052 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 000f1f96e5ef4821a8023408850a2972 Jul 28 03:38:42.463052 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1661675032-project-admin Jul 28 03:38:42.463052 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:38:42.463052 n-d-826756-3 devstack@n-api.service[126071]: {"os-resetState": {"state": 1}} Jul 28 03:38:42.463052 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:38:42.463052 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a33dc7b6-d97c-4973-b4a3-e576cddcdbb6', 'body': {'os-resetState': {'state': 1}}} Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 1 Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:38:42.464080 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 28 03:38:42.465555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:42.471326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f3c94c6-2807-45a1-b835-535851357043 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:38:42.472719 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6f3c94c6-2807-45a1-b835-535851357043 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6/action" status: 400 len: 120 microversion: 2.1 time: 0.025411 Jul 28 03:38:42.474370 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 413/805] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:42 2022] POST /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6/action => generated 120 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:38:42.495672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-941428482", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:42.664382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:38:42.689819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-de8f4522-92c4-4aec-a71f-ba99c1f059f8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:42.700606 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-de8f4522-92c4-4aec-a71f-ba99c1f059f8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.700948 Jul 28 03:38:42.701749 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 393/806] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:41 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:42.707555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4e8f18f4-8d6e-42ea-976f-c73bf49c8d13 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:42.708210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4e8f18f4-8d6e-42ea-976f-c73bf49c8d13 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:42.715042 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e8f18f4-8d6e-42ea-976f-c73bf49c8d13 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:42.715510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e8f18f4-8d6e-42ea-976f-c73bf49c8d13 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:42.716422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e8f18f4-8d6e-42ea-976f-c73bf49c8d13 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:42.716855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e8f18f4-8d6e-42ea-976f-c73bf49c8d13 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:43.052319 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4e8f18f4-8d6e-42ea-976f-c73bf49c8d13 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1647 microversion: 2.1 time: 0.349118 Jul 28 03:38:43.057088 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 394/807] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:42 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1647 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:43.062994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7d8247cd-729d-427c-8ea8-108801c11f08 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:43.066429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7d8247cd-729d-427c-8ea8-108801c11f08 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Failed to fetch instance by id 999 {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2972}} Jul 28 03:38:43.067334 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-7d8247cd-729d-427c-8ea8-108801c11f08 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7d8247cd-729d-427c-8ea8-108801c11f08 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Request method failure captured: Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 37 Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gSIjBY89Jxd5nvAyUxV8IJGlmMT8WSjW9enYw2aPvjaBglR22lsLsimLjP0YBER-Wx_HI7flV-rAAGYvCEVs0vpvpfU1SA6bWZBm8XhQG2IFunRerWZKhlpyFK5p5ltUnZmKTsh1UoxWt4ZZkDXJ64HO7aE_soV04gEO8li9ycM1cI Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: e3a4561560cc4057b0b0b0d65b2a0686 Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:38:43.075696 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:38:43.077354 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e3a4561560cc4057b0b0b0d65b2a0686"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e3a4561560cc4057b0b0b0d65b2a0686"}]}] Jul 28 03:38:43.077354 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:43.077354 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: e3a4561560cc4057b0b0b0d65b2a0686 Jul 28 03:38:43.077354 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1661675032 Jul 28 03:38:43.077354 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersAdminNegativeTestJSON-1661675032-project-admin Jul 28 03:38:43.077354 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:38:43.077354 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:38:43.077354 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 000f1f96e5ef4821a8023408850a2972 Jul 28 03:38:43.077354 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1661675032-project-admin Jul 28 03:38:43.077354 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:38:43.077354 n-d-826756-3 devstack@n-api.service[126072]: {"os-resetState": {"state": "error"}} Jul 28 03:38:43.077354 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:38:43.077354 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 999 could not be found. Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2973, in get Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:38:43.078323 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7d8247cd-729d-427c-8ea8-108801c11f08 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:38:43.079874 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7d8247cd-729d-427c-8ea8-108801c11f08 tempest-ServersAdminNegativeTestJSON-1661675032 tempest-ServersAdminNegativeTestJSON-1661675032-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.019514 Jul 28 03:38:43.081064 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 395/808] 10.222.0.48 () {60 vars in 1179 bytes} [Thu Jul 28 03:38:43 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:38:43.087961 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-df917936-e3c2-44e8-abc6-0750701918bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:43.088909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-df917936-e3c2-44e8-abc6-0750701918bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:43.098707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df917936-e3c2-44e8-abc6-0750701918bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:43.099239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df917936-e3c2-44e8-abc6-0750701918bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:43.100310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df917936-e3c2-44e8-abc6-0750701918bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:43.101035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df917936-e3c2-44e8-abc6-0750701918bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:43.362118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-df917936-e3c2-44e8-abc6-0750701918bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:43.375521 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-df917936-e3c2-44e8-abc6-0750701918bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:43.379858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-df917936-e3c2-44e8-abc6-0750701918bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:43.381138 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-df917936-e3c2-44e8-abc6-0750701918bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1568 microversion: 2.25 time: 0.302326 Jul 28 03:38:43.381716 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 396/809] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:43 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1568 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:43.386561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-575c70e6-0faa-441b-b54a-40bb48af5430 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-30014491"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:43.393825 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-575c70e6-0faa-441b-b54a-40bb48af5430 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:43.400948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-575c70e6-0faa-441b-b54a-40bb48af5430 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:43.401701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-575c70e6-0faa-441b-b54a-40bb48af5430 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:43.402488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-575c70e6-0faa-441b-b54a-40bb48af5430 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:43.404038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-575c70e6-0faa-441b-b54a-40bb48af5430 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:43.527639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:38:43.528155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:38:43.528554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:38:43.528969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:38:43.529601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:38:43.551486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:43.551942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:43.552782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:43.553222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:43.614868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Getting quotas for project 73bbf29c8c7f4f3385717d49ff9fe5f4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:38:43.633917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Getting quotas for user b4eff140fd7d4ec0ae9fe1a851d272e2 and project 73bbf29c8c7f4f3385717d49ff9fe5f4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:38:43.663744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:38:43.678237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:38:43.720831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:43.748899 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-575c70e6-0faa-441b-b54a-40bb48af5430 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.365452 Jul 28 03:38:43.754398 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 397/810] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:43 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 28 03:38:43.769667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a885c040-7751-46f9-863e-dfa2233e3bb2 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:43.770624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a885c040-7751-46f9-863e-dfa2233e3bb2 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:43.791145 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a885c040-7751-46f9-863e-dfa2233e3bb2 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:43.792177 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ebcf2746-be8f-459b-a5ce-1b8721d5f376 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.309367 Jul 28 03:38:43.793979 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 414/811] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:38:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:38:43.797885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a885c040-7751-46f9-863e-dfa2233e3bb2 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:43.799118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a885c040-7751-46f9-863e-dfa2233e3bb2 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:43.800279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a885c040-7751-46f9-863e-dfa2233e3bb2 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:43.814774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:43.815984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-2dc5b894-9c3d-47fc-af25-2f4c3e836af0 req-a7f84eaa-8d98-4177-8def-c57640f7735b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291f9510-9d09-47ee-bc90-13a457673493", "name": "network-vif-unplugged", "status": "completed", "tag": "e5a92ce3-6306-4cbb-9e4b-5d834b786894"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:43.869095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2dc5b894-9c3d-47fc-af25-2f4c3e836af0 req-a7f84eaa-8d98-4177-8def-c57640f7735b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:43.870624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2dc5b894-9c3d-47fc-af25-2f4c3e836af0 req-a7f84eaa-8d98-4177-8def-c57640f7735b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:43.880194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a885c040-7751-46f9-863e-dfa2233e3bb2 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:38:43.889477 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-2dc5b894-9c3d-47fc-af25-2f4c3e836af0 req-a7f84eaa-8d98-4177-8def-c57640f7735b service nova] Creating event network-vif-unplugged:e5a92ce3-6306-4cbb-9e4b-5d834b786894 for instance 291f9510-9d09-47ee-bc90-13a457673493 on n-h2-826756-3 Jul 28 03:38:43.951354 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-2dc5b894-9c3d-47fc-af25-2f4c3e836af0 req-a7f84eaa-8d98-4177-8def-c57640f7735b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154301 Jul 28 03:38:43.953113 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 415/812] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:43.961287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1f0d7fc5-762e-4133-a098-a6fd12e66a8b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:43.963470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1f0d7fc5-762e-4133-a098-a6fd12e66a8b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:44.151458 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a885c040-7751-46f9-863e-dfa2233e3bb2 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 204 len: 0 microversion: 2.1 time: 0.394881 Jul 28 03:38:44.181845 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 398/813] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:38:43 2022] DELETE /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:38:44.198798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3c8c22a2-d815-49b5-9386-f603d7cfd33a tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:44.201299 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3c8c22a2-d815-49b5-9386-f603d7cfd33a tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:44.228966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c8c22a2-d815-49b5-9386-f603d7cfd33a tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:44.241753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c8c22a2-d815-49b5-9386-f603d7cfd33a tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:44.243731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c8c22a2-d815-49b5-9386-f603d7cfd33a tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:44.244705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c8c22a2-d815-49b5-9386-f603d7cfd33a tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:44.269711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1f0d7fc5-762e-4133-a098-a6fd12e66a8b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:44.301293 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1f0d7fc5-762e-4133-a098-a6fd12e66a8b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1213 microversion: 2.1 time: 0.344861 Jul 28 03:38:44.302888 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 416/814] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:43 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1213 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:44.334170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-530b4fdc-0b4c-47bf-ac7d-2f694987987a tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:44.337994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-530b4fdc-0b4c-47bf-ac7d-2f694987987a tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:44.383201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-530b4fdc-0b4c-47bf-ac7d-2f694987987a tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:44.383661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-530b4fdc-0b4c-47bf-ac7d-2f694987987a tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:44.384820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-530b4fdc-0b4c-47bf-ac7d-2f694987987a tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:44.385439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-530b4fdc-0b4c-47bf-ac7d-2f694987987a tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:44.446384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:44.931306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-530b4fdc-0b4c-47bf-ac7d-2f694987987a tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:44.952448 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-530b4fdc-0b4c-47bf-ac7d-2f694987987a tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1468 microversion: 2.1 time: 0.631054 Jul 28 03:38:44.953480 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 417/815] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:44 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1468 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:44.960149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-10d6912a-7ddc-4401-aab1-721f85eb546c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:44.965184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-10d6912a-7ddc-4401-aab1-721f85eb546c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:44.986916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10d6912a-7ddc-4401-aab1-721f85eb546c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:44.987437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10d6912a-7ddc-4401-aab1-721f85eb546c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:44.988498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10d6912a-7ddc-4401-aab1-721f85eb546c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:44.988997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10d6912a-7ddc-4401-aab1-721f85eb546c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:45.048195 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3c8c22a2-d815-49b5-9386-f603d7cfd33a tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1627 microversion: 2.1 time: 0.860905 Jul 28 03:38:45.070545 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 399/816] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:44 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1627 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:45.081349 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-682bf43c-fbdb-47f7-8b92-346c44ba7561 req-88336b03-4de5-4784-81c3-392c9db9853d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4b8ffa-dbe6-4e90-a8f5-728addf73aae", "name": "network-vif-unplugged", "status": "completed", "tag": "3931df07-76f1-4feb-a179-d48d42b61b21"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:45.096573 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-682bf43c-fbdb-47f7-8b92-346c44ba7561 req-88336b03-4de5-4784-81c3-392c9db9853d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:45.097688 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-682bf43c-fbdb-47f7-8b92-346c44ba7561 req-88336b03-4de5-4784-81c3-392c9db9853d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:45.124967 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-682bf43c-fbdb-47f7-8b92-346c44ba7561 req-88336b03-4de5-4784-81c3-392c9db9853d service nova] Creating event network-vif-unplugged:3931df07-76f1-4feb-a179-d48d42b61b21 for instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae on n-h2-826756-3 Jul 28 03:38:45.139059 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-682bf43c-fbdb-47f7-8b92-346c44ba7561 req-88336b03-4de5-4784-81c3-392c9db9853d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066496 Jul 28 03:38:45.148014 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 400/817] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:45.156215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2ec617f7-c9bd-4115-bc86-b06b09a4e902 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826756-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:45.160086 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2ec617f7-c9bd-4115-bc86-b06b09a4e902 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:45.168253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ec617f7-c9bd-4115-bc86-b06b09a4e902 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:45.169230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ec617f7-c9bd-4115-bc86-b06b09a4e902 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:45.170408 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ec617f7-c9bd-4115-bc86-b06b09a4e902 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:45.170841 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ec617f7-c9bd-4115-bc86-b06b09a4e902 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:45.203095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-2ec617f7-c9bd-4115-bc86-b06b09a4e902 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lazy-loading 'flavor' on Instance uuid fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:45.226155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2ec617f7-c9bd-4115-bc86-b06b09a4e902 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Going to try to live migrate instance to n-h2-826756-3 {{(pid=126072) live_migrate /opt/stack/nova/nova/compute/api.py:5474}} Jul 28 03:38:45.483740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-10d6912a-7ddc-4401-aab1-721f85eb546c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:45.495976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-10d6912a-7ddc-4401-aab1-721f85eb546c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:45.510567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-10d6912a-7ddc-4401-aab1-721f85eb546c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:45.511953 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-10d6912a-7ddc-4401-aab1-721f85eb546c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1568 microversion: 2.25 time: 0.556943 Jul 28 03:38:45.512708 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 418/818] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:44 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1568 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:45.517962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5a4bd6d3-7403-4ed5-b339-52692c9e536e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:45.525011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5a4bd6d3-7403-4ed5-b339-52692c9e536e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:45.535753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a4bd6d3-7403-4ed5-b339-52692c9e536e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:45.539500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a4bd6d3-7403-4ed5-b339-52692c9e536e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:45.542877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a4bd6d3-7403-4ed5-b339-52692c9e536e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:45.549020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a4bd6d3-7403-4ed5-b339-52692c9e536e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:45.747422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5a4bd6d3-7403-4ed5-b339-52692c9e536e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:45.766923 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5a4bd6d3-7403-4ed5-b339-52692c9e536e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1265 microversion: 2.1 time: 0.252670 Jul 28 03:38:45.767916 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 419/819] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:45 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:45.993834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e156a771-ebae-4969-9f2d-d3f3f0753f94 req-837e9159-e123-4e60-b2c1-61d34b51969c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "291f9510-9d09-47ee-bc90-13a457673493", "tag": "e5a92ce3-6306-4cbb-9e4b-5d834b786894"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:46.059064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e156a771-ebae-4969-9f2d-d3f3f0753f94 req-837e9159-e123-4e60-b2c1-61d34b51969c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:46.064630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e156a771-ebae-4969-9f2d-d3f3f0753f94 req-837e9159-e123-4e60-b2c1-61d34b51969c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:46.094749 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e156a771-ebae-4969-9f2d-d3f3f0753f94 req-837e9159-e123-4e60-b2c1-61d34b51969c service nova] Creating event network-changed:e5a92ce3-6306-4cbb-9e4b-5d834b786894 for instance 291f9510-9d09-47ee-bc90-13a457673493 on n-h2-826756-3 Jul 28 03:38:46.101091 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e156a771-ebae-4969-9f2d-d3f3f0753f94 req-837e9159-e123-4e60-b2c1-61d34b51969c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125411 Jul 28 03:38:46.103760 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 420/820] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:38:46.109149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-153a03a6-5883-407b-bd28-9e9b93eefa87 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:46.110046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-153a03a6-5883-407b-bd28-9e9b93eefa87 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:46.121986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-153a03a6-5883-407b-bd28-9e9b93eefa87 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:46.122448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-153a03a6-5883-407b-bd28-9e9b93eefa87 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:46.123247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-153a03a6-5883-407b-bd28-9e9b93eefa87 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:46.123691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-153a03a6-5883-407b-bd28-9e9b93eefa87 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:46.665995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-153a03a6-5883-407b-bd28-9e9b93eefa87 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:46.692907 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-153a03a6-5883-407b-bd28-9e9b93eefa87 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1468 microversion: 2.1 time: 0.587589 Jul 28 03:38:46.693970 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 421/821] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:46 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1468 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:46.721586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-81de8c08-36e9-48c7-8c9d-0bffa0bbfe73 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:46.723174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-81de8c08-36e9-48c7-8c9d-0bffa0bbfe73 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:46.742257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81de8c08-36e9-48c7-8c9d-0bffa0bbfe73 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:46.743064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81de8c08-36e9-48c7-8c9d-0bffa0bbfe73 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:46.744673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81de8c08-36e9-48c7-8c9d-0bffa0bbfe73 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:46.747265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81de8c08-36e9-48c7-8c9d-0bffa0bbfe73 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:47.103669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-81de8c08-36e9-48c7-8c9d-0bffa0bbfe73 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:47.119212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-81de8c08-36e9-48c7-8c9d-0bffa0bbfe73 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:47.122176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-81de8c08-36e9-48c7-8c9d-0bffa0bbfe73 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:47.126048 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-81de8c08-36e9-48c7-8c9d-0bffa0bbfe73 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1568 microversion: 2.25 time: 0.422744 Jul 28 03:38:47.127063 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 422/822] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:46 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1568 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:47.137041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-626709a7-f367-47f7-b753-9a4d920636e7 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:47.138452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-626709a7-f367-47f7-b753-9a4d920636e7 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:47.160580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-626709a7-f367-47f7-b753-9a4d920636e7 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:47.161587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-626709a7-f367-47f7-b753-9a4d920636e7 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:47.163197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-626709a7-f367-47f7-b753-9a4d920636e7 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:47.163886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-626709a7-f367-47f7-b753-9a4d920636e7 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:47.287940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-626709a7-f367-47f7-b753-9a4d920636e7 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:47.305840 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-626709a7-f367-47f7-b753-9a4d920636e7 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1271 microversion: 2.1 time: 0.176799 Jul 28 03:38:47.307693 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 423/823] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:47 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:47.716607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1753f169-e56c-4077-83fc-dafc5d391a61 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:47.718928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1753f169-e56c-4077-83fc-dafc5d391a61 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:47.728317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1753f169-e56c-4077-83fc-dafc5d391a61 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:47.728785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1753f169-e56c-4077-83fc-dafc5d391a61 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:47.729766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1753f169-e56c-4077-83fc-dafc5d391a61 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:47.730379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1753f169-e56c-4077-83fc-dafc5d391a61 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:47.928835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1753f169-e56c-4077-83fc-dafc5d391a61 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:47.947572 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1753f169-e56c-4077-83fc-dafc5d391a61 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1468 microversion: 2.1 time: 0.235323 Jul 28 03:38:47.952994 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 424/824] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:47 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1468 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:48.168008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f833b195-fbd8-4436-9a0b-dce5807e79fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:48.170261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f833b195-fbd8-4436-9a0b-dce5807e79fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:48.179973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f833b195-fbd8-4436-9a0b-dce5807e79fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:48.180436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f833b195-fbd8-4436-9a0b-dce5807e79fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:48.181564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f833b195-fbd8-4436-9a0b-dce5807e79fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:48.182197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f833b195-fbd8-4436-9a0b-dce5807e79fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:48.379231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f833b195-fbd8-4436-9a0b-dce5807e79fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:48.389724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f833b195-fbd8-4436-9a0b-dce5807e79fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:48.392651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f833b195-fbd8-4436-9a0b-dce5807e79fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:48.403363 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f833b195-fbd8-4436-9a0b-dce5807e79fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1568 microversion: 2.25 time: 0.238837 Jul 28 03:38:48.404917 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 425/825] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:48 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:38:48.423517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-68e8e201-c001-4954-860a-e511f0352662 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:48.424828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-68e8e201-c001-4954-860a-e511f0352662 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:48.435132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68e8e201-c001-4954-860a-e511f0352662 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:48.436072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68e8e201-c001-4954-860a-e511f0352662 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:48.437138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68e8e201-c001-4954-860a-e511f0352662 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:48.437767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68e8e201-c001-4954-860a-e511f0352662 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:48.835427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-68e8e201-c001-4954-860a-e511f0352662 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:48.855123 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-68e8e201-c001-4954-860a-e511f0352662 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1313 microversion: 2.1 time: 0.448508 Jul 28 03:38:48.861998 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 426/826] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:48 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:48.909105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-414218b9-6999-4328-ba42-555342ddfadc req-50286a26-710f-4241-a772-4fb9544577d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b228d20-b95a-4077-a833-0c74064590e4", "name": "network-vif-deleted", "tag": "3acb121f-372c-4c08-9b11-0c55c56ab25b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:48.950766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-414218b9-6999-4328-ba42-555342ddfadc req-50286a26-710f-4241-a772-4fb9544577d1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:48.951490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-414218b9-6999-4328-ba42-555342ddfadc req-50286a26-710f-4241-a772-4fb9544577d1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:48.988948 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-414218b9-6999-4328-ba42-555342ddfadc req-50286a26-710f-4241-a772-4fb9544577d1 service nova] Creating event network-vif-deleted:3acb121f-372c-4c08-9b11-0c55c56ab25b for instance 4b228d20-b95a-4077-a833-0c74064590e4 on n-h2-826756-3 Jul 28 03:38:49.000892 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-414218b9-6999-4328-ba42-555342ddfadc req-50286a26-710f-4241-a772-4fb9544577d1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094746 Jul 28 03:38:49.002160 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 427/827] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:38:49.012541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ebd5b572-6633-4c18-9e77-9c084c31552d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:49.013305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ebd5b572-6633-4c18-9e77-9c084c31552d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:49.039048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebd5b572-6633-4c18-9e77-9c084c31552d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:49.039048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebd5b572-6633-4c18-9e77-9c084c31552d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:49.039048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebd5b572-6633-4c18-9e77-9c084c31552d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:49.039461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebd5b572-6633-4c18-9e77-9c084c31552d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:49.235707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ebd5b572-6633-4c18-9e77-9c084c31552d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:49.253843 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ebd5b572-6633-4c18-9e77-9c084c31552d tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1426 microversion: 2.1 time: 0.249478 Jul 28 03:38:49.257134 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 428/828] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:49 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1426 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:49.344896 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2ec617f7-c9bd-4115-bc86-b06b09a4e902 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24/action" status: 202 len: 0 microversion: 2.1 time: 4.193732 Jul 28 03:38:49.345528 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 401/829] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:38:45 2022] POST /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24/action => generated 0 bytes in 4197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:49.357059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17b2f35f-6615-4aba-8d54-ad3651aa798f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:49.357874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-17b2f35f-6615-4aba-8d54-ad3651aa798f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:49.373064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17b2f35f-6615-4aba-8d54-ad3651aa798f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:49.378201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17b2f35f-6615-4aba-8d54-ad3651aa798f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:49.381224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17b2f35f-6615-4aba-8d54-ad3651aa798f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:49.381973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17b2f35f-6615-4aba-8d54-ad3651aa798f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:49.435352 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7c60df15-fd27-48e4-afef-c52e44ce1d0c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:49.435989 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7c60df15-fd27-48e4-afef-c52e44ce1d0c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:49.454427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c60df15-fd27-48e4-afef-c52e44ce1d0c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:49.455185 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c60df15-fd27-48e4-afef-c52e44ce1d0c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:49.456188 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c60df15-fd27-48e4-afef-c52e44ce1d0c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:49.456874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c60df15-fd27-48e4-afef-c52e44ce1d0c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:49.744717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-17b2f35f-6615-4aba-8d54-ad3651aa798f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:49.757839 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-17b2f35f-6615-4aba-8d54-ad3651aa798f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1501 microversion: 2.1 time: 0.405795 Jul 28 03:38:49.758448 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 429/830] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:49 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1501 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:49.890882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca394958-c573-4bf7-ae0e-a6c42a86b9a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:49.891964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca394958-c573-4bf7-ae0e-a6c42a86b9a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:49.904524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca394958-c573-4bf7-ae0e-a6c42a86b9a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:49.905723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca394958-c573-4bf7-ae0e-a6c42a86b9a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:49.907483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca394958-c573-4bf7-ae0e-a6c42a86b9a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:49.908256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca394958-c573-4bf7-ae0e-a6c42a86b9a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:50.280658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca394958-c573-4bf7-ae0e-a6c42a86b9a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:50.300971 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca394958-c573-4bf7-ae0e-a6c42a86b9a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1313 microversion: 2.1 time: 0.416684 Jul 28 03:38:50.303089 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 430/831] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:49 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:50.311168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3d53cdb-459e-482d-8173-bebce3c3db75 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:50.312679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3d53cdb-459e-482d-8173-bebce3c3db75 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:50.317061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7c60df15-fd27-48e4-afef-c52e44ce1d0c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:50.333199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3d53cdb-459e-482d-8173-bebce3c3db75 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:50.333560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3d53cdb-459e-482d-8173-bebce3c3db75 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:50.334899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3d53cdb-459e-482d-8173-bebce3c3db75 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:50.335954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3d53cdb-459e-482d-8173-bebce3c3db75 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:50.349675 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7c60df15-fd27-48e4-afef-c52e44ce1d0c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:50.369693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7c60df15-fd27-48e4-afef-c52e44ce1d0c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:50.387024 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7c60df15-fd27-48e4-afef-c52e44ce1d0c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1568 microversion: 2.25 time: 0.955460 Jul 28 03:38:50.393679 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 402/832] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:49 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1568 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:38:50.547836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3d53cdb-459e-482d-8173-bebce3c3db75 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:50.604606 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3d53cdb-459e-482d-8173-bebce3c3db75 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 200 len: 1426 microversion: 2.1 time: 0.298873 Jul 28 03:38:50.606383 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 431/833] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:50 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 1426 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:50.796756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-541c4f65-c8eb-48b9-a4bf-fed6c36012bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:50.801924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-541c4f65-c8eb-48b9-a4bf-fed6c36012bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:50.827496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-541c4f65-c8eb-48b9-a4bf-fed6c36012bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:50.828684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-541c4f65-c8eb-48b9-a4bf-fed6c36012bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:50.830147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-541c4f65-c8eb-48b9-a4bf-fed6c36012bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:50.830889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-541c4f65-c8eb-48b9-a4bf-fed6c36012bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:51.162446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4a4a5257-da7d-4800-903c-aff601abe08c req-338a9e12-b5a5-46a2-aaa8-00cd469bd6a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b019cf-2b83-4fba-adf1-a5ffaf2faeab", "tag": "d3aac98a-25aa-4c76-8c14-3b69b36b3eb6"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:51.245609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4a4a5257-da7d-4800-903c-aff601abe08c req-338a9e12-b5a5-46a2-aaa8-00cd469bd6a5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:51.246978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4a4a5257-da7d-4800-903c-aff601abe08c req-338a9e12-b5a5-46a2-aaa8-00cd469bd6a5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:51.307649 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4a4a5257-da7d-4800-903c-aff601abe08c req-338a9e12-b5a5-46a2-aaa8-00cd469bd6a5 service nova] Creating event network-changed:d3aac98a-25aa-4c76-8c14-3b69b36b3eb6 for instance 95b019cf-2b83-4fba-adf1-a5ffaf2faeab on n-h1-826756-3 Jul 28 03:38:51.330970 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4a4a5257-da7d-4800-903c-aff601abe08c req-338a9e12-b5a5-46a2-aaa8-00cd469bd6a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175188 Jul 28 03:38:51.332407 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 432/834] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:51.358346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d100a20c-42b4-4d6e-801b-fb132ba48f76 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:51.359553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d100a20c-42b4-4d6e-801b-fb132ba48f76 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:51.397850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d100a20c-42b4-4d6e-801b-fb132ba48f76 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:51.399050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d100a20c-42b4-4d6e-801b-fb132ba48f76 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:51.404844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d100a20c-42b4-4d6e-801b-fb132ba48f76 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:51.407396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d100a20c-42b4-4d6e-801b-fb132ba48f76 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:51.803624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-541c4f65-c8eb-48b9-a4bf-fed6c36012bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:51.831807 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-541c4f65-c8eb-48b9-a4bf-fed6c36012bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1501 microversion: 2.1 time: 1.046189 Jul 28 03:38:51.833201 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 403/835] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:50 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1501 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:51.852484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dea0327c-dd16-4417-8942-b2196432cd88 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:51.853361 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dea0327c-dd16-4417-8942-b2196432cd88 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:51.863734 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dea0327c-dd16-4417-8942-b2196432cd88 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:51.864797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dea0327c-dd16-4417-8942-b2196432cd88 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:51.866855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dea0327c-dd16-4417-8942-b2196432cd88 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:51.867582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dea0327c-dd16-4417-8942-b2196432cd88 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:51.973631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:52.108299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d100a20c-42b4-4d6e-801b-fb132ba48f76 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:52.121884 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d100a20c-42b4-4d6e-801b-fb132ba48f76 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1313 microversion: 2.1 time: 0.778135 Jul 28 03:38:52.136912 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 433/836] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:51 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1313 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:52.147392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3cd29648-ed38-4ea8-ac71-a5131be9f1a8 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:52.150940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3cd29648-ed38-4ea8-ac71-a5131be9f1a8 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:52.159293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3cd29648-ed38-4ea8-ac71-a5131be9f1a8 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:52.160113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3cd29648-ed38-4ea8-ac71-a5131be9f1a8 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:52.161396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3cd29648-ed38-4ea8-ac71-a5131be9f1a8 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:52.162101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3cd29648-ed38-4ea8-ac71-a5131be9f1a8 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:52.240325 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3cd29648-ed38-4ea8-ac71-a5131be9f1a8 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101802 Jul 28 03:38:52.241127 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 434/837] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:38:52 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:52.251292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80145a75-7a3c-4498-9855-90e7586be60c tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:52.254765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-80145a75-7a3c-4498-9855-90e7586be60c tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: 4b228d20-b95a-4077-a833-0c74064590e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:52.271730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80145a75-7a3c-4498-9855-90e7586be60c tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:52.273598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80145a75-7a3c-4498-9855-90e7586be60c tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:52.276690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80145a75-7a3c-4498-9855-90e7586be60c tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:52.277694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80145a75-7a3c-4498-9855-90e7586be60c tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:52.315476 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-80145a75-7a3c-4498-9855-90e7586be60c tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] HTTP exception thrown: Instance 4b228d20-b95a-4077-a833-0c74064590e4 could not be found. Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80145a75-7a3c-4498-9855-90e7586be60c tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Request method failure captured: Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 HTTP/1.1 Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gSHcJrf_OMNV-Cc99iJWNectdxnnzrYtXrJ2wTw37yvBZFU3FIEr_BVbituBhRL7LaX8ovfny6Ry_Td-OddBHd2WGyopDXI7rz9-fI9zLrrO0KOtyqvnuaGRnDy8yUVyMpptuoH93eKUhQWqFCzWtIEF13dVUSURX0NVrk1k0f2GUM Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 391141504bc0471d932aa2799c28721c Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-391456071 Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:38:52.320843 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:38:52.323343 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/391141504bc0471d932aa2799c28721c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/391141504bc0471d932aa2799c28721c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_391141504bc0471d932aa2799c28721c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/391141504bc0471d932aa2799c28721c"}]}] Jul 28 03:38:52.323343 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersAdminNegativeTestJSON-391456071 Jul 28 03:38:52.323343 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 391141504bc0471d932aa2799c28721c Jul 28 03:38:52.323343 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-391456071 Jul 28 03:38:52.323343 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersAdminNegativeTestJSON-391456071-project Jul 28 03:38:52.323343 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:38:52.323343 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:38:52.323343 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 07f281c9665e45529130d241ea5f4a84 Jul 28 03:38:52.323343 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersAdminNegativeTestJSON-391456071-project Jul 28 03:38:52.323343 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:38:52.323343 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 4b228d20-b95a-4077-a833-0c74064590e4 could not be found. Jul 28 03:38:52.323343 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '4b228d20-b95a-4077-a833-0c74064590e4'} Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b228d20-b95a-4077-a833-0c74064590e4 could not be found. Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:38:52.324450 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b228d20-b95a-4077-a833-0c74064590e4 could not be found. Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b228d20-b95a-4077-a833-0c74064590e4 could not be found. Jul 28 03:38:52.326276 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:38:52.331261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80145a75-7a3c-4498-9855-90e7586be60c tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Returning 404 to user: Instance 4b228d20-b95a-4077-a833-0c74064590e4 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:38:52.332889 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-80145a75-7a3c-4498-9855-90e7586be60c tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4" status: 404 len: 111 microversion: 2.1 time: 0.090389 Jul 28 03:38:52.333886 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 435/838] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:52 2022] GET /compute/v2.1/servers/4b228d20-b95a-4077-a833-0c74064590e4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:38:52.365226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c9f5abb3-5fe7-49d3-8292-a295f8cd4a2a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:52.366037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c9f5abb3-5fe7-49d3-8292-a295f8cd4a2a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:52.375567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9f5abb3-5fe7-49d3-8292-a295f8cd4a2a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:52.376267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9f5abb3-5fe7-49d3-8292-a295f8cd4a2a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:52.377343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9f5abb3-5fe7-49d3-8292-a295f8cd4a2a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:52.378200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9f5abb3-5fe7-49d3-8292-a295f8cd4a2a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:52.862376 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dea0327c-dd16-4417-8942-b2196432cd88 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:52.879569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dea0327c-dd16-4417-8942-b2196432cd88 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:52.892285 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dea0327c-dd16-4417-8942-b2196432cd88 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:52.898159 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dea0327c-dd16-4417-8942-b2196432cd88 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1568 microversion: 2.25 time: 1.061060 Jul 28 03:38:52.901694 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 404/839] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:51 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1568 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:52.931265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8349c486-0696-461f-8e5c-26c89b585cd6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:52.935081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8349c486-0696-461f-8e5c-26c89b585cd6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:52.962568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8349c486-0696-461f-8e5c-26c89b585cd6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:52.964229 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8349c486-0696-461f-8e5c-26c89b585cd6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:52.967371 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8349c486-0696-461f-8e5c-26c89b585cd6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:52.968154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8349c486-0696-461f-8e5c-26c89b585cd6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:53.018846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:53.020563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-c9f5abb3-5fe7-49d3-8292-a295f8cd4a2a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lazy-loading 'services' on Instance uuid 8280d682-4608-420d-8bee-48984a6c1a01 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:38:53.024710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8349c486-0696-461f-8e5c-26c89b585cd6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:38:53.229537 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8349c486-0696-461f-8e5c-26c89b585cd6 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 204 len: 0 microversion: 2.1 time: 0.321187 Jul 28 03:38:53.230409 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 405/840] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:38:52 2022] DELETE /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:38:53.249131 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-d8d9b17f-28b6-4948-8ecd-d1c912782e6c req-f0749c94-916e-4abd-ac54-517e57a91f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291f9510-9d09-47ee-bc90-13a457673493", "name": "network-vif-unplugged", "status": "completed", "tag": "e5a92ce3-6306-4cbb-9e4b-5d834b786894"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:53.275415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-d8d9b17f-28b6-4948-8ecd-d1c912782e6c req-f0749c94-916e-4abd-ac54-517e57a91f85 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:53.276209 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-d8d9b17f-28b6-4948-8ecd-d1c912782e6c req-f0749c94-916e-4abd-ac54-517e57a91f85 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:53.339982 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-d8d9b17f-28b6-4948-8ecd-d1c912782e6c req-f0749c94-916e-4abd-ac54-517e57a91f85 service nova] Creating event network-vif-unplugged:e5a92ce3-6306-4cbb-9e4b-5d834b786894 for instance 291f9510-9d09-47ee-bc90-13a457673493 on n-h2-826756-3 Jul 28 03:38:53.357988 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-d8d9b17f-28b6-4948-8ecd-d1c912782e6c req-f0749c94-916e-4abd-ac54-517e57a91f85 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125730 Jul 28 03:38:53.359780 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 406/841] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:53.383437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-055e97cb-a9a8-414a-9ea8-86e8ff86f78d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:53.385543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-055e97cb-a9a8-414a-9ea8-86e8ff86f78d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:53.402465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-055e97cb-a9a8-414a-9ea8-86e8ff86f78d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:53.403279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-055e97cb-a9a8-414a-9ea8-86e8ff86f78d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:53.404932 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-055e97cb-a9a8-414a-9ea8-86e8ff86f78d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:53.408991 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-055e97cb-a9a8-414a-9ea8-86e8ff86f78d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:53.469891 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c9f5abb3-5fe7-49d3-8292-a295f8cd4a2a tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01/os-volume_attachments/119e5aae-a6e3-442d-aa26-ae3758503bb7" status: 202 len: 0 microversion: 2.1 time: 1.134272 Jul 28 03:38:53.472075 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 436/842] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 03:38:52 2022] DELETE /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01/os-volume_attachments/119e5aae-a6e3-442d-aa26-ae3758503bb7 => generated 0 bytes in 1137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:38:53.497499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-734e3fab-1d1f-48df-8be1-9fdacadc9048 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:53.499343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-734e3fab-1d1f-48df-8be1-9fdacadc9048 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:53.529057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-734e3fab-1d1f-48df-8be1-9fdacadc9048 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:53.529796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-734e3fab-1d1f-48df-8be1-9fdacadc9048 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:53.531477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-734e3fab-1d1f-48df-8be1-9fdacadc9048 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:53.537919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-734e3fab-1d1f-48df-8be1-9fdacadc9048 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:53.593821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:53.883372 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-055e97cb-a9a8-414a-9ea8-86e8ff86f78d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:53.904562 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-055e97cb-a9a8-414a-9ea8-86e8ff86f78d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1501 microversion: 2.1 time: 0.540376 Jul 28 03:38:53.906782 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 407/843] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:53 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1501 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:53.917087 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a863ef72-95b4-4a5f-a782-56cbe2cf26f4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:53.918423 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a863ef72-95b4-4a5f-a782-56cbe2cf26f4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:53.938310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a863ef72-95b4-4a5f-a782-56cbe2cf26f4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:53.939137 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a863ef72-95b4-4a5f-a782-56cbe2cf26f4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:53.940505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a863ef72-95b4-4a5f-a782-56cbe2cf26f4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:53.942196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a863ef72-95b4-4a5f-a782-56cbe2cf26f4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:54.130845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-734e3fab-1d1f-48df-8be1-9fdacadc9048 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:54.143395 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-734e3fab-1d1f-48df-8be1-9fdacadc9048 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1313 microversion: 2.1 time: 0.664683 Jul 28 03:38:54.144245 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 437/844] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:53 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1313 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:54.175072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-06c0091e-8141-45a6-99e4-e344feb08fb8 req-af16f3be-0cbc-44f8-91c3-7a8ed9b21584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52043e72-36dc-4a60-aaf8-f8a40ebf2f1f", "tag": "6dc794f8-4acd-49fc-8b8a-c67699e6bba0"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:54.208832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-06c0091e-8141-45a6-99e4-e344feb08fb8 req-af16f3be-0cbc-44f8-91c3-7a8ed9b21584 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:54.209528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-06c0091e-8141-45a6-99e4-e344feb08fb8 req-af16f3be-0cbc-44f8-91c3-7a8ed9b21584 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:54.276945 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-06c0091e-8141-45a6-99e4-e344feb08fb8 req-af16f3be-0cbc-44f8-91c3-7a8ed9b21584 service nova] Creating event network-changed:6dc794f8-4acd-49fc-8b8a-c67699e6bba0 for instance 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f on n-h1-826756-3 Jul 28 03:38:54.282087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=14 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:54.299190 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-06c0091e-8141-45a6-99e4-e344feb08fb8 req-af16f3be-0cbc-44f8-91c3-7a8ed9b21584 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138259 Jul 28 03:38:54.300526 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 438/845] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:54.313655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b6e1656d-5c93-4e78-ac66-0de7fee2c7c0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:54.313655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b6e1656d-5c93-4e78-ac66-0de7fee2c7c0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:54.340617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6e1656d-5c93-4e78-ac66-0de7fee2c7c0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:54.341126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6e1656d-5c93-4e78-ac66-0de7fee2c7c0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:54.342024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6e1656d-5c93-4e78-ac66-0de7fee2c7c0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:54.342476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6e1656d-5c93-4e78-ac66-0de7fee2c7c0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:54.411035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a863ef72-95b4-4a5f-a782-56cbe2cf26f4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:54.431417 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a863ef72-95b4-4a5f-a782-56cbe2cf26f4 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1477 microversion: 2.1 time: 0.523009 Jul 28 03:38:54.432795 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 408/846] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:53 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1477 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:54.945171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c133504f-939a-49c9-828b-398acffdf440 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:54.954403 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c133504f-939a-49c9-828b-398acffdf440 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:54.964013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c133504f-939a-49c9-828b-398acffdf440 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:54.964798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c133504f-939a-49c9-828b-398acffdf440 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:54.965817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c133504f-939a-49c9-828b-398acffdf440 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:54.966464 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c133504f-939a-49c9-828b-398acffdf440 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:55.457541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b6e1656d-5c93-4e78-ac66-0de7fee2c7c0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:55.473957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b6e1656d-5c93-4e78-ac66-0de7fee2c7c0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:55.498244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b6e1656d-5c93-4e78-ac66-0de7fee2c7c0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:55.502516 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b6e1656d-5c93-4e78-ac66-0de7fee2c7c0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1568 microversion: 2.25 time: 1.200596 Jul 28 03:38:55.524939 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 439/847] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:54 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1568 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:55.539116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ef09cd27-d2af-4c3b-8626-2abb21e77639 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:55.540939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ef09cd27-d2af-4c3b-8626-2abb21e77639 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:55.548892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef09cd27-d2af-4c3b-8626-2abb21e77639 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:55.549735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef09cd27-d2af-4c3b-8626-2abb21e77639 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:55.550824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef09cd27-d2af-4c3b-8626-2abb21e77639 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:55.551483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef09cd27-d2af-4c3b-8626-2abb21e77639 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:56.088700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ef09cd27-d2af-4c3b-8626-2abb21e77639 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:56.097856 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ef09cd27-d2af-4c3b-8626-2abb21e77639 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1313 microversion: 2.1 time: 0.571232 Jul 28 03:38:56.110720 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 440/848] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:55 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:56.122724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4aa11823-3908-4f31-aeed-8a42133058d5 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:56.123750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4aa11823-3908-4f31-aeed-8a42133058d5 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:56.138186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4aa11823-3908-4f31-aeed-8a42133058d5 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:56.139061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4aa11823-3908-4f31-aeed-8a42133058d5 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:56.141117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4aa11823-3908-4f31-aeed-8a42133058d5 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:56.143798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4aa11823-3908-4f31-aeed-8a42133058d5 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:56.836531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4aa11823-3908-4f31-aeed-8a42133058d5 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:56.850653 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4aa11823-3908-4f31-aeed-8a42133058d5 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1477 microversion: 2.1 time: 0.738213 Jul 28 03:38:56.855508 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 441/849] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:56 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1477 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:56.870680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-75e5d7ff-d0b1-43d5-a8d4-ffd5d6694eea req-136f8a08-5a81-4281-9c47-487dabe67453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4b8ffa-dbe6-4e90-a8f5-728addf73aae", "name": "network-vif-plugged", "status": "completed", "tag": "3931df07-76f1-4feb-a179-d48d42b61b21"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:56.889984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-75e5d7ff-d0b1-43d5-a8d4-ffd5d6694eea req-136f8a08-5a81-4281-9c47-487dabe67453 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:56.890786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-75e5d7ff-d0b1-43d5-a8d4-ffd5d6694eea req-136f8a08-5a81-4281-9c47-487dabe67453 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:56.912522 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-75e5d7ff-d0b1-43d5-a8d4-ffd5d6694eea req-136f8a08-5a81-4281-9c47-487dabe67453 service nova] Creating event network-vif-plugged:3931df07-76f1-4feb-a179-d48d42b61b21 for instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae on n-h2-826756-3 Jul 28 03:38:56.927549 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-75e5d7ff-d0b1-43d5-a8d4-ffd5d6694eea req-136f8a08-5a81-4281-9c47-487dabe67453 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061542 Jul 28 03:38:56.929583 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 442/850] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:56.955628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-189cc82c-e39e-464f-93af-b65338b762d7 req-b0e7d164-fa14-42c9-9e95-b2aff4bafed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24", "name": "network-vif-unplugged", "status": "completed", "tag": "341becb1-9ad4-4e21-893d-15bc21d8044e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:56.971103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-189cc82c-e39e-464f-93af-b65338b762d7 req-b0e7d164-fa14-42c9-9e95-b2aff4bafed6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:56.972076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-189cc82c-e39e-464f-93af-b65338b762d7 req-b0e7d164-fa14-42c9-9e95-b2aff4bafed6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:56.991627 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-189cc82c-e39e-464f-93af-b65338b762d7 req-b0e7d164-fa14-42c9-9e95-b2aff4bafed6 service nova] Creating event network-vif-unplugged:341becb1-9ad4-4e21-893d-15bc21d8044e for instance fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 on n-h1-826756-3 Jul 28 03:38:56.998044 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-189cc82c-e39e-464f-93af-b65338b762d7 req-b0e7d164-fa14-42c9-9e95-b2aff4bafed6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057787 Jul 28 03:38:56.999433 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 443/851] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:57.007698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d14d8976-2988-4829-85c8-d5075c25a448 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:57.008963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d14d8976-2988-4829-85c8-d5075c25a448 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:57.021129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d14d8976-2988-4829-85c8-d5075c25a448 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:57.023082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d14d8976-2988-4829-85c8-d5075c25a448 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:57.027166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d14d8976-2988-4829-85c8-d5075c25a448 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:57.028804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d14d8976-2988-4829-85c8-d5075c25a448 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:57.081114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c133504f-939a-49c9-828b-398acffdf440 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:57.100161 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c133504f-939a-49c9-828b-398acffdf440 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1501 microversion: 2.1 time: 2.165253 Jul 28 03:38:57.102825 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 409/852] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:54 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1501 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:57.141005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3640a4b5-42e7-42ec-8d6a-14204dd7314b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:57.142858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3640a4b5-42e7-42ec-8d6a-14204dd7314b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:57.161394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:57.167394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3640a4b5-42e7-42ec-8d6a-14204dd7314b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:57.169113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3640a4b5-42e7-42ec-8d6a-14204dd7314b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:57.171411 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3640a4b5-42e7-42ec-8d6a-14204dd7314b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:57.173713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3640a4b5-42e7-42ec-8d6a-14204dd7314b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:57.509739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d14d8976-2988-4829-85c8-d5075c25a448 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:57.530292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d14d8976-2988-4829-85c8-d5075c25a448 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:57.532234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d14d8976-2988-4829-85c8-d5075c25a448 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:57.533739 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d14d8976-2988-4829-85c8-d5075c25a448 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1568 microversion: 2.25 time: 0.532558 Jul 28 03:38:57.534527 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 444/853] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:56 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1568 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:57.882089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f94fceac-baea-48bd-8c8c-6799bc22a011 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:57.884266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f94fceac-baea-48bd-8c8c-6799bc22a011 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:57.903200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f94fceac-baea-48bd-8c8c-6799bc22a011 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:57.905267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f94fceac-baea-48bd-8c8c-6799bc22a011 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:57.909777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f94fceac-baea-48bd-8c8c-6799bc22a011 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:57.914231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f94fceac-baea-48bd-8c8c-6799bc22a011 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:58.124380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f94fceac-baea-48bd-8c8c-6799bc22a011 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07f281c9665e45529130d241ea5f4a84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391141504bc0471d932aa2799c28721c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:58.137029 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f94fceac-baea-48bd-8c8c-6799bc22a011 tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 200 len: 1435 microversion: 2.1 time: 0.255983 Jul 28 03:38:58.154253 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 445/854] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:57 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 1435 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:38:58.160260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3f28237d-4970-45cc-acff-e98206d31829 req-f247677d-6725-4d7f-874f-a2cb4b7389f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33dc7b6-d97c-4973-b4a3-e576cddcdbb6", "name": "network-vif-deleted", "tag": "8c5f10b9-7997-49b9-9d60-54f589aacd7d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:58.185999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3f28237d-4970-45cc-acff-e98206d31829 req-f247677d-6725-4d7f-874f-a2cb4b7389f4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:58.192732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3f28237d-4970-45cc-acff-e98206d31829 req-f247677d-6725-4d7f-874f-a2cb4b7389f4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:58.220332 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3f28237d-4970-45cc-acff-e98206d31829 req-f247677d-6725-4d7f-874f-a2cb4b7389f4 service nova] Creating event network-vif-deleted:8c5f10b9-7997-49b9-9d60-54f589aacd7d for instance a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 on n-h1-826756-3 Jul 28 03:38:58.235144 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3f28237d-4970-45cc-acff-e98206d31829 req-f247677d-6725-4d7f-874f-a2cb4b7389f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077047 Jul 28 03:38:58.252021 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 446/855] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:58.266043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed202341-562d-474f-b2ec-f89f55d14ce1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:58.267015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed202341-562d-474f-b2ec-f89f55d14ce1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:58.282356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed202341-562d-474f-b2ec-f89f55d14ce1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:58.294503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed202341-562d-474f-b2ec-f89f55d14ce1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:58.296293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed202341-562d-474f-b2ec-f89f55d14ce1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:58.297311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed202341-562d-474f-b2ec-f89f55d14ce1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:58.720260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed202341-562d-474f-b2ec-f89f55d14ce1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:58.739732 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed202341-562d-474f-b2ec-f89f55d14ce1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1501 microversion: 2.1 time: 0.485954 Jul 28 03:38:58.769960 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 447/856] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:58 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1501 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:58.790190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b70035b0-d911-466e-8b35-3bf92c440663 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:58.791153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b70035b0-d911-466e-8b35-3bf92c440663 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:58.803219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b70035b0-d911-466e-8b35-3bf92c440663 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:58.805681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b70035b0-d911-466e-8b35-3bf92c440663 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:58.806781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b70035b0-d911-466e-8b35-3bf92c440663 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:58.808840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b70035b0-d911-466e-8b35-3bf92c440663 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:58.890716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3640a4b5-42e7-42ec-8d6a-14204dd7314b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:58.906360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:38:58.915209 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3640a4b5-42e7-42ec-8d6a-14204dd7314b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1313 microversion: 2.1 time: 1.783212 Jul 28 03:38:58.928565 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 410/857] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:57 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1313 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:38:59.143658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b70035b0-d911-466e-8b35-3bf92c440663 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:59.169613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a3b07e6f-a8e7-4ffa-a60a-d904a0be259b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:59.187708 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a3b07e6f-a8e7-4ffa-a60a-d904a0be259b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] [instance: a33dc7b6-d97c-4973-b4a3-e576cddcdbb6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:59.203199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b70035b0-d911-466e-8b35-3bf92c440663 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:59.225157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b70035b0-d911-466e-8b35-3bf92c440663 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:38:59.238117 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b70035b0-d911-466e-8b35-3bf92c440663 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1568 microversion: 2.25 time: 0.457746 Jul 28 03:38:59.239708 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3b07e6f-a8e7-4ffa-a60a-d904a0be259b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:59.244280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3b07e6f-a8e7-4ffa-a60a-d904a0be259b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:59.244753 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 448/858] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:38:58 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1568 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:38:59.250474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3b07e6f-a8e7-4ffa-a60a-d904a0be259b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:59.253889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3b07e6f-a8e7-4ffa-a60a-d904a0be259b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:59.266140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-973bbffd-afe6-441d-b53e-78088d3e0ae9 req-c32eeff6-82e3-46b7-9867-a5b65cbe69ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24", "tag": "341becb1-9ad4-4e21-893d-15bc21d8044e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:38:59.339845 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-a3b07e6f-a8e7-4ffa-a60a-d904a0be259b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] HTTP exception thrown: Instance a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 could not be found. Jul 28 03:38:59.361601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-973bbffd-afe6-441d-b53e-78088d3e0ae9 req-c32eeff6-82e3-46b7-9867-a5b65cbe69ab service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a3b07e6f-a8e7-4ffa-a60a-d904a0be259b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Request method failure captured: Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 HTTP/1.1 Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gSHcJrf_OMNV-Cc99iJWNectdxnnzrYtXrJ2wTw37yvBZFU3FIEr_BVbituBhRL7LaX8ovfny6Ry_Td-OddBHd2WGyopDXI7rz9-fI9zLrrO0KOtyqvnuaGRnDy8yUVyMpptuoH93eKUhQWqFCzWtIEF13dVUSURX0NVrk1k0f2GUM Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 391141504bc0471d932aa2799c28721c Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-391456071 Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:38:59.362535 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:38:59.364097 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/391141504bc0471d932aa2799c28721c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/391141504bc0471d932aa2799c28721c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_391141504bc0471d932aa2799c28721c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/391141504bc0471d932aa2799c28721c"}]}] Jul 28 03:38:59.364097 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersAdminNegativeTestJSON-391456071 Jul 28 03:38:59.364097 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 391141504bc0471d932aa2799c28721c Jul 28 03:38:59.364097 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-391456071 Jul 28 03:38:59.364097 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersAdminNegativeTestJSON-391456071-project Jul 28 03:38:59.364097 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:38:59.364097 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:38:59.364097 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 07f281c9665e45529130d241ea5f4a84 Jul 28 03:38:59.364097 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersAdminNegativeTestJSON-391456071-project Jul 28 03:38:59.364097 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:38:59.364097 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 could not be found. Jul 28 03:38:59.364097 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'a33dc7b6-d97c-4973-b4a3-e576cddcdbb6'} Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 could not be found. Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:38:59.365098 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 could not be found. Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 could not be found. Jul 28 03:38:59.366549 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:38:59.368198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-973bbffd-afe6-441d-b53e-78088d3e0ae9 req-c32eeff6-82e3-46b7-9867-a5b65cbe69ab service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:59.376031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a3b07e6f-a8e7-4ffa-a60a-d904a0be259b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] Returning 404 to user: Instance a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:38:59.379435 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a3b07e6f-a8e7-4ffa-a60a-d904a0be259b tempest-ServersAdminNegativeTestJSON-391456071 tempest-ServersAdminNegativeTestJSON-391456071-project] 10.222.0.48 "GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6" status: 404 len: 111 microversion: 2.1 time: 0.221537 Jul 28 03:38:59.383237 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 411/859] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:59 2022] GET /compute/v2.1/servers/a33dc7b6-d97c-4973-b4a3-e576cddcdbb6 => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:38:59.396989 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-973bbffd-afe6-441d-b53e-78088d3e0ae9 req-c32eeff6-82e3-46b7-9867-a5b65cbe69ab service nova] Creating event network-changed:341becb1-9ad4-4e21-893d-15bc21d8044e for instance fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 on n-h1-826756-3 Jul 28 03:38:59.413863 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-973bbffd-afe6-441d-b53e-78088d3e0ae9 req-c32eeff6-82e3-46b7-9867-a5b65cbe69ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167074 Jul 28 03:38:59.415052 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 449/860] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:38:59.779037 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5d0d3f68-b294-45f2-a565-176bd40d60ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:59.780094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5d0d3f68-b294-45f2-a565-176bd40d60ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:59.796395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d0d3f68-b294-45f2-a565-176bd40d60ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:59.799975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d0d3f68-b294-45f2-a565-176bd40d60ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:59.802462 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d0d3f68-b294-45f2-a565-176bd40d60ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:59.805824 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d0d3f68-b294-45f2-a565-176bd40d60ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:59.937133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-750cfb56-9287-4995-9ba4-cd7e992f4272 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:38:59.938030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-750cfb56-9287-4995-9ba4-cd7e992f4272 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:38:59.966921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-750cfb56-9287-4995-9ba4-cd7e992f4272 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:59.967297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-750cfb56-9287-4995-9ba4-cd7e992f4272 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:38:59.979801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-750cfb56-9287-4995-9ba4-cd7e992f4272 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:38:59.982771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-750cfb56-9287-4995-9ba4-cd7e992f4272 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:00.478393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5d0d3f68-b294-45f2-a565-176bd40d60ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:00.503372 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5d0d3f68-b294-45f2-a565-176bd40d60ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1501 microversion: 2.1 time: 0.728657 Jul 28 03:39:00.504385 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 412/861] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:59 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1501 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:00.570092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8133651a-5c62-4a92-b64e-afa3805e9ca3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:00.572135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8133651a-5c62-4a92-b64e-afa3805e9ca3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:00.610831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8133651a-5c62-4a92-b64e-afa3805e9ca3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:00.617125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8133651a-5c62-4a92-b64e-afa3805e9ca3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:00.620918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8133651a-5c62-4a92-b64e-afa3805e9ca3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:00.624229 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8133651a-5c62-4a92-b64e-afa3805e9ca3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:01.535029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8133651a-5c62-4a92-b64e-afa3805e9ca3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:01.556175 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8133651a-5c62-4a92-b64e-afa3805e9ca3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:01.567250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8133651a-5c62-4a92-b64e-afa3805e9ca3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:01.573896 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8133651a-5c62-4a92-b64e-afa3805e9ca3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1568 microversion: 2.25 time: 1.036294 Jul 28 03:39:01.581033 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 413/862] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:39:00 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1568 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:01.603027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-22bdf383-d02d-424e-9161-49083e6d6dc5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:01.604100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-22bdf383-d02d-424e-9161-49083e6d6dc5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:01.618549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22bdf383-d02d-424e-9161-49083e6d6dc5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:01.619476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22bdf383-d02d-424e-9161-49083e6d6dc5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:01.623143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22bdf383-d02d-424e-9161-49083e6d6dc5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:01.624109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22bdf383-d02d-424e-9161-49083e6d6dc5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:01.728010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-750cfb56-9287-4995-9ba4-cd7e992f4272 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:01.747838 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-750cfb56-9287-4995-9ba4-cd7e992f4272 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1313 microversion: 2.1 time: 1.815673 Jul 28 03:39:01.750306 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 450/863] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:38:59 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1313 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:02.443717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-22bdf383-d02d-424e-9161-49083e6d6dc5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:02.478346 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-22bdf383-d02d-424e-9161-49083e6d6dc5 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1501 microversion: 2.1 time: 0.886956 Jul 28 03:39:02.482177 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 414/864] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:01 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1501 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:02.603624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-feb8ea66-5dff-4ca1-980b-5a8063bf4725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:02.604673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-feb8ea66-5dff-4ca1-980b-5a8063bf4725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:02.615004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb8ea66-5dff-4ca1-980b-5a8063bf4725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:02.635654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb8ea66-5dff-4ca1-980b-5a8063bf4725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:02.640387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb8ea66-5dff-4ca1-980b-5a8063bf4725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:02.643184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb8ea66-5dff-4ca1-980b-5a8063bf4725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:02.781023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-964f93e9-f0f4-46ce-92bb-85d8bbd87c7b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:02.786976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-964f93e9-f0f4-46ce-92bb-85d8bbd87c7b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:02.814792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-964f93e9-f0f4-46ce-92bb-85d8bbd87c7b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:02.824253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-964f93e9-f0f4-46ce-92bb-85d8bbd87c7b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:02.830395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-964f93e9-f0f4-46ce-92bb-85d8bbd87c7b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:02.837329 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-964f93e9-f0f4-46ce-92bb-85d8bbd87c7b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:03.508450 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-964f93e9-f0f4-46ce-92bb-85d8bbd87c7b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:03.520142 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-964f93e9-f0f4-46ce-92bb-85d8bbd87c7b tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1313 microversion: 2.1 time: 0.749768 Jul 28 03:39:03.521401 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 415/865] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:02 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1313 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:03.526641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ad3f1247-f951-412a-a7e4-1a47b6f7ef51 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:03.527537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ad3f1247-f951-412a-a7e4-1a47b6f7ef51 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:03.534375 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad3f1247-f951-412a-a7e4-1a47b6f7ef51 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:03.535097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad3f1247-f951-412a-a7e4-1a47b6f7ef51 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:03.536199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad3f1247-f951-412a-a7e4-1a47b6f7ef51 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:03.536819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad3f1247-f951-412a-a7e4-1a47b6f7ef51 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:03.981397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ad3f1247-f951-412a-a7e4-1a47b6f7ef51 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:03.998024 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ad3f1247-f951-412a-a7e4-1a47b6f7ef51 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1501 microversion: 2.1 time: 0.475036 Jul 28 03:39:03.998949 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 416/866] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:03 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1501 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:04.261381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-feb8ea66-5dff-4ca1-980b-5a8063bf4725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:04.289335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-feb8ea66-5dff-4ca1-980b-5a8063bf4725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:04.302696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-feb8ea66-5dff-4ca1-980b-5a8063bf4725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:04.304505 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-feb8ea66-5dff-4ca1-980b-5a8063bf4725 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1543 microversion: 2.25 time: 1.705036 Jul 28 03:39:04.309316 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 451/867] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:39:02 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1543 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:04.333143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ecb22c20-0d26-44a3-9fc4-8a64a220a454 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '.version_select at 0x7ffa749bed30>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:04.346924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ecb22c20-0d26-44a3-9fc4-8a64a220a454 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:04.350873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ecb22c20-0d26-44a3-9fc4-8a64a220a454 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:04.395230 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ecb22c20-0d26-44a3-9fc4-8a64a220a454 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 2184 microversion: 2.25 time: 0.066507 Jul 28 03:39:04.395860 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 417/868] 10.222.0.48 () {60 vars in 1184 bytes} [Thu Jul 28 03:39:04 2022] GET /compute/v2.1/os-migrations => generated 2184 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:04.417124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0a45cca3-dc7d-4a66-a4dc-3754d3233e48 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:04.418671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0a45cca3-dc7d-4a66-a4dc-3754d3233e48 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:04.433521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a45cca3-dc7d-4a66-a4dc-3754d3233e48 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:04.434304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a45cca3-dc7d-4a66-a4dc-3754d3233e48 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:04.435278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a45cca3-dc7d-4a66-a4dc-3754d3233e48 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:04.435868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a45cca3-dc7d-4a66-a4dc-3754d3233e48 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:04.547264 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-05dab020-8495-49f4-8d5b-5f343372da89 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:04.547943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-05dab020-8495-49f4-8d5b-5f343372da89 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:04.579360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-05dab020-8495-49f4-8d5b-5f343372da89 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:04.594923 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-05dab020-8495-49f4-8d5b-5f343372da89 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:04.594923 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-05dab020-8495-49f4-8d5b-5f343372da89 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:04.594923 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-05dab020-8495-49f4-8d5b-5f343372da89 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:05.136533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-05dab020-8495-49f4-8d5b-5f343372da89 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:05.153897 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-05dab020-8495-49f4-8d5b-5f343372da89 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1313 microversion: 2.1 time: 0.605337 Jul 28 03:39:05.157299 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 418/869] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:04 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:05.170197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-5167f73d-d963-469b-95bf-8a016fef2a58 req-fe8f1b06-5184-4d6f-a377-ec80cffb8a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b019cf-2b83-4fba-adf1-a5ffaf2faeab", "name": "network-vif-plugged", "status": "completed", "tag": "d3aac98a-25aa-4c76-8c14-3b69b36b3eb6"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:05.189150 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5167f73d-d963-469b-95bf-8a016fef2a58 req-fe8f1b06-5184-4d6f-a377-ec80cffb8a17 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:05.190000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5167f73d-d963-469b-95bf-8a016fef2a58 req-fe8f1b06-5184-4d6f-a377-ec80cffb8a17 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:05.227830 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-5167f73d-d963-469b-95bf-8a016fef2a58 req-fe8f1b06-5184-4d6f-a377-ec80cffb8a17 service nova] Creating event network-vif-plugged:d3aac98a-25aa-4c76-8c14-3b69b36b3eb6 for instance 95b019cf-2b83-4fba-adf1-a5ffaf2faeab on n-h1-826756-3 Jul 28 03:39:05.236398 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-5167f73d-d963-469b-95bf-8a016fef2a58 req-fe8f1b06-5184-4d6f-a377-ec80cffb8a17 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077063 Jul 28 03:39:05.253444 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 419/870] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:05.295901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a86c0298-526c-480a-a340-8d5a4fc2c6ed tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:05.296653 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a86c0298-526c-480a-a340-8d5a4fc2c6ed tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:05.326555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a86c0298-526c-480a-a340-8d5a4fc2c6ed tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:05.327000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a86c0298-526c-480a-a340-8d5a4fc2c6ed tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:05.327849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a86c0298-526c-480a-a340-8d5a4fc2c6ed tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:05.328208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a86c0298-526c-480a-a340-8d5a4fc2c6ed tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:05.377619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-0a45cca3-dc7d-4a66-a4dc-3754d3233e48 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid 291f9510-9d09-47ee-bc90-13a457673493 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:39:05.446592 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0a45cca3-dc7d-4a66-a4dc-3754d3233e48 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 2035 microversion: 2.25 time: 1.035382 Jul 28 03:39:05.447209 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 452/871] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:39:04 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 2035 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:05.461598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-17960555-a145-4268-9d61-54787b060210 req-61b27dba-871e-48db-81ea-aa5f8016e0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24", "name": "network-vif-unplugged", "status": "completed", "tag": "341becb1-9ad4-4e21-893d-15bc21d8044e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:05.513823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-17960555-a145-4268-9d61-54787b060210 req-61b27dba-871e-48db-81ea-aa5f8016e0f0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:05.522494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-17960555-a145-4268-9d61-54787b060210 req-61b27dba-871e-48db-81ea-aa5f8016e0f0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:05.575202 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-17960555-a145-4268-9d61-54787b060210 req-61b27dba-871e-48db-81ea-aa5f8016e0f0 service nova] Creating event network-vif-unplugged:341becb1-9ad4-4e21-893d-15bc21d8044e for instance fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 on n-h1-826756-3 Jul 28 03:39:05.605259 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-17960555-a145-4268-9d61-54787b060210 req-61b27dba-871e-48db-81ea-aa5f8016e0f0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151855 Jul 28 03:39:05.607031 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 453/872] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:05.639396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2547505d-937b-4609-82f4-f684fd6411d0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Action: 'create', calling method: .version_select at 0x7ffa74654dc0>, body: {"keypair": {"name": "tempest-keypair-1659129971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKjPPXbleIikBTUe1XBa8FCZpi2CHGJIrf7M0KKrhcNPQx+cjaixsqdEtiOYZEfbzI/cQV49PEVBS6aD6q+1K2oYxX24lYPrL/5rmGzx77wWPj5vFMSv4uJRmCA/Sz8lA=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:05.719127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2547505d-937b-4609-82f4-f684fd6411d0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Getting quotas for project 881125b6bb84430fb4f2e0c6ebf79983. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:39:05.751638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2547505d-937b-4609-82f4-f684fd6411d0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Getting quotas for user c2e3c37253bc408682e9a15c3b5a85ab and project 881125b6bb84430fb4f2e0c6ebf79983. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:39:05.816012 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2547505d-937b-4609-82f4-f684fd6411d0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.206237 Jul 28 03:39:05.819672 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 454/873] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Jul 28 03:39:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 210 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 03:39:05.855499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a86c0298-526c-480a-a340-8d5a4fc2c6ed tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:05.869466 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a86c0298-526c-480a-a340-8d5a4fc2c6ed tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1501 microversion: 2.1 time: 0.611616 Jul 28 03:39:05.874516 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 420/874] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:05 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1501 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:06.198718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abcf04a8-cff1-42c4-930d-23efdda46bed tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:06.201090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-abcf04a8-cff1-42c4-930d-23efdda46bed tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:06.244716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abcf04a8-cff1-42c4-930d-23efdda46bed tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:06.245492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abcf04a8-cff1-42c4-930d-23efdda46bed tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:06.246495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abcf04a8-cff1-42c4-930d-23efdda46bed tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:06.249468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abcf04a8-cff1-42c4-930d-23efdda46bed tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:06.506244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39d520d1-be33-471f-9b56-0f10b5edb561 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:06.509315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-39d520d1-be33-471f-9b56-0f10b5edb561 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:06.526753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39d520d1-be33-471f-9b56-0f10b5edb561 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:06.527595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39d520d1-be33-471f-9b56-0f10b5edb561 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:06.528696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39d520d1-be33-471f-9b56-0f10b5edb561 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:06.531684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39d520d1-be33-471f-9b56-0f10b5edb561 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:06.623508 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-39d520d1-be33-471f-9b56-0f10b5edb561 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122370 Jul 28 03:39:06.628932 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 421/875] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:39:06 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:39:06.676928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-abcf04a8-cff1-42c4-930d-23efdda46bed tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:06.687223 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-abcf04a8-cff1-42c4-930d-23efdda46bed tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1313 microversion: 2.1 time: 0.498362 Jul 28 03:39:06.701023 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 455/876] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:06 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1313 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:06.819495 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7efacc2d-69ff-4887-92b5-e33a3df64f5b tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:06.822724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7efacc2d-69ff-4887-92b5-e33a3df64f5b tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:06.856995 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7efacc2d-69ff-4887-92b5-e33a3df64f5b tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:06.861448 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7efacc2d-69ff-4887-92b5-e33a3df64f5b tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:06.882054 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7efacc2d-69ff-4887-92b5-e33a3df64f5b tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:06.885972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7efacc2d-69ff-4887-92b5-e33a3df64f5b tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:06.983094 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7efacc2d-69ff-4887-92b5-e33a3df64f5b tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.169202 Jul 28 03:39:06.987472 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 422/877] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:39:06 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01/os-volume_attachments => generated 25 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:39:07.009762 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c2ffa132-aec4-4960-ac29-eabd15a892ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:07.019951 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c2ffa132-aec4-4960-ac29-eabd15a892ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:07.049782 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2ffa132-aec4-4960-ac29-eabd15a892ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:07.050545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2ffa132-aec4-4960-ac29-eabd15a892ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:07.051529 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2ffa132-aec4-4960-ac29-eabd15a892ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:07.059065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2ffa132-aec4-4960-ac29-eabd15a892ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:07.228293 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6b1676a1-3978-471c-84a0-af736cf87f39 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] 10.222.0.48 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.375864 Jul 28 03:39:07.232229 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 456/878] 10.222.0.48 () {58 vars in 1128 bytes} [Thu Jul 28 03:39:06 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 03:39:07.248584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d0defb3-f386-4110-891a-d601e131297c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:07.248953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5d0defb3-f386-4110-891a-d601e131297c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:07.266105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d0defb3-f386-4110-891a-d601e131297c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:07.270734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d0defb3-f386-4110-891a-d601e131297c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:07.273287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d0defb3-f386-4110-891a-d601e131297c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:07.275396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d0defb3-f386-4110-891a-d601e131297c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:07.375057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5d0defb3-f386-4110-891a-d601e131297c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:39:07.429138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:07.517048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:07.552113 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5d0defb3-f386-4110-891a-d601e131297c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 204 len: 0 microversion: 2.1 time: 0.321598 Jul 28 03:39:07.556716 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 457/879] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:39:07 2022] DELETE /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:39:07.564208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-04656e77-ca9e-4e32-adcf-97d3ccb1d394 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Calling method '.version_select at 0x7ffa745b1d30>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:07.653528 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-04656e77-ca9e-4e32-adcf-97d3ccb1d394 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] HTTP exception thrown: Image not found. Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-04656e77-ca9e-4e32-adcf-97d3ccb1d394 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Request method failure captured: Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gTab0AU0lJuhb-37tzq1_xinXCD1XajlTdpSWKJlfpoBY3p8KkfqZQzwqD5EZSR0tMWEH4H13AW9Y6v9adUV7qlKQ4q_VWvNWJg1LEpl-4kEiSc3Eu1k2BT2BtpD68nQuCbw35Yuo8cqv6CcRWLYomtf_hrRYF4THXsg80FCAWm85A Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 6647ea99fb0f472dab0ce5b9e703d125 Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:07.673107 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:07.674712 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6647ea99fb0f472dab0ce5b9e703d125"}]}] Jul 28 03:39:07.674712 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:07.674712 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 6647ea99fb0f472dab0ce5b9e703d125 Jul 28 03:39:07.674712 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:07.674712 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesDeleteNegativeTestJSON-2041455143-project Jul 28 03:39:07.674712 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:07.674712 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:07.674712 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a19750399aee48779d82c3e97bf8613c Jul 28 03:39:07.674712 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143-project Jul 28 03:39:07.674712 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:39:07.674712 n-d-826756-3 devstack@n-api.service[126071]: exception: Image not found. Jul 28 03:39:07.674712 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '-1'} Jul 28 03:39:07.674712 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:07.674712 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:07.676505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:07.680129 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 03:39:07.681676 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:39:07.681676 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:39:07.681676 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:07.681676 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:07.681676 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:07.681676 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:07.681676 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:07.681676 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:07.681676 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:07.681676 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:07.681676 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:39:07.681676 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:07.684124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-04656e77-ca9e-4e32-adcf-97d3ccb1d394 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Returning 404 to user: Image not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:07.685242 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-04656e77-ca9e-4e32-adcf-97d3ccb1d394 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] 10.222.0.48 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.131066 Jul 28 03:39:07.686045 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 458/880] 10.222.0.48 () {58 vars in 1134 bytes} [Thu Jul 28 03:39:07 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:39:07.697789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c29d9fe9-49c4-46c2-bb74-7d6240b4d8b9 req-de7deb54-0864-4b19-820b-4cc3d2e7deeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52043e72-36dc-4a60-aaf8-f8a40ebf2f1f", "name": "network-vif-plugged", "status": "completed", "tag": "6dc794f8-4acd-49fc-8b8a-c67699e6bba0"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:07.712640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c29d9fe9-49c4-46c2-bb74-7d6240b4d8b9 req-de7deb54-0864-4b19-820b-4cc3d2e7deeb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:07.714990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c29d9fe9-49c4-46c2-bb74-7d6240b4d8b9 req-de7deb54-0864-4b19-820b-4cc3d2e7deeb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:07.747753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c2ffa132-aec4-4960-ac29-eabd15a892ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:07.768185 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c2ffa132-aec4-4960-ac29-eabd15a892ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1501 microversion: 2.1 time: 0.778951 Jul 28 03:39:07.775438 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 423/881] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:06 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1501 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:07.781181 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c29d9fe9-49c4-46c2-bb74-7d6240b4d8b9 req-de7deb54-0864-4b19-820b-4cc3d2e7deeb service nova] Creating event network-vif-plugged:6dc794f8-4acd-49fc-8b8a-c67699e6bba0 for instance 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f on n-h1-826756-3 Jul 28 03:39:07.799713 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c29d9fe9-49c4-46c2-bb74-7d6240b4d8b9 req-de7deb54-0864-4b19-820b-4cc3d2e7deeb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111097 Jul 28 03:39:07.801222 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 459/882] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:07.809832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6c5d84f7-dc6d-4fd0-be31-3588773529f7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:07.810549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6c5d84f7-dc6d-4fd0-be31-3588773529f7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:07.822543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c5d84f7-dc6d-4fd0-be31-3588773529f7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:07.823678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c5d84f7-dc6d-4fd0-be31-3588773529f7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:07.824788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c5d84f7-dc6d-4fd0-be31-3588773529f7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:07.825384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c5d84f7-dc6d-4fd0-be31-3588773529f7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:07.982488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3cb2bb4c-cf41-4ba8-8614-0b775fa6326c tempest-FloatingIPDetailsNegativeTestJSON-1833721741 tempest-FloatingIPDetailsNegativeTestJSON-1833721741-project] Calling method '.version_select at 0x7ffa74a2e0d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:08.248509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG neutronclient.v2_0.client [None req-3cb2bb4c-cf41-4ba8-8614-0b775fa6326c tempest-FloatingIPDetailsNegativeTestJSON-1833721741 tempest-FloatingIPDetailsNegativeTestJSON-1833721741-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 55919983-ea3e-4032-bf99-8fe95d165a35 could not be found", "detail": ""}} {{(pid=126072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:39:08.249240 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-3cb2bb4c-cf41-4ba8-8614-0b775fa6326c tempest-FloatingIPDetailsNegativeTestJSON-1833721741 tempest-FloatingIPDetailsNegativeTestJSON-1833721741-project] HTTP exception thrown: Floating IP not found for ID 55919983-ea3e-4032-bf99-8fe95d165a35 Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3cb2bb4c-cf41-4ba8-8614-0b775fa6326c tempest-FloatingIPDetailsNegativeTestJSON-1833721741 tempest-FloatingIPDetailsNegativeTestJSON-1833721741-project] Request method failure captured: Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-floating-ips/55919983-ea3e-4032-bf99-8fe95d165a35 HTTP/1.1 Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gTbtgSku1TTbhHglvv33Qfi6kVN-Lz2-SIFOEgHQR46dfEQu0Sgkg7q_65YUzyq1JsfvL92rRGFACX4qOD6eDK_Ccq2NpWsAQ_6Pior9zJcogHfXCv-2Met3WPE9k6wbyFHjakvyZgGo3_hfGZtbIlFPPDAzr7ohmz79WC26XwlMO0 Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: b47bdcdb036f4de7b0acccebcf73840b Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1833721741 Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:39:08.256132 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:39:08.259032 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b47bdcdb036f4de7b0acccebcf73840b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b47bdcdb036f4de7b0acccebcf73840b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b47bdcdb036f4de7b0acccebcf73840b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b47bdcdb036f4de7b0acccebcf73840b"}]}] Jul 28 03:39:08.259032 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1833721741 Jul 28 03:39:08.259032 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: b47bdcdb036f4de7b0acccebcf73840b Jul 28 03:39:08.259032 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1833721741 Jul 28 03:39:08.259032 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1833721741-project Jul 28 03:39:08.259032 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:39:08.259032 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:39:08.259032 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 1afcccc5fc8948239793a33ff7b58116 Jul 28 03:39:08.259032 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1833721741-project Jul 28 03:39:08.259032 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:39:08.259032 n-d-826756-3 devstack@n-api.service[126072]: exception: Floating IP not found for ID 55919983-ea3e-4032-bf99-8fe95d165a35 Jul 28 03:39:08.259032 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '55919983-ea3e-4032-bf99-8fe95d165a35'} Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:39:08.260732 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 55919983-ea3e-4032-bf99-8fe95d165a35 could not be found Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e6c59b1-4c4a-4273-888f-55b0497336f4'] Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 55919983-ea3e-4032-bf99-8fe95d165a35. Jul 28 03:39:08.265580 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 55919983-ea3e-4032-bf99-8fe95d165a35 Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:08.269405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:08.273748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:08.273748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 55919983-ea3e-4032-bf99-8fe95d165a35 Jul 28 03:39:08.273748 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.273748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3cb2bb4c-cf41-4ba8-8614-0b775fa6326c tempest-FloatingIPDetailsNegativeTestJSON-1833721741 tempest-FloatingIPDetailsNegativeTestJSON-1833721741-project] Returning 404 to user: Floating IP not found for ID 55919983-ea3e-4032-bf99-8fe95d165a35 {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:08.273748 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3cb2bb4c-cf41-4ba8-8614-0b775fa6326c tempest-FloatingIPDetailsNegativeTestJSON-1833721741 tempest-FloatingIPDetailsNegativeTestJSON-1833721741-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/55919983-ea3e-4032-bf99-8fe95d165a35" status: 404 len: 111 microversion: 2.1 time: 0.483250 Jul 28 03:39:08.273748 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 424/883] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Jul 28 03:39:07 2022] GET /compute/v2.1/os-floating-ips/55919983-ea3e-4032-bf99-8fe95d165a35 => generated 111 bytes in 491 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:08.276165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6eeb390a-6b71-4779-855b-20aa16ea6d3b tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Calling method '.version_select at 0x7ffa74917670>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:08.440018 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-6eeb390a-6b71-4779-855b-20aa16ea6d3b tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] HTTP exception thrown: Image not found. Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6eeb390a-6b71-4779-855b-20aa16ea6d3b tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Request method failure captured: Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/images/88852fc9-9cb0-40fe-bcec-311f5acf596j HTTP/1.1 Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gTab0AU0lJuhb-37tzq1_xinXCD1XajlTdpSWKJlfpoBY3p8KkfqZQzwqD5EZSR0tMWEH4H13AW9Y6v9adUV7qlKQ4q_VWvNWJg1LEpl-4kEiSc3Eu1k2BT2BtpD68nQuCbw35Yuo8cqv6CcRWLYomtf_hrRYF4THXsg80FCAWm85A Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 6647ea99fb0f472dab0ce5b9e703d125 Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:39:08.450709 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:39:08.453360 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6647ea99fb0f472dab0ce5b9e703d125"}]}] Jul 28 03:39:08.453360 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:08.453360 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 6647ea99fb0f472dab0ce5b9e703d125 Jul 28 03:39:08.453360 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:08.453360 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesDeleteNegativeTestJSON-2041455143-project Jul 28 03:39:08.453360 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:39:08.453360 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:39:08.453360 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a19750399aee48779d82c3e97bf8613c Jul 28 03:39:08.453360 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143-project Jul 28 03:39:08.453360 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:39:08.453360 n-d-826756-3 devstack@n-api.service[126072]: exception: Image not found. Jul 28 03:39:08.453360 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '88852fc9-9cb0-40fe-bcec-311f5acf596j'} Jul 28 03:39:08.453360 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 88852fc9-9cb0-40fe-bcec-311f5acf596j to delete Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:08.457887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 88852fc9-9cb0-40fe-bcec-311f5acf596j could not be found. Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:08.460246 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6eeb390a-6b71-4779-855b-20aa16ea6d3b tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Returning 404 to user: Image not found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:08.468555 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6eeb390a-6b71-4779-855b-20aa16ea6d3b tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] 10.222.0.48 "DELETE /compute/v2.1/images/88852fc9-9cb0-40fe-bcec-311f5acf596j" status: 404 len: 62 microversion: 2.1 time: 0.185944 Jul 28 03:39:08.469467 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 425/884] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:08 2022] DELETE /compute/v2.1/images/88852fc9-9cb0-40fe-bcec-311f5acf596j => generated 62 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:39:08.469467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-77087c01-9eec-4955-9981-37c895a33061 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:08.469467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-77087c01-9eec-4955-9981-37c895a33061 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:08.474398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77087c01-9eec-4955-9981-37c895a33061 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:08.475952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77087c01-9eec-4955-9981-37c895a33061 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:08.476998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77087c01-9eec-4955-9981-37c895a33061 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:08.477650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77087c01-9eec-4955-9981-37c895a33061 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:08.661856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6c5d84f7-dc6d-4fd0-be31-3588773529f7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:08.672626 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6c5d84f7-dc6d-4fd0-be31-3588773529f7 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1679 microversion: 2.1 time: 0.868982 Jul 28 03:39:08.679350 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 460/885] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:07 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1679 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:08.689699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-499961ee-8ca0-4fdb-86c7-e4f4f9af07f9 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Calling method '.version_select at 0x7ffa745e1040>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:08.733568 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-499961ee-8ca0-4fdb-86c7-e4f4f9af07f9 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] HTTP exception thrown: Image not found. Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-499961ee-8ca0-4fdb-86c7-e4f4f9af07f9 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Request method failure captured: Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/images/2319af76-6223-4ec4-8c42-dfe8a4e7201d1 HTTP/1.1 Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gTab0AU0lJuhb-37tzq1_xinXCD1XajlTdpSWKJlfpoBY3p8KkfqZQzwqD5EZSR0tMWEH4H13AW9Y6v9adUV7qlKQ4q_VWvNWJg1LEpl-4kEiSc3Eu1k2BT2BtpD68nQuCbw35Yuo8cqv6CcRWLYomtf_hrRYF4THXsg80FCAWm85A Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 6647ea99fb0f472dab0ce5b9e703d125 Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:08.737095 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:08.738674 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6647ea99fb0f472dab0ce5b9e703d125"}]}] Jul 28 03:39:08.738674 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:08.738674 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 6647ea99fb0f472dab0ce5b9e703d125 Jul 28 03:39:08.738674 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:08.738674 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesDeleteNegativeTestJSON-2041455143-project Jul 28 03:39:08.738674 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:08.738674 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:08.738674 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a19750399aee48779d82c3e97bf8613c Jul 28 03:39:08.738674 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143-project Jul 28 03:39:08.738674 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:39:08.738674 n-d-826756-3 devstack@n-api.service[126071]: exception: Image not found. Jul 28 03:39:08.738674 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2319af76-6223-4ec4-8c42-dfe8a4e7201d1'} Jul 28 03:39:08.738674 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2319af76-6223-4ec4-8c42-dfe8a4e7201d1 to delete Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:08.739467 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2319af76-6223-4ec4-8c42-dfe8a4e7201d1 could not be found. Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:08.740621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:08.741893 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 03:39:08.741893 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:39:08.741893 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:39:08.741893 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.741893 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:08.741893 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.741893 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.741893 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:08.741893 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:08.741893 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:08.741893 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:08.741893 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:39:08.741893 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.744030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-499961ee-8ca0-4fdb-86c7-e4f4f9af07f9 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Returning 404 to user: Image not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:08.748124 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-499961ee-8ca0-4fdb-86c7-e4f4f9af07f9 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] 10.222.0.48 "DELETE /compute/v2.1/images/2319af76-6223-4ec4-8c42-dfe8a4e7201d1" status: 404 len: 62 microversion: 2.1 time: 0.066314 Jul 28 03:39:08.753579 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 461/886] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:39:08 2022] DELETE /compute/v2.1/images/2319af76-6223-4ec4-8c42-dfe8a4e7201d1 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:39:08.763823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bf2f1af2-6627-4962-ba33-f68f6de6ea40 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Calling method '.version_select at 0x7ffa74688a60>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:08.823543 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-bf2f1af2-6627-4962-ba33-f68f6de6ea40 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] HTTP exception thrown: Image not found. Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bf2f1af2-6627-4962-ba33-f68f6de6ea40 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Request method failure captured: Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/images/tempest-invalid-248276188 HTTP/1.1 Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gTab0AU0lJuhb-37tzq1_xinXCD1XajlTdpSWKJlfpoBY3p8KkfqZQzwqD5EZSR0tMWEH4H13AW9Y6v9adUV7qlKQ4q_VWvNWJg1LEpl-4kEiSc3Eu1k2BT2BtpD68nQuCbw35Yuo8cqv6CcRWLYomtf_hrRYF4THXsg80FCAWm85A Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 6647ea99fb0f472dab0ce5b9e703d125 Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:08.825758 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:08.827247 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6647ea99fb0f472dab0ce5b9e703d125"}]}] Jul 28 03:39:08.827247 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:08.827247 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 6647ea99fb0f472dab0ce5b9e703d125 Jul 28 03:39:08.827247 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:08.827247 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesDeleteNegativeTestJSON-2041455143-project Jul 28 03:39:08.827247 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:08.827247 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:08.827247 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a19750399aee48779d82c3e97bf8613c Jul 28 03:39:08.827247 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143-project Jul 28 03:39:08.827247 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:39:08.827247 n-d-826756-3 devstack@n-api.service[126071]: exception: Image not found. Jul 28 03:39:08.827247 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'tempest-invalid-248276188'} Jul 28 03:39:08.827247 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-248276188 to delete Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:08.828161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-248276188 could not be found. Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:08.829326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:08.830512 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 03:39:08.830512 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:39:08.830512 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:39:08.830512 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.830512 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:08.830512 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.830512 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:08.830512 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:08.830512 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:08.830512 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:08.830512 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:08.830512 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:39:08.830512 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:08.832867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bf2f1af2-6627-4962-ba33-f68f6de6ea40 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Returning 404 to user: Image not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:08.834517 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bf2f1af2-6627-4962-ba33-f68f6de6ea40 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] 10.222.0.48 "DELETE /compute/v2.1/images/tempest-invalid-248276188" status: 404 len: 62 microversion: 2.1 time: 0.074552 Jul 28 03:39:08.837106 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 462/887] 10.222.0.48 () {58 vars in 1203 bytes} [Thu Jul 28 03:39:08 2022] DELETE /compute/v2.1/images/tempest-invalid-248276188 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:39:08.851242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-71e7aa78-62e8-4dd6-8ddd-9c0267ebe996 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:08.852739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-71e7aa78-62e8-4dd6-8ddd-9c0267ebe996 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:08.863921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71e7aa78-62e8-4dd6-8ddd-9c0267ebe996 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:08.865130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71e7aa78-62e8-4dd6-8ddd-9c0267ebe996 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:08.866955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71e7aa78-62e8-4dd6-8ddd-9c0267ebe996 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:08.868089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71e7aa78-62e8-4dd6-8ddd-9c0267ebe996 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:09.384787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-71e7aa78-62e8-4dd6-8ddd-9c0267ebe996 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:09.409950 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-71e7aa78-62e8-4dd6-8ddd-9c0267ebe996 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1501 microversion: 2.1 time: 0.566677 Jul 28 03:39:09.423910 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 463/888] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:08 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1501 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:09.452310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0a122dff-ae51-494b-a82e-6745594653b8 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Calling method '.version_select at 0x7ffa74669310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:09.566701 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-0a122dff-ae51-494b-a82e-6745594653b8 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] HTTP exception thrown: Image not found. Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0a122dff-ae51-494b-a82e-6745594653b8 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Request method failure captured: Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/images/031b2cf4-6543-4e52-a216-864074e85beb HTTP/1.1 Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gTab0AU0lJuhb-37tzq1_xinXCD1XajlTdpSWKJlfpoBY3p8KkfqZQzwqD5EZSR0tMWEH4H13AW9Y6v9adUV7qlKQ4q_VWvNWJg1LEpl-4kEiSc3Eu1k2BT2BtpD68nQuCbw35Yuo8cqv6CcRWLYomtf_hrRYF4THXsg80FCAWm85A Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 6647ea99fb0f472dab0ce5b9e703d125 Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:09.568952 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:09.572311 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6647ea99fb0f472dab0ce5b9e703d125"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6647ea99fb0f472dab0ce5b9e703d125"}]}] Jul 28 03:39:09.572311 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:09.572311 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 6647ea99fb0f472dab0ce5b9e703d125 Jul 28 03:39:09.572311 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143 Jul 28 03:39:09.572311 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesDeleteNegativeTestJSON-2041455143-project Jul 28 03:39:09.572311 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:09.572311 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:09.572311 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a19750399aee48779d82c3e97bf8613c Jul 28 03:39:09.572311 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2041455143-project Jul 28 03:39:09.572311 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:39:09.572311 n-d-826756-3 devstack@n-api.service[126071]: exception: Image not found. Jul 28 03:39:09.572311 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '031b2cf4-6543-4e52-a216-864074e85beb'} Jul 28 03:39:09.572311 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 031b2cf4-6543-4e52-a216-864074e85beb to delete Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:09.573960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 031b2cf4-6543-4e52-a216-864074e85beb could not be found. Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:09.576747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0a122dff-ae51-494b-a82e-6745594653b8 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] Returning 404 to user: Image not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:09.581517 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0a122dff-ae51-494b-a82e-6745594653b8 tempest-ImagesDeleteNegativeTestJSON-2041455143 tempest-ImagesDeleteNegativeTestJSON-2041455143-project] 10.222.0.48 "DELETE /compute/v2.1/images/031b2cf4-6543-4e52-a216-864074e85beb" status: 404 len: 62 microversion: 2.1 time: 0.145648 Jul 28 03:39:09.583388 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 464/889] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:09 2022] DELETE /compute/v2.1/images/031b2cf4-6543-4e52-a216-864074e85beb => generated 62 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:39:09.722718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c49b2807-3e70-474b-86bd-292436c9e453 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:09.727885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c49b2807-3e70-474b-86bd-292436c9e453 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:09.777064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c49b2807-3e70-474b-86bd-292436c9e453 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:09.777633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c49b2807-3e70-474b-86bd-292436c9e453 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:09.779529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c49b2807-3e70-474b-86bd-292436c9e453 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:09.779989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c49b2807-3e70-474b-86bd-292436c9e453 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:09.869035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-77087c01-9eec-4955-9981-37c895a33061 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:09.881021 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-77087c01-9eec-4955-9981-37c895a33061 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1313 microversion: 2.1 time: 1.421869 Jul 28 03:39:09.882628 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 426/890] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:08 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1313 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:10.443032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-155ce868-183e-49f9-9eb5-bb7584438b97 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:10.444236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-155ce868-183e-49f9-9eb5-bb7584438b97 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:10.466674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-155ce868-183e-49f9-9eb5-bb7584438b97 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:10.467495 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-155ce868-183e-49f9-9eb5-bb7584438b97 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:10.473231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-155ce868-183e-49f9-9eb5-bb7584438b97 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:10.474955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-155ce868-183e-49f9-9eb5-bb7584438b97 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:10.571930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c49b2807-3e70-474b-86bd-292436c9e453 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:10.615692 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c49b2807-3e70-474b-86bd-292436c9e453 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1679 microversion: 2.1 time: 0.900970 Jul 28 03:39:10.628384 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 465/891] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:09 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1679 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:10.922230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5bb5e80-d465-49ae-8997-8d4c8d0a0a21 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:10.923828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b5bb5e80-d465-49ae-8997-8d4c8d0a0a21 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:10.936551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5bb5e80-d465-49ae-8997-8d4c8d0a0a21 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:10.942718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5bb5e80-d465-49ae-8997-8d4c8d0a0a21 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:10.944579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5bb5e80-d465-49ae-8997-8d4c8d0a0a21 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:10.945246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5bb5e80-d465-49ae-8997-8d4c8d0a0a21 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:11.477524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-155ce868-183e-49f9-9eb5-bb7584438b97 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:11.577154 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-155ce868-183e-49f9-9eb5-bb7584438b97 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1501 microversion: 2.1 time: 1.138400 Jul 28 03:39:11.609903 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 427/892] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:10 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1501 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:11.643110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aadb6dda-323a-4459-a736-768407788e0c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:11.648673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-aadb6dda-323a-4459-a736-768407788e0c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:11.679454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aadb6dda-323a-4459-a736-768407788e0c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:11.693352 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aadb6dda-323a-4459-a736-768407788e0c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:11.694126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aadb6dda-323a-4459-a736-768407788e0c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:11.694568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aadb6dda-323a-4459-a736-768407788e0c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:12.280789 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-aadb6dda-323a-4459-a736-768407788e0c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:12.297112 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aadb6dda-323a-4459-a736-768407788e0c tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1679 microversion: 2.1 time: 0.657337 Jul 28 03:39:12.302295 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 428/893] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:11 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1679 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:12.621098 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-db0f66d6-5946-4435-8767-359d840d384a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:12.621834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-db0f66d6-5946-4435-8767-359d840d384a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:12.640282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db0f66d6-5946-4435-8767-359d840d384a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:12.640867 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db0f66d6-5946-4435-8767-359d840d384a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:12.642902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db0f66d6-5946-4435-8767-359d840d384a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:12.644825 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db0f66d6-5946-4435-8767-359d840d384a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:12.813358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b5bb5e80-d465-49ae-8997-8d4c8d0a0a21 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:12.837439 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5bb5e80-d465-49ae-8997-8d4c8d0a0a21 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1463 microversion: 2.1 time: 1.921611 Jul 28 03:39:12.848145 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 466/894] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:10 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1463 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:12.868875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a66ee62-07ff-4f0b-a7a7-c497d07d1d73 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:12.869511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1a66ee62-07ff-4f0b-a7a7-c497d07d1d73 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:12.893062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a66ee62-07ff-4f0b-a7a7-c497d07d1d73 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:12.893524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a66ee62-07ff-4f0b-a7a7-c497d07d1d73 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:12.894334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a66ee62-07ff-4f0b-a7a7-c497d07d1d73 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:12.894769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a66ee62-07ff-4f0b-a7a7-c497d07d1d73 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:13.149278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-db0f66d6-5946-4435-8767-359d840d384a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:13.169449 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-db0f66d6-5946-4435-8767-359d840d384a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1476 microversion: 2.1 time: 0.555661 Jul 28 03:39:13.170770 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 429/895] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:12 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1476 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:13.185201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2135941429", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f61dea9e-b85d-46b5-aa09-70f0225d6c84"}], "security_groups": [{"name": "tempest-securitygroup--23639398"}], "key_name": "tempest-keypair-1659129971", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:13.520257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] validate_networks() for [('f61dea9e-b85d-46b5-aa09-70f0225d6c84', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:39:13.665466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1a66ee62-07ff-4f0b-a7a7-c497d07d1d73 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:13.689412 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1a66ee62-07ff-4f0b-a7a7-c497d07d1d73 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1463 microversion: 2.1 time: 0.825557 Jul 28 03:39:13.690502 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 467/896] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:12 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1463 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:13.697193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aba7bc84-36b6-4f97-9314-e5368d424306 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '.version_select at 0x7ffa745f0040>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:13.702636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aba7bc84-36b6-4f97-9314-e5368d424306 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:13.703392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aba7bc84-36b6-4f97-9314-e5368d424306 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:13.728739 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aba7bc84-36b6-4f97-9314-e5368d424306 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.035825 Jul 28 03:39:13.729879 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 468/897] 10.222.0.48 () {58 vars in 1143 bytes} [Thu Jul 28 03:39:13 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:13.735560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47441ee0-b224-4599-a2a3-caa7b0b94d33 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:13.736605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-47441ee0-b224-4599-a2a3-caa7b0b94d33 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:13.745120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47441ee0-b224-4599-a2a3-caa7b0b94d33 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:13.745968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47441ee0-b224-4599-a2a3-caa7b0b94d33 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:13.746994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47441ee0-b224-4599-a2a3-caa7b0b94d33 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:13.747660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47441ee0-b224-4599-a2a3-caa7b0b94d33 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:13.915607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-47441ee0-b224-4599-a2a3-caa7b0b94d33 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:13.931647 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-47441ee0-b224-4599-a2a3-caa7b0b94d33 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1612 microversion: 2.1 time: 0.195740 Jul 28 03:39:13.933722 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 469/898] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:13 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1612 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:13.943910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-886a79ab-9162-4de5-98c1-69190fbc060b tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:13.944973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-886a79ab-9162-4de5-98c1-69190fbc060b tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:13.953405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-886a79ab-9162-4de5-98c1-69190fbc060b tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:13.954149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-886a79ab-9162-4de5-98c1-69190fbc060b tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:13.955124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-886a79ab-9162-4de5-98c1-69190fbc060b tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:13.955732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-886a79ab-9162-4de5-98c1-69190fbc060b tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:14.604197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:39:14.605300 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:39:14.611245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:39:14.612244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:39:14.614531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:39:14.637435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:14.638253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:14.639323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:14.639952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:14.674089 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-886a79ab-9162-4de5-98c1-69190fbc060b tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1627 microversion: 2.1 time: 0.737745 Jul 28 03:39:14.675168 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 470/899] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:13 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1627 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:14.680330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1872233196", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "95b019cf-2b83-4fba-adf1-a5ffaf2faeab"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:14.712121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Getting quotas for project 881125b6bb84430fb4f2e0c6ebf79983. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:39:14.719137 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Getting quotas for user c2e3c37253bc408682e9a15c3b5a85ab and project 881125b6bb84430fb4f2e0c6ebf79983. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:39:14.738270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:39:14.741328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:39:14.780277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:39:14.842607 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a15c7a43-fe72-4867-a2d3-9d9be45bfd72 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.25 time: 1.670429 Jul 28 03:39:14.855521 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 430/900] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:39:13 2022] POST /compute/v2.1/servers => generated 404 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:39:14.862378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-83d50552-60b4-41a9-b628-be49eafd48fc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Action: 'create', calling method: .version_select at 0x7ffa74d9ad30>, body: {"keypair": {"name": "tempest-keypair-1382115356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjnwd3OkS3gUxXyY73KfuM2xp+0ecCLwunMHb2F/8Swexaet0Wqgh0cfJViASbAPAcgDCZPbWibkTuj0aDFzoX/lFEu0UI6e/Ee5ZLE+Yu3p9mz21LXVo3ci3wzqxRz/w=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:14.880975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-83d50552-60b4-41a9-b628-be49eafd48fc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Getting quotas for project 006f4f23380b45fab24edfea5be8f3a7. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:39:14.888684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-83d50552-60b4-41a9-b628-be49eafd48fc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Getting quotas for user 15947ba65c714e0dbb60fc36afcb9a9c and project 006f4f23380b45fab24edfea5be8f3a7. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:39:14.955834 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-83d50552-60b4-41a9-b628-be49eafd48fc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087090 Jul 28 03:39:14.957238 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 431/901] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:39:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:14.985199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-35d9735b-a944-464c-b451-f5b2baa6a938 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:14.988196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-35d9735b-a944-464c-b451-f5b2baa6a938 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:15.182447 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-35d9735b-a944-464c-b451-f5b2baa6a938 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:15.207431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-35d9735b-a944-464c-b451-f5b2baa6a938 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:15.209023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-35d9735b-a944-464c-b451-f5b2baa6a938 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:15.210177 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-35d9735b-a944-464c-b451-f5b2baa6a938 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1286 microversion: 2.25 time: 0.250085 Jul 28 03:39:15.224388 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 432/902] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:39:14 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1286 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:15.238021 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9461dcae-d743-457b-81d3-a392a610f4b6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:15.238905 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9461dcae-d743-457b-81d3-a392a610f4b6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:15.267203 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9461dcae-d743-457b-81d3-a392a610f4b6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:15.267715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9461dcae-d743-457b-81d3-a392a610f4b6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:15.268607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9461dcae-d743-457b-81d3-a392a610f4b6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:15.269056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9461dcae-d743-457b-81d3-a392a610f4b6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:15.472131 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9461dcae-d743-457b-81d3-a392a610f4b6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:15.482482 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9461dcae-d743-457b-81d3-a392a610f4b6 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1612 microversion: 2.1 time: 0.270074 Jul 28 03:39:15.496087 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 433/903] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:15 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1612 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:15.770549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:16.114458 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-291718ce-24e0-4d3e-8518-99f047eb505e req-bdd436fb-5988-4fb4-b769-12baa911f458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8280d682-4608-420d-8bee-48984a6c1a01", "name": "network-vif-deleted", "tag": "fd5a933b-cfed-47cd-bae0-70c895f135ea"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:16.155390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-291718ce-24e0-4d3e-8518-99f047eb505e req-bdd436fb-5988-4fb4-b769-12baa911f458 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:16.156115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-291718ce-24e0-4d3e-8518-99f047eb505e req-bdd436fb-5988-4fb4-b769-12baa911f458 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:16.184124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:16.191677 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-291718ce-24e0-4d3e-8518-99f047eb505e req-bdd436fb-5988-4fb4-b769-12baa911f458 service nova] Creating event network-vif-deleted:fd5a933b-cfed-47cd-bae0-70c895f135ea for instance 8280d682-4608-420d-8bee-48984a6c1a01 on n-h2-826756-3 Jul 28 03:39:16.207980 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-291718ce-24e0-4d3e-8518-99f047eb505e req-bdd436fb-5988-4fb4-b769-12baa911f458 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096291 Jul 28 03:39:16.212740 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 434/904] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:39:16.239185 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2e099e54-7b12-4192-95b5-2131dbc6e524 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:16.240760 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2e099e54-7b12-4192-95b5-2131dbc6e524 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:16.258246 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2e099e54-7b12-4192-95b5-2131dbc6e524 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:16.260527 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2e099e54-7b12-4192-95b5-2131dbc6e524 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:16.262779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2e099e54-7b12-4192-95b5-2131dbc6e524 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:16.263441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2e099e54-7b12-4192-95b5-2131dbc6e524 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:16.407933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:39:16.407933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:39:16.407933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:39:16.407933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:39:16.407933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:39:16.452619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:16.461759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:16.474519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:16.479487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:16.591219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Getting quotas for project 73bbf29c8c7f4f3385717d49ff9fe5f4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:39:16.605522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Getting quotas for user b4eff140fd7d4ec0ae9fe1a851d272e2 and project 73bbf29c8c7f4f3385717d49ff9fe5f4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:39:16.608889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2e099e54-7b12-4192-95b5-2131dbc6e524 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:16.629417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2e099e54-7b12-4192-95b5-2131dbc6e524 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:16.631223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2e099e54-7b12-4192-95b5-2131dbc6e524 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:16.636619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:39:16.642001 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2e099e54-7b12-4192-95b5-2131dbc6e524 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1338 microversion: 2.25 time: 0.408033 Jul 28 03:39:16.642612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:39:16.646164 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 435/905] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:39:16 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1338 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:39:16.673812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fa45e557-2c09-4385-b12f-6d499ab9f664 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:16.676805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fa45e557-2c09-4385-b12f-6d499ab9f664 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:16.707424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa45e557-2c09-4385-b12f-6d499ab9f664 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:16.707911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa45e557-2c09-4385-b12f-6d499ab9f664 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:16.711862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa45e557-2c09-4385-b12f-6d499ab9f664 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:16.715754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa45e557-2c09-4385-b12f-6d499ab9f664 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:16.797191 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59cfc352-2706-421e-a1c7-408749999211 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.120610 Jul 28 03:39:16.797876 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 471/906] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:39:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:39:16.831451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a140c32-552f-4c0e-850a-0bd098e2f76d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:16.833633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7a140c32-552f-4c0e-850a-0bd098e2f76d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:16.914945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa45e557-2c09-4385-b12f-6d499ab9f664 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:16.917984 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa45e557-2c09-4385-b12f-6d499ab9f664 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:16.918655 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-fa45e557-2c09-4385-b12f-6d499ab9f664 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lazy-loading 'fault' on Instance uuid 8280d682-4608-420d-8bee-48984a6c1a01 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:39:17.145984 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fa45e557-2c09-4385-b12f-6d499ab9f664 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3843d34282c4e319380ec87b584e2c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc91ad107318444881db8af480262a29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:17.158874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a140c32-552f-4c0e-850a-0bd098e2f76d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:17.171348 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fa45e557-2c09-4385-b12f-6d499ab9f664 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 200 len: 1330 microversion: 2.1 time: 0.521124 Jul 28 03:39:17.176499 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 436/907] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:16 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 1330 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:17.179986 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7a140c32-552f-4c0e-850a-0bd098e2f76d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1214 microversion: 2.1 time: 0.366111 Jul 28 03:39:17.186731 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 472/908] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:16 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1214 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:17.671128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a19a5506-0203-4c63-8f85-42299ef802c3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:17.673135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a19a5506-0203-4c63-8f85-42299ef802c3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:17.703064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a19a5506-0203-4c63-8f85-42299ef802c3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:17.709860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a19a5506-0203-4c63-8f85-42299ef802c3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:17.716133 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a19a5506-0203-4c63-8f85-42299ef802c3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:17.721161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a19a5506-0203-4c63-8f85-42299ef802c3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:18.035412 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a19a5506-0203-4c63-8f85-42299ef802c3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:18.062799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a19a5506-0203-4c63-8f85-42299ef802c3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:18.076009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a19a5506-0203-4c63-8f85-42299ef802c3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:18.077866 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a19a5506-0203-4c63-8f85-42299ef802c3 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1344 microversion: 2.25 time: 0.411428 Jul 28 03:39:18.083348 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 437/909] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:39:17 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1344 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:18.204048 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0de21385-e7a3-440b-971e-7430558b9ee9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:18.205161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0de21385-e7a3-440b-971e-7430558b9ee9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:18.216788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0de21385-e7a3-440b-971e-7430558b9ee9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:18.217235 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0de21385-e7a3-440b-971e-7430558b9ee9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:18.218387 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0de21385-e7a3-440b-971e-7430558b9ee9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:18.218819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0de21385-e7a3-440b-971e-7430558b9ee9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:18.219479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97615d57-33bd-4897-94b1-adbec6d5f140 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:18.222853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-97615d57-33bd-4897-94b1-adbec6d5f140 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:18.267796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97615d57-33bd-4897-94b1-adbec6d5f140 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:18.272686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97615d57-33bd-4897-94b1-adbec6d5f140 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:18.273734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97615d57-33bd-4897-94b1-adbec6d5f140 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:18.279122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97615d57-33bd-4897-94b1-adbec6d5f140 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:18.338610 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-97615d57-33bd-4897-94b1-adbec6d5f140 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] HTTP exception thrown: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97615d57-33bd-4897-94b1-adbec6d5f140 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Request method failure captured: Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 HTTP/1.1 Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gQTocUzG4mwW0goW0PWtVK7KLvt1rxEkCkdi7OQqIGAWU3VJeICqHcMyApHblLH7r9VUzFsAqSL21UdcW4yP-gEH-6FJlc4fHQYTo8bmlDcC9xIluj_dfpTcb9lxMjTRy3qNOLch2FpfqXyflcb-JnpkLAFH7Z_ALnoA3LyVjj0SDY Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: dc91ad107318444881db8af480262a29 Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-251982860 Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:18.343272 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:18.344798 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc91ad107318444881db8af480262a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc91ad107318444881db8af480262a29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc91ad107318444881db8af480262a29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc91ad107318444881db8af480262a29"}]}] Jul 28 03:39:18.344798 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-251982860 Jul 28 03:39:18.344798 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: dc91ad107318444881db8af480262a29 Jul 28 03:39:18.344798 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-251982860 Jul 28 03:39:18.344798 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachSCSIVolumeTestJSON-251982860-project Jul 28 03:39:18.344798 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:18.344798 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:18.344798 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d3843d34282c4e319380ec87b584e2c4 Jul 28 03:39:18.344798 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-251982860-project Jul 28 03:39:18.344798 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:39:18.344798 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:18.344798 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8280d682-4608-420d-8bee-48984a6c1a01'} Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:18.345610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:18.346871 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:18.350842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97615d57-33bd-4897-94b1-adbec6d5f140 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Returning 404 to user: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:18.353363 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-97615d57-33bd-4897-94b1-adbec6d5f140 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 404 len: 111 microversion: 2.1 time: 0.156565 Jul 28 03:39:18.358190 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 473/910] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:18 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:18.372122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c4fc497d-fb65-4eea-9ad5-5eb70a1a2be4 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '.version_select at 0x7ffa74550820>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:18.419656 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c4fc497d-fb65-4eea-9ad5-5eb70a1a2be4 tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-713113740" status: 202 len: 0 microversion: 2.1 time: 0.054791 Jul 28 03:39:18.421749 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 474/911] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 03:39:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-713113740 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:39:18.587603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0de21385-e7a3-440b-971e-7430558b9ee9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:18.597109 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0de21385-e7a3-440b-971e-7430558b9ee9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1218 microversion: 2.1 time: 0.397469 Jul 28 03:39:18.609664 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 438/912] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:18 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1218 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:19.113758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2dcb415d-f4b3-4edb-9d82-4b8293ba62a4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:19.114558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2dcb415d-f4b3-4edb-9d82-4b8293ba62a4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:19.142651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2dcb415d-f4b3-4edb-9d82-4b8293ba62a4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:19.144425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2dcb415d-f4b3-4edb-9d82-4b8293ba62a4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:19.146828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2dcb415d-f4b3-4edb-9d82-4b8293ba62a4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:19.150691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2dcb415d-f4b3-4edb-9d82-4b8293ba62a4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:19.638900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9e5767f4-d276-43b2-97d7-7a4b5efca8d3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:19.643382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9e5767f4-d276-43b2-97d7-7a4b5efca8d3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:19.672162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e5767f4-d276-43b2-97d7-7a4b5efca8d3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:19.677917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e5767f4-d276-43b2-97d7-7a4b5efca8d3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:19.679179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e5767f4-d276-43b2-97d7-7a4b5efca8d3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:19.679868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e5767f4-d276-43b2-97d7-7a4b5efca8d3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:19.860383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2dcb415d-f4b3-4edb-9d82-4b8293ba62a4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:19.875134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2dcb415d-f4b3-4edb-9d82-4b8293ba62a4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:19.881661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2dcb415d-f4b3-4edb-9d82-4b8293ba62a4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:19.884628 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2dcb415d-f4b3-4edb-9d82-4b8293ba62a4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1344 microversion: 2.25 time: 0.782772 Jul 28 03:39:19.889650 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 475/913] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:39:19 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1344 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:20.199296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9e5767f4-d276-43b2-97d7-7a4b5efca8d3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:20.215912 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9e5767f4-d276-43b2-97d7-7a4b5efca8d3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1284 microversion: 2.1 time: 0.584465 Jul 28 03:39:20.229387 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 439/914] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:19 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1284 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:20.916235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b179683b-654c-4ac2-aa24-abd823c10857 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:20.917507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b179683b-654c-4ac2-aa24-abd823c10857 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:20.929797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b179683b-654c-4ac2-aa24-abd823c10857 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:20.929797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b179683b-654c-4ac2-aa24-abd823c10857 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:20.930731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b179683b-654c-4ac2-aa24-abd823c10857 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:20.931176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b179683b-654c-4ac2-aa24-abd823c10857 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:21.260061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0602922a-6751-45fc-8aa2-113311a6d8fb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:21.260737 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0602922a-6751-45fc-8aa2-113311a6d8fb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:21.284202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0602922a-6751-45fc-8aa2-113311a6d8fb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:21.285091 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0602922a-6751-45fc-8aa2-113311a6d8fb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:21.286637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0602922a-6751-45fc-8aa2-113311a6d8fb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:21.293281 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0602922a-6751-45fc-8aa2-113311a6d8fb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:21.551488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0602922a-6751-45fc-8aa2-113311a6d8fb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:21.575708 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0602922a-6751-45fc-8aa2-113311a6d8fb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1272 microversion: 2.1 time: 0.329910 Jul 28 03:39:21.579781 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 440/915] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:21 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1272 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:22.185591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1200685431", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "4becdb03-f4b9-4bc9-b3de-403ab318d4dd"}], "security_groups": [{"name": "tempest-securitygroup--1265734950"}], "key_name": "tempest-keypair-1382115356", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:22.780968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b179683b-654c-4ac2-aa24-abd823c10857 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:22.796560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b179683b-654c-4ac2-aa24-abd823c10857 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:22.798246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b179683b-654c-4ac2-aa24-abd823c10857 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:22.801284 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b179683b-654c-4ac2-aa24-abd823c10857 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1410 microversion: 2.25 time: 1.888977 Jul 28 03:39:22.804448 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 476/916] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:39:20 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1410 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:22.815532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-95744bec-b1e8-49c6-ae4c-174ae8f0f888 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:22.817774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-95744bec-b1e8-49c6-ae4c-174ae8f0f888 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:22.837569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95744bec-b1e8-49c6-ae4c-174ae8f0f888 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:22.841897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95744bec-b1e8-49c6-ae4c-174ae8f0f888 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:22.843344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95744bec-b1e8-49c6-ae4c-174ae8f0f888 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:22.860821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95744bec-b1e8-49c6-ae4c-174ae8f0f888 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:23.124014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-95744bec-b1e8-49c6-ae4c-174ae8f0f888 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:23.141201 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-95744bec-b1e8-49c6-ae4c-174ae8f0f888 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1272 microversion: 2.1 time: 0.335203 Jul 28 03:39:23.158963 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 477/917] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:22 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1272 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:23.158963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9961e9c9-1995-4b24-9fa8-f192b470d58a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:23.158963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9961e9c9-1995-4b24-9fa8-f192b470d58a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:23.161113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9961e9c9-1995-4b24-9fa8-f192b470d58a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:23.161654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9961e9c9-1995-4b24-9fa8-f192b470d58a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:23.162725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9961e9c9-1995-4b24-9fa8-f192b470d58a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:23.163141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9961e9c9-1995-4b24-9fa8-f192b470d58a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:23.385349 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] validate_networks() for [('4becdb03-f4b9-4bc9-b3de-403ab318d4dd', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:39:23.705296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9961e9c9-1995-4b24-9fa8-f192b470d58a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:23.725895 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9961e9c9-1995-4b24-9fa8-f192b470d58a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1681 microversion: 2.1 time: 0.578738 Jul 28 03:39:23.726464 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 478/918] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:23 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1681 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:23.735274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-fa6b399e-3eb6-4fd9-a8ba-78a0d5fe6d88 req-d909d7db-9635-49d5-aa04-f5fa22cb2271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcbae58d-a326-4197-a350-9278d664d3e7", "tag": "1c43a93b-de22-40be-a837-98a92e1f0f4c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:23.773240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fa6b399e-3eb6-4fd9-a8ba-78a0d5fe6d88 req-d909d7db-9635-49d5-aa04-f5fa22cb2271 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:23.773776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fa6b399e-3eb6-4fd9-a8ba-78a0d5fe6d88 req-d909d7db-9635-49d5-aa04-f5fa22cb2271 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:23.810139 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-fa6b399e-3eb6-4fd9-a8ba-78a0d5fe6d88 req-d909d7db-9635-49d5-aa04-f5fa22cb2271 service nova] Creating event network-changed:1c43a93b-de22-40be-a837-98a92e1f0f4c for instance fcbae58d-a326-4197-a350-9278d664d3e7 on n-h1-826756-3 Jul 28 03:39:23.829472 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-fa6b399e-3eb6-4fd9-a8ba-78a0d5fe6d88 req-d909d7db-9635-49d5-aa04-f5fa22cb2271 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097714 Jul 28 03:39:23.830656 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 479/919] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:23.836422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ad4141f2-c8d4-46b7-9055-61444ef34df6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:23.854607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ad4141f2-c8d4-46b7-9055-61444ef34df6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:23.863139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad4141f2-c8d4-46b7-9055-61444ef34df6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:23.867493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad4141f2-c8d4-46b7-9055-61444ef34df6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:23.870007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad4141f2-c8d4-46b7-9055-61444ef34df6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:23.871568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad4141f2-c8d4-46b7-9055-61444ef34df6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:24.368147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ad4141f2-c8d4-46b7-9055-61444ef34df6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:24.384696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ad4141f2-c8d4-46b7-9055-61444ef34df6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:24.386470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ad4141f2-c8d4-46b7-9055-61444ef34df6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:24.391050 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ad4141f2-c8d4-46b7-9055-61444ef34df6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1410 microversion: 2.25 time: 0.558957 Jul 28 03:39:24.391903 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 480/920] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:39:23 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1410 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:24.403491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-463fc37d-d4ef-47ae-b181-aa1594e4b2b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:24.405902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-463fc37d-d4ef-47ae-b181-aa1594e4b2b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:24.420757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-463fc37d-d4ef-47ae-b181-aa1594e4b2b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:24.433516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-463fc37d-d4ef-47ae-b181-aa1594e4b2b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:24.436315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-463fc37d-d4ef-47ae-b181-aa1594e4b2b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:24.437814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-463fc37d-d4ef-47ae-b181-aa1594e4b2b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:24.658546 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:24.729636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-463fc37d-d4ef-47ae-b181-aa1594e4b2b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:24.740189 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-463fc37d-d4ef-47ae-b181-aa1594e4b2b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1314 microversion: 2.1 time: 0.346482 Jul 28 03:39:24.743134 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 481/921] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:24 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:24.749340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a084efb5-e901-4bda-944f-c48420eaad7a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:24.750621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a084efb5-e901-4bda-944f-c48420eaad7a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:24.758576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a084efb5-e901-4bda-944f-c48420eaad7a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:24.759114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a084efb5-e901-4bda-944f-c48420eaad7a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:24.760095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a084efb5-e901-4bda-944f-c48420eaad7a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:24.760807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a084efb5-e901-4bda-944f-c48420eaad7a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:24.993325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a084efb5-e901-4bda-944f-c48420eaad7a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:24.999223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:25.012292 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a084efb5-e901-4bda-944f-c48420eaad7a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.266588 Jul 28 03:39:25.013775 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 482/922] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:24 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:25.043381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-651419a5-ba0f-4567-97e5-8af9bd2b353d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-855192227"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:25.064542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-651419a5-ba0f-4567-97e5-8af9bd2b353d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:25.074634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-651419a5-ba0f-4567-97e5-8af9bd2b353d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:25.075258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-651419a5-ba0f-4567-97e5-8af9bd2b353d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:25.076122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-651419a5-ba0f-4567-97e5-8af9bd2b353d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:25.076656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-651419a5-ba0f-4567-97e5-8af9bd2b353d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:25.206643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=12 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:25.440781 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-651419a5-ba0f-4567-97e5-8af9bd2b353d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.391057 Jul 28 03:39:25.447186 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 483/923] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:39:25 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 28 03:39:25.464139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f9c64d6b-96d1-4312-aa34-1486f12aeba7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:25.464513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f9c64d6b-96d1-4312-aa34-1486f12aeba7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:25.473481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9c64d6b-96d1-4312-aa34-1486f12aeba7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:25.474039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9c64d6b-96d1-4312-aa34-1486f12aeba7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:25.475025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9c64d6b-96d1-4312-aa34-1486f12aeba7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:25.475558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9c64d6b-96d1-4312-aa34-1486f12aeba7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:25.479760 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:39:25.480182 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:39:25.480700 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:39:25.481103 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:39:25.481525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:39:25.500526 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:25.501071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:25.501978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:25.502415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:25.548862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Getting quotas for project 006f4f23380b45fab24edfea5be8f3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:39:25.558906 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Getting quotas for user 15947ba65c714e0dbb60fc36afcb9a9c and project 006f4f23380b45fab24edfea5be8f3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:39:25.577485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:39:25.580592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:39:25.624691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:25.674438 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-59e5db90-1ca8-4c21-9866-f430a8b33120 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.490030 Jul 28 03:39:25.679991 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 441/924] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:39:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 3500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:39:25.719698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9a2ea566-22d2-468d-a52f-3d8921779052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:25.722155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9a2ea566-22d2-468d-a52f-3d8921779052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:25.737183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a2ea566-22d2-468d-a52f-3d8921779052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:25.740302 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a2ea566-22d2-468d-a52f-3d8921779052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:25.744252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a2ea566-22d2-468d-a52f-3d8921779052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:25.745062 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a2ea566-22d2-468d-a52f-3d8921779052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:25.772992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f9c64d6b-96d1-4312-aa34-1486f12aeba7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:25.784208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f9c64d6b-96d1-4312-aa34-1486f12aeba7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:25.786404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f9c64d6b-96d1-4312-aa34-1486f12aeba7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:25.787970 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f9c64d6b-96d1-4312-aa34-1486f12aeba7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1410 microversion: 2.25 time: 0.340075 Jul 28 03:39:25.789249 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 484/925] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:39:25 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1410 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:25.798311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-245ede99-4059-4a0a-a368-c253c18aaa28 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:25.800029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-245ede99-4059-4a0a-a368-c253c18aaa28 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:25.836745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-245ede99-4059-4a0a-a368-c253c18aaa28 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:25.839786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-245ede99-4059-4a0a-a368-c253c18aaa28 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:25.841793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-245ede99-4059-4a0a-a368-c253c18aaa28 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:25.845486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-245ede99-4059-4a0a-a368-c253c18aaa28 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:25.919488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-245ede99-4059-4a0a-a368-c253c18aaa28 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:39:26.136700 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-245ede99-4059-4a0a-a368-c253c18aaa28 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 204 len: 0 microversion: 2.1 time: 0.343172 Jul 28 03:39:26.139855 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 485/926] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:39:25 2022] DELETE /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:39:26.177418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f204a88e-bf41-48f1-89eb-cb26ca402824 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:26.183143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f204a88e-bf41-48f1-89eb-cb26ca402824 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:26.300427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9a2ea566-22d2-468d-a52f-3d8921779052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:26.337086 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9a2ea566-22d2-468d-a52f-3d8921779052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 0.652974 Jul 28 03:39:26.339762 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 442/927] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:25 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:26.371018 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-243bba8a-8028-4458-8449-bb5c265a6dae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:26.391030 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-243bba8a-8028-4458-8449-bb5c265a6dae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:26.448751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f204a88e-bf41-48f1-89eb-cb26ca402824 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:26.449266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-243bba8a-8028-4458-8449-bb5c265a6dae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:26.453304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-243bba8a-8028-4458-8449-bb5c265a6dae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:26.455098 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-243bba8a-8028-4458-8449-bb5c265a6dae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:26.455927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-243bba8a-8028-4458-8449-bb5c265a6dae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:26.481670 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f204a88e-bf41-48f1-89eb-cb26ca402824 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1235 microversion: 2.1 time: 0.327977 Jul 28 03:39:26.486699 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 486/928] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:26 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1235 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:26.525382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bff34e7f-ca6d-48da-a5a0-e76c4d3c42bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:26.526317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bff34e7f-ca6d-48da-a5a0-e76c4d3c42bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:26.557138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:26.565445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bff34e7f-ca6d-48da-a5a0-e76c4d3c42bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:26.574877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bff34e7f-ca6d-48da-a5a0-e76c4d3c42bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:26.579655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bff34e7f-ca6d-48da-a5a0-e76c4d3c42bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:26.580692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bff34e7f-ca6d-48da-a5a0-e76c4d3c42bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:27.253476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-243bba8a-8028-4458-8449-bb5c265a6dae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:27.269723 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-243bba8a-8028-4458-8449-bb5c265a6dae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1314 microversion: 2.1 time: 0.919001 Jul 28 03:39:27.272164 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 443/929] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:26 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1314 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:27.281677 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-44794ef7-3efc-49eb-a134-03ba3e148ea2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:27.282565 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-44794ef7-3efc-49eb-a134-03ba3e148ea2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:27.306566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44794ef7-3efc-49eb-a134-03ba3e148ea2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:27.307293 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44794ef7-3efc-49eb-a134-03ba3e148ea2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:27.308268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44794ef7-3efc-49eb-a134-03ba3e148ea2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:27.309068 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44794ef7-3efc-49eb-a134-03ba3e148ea2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:27.412637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bff34e7f-ca6d-48da-a5a0-e76c4d3c42bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:27.424108 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bff34e7f-ca6d-48da-a5a0-e76c4d3c42bd tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1708 microversion: 2.1 time: 0.930740 Jul 28 03:39:27.424787 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 487/930] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:26 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1708 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:27.449256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-edb6c15b-96c8-449d-adee-d66e857b7a55 req-df6466f0-8f75-42f1-92c2-a3473f217d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4b8ffa-dbe6-4e90-a8f5-728addf73aae", "name": "network-vif-unplugged", "status": "completed", "tag": "3931df07-76f1-4feb-a179-d48d42b61b21"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:27.488227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-edb6c15b-96c8-449d-adee-d66e857b7a55 req-df6466f0-8f75-42f1-92c2-a3473f217d17 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:27.489135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-edb6c15b-96c8-449d-adee-d66e857b7a55 req-df6466f0-8f75-42f1-92c2-a3473f217d17 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:27.516076 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-edb6c15b-96c8-449d-adee-d66e857b7a55 req-df6466f0-8f75-42f1-92c2-a3473f217d17 service nova] Creating event network-vif-unplugged:3931df07-76f1-4feb-a179-d48d42b61b21 for instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae on n-h2-826756-3 Jul 28 03:39:27.531992 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-edb6c15b-96c8-449d-adee-d66e857b7a55 req-df6466f0-8f75-42f1-92c2-a3473f217d17 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104508 Jul 28 03:39:27.533261 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 488/931] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:27.548733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-24390488-e16e-4167-bd3b-3f93c814b4c0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:27.550293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-24390488-e16e-4167-bd3b-3f93c814b4c0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:27.571451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24390488-e16e-4167-bd3b-3f93c814b4c0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:27.572506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24390488-e16e-4167-bd3b-3f93c814b4c0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:27.573503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24390488-e16e-4167-bd3b-3f93c814b4c0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:27.574102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24390488-e16e-4167-bd3b-3f93c814b4c0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:27.899011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-44794ef7-3efc-49eb-a134-03ba3e148ea2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:27.919091 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-44794ef7-3efc-49eb-a134-03ba3e148ea2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:27.921530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-44794ef7-3efc-49eb-a134-03ba3e148ea2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:27.923647 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-44794ef7-3efc-49eb-a134-03ba3e148ea2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1410 microversion: 2.25 time: 0.649611 Jul 28 03:39:27.928733 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 444/932] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:39:27 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1410 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:27.945665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c4e9bc1c-45ff-43d2-a2c3-856176cd795b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:27.947526 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c4e9bc1c-45ff-43d2-a2c3-856176cd795b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:27.966752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4e9bc1c-45ff-43d2-a2c3-856176cd795b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:27.968391 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4e9bc1c-45ff-43d2-a2c3-856176cd795b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:27.969605 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4e9bc1c-45ff-43d2-a2c3-856176cd795b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:27.970322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4e9bc1c-45ff-43d2-a2c3-856176cd795b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:28.178380 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c4e9bc1c-45ff-43d2-a2c3-856176cd795b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:28.206056 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c4e9bc1c-45ff-43d2-a2c3-856176cd795b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1239 microversion: 2.1 time: 0.275192 Jul 28 03:39:28.224623 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 445/933] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:27 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1239 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:28.699178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-de5755f0-a9b4-4b2f-bb7d-1d56459a6021 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Calling method '.version_select at 0x7ffa74874280>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:28.741281 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-de5755f0-a9b4-4b2f-bb7d-1d56459a6021 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] HTTP exception thrown: Image not found. Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-de5755f0-a9b4-4b2f-bb7d-1d56459a6021 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Request method failure captured: Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/images/6fabc2e7-22f0-4657-9281-5a9cf7bcc232/metadata/os_distro HTTP/1.1 Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gTvYAXluZ9xKtSYkctRf6PgTySJ__phKywTajx5qFMrI9XiUkwruHAHif6nIVQX6t2vO6EHVhpwCcpcELjDr8r3B6o3RMb7NpJVom6w9EyQnGbJ11c7QW2GLYQVcqrJp4xqgD4RPeXQfdAj7EVP0v372Duqt19u8XsJoJ-JmgEluJI Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 727ede22a0f1490bb4b1c4bea789b28e Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:39:28.748750 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:39:28.750473 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/727ede22a0f1490bb4b1c4bea789b28e"}]}] Jul 28 03:39:28.750473 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:28.750473 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 727ede22a0f1490bb4b1c4bea789b28e Jul 28 03:39:28.750473 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:28.750473 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesMetadataNegativeTestJSON-794317439-project Jul 28 03:39:28.750473 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:39:28.750473 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:39:28.750473 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 9aa750dc7a7b48fa8c2038df07a1556f Jul 28 03:39:28.750473 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-794317439-project Jul 28 03:39:28.750473 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:39:28.750473 n-d-826756-3 devstack@n-api.service[126072]: exception: Image not found. Jul 28 03:39:28.750473 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'image_id': '6fabc2e7-22f0-4657-9281-5a9cf7bcc232', 'id': 'os_distro'} Jul 28 03:39:28.750473 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:28.751471 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6fabc2e7-22f0-4657-9281-5a9cf7bcc232 Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:28.753162 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6fabc2e7-22f0-4657-9281-5a9cf7bcc232 could not be found. Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:39:28.755490 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:28.757800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-de5755f0-a9b4-4b2f-bb7d-1d56459a6021 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Returning 404 to user: Image not found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:28.765671 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-de5755f0-a9b4-4b2f-bb7d-1d56459a6021 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] 10.222.0.48 "DELETE /compute/v2.1/images/6fabc2e7-22f0-4657-9281-5a9cf7bcc232/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.528474 Jul 28 03:39:28.765671 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 446/934] 10.222.0.48 () {58 vars in 1293 bytes} [Thu Jul 28 03:39:28 2022] DELETE /compute/v2.1/images/6fabc2e7-22f0-4657-9281-5a9cf7bcc232/metadata/os_distro => generated 62 bytes in 531 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:39:28.778990 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-670b130b-2b2c-4a54-8a7a-87d47fe2dcb2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:28.784944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-670b130b-2b2c-4a54-8a7a-87d47fe2dcb2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:28.833985 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-670b130b-2b2c-4a54-8a7a-87d47fe2dcb2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:28.836814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-670b130b-2b2c-4a54-8a7a-87d47fe2dcb2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:28.838838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-670b130b-2b2c-4a54-8a7a-87d47fe2dcb2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:28.846678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-670b130b-2b2c-4a54-8a7a-87d47fe2dcb2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:29.394583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-24390488-e16e-4167-bd3b-3f93c814b4c0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:29.418335 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-24390488-e16e-4167-bd3b-3f93c814b4c0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 1.883301 Jul 28 03:39:29.428488 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 489/935] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:27 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:29.469273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4685e8d3-e552-405d-a98c-f692a3ac21a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:29.470550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4685e8d3-e552-405d-a98c-f692a3ac21a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:29.502187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4685e8d3-e552-405d-a98c-f692a3ac21a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:29.509774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4685e8d3-e552-405d-a98c-f692a3ac21a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:29.510759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4685e8d3-e552-405d-a98c-f692a3ac21a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:29.515262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4685e8d3-e552-405d-a98c-f692a3ac21a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:30.049353 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-670b130b-2b2c-4a54-8a7a-87d47fe2dcb2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:30.059716 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-670b130b-2b2c-4a54-8a7a-87d47fe2dcb2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1314 microversion: 2.1 time: 1.299625 Jul 28 03:39:30.072395 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 447/936] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:28 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1314 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:30.077043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-3e3c44a3-1a75-4f38-80e5-83ea920fe16c req-c58e9d3e-92ef-4407-9762-b3c9fa5d0202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db682d4c-b880-4215-acf1-18c6d7118aca", "tag": "768b4449-0aa9-474a-a899-7501e3428c00"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:30.123998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3e3c44a3-1a75-4f38-80e5-83ea920fe16c req-c58e9d3e-92ef-4407-9762-b3c9fa5d0202 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:30.124560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3e3c44a3-1a75-4f38-80e5-83ea920fe16c req-c58e9d3e-92ef-4407-9762-b3c9fa5d0202 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:30.142501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4685e8d3-e552-405d-a98c-f692a3ac21a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:30.168723 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4685e8d3-e552-405d-a98c-f692a3ac21a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1708 microversion: 2.1 time: 0.733403 Jul 28 03:39:30.170788 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 490/937] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:29 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1708 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:30.174473 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-3e3c44a3-1a75-4f38-80e5-83ea920fe16c req-c58e9d3e-92ef-4407-9762-b3c9fa5d0202 service nova] Creating event network-changed:768b4449-0aa9-474a-a899-7501e3428c00 for instance db682d4c-b880-4215-acf1-18c6d7118aca on n-h1-826756-3 Jul 28 03:39:30.185131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3a40128c-99dc-4430-80d8-a6e64817534d tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Calling method '.version_select at 0x7ffa74550ee0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:30.186254 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-3e3c44a3-1a75-4f38-80e5-83ea920fe16c req-c58e9d3e-92ef-4407-9762-b3c9fa5d0202 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116428 Jul 28 03:39:30.186879 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 448/938] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:30.205064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e820ce75-f235-41f3-93dc-a92126b666dd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:30.205779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e820ce75-f235-41f3-93dc-a92126b666dd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:30.220287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e820ce75-f235-41f3-93dc-a92126b666dd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:30.220782 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e820ce75-f235-41f3-93dc-a92126b666dd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:30.221617 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e820ce75-f235-41f3-93dc-a92126b666dd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:30.224331 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-3a40128c-99dc-4430-80d8-a6e64817534d tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] HTTP exception thrown: Image not found. Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3a40128c-99dc-4430-80d8-a6e64817534d tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Request method failure captured: Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/images/32ad0aba-2907-4ab1-a1bb-85773a68c377/metadata/os_version HTTP/1.1 Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gTvYAXluZ9xKtSYkctRf6PgTySJ__phKywTajx5qFMrI9XiUkwruHAHif6nIVQX6t2vO6EHVhpwCcpcELjDr8r3B6o3RMb7NpJVom6w9EyQnGbJ11c7QW2GLYQVcqrJp4xqgD4RPeXQfdAj7EVP0v372Duqt19u8XsJoJ-JmgEluJI Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 727ede22a0f1490bb4b1c4bea789b28e Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:30.227470 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:30.229306 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/727ede22a0f1490bb4b1c4bea789b28e"}]}] Jul 28 03:39:30.229306 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:30.229306 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 727ede22a0f1490bb4b1c4bea789b28e Jul 28 03:39:30.229306 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:30.229306 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesMetadataNegativeTestJSON-794317439-project Jul 28 03:39:30.229306 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:30.229306 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:30.229306 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 9aa750dc7a7b48fa8c2038df07a1556f Jul 28 03:39:30.229306 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-794317439-project Jul 28 03:39:30.229306 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:39:30.229306 n-d-826756-3 devstack@n-api.service[126071]: exception: Image not found. Jul 28 03:39:30.229306 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'image_id': '32ad0aba-2907-4ab1-a1bb-85773a68c377', 'id': 'os_version'} Jul 28 03:39:30.229306 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:30.230192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 32ad0aba-2907-4ab1-a1bb-85773a68c377 Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:30.231300 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 32ad0aba-2907-4ab1-a1bb-85773a68c377 could not be found. Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:39:30.234505 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:39:30.237192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:30.240070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e820ce75-f235-41f3-93dc-a92126b666dd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:30.241034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3a40128c-99dc-4430-80d8-a6e64817534d tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Returning 404 to user: Image not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:30.243810 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3a40128c-99dc-4430-80d8-a6e64817534d tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] 10.222.0.48 "GET /compute/v2.1/images/32ad0aba-2907-4ab1-a1bb-85773a68c377/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.068212 Jul 28 03:39:30.244932 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 491/939] 10.222.0.48 () {58 vars in 1293 bytes} [Thu Jul 28 03:39:30 2022] GET /compute/v2.1/images/32ad0aba-2907-4ab1-a1bb-85773a68c377/metadata/os_version => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:39:30.254854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af67566a-db4c-4da7-ba07-60361ad34a82 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:30.255951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-af67566a-db4c-4da7-ba07-60361ad34a82 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:30.265188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af67566a-db4c-4da7-ba07-60361ad34a82 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:30.266716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af67566a-db4c-4da7-ba07-60361ad34a82 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:30.268150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af67566a-db4c-4da7-ba07-60361ad34a82 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:30.268924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af67566a-db4c-4da7-ba07-60361ad34a82 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:30.726219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e820ce75-f235-41f3-93dc-a92126b666dd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:30.742715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e820ce75-f235-41f3-93dc-a92126b666dd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:30.745031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e820ce75-f235-41f3-93dc-a92126b666dd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:30.746227 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e820ce75-f235-41f3-93dc-a92126b666dd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1410 microversion: 2.25 time: 0.552994 Jul 28 03:39:30.766021 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 449/940] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:39:30 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1410 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:30.771552 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-899edbf5-a43b-41aa-b3b9-95dca2ea314c tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Calling method '.version_select at 0x7ffa748ec940>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:30.818895 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-899edbf5-a43b-41aa-b3b9-95dca2ea314c tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] HTTP exception thrown: Image not found. Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-899edbf5-a43b-41aa-b3b9-95dca2ea314c tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Request method failure captured: Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/images/c391ca88-1686-42df-900f-f38eafa9d823/metadata HTTP/1.1 Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gTvYAXluZ9xKtSYkctRf6PgTySJ__phKywTajx5qFMrI9XiUkwruHAHif6nIVQX6t2vO6EHVhpwCcpcELjDr8r3B6o3RMb7NpJVom6w9EyQnGbJ11c7QW2GLYQVcqrJp4xqgD4RPeXQfdAj7EVP0v372Duqt19u8XsJoJ-JmgEluJI Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 727ede22a0f1490bb4b1c4bea789b28e Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:39:30.821194 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:39:30.822976 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/727ede22a0f1490bb4b1c4bea789b28e"}]}] Jul 28 03:39:30.822976 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:30.822976 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 727ede22a0f1490bb4b1c4bea789b28e Jul 28 03:39:30.822976 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:30.822976 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesMetadataNegativeTestJSON-794317439-project Jul 28 03:39:30.822976 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:39:30.822976 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:39:30.822976 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 9aa750dc7a7b48fa8c2038df07a1556f Jul 28 03:39:30.822976 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-794317439-project Jul 28 03:39:30.822976 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:39:30.822976 n-d-826756-3 devstack@n-api.service[126072]: exception: Image not found. Jul 28 03:39:30.822976 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'image_id': 'c391ca88-1686-42df-900f-f38eafa9d823'} Jul 28 03:39:30.822976 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:30.823850 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c391ca88-1686-42df-900f-f38eafa9d823 Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:30.825515 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c391ca88-1686-42df-900f-f38eafa9d823 could not be found. Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:39:30.826760 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:30.828121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-899edbf5-a43b-41aa-b3b9-95dca2ea314c tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Returning 404 to user: Image not found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:30.829393 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-899edbf5-a43b-41aa-b3b9-95dca2ea314c tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] 10.222.0.48 "GET /compute/v2.1/images/c391ca88-1686-42df-900f-f38eafa9d823/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055630 Jul 28 03:39:30.829393 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 450/941] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Jul 28 03:39:30 2022] GET /compute/v2.1/images/c391ca88-1686-42df-900f-f38eafa9d823/metadata => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:39:30.829393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3cf14bb3-1168-4338-8195-f6c625ea3431 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:30.832757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3cf14bb3-1168-4338-8195-f6c625ea3431 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:30.857142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3cf14bb3-1168-4338-8195-f6c625ea3431 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:30.864569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3cf14bb3-1168-4338-8195-f6c625ea3431 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:30.866116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3cf14bb3-1168-4338-8195-f6c625ea3431 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:30.866896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3cf14bb3-1168-4338-8195-f6c625ea3431 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:30.890431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-af67566a-db4c-4da7-ba07-60361ad34a82 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:30.909422 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-af67566a-db4c-4da7-ba07-60361ad34a82 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1293 microversion: 2.1 time: 0.662487 Jul 28 03:39:30.921947 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 492/942] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:30 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1293 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:30.933940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6aca3cba-3fb1-41cf-b809-f6644210266e req-5cbc69c4-bf3a-4eb2-9863-db265b641a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcbae58d-a326-4197-a350-9278d664d3e7", "name": "network-vif-plugged", "status": "completed", "tag": "1c43a93b-de22-40be-a837-98a92e1f0f4c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:30.973531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6aca3cba-3fb1-41cf-b809-f6644210266e req-5cbc69c4-bf3a-4eb2-9863-db265b641a1d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:30.974247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6aca3cba-3fb1-41cf-b809-f6644210266e req-5cbc69c4-bf3a-4eb2-9863-db265b641a1d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:31.020226 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6aca3cba-3fb1-41cf-b809-f6644210266e req-5cbc69c4-bf3a-4eb2-9863-db265b641a1d service nova] Creating event network-vif-plugged:1c43a93b-de22-40be-a837-98a92e1f0f4c for instance fcbae58d-a326-4197-a350-9278d664d3e7 on n-h1-826756-3 Jul 28 03:39:31.039550 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6aca3cba-3fb1-41cf-b809-f6644210266e req-5cbc69c4-bf3a-4eb2-9863-db265b641a1d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115957 Jul 28 03:39:31.040163 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 493/943] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:31.053461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a26b5bd-b441-4727-aab7-258ecf3f1477 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Action: 'update_all', calling method: .version_select at 0x7ffa74654af0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:31.124241 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-9a26b5bd-b441-4727-aab7-258ecf3f1477 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] HTTP exception thrown: Image not found. Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a26b5bd-b441-4727-aab7-258ecf3f1477 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Request method failure captured: Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: request: PUT /compute/v2.1/images/e13e3990-0d58-459a-91c3-536ca7856958/metadata HTTP/1.1 Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 57 Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gTvYAXluZ9xKtSYkctRf6PgTySJ__phKywTajx5qFMrI9XiUkwruHAHif6nIVQX6t2vO6EHVhpwCcpcELjDr8r3B6o3RMb7NpJVom6w9EyQnGbJ11c7QW2GLYQVcqrJp4xqgD4RPeXQfdAj7EVP0v372Duqt19u8XsJoJ-JmgEluJI Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 727ede22a0f1490bb4b1c4bea789b28e Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:31.127773 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:31.130428 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/727ede22a0f1490bb4b1c4bea789b28e"}]}] Jul 28 03:39:31.130428 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:31.130428 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 727ede22a0f1490bb4b1c4bea789b28e Jul 28 03:39:31.130428 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:31.130428 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesMetadataNegativeTestJSON-794317439-project Jul 28 03:39:31.130428 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:31.130428 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:31.130428 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 9aa750dc7a7b48fa8c2038df07a1556f Jul 28 03:39:31.130428 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-794317439-project Jul 28 03:39:31.130428 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:39:31.130428 n-d-826756-3 devstack@n-api.service[126071]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 28 03:39:31.130428 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:39:31.130428 n-d-826756-3 devstack@n-api.service[126071]: exception: Image not found. Jul 28 03:39:31.130428 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'image_id': 'e13e3990-0d58-459a-91c3-536ca7856958', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:31.133118 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e13e3990-0d58-459a-91c3-536ca7856958 Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:39:31.135728 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e13e3990-0d58-459a-91c3-536ca7856958 could not be found. Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:31.137904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:39:31.139381 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.142392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a26b5bd-b441-4727-aab7-258ecf3f1477 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Returning 404 to user: Image not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:31.143570 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9a26b5bd-b441-4727-aab7-258ecf3f1477 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] 10.222.0.48 "PUT /compute/v2.1/images/e13e3990-0d58-459a-91c3-536ca7856958/metadata" status: 404 len: 62 microversion: 2.1 time: 0.094951 Jul 28 03:39:31.145573 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 494/944] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:39:31 2022] PUT /compute/v2.1/images/e13e3990-0d58-459a-91c3-536ca7856958/metadata => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:39:31.155951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-903e6481-3ce7-4c49-96a3-d7981f724b4d tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:31.157140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-903e6481-3ce7-4c49-96a3-d7981f724b4d tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:31.171293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-903e6481-3ce7-4c49-96a3-d7981f724b4d tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:31.172344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-903e6481-3ce7-4c49-96a3-d7981f724b4d tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:31.173355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-903e6481-3ce7-4c49-96a3-d7981f724b4d tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:31.174327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-903e6481-3ce7-4c49-96a3-d7981f724b4d tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:31.197550 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-903e6481-3ce7-4c49-96a3-d7981f724b4d tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] HTTP exception thrown: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-903e6481-3ce7-4c49-96a3-d7981f724b4d tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Request method failure captured: Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 HTTP/1.1 Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gQTocUzG4mwW0goW0PWtVK7KLvt1rxEkCkdi7OQqIGAWU3VJeICqHcMyApHblLH7r9VUzFsAqSL21UdcW4yP-gEH-6FJlc4fHQYTo8bmlDcC9xIluj_dfpTcb9lxMjTRy3qNOLch2FpfqXyflcb-JnpkLAFH7Z_ALnoA3LyVjj0SDY Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: dc91ad107318444881db8af480262a29 Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-251982860 Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:31.199753 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:31.201540 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc91ad107318444881db8af480262a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc91ad107318444881db8af480262a29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc91ad107318444881db8af480262a29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc91ad107318444881db8af480262a29"}]}] Jul 28 03:39:31.201540 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-251982860 Jul 28 03:39:31.201540 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: dc91ad107318444881db8af480262a29 Jul 28 03:39:31.201540 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-251982860 Jul 28 03:39:31.201540 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachSCSIVolumeTestJSON-251982860-project Jul 28 03:39:31.201540 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:31.201540 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:31.201540 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d3843d34282c4e319380ec87b584e2c4 Jul 28 03:39:31.201540 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-251982860-project Jul 28 03:39:31.201540 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:39:31.201540 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:31.201540 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8280d682-4608-420d-8bee-48984a6c1a01'} Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:31.202453 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:31.203991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.207252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-903e6481-3ce7-4c49-96a3-d7981f724b4d tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Returning 404 to user: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:31.209207 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-903e6481-3ce7-4c49-96a3-d7981f724b4d tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 404 len: 111 microversion: 2.1 time: 0.060780 Jul 28 03:39:31.210084 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 495/945] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:39:31 2022] DELETE /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:31.222632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a66e8854-d39b-409e-a789-2dd9e11f0671 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:31.223548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a66e8854-d39b-409e-a789-2dd9e11f0671 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:31.231216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a66e8854-d39b-409e-a789-2dd9e11f0671 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:31.232055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a66e8854-d39b-409e-a789-2dd9e11f0671 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:31.238831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a66e8854-d39b-409e-a789-2dd9e11f0671 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:31.239593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a66e8854-d39b-409e-a789-2dd9e11f0671 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:31.667696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a66e8854-d39b-409e-a789-2dd9e11f0671 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:31.679027 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a66e8854-d39b-409e-a789-2dd9e11f0671 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1314 microversion: 2.1 time: 0.467043 Jul 28 03:39:31.692728 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 496/946] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:31 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:31.702933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17e5604e-6db2-467b-bc3e-313f6bf09892 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Action: 'update', calling method: .version_select at 0x7ffa745e1790>, body: {"meta": {"os_distro": "alt"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:31.747721 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-17e5604e-6db2-467b-bc3e-313f6bf09892 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] HTTP exception thrown: Image not found. Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17e5604e-6db2-467b-bc3e-313f6bf09892 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Request method failure captured: Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: request: PUT /compute/v2.1/images/5ffb3f85-b823-4327-a0a7-903638a60392/metadata/os_distro HTTP/1.1 Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 30 Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gTvYAXluZ9xKtSYkctRf6PgTySJ__phKywTajx5qFMrI9XiUkwruHAHif6nIVQX6t2vO6EHVhpwCcpcELjDr8r3B6o3RMb7NpJVom6w9EyQnGbJ11c7QW2GLYQVcqrJp4xqgD4RPeXQfdAj7EVP0v372Duqt19u8XsJoJ-JmgEluJI Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 727ede22a0f1490bb4b1c4bea789b28e Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:31.756859 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:31.758422 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/727ede22a0f1490bb4b1c4bea789b28e"}]}] Jul 28 03:39:31.758422 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:31.758422 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 727ede22a0f1490bb4b1c4bea789b28e Jul 28 03:39:31.758422 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:31.758422 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesMetadataNegativeTestJSON-794317439-project Jul 28 03:39:31.758422 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:31.758422 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:31.758422 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 9aa750dc7a7b48fa8c2038df07a1556f Jul 28 03:39:31.758422 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-794317439-project Jul 28 03:39:31.758422 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:39:31.758422 n-d-826756-3 devstack@n-api.service[126071]: {"meta": {"os_distro": "alt"}} Jul 28 03:39:31.758422 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:39:31.758422 n-d-826756-3 devstack@n-api.service[126071]: exception: Image not found. Jul 28 03:39:31.758422 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'image_id': '5ffb3f85-b823-4327-a0a7-903638a60392', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:31.759387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5ffb3f85-b823-4327-a0a7-903638a60392 Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:39:31.760532 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5ffb3f85-b823-4327-a0a7-903638a60392 could not be found. Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:31.761653 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:39:31.762859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:31.764290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17e5604e-6db2-467b-bc3e-313f6bf09892 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Returning 404 to user: Image not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:31.764290 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-17e5604e-6db2-467b-bc3e-313f6bf09892 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] 10.222.0.48 "PUT /compute/v2.1/images/5ffb3f85-b823-4327-a0a7-903638a60392/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.063382 Jul 28 03:39:31.783274 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 497/947] 10.222.0.48 () {60 vars in 1310 bytes} [Thu Jul 28 03:39:31 2022] PUT /compute/v2.1/images/5ffb3f85-b823-4327-a0a7-903638a60392/metadata/os_distro => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:39:31.792106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bfa567c1-527f-4354-9859-6e8c31685f57 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:31.797541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bfa567c1-527f-4354-9859-6e8c31685f57 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:31.822479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfa567c1-527f-4354-9859-6e8c31685f57 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:31.824333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfa567c1-527f-4354-9859-6e8c31685f57 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:31.825581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfa567c1-527f-4354-9859-6e8c31685f57 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:31.831185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfa567c1-527f-4354-9859-6e8c31685f57 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:32.266012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bfa567c1-527f-4354-9859-6e8c31685f57 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876dd26de70496cbca6b3c066d72170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc92b66c7414566a24bf7f67535fd94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:32.306930 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bfa567c1-527f-4354-9859-6e8c31685f57 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 200 len: 1641 microversion: 2.1 time: 0.521409 Jul 28 03:39:32.319373 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 498/948] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:31 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 1641 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:32.330090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6c517f63-57d6-4a7a-83b1-30fa7a64bbdd tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:32.331078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6c517f63-57d6-4a7a-83b1-30fa7a64bbdd tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] [instance: 8280d682-4608-420d-8bee-48984a6c1a01] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:32.358944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c517f63-57d6-4a7a-83b1-30fa7a64bbdd tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:32.366648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c517f63-57d6-4a7a-83b1-30fa7a64bbdd tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:32.367876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c517f63-57d6-4a7a-83b1-30fa7a64bbdd tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:32.371321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c517f63-57d6-4a7a-83b1-30fa7a64bbdd tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:32.407481 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-6c517f63-57d6-4a7a-83b1-30fa7a64bbdd tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] HTTP exception thrown: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6c517f63-57d6-4a7a-83b1-30fa7a64bbdd tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Request method failure captured: Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 HTTP/1.1 Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gQTocUzG4mwW0goW0PWtVK7KLvt1rxEkCkdi7OQqIGAWU3VJeICqHcMyApHblLH7r9VUzFsAqSL21UdcW4yP-gEH-6FJlc4fHQYTo8bmlDcC9xIluj_dfpTcb9lxMjTRy3qNOLch2FpfqXyflcb-JnpkLAFH7Z_ALnoA3LyVjj0SDY Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: dc91ad107318444881db8af480262a29 Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-251982860 Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:32.412183 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:32.414930 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc91ad107318444881db8af480262a29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc91ad107318444881db8af480262a29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc91ad107318444881db8af480262a29"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc91ad107318444881db8af480262a29"}]}] Jul 28 03:39:32.414930 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-251982860 Jul 28 03:39:32.414930 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: dc91ad107318444881db8af480262a29 Jul 28 03:39:32.414930 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-251982860 Jul 28 03:39:32.414930 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachSCSIVolumeTestJSON-251982860-project Jul 28 03:39:32.414930 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:32.414930 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:32.414930 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d3843d34282c4e319380ec87b584e2c4 Jul 28 03:39:32.414930 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-251982860-project Jul 28 03:39:32.414930 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:39:32.414930 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:32.414930 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8280d682-4608-420d-8bee-48984a6c1a01'} Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:32.416374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. Jul 28 03:39:32.417837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:32.418930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6c517f63-57d6-4a7a-83b1-30fa7a64bbdd tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] Returning 404 to user: Instance 8280d682-4608-420d-8bee-48984a6c1a01 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:32.418930 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6c517f63-57d6-4a7a-83b1-30fa7a64bbdd tempest-AttachSCSIVolumeTestJSON-251982860 tempest-AttachSCSIVolumeTestJSON-251982860-project] 10.222.0.48 "GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01" status: 404 len: 111 microversion: 2.1 time: 0.093660 Jul 28 03:39:32.422943 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 499/949] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:32 2022] GET /compute/v2.1/servers/8280d682-4608-420d-8bee-48984a6c1a01 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:32.438105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f12ec7d-b5de-45e8-be7f-b8d8ad61f695 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Action: 'create', calling method: .version_select at 0x7ffa745e1160>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:32.481395 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-8f12ec7d-b5de-45e8-be7f-b8d8ad61f695 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] HTTP exception thrown: Image not found. Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f12ec7d-b5de-45e8-be7f-b8d8ad61f695 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Request method failure captured: Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/images/880c823f-a790-44e2-9b7f-bdacf10bd303/metadata HTTP/1.1 Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 57 Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gTvYAXluZ9xKtSYkctRf6PgTySJ__phKywTajx5qFMrI9XiUkwruHAHif6nIVQX6t2vO6EHVhpwCcpcELjDr8r3B6o3RMb7NpJVom6w9EyQnGbJ11c7QW2GLYQVcqrJp4xqgD4RPeXQfdAj7EVP0v372Duqt19u8XsJoJ-JmgEluJI Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 727ede22a0f1490bb4b1c4bea789b28e Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:32.483576 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:32.485244 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_727ede22a0f1490bb4b1c4bea789b28e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/727ede22a0f1490bb4b1c4bea789b28e"}]}] Jul 28 03:39:32.485244 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:32.485244 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 727ede22a0f1490bb4b1c4bea789b28e Jul 28 03:39:32.485244 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-794317439 Jul 28 03:39:32.485244 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesMetadataNegativeTestJSON-794317439-project Jul 28 03:39:32.485244 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:32.485244 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:32.485244 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 9aa750dc7a7b48fa8c2038df07a1556f Jul 28 03:39:32.485244 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-794317439-project Jul 28 03:39:32.485244 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:39:32.485244 n-d-826756-3 devstack@n-api.service[126071]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 28 03:39:32.485244 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:39:32.485244 n-d-826756-3 devstack@n-api.service[126071]: exception: Image not found. Jul 28 03:39:32.485244 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'image_id': '880c823f-a790-44e2-9b7f-bdacf10bd303', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:32.486433 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 880c823f-a790-44e2-9b7f-bdacf10bd303 Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:39:32.487759 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 880c823f-a790-44e2-9b7f-bdacf10bd303 could not be found. Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:32.490018 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:39:32.492546 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:32.503352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f12ec7d-b5de-45e8-be7f-b8d8ad61f695 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] Returning 404 to user: Image not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:32.503352 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8f12ec7d-b5de-45e8-be7f-b8d8ad61f695 tempest-ImagesMetadataNegativeTestJSON-794317439 tempest-ImagesMetadataNegativeTestJSON-794317439-project] 10.222.0.48 "POST /compute/v2.1/images/880c823f-a790-44e2-9b7f-bdacf10bd303/metadata" status: 404 len: 62 microversion: 2.1 time: 0.068352 Jul 28 03:39:32.503352 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 500/950] 10.222.0.48 () {60 vars in 1281 bytes} [Thu Jul 28 03:39:32 2022] POST /compute/v2.1/images/880c823f-a790-44e2-9b7f-bdacf10bd303/metadata => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:39:32.512903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc7e285e-3bc3-4a3d-8c97-7a8b40496442 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:32.513776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cc7e285e-3bc3-4a3d-8c97-7a8b40496442 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:32.533603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc7e285e-3bc3-4a3d-8c97-7a8b40496442 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:32.542269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc7e285e-3bc3-4a3d-8c97-7a8b40496442 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:32.552724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc7e285e-3bc3-4a3d-8c97-7a8b40496442 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:32.559601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc7e285e-3bc3-4a3d-8c97-7a8b40496442 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:33.340084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3cf14bb3-1168-4338-8195-f6c625ea3431 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:33.368184 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3cf14bb3-1168-4338-8195-f6c625ea3431 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1686 microversion: 2.1 time: 2.543226 Jul 28 03:39:33.386539 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 451/951] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:30 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1686 bytes in 2561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:33.411926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d662c339-c2af-4de2-a0b6-c3d42c2b9169 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:33.420503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d662c339-c2af-4de2-a0b6-c3d42c2b9169 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:33.432916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cc7e285e-3bc3-4a3d-8c97-7a8b40496442 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:33.458699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cc7e285e-3bc3-4a3d-8c97-7a8b40496442 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:33.460964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cc7e285e-3bc3-4a3d-8c97-7a8b40496442 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:33.462226 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cc7e285e-3bc3-4a3d-8c97-7a8b40496442 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1410 microversion: 2.25 time: 0.964861 Jul 28 03:39:33.463684 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 501/952] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:39:32 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1410 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:33.464726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d662c339-c2af-4de2-a0b6-c3d42c2b9169 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:33.465996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d662c339-c2af-4de2-a0b6-c3d42c2b9169 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:33.469382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d662c339-c2af-4de2-a0b6-c3d42c2b9169 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:33.477437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d662c339-c2af-4de2-a0b6-c3d42c2b9169 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:33.480820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-13b0b339-9c5a-4b19-97e3-76614cb496a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:33.481535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-13b0b339-9c5a-4b19-97e3-76614cb496a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:33.491552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:33.493473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-13b0b339-9c5a-4b19-97e3-76614cb496a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:33.496487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-13b0b339-9c5a-4b19-97e3-76614cb496a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:33.497456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-13b0b339-9c5a-4b19-97e3-76614cb496a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:33.498057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-13b0b339-9c5a-4b19-97e3-76614cb496a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:34.947237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-13b0b339-9c5a-4b19-97e3-76614cb496a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:34.970990 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-13b0b339-9c5a-4b19-97e3-76614cb496a9 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1314 microversion: 2.1 time: 1.501202 Jul 28 03:39:34.972837 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 502/953] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:33 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1314 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:35.003381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9039a2fa-69b6-4748-8ac8-1cb58f5f13ae tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:35.004430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9039a2fa-69b6-4748-8ac8-1cb58f5f13ae tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:35.017167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9039a2fa-69b6-4748-8ac8-1cb58f5f13ae tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:35.022552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9039a2fa-69b6-4748-8ac8-1cb58f5f13ae tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:35.024285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9039a2fa-69b6-4748-8ac8-1cb58f5f13ae tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:35.027200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9039a2fa-69b6-4748-8ac8-1cb58f5f13ae tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:35.050234 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-9039a2fa-69b6-4748-8ac8-1cb58f5f13ae tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] HTTP exception thrown: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9039a2fa-69b6-4748-8ac8-1cb58f5f13ae tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Request method failure captured: Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 HTTP/1.1 Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gQzzBVjsX3X9f39BaBkndPGkFUd9FTCGdIanat6WSFokNPq-NXKh4NmjdJNY6HKKj_PUK6OUGW4utoYzXNkMdDDnLVSK2_dXp3Qzk_JWtbX3Af0rC5ERQusE97053Fv6GjGKDGE4jWHOHvRmaG-HGi5TSgpUTvNqJ0nlBymbUOjDNU Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: edc92b66c7414566a24bf7f67535fd94 Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:35.065944 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:35.067494 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc92b66c7414566a24bf7f67535fd94"}]}] Jul 28 03:39:35.067494 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:35.067494 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: edc92b66c7414566a24bf7f67535fd94 Jul 28 03:39:35.067494 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:35.067494 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1188996709-project Jul 28 03:39:35.067494 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:35.067494 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:35.067494 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d876dd26de70496cbca6b3c066d72170 Jul 28 03:39:35.067494 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709-project Jul 28 03:39:35.067494 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:39:35.067494 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:35.067494 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'fd3aa530-0f24-4157-97ab-ea9ab8423ca5'} Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:35.068266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:35.069740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:35.073075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9039a2fa-69b6-4748-8ac8-1cb58f5f13ae tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Returning 404 to user: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:35.074237 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9039a2fa-69b6-4748-8ac8-1cb58f5f13ae tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 404 len: 111 microversion: 2.1 time: 0.100106 Jul 28 03:39:35.077698 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 503/954] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:34 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:35.110691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-aa4cfe4a-4702-4458-bc23-441097e952a3 req-993c3bc0-601f-40a6-b12e-23963817396a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4b8ffa-dbe6-4e90-a8f5-728addf73aae", "name": "network-vif-plugged", "status": "completed", "tag": "3931df07-76f1-4feb-a179-d48d42b61b21"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:35.129908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-aa4cfe4a-4702-4458-bc23-441097e952a3 req-993c3bc0-601f-40a6-b12e-23963817396a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:35.130666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-aa4cfe4a-4702-4458-bc23-441097e952a3 req-993c3bc0-601f-40a6-b12e-23963817396a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:35.159021 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-aa4cfe4a-4702-4458-bc23-441097e952a3 req-993c3bc0-601f-40a6-b12e-23963817396a service nova] Creating event network-vif-plugged:3931df07-76f1-4feb-a179-d48d42b61b21 for instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae on n-h2-826756-3 Jul 28 03:39:35.172990 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-aa4cfe4a-4702-4458-bc23-441097e952a3 req-993c3bc0-601f-40a6-b12e-23963817396a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093717 Jul 28 03:39:35.176803 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 504/955] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:35.185709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b7126abf-f34d-4256-8a8b-ec2cf3983c4e req-208a7414-9fb9-4d91-88bd-9685f98d0e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd3aa530-0f24-4157-97ab-ea9ab8423ca5", "name": "network-vif-deleted", "tag": "9d7f2b85-1892-469a-a4c4-0299eeaba795"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:35.213306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b7126abf-f34d-4256-8a8b-ec2cf3983c4e req-208a7414-9fb9-4d91-88bd-9685f98d0e6c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:35.216716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b7126abf-f34d-4256-8a8b-ec2cf3983c4e req-208a7414-9fb9-4d91-88bd-9685f98d0e6c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:35.262638 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b7126abf-f34d-4256-8a8b-ec2cf3983c4e req-208a7414-9fb9-4d91-88bd-9685f98d0e6c service nova] Creating event network-vif-deleted:9d7f2b85-1892-469a-a4c4-0299eeaba795 for instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 on n-h2-826756-3 Jul 28 03:39:35.287941 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b7126abf-f34d-4256-8a8b-ec2cf3983c4e req-208a7414-9fb9-4d91-88bd-9685f98d0e6c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108891 Jul 28 03:39:35.289346 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 505/956] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:35.295892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-549bf5e0-8759-427f-a376-2de813fd70fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:35.297506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-549bf5e0-8759-427f-a376-2de813fd70fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:35.310944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-549bf5e0-8759-427f-a376-2de813fd70fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:35.314437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-549bf5e0-8759-427f-a376-2de813fd70fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:35.318365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-549bf5e0-8759-427f-a376-2de813fd70fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:35.319220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-549bf5e0-8759-427f-a376-2de813fd70fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:35.323060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:35.351881 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d662c339-c2af-4de2-a0b6-c3d42c2b9169 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:35.364676 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d662c339-c2af-4de2-a0b6-c3d42c2b9169 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1361 microversion: 2.1 time: 1.974967 Jul 28 03:39:35.374121 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 452/957] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:33 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1361 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:35.393330 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f30f8f67-1d36-41c0-b443-a12bb8833fbd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:35.402982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f30f8f67-1d36-41c0-b443-a12bb8833fbd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:35.432692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f30f8f67-1d36-41c0-b443-a12bb8833fbd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:35.433831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f30f8f67-1d36-41c0-b443-a12bb8833fbd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:35.446079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f30f8f67-1d36-41c0-b443-a12bb8833fbd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:35.451370 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f30f8f67-1d36-41c0-b443-a12bb8833fbd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:35.533916 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:35.574185 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:35.751667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-549bf5e0-8759-427f-a376-2de813fd70fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:35.769568 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-549bf5e0-8759-427f-a376-2de813fd70fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1681 microversion: 2.1 time: 0.478703 Jul 28 03:39:35.770483 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 506/958] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:35 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1681 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:35.776614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-77246dbe-fed6-4817-b6b1-8424be242d04 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:35.777369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-77246dbe-fed6-4817-b6b1-8424be242d04 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:35.785323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77246dbe-fed6-4817-b6b1-8424be242d04 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:35.786083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77246dbe-fed6-4817-b6b1-8424be242d04 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:35.787065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77246dbe-fed6-4817-b6b1-8424be242d04 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:35.787672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77246dbe-fed6-4817-b6b1-8424be242d04 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:35.824668 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-77246dbe-fed6-4817-b6b1-8424be242d04 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] HTTP exception thrown: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-77246dbe-fed6-4817-b6b1-8424be242d04 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Request method failure captured: Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d HTTP/1.1 Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gQzzBVjsX3X9f39BaBkndPGkFUd9FTCGdIanat6WSFokNPq-NXKh4NmjdJNY6HKKj_PUK6OUGW4utoYzXNkMdDDnLVSK2_dXp3Qzk_JWtbX3Af0rC5ERQusE97053Fv6GjGKDGE4jWHOHvRmaG-HGi5TSgpUTvNqJ0nlBymbUOjDNU Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: edc92b66c7414566a24bf7f67535fd94 Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:35.828521 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:35.830209 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc92b66c7414566a24bf7f67535fd94"}]}] Jul 28 03:39:35.830209 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:35.830209 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: edc92b66c7414566a24bf7f67535fd94 Jul 28 03:39:35.830209 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:35.830209 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1188996709-project Jul 28 03:39:35.830209 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:35.830209 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:35.830209 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d876dd26de70496cbca6b3c066d72170 Jul 28 03:39:35.830209 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709-project Jul 28 03:39:35.830209 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:39:35.830209 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:35.830209 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '40d67752-6c63-4b60-9306-007519a62c9d'} Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:35.831116 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:35.832605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:35.836131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-77246dbe-fed6-4817-b6b1-8424be242d04 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Returning 404 to user: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:35.837265 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-77246dbe-fed6-4817-b6b1-8424be242d04 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "DELETE /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 404 len: 111 microversion: 2.1 time: 0.065654 Jul 28 03:39:35.842956 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 507/959] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:39:35 2022] DELETE /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:36.234823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f30f8f67-1d36-41c0-b443-a12bb8833fbd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:36.245153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1821641341", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "03ba27ec-48ee-4635-8849-cb4025bb3846"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:36.267556 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f30f8f67-1d36-41c0-b443-a12bb8833fbd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:36.270648 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f30f8f67-1d36-41c0-b443-a12bb8833fbd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:36.274947 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f30f8f67-1d36-41c0-b443-a12bb8833fbd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1606 microversion: 2.25 time: 0.899363 Jul 28 03:39:36.279394 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 453/960] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:39:35 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1606 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:39:36.298694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d53ccd9b-a080-46b1-9da9-1ee3ff7790d8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:36.308483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d53ccd9b-a080-46b1-9da9-1ee3ff7790d8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:36.326951 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d53ccd9b-a080-46b1-9da9-1ee3ff7790d8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:36.329750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d53ccd9b-a080-46b1-9da9-1ee3ff7790d8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:36.330946 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d53ccd9b-a080-46b1-9da9-1ee3ff7790d8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:36.333001 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d53ccd9b-a080-46b1-9da9-1ee3ff7790d8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:36.390275 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-d53ccd9b-a080-46b1-9da9-1ee3ff7790d8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] HTTP exception thrown: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d53ccd9b-a080-46b1-9da9-1ee3ff7790d8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Request method failure captured: Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d HTTP/1.1 Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gQzzBVjsX3X9f39BaBkndPGkFUd9FTCGdIanat6WSFokNPq-NXKh4NmjdJNY6HKKj_PUK6OUGW4utoYzXNkMdDDnLVSK2_dXp3Qzk_JWtbX3Af0rC5ERQusE97053Fv6GjGKDGE4jWHOHvRmaG-HGi5TSgpUTvNqJ0nlBymbUOjDNU Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: edc92b66c7414566a24bf7f67535fd94 Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:39:36.396603 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:39:36.398457 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc92b66c7414566a24bf7f67535fd94"}]}] Jul 28 03:39:36.398457 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:36.398457 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: edc92b66c7414566a24bf7f67535fd94 Jul 28 03:39:36.398457 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:36.398457 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1188996709-project Jul 28 03:39:36.398457 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:39:36.398457 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:39:36.398457 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: d876dd26de70496cbca6b3c066d72170 Jul 28 03:39:36.398457 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709-project Jul 28 03:39:36.398457 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:39:36.398457 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:36.398457 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '40d67752-6c63-4b60-9306-007519a62c9d'} Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:36.399363 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:36.401294 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:39:36.402758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d53ccd9b-a080-46b1-9da9-1ee3ff7790d8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Returning 404 to user: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:36.403793 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d53ccd9b-a080-46b1-9da9-1ee3ff7790d8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 404 len: 111 microversion: 2.1 time: 0.119823 Jul 28 03:39:36.406384 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 454/961] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:36 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:36.418788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fa876e86-cdc5-48e2-8dfa-662af8f16ee3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:36.425434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] validate_networks() for [('03ba27ec-48ee-4635-8849-cb4025bb3846', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:39:36.444003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fa876e86-cdc5-48e2-8dfa-662af8f16ee3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:36.463553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=10 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:36.470522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa876e86-cdc5-48e2-8dfa-662af8f16ee3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:36.471354 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa876e86-cdc5-48e2-8dfa-662af8f16ee3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:36.472553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa876e86-cdc5-48e2-8dfa-662af8f16ee3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:36.477713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa876e86-cdc5-48e2-8dfa-662af8f16ee3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:36.482944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:37.425458 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fa876e86-cdc5-48e2-8dfa-662af8f16ee3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:37.445905 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fa876e86-cdc5-48e2-8dfa-662af8f16ee3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1314 microversion: 2.1 time: 1.034687 Jul 28 03:39:37.453550 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 455/962] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:36 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1314 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:37.458983 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-21ed023d-dcae-4675-b626-804f82600f68 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:37.469219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-21ed023d-dcae-4675-b626-804f82600f68 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:37.481614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21ed023d-dcae-4675-b626-804f82600f68 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:37.485099 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21ed023d-dcae-4675-b626-804f82600f68 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:37.491616 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21ed023d-dcae-4675-b626-804f82600f68 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:37.492141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21ed023d-dcae-4675-b626-804f82600f68 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:37.656052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:39:37.656673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:39:37.657600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:39:37.658475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:39:37.659445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:39:37.683484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:37.698315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:37.699974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:37.700672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:37.736334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Getting quotas for project 011e8a0f854340a8bb93587077ce69ae. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:39:37.747706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Getting quotas for user 8e5420aa54a64a8db808514dc50b596e and project 011e8a0f854340a8bb93587077ce69ae. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:39:37.788241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:39:37.798254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:39:37.907874 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7c8b5c20-551a-4252-97c0-5315dbe766c0 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.063441 Jul 28 03:39:37.912950 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 508/963] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:39:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:39:37.920451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-210f2d15-7814-471c-adc0-8c1696e57503 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:37.925838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-210f2d15-7814-471c-adc0-8c1696e57503 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:37.941397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-210f2d15-7814-471c-adc0-8c1696e57503 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:37.942352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-210f2d15-7814-471c-adc0-8c1696e57503 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:37.944453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-210f2d15-7814-471c-adc0-8c1696e57503 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:37.947228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-210f2d15-7814-471c-adc0-8c1696e57503 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:38.186848 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-21ed023d-dcae-4675-b626-804f82600f68 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.731622 Jul 28 03:39:38.188156 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 456/964] 10.222.0.48 () {60 vars in 1316 bytes} [Thu Jul 28 03:39:37 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-interface => generated 284 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:39:38.195724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9e5b4eb1-2c3e-4f7a-b248-67cfcbcfe4b3 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '.version_select at 0x7ffa74832c10>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:38.247451 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9e5b4eb1-2c3e-4f7a-b248-67cfcbcfe4b3 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-315226568" status: 202 len: 0 microversion: 2.1 time: 0.057961 Jul 28 03:39:38.248050 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 457/965] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 03:39:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-315226568 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:39:38.262890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e6e1a4dc-1690-4b5d-8e68-de61b2685b2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:38.263809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e6e1a4dc-1690-4b5d-8e68-de61b2685b2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:38.283581 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6e1a4dc-1690-4b5d-8e68-de61b2685b2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:38.283839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6e1a4dc-1690-4b5d-8e68-de61b2685b2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:38.284674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6e1a4dc-1690-4b5d-8e68-de61b2685b2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:38.285110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6e1a4dc-1690-4b5d-8e68-de61b2685b2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:38.311054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-210f2d15-7814-471c-adc0-8c1696e57503 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:38.335626 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-210f2d15-7814-471c-adc0-8c1696e57503 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1361 microversion: 2.1 time: 0.417144 Jul 28 03:39:38.336397 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 509/966] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:37 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1361 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:38.365773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1d3a15b4-903c-4bbc-9ac7-7a8236b4e02f req-02422611-4aa4-43a6-b26d-a6acbd5c3d27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76", "tag": "a8b69e61-4d26-492e-8d90-78fee625d19c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:38.429077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1d3a15b4-903c-4bbc-9ac7-7a8236b4e02f req-02422611-4aa4-43a6-b26d-a6acbd5c3d27 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:38.429671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1d3a15b4-903c-4bbc-9ac7-7a8236b4e02f req-02422611-4aa4-43a6-b26d-a6acbd5c3d27 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:38.477449 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1d3a15b4-903c-4bbc-9ac7-7a8236b4e02f req-02422611-4aa4-43a6-b26d-a6acbd5c3d27 service nova] Creating event network-changed:a8b69e61-4d26-492e-8d90-78fee625d19c for instance 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 on n-h2-826756-3 Jul 28 03:39:38.492180 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1d3a15b4-903c-4bbc-9ac7-7a8236b4e02f req-02422611-4aa4-43a6-b26d-a6acbd5c3d27 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149146 Jul 28 03:39:38.494101 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 510/967] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:38.509997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-54f3744a-2b53-4889-8ef3-0e8a27967771 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:38.510977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-54f3744a-2b53-4889-8ef3-0e8a27967771 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:38.685024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-54f3744a-2b53-4889-8ef3-0e8a27967771 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:38.710459 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-54f3744a-2b53-4889-8ef3-0e8a27967771 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1216 microversion: 2.1 time: 0.210256 Jul 28 03:39:38.728738 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 511/968] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:38 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1216 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:38.735814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d7ca3a5-5d6d-4d6c-be0a-dfeef7ee33f6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:38.736733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4d7ca3a5-5d6d-4d6c-be0a-dfeef7ee33f6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:38.769511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d7ca3a5-5d6d-4d6c-be0a-dfeef7ee33f6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:38.771243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d7ca3a5-5d6d-4d6c-be0a-dfeef7ee33f6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:38.774440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d7ca3a5-5d6d-4d6c-be0a-dfeef7ee33f6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:38.777109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d7ca3a5-5d6d-4d6c-be0a-dfeef7ee33f6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:39.202410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d7ca3a5-5d6d-4d6c-be0a-dfeef7ee33f6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:39.232011 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d7ca3a5-5d6d-4d6c-be0a-dfeef7ee33f6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1314 microversion: 2.1 time: 0.500960 Jul 28 03:39:39.232727 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 512/969] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:38 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:39.249517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d92f2a1e-8128-4986-94ec-b185b495e14a req-19ddb5bf-cc8a-4197-80b1-854cedf26266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db682d4c-b880-4215-acf1-18c6d7118aca", "name": "network-vif-plugged", "status": "completed", "tag": "768b4449-0aa9-474a-a899-7501e3428c00"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:39.252841 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e6e1a4dc-1690-4b5d-8e68-de61b2685b2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:39.268100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d92f2a1e-8128-4986-94ec-b185b495e14a req-19ddb5bf-cc8a-4197-80b1-854cedf26266 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:39.268577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d92f2a1e-8128-4986-94ec-b185b495e14a req-19ddb5bf-cc8a-4197-80b1-854cedf26266 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:39.282879 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-d92f2a1e-8128-4986-94ec-b185b495e14a req-19ddb5bf-cc8a-4197-80b1-854cedf26266 service nova] Creating event network-vif-plugged:768b4449-0aa9-474a-a899-7501e3428c00 for instance db682d4c-b880-4215-acf1-18c6d7118aca on n-h1-826756-3 Jul 28 03:39:39.288479 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d92f2a1e-8128-4986-94ec-b185b495e14a req-19ddb5bf-cc8a-4197-80b1-854cedf26266 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053547 Jul 28 03:39:39.289914 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 513/970] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:39.296437 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e6e1a4dc-1690-4b5d-8e68-de61b2685b2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1681 microversion: 2.1 time: 1.042326 Jul 28 03:39:39.297919 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 458/971] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:38 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1681 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:39.364958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-10195e69-461f-4bfa-a9d8-dd9c0a2a1381 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:39.366046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-10195e69-461f-4bfa-a9d8-dd9c0a2a1381 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:39.375616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10195e69-461f-4bfa-a9d8-dd9c0a2a1381 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:39.378723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10195e69-461f-4bfa-a9d8-dd9c0a2a1381 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:39.379749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10195e69-461f-4bfa-a9d8-dd9c0a2a1381 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:39.380608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10195e69-461f-4bfa-a9d8-dd9c0a2a1381 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:39.682038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-10195e69-461f-4bfa-a9d8-dd9c0a2a1381 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:39.694096 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-10195e69-461f-4bfa-a9d8-dd9c0a2a1381 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1361 microversion: 2.1 time: 0.335261 Jul 28 03:39:39.712863 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 514/972] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:39 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1361 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:39.736290 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7038fcb3-cc9d-4bba-915c-a673b102fc63 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:39.737389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7038fcb3-cc9d-4bba-915c-a673b102fc63 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:39.745134 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7038fcb3-cc9d-4bba-915c-a673b102fc63 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:39.746273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7038fcb3-cc9d-4bba-915c-a673b102fc63 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:39.747347 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7038fcb3-cc9d-4bba-915c-a673b102fc63 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:39.748269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7038fcb3-cc9d-4bba-915c-a673b102fc63 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:39.939166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7038fcb3-cc9d-4bba-915c-a673b102fc63 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:39.961811 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7038fcb3-cc9d-4bba-915c-a673b102fc63 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1268 microversion: 2.1 time: 0.229812 Jul 28 03:39:39.988840 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 459/973] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:39 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1268 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:40.262540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a5cd4b69-8cb1-448b-aac1-7762a5daecee tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:40.263725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a5cd4b69-8cb1-448b-aac1-7762a5daecee tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:40.283588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5cd4b69-8cb1-448b-aac1-7762a5daecee tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:40.284048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5cd4b69-8cb1-448b-aac1-7762a5daecee tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:40.284885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5cd4b69-8cb1-448b-aac1-7762a5daecee tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:40.285326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5cd4b69-8cb1-448b-aac1-7762a5daecee tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:40.323181 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8ed00831-78d4-4ead-b355-895cde58cee2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:40.324390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8ed00831-78d4-4ead-b355-895cde58cee2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:40.341238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8ed00831-78d4-4ead-b355-895cde58cee2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:40.344130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8ed00831-78d4-4ead-b355-895cde58cee2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:40.345743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8ed00831-78d4-4ead-b355-895cde58cee2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:40.346194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8ed00831-78d4-4ead-b355-895cde58cee2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:40.571463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a5cd4b69-8cb1-448b-aac1-7762a5daecee tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:40.585739 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a5cd4b69-8cb1-448b-aac1-7762a5daecee tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1314 microversion: 2.1 time: 0.333027 Jul 28 03:39:40.596967 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 515/974] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:40 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:40.718257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bfeabddd-7128-4cd1-84c0-fdb35723aa10 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:40.719283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bfeabddd-7128-4cd1-84c0-fdb35723aa10 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:40.733673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfeabddd-7128-4cd1-84c0-fdb35723aa10 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:40.739196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfeabddd-7128-4cd1-84c0-fdb35723aa10 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:40.749197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfeabddd-7128-4cd1-84c0-fdb35723aa10 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:40.752817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfeabddd-7128-4cd1-84c0-fdb35723aa10 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:41.126401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bfeabddd-7128-4cd1-84c0-fdb35723aa10 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:41.136696 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bfeabddd-7128-4cd1-84c0-fdb35723aa10 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1361 microversion: 2.1 time: 0.422610 Jul 28 03:39:41.137881 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 516/975] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:40 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1361 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:41.152157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c1fc20e-3c71-45bd-a4c3-801e91fc2039 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:41.154975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c1fc20e-3c71-45bd-a4c3-801e91fc2039 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:41.174210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c1fc20e-3c71-45bd-a4c3-801e91fc2039 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:41.174756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c1fc20e-3c71-45bd-a4c3-801e91fc2039 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:41.175619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c1fc20e-3c71-45bd-a4c3-801e91fc2039 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:41.176932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c1fc20e-3c71-45bd-a4c3-801e91fc2039 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:41.255960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7c1fc20e-3c71-45bd-a4c3-801e91fc2039 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:41.264871 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7c1fc20e-3c71-45bd-a4c3-801e91fc2039 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1268 microversion: 2.1 time: 0.125722 Jul 28 03:39:41.266295 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 517/976] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:41 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1268 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:41.383485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8ed00831-78d4-4ead-b355-895cde58cee2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:41.394403 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8ed00831-78d4-4ead-b355-895cde58cee2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1681 microversion: 2.1 time: 1.078087 Jul 28 03:39:41.397317 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 460/977] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:40 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1681 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:41.436823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-462d777a-7e0c-495c-9147-f777261c98c2 tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:41.438949 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:39:41.438949 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:39:41.487319 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-462d777a-7e0c-495c-9147-f777261c98c2 tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/2001455220" status: 202 len: 0 microversion: 2.1 time: 0.054632 Jul 28 03:39:41.494362 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 518/978] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:39:41 2022] DELETE /compute/v2.1/flavors/2001455220 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:39:41.500820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2e800a35-44de-4b3a-870a-4bf7ff15d545 tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:41.574733 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2e800a35-44de-4b3a-870a-4bf7ff15d545 tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.079836 Jul 28 03:39:41.578564 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 461/979] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:39:41 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:41.600423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c357ed7-e789-4cb4-b08c-13df75b4a5a2 tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:41.607863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c3903559-c5ff-454f-ae79-f044c19af4d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:41.610044 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c3903559-c5ff-454f-ae79-f044c19af4d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:41.626154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3903559-c5ff-454f-ae79-f044c19af4d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:41.626871 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3903559-c5ff-454f-ae79-f044c19af4d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:41.627963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3903559-c5ff-454f-ae79-f044c19af4d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:41.628615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3903559-c5ff-454f-ae79-f044c19af4d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:41.635223 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5c357ed7-e789-4cb4-b08c-13df75b4a5a2 tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/545521223" status: 202 len: 0 microversion: 2.1 time: 0.043549 Jul 28 03:39:41.636569 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 519/980] 10.222.0.48 () {58 vars in 1158 bytes} [Thu Jul 28 03:39:41 2022] DELETE /compute/v2.1/flavors/545521223 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:39:41.647290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-03afa823-aa70-475f-aead-e351eea22266 tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:41.675652 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-03afa823-aa70-475f-aead-e351eea22266 tempest-ServersWithSpecificFlavorTestJSON-674167119 tempest-ServersWithSpecificFlavorTestJSON-674167119-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033275 Jul 28 03:39:41.688379 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 520/981] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:39:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:41.726681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f0b26450-e835-4b02-b6bf-4e611ebbb3af tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:41.727361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f0b26450-e835-4b02-b6bf-4e611ebbb3af tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:41.739804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0b26450-e835-4b02-b6bf-4e611ebbb3af tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:41.740259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0b26450-e835-4b02-b6bf-4e611ebbb3af tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:41.741146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0b26450-e835-4b02-b6bf-4e611ebbb3af tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:41.742175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0b26450-e835-4b02-b6bf-4e611ebbb3af tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:41.763226 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-f0b26450-e835-4b02-b6bf-4e611ebbb3af tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] HTTP exception thrown: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f0b26450-e835-4b02-b6bf-4e611ebbb3af tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Request method failure captured: Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 HTTP/1.1 Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gQzzBVjsX3X9f39BaBkndPGkFUd9FTCGdIanat6WSFokNPq-NXKh4NmjdJNY6HKKj_PUK6OUGW4utoYzXNkMdDDnLVSK2_dXp3Qzk_JWtbX3Af0rC5ERQusE97053Fv6GjGKDGE4jWHOHvRmaG-HGi5TSgpUTvNqJ0nlBymbUOjDNU Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: edc92b66c7414566a24bf7f67535fd94 Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:41.765302 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:41.766972 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc92b66c7414566a24bf7f67535fd94"}]}] Jul 28 03:39:41.766972 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:41.766972 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: edc92b66c7414566a24bf7f67535fd94 Jul 28 03:39:41.766972 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:41.766972 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1188996709-project Jul 28 03:39:41.766972 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:41.766972 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:41.766972 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d876dd26de70496cbca6b3c066d72170 Jul 28 03:39:41.766972 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709-project Jul 28 03:39:41.766972 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:39:41.766972 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:41.766972 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'fd3aa530-0f24-4157-97ab-ea9ab8423ca5'} Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:41.767875 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:41.769366 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.771798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f0b26450-e835-4b02-b6bf-4e611ebbb3af tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Returning 404 to user: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:41.773483 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f0b26450-e835-4b02-b6bf-4e611ebbb3af tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 404 len: 111 microversion: 2.1 time: 0.058928 Jul 28 03:39:41.774538 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 521/982] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:39:41 2022] DELETE /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:41.786212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa651cc4-b559-4bb5-9116-bdb8140d94a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:41.787208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fa651cc4-b559-4bb5-9116-bdb8140d94a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: fd3aa530-0f24-4157-97ab-ea9ab8423ca5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:41.794821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa651cc4-b559-4bb5-9116-bdb8140d94a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:41.795619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa651cc4-b559-4bb5-9116-bdb8140d94a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:41.797318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa651cc4-b559-4bb5-9116-bdb8140d94a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:41.797922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa651cc4-b559-4bb5-9116-bdb8140d94a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:41.821995 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-fa651cc4-b559-4bb5-9116-bdb8140d94a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] HTTP exception thrown: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa651cc4-b559-4bb5-9116-bdb8140d94a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Request method failure captured: Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 HTTP/1.1 Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gQzzBVjsX3X9f39BaBkndPGkFUd9FTCGdIanat6WSFokNPq-NXKh4NmjdJNY6HKKj_PUK6OUGW4utoYzXNkMdDDnLVSK2_dXp3Qzk_JWtbX3Af0rC5ERQusE97053Fv6GjGKDGE4jWHOHvRmaG-HGi5TSgpUTvNqJ0nlBymbUOjDNU Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: edc92b66c7414566a24bf7f67535fd94 Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:41.824084 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:41.825694 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc92b66c7414566a24bf7f67535fd94"}]}] Jul 28 03:39:41.825694 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:41.825694 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: edc92b66c7414566a24bf7f67535fd94 Jul 28 03:39:41.825694 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:41.825694 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1188996709-project Jul 28 03:39:41.825694 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:41.825694 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:41.825694 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d876dd26de70496cbca6b3c066d72170 Jul 28 03:39:41.825694 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709-project Jul 28 03:39:41.825694 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:39:41.825694 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:41.825694 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'fd3aa530-0f24-4157-97ab-ea9ab8423ca5'} Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:41.826578 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. Jul 28 03:39:41.828084 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.830505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa651cc4-b559-4bb5-9116-bdb8140d94a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Returning 404 to user: Instance fd3aa530-0f24-4157-97ab-ea9ab8423ca5 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:41.831390 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fa651cc4-b559-4bb5-9116-bdb8140d94a8 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5" status: 404 len: 111 microversion: 2.1 time: 0.051414 Jul 28 03:39:41.832621 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 522/983] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:41 2022] GET /compute/v2.1/servers/fd3aa530-0f24-4157-97ab-ea9ab8423ca5 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:41.860509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2d180858-0118-44ed-8f08-7e96b7d5594e tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:41.861293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2d180858-0118-44ed-8f08-7e96b7d5594e tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:41.878941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d180858-0118-44ed-8f08-7e96b7d5594e tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:41.879716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d180858-0118-44ed-8f08-7e96b7d5594e tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:41.883094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d180858-0118-44ed-8f08-7e96b7d5594e tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:41.883772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d180858-0118-44ed-8f08-7e96b7d5594e tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:41.933360 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-2d180858-0118-44ed-8f08-7e96b7d5594e tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] HTTP exception thrown: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2d180858-0118-44ed-8f08-7e96b7d5594e tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Request method failure captured: Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d HTTP/1.1 Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gQzzBVjsX3X9f39BaBkndPGkFUd9FTCGdIanat6WSFokNPq-NXKh4NmjdJNY6HKKj_PUK6OUGW4utoYzXNkMdDDnLVSK2_dXp3Qzk_JWtbX3Af0rC5ERQusE97053Fv6GjGKDGE4jWHOHvRmaG-HGi5TSgpUTvNqJ0nlBymbUOjDNU Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: edc92b66c7414566a24bf7f67535fd94 Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:41.935361 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:41.936991 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc92b66c7414566a24bf7f67535fd94"}]}] Jul 28 03:39:41.936991 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:41.936991 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: edc92b66c7414566a24bf7f67535fd94 Jul 28 03:39:41.936991 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:41.936991 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1188996709-project Jul 28 03:39:41.936991 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:41.936991 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:41.936991 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d876dd26de70496cbca6b3c066d72170 Jul 28 03:39:41.936991 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709-project Jul 28 03:39:41.936991 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:39:41.936991 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:41.936991 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '40d67752-6c63-4b60-9306-007519a62c9d'} Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:41.937971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:41.939436 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:41.944309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2d180858-0118-44ed-8f08-7e96b7d5594e tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Returning 404 to user: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:41.945529 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2d180858-0118-44ed-8f08-7e96b7d5594e tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "DELETE /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 404 len: 111 microversion: 2.1 time: 0.097800 Jul 28 03:39:41.946831 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 523/984] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:39:41 2022] DELETE /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:41.966096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5480a3b7-fb63-4973-8814-fd2a865ddb08 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:41.966969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5480a3b7-fb63-4973-8814-fd2a865ddb08 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] [instance: 40d67752-6c63-4b60-9306-007519a62c9d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:41.978056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5480a3b7-fb63-4973-8814-fd2a865ddb08 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:41.978960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5480a3b7-fb63-4973-8814-fd2a865ddb08 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:41.980376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5480a3b7-fb63-4973-8814-fd2a865ddb08 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:41.981301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5480a3b7-fb63-4973-8814-fd2a865ddb08 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:42.003792 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-5480a3b7-fb63-4973-8814-fd2a865ddb08 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] HTTP exception thrown: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5480a3b7-fb63-4973-8814-fd2a865ddb08 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Request method failure captured: Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d HTTP/1.1 Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gQzzBVjsX3X9f39BaBkndPGkFUd9FTCGdIanat6WSFokNPq-NXKh4NmjdJNY6HKKj_PUK6OUGW4utoYzXNkMdDDnLVSK2_dXp3Qzk_JWtbX3Af0rC5ERQusE97053Fv6GjGKDGE4jWHOHvRmaG-HGi5TSgpUTvNqJ0nlBymbUOjDNU Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: edc92b66c7414566a24bf7f67535fd94 Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:39:42.005874 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:39:42.007587 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc92b66c7414566a24bf7f67535fd94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc92b66c7414566a24bf7f67535fd94"}]}] Jul 28 03:39:42.007587 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:42.007587 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: edc92b66c7414566a24bf7f67535fd94 Jul 28 03:39:42.007587 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709 Jul 28 03:39:42.007587 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1188996709-project Jul 28 03:39:42.007587 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:39:42.007587 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:39:42.007587 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d876dd26de70496cbca6b3c066d72170 Jul 28 03:39:42.007587 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1188996709-project Jul 28 03:39:42.007587 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:39:42.007587 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:42.007587 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '40d67752-6c63-4b60-9306-007519a62c9d'} Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:39:42.008506 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. Jul 28 03:39:42.011392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:39:42.014399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5480a3b7-fb63-4973-8814-fd2a865ddb08 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] Returning 404 to user: Instance 40d67752-6c63-4b60-9306-007519a62c9d could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:39:42.014399 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5480a3b7-fb63-4973-8814-fd2a865ddb08 tempest-ServersWithSpecificFlavorTestJSON-1188996709 tempest-ServersWithSpecificFlavorTestJSON-1188996709-project] 10.222.0.48 "GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d" status: 404 len: 111 microversion: 2.1 time: 0.057356 Jul 28 03:39:42.017660 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 524/985] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:41 2022] GET /compute/v2.1/servers/40d67752-6c63-4b60-9306-007519a62c9d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:39:42.159406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f01ce07-c783-4b6e-ab59-edd48f35ccec tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:42.160190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8f01ce07-c783-4b6e-ab59-edd48f35ccec tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:42.174072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f01ce07-c783-4b6e-ab59-edd48f35ccec tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:42.174573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f01ce07-c783-4b6e-ab59-edd48f35ccec tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:42.175386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f01ce07-c783-4b6e-ab59-edd48f35ccec tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:42.175828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f01ce07-c783-4b6e-ab59-edd48f35ccec tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:42.656759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8f01ce07-c783-4b6e-ab59-edd48f35ccec tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:42.675036 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8f01ce07-c783-4b6e-ab59-edd48f35ccec tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1361 microversion: 2.1 time: 0.521101 Jul 28 03:39:42.676197 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 525/986] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:42 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1361 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:42.682249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a9d129ac-d73e-4ef3-9799-f3b25fbcc7c2 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:42.683085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a9d129ac-d73e-4ef3-9799-f3b25fbcc7c2 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:42.699909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9d129ac-d73e-4ef3-9799-f3b25fbcc7c2 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:42.700615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9d129ac-d73e-4ef3-9799-f3b25fbcc7c2 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:42.702337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9d129ac-d73e-4ef3-9799-f3b25fbcc7c2 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:42.705201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9d129ac-d73e-4ef3-9799-f3b25fbcc7c2 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:42.768618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c3903559-c5ff-454f-ae79-f044c19af4d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:42.778087 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c3903559-c5ff-454f-ae79-f044c19af4d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1464 microversion: 2.1 time: 1.174246 Jul 28 03:39:42.781354 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 462/987] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:41 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1464 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:42.792070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9abb48fc-99fe-4eb0-a5bd-c71cec236817 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:42.793039 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9abb48fc-99fe-4eb0-a5bd-c71cec236817 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:42.813173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9abb48fc-99fe-4eb0-a5bd-c71cec236817 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:42.813990 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9abb48fc-99fe-4eb0-a5bd-c71cec236817 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:42.815018 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9abb48fc-99fe-4eb0-a5bd-c71cec236817 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:42.816970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9abb48fc-99fe-4eb0-a5bd-c71cec236817 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:42.929602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a9d129ac-d73e-4ef3-9799-f3b25fbcc7c2 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:42.950706 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a9d129ac-d73e-4ef3-9799-f3b25fbcc7c2 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1274 microversion: 2.1 time: 0.272812 Jul 28 03:39:42.960469 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 526/988] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:42 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1274 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:43.408466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b780dfdc-ee47-4b81-98e3-7edc1dd47b2e tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:43.416865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b780dfdc-ee47-4b81-98e3-7edc1dd47b2e tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Searching by: {'deleted': False, 'project_id': '08c05a2dc08b48d2bbf2c44db97ae5c8'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:39:43.441052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b780dfdc-ee47-4b81-98e3-7edc1dd47b2e tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:43.442578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b780dfdc-ee47-4b81-98e3-7edc1dd47b2e tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:43.443423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b780dfdc-ee47-4b81-98e3-7edc1dd47b2e tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:43.443844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b780dfdc-ee47-4b81-98e3-7edc1dd47b2e tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:43.584694 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b780dfdc-ee47-4b81-98e3-7edc1dd47b2e tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.630381 Jul 28 03:39:43.587253 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 527/989] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:39:42 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:39:43.617461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed1989b6-77ad-40a4-88ec-e22d11f1e58b tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:43.629525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed1989b6-77ad-40a4-88ec-e22d11f1e58b tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Searching by: {'deleted': False} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:39:43.642069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed1989b6-77ad-40a4-88ec-e22d11f1e58b tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:43.645023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed1989b6-77ad-40a4-88ec-e22d11f1e58b tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:43.647735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed1989b6-77ad-40a4-88ec-e22d11f1e58b tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:43.648191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed1989b6-77ad-40a4-88ec-e22d11f1e58b tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:43.671511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9abb48fc-99fe-4eb0-a5bd-c71cec236817 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:43.689899 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9abb48fc-99fe-4eb0-a5bd-c71cec236817 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1681 microversion: 2.1 time: 0.906796 Jul 28 03:39:43.690831 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 463/990] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:42 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1681 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:43.704165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cafd17a8-6643-4e8f-a2f0-3979406e2cde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:43.711994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cafd17a8-6643-4e8f-a2f0-3979406e2cde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:43.739123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cafd17a8-6643-4e8f-a2f0-3979406e2cde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:43.745449 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cafd17a8-6643-4e8f-a2f0-3979406e2cde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:43.748963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cafd17a8-6643-4e8f-a2f0-3979406e2cde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:43.754572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cafd17a8-6643-4e8f-a2f0-3979406e2cde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:43.858201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-ed1989b6-77ad-40a4-88ec-e22d11f1e58b tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:39:44.057741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed1989b6-77ad-40a4-88ec-e22d11f1e58b tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:44.058475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed1989b6-77ad-40a4-88ec-e22d11f1e58b tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:44.197947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cafd17a8-6643-4e8f-a2f0-3979406e2cde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:44.212441 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cafd17a8-6643-4e8f-a2f0-3979406e2cde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1361 microversion: 2.1 time: 0.511127 Jul 28 03:39:44.214197 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 464/991] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:43 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1361 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:44.226776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-468725f1-06e2-45f5-8c3f-66d8ed802816 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:44.252396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-468725f1-06e2-45f5-8c3f-66d8ed802816 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:44.275041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-468725f1-06e2-45f5-8c3f-66d8ed802816 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:44.275897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-468725f1-06e2-45f5-8c3f-66d8ed802816 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:44.276933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-468725f1-06e2-45f5-8c3f-66d8ed802816 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:44.280413 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-468725f1-06e2-45f5-8c3f-66d8ed802816 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:45.197999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-468725f1-06e2-45f5-8c3f-66d8ed802816 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:45.213137 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-468725f1-06e2-45f5-8c3f-66d8ed802816 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1316 microversion: 2.1 time: 0.990077 Jul 28 03:39:45.219349 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 465/992] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:44 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1316 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:45.238586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0ed3e0ae-6fc6-4f0b-9503-6419331d7bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:45.242477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0ed3e0ae-6fc6-4f0b-9503-6419331d7bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:45.273219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ed3e0ae-6fc6-4f0b-9503-6419331d7bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:45.274209 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ed3e0ae-6fc6-4f0b-9503-6419331d7bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:45.275274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ed3e0ae-6fc6-4f0b-9503-6419331d7bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:45.277367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ed3e0ae-6fc6-4f0b-9503-6419331d7bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:45.832149 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed1989b6-77ad-40a4-88ec-e22d11f1e58b tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17833 microversion: 2.1 time: 2.224441 Jul 28 03:39:45.854077 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 528/993] 10.222.0.48 () {58 vars in 1171 bytes} [Thu Jul 28 03:39:43 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17833 bytes in 2247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:39:45.871581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-37830d3e-0182-455f-8804-79f494a90660 req-feb223c1-7ac2-4a9f-92d3-605a4a77782b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcbae58d-a326-4197-a350-9278d664d3e7", "tag": "1c43a93b-de22-40be-a837-98a92e1f0f4c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:45.908111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-37830d3e-0182-455f-8804-79f494a90660 req-feb223c1-7ac2-4a9f-92d3-605a4a77782b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:45.912858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-37830d3e-0182-455f-8804-79f494a90660 req-feb223c1-7ac2-4a9f-92d3-605a4a77782b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:45.934906 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-37830d3e-0182-455f-8804-79f494a90660 req-feb223c1-7ac2-4a9f-92d3-605a4a77782b service nova] Creating event network-changed:1c43a93b-de22-40be-a837-98a92e1f0f4c for instance fcbae58d-a326-4197-a350-9278d664d3e7 on n-h1-826756-3 Jul 28 03:39:45.948557 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-37830d3e-0182-455f-8804-79f494a90660 req-feb223c1-7ac2-4a9f-92d3-605a4a77782b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093007 Jul 28 03:39:45.952483 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 529/994] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:45.963420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d6056b14-122a-4b0c-a18f-c2bb294f95f0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:45.964965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d6056b14-122a-4b0c-a18f-c2bb294f95f0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:45.978910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6056b14-122a-4b0c-a18f-c2bb294f95f0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:45.985273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6056b14-122a-4b0c-a18f-c2bb294f95f0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:45.986190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6056b14-122a-4b0c-a18f-c2bb294f95f0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:45.986736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6056b14-122a-4b0c-a18f-c2bb294f95f0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:46.400869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d6056b14-122a-4b0c-a18f-c2bb294f95f0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:46.412173 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d6056b14-122a-4b0c-a18f-c2bb294f95f0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1361 microversion: 2.1 time: 0.458096 Jul 28 03:39:46.413147 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 530/995] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:45 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1361 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:46.427785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-2aba8917-eebb-4f6a-b86c-f65e36ea8e47 req-49bb1e51-f0e1-4b7a-af77-4b6f0efa3432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76", "name": "network-vif-plugged", "status": "completed", "tag": "a8b69e61-4d26-492e-8d90-78fee625d19c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:46.453572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2aba8917-eebb-4f6a-b86c-f65e36ea8e47 req-49bb1e51-f0e1-4b7a-af77-4b6f0efa3432 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:46.466016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2aba8917-eebb-4f6a-b86c-f65e36ea8e47 req-49bb1e51-f0e1-4b7a-af77-4b6f0efa3432 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:46.507142 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-2aba8917-eebb-4f6a-b86c-f65e36ea8e47 req-49bb1e51-f0e1-4b7a-af77-4b6f0efa3432 service nova] Creating event network-vif-plugged:a8b69e61-4d26-492e-8d90-78fee625d19c for instance 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 on n-h2-826756-3 Jul 28 03:39:46.530343 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-2aba8917-eebb-4f6a-b86c-f65e36ea8e47 req-49bb1e51-f0e1-4b7a-af77-4b6f0efa3432 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114662 Jul 28 03:39:46.531297 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 531/996] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:46.539558 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0ed3e0ae-6fc6-4f0b-9503-6419331d7bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:46.541898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66a0c0e9-8905-4ca2-a522-e155decd72f1 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:46.556711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-66a0c0e9-8905-4ca2-a522-e155decd72f1 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Searching by: {'deleted': False, 'project_id': '08c05a2dc08b48d2bbf2c44db97ae5c8'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:39:46.578214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66a0c0e9-8905-4ca2-a522-e155decd72f1 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:46.579434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66a0c0e9-8905-4ca2-a522-e155decd72f1 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:46.582229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66a0c0e9-8905-4ca2-a522-e155decd72f1 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:46.596991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66a0c0e9-8905-4ca2-a522-e155decd72f1 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:46.645714 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0ed3e0ae-6fc6-4f0b-9503-6419331d7bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1681 microversion: 2.1 time: 1.420400 Jul 28 03:39:46.649395 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 466/997] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:45 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1681 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:46.672262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7972416d-cc34-4b1f-b0d0-fae5e9b793f9 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:46.674266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7972416d-cc34-4b1f-b0d0-fae5e9b793f9 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:46.719267 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-66a0c0e9-8905-4ca2-a522-e155decd72f1 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?tenant_id=73bbf29c8c7f4f3385717d49ff9fe5f4" status: 200 len: 15 microversion: 2.1 time: 0.180030 Jul 28 03:39:46.720462 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 532/998] 10.222.0.48 () {58 vars in 1231 bytes} [Thu Jul 28 03:39:46 2022] GET /compute/v2.1/servers/detail?tenant_id=73bbf29c8c7f4f3385717d49ff9fe5f4 => generated 15 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:39:46.733835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7972416d-cc34-4b1f-b0d0-fae5e9b793f9 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:46.734441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7972416d-cc34-4b1f-b0d0-fae5e9b793f9 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.052s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:46.737672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7972416d-cc34-4b1f-b0d0-fae5e9b793f9 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:46.738123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7972416d-cc34-4b1f-b0d0-fae5e9b793f9 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:46.743444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5a5b76a4-a6c2-49a1-8364-c05b27e8d329 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:46.750250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5a5b76a4-a6c2-49a1-8364-c05b27e8d329 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Searching by: {'tenant_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'deleted': False} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:39:46.776520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a5b76a4-a6c2-49a1-8364-c05b27e8d329 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:46.777664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a5b76a4-a6c2-49a1-8364-c05b27e8d329 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:46.778738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a5b76a4-a6c2-49a1-8364-c05b27e8d329 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:46.779355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a5b76a4-a6c2-49a1-8364-c05b27e8d329 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:46.882647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-5a5b76a4-a6c2-49a1-8364-c05b27e8d329 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:39:47.118611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:47.137914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a5b76a4-a6c2-49a1-8364-c05b27e8d329 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:47.138646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a5b76a4-a6c2-49a1-8364-c05b27e8d329 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:47.795130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7972416d-cc34-4b1f-b0d0-fae5e9b793f9 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:47.829381 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7972416d-cc34-4b1f-b0d0-fae5e9b793f9 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1316 microversion: 2.1 time: 1.175203 Jul 28 03:39:47.831264 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 467/999] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:46 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1316 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:47.844269 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5a5b76a4-a6c2-49a1-8364-c05b27e8d329 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=73bbf29c8c7f4f3385717d49ff9fe5f4" status: 200 len: 4826 microversion: 2.1 time: 1.105167 Jul 28 03:39:47.845194 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 533/1000] 10.222.0.48 () {58 vars in 1257 bytes} [Thu Jul 28 03:39:46 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=73bbf29c8c7f4f3385717d49ff9fe5f4 => generated 4826 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:47.850145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-27e74ba9-62c0-4bae-b3d8-d88e0940e40a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:47.851173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-27e74ba9-62c0-4bae-b3d8-d88e0940e40a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:47.855764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bf7e775d-0494-4373-a21e-7546d53ce102 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:47.857460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bf7e775d-0494-4373-a21e-7546d53ce102 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:47.872758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27e74ba9-62c0-4bae-b3d8-d88e0940e40a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:47.883232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27e74ba9-62c0-4bae-b3d8-d88e0940e40a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:47.885127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27e74ba9-62c0-4bae-b3d8-d88e0940e40a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:47.887754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27e74ba9-62c0-4bae-b3d8-d88e0940e40a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:47.891033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf7e775d-0494-4373-a21e-7546d53ce102 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:47.891667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf7e775d-0494-4373-a21e-7546d53ce102 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:47.892652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf7e775d-0494-4373-a21e-7546d53ce102 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:47.895042 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf7e775d-0494-4373-a21e-7546d53ce102 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:48.536967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-27e74ba9-62c0-4bae-b3d8-d88e0940e40a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:48.558316 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-27e74ba9-62c0-4bae-b3d8-d88e0940e40a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1681 microversion: 2.1 time: 0.711733 Jul 28 03:39:48.574493 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 534/1001] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:47 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1681 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:48.580180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-089477d6-d744-4fd5-8124-03524b988da2 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:48.588556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-089477d6-d744-4fd5-8124-03524b988da2 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Searching by: {'tenant_id': '08c05a2dc08b48d2bbf2c44db97ae5c8', 'deleted': False} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:39:48.593939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:48.596231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-089477d6-d744-4fd5-8124-03524b988da2 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:48.597065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-089477d6-d744-4fd5-8124-03524b988da2 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:48.598146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-089477d6-d744-4fd5-8124-03524b988da2 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:48.598738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-089477d6-d744-4fd5-8124-03524b988da2 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:48.636026 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bf7e775d-0494-4373-a21e-7546d53ce102 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:48.657949 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bf7e775d-0494-4373-a21e-7546d53ce102 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1361 microversion: 2.1 time: 0.825280 Jul 28 03:39:48.662626 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 468/1002] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:47 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1361 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:48.682056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-b1672b87-bdb3-4d33-a458-52b84baa1467 req-e47a6006-3326-4c70-9cea-3da50a9c44e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5ac650-8b79-43bf-88f9-b18d37196d0d", "tag": "0f2c2ab9-d361-41b3-932e-9fe402cf4c3e"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:48.709812 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-089477d6-d744-4fd5-8124-03524b988da2 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=08c05a2dc08b48d2bbf2c44db97ae5c8" status: 200 len: 15 microversion: 2.1 time: 0.131308 Jul 28 03:39:48.717867 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 535/1003] 10.222.0.48 () {58 vars in 1257 bytes} [Thu Jul 28 03:39:48 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=08c05a2dc08b48d2bbf2c44db97ae5c8 => generated 15 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:39:48.742669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b1672b87-bdb3-4d33-a458-52b84baa1467 req-e47a6006-3326-4c70-9cea-3da50a9c44e7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:48.744520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b1672b87-bdb3-4d33-a458-52b84baa1467 req-e47a6006-3326-4c70-9cea-3da50a9c44e7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:48.747424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7ead7533-cb42-4cc9-8076-62aaf336df96 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:48.783289 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-b1672b87-bdb3-4d33-a458-52b84baa1467 req-e47a6006-3326-4c70-9cea-3da50a9c44e7 service nova] Creating event network-changed:0f2c2ab9-d361-41b3-932e-9fe402cf4c3e for instance ed5ac650-8b79-43bf-88f9-b18d37196d0d on n-h2-826756-3 Jul 28 03:39:48.790405 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-b1672b87-bdb3-4d33-a458-52b84baa1467 req-e47a6006-3326-4c70-9cea-3da50a9c44e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124941 Jul 28 03:39:48.791831 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 469/1004] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:48.800089 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7ead7533-cb42-4cc9-8076-62aaf336df96 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.062798 Jul 28 03:39:48.802852 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 536/1005] 10.222.0.48 () {58 vars in 1189 bytes} [Thu Jul 28 03:39:48 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:39:48.833168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-70191bd1-3fba-44bd-af6f-fc1118ec8909 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:48.838296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-70191bd1-3fba-44bd-af6f-fc1118ec8909 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:48.870753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-650d70a7-aab6-4295-83ca-4a28c6f01758 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:48.872002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-650d70a7-aab6-4295-83ca-4a28c6f01758 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:48.899135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70191bd1-3fba-44bd-af6f-fc1118ec8909 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:48.900113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70191bd1-3fba-44bd-af6f-fc1118ec8909 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:48.900497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-650d70a7-aab6-4295-83ca-4a28c6f01758 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:48.901892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70191bd1-3fba-44bd-af6f-fc1118ec8909 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:48.902613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-650d70a7-aab6-4295-83ca-4a28c6f01758 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:48.906915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-650d70a7-aab6-4295-83ca-4a28c6f01758 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:48.907041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70191bd1-3fba-44bd-af6f-fc1118ec8909 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:48.907831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-650d70a7-aab6-4295-83ca-4a28c6f01758 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:49.150671 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-70191bd1-3fba-44bd-af6f-fc1118ec8909 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab/action" status: 202 len: 0 microversion: 2.1 time: 0.327559 Jul 28 03:39:49.153491 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 470/1006] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:39:48 2022] POST /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:39:49.162715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b17cf038-dd0e-4e09-b345-67138d0ee74d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:49.170466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b17cf038-dd0e-4e09-b345-67138d0ee74d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:49.171340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b17cf038-dd0e-4e09-b345-67138d0ee74d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:39:49.183000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b17cf038-dd0e-4e09-b345-67138d0ee74d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:49.183000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b17cf038-dd0e-4e09-b345-67138d0ee74d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:49.183715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b17cf038-dd0e-4e09-b345-67138d0ee74d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:49.184783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b17cf038-dd0e-4e09-b345-67138d0ee74d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:49.347769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-b17cf038-dd0e-4e09-b345-67138d0ee74d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:39:49.575613 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b17cf038-dd0e-4e09-b345-67138d0ee74d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.416449 Jul 28 03:39:49.582376 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 471/1007] 10.222.0.48 () {58 vars in 1150 bytes} [Thu Jul 28 03:39:49 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:39:49.590138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f94848bc-2c6c-496a-b8e4-01b66294d60a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:49.590804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f94848bc-2c6c-496a-b8e4-01b66294d60a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:49.601422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f94848bc-2c6c-496a-b8e4-01b66294d60a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:49.601867 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f94848bc-2c6c-496a-b8e4-01b66294d60a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:49.602738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f94848bc-2c6c-496a-b8e4-01b66294d60a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:49.603178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f94848bc-2c6c-496a-b8e4-01b66294d60a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:49.898304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f94848bc-2c6c-496a-b8e4-01b66294d60a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:49.908811 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f94848bc-2c6c-496a-b8e4-01b66294d60a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1681 microversion: 2.1 time: 0.325211 Jul 28 03:39:49.919025 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 472/1008] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:49 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1681 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:49.924523 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f95f43ae-982b-4f9b-a662-78ec2bf1f56a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:49.927560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f95f43ae-982b-4f9b-a662-78ec2bf1f56a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:49.950553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f95f43ae-982b-4f9b-a662-78ec2bf1f56a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:49.951009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f95f43ae-982b-4f9b-a662-78ec2bf1f56a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:49.951812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f95f43ae-982b-4f9b-a662-78ec2bf1f56a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:49.952243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f95f43ae-982b-4f9b-a662-78ec2bf1f56a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:49.997955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:50.138423 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f95f43ae-982b-4f9b-a662-78ec2bf1f56a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab/action" status: 202 len: 0 microversion: 2.1 time: 0.217759 Jul 28 03:39:50.139715 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 473/1009] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:39:49 2022] POST /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:39:50.144823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-abe9b3fd-65fa-4eeb-827c-8dd905f85fc3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:50.145803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-abe9b3fd-65fa-4eeb-827c-8dd905f85fc3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:50.157871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-650d70a7-aab6-4295-83ca-4a28c6f01758 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:50.161904 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abe9b3fd-65fa-4eeb-827c-8dd905f85fc3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:50.162513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abe9b3fd-65fa-4eeb-827c-8dd905f85fc3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:50.164604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abe9b3fd-65fa-4eeb-827c-8dd905f85fc3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:50.165180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abe9b3fd-65fa-4eeb-827c-8dd905f85fc3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:50.173168 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-650d70a7-aab6-4295-83ca-4a28c6f01758 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1316 microversion: 2.1 time: 1.309450 Jul 28 03:39:50.174300 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 537/1010] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:48 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1316 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:50.185156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-349f970a-43f5-4539-8da9-d722a52a9c43 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:50.186050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-349f970a-43f5-4539-8da9-d722a52a9c43 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:50.205975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-349f970a-43f5-4539-8da9-d722a52a9c43 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:50.209609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-349f970a-43f5-4539-8da9-d722a52a9c43 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:50.210464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-349f970a-43f5-4539-8da9-d722a52a9c43 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:50.210829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-349f970a-43f5-4539-8da9-d722a52a9c43 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:50.589788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-abe9b3fd-65fa-4eeb-827c-8dd905f85fc3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:50.605362 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-abe9b3fd-65fa-4eeb-827c-8dd905f85fc3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1544 microversion: 2.1 time: 0.464341 Jul 28 03:39:50.616492 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 474/1011] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:50 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1544 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:50.629609 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-00ca3b3b-140d-42c5-8f28-c3b99c9a4cb2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:50.630106 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-00ca3b3b-140d-42c5-8f28-c3b99c9a4cb2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:50.643553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00ca3b3b-140d-42c5-8f28-c3b99c9a4cb2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:50.643985 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00ca3b3b-140d-42c5-8f28-c3b99c9a4cb2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:50.644816 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00ca3b3b-140d-42c5-8f28-c3b99c9a4cb2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:50.645249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00ca3b3b-140d-42c5-8f28-c3b99c9a4cb2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:50.744481 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-349f970a-43f5-4539-8da9-d722a52a9c43 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1614 microversion: 2.1 time: 0.568857 Jul 28 03:39:50.745427 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 538/1012] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:50 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1614 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:50.772545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1b7ca0eb-f231-4d08-88c3-9611f43c9a6f tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:50.773183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1b7ca0eb-f231-4d08-88c3-9611f43c9a6f tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:50.784947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b7ca0eb-f231-4d08-88c3-9611f43c9a6f tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:50.786101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b7ca0eb-f231-4d08-88c3-9611f43c9a6f tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:50.787022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b7ca0eb-f231-4d08-88c3-9611f43c9a6f tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:50.787964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b7ca0eb-f231-4d08-88c3-9611f43c9a6f tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:51.170466 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1b7ca0eb-f231-4d08-88c3-9611f43c9a6f tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1614 microversion: 2.1 time: 0.401963 Jul 28 03:39:51.175070 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 539/1013] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:50 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1614 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:51.189745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1572c343-b5f0-4bde-9ab7-5d50ea893d9d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:51.206985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1572c343-b5f0-4bde-9ab7-5d50ea893d9d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:51.235577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1572c343-b5f0-4bde-9ab7-5d50ea893d9d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:51.237122 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-00ca3b3b-140d-42c5-8f28-c3b99c9a4cb2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.611737 Jul 28 03:39:51.238065 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 475/1014] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:39:50 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-interface => generated 285 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:39:51.242864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6f026d1f-8003-4234-ab6e-21c93f8703bb tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:51.249239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1572c343-b5f0-4bde-9ab7-5d50ea893d9d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:51.250277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1572c343-b5f0-4bde-9ab7-5d50ea893d9d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:51.250854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1572c343-b5f0-4bde-9ab7-5d50ea893d9d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:51.256041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6f026d1f-8003-4234-ab6e-21c93f8703bb tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Searching by: {'host': 'n-h1-826756-3', 'deleted': False} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:39:51.266387 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f026d1f-8003-4234-ab6e-21c93f8703bb tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:51.266840 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f026d1f-8003-4234-ab6e-21c93f8703bb tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:51.267638 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f026d1f-8003-4234-ab6e-21c93f8703bb tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:51.268067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f026d1f-8003-4234-ab6e-21c93f8703bb tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:51.516650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-6f026d1f-8003-4234-ab6e-21c93f8703bb tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:39:51.658578 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6f026d1f-8003-4234-ab6e-21c93f8703bb tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "GET /compute/v2.1/servers?host=n-h1-826756-3&all_tenants=1" status: 200 len: 1997 microversion: 2.1 time: 0.418822 Jul 28 03:39:51.661136 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 476/1015] 10.222.0.48 () {58 vars in 1190 bytes} [Thu Jul 28 03:39:51 2022] GET /compute/v2.1/servers?host=n-h1-826756-3&all_tenants=1 => generated 1997 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:51.672429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-73a5a836-775b-4b7c-85ad-b70b79b168c4 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:51.673435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-73a5a836-775b-4b7c-85ad-b70b79b168c4 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:51.689757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73a5a836-775b-4b7c-85ad-b70b79b168c4 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:51.690695 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73a5a836-775b-4b7c-85ad-b70b79b168c4 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:51.692279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73a5a836-775b-4b7c-85ad-b70b79b168c4 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:51.693031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73a5a836-775b-4b7c-85ad-b70b79b168c4 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:51.901147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1572c343-b5f0-4bde-9ab7-5d50ea893d9d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:51.918797 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1572c343-b5f0-4bde-9ab7-5d50ea893d9d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1681 microversion: 2.1 time: 0.739642 Jul 28 03:39:51.941472 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 540/1016] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:51 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1681 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:51.952605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0d546bef-89d7-462d-a09b-31b42132a52c tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:51.977308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0d546bef-89d7-462d-a09b-31b42132a52c tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:39:51.989339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d546bef-89d7-462d-a09b-31b42132a52c tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:51.998013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d546bef-89d7-462d-a09b-31b42132a52c tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:51.999640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d546bef-89d7-462d-a09b-31b42132a52c tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:52.000676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d546bef-89d7-462d-a09b-31b42132a52c tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:52.250790 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0d546bef-89d7-462d-a09b-31b42132a52c tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.307069 Jul 28 03:39:52.264229 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 541/1017] 10.222.0.48 () {58 vars in 1196 bytes} [Thu Jul 28 03:39:51 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:39:52.281287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1e27b4db-9550-4622-9276-9b92c4279018 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:52.284267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1e27b4db-9550-4622-9276-9b92c4279018 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:52.308877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e27b4db-9550-4622-9276-9b92c4279018 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:52.309664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e27b4db-9550-4622-9276-9b92c4279018 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:52.310730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e27b4db-9550-4622-9276-9b92c4279018 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:52.311377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e27b4db-9550-4622-9276-9b92c4279018 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:52.532432 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1e27b4db-9550-4622-9276-9b92c4279018 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab/action" status: 202 len: 0 microversion: 2.1 time: 0.256361 Jul 28 03:39:52.534505 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 542/1018] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:39:52 2022] POST /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:39:52.548999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:52.557896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:52.571181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:52.573072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:52.575362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:52.576256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:52.844454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:39:52.846637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:39:52.847263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:39:52.847789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:39:52.852415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:39:53.014266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:53.041295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:53.063019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:53.066107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:53.066833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:53.164725 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e30365a5-8d7f-4c1b-985a-ac741545503e tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "POST /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab/action" status: 202 len: 1067 microversion: 2.1 time: 0.624884 Jul 28 03:39:53.169411 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 543/1019] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:39:52 2022] POST /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab/action => generated 1067 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 28 03:39:53.194752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b7b95f11-bcf6-4008-bf75-09e89f60d2db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:53.198112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b7b95f11-bcf6-4008-bf75-09e89f60d2db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:53.228182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7b95f11-bcf6-4008-bf75-09e89f60d2db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:53.229089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7b95f11-bcf6-4008-bf75-09e89f60d2db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:53.232142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7b95f11-bcf6-4008-bf75-09e89f60d2db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:53.233700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7b95f11-bcf6-4008-bf75-09e89f60d2db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:53.345962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-73a5a836-775b-4b7c-85ad-b70b79b168c4 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:53.425556 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-73a5a836-775b-4b7c-85ad-b70b79b168c4 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1316 microversion: 2.1 time: 1.761204 Jul 28 03:39:53.426196 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 477/1020] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:51 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1316 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:53.447245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4dd1eed4-56e7-4e64-bb26-e1990269ae4f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:53.449083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4dd1eed4-56e7-4e64-bb26-e1990269ae4f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:53.473009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4dd1eed4-56e7-4e64-bb26-e1990269ae4f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:53.476838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4dd1eed4-56e7-4e64-bb26-e1990269ae4f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:53.480843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4dd1eed4-56e7-4e64-bb26-e1990269ae4f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:53.483237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4dd1eed4-56e7-4e64-bb26-e1990269ae4f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:54.269331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b7b95f11-bcf6-4008-bf75-09e89f60d2db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:54.297365 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b7b95f11-bcf6-4008-bf75-09e89f60d2db tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1681 microversion: 2.1 time: 1.119899 Jul 28 03:39:54.301340 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 544/1021] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:53 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1681 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:54.369095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4dd1eed4-56e7-4e64-bb26-e1990269ae4f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:54.390624 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4dd1eed4-56e7-4e64-bb26-e1990269ae4f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1471 microversion: 2.1 time: 0.961778 Jul 28 03:39:54.394368 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 478/1022] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:53 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1471 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:54.477223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7f78e685-9e1b-40a0-b4cd-600ad82449bc tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:54.478336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7f78e685-9e1b-40a0-b4cd-600ad82449bc tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:54.516209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f78e685-9e1b-40a0-b4cd-600ad82449bc tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:54.517291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f78e685-9e1b-40a0-b4cd-600ad82449bc tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:54.523561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f78e685-9e1b-40a0-b4cd-600ad82449bc tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:54.524320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f78e685-9e1b-40a0-b4cd-600ad82449bc tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:55.344797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-66616f63-eea5-4c28-80e4-f5c636434f04 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:55.345573 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-66616f63-eea5-4c28-80e4-f5c636434f04 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:55.369038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66616f63-eea5-4c28-80e4-f5c636434f04 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:55.369922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66616f63-eea5-4c28-80e4-f5c636434f04 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:55.373538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66616f63-eea5-4c28-80e4-f5c636434f04 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:55.375319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66616f63-eea5-4c28-80e4-f5c636434f04 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:55.687682 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-66616f63-eea5-4c28-80e4-f5c636434f04 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:55.703396 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-66616f63-eea5-4c28-80e4-f5c636434f04 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1681 microversion: 2.1 time: 0.362570 Jul 28 03:39:55.708007 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 479/1023] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:55 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1681 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:55.719998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1839aa91-fe80-4e71-8736-9ada42a29875 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:55.726272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1839aa91-fe80-4e71-8736-9ada42a29875 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:55.744820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=74,nova_api:DELETE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:55.751772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1839aa91-fe80-4e71-8736-9ada42a29875 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:55.754327 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1839aa91-fe80-4e71-8736-9ada42a29875 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:55.758911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1839aa91-fe80-4e71-8736-9ada42a29875 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:55.761882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1839aa91-fe80-4e71-8736-9ada42a29875 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:55.779563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7f78e685-9e1b-40a0-b4cd-600ad82449bc tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:55.808692 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7f78e685-9e1b-40a0-b4cd-600ad82449bc tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1316 microversion: 2.1 time: 1.338838 Jul 28 03:39:55.846967 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 545/1024] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:54 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1316 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:56.730353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-35ab1bb9-ac53-4cdd-ad9a-aa1b6993581a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:56.731362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-35ab1bb9-ac53-4cdd-ad9a-aa1b6993581a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:56.740063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35ab1bb9-ac53-4cdd-ad9a-aa1b6993581a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:56.752868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35ab1bb9-ac53-4cdd-ad9a-aa1b6993581a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:56.756756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35ab1bb9-ac53-4cdd-ad9a-aa1b6993581a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:56.759972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35ab1bb9-ac53-4cdd-ad9a-aa1b6993581a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:57.128625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:57.231580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1839aa91-fe80-4e71-8736-9ada42a29875 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:57.244464 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1839aa91-fe80-4e71-8736-9ada42a29875 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1471 microversion: 2.1 time: 1.534739 Jul 28 03:39:57.245281 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 480/1025] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:55 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1471 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:57.270593 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-398d68c6-8279-4084-9662-ad09af95f39c req-671baa7e-3bed-4610-9c90-e471d2116b1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76", "tag": "a8b69e61-4d26-492e-8d90-78fee625d19c"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:57.296955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-398d68c6-8279-4084-9662-ad09af95f39c req-671baa7e-3bed-4610-9c90-e471d2116b1f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:57.298108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-398d68c6-8279-4084-9662-ad09af95f39c req-671baa7e-3bed-4610-9c90-e471d2116b1f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:57.314315 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-398d68c6-8279-4084-9662-ad09af95f39c req-671baa7e-3bed-4610-9c90-e471d2116b1f service nova] Creating event network-changed:a8b69e61-4d26-492e-8d90-78fee625d19c for instance 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 on n-h2-826756-3 Jul 28 03:39:57.324940 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-398d68c6-8279-4084-9662-ad09af95f39c req-671baa7e-3bed-4610-9c90-e471d2116b1f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061565 Jul 28 03:39:57.328596 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 481/1026] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:57.340750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0f82d0b2-fd01-4d28-9568-b1b182e0d304 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:57.342861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0f82d0b2-fd01-4d28-9568-b1b182e0d304 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:57.360522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0f82d0b2-fd01-4d28-9568-b1b182e0d304 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:57.362088 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0f82d0b2-fd01-4d28-9568-b1b182e0d304 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:57.363782 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0f82d0b2-fd01-4d28-9568-b1b182e0d304 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:57.365869 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0f82d0b2-fd01-4d28-9568-b1b182e0d304 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:57.858797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0f82d0b2-fd01-4d28-9568-b1b182e0d304 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:57.887857 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0f82d0b2-fd01-4d28-9568-b1b182e0d304 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1316 microversion: 2.1 time: 0.556468 Jul 28 03:39:57.891266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-35ab1bb9-ac53-4cdd-ad9a-aa1b6993581a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:57.924005 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 482/1027] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:57 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1316 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:57.929531 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-35ab1bb9-ac53-4cdd-ad9a-aa1b6993581a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1681 microversion: 2.1 time: 1.199252 Jul 28 03:39:57.934969 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 546/1028] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:56 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1681 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:58.048532 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-a69c450a-f9f8-4887-a1ea-897ea33376a0 req-f662c985-cd75-484f-be4f-30e197751cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5ac650-8b79-43bf-88f9-b18d37196d0d", "name": "network-vif-plugged", "status": "completed", "tag": "0f2c2ab9-d361-41b3-932e-9fe402cf4c3e"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:39:58.106116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a69c450a-f9f8-4887-a1ea-897ea33376a0 req-f662c985-cd75-484f-be4f-30e197751cbd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:58.106952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a69c450a-f9f8-4887-a1ea-897ea33376a0 req-f662c985-cd75-484f-be4f-30e197751cbd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:58.178517 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-a69c450a-f9f8-4887-a1ea-897ea33376a0 req-f662c985-cd75-484f-be4f-30e197751cbd service nova] Creating event network-vif-plugged:0f2c2ab9-d361-41b3-932e-9fe402cf4c3e for instance ed5ac650-8b79-43bf-88f9-b18d37196d0d on n-h2-826756-3 Jul 28 03:39:58.194435 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-a69c450a-f9f8-4887-a1ea-897ea33376a0 req-f662c985-cd75-484f-be4f-30e197751cbd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208088 Jul 28 03:39:58.195659 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 483/1029] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:39:58.273012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-02f9e180-714a-497b-90a2-ca1b32278a18 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:58.275110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-02f9e180-714a-497b-90a2-ca1b32278a18 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:58.311227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02f9e180-714a-497b-90a2-ca1b32278a18 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:58.313258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02f9e180-714a-497b-90a2-ca1b32278a18 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:58.315070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02f9e180-714a-497b-90a2-ca1b32278a18 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:58.316157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02f9e180-714a-497b-90a2-ca1b32278a18 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:58.922798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-def790fd-ec17-4e23-ad51-811a15a7af8c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:58.925283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-def790fd-ec17-4e23-ad51-811a15a7af8c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:58.951795 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-def790fd-ec17-4e23-ad51-811a15a7af8c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:58.952380 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-def790fd-ec17-4e23-ad51-811a15a7af8c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:58.958234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-def790fd-ec17-4e23-ad51-811a15a7af8c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:58.958817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-def790fd-ec17-4e23-ad51-811a15a7af8c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:59.023516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-02f9e180-714a-497b-90a2-ca1b32278a18 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:59.072770 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-02f9e180-714a-497b-90a2-ca1b32278a18 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1471 microversion: 2.1 time: 0.807588 Jul 28 03:39:59.074987 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 547/1030] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:58 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1471 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:39:59.085204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dbe7f291-7a01-484b-8fa1-9b9b5fd1e6a5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:39:59.086750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dbe7f291-7a01-484b-8fa1-9b9b5fd1e6a5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:39:59.104954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dbe7f291-7a01-484b-8fa1-9b9b5fd1e6a5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:59.106196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dbe7f291-7a01-484b-8fa1-9b9b5fd1e6a5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:59.122280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dbe7f291-7a01-484b-8fa1-9b9b5fd1e6a5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:39:59.124022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dbe7f291-7a01-484b-8fa1-9b9b5fd1e6a5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:39:59.324040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-def790fd-ec17-4e23-ad51-811a15a7af8c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:59.339557 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-def790fd-ec17-4e23-ad51-811a15a7af8c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1316 microversion: 2.1 time: 0.422367 Jul 28 03:39:59.340145 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 484/1031] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:58 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:39:59.687120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dbe7f291-7a01-484b-8fa1-9b9b5fd1e6a5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:39:59.694455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:39:59.710277 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dbe7f291-7a01-484b-8fa1-9b9b5fd1e6a5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1681 microversion: 2.1 time: 0.633278 Jul 28 03:39:59.712231 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 548/1032] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:39:59 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1681 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:00.096721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c175e6ce-6417-4292-9996-de7b66d4f221 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:00.098058 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c175e6ce-6417-4292-9996-de7b66d4f221 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:00.106142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c175e6ce-6417-4292-9996-de7b66d4f221 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:00.106986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c175e6ce-6417-4292-9996-de7b66d4f221 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:00.107932 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c175e6ce-6417-4292-9996-de7b66d4f221 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:00.108629 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c175e6ce-6417-4292-9996-de7b66d4f221 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:00.362166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3c64cfb-b8db-48ee-84f0-f117d0b0c170 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:00.362733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3c64cfb-b8db-48ee-84f0-f117d0b0c170 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:00.370707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3c64cfb-b8db-48ee-84f0-f117d0b0c170 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:00.375940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3c64cfb-b8db-48ee-84f0-f117d0b0c170 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:00.379557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3c64cfb-b8db-48ee-84f0-f117d0b0c170 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:00.383116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c175e6ce-6417-4292-9996-de7b66d4f221 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:00.387170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3c64cfb-b8db-48ee-84f0-f117d0b0c170 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:00.393659 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c175e6ce-6417-4292-9996-de7b66d4f221 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1471 microversion: 2.1 time: 0.302225 Jul 28 03:40:00.394270 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 485/1033] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:00 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1471 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:00.735075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-418f0b15-fb3c-41e7-89ee-7c279731c941 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:00.736122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-418f0b15-fb3c-41e7-89ee-7c279731c941 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:00.744604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-418f0b15-fb3c-41e7-89ee-7c279731c941 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:00.745192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-418f0b15-fb3c-41e7-89ee-7c279731c941 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:00.746143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-418f0b15-fb3c-41e7-89ee-7c279731c941 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:00.746780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-418f0b15-fb3c-41e7-89ee-7c279731c941 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:00.921496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-418f0b15-fb3c-41e7-89ee-7c279731c941 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:00.933451 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-418f0b15-fb3c-41e7-89ee-7c279731c941 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.203003 Jul 28 03:40:00.951544 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 486/1034] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:00 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:01.407580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3c64cfb-b8db-48ee-84f0-f117d0b0c170 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:01.421775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fc88ced7-75bd-4fda-b166-4a703dde9826 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:01.423727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fc88ced7-75bd-4fda-b166-4a703dde9826 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:01.424673 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3c64cfb-b8db-48ee-84f0-f117d0b0c170 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1505 microversion: 2.1 time: 1.066072 Jul 28 03:40:01.426192 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 549/1035] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:00 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1505 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:01.431478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:01.443800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc88ced7-75bd-4fda-b166-4a703dde9826 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:01.444896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc88ced7-75bd-4fda-b166-4a703dde9826 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:01.446957 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc88ced7-75bd-4fda-b166-4a703dde9826 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:01.448197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc88ced7-75bd-4fda-b166-4a703dde9826 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:01.477869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0072578c-c9fa-440c-bec0-72effcf33c46 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:01.478863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0072578c-c9fa-440c-bec0-72effcf33c46 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:01.506112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0072578c-c9fa-440c-bec0-72effcf33c46 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:01.507468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0072578c-c9fa-440c-bec0-72effcf33c46 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:01.510418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0072578c-c9fa-440c-bec0-72effcf33c46 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:01.511209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0072578c-c9fa-440c-bec0-72effcf33c46 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:01.606201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0072578c-c9fa-440c-bec0-72effcf33c46 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:40:01.681672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fc88ced7-75bd-4fda-b166-4a703dde9826 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:01.692023 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fc88ced7-75bd-4fda-b166-4a703dde9826 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1471 microversion: 2.1 time: 0.279288 Jul 28 03:40:01.692815 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 487/1036] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:01 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1471 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:01.785354 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0072578c-c9fa-440c-bec0-72effcf33c46 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 204 len: 0 microversion: 2.1 time: 0.326499 Jul 28 03:40:01.786154 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 550/1037] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:40:01 2022] DELETE /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:40:01.806646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7de0a8a3-6c9b-4f59-8299-00933506d28c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:01.807443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7de0a8a3-6c9b-4f59-8299-00933506d28c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:01.834703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7de0a8a3-6c9b-4f59-8299-00933506d28c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:01.835166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7de0a8a3-6c9b-4f59-8299-00933506d28c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:01.836199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7de0a8a3-6c9b-4f59-8299-00933506d28c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:01.836887 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7de0a8a3-6c9b-4f59-8299-00933506d28c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:01.940947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-748396317", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f8adb240-7396-4ba1-87bd-7c26f1c16184"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:01.993301 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7de0a8a3-6c9b-4f59-8299-00933506d28c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:02.001659 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7de0a8a3-6c9b-4f59-8299-00933506d28c tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1511 microversion: 2.1 time: 0.207245 Jul 28 03:40:02.002247 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 488/1038] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:01 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:02.047849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] validate_networks() for [('f8adb240-7396-4ba1-87bd-7c26f1c16184', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:40:02.141778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=14 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:02.152231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1e7ef4f7-281b-4e07-9bd0-013b12b7cafa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:02.153999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1e7ef4f7-281b-4e07-9bd0-013b12b7cafa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:02.168761 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e7ef4f7-281b-4e07-9bd0-013b12b7cafa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:02.169899 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e7ef4f7-281b-4e07-9bd0-013b12b7cafa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:02.171785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e7ef4f7-281b-4e07-9bd0-013b12b7cafa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:02.172824 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e7ef4f7-281b-4e07-9bd0-013b12b7cafa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:02.208295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:02.341537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1e7ef4f7-281b-4e07-9bd0-013b12b7cafa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:02.353023 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1e7ef4f7-281b-4e07-9bd0-013b12b7cafa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.213768 Jul 28 03:40:02.354054 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 489/1039] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:02 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:02.724942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7f1b60aa-11fe-4942-a03a-1b288e104796 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:02.727050 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7f1b60aa-11fe-4942-a03a-1b288e104796 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:02.741955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f1b60aa-11fe-4942-a03a-1b288e104796 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:02.742656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f1b60aa-11fe-4942-a03a-1b288e104796 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:02.743708 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f1b60aa-11fe-4942-a03a-1b288e104796 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:02.744427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f1b60aa-11fe-4942-a03a-1b288e104796 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:03.479779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:40:03.481497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:40:03.482033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:40:03.483056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:40:03.483056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:40:03.493242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7f1b60aa-11fe-4942-a03a-1b288e104796 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:03.503422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:03.503422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:03.503422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:03.507009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:03.510526 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7f1b60aa-11fe-4942-a03a-1b288e104796 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1471 microversion: 2.1 time: 0.795948 Jul 28 03:40:03.536171 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 490/1040] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:02 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1471 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:03.536171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-371de173-cab6-4989-b0d6-b6444414a27b tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:03.536171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-371de173-cab6-4989-b0d6-b6444414a27b tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:03.548114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-371de173-cab6-4989-b0d6-b6444414a27b tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:03.550606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-371de173-cab6-4989-b0d6-b6444414a27b tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:03.551829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-371de173-cab6-4989-b0d6-b6444414a27b tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:03.554313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-371de173-cab6-4989-b0d6-b6444414a27b tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:03.639835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Getting quotas for project edc9288cef154fa28f7057f25e0e3213. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:40:03.656788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Getting quotas for user 670b269eb20c416e9f43f8d4e43ded45 and project edc9288cef154fa28f7057f25e0e3213. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:40:03.688243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:40:03.697429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:40:03.886488 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e3a54795-a14c-43e9-92ea-26dce8cada55 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.031488 Jul 28 03:40:03.889285 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 551/1041] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:40:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:40:03.913164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9702d406-d3b6-40ec-ac12-af3853f98f8a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:03.917622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9702d406-d3b6-40ec-ac12-af3853f98f8a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:04.139585 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-371de173-cab6-4989-b0d6-b6444414a27b tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:04.149624 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-371de173-cab6-4989-b0d6-b6444414a27b tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1511 microversion: 2.1 time: 0.627312 Jul 28 03:40:04.153797 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 491/1042] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:03 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1511 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:04.233487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-6776169b-e535-4564-a0ce-b9fcb868b7d0 req-11fc2521-c41d-45e3-8b26-84a35b78058e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4b8ffa-dbe6-4e90-a8f5-728addf73aae", "name": "network-vif-unplugged", "status": "completed", "tag": "3931df07-76f1-4feb-a179-d48d42b61b21"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:04.257700 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-6776169b-e535-4564-a0ce-b9fcb868b7d0 req-11fc2521-c41d-45e3-8b26-84a35b78058e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:04.260949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-6776169b-e535-4564-a0ce-b9fcb868b7d0 req-11fc2521-c41d-45e3-8b26-84a35b78058e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:04.307191 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-6776169b-e535-4564-a0ce-b9fcb868b7d0 req-11fc2521-c41d-45e3-8b26-84a35b78058e service nova] Creating event network-vif-unplugged:3931df07-76f1-4feb-a179-d48d42b61b21 for instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae on n-h2-826756-3 Jul 28 03:40:04.312847 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-6776169b-e535-4564-a0ce-b9fcb868b7d0 req-11fc2521-c41d-45e3-8b26-84a35b78058e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086076 Jul 28 03:40:04.318272 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 492/1043] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:40:04.323827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7ca7ee0d-f708-4900-adf6-77cd39d89a8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:04.324555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7ca7ee0d-f708-4900-adf6-77cd39d89a8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:04.348000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ca7ee0d-f708-4900-adf6-77cd39d89a8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:04.348637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ca7ee0d-f708-4900-adf6-77cd39d89a8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:04.349478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ca7ee0d-f708-4900-adf6-77cd39d89a8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:04.349950 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ca7ee0d-f708-4900-adf6-77cd39d89a8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:04.621217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7ca7ee0d-f708-4900-adf6-77cd39d89a8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:04.630891 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7ca7ee0d-f708-4900-adf6-77cd39d89a8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.311299 Jul 28 03:40:04.631538 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 493/1044] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:04 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:04.652490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0a0b278e-8284-4aa2-a48c-91150c1cce82 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:04.653106 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0a0b278e-8284-4aa2-a48c-91150c1cce82 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:04.659453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a0b278e-8284-4aa2-a48c-91150c1cce82 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:04.659899 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a0b278e-8284-4aa2-a48c-91150c1cce82 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:04.667408 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a0b278e-8284-4aa2-a48c-91150c1cce82 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:04.667915 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a0b278e-8284-4aa2-a48c-91150c1cce82 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:04.799243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9702d406-d3b6-40ec-ac12-af3853f98f8a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:04.807323 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9702d406-d3b6-40ec-ac12-af3853f98f8a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 200 len: 1207 microversion: 2.1 time: 0.909583 Jul 28 03:40:04.811987 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 552/1045] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:03 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 1207 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:04.819032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f6c3003-baba-4424-8712-27c74705ccf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:04.824829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8f6c3003-baba-4424-8712-27c74705ccf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:04.840471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f6c3003-baba-4424-8712-27c74705ccf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:04.840926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f6c3003-baba-4424-8712-27c74705ccf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:04.841710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f6c3003-baba-4424-8712-27c74705ccf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:04.842513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f6c3003-baba-4424-8712-27c74705ccf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:05.238973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0a0b278e-8284-4aa2-a48c-91150c1cce82 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:05.253125 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0a0b278e-8284-4aa2-a48c-91150c1cce82 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1471 microversion: 2.1 time: 0.620237 Jul 28 03:40:05.265066 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 494/1046] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:04 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1471 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:05.271422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1a894444-e1c2-4a8e-8397-be16ab8dc1e8 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:05.278515 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1a894444-e1c2-4a8e-8397-be16ab8dc1e8 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:05.300702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8f6c3003-baba-4424-8712-27c74705ccf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:05.313294 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8f6c3003-baba-4424-8712-27c74705ccf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.499876 Jul 28 03:40:05.317568 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 553/1047] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:04 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:05.340338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1a894444-e1c2-4a8e-8397-be16ab8dc1e8 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:05.341660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1a894444-e1c2-4a8e-8397-be16ab8dc1e8 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:05.343640 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1a894444-e1c2-4a8e-8397-be16ab8dc1e8 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:05.344338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1a894444-e1c2-4a8e-8397-be16ab8dc1e8 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:05.358975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e545422d-8ef3-49e1-9165-2e51beb70bb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:05.360106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e545422d-8ef3-49e1-9165-2e51beb70bb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:05.394794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e545422d-8ef3-49e1-9165-2e51beb70bb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:05.395297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e545422d-8ef3-49e1-9165-2e51beb70bb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:05.400003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e545422d-8ef3-49e1-9165-2e51beb70bb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:05.402221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e545422d-8ef3-49e1-9165-2e51beb70bb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:05.854885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e545422d-8ef3-49e1-9165-2e51beb70bb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:05.871522 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e545422d-8ef3-49e1-9165-2e51beb70bb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.520010 Jul 28 03:40:05.874707 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 554/1048] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:05 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:05.905219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9cfdbc18-c05f-4669-af9d-1d4a245766c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:05.907099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9cfdbc18-c05f-4669-af9d-1d4a245766c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:05.926993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cfdbc18-c05f-4669-af9d-1d4a245766c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:05.927524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cfdbc18-c05f-4669-af9d-1d4a245766c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:05.928607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cfdbc18-c05f-4669-af9d-1d4a245766c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:05.929344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cfdbc18-c05f-4669-af9d-1d4a245766c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:06.167760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9cfdbc18-c05f-4669-af9d-1d4a245766c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:06.193680 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9cfdbc18-c05f-4669-af9d-1d4a245766c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 200 len: 1259 microversion: 2.1 time: 0.315793 Jul 28 03:40:06.204387 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 555/1049] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:05 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 1259 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:06.219395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ccade524-ac87-4e1a-9fa0-5eac38e6a67e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:06.240115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ccade524-ac87-4e1a-9fa0-5eac38e6a67e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:06.261297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccade524-ac87-4e1a-9fa0-5eac38e6a67e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:06.265570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccade524-ac87-4e1a-9fa0-5eac38e6a67e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:06.268832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccade524-ac87-4e1a-9fa0-5eac38e6a67e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:06.269482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccade524-ac87-4e1a-9fa0-5eac38e6a67e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:06.380495 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ccade524-ac87-4e1a-9fa0-5eac38e6a67e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.180692 Jul 28 03:40:06.383778 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 556/1050] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:40:06 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:40:06.398430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-cb708017-37f1-4cc1-bb2d-a867fd354d81 req-6104afd3-a01d-4761-9f90-bf86ec3602e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5ac650-8b79-43bf-88f9-b18d37196d0d", "name": "network-vif-deleted", "tag": "0f2c2ab9-d361-41b3-932e-9fe402cf4c3e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:06.431324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cb708017-37f1-4cc1-bb2d-a867fd354d81 req-6104afd3-a01d-4761-9f90-bf86ec3602e2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:06.431984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cb708017-37f1-4cc1-bb2d-a867fd354d81 req-6104afd3-a01d-4761-9f90-bf86ec3602e2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:06.467844 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-cb708017-37f1-4cc1-bb2d-a867fd354d81 req-6104afd3-a01d-4761-9f90-bf86ec3602e2 service nova] Creating event network-vif-deleted:0f2c2ab9-d361-41b3-932e-9fe402cf4c3e for instance ed5ac650-8b79-43bf-88f9-b18d37196d0d on n-h2-826756-3 Jul 28 03:40:06.473919 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-cb708017-37f1-4cc1-bb2d-a867fd354d81 req-6104afd3-a01d-4761-9f90-bf86ec3602e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090420 Jul 28 03:40:06.474778 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 557/1051] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:06.483844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e813d113-eb19-40b5-acd7-458cfb7e4686 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:06.484307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e813d113-eb19-40b5-acd7-458cfb7e4686 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:06.492159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e813d113-eb19-40b5-acd7-458cfb7e4686 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:06.493197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e813d113-eb19-40b5-acd7-458cfb7e4686 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:06.494389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e813d113-eb19-40b5-acd7-458cfb7e4686 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:06.495089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e813d113-eb19-40b5-acd7-458cfb7e4686 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:06.686958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e813d113-eb19-40b5-acd7-458cfb7e4686 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:06.700688 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e813d113-eb19-40b5-acd7-458cfb7e4686 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1477 microversion: 2.1 time: 0.221812 Jul 28 03:40:06.701651 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 558/1052] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:06 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1477 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:06.709127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e9da2b9-3f8d-40f7-afe6-dd0b9d6fe2b9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:06.710657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e9da2b9-3f8d-40f7-afe6-dd0b9d6fe2b9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:06.721838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e9da2b9-3f8d-40f7-afe6-dd0b9d6fe2b9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:06.722510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e9da2b9-3f8d-40f7-afe6-dd0b9d6fe2b9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:06.723511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e9da2b9-3f8d-40f7-afe6-dd0b9d6fe2b9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:06.724284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e9da2b9-3f8d-40f7-afe6-dd0b9d6fe2b9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:06.768819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1a894444-e1c2-4a8e-8397-be16ab8dc1e8 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e5420aa54a64a8db808514dc50b596e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011e8a0f854340a8bb93587077ce69ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:06.784634 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1a894444-e1c2-4a8e-8397-be16ab8dc1e8 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 200 len: 1511 microversion: 2.1 time: 1.517943 Jul 28 03:40:06.800714 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 495/1053] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:05 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 1511 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:07.187498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e9da2b9-3f8d-40f7-afe6-dd0b9d6fe2b9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:07.223218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-43737ac4-ad2a-4933-96e0-0a29922ee2fa tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:07.223562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-43737ac4-ad2a-4933-96e0-0a29922ee2fa tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:07.230395 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e9da2b9-3f8d-40f7-afe6-dd0b9d6fe2b9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1670 microversion: 2.1 time: 0.526218 Jul 28 03:40:07.244384 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 559/1054] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:06 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1670 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:07.257580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-43737ac4-ad2a-4933-96e0-0a29922ee2fa tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:07.258025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-43737ac4-ad2a-4933-96e0-0a29922ee2fa tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:07.259016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-43737ac4-ad2a-4933-96e0-0a29922ee2fa tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:07.259445 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-43737ac4-ad2a-4933-96e0-0a29922ee2fa tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:07.621674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-43737ac4-ad2a-4933-96e0-0a29922ee2fa tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:07.640744 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-43737ac4-ad2a-4933-96e0-0a29922ee2fa tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 200 len: 1277 microversion: 2.1 time: 0.424307 Jul 28 03:40:07.652278 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 496/1055] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:07 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 1277 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:07.723146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ba02921-94c3-4f20-a748-caef1c3a70ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:07.723748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ba02921-94c3-4f20-a748-caef1c3a70ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:07.735390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ba02921-94c3-4f20-a748-caef1c3a70ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:07.739335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ba02921-94c3-4f20-a748-caef1c3a70ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:07.740631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ba02921-94c3-4f20-a748-caef1c3a70ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:07.741418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ba02921-94c3-4f20-a748-caef1c3a70ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:07.814366 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9d2c520f-cda1-4ab8-8f73-4e3d862aa582 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:07.814981 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9d2c520f-cda1-4ab8-8f73-4e3d862aa582 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:07.823774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d2c520f-cda1-4ab8-8f73-4e3d862aa582 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:07.824142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d2c520f-cda1-4ab8-8f73-4e3d862aa582 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:07.824932 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d2c520f-cda1-4ab8-8f73-4e3d862aa582 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:07.837231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d2c520f-cda1-4ab8-8f73-4e3d862aa582 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:07.871219 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-9d2c520f-cda1-4ab8-8f73-4e3d862aa582 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] HTTP exception thrown: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9d2c520f-cda1-4ab8-8f73-4e3d862aa582 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Request method failure captured: Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d HTTP/1.1 Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gT3W2xkxhYMEJMLTTZadKFIzexVaTb6nhffhmAp3W3qoShw68_n1TgfHbK_rx7G6rtP13ixG3eNM6WmTnfGzqis8EU-Iq6gJeKf0STnG4Pm0XHANZCRqpQpZELMFk58meYysmNtG3OalaNkeUluG3aDGbstGcxnPe9I1I-y0cyRD5o Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 011e8a0f854340a8bb93587077ce69ae Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:40:07.873231 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:40:07.874709 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/011e8a0f854340a8bb93587077ce69ae"}]}] Jul 28 03:40:07.874709 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:07.874709 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 011e8a0f854340a8bb93587077ce69ae Jul 28 03:40:07.874709 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:07.874709 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesNegativeTestJSON-1404960803-project Jul 28 03:40:07.874709 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:40:07.874709 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:40:07.874709 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 8e5420aa54a64a8db808514dc50b596e Jul 28 03:40:07.874709 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesNegativeTestJSON-1404960803-project Jul 28 03:40:07.874709 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:40:07.874709 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:07.874709 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'ed5ac650-8b79-43bf-88f9-b18d37196d0d'} Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:40:07.875533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:07.877632 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:07.887059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9d2c520f-cda1-4ab8-8f73-4e3d862aa582 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Returning 404 to user: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:40:07.891798 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9d2c520f-cda1-4ab8-8f73-4e3d862aa582 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 404 len: 111 microversion: 2.1 time: 0.078797 Jul 28 03:40:07.892853 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 497/1056] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:07 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:40:07.898381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aa1feede-001c-40cc-a9b6-e165ca2f360a tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2131334733", "metadata": {"image_type": "test"}}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:07.917272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-aa1feede-001c-40cc-a9b6-e165ca2f360a tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:07.936609 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa1feede-001c-40cc-a9b6-e165ca2f360a tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:07.938280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa1feede-001c-40cc-a9b6-e165ca2f360a tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:07.938280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa1feede-001c-40cc-a9b6-e165ca2f360a tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:07.938280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa1feede-001c-40cc-a9b6-e165ca2f360a tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:07.975877 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-aa1feede-001c-40cc-a9b6-e165ca2f360a tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] HTTP exception thrown: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aa1feede-001c-40cc-a9b6-e165ca2f360a tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Request method failure captured: Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d/action HTTP/1.1 Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 112 Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gT3W2xkxhYMEJMLTTZadKFIzexVaTb6nhffhmAp3W3qoShw68_n1TgfHbK_rx7G6rtP13ixG3eNM6WmTnfGzqis8EU-Iq6gJeKf0STnG4Pm0XHANZCRqpQpZELMFk58meYysmNtG3OalaNkeUluG3aDGbstGcxnPe9I1I-y0cyRD5o Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 011e8a0f854340a8bb93587077ce69ae Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:40:07.978379 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:40:07.979885 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/011e8a0f854340a8bb93587077ce69ae"}]}] Jul 28 03:40:07.979885 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:07.979885 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 011e8a0f854340a8bb93587077ce69ae Jul 28 03:40:07.979885 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:07.979885 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesNegativeTestJSON-1404960803-project Jul 28 03:40:07.979885 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:40:07.979885 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:40:07.979885 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 8e5420aa54a64a8db808514dc50b596e Jul 28 03:40:07.979885 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesNegativeTestJSON-1404960803-project Jul 28 03:40:07.979885 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:40:07.979885 n-d-826756-3 devstack@n-api.service[126072]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2131334733", "metadata": {"image_type": "test"}}} Jul 28 03:40:07.979885 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'ed5ac650-8b79-43bf-88f9-b18d37196d0d', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2131334733', 'metadata': {'image_type': 'test'}}}} Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:07.980722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:07.981995 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:07.983233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:07.983233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:40:07.983233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:40:07.983233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:07.983233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:07.983233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aa1feede-001c-40cc-a9b6-e165ca2f360a tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Returning 404 to user: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:40:07.983233 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aa1feede-001c-40cc-a9b6-e165ca2f360a tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "POST /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d/action" status: 404 len: 111 microversion: 2.1 time: 0.086073 Jul 28 03:40:07.990689 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 498/1057] 10.222.0.48 () {60 vars in 1279 bytes} [Thu Jul 28 03:40:07 2022] POST /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d/action => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:40:07.996691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-672f3154-6761-4b83-87bc-f80402a37ef2 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1762630350", "metadata": {"image_type": "test"}}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:08.002780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-672f3154-6761-4b83-87bc-f80402a37ef2 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Failed to fetch instance by id tempest-invalid-523669692 {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2972}} Jul 28 03:40:08.003299 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-672f3154-6761-4b83-87bc-f80402a37ef2 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] HTTP exception thrown: Instance tempest-invalid-523669692 could not be found. Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-672f3154-6761-4b83-87bc-f80402a37ef2 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Request method failure captured: Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/tempest-invalid-523669692/action HTTP/1.1 Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 112 Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gT3W2xkxhYMEJMLTTZadKFIzexVaTb6nhffhmAp3W3qoShw68_n1TgfHbK_rx7G6rtP13ixG3eNM6WmTnfGzqis8EU-Iq6gJeKf0STnG4Pm0XHANZCRqpQpZELMFk58meYysmNtG3OalaNkeUluG3aDGbstGcxnPe9I1I-y0cyRD5o Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 011e8a0f854340a8bb93587077ce69ae Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:40:08.005325 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:40:08.007361 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/011e8a0f854340a8bb93587077ce69ae"}]}] Jul 28 03:40:08.007361 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.007361 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 011e8a0f854340a8bb93587077ce69ae Jul 28 03:40:08.007361 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.007361 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesNegativeTestJSON-1404960803-project Jul 28 03:40:08.007361 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:40:08.007361 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:40:08.007361 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 8e5420aa54a64a8db808514dc50b596e Jul 28 03:40:08.007361 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesNegativeTestJSON-1404960803-project Jul 28 03:40:08.007361 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:40:08.007361 n-d-826756-3 devstack@n-api.service[126072]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1762630350", "metadata": {"image_type": "test"}}} Jul 28 03:40:08.007361 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:40:08.007361 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance tempest-invalid-523669692 could not be found. Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'tempest-invalid-523669692', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1762630350', 'metadata': {'image_type': 'test'}}}} Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2973, in get Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-523669692 could not be found. Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:40:08.008333 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-523669692 could not be found. Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-523669692 could not be found. Jul 28 03:40:08.009877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.011120 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-672f3154-6761-4b83-87bc-f80402a37ef2 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Returning 404 to user: Instance tempest-invalid-523669692 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:40:08.011325 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-672f3154-6761-4b83-87bc-f80402a37ef2 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "POST /compute/v2.1/servers/tempest-invalid-523669692/action" status: 404 len: 100 microversion: 2.1 time: 0.019371 Jul 28 03:40:08.017878 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 499/1058] 10.222.0.48 () {60 vars in 1246 bytes} [Thu Jul 28 03:40:07 2022] POST /compute/v2.1/servers/tempest-invalid-523669692/action => generated 100 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:40:08.027926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0642bbb8-0d92-431b-8c11-a3149d5915ac tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-413118513"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:08.044899 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0642bbb8-0d92-431b-8c11-a3149d5915ac tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2972}} Jul 28 03:40:08.046096 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-0642bbb8-0d92-431b-8c11-a3149d5915ac tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0642bbb8-0d92-431b-8c11-a3149d5915ac tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Request method failure captured: Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 56 Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gT3W2xkxhYMEJMLTTZadKFIzexVaTb6nhffhmAp3W3qoShw68_n1TgfHbK_rx7G6rtP13ixG3eNM6WmTnfGzqis8EU-Iq6gJeKf0STnG4Pm0XHANZCRqpQpZELMFk58meYysmNtG3OalaNkeUluG3aDGbstGcxnPe9I1I-y0cyRD5o Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 011e8a0f854340a8bb93587077ce69ae Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:40:08.050744 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:40:08.052971 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/011e8a0f854340a8bb93587077ce69ae"}]}] Jul 28 03:40:08.052971 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.052971 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 011e8a0f854340a8bb93587077ce69ae Jul 28 03:40:08.052971 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.052971 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesNegativeTestJSON-1404960803-project Jul 28 03:40:08.052971 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:40:08.052971 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:40:08.052971 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 8e5420aa54a64a8db808514dc50b596e Jul 28 03:40:08.052971 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesNegativeTestJSON-1404960803-project Jul 28 03:40:08.052971 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:40:08.052971 n-d-826756-3 devstack@n-api.service[126072]: {"createImage": {"name": "tempest-test-snap-413118513"}} Jul 28 03:40:08.052971 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:40:08.052971 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-413118513'}}} Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2973, in get Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:40:08.054064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 03:40:08.056072 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.059601 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0642bbb8-0d92-431b-8c11-a3149d5915ac tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:40:08.060745 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0642bbb8-0d92-431b-8c11-a3149d5915ac tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.041056 Jul 28 03:40:08.061735 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 500/1059] 10.222.0.48 () {60 vars in 1275 bytes} [Thu Jul 28 03:40:08 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:40:08.074228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d3ecff81-63c2-4e46-8aad-e116b7571722 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1211115457"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:08.077985 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d3ecff81-63c2-4e46-8aad-e116b7571722 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2972}} Jul 28 03:40:08.079381 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-d3ecff81-63c2-4e46-8aad-e116b7571722 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d3ecff81-63c2-4e46-8aad-e116b7571722 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Request method failure captured: Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 57 Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gT3W2xkxhYMEJMLTTZadKFIzexVaTb6nhffhmAp3W3qoShw68_n1TgfHbK_rx7G6rtP13ixG3eNM6WmTnfGzqis8EU-Iq6gJeKf0STnG4Pm0XHANZCRqpQpZELMFk58meYysmNtG3OalaNkeUluG3aDGbstGcxnPe9I1I-y0cyRD5o Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 011e8a0f854340a8bb93587077ce69ae Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:40:08.081146 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:40:08.082798 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/011e8a0f854340a8bb93587077ce69ae"}]}] Jul 28 03:40:08.082798 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.082798 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 011e8a0f854340a8bb93587077ce69ae Jul 28 03:40:08.082798 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.082798 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesNegativeTestJSON-1404960803-project Jul 28 03:40:08.082798 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:40:08.082798 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:40:08.082798 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 8e5420aa54a64a8db808514dc50b596e Jul 28 03:40:08.082798 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesNegativeTestJSON-1404960803-project Jul 28 03:40:08.082798 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:40:08.082798 n-d-826756-3 devstack@n-api.service[126072]: {"createImage": {"name": "tempest-test-snap-1211115457"}} Jul 28 03:40:08.082798 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:40:08.082798 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1211115457'}}} Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2973, in get Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:40:08.083652 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 28 03:40:08.084990 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.088711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d3ecff81-63c2-4e46-8aad-e116b7571722 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:40:08.090454 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d3ecff81-63c2-4e46-8aad-e116b7571722 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.021935 Jul 28 03:40:08.092128 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 501/1060] 10.222.0.48 () {60 vars in 1281 bytes} [Thu Jul 28 03:40:08 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:40:08.117952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c63b0a41-f839-4cb3-8bb6-fd61b44c9648 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:08.119803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c63b0a41-f839-4cb3-8bb6-fd61b44c9648 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:08.140589 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c63b0a41-f839-4cb3-8bb6-fd61b44c9648 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:08.141855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c63b0a41-f839-4cb3-8bb6-fd61b44c9648 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:08.147272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c63b0a41-f839-4cb3-8bb6-fd61b44c9648 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:08.148613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c63b0a41-f839-4cb3-8bb6-fd61b44c9648 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:08.165312 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-c63b0a41-f839-4cb3-8bb6-fd61b44c9648 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] HTTP exception thrown: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c63b0a41-f839-4cb3-8bb6-fd61b44c9648 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Request method failure captured: Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d HTTP/1.1 Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gT3W2xkxhYMEJMLTTZadKFIzexVaTb6nhffhmAp3W3qoShw68_n1TgfHbK_rx7G6rtP13ixG3eNM6WmTnfGzqis8EU-Iq6gJeKf0STnG4Pm0XHANZCRqpQpZELMFk58meYysmNtG3OalaNkeUluG3aDGbstGcxnPe9I1I-y0cyRD5o Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 011e8a0f854340a8bb93587077ce69ae Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:40:08.167311 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:40:08.168810 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/011e8a0f854340a8bb93587077ce69ae"}]}] Jul 28 03:40:08.168810 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.168810 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 011e8a0f854340a8bb93587077ce69ae Jul 28 03:40:08.168810 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.168810 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesNegativeTestJSON-1404960803-project Jul 28 03:40:08.168810 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:40:08.168810 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:40:08.168810 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 8e5420aa54a64a8db808514dc50b596e Jul 28 03:40:08.168810 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesNegativeTestJSON-1404960803-project Jul 28 03:40:08.168810 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:40:08.168810 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:08.168810 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'ed5ac650-8b79-43bf-88f9-b18d37196d0d'} Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:40:08.169599 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:08.170828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.172936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c63b0a41-f839-4cb3-8bb6-fd61b44c9648 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Returning 404 to user: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:40:08.174357 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c63b0a41-f839-4cb3-8bb6-fd61b44c9648 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 404 len: 111 microversion: 2.1 time: 0.071467 Jul 28 03:40:08.175458 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 502/1061] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:40:08 2022] DELETE /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:40:08.186158 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3beff91b-cf80-4f5b-9400-6c99730e5976 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:08.187112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3beff91b-cf80-4f5b-9400-6c99730e5976 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] [instance: ed5ac650-8b79-43bf-88f9-b18d37196d0d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:08.200575 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3beff91b-cf80-4f5b-9400-6c99730e5976 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:08.201726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3beff91b-cf80-4f5b-9400-6c99730e5976 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:08.205071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3beff91b-cf80-4f5b-9400-6c99730e5976 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:08.206570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3beff91b-cf80-4f5b-9400-6c99730e5976 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:08.240423 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-3beff91b-cf80-4f5b-9400-6c99730e5976 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] HTTP exception thrown: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3beff91b-cf80-4f5b-9400-6c99730e5976 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Request method failure captured: Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d HTTP/1.1 Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gT3W2xkxhYMEJMLTTZadKFIzexVaTb6nhffhmAp3W3qoShw68_n1TgfHbK_rx7G6rtP13ixG3eNM6WmTnfGzqis8EU-Iq6gJeKf0STnG4Pm0XHANZCRqpQpZELMFk58meYysmNtG3OalaNkeUluG3aDGbstGcxnPe9I1I-y0cyRD5o Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 011e8a0f854340a8bb93587077ce69ae Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:40:08.242159 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:40:08.243878 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_011e8a0f854340a8bb93587077ce69ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/011e8a0f854340a8bb93587077ce69ae"}]}] Jul 28 03:40:08.243878 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.243878 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 011e8a0f854340a8bb93587077ce69ae Jul 28 03:40:08.243878 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1404960803 Jul 28 03:40:08.243878 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesNegativeTestJSON-1404960803-project Jul 28 03:40:08.243878 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:40:08.243878 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:40:08.243878 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 8e5420aa54a64a8db808514dc50b596e Jul 28 03:40:08.243878 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesNegativeTestJSON-1404960803-project Jul 28 03:40:08.243878 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:40:08.243878 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:08.243878 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'ed5ac650-8b79-43bf-88f9-b18d37196d0d'} Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:40:08.245086 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. Jul 28 03:40:08.247319 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:40:08.252005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3beff91b-cf80-4f5b-9400-6c99730e5976 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] Returning 404 to user: Instance ed5ac650-8b79-43bf-88f9-b18d37196d0d could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:40:08.253180 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3beff91b-cf80-4f5b-9400-6c99730e5976 tempest-ImagesNegativeTestJSON-1404960803 tempest-ImagesNegativeTestJSON-1404960803-project] 10.222.0.48 "GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d" status: 404 len: 111 microversion: 2.1 time: 0.071838 Jul 28 03:40:08.258943 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 503/1062] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:08 2022] GET /compute/v2.1/servers/ed5ac650-8b79-43bf-88f9-b18d37196d0d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:40:08.265682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ba02921-94c3-4f20-a748-caef1c3a70ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:08.282473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d64355b6-cbc8-496f-8d90-7005cce7098e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:08.283473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d64355b6-cbc8-496f-8d90-7005cce7098e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:08.285568 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ba02921-94c3-4f20-a748-caef1c3a70ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1477 microversion: 2.1 time: 0.566897 Jul 28 03:40:08.288297 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 560/1063] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:07 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1477 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:08.307382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d64355b6-cbc8-496f-8d90-7005cce7098e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:08.308485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d64355b6-cbc8-496f-8d90-7005cce7098e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:08.309813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d64355b6-cbc8-496f-8d90-7005cce7098e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:08.310489 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d64355b6-cbc8-496f-8d90-7005cce7098e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:08.667961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e53f6f23-4669-4d0d-86e1-2b1a6a5b2efe tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:08.668614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e53f6f23-4669-4d0d-86e1-2b1a6a5b2efe tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:08.679960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e53f6f23-4669-4d0d-86e1-2b1a6a5b2efe tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:08.684613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e53f6f23-4669-4d0d-86e1-2b1a6a5b2efe tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:08.685902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e53f6f23-4669-4d0d-86e1-2b1a6a5b2efe tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:08.686552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e53f6f23-4669-4d0d-86e1-2b1a6a5b2efe tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:08.783671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e53f6f23-4669-4d0d-86e1-2b1a6a5b2efe tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:08.798308 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e53f6f23-4669-4d0d-86e1-2b1a6a5b2efe tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 200 len: 1265 microversion: 2.1 time: 0.135339 Jul 28 03:40:08.800619 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 561/1064] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:08 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:08.910094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d64355b6-cbc8-496f-8d90-7005cce7098e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:08.921478 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d64355b6-cbc8-496f-8d90-7005cce7098e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1670 microversion: 2.1 time: 0.649749 Jul 28 03:40:08.923201 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 504/1065] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:08 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1670 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:08.950080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e141df89-513e-4bba-84ab-fce7ed8762ba req-4320bbf3-6931-49c8-ab59-f9ea24401acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b019cf-2b83-4fba-adf1-a5ffaf2faeab", "name": "network-vif-unplugged", "status": "completed", "tag": "d3aac98a-25aa-4c76-8c14-3b69b36b3eb6"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:08.979520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e141df89-513e-4bba-84ab-fce7ed8762ba req-4320bbf3-6931-49c8-ab59-f9ea24401acd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:08.980455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e141df89-513e-4bba-84ab-fce7ed8762ba req-4320bbf3-6931-49c8-ab59-f9ea24401acd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:09.011699 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e141df89-513e-4bba-84ab-fce7ed8762ba req-4320bbf3-6931-49c8-ab59-f9ea24401acd service nova] Creating event network-vif-unplugged:d3aac98a-25aa-4c76-8c14-3b69b36b3eb6 for instance 95b019cf-2b83-4fba-adf1-a5ffaf2faeab on n-h1-826756-3 Jul 28 03:40:09.027936 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e141df89-513e-4bba-84ab-fce7ed8762ba req-4320bbf3-6931-49c8-ab59-f9ea24401acd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093524 Jul 28 03:40:09.030131 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 562/1066] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:09.326917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-101e693c-ea05-4d74-822c-5834bc7cef7c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:09.328755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-101e693c-ea05-4d74-822c-5834bc7cef7c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:09.338294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-101e693c-ea05-4d74-822c-5834bc7cef7c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:09.339745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-101e693c-ea05-4d74-822c-5834bc7cef7c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:09.342241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-101e693c-ea05-4d74-822c-5834bc7cef7c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:09.343453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-101e693c-ea05-4d74-822c-5834bc7cef7c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:09.816671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-101e693c-ea05-4d74-822c-5834bc7cef7c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:09.836771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3075a7eb-0bfd-4673-98ff-410bc840647c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:09.839633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3075a7eb-0bfd-4673-98ff-410bc840647c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:09.872321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3075a7eb-0bfd-4673-98ff-410bc840647c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:09.874755 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-101e693c-ea05-4d74-822c-5834bc7cef7c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1477 microversion: 2.1 time: 0.557958 Jul 28 03:40:09.875979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3075a7eb-0bfd-4673-98ff-410bc840647c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:09.877684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3075a7eb-0bfd-4673-98ff-410bc840647c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:09.879355 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 505/1067] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:09 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1477 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:09.880934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3075a7eb-0bfd-4673-98ff-410bc840647c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:09.959716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-589e6df7-880a-470d-9b6c-686fe22fee2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:09.962920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-589e6df7-880a-470d-9b6c-686fe22fee2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:09.981654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-589e6df7-880a-470d-9b6c-686fe22fee2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:09.982114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-589e6df7-880a-470d-9b6c-686fe22fee2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:09.982911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-589e6df7-880a-470d-9b6c-686fe22fee2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:09.983341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-589e6df7-880a-470d-9b6c-686fe22fee2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:10.335944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-589e6df7-880a-470d-9b6c-686fe22fee2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:10.357582 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-589e6df7-880a-470d-9b6c-686fe22fee2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.407264 Jul 28 03:40:10.390855 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 506/1068] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:09 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:10.406934 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d6e34377-06e6-4955-b5da-a353e07e673d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:10.407939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3075a7eb-0bfd-4673-98ff-410bc840647c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:10.410816 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d6e34377-06e6-4955-b5da-a353e07e673d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:10.422443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6e34377-06e6-4955-b5da-a353e07e673d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:10.423440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6e34377-06e6-4955-b5da-a353e07e673d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:10.426084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6e34377-06e6-4955-b5da-a353e07e673d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:10.426916 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6e34377-06e6-4955-b5da-a353e07e673d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:10.436062 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3075a7eb-0bfd-4673-98ff-410bc840647c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 200 len: 1307 microversion: 2.1 time: 0.608676 Jul 28 03:40:10.444542 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 563/1069] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:09 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 1307 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:10.588767 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d6e34377-06e6-4955-b5da-a353e07e673d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 200 len: 323 microversion: 2.1 time: 0.188502 Jul 28 03:40:10.600849 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 507/1070] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:40:10 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:40:10.605741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-60027526-c6a4-4907-9bf7-9ab80487a47a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:10.607518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-60027526-c6a4-4907-9bf7-9ab80487a47a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:10.618311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60027526-c6a4-4907-9bf7-9ab80487a47a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:10.619611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60027526-c6a4-4907-9bf7-9ab80487a47a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:10.621314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60027526-c6a4-4907-9bf7-9ab80487a47a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:10.622391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60027526-c6a4-4907-9bf7-9ab80487a47a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:10.903161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-68802635-175e-43c9-aae0-ce7a62f22084 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:10.904317 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-68802635-175e-43c9-aae0-ce7a62f22084 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:10.928417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-68802635-175e-43c9-aae0-ce7a62f22084 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:10.931144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-68802635-175e-43c9-aae0-ce7a62f22084 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:10.936513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-68802635-175e-43c9-aae0-ce7a62f22084 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:10.937430 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-68802635-175e-43c9-aae0-ce7a62f22084 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:10.944462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-60027526-c6a4-4907-9bf7-9ab80487a47a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:10.966468 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-60027526-c6a4-4907-9bf7-9ab80487a47a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.364159 Jul 28 03:40:10.969135 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 564/1071] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:10 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:11.008161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ce75007-0042-4ce0-9c57-3444b8a556ad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:11.009600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ce75007-0042-4ce0-9c57-3444b8a556ad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:11.029823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ce75007-0042-4ce0-9c57-3444b8a556ad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:11.033103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ce75007-0042-4ce0-9c57-3444b8a556ad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:11.040565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ce75007-0042-4ce0-9c57-3444b8a556ad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:11.041210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ce75007-0042-4ce0-9c57-3444b8a556ad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:11.282776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2ce75007-0042-4ce0-9c57-3444b8a556ad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:11.290801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:11.294482 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ce75007-0042-4ce0-9c57-3444b8a556ad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.298901 Jul 28 03:40:11.307295 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 565/1072] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:10 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:11.317657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a2074640-3aa4-4828-927a-c3c37b14e58d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:11.318870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a2074640-3aa4-4828-927a-c3c37b14e58d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:11.327476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2074640-3aa4-4828-927a-c3c37b14e58d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:11.328295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2074640-3aa4-4828-927a-c3c37b14e58d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:11.329495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2074640-3aa4-4828-927a-c3c37b14e58d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:11.330198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2074640-3aa4-4828-927a-c3c37b14e58d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:11.554125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-68802635-175e-43c9-aae0-ce7a62f22084 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:11.579645 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-68802635-175e-43c9-aae0-ce7a62f22084 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1477 microversion: 2.1 time: 0.683127 Jul 28 03:40:11.581071 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 508/1073] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:10 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1477 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:11.589192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2c4df0a8-cbe1-40b1-bdb9-b12691a1733b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:11.590233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2c4df0a8-cbe1-40b1-bdb9-b12691a1733b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:11.611970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a2074640-3aa4-4828-927a-c3c37b14e58d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:11.626120 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a2074640-3aa4-4828-927a-c3c37b14e58d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.310177 Jul 28 03:40:11.627255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c4df0a8-cbe1-40b1-bdb9-b12691a1733b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:11.628008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c4df0a8-cbe1-40b1-bdb9-b12691a1733b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:11.629413 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c4df0a8-cbe1-40b1-bdb9-b12691a1733b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:11.630098 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c4df0a8-cbe1-40b1-bdb9-b12691a1733b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:11.640366 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 566/1074] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:11 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:11.648013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c62a16e-585a-48e6-88f7-f933fb5ba653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:11.649938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5c62a16e-585a-48e6-88f7-f933fb5ba653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:11.658786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c62a16e-585a-48e6-88f7-f933fb5ba653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:11.659579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c62a16e-585a-48e6-88f7-f933fb5ba653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:11.660906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c62a16e-585a-48e6-88f7-f933fb5ba653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:11.661531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c62a16e-585a-48e6-88f7-f933fb5ba653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:11.824807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5c62a16e-585a-48e6-88f7-f933fb5ba653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:11.838388 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5c62a16e-585a-48e6-88f7-f933fb5ba653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.194012 Jul 28 03:40:11.841605 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 567/1075] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:11 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:12.055416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1447367808", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f76c85a0-c616-4cd2-a4d5-29a90d49abe8"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:12.152460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] validate_networks() for [('f76c85a0-c616-4cd2-a4d5-29a90d49abe8', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:40:12.230606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2c4df0a8-cbe1-40b1-bdb9-b12691a1733b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:12.249520 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2c4df0a8-cbe1-40b1-bdb9-b12691a1733b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 200 len: 1307 microversion: 2.1 time: 0.666996 Jul 28 03:40:12.250417 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 509/1076] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:11 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 1307 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:12.605619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-abe58470-9f08-41bd-9491-f2fffdc86054 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:12.606314 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-abe58470-9f08-41bd-9491-f2fffdc86054 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:12.619427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abe58470-9f08-41bd-9491-f2fffdc86054 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:12.619973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abe58470-9f08-41bd-9491-f2fffdc86054 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:12.621560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abe58470-9f08-41bd-9491-f2fffdc86054 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:12.623332 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abe58470-9f08-41bd-9491-f2fffdc86054 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:12.808192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:40:12.808743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:40:12.809215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:40:12.809626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:40:12.810036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:40:12.830183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:12.830637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:12.831439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:12.831878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:12.914248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Getting quotas for project b7bee0b59b0b43ce80623b7aca24111a. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:40:12.925104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Getting quotas for user 26b9a63a13e1420aa3b7f299456c65e6 and project b7bee0b59b0b43ce80623b7aca24111a. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:40:12.930622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:12.951440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:40:12.955404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:40:13.087267 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bbcc1eb1-cb15-4f4b-9d35-c2bea144e781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035010 Jul 28 03:40:13.089963 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 568/1077] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:40:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:40:13.100303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0bb24c4f-9e26-48d0-b524-bc7fbde3db09 req-a4503aad-4d0f-430b-b130-f4b5c9898e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a436784-353a-401e-877a-fcc0ac2fceb7", "tag": "4de6423a-6733-4628-b10d-534a2cfa5f75"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:13.141814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0bb24c4f-9e26-48d0-b524-bc7fbde3db09 req-a4503aad-4d0f-430b-b130-f4b5c9898e4e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:13.142559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0bb24c4f-9e26-48d0-b524-bc7fbde3db09 req-a4503aad-4d0f-430b-b130-f4b5c9898e4e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:13.144171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-abe58470-9f08-41bd-9491-f2fffdc86054 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:13.156776 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-abe58470-9f08-41bd-9491-f2fffdc86054 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1477 microversion: 2.1 time: 0.555525 Jul 28 03:40:13.158071 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 510/1078] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:12 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1477 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:13.166880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-0b7eb21b-d8b9-41a0-baea-8f521467746f req-51e9c730-23e3-4b84-8d63-f801bf750a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b019cf-2b83-4fba-adf1-a5ffaf2faeab", "name": "network-vif-plugged", "status": "completed", "tag": "d3aac98a-25aa-4c76-8c14-3b69b36b3eb6"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:13.175222 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0bb24c4f-9e26-48d0-b524-bc7fbde3db09 req-a4503aad-4d0f-430b-b130-f4b5c9898e4e service nova] Creating event network-changed:4de6423a-6733-4628-b10d-534a2cfa5f75 for instance 9a436784-353a-401e-877a-fcc0ac2fceb7 on n-h1-826756-3 Jul 28 03:40:13.183831 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0bb24c4f-9e26-48d0-b524-bc7fbde3db09 req-a4503aad-4d0f-430b-b130-f4b5c9898e4e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091409 Jul 28 03:40:13.185437 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 569/1079] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:13.192387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b1f9b53-316f-4982-9f12-20d02e3d84e3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:13.193234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-0b7eb21b-d8b9-41a0-baea-8f521467746f req-51e9c730-23e3-4b84-8d63-f801bf750a30 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:13.193779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-0b7eb21b-d8b9-41a0-baea-8f521467746f req-51e9c730-23e3-4b84-8d63-f801bf750a30 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:13.194801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b1f9b53-316f-4982-9f12-20d02e3d84e3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:13.232014 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-0b7eb21b-d8b9-41a0-baea-8f521467746f req-51e9c730-23e3-4b84-8d63-f801bf750a30 service nova] Creating event network-vif-plugged:d3aac98a-25aa-4c76-8c14-3b69b36b3eb6 for instance 95b019cf-2b83-4fba-adf1-a5ffaf2faeab on n-h1-826756-3 Jul 28 03:40:13.248975 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-0b7eb21b-d8b9-41a0-baea-8f521467746f req-51e9c730-23e3-4b84-8d63-f801bf750a30 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087500 Jul 28 03:40:13.250557 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 511/1080] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:13.275839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-11dc9077-46a4-4ff8-a09e-8f3dcc1588b5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:13.276868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-11dc9077-46a4-4ff8-a09e-8f3dcc1588b5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:13.290920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-11dc9077-46a4-4ff8-a09e-8f3dcc1588b5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:13.291551 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-11dc9077-46a4-4ff8-a09e-8f3dcc1588b5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:13.293559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-11dc9077-46a4-4ff8-a09e-8f3dcc1588b5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:13.294373 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-11dc9077-46a4-4ff8-a09e-8f3dcc1588b5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:13.302748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b1f9b53-316f-4982-9f12-20d02e3d84e3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:13.319352 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b1f9b53-316f-4982-9f12-20d02e3d84e3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1215 microversion: 2.1 time: 0.131861 Jul 28 03:40:13.320028 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 570/1081] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:13 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:13.765825 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-11dc9077-46a4-4ff8-a09e-8f3dcc1588b5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:13.778685 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-11dc9077-46a4-4ff8-a09e-8f3dcc1588b5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 200 len: 1307 microversion: 2.1 time: 0.508868 Jul 28 03:40:13.779279 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 512/1082] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:13 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 1307 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:14.194513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d24170bc-e61c-44a7-8711-0c0f85ffcaa4 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:14.197583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d24170bc-e61c-44a7-8711-0c0f85ffcaa4 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:14.211624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d24170bc-e61c-44a7-8711-0c0f85ffcaa4 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:14.212382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d24170bc-e61c-44a7-8711-0c0f85ffcaa4 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:14.213389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d24170bc-e61c-44a7-8711-0c0f85ffcaa4 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:14.213986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d24170bc-e61c-44a7-8711-0c0f85ffcaa4 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:14.349833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ee689414-f99a-49ee-b248-4fdec52b2cb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:14.354262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ee689414-f99a-49ee-b248-4fdec52b2cb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:14.711506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ee689414-f99a-49ee-b248-4fdec52b2cb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:14.728044 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ee689414-f99a-49ee-b248-4fdec52b2cb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1215 microversion: 2.1 time: 0.390674 Jul 28 03:40:14.740389 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 513/1083] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:14 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1215 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:14.820763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5c1655ea-ab33-4c49-9c2e-65c3b55d94d5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:14.822004 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5c1655ea-ab33-4c49-9c2e-65c3b55d94d5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:14.872444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5c1655ea-ab33-4c49-9c2e-65c3b55d94d5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:14.872994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5c1655ea-ab33-4c49-9c2e-65c3b55d94d5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:14.874014 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5c1655ea-ab33-4c49-9c2e-65c3b55d94d5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:14.874421 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5c1655ea-ab33-4c49-9c2e-65c3b55d94d5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:14.894333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:14.955612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d24170bc-e61c-44a7-8711-0c0f85ffcaa4 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:14.977207 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d24170bc-e61c-44a7-8711-0c0f85ffcaa4 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1477 microversion: 2.1 time: 0.792980 Jul 28 03:40:14.979759 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 571/1084] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:14 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1477 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:15.186927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5c1655ea-ab33-4c49-9c2e-65c3b55d94d5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:15.208085 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5c1655ea-ab33-4c49-9c2e-65c3b55d94d5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 200 len: 1307 microversion: 2.1 time: 0.395273 Jul 28 03:40:15.217600 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 514/1085] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:14 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 1307 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:15.761105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-835e81b3-a599-4efb-b83b-987c5558c1a7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:15.761909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-835e81b3-a599-4efb-b83b-987c5558c1a7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:15.770679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-835e81b3-a599-4efb-b83b-987c5558c1a7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:15.771159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-835e81b3-a599-4efb-b83b-987c5558c1a7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:15.771947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-835e81b3-a599-4efb-b83b-987c5558c1a7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:15.772390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-835e81b3-a599-4efb-b83b-987c5558c1a7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:16.011612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fa03771a-7d9e-4531-b43c-b5ef6ae43dfb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:16.014582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fa03771a-7d9e-4531-b43c-b5ef6ae43dfb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:16.030847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa03771a-7d9e-4531-b43c-b5ef6ae43dfb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:16.039210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa03771a-7d9e-4531-b43c-b5ef6ae43dfb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:16.045891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa03771a-7d9e-4531-b43c-b5ef6ae43dfb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:16.046635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa03771a-7d9e-4531-b43c-b5ef6ae43dfb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:16.133725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-835e81b3-a599-4efb-b83b-987c5558c1a7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:16.156862 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-835e81b3-a599-4efb-b83b-987c5558c1a7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1267 microversion: 2.1 time: 0.392023 Jul 28 03:40:16.176786 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 572/1086] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:15 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1267 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:16.528147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-983da4f2-7f00-4264-bdb9-b55787191511 tempest-InstanceUsageAuditLogTestJSON-647852691 tempest-InstanceUsageAuditLogTestJSON-647852691-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:16.529833 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:40:16.529833 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:40:16.547294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fa03771a-7d9e-4531-b43c-b5ef6ae43dfb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:16.556306 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-983da4f2-7f00-4264-bdb9-b55787191511 tempest-InstanceUsageAuditLogTestJSON-647852691 tempest-InstanceUsageAuditLogTestJSON-647852691-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28 03:40:16" status: 200 len: 318 microversion: 2.1 time: 0.375404 Jul 28 03:40:16.557189 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 573/1087] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 03:40:16 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-28%2003%3A40%3A16 => generated 318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:16.573247 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fa03771a-7d9e-4531-b43c-b5ef6ae43dfb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1477 microversion: 2.1 time: 0.565277 Jul 28 03:40:16.574131 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 515/1088] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:16 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1477 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:16.578916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fe1e16a5-b81c-4cd6-aa6c-ef8425fd232d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:16.579969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fe1e16a5-b81c-4cd6-aa6c-ef8425fd232d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:16.587401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe1e16a5-b81c-4cd6-aa6c-ef8425fd232d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:16.588093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe1e16a5-b81c-4cd6-aa6c-ef8425fd232d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:16.593158 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b6c2d58f-a889-4708-a7da-f8a06032219b tempest-InstanceUsageAuditLogTestJSON-647852691 tempest-InstanceUsageAuditLogTestJSON-647852691-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:16.594555 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:40:16.594555 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:40:16.601425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe1e16a5-b81c-4cd6-aa6c-ef8425fd232d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:16.602145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe1e16a5-b81c-4cd6-aa6c-ef8425fd232d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:16.661445 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b6c2d58f-a889-4708-a7da-f8a06032219b tempest-InstanceUsageAuditLogTestJSON-647852691 tempest-InstanceUsageAuditLogTestJSON-647852691-project-admin] 10.222.0.48 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.082668 Jul 28 03:40:16.662593 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 516/1089] 10.222.0.48 () {58 vars in 1185 bytes} [Thu Jul 28 03:40:16 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:16.783895 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b3832346-1e6f-4e52-8ebe-fce306d3eb3b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:16.785125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b3832346-1e6f-4e52-8ebe-fce306d3eb3b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:16.815242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3832346-1e6f-4e52-8ebe-fce306d3eb3b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:16.816003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3832346-1e6f-4e52-8ebe-fce306d3eb3b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:16.817416 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3832346-1e6f-4e52-8ebe-fce306d3eb3b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:16.818219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3832346-1e6f-4e52-8ebe-fce306d3eb3b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:17.481437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fe1e16a5-b81c-4cd6-aa6c-ef8425fd232d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:17.491404 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fe1e16a5-b81c-4cd6-aa6c-ef8425fd232d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 200 len: 1307 microversion: 2.1 time: 0.932928 Jul 28 03:40:17.509302 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 574/1090] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:16 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 1307 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:17.512166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6085f1e8-8bd6-46b6-9b3a-096d2e10a410 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:17.513095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6085f1e8-8bd6-46b6-9b3a-096d2e10a410 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:17.535565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6085f1e8-8bd6-46b6-9b3a-096d2e10a410 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:17.543958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6085f1e8-8bd6-46b6-9b3a-096d2e10a410 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:17.547133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6085f1e8-8bd6-46b6-9b3a-096d2e10a410 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:17.549311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6085f1e8-8bd6-46b6-9b3a-096d2e10a410 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:17.698715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-b3832346-1e6f-4e52-8ebe-fce306d3eb3b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid fcbae58d-a326-4197-a350-9278d664d3e7 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:40:17.730203 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b3832346-1e6f-4e52-8ebe-fce306d3eb3b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 2344 microversion: 2.25 time: 0.952237 Jul 28 03:40:17.735184 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 517/1091] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:40:16 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 2344 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:40:17.743837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-344d6e87-f2cc-4a9f-be47-fd7887ef7ddb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:17.746532 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-344d6e87-f2cc-4a9f-be47-fd7887ef7ddb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:17.753993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-344d6e87-f2cc-4a9f-be47-fd7887ef7ddb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:17.755664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-344d6e87-f2cc-4a9f-be47-fd7887ef7ddb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:17.756818 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-344d6e87-f2cc-4a9f-be47-fd7887ef7ddb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:17.757500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-344d6e87-f2cc-4a9f-be47-fd7887ef7ddb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:18.065919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6085f1e8-8bd6-46b6-9b3a-096d2e10a410 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:18.076895 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6085f1e8-8bd6-46b6-9b3a-096d2e10a410 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1273 microversion: 2.1 time: 0.579511 Jul 28 03:40:18.077786 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 575/1092] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:17 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1273 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:18.083317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b78f205e-4fe8-4e80-869a-e3aec9d43fd8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:18.088904 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:40:18.088904 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:40:18.097331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b78f205e-4fe8-4e80-869a-e3aec9d43fd8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:18.097331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b78f205e-4fe8-4e80-869a-e3aec9d43fd8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:18.097331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b78f205e-4fe8-4e80-869a-e3aec9d43fd8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:18.097894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b78f205e-4fe8-4e80-869a-e3aec9d43fd8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:18.124082 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b78f205e-4fe8-4e80-869a-e3aec9d43fd8 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.044892 Jul 28 03:40:18.129723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-344d6e87-f2cc-4a9f-be47-fd7887ef7ddb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:18.132970 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 576/1093] 10.222.0.48 () {60 vars in 1217 bytes} [Thu Jul 28 03:40:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:40:18.159609 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-344d6e87-f2cc-4a9f-be47-fd7887ef7ddb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1463 microversion: 2.1 time: 0.422492 Jul 28 03:40:18.160681 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 518/1094] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:17 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1463 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:18.188324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0a95b87f-c204-47c4-8422-e1c27c026fe3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:18.190272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0a95b87f-c204-47c4-8422-e1c27c026fe3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:18.208880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a95b87f-c204-47c4-8422-e1c27c026fe3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:18.210397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a95b87f-c204-47c4-8422-e1c27c026fe3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:18.212627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a95b87f-c204-47c4-8422-e1c27c026fe3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:18.213320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a95b87f-c204-47c4-8422-e1c27c026fe3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:18.533009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-51b7b045-867d-4ab1-a031-e6adacc30363 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:18.534087 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-51b7b045-867d-4ab1-a031-e6adacc30363 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:18.546594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51b7b045-867d-4ab1-a031-e6adacc30363 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:18.547585 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51b7b045-867d-4ab1-a031-e6adacc30363 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:18.548789 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51b7b045-867d-4ab1-a031-e6adacc30363 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:18.549631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51b7b045-867d-4ab1-a031-e6adacc30363 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:18.884255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-51b7b045-867d-4ab1-a031-e6adacc30363 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:18.919401 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-51b7b045-867d-4ab1-a031-e6adacc30363 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 200 len: 1307 microversion: 2.1 time: 0.392661 Jul 28 03:40:18.921161 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 519/1095] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:18 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 1307 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:19.099734 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a966e24e-6d3a-460b-b0be-b86c3969c7a8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:19.100655 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a966e24e-6d3a-460b-b0be-b86c3969c7a8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:19.111615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a966e24e-6d3a-460b-b0be-b86c3969c7a8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:19.117146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a966e24e-6d3a-460b-b0be-b86c3969c7a8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:19.117995 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a966e24e-6d3a-460b-b0be-b86c3969c7a8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:19.118428 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a966e24e-6d3a-460b-b0be-b86c3969c7a8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:19.360865 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a966e24e-6d3a-460b-b0be-b86c3969c7a8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:19.371921 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a966e24e-6d3a-460b-b0be-b86c3969c7a8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1273 microversion: 2.1 time: 0.276194 Jul 28 03:40:19.376215 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 520/1096] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:19 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1273 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:19.439611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0a95b87f-c204-47c4-8422-e1c27c026fe3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:19.449974 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0a95b87f-c204-47c4-8422-e1c27c026fe3 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1463 microversion: 2.1 time: 1.269150 Jul 28 03:40:19.450567 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 577/1097] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:18 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1463 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:19.481385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:19.485229 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:19.498328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:19.501566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:19.502607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:19.505933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:19.675333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:40:19.677842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:40:19.678614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:40:19.679173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:40:19.684925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:40:19.836574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:19.855503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:19.855947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:19.856778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:19.857235 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:19.946275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3938c62e-bfaa-41ae-87a5-a5a9d095f71a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:19.952113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3938c62e-bfaa-41ae-87a5-a5a9d095f71a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:19.990956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3938c62e-bfaa-41ae-87a5-a5a9d095f71a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:19.991644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3938c62e-bfaa-41ae-87a5-a5a9d095f71a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:19.993021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3938c62e-bfaa-41ae-87a5-a5a9d095f71a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:19.993584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3938c62e-bfaa-41ae-87a5-a5a9d095f71a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:20.012543 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b3a64243-5130-48d9-b5d7-b45708c0b3d0 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "POST /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab/action" status: 202 len: 1067 microversion: 2.1 time: 0.535864 Jul 28 03:40:20.027023 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 521/1098] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:40:19 2022] POST /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab/action => generated 1067 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 28 03:40:20.060540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-33001124-30f3-4df9-86d5-92a6832ac4eb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:20.061789 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-33001124-30f3-4df9-86d5-92a6832ac4eb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:20.073862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33001124-30f3-4df9-86d5-92a6832ac4eb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:20.074885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33001124-30f3-4df9-86d5-92a6832ac4eb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:20.076679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33001124-30f3-4df9-86d5-92a6832ac4eb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:20.077634 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33001124-30f3-4df9-86d5-92a6832ac4eb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:20.424546 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-33001124-30f3-4df9-86d5-92a6832ac4eb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:20.437796 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-33001124-30f3-4df9-86d5-92a6832ac4eb tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1472 microversion: 2.1 time: 0.391496 Jul 28 03:40:20.440121 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 522/1099] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:20 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1472 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:20.465228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b0a7e46-aa87-4900-8230-0848b2d4760c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:20.468811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2b0a7e46-aa87-4900-8230-0848b2d4760c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:20.491900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b0a7e46-aa87-4900-8230-0848b2d4760c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:20.493051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b0a7e46-aa87-4900-8230-0848b2d4760c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:20.499279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b0a7e46-aa87-4900-8230-0848b2d4760c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:20.502396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b0a7e46-aa87-4900-8230-0848b2d4760c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:20.640552 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2b0a7e46-aa87-4900-8230-0848b2d4760c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:20.656408 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2b0a7e46-aa87-4900-8230-0848b2d4760c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1273 microversion: 2.1 time: 0.213460 Jul 28 03:40:20.657704 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 523/1100] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:20 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1273 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:20.818290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3938c62e-bfaa-41ae-87a5-a5a9d095f71a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:20.839519 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3938c62e-bfaa-41ae-87a5-a5a9d095f71a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 200 len: 1307 microversion: 2.1 time: 0.900375 Jul 28 03:40:20.857977 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 578/1101] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:19 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 1307 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:20.932487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8499008a-fec6-44fa-9207-36ca39d4fe4a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef4be6a5-aa12-47c2-82f1-3db1ef0201f3", "device": "/dev/xvdb"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:20.935936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8499008a-fec6-44fa-9207-36ca39d4fe4a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:20.943064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8499008a-fec6-44fa-9207-36ca39d4fe4a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:20.944142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8499008a-fec6-44fa-9207-36ca39d4fe4a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:20.945197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8499008a-fec6-44fa-9207-36ca39d4fe4a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:20.945873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8499008a-fec6-44fa-9207-36ca39d4fe4a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:21.411699 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8499008a-fec6-44fa-9207-36ca39d4fe4a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "POST /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.485906 Jul 28 03:40:21.413780 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 524/1102] 10.222.0.48 () {62 vars in 1364 bytes} [Thu Jul 28 03:40:20 2022] POST /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments => generated 194 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:40:21.463219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b3b960c-d87d-470b-9ad7-b394f01bd2d2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:21.464208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b3b960c-d87d-470b-9ad7-b394f01bd2d2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:21.481936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b3b960c-d87d-470b-9ad7-b394f01bd2d2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:21.483529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b3b960c-d87d-470b-9ad7-b394f01bd2d2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:21.486455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b3b960c-d87d-470b-9ad7-b394f01bd2d2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:21.487047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b3b960c-d87d-470b-9ad7-b394f01bd2d2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:21.679083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-012d8af0-b3d4-4157-9267-609e9be59d14 req-83417761-60b7-463b-9a73-1063ed1e8301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a436784-353a-401e-877a-fcc0ac2fceb7", "name": "network-vif-plugged", "status": "completed", "tag": "4de6423a-6733-4628-b10d-534a2cfa5f75"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:21.701504 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-012d8af0-b3d4-4157-9267-609e9be59d14 req-83417761-60b7-463b-9a73-1063ed1e8301 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:21.705271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-012d8af0-b3d4-4157-9267-609e9be59d14 req-83417761-60b7-463b-9a73-1063ed1e8301 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:21.740914 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-012d8af0-b3d4-4157-9267-609e9be59d14 req-83417761-60b7-463b-9a73-1063ed1e8301 service nova] Creating event network-vif-plugged:4de6423a-6733-4628-b10d-534a2cfa5f75 for instance 9a436784-353a-401e-877a-fcc0ac2fceb7 on n-h1-826756-3 Jul 28 03:40:21.750900 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-012d8af0-b3d4-4157-9267-609e9be59d14 req-83417761-60b7-463b-9a73-1063ed1e8301 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080180 Jul 28 03:40:21.755908 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 525/1103] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:40:21.770561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9735e45f-cda6-42eb-99e4-30369d555a49 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:21.771568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9735e45f-cda6-42eb-99e4-30369d555a49 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:21.801601 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9735e45f-cda6-42eb-99e4-30369d555a49 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:21.803756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9735e45f-cda6-42eb-99e4-30369d555a49 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:21.806085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9735e45f-cda6-42eb-99e4-30369d555a49 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:21.806838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9735e45f-cda6-42eb-99e4-30369d555a49 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:22.110674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9735e45f-cda6-42eb-99e4-30369d555a49 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:22.120739 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9735e45f-cda6-42eb-99e4-30369d555a49 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1315 microversion: 2.1 time: 0.357193 Jul 28 03:40:22.121977 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 526/1104] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:21 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:22.136088 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-94e80dfd-e588-408f-b00e-b9889a9e322e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:22.136729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-94e80dfd-e588-408f-b00e-b9889a9e322e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:22.147699 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-94e80dfd-e588-408f-b00e-b9889a9e322e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:22.148134 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-94e80dfd-e588-408f-b00e-b9889a9e322e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:22.149457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-94e80dfd-e588-408f-b00e-b9889a9e322e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:22.150331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-94e80dfd-e588-408f-b00e-b9889a9e322e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:22.272416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7b3b960c-d87d-470b-9ad7-b394f01bd2d2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:22.288815 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b3b960c-d87d-470b-9ad7-b394f01bd2d2 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1472 microversion: 2.1 time: 0.830282 Jul 28 03:40:22.304945 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 579/1105] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:21 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1472 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:22.393805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-94e80dfd-e588-408f-b00e-b9889a9e322e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:22.402470 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-94e80dfd-e588-408f-b00e-b9889a9e322e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 200 len: 1307 microversion: 2.1 time: 0.279017 Jul 28 03:40:22.413748 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 527/1106] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:22 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 1307 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:22.856976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8c6bd45f-7549-4b5c-bc7f-577a767d4b9b tempest-AbsoluteLimitsTestJSON-646850594 tempest-AbsoluteLimitsTestJSON-646850594-project] Calling method '.version_select at 0x7ffa74229b80>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:22.871498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c6bd45f-7549-4b5c-bc7f-577a767d4b9b tempest-AbsoluteLimitsTestJSON-646850594 tempest-AbsoluteLimitsTestJSON-646850594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:22.872229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c6bd45f-7549-4b5c-bc7f-577a767d4b9b tempest-AbsoluteLimitsTestJSON-646850594 tempest-AbsoluteLimitsTestJSON-646850594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:22.873244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c6bd45f-7549-4b5c-bc7f-577a767d4b9b tempest-AbsoluteLimitsTestJSON-646850594 tempest-AbsoluteLimitsTestJSON-646850594-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:22.873895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c6bd45f-7549-4b5c-bc7f-577a767d4b9b tempest-AbsoluteLimitsTestJSON-646850594 tempest-AbsoluteLimitsTestJSON-646850594-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:22.902848 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8c6bd45f-7549-4b5c-bc7f-577a767d4b9b tempest-AbsoluteLimitsTestJSON-646850594 tempest-AbsoluteLimitsTestJSON-646850594-project] 10.222.0.48 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.596250 Jul 28 03:40:22.903865 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 580/1107] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 03:40:22 2022] GET /compute/v2.1/limits => generated 511 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:23.142934 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1e3f7eb5-725a-401d-9e23-7d7cdbf4c6ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:23.143432 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1e3f7eb5-725a-401d-9e23-7d7cdbf4c6ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:23.155114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e3f7eb5-725a-401d-9e23-7d7cdbf4c6ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:23.155555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e3f7eb5-725a-401d-9e23-7d7cdbf4c6ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:23.165567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e3f7eb5-725a-401d-9e23-7d7cdbf4c6ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:23.168419 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e3f7eb5-725a-401d-9e23-7d7cdbf4c6ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:23.569505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1e3f7eb5-725a-401d-9e23-7d7cdbf4c6ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:23.582565 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1e3f7eb5-725a-401d-9e23-7d7cdbf4c6ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1315 microversion: 2.1 time: 0.443322 Jul 28 03:40:23.584275 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 528/1108] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:23 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:23.590103 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7fec4027-2763-425e-839d-5515ebd78870 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:23.590972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7fec4027-2763-425e-839d-5515ebd78870 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:23.600166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fec4027-2763-425e-839d-5515ebd78870 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:23.601387 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fec4027-2763-425e-839d-5515ebd78870 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:23.602621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fec4027-2763-425e-839d-5515ebd78870 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:23.603276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fec4027-2763-425e-839d-5515ebd78870 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:23.611279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:23.888017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-942870846", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:23.937421 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7fec4027-2763-425e-839d-5515ebd78870 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:23.948031 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7fec4027-2763-425e-839d-5515ebd78870 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1472 microversion: 2.1 time: 0.362417 Jul 28 03:40:23.950949 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 529/1109] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:23 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1472 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:23.958790 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-f663e055-2703-42a3-81e9-d495b6cfdd1b req-52bf9c34-3dcf-4f06-b621-65a2c77cd43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "472d1cfd-d5de-4031-81b3-d6d3b2a6be21", "tag": "8b7c5c8d-e7eb-4dee-995a-2f41bedd4e40"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:23.986061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:40:23.993324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f663e055-2703-42a3-81e9-d495b6cfdd1b req-52bf9c34-3dcf-4f06-b621-65a2c77cd43e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:23.998441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f663e055-2703-42a3-81e9-d495b6cfdd1b req-52bf9c34-3dcf-4f06-b621-65a2c77cd43e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:24.024810 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-f663e055-2703-42a3-81e9-d495b6cfdd1b req-52bf9c34-3dcf-4f06-b621-65a2c77cd43e service nova] Creating event network-changed:8b7c5c8d-e7eb-4dee-995a-2f41bedd4e40 for instance 472d1cfd-d5de-4031-81b3-d6d3b2a6be21 on n-h2-826756-3 Jul 28 03:40:24.037525 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-f663e055-2703-42a3-81e9-d495b6cfdd1b req-52bf9c34-3dcf-4f06-b621-65a2c77cd43e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079867 Jul 28 03:40:24.038241 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 530/1110] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:24.050035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dafe7dd1-13aa-4897-a833-008e91d9429f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:24.050736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dafe7dd1-13aa-4897-a833-008e91d9429f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:24.068628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:24.073875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dafe7dd1-13aa-4897-a833-008e91d9429f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:24.075656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dafe7dd1-13aa-4897-a833-008e91d9429f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:24.076793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dafe7dd1-13aa-4897-a833-008e91d9429f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:24.078536 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dafe7dd1-13aa-4897-a833-008e91d9429f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:24.400487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dafe7dd1-13aa-4897-a833-008e91d9429f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:24.421576 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dafe7dd1-13aa-4897-a833-008e91d9429f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 200 len: 1488 microversion: 2.1 time: 0.380612 Jul 28 03:40:24.429596 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 531/1111] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:24 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 1488 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:24.465524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-27bff9c7-3cc5-4ae3-9ca3-2dcda18d1863 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:24.467078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-27bff9c7-3cc5-4ae3-9ca3-2dcda18d1863 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:24.480507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27bff9c7-3cc5-4ae3-9ca3-2dcda18d1863 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:24.481186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27bff9c7-3cc5-4ae3-9ca3-2dcda18d1863 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:24.485163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27bff9c7-3cc5-4ae3-9ca3-2dcda18d1863 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:24.486333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27bff9c7-3cc5-4ae3-9ca3-2dcda18d1863 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:24.637988 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-27bff9c7-3cc5-4ae3-9ca3-2dcda18d1863 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "POST /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7/action" status: 202 len: 0 microversion: 2.1 time: 0.172660 Jul 28 03:40:24.641012 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 532/1112] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:40:24 2022] POST /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:40:24.660273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-32c5ead2-9132-4b28-b8d5-12ab66e5ff62 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:24.662736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-32c5ead2-9132-4b28-b8d5-12ab66e5ff62 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:24.680090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:40:24.680946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:40:24.683098 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-32c5ead2-9132-4b28-b8d5-12ab66e5ff62 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:24.683665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:40:24.685405 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-32c5ead2-9132-4b28-b8d5-12ab66e5ff62 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:24.686409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:40:24.688823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-32c5ead2-9132-4b28-b8d5-12ab66e5ff62 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:24.689007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:40:24.689622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-32c5ead2-9132-4b28-b8d5-12ab66e5ff62 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:24.725034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:24.726034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:24.727030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:24.727717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:24.772872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Getting quotas for project 4c78a01dfb2242a3bf66939666031eb9. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:40:24.792403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Getting quotas for user f6e8d4e8b898489a819618e4b3b97994 and project 4c78a01dfb2242a3bf66939666031eb9. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:40:24.812934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:40:24.816451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:40:24.975791 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b52a6e54-507b-4617-9972-d4a25e267108 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.767385 Jul 28 03:40:24.993615 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 581/1113] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:40:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:40:25.003337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70797462-0041-4e95-8d1b-30674198d35d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:25.010089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-70797462-0041-4e95-8d1b-30674198d35d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:25.023856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70797462-0041-4e95-8d1b-30674198d35d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:25.041124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70797462-0041-4e95-8d1b-30674198d35d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:25.042819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70797462-0041-4e95-8d1b-30674198d35d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:25.043432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70797462-0041-4e95-8d1b-30674198d35d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:25.122367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-32c5ead2-9132-4b28-b8d5-12ab66e5ff62 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:25.132894 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-32c5ead2-9132-4b28-b8d5-12ab66e5ff62 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1315 microversion: 2.1 time: 0.490540 Jul 28 03:40:25.136753 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 533/1114] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:24 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:25.158341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-50b628ae-917c-47a9-aa7d-48b48899e79d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:25.158966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-50b628ae-917c-47a9-aa7d-48b48899e79d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:25.174322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50b628ae-917c-47a9-aa7d-48b48899e79d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:25.174770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50b628ae-917c-47a9-aa7d-48b48899e79d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:25.175545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50b628ae-917c-47a9-aa7d-48b48899e79d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:25.175977 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50b628ae-917c-47a9-aa7d-48b48899e79d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:25.470100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-50b628ae-917c-47a9-aa7d-48b48899e79d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:25.484932 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-50b628ae-917c-47a9-aa7d-48b48899e79d tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1472 microversion: 2.1 time: 0.346131 Jul 28 03:40:25.486305 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 534/1115] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:25 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1472 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:25.506621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-55e005e7-5685-4165-ac8b-c6f9d0d581b8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:25.507817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-55e005e7-5685-4165-ac8b-c6f9d0d581b8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:25.615076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-70797462-0041-4e95-8d1b-30674198d35d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:25.631998 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-70797462-0041-4e95-8d1b-30674198d35d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 200 len: 1473 microversion: 2.1 time: 0.636482 Jul 28 03:40:25.632999 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 582/1116] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:24 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 1473 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:25.675967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9b885817-a556-4d92-9259-80dd624990d9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-452792799"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:25.684012 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-55e005e7-5685-4165-ac8b-c6f9d0d581b8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:25.686821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9b885817-a556-4d92-9259-80dd624990d9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:25.717892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b885817-a556-4d92-9259-80dd624990d9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:25.718950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b885817-a556-4d92-9259-80dd624990d9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:25.720513 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-55e005e7-5685-4165-ac8b-c6f9d0d581b8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1218 microversion: 2.1 time: 0.228174 Jul 28 03:40:25.720772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b885817-a556-4d92-9259-80dd624990d9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:25.721741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b885817-a556-4d92-9259-80dd624990d9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:25.726563 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 535/1117] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:25 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1218 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:26.179707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a78e75a2-18dc-4bae-a1c3-aeabc3d34b12 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:26.181231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a78e75a2-18dc-4bae-a1c3-aeabc3d34b12 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:26.201262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a78e75a2-18dc-4bae-a1c3-aeabc3d34b12 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:26.201712 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a78e75a2-18dc-4bae-a1c3-aeabc3d34b12 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:26.202676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a78e75a2-18dc-4bae-a1c3-aeabc3d34b12 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:26.203109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a78e75a2-18dc-4bae-a1c3-aeabc3d34b12 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:26.566735 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9b885817-a556-4d92-9259-80dd624990d9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "POST /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7/action" status: 202 len: 0 microversion: 2.1 time: 0.897065 Jul 28 03:40:26.570398 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 583/1118] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:40:25 2022] POST /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7/action => generated 0 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 03:40:26.626816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-34f6ab4b-dc6d-4888-affe-ef8eb8536d29 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:26.632550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-34f6ab4b-dc6d-4888-affe-ef8eb8536d29 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:26.658920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34f6ab4b-dc6d-4888-affe-ef8eb8536d29 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:26.660513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34f6ab4b-dc6d-4888-affe-ef8eb8536d29 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:26.666734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34f6ab4b-dc6d-4888-affe-ef8eb8536d29 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:26.667691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34f6ab4b-dc6d-4888-affe-ef8eb8536d29 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:26.733510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a78e75a2-18dc-4bae-a1c3-aeabc3d34b12 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:26.747645 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a78e75a2-18dc-4bae-a1c3-aeabc3d34b12 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1315 microversion: 2.1 time: 0.588432 Jul 28 03:40:26.754683 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 536/1119] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:26 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:26.776622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-42f05fad-e706-4181-9b49-74ad07c84471 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa745c8280>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:26.954633 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-42f05fad-e706-4181-9b49-74ad07c84471 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.195080 Jul 28 03:40:26.963720 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 537/1120] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:26 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:26.987027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-57e2264e-64e2-4677-a429-985ce3f99e8d tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:26.988313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-57e2264e-64e2-4677-a429-985ce3f99e8d tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:27.042769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-57e2264e-64e2-4677-a429-985ce3f99e8d tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:27.044047 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-57e2264e-64e2-4677-a429-985ce3f99e8d tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:27.045058 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-57e2264e-64e2-4677-a429-985ce3f99e8d tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:27.053189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-57e2264e-64e2-4677-a429-985ce3f99e8d tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:27.269141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-57e2264e-64e2-4677-a429-985ce3f99e8d tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:27.291123 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-57e2264e-64e2-4677-a429-985ce3f99e8d tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1270 microversion: 2.1 time: 0.323664 Jul 28 03:40:27.296210 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 538/1121] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:26 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1270 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:27.416241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-34f6ab4b-dc6d-4888-affe-ef8eb8536d29 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:27.436003 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-34f6ab4b-dc6d-4888-affe-ef8eb8536d29 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1472 microversion: 2.1 time: 0.863086 Jul 28 03:40:27.451273 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 584/1122] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:26 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1472 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:27.777346 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bbfd9004-3981-4a41-9b75-eaaccb6e5201 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:27.778421 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bbfd9004-3981-4a41-9b75-eaaccb6e5201 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:27.793295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bbfd9004-3981-4a41-9b75-eaaccb6e5201 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:27.797113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bbfd9004-3981-4a41-9b75-eaaccb6e5201 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:27.798144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bbfd9004-3981-4a41-9b75-eaaccb6e5201 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:27.798743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bbfd9004-3981-4a41-9b75-eaaccb6e5201 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:27.989772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b110727a-16eb-4cbd-b1e2-440783279349 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74309430>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:28.073029 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b110727a-16eb-4cbd-b1e2-440783279349 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.087203 Jul 28 03:40:28.078990 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 585/1123] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:27 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:28.317997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2564fbac-0d8d-4056-ab9b-ae10f5a942a1 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:28.318754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2564fbac-0d8d-4056-ab9b-ae10f5a942a1 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:28.351649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2564fbac-0d8d-4056-ab9b-ae10f5a942a1 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:28.352289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2564fbac-0d8d-4056-ab9b-ae10f5a942a1 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:28.355939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2564fbac-0d8d-4056-ab9b-ae10f5a942a1 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:28.362958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2564fbac-0d8d-4056-ab9b-ae10f5a942a1 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:28.475411 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bbfd9004-3981-4a41-9b75-eaaccb6e5201 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:28.498067 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bbfd9004-3981-4a41-9b75-eaaccb6e5201 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1315 microversion: 2.1 time: 0.727689 Jul 28 03:40:28.503166 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 539/1124] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:27 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1315 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:28.527930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-35701838-4554-4100-bcbe-461290c2f4ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:28.541980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-35701838-4554-4100-bcbe-461290c2f4ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:28.571412 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-35701838-4554-4100-bcbe-461290c2f4ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:28.576759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-35701838-4554-4100-bcbe-461290c2f4ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:28.581481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-35701838-4554-4100-bcbe-461290c2f4ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:28.582883 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-35701838-4554-4100-bcbe-461290c2f4ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:28.807770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2564fbac-0d8d-4056-ab9b-ae10f5a942a1 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:28.827289 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2564fbac-0d8d-4056-ab9b-ae10f5a942a1 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1276 microversion: 2.1 time: 0.516105 Jul 28 03:40:28.827891 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 586/1125] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:28 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1276 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:28.943793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-35701838-4554-4100-bcbe-461290c2f4ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:28.962544 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-35701838-4554-4100-bcbe-461290c2f4ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1472 microversion: 2.1 time: 0.457294 Jul 28 03:40:28.963156 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 540/1126] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:28 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1472 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:29.089094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f69ae8ef-2c0d-4a6a-9a02-a411f1683b47 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74239310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:29.165298 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f69ae8ef-2c0d-4a6a-9a02-a411f1683b47 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.080029 Jul 28 03:40:29.180924 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 587/1127] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:29 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:29.532678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ed101dbb-f24e-41ec-9813-4012a62871e4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:29.533337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ed101dbb-f24e-41ec-9813-4012a62871e4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:29.561036 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed101dbb-f24e-41ec-9813-4012a62871e4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:29.561774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed101dbb-f24e-41ec-9813-4012a62871e4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:29.562845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed101dbb-f24e-41ec-9813-4012a62871e4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:29.563668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed101dbb-f24e-41ec-9813-4012a62871e4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:29.856931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ef806f81-ee8b-4220-b876-9b94a583fbe6 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:29.857557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ef806f81-ee8b-4220-b876-9b94a583fbe6 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:29.872224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef806f81-ee8b-4220-b876-9b94a583fbe6 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:29.872716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef806f81-ee8b-4220-b876-9b94a583fbe6 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:29.873524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef806f81-ee8b-4220-b876-9b94a583fbe6 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:29.873969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef806f81-ee8b-4220-b876-9b94a583fbe6 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:29.961956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:30.096547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ed101dbb-f24e-41ec-9813-4012a62871e4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:30.106650 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ed101dbb-f24e-41ec-9813-4012a62871e4 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1315 microversion: 2.1 time: 0.579716 Jul 28 03:40:30.110490 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 541/1128] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:29 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:30.128579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6a077765-f822-4bbd-83c7-d085990aaf2c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:30.129514 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6a077765-f822-4bbd-83c7-d085990aaf2c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:30.153401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a077765-f822-4bbd-83c7-d085990aaf2c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:30.161407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a077765-f822-4bbd-83c7-d085990aaf2c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:30.162256 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a077765-f822-4bbd-83c7-d085990aaf2c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:30.162702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a077765-f822-4bbd-83c7-d085990aaf2c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:30.217067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ef806f81-ee8b-4220-b876-9b94a583fbe6 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:30.225114 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ef806f81-ee8b-4220-b876-9b94a583fbe6 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1276 microversion: 2.1 time: 0.374360 Jul 28 03:40:30.225697 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 588/1129] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:29 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1276 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:30.259707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-179d5d2c-2d43-43a5-9afb-049dd67c2862 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa741d50d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:30.369886 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-179d5d2c-2d43-43a5-9afb-049dd67c2862 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.123874 Jul 28 03:40:30.370876 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 589/1130] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:30 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:31.034825 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6a077765-f822-4bbd-83c7-d085990aaf2c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:31.081021 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6a077765-f822-4bbd-83c7-d085990aaf2c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1472 microversion: 2.1 time: 0.968668 Jul 28 03:40:31.087658 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 542/1131] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:30 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1472 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:31.130636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-45afdb68-cfea-45e2-9470-9cf6c500f7a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:31.131710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-45afdb68-cfea-45e2-9470-9cf6c500f7a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:31.143336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45afdb68-cfea-45e2-9470-9cf6c500f7a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:31.144111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45afdb68-cfea-45e2-9470-9cf6c500f7a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:31.148104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45afdb68-cfea-45e2-9470-9cf6c500f7a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:31.150135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45afdb68-cfea-45e2-9470-9cf6c500f7a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:31.267922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c6893897-5c97-409f-86eb-aad6f5a4c98a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:31.268673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c6893897-5c97-409f-86eb-aad6f5a4c98a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:31.278127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6893897-5c97-409f-86eb-aad6f5a4c98a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:31.282497 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6893897-5c97-409f-86eb-aad6f5a4c98a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:31.284886 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6893897-5c97-409f-86eb-aad6f5a4c98a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:31.286412 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6893897-5c97-409f-86eb-aad6f5a4c98a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:31.825781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-45afdb68-cfea-45e2-9470-9cf6c500f7a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:31.841904 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-45afdb68-cfea-45e2-9470-9cf6c500f7a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1315 microversion: 2.1 time: 0.715824 Jul 28 03:40:31.842517 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 590/1132] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:31 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:31.857588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5efdcb8f-61f1-4dae-90bd-1df427090328 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74239f70>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:32.012044 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5efdcb8f-61f1-4dae-90bd-1df427090328 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.158273 Jul 28 03:40:32.012702 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 591/1133] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:31 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:32.125197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f52e4d2-a40f-435e-96a7-f24c28083243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:32.126129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8f52e4d2-a40f-435e-96a7-f24c28083243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:32.137833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f52e4d2-a40f-435e-96a7-f24c28083243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:32.140297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f52e4d2-a40f-435e-96a7-f24c28083243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:32.141173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f52e4d2-a40f-435e-96a7-f24c28083243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:32.141617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f52e4d2-a40f-435e-96a7-f24c28083243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:32.389915 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c6893897-5c97-409f-86eb-aad6f5a4c98a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:32.409444 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c6893897-5c97-409f-86eb-aad6f5a4c98a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1318 microversion: 2.1 time: 1.145764 Jul 28 03:40:32.435602 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 543/1134] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:31 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1318 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:32.620164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-4f3a8f96-6ff3-46ce-b63d-dc5fb765bf6b req-75d41c6e-9966-4937-9890-25bc1bff7a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "472d1cfd-d5de-4031-81b3-d6d3b2a6be21", "name": "network-vif-plugged", "status": "completed", "tag": "8b7c5c8d-e7eb-4dee-995a-2f41bedd4e40"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:32.661693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4f3a8f96-6ff3-46ce-b63d-dc5fb765bf6b req-75d41c6e-9966-4937-9890-25bc1bff7a69 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:32.663805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4f3a8f96-6ff3-46ce-b63d-dc5fb765bf6b req-75d41c6e-9966-4937-9890-25bc1bff7a69 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:32.726612 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-4f3a8f96-6ff3-46ce-b63d-dc5fb765bf6b req-75d41c6e-9966-4937-9890-25bc1bff7a69 service nova] Creating event network-vif-plugged:8b7c5c8d-e7eb-4dee-995a-2f41bedd4e40 for instance 472d1cfd-d5de-4031-81b3-d6d3b2a6be21 on n-h2-826756-3 Jul 28 03:40:32.758684 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-4f3a8f96-6ff3-46ce-b63d-dc5fb765bf6b req-75d41c6e-9966-4937-9890-25bc1bff7a69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140626 Jul 28 03:40:32.765776 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 544/1135] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:32.872664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5e84f703-1677-48ca-beba-0f3257d670aa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:32.877612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5e84f703-1677-48ca-beba-0f3257d670aa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:32.931570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e84f703-1677-48ca-beba-0f3257d670aa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:32.932531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e84f703-1677-48ca-beba-0f3257d670aa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:32.940778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e84f703-1677-48ca-beba-0f3257d670aa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:32.946261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e84f703-1677-48ca-beba-0f3257d670aa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:33.877731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8f52e4d2-a40f-435e-96a7-f24c28083243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:33.936069 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8f52e4d2-a40f-435e-96a7-f24c28083243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1472 microversion: 2.1 time: 1.807431 Jul 28 03:40:33.957414 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 592/1136] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:32 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1472 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:33.980706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ef84c343-b39d-4c64-b42c-077eb6b49e60 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa7425a940>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:34.097992 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ef84c343-b39d-4c64-b42c-077eb6b49e60 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.129009 Jul 28 03:40:34.099543 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 593/1137] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:33 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:34.108271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5e84f703-1677-48ca-beba-0f3257d670aa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:34.120734 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5e84f703-1677-48ca-beba-0f3257d670aa tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1315 microversion: 2.1 time: 1.260551 Jul 28 03:40:34.121873 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 545/1138] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:32 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1315 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:34.134838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b887a12e-d9e5-4976-8cfe-1da184530629 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:34.138081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b887a12e-d9e5-4976-8cfe-1da184530629 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:34.161216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b887a12e-d9e5-4976-8cfe-1da184530629 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:34.168830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b887a12e-d9e5-4976-8cfe-1da184530629 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:34.170839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b887a12e-d9e5-4976-8cfe-1da184530629 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:34.174173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b887a12e-d9e5-4976-8cfe-1da184530629 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:34.756938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=10 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:34.805687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=28 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:34.874856 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-aab5d4b6-b804-4ba5-8908-f24c96e1774d req-0e2b5d8f-1133-4cfd-a9ea-6e1c4bc2ba66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd55ca4a-13e1-4bef-bd20-10b981d48291", "tag": "11dadaf8-0b7a-479d-a8d0-fd5143083dd4"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:34.925300 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-aab5d4b6-b804-4ba5-8908-f24c96e1774d req-0e2b5d8f-1133-4cfd-a9ea-6e1c4bc2ba66 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:34.925967 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-aab5d4b6-b804-4ba5-8908-f24c96e1774d req-0e2b5d8f-1133-4cfd-a9ea-6e1c4bc2ba66 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:34.961007 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-aab5d4b6-b804-4ba5-8908-f24c96e1774d req-0e2b5d8f-1133-4cfd-a9ea-6e1c4bc2ba66 service nova] Creating event network-changed:11dadaf8-0b7a-479d-a8d0-fd5143083dd4 for instance dd55ca4a-13e1-4bef-bd20-10b981d48291 on n-h2-826756-3 Jul 28 03:40:34.971425 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-aab5d4b6-b804-4ba5-8908-f24c96e1774d req-0e2b5d8f-1133-4cfd-a9ea-6e1c4bc2ba66 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.835047 Jul 28 03:40:34.973198 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 546/1139] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:35.011121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ba31744d-f243-471e-ad4f-cf66ad8b8a2f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:35.016148 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ba31744d-f243-471e-ad4f-cf66ad8b8a2f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:35.040009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba31744d-f243-471e-ad4f-cf66ad8b8a2f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:35.043309 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba31744d-f243-471e-ad4f-cf66ad8b8a2f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:35.045895 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba31744d-f243-471e-ad4f-cf66ad8b8a2f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:35.046595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba31744d-f243-471e-ad4f-cf66ad8b8a2f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:35.112559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b887a12e-d9e5-4976-8cfe-1da184530629 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:35.129928 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b887a12e-d9e5-4976-8cfe-1da184530629 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1318 microversion: 2.1 time: 1.027362 Jul 28 03:40:35.132318 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 594/1140] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:34 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1318 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:35.150174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4503cb7a-ce28-466c-ae21-5720b54d6cd5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa7425aee0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:35.245718 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4503cb7a-ce28-466c-ae21-5720b54d6cd5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.111617 Jul 28 03:40:35.246742 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 595/1141] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:35 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:35.271746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ab013eed-7b4d-492f-88c8-42014909130a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:35.272388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ab013eed-7b4d-492f-88c8-42014909130a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:35.318547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab013eed-7b4d-492f-88c8-42014909130a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:35.319874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab013eed-7b4d-492f-88c8-42014909130a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:35.321307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab013eed-7b4d-492f-88c8-42014909130a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:35.322205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab013eed-7b4d-492f-88c8-42014909130a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:35.630905 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ba31744d-f243-471e-ad4f-cf66ad8b8a2f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:35.651183 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ba31744d-f243-471e-ad4f-cf66ad8b8a2f tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1472 microversion: 2.1 time: 0.656814 Jul 28 03:40:35.654802 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 547/1142] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:34 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1472 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:36.113033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ab013eed-7b4d-492f-88c8-42014909130a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:36.147015 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ab013eed-7b4d-492f-88c8-42014909130a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1315 microversion: 2.1 time: 0.898221 Jul 28 03:40:36.148313 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 596/1143] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:35 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1315 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:36.160294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-79168efd-ee2e-43c8-a887-04c368f92da8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:36.161528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-79168efd-ee2e-43c8-a887-04c368f92da8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:36.176022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=8 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:36.195180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-79168efd-ee2e-43c8-a887-04c368f92da8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:36.200128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-79168efd-ee2e-43c8-a887-04c368f92da8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:36.201018 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-79168efd-ee2e-43c8-a887-04c368f92da8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:36.201464 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-79168efd-ee2e-43c8-a887-04c368f92da8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:36.261014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0c9e271-83aa-476f-9a9e-b4b6f71c4769 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74309ca0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:36.348365 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e0c9e271-83aa-476f-9a9e-b4b6f71c4769 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.091546 Jul 28 03:40:36.352160 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 597/1144] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:36 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:36.674828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e789d342-8163-4520-ba16-8617e6aef5ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:36.675522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e789d342-8163-4520-ba16-8617e6aef5ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:36.689597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e789d342-8163-4520-ba16-8617e6aef5ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:36.690048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e789d342-8163-4520-ba16-8617e6aef5ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:36.690846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e789d342-8163-4520-ba16-8617e6aef5ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:36.694088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e789d342-8163-4520-ba16-8617e6aef5ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:37.109235 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-79168efd-ee2e-43c8-a887-04c368f92da8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:37.143935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:37.168076 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-79168efd-ee2e-43c8-a887-04c368f92da8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1318 microversion: 2.1 time: 1.015591 Jul 28 03:40:37.169111 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 548/1145] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:36 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1318 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:37.436492 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-fd7b6d30-e137-45d6-8046-4ee5cc5627c0 req-c8062fb7-6267-460e-804e-457bc0b4abae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a436784-353a-401e-877a-fcc0ac2fceb7", "name": "network-vif-plugged", "status": "completed", "tag": "4de6423a-6733-4628-b10d-534a2cfa5f75"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:37.478917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e789d342-8163-4520-ba16-8617e6aef5ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:37.484147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-fd7b6d30-e137-45d6-8046-4ee5cc5627c0 req-c8062fb7-6267-460e-804e-457bc0b4abae service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:37.487778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-fd7b6d30-e137-45d6-8046-4ee5cc5627c0 req-c8062fb7-6267-460e-804e-457bc0b4abae service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:37.494546 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e789d342-8163-4520-ba16-8617e6aef5ca tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1472 microversion: 2.1 time: 0.824500 Jul 28 03:40:37.499455 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 598/1146] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:36 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1472 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:37.518254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4216aed1-7b38-420e-ab6e-e6f77d036fa6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:37.527450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4216aed1-7b38-420e-ab6e-e6f77d036fa6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:37.551750 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-fd7b6d30-e137-45d6-8046-4ee5cc5627c0 req-c8062fb7-6267-460e-804e-457bc0b4abae service nova] Creating event network-vif-plugged:4de6423a-6733-4628-b10d-534a2cfa5f75 for instance 9a436784-353a-401e-877a-fcc0ac2fceb7 on n-h1-826756-3 Jul 28 03:40:37.556392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4216aed1-7b38-420e-ab6e-e6f77d036fa6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:37.556834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4216aed1-7b38-420e-ab6e-e6f77d036fa6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:37.557648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4216aed1-7b38-420e-ab6e-e6f77d036fa6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:37.558089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4216aed1-7b38-420e-ab6e-e6f77d036fa6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:37.587571 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-fd7b6d30-e137-45d6-8046-4ee5cc5627c0 req-c8062fb7-6267-460e-804e-457bc0b4abae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.403481 Jul 28 03:40:37.588745 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 549/1147] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:37.629969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-27b3de19-e627-4295-9177-79b2a305f71f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa746ab430>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:37.795460 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-27b3de19-e627-4295-9177-79b2a305f71f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.191628 Jul 28 03:40:37.796937 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 550/1148] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:37 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:38.036307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4216aed1-7b38-420e-ab6e-e6f77d036fa6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:38.072179 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4216aed1-7b38-420e-ab6e-e6f77d036fa6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1501 microversion: 2.1 time: 0.565624 Jul 28 03:40:38.073215 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 599/1149] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:37 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1501 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:38.101454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-69cfd2fa-300b-4003-8085-9c293d97fbd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:38.122874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-69cfd2fa-300b-4003-8085-9c293d97fbd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:38.123679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-69cfd2fa-300b-4003-8085-9c293d97fbd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:38.194610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-14fc0909-0e93-4cb4-83fb-9a8a9362e910 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:38.196079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-14fc0909-0e93-4cb4-83fb-9a8a9362e910 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:38.235442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-14fc0909-0e93-4cb4-83fb-9a8a9362e910 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:38.240342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-14fc0909-0e93-4cb4-83fb-9a8a9362e910 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:38.242099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-14fc0909-0e93-4cb4-83fb-9a8a9362e910 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:38.249555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-14fc0909-0e93-4cb4-83fb-9a8a9362e910 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:38.507959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-69cfd2fa-300b-4003-8085-9c293d97fbd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Going to try to stop instance {{(pid=126072) force_stop /opt/stack/nova/nova/compute/api.py:2753}} Jul 28 03:40:38.679275 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-69cfd2fa-300b-4003-8085-9c293d97fbd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21/action" status: 202 len: 0 microversion: 2.1 time: 0.582345 Jul 28 03:40:38.682981 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 551/1150] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:40:38 2022] POST /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:40:38.708775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-743e2a92-e03c-4ef3-83a5-7871f3a8dccd tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:38.715509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-743e2a92-e03c-4ef3-83a5-7871f3a8dccd tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:38.747501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-743e2a92-e03c-4ef3-83a5-7871f3a8dccd tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:38.751498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-743e2a92-e03c-4ef3-83a5-7871f3a8dccd tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:38.753247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-743e2a92-e03c-4ef3-83a5-7871f3a8dccd tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:38.757413 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-743e2a92-e03c-4ef3-83a5-7871f3a8dccd tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:38.786534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-14fc0909-0e93-4cb4-83fb-9a8a9362e910 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:38.821404 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-14fc0909-0e93-4cb4-83fb-9a8a9362e910 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1318 microversion: 2.1 time: 0.627309 Jul 28 03:40:38.823562 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 600/1151] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:38 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1318 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:38.840964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1471073a-c534-41ff-9a68-1ac9d4d4553d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:38.860950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1471073a-c534-41ff-9a68-1ac9d4d4553d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:38.874849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1471073a-c534-41ff-9a68-1ac9d4d4553d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:38.875650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1471073a-c534-41ff-9a68-1ac9d4d4553d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:38.877049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1471073a-c534-41ff-9a68-1ac9d4d4553d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:38.877725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1471073a-c534-41ff-9a68-1ac9d4d4553d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:39.609269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1471073a-c534-41ff-9a68-1ac9d4d4553d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:39.624334 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1471073a-c534-41ff-9a68-1ac9d4d4553d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1511 microversion: 2.1 time: 0.798547 Jul 28 03:40:39.624984 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 601/1152] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:38 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1511 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:39.645386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c7a5a173-b7a7-478e-936e-eee94f6f30c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa742a91f0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:39.651456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-743e2a92-e03c-4ef3-83a5-7871f3a8dccd tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:39.668143 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-743e2a92-e03c-4ef3-83a5-7871f3a8dccd tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1472 microversion: 2.1 time: 0.982900 Jul 28 03:40:39.687430 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 552/1153] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:38 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1472 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:39.814060 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c7a5a173-b7a7-478e-936e-eee94f6f30c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.187745 Jul 28 03:40:39.815262 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 602/1154] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:39 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:39.859084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-acbf74b4-753d-4eee-b194-659392d062b0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:39.859738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-acbf74b4-753d-4eee-b194-659392d062b0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:39.871874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acbf74b4-753d-4eee-b194-659392d062b0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:39.875170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acbf74b4-753d-4eee-b194-659392d062b0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:39.876136 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acbf74b4-753d-4eee-b194-659392d062b0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:39.876735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acbf74b4-753d-4eee-b194-659392d062b0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:40.652761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d832c049-0422-420a-b69a-aff0be893d9e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:40.653862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d832c049-0422-420a-b69a-aff0be893d9e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:40.672305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d832c049-0422-420a-b69a-aff0be893d9e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:40.674522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d832c049-0422-420a-b69a-aff0be893d9e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:40.676383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d832c049-0422-420a-b69a-aff0be893d9e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:40.684234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d832c049-0422-420a-b69a-aff0be893d9e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:40.810938 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-acbf74b4-753d-4eee-b194-659392d062b0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:40.827637 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-acbf74b4-753d-4eee-b194-659392d062b0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1318 microversion: 2.1 time: 0.979051 Jul 28 03:40:40.831386 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 553/1155] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:39 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1318 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:40.837269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-05973239-dc76-4c41-b063-9d57314cd481 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:40.842362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-05973239-dc76-4c41-b063-9d57314cd481 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:40.861548 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-05973239-dc76-4c41-b063-9d57314cd481 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:40.862379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-05973239-dc76-4c41-b063-9d57314cd481 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:40.863704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-05973239-dc76-4c41-b063-9d57314cd481 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:40.865604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-05973239-dc76-4c41-b063-9d57314cd481 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:41.455465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d832c049-0422-420a-b69a-aff0be893d9e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:41.491004 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d832c049-0422-420a-b69a-aff0be893d9e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1511 microversion: 2.1 time: 0.839397 Jul 28 03:40:41.494782 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 603/1156] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:40 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1511 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:40:41.530113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9ca5a789-9548-43ff-8bc6-cbf489662fe1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74229f70>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:41.653481 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9ca5a789-9548-43ff-8bc6-cbf489662fe1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.156887 Jul 28 03:40:41.661575 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 604/1157] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:41 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:41.666985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a41408f3-c99c-44d8-b66f-254d59567eb8 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:41.667597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a41408f3-c99c-44d8-b66f-254d59567eb8 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:41.708993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a41408f3-c99c-44d8-b66f-254d59567eb8 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:41.708993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a41408f3-c99c-44d8-b66f-254d59567eb8 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:41.708993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a41408f3-c99c-44d8-b66f-254d59567eb8 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:41.708993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a41408f3-c99c-44d8-b66f-254d59567eb8 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:41.711534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-05973239-dc76-4c41-b063-9d57314cd481 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:41.728865 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-05973239-dc76-4c41-b063-9d57314cd481 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1472 microversion: 2.1 time: 0.893964 Jul 28 03:40:41.730407 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 554/1158] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:40 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1472 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:41.746501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-84dd0021-3fc4-4d5c-8061-08b4cc8489c9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:41.747498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-84dd0021-3fc4-4d5c-8061-08b4cc8489c9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:41.778012 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-84dd0021-3fc4-4d5c-8061-08b4cc8489c9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:41.787050 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-84dd0021-3fc4-4d5c-8061-08b4cc8489c9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:41.798943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-84dd0021-3fc4-4d5c-8061-08b4cc8489c9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:41.799701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-84dd0021-3fc4-4d5c-8061-08b4cc8489c9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:42.204651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-84dd0021-3fc4-4d5c-8061-08b4cc8489c9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid fcbae58d-a326-4197-a350-9278d664d3e7 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:40:42.231277 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-84dd0021-3fc4-4d5c-8061-08b4cc8489c9 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 2422 microversion: 2.25 time: 0.490454 Jul 28 03:40:42.232188 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 555/1159] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:40:41 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 2422 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:42.238579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b7567485-e02d-4aa9-8f82-af06d2b09bc5 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:42.240672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b7567485-e02d-4aa9-8f82-af06d2b09bc5 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:42.247684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7567485-e02d-4aa9-8f82-af06d2b09bc5 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:42.248599 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7567485-e02d-4aa9-8f82-af06d2b09bc5 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:42.249776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7567485-e02d-4aa9-8f82-af06d2b09bc5 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:42.251756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7567485-e02d-4aa9-8f82-af06d2b09bc5 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:42.531290 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b7567485-e02d-4aa9-8f82-af06d2b09bc5 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:42.542371 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b7567485-e02d-4aa9-8f82-af06d2b09bc5 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1318 microversion: 2.1 time: 0.308272 Jul 28 03:40:42.552481 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 556/1160] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:42 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:42.552481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0a0d3f6d-b537-4ab3-bec2-632226432223 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826756-3", "block_migration": "auto"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:42.552481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0a0d3f6d-b537-4ab3-bec2-632226432223 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:42.559745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a0d3f6d-b537-4ab3-bec2-632226432223 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:42.560198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a0d3f6d-b537-4ab3-bec2-632226432223 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:42.561364 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a41408f3-c99c-44d8-b66f-254d59567eb8 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1813 microversion: 2.1 time: 0.898404 Jul 28 03:40:42.561873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a0d3f6d-b537-4ab3-bec2-632226432223 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:42.561971 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 605/1161] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:41 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1813 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:42.563362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a0d3f6d-b537-4ab3-bec2-632226432223 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:42.577201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d7003dbc-8fe3-4df1-97df-ef0352f4eda8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:42.577987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d7003dbc-8fe3-4df1-97df-ef0352f4eda8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:42.608886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7003dbc-8fe3-4df1-97df-ef0352f4eda8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:42.609245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7003dbc-8fe3-4df1-97df-ef0352f4eda8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:42.610038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7003dbc-8fe3-4df1-97df-ef0352f4eda8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:42.610476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7003dbc-8fe3-4df1-97df-ef0352f4eda8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:42.659253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-0a0d3f6d-b537-4ab3-bec2-632226432223 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'flavor' on Instance uuid fcbae58d-a326-4197-a350-9278d664d3e7 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:40:42.696071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0a0d3f6d-b537-4ab3-bec2-632226432223 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Going to try to live migrate instance to n-h2-826756-3 {{(pid=126072) live_migrate /opt/stack/nova/nova/compute/api.py:5474}} Jul 28 03:40:43.930944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d7003dbc-8fe3-4df1-97df-ef0352f4eda8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:43.984909 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d7003dbc-8fe3-4df1-97df-ef0352f4eda8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1511 microversion: 2.1 time: 1.401171 Jul 28 03:40:43.985799 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 606/1162] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:42 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1511 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:44.009396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-42a5ef65-cf32-4b59-90c3-4b52d3fc3823 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:44.036530 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:40:44.036530 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:40:44.044297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42a5ef65-cf32-4b59-90c3-4b52d3fc3823 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:44.047848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42a5ef65-cf32-4b59-90c3-4b52d3fc3823 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:44.049199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42a5ef65-cf32-4b59-90c3-4b52d3fc3823 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:44.055091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42a5ef65-cf32-4b59-90c3-4b52d3fc3823 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:44.123108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:44.159205 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-42a5ef65-cf32-4b59-90c3-4b52d3fc3823 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.162909 Jul 28 03:40:44.160031 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 607/1163] 10.222.0.48 () {58 vars in 1176 bytes} [Thu Jul 28 03:40:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:44.165343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eeda3c8c-5537-469c-b2c0-cb673a669257 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa741d50d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:44.251446 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eeda3c8c-5537-469c-b2c0-cb673a669257 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.089814 Jul 28 03:40:44.252104 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 608/1164] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:44 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:44.265847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05d183c7-013b-4ece-a68a-e46674c56cde tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:44.272342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-05d183c7-013b-4ece-a68a-e46674c56cde tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:44.294311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05d183c7-013b-4ece-a68a-e46674c56cde tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:44.295096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05d183c7-013b-4ece-a68a-e46674c56cde tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:44.296572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05d183c7-013b-4ece-a68a-e46674c56cde tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:44.307822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05d183c7-013b-4ece-a68a-e46674c56cde tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:45.515131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-05d183c7-013b-4ece-a68a-e46674c56cde tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:45.533709 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-05d183c7-013b-4ece-a68a-e46674c56cde tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1472 microversion: 2.1 time: 1.271959 Jul 28 03:40:45.538155 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 609/1165] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:44 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1472 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:45.565449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dbe08a31-75a4-4053-8aa0-417dee3a6e6c tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:45.567918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dbe08a31-75a4-4053-8aa0-417dee3a6e6c tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:45.586804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dbe08a31-75a4-4053-8aa0-417dee3a6e6c tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:45.587708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dbe08a31-75a4-4053-8aa0-417dee3a6e6c tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:45.589234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dbe08a31-75a4-4053-8aa0-417dee3a6e6c tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:45.590015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dbe08a31-75a4-4053-8aa0-417dee3a6e6c tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:46.569596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dbe08a31-75a4-4053-8aa0-417dee3a6e6c tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:46.586452 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dbe08a31-75a4-4053-8aa0-417dee3a6e6c tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1318 microversion: 2.1 time: 1.024590 Jul 28 03:40:46.594727 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 610/1166] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:45 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1318 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:46.606150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8fbb1943-90a7-47f4-afb9-df74a4981dd3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:46.606872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8fbb1943-90a7-47f4-afb9-df74a4981dd3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:46.657581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fbb1943-90a7-47f4-afb9-df74a4981dd3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:46.660164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fbb1943-90a7-47f4-afb9-df74a4981dd3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:46.661870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fbb1943-90a7-47f4-afb9-df74a4981dd3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:46.662679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fbb1943-90a7-47f4-afb9-df74a4981dd3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:47.221036 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0a0d3f6d-b537-4ab3-bec2-632226432223 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/action" status: 202 len: 0 microversion: 2.25 time: 4.676458 Jul 28 03:40:47.221697 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 557/1167] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 03:40:42 2022] POST /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/action => generated 0 bytes in 4678 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:40:47.229645 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a41bbcb4-d85f-4c7e-ae2a-f94b78a2efb9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa745c8c10>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:47.339738 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a41bbcb4-d85f-4c7e-ae2a-f94b78a2efb9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.115803 Jul 28 03:40:47.346005 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 558/1168] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:47 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:47.374494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8fbb1943-90a7-47f4-afb9-df74a4981dd3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:47.383566 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8fbb1943-90a7-47f4-afb9-df74a4981dd3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1511 microversion: 2.1 time: 0.787072 Jul 28 03:40:47.385940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-17e33aee-2db6-4d4e-99a7-024db3cd40c8 req-b9921e86-2348-4cdf-8bff-09671bd8f6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd55ca4a-13e1-4bef-bd20-10b981d48291", "name": "network-vif-plugged", "status": "completed", "tag": "11dadaf8-0b7a-479d-a8d0-fd5143083dd4"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:47.407200 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 611/1169] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:46 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1511 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:47.415782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8c8c0c7e-65e9-473c-a58d-3b46989d984c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:47.423272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8c8c0c7e-65e9-473c-a58d-3b46989d984c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:47.439799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c8c0c7e-65e9-473c-a58d-3b46989d984c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:47.440760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c8c0c7e-65e9-473c-a58d-3b46989d984c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:47.444621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c8c0c7e-65e9-473c-a58d-3b46989d984c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:47.447507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-17e33aee-2db6-4d4e-99a7-024db3cd40c8 req-b9921e86-2348-4cdf-8bff-09671bd8f6a0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:47.448515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c8c0c7e-65e9-473c-a58d-3b46989d984c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:47.455546 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-17e33aee-2db6-4d4e-99a7-024db3cd40c8 req-b9921e86-2348-4cdf-8bff-09671bd8f6a0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:47.512312 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-17e33aee-2db6-4d4e-99a7-024db3cd40c8 req-b9921e86-2348-4cdf-8bff-09671bd8f6a0 service nova] Creating event network-vif-plugged:11dadaf8-0b7a-479d-a8d0-fd5143083dd4 for instance dd55ca4a-13e1-4bef-bd20-10b981d48291 on n-h2-826756-3 Jul 28 03:40:47.553270 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-17e33aee-2db6-4d4e-99a7-024db3cd40c8 req-b9921e86-2348-4cdf-8bff-09671bd8f6a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203261 Jul 28 03:40:47.561121 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 559/1170] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:47.603102 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ff70d01e-290f-4753-aa61-f6638d18091f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:47.613838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ff70d01e-290f-4753-aa61-f6638d18091f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:47.635327 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff70d01e-290f-4753-aa61-f6638d18091f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:47.641590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff70d01e-290f-4753-aa61-f6638d18091f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:47.646850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff70d01e-290f-4753-aa61-f6638d18091f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:47.650639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff70d01e-290f-4753-aa61-f6638d18091f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:48.090733 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ff70d01e-290f-4753-aa61-f6638d18091f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:48.110753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ff70d01e-290f-4753-aa61-f6638d18091f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:48.112639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ff70d01e-290f-4753-aa61-f6638d18091f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:48.131779 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ff70d01e-290f-4753-aa61-f6638d18091f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.563741 Jul 28 03:40:48.135103 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 560/1171] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:40:47 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:48.151578 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-72a2171e-bf48-4417-81e0-7338b701cb0f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:48.156046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-72a2171e-bf48-4417-81e0-7338b701cb0f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:48.168955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72a2171e-bf48-4417-81e0-7338b701cb0f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:48.175083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72a2171e-bf48-4417-81e0-7338b701cb0f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:48.180479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72a2171e-bf48-4417-81e0-7338b701cb0f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:48.181724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72a2171e-bf48-4417-81e0-7338b701cb0f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:48.431372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8c8c0c7e-65e9-473c-a58d-3b46989d984c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:48.461251 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8c8c0c7e-65e9-473c-a58d-3b46989d984c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1478 microversion: 2.1 time: 1.049161 Jul 28 03:40:48.463288 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 612/1172] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:47 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1478 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:48.475863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-600cfabe-a4c9-4dd2-b57a-66adb65fbc1a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74249940>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:48.576239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-72a2171e-bf48-4417-81e0-7338b701cb0f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:48.585624 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-72a2171e-bf48-4417-81e0-7338b701cb0f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1318 microversion: 2.1 time: 0.448835 Jul 28 03:40:48.597868 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 561/1173] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:48 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:48.607031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6edff2ec-0256-46c0-9aca-757e108eac7c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:48.614812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6edff2ec-0256-46c0-9aca-757e108eac7c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:48.625200 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-600cfabe-a4c9-4dd2-b57a-66adb65fbc1a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.159278 Jul 28 03:40:48.625906 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 613/1174] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:48 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:48.627820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6edff2ec-0256-46c0-9aca-757e108eac7c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:48.630221 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6edff2ec-0256-46c0-9aca-757e108eac7c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:48.631277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6edff2ec-0256-46c0-9aca-757e108eac7c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:48.631971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6edff2ec-0256-46c0-9aca-757e108eac7c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:48.941411 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6edff2ec-0256-46c0-9aca-757e108eac7c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:48.954493 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6edff2ec-0256-46c0-9aca-757e108eac7c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1511 microversion: 2.1 time: 0.351903 Jul 28 03:40:48.955354 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 562/1175] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:48 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:49.193436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74f1e8bd-0d86-4557-9398-156b6141d344 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:49.194836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6538f9ce-bbf1-4ac6-8afd-a368d473c89a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eea547e1-3ed7-4613-b1a0-6afe01312cba", "device": "/dev/xvdb"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:49.197709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6538f9ce-bbf1-4ac6-8afd-a368d473c89a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:49.203141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74f1e8bd-0d86-4557-9398-156b6141d344 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:49.216775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6538f9ce-bbf1-4ac6-8afd-a368d473c89a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:49.218829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6538f9ce-bbf1-4ac6-8afd-a368d473c89a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:49.219876 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6538f9ce-bbf1-4ac6-8afd-a368d473c89a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:49.222177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6538f9ce-bbf1-4ac6-8afd-a368d473c89a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:49.233268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74f1e8bd-0d86-4557-9398-156b6141d344 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:49.234020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74f1e8bd-0d86-4557-9398-156b6141d344 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:49.246341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74f1e8bd-0d86-4557-9398-156b6141d344 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:49.246458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74f1e8bd-0d86-4557-9398-156b6141d344 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:49.819861 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6538f9ce-bbf1-4ac6-8afd-a368d473c89a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "POST /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.628749 Jul 28 03:40:49.821526 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 563/1176] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 03:40:49 2022] POST /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments => generated 194 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:49.829422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-378fae22-ea15-4510-9997-698157fd4064 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:49.830860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-378fae22-ea15-4510-9997-698157fd4064 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:49.839614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-378fae22-ea15-4510-9997-698157fd4064 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:49.840474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-378fae22-ea15-4510-9997-698157fd4064 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:49.842170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-378fae22-ea15-4510-9997-698157fd4064 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:49.842933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-378fae22-ea15-4510-9997-698157fd4064 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:49.876978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:50.159111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-378fae22-ea15-4510-9997-698157fd4064 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:50.167700 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-378fae22-ea15-4510-9997-698157fd4064 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1478 microversion: 2.1 time: 0.343863 Jul 28 03:40:50.170024 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 564/1177] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:49 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1478 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:50.175329 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b9847f9f-db4e-42fb-806b-c24f300e6f9f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:50.176513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b9847f9f-db4e-42fb-806b-c24f300e6f9f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:50.187287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9847f9f-db4e-42fb-806b-c24f300e6f9f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:50.188030 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9847f9f-db4e-42fb-806b-c24f300e6f9f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:50.189094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9847f9f-db4e-42fb-806b-c24f300e6f9f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:50.189821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9847f9f-db4e-42fb-806b-c24f300e6f9f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:50.397825 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b9847f9f-db4e-42fb-806b-c24f300e6f9f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:50.410062 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b9847f9f-db4e-42fb-806b-c24f300e6f9f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1468 microversion: 2.1 time: 0.238404 Jul 28 03:40:50.412557 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 565/1178] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:50 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1468 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:50.421550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e5a18cef-0dc1-4b40-9c4a-0d39d49f7b3e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa745ae940>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:50.634214 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e5a18cef-0dc1-4b40-9c4a-0d39d49f7b3e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.219020 Jul 28 03:40:50.635446 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 566/1179] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:50 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:50.649742 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-78f85770-5138-4444-8d70-c971d3905eb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:50.651481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-78f85770-5138-4444-8d70-c971d3905eb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:50.678859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78f85770-5138-4444-8d70-c971d3905eb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:50.679608 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78f85770-5138-4444-8d70-c971d3905eb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:50.682237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78f85770-5138-4444-8d70-c971d3905eb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:50.690655 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78f85770-5138-4444-8d70-c971d3905eb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:51.072860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-74f1e8bd-0d86-4557-9398-156b6141d344 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:51.105119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:51.115980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-74f1e8bd-0d86-4557-9398-156b6141d344 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:51.160805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-74f1e8bd-0d86-4557-9398-156b6141d344 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:51.179121 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74f1e8bd-0d86-4557-9398-156b6141d344 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 2.018703 Jul 28 03:40:51.182497 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 614/1180] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:40:49 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:51.934138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-78f85770-5138-4444-8d70-c971d3905eb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:51.956093 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-78f85770-5138-4444-8d70-c971d3905eb1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1511 microversion: 2.1 time: 1.317738 Jul 28 03:40:51.962860 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 567/1181] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:50 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1511 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:51.987074 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0bf9be2e-2de5-44ff-bb74-887934fa2a26 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:51.990110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0bf9be2e-2de5-44ff-bb74-887934fa2a26 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:52.011879 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0bf9be2e-2de5-44ff-bb74-887934fa2a26 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:52.014769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0bf9be2e-2de5-44ff-bb74-887934fa2a26 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:52.016575 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0bf9be2e-2de5-44ff-bb74-887934fa2a26 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:52.028079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0bf9be2e-2de5-44ff-bb74-887934fa2a26 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:52.101674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1fc9bb98-7868-4be7-9442-a76f58fe210f tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1854668750", "block_migration": true, "disk_over_commit": false}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:52.119203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1fc9bb98-7868-4be7-9442-a76f58fe210f tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:52.165669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fc9bb98-7868-4be7-9442-a76f58fe210f tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:52.166799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fc9bb98-7868-4be7-9442-a76f58fe210f tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:52.168582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fc9bb98-7868-4be7-9442-a76f58fe210f tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:52.169853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fc9bb98-7868-4be7-9442-a76f58fe210f tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:52.279565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-1fc9bb98-7868-4be7-9442-a76f58fe210f tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lazy-loading 'flavor' on Instance uuid dd55ca4a-13e1-4bef-bd20-10b981d48291 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:40:52.351816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1fc9bb98-7868-4be7-9442-a76f58fe210f tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Going to try to live migrate instance to tempest-host-1854668750 {{(pid=126071) live_migrate /opt/stack/nova/nova/compute/api.py:5474}} Jul 28 03:40:52.357824 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0bf9be2e-2de5-44ff-bb74-887934fa2a26 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:52.369452 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0bf9be2e-2de5-44ff-bb74-887934fa2a26 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1478 microversion: 2.1 time: 0.402313 Jul 28 03:40:52.371361 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 568/1182] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:51 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1478 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:52.381231 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-1fc9bb98-7868-4be7-9442-a76f58fe210f tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] HTTP exception thrown: Compute host tempest-host-1854668750 could not be found. Jul 28 03:40:52.386141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b3a1e9f6-466f-447e-9fa3-99be7e46de0f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa7465b940>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1fc9bb98-7868-4be7-9442-a76f58fe210f tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Request method failure captured: Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291/action HTTP/1.1 Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 107 Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gUmrORWb_LIvjFwY2W0eBrMYV1jmecivJZBxctUJBX16mroca7h9W1-pb-tk4eXatAOuGevrgALE4IkXQO5ti9G0kOoAawRVpA6t7u8JfC1Fdh-H8QBE86cqagib7khqdrVKA3LBiLUj70b0avkWoNw8cPZHxJAMtEE7Max8niwpYo Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 558b76842b8c40a8be26926aa907ed86 Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-LiveMigrationNegativeTest-1573568951 Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:40:52.413495 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:40:52.416264 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/558b76842b8c40a8be26926aa907ed86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/558b76842b8c40a8be26926aa907ed86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_558b76842b8c40a8be26926aa907ed86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/558b76842b8c40a8be26926aa907ed86"}]}] Jul 28 03:40:52.416264 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-LiveMigrationNegativeTest-1573568951 Jul 28 03:40:52.416264 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 558b76842b8c40a8be26926aa907ed86 Jul 28 03:40:52.416264 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1573568951 Jul 28 03:40:52.416264 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-LiveMigrationNegativeTest-1573568951-project-admin Jul 28 03:40:52.416264 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:40:52.416264 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:40:52.416264 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: e842412e62da4a2a8c25d2a2989254e5 Jul 28 03:40:52.416264 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-LiveMigrationNegativeTest-1573568951-project-admin Jul 28 03:40:52.416264 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:40:52.416264 n-d-826756-3 devstack@n-api.service[126071]: {"os-migrateLive": {"host": "tempest-host-1854668750", "block_migration": true, "disk_over_commit": false}} Jul 28 03:40:52.416264 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: exception: Compute host tempest-host-1854668750 could not be found. Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'dd55ca4a-13e1-4bef-bd20-10b981d48291', 'body': {'os-migrateLive': {'host': 'tempest-host-1854668750', 'block_migration': True, 'disk_over_commit': False}}} Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 376, in inner Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 276, in inner Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 257, in inner Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 03:40:52.423513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5480, in live_migrate Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1854668750 could not be found. Jul 28 03:40:52.428175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1854668750 could not be found. Jul 28 03:40:52.434839 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:40:52.439463 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:40:52.439463 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:40:52.439463 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:40:52.439463 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:40:52.439463 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:40:52.439463 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:40:52.439463 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:40:52.439463 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1854668750 could not be found. Jul 28 03:40:52.439463 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:40:52.439463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1fc9bb98-7868-4be7-9442-a76f58fe210f tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Returning 400 to user: Compute host tempest-host-1854668750 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:40:52.439463 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1fc9bb98-7868-4be7-9442-a76f58fe210f tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291/action" status: 400 len: 100 microversion: 2.1 time: 1.231380 Jul 28 03:40:52.439463 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 615/1183] 10.222.0.48 () {60 vars in 1279 bytes} [Thu Jul 28 03:40:51 2022] POST /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291/action => generated 100 bytes in 1234 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:40:52.474709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a3748be2-4f8f-4f37-bb30-2a7a3aec7147 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:52.490706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a3748be2-4f8f-4f37-bb30-2a7a3aec7147 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:52.528508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3748be2-4f8f-4f37-bb30-2a7a3aec7147 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:52.529261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3748be2-4f8f-4f37-bb30-2a7a3aec7147 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:52.530571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3748be2-4f8f-4f37-bb30-2a7a3aec7147 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:52.543257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3748be2-4f8f-4f37-bb30-2a7a3aec7147 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:52.557694 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b3a1e9f6-466f-447e-9fa3-99be7e46de0f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.185192 Jul 28 03:40:52.571162 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 569/1184] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:52 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:52.571162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7a0719fc-df41-4bc3-9759-22ab2007928b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:52.571162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7a0719fc-df41-4bc3-9759-22ab2007928b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:52.615705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a0719fc-df41-4bc3-9759-22ab2007928b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:52.616156 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a0719fc-df41-4bc3-9759-22ab2007928b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:52.617300 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a0719fc-df41-4bc3-9759-22ab2007928b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:52.617459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a0719fc-df41-4bc3-9759-22ab2007928b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:53.054416 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7a0719fc-df41-4bc3-9759-22ab2007928b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:53.074518 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7a0719fc-df41-4bc3-9759-22ab2007928b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1468 microversion: 2.1 time: 0.509881 Jul 28 03:40:53.077106 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 570/1185] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:52 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1468 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:53.097607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f07ae37b-f4f7-4338-acf2-0220bc530513 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:53.098948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f07ae37b-f4f7-4338-acf2-0220bc530513 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:53.118901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f07ae37b-f4f7-4338-acf2-0220bc530513 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:53.119902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f07ae37b-f4f7-4338-acf2-0220bc530513 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:53.120939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f07ae37b-f4f7-4338-acf2-0220bc530513 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:53.121587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f07ae37b-f4f7-4338-acf2-0220bc530513 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:53.436236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f07ae37b-f4f7-4338-acf2-0220bc530513 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:53.446958 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f07ae37b-f4f7-4338-acf2-0220bc530513 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1511 microversion: 2.1 time: 0.368539 Jul 28 03:40:53.453200 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 571/1186] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:53 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1511 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:53.686196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-972a8566-8646-4295-821b-1f403f351ab8 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Action: 'create', calling method: .version_select at 0x7ffa74502430>, body: {"keypair": {"name": "tempest-keypair-2110000269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkU2P0AD9bxxaq8L538OJqaP6TlDHoobfok230Fs3bK16RP6cThp0jxNmejAr+LW2gNRSv1UveS9Zkc7zrRYF8zaQBq5Ji9rKJvv79JzrzJ+ljF/JF2GeNONzZgzHkugA=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:53.726657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-972a8566-8646-4295-821b-1f403f351ab8 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Getting quotas for project 39b785d4e7c6483e8affc1cc61a8998e. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:40:53.740423 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-972a8566-8646-4295-821b-1f403f351ab8 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Getting quotas for user 590f4ca3ef8640529749d54793c05f46 and project 39b785d4e7c6483e8affc1cc61a8998e. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:40:53.791825 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-972a8566-8646-4295-821b-1f403f351ab8 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.336025 Jul 28 03:40:53.800952 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 572/1187] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:40:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:53.811941 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ce39d8da-7aa8-4922-8a3f-f88ce6aa5135 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:53.815036 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ce39d8da-7aa8-4922-8a3f-f88ce6aa5135 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:53.843551 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce39d8da-7aa8-4922-8a3f-f88ce6aa5135 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:53.847915 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce39d8da-7aa8-4922-8a3f-f88ce6aa5135 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:53.851381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce39d8da-7aa8-4922-8a3f-f88ce6aa5135 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:53.854221 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce39d8da-7aa8-4922-8a3f-f88ce6aa5135 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:53.865706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a3748be2-4f8f-4f37-bb30-2a7a3aec7147 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:53.891503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a3748be2-4f8f-4f37-bb30-2a7a3aec7147 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:53.893973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a3748be2-4f8f-4f37-bb30-2a7a3aec7147 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:53.909972 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a3748be2-4f8f-4f37-bb30-2a7a3aec7147 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 1.477434 Jul 28 03:40:53.910558 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 616/1188] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:40:52 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:53.927072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1783026536", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:54.045898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:40:54.091424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:54.430944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:40:54.431369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:40:54.431851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:40:54.432252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:40:54.432863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:40:54.448085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ce39d8da-7aa8-4922-8a3f-f88ce6aa5135 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:54.466310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:54.466769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:54.479798 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ce39d8da-7aa8-4922-8a3f-f88ce6aa5135 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1478 microversion: 2.1 time: 0.677335 Jul 28 03:40:54.483621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:54.485045 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 573/1189] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:53 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1478 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:54.488475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:54.495253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-33019aad-03a7-4f25-83b5-43a71245c2e6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa745aef70>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:54.585670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Getting quotas for project 4c78a01dfb2242a3bf66939666031eb9. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:40:54.610346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Getting quotas for user f6e8d4e8b898489a819618e4b3b97994 and project 4c78a01dfb2242a3bf66939666031eb9. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:40:54.633902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:40:54.640226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:40:54.654390 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-33019aad-03a7-4f25-83b5-43a71245c2e6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.164174 Jul 28 03:40:54.655229 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 574/1190] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:54 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:54.694822 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-f6cf5a87-5f98-4ec9-98c3-93e78c55299a req-ac52d135-c5af-452b-b1dd-f1cf7fb77ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b019cf-2b83-4fba-adf1-a5ffaf2faeab", "name": "network-vif-unplugged", "status": "completed", "tag": "d3aac98a-25aa-4c76-8c14-3b69b36b3eb6"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:40:54.709445 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:40:54.754696 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e22379a1-ef8e-43d2-b560-85dcae9a1304 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842994 Jul 28 03:40:54.758019 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 617/1191] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:40:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:40:54.768734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94429587-3f53-481f-9a43-9b6401f91468 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:54.769347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-94429587-3f53-481f-9a43-9b6401f91468 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:54.778337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f6cf5a87-5f98-4ec9-98c3-93e78c55299a req-ac52d135-c5af-452b-b1dd-f1cf7fb77ee2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:54.785217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f6cf5a87-5f98-4ec9-98c3-93e78c55299a req-ac52d135-c5af-452b-b1dd-f1cf7fb77ee2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:54.785458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94429587-3f53-481f-9a43-9b6401f91468 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:54.785879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94429587-3f53-481f-9a43-9b6401f91468 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:54.788937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94429587-3f53-481f-9a43-9b6401f91468 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:54.788937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94429587-3f53-481f-9a43-9b6401f91468 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:54.839872 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-f6cf5a87-5f98-4ec9-98c3-93e78c55299a req-ac52d135-c5af-452b-b1dd-f1cf7fb77ee2 service nova] Creating event network-vif-unplugged:d3aac98a-25aa-4c76-8c14-3b69b36b3eb6 for instance 95b019cf-2b83-4fba-adf1-a5ffaf2faeab on n-h1-826756-3 Jul 28 03:40:54.855586 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-f6cf5a87-5f98-4ec9-98c3-93e78c55299a req-ac52d135-c5af-452b-b1dd-f1cf7fb77ee2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.198034 Jul 28 03:40:54.858118 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 575/1192] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:40:54.877161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0fd4c11d-b4e1-4ffc-be35-ac063c4c930b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:54.878622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0fd4c11d-b4e1-4ffc-be35-ac063c4c930b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:55.350880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0fd4c11d-b4e1-4ffc-be35-ac063c4c930b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:55.375964 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0fd4c11d-b4e1-4ffc-be35-ac063c4c930b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1219 microversion: 2.1 time: 0.515209 Jul 28 03:40:55.396736 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 576/1193] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:54 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1219 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:55.399542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-94429587-3f53-481f-9a43-9b6401f91468 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:55.408027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e91dc218-2d38-47f4-8fd2-b09b0d691b1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:55.409702 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-94429587-3f53-481f-9a43-9b6401f91468 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1511 microversion: 2.1 time: 0.650511 Jul 28 03:40:55.410326 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 618/1194] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:54 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1511 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:55.420570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e91dc218-2d38-47f4-8fd2-b09b0d691b1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:55.431623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e91dc218-2d38-47f4-8fd2-b09b0d691b1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:55.432205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e91dc218-2d38-47f4-8fd2-b09b0d691b1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:55.433316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e91dc218-2d38-47f4-8fd2-b09b0d691b1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:55.437263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e91dc218-2d38-47f4-8fd2-b09b0d691b1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:55.515276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2736c540-0ce2-4fe8-8b6c-42d276b742ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:55.515967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2736c540-0ce2-4fe8-8b6c-42d276b742ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:55.537274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2736c540-0ce2-4fe8-8b6c-42d276b742ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:55.538077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2736c540-0ce2-4fe8-8b6c-42d276b742ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:55.543246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2736c540-0ce2-4fe8-8b6c-42d276b742ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:55.544829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2736c540-0ce2-4fe8-8b6c-42d276b742ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:56.163925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e91dc218-2d38-47f4-8fd2-b09b0d691b1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:56.265456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e91dc218-2d38-47f4-8fd2-b09b0d691b1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:56.279072 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e91dc218-2d38-47f4-8fd2-b09b0d691b1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:56.285211 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e91dc218-2d38-47f4-8fd2-b09b0d691b1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.886447 Jul 28 03:40:56.299654 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 577/1195] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:40:55 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:56.390456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-93172e19-8e19-45c5-992d-6fb12d17b1be tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa745c89d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:56.515842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2736c540-0ce2-4fe8-8b6c-42d276b742ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:56.526280 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2736c540-0ce2-4fe8-8b6c-42d276b742ad tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1478 microversion: 2.1 time: 1.019567 Jul 28 03:40:56.531819 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 619/1196] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:55 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1478 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:56.565105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-842253d5-95e0-47ae-8f00-2812aa5cb17a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:56.572696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-842253d5-95e0-47ae-8f00-2812aa5cb17a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:56.575518 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-93172e19-8e19-45c5-992d-6fb12d17b1be tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.239645 Jul 28 03:40:56.579654 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 578/1197] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:56 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:56.606076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-311f2fb8-12d0-495f-b4cb-3e931d95d045 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:56.606826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-311f2fb8-12d0-495f-b4cb-3e931d95d045 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:56.632676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-842253d5-95e0-47ae-8f00-2812aa5cb17a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:56.635348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-842253d5-95e0-47ae-8f00-2812aa5cb17a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:56.637147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-842253d5-95e0-47ae-8f00-2812aa5cb17a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:56.638268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-311f2fb8-12d0-495f-b4cb-3e931d95d045 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:56.642413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-842253d5-95e0-47ae-8f00-2812aa5cb17a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:56.646052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-311f2fb8-12d0-495f-b4cb-3e931d95d045 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:56.653261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-311f2fb8-12d0-495f-b4cb-3e931d95d045 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:56.654017 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-311f2fb8-12d0-495f-b4cb-3e931d95d045 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:56.957245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-842253d5-95e0-47ae-8f00-2812aa5cb17a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:56.995940 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-842253d5-95e0-47ae-8f00-2812aa5cb17a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1215 microversion: 2.1 time: 0.462423 Jul 28 03:40:57.003254 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 620/1198] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:56 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1215 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:57.229684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-311f2fb8-12d0-495f-b4cb-3e931d95d045 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:57.257597 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-311f2fb8-12d0-495f-b4cb-3e931d95d045 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1511 microversion: 2.1 time: 0.675660 Jul 28 03:40:57.289215 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 579/1199] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:56 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1511 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:57.330819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5784c36a-daf1-4a93-a422-3904ba4b1eb1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:57.334162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5784c36a-daf1-4a93-a422-3904ba4b1eb1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:57.370835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5784c36a-daf1-4a93-a422-3904ba4b1eb1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:57.372191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5784c36a-daf1-4a93-a422-3904ba4b1eb1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:57.373980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5784c36a-daf1-4a93-a422-3904ba4b1eb1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:57.381576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5784c36a-daf1-4a93-a422-3904ba4b1eb1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:57.568317 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2031b981-1b15-4790-9986-eebcead68a49 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:57.569583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2031b981-1b15-4790-9986-eebcead68a49 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:57.611171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2031b981-1b15-4790-9986-eebcead68a49 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:57.618310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2031b981-1b15-4790-9986-eebcead68a49 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:57.620143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2031b981-1b15-4790-9986-eebcead68a49 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:57.624684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2031b981-1b15-4790-9986-eebcead68a49 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:58.552594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2031b981-1b15-4790-9986-eebcead68a49 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:58.556195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5784c36a-daf1-4a93-a422-3904ba4b1eb1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:58.573369 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2031b981-1b15-4790-9986-eebcead68a49 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1478 microversion: 2.1 time: 1.012091 Jul 28 03:40:58.578381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5784c36a-daf1-4a93-a422-3904ba4b1eb1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:58.580232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5784c36a-daf1-4a93-a422-3904ba4b1eb1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:58.581510 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5784c36a-daf1-4a93-a422-3904ba4b1eb1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 1.264967 Jul 28 03:40:58.583126 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 580/1200] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:57 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1478 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:58.623659 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-047764b9-199f-4918-ad83-591fbb0ca7d2 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa7458a310>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:58.624785 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 621/1201] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:40:57 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:40:58.635760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-01ad4dda-aced-4d68-b43b-b58a806e2d29 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:58.640706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-01ad4dda-aced-4d68-b43b-b58a806e2d29 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:58.659281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01ad4dda-aced-4d68-b43b-b58a806e2d29 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:58.659741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01ad4dda-aced-4d68-b43b-b58a806e2d29 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:58.660635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01ad4dda-aced-4d68-b43b-b58a806e2d29 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:58.661078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01ad4dda-aced-4d68-b43b-b58a806e2d29 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:58.841841 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-047764b9-199f-4918-ad83-591fbb0ca7d2 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.248359 Jul 28 03:40:58.850382 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 581/1202] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:40:58 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:58.900775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6db54df9-e6c0-4162-95f0-ebc6e6e39e81 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:58.906770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6db54df9-e6c0-4162-95f0-ebc6e6e39e81 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:58.953226 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6db54df9-e6c0-4162-95f0-ebc6e6e39e81 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:58.954040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6db54df9-e6c0-4162-95f0-ebc6e6e39e81 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:58.963487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6db54df9-e6c0-4162-95f0-ebc6e6e39e81 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:58.967259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6db54df9-e6c0-4162-95f0-ebc6e6e39e81 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:59.545249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-01ad4dda-aced-4d68-b43b-b58a806e2d29 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:40:59.559306 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-01ad4dda-aced-4d68-b43b-b58a806e2d29 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1277 microversion: 2.1 time: 0.932814 Jul 28 03:40:59.576880 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 622/1203] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:58 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1277 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:40:59.619755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2dcbd8f-3fb1-4fc2-870e-ecb05fd424d6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:40:59.621183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d2dcbd8f-3fb1-4fc2-870e-ecb05fd424d6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:40:59.637643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2dcbd8f-3fb1-4fc2-870e-ecb05fd424d6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:59.638100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2dcbd8f-3fb1-4fc2-870e-ecb05fd424d6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:40:59.638903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2dcbd8f-3fb1-4fc2-870e-ecb05fd424d6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:40:59.639346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2dcbd8f-3fb1-4fc2-870e-ecb05fd424d6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:00.511077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d2dcbd8f-3fb1-4fc2-870e-ecb05fd424d6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:00.528893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d2dcbd8f-3fb1-4fc2-870e-ecb05fd424d6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:00.531622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d2dcbd8f-3fb1-4fc2-870e-ecb05fd424d6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:00.533316 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d2dcbd8f-3fb1-4fc2-870e-ecb05fd424d6 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.917845 Jul 28 03:41:00.543400 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 623/1204] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:40:59 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:00.590852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-779263c0-ee44-4af8-854e-4fe76754b7ba tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:00.598556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-779263c0-ee44-4af8-854e-4fe76754b7ba tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:00.651332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-779263c0-ee44-4af8-854e-4fe76754b7ba tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:00.652249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-779263c0-ee44-4af8-854e-4fe76754b7ba tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:00.656721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-779263c0-ee44-4af8-854e-4fe76754b7ba tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:00.657515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-779263c0-ee44-4af8-854e-4fe76754b7ba tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:00.846139 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6db54df9-e6c0-4162-95f0-ebc6e6e39e81 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:00.866207 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6db54df9-e6c0-4162-95f0-ebc6e6e39e81 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1511 microversion: 2.1 time: 2.012909 Jul 28 03:41:00.885458 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 582/1205] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:40:58 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1511 bytes in 2034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:00.907609 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7057bdee-b993-47a2-8271-cbcfdf16b85d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa745190d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:01.052244 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7057bdee-b993-47a2-8271-cbcfdf16b85d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.158012 Jul 28 03:41:01.056813 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 583/1206] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:41:00 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:01.066186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1542038989", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "1910a77c-9cb7-4e01-ac7e-093a589dc9ac"}], "security_groups": [{"name": "tempest-securitygroup--830143766"}], "key_name": "tempest-keypair-2110000269", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:01.443981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-779263c0-ee44-4af8-854e-4fe76754b7ba tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:01.472961 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-779263c0-ee44-4af8-854e-4fe76754b7ba tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1478 microversion: 2.1 time: 0.927955 Jul 28 03:41:01.480190 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 624/1207] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:00 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1478 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:01.492530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d47fd914-59cf-4309-aaba-4f34ad6aaf40 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:01.509099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d47fd914-59cf-4309-aaba-4f34ad6aaf40 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:01.529028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d47fd914-59cf-4309-aaba-4f34ad6aaf40 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:01.529641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d47fd914-59cf-4309-aaba-4f34ad6aaf40 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:01.530468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d47fd914-59cf-4309-aaba-4f34ad6aaf40 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:01.530910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d47fd914-59cf-4309-aaba-4f34ad6aaf40 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:01.685159 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] validate_networks() for [('1910a77c-9cb7-4e01-ac7e-093a589dc9ac', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:41:01.955539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d47fd914-59cf-4309-aaba-4f34ad6aaf40 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:01.973445 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d47fd914-59cf-4309-aaba-4f34ad6aaf40 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1319 microversion: 2.1 time: 0.488074 Jul 28 03:41:01.976538 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 625/1208] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:01 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:01.992124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-669c55be-bbba-49b1-8ba5-1f7339e72217 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:01.998459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-669c55be-bbba-49b1-8ba5-1f7339e72217 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:02.013864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-669c55be-bbba-49b1-8ba5-1f7339e72217 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:02.015082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-669c55be-bbba-49b1-8ba5-1f7339e72217 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:02.016000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-669c55be-bbba-49b1-8ba5-1f7339e72217 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:02.016503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-669c55be-bbba-49b1-8ba5-1f7339e72217 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:02.589034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-669c55be-bbba-49b1-8ba5-1f7339e72217 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:02.608543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-669c55be-bbba-49b1-8ba5-1f7339e72217 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:02.612035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-669c55be-bbba-49b1-8ba5-1f7339e72217 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:02.616562 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-669c55be-bbba-49b1-8ba5-1f7339e72217 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.638519 Jul 28 03:41:02.617986 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 626/1209] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:01 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:02.627546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2e3efb99-e60a-4120-b955-a4ba87748136 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:02.628590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2e3efb99-e60a-4120-b955-a4ba87748136 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:02.637565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e3efb99-e60a-4120-b955-a4ba87748136 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:02.638513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e3efb99-e60a-4120-b955-a4ba87748136 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:02.639602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e3efb99-e60a-4120-b955-a4ba87748136 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:02.640292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e3efb99-e60a-4120-b955-a4ba87748136 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:02.963637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:41:02.964327 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:41:02.965561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:41:02.966354 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:41:02.966768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:41:02.991693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:02.992142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:02.992996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:02.993436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:03.064813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Getting quotas for project 39b785d4e7c6483e8affc1cc61a8998e. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:41:03.081942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Getting quotas for user 590f4ca3ef8640529749d54793c05f46 and project 39b785d4e7c6483e8affc1cc61a8998e. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:41:03.114911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:41:03.122177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:41:03.278498 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7dc13596-e42c-40d0-bda2-5e50d920a566 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.218920 Jul 28 03:41:03.279538 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 584/1210] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:41:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 2221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:41:03.294724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4e6f635a-5ed6-40c4-94b7-866b67fabcfc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74597e50>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:03.407723 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4e6f635a-5ed6-40c4-94b7-866b67fabcfc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1411 microversion: 2.1 time: 0.125460 Jul 28 03:41:03.408805 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 585/1211] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:41:03 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:03.420174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e979ac2e-4896-4bc7-8149-403cc2131348 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:03.436993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e979ac2e-4896-4bc7-8149-403cc2131348 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:03.458772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e979ac2e-4896-4bc7-8149-403cc2131348 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:03.469244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e979ac2e-4896-4bc7-8149-403cc2131348 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:03.472788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e979ac2e-4896-4bc7-8149-403cc2131348 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:03.473554 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e979ac2e-4896-4bc7-8149-403cc2131348 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:03.949517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2e3efb99-e60a-4120-b955-a4ba87748136 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:03.960388 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2e3efb99-e60a-4120-b955-a4ba87748136 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1511 microversion: 2.1 time: 1.340988 Jul 28 03:41:03.971015 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 627/1212] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:02 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1511 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:03.994044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ab7d86ec-3202-4775-83f3-4335317fd3d2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:03.995290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ab7d86ec-3202-4775-83f3-4335317fd3d2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:04.015944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab7d86ec-3202-4775-83f3-4335317fd3d2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:04.016848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab7d86ec-3202-4775-83f3-4335317fd3d2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:04.018679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab7d86ec-3202-4775-83f3-4335317fd3d2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:04.021857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab7d86ec-3202-4775-83f3-4335317fd3d2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:04.138530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e979ac2e-4896-4bc7-8149-403cc2131348 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:04.151519 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e979ac2e-4896-4bc7-8149-403cc2131348 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1478 microversion: 2.1 time: 0.741546 Jul 28 03:41:04.152129 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 586/1213] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:03 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1478 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:04.170914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-a77fc70b-20c3-43e5-96b7-95584c4ff68c req-20d4897b-26c7-4873-ac1a-dcde7dd3cbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b019cf-2b83-4fba-adf1-a5ffaf2faeab", "name": "network-vif-plugged", "status": "completed", "tag": "d3aac98a-25aa-4c76-8c14-3b69b36b3eb6"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:04.202069 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a77fc70b-20c3-43e5-96b7-95584c4ff68c req-20d4897b-26c7-4873-ac1a-dcde7dd3cbd1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:04.208044 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a77fc70b-20c3-43e5-96b7-95584c4ff68c req-20d4897b-26c7-4873-ac1a-dcde7dd3cbd1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:04.246134 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-a77fc70b-20c3-43e5-96b7-95584c4ff68c req-20d4897b-26c7-4873-ac1a-dcde7dd3cbd1 service nova] Creating event network-vif-plugged:d3aac98a-25aa-4c76-8c14-3b69b36b3eb6 for instance 95b019cf-2b83-4fba-adf1-a5ffaf2faeab on n-h1-826756-3 Jul 28 03:41:04.258402 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-a77fc70b-20c3-43e5-96b7-95584c4ff68c req-20d4897b-26c7-4873-ac1a-dcde7dd3cbd1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100476 Jul 28 03:41:04.267863 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 587/1214] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:04.292582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-61494598-c45f-41b0-a8a3-9b595a7e87be tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:04.299496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-61494598-c45f-41b0-a8a3-9b595a7e87be tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:04.535768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:04.631114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:04.937338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ab7d86ec-3202-4775-83f3-4335317fd3d2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:04.945909 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ab7d86ec-3202-4775-83f3-4335317fd3d2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1319 microversion: 2.1 time: 0.970121 Jul 28 03:41:04.950391 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 628/1215] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:03 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1319 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:04.964786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f70ac23e-04c1-4045-a144-33c7af0902c1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:04.965724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f70ac23e-04c1-4045-a144-33c7af0902c1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:04.981396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f70ac23e-04c1-4045-a144-33c7af0902c1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:04.982266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f70ac23e-04c1-4045-a144-33c7af0902c1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:04.983357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f70ac23e-04c1-4045-a144-33c7af0902c1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:04.986768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f70ac23e-04c1-4045-a144-33c7af0902c1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:05.304238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-61494598-c45f-41b0-a8a3-9b595a7e87be tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:05.329121 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-61494598-c45f-41b0-a8a3-9b595a7e87be tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 200 len: 1242 microversion: 2.1 time: 1.054212 Jul 28 03:41:05.342760 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 588/1216] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:04 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 1242 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:05.354510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7e99b7b6-f61d-4139-a4fa-8ab321f4f7a6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74522700>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:05.469279 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7e99b7b6-f61d-4139-a4fa-8ab321f4f7a6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1420 microversion: 2.1 time: 0.122940 Jul 28 03:41:05.469872 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 589/1217] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:41:05 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:05.487314 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-20ff232b-ff6d-436c-9d20-c4a2373963b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:05.487926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-20ff232b-ff6d-436c-9d20-c4a2373963b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:05.511286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20ff232b-ff6d-436c-9d20-c4a2373963b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:05.511743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20ff232b-ff6d-436c-9d20-c4a2373963b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:05.512627 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20ff232b-ff6d-436c-9d20-c4a2373963b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:05.513244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20ff232b-ff6d-436c-9d20-c4a2373963b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:05.577820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f70ac23e-04c1-4045-a144-33c7af0902c1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:05.601896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f70ac23e-04c1-4045-a144-33c7af0902c1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:05.603557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f70ac23e-04c1-4045-a144-33c7af0902c1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:05.612622 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f70ac23e-04c1-4045-a144-33c7af0902c1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.659642 Jul 28 03:41:05.614649 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 629/1218] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:04 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:05.646535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1915d879-1ab1-4835-8ca6-7bcee68b95ae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:05.647176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1915d879-1ab1-4835-8ca6-7bcee68b95ae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:05.663396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1915d879-1ab1-4835-8ca6-7bcee68b95ae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:05.667577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1915d879-1ab1-4835-8ca6-7bcee68b95ae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:05.669626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1915d879-1ab1-4835-8ca6-7bcee68b95ae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:05.671504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1915d879-1ab1-4835-8ca6-7bcee68b95ae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:06.051342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-20ff232b-ff6d-436c-9d20-c4a2373963b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:06.075041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1915d879-1ab1-4835-8ca6-7bcee68b95ae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:06.092039 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-20ff232b-ff6d-436c-9d20-c4a2373963b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1511 microversion: 2.1 time: 0.597380 Jul 28 03:41:06.097159 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 590/1219] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:05 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1511 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:06.105831 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1915d879-1ab1-4835-8ca6-7bcee68b95ae tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1478 microversion: 2.1 time: 0.489585 Jul 28 03:41:06.106832 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 630/1220] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:05 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1478 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:06.113039 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-63d478b3-499a-4e75-97aa-b3154aa7d53c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa7451c040>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:06.232735 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-63d478b3-499a-4e75-97aa-b3154aa7d53c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 200 len: 1420 microversion: 2.1 time: 0.131194 Jul 28 03:41:06.233777 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 591/1221] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:41:06 2022] GET /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:06.246859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-17ad1449-4001-4451-b342-9f70bcab3053 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:06.248405 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-17ad1449-4001-4451-b342-9f70bcab3053 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:06.255126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-5efd2292-1ac2-45cb-bdf7-b47e39b48047 req-f12f3f6c-dcee-4c87-bbd9-08a07017d30c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76cd273-b14b-410b-b0c1-2379d46988ad", "tag": "fe6e0906-a74d-4d72-9706-2079c277e4ac"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:06.259733 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-17ad1449-4001-4451-b342-9f70bcab3053 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:06.260897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-17ad1449-4001-4451-b342-9f70bcab3053 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:06.262918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-17ad1449-4001-4451-b342-9f70bcab3053 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:06.264055 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-17ad1449-4001-4451-b342-9f70bcab3053 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:06.268601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5efd2292-1ac2-45cb-bdf7-b47e39b48047 req-f12f3f6c-dcee-4c87-bbd9-08a07017d30c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:06.270528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5efd2292-1ac2-45cb-bdf7-b47e39b48047 req-f12f3f6c-dcee-4c87-bbd9-08a07017d30c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:06.333605 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5efd2292-1ac2-45cb-bdf7-b47e39b48047 req-f12f3f6c-dcee-4c87-bbd9-08a07017d30c service nova] Creating event network-changed:fe6e0906-a74d-4d72-9706-2079c277e4ac for instance c76cd273-b14b-410b-b0c1-2379d46988ad on n-h2-826756-3 Jul 28 03:41:06.371079 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-5efd2292-1ac2-45cb-bdf7-b47e39b48047 req-f12f3f6c-dcee-4c87-bbd9-08a07017d30c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248441 Jul 28 03:41:06.379557 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 631/1222] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:06.391679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3ea3f259-be9e-45b9-8062-650b6c834dbd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa7453b160>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:06.707144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-17ad1449-4001-4451-b342-9f70bcab3053 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:06.725043 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-17ad1449-4001-4451-b342-9f70bcab3053 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1319 microversion: 2.1 time: 0.488386 Jul 28 03:41:06.739552 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 592/1223] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:06 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:06.745257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aa909cb8-3309-44c5-ae32-674b79554a9c tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:06.746340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-aa909cb8-3309-44c5-ae32-674b79554a9c tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:06.756290 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa909cb8-3309-44c5-ae32-674b79554a9c tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:06.756799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa909cb8-3309-44c5-ae32-674b79554a9c tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:06.757600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa909cb8-3309-44c5-ae32-674b79554a9c tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:06.758040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa909cb8-3309-44c5-ae32-674b79554a9c tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:06.867112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-aa909cb8-3309-44c5-ae32-674b79554a9c tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:06.883308 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aa909cb8-3309-44c5-ae32-674b79554a9c tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 200 len: 1300 microversion: 2.1 time: 0.151899 Jul 28 03:41:06.884441 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 593/1224] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:06 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 1300 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:06.906163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2ca1f389-df48-40fa-8d41-55f807b9e92a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:06.907371 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2ca1f389-df48-40fa-8d41-55f807b9e92a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:06.948616 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ca1f389-df48-40fa-8d41-55f807b9e92a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:06.950850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ca1f389-df48-40fa-8d41-55f807b9e92a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:06.951745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ca1f389-df48-40fa-8d41-55f807b9e92a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:06.952146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ca1f389-df48-40fa-8d41-55f807b9e92a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:07.237179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2ca1f389-df48-40fa-8d41-55f807b9e92a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:07.241100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:07.253910 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2ca1f389-df48-40fa-8d41-55f807b9e92a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:07.255611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2ca1f389-df48-40fa-8d41-55f807b9e92a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:07.257047 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2ca1f389-df48-40fa-8d41-55f807b9e92a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.371514 Jul 28 03:41:07.268787 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 594/1225] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:06 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:07.276161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-69f817ac-ff7f-40b1-a008-64252200fa8f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:07.280512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-69f817ac-ff7f-40b1-a008-64252200fa8f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:07.294652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-69f817ac-ff7f-40b1-a008-64252200fa8f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:07.295103 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-69f817ac-ff7f-40b1-a008-64252200fa8f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:07.295894 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-69f817ac-ff7f-40b1-a008-64252200fa8f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:07.296329 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-69f817ac-ff7f-40b1-a008-64252200fa8f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:07.405200 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3ea3f259-be9e-45b9-8062-650b6c834dbd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 204 len: 0 microversion: 2.1 time: 1.023483 Jul 28 03:41:07.407198 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 632/1226] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:06 2022] DELETE /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 0 bytes in 1026 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:07.415623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cd1ed576-8319-45c4-90d7-a2f23c843513 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:07.426047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cd1ed576-8319-45c4-90d7-a2f23c843513 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:07.436092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd1ed576-8319-45c4-90d7-a2f23c843513 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:07.437036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd1ed576-8319-45c4-90d7-a2f23c843513 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:07.438078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd1ed576-8319-45c4-90d7-a2f23c843513 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:07.438891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd1ed576-8319-45c4-90d7-a2f23c843513 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:07.470056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:07.655390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cd1ed576-8319-45c4-90d7-a2f23c843513 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:07.664169 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cd1ed576-8319-45c4-90d7-a2f23c843513 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1463 microversion: 2.1 time: 0.255434 Jul 28 03:41:07.679794 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 633/1227] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:07 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1463 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:07.692560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-69f817ac-ff7f-40b1-a008-64252200fa8f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:07.701136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a1d3b40f-8053-4c0a-b460-a528d3211c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:07.701980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a1d3b40f-8053-4c0a-b460-a528d3211c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:07.706502 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-69f817ac-ff7f-40b1-a008-64252200fa8f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1511 microversion: 2.1 time: 0.435772 Jul 28 03:41:07.710687 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 595/1228] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:07 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1511 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:07.716896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-972be1df-725e-424e-933c-9ea5c4bcd281 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:07.722683 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-972be1df-725e-424e-933c-9ea5c4bcd281 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:07.725629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1d3b40f-8053-4c0a-b460-a528d3211c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:07.726082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1d3b40f-8053-4c0a-b460-a528d3211c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:07.727102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1d3b40f-8053-4c0a-b460-a528d3211c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:07.727714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1d3b40f-8053-4c0a-b460-a528d3211c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:07.730826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-972be1df-725e-424e-933c-9ea5c4bcd281 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:07.730826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-972be1df-725e-424e-933c-9ea5c4bcd281 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:07.731890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-972be1df-725e-424e-933c-9ea5c4bcd281 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:07.732426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-972be1df-725e-424e-933c-9ea5c4bcd281 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:07.781862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a1d3b40f-8053-4c0a-b460-a528d3211c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:41:07.856427 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-972be1df-725e-424e-933c-9ea5c4bcd281 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab/action" status: 202 len: 0 microversion: 2.1 time: 0.143689 Jul 28 03:41:07.859353 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 596/1229] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:07 2022] POST /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:41:07.866267 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b6879278-f983-4802-b753-91417c877efd tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:07.867124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b6879278-f983-4802-b753-91417c877efd tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:07.876673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6879278-f983-4802-b753-91417c877efd tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:07.877230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6879278-f983-4802-b753-91417c877efd tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:07.878104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6879278-f983-4802-b753-91417c877efd tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:07.878633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6879278-f983-4802-b753-91417c877efd tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:07.937107 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a1d3b40f-8053-4c0a-b460-a528d3211c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 204 len: 0 microversion: 2.1 time: 0.255058 Jul 28 03:41:07.938749 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 634/1230] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:41:07 2022] DELETE /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:07.946144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0edbae94-7b34-44b5-9696-277b68d43b5a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:07.949043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0edbae94-7b34-44b5-9696-277b68d43b5a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:07.980843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0edbae94-7b34-44b5-9696-277b68d43b5a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:07.983117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0edbae94-7b34-44b5-9696-277b68d43b5a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:07.987619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0edbae94-7b34-44b5-9696-277b68d43b5a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:07.988684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0edbae94-7b34-44b5-9696-277b68d43b5a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:08.071907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0edbae94-7b34-44b5-9696-277b68d43b5a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:08.072663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0edbae94-7b34-44b5-9696-277b68d43b5a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:08.073238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-0edbae94-7b34-44b5-9696-277b68d43b5a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lazy-loading 'fault' on Instance uuid 95b019cf-2b83-4fba-adf1-a5ffaf2faeab {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:41:08.162202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b6879278-f983-4802-b753-91417c877efd tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:08.173027 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b6879278-f983-4802-b753-91417c877efd tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1319 microversion: 2.1 time: 0.311537 Jul 28 03:41:08.174188 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 597/1231] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:07 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:08.180673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b248e653-0257-4b0c-b4b1-d0db93098f43 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:08.181750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b248e653-0257-4b0c-b4b1-d0db93098f43 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:08.190505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b248e653-0257-4b0c-b4b1-d0db93098f43 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:08.190855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b248e653-0257-4b0c-b4b1-d0db93098f43 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:08.191677 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b248e653-0257-4b0c-b4b1-d0db93098f43 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:08.192109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b248e653-0257-4b0c-b4b1-d0db93098f43 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:08.249435 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0edbae94-7b34-44b5-9696-277b68d43b5a tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1597 microversion: 2.1 time: 0.308433 Jul 28 03:41:08.251320 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 635/1232] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:07 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1597 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:08.260133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-469800361", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f8adb240-7396-4ba1-87bd-7c26f1c16184"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:08.377212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] validate_networks() for [('f8adb240-7396-4ba1-87bd-7c26f1c16184', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:41:08.462389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b248e653-0257-4b0c-b4b1-d0db93098f43 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:08.470819 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b248e653-0257-4b0c-b4b1-d0db93098f43 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 200 len: 1367 microversion: 2.1 time: 0.295560 Jul 28 03:41:08.480620 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 598/1233] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:08 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:08.485788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-778f3b9e-12b2-47c9-b08f-f9f1a3d5139c tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:08.489787 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-778f3b9e-12b2-47c9-b08f-f9f1a3d5139c tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:08.506516 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-778f3b9e-12b2-47c9-b08f-f9f1a3d5139c tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:08.507683 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-778f3b9e-12b2-47c9-b08f-f9f1a3d5139c tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:08.511554 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-778f3b9e-12b2-47c9-b08f-f9f1a3d5139c tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:08.512280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-778f3b9e-12b2-47c9-b08f-f9f1a3d5139c tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:08.662820 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-778f3b9e-12b2-47c9-b08f-f9f1a3d5139c tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab/action" status: 202 len: 0 microversion: 2.1 time: 0.180616 Jul 28 03:41:08.667276 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 599/1234] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:08 2022] POST /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:41:08.676801 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-557d49f2-f974-4fe3-8412-2c0a1a8303d4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:08.677915 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-557d49f2-f974-4fe3-8412-2c0a1a8303d4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:08.684967 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-557d49f2-f974-4fe3-8412-2c0a1a8303d4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:08.686080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-557d49f2-f974-4fe3-8412-2c0a1a8303d4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:08.687062 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-557d49f2-f974-4fe3-8412-2c0a1a8303d4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:08.687664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-557d49f2-f974-4fe3-8412-2c0a1a8303d4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:08.914636 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-557d49f2-f974-4fe3-8412-2c0a1a8303d4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:08.930798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-557d49f2-f974-4fe3-8412-2c0a1a8303d4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:08.932389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-557d49f2-f974-4fe3-8412-2c0a1a8303d4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:08.933610 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-557d49f2-f974-4fe3-8412-2c0a1a8303d4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.264988 Jul 28 03:41:08.948381 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 600/1235] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:08 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:08.948381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b87dad06-c1b8-41b9-bc81-2b2e1e2dae51 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:08.949949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b87dad06-c1b8-41b9-bc81-2b2e1e2dae51 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:08.963130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b87dad06-c1b8-41b9-bc81-2b2e1e2dae51 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:08.963535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b87dad06-c1b8-41b9-bc81-2b2e1e2dae51 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:08.964267 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b87dad06-c1b8-41b9-bc81-2b2e1e2dae51 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:08.964739 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b87dad06-c1b8-41b9-bc81-2b2e1e2dae51 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:09.251959 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b87dad06-c1b8-41b9-bc81-2b2e1e2dae51 tempest-ServersAdminTestJSON-1553915686 tempest-ServersAdminTestJSON-1553915686-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1614 microversion: 2.1 time: 0.316674 Jul 28 03:41:09.257176 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 601/1236] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:08 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1614 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:09.263540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-651d1a76-8cdd-45ad-ab96-3f62b40bad8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:09.264155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-651d1a76-8cdd-45ad-ab96-3f62b40bad8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:09.281646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-651d1a76-8cdd-45ad-ab96-3f62b40bad8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:09.282100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-651d1a76-8cdd-45ad-ab96-3f62b40bad8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:09.282889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-651d1a76-8cdd-45ad-ab96-3f62b40bad8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:09.287794 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-651d1a76-8cdd-45ad-ab96-3f62b40bad8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:09.398299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:41:09.399299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:41:09.399937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:41:09.400567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:41:09.401162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:41:09.419079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:09.419646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:09.423548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:09.424224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:09.469297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Getting quotas for project edc9288cef154fa28f7057f25e0e3213. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:41:09.476018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Getting quotas for user 670b269eb20c416e9f43f8d4e43ded45 and project edc9288cef154fa28f7057f25e0e3213. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:41:09.496734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:41:09.499253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:41:09.586541 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2e666753-3bf1-4a1d-a7bf-c29bf7b1e470 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.330473 Jul 28 03:41:09.590870 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 636/1237] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:41:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:41:09.603047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6455420f-fb37-43c8-adda-5176422fa4d3 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:09.605381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6455420f-fb37-43c8-adda-5176422fa4d3 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:09.623235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6455420f-fb37-43c8-adda-5176422fa4d3 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:09.624527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6455420f-fb37-43c8-adda-5176422fa4d3 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:09.626471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6455420f-fb37-43c8-adda-5176422fa4d3 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:09.628664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6455420f-fb37-43c8-adda-5176422fa4d3 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:09.833259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-651d1a76-8cdd-45ad-ab96-3f62b40bad8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:09.849171 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-651d1a76-8cdd-45ad-ab96-3f62b40bad8e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1511 microversion: 2.1 time: 0.590779 Jul 28 03:41:09.850085 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 602/1238] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:09 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1511 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:09.860437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fab9d2b4-9b67-46f8-90dd-6548b74584f8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:09.861050 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fab9d2b4-9b67-46f8-90dd-6548b74584f8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:09.884104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fab9d2b4-9b67-46f8-90dd-6548b74584f8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:09.884636 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fab9d2b4-9b67-46f8-90dd-6548b74584f8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:09.885417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fab9d2b4-9b67-46f8-90dd-6548b74584f8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:09.885850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fab9d2b4-9b67-46f8-90dd-6548b74584f8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:09.939167 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fab9d2b4-9b67-46f8-90dd-6548b74584f8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:41:10.151996 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fab9d2b4-9b67-46f8-90dd-6548b74584f8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "DELETE /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 204 len: 0 microversion: 2.1 time: 0.287953 Jul 28 03:41:10.151996 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 603/1239] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:41:09 2022] DELETE /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:10.151996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0d9fc395-9ad4-4442-807c-cdfd922bbb84 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:10.151996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0d9fc395-9ad4-4442-807c-cdfd922bbb84 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:10.175082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d9fc395-9ad4-4442-807c-cdfd922bbb84 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:10.181611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d9fc395-9ad4-4442-807c-cdfd922bbb84 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:10.184120 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d9fc395-9ad4-4442-807c-cdfd922bbb84 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:10.187160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d9fc395-9ad4-4442-807c-cdfd922bbb84 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:10.261725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6455420f-fb37-43c8-adda-5176422fa4d3 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:10.278463 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6455420f-fb37-43c8-adda-5176422fa4d3 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1319 microversion: 2.1 time: 0.685692 Jul 28 03:41:10.279114 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 637/1240] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:09 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1319 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:10.304413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-5af43f55-e4f5-4c3c-a012-9b6a0b8dca55 req-4632d715-8f72-4273-a01a-e9dec69d4f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a436784-353a-401e-877a-fcc0ac2fceb7", "name": "network-vif-unplugged", "status": "completed", "tag": "4de6423a-6733-4628-b10d-534a2cfa5f75"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:10.329662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5af43f55-e4f5-4c3c-a012-9b6a0b8dca55 req-4632d715-8f72-4273-a01a-e9dec69d4f47 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:10.330372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5af43f55-e4f5-4c3c-a012-9b6a0b8dca55 req-4632d715-8f72-4273-a01a-e9dec69d4f47 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:10.354843 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5af43f55-e4f5-4c3c-a012-9b6a0b8dca55 req-4632d715-8f72-4273-a01a-e9dec69d4f47 service nova] Creating event network-vif-unplugged:4de6423a-6733-4628-b10d-534a2cfa5f75 for instance 9a436784-353a-401e-877a-fcc0ac2fceb7 on n-h1-826756-3 Jul 28 03:41:10.366494 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-5af43f55-e4f5-4c3c-a012-9b6a0b8dca55 req-4632d715-8f72-4273-a01a-e9dec69d4f47 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075493 Jul 28 03:41:10.368313 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 638/1241] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:10.379904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b47576d-b600-4f5a-939c-db03d563f0da tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:10.381477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3b47576d-b600-4f5a-939c-db03d563f0da tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:10.592131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3b47576d-b600-4f5a-939c-db03d563f0da tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:10.600248 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3b47576d-b600-4f5a-939c-db03d563f0da tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1207 microversion: 2.1 time: 0.228866 Jul 28 03:41:10.603503 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 639/1242] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:10 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1207 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:10.623618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19b0b8d9-8775-45dd-a2be-0ad5437d6290 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:10.625539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-19b0b8d9-8775-45dd-a2be-0ad5437d6290 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:10.631714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:10.657885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19b0b8d9-8775-45dd-a2be-0ad5437d6290 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:10.658929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19b0b8d9-8775-45dd-a2be-0ad5437d6290 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:10.660330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19b0b8d9-8775-45dd-a2be-0ad5437d6290 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:10.663039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19b0b8d9-8775-45dd-a2be-0ad5437d6290 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:10.810601 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0d9fc395-9ad4-4442-807c-cdfd922bbb84 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:10.819653 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0d9fc395-9ad4-4442-807c-cdfd922bbb84 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 200 len: 1367 microversion: 2.1 time: 0.678153 Jul 28 03:41:10.832725 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 604/1243] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:10 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 1367 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:10.837667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a3a4429e-a4a3-4a6e-8182-176b63e513d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:10.838282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a3a4429e-a4a3-4a6e-8182-176b63e513d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:10.873158 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3a4429e-a4a3-4a6e-8182-176b63e513d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:10.873618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3a4429e-a4a3-4a6e-8182-176b63e513d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:10.874422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3a4429e-a4a3-4a6e-8182-176b63e513d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:10.874860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3a4429e-a4a3-4a6e-8182-176b63e513d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:11.158294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19b0b8d9-8775-45dd-a2be-0ad5437d6290 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:11.174638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19b0b8d9-8775-45dd-a2be-0ad5437d6290 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:11.177486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19b0b8d9-8775-45dd-a2be-0ad5437d6290 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:11.181286 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-19b0b8d9-8775-45dd-a2be-0ad5437d6290 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.576210 Jul 28 03:41:11.199354 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 640/1244] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:10 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:11.231043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed7bef2b-bb73-4963-bb26-cf1e85da01b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:11.231997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed7bef2b-bb73-4963-bb26-cf1e85da01b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:11.257378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed7bef2b-bb73-4963-bb26-cf1e85da01b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:11.259276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed7bef2b-bb73-4963-bb26-cf1e85da01b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:11.260146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed7bef2b-bb73-4963-bb26-cf1e85da01b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:11.260608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed7bef2b-bb73-4963-bb26-cf1e85da01b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:11.668245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a3a4429e-a4a3-4a6e-8182-176b63e513d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:11.678024 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a3a4429e-a4a3-4a6e-8182-176b63e513d1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1470 microversion: 2.1 time: 0.844319 Jul 28 03:41:11.688530 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 605/1245] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:10 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1470 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:11.698302 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-8ee30b75-fae8-4ac0-9602-52dbff00829d req-414039e2-dcd2-4d34-b263-a8ee880f5761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a436784-353a-401e-877a-fcc0ac2fceb7", "name": "network-vif-deleted", "tag": "4de6423a-6733-4628-b10d-534a2cfa5f75"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:11.714824 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-8ee30b75-fae8-4ac0-9602-52dbff00829d req-414039e2-dcd2-4d34-b263-a8ee880f5761 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:11.715571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-8ee30b75-fae8-4ac0-9602-52dbff00829d req-414039e2-dcd2-4d34-b263-a8ee880f5761 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:11.732758 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-8ee30b75-fae8-4ac0-9602-52dbff00829d req-414039e2-dcd2-4d34-b263-a8ee880f5761 service nova] Creating event network-vif-deleted:4de6423a-6733-4628-b10d-534a2cfa5f75 for instance 9a436784-353a-401e-877a-fcc0ac2fceb7 on n-h1-826756-3 Jul 28 03:41:11.745962 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-8ee30b75-fae8-4ac0-9602-52dbff00829d req-414039e2-dcd2-4d34-b263-a8ee880f5761 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054981 Jul 28 03:41:11.747324 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 606/1246] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:11.753222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4945f4b5-4e98-44ff-a292-a63bab4840df tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:11.754588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4945f4b5-4e98-44ff-a292-a63bab4840df tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:11.762293 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4945f4b5-4e98-44ff-a292-a63bab4840df tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:11.762919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4945f4b5-4e98-44ff-a292-a63bab4840df tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:11.764104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4945f4b5-4e98-44ff-a292-a63bab4840df tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:11.764854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4945f4b5-4e98-44ff-a292-a63bab4840df tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:11.796998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:11.903596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed7bef2b-bb73-4963-bb26-cf1e85da01b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:11.920754 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed7bef2b-bb73-4963-bb26-cf1e85da01b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1488 microversion: 2.1 time: 0.717938 Jul 28 03:41:11.923337 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 641/1247] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:11 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1488 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:11.950581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a15fd378-92fc-47f5-96bc-92fb2dcf24b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:11.951339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a15fd378-92fc-47f5-96bc-92fb2dcf24b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:11.984305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a15fd378-92fc-47f5-96bc-92fb2dcf24b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:11.990274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a15fd378-92fc-47f5-96bc-92fb2dcf24b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:11.991607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a15fd378-92fc-47f5-96bc-92fb2dcf24b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:11.992444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a15fd378-92fc-47f5-96bc-92fb2dcf24b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:12.183328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4945f4b5-4e98-44ff-a292-a63bab4840df tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:12.197008 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4945f4b5-4e98-44ff-a292-a63bab4840df tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1319 microversion: 2.1 time: 0.447866 Jul 28 03:41:12.197900 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 607/1248] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:11 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1319 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:12.212485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a15fd378-92fc-47f5-96bc-92fb2dcf24b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:12.219383 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a15fd378-92fc-47f5-96bc-92fb2dcf24b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1203 microversion: 2.1 time: 0.294162 Jul 28 03:41:12.225637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-cd2532bf-0abf-4449-9efb-cf8d917a46dd req-5f7f43d9-a0c5-461f-bde3-4056e8733f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c44d8fc8-f642-4816-9e16-62dcc5798678", "tag": "6a86d23f-b83d-46cb-ba4a-d646641993f9"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:12.226586 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 642/1249] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:11 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1203 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:12.240333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-cd2532bf-0abf-4449-9efb-cf8d917a46dd req-5f7f43d9-a0c5-461f-bde3-4056e8733f40 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:12.241310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-cd2532bf-0abf-4449-9efb-cf8d917a46dd req-5f7f43d9-a0c5-461f-bde3-4056e8733f40 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:12.247290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-db9eeadd-fec9-48af-9253-3a7b2f826b15 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:12.251439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-db9eeadd-fec9-48af-9253-3a7b2f826b15 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:12.274930 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-cd2532bf-0abf-4449-9efb-cf8d917a46dd req-5f7f43d9-a0c5-461f-bde3-4056e8733f40 service nova] Creating event network-changed:6a86d23f-b83d-46cb-ba4a-d646641993f9 for instance c44d8fc8-f642-4816-9e16-62dcc5798678 on n-h1-826756-3 Jul 28 03:41:12.281122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db9eeadd-fec9-48af-9253-3a7b2f826b15 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:12.286342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db9eeadd-fec9-48af-9253-3a7b2f826b15 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:12.287716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db9eeadd-fec9-48af-9253-3a7b2f826b15 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:12.288457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db9eeadd-fec9-48af-9253-3a7b2f826b15 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:12.289555 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-cd2532bf-0abf-4449-9efb-cf8d917a46dd req-5f7f43d9-a0c5-461f-bde3-4056e8733f40 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071704 Jul 28 03:41:12.291923 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 608/1250] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:12.312154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7fe7cd64-d35d-458b-b3e4-61644842ea4b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:12.319144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7fe7cd64-d35d-458b-b3e4-61644842ea4b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:12.336251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fe7cd64-d35d-458b-b3e4-61644842ea4b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:12.340283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fe7cd64-d35d-458b-b3e4-61644842ea4b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:12.344543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fe7cd64-d35d-458b-b3e4-61644842ea4b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:12.345269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fe7cd64-d35d-458b-b3e4-61644842ea4b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:12.466167 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7fe7cd64-d35d-458b-b3e4-61644842ea4b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 200 len: 157 microversion: 2.1 time: 0.171406 Jul 28 03:41:12.468017 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 609/1251] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:12 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 157 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:12.474254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fe828a11-b89d-47d8-acba-9b001d458a98 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:12.478396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fe828a11-b89d-47d8-acba-9b001d458a98 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:12.497757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe828a11-b89d-47d8-acba-9b001d458a98 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:12.499500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe828a11-b89d-47d8-acba-9b001d458a98 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:12.500672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe828a11-b89d-47d8-acba-9b001d458a98 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:12.506457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe828a11-b89d-47d8-acba-9b001d458a98 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:13.043596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:13.065143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fe828a11-b89d-47d8-acba-9b001d458a98 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:13.085869 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fe828a11-b89d-47d8-acba-9b001d458a98 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:13.114477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fe828a11-b89d-47d8-acba-9b001d458a98 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:13.116264 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fe828a11-b89d-47d8-acba-9b001d458a98 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.646861 Jul 28 03:41:13.128264 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 610/1252] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:12 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:13.140540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e14999dc-5b61-4949-8f9b-f5dc88a32e89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:13.159837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e14999dc-5b61-4949-8f9b-f5dc88a32e89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:13.176022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e14999dc-5b61-4949-8f9b-f5dc88a32e89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:13.181092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e14999dc-5b61-4949-8f9b-f5dc88a32e89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:13.182286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e14999dc-5b61-4949-8f9b-f5dc88a32e89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:13.182965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e14999dc-5b61-4949-8f9b-f5dc88a32e89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:13.208116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-db9eeadd-fec9-48af-9253-3a7b2f826b15 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:13.233761 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-db9eeadd-fec9-48af-9253-3a7b2f826b15 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 200 len: 1367 microversion: 2.1 time: 1.005798 Jul 28 03:41:13.240323 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 643/1253] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:12 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 1367 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:13.262561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-49ee992c-d9a3-4a9b-a53b-b3aff5968a8c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:13.269733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-49ee992c-d9a3-4a9b-a53b-b3aff5968a8c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:13.287114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49ee992c-d9a3-4a9b-a53b-b3aff5968a8c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:13.301107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49ee992c-d9a3-4a9b-a53b-b3aff5968a8c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:13.302444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49ee992c-d9a3-4a9b-a53b-b3aff5968a8c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:13.303073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49ee992c-d9a3-4a9b-a53b-b3aff5968a8c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:13.793488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-49ee992c-d9a3-4a9b-a53b-b3aff5968a8c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:13.836234 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-49ee992c-d9a3-4a9b-a53b-b3aff5968a8c tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1428 microversion: 2.1 time: 0.582455 Jul 28 03:41:13.837961 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 644/1254] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:13 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1428 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:13.863895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4fde0b4-1744-4422-b043-5bf5878e6778 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:13.864561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4fde0b4-1744-4422-b043-5bf5878e6778 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:13.897988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4fde0b4-1744-4422-b043-5bf5878e6778 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:13.899773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4fde0b4-1744-4422-b043-5bf5878e6778 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:13.902894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4fde0b4-1744-4422-b043-5bf5878e6778 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:13.903551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4fde0b4-1744-4422-b043-5bf5878e6778 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:14.434006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e14999dc-5b61-4949-8f9b-f5dc88a32e89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:14.447870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a4fde0b4-1744-4422-b043-5bf5878e6778 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:14.458568 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4fde0b4-1744-4422-b043-5bf5878e6778 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1319 microversion: 2.1 time: 0.613894 Jul 28 03:41:14.460822 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 645/1255] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:13 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1319 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:14.468715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63071e05-2afe-4681-8177-06ff8ebbcbc8 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:14.468945 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e14999dc-5b61-4949-8f9b-f5dc88a32e89 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 1.333694 Jul 28 03:41:14.469783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63071e05-2afe-4681-8177-06ff8ebbcbc8 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:14.485338 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 611/1256] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:13 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:14.500234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63071e05-2afe-4681-8177-06ff8ebbcbc8 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:14.501142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63071e05-2afe-4681-8177-06ff8ebbcbc8 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:14.509476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63071e05-2afe-4681-8177-06ff8ebbcbc8 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:14.509932 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-1f82bbb6-3c1a-400f-b388-d99a6d17aa1d req-e29f15b0-aad3-4aa7-89e6-f4040ae8d9ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db682d4c-b880-4215-acf1-18c6d7118aca", "name": "network-vif-deleted", "tag": "768b4449-0aa9-474a-a899-7501e3428c00"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:14.510852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63071e05-2afe-4681-8177-06ff8ebbcbc8 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:14.527473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1f82bbb6-3c1a-400f-b388-d99a6d17aa1d req-e29f15b0-aad3-4aa7-89e6-f4040ae8d9ae service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:14.528018 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1f82bbb6-3c1a-400f-b388-d99a6d17aa1d req-e29f15b0-aad3-4aa7-89e6-f4040ae8d9ae service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:14.547405 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-1f82bbb6-3c1a-400f-b388-d99a6d17aa1d req-e29f15b0-aad3-4aa7-89e6-f4040ae8d9ae service nova] Creating event network-vif-deleted:768b4449-0aa9-474a-a899-7501e3428c00 for instance db682d4c-b880-4215-acf1-18c6d7118aca on n-h1-826756-3 Jul 28 03:41:14.556036 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-1f82bbb6-3c1a-400f-b388-d99a6d17aa1d req-e29f15b0-aad3-4aa7-89e6-f4040ae8d9ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068840 Jul 28 03:41:14.557333 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 612/1257] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:14.570490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1501266e-69f1-49da-8378-627fc0659004 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:14.572284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1501266e-69f1-49da-8378-627fc0659004 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:14.591880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1501266e-69f1-49da-8378-627fc0659004 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:14.592994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1501266e-69f1-49da-8378-627fc0659004 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:14.593951 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1501266e-69f1-49da-8378-627fc0659004 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:14.594541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1501266e-69f1-49da-8378-627fc0659004 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:14.638774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63071e05-2afe-4681-8177-06ff8ebbcbc8 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:14.667729 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63071e05-2afe-4681-8177-06ff8ebbcbc8 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1265 microversion: 2.1 time: 0.204283 Jul 28 03:41:14.669758 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 646/1258] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:14 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:14.689179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ba5b5e44-07b0-4f2d-9949-7c3223fe79aa tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:14.692048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ba5b5e44-07b0-4f2d-9949-7c3223fe79aa tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:14.706571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba5b5e44-07b0-4f2d-9949-7c3223fe79aa tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:14.707528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba5b5e44-07b0-4f2d-9949-7c3223fe79aa tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:14.709650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba5b5e44-07b0-4f2d-9949-7c3223fe79aa tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:14.712104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba5b5e44-07b0-4f2d-9949-7c3223fe79aa tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.040780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ba5b5e44-07b0-4f2d-9949-7c3223fe79aa tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:15.043338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1501266e-69f1-49da-8378-627fc0659004 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:15.051352 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ba5b5e44-07b0-4f2d-9949-7c3223fe79aa tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 200 len: 1367 microversion: 2.1 time: 0.378522 Jul 28 03:41:15.055829 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 647/1259] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:14 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:15.074906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-7b07a177-6efb-4b0c-9a8b-5d05149316ef req-5bec7f24-05ce-4c59-bb7b-7ee0c3282feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76cd273-b14b-410b-b0c1-2379d46988ad", "name": "network-vif-plugged", "status": "completed", "tag": "fe6e0906-a74d-4d72-9706-2079c277e4ac"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:15.088575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7b07a177-6efb-4b0c-9a8b-5d05149316ef req-5bec7f24-05ce-4c59-bb7b-7ee0c3282feb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.089011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7b07a177-6efb-4b0c-9a8b-5d05149316ef req-5bec7f24-05ce-4c59-bb7b-7ee0c3282feb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.089741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1501266e-69f1-49da-8378-627fc0659004 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:15.091749 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1501266e-69f1-49da-8378-627fc0659004 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:15.093104 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1501266e-69f1-49da-8378-627fc0659004 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.534320 Jul 28 03:41:15.109732 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 613/1260] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:14 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:15.115271 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-7b07a177-6efb-4b0c-9a8b-5d05149316ef req-5bec7f24-05ce-4c59-bb7b-7ee0c3282feb service nova] Creating event network-vif-plugged:fe6e0906-a74d-4d72-9706-2079c277e4ac for instance c76cd273-b14b-410b-b0c1-2379d46988ad on n-h2-826756-3 Jul 28 03:41:15.116174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eeb9e9c9-840a-4a9e-8894-c19b9a44aa35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:15.117086 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-eeb9e9c9-840a-4a9e-8894-c19b9a44aa35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:15.123856 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-7b07a177-6efb-4b0c-9a8b-5d05149316ef req-5bec7f24-05ce-4c59-bb7b-7ee0c3282feb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065874 Jul 28 03:41:15.124441 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 648/1261] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:15.128063 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eeb9e9c9-840a-4a9e-8894-c19b9a44aa35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.129295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eeb9e9c9-840a-4a9e-8894-c19b9a44aa35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.130958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eeb9e9c9-840a-4a9e-8894-c19b9a44aa35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.131671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e5829f51-22ac-4a9e-b872-43a4d174acd1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:15.132374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eeb9e9c9-840a-4a9e-8894-c19b9a44aa35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.133220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e5829f51-22ac-4a9e-b872-43a4d174acd1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:15.149464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5829f51-22ac-4a9e-b872-43a4d174acd1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.150091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5829f51-22ac-4a9e-b872-43a4d174acd1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.150907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5829f51-22ac-4a9e-b872-43a4d174acd1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.151342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5829f51-22ac-4a9e-b872-43a4d174acd1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.231119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5829f51-22ac-4a9e-b872-43a4d174acd1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.231898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5829f51-22ac-4a9e-b872-43a4d174acd1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.232419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-e5829f51-22ac-4a9e-b872-43a4d174acd1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lazy-loading 'fault' on Instance uuid db682d4c-b880-4215-acf1-18c6d7118aca {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:41:15.309078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e5829f51-22ac-4a9e-b872-43a4d174acd1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:15.317720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=14 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:15.327696 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e5829f51-22ac-4a9e-b872-43a4d174acd1 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 200 len: 1304 microversion: 2.1 time: 0.201647 Jul 28 03:41:15.342132 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 649/1262] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:15 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 1304 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:15.344772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7ee2e3df-43f4-43d8-8145-6ca978cffc1e tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:15.345699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7ee2e3df-43f4-43d8-8145-6ca978cffc1e tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:15.355463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ee2e3df-43f4-43d8-8145-6ca978cffc1e tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.355917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ee2e3df-43f4-43d8-8145-6ca978cffc1e tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.357968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ee2e3df-43f4-43d8-8145-6ca978cffc1e tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.358415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ee2e3df-43f4-43d8-8145-6ca978cffc1e tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.467314 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-eeb9e9c9-840a-4a9e-8894-c19b9a44aa35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:15.490483 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-eeb9e9c9-840a-4a9e-8894-c19b9a44aa35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.374955 Jul 28 03:41:15.504462 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 614/1263] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:15 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:15.510349 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a889bba5-ef78-40d6-845c-e909ce6c3498 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:15.512487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a889bba5-ef78-40d6-845c-e909ce6c3498 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:15.540997 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a889bba5-ef78-40d6-845c-e909ce6c3498 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.545065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a889bba5-ef78-40d6-845c-e909ce6c3498 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.546730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a889bba5-ef78-40d6-845c-e909ce6c3498 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.547182 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a889bba5-ef78-40d6-845c-e909ce6c3498 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.650295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:15.659278 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7ee2e3df-43f4-43d8-8145-6ca978cffc1e tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1859 microversion: 2.1 time: 0.328610 Jul 28 03:41:15.663050 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 650/1264] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:15 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1859 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:15.668972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-be4e43cf-f404-424c-8770-55300675e270 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:15.669810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-be4e43cf-f404-424c-8770-55300675e270 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:15.682114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be4e43cf-f404-424c-8770-55300675e270 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.683502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be4e43cf-f404-424c-8770-55300675e270 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.684623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be4e43cf-f404-424c-8770-55300675e270 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.685374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be4e43cf-f404-424c-8770-55300675e270 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.873005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a889bba5-ef78-40d6-845c-e909ce6c3498 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:15.881795 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a889bba5-ef78-40d6-845c-e909ce6c3498 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1319 microversion: 2.1 time: 0.382757 Jul 28 03:41:15.885087 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 615/1265] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:15 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:15.891839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-76e76446-bd6d-4243-8a51-880c083efb39 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-826756-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:15.894726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-76e76446-bd6d-4243-8a51-880c083efb39 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:15.901826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76e76446-bd6d-4243-8a51-880c083efb39 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.902717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76e76446-bd6d-4243-8a51-880c083efb39 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.903887 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76e76446-bd6d-4243-8a51-880c083efb39 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.904605 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76e76446-bd6d-4243-8a51-880c083efb39 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.907978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be4e43cf-f404-424c-8770-55300675e270 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:15.925188 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-be4e43cf-f404-424c-8770-55300675e270 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.260749 Jul 28 03:41:15.941099 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 651/1266] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:15 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:15.941425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-76e76446-bd6d-4243-8a51-880c083efb39 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lazy-loading 'flavor' on Instance uuid 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:41:15.941547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-486dc5ac-86d5-4343-9dee-45e23bf19b85 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:15.941912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-486dc5ac-86d5-4343-9dee-45e23bf19b85 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:15.958207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-76e76446-bd6d-4243-8a51-880c083efb39 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Going to try to live migrate instance to n-h1-826756-3 {{(pid=126072) live_migrate /opt/stack/nova/nova/compute/api.py:5474}} Jul 28 03:41:15.962729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-486dc5ac-86d5-4343-9dee-45e23bf19b85 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.963189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-486dc5ac-86d5-4343-9dee-45e23bf19b85 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:15.963989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-486dc5ac-86d5-4343-9dee-45e23bf19b85 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:15.964483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-486dc5ac-86d5-4343-9dee-45e23bf19b85 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:16.220457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-486dc5ac-86d5-4343-9dee-45e23bf19b85 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:16.230113 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-486dc5ac-86d5-4343-9dee-45e23bf19b85 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1307 microversion: 2.1 time: 0.299182 Jul 28 03:41:16.231390 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 652/1267] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:15 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1307 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:16.236671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb9e0299-96e9-4d00-b6de-88b26a04cef6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:16.237204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eb9e0299-96e9-4d00-b6de-88b26a04cef6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:16.244222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb9e0299-96e9-4d00-b6de-88b26a04cef6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:16.244740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb9e0299-96e9-4d00-b6de-88b26a04cef6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:16.245584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb9e0299-96e9-4d00-b6de-88b26a04cef6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:16.246215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb9e0299-96e9-4d00-b6de-88b26a04cef6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:16.458618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eb9e0299-96e9-4d00-b6de-88b26a04cef6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:16.468058 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb9e0299-96e9-4d00-b6de-88b26a04cef6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.235882 Jul 28 03:41:16.480385 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 653/1268] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:16 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:16.480385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1feefaec-e748-4b8d-9f16-2633b0670071 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:16.480385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1feefaec-e748-4b8d-9f16-2633b0670071 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:16.491669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1feefaec-e748-4b8d-9f16-2633b0670071 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:16.492044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1feefaec-e748-4b8d-9f16-2633b0670071 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:16.497732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1feefaec-e748-4b8d-9f16-2633b0670071 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:16.498988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1feefaec-e748-4b8d-9f16-2633b0670071 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:16.846838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1feefaec-e748-4b8d-9f16-2633b0670071 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:16.861945 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1feefaec-e748-4b8d-9f16-2633b0670071 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 200 len: 1367 microversion: 2.1 time: 0.391037 Jul 28 03:41:16.862559 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 654/1269] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:16 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 1367 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:16.873354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-803eadaf-50bc-4c2c-9a5c-abc09d7161b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:16.874219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-803eadaf-50bc-4c2c-9a5c-abc09d7161b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:16.887005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-803eadaf-50bc-4c2c-9a5c-abc09d7161b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:16.888212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-803eadaf-50bc-4c2c-9a5c-abc09d7161b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:16.892595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-803eadaf-50bc-4c2c-9a5c-abc09d7161b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:16.893753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-803eadaf-50bc-4c2c-9a5c-abc09d7161b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:17.155394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-803eadaf-50bc-4c2c-9a5c-abc09d7161b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:17.165760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-803eadaf-50bc-4c2c-9a5c-abc09d7161b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:17.167640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-803eadaf-50bc-4c2c-9a5c-abc09d7161b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:17.168564 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-803eadaf-50bc-4c2c-9a5c-abc09d7161b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.304019 Jul 28 03:41:17.174394 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 655/1270] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:16 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:17.186894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7cbde05c-b2a2-40f8-b541-c07868667b4a tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:17.188231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7cbde05c-b2a2-40f8-b541-c07868667b4a tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: db682d4c-b880-4215-acf1-18c6d7118aca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:17.217417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cbde05c-b2a2-40f8-b541-c07868667b4a tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:17.218168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cbde05c-b2a2-40f8-b541-c07868667b4a tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:17.219462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cbde05c-b2a2-40f8-b541-c07868667b4a tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:17.221458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cbde05c-b2a2-40f8-b541-c07868667b4a tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:17.252697 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-7cbde05c-b2a2-40f8-b541-c07868667b4a tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] HTTP exception thrown: Instance db682d4c-b880-4215-acf1-18c6d7118aca could not be found. Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7cbde05c-b2a2-40f8-b541-c07868667b4a tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Request method failure captured: Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca HTTP/1.1 Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gS_iXcihX0o4gYoKIokTvXGU_Ilt0CRjXC97ktUkU756klUyqJCnv9VnRS7_uHOtrepoIhbsKyl5Z54Bvt23q9_klJBkvptIVIVwaTbcLWonWYLH7o_julm0C_2HeGuTNQ3DoAziyP3vC5nr3WWqPI1HPMyZmN44ID0VtdqgMYEN34 Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 73bbf29c8c7f4f3385717d49ff9fe5f4 Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersAdminTestJSON-2140037471 Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:41:17.254554 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:41:17.257121 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73bbf29c8c7f4f3385717d49ff9fe5f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bbf29c8c7f4f3385717d49ff9fe5f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73bbf29c8c7f4f3385717d49ff9fe5f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bbf29c8c7f4f3385717d49ff9fe5f4"}]}] Jul 28 03:41:17.257121 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersAdminTestJSON-2140037471 Jul 28 03:41:17.257121 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 73bbf29c8c7f4f3385717d49ff9fe5f4 Jul 28 03:41:17.257121 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersAdminTestJSON-2140037471 Jul 28 03:41:17.257121 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersAdminTestJSON-2140037471-project Jul 28 03:41:17.257121 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:41:17.257121 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:41:17.257121 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: b4eff140fd7d4ec0ae9fe1a851d272e2 Jul 28 03:41:17.257121 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersAdminTestJSON-2140037471-project Jul 28 03:41:17.257121 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:41:17.257121 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance db682d4c-b880-4215-acf1-18c6d7118aca could not be found. Jul 28 03:41:17.257121 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'db682d4c-b880-4215-acf1-18c6d7118aca'} Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db682d4c-b880-4215-acf1-18c6d7118aca could not be found. Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:41:17.258604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db682d4c-b880-4215-acf1-18c6d7118aca could not be found. Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db682d4c-b880-4215-acf1-18c6d7118aca could not be found. Jul 28 03:41:17.260993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:17.264013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7cbde05c-b2a2-40f8-b541-c07868667b4a tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Returning 404 to user: Instance db682d4c-b880-4215-acf1-18c6d7118aca could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:41:17.264013 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7cbde05c-b2a2-40f8-b541-c07868667b4a tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca" status: 404 len: 111 microversion: 2.1 time: 0.079931 Jul 28 03:41:17.264013 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 656/1271] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:17 2022] GET /compute/v2.1/servers/db682d4c-b880-4215-acf1-18c6d7118aca => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:41:17.267264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2142798271", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f76c85a0-c616-4cd2-a4d5-29a90d49abe8"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:17.373689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] validate_networks() for [('f76c85a0-c616-4cd2-a4d5-29a90d49abe8', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:41:18.624103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:41:18.625302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:41:18.626245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:41:18.626917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:41:18.627359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:41:18.646973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:18.647698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:18.648790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:18.649314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:18.675270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Getting quotas for project b7bee0b59b0b43ce80623b7aca24111a. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:41:18.683024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Getting quotas for user 26b9a63a13e1420aa3b7f299456c65e6 and project b7bee0b59b0b43ce80623b7aca24111a. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:41:18.701611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:41:18.704083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:41:18.789463 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c8e0d4ee-11ef-4249-92eb-b63a3c82d241 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.530312 Jul 28 03:41:18.791417 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 657/1272] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:41:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:41:18.801635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7158abde-035d-43f8-871b-10b92f5a5213 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:18.802718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7158abde-035d-43f8-871b-10b92f5a5213 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:18.814899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7158abde-035d-43f8-871b-10b92f5a5213 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:18.815601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7158abde-035d-43f8-871b-10b92f5a5213 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:18.816572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7158abde-035d-43f8-871b-10b92f5a5213 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:18.817293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7158abde-035d-43f8-871b-10b92f5a5213 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:18.855251 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-76e76446-bd6d-4243-8a51-880c083efb39 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/action" status: 202 len: 0 microversion: 2.1 time: 2.967722 Jul 28 03:41:18.856668 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 616/1273] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:15 2022] POST /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/action => generated 0 bytes in 2970 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:41:18.875398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c914a14c-0d6f-45a5-af16-d7250a5345bb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:18.876831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c914a14c-0d6f-45a5-af16-d7250a5345bb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:18.910276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:18.921914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c914a14c-0d6f-45a5-af16-d7250a5345bb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:18.922550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c914a14c-0d6f-45a5-af16-d7250a5345bb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:18.923583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c914a14c-0d6f-45a5-af16-d7250a5345bb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:18.924193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c914a14c-0d6f-45a5-af16-d7250a5345bb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.069413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7158abde-035d-43f8-871b-10b92f5a5213 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:19.078144 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7158abde-035d-43f8-871b-10b92f5a5213 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1468 microversion: 2.1 time: 0.284748 Jul 28 03:41:19.092388 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 658/1274] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:18 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1468 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:19.092388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2cc6d3ac-b061-49ce-92b2-112bd9c840b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:19.092388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2cc6d3ac-b061-49ce-92b2-112bd9c840b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:19.093168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2cc6d3ac-b061-49ce-92b2-112bd9c840b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.095706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2cc6d3ac-b061-49ce-92b2-112bd9c840b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.095968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2cc6d3ac-b061-49ce-92b2-112bd9c840b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.096255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2cc6d3ac-b061-49ce-92b2-112bd9c840b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.140513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2cc6d3ac-b061-49ce-92b2-112bd9c840b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:41:19.290568 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2cc6d3ac-b061-49ce-92b2-112bd9c840b6 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "DELETE /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 204 len: 0 microversion: 2.1 time: 0.207948 Jul 28 03:41:19.291795 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 659/1275] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:41:19 2022] DELETE /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:19.312383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c4e20ae-ad5c-404e-86b9-f1217ec9f399 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:19.312383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c4e20ae-ad5c-404e-86b9-f1217ec9f399 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:19.322875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c914a14c-0d6f-45a5-af16-d7250a5345bb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:19.337997 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c914a14c-0d6f-45a5-af16-d7250a5345bb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1307 microversion: 2.1 time: 0.479984 Jul 28 03:41:19.338229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c4e20ae-ad5c-404e-86b9-f1217ec9f399 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.338863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c4e20ae-ad5c-404e-86b9-f1217ec9f399 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.346034 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 617/1276] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:18 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1307 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:19.355100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39b9db0f-c789-4cda-8bdd-426726f2ac59 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:19.355971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-39b9db0f-c789-4cda-8bdd-426726f2ac59 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:19.359314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c4e20ae-ad5c-404e-86b9-f1217ec9f399 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.360790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c4e20ae-ad5c-404e-86b9-f1217ec9f399 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.365874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39b9db0f-c789-4cda-8bdd-426726f2ac59 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.367236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39b9db0f-c789-4cda-8bdd-426726f2ac59 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.368399 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39b9db0f-c789-4cda-8bdd-426726f2ac59 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.369106 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39b9db0f-c789-4cda-8bdd-426726f2ac59 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.576246 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-39b9db0f-c789-4cda-8bdd-426726f2ac59 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:19.592731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-39b9db0f-c789-4cda-8bdd-426726f2ac59 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:19.595512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-39b9db0f-c789-4cda-8bdd-426726f2ac59 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:19.597279 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-39b9db0f-c789-4cda-8bdd-426726f2ac59 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.249624 Jul 28 03:41:19.614113 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 618/1277] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:19 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:19.631226 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-a69de270-a450-4671-bbe7-80667f621abc req-c2b1427b-ea61-4dea-ac64-6d3d23c5d4ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf954030-af98-4832-a28a-03cf2a3fe8c9", "tag": "bf305f0a-27a2-4078-b918-f102991b6796"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:19.643737 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a69de270-a450-4671-bbe7-80667f621abc req-c2b1427b-ea61-4dea-ac64-6d3d23c5d4ab service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.644405 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a69de270-a450-4671-bbe7-80667f621abc req-c2b1427b-ea61-4dea-ac64-6d3d23c5d4ab service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.653607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7c4e20ae-ad5c-404e-86b9-f1217ec9f399 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:19.657488 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-a69de270-a450-4671-bbe7-80667f621abc req-c2b1427b-ea61-4dea-ac64-6d3d23c5d4ab service nova] Creating event network-changed:bf305f0a-27a2-4078-b918-f102991b6796 for instance bf954030-af98-4832-a28a-03cf2a3fe8c9 on n-h1-826756-3 Jul 28 03:41:19.664385 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-a69de270-a450-4671-bbe7-80667f621abc req-c2b1427b-ea61-4dea-ac64-6d3d23c5d4ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048802 Jul 28 03:41:19.664616 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7c4e20ae-ad5c-404e-86b9-f1217ec9f399 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 200 len: 1367 microversion: 2.1 time: 0.369610 Jul 28 03:41:19.670024 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 619/1278] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:19.676440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3064e772-9a2d-4139-95e8-3431b0adccbd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:19.677331 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 660/1279] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:19 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:19.678479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3064e772-9a2d-4139-95e8-3431b0adccbd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:19.687759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3064e772-9a2d-4139-95e8-3431b0adccbd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.688411 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3064e772-9a2d-4139-95e8-3431b0adccbd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.689462 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3064e772-9a2d-4139-95e8-3431b0adccbd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.690151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3064e772-9a2d-4139-95e8-3431b0adccbd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.691675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-038f3595-c8dd-48e4-88b0-609c4bc2eaf3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:19.692390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-038f3595-c8dd-48e4-88b0-609c4bc2eaf3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:19.703128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-038f3595-c8dd-48e4-88b0-609c4bc2eaf3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.704401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-038f3595-c8dd-48e4-88b0-609c4bc2eaf3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.705882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-038f3595-c8dd-48e4-88b0-609c4bc2eaf3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.706809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-038f3595-c8dd-48e4-88b0-609c4bc2eaf3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.780279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3064e772-9a2d-4139-95e8-3431b0adccbd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:19.789261 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3064e772-9a2d-4139-95e8-3431b0adccbd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1219 microversion: 2.1 time: 0.117285 Jul 28 03:41:19.790131 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 620/1280] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:19 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:19.821779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2e232efa-eac0-42e1-9108-7be90d356d14 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:19.823003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2e232efa-eac0-42e1-9108-7be90d356d14 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:19.840205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2e232efa-eac0-42e1-9108-7be90d356d14 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.845162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2e232efa-eac0-42e1-9108-7be90d356d14 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.846834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2e232efa-eac0-42e1-9108-7be90d356d14 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.848126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2e232efa-eac0-42e1-9108-7be90d356d14 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.897740 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-2e232efa-eac0-42e1-9108-7be90d356d14 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lazy-loading 'flavor' on Instance uuid c76cd273-b14b-410b-b0c1-2379d46988ad {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:41:19.949716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-038f3595-c8dd-48e4-88b0-609c4bc2eaf3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:19.965990 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-038f3595-c8dd-48e4-88b0-609c4bc2eaf3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.286762 Jul 28 03:41:19.980388 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 661/1281] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:19 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:19.980388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-814de6c1-b5d9-461e-b2f5-07b7d0907060 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:19.980388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-814de6c1-b5d9-461e-b2f5-07b7d0907060 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:19.989323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-814de6c1-b5d9-461e-b2f5-07b7d0907060 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.990655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-814de6c1-b5d9-461e-b2f5-07b7d0907060 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:19.993512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-814de6c1-b5d9-461e-b2f5-07b7d0907060 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:19.994516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-814de6c1-b5d9-461e-b2f5-07b7d0907060 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:20.034824 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2e232efa-eac0-42e1-9108-7be90d356d14 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad/action" status: 202 len: 0 microversion: 2.1 time: 0.241676 Jul 28 03:41:20.040718 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 621/1282] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:19 2022] POST /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:41:20.050712 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-3fa7aff6-b64e-4c7b-9039-9679251c07cf req-815766fb-651c-49ab-a3bb-77e53f4ded3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44d8fc8-f642-4816-9e16-62dcc5798678", "name": "network-vif-plugged", "status": "completed", "tag": "6a86d23f-b83d-46cb-ba4a-d646641993f9"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:20.066925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3fa7aff6-b64e-4c7b-9039-9679251c07cf req-815766fb-651c-49ab-a3bb-77e53f4ded3a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:20.068566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3fa7aff6-b64e-4c7b-9039-9679251c07cf req-815766fb-651c-49ab-a3bb-77e53f4ded3a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:20.087806 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-3fa7aff6-b64e-4c7b-9039-9679251c07cf req-815766fb-651c-49ab-a3bb-77e53f4ded3a service nova] Creating event network-vif-plugged:6a86d23f-b83d-46cb-ba4a-d646641993f9 for instance c44d8fc8-f642-4816-9e16-62dcc5798678 on n-h1-826756-3 Jul 28 03:41:20.095077 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-3fa7aff6-b64e-4c7b-9039-9679251c07cf req-815766fb-651c-49ab-a3bb-77e53f4ded3a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051628 Jul 28 03:41:20.095997 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 622/1283] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:20.101144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-09864959-2714-4c50-a56a-180aa22f205f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:20.101842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-09864959-2714-4c50-a56a-180aa22f205f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:20.110772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09864959-2714-4c50-a56a-180aa22f205f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:20.111307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09864959-2714-4c50-a56a-180aa22f205f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:20.112119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09864959-2714-4c50-a56a-180aa22f205f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:20.112591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09864959-2714-4c50-a56a-180aa22f205f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:20.134726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:20.214868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-814de6c1-b5d9-461e-b2f5-07b7d0907060 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:20.224809 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-814de6c1-b5d9-461e-b2f5-07b7d0907060 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1469 microversion: 2.1 time: 0.254952 Jul 28 03:41:20.225616 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 662/1284] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:19 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1469 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:20.363712 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-09864959-2714-4c50-a56a-180aa22f205f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:20.366418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3415138c-b7f7-4613-b0d4-b2995d9cf00b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:20.367773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3415138c-b7f7-4613-b0d4-b2995d9cf00b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:20.380248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3415138c-b7f7-4613-b0d4-b2995d9cf00b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:20.381564 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-09864959-2714-4c50-a56a-180aa22f205f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1476 microversion: 2.1 time: 0.284255 Jul 28 03:41:20.381786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3415138c-b7f7-4613-b0d4-b2995d9cf00b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:20.382847 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 623/1285] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:20 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1476 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:20.398973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3415138c-b7f7-4613-b0d4-b2995d9cf00b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:20.399935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3415138c-b7f7-4613-b0d4-b2995d9cf00b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:20.630924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-32108be5-056a-4a0f-bd35-11c147bdfaff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:20.633194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-32108be5-056a-4a0f-bd35-11c147bdfaff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:20.647983 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-32108be5-056a-4a0f-bd35-11c147bdfaff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:20.649019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-32108be5-056a-4a0f-bd35-11c147bdfaff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:20.651200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-32108be5-056a-4a0f-bd35-11c147bdfaff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:20.652240 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-32108be5-056a-4a0f-bd35-11c147bdfaff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:20.809074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3415138c-b7f7-4613-b0d4-b2995d9cf00b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:20.817742 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3415138c-b7f7-4613-b0d4-b2995d9cf00b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1307 microversion: 2.1 time: 0.460785 Jul 28 03:41:20.819077 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 663/1286] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:20 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1307 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:20.824797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-353a6ae8-6678-490f-80af-731a349d7d6b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:20.825689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-353a6ae8-6678-490f-80af-731a349d7d6b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:20.833455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-353a6ae8-6678-490f-80af-731a349d7d6b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:20.834698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-353a6ae8-6678-490f-80af-731a349d7d6b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:20.836033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-353a6ae8-6678-490f-80af-731a349d7d6b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:20.837304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-353a6ae8-6678-490f-80af-731a349d7d6b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:20.984170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-32108be5-056a-4a0f-bd35-11c147bdfaff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:20.994895 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-32108be5-056a-4a0f-bd35-11c147bdfaff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:20.997824 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-32108be5-056a-4a0f-bd35-11c147bdfaff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:20.997824 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-32108be5-056a-4a0f-bd35-11c147bdfaff tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.374841 Jul 28 03:41:20.998531 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 624/1287] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:20 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:41:21.004108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-80800c79-6f92-4f80-aa28-aad7c554d8cc tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:21.004971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-80800c79-6f92-4f80-aa28-aad7c554d8cc tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:21.013070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-80800c79-6f92-4f80-aa28-aad7c554d8cc tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:21.013555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-80800c79-6f92-4f80-aa28-aad7c554d8cc tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:21.014869 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-80800c79-6f92-4f80-aa28-aad7c554d8cc tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:21.015618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-80800c79-6f92-4f80-aa28-aad7c554d8cc tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:21.111556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-353a6ae8-6678-490f-80af-731a349d7d6b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:21.125250 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-353a6ae8-6678-490f-80af-731a349d7d6b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 200 len: 1367 microversion: 2.1 time: 0.303575 Jul 28 03:41:21.126280 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 664/1288] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:20 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:21.130446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-80800c79-6f92-4f80-aa28-aad7c554d8cc tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:21.144469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b840f646-e21e-4ed9-9843-7a0a46ac2717 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:21.144980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b840f646-e21e-4ed9-9843-7a0a46ac2717 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:21.146639 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-80800c79-6f92-4f80-aa28-aad7c554d8cc tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1219 microversion: 2.1 time: 0.147001 Jul 28 03:41:21.161139 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 625/1289] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:20 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:21.161139 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-74dbda3f-62f8-46e6-aea3-3408f93269fc req-fc1f1adb-1c91-4a0a-81ab-2c113e35d4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcbae58d-a326-4197-a350-9278d664d3e7", "name": "network-vif-unplugged", "status": "completed", "tag": "1c43a93b-de22-40be-a837-98a92e1f0f4c"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:21.161452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b840f646-e21e-4ed9-9843-7a0a46ac2717 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:21.161452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b840f646-e21e-4ed9-9843-7a0a46ac2717 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:21.161452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b840f646-e21e-4ed9-9843-7a0a46ac2717 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:21.161452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b840f646-e21e-4ed9-9843-7a0a46ac2717 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:21.177135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-74dbda3f-62f8-46e6-aea3-3408f93269fc req-fc1f1adb-1c91-4a0a-81ab-2c113e35d4c6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:21.177592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-74dbda3f-62f8-46e6-aea3-3408f93269fc req-fc1f1adb-1c91-4a0a-81ab-2c113e35d4c6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:21.200498 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-74dbda3f-62f8-46e6-aea3-3408f93269fc req-fc1f1adb-1c91-4a0a-81ab-2c113e35d4c6 service nova] Creating event network-vif-unplugged:1c43a93b-de22-40be-a837-98a92e1f0f4c for instance fcbae58d-a326-4197-a350-9278d664d3e7 on n-h1-826756-3 Jul 28 03:41:21.219814 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-74dbda3f-62f8-46e6-aea3-3408f93269fc req-fc1f1adb-1c91-4a0a-81ab-2c113e35d4c6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070130 Jul 28 03:41:21.222036 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 626/1290] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:21.252045 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e8b32155-6da1-4e33-bd3b-8eef80cb2547 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:21.252854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e8b32155-6da1-4e33-bd3b-8eef80cb2547 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:21.260153 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e8b32155-6da1-4e33-bd3b-8eef80cb2547 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:21.260663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e8b32155-6da1-4e33-bd3b-8eef80cb2547 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:21.261498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e8b32155-6da1-4e33-bd3b-8eef80cb2547 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:21.261901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e8b32155-6da1-4e33-bd3b-8eef80cb2547 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:21.532249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e8b32155-6da1-4e33-bd3b-8eef80cb2547 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:21.554877 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e8b32155-6da1-4e33-bd3b-8eef80cb2547 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1469 microversion: 2.1 time: 0.311109 Jul 28 03:41:21.562052 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 627/1291] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:21 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1469 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:21.575345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b840f646-e21e-4ed9-9843-7a0a46ac2717 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:21.576934 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dd751412-7239-441e-813a-609bff7e7f94 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:21.577800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dd751412-7239-441e-813a-609bff7e7f94 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:21.592849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd751412-7239-441e-813a-609bff7e7f94 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:21.596795 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd751412-7239-441e-813a-609bff7e7f94 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:21.597037 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b840f646-e21e-4ed9-9843-7a0a46ac2717 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.469151 Jul 28 03:41:21.601369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd751412-7239-441e-813a-609bff7e7f94 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:21.603174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd751412-7239-441e-813a-609bff7e7f94 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:21.615771 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 665/1292] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:21 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:21.854315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7ffd03dc-472f-467f-9e45-acaa51cb6702 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:21.855133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7ffd03dc-472f-467f-9e45-acaa51cb6702 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:21.882305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ffd03dc-472f-467f-9e45-acaa51cb6702 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:21.882904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ffd03dc-472f-467f-9e45-acaa51cb6702 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:21.884300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ffd03dc-472f-467f-9e45-acaa51cb6702 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:21.884777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ffd03dc-472f-467f-9e45-acaa51cb6702 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:22.074071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dd751412-7239-441e-813a-609bff7e7f94 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:22.094213 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dd751412-7239-441e-813a-609bff7e7f94 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1459 microversion: 2.1 time: 0.526029 Jul 28 03:41:22.094920 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 628/1293] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:21 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1459 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:22.115618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-322ec662-a77a-4082-98a2-69b98ebf26bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:22.117161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-322ec662-a77a-4082-98a2-69b98ebf26bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:22.132693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-322ec662-a77a-4082-98a2-69b98ebf26bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:22.133463 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-322ec662-a77a-4082-98a2-69b98ebf26bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:22.135008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-322ec662-a77a-4082-98a2-69b98ebf26bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:22.135882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-322ec662-a77a-4082-98a2-69b98ebf26bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:22.295951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7ffd03dc-472f-467f-9e45-acaa51cb6702 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:22.306508 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7ffd03dc-472f-467f-9e45-acaa51cb6702 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1307 microversion: 2.1 time: 0.458701 Jul 28 03:41:22.307102 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 666/1294] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:21 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1307 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:41:22.313107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-345a682b-0162-43d6-a8a7-f7d7f9ea2e44 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:22.314150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-345a682b-0162-43d6-a8a7-f7d7f9ea2e44 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:22.340158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-345a682b-0162-43d6-a8a7-f7d7f9ea2e44 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:22.340897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-345a682b-0162-43d6-a8a7-f7d7f9ea2e44 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:22.342253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-345a682b-0162-43d6-a8a7-f7d7f9ea2e44 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:22.343711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-345a682b-0162-43d6-a8a7-f7d7f9ea2e44 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:22.356343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:22.778961 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-322ec662-a77a-4082-98a2-69b98ebf26bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:22.826166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-322ec662-a77a-4082-98a2-69b98ebf26bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:22.838046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-322ec662-a77a-4082-98a2-69b98ebf26bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:22.843815 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-322ec662-a77a-4082-98a2-69b98ebf26bb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.745495 Jul 28 03:41:22.846249 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 629/1295] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:22 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:22.882775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-456970c3-420c-4985-92c4-86dd9289ac2e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:22.887283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-456970c3-420c-4985-92c4-86dd9289ac2e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:22.917216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-456970c3-420c-4985-92c4-86dd9289ac2e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:22.918073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-456970c3-420c-4985-92c4-86dd9289ac2e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:22.919633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-456970c3-420c-4985-92c4-86dd9289ac2e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:22.920566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-456970c3-420c-4985-92c4-86dd9289ac2e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:23.093104 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-345a682b-0162-43d6-a8a7-f7d7f9ea2e44 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1610 microversion: 2.1 time: 0.783818 Jul 28 03:41:23.093982 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 667/1296] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:22 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1610 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:23.116258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e66f5e9c-8214-46ad-bf7a-e3041cacd87b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:23.120888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e66f5e9c-8214-46ad-bf7a-e3041cacd87b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:23.139655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e66f5e9c-8214-46ad-bf7a-e3041cacd87b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:23.140314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e66f5e9c-8214-46ad-bf7a-e3041cacd87b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:23.144619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e66f5e9c-8214-46ad-bf7a-e3041cacd87b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:23.145182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e66f5e9c-8214-46ad-bf7a-e3041cacd87b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:23.252011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e66f5e9c-8214-46ad-bf7a-e3041cacd87b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:23.263100 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e66f5e9c-8214-46ad-bf7a-e3041cacd87b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1273 microversion: 2.1 time: 0.153011 Jul 28 03:41:23.264770 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 668/1297] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:23 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:23.272961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf6c9da1-fb8a-42e0-a286-7dfb20efe243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:23.273842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cf6c9da1-fb8a-42e0-a286-7dfb20efe243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:23.280342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf6c9da1-fb8a-42e0-a286-7dfb20efe243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:23.281557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf6c9da1-fb8a-42e0-a286-7dfb20efe243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:23.282922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf6c9da1-fb8a-42e0-a286-7dfb20efe243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:23.283517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf6c9da1-fb8a-42e0-a286-7dfb20efe243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:23.348418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-456970c3-420c-4985-92c4-86dd9289ac2e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:23.355389 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-456970c3-420c-4985-92c4-86dd9289ac2e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 200 len: 1367 microversion: 2.1 time: 0.491373 Jul 28 03:41:23.380794 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 630/1298] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:22 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 1367 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:23.386446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-06376b91-c5b7-498a-9968-44fea3f0cc3a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:23.387446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-06376b91-c5b7-498a-9968-44fea3f0cc3a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:23.408606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06376b91-c5b7-498a-9968-44fea3f0cc3a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:23.409898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06376b91-c5b7-498a-9968-44fea3f0cc3a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:23.411636 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06376b91-c5b7-498a-9968-44fea3f0cc3a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:23.412837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06376b91-c5b7-498a-9968-44fea3f0cc3a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:23.686625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf6c9da1-fb8a-42e0-a286-7dfb20efe243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:23.696091 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf6c9da1-fb8a-42e0-a286-7dfb20efe243 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 200 len: 1469 microversion: 2.1 time: 0.429734 Jul 28 03:41:23.712173 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 669/1299] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:23 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 1469 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:23.724710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e06f84e2-736f-47a1-ac11-fed209a74746 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:23.729976 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:41:23.729976 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:41:23.732306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e06f84e2-736f-47a1-ac11-fed209a74746 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:23.732879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e06f84e2-736f-47a1-ac11-fed209a74746 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:23.734776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e06f84e2-736f-47a1-ac11-fed209a74746 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:23.735479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e06f84e2-736f-47a1-ac11-fed209a74746 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:23.782940 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e06f84e2-736f-47a1-ac11-fed209a74746 tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.068371 Jul 28 03:41:23.784533 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 670/1300] 10.222.0.48 () {58 vars in 1176 bytes} [Thu Jul 28 03:41:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:23.795779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0fd55921-1515-4fc1-8da1-b2a70c6f3288 req-65911710-b47b-48b6-8d6b-c7a3d1317601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcbae58d-a326-4197-a350-9278d664d3e7", "tag": "1c43a93b-de22-40be-a837-98a92e1f0f4c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:23.810693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0fd55921-1515-4fc1-8da1-b2a70c6f3288 req-65911710-b47b-48b6-8d6b-c7a3d1317601 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:23.814835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0fd55921-1515-4fc1-8da1-b2a70c6f3288 req-65911710-b47b-48b6-8d6b-c7a3d1317601 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:23.855246 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0fd55921-1515-4fc1-8da1-b2a70c6f3288 req-65911710-b47b-48b6-8d6b-c7a3d1317601 service nova] Creating event network-changed:1c43a93b-de22-40be-a837-98a92e1f0f4c for instance fcbae58d-a326-4197-a350-9278d664d3e7 on n-h1-826756-3 Jul 28 03:41:23.881866 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0fd55921-1515-4fc1-8da1-b2a70c6f3288 req-65911710-b47b-48b6-8d6b-c7a3d1317601 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090304 Jul 28 03:41:23.887164 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 671/1301] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:23.915302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-96b3d7d1-8d75-4d6a-b9d2-bfcca78133a9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:23.918620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-96b3d7d1-8d75-4d6a-b9d2-bfcca78133a9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:23.960128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96b3d7d1-8d75-4d6a-b9d2-bfcca78133a9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:23.964952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96b3d7d1-8d75-4d6a-b9d2-bfcca78133a9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:23.968877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96b3d7d1-8d75-4d6a-b9d2-bfcca78133a9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:23.973042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96b3d7d1-8d75-4d6a-b9d2-bfcca78133a9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:24.234902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-06376b91-c5b7-498a-9968-44fea3f0cc3a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:24.253435 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-06376b91-c5b7-498a-9968-44fea3f0cc3a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.869769 Jul 28 03:41:24.254138 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 631/1302] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:23 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:24.269087 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4a16be31-de99-4b74-9fac-c33f9c01842d tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-826756-3", "block_migration": true, "disk_over_commit": false}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:24.276638 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4a16be31-de99-4b74-9fac-c33f9c01842d tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:24.289225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a16be31-de99-4b74-9fac-c33f9c01842d tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:24.295771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a16be31-de99-4b74-9fac-c33f9c01842d tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:24.297694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a16be31-de99-4b74-9fac-c33f9c01842d tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:24.298377 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a16be31-de99-4b74-9fac-c33f9c01842d tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:24.365255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-4a16be31-de99-4b74-9fac-c33f9c01842d tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Lazy-loading 'flavor' on Instance uuid c76cd273-b14b-410b-b0c1-2379d46988ad {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:41:24.391052 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-4a16be31-de99-4b74-9fac-c33f9c01842d tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance c76cd273-b14b-410b-b0c1-2379d46988ad while it is in vm_state suspended Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4a16be31-de99-4b74-9fac-c33f9c01842d tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Request method failure captured: Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad/action HTTP/1.1 Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 97 Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gUmrORWb_LIvjFwY2W0eBrMYV1jmecivJZBxctUJBX16mroca7h9W1-pb-tk4eXatAOuGevrgALE4IkXQO5ti9G0kOoAawRVpA6t7u8JfC1Fdh-H8QBE86cqagib7khqdrVKA3LBiLUj70b0avkWoNw8cPZHxJAMtEE7Max8niwpYo Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 558b76842b8c40a8be26926aa907ed86 Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-LiveMigrationNegativeTest-1573568951 Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:41:24.394412 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:41:24.396102 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/558b76842b8c40a8be26926aa907ed86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/558b76842b8c40a8be26926aa907ed86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_558b76842b8c40a8be26926aa907ed86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/558b76842b8c40a8be26926aa907ed86"}]}] Jul 28 03:41:24.396102 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-LiveMigrationNegativeTest-1573568951 Jul 28 03:41:24.396102 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 558b76842b8c40a8be26926aa907ed86 Jul 28 03:41:24.396102 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1573568951 Jul 28 03:41:24.396102 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-LiveMigrationNegativeTest-1573568951-project-admin Jul 28 03:41:24.396102 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:41:24.396102 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:41:24.396102 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: e842412e62da4a2a8c25d2a2989254e5 Jul 28 03:41:24.396102 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-LiveMigrationNegativeTest-1573568951-project-admin Jul 28 03:41:24.396102 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:41:24.396102 n-d-826756-3 devstack@n-api.service[126072]: {"os-migrateLive": {"host": "n-h1-826756-3", "block_migration": true, "disk_over_commit": false}} Jul 28 03:41:24.396102 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: exception: Cannot 'os-migrateLive' instance c76cd273-b14b-410b-b0c1-2379d46988ad while it is in vm_state suspended Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'c76cd273-b14b-410b-b0c1-2379d46988ad', 'body': {'os-migrateLive': {'host': 'n-h1-826756-3', 'block_migration': True, 'disk_over_commit': False}}} Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 376, in inner Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 276, in inner Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 257, in inner Jul 28 03:41:24.397271 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c76cd273-b14b-410b-b0c1-2379d46988ad in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:41:24.398455 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance c76cd273-b14b-410b-b0c1-2379d46988ad while it is in vm_state suspended Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance c76cd273-b14b-410b-b0c1-2379d46988ad while it is in vm_state suspended Jul 28 03:41:24.399744 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:24.402132 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4a16be31-de99-4b74-9fac-c33f9c01842d tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance c76cd273-b14b-410b-b0c1-2379d46988ad while it is in vm_state suspended {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:41:24.402132 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4a16be31-de99-4b74-9fac-c33f9c01842d tempest-LiveMigrationNegativeTest-1573568951 tempest-LiveMigrationNegativeTest-1573568951-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad/action" status: 409 len: 155 microversion: 2.1 time: 0.138208 Jul 28 03:41:24.402132 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 632/1303] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:24 2022] POST /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad/action => generated 155 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:41:24.408130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a01f6978-f938-4cdf-a41b-6db28ae8f76f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:24.408772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a01f6978-f938-4cdf-a41b-6db28ae8f76f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:24.429663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a01f6978-f938-4cdf-a41b-6db28ae8f76f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:24.430130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a01f6978-f938-4cdf-a41b-6db28ae8f76f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:24.430986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a01f6978-f938-4cdf-a41b-6db28ae8f76f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:24.432389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a01f6978-f938-4cdf-a41b-6db28ae8f76f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:24.704926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-96b3d7d1-8d75-4d6a-b9d2-bfcca78133a9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:24.733709 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-96b3d7d1-8d75-4d6a-b9d2-bfcca78133a9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1307 microversion: 2.1 time: 0.843330 Jul 28 03:41:24.735414 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 672/1304] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:23 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1307 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:24.759939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f19af444-beb9-469a-87d9-dea1196137e9 req-bd41627f-73c6-4f3e-9f1a-8798924cb8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52043e72-36dc-4a60-aaf8-f8a40ebf2f1f", "name": "network-vif-deleted", "tag": "6dc794f8-4acd-49fc-8b8a-c67699e6bba0"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:24.796727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f19af444-beb9-469a-87d9-dea1196137e9 req-bd41627f-73c6-4f3e-9f1a-8798924cb8cb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:24.797483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f19af444-beb9-469a-87d9-dea1196137e9 req-bd41627f-73c6-4f3e-9f1a-8798924cb8cb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:24.885421 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f19af444-beb9-469a-87d9-dea1196137e9 req-bd41627f-73c6-4f3e-9f1a-8798924cb8cb service nova] Creating event network-vif-deleted:6dc794f8-4acd-49fc-8b8a-c67699e6bba0 for instance 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f on n-h1-826756-3 Jul 28 03:41:24.914987 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f19af444-beb9-469a-87d9-dea1196137e9 req-bd41627f-73c6-4f3e-9f1a-8798924cb8cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161459 Jul 28 03:41:24.921730 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 673/1305] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:24.939351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93feebe9-3d5e-48ef-b992-7aa12ab582c5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:24.941720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93feebe9-3d5e-48ef-b992-7aa12ab582c5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:24.975485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93feebe9-3d5e-48ef-b992-7aa12ab582c5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:24.981295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93feebe9-3d5e-48ef-b992-7aa12ab582c5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:24.987001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93feebe9-3d5e-48ef-b992-7aa12ab582c5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:24.990126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93feebe9-3d5e-48ef-b992-7aa12ab582c5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:25.170589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93feebe9-3d5e-48ef-b992-7aa12ab582c5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:25.191849 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93feebe9-3d5e-48ef-b992-7aa12ab582c5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1273 microversion: 2.1 time: 0.265373 Jul 28 03:41:25.192866 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 674/1306] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:24 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:25.204728 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a01f6978-f938-4cdf-a41b-6db28ae8f76f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:25.220904 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a01f6978-f938-4cdf-a41b-6db28ae8f76f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:25.222619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a01f6978-f938-4cdf-a41b-6db28ae8f76f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:25.223859 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a01f6978-f938-4cdf-a41b-6db28ae8f76f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.820725 Jul 28 03:41:25.224436 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 633/1307] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:24 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:25.230056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4ef2decb-3fb3-4487-b64e-fa009529c358 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:25.230813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4ef2decb-3fb3-4487-b64e-fa009529c358 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:25.238245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ef2decb-3fb3-4487-b64e-fa009529c358 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:25.238691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ef2decb-3fb3-4487-b64e-fa009529c358 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:25.239483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ef2decb-3fb3-4487-b64e-fa009529c358 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:25.239912 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ef2decb-3fb3-4487-b64e-fa009529c358 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:25.241783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a9a18fe4-eeea-4b9a-bc40-ad53924ad363 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:25.243313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a9a18fe4-eeea-4b9a-bc40-ad53924ad363 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:25.253760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9a18fe4-eeea-4b9a-bc40-ad53924ad363 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:25.257486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9a18fe4-eeea-4b9a-bc40-ad53924ad363 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:25.259362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9a18fe4-eeea-4b9a-bc40-ad53924ad363 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:25.260408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9a18fe4-eeea-4b9a-bc40-ad53924ad363 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:25.292045 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4ef2decb-3fb3-4487-b64e-fa009529c358 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:41:25.433355 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4ef2decb-3fb3-4487-b64e-fa009529c358 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 204 len: 0 microversion: 2.1 time: 0.206669 Jul 28 03:41:25.436405 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 634/1308] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:41:25 2022] DELETE /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:25.454952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39d68115-72ce-4e9f-8131-649ed92b8bd8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:25.459211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-39d68115-72ce-4e9f-8131-649ed92b8bd8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:25.474397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39d68115-72ce-4e9f-8131-649ed92b8bd8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:25.475584 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39d68115-72ce-4e9f-8131-649ed92b8bd8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:25.477730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39d68115-72ce-4e9f-8131-649ed92b8bd8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:25.480105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39d68115-72ce-4e9f-8131-649ed92b8bd8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:25.513470 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-39d68115-72ce-4e9f-8131-649ed92b8bd8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] HTTP exception thrown: Instance 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f could not be found. Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39d68115-72ce-4e9f-8131-649ed92b8bd8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Request method failure captured: Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f HTTP/1.1 Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gS_iXcihX0o4gYoKIokTvXGU_Ilt0CRjXC97ktUkU756klUyqJCnv9VnRS7_uHOtrepoIhbsKyl5Z54Bvt23q9_klJBkvptIVIVwaTbcLWonWYLH7o_julm0C_2HeGuTNQ3DoAziyP3vC5nr3WWqPI1HPMyZmN44ID0VtdqgMYEN34 Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 73bbf29c8c7f4f3385717d49ff9fe5f4 Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersAdminTestJSON-2140037471 Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:41:25.518490 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:41:25.521849 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73bbf29c8c7f4f3385717d49ff9fe5f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bbf29c8c7f4f3385717d49ff9fe5f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73bbf29c8c7f4f3385717d49ff9fe5f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bbf29c8c7f4f3385717d49ff9fe5f4"}]}] Jul 28 03:41:25.521849 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersAdminTestJSON-2140037471 Jul 28 03:41:25.521849 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 73bbf29c8c7f4f3385717d49ff9fe5f4 Jul 28 03:41:25.521849 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersAdminTestJSON-2140037471 Jul 28 03:41:25.521849 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersAdminTestJSON-2140037471-project Jul 28 03:41:25.521849 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:41:25.521849 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:41:25.521849 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: b4eff140fd7d4ec0ae9fe1a851d272e2 Jul 28 03:41:25.521849 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersAdminTestJSON-2140037471-project Jul 28 03:41:25.521849 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:41:25.521849 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f could not be found. Jul 28 03:41:25.521849 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '52043e72-36dc-4a60-aaf8-f8a40ebf2f1f'} Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f could not be found. Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:41:25.523573 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f could not be found. Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f could not be found. Jul 28 03:41:25.526823 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:25.532881 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39d68115-72ce-4e9f-8131-649ed92b8bd8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Returning 404 to user: Instance 52043e72-36dc-4a60-aaf8-f8a40ebf2f1f could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:41:25.534854 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-39d68115-72ce-4e9f-8131-649ed92b8bd8 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f" status: 404 len: 111 microversion: 2.1 time: 0.095038 Jul 28 03:41:25.537778 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 635/1309] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:25 2022] GET /compute/v2.1/servers/52043e72-36dc-4a60-aaf8-f8a40ebf2f1f => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:41:25.547117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-947edc6b-2875-42f6-9b47-3f7960d63218 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:25.549053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-947edc6b-2875-42f6-9b47-3f7960d63218 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:25.558518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-947edc6b-2875-42f6-9b47-3f7960d63218 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:25.559385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-947edc6b-2875-42f6-9b47-3f7960d63218 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:25.561246 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-947edc6b-2875-42f6-9b47-3f7960d63218 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:25.562744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-947edc6b-2875-42f6-9b47-3f7960d63218 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:25.623803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a9a18fe4-eeea-4b9a-bc40-ad53924ad363 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:25.634513 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a9a18fe4-eeea-4b9a-bc40-ad53924ad363 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 200 len: 1555 microversion: 2.1 time: 0.414351 Jul 28 03:41:25.636141 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 675/1310] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:25 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 1555 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:25.641815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b6cd4bb-4290-4923-941d-8f12ff2a3801 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:25.642764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b6cd4bb-4290-4923-941d-8f12ff2a3801 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:25.653420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b6cd4bb-4290-4923-941d-8f12ff2a3801 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:25.654139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b6cd4bb-4290-4923-941d-8f12ff2a3801 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:25.655487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b6cd4bb-4290-4923-941d-8f12ff2a3801 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:25.656109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b6cd4bb-4290-4923-941d-8f12ff2a3801 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:26.014706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7b6cd4bb-4290-4923-941d-8f12ff2a3801 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:26.026956 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b6cd4bb-4290-4923-941d-8f12ff2a3801 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1465 microversion: 2.1 time: 0.389175 Jul 28 03:41:26.030300 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 676/1311] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:25 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1465 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:26.044651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2854543e-cc25-4f71-96d0-af6559b23258 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:26.045526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2854543e-cc25-4f71-96d0-af6559b23258 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:26.078411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2854543e-cc25-4f71-96d0-af6559b23258 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:26.079189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2854543e-cc25-4f71-96d0-af6559b23258 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:26.082854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2854543e-cc25-4f71-96d0-af6559b23258 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:26.085151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2854543e-cc25-4f71-96d0-af6559b23258 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:26.103826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-947edc6b-2875-42f6-9b47-3f7960d63218 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:26.129363 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-947edc6b-2875-42f6-9b47-3f7960d63218 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.578493 Jul 28 03:41:26.130723 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 636/1312] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:25 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:26.143742 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-33273f9e-05a5-43d8-96ba-fddd2896f81a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:26.145014 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-33273f9e-05a5-43d8-96ba-fddd2896f81a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:26.170890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33273f9e-05a5-43d8-96ba-fddd2896f81a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:26.171863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33273f9e-05a5-43d8-96ba-fddd2896f81a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:26.178041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33273f9e-05a5-43d8-96ba-fddd2896f81a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:26.179158 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33273f9e-05a5-43d8-96ba-fddd2896f81a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:26.193887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2854543e-cc25-4f71-96d0-af6559b23258 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:41:26.350469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:26.409340 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2854543e-cc25-4f71-96d0-af6559b23258 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "DELETE /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 204 len: 0 microversion: 2.1 time: 0.372361 Jul 28 03:41:26.416937 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 677/1313] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:41:26 2022] DELETE /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:26.432532 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-33273f9e-05a5-43d8-96ba-fddd2896f81a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.300063 Jul 28 03:41:26.433114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2a42cf77-b0cc-4058-bef3-0505bce95fb0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:26.440685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2a42cf77-b0cc-4058-bef3-0505bce95fb0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:26.441688 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 637/1314] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:41:26 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-interface => generated 284 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:26.447611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-9bd90457-0b36-44e7-85b1-4d4a18cd0deb req-f27ed86e-c59d-4df4-88ad-c99d981167ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf954030-af98-4832-a28a-03cf2a3fe8c9", "name": "network-vif-plugged", "status": "completed", "tag": "bf305f0a-27a2-4078-b918-f102991b6796"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:26.472531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a42cf77-b0cc-4058-bef3-0505bce95fb0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:26.476237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a42cf77-b0cc-4058-bef3-0505bce95fb0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:26.478600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9bd90457-0b36-44e7-85b1-4d4a18cd0deb req-f27ed86e-c59d-4df4-88ad-c99d981167ce service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:26.479836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9bd90457-0b36-44e7-85b1-4d4a18cd0deb req-f27ed86e-c59d-4df4-88ad-c99d981167ce service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:26.484322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a42cf77-b0cc-4058-bef3-0505bce95fb0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:26.485084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a42cf77-b0cc-4058-bef3-0505bce95fb0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:26.525226 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-9bd90457-0b36-44e7-85b1-4d4a18cd0deb req-f27ed86e-c59d-4df4-88ad-c99d981167ce service nova] Creating event network-vif-plugged:bf305f0a-27a2-4078-b918-f102991b6796 for instance bf954030-af98-4832-a28a-03cf2a3fe8c9 on n-h1-826756-3 Jul 28 03:41:26.550805 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-9bd90457-0b36-44e7-85b1-4d4a18cd0deb req-f27ed86e-c59d-4df4-88ad-c99d981167ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106899 Jul 28 03:41:26.552071 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 638/1315] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:26.570754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-76b4501a-b3bb-45fa-b61e-9fb87804c7be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:26.571748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-76b4501a-b3bb-45fa-b61e-9fb87804c7be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:26.587260 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76b4501a-b3bb-45fa-b61e-9fb87804c7be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:26.593490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76b4501a-b3bb-45fa-b61e-9fb87804c7be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:26.594784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76b4501a-b3bb-45fa-b61e-9fb87804c7be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:26.595439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76b4501a-b3bb-45fa-b61e-9fb87804c7be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:27.142785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2a42cf77-b0cc-4058-bef3-0505bce95fb0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:27.154294 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2a42cf77-b0cc-4058-bef3-0505bce95fb0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1307 microversion: 2.1 time: 0.734955 Jul 28 03:41:27.169725 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 678/1316] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:26 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1307 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:27.178194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4db0a055-cbab-4b3d-86ff-71fdfbebdd78 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:27.179646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4db0a055-cbab-4b3d-86ff-71fdfbebdd78 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:27.190498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4db0a055-cbab-4b3d-86ff-71fdfbebdd78 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:27.191499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4db0a055-cbab-4b3d-86ff-71fdfbebdd78 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:27.192747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4db0a055-cbab-4b3d-86ff-71fdfbebdd78 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:27.193461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4db0a055-cbab-4b3d-86ff-71fdfbebdd78 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:27.271740 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-76b4501a-b3bb-45fa-b61e-9fb87804c7be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:27.289987 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-76b4501a-b3bb-45fa-b61e-9fb87804c7be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1315 microversion: 2.1 time: 0.736028 Jul 28 03:41:27.305815 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 639/1317] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:26 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:27.322966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c3ed5f28-8e45-41f9-b956-691ae6563e17 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:27.323943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c3ed5f28-8e45-41f9-b956-691ae6563e17 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:27.343006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3ed5f28-8e45-41f9-b956-691ae6563e17 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:27.344160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3ed5f28-8e45-41f9-b956-691ae6563e17 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:27.345621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3ed5f28-8e45-41f9-b956-691ae6563e17 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:27.346397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3ed5f28-8e45-41f9-b956-691ae6563e17 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:27.635943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c3ed5f28-8e45-41f9-b956-691ae6563e17 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:27.639705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:27.646229 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c3ed5f28-8e45-41f9-b956-691ae6563e17 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1469 microversion: 2.1 time: 0.338614 Jul 28 03:41:27.661736 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 640/1318] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:27 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1469 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:27.667388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-145d8fa9-5e88-4e66-af01-667cce9f08a2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:27.668270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-145d8fa9-5e88-4e66-af01-667cce9f08a2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:27.676513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-145d8fa9-5e88-4e66-af01-667cce9f08a2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:27.677335 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-145d8fa9-5e88-4e66-af01-667cce9f08a2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:27.678395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-145d8fa9-5e88-4e66-af01-667cce9f08a2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:27.679071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-145d8fa9-5e88-4e66-af01-667cce9f08a2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:27.731279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4db0a055-cbab-4b3d-86ff-71fdfbebdd78 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:27.745603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4db0a055-cbab-4b3d-86ff-71fdfbebdd78 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:27.747163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4db0a055-cbab-4b3d-86ff-71fdfbebdd78 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:27.751858 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4db0a055-cbab-4b3d-86ff-71fdfbebdd78 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.580068 Jul 28 03:41:27.772455 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 679/1319] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:27 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:27.777947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-87cbdd43-1996-4152-9c5a-a728fbdd1133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:27.778591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-87cbdd43-1996-4152-9c5a-a728fbdd1133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:27.787239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87cbdd43-1996-4152-9c5a-a728fbdd1133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:27.787722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87cbdd43-1996-4152-9c5a-a728fbdd1133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:27.788586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87cbdd43-1996-4152-9c5a-a728fbdd1133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:27.789036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87cbdd43-1996-4152-9c5a-a728fbdd1133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:28.347849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-87cbdd43-1996-4152-9c5a-a728fbdd1133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:28.362674 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-87cbdd43-1996-4152-9c5a-a728fbdd1133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.588914 Jul 28 03:41:28.363388 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 680/1320] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:27 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:28.380458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd46cb4b-a64a-4fa0-aa78-2d2084fd6885 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:28.380983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd46cb4b-a64a-4fa0-aa78-2d2084fd6885 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:28.396716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd46cb4b-a64a-4fa0-aa78-2d2084fd6885 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:28.397625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd46cb4b-a64a-4fa0-aa78-2d2084fd6885 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:28.399934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd46cb4b-a64a-4fa0-aa78-2d2084fd6885 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:28.401286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd46cb4b-a64a-4fa0-aa78-2d2084fd6885 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:28.413392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-145d8fa9-5e88-4e66-af01-667cce9f08a2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:28.427979 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-145d8fa9-5e88-4e66-af01-667cce9f08a2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1465 microversion: 2.1 time: 0.764327 Jul 28 03:41:28.441700 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 641/1321] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:27 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1465 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:28.450413 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b92d0c9e-8350-44e9-bca9-156d5e764adb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:28.463448 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b92d0c9e-8350-44e9-bca9-156d5e764adb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:28.486744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b92d0c9e-8350-44e9-bca9-156d5e764adb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:28.494663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b92d0c9e-8350-44e9-bca9-156d5e764adb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:28.501719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b92d0c9e-8350-44e9-bca9-156d5e764adb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:28.502666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b92d0c9e-8350-44e9-bca9-156d5e764adb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:28.695221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=14 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:29.177141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b92d0c9e-8350-44e9-bca9-156d5e764adb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:29.196607 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b92d0c9e-8350-44e9-bca9-156d5e764adb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1315 microversion: 2.1 time: 0.752952 Jul 28 03:41:29.201152 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 642/1322] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:28 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:29.206312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-466208a7-db11-4af4-9303-7a91b9d3c037 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:29.207000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-466208a7-db11-4af4-9303-7a91b9d3c037 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:29.229078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-466208a7-db11-4af4-9303-7a91b9d3c037 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:29.229977 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-466208a7-db11-4af4-9303-7a91b9d3c037 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:29.230531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-466208a7-db11-4af4-9303-7a91b9d3c037 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:29.232122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-466208a7-db11-4af4-9303-7a91b9d3c037 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:29.438575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dd46cb4b-a64a-4fa0-aa78-2d2084fd6885 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:29.457795 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd46cb4b-a64a-4fa0-aa78-2d2084fd6885 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1307 microversion: 2.1 time: 1.082123 Jul 28 03:41:29.459477 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 681/1323] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:28 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1307 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:29.467907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e09f8b1f-b96d-40a4-9176-972df7bcfe3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:29.468685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e09f8b1f-b96d-40a4-9176-972df7bcfe3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:29.477184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e09f8b1f-b96d-40a4-9176-972df7bcfe3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:29.478440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e09f8b1f-b96d-40a4-9176-972df7bcfe3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:29.492764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e09f8b1f-b96d-40a4-9176-972df7bcfe3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:29.494208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e09f8b1f-b96d-40a4-9176-972df7bcfe3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:29.593558 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-466208a7-db11-4af4-9303-7a91b9d3c037 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4eff140fd7d4ec0ae9fe1a851d272e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73bbf29c8c7f4f3385717d49ff9fe5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:29.609890 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-466208a7-db11-4af4-9303-7a91b9d3c037 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 200 len: 1469 microversion: 2.1 time: 0.407502 Jul 28 03:41:29.610789 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 643/1324] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:29 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 1469 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:29.622251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-efe2a604-e3a6-4f02-882a-0ac7871c4a5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:29.631774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-efe2a604-e3a6-4f02-882a-0ac7871c4a5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:29.646232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-efe2a604-e3a6-4f02-882a-0ac7871c4a5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:29.653937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-efe2a604-e3a6-4f02-882a-0ac7871c4a5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:29.655099 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-efe2a604-e3a6-4f02-882a-0ac7871c4a5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:29.656027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-efe2a604-e3a6-4f02-882a-0ac7871c4a5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:30.077526 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-efe2a604-e3a6-4f02-882a-0ac7871c4a5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:30.100246 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-efe2a604-e3a6-4f02-882a-0ac7871c4a5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.486681 Jul 28 03:41:30.108841 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 644/1325] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:29 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:30.130704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a021279e-e7b9-4577-9f6d-fa6376ded343 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:30.137359 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a021279e-e7b9-4577-9f6d-fa6376ded343 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:30.146883 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a021279e-e7b9-4577-9f6d-fa6376ded343 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:30.147713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a021279e-e7b9-4577-9f6d-fa6376ded343 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:30.148852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a021279e-e7b9-4577-9f6d-fa6376ded343 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:30.149692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a021279e-e7b9-4577-9f6d-fa6376ded343 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:30.390615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e09f8b1f-b96d-40a4-9176-972df7bcfe3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:30.424295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e09f8b1f-b96d-40a4-9176-972df7bcfe3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:30.431195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e09f8b1f-b96d-40a4-9176-972df7bcfe3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:30.439930 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e09f8b1f-b96d-40a4-9176-972df7bcfe3d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.971346 Jul 28 03:41:30.461149 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 682/1326] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:29 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:30.479342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a021279e-e7b9-4577-9f6d-fa6376ded343 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:30.495812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c0a80ca9-2b81-46ec-8a1e-dcb83eaa3151 req-4f08ddf4-cc86-4df4-b16d-7cd160d54650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b019cf-2b83-4fba-adf1-a5ffaf2faeab", "name": "network-vif-deleted", "tag": "d3aac98a-25aa-4c76-8c14-3b69b36b3eb6"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:30.500495 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a021279e-e7b9-4577-9f6d-fa6376ded343 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 200 len: 1423 microversion: 2.1 time: 0.384133 Jul 28 03:41:30.501816 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 645/1327] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:30 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 1423 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:30.515159 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c51049d3-ae8f-43ba-897b-8b5eee686a87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:30.515159 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c51049d3-ae8f-43ba-897b-8b5eee686a87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:30.560515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c0a80ca9-2b81-46ec-8a1e-dcb83eaa3151 req-4f08ddf4-cc86-4df4-b16d-7cd160d54650 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:30.560961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c0a80ca9-2b81-46ec-8a1e-dcb83eaa3151 req-4f08ddf4-cc86-4df4-b16d-7cd160d54650 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:30.573203 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c51049d3-ae8f-43ba-897b-8b5eee686a87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:30.581284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c51049d3-ae8f-43ba-897b-8b5eee686a87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:30.583490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c51049d3-ae8f-43ba-897b-8b5eee686a87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:30.583948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c51049d3-ae8f-43ba-897b-8b5eee686a87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:30.618501 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c0a80ca9-2b81-46ec-8a1e-dcb83eaa3151 req-4f08ddf4-cc86-4df4-b16d-7cd160d54650 service nova] Creating event network-vif-deleted:d3aac98a-25aa-4c76-8c14-3b69b36b3eb6 for instance 95b019cf-2b83-4fba-adf1-a5ffaf2faeab on n-h1-826756-3 Jul 28 03:41:30.634498 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c0a80ca9-2b81-46ec-8a1e-dcb83eaa3151 req-4f08ddf4-cc86-4df4-b16d-7cd160d54650 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165098 Jul 28 03:41:30.637657 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 683/1328] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:30.647798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-18f47a17-a283-4442-8316-e9b3a5fed316 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:30.658182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-18f47a17-a283-4442-8316-e9b3a5fed316 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:30.679677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18f47a17-a283-4442-8316-e9b3a5fed316 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:30.681413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18f47a17-a283-4442-8316-e9b3a5fed316 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:30.686680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18f47a17-a283-4442-8316-e9b3a5fed316 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:30.689688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18f47a17-a283-4442-8316-e9b3a5fed316 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:31.309210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c51049d3-ae8f-43ba-897b-8b5eee686a87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:31.326652 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c51049d3-ae8f-43ba-897b-8b5eee686a87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1315 microversion: 2.1 time: 0.823173 Jul 28 03:41:31.329096 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 646/1329] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:30 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:31.330694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-18f47a17-a283-4442-8316-e9b3a5fed316 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:31.335226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:31.339386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5a4faa3f-c061-47f9-a23a-1c85630e2545 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:31.340578 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5a4faa3f-c061-47f9-a23a-1c85630e2545 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] [instance: 95b019cf-2b83-4fba-adf1-a5ffaf2faeab] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:31.349920 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-18f47a17-a283-4442-8316-e9b3a5fed316 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1487 microversion: 2.1 time: 0.710526 Jul 28 03:41:31.352936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a4faa3f-c061-47f9-a23a-1c85630e2545 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:31.353530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a4faa3f-c061-47f9-a23a-1c85630e2545 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:31.356415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a4faa3f-c061-47f9-a23a-1c85630e2545 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:31.356415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a4faa3f-c061-47f9-a23a-1c85630e2545 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:31.363634 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 684/1330] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:30 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1487 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:31.375932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-108e46c8-a07d-4361-a15a-a77f2828c501 req-401132ca-cc0f-4368-915e-c20d842fd316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76cd273-b14b-410b-b0c1-2379d46988ad", "name": "network-vif-deleted", "tag": "fe6e0906-a74d-4d72-9706-2079c277e4ac"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:31.403720 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-5a4faa3f-c061-47f9-a23a-1c85630e2545 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] HTTP exception thrown: Instance 95b019cf-2b83-4fba-adf1-a5ffaf2faeab could not be found. Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5a4faa3f-c061-47f9-a23a-1c85630e2545 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Request method failure captured: Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab HTTP/1.1 Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gS_iXcihX0o4gYoKIokTvXGU_Ilt0CRjXC97ktUkU756klUyqJCnv9VnRS7_uHOtrepoIhbsKyl5Z54Bvt23q9_klJBkvptIVIVwaTbcLWonWYLH7o_julm0C_2HeGuTNQ3DoAziyP3vC5nr3WWqPI1HPMyZmN44ID0VtdqgMYEN34 Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 73bbf29c8c7f4f3385717d49ff9fe5f4 Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersAdminTestJSON-2140037471 Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:41:31.405804 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:41:31.408425 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/73bbf29c8c7f4f3385717d49ff9fe5f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bbf29c8c7f4f3385717d49ff9fe5f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_73bbf29c8c7f4f3385717d49ff9fe5f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/73bbf29c8c7f4f3385717d49ff9fe5f4"}]}] Jul 28 03:41:31.408425 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersAdminTestJSON-2140037471 Jul 28 03:41:31.408425 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 73bbf29c8c7f4f3385717d49ff9fe5f4 Jul 28 03:41:31.408425 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersAdminTestJSON-2140037471 Jul 28 03:41:31.408425 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersAdminTestJSON-2140037471-project Jul 28 03:41:31.408425 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:41:31.408425 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:41:31.408425 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: b4eff140fd7d4ec0ae9fe1a851d272e2 Jul 28 03:41:31.408425 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersAdminTestJSON-2140037471-project Jul 28 03:41:31.408425 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:41:31.408425 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 95b019cf-2b83-4fba-adf1-a5ffaf2faeab could not be found. Jul 28 03:41:31.408425 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '95b019cf-2b83-4fba-adf1-a5ffaf2faeab'} Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b019cf-2b83-4fba-adf1-a5ffaf2faeab could not be found. Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:41:31.409787 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b019cf-2b83-4fba-adf1-a5ffaf2faeab could not be found. Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b019cf-2b83-4fba-adf1-a5ffaf2faeab could not be found. Jul 28 03:41:31.412127 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:31.417963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5a4faa3f-c061-47f9-a23a-1c85630e2545 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] Returning 404 to user: Instance 95b019cf-2b83-4fba-adf1-a5ffaf2faeab could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:41:31.417963 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5a4faa3f-c061-47f9-a23a-1c85630e2545 tempest-ServersAdminTestJSON-2140037471 tempest-ServersAdminTestJSON-2140037471-project] 10.222.0.48 "GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab" status: 404 len: 111 microversion: 2.1 time: 0.086622 Jul 28 03:41:31.417963 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 647/1331] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:31 2022] GET /compute/v2.1/servers/95b019cf-2b83-4fba-adf1-a5ffaf2faeab => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:41:31.422850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-108e46c8-a07d-4361-a15a-a77f2828c501 req-401132ca-cc0f-4368-915e-c20d842fd316 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:31.424159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-108e46c8-a07d-4361-a15a-a77f2828c501 req-401132ca-cc0f-4368-915e-c20d842fd316 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:31.429479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3ba4652d-d324-4eb9-9a76-476753146014 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:31.432596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3ba4652d-d324-4eb9-9a76-476753146014 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:31.440473 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-108e46c8-a07d-4361-a15a-a77f2828c501 req-401132ca-cc0f-4368-915e-c20d842fd316 service nova] Creating event network-vif-deleted:fe6e0906-a74d-4d72-9706-2079c277e4ac for instance c76cd273-b14b-410b-b0c1-2379d46988ad on n-h2-826756-3 Jul 28 03:41:31.449095 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-108e46c8-a07d-4361-a15a-a77f2828c501 req-401132ca-cc0f-4368-915e-c20d842fd316 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081732 Jul 28 03:41:31.450594 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 685/1332] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:31.452004 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ba4652d-d324-4eb9-9a76-476753146014 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:31.452588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ba4652d-d324-4eb9-9a76-476753146014 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:31.453507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ba4652d-d324-4eb9-9a76-476753146014 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:31.453946 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ba4652d-d324-4eb9-9a76-476753146014 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:31.462172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0dcee582-f863-4174-9277-91369beefff7 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:31.471832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dcee582-f863-4174-9277-91369beefff7 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:31.472865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dcee582-f863-4174-9277-91369beefff7 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:31.912680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3ba4652d-d324-4eb9-9a76-476753146014 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:31.929248 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3ba4652d-d324-4eb9-9a76-476753146014 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.502587 Jul 28 03:41:31.932053 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 648/1333] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:31 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:31.942372 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-318f1229-96d9-4e23-bc13-1f2f5e9d7099 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:31.943229 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-318f1229-96d9-4e23-bc13-1f2f5e9d7099 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:31.979704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-318f1229-96d9-4e23-bc13-1f2f5e9d7099 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:31.982427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-318f1229-96d9-4e23-bc13-1f2f5e9d7099 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:31.983499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-318f1229-96d9-4e23-bc13-1f2f5e9d7099 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:31.985847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-318f1229-96d9-4e23-bc13-1f2f5e9d7099 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:32.154091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0dcee582-f863-4174-9277-91369beefff7 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Going to try to stop instance {{(pid=126071) force_stop /opt/stack/nova/nova/compute/api.py:2753}} Jul 28 03:41:32.280231 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0dcee582-f863-4174-9277-91369beefff7 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "POST /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9/action" status: 202 len: 0 microversion: 2.1 time: 0.827685 Jul 28 03:41:32.280922 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 686/1334] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:31 2022] POST /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9/action => generated 0 bytes in 829 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:41:32.299757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e9c13932-dac0-4ffd-b7e7-ae1681e7638b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:32.305174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e9c13932-dac0-4ffd-b7e7-ae1681e7638b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: c76cd273-b14b-410b-b0c1-2379d46988ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:32.320945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9c13932-dac0-4ffd-b7e7-ae1681e7638b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:32.321397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9c13932-dac0-4ffd-b7e7-ae1681e7638b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:32.322189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9c13932-dac0-4ffd-b7e7-ae1681e7638b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:32.322647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9c13932-dac0-4ffd-b7e7-ae1681e7638b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:32.355964 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e9c13932-dac0-4ffd-b7e7-ae1681e7638b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] HTTP exception thrown: Instance c76cd273-b14b-410b-b0c1-2379d46988ad could not be found. Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e9c13932-dac0-4ffd-b7e7-ae1681e7638b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Request method failure captured: Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad HTTP/1.1 Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gUlOBo-B2HhlIUt6q9MsP89JsYIu7OUihBPCv3RNLpPOrpLHclPbC8GOw3nKeaxF3PgqCvl9KXvyBCgE10I26XzuIkNbMOrgUfb_G2ZDo56PfRl0yOFK8if5XFJFWVmy7y2szpIO2mAxaboU8ZHA5JleoFNsc9ou21Rc2CimEwrXjM Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 4c78a01dfb2242a3bf66939666031eb9 Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-LiveMigrationNegativeTest-1481405521 Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:41:32.359574 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:41:32.361215 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c78a01dfb2242a3bf66939666031eb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c78a01dfb2242a3bf66939666031eb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c78a01dfb2242a3bf66939666031eb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c78a01dfb2242a3bf66939666031eb9"}]}] Jul 28 03:41:32.361215 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-LiveMigrationNegativeTest-1481405521 Jul 28 03:41:32.361215 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 4c78a01dfb2242a3bf66939666031eb9 Jul 28 03:41:32.361215 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1481405521 Jul 28 03:41:32.361215 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-LiveMigrationNegativeTest-1481405521-project Jul 28 03:41:32.361215 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:41:32.361215 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:41:32.361215 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: f6e8d4e8b898489a819618e4b3b97994 Jul 28 03:41:32.361215 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-LiveMigrationNegativeTest-1481405521-project Jul 28 03:41:32.361215 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:41:32.361215 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c76cd273-b14b-410b-b0c1-2379d46988ad could not be found. Jul 28 03:41:32.361215 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c76cd273-b14b-410b-b0c1-2379d46988ad'} Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76cd273-b14b-410b-b0c1-2379d46988ad could not be found. Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:41:32.362125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76cd273-b14b-410b-b0c1-2379d46988ad could not be found. Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76cd273-b14b-410b-b0c1-2379d46988ad could not be found. Jul 28 03:41:32.364665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:32.367382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e9c13932-dac0-4ffd-b7e7-ae1681e7638b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Returning 404 to user: Instance c76cd273-b14b-410b-b0c1-2379d46988ad could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:41:32.367382 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e9c13932-dac0-4ffd-b7e7-ae1681e7638b tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad" status: 404 len: 111 microversion: 2.1 time: 0.078945 Jul 28 03:41:32.367382 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 687/1335] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:32 2022] GET /compute/v2.1/servers/c76cd273-b14b-410b-b0c1-2379d46988ad => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:41:32.375414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c64dd4b-a042-4575-94fe-ca024ce0b0b6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:32.376042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c64dd4b-a042-4575-94fe-ca024ce0b0b6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:32.385140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c64dd4b-a042-4575-94fe-ca024ce0b0b6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:32.385622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c64dd4b-a042-4575-94fe-ca024ce0b0b6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:32.386602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c64dd4b-a042-4575-94fe-ca024ce0b0b6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:32.387045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c64dd4b-a042-4575-94fe-ca024ce0b0b6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:32.420939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-318f1229-96d9-4e23-bc13-1f2f5e9d7099 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:32.435969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-318f1229-96d9-4e23-bc13-1f2f5e9d7099 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:32.438004 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-318f1229-96d9-4e23-bc13-1f2f5e9d7099 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:32.443133 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-318f1229-96d9-4e23-bc13-1f2f5e9d7099 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.509579 Jul 28 03:41:32.449919 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 649/1336] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:31 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:32.460028 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-4c477f0d-ba6f-4906-a1f6-a18ba028913b req-7266fe35-abe3-4688-a9ff-b8efbde59a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcbae58d-a326-4197-a350-9278d664d3e7", "name": "network-vif-unplugged", "status": "completed", "tag": "1c43a93b-de22-40be-a837-98a92e1f0f4c"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:32.481189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4c477f0d-ba6f-4906-a1f6-a18ba028913b req-7266fe35-abe3-4688-a9ff-b8efbde59a81 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:32.486964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4c477f0d-ba6f-4906-a1f6-a18ba028913b req-7266fe35-abe3-4688-a9ff-b8efbde59a81 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:32.521526 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-4c477f0d-ba6f-4906-a1f6-a18ba028913b req-7266fe35-abe3-4688-a9ff-b8efbde59a81 service nova] Creating event network-vif-unplugged:1c43a93b-de22-40be-a837-98a92e1f0f4c for instance fcbae58d-a326-4197-a350-9278d664d3e7 on n-h1-826756-3 Jul 28 03:41:32.533361 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-4c477f0d-ba6f-4906-a1f6-a18ba028913b req-7266fe35-abe3-4688-a9ff-b8efbde59a81 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081514 Jul 28 03:41:32.536395 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 650/1337] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:32.549632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-66b475e6-2c68-495b-ac46-bb6af866313c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:32.550333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-66b475e6-2c68-495b-ac46-bb6af866313c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:32.566110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66b475e6-2c68-495b-ac46-bb6af866313c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:32.566661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66b475e6-2c68-495b-ac46-bb6af866313c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:32.573407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66b475e6-2c68-495b-ac46-bb6af866313c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:32.573863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66b475e6-2c68-495b-ac46-bb6af866313c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:32.684037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7c64dd4b-a042-4575-94fe-ca024ce0b0b6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:32.692616 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7c64dd4b-a042-4575-94fe-ca024ce0b0b6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.324674 Jul 28 03:41:32.696137 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 688/1338] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:32 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:32.710731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7cc7eb2b-a9ff-49b2-8d6a-7229154f8bf2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:32.711655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7cc7eb2b-a9ff-49b2-8d6a-7229154f8bf2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:32.724127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cc7eb2b-a9ff-49b2-8d6a-7229154f8bf2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:32.724630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cc7eb2b-a9ff-49b2-8d6a-7229154f8bf2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:32.725412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cc7eb2b-a9ff-49b2-8d6a-7229154f8bf2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:32.725949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cc7eb2b-a9ff-49b2-8d6a-7229154f8bf2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:32.792145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7cc7eb2b-a9ff-49b2-8d6a-7229154f8bf2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:41:32.827690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-66b475e6-2c68-495b-ac46-bb6af866313c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:32.843054 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-66b475e6-2c68-495b-ac46-bb6af866313c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1315 microversion: 2.1 time: 0.297756 Jul 28 03:41:32.847691 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 651/1339] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:32 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:32.854456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-40ac11e5-a7dc-464b-8204-4196d35822e6 req-fc2a763d-0d14-42c2-a852-4f4a1dd34cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ed6431d-350b-4d4b-9fd9-9aa50ebe098b", "tag": "37c1e27c-7161-48a0-8289-9627fdc1847a"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:32.869658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-40ac11e5-a7dc-464b-8204-4196d35822e6 req-fc2a763d-0d14-42c2-a852-4f4a1dd34cf6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:32.870929 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-40ac11e5-a7dc-464b-8204-4196d35822e6 req-fc2a763d-0d14-42c2-a852-4f4a1dd34cf6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:32.891376 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-40ac11e5-a7dc-464b-8204-4196d35822e6 req-fc2a763d-0d14-42c2-a852-4f4a1dd34cf6 service nova] Creating event network-changed:37c1e27c-7161-48a0-8289-9627fdc1847a for instance 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b on n-h1-826756-3 Jul 28 03:41:32.903461 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-40ac11e5-a7dc-464b-8204-4196d35822e6 req-fc2a763d-0d14-42c2-a852-4f4a1dd34cf6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053314 Jul 28 03:41:32.904729 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 652/1340] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:32.977486 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7cc7eb2b-a9ff-49b2-8d6a-7229154f8bf2 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 204 len: 0 microversion: 2.1 time: 0.278807 Jul 28 03:41:32.978239 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 689/1341] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:41:32 2022] DELETE /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:32.983085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-751b805a-7c0f-4bfa-9153-0032031de92f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:32.987987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb6513bb-e02a-48ce-8955-f6b11507da7f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:32.988678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-751b805a-7c0f-4bfa-9153-0032031de92f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:32.988825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb6513bb-e02a-48ce-8955-f6b11507da7f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:33.003613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-751b805a-7c0f-4bfa-9153-0032031de92f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:33.004538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-751b805a-7c0f-4bfa-9153-0032031de92f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:33.005099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb6513bb-e02a-48ce-8955-f6b11507da7f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:33.005793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-751b805a-7c0f-4bfa-9153-0032031de92f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:33.006563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-751b805a-7c0f-4bfa-9153-0032031de92f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:33.007940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb6513bb-e02a-48ce-8955-f6b11507da7f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:33.008788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb6513bb-e02a-48ce-8955-f6b11507da7f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:33.011564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb6513bb-e02a-48ce-8955-f6b11507da7f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:33.224407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-751b805a-7c0f-4bfa-9153-0032031de92f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:33.235415 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-751b805a-7c0f-4bfa-9153-0032031de92f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.271677 Jul 28 03:41:33.236652 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 653/1342] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:32 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:41:33.255448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fb6513bb-e02a-48ce-8955-f6b11507da7f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:33.266429 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fb6513bb-e02a-48ce-8955-f6b11507da7f tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1474 microversion: 2.1 time: 0.283277 Jul 28 03:41:33.279333 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 690/1343] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:32 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1474 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:33.477443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86d2c3f7-63f6-4752-9c80-5ec27130b8b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:33.479092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-86d2c3f7-63f6-4752-9c80-5ec27130b8b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:33.480585 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-0ff268d8-e503-4d2a-8d20-e639be0edc23 req-0ecb0f32-a8f8-4b9d-9a9a-b1023996a9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c44d8fc8-f642-4816-9e16-62dcc5798678", "tag": "6a86d23f-b83d-46cb-ba4a-d646641993f9"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:33.501781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86d2c3f7-63f6-4752-9c80-5ec27130b8b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:33.504247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86d2c3f7-63f6-4752-9c80-5ec27130b8b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:33.508704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86d2c3f7-63f6-4752-9c80-5ec27130b8b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:33.511408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86d2c3f7-63f6-4752-9c80-5ec27130b8b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:33.514247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-0ff268d8-e503-4d2a-8d20-e639be0edc23 req-0ecb0f32-a8f8-4b9d-9a9a-b1023996a9b0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:33.518196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-0ff268d8-e503-4d2a-8d20-e639be0edc23 req-0ecb0f32-a8f8-4b9d-9a9a-b1023996a9b0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:33.549131 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-0ff268d8-e503-4d2a-8d20-e639be0edc23 req-0ecb0f32-a8f8-4b9d-9a9a-b1023996a9b0 service nova] Creating event network-changed:6a86d23f-b83d-46cb-ba4a-d646641993f9 for instance c44d8fc8-f642-4816-9e16-62dcc5798678 on n-h1-826756-3 Jul 28 03:41:33.560288 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-0ff268d8-e503-4d2a-8d20-e639be0edc23 req-0ecb0f32-a8f8-4b9d-9a9a-b1023996a9b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092541 Jul 28 03:41:33.561869 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 654/1344] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:33.728271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3097b432-98b6-45c3-a4f3-6a8da815b245 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:33.730104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3097b432-98b6-45c3-a4f3-6a8da815b245 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:33.758192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:33.766697 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3097b432-98b6-45c3-a4f3-6a8da815b245 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:33.767542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3097b432-98b6-45c3-a4f3-6a8da815b245 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:33.768991 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3097b432-98b6-45c3-a4f3-6a8da815b245 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:33.770012 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3097b432-98b6-45c3-a4f3-6a8da815b245 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:33.975777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-86d2c3f7-63f6-4752-9c80-5ec27130b8b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:34.017484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-86d2c3f7-63f6-4752-9c80-5ec27130b8b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:34.020140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-86d2c3f7-63f6-4752-9c80-5ec27130b8b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:34.024773 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-86d2c3f7-63f6-4752-9c80-5ec27130b8b9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.554104 Jul 28 03:41:34.029336 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 691/1345] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:33 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:34.041499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2207409f-96ad-424b-a275-dfceb567abad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:34.042407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2207409f-96ad-424b-a275-dfceb567abad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:34.057329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2207409f-96ad-424b-a275-dfceb567abad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:34.058509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2207409f-96ad-424b-a275-dfceb567abad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:34.060291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2207409f-96ad-424b-a275-dfceb567abad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:34.061423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2207409f-96ad-424b-a275-dfceb567abad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:34.310467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2207409f-96ad-424b-a275-dfceb567abad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:34.326436 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2207409f-96ad-424b-a275-dfceb567abad tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1315 microversion: 2.1 time: 0.294337 Jul 28 03:41:34.328200 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 692/1346] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:34 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:34.339168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1cce3d08-3425-4a98-8557-87a3c2cb532a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:34.339800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1cce3d08-3425-4a98-8557-87a3c2cb532a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:34.357206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cce3d08-3425-4a98-8557-87a3c2cb532a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:34.360517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cce3d08-3425-4a98-8557-87a3c2cb532a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:34.361835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cce3d08-3425-4a98-8557-87a3c2cb532a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:34.362131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cce3d08-3425-4a98-8557-87a3c2cb532a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:34.690213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1cce3d08-3425-4a98-8557-87a3c2cb532a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:34.713999 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1cce3d08-3425-4a98-8557-87a3c2cb532a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.383578 Jul 28 03:41:34.717248 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 693/1347] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:34 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:34.732212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3097b432-98b6-45c3-a4f3-6a8da815b245 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:34.745316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dcaab44b-9102-4fc3-8612-833667360cc8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:34.746209 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3097b432-98b6-45c3-a4f3-6a8da815b245 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 1.034925 Jul 28 03:41:34.754588 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 655/1348] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:33 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:34.755256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dcaab44b-9102-4fc3-8612-833667360cc8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:34.775561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcaab44b-9102-4fc3-8612-833667360cc8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:34.776193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcaab44b-9102-4fc3-8612-833667360cc8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:34.777628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcaab44b-9102-4fc3-8612-833667360cc8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:34.778330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcaab44b-9102-4fc3-8612-833667360cc8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:35.035950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dcaab44b-9102-4fc3-8612-833667360cc8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:35.049305 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dcaab44b-9102-4fc3-8612-833667360cc8 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1474 microversion: 2.1 time: 0.329769 Jul 28 03:41:35.055040 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 694/1349] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:34 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1474 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:35.077508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-51137c98-1050-4272-83be-fb317fa150d2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:35.078134 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-51137c98-1050-4272-83be-fb317fa150d2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:35.104955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51137c98-1050-4272-83be-fb317fa150d2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:35.106874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51137c98-1050-4272-83be-fb317fa150d2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:35.111023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51137c98-1050-4272-83be-fb317fa150d2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:35.112650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51137c98-1050-4272-83be-fb317fa150d2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:35.355845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40253b85-f814-41bc-89af-d2565b9ff0f3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:35.356885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40253b85-f814-41bc-89af-d2565b9ff0f3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:35.378874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40253b85-f814-41bc-89af-d2565b9ff0f3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:35.383135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40253b85-f814-41bc-89af-d2565b9ff0f3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:35.384659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40253b85-f814-41bc-89af-d2565b9ff0f3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:35.389008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40253b85-f814-41bc-89af-d2565b9ff0f3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:35.856780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40253b85-f814-41bc-89af-d2565b9ff0f3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:35.871846 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40253b85-f814-41bc-89af-d2565b9ff0f3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1315 microversion: 2.1 time: 0.518093 Jul 28 03:41:35.891398 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 695/1350] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:35 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:41:35.902962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ad479004-0297-4c0a-9af1-25316ba2cb1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:35.904253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ad479004-0297-4c0a-9af1-25316ba2cb1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:35.922847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad479004-0297-4c0a-9af1-25316ba2cb1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:35.924059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad479004-0297-4c0a-9af1-25316ba2cb1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:35.925267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad479004-0297-4c0a-9af1-25316ba2cb1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:35.926712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad479004-0297-4c0a-9af1-25316ba2cb1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:36.148745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-51137c98-1050-4272-83be-fb317fa150d2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:36.194596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-51137c98-1050-4272-83be-fb317fa150d2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:36.197010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-51137c98-1050-4272-83be-fb317fa150d2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:36.200828 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-51137c98-1050-4272-83be-fb317fa150d2 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 1.148099 Jul 28 03:41:36.230609 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 656/1351] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:35 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:41:36.259492 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b2274fac-6c05-45f8-9b49-0079ef887938 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:36.260130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b2274fac-6c05-45f8-9b49-0079ef887938 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:36.292892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b2274fac-6c05-45f8-9b49-0079ef887938 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:36.292892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b2274fac-6c05-45f8-9b49-0079ef887938 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:36.293719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b2274fac-6c05-45f8-9b49-0079ef887938 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:36.294540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b2274fac-6c05-45f8-9b49-0079ef887938 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:36.359672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ad479004-0297-4c0a-9af1-25316ba2cb1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:36.388690 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ad479004-0297-4c0a-9af1-25316ba2cb1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.495390 Jul 28 03:41:36.390405 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 696/1352] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:35 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:36.403666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a0136100-30d7-41a6-b43c-57c6e27b118a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:36.404899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a0136100-30d7-41a6-b43c-57c6e27b118a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:36.413593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0136100-30d7-41a6-b43c-57c6e27b118a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:36.414599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0136100-30d7-41a6-b43c-57c6e27b118a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:36.415787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0136100-30d7-41a6-b43c-57c6e27b118a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:36.416674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0136100-30d7-41a6-b43c-57c6e27b118a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:36.610445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a0136100-30d7-41a6-b43c-57c6e27b118a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e8d4e8b898489a819618e4b3b97994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c78a01dfb2242a3bf66939666031eb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:36.622324 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a0136100-30d7-41a6-b43c-57c6e27b118a tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 200 len: 1303 microversion: 2.1 time: 0.227737 Jul 28 03:41:36.624700 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 697/1353] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:36 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 1303 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:36.634136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-7e903b0c-e6c3-4e36-a3c9-919c5b7851cc req-e9d7a4ec-5913-45b9-b477-ced4767bce03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd55ca4a-13e1-4bef-bd20-10b981d48291", "name": "network-vif-deleted", "tag": "11dadaf8-0b7a-479d-a8d0-fd5143083dd4"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:36.662140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7e903b0c-e6c3-4e36-a3c9-919c5b7851cc req-e9d7a4ec-5913-45b9-b477-ced4767bce03 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:36.662644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7e903b0c-e6c3-4e36-a3c9-919c5b7851cc req-e9d7a4ec-5913-45b9-b477-ced4767bce03 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:36.690911 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-7e903b0c-e6c3-4e36-a3c9-919c5b7851cc req-e9d7a4ec-5913-45b9-b477-ced4767bce03 service nova] Creating event network-vif-deleted:11dadaf8-0b7a-479d-a8d0-fd5143083dd4 for instance dd55ca4a-13e1-4bef-bd20-10b981d48291 on n-h2-826756-3 Jul 28 03:41:36.704654 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-7e903b0c-e6c3-4e36-a3c9-919c5b7851cc req-e9d7a4ec-5913-45b9-b477-ced4767bce03 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078481 Jul 28 03:41:36.707556 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 698/1354] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:36.845499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b2274fac-6c05-45f8-9b49-0079ef887938 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:36.866970 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b2274fac-6c05-45f8-9b49-0079ef887938 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.633060 Jul 28 03:41:36.869082 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 657/1355] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:36 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:37.255603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aadf53fc-0138-4eac-ac37-4ea31bba23cb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:37.257872 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-aadf53fc-0138-4eac-ac37-4ea31bba23cb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:37.273543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aadf53fc-0138-4eac-ac37-4ea31bba23cb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:37.276570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aadf53fc-0138-4eac-ac37-4ea31bba23cb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:37.278319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aadf53fc-0138-4eac-ac37-4ea31bba23cb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:37.281177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aadf53fc-0138-4eac-ac37-4ea31bba23cb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:37.350466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f8154db-0f59-4106-9db8-96bd9a1350d6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:37.351240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f8154db-0f59-4106-9db8-96bd9a1350d6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:37.373384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f8154db-0f59-4106-9db8-96bd9a1350d6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:37.374552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f8154db-0f59-4106-9db8-96bd9a1350d6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:37.376698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f8154db-0f59-4106-9db8-96bd9a1350d6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:37.377315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f8154db-0f59-4106-9db8-96bd9a1350d6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:37.739920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f8154db-0f59-4106-9db8-96bd9a1350d6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:37.758441 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f8154db-0f59-4106-9db8-96bd9a1350d6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1315 microversion: 2.1 time: 0.864483 Jul 28 03:41:37.759681 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 699/1356] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:36 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1315 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:37.765022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59282060-a10f-4995-a229-1039ae9d7bbf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:37.765980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59282060-a10f-4995-a229-1039ae9d7bbf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:37.774074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59282060-a10f-4995-a229-1039ae9d7bbf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:37.774798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59282060-a10f-4995-a229-1039ae9d7bbf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:37.775809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59282060-a10f-4995-a229-1039ae9d7bbf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:37.776442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59282060-a10f-4995-a229-1039ae9d7bbf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:37.830175 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-aadf53fc-0138-4eac-ac37-4ea31bba23cb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:37.839674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-aadf53fc-0138-4eac-ac37-4ea31bba23cb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:37.847152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-aadf53fc-0138-4eac-ac37-4ea31bba23cb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:37.851332 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aadf53fc-0138-4eac-ac37-4ea31bba23cb tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.599997 Jul 28 03:41:37.859697 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 658/1357] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:37 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:41:37.868970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-001f2a8d-daea-4f37-9e95-50fe782569d0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:37.872233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-001f2a8d-daea-4f37-9e95-50fe782569d0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] [instance: dd55ca4a-13e1-4bef-bd20-10b981d48291] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:37.879429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-001f2a8d-daea-4f37-9e95-50fe782569d0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:37.879887 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-001f2a8d-daea-4f37-9e95-50fe782569d0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:37.880920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-001f2a8d-daea-4f37-9e95-50fe782569d0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:37.881853 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-001f2a8d-daea-4f37-9e95-50fe782569d0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:37.908033 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-001f2a8d-daea-4f37-9e95-50fe782569d0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] HTTP exception thrown: Instance dd55ca4a-13e1-4bef-bd20-10b981d48291 could not be found. Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-001f2a8d-daea-4f37-9e95-50fe782569d0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Request method failure captured: Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 HTTP/1.1 Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gUlOBo-B2HhlIUt6q9MsP89JsYIu7OUihBPCv3RNLpPOrpLHclPbC8GOw3nKeaxF3PgqCvl9KXvyBCgE10I26XzuIkNbMOrgUfb_G2ZDo56PfRl0yOFK8if5XFJFWVmy7y2szpIO2mAxaboU8ZHA5JleoFNsc9ou21Rc2CimEwrXjM Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 4c78a01dfb2242a3bf66939666031eb9 Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-LiveMigrationNegativeTest-1481405521 Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:41:37.910225 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:41:37.911953 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4c78a01dfb2242a3bf66939666031eb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c78a01dfb2242a3bf66939666031eb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4c78a01dfb2242a3bf66939666031eb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4c78a01dfb2242a3bf66939666031eb9"}]}] Jul 28 03:41:37.911953 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-LiveMigrationNegativeTest-1481405521 Jul 28 03:41:37.911953 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 4c78a01dfb2242a3bf66939666031eb9 Jul 28 03:41:37.911953 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1481405521 Jul 28 03:41:37.911953 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-LiveMigrationNegativeTest-1481405521-project Jul 28 03:41:37.911953 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:41:37.911953 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:41:37.911953 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: f6e8d4e8b898489a819618e4b3b97994 Jul 28 03:41:37.911953 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-LiveMigrationNegativeTest-1481405521-project Jul 28 03:41:37.911953 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:41:37.911953 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance dd55ca4a-13e1-4bef-bd20-10b981d48291 could not be found. Jul 28 03:41:37.911953 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'dd55ca4a-13e1-4bef-bd20-10b981d48291'} Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd55ca4a-13e1-4bef-bd20-10b981d48291 could not be found. Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:41:37.912955 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd55ca4a-13e1-4bef-bd20-10b981d48291 could not be found. Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd55ca4a-13e1-4bef-bd20-10b981d48291 could not be found. Jul 28 03:41:37.914528 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:37.923821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-001f2a8d-daea-4f37-9e95-50fe782569d0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] Returning 404 to user: Instance dd55ca4a-13e1-4bef-bd20-10b981d48291 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:41:37.925203 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-001f2a8d-daea-4f37-9e95-50fe782569d0 tempest-LiveMigrationNegativeTest-1481405521 tempest-LiveMigrationNegativeTest-1481405521-project] 10.222.0.48 "GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291" status: 404 len: 111 microversion: 2.1 time: 0.064229 Jul 28 03:41:37.929559 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 659/1358] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:37 2022] GET /compute/v2.1/servers/dd55ca4a-13e1-4bef-bd20-10b981d48291 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:41:37.964652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-59282060-a10f-4995-a229-1039ae9d7bbf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:37.968397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:37.981413 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59282060-a10f-4995-a229-1039ae9d7bbf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.220246 Jul 28 03:41:37.986007 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 700/1359] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:37 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:37.996892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-864ae5fd-c77d-49ca-be42-cd2d36a5d4cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:37.997427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-864ae5fd-c77d-49ca-be42-cd2d36a5d4cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:38.009759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-864ae5fd-c77d-49ca-be42-cd2d36a5d4cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.010426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-864ae5fd-c77d-49ca-be42-cd2d36a5d4cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.010973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-864ae5fd-c77d-49ca-be42-cd2d36a5d4cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.011547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-864ae5fd-c77d-49ca-be42-cd2d36a5d4cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.204705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0916f1b2-7e1c-499f-81a1-3af30153a951 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74836040>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:38.207888 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:41:38.207888 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:41:38.209473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0916f1b2-7e1c-499f-81a1-3af30153a951 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.211414 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0916f1b2-7e1c-499f-81a1-3af30153a951 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.247850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0916f1b2-7e1c-499f-81a1-3af30153a951 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.248303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0916f1b2-7e1c-499f-81a1-3af30153a951 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.278706 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-0916f1b2-7e1c-499f-81a1-3af30153a951 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] HTTP exception thrown: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0916f1b2-7e1c-499f-81a1-3af30153a951 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Request method failure captured: Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: request: PUT /compute/v2.1/os-services/f12c0c97-d732-4d42-a3a7-4c96f3e397c9 HTTP/1.1 Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 56 Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gVxz4qSKBo8ufV2zessntw_vQIWSYIMygzxadq7xIZDF1CcEXL55yXEiCU33MlKCEA82wmEM5wyBGpeDioC30z9n1u6It9sbCOH_kyEy2QbNdWe5J_F3243rNFzHTOZ1K50ZB9TMaa1ZgGx6FHnl5_Dd3x185xpdwOz055RA_ZkGcY Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: X-Openstack-Nova-Api-Version: 2.53 Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: c2501de2537a450aa1ee004c3f4db61c Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1068618869 Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:41:38.290528 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:41:38.292376 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2501de2537a450aa1ee004c3f4db61c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2501de2537a450aa1ee004c3f4db61c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2501de2537a450aa1ee004c3f4db61c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2501de2537a450aa1ee004c3f4db61c"}]}] Jul 28 03:41:38.292376 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1068618869 Jul 28 03:41:38.292376 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: c2501de2537a450aa1ee004c3f4db61c Jul 28 03:41:38.292376 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1068618869 Jul 28 03:41:38.292376 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin Jul 28 03:41:38.292376 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:41:38.292376 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:41:38.292376 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: e72811df717d4b24a8d5622c232e6bbe Jul 28 03:41:38.292376 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin Jul 28 03:41:38.292376 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:41:38.292376 n-d-826756-3 devstack@n-api.service[126072]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 28 03:41:38.292376 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:41:38.292376 n-d-826756-3 devstack@n-api.service[126072]: exception: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'f12c0c97-d732-4d42-a3a7-4c96f3e397c9', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6201, in service_get_by_id Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6061, in _find_service_in_cell Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6203, in service_get_by_id Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.293332 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:38.294824 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:41:38.296150 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:41:38.296150 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.296150 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.298171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0916f1b2-7e1c-499f-81a1-3af30153a951 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Returning 404 to user: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:41:38.299069 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0916f1b2-7e1c-499f-81a1-3af30153a951 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/f12c0c97-d732-4d42-a3a7-4c96f3e397c9" status: 404 len: 110 microversion: 2.53 time: 0.368218 Jul 28 03:41:38.299982 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 660/1360] 10.222.0.48 () {62 vars in 1309 bytes} [Thu Jul 28 03:41:37 2022] PUT /compute/v2.1/os-services/f12c0c97-d732-4d42-a3a7-4c96f3e397c9 => generated 110 bytes in 369 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:41:38.307539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-b691a73f-0759-4c99-9023-efc9250648b6 req-55137bff-ce11-4449-b385-49738b4b1709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed6431d-350b-4d4b-9fd9-9aa50ebe098b", "name": "network-vif-plugged", "status": "completed", "tag": "37c1e27c-7161-48a0-8289-9627fdc1847a"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:38.331942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b691a73f-0759-4c99-9023-efc9250648b6 req-55137bff-ce11-4449-b385-49738b4b1709 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.332426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b691a73f-0759-4c99-9023-efc9250648b6 req-55137bff-ce11-4449-b385-49738b4b1709 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.336132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-864ae5fd-c77d-49ca-be42-cd2d36a5d4cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:38.353022 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-864ae5fd-c77d-49ca-be42-cd2d36a5d4cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.360524 Jul 28 03:41:38.354074 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-b691a73f-0759-4c99-9023-efc9250648b6 req-55137bff-ce11-4449-b385-49738b4b1709 service nova] Creating event network-vif-plugged:37c1e27c-7161-48a0-8289-9627fdc1847a for instance 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b on n-h1-826756-3 Jul 28 03:41:38.354689 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 701/1361] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:37 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:38.360031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9edd510d-cda9-43e4-b02d-6c5ddd4aa332 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74110430>, body: {"status": "disabled"} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:38.374229 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-b691a73f-0759-4c99-9023-efc9250648b6 req-55137bff-ce11-4449-b385-49738b4b1709 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072786 Jul 28 03:41:38.374844 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 661/1362] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:38.381270 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:41:38.381270 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:41:38.385108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9edd510d-cda9-43e4-b02d-6c5ddd4aa332 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.388008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9edd510d-cda9-43e4-b02d-6c5ddd4aa332 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.430342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9edd510d-cda9-43e4-b02d-6c5ddd4aa332 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.430791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9edd510d-cda9-43e4-b02d-6c5ddd4aa332 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.450561 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-9edd510d-cda9-43e4-b02d-6c5ddd4aa332 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] HTTP exception thrown: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9edd510d-cda9-43e4-b02d-6c5ddd4aa332 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Request method failure captured: Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: request: PUT /compute/v2.1/os-services/f12c0c97-d732-4d42-a3a7-4c96f3e397c9 HTTP/1.1 Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 22 Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gVxz4qSKBo8ufV2zessntw_vQIWSYIMygzxadq7xIZDF1CcEXL55yXEiCU33MlKCEA82wmEM5wyBGpeDioC30z9n1u6It9sbCOH_kyEy2QbNdWe5J_F3243rNFzHTOZ1K50ZB9TMaa1ZgGx6FHnl5_Dd3x185xpdwOz055RA_ZkGcY Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.53 Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: c2501de2537a450aa1ee004c3f4db61c Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1068618869 Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:41:38.452782 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:41:38.454294 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2501de2537a450aa1ee004c3f4db61c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2501de2537a450aa1ee004c3f4db61c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2501de2537a450aa1ee004c3f4db61c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2501de2537a450aa1ee004c3f4db61c"}]}] Jul 28 03:41:38.454294 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1068618869 Jul 28 03:41:38.454294 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: c2501de2537a450aa1ee004c3f4db61c Jul 28 03:41:38.454294 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1068618869 Jul 28 03:41:38.454294 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin Jul 28 03:41:38.454294 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:41:38.454294 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:41:38.454294 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: e72811df717d4b24a8d5622c232e6bbe Jul 28 03:41:38.454294 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin Jul 28 03:41:38.454294 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:41:38.454294 n-d-826756-3 devstack@n-api.service[126071]: {"status": "disabled"} Jul 28 03:41:38.454294 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:41:38.454294 n-d-826756-3 devstack@n-api.service[126071]: exception: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.454294 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'f12c0c97-d732-4d42-a3a7-4c96f3e397c9', 'body': {'status': 'disabled'}} Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6201, in service_get_by_id Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6061, in _find_service_in_cell Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6203, in service_get_by_id Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:38.455256 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:41:38.458387 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:41:38.460012 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.460012 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.460012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9edd510d-cda9-43e4-b02d-6c5ddd4aa332 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Returning 404 to user: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:41:38.460012 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9edd510d-cda9-43e4-b02d-6c5ddd4aa332 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/f12c0c97-d732-4d42-a3a7-4c96f3e397c9" status: 404 len: 110 microversion: 2.53 time: 0.098989 Jul 28 03:41:38.463929 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 702/1363] 10.222.0.48 () {62 vars in 1309 bytes} [Thu Jul 28 03:41:38 2022] PUT /compute/v2.1/os-services/f12c0c97-d732-4d42-a3a7-4c96f3e397c9 => generated 110 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:41:38.468465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c3d60f76-6ebe-40d6-a0fc-4d48510cdfa1 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74836310>, body: {"status": "enabled"} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:38.471345 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:41:38.471345 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:41:38.473089 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3d60f76-6ebe-40d6-a0fc-4d48510cdfa1 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.474792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3d60f76-6ebe-40d6-a0fc-4d48510cdfa1 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.482586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3d60f76-6ebe-40d6-a0fc-4d48510cdfa1 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.483355 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3d60f76-6ebe-40d6-a0fc-4d48510cdfa1 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.491023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:38.492806 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-c3d60f76-6ebe-40d6-a0fc-4d48510cdfa1 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] HTTP exception thrown: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c3d60f76-6ebe-40d6-a0fc-4d48510cdfa1 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Request method failure captured: Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: request: PUT /compute/v2.1/os-services/f12c0c97-d732-4d42-a3a7-4c96f3e397c9 HTTP/1.1 Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 21 Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gVxz4qSKBo8ufV2zessntw_vQIWSYIMygzxadq7xIZDF1CcEXL55yXEiCU33MlKCEA82wmEM5wyBGpeDioC30z9n1u6It9sbCOH_kyEy2QbNdWe5J_F3243rNFzHTOZ1K50ZB9TMaa1ZgGx6FHnl5_Dd3x185xpdwOz055RA_ZkGcY Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: X-Openstack-Nova-Api-Version: 2.53 Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: c2501de2537a450aa1ee004c3f4db61c Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1068618869 Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:41:38.496545 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:41:38.500262 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c2501de2537a450aa1ee004c3f4db61c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2501de2537a450aa1ee004c3f4db61c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c2501de2537a450aa1ee004c3f4db61c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c2501de2537a450aa1ee004c3f4db61c"}]}] Jul 28 03:41:38.500262 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1068618869 Jul 28 03:41:38.500262 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: c2501de2537a450aa1ee004c3f4db61c Jul 28 03:41:38.500262 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1068618869 Jul 28 03:41:38.500262 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin Jul 28 03:41:38.500262 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:41:38.500262 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:41:38.500262 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: e72811df717d4b24a8d5622c232e6bbe Jul 28 03:41:38.500262 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin Jul 28 03:41:38.500262 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:41:38.500262 n-d-826756-3 devstack@n-api.service[126072]: {"status": "enabled"} Jul 28 03:41:38.500262 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:41:38.500262 n-d-826756-3 devstack@n-api.service[126072]: exception: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.500262 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'f12c0c97-d732-4d42-a3a7-4c96f3e397c9', 'body': {'status': 'enabled'}} Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6201, in service_get_by_id Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6061, in _find_service_in_cell Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6203, in service_get_by_id Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:38.501714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:41:38.503780 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:41:38.505591 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. Jul 28 03:41:38.505591 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:38.509231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c3d60f76-6ebe-40d6-a0fc-4d48510cdfa1 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Returning 404 to user: Service f12c0c97-d732-4d42-a3a7-4c96f3e397c9 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:41:38.510927 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c3d60f76-6ebe-40d6-a0fc-4d48510cdfa1 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-services/f12c0c97-d732-4d42-a3a7-4c96f3e397c9" status: 404 len: 110 microversion: 2.53 time: 0.048459 Jul 28 03:41:38.511990 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 662/1364] 10.222.0.48 () {62 vars in 1309 bytes} [Thu Jul 28 03:41:38 2022] PUT /compute/v2.1/os-services/f12c0c97-d732-4d42-a3a7-4c96f3e397c9 => generated 110 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:41:38.521652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7addda4d-fd9e-4fc3-ba13-428831473820 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:38.524635 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:41:38.524635 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:41:38.525934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7addda4d-fd9e-4fc3-ba13-428831473820 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.537321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7addda4d-fd9e-4fc3-ba13-428831473820 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.538289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7addda4d-fd9e-4fc3-ba13-428831473820 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.538734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7addda4d-fd9e-4fc3-ba13-428831473820 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.578083 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7addda4d-fd9e-4fc3-ba13-428831473820 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.061299 Jul 28 03:41:38.592645 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-64c60a43-ffc8-4cba-aea9-98f7d31572a7 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:38.594956 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:41:38.594956 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:41:38.597268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64c60a43-ffc8-4cba-aea9-98f7d31572a7 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.597504 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 703/1365] 10.222.0.48 () {60 vars in 1178 bytes} [Thu Jul 28 03:41:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:38.598188 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64c60a43-ffc8-4cba-aea9-98f7d31572a7 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.599184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64c60a43-ffc8-4cba-aea9-98f7d31572a7 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.599847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64c60a43-ffc8-4cba-aea9-98f7d31572a7 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.630753 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-64c60a43-ffc8-4cba-aea9-98f7d31572a7 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.041861 Jul 28 03:41:38.641630 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 663/1366] 10.222.0.48 () {60 vars in 1211 bytes} [Thu Jul 28 03:41:38 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:38.647027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9eaa851f-178c-443a-8c26-1bc1ab0640ef tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:38.650655 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:41:38.650655 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:41:38.653793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9eaa851f-178c-443a-8c26-1bc1ab0640ef tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.654440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9eaa851f-178c-443a-8c26-1bc1ab0640ef tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.655954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9eaa851f-178c-443a-8c26-1bc1ab0640ef tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.656593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9eaa851f-178c-443a-8c26-1bc1ab0640ef tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.689857 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9eaa851f-178c-443a-8c26-1bc1ab0640ef tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.048835 Jul 28 03:41:38.690528 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 704/1367] 10.222.0.48 () {60 vars in 1178 bytes} [Thu Jul 28 03:41:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:41:38.702947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-28fd1ca3-9568-4704-902c-429174582899 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:38.705569 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:41:38.705569 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:41:38.706842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-28fd1ca3-9568-4704-902c-429174582899 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.707352 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-28fd1ca3-9568-4704-902c-429174582899 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.709366 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-28fd1ca3-9568-4704-902c-429174582899 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.709804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-28fd1ca3-9568-4704-902c-429174582899 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.742249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:38.753298 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-28fd1ca3-9568-4704-902c-429174582899 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-826756-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.054069 Jul 28 03:41:38.754691 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 664/1368] 10.222.0.48 () {60 vars in 1235 bytes} [Thu Jul 28 03:41:38 2022] GET /compute/v2.1/os-services?host=n-d-826756-3&binary=xxx => generated 16 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:38.766721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5510d30-d5f3-4e7a-b9d9-92aa41fa9586 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:38.769794 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:41:38.769794 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:41:38.771387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5510d30-d5f3-4e7a-b9d9-92aa41fa9586 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.772020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5510d30-d5f3-4e7a-b9d9-92aa41fa9586 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.773044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5510d30-d5f3-4e7a-b9d9-92aa41fa9586 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.773482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5510d30-d5f3-4e7a-b9d9-92aa41fa9586 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.788397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-638c22d7-8a48-4780-94ad-cf3e11f7a279 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:38.789156 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-638c22d7-8a48-4780-94ad-cf3e11f7a279 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:38.802492 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-638c22d7-8a48-4780-94ad-cf3e11f7a279 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.802880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-638c22d7-8a48-4780-94ad-cf3e11f7a279 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.805095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-638c22d7-8a48-4780-94ad-cf3e11f7a279 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.805550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-638c22d7-8a48-4780-94ad-cf3e11f7a279 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.821371 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5510d30-d5f3-4e7a-b9d9-92aa41fa9586 tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.058900 Jul 28 03:41:38.822626 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 705/1369] 10.222.0.48 () {60 vars in 1178 bytes} [Thu Jul 28 03:41:38 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:38.836788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c37c67cd-14e5-4ea0-9649-d9b9b7d9b39a tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:38.844530 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:41:38.844530 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:41:38.848323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c37c67cd-14e5-4ea0-9649-d9b9b7d9b39a tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.849879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c37c67cd-14e5-4ea0-9649-d9b9b7d9b39a tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.850813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c37c67cd-14e5-4ea0-9649-d9b9b7d9b39a tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.852725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c37c67cd-14e5-4ea0-9649-d9b9b7d9b39a tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.887850 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c37c67cd-14e5-4ea0-9649-d9b9b7d9b39a tempest-ServicesAdminNegativeV253TestJSON-1068618869 tempest-ServicesAdminNegativeV253TestJSON-1068618869-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.057204 Jul 28 03:41:38.895674 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 706/1370] 10.222.0.48 () {60 vars in 1239 bytes} [Thu Jul 28 03:41:38 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:38.900816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-82833415-c9e5-414f-9efc-d12ce98f5b4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:38.901644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-82833415-c9e5-414f-9efc-d12ce98f5b4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:38.908437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82833415-c9e5-414f-9efc-d12ce98f5b4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.909105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82833415-c9e5-414f-9efc-d12ce98f5b4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:38.909875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82833415-c9e5-414f-9efc-d12ce98f5b4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:38.910341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82833415-c9e5-414f-9efc-d12ce98f5b4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:39.035244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-638c22d7-8a48-4780-94ad-cf3e11f7a279 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:39.052248 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-638c22d7-8a48-4780-94ad-cf3e11f7a279 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1315 microversion: 2.1 time: 0.276763 Jul 28 03:41:39.054697 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 665/1371] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:38 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:39.208607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82833415-c9e5-414f-9efc-d12ce98f5b4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:39.223653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82833415-c9e5-414f-9efc-d12ce98f5b4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:39.226261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82833415-c9e5-414f-9efc-d12ce98f5b4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:39.229078 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-82833415-c9e5-414f-9efc-d12ce98f5b4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1813 microversion: 2.25 time: 0.332077 Jul 28 03:41:39.243247 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 707/1372] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:38 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1813 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:39.243247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-25cdaf60-0942-457b-8597-cd1a992235d6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:39.243555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-25cdaf60-0942-457b-8597-cd1a992235d6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:39.250989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25cdaf60-0942-457b-8597-cd1a992235d6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:39.251590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25cdaf60-0942-457b-8597-cd1a992235d6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:39.252517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25cdaf60-0942-457b-8597-cd1a992235d6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:39.253065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25cdaf60-0942-457b-8597-cd1a992235d6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:39.279995 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fcc96a0f-2cef-48af-9df7-b390245cfdce tempest-ServicesAdminNegativeV253TestJSON-1675661913 tempest-ServicesAdminNegativeV253TestJSON-1675661913-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:39.283504 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:41:39.283504 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:41:39.286263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fcc96a0f-2cef-48af-9df7-b390245cfdce tempest-ServicesAdminNegativeV253TestJSON-1675661913 tempest-ServicesAdminNegativeV253TestJSON-1675661913-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '37827e68cd8a4d7ba8aa85586e0ea609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '755c297e52ca40bbb4c2f6d71bf0f7ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fcc96a0f-2cef-48af-9df7-b390245cfdce tempest-ServicesAdminNegativeV253TestJSON-1675661913 tempest-ServicesAdminNegativeV253TestJSON-1675661913-project] Request method failure captured: Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gVv4ABNaeGuUdlgfUOM91jqOqB1DZv-OjNBmpfLq8xyt7Q3Z8rIH114-CKWvziUaVS3OVDlfVWcoSLUsEWUyu9jdAf8OUBPoLttQUdjBXeMPbr6--19jk9kPLc_wwouHEsPBa8h6HiclmdMUlSrhDzi5k5SRYYt_ASGyk0URc_kafI Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: X-Openstack-Nova-Api-Version: 2.53 Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 755c297e52ca40bbb4c2f6d71bf0f7ff Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1675661913 Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:41:39.288664 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:41:39.290433 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/755c297e52ca40bbb4c2f6d71bf0f7ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/755c297e52ca40bbb4c2f6d71bf0f7ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_755c297e52ca40bbb4c2f6d71bf0f7ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/755c297e52ca40bbb4c2f6d71bf0f7ff"}]}] Jul 28 03:41:39.290433 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1675661913 Jul 28 03:41:39.290433 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 755c297e52ca40bbb4c2f6d71bf0f7ff Jul 28 03:41:39.290433 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1675661913 Jul 28 03:41:39.290433 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1675661913-project Jul 28 03:41:39.290433 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:41:39.290433 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:41:39.290433 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 37827e68cd8a4d7ba8aa85586e0ea609 Jul 28 03:41:39.290433 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1675661913-project Jul 28 03:41:39.290433 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:41:39.290433 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 03:41:39.290433 n-d-826756-3 devstack@n-api.service[126072]: action_args: {} Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:41:39.291265 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 03:41:39.292531 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:41:39.293898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fcc96a0f-2cef-48af-9df7-b390245cfdce tempest-ServicesAdminNegativeV253TestJSON-1675661913 tempest-ServicesAdminNegativeV253TestJSON-1675661913-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:41:39.293898 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fcc96a0f-2cef-48af-9df7-b390245cfdce tempest-ServicesAdminNegativeV253TestJSON-1675661913 tempest-ServicesAdminNegativeV253TestJSON-1675661913-project] 10.222.0.48 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.233310 Jul 28 03:41:39.293898 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 666/1373] 10.222.0.48 () {60 vars in 1178 bytes} [Thu Jul 28 03:41:39 2022] GET /compute/v2.1/os-services => generated 112 bytes in 236 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:41:39.395541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f33d752b-9aa0-4a52-a311-ad18b8d59750 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:39.397046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f33d752b-9aa0-4a52-a311-ad18b8d59750 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:39.420423 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f33d752b-9aa0-4a52-a311-ad18b8d59750 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:39.422854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f33d752b-9aa0-4a52-a311-ad18b8d59750 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:39.424066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f33d752b-9aa0-4a52-a311-ad18b8d59750 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:39.425368 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f33d752b-9aa0-4a52-a311-ad18b8d59750 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:39.505773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-25cdaf60-0942-457b-8597-cd1a992235d6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:39.525574 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-25cdaf60-0942-457b-8597-cd1a992235d6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.287147 Jul 28 03:41:39.526181 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 708/1374] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:39 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:39.696302 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f33d752b-9aa0-4a52-a311-ad18b8d59750 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:39.711410 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f33d752b-9aa0-4a52-a311-ad18b8d59750 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.325362 Jul 28 03:41:39.712281 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 667/1375] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:39 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:41:40.082582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5f06c24-b567-4b99-86d6-33c184429d97 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:40.083879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b5f06c24-b567-4b99-86d6-33c184429d97 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:40.096767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5f06c24-b567-4b99-86d6-33c184429d97 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:40.097833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5f06c24-b567-4b99-86d6-33c184429d97 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:40.099684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5f06c24-b567-4b99-86d6-33c184429d97 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:40.100586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5f06c24-b567-4b99-86d6-33c184429d97 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:40.259094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-261f3db5-cc38-4596-99de-d67da0a6a090 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:40.260419 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-261f3db5-cc38-4596-99de-d67da0a6a090 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:40.273501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-261f3db5-cc38-4596-99de-d67da0a6a090 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:40.274236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-261f3db5-cc38-4596-99de-d67da0a6a090 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:40.275684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-261f3db5-cc38-4596-99de-d67da0a6a090 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:40.277578 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-261f3db5-cc38-4596-99de-d67da0a6a090 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:40.384960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b5f06c24-b567-4b99-86d6-33c184429d97 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:40.398222 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5f06c24-b567-4b99-86d6-33c184429d97 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1501 microversion: 2.1 time: 0.326431 Jul 28 03:41:40.399321 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 709/1376] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:40 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1501 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:40.425532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-75bc1145-9a87-45b0-b0db-ad69a30f9f17 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:40.429632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-75bc1145-9a87-45b0-b0db-ad69a30f9f17 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:40.468652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75bc1145-9a87-45b0-b0db-ad69a30f9f17 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:40.469112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75bc1145-9a87-45b0-b0db-ad69a30f9f17 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:40.471402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75bc1145-9a87-45b0-b0db-ad69a30f9f17 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:40.472442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75bc1145-9a87-45b0-b0db-ad69a30f9f17 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:40.494187 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-261f3db5-cc38-4596-99de-d67da0a6a090 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:40.505320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-261f3db5-cc38-4596-99de-d67da0a6a090 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:40.512535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-261f3db5-cc38-4596-99de-d67da0a6a090 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:40.517820 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-261f3db5-cc38-4596-99de-d67da0a6a090 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1803 microversion: 2.25 time: 0.266523 Jul 28 03:41:40.540365 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 668/1377] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:40 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1803 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:40.597543 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-75bc1145-9a87-45b0-b0db-ad69a30f9f17 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action" status: 200 len: 14 microversion: 2.1 time: 0.182167 Jul 28 03:41:40.603667 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 710/1378] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:40 2022] POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:41:40.616550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c8d91d92-43a0-43da-a04b-3fce77ea7979 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:40.622749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce357e33-4c48-46b6-8524-f239d822adca tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '.version_select at 0x7ffa74110c10>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:40.626896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce357e33-4c48-46b6-8524-f239d822adca tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:40.627531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce357e33-4c48-46b6-8524-f239d822adca tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:40.628025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c8d91d92-43a0-43da-a04b-3fce77ea7979 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:40.641822 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce357e33-4c48-46b6-8524-f239d822adca tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 3026 microversion: 2.25 time: 0.023164 Jul 28 03:41:40.642742 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 711/1379] 10.222.0.48 () {60 vars in 1184 bytes} [Thu Jul 28 03:41:40 2022] GET /compute/v2.1/os-migrations => generated 3026 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:41:40.658698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8b1827d9-9170-4104-8b20-9c9ae8e57c97 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:40.659709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8b1827d9-9170-4104-8b20-9c9ae8e57c97 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:40.666217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8d91d92-43a0-43da-a04b-3fce77ea7979 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:40.667184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b1827d9-9170-4104-8b20-9c9ae8e57c97 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:40.667327 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8d91d92-43a0-43da-a04b-3fce77ea7979 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:40.667918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b1827d9-9170-4104-8b20-9c9ae8e57c97 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:40.668075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8d91d92-43a0-43da-a04b-3fce77ea7979 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:40.668555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8d91d92-43a0-43da-a04b-3fce77ea7979 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:40.669208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b1827d9-9170-4104-8b20-9c9ae8e57c97 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:40.669849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b1827d9-9170-4104-8b20-9c9ae8e57c97 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:40.857884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-8b1827d9-9170-4104-8b20-9c9ae8e57c97 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid fcbae58d-a326-4197-a350-9278d664d3e7 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:41:40.900555 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8b1827d9-9170-4104-8b20-9c9ae8e57c97 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 2422 microversion: 2.25 time: 0.244994 Jul 28 03:41:40.902160 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 712/1380] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:40 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 2422 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:41:40.908647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5a44f814-c98e-4ff6-8822-216d2751c7f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:40.909547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5a44f814-c98e-4ff6-8822-216d2751c7f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:40.943714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a44f814-c98e-4ff6-8822-216d2751c7f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:40.945688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a44f814-c98e-4ff6-8822-216d2751c7f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:40.948562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a44f814-c98e-4ff6-8822-216d2751c7f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:40.949895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a44f814-c98e-4ff6-8822-216d2751c7f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:40.978534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c8d91d92-43a0-43da-a04b-3fce77ea7979 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:40.991051 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c8d91d92-43a0-43da-a04b-3fce77ea7979 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.379962 Jul 28 03:41:40.991652 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 669/1381] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:40 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:41.000082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-04f7b291-36fb-4d31-abfb-c1393cb34096 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:41.001032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-04f7b291-36fb-4d31-abfb-c1393cb34096 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:41.008891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04f7b291-36fb-4d31-abfb-c1393cb34096 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:41.009353 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04f7b291-36fb-4d31-abfb-c1393cb34096 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:41.010204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04f7b291-36fb-4d31-abfb-c1393cb34096 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:41.010704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04f7b291-36fb-4d31-abfb-c1393cb34096 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:41.175767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5a44f814-c98e-4ff6-8822-216d2751c7f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:41.185409 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5a44f814-c98e-4ff6-8822-216d2751c7f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.280976 Jul 28 03:41:41.185746 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 713/1382] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:40 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:41.254021 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-04f7b291-36fb-4d31-abfb-c1393cb34096 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid fcbae58d-a326-4197-a350-9278d664d3e7 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:41:41.276707 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-04f7b291-36fb-4d31-abfb-c1393cb34096 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 2422 microversion: 2.25 time: 0.280591 Jul 28 03:41:41.277628 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 670/1383] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:41:40 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 2422 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:41:41.412563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf13258e-eae2-41c8-98f3-1a8c8e3caaaa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:41.423075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cf13258e-eae2-41c8-98f3-1a8c8e3caaaa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:41.445178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf13258e-eae2-41c8-98f3-1a8c8e3caaaa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:41.446431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf13258e-eae2-41c8-98f3-1a8c8e3caaaa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:41.447682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf13258e-eae2-41c8-98f3-1a8c8e3caaaa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:41.449332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf13258e-eae2-41c8-98f3-1a8c8e3caaaa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:41.600432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-cf13258e-eae2-41c8-98f3-1a8c8e3caaaa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lazy-loading 'services' on Instance uuid fcbae58d-a326-4197-a350-9278d664d3e7 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:41:41.614369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4db3bf33-5fb6-48e4-b82d-eedce23cea6f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:41.617541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4db3bf33-5fb6-48e4-b82d-eedce23cea6f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:41.636324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4db3bf33-5fb6-48e4-b82d-eedce23cea6f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:41.636809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4db3bf33-5fb6-48e4-b82d-eedce23cea6f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:41.641291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4db3bf33-5fb6-48e4-b82d-eedce23cea6f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:41.642051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4db3bf33-5fb6-48e4-b82d-eedce23cea6f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:41.725820 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4db3bf33-5fb6-48e4-b82d-eedce23cea6f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action" status: 200 len: 14 microversion: 2.1 time: 0.115997 Jul 28 03:41:41.726849 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 671/1384] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:41 2022] POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:41:41.754221 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf13258e-eae2-41c8-98f3-1a8c8e3caaaa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments/ef4be6a5-aa12-47c2-82f1-3db1ef0201f3" status: 202 len: 0 microversion: 2.25 time: 0.346837 Jul 28 03:41:41.755057 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 714/1385] 10.222.0.48 () {60 vars in 1457 bytes} [Thu Jul 28 03:41:41 2022] DELETE /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments/ef4be6a5-aa12-47c2-82f1-3db1ef0201f3 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:41:41.783788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-92a347b6-f3b5-47d6-8838-0dadc0bc2383 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:41.787205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-92a347b6-f3b5-47d6-8838-0dadc0bc2383 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:41.798906 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92a347b6-f3b5-47d6-8838-0dadc0bc2383 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:41.800115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92a347b6-f3b5-47d6-8838-0dadc0bc2383 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:41.801391 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92a347b6-f3b5-47d6-8838-0dadc0bc2383 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:41.802247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92a347b6-f3b5-47d6-8838-0dadc0bc2383 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:41.885171 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-92a347b6-f3b5-47d6-8838-0dadc0bc2383 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.122872 Jul 28 03:41:41.893200 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 672/1386] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:41:41 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:41:42.015910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ada28828-b5cf-44c9-988c-ec2e7f171b0f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:42.017546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ada28828-b5cf-44c9-988c-ec2e7f171b0f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:42.029226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ada28828-b5cf-44c9-988c-ec2e7f171b0f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:42.029752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ada28828-b5cf-44c9-988c-ec2e7f171b0f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:42.030804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ada28828-b5cf-44c9-988c-ec2e7f171b0f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:42.031372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ada28828-b5cf-44c9-988c-ec2e7f171b0f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:42.207730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8bb7ac74-e152-47a2-bb74-8815b81fedc0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:42.209127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8bb7ac74-e152-47a2-bb74-8815b81fedc0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:42.224238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bb7ac74-e152-47a2-bb74-8815b81fedc0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:42.226689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ada28828-b5cf-44c9-988c-ec2e7f171b0f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:42.231590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bb7ac74-e152-47a2-bb74-8815b81fedc0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:42.232724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bb7ac74-e152-47a2-bb74-8815b81fedc0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:42.233146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bb7ac74-e152-47a2-bb74-8815b81fedc0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:42.239699 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ada28828-b5cf-44c9-988c-ec2e7f171b0f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.229893 Jul 28 03:41:42.240635 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 715/1387] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:42 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:41:42.437429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8bb7ac74-e152-47a2-bb74-8815b81fedc0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:42.450429 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8bb7ac74-e152-47a2-bb74-8815b81fedc0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.246951 Jul 28 03:41:42.451361 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 673/1388] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:42 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:42.748587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a5e88c60-734f-4555-af63-016c1a0ad426 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:42.756484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a5e88c60-734f-4555-af63-016c1a0ad426 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:42.773013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5e88c60-734f-4555-af63-016c1a0ad426 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:42.774395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5e88c60-734f-4555-af63-016c1a0ad426 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:42.777010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5e88c60-734f-4555-af63-016c1a0ad426 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:42.778565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5e88c60-734f-4555-af63-016c1a0ad426 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:42.833213 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a5e88c60-734f-4555-af63-016c1a0ad426 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action" status: 200 len: 14 microversion: 2.1 time: 0.097623 Jul 28 03:41:42.833964 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 716/1389] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:42 2022] POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:41:42.904737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3c412e92-0794-4704-aaad-398901de2e34 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:42.907858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3c412e92-0794-4704-aaad-398901de2e34 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:42.918273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c412e92-0794-4704-aaad-398901de2e34 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:42.919548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c412e92-0794-4704-aaad-398901de2e34 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:42.920727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c412e92-0794-4704-aaad-398901de2e34 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:42.921442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c412e92-0794-4704-aaad-398901de2e34 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:42.979717 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3c412e92-0794-4704-aaad-398901de2e34 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081040 Jul 28 03:41:42.980698 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 717/1390] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:41:42 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:41:43.023556 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-853d3c29-7c06-488c-b890-624c762e7773 tempest-NetworksTest-1387034021 tempest-NetworksTest-1387034021-project-admin] Calling method '.version_select at 0x7ffa746983a0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:43.262647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47287f06-8a5d-4560-9f76-1d13497a88a2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:43.263512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-47287f06-8a5d-4560-9f76-1d13497a88a2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:43.274581 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-853d3c29-7c06-488c-b890-624c762e7773 tempest-NetworksTest-1387034021 tempest-NetworksTest-1387034021-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks" status: 200 len: 8783 microversion: 2.1 time: 0.442457 Jul 28 03:41:43.275131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47287f06-8a5d-4560-9f76-1d13497a88a2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:43.275616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47287f06-8a5d-4560-9f76-1d13497a88a2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:43.276743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47287f06-8a5d-4560-9f76-1d13497a88a2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:43.276885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47287f06-8a5d-4560-9f76-1d13497a88a2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:43.280658 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 674/1391] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:41:42 2022] GET /compute/v2.1/os-networks => generated 8783 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:41:43.286481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-75bf432f-3694-4033-8ce7-240ba4162398 tempest-NetworksTest-1387034021 tempest-NetworksTest-1387034021-project-admin] Calling method '.version_select at 0x7ffa7469e550>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:43.403917 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-75bf432f-3694-4033-8ce7-240ba4162398 tempest-NetworksTest-1387034021 tempest-NetworksTest-1387034021-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks/a00943e5-a0eb-4dda-9987-6ff19b962697" status: 200 len: 652 microversion: 2.1 time: 0.121858 Jul 28 03:41:43.409981 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 675/1392] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:41:43 2022] GET /compute/v2.1/os-networks/a00943e5-a0eb-4dda-9987-6ff19b962697 => generated 652 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:43.415364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-944e5d47-dcae-4e95-adf3-dd75d46ef052 tempest-NetworksTest-1387034021 tempest-NetworksTest-1387034021-project-admin] Calling method '.version_select at 0x7ffa7469ea60>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:43.499601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-47287f06-8a5d-4560-9f76-1d13497a88a2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:43.512557 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-47287f06-8a5d-4560-9f76-1d13497a88a2 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.253695 Jul 28 03:41:43.513156 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 718/1393] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:43 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:43.518276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4155643a-cccb-47d5-8fa2-490ad093d0c1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:43.519942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4155643a-cccb-47d5-8fa2-490ad093d0c1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:43.526731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4155643a-cccb-47d5-8fa2-490ad093d0c1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:43.527482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4155643a-cccb-47d5-8fa2-490ad093d0c1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:43.530188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4155643a-cccb-47d5-8fa2-490ad093d0c1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:43.530876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4155643a-cccb-47d5-8fa2-490ad093d0c1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:43.567076 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-944e5d47-dcae-4e95-adf3-dd75d46ef052 tempest-NetworksTest-1387034021 tempest-NetworksTest-1387034021-project-admin] 10.222.0.48 "GET /compute/v2.1/os-networks" status: 200 len: 8783 microversion: 2.1 time: 0.154745 Jul 28 03:41:43.567824 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 676/1394] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:41:43 2022] GET /compute/v2.1/os-networks => generated 8783 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:43.777272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4155643a-cccb-47d5-8fa2-490ad093d0c1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:43.789970 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4155643a-cccb-47d5-8fa2-490ad093d0c1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.275137 Jul 28 03:41:43.803946 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 719/1395] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:43 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:43.846191 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-72281c22-bd93-4dc5-be0e-cd97cbdf9052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:43.850072 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-72281c22-bd93-4dc5-be0e-cd97cbdf9052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:43.858471 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72281c22-bd93-4dc5-be0e-cd97cbdf9052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:43.859198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72281c22-bd93-4dc5-be0e-cd97cbdf9052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:43.860156 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72281c22-bd93-4dc5-be0e-cd97cbdf9052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:43.860791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72281c22-bd93-4dc5-be0e-cd97cbdf9052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:43.907787 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-72281c22-bd93-4dc5-be0e-cd97cbdf9052 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action" status: 200 len: 14 microversion: 2.1 time: 0.067343 Jul 28 03:41:43.912278 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 677/1396] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:43 2022] POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:41:43.995889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7398077e-bb14-4db6-b5da-4af8bbbf9d4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:43.999454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7398077e-bb14-4db6-b5da-4af8bbbf9d4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:44.009508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:44.012027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7398077e-bb14-4db6-b5da-4af8bbbf9d4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:44.012853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7398077e-bb14-4db6-b5da-4af8bbbf9d4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:44.014552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7398077e-bb14-4db6-b5da-4af8bbbf9d4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:44.015998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7398077e-bb14-4db6-b5da-4af8bbbf9d4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:44.093731 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7398077e-bb14-4db6-b5da-4af8bbbf9d4b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.105940 Jul 28 03:41:44.100434 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 720/1397] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:41:43 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:41:44.538239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b52dc2c-7d47-4395-bd72-d059be4065f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:44.551553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2b52dc2c-7d47-4395-bd72-d059be4065f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:44.566602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b52dc2c-7d47-4395-bd72-d059be4065f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:44.566902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b52dc2c-7d47-4395-bd72-d059be4065f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:44.573696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b52dc2c-7d47-4395-bd72-d059be4065f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:44.573910 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b52dc2c-7d47-4395-bd72-d059be4065f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:44.812698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a28ac661-6697-4347-a7eb-c30ba84605a4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:44.813956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a28ac661-6697-4347-a7eb-c30ba84605a4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:44.827388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2b52dc2c-7d47-4395-bd72-d059be4065f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:44.836010 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2b52dc2c-7d47-4395-bd72-d059be4065f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.305548 Jul 28 03:41:44.836634 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 678/1398] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:44 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:44.839429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a28ac661-6697-4347-a7eb-c30ba84605a4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:44.839899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a28ac661-6697-4347-a7eb-c30ba84605a4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:44.840735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a28ac661-6697-4347-a7eb-c30ba84605a4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:44.841176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a28ac661-6697-4347-a7eb-c30ba84605a4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:44.856471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:44.919774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-61c6144f-535a-4258-b855-9487e7efce18 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:44.922115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-61c6144f-535a-4258-b855-9487e7efce18 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:44.944218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-61c6144f-535a-4258-b855-9487e7efce18 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:44.944704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-61c6144f-535a-4258-b855-9487e7efce18 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:44.945589 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-61c6144f-535a-4258-b855-9487e7efce18 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:44.946072 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-61c6144f-535a-4258-b855-9487e7efce18 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:45.046129 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-61c6144f-535a-4258-b855-9487e7efce18 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action" status: 200 len: 14 microversion: 2.1 time: 0.129575 Jul 28 03:41:45.047409 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 679/1399] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:44 2022] POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:41:45.107367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9d665713-a7d8-4abb-983a-334d2c9eb6c4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:45.114937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9d665713-a7d8-4abb-983a-334d2c9eb6c4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:45.135622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d665713-a7d8-4abb-983a-334d2c9eb6c4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:45.136081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d665713-a7d8-4abb-983a-334d2c9eb6c4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:45.145175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a28ac661-6697-4347-a7eb-c30ba84605a4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:45.145416 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d665713-a7d8-4abb-983a-334d2c9eb6c4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:45.145661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d665713-a7d8-4abb-983a-334d2c9eb6c4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:45.158152 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a28ac661-6697-4347-a7eb-c30ba84605a4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.349883 Jul 28 03:41:45.159675 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 721/1400] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:44 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:41:45.221998 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9d665713-a7d8-4abb-983a-334d2c9eb6c4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119256 Jul 28 03:41:45.227378 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 680/1401] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:41:45 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:41:45.488623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c5e6e0ee-732d-491c-8d7c-ad1fbc5b0a2b req-2df3b78f-15be-4625-8ae5-b89d4a2d535e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76", "name": "network-vif-unplugged", "status": "completed", "tag": "a8b69e61-4d26-492e-8d90-78fee625d19c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:45.533670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c5e6e0ee-732d-491c-8d7c-ad1fbc5b0a2b req-2df3b78f-15be-4625-8ae5-b89d4a2d535e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:45.537646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c5e6e0ee-732d-491c-8d7c-ad1fbc5b0a2b req-2df3b78f-15be-4625-8ae5-b89d4a2d535e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:45.585720 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c5e6e0ee-732d-491c-8d7c-ad1fbc5b0a2b req-2df3b78f-15be-4625-8ae5-b89d4a2d535e service nova] Creating event network-vif-unplugged:a8b69e61-4d26-492e-8d90-78fee625d19c for instance 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 on n-h2-826756-3 Jul 28 03:41:45.599532 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c5e6e0ee-732d-491c-8d7c-ad1fbc5b0a2b req-2df3b78f-15be-4625-8ae5-b89d4a2d535e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114229 Jul 28 03:41:45.600228 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 722/1402] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:41:45.873641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-89ba95b6-8e8b-4306-8480-dd92764d1008 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:45.874252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-89ba95b6-8e8b-4306-8480-dd92764d1008 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:45.882530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-89ba95b6-8e8b-4306-8480-dd92764d1008 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:45.882971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-89ba95b6-8e8b-4306-8480-dd92764d1008 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:45.883754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-89ba95b6-8e8b-4306-8480-dd92764d1008 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:45.896831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-89ba95b6-8e8b-4306-8480-dd92764d1008 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:46.059890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e1b64577-15a7-4f16-898d-51b9d252222a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:46.064798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e1b64577-15a7-4f16-898d-51b9d252222a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:46.090869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1b64577-15a7-4f16-898d-51b9d252222a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:46.091365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1b64577-15a7-4f16-898d-51b9d252222a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:46.092558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1b64577-15a7-4f16-898d-51b9d252222a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:46.093004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1b64577-15a7-4f16-898d-51b9d252222a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:46.193328 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e1b64577-15a7-4f16-898d-51b9d252222a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action" status: 200 len: 14 microversion: 2.1 time: 0.135859 Jul 28 03:41:46.196720 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 723/1403] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:46 2022] POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:41:46.227049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93a15f95-111a-4d66-a4c2-1e788c54c388 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:46.228114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93a15f95-111a-4d66-a4c2-1e788c54c388 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:46.242418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93a15f95-111a-4d66-a4c2-1e788c54c388 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:46.243417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93a15f95-111a-4d66-a4c2-1e788c54c388 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:46.244551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93a15f95-111a-4d66-a4c2-1e788c54c388 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:46.245389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93a15f95-111a-4d66-a4c2-1e788c54c388 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:46.574737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93a15f95-111a-4d66-a4c2-1e788c54c388 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:46.597972 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93a15f95-111a-4d66-a4c2-1e788c54c388 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.399216 Jul 28 03:41:46.609276 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 724/1404] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:46 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:46.619496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-861d6348-cf36-4812-99e4-e3a1955098f7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:46.621993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-861d6348-cf36-4812-99e4-e3a1955098f7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:46.630510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-861d6348-cf36-4812-99e4-e3a1955098f7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:46.631058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-861d6348-cf36-4812-99e4-e3a1955098f7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:46.632335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-861d6348-cf36-4812-99e4-e3a1955098f7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:46.632910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-861d6348-cf36-4812-99e4-e3a1955098f7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:46.705261 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-861d6348-cf36-4812-99e4-e3a1955098f7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.094338 Jul 28 03:41:46.706198 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 725/1405] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:41:46 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:41:46.749250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-89ba95b6-8e8b-4306-8480-dd92764d1008 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:46.772036 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-89ba95b6-8e8b-4306-8480-dd92764d1008 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.902516 Jul 28 03:41:46.773472 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 681/1406] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:45 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:47.211059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f98621f-1f82-45b3-beb9-ae73ceeea653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:47.213615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f98621f-1f82-45b3-beb9-ae73ceeea653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:47.232417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f98621f-1f82-45b3-beb9-ae73ceeea653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:47.235376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f98621f-1f82-45b3-beb9-ae73ceeea653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:47.239084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f98621f-1f82-45b3-beb9-ae73ceeea653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:47.242965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f98621f-1f82-45b3-beb9-ae73ceeea653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:47.338967 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f98621f-1f82-45b3-beb9-ae73ceeea653 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action" status: 200 len: 14 microversion: 2.1 time: 0.135888 Jul 28 03:41:47.339988 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 726/1407] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:47 2022] POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:41:47.628763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8e91362e-05a2-4821-963e-c601d3a69959 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:47.630371 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8e91362e-05a2-4821-963e-c601d3a69959 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:47.640924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c339b76b-db44-4383-96a3-ca52791912f1 req-f64b2099-e889-4f34-8040-7274a923f29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76", "tag": "a8b69e61-4d26-492e-8d90-78fee625d19c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:47.655369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e91362e-05a2-4821-963e-c601d3a69959 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:47.661414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c339b76b-db44-4383-96a3-ca52791912f1 req-f64b2099-e889-4f34-8040-7274a923f29e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:47.662565 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e91362e-05a2-4821-963e-c601d3a69959 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:47.663951 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e91362e-05a2-4821-963e-c601d3a69959 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:47.664834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e91362e-05a2-4821-963e-c601d3a69959 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:47.672342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c339b76b-db44-4383-96a3-ca52791912f1 req-f64b2099-e889-4f34-8040-7274a923f29e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:47.709014 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c339b76b-db44-4383-96a3-ca52791912f1 req-f64b2099-e889-4f34-8040-7274a923f29e service nova] Creating event network-changed:a8b69e61-4d26-492e-8d90-78fee625d19c for instance 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 on n-h2-826756-3 Jul 28 03:41:47.720668 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c339b76b-db44-4383-96a3-ca52791912f1 req-f64b2099-e889-4f34-8040-7274a923f29e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083905 Jul 28 03:41:47.724280 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 727/1408] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:47.741385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-006cfb1f-beda-4ce7-bb8d-946b2f2a1348 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:47.751694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-006cfb1f-beda-4ce7-bb8d-946b2f2a1348 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:47.795855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-006cfb1f-beda-4ce7-bb8d-946b2f2a1348 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:47.796319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-006cfb1f-beda-4ce7-bb8d-946b2f2a1348 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:47.803006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-006cfb1f-beda-4ce7-bb8d-946b2f2a1348 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:47.803461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-006cfb1f-beda-4ce7-bb8d-946b2f2a1348 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:47.913455 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-006cfb1f-beda-4ce7-bb8d-946b2f2a1348 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.185022 Jul 28 03:41:47.918378 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 728/1409] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:41:47 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:41:47.927874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c1f399d3-d418-483a-8f1e-dbf2b6bcfd1a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:47.928543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c1f399d3-d418-483a-8f1e-dbf2b6bcfd1a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:47.959742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1f399d3-d418-483a-8f1e-dbf2b6bcfd1a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:47.960487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1f399d3-d418-483a-8f1e-dbf2b6bcfd1a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:47.961370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1f399d3-d418-483a-8f1e-dbf2b6bcfd1a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:47.961913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1f399d3-d418-483a-8f1e-dbf2b6bcfd1a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:48.384611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c1f399d3-d418-483a-8f1e-dbf2b6bcfd1a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:48.417177 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c1f399d3-d418-483a-8f1e-dbf2b6bcfd1a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.492594 Jul 28 03:41:48.419225 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 729/1410] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:47 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:48.426817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bfc14c45-48e6-432a-a95e-657d4d5cda2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:48.429821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bfc14c45-48e6-432a-a95e-657d4d5cda2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:48.446942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfc14c45-48e6-432a-a95e-657d4d5cda2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:48.448768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfc14c45-48e6-432a-a95e-657d4d5cda2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:48.451068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfc14c45-48e6-432a-a95e-657d4d5cda2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:48.452962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfc14c45-48e6-432a-a95e-657d4d5cda2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:48.532900 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bfc14c45-48e6-432a-a95e-657d4d5cda2e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action" status: 200 len: 14 microversion: 2.1 time: 0.111996 Jul 28 03:41:48.535277 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 730/1411] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:48 2022] POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:41:48.635045 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8e91362e-05a2-4821-963e-c601d3a69959 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:48.651695 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8e91362e-05a2-4821-963e-c601d3a69959 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 1.026860 Jul 28 03:41:48.654734 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 682/1412] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:47 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:48.936144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-52d971f8-acfb-42dd-9d99-1e404b32ac30 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:48.942871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-52d971f8-acfb-42dd-9d99-1e404b32ac30 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:48.963123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=10 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:48.970058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52d971f8-acfb-42dd-9d99-1e404b32ac30 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:48.970640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52d971f8-acfb-42dd-9d99-1e404b32ac30 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:48.980942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=8 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:48.984089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52d971f8-acfb-42dd-9d99-1e404b32ac30 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:48.989646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52d971f8-acfb-42dd-9d99-1e404b32ac30 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:49.120962 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-52d971f8-acfb-42dd-9d99-1e404b32ac30 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.192081 Jul 28 03:41:49.127283 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 731/1413] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:41:48 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:41:49.286755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-136534837", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:49.408197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:41:49.447688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-42353f82-66c2-474a-a93d-0fa81d22a373 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:49.448520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-42353f82-66c2-474a-a93d-0fa81d22a373 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:49.462906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42353f82-66c2-474a-a93d-0fa81d22a373 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:49.464542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42353f82-66c2-474a-a93d-0fa81d22a373 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:49.470055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42353f82-66c2-474a-a93d-0fa81d22a373 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:49.470654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42353f82-66c2-474a-a93d-0fa81d22a373 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:49.742220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-42353f82-66c2-474a-a93d-0fa81d22a373 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:49.752836 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-42353f82-66c2-474a-a93d-0fa81d22a373 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.310044 Jul 28 03:41:49.753524 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 732/1414] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:49 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:41:49.759776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e9afa1c-de92-4499-a065-c92b2986113e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:49.765601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4e9afa1c-de92-4499-a065-c92b2986113e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:49.780447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e9afa1c-de92-4499-a065-c92b2986113e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:49.781335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e9afa1c-de92-4499-a065-c92b2986113e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:49.782388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e9afa1c-de92-4499-a065-c92b2986113e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:49.783051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e9afa1c-de92-4499-a065-c92b2986113e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:49.871938 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e9afa1c-de92-4499-a065-c92b2986113e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action" status: 200 len: 14 microversion: 2.1 time: 0.112093 Jul 28 03:41:49.875617 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 733/1415] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:49 2022] POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:41:49.888505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0dff993-1dd2-4802-83bb-bf11dbaeb1d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:49.890009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e0dff993-1dd2-4802-83bb-bf11dbaeb1d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:49.900201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0dff993-1dd2-4802-83bb-bf11dbaeb1d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:49.901682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0dff993-1dd2-4802-83bb-bf11dbaeb1d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:49.902708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0dff993-1dd2-4802-83bb-bf11dbaeb1d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:49.903601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0dff993-1dd2-4802-83bb-bf11dbaeb1d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:49.947681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:41:49.948435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:41:49.948980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:41:49.949494 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:41:49.950810 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:41:49.964779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:49.965615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:49.967422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:49.968508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:49.995857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:41:50.019393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:41:50.056315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:41:50.059357 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:41:50.145670 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-414e6de3-d00a-4f51-9e6f-44345cc41191 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.170823 Jul 28 03:41:50.148259 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 683/1416] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:41:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:41:50.153881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e0dff993-1dd2-4802-83bb-bf11dbaeb1d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:50.155839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ea2705aa-d2e0-4b88-9be9-8b08924c2075 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:50.160295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ea2705aa-d2e0-4b88-9be9-8b08924c2075 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:50.170182 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e0dff993-1dd2-4802-83bb-bf11dbaeb1d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.288446 Jul 28 03:41:50.170182 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 734/1417] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:49 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:50.173499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea2705aa-d2e0-4b88-9be9-8b08924c2075 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:50.174496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea2705aa-d2e0-4b88-9be9-8b08924c2075 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:50.175634 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea2705aa-d2e0-4b88-9be9-8b08924c2075 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:50.176444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea2705aa-d2e0-4b88-9be9-8b08924c2075 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:50.177965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ab8da13-a5e7-4b02-a649-964123462559 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:50.179348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5ab8da13-a5e7-4b02-a649-964123462559 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:50.228924 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ea2705aa-d2e0-4b88-9be9-8b08924c2075 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.078758 Jul 28 03:41:50.232473 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 684/1418] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:41:50 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:50.276124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ab8da13-a5e7-4b02-a649-964123462559 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:50.287918 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ab8da13-a5e7-4b02-a649-964123462559 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1216 microversion: 2.1 time: 0.116578 Jul 28 03:41:50.288863 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 735/1419] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:50 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1216 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:50.786258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8c3e7000-dd0f-48f7-805d-a518071f5f14 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:50.791970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8c3e7000-dd0f-48f7-805d-a518071f5f14 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:50.820846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c3e7000-dd0f-48f7-805d-a518071f5f14 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:50.823259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c3e7000-dd0f-48f7-805d-a518071f5f14 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:50.827064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c3e7000-dd0f-48f7-805d-a518071f5f14 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:50.835169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c3e7000-dd0f-48f7-805d-a518071f5f14 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:50.890960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4bcd7ac-ac9f-44c6-befe-2433e18620df tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:50.897608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d4bcd7ac-ac9f-44c6-befe-2433e18620df tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:50.919419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4bcd7ac-ac9f-44c6-befe-2433e18620df tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:50.919879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4bcd7ac-ac9f-44c6-befe-2433e18620df tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:50.926157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4bcd7ac-ac9f-44c6-befe-2433e18620df tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:50.926664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4bcd7ac-ac9f-44c6-befe-2433e18620df tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:51.067085 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d4bcd7ac-ac9f-44c6-befe-2433e18620df tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action" status: 200 len: 14 microversion: 2.1 time: 0.182876 Jul 28 03:41:51.068224 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 736/1420] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:50 2022] POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:41:51.203962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-01fa86e7-e358-4dc1-bae4-3fe8e192eb5e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:51.205916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-01fa86e7-e358-4dc1-bae4-3fe8e192eb5e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:51.258618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01fa86e7-e358-4dc1-bae4-3fe8e192eb5e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:51.267221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01fa86e7-e358-4dc1-bae4-3fe8e192eb5e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:51.273923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01fa86e7-e358-4dc1-bae4-3fe8e192eb5e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:51.275949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01fa86e7-e358-4dc1-bae4-3fe8e192eb5e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:51.429801 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8c3e7000-dd0f-48f7-805d-a518071f5f14 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:51.444149 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8c3e7000-dd0f-48f7-805d-a518071f5f14 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.670567 Jul 28 03:41:51.463999 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 685/1421] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:50 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:41:51.484994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-edc706ac-3eab-4521-9ef8-0366927f57b6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:51.485983 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-edc706ac-3eab-4521-9ef8-0366927f57b6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:51.497598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-edc706ac-3eab-4521-9ef8-0366927f57b6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:51.503082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-edc706ac-3eab-4521-9ef8-0366927f57b6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:51.505311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-edc706ac-3eab-4521-9ef8-0366927f57b6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:51.506004 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-edc706ac-3eab-4521-9ef8-0366927f57b6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:51.551059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:51.827306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-edc706ac-3eab-4521-9ef8-0366927f57b6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:51.851239 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-edc706ac-3eab-4521-9ef8-0366927f57b6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1212 microversion: 2.1 time: 0.385726 Jul 28 03:41:51.852216 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 686/1422] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:51 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1212 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:51.898280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-01fa86e7-e358-4dc1-bae4-3fe8e192eb5e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:51.934376 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-01fa86e7-e358-4dc1-bae4-3fe8e192eb5e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.744463 Jul 28 03:41:51.936635 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 737/1423] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:51 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:52.083845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cab9b489-d2ab-4fdb-a7e7-f1820abea903 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:52.086288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cab9b489-d2ab-4fdb-a7e7-f1820abea903 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:52.104759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cab9b489-d2ab-4fdb-a7e7-f1820abea903 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:52.106918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cab9b489-d2ab-4fdb-a7e7-f1820abea903 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:52.108167 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cab9b489-d2ab-4fdb-a7e7-f1820abea903 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:52.108657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cab9b489-d2ab-4fdb-a7e7-f1820abea903 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:52.190699 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cab9b489-d2ab-4fdb-a7e7-f1820abea903 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action" status: 200 len: 14 microversion: 2.1 time: 0.113193 Jul 28 03:41:52.191740 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 687/1424] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:52 2022] POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:41:52.476290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-67641ed4-57e9-449a-81aa-c413f8092cff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:52.477116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-67641ed4-57e9-449a-81aa-c413f8092cff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:52.512536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67641ed4-57e9-449a-81aa-c413f8092cff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:52.513048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67641ed4-57e9-449a-81aa-c413f8092cff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:52.514880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67641ed4-57e9-449a-81aa-c413f8092cff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:52.516268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67641ed4-57e9-449a-81aa-c413f8092cff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:52.790182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-67641ed4-57e9-449a-81aa-c413f8092cff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:52.800470 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-67641ed4-57e9-449a-81aa-c413f8092cff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.328744 Jul 28 03:41:52.805775 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 738/1425] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:52 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:52.888445 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7424d9d4-5c5d-46c1-b3ef-8c30f5f15dd4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:52.890071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7424d9d4-5c5d-46c1-b3ef-8c30f5f15dd4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:52.909456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7424d9d4-5c5d-46c1-b3ef-8c30f5f15dd4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:52.915590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7424d9d4-5c5d-46c1-b3ef-8c30f5f15dd4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:52.917855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7424d9d4-5c5d-46c1-b3ef-8c30f5f15dd4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:52.919069 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7424d9d4-5c5d-46c1-b3ef-8c30f5f15dd4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:52.960030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-afb1453b-8755-484f-8bd2-c93fc6518b84 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:52.961333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-afb1453b-8755-484f-8bd2-c93fc6518b84 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:52.981819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afb1453b-8755-484f-8bd2-c93fc6518b84 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:52.985549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afb1453b-8755-484f-8bd2-c93fc6518b84 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:52.986587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afb1453b-8755-484f-8bd2-c93fc6518b84 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:52.987233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afb1453b-8755-484f-8bd2-c93fc6518b84 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:53.401383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-afb1453b-8755-484f-8bd2-c93fc6518b84 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:53.420591 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-afb1453b-8755-484f-8bd2-c93fc6518b84 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.462899 Jul 28 03:41:53.421527 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 739/1426] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:52 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:41:53.429811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-feb0dce0-f214-4e51-a8c5-b6c4cf25425b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:53.432186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-feb0dce0-f214-4e51-a8c5-b6c4cf25425b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:53.458393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb0dce0-f214-4e51-a8c5-b6c4cf25425b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:53.458771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb0dce0-f214-4e51-a8c5-b6c4cf25425b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:53.476840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb0dce0-f214-4e51-a8c5-b6c4cf25425b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:53.477582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb0dce0-f214-4e51-a8c5-b6c4cf25425b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:53.549074 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-feb0dce0-f214-4e51-a8c5-b6c4cf25425b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action" status: 200 len: 14 microversion: 2.1 time: 0.125384 Jul 28 03:41:53.550823 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 740/1427] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:53 2022] POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:41:53.806532 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7424d9d4-5c5d-46c1-b3ef-8c30f5f15dd4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:53.829810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-72d01c77-efdf-4fb4-9b1b-cd1a75624b1d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:53.830993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-72d01c77-efdf-4fb4-9b1b-cd1a75624b1d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:53.846617 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7424d9d4-5c5d-46c1-b3ef-8c30f5f15dd4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1274 microversion: 2.1 time: 0.964180 Jul 28 03:41:53.853029 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 688/1428] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:52 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1274 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:53.858346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72d01c77-efdf-4fb4-9b1b-cd1a75624b1d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:53.858801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72d01c77-efdf-4fb4-9b1b-cd1a75624b1d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:53.859603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72d01c77-efdf-4fb4-9b1b-cd1a75624b1d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:53.860045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72d01c77-efdf-4fb4-9b1b-cd1a75624b1d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:54.190836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-72d01c77-efdf-4fb4-9b1b-cd1a75624b1d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:54.207490 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-72d01c77-efdf-4fb4-9b1b-cd1a75624b1d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.385584 Jul 28 03:41:54.214458 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 741/1429] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:53 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:54.444311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c0257059-506b-4334-8f9e-a8eb8a94f13c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:54.446029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c0257059-506b-4334-8f9e-a8eb8a94f13c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:54.463212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0257059-506b-4334-8f9e-a8eb8a94f13c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:54.465660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0257059-506b-4334-8f9e-a8eb8a94f13c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:54.468939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0257059-506b-4334-8f9e-a8eb8a94f13c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:54.470238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0257059-506b-4334-8f9e-a8eb8a94f13c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:54.565335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ad6ee342-bf4f-4b6d-aa87-0f48634500a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:54.568076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ad6ee342-bf4f-4b6d-aa87-0f48634500a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:54.605683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad6ee342-bf4f-4b6d-aa87-0f48634500a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:54.606399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad6ee342-bf4f-4b6d-aa87-0f48634500a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:54.611200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad6ee342-bf4f-4b6d-aa87-0f48634500a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:54.612036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad6ee342-bf4f-4b6d-aa87-0f48634500a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:54.627113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:41:54.713034 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ad6ee342-bf4f-4b6d-aa87-0f48634500a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action" status: 200 len: 14 microversion: 2.1 time: 0.152212 Jul 28 03:41:54.716267 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 742/1430] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:54 2022] POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:41:54.874071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-199cd9fc-4a8a-40fd-9a16-70976ea573a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:54.875093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-199cd9fc-4a8a-40fd-9a16-70976ea573a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:54.894676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-199cd9fc-4a8a-40fd-9a16-70976ea573a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:54.895415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-199cd9fc-4a8a-40fd-9a16-70976ea573a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:54.896588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-199cd9fc-4a8a-40fd-9a16-70976ea573a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:54.897211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-199cd9fc-4a8a-40fd-9a16-70976ea573a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:54.984666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c0257059-506b-4334-8f9e-a8eb8a94f13c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:55.002588 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c0257059-506b-4334-8f9e-a8eb8a94f13c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.564085 Jul 28 03:41:55.011609 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 689/1431] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:54 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:55.134131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-199cd9fc-4a8a-40fd-9a16-70976ea573a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:55.149444 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-199cd9fc-4a8a-40fd-9a16-70976ea573a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1274 microversion: 2.1 time: 0.278081 Jul 28 03:41:55.152022 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 743/1432] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:54 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1274 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:55.233310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a3dd6c5c-c98a-4381-bdad-562d9da3e976 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:55.234531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a3dd6c5c-c98a-4381-bdad-562d9da3e976 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:55.259288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3dd6c5c-c98a-4381-bdad-562d9da3e976 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:55.259939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3dd6c5c-c98a-4381-bdad-562d9da3e976 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:55.265561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3dd6c5c-c98a-4381-bdad-562d9da3e976 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:55.266925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3dd6c5c-c98a-4381-bdad-562d9da3e976 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:55.741099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1668712417", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "db476184-d60c-46a3-9670-b892a40ef885"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:55.857447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] validate_networks() for [('db476184-d60c-46a3-9670-b892a40ef885', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:41:55.884383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a3dd6c5c-c98a-4381-bdad-562d9da3e976 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:55.896937 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a3dd6c5c-c98a-4381-bdad-562d9da3e976 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.669693 Jul 28 03:41:55.904131 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 690/1433] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:55 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:55.917426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5729c14c-171a-4dc1-bdd7-6004603283ac tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:55.925778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5729c14c-171a-4dc1-bdd7-6004603283ac tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:55.941616 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5729c14c-171a-4dc1-bdd7-6004603283ac tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:55.942358 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5729c14c-171a-4dc1-bdd7-6004603283ac tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:55.944135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5729c14c-171a-4dc1-bdd7-6004603283ac tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:55.947754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5729c14c-171a-4dc1-bdd7-6004603283ac tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:56.078965 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5729c14c-171a-4dc1-bdd7-6004603283ac tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action" status: 200 len: 8203 microversion: 2.1 time: 0.169121 Jul 28 03:41:56.084919 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 691/1434] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:41:55 2022] POST /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b/action => generated 8203 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:56.106024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8b956a78-2442-4bde-a13f-1dde1ac968c9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:56.110970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8b956a78-2442-4bde-a13f-1dde1ac968c9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:56.145511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b956a78-2442-4bde-a13f-1dde1ac968c9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:56.146502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b956a78-2442-4bde-a13f-1dde1ac968c9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:56.147647 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b956a78-2442-4bde-a13f-1dde1ac968c9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:56.149639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b956a78-2442-4bde-a13f-1dde1ac968c9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:56.662007 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8b956a78-2442-4bde-a13f-1dde1ac968c9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:56.680725 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8b956a78-2442-4bde-a13f-1dde1ac968c9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.585096 Jul 28 03:41:56.681928 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 692/1435] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:56 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:56.697328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1051dc5e-9469-4303-b66f-62f09fa90645 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:56.703741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1051dc5e-9469-4303-b66f-62f09fa90645 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:56.723382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1051dc5e-9469-4303-b66f-62f09fa90645 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:56.730837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1051dc5e-9469-4303-b66f-62f09fa90645 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:56.731707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1051dc5e-9469-4303-b66f-62f09fa90645 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:56.732148 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1051dc5e-9469-4303-b66f-62f09fa90645 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:57.242946 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1051dc5e-9469-4303-b66f-62f09fa90645 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:57.280771 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1051dc5e-9469-4303-b66f-62f09fa90645 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.586995 Jul 28 03:41:57.282469 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 693/1436] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:56 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:57.300437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9c457137-d48d-4f18-b197-080396b8d307 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:57.303267 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9c457137-d48d-4f18-b197-080396b8d307 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:57.320374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9c457137-d48d-4f18-b197-080396b8d307 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:57.328152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9c457137-d48d-4f18-b197-080396b8d307 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:57.331348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9c457137-d48d-4f18-b197-080396b8d307 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:57.333390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9c457137-d48d-4f18-b197-080396b8d307 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:57.902080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:41:57.902977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:41:57.906726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:41:57.908982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:41:57.911287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:41:57.959133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:57.965015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:57.966052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:57.966771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:57.999011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9c457137-d48d-4f18-b197-080396b8d307 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:58.048928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Getting quotas for project 9f7680ec7bd44a62be5017f043d4613b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:41:58.058995 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9c457137-d48d-4f18-b197-080396b8d307 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1316 microversion: 2.1 time: 0.768165 Jul 28 03:41:58.086492 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 694/1437] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:57 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1316 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:58.092592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fe08add3-ee79-496b-96d8-1efcbebc1c5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:58.093607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fe08add3-ee79-496b-96d8-1efcbebc1c5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:58.100630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe08add3-ee79-496b-96d8-1efcbebc1c5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:58.101480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe08add3-ee79-496b-96d8-1efcbebc1c5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:58.102487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe08add3-ee79-496b-96d8-1efcbebc1c5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:58.103142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe08add3-ee79-496b-96d8-1efcbebc1c5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:58.103576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Getting quotas for user da34b0ac72d94d2fbd00ea09d805f0fe and project 9f7680ec7bd44a62be5017f043d4613b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:41:58.199704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:41:58.210140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:41:58.370960 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-57d3ff36-9582-4906-9107-a9000bd3d0ce tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.754369 Jul 28 03:41:58.373821 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 744/1438] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:41:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:41:58.400763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-5843bf24-dcf5-4661-84c8-0a5ed5d22439 req-7884bb01-5b4f-42d8-8b23-8c7f40d7292c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76", "name": "network-vif-unplugged", "status": "completed", "tag": "a8b69e61-4d26-492e-8d90-78fee625d19c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:58.435478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5843bf24-dcf5-4661-84c8-0a5ed5d22439 req-7884bb01-5b4f-42d8-8b23-8c7f40d7292c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:58.435946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5843bf24-dcf5-4661-84c8-0a5ed5d22439 req-7884bb01-5b4f-42d8-8b23-8c7f40d7292c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:58.504453 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5843bf24-dcf5-4661-84c8-0a5ed5d22439 req-7884bb01-5b4f-42d8-8b23-8c7f40d7292c service nova] Creating event network-vif-unplugged:a8b69e61-4d26-492e-8d90-78fee625d19c for instance 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 on n-h2-826756-3 Jul 28 03:41:58.535285 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-5843bf24-dcf5-4661-84c8-0a5ed5d22439 req-7884bb01-5b4f-42d8-8b23-8c7f40d7292c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150595 Jul 28 03:41:58.542413 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 745/1439] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:58.564334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3d3069e8-6f81-41a6-8455-38722b0903cd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:58.565529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3d3069e8-6f81-41a6-8455-38722b0903cd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:58.590518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d3069e8-6f81-41a6-8455-38722b0903cd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:58.593815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d3069e8-6f81-41a6-8455-38722b0903cd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:58.603594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d3069e8-6f81-41a6-8455-38722b0903cd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:58.605205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d3069e8-6f81-41a6-8455-38722b0903cd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:58.654819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fe08add3-ee79-496b-96d8-1efcbebc1c5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:58.665544 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fe08add3-ee79-496b-96d8-1efcbebc1c5f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.577260 Jul 28 03:41:58.666145 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 695/1440] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:58 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:58.687927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d3adb6e6-cbc0-43a2-b8a1-0dbc029c162b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:58.689024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d3adb6e6-cbc0-43a2-b8a1-0dbc029c162b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:58.737238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d3adb6e6-cbc0-43a2-b8a1-0dbc029c162b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:58.739357 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d3adb6e6-cbc0-43a2-b8a1-0dbc029c162b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:58.740184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d3adb6e6-cbc0-43a2-b8a1-0dbc029c162b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:58.740656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d3adb6e6-cbc0-43a2-b8a1-0dbc029c162b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:59.230231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d3adb6e6-cbc0-43a2-b8a1-0dbc029c162b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:59.237357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3d3069e8-6f81-41a6-8455-38722b0903cd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:59.243706 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d3adb6e6-cbc0-43a2-b8a1-0dbc029c162b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.570263 Jul 28 03:41:59.247413 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 696/1441] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:58 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:59.256689 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3d3069e8-6f81-41a6-8455-38722b0903cd tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.704418 Jul 28 03:41:59.256689 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 746/1442] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:58 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:59.262816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a791f6c-8ad5-4a1d-a0ed-9e5a3934c190 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:59.265179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9a791f6c-8ad5-4a1d-a0ed-9e5a3934c190 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:59.293394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f0066f40-0fb7-4345-966a-b822cb6a49d8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Action: 'create', calling method: .version_select at 0x7ffa7469ee50>, body: {"keypair": {"name": "tempest-keypair-62642133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+YbmRqb1VRYSmnEmPPBlfkiWtWvbdKM8jaP/2Fctz879d6wC8yay6dgYJRReJXrjQ8ZI16qUJRlYul4CWr90S78lap/Q3707Cbx/l9lSVCC/MFOeQqDNLg6VeRpC82jQ=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:59.341351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-f0066f40-0fb7-4345-966a-b822cb6a49d8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Getting quotas for project a1d6ebac92a1492b8b85a2b30f7c145c. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:41:59.356539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-f0066f40-0fb7-4345-966a-b822cb6a49d8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Getting quotas for user c241cd30b794493abc7fa1d15987c92a and project a1d6ebac92a1492b8b85a2b30f7c145c. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:41:59.433767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9a791f6c-8ad5-4a1d-a0ed-9e5a3934c190 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:41:59.443135 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f0066f40-0fb7-4345-966a-b822cb6a49d8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.42 time: 0.184096 Jul 28 03:41:59.444747 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 697/1443] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Jul 28 03:41:59 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 186 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 03:41:59.451691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-22b1c4f1-c6a2-4b9b-8468-e6ffc03f8d56 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:59.452797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-22b1c4f1-c6a2-4b9b-8468-e6ffc03f8d56 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:59.453561 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9a791f6c-8ad5-4a1d-a0ed-9e5a3934c190 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1224 microversion: 2.1 time: 0.190017 Jul 28 03:41:59.462447 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22b1c4f1-c6a2-4b9b-8468-e6ffc03f8d56 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:59.463212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22b1c4f1-c6a2-4b9b-8468-e6ffc03f8d56 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:59.464222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22b1c4f1-c6a2-4b9b-8468-e6ffc03f8d56 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:59.464891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22b1c4f1-c6a2-4b9b-8468-e6ffc03f8d56 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:59.473039 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 747/1444] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:59 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1224 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:41:59.486765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0fada604-bd5e-4f97-91b7-7a372edc6001 req-1e70a483-4eb8-408c-a093-ce5a591f3539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928e7a74-9453-46fe-a1dd-ebc281e8ea52", "tag": "d259e9d8-82aa-4835-8762-c43089b17976"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:41:59.528818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0fada604-bd5e-4f97-91b7-7a372edc6001 req-1e70a483-4eb8-408c-a093-ce5a591f3539 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:59.530043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0fada604-bd5e-4f97-91b7-7a372edc6001 req-1e70a483-4eb8-408c-a093-ce5a591f3539 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:59.573571 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0fada604-bd5e-4f97-91b7-7a372edc6001 req-1e70a483-4eb8-408c-a093-ce5a591f3539 service nova] Creating event network-changed:d259e9d8-82aa-4835-8762-c43089b17976 for instance 928e7a74-9453-46fe-a1dd-ebc281e8ea52 on n-h1-826756-3 Jul 28 03:41:59.589555 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0fada604-bd5e-4f97-91b7-7a372edc6001 req-1e70a483-4eb8-408c-a093-ce5a591f3539 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115108 Jul 28 03:41:59.594465 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 748/1445] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:41:59.601444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c21052b1-c03d-4d21-9da5-d90bc0226c38 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:41:59.613418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c21052b1-c03d-4d21-9da5-d90bc0226c38 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:41:59.650563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c21052b1-c03d-4d21-9da5-d90bc0226c38 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:59.651019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c21052b1-c03d-4d21-9da5-d90bc0226c38 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:59.658764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c21052b1-c03d-4d21-9da5-d90bc0226c38 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:41:59.659237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c21052b1-c03d-4d21-9da5-d90bc0226c38 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:41:59.981812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:00.139637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-22b1c4f1-c6a2-4b9b-8468-e6ffc03f8d56 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:00.149301 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-22b1c4f1-c6a2-4b9b-8468-e6ffc03f8d56 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1316 microversion: 2.1 time: 0.703221 Jul 28 03:42:00.169672 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 698/1446] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:59 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1316 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:00.183586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bed4158a-a7bf-4724-9ba9-b46fbd136bde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:00.192942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bed4158a-a7bf-4724-9ba9-b46fbd136bde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:00.200154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bed4158a-a7bf-4724-9ba9-b46fbd136bde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:00.201097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bed4158a-a7bf-4724-9ba9-b46fbd136bde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:00.208173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bed4158a-a7bf-4724-9ba9-b46fbd136bde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:00.209358 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bed4158a-a7bf-4724-9ba9-b46fbd136bde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:00.301533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c21052b1-c03d-4d21-9da5-d90bc0226c38 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:00.332711 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c21052b1-c03d-4d21-9da5-d90bc0226c38 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.736500 Jul 28 03:42:00.337117 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 749/1447] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:41:59 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:00.354645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c19f8a7d-0d7e-4aa7-88a4-6a6fa75a3473 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:00.355525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c19f8a7d-0d7e-4aa7-88a4-6a6fa75a3473 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:00.366601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c19f8a7d-0d7e-4aa7-88a4-6a6fa75a3473 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:00.367058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c19f8a7d-0d7e-4aa7-88a4-6a6fa75a3473 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:00.367869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c19f8a7d-0d7e-4aa7-88a4-6a6fa75a3473 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:00.368308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c19f8a7d-0d7e-4aa7-88a4-6a6fa75a3473 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:01.110995 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bed4158a-a7bf-4724-9ba9-b46fbd136bde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:01.136139 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bed4158a-a7bf-4724-9ba9-b46fbd136bde tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.958544 Jul 28 03:42:01.136820 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 699/1448] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:00 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:01.159374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7cb93f8b-1c2a-40d5-b35d-7a61621eb942 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:01.160182 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7cb93f8b-1c2a-40d5-b35d-7a61621eb942 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:01.202138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cb93f8b-1c2a-40d5-b35d-7a61621eb942 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:01.208589 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cb93f8b-1c2a-40d5-b35d-7a61621eb942 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:01.210672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cb93f8b-1c2a-40d5-b35d-7a61621eb942 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:01.212580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cb93f8b-1c2a-40d5-b35d-7a61621eb942 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:01.496258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c19f8a7d-0d7e-4aa7-88a4-6a6fa75a3473 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:01.522718 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c19f8a7d-0d7e-4aa7-88a4-6a6fa75a3473 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 1.179911 Jul 28 03:42:01.525791 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 750/1449] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:00 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:01.575307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1008342b-5413-4a1c-afda-c167f9859c7b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:01.575936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1008342b-5413-4a1c-afda-c167f9859c7b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:01.625706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1008342b-5413-4a1c-afda-c167f9859c7b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:01.627129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1008342b-5413-4a1c-afda-c167f9859c7b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:01.628661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1008342b-5413-4a1c-afda-c167f9859c7b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:01.630441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1008342b-5413-4a1c-afda-c167f9859c7b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:01.831344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1008342b-5413-4a1c-afda-c167f9859c7b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:01.842743 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1008342b-5413-4a1c-afda-c167f9859c7b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1294 microversion: 2.1 time: 0.313808 Jul 28 03:42:01.852266 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 751/1450] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:01 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1294 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:01.865182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f024b6d7-2a56-449c-b2ac-27baddc55bbe tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:01.867438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f024b6d7-2a56-449c-b2ac-27baddc55bbe tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:01.889554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f024b6d7-2a56-449c-b2ac-27baddc55bbe tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:01.890205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f024b6d7-2a56-449c-b2ac-27baddc55bbe tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:01.891221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f024b6d7-2a56-449c-b2ac-27baddc55bbe tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:01.891989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f024b6d7-2a56-449c-b2ac-27baddc55bbe tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:01.977896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7cb93f8b-1c2a-40d5-b35d-7a61621eb942 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:01.996552 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7cb93f8b-1c2a-40d5-b35d-7a61621eb942 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.847827 Jul 28 03:42:01.998298 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 700/1451] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:01 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:02.020673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-49ab4806-e309-4024-b05f-d2d2fe4cdb2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:02.021561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-49ab4806-e309-4024-b05f-d2d2fe4cdb2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:02.057580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-49ab4806-e309-4024-b05f-d2d2fe4cdb2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:02.058122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-49ab4806-e309-4024-b05f-d2d2fe4cdb2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:02.058976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-49ab4806-e309-4024-b05f-d2d2fe4cdb2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:02.059420 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-49ab4806-e309-4024-b05f-d2d2fe4cdb2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:02.194111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-49ab4806-e309-4024-b05f-d2d2fe4cdb2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Locking {{(pid=126072) lock /opt/stack/nova/nova/compute/api.py:4825}} Jul 28 03:42:02.247082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f024b6d7-2a56-449c-b2ac-27baddc55bbe tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:02.266955 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f024b6d7-2a56-449c-b2ac-27baddc55bbe tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1316 microversion: 2.1 time: 0.413226 Jul 28 03:42:02.270650 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 752/1452] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:01 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:02.289059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a3fe0bbd-ee9a-4a30-aafb-e81594e1c3e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:02.290361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a3fe0bbd-ee9a-4a30-aafb-e81594e1c3e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:02.297925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3fe0bbd-ee9a-4a30-aafb-e81594e1c3e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:02.300656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3fe0bbd-ee9a-4a30-aafb-e81594e1c3e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:02.302042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3fe0bbd-ee9a-4a30-aafb-e81594e1c3e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:02.303935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3fe0bbd-ee9a-4a30-aafb-e81594e1c3e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:02.321734 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-49ab4806-e309-4024-b05f-d2d2fe4cdb2f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.305425 Jul 28 03:42:02.323367 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 701/1453] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:42:02 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:42:02.333655 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-631d8b16-bd22-4a1a-90aa-a7a48842cd13 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:02.340996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-631d8b16-bd22-4a1a-90aa-a7a48842cd13 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:02.352690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-631d8b16-bd22-4a1a-90aa-a7a48842cd13 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:02.353711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-631d8b16-bd22-4a1a-90aa-a7a48842cd13 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:02.354799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-631d8b16-bd22-4a1a-90aa-a7a48842cd13 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:02.359114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-631d8b16-bd22-4a1a-90aa-a7a48842cd13 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:02.362604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:02.752310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-631d8b16-bd22-4a1a-90aa-a7a48842cd13 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:02.765593 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-631d8b16-bd22-4a1a-90aa-a7a48842cd13 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.437911 Jul 28 03:42:02.771717 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 702/1454] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:02 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:02.779187 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-60c341b4-3f36-4c0c-b2ff-6a2177edcb44 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:02.782722 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-60c341b4-3f36-4c0c-b2ff-6a2177edcb44 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:02.798441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a3fe0bbd-ee9a-4a30-aafb-e81594e1c3e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:02.800911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-60c341b4-3f36-4c0c-b2ff-6a2177edcb44 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:02.802396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-60c341b4-3f36-4c0c-b2ff-6a2177edcb44 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:02.805460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-60c341b4-3f36-4c0c-b2ff-6a2177edcb44 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:02.806151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-60c341b4-3f36-4c0c-b2ff-6a2177edcb44 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:02.819832 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a3fe0bbd-ee9a-4a30-aafb-e81594e1c3e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.547439 Jul 28 03:42:02.821683 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 753/1455] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:02 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:02.836185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d63038e-c105-475c-bfdb-23d092e842cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:02.860741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d63038e-c105-475c-bfdb-23d092e842cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:02.862028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d63038e-c105-475c-bfdb-23d092e842cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:02.943784 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-5d63038e-c105-475c-bfdb-23d092e842cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] HTTP exception thrown: Instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae is locked Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d63038e-c105-475c-bfdb-23d092e842cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Request method failure captured: Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action HTTP/1.1 Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 15 Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRDP1iWHaD9HAxV7lPiGaBCA98FdCzWWfXnmkEsHPedE1oooQh-xW9JE4w71iBHhRDCvimx8IG2PwPLfvOCapZtWjeVe5xWcXBjyRkBb6hdFDwPdZkSK1ZEyvKcvyrl85YENZuOv85xnb6f8tNb_2DFAB_r9-AWzlzrWYMd8S2Gojo Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: b7bee0b59b0b43ce80623b7aca24111a Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:42:02.955306 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:42:02.957049 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7bee0b59b0b43ce80623b7aca24111a"}]}] Jul 28 03:42:02.957049 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:42:02.957049 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: b7bee0b59b0b43ce80623b7aca24111a Jul 28 03:42:02.957049 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:42:02.957049 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-1388238885-project Jul 28 03:42:02.957049 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:42:02.957049 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:42:02.957049 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 26b9a63a13e1420aa3b7f299456c65e6 Jul 28 03:42:02.957049 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-1388238885-project Jul 28 03:42:02.957049 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:42:02.957049 n-d-826756-3 devstack@n-api.service[126071]: {"os-stop": {}} Jul 28 03:42:02.957049 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:42:02.957049 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae is locked Jul 28 03:42:02.957049 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'cb4b8ffa-dbe6-4e90-a8f5-728addf73aae', 'body': {'os-stop': {}}} Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae is locked Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 28 03:42:02.958058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae is locked Jul 28 03:42:02.959384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:42:02.959384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:42:02.959384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:42:02.959384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:42:02.959384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:42:02.959384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:42:02.959384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:42:02.959384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:42:02.959384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae is locked Jul 28 03:42:02.959384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:42:02.959384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d63038e-c105-475c-bfdb-23d092e842cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Returning 409 to user: Instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae is locked {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:42:02.961106 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5d63038e-c105-475c-bfdb-23d092e842cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 409 len: 107 microversion: 2.1 time: 0.135676 Jul 28 03:42:02.966106 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 754/1456] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:42:02 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 107 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:42:02.981876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bcd3dd91-2c62-415a-8e25-950caad26a67 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:02.982522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bcd3dd91-2c62-415a-8e25-950caad26a67 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:03.015449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcd3dd91-2c62-415a-8e25-950caad26a67 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:03.016215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcd3dd91-2c62-415a-8e25-950caad26a67 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:03.022842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcd3dd91-2c62-415a-8e25-950caad26a67 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:03.026909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcd3dd91-2c62-415a-8e25-950caad26a67 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:03.534206 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-60c341b4-3f36-4c0c-b2ff-6a2177edcb44 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:03.553593 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-60c341b4-3f36-4c0c-b2ff-6a2177edcb44 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1497 microversion: 2.1 time: 0.778491 Jul 28 03:42:03.556278 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 703/1457] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:02 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1497 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:03.561026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bcd3dd91-2c62-415a-8e25-950caad26a67 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:03.570794 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b99385ea-ba37-412e-9b4b-84521d40165b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:03.571613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b99385ea-ba37-412e-9b4b-84521d40165b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:03.588748 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bcd3dd91-2c62-415a-8e25-950caad26a67 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1324 microversion: 2.1 time: 0.621223 Jul 28 03:42:03.593401 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 755/1458] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:02 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1324 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:03.601316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b99385ea-ba37-412e-9b4b-84521d40165b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:03.603041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b99385ea-ba37-412e-9b4b-84521d40165b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:03.603041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b99385ea-ba37-412e-9b4b-84521d40165b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:03.605010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b99385ea-ba37-412e-9b4b-84521d40165b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:03.610291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d48b046-2103-4839-b692-6f60b3e91ca6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:03.617633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6d48b046-2103-4839-b692-6f60b3e91ca6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:03.642144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d48b046-2103-4839-b692-6f60b3e91ca6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:03.642952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d48b046-2103-4839-b692-6f60b3e91ca6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:03.645295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d48b046-2103-4839-b692-6f60b3e91ca6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:03.647965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d48b046-2103-4839-b692-6f60b3e91ca6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:03.706832 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b99385ea-ba37-412e-9b4b-84521d40165b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Unlocking {{(pid=126072) unlock /opt/stack/nova/nova/compute/api.py:4854}} Jul 28 03:42:03.874888 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b99385ea-ba37-412e-9b4b-84521d40165b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.314243 Jul 28 03:42:03.883967 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 704/1459] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:42:03 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:42:03.891987 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a82d3728-cfb6-4492-af04-117aa30e532c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:03.892999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a82d3728-cfb6-4492-af04-117aa30e532c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:03.904468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a82d3728-cfb6-4492-af04-117aa30e532c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:03.905155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a82d3728-cfb6-4492-af04-117aa30e532c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:03.906372 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a82d3728-cfb6-4492-af04-117aa30e532c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:03.907106 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a82d3728-cfb6-4492-af04-117aa30e532c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:03.965865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6d48b046-2103-4839-b692-6f60b3e91ca6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:03.979597 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d48b046-2103-4839-b692-6f60b3e91ca6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1316 microversion: 2.1 time: 0.384632 Jul 28 03:42:03.981315 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 756/1460] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:03 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:03.998998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-729bab19-0bfb-4085-90e5-f9b66c98fb26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:04.016187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-729bab19-0bfb-4085-90e5-f9b66c98fb26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:04.016743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-729bab19-0bfb-4085-90e5-f9b66c98fb26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:04.063247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-729bab19-0bfb-4085-90e5-f9b66c98fb26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Going to try to stop instance {{(pid=126071) force_stop /opt/stack/nova/nova/compute/api.py:2753}} Jul 28 03:42:04.181573 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-729bab19-0bfb-4085-90e5-f9b66c98fb26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.191442 Jul 28 03:42:04.182843 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 757/1461] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:42:03 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:42:04.197586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-855e893a-3e9e-44f6-891c-74df85b48eb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:04.199556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-855e893a-3e9e-44f6-891c-74df85b48eb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:04.214659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-855e893a-3e9e-44f6-891c-74df85b48eb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:04.216095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-855e893a-3e9e-44f6-891c-74df85b48eb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:04.218635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-855e893a-3e9e-44f6-891c-74df85b48eb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:04.219251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-855e893a-3e9e-44f6-891c-74df85b48eb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:04.489111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-855e893a-3e9e-44f6-891c-74df85b48eb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:04.501617 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-855e893a-3e9e-44f6-891c-74df85b48eb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 0.312601 Jul 28 03:42:04.503142 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 758/1462] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:04 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:04.583808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2c9d7766-b6e7-44d8-95f2-b73f6a5f6489 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:04.584607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2c9d7766-b6e7-44d8-95f2-b73f6a5f6489 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:04.593941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c9d7766-b6e7-44d8-95f2-b73f6a5f6489 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:04.595031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c9d7766-b6e7-44d8-95f2-b73f6a5f6489 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:04.596324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c9d7766-b6e7-44d8-95f2-b73f6a5f6489 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:04.596886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c9d7766-b6e7-44d8-95f2-b73f6a5f6489 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:04.731167 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a82d3728-cfb6-4492-af04-117aa30e532c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:04.740184 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a82d3728-cfb6-4492-af04-117aa30e532c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.857125 Jul 28 03:42:04.743685 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 705/1463] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:03 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:04.749469 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-059474fa-a200-4328-8187-a7b152542e77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:04.751838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-059474fa-a200-4328-8187-a7b152542e77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:04.757727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:04.767279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-059474fa-a200-4328-8187-a7b152542e77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:04.767886 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-059474fa-a200-4328-8187-a7b152542e77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:04.768806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-059474fa-a200-4328-8187-a7b152542e77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:04.769548 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-059474fa-a200-4328-8187-a7b152542e77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:04.826657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2c9d7766-b6e7-44d8-95f2-b73f6a5f6489 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:04.837912 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2c9d7766-b6e7-44d8-95f2-b73f6a5f6489 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 200 len: 1474 microversion: 2.1 time: 0.263953 Jul 28 03:42:04.840717 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 759/1464] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:04 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 1474 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:04.864807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-72eed16c-5c50-44e9-a1d2-8b850596e036 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1960134913"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:04.867637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-72eed16c-5c50-44e9-a1d2-8b850596e036 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:04.875475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72eed16c-5c50-44e9-a1d2-8b850596e036 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:04.876288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72eed16c-5c50-44e9-a1d2-8b850596e036 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:04.877281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72eed16c-5c50-44e9-a1d2-8b850596e036 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:04.877951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72eed16c-5c50-44e9-a1d2-8b850596e036 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:05.099084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:05.157025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-059474fa-a200-4328-8187-a7b152542e77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:05.162389 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-72eed16c-5c50-44e9-a1d2-8b850596e036 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "POST /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9/action" status: 202 len: 0 microversion: 2.1 time: 0.289556 Jul 28 03:42:05.170880 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-059474fa-a200-4328-8187-a7b152542e77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1324 microversion: 2.1 time: 0.425038 Jul 28 03:42:05.173927 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 706/1465] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:04 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1324 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:05.174264 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 760/1466] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:42:04 2022] POST /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 28 03:42:05.183277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-57fb034d-4b7f-49b2-b595-5705e0b959ca tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa7471aaf0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:05.187579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-857d582b-163a-4d6f-a09a-986390cec91b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:05.188558 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-857d582b-163a-4d6f-a09a-986390cec91b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:05.197040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-857d582b-163a-4d6f-a09a-986390cec91b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:05.197743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-857d582b-163a-4d6f-a09a-986390cec91b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:05.198769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-857d582b-163a-4d6f-a09a-986390cec91b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:05.199567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-857d582b-163a-4d6f-a09a-986390cec91b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:05.256001 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-57fb034d-4b7f-49b2-b595-5705e0b959ca tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.079953 Jul 28 03:42:05.257246 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 761/1467] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:05 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:05.331834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-201191691", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a8fedbda-e06a-4b75-b3b2-b1f6307908e0"}, {"port": "63bb8bca-6b52-40f6-ad2d-1ef5bfde276f", "tag": "port-1"}, {"port": "643a4f2c-2609-4334-af83-0e2c8308e75c", "tag": "port-2"}, {"uuid": "1fce96f7-a267-4ebc-86ae-ff523769b3f6", "tag": "net-1"}, {"uuid": "1fce96f7-a267-4ebc-86ae-ff523769b3f6"}, {"uuid": "f83cdd17-b9dc-4718-b03c-869683cbcc6e", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f83cdd17-b9dc-4718-b03c-869683cbcc6e", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "016ec2a4-260c-4000-86ab-13469169be59", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "9af0c489-bca6-4b6c-9c43-8e31bb96d48e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "8a772d27-45f3-46d4-ae57-5f1d2ae1d7fa", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--793577514"}], "key_name": "tempest-keypair-62642133", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:05.370201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:05.531813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] validate_networks() for [('a8fedbda-e06a-4b75-b3b2-b1f6307908e0', None, None, None, None, None), (None, None, '63bb8bca-6b52-40f6-ad2d-1ef5bfde276f', None, None, None), (None, None, '643a4f2c-2609-4334-af83-0e2c8308e75c', None, None, None), ('1fce96f7-a267-4ebc-86ae-ff523769b3f6', None, None, None, None, None), ('1fce96f7-a267-4ebc-86ae-ff523769b3f6', None, None, None, None, None), ('f83cdd17-b9dc-4718-b03c-869683cbcc6e', '10.2.2.100', None, None, None, None), ('f83cdd17-b9dc-4718-b03c-869683cbcc6e', '10.2.2.200', None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:42:05.791042 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-857d582b-163a-4d6f-a09a-986390cec91b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:05.799606 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-857d582b-163a-4d6f-a09a-986390cec91b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1316 microversion: 2.1 time: 0.623049 Jul 28 03:42:05.817080 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 707/1468] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:05 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1316 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:05.827807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e3f327f9-8f53-4d3f-8482-d80179f93679 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:05.829111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e3f327f9-8f53-4d3f-8482-d80179f93679 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:05.837348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3f327f9-8f53-4d3f-8482-d80179f93679 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:05.838107 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3f327f9-8f53-4d3f-8482-d80179f93679 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:05.839142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3f327f9-8f53-4d3f-8482-d80179f93679 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:05.839814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3f327f9-8f53-4d3f-8482-d80179f93679 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:06.314805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e3f327f9-8f53-4d3f-8482-d80179f93679 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:06.331829 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e3f327f9-8f53-4d3f-8482-d80179f93679 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 0.512730 Jul 28 03:42:06.338064 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 708/1469] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:05 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:06.346058 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-03efa7ac-91b4-4537-a313-f34491eb928c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:06.347918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-03efa7ac-91b4-4537-a313-f34491eb928c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:06.372125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03efa7ac-91b4-4537-a313-f34491eb928c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:06.374517 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03efa7ac-91b4-4537-a313-f34491eb928c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:06.381498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03efa7ac-91b4-4537-a313-f34491eb928c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:06.382996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03efa7ac-91b4-4537-a313-f34491eb928c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:06.619024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-03efa7ac-91b4-4537-a313-f34491eb928c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:06.632702 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-03efa7ac-91b4-4537-a313-f34491eb928c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1718 microversion: 2.1 time: 0.292215 Jul 28 03:42:06.634399 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 709/1470] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:06 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1718 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:06.655220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e405da3d-1990-4cc2-b036-4e251cd9bf65 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:06.656440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e405da3d-1990-4cc2-b036-4e251cd9bf65 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:06.663959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e405da3d-1990-4cc2-b036-4e251cd9bf65 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:06.665164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e405da3d-1990-4cc2-b036-4e251cd9bf65 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:06.666186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e405da3d-1990-4cc2-b036-4e251cd9bf65 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:06.666854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e405da3d-1990-4cc2-b036-4e251cd9bf65 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:07.014084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e405da3d-1990-4cc2-b036-4e251cd9bf65 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:07.029675 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e405da3d-1990-4cc2-b036-4e251cd9bf65 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1324 microversion: 2.1 time: 0.383199 Jul 28 03:42:07.060270 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 710/1471] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:06 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1324 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:07.065366 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d1b155d1-c5ab-4606-ad68-3353c8c5516e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74657790>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:07.117005 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d1b155d1-c5ab-4606-ad68-3353c8c5516e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.055231 Jul 28 03:42:07.117718 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 711/1472] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:07 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:07.123511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-9ee34623-18f1-4b03-9a51-9904c59ead61 req-a3284aa4-bed6-47c3-ac51-db94e385fb46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "623a67cb-d39e-4de8-877f-a81af9613a10", "tag": "62f765ff-c7d8-4877-9576-bc720cc3f64f"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:07.135922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9ee34623-18f1-4b03-9a51-9904c59ead61 req-a3284aa4-bed6-47c3-ac51-db94e385fb46 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:07.136392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9ee34623-18f1-4b03-9a51-9904c59ead61 req-a3284aa4-bed6-47c3-ac51-db94e385fb46 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:07.150189 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-9ee34623-18f1-4b03-9a51-9904c59ead61 req-a3284aa4-bed6-47c3-ac51-db94e385fb46 service nova] Creating event network-changed:62f765ff-c7d8-4877-9576-bc720cc3f64f for instance 623a67cb-d39e-4de8-877f-a81af9613a10 on n-h2-826756-3 Jul 28 03:42:07.155918 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-9ee34623-18f1-4b03-9a51-9904c59ead61 req-a3284aa4-bed6-47c3-ac51-db94e385fb46 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036876 Jul 28 03:42:07.156978 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 712/1473] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:07.163321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-404ab294-6223-48f3-8c87-9c05efed8b66 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:07.164218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-404ab294-6223-48f3-8c87-9c05efed8b66 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:07.172820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-404ab294-6223-48f3-8c87-9c05efed8b66 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:07.173480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-404ab294-6223-48f3-8c87-9c05efed8b66 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:07.174735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-404ab294-6223-48f3-8c87-9c05efed8b66 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:07.175384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-404ab294-6223-48f3-8c87-9c05efed8b66 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:07.439957 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-404ab294-6223-48f3-8c87-9c05efed8b66 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:07.449082 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-404ab294-6223-48f3-8c87-9c05efed8b66 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1316 microversion: 2.1 time: 0.290566 Jul 28 03:42:07.449657 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 713/1474] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:07 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:07.468056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4dd67c22-2647-4630-9b93-465c94718d40 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:07.470778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4dd67c22-2647-4630-9b93-465c94718d40 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:07.482052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4dd67c22-2647-4630-9b93-465c94718d40 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:07.482946 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4dd67c22-2647-4630-9b93-465c94718d40 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:07.485308 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4dd67c22-2647-4630-9b93-465c94718d40 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:07.486586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4dd67c22-2647-4630-9b93-465c94718d40 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:07.821203 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4dd67c22-2647-4630-9b93-465c94718d40 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:07.834085 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4dd67c22-2647-4630-9b93-465c94718d40 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 0.375178 Jul 28 03:42:07.834915 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 714/1475] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:07 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:07.851690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eb3c3fb6-3785-41b7-9a46-f0caf434ec90 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:07.852471 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-eb3c3fb6-3785-41b7-9a46-f0caf434ec90 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:07.873944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb3c3fb6-3785-41b7-9a46-f0caf434ec90 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:07.878183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb3c3fb6-3785-41b7-9a46-f0caf434ec90 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:07.879997 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb3c3fb6-3785-41b7-9a46-f0caf434ec90 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:07.881040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb3c3fb6-3785-41b7-9a46-f0caf434ec90 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:08.020676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:08.172765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-eb3c3fb6-3785-41b7-9a46-f0caf434ec90 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:08.187343 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-eb3c3fb6-3785-41b7-9a46-f0caf434ec90 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1708 microversion: 2.1 time: 0.350259 Jul 28 03:42:08.187343 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 715/1476] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:07 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1708 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:08.196087 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0887e147-f3f8-4962-89d8-c0bf7565a7be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:08.197499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0887e147-f3f8-4962-89d8-c0bf7565a7be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:08.209756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0887e147-f3f8-4962-89d8-c0bf7565a7be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:08.210995 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0887e147-f3f8-4962-89d8-c0bf7565a7be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:08.212216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0887e147-f3f8-4962-89d8-c0bf7565a7be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:08.213593 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0887e147-f3f8-4962-89d8-c0bf7565a7be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:08.465112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0887e147-f3f8-4962-89d8-c0bf7565a7be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:08.478847 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0887e147-f3f8-4962-89d8-c0bf7565a7be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1324 microversion: 2.1 time: 0.289388 Jul 28 03:42:08.494599 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 716/1477] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:08 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:08.512246 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7e7c6496-55b8-44d7-adf7-fde7cce791ff tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa7458a4c0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:08.588243 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7e7c6496-55b8-44d7-adf7-fde7cce791ff tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.089516 Jul 28 03:42:08.596550 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 717/1478] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:08 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:08.602438 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d7d4f00b-0273-42f7-abe0-3e6ac4945fc2 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '.version_select at 0x7ffa74522dc0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:08.608211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d7d4f00b-0273-42f7-abe0-3e6ac4945fc2 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:08.608706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d7d4f00b-0273-42f7-abe0-3e6ac4945fc2 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:08.639333 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d7d4f00b-0273-42f7-abe0-3e6ac4945fc2 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.047836 Jul 28 03:42:08.642528 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 718/1479] 10.222.0.48 () {58 vars in 1143 bytes} [Thu Jul 28 03:42:08 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:08.665130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ece6eb97-8b89-45ef-9020-48c475ecf464 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:08.670320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ece6eb97-8b89-45ef-9020-48c475ecf464 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:08.678206 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ece6eb97-8b89-45ef-9020-48c475ecf464 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:08.678956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ece6eb97-8b89-45ef-9020-48c475ecf464 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:08.679913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ece6eb97-8b89-45ef-9020-48c475ecf464 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:08.680589 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ece6eb97-8b89-45ef-9020-48c475ecf464 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:08.704628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:08.941391 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ece6eb97-8b89-45ef-9020-48c475ecf464 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:08.958232 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ece6eb97-8b89-45ef-9020-48c475ecf464 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1316 microversion: 2.1 time: 0.312850 Jul 28 03:42:08.959441 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 719/1480] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:08 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:08.965338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-b3518e24-2651-4bf2-84b8-1b6df7c82b26 req-0004df43-623e-4434-9822-6fff61970d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928e7a74-9453-46fe-a1dd-ebc281e8ea52", "name": "network-vif-plugged", "status": "completed", "tag": "d259e9d8-82aa-4835-8762-c43089b17976"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:08.984187 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b3518e24-2651-4bf2-84b8-1b6df7c82b26 req-0004df43-623e-4434-9822-6fff61970d12 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:08.985105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b3518e24-2651-4bf2-84b8-1b6df7c82b26 req-0004df43-623e-4434-9822-6fff61970d12 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:09.019627 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-b3518e24-2651-4bf2-84b8-1b6df7c82b26 req-0004df43-623e-4434-9822-6fff61970d12 service nova] Creating event network-vif-plugged:d259e9d8-82aa-4835-8762-c43089b17976 for instance 928e7a74-9453-46fe-a1dd-ebc281e8ea52 on n-h1-826756-3 Jul 28 03:42:09.026910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:42:09.027631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:42:09.027783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:42:09.028103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:42:09.028579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:42:09.037564 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-b3518e24-2651-4bf2-84b8-1b6df7c82b26 req-0004df43-623e-4434-9822-6fff61970d12 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069387 Jul 28 03:42:09.037564 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 720/1481] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:09.038945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fdb9863c-3a0f-4bed-9094-70c909c7ce08 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:09.039691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fdb9863c-3a0f-4bed-9094-70c909c7ce08 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:09.053845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:09.053845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:09.053845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:09.053845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:09.054478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fdb9863c-3a0f-4bed-9094-70c909c7ce08 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:09.054478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fdb9863c-3a0f-4bed-9094-70c909c7ce08 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:09.055171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fdb9863c-3a0f-4bed-9094-70c909c7ce08 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:09.062614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fdb9863c-3a0f-4bed-9094-70c909c7ce08 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:09.095614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Getting quotas for project a1d6ebac92a1492b8b85a2b30f7c145c. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:42:09.115994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Getting quotas for user c241cd30b794493abc7fa1d15987c92a and project a1d6ebac92a1492b8b85a2b30f7c145c. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:42:09.378990 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=10 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:09.438351 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fdb9863c-3a0f-4bed-9094-70c909c7ce08 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1859 microversion: 2.1 time: 0.404251 Jul 28 03:42:09.452856 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 721/1482] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:09 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1859 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:09.471605 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8c7a5cec-a1e0-4d74-abde-0eda3a6e5b7f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:09.472163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8c7a5cec-a1e0-4d74-abde-0eda3a6e5b7f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:09.478878 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c7a5cec-a1e0-4d74-abde-0eda3a6e5b7f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:09.479663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c7a5cec-a1e0-4d74-abde-0eda3a6e5b7f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:09.480640 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c7a5cec-a1e0-4d74-abde-0eda3a6e5b7f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:09.481246 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c7a5cec-a1e0-4d74-abde-0eda3a6e5b7f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:09.498081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:42:09.504018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='016ec2a4-260c-4000-86ab-13469169be59',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='9af0c489-bca6-4b6c-9c43-8e31bb96d48e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a772d27-45f3-46d4-ae57-5f1d2ae1d7fa',volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:42:09.714152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8c7a5cec-a1e0-4d74-abde-0eda3a6e5b7f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:09.734357 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8c7a5cec-a1e0-4d74-abde-0eda3a6e5b7f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 0.280289 Jul 28 03:42:09.736738 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 722/1483] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:09 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:09.753688 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f94b4734-0f98-41a4-bca0-ae7ad2f6e22c tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:09.754652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f94b4734-0f98-41a4-bca0-ae7ad2f6e22c tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:09.783928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f94b4734-0f98-41a4-bca0-ae7ad2f6e22c tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:09.784429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f94b4734-0f98-41a4-bca0-ae7ad2f6e22c tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:09.786396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f94b4734-0f98-41a4-bca0-ae7ad2f6e22c tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:09.793791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f94b4734-0f98-41a4-bca0-ae7ad2f6e22c tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:10.186549 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-773785e5-a86b-45e9-8480-1414bd41c060 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 4.858358 Jul 28 03:42:10.197556 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 762/1484] 10.222.0.48 () {62 vars in 1189 bytes} [Thu Jul 28 03:42:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 4871 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 03:42:10.212232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a32c0fd7-5a9d-4086-8dca-246b123ac3c3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:10.215255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a32c0fd7-5a9d-4086-8dca-246b123ac3c3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:10.231574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a32c0fd7-5a9d-4086-8dca-246b123ac3c3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:10.232279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a32c0fd7-5a9d-4086-8dca-246b123ac3c3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:10.233287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a32c0fd7-5a9d-4086-8dca-246b123ac3c3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:10.237044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a32c0fd7-5a9d-4086-8dca-246b123ac3c3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:10.410225 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f94b4734-0f98-41a4-bca0-ae7ad2f6e22c tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1859 microversion: 2.1 time: 0.672086 Jul 28 03:42:10.415135 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 723/1485] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:09 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1859 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:10.433806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f313037a-d9e2-451f-99d2-ad42477e80f1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa748ec0d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:10.474105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a32c0fd7-5a9d-4086-8dca-246b123ac3c3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:10.483845 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a32c0fd7-5a9d-4086-8dca-246b123ac3c3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1324 microversion: 2.1 time: 0.283703 Jul 28 03:42:10.485562 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 763/1486] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:10 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1324 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:10.491354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f0e3fd47-d117-4bb0-b3ef-5815824da513 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:10.492474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f0e3fd47-d117-4bb0-b3ef-5815824da513 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:10.509930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0e3fd47-d117-4bb0-b3ef-5815824da513 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:10.512914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0e3fd47-d117-4bb0-b3ef-5815824da513 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:10.515715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0e3fd47-d117-4bb0-b3ef-5815824da513 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:10.517946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0e3fd47-d117-4bb0-b3ef-5815824da513 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:10.886227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f0e3fd47-d117-4bb0-b3ef-5815824da513 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:10.918105 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f0e3fd47-d117-4bb0-b3ef-5815824da513 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1316 microversion: 2.1 time: 0.430174 Jul 28 03:42:10.921844 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 764/1487] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:10 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1316 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:10.944280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-88eec2fb-9737-45a6-8734-c30928208f84 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:10.945336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-88eec2fb-9737-45a6-8734-c30928208f84 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:11.075636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-88eec2fb-9737-45a6-8734-c30928208f84 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:11.078418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-88eec2fb-9737-45a6-8734-c30928208f84 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:11.079953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-88eec2fb-9737-45a6-8734-c30928208f84 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:11.081170 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-88eec2fb-9737-45a6-8734-c30928208f84 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1283 microversion: 2.42 time: 0.157081 Jul 28 03:42:11.081936 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 765/1488] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:10 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1283 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:11.126012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3a0c8062-31c3-4150-a5bd-d939a65ad2ad tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:11.126595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3a0c8062-31c3-4150-a5bd-d939a65ad2ad tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:11.163979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a0c8062-31c3-4150-a5bd-d939a65ad2ad tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:11.164464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a0c8062-31c3-4150-a5bd-d939a65ad2ad tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:11.165498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a0c8062-31c3-4150-a5bd-d939a65ad2ad tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:11.166103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a0c8062-31c3-4150-a5bd-d939a65ad2ad tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:11.363770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-3a0c8062-31c3-4150-a5bd-d939a65ad2ad tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lazy-loading 'services' on Instance uuid 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:42:11.482236 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3a0c8062-31c3-4150-a5bd-d939a65ad2ad tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "DELETE /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments/eea547e1-3ed7-4613-b1a0-6afe01312cba" status: 202 len: 0 microversion: 2.1 time: 0.362259 Jul 28 03:42:11.483513 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 766/1489] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 03:42:11 2022] DELETE /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments/eea547e1-3ed7-4613-b1a0-6afe01312cba => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:42:11.496730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-08d9c456-ab0a-42da-9ffc-dca4f00c7530 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01c987a8-dfa2-48de-88d4-e1edfff4ddbe"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:11.504486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-08d9c456-ab0a-42da-9ffc-dca4f00c7530 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:11.515038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08d9c456-ab0a-42da-9ffc-dca4f00c7530 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:11.516524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08d9c456-ab0a-42da-9ffc-dca4f00c7530 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:11.519612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08d9c456-ab0a-42da-9ffc-dca4f00c7530 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:11.520490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08d9c456-ab0a-42da-9ffc-dca4f00c7530 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:12.366953 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-08d9c456-ab0a-42da-9ffc-dca4f00c7530 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "POST /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.880904 Jul 28 03:42:12.372267 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 767/1490] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 03:42:11 2022] POST /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments => generated 194 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:12.410412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-33fe3c86-38fc-4844-8155-e4e1827fa64c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:12.418370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-33fe3c86-38fc-4844-8155-e4e1827fa64c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:12.446878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33fe3c86-38fc-4844-8155-e4e1827fa64c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:12.448816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33fe3c86-38fc-4844-8155-e4e1827fa64c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:12.451008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33fe3c86-38fc-4844-8155-e4e1827fa64c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:12.452069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33fe3c86-38fc-4844-8155-e4e1827fa64c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:12.817304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-33fe3c86-38fc-4844-8155-e4e1827fa64c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:12.832559 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-33fe3c86-38fc-4844-8155-e4e1827fa64c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 0.456413 Jul 28 03:42:12.833363 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 768/1491] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:12 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:12.853777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-39828bab-e58a-4b48-8896-5811535f1dce req-c2f30f8b-873c-462c-b234-780bb9f8d7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf954030-af98-4832-a28a-03cf2a3fe8c9", "name": "network-vif-plugged", "status": "completed", "tag": "bf305f0a-27a2-4078-b918-f102991b6796"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:12.912561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-39828bab-e58a-4b48-8896-5811535f1dce req-c2f30f8b-873c-462c-b234-780bb9f8d7c0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:12.913909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-39828bab-e58a-4b48-8896-5811535f1dce req-c2f30f8b-873c-462c-b234-780bb9f8d7c0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:12.947084 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-39828bab-e58a-4b48-8896-5811535f1dce req-c2f30f8b-873c-462c-b234-780bb9f8d7c0 service nova] Creating event network-vif-plugged:bf305f0a-27a2-4078-b918-f102991b6796 for instance bf954030-af98-4832-a28a-03cf2a3fe8c9 on n-h1-826756-3 Jul 28 03:42:12.959149 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-39828bab-e58a-4b48-8896-5811535f1dce req-c2f30f8b-873c-462c-b234-780bb9f8d7c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120195 Jul 28 03:42:12.963635 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 769/1492] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:12.989658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9049bf5-94f7-48f1-a22c-f9cecc70eda6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:13.005497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9049bf5-94f7-48f1-a22c-f9cecc70eda6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:13.026320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9049bf5-94f7-48f1-a22c-f9cecc70eda6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:13.028118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9049bf5-94f7-48f1-a22c-f9cecc70eda6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:13.033708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9049bf5-94f7-48f1-a22c-f9cecc70eda6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:13.035829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9049bf5-94f7-48f1-a22c-f9cecc70eda6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:13.216281 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9049bf5-94f7-48f1-a22c-f9cecc70eda6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.244527 Jul 28 03:42:13.220841 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 770/1493] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:42:12 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments => generated 197 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:13.241548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ac74b9b1-1dc1-473c-bcc7-2d9653dddf7a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:13.242619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ac74b9b1-1dc1-473c-bcc7-2d9653dddf7a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:13.268594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac74b9b1-1dc1-473c-bcc7-2d9653dddf7a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:13.271400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac74b9b1-1dc1-473c-bcc7-2d9653dddf7a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:13.276780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac74b9b1-1dc1-473c-bcc7-2d9653dddf7a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:13.280069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac74b9b1-1dc1-473c-bcc7-2d9653dddf7a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:13.726948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ac74b9b1-1dc1-473c-bcc7-2d9653dddf7a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:13.749292 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ac74b9b1-1dc1-473c-bcc7-2d9653dddf7a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1324 microversion: 2.1 time: 0.526010 Jul 28 03:42:13.750240 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 771/1494] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:13 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:13.755556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-57eea1a6-6a8c-45ab-96d5-aafb160c6084 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:13.756197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-57eea1a6-6a8c-45ab-96d5-aafb160c6084 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:13.765111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57eea1a6-6a8c-45ab-96d5-aafb160c6084 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:13.768407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57eea1a6-6a8c-45ab-96d5-aafb160c6084 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:13.771091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57eea1a6-6a8c-45ab-96d5-aafb160c6084 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:13.771551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57eea1a6-6a8c-45ab-96d5-aafb160c6084 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:14.015551 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f313037a-d9e2-451f-99d2-ad42477e80f1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 3.598286 Jul 28 03:42:14.023990 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 724/1495] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:10 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 3607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:14.042819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bb87836a-4ead-4981-ba18-3271c5559568 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:14.043444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bb87836a-4ead-4981-ba18-3271c5559568 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:14.055085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb87836a-4ead-4981-ba18-3271c5559568 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:14.055747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb87836a-4ead-4981-ba18-3271c5559568 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:14.056749 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb87836a-4ead-4981-ba18-3271c5559568 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:14.057348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb87836a-4ead-4981-ba18-3271c5559568 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:14.096040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-57eea1a6-6a8c-45ab-96d5-aafb160c6084 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:14.109283 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-57eea1a6-6a8c-45ab-96d5-aafb160c6084 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1466 microversion: 2.1 time: 0.354072 Jul 28 03:42:14.121061 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 772/1496] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:13 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1466 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:14.138517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17444900-1375-4f69-bd87-993f8373910b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:14.139544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-17444900-1375-4f69-bd87-993f8373910b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:14.157037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17444900-1375-4f69-bd87-993f8373910b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:14.157652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17444900-1375-4f69-bd87-993f8373910b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:14.158822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17444900-1375-4f69-bd87-993f8373910b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:14.159264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17444900-1375-4f69-bd87-993f8373910b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:14.403079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bb87836a-4ead-4981-ba18-3271c5559568 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:14.416949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bb87836a-4ead-4981-ba18-3271c5559568 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:14.419209 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bb87836a-4ead-4981-ba18-3271c5559568 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:14.421293 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bb87836a-4ead-4981-ba18-3271c5559568 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1591 microversion: 2.42 time: 0.394763 Jul 28 03:42:14.427552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-17444900-1375-4f69-bd87-993f8373910b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:14.433110 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 725/1497] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:14 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1591 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:14.449465 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-17444900-1375-4f69-bd87-993f8373910b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 0.326832 Jul 28 03:42:14.450510 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 773/1498] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:14 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:14.464006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fccc8d57-5574-4790-8988-8ed6109eb187 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:14.476208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fccc8d57-5574-4790-8988-8ed6109eb187 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:14.496833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fccc8d57-5574-4790-8988-8ed6109eb187 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:14.497680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fccc8d57-5574-4790-8988-8ed6109eb187 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:14.498714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fccc8d57-5574-4790-8988-8ed6109eb187 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:14.501660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fccc8d57-5574-4790-8988-8ed6109eb187 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:14.542511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dabf212e-e6ab-4e82-b01b-92c5a961fa70 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:14.543287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dabf212e-e6ab-4e82-b01b-92c5a961fa70 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:14.557346 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dabf212e-e6ab-4e82-b01b-92c5a961fa70 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:14.558919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dabf212e-e6ab-4e82-b01b-92c5a961fa70 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:14.560555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dabf212e-e6ab-4e82-b01b-92c5a961fa70 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:14.563327 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dabf212e-e6ab-4e82-b01b-92c5a961fa70 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:14.584233 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fccc8d57-5574-4790-8988-8ed6109eb187 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132279 Jul 28 03:42:14.591872 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 774/1499] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:42:14 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:14.778872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b8f402ff-bdcd-40fc-a894-59583e0743fd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:14.781145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b8f402ff-bdcd-40fc-a894-59583e0743fd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:14.808294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8f402ff-bdcd-40fc-a894-59583e0743fd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:14.808939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8f402ff-bdcd-40fc-a894-59583e0743fd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:14.810632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8f402ff-bdcd-40fc-a894-59583e0743fd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:14.811170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8f402ff-bdcd-40fc-a894-59583e0743fd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:15.031630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8f402ff-bdcd-40fc-a894-59583e0743fd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:15.059672 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b8f402ff-bdcd-40fc-a894-59583e0743fd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1324 microversion: 2.1 time: 0.293157 Jul 28 03:42:15.074458 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 775/1500] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:14 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1324 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:42:15.081109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-860bd4bb-5bc1-470d-b2a5-e600d7947671 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74309280>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:15.153481 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-860bd4bb-5bc1-470d-b2a5-e600d7947671 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.076634 Jul 28 03:42:15.154813 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 776/1501] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:15 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:15.161205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c93238bf-f992-4ddb-86c2-6d8edddc8944 req-87e0b4f0-c9d9-4552-a551-58e97a71fe4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "623a67cb-d39e-4de8-877f-a81af9613a10", "name": "network-vif-plugged", "status": "completed", "tag": "62f765ff-c7d8-4877-9576-bc720cc3f64f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:15.181501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c93238bf-f992-4ddb-86c2-6d8edddc8944 req-87e0b4f0-c9d9-4552-a551-58e97a71fe4e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:15.182401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c93238bf-f992-4ddb-86c2-6d8edddc8944 req-87e0b4f0-c9d9-4552-a551-58e97a71fe4e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:15.195479 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c93238bf-f992-4ddb-86c2-6d8edddc8944 req-87e0b4f0-c9d9-4552-a551-58e97a71fe4e service nova] Creating event network-vif-plugged:62f765ff-c7d8-4877-9576-bc720cc3f64f for instance 623a67cb-d39e-4de8-877f-a81af9613a10 on n-h2-826756-3 Jul 28 03:42:15.201888 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c93238bf-f992-4ddb-86c2-6d8edddc8944 req-87e0b4f0-c9d9-4552-a551-58e97a71fe4e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045346 Jul 28 03:42:15.203502 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 777/1502] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:15.377294 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dabf212e-e6ab-4e82-b01b-92c5a961fa70 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1617 microversion: 2.1 time: 0.940738 Jul 28 03:42:15.386084 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 726/1503] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:14 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1617 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:15.417430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-942fd0ad-c93c-4122-97bb-eb346b5b4bcc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Action: 'create', calling method: .version_select at 0x7ffa74703160>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1839988707", "policies": ["affinity"]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:15.448682 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-15a06dee-748e-4c60-83a5-095386ce3108 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:15.449648 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-15a06dee-748e-4c60-83a5-095386ce3108 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:15.463095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-942fd0ad-c93c-4122-97bb-eb346b5b4bcc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:42:15.463897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-15a06dee-748e-4c60-83a5-095386ce3108 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:15.464853 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-15a06dee-748e-4c60-83a5-095386ce3108 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:15.469144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-15a06dee-748e-4c60-83a5-095386ce3108 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:15.471478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-15a06dee-748e-4c60-83a5-095386ce3108 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:15.477829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-942fd0ad-c93c-4122-97bb-eb346b5b4bcc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:42:15.547458 n-d-826756-3 devstack@n-api.service[126071]: ERROR oslo.messaging._drivers.impl_rabbit [None req-942fd0ad-c93c-4122-97bb-eb346b5b4bcc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [16af238c-2474-43c9-8a09-04a93ce80656] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 03:42:15.616868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-15a06dee-748e-4c60-83a5-095386ce3108 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:15.634527 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-15a06dee-748e-4c60-83a5-095386ce3108 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:15.641057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-15a06dee-748e-4c60-83a5-095386ce3108 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:15.642792 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-15a06dee-748e-4c60-83a5-095386ce3108 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1591 microversion: 2.42 time: 0.199513 Jul 28 03:42:15.657013 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 727/1504] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:15 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1591 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:42:15.665522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-64f81b13-6971-4e26-8e5d-bb12b0dff84f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:15.666489 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-64f81b13-6971-4e26-8e5d-bb12b0dff84f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:15.673531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64f81b13-6971-4e26-8e5d-bb12b0dff84f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:15.674270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64f81b13-6971-4e26-8e5d-bb12b0dff84f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:15.675511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64f81b13-6971-4e26-8e5d-bb12b0dff84f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:15.676165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64f81b13-6971-4e26-8e5d-bb12b0dff84f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:16.197653 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-64f81b13-6971-4e26-8e5d-bb12b0dff84f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:16.224159 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-64f81b13-6971-4e26-8e5d-bb12b0dff84f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1655 microversion: 2.1 time: 0.565547 Jul 28 03:42:16.229280 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 728/1505] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:15 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1655 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:16.245924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-06a350da-c9a6-4446-a001-eb3845ebdae3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:16.248799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-06a350da-c9a6-4446-a001-eb3845ebdae3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:16.256335 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06a350da-c9a6-4446-a001-eb3845ebdae3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:16.257248 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06a350da-c9a6-4446-a001-eb3845ebdae3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:16.258213 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06a350da-c9a6-4446-a001-eb3845ebdae3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:16.258818 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06a350da-c9a6-4446-a001-eb3845ebdae3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:16.331782 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-06a350da-c9a6-4446-a001-eb3845ebdae3 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100970 Jul 28 03:42:16.333374 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 729/1506] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:42:16 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:16.338764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c729c45c-9fde-4ae4-a3a6-d5dcb315e522 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:16.339629 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c729c45c-9fde-4ae4-a3a6-d5dcb315e522 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:16.347956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c729c45c-9fde-4ae4-a3a6-d5dcb315e522 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:16.348739 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c729c45c-9fde-4ae4-a3a6-d5dcb315e522 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:16.349716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c729c45c-9fde-4ae4-a3a6-d5dcb315e522 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:16.350357 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c729c45c-9fde-4ae4-a3a6-d5dcb315e522 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:16.564948 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [None req-942fd0ad-c93c-4122-97bb-eb346b5b4bcc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [16af238c-2474-43c9-8a09-04a93ce80656] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 38488. Jul 28 03:42:16.640078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-942fd0ad-c93c-4122-97bb-eb346b5b4bcc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:42:16.660015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-942fd0ad-c93c-4122-97bb-eb346b5b4bcc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:42:16.722759 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-942fd0ad-c93c-4122-97bb-eb346b5b4bcc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 1.317996 Jul 28 03:42:16.741134 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 778/1507] 10.222.0.48 () {60 vars in 1174 bytes} [Thu Jul 28 03:42:15 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:16.786021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a92e66ae-7022-4d7b-bf99-9b472a579350 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa747033a0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:16.909826 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a92e66ae-7022-4d7b-bf99-9b472a579350 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.166334 Jul 28 03:42:16.910850 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 779/1508] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:16 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:16.935086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d790da03-1033-4d05-ab52-db388fbebb85 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:16.949575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d790da03-1033-4d05-ab52-db388fbebb85 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:16.950889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d790da03-1033-4d05-ab52-db388fbebb85 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:16.986903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d790da03-1033-4d05-ab52-db388fbebb85 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Going to try to start instance {{(pid=126071) start /opt/stack/nova/nova/compute/api.py:2776}} Jul 28 03:42:17.002891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c729c45c-9fde-4ae4-a3a6-d5dcb315e522 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:17.014707 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c729c45c-9fde-4ae4-a3a6-d5dcb315e522 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1324 microversion: 2.1 time: 0.679967 Jul 28 03:42:17.031743 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 730/1509] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:16 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1324 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:17.059733 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fb78590e-9ec1-41cb-9da8-08651e7bdd28 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:17.060726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fb78590e-9ec1-41cb-9da8-08651e7bdd28 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:17.067917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb78590e-9ec1-41cb-9da8-08651e7bdd28 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:17.069033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb78590e-9ec1-41cb-9da8-08651e7bdd28 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:17.070069 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb78590e-9ec1-41cb-9da8-08651e7bdd28 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:17.070663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb78590e-9ec1-41cb-9da8-08651e7bdd28 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:17.082072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=92,nova_cell1:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:17.106772 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d790da03-1033-4d05-ab52-db388fbebb85 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.192337 Jul 28 03:42:17.110891 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 780/1510] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:42:16 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:42:17.141159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1743472540", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "b897bf6d-9c40-4ae5-a228-6d95f0eb5f2b"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:17.270197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:42:17.593198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:42:17.593902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:42:17.594850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:42:17.595319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:42:17.595731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:42:17.657026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:17.657783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:17.658796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:17.659452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:17.702587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:42:17.709623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:42:17.752732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Going to run 2 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:42:17.773543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:42:17.877074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126071) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 28 03:42:17.914730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:17.928608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:42:17.937348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:42:18.022570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:42:18.034282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:42:18.051281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:42:18.149152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:42:18.175620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:42:18.293330 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fb78590e-9ec1-41cb-9da8-08651e7bdd28 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:18.307781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fb78590e-9ec1-41cb-9da8-08651e7bdd28 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:18.313508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fb78590e-9ec1-41cb-9da8-08651e7bdd28 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:18.320698 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fb78590e-9ec1-41cb-9da8-08651e7bdd28 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1658 microversion: 2.42 time: 1.287806 Jul 28 03:42:18.320934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:42:18.327387 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 731/1511] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:17 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1658 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:18.342963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cc75baee-0371-4f73-a5c6-84830fc81ec2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:18.343960 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cc75baee-0371-4f73-a5c6-84830fc81ec2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:18.364367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:42:18.367131 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cc75baee-0371-4f73-a5c6-84830fc81ec2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:18.370184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cc75baee-0371-4f73-a5c6-84830fc81ec2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:18.372124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cc75baee-0371-4f73-a5c6-84830fc81ec2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:18.377600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cc75baee-0371-4f73-a5c6-84830fc81ec2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:18.447046 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b2edf3a-a293-469e-b1a2-bb023c28a080 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.333286 Jul 28 03:42:18.448297 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 781/1512] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:42:17 2022] POST /compute/v2.1/servers => generated 32 bytes in 1337 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 28 03:42:18.473486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b9488b1-a2b6-4d34-acd5-bef012d9f855 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:18.485911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b9488b1-a2b6-4d34-acd5-bef012d9f855 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:18.502392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b9488b1-a2b6-4d34-acd5-bef012d9f855 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:18.503149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b9488b1-a2b6-4d34-acd5-bef012d9f855 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:18.504748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b9488b1-a2b6-4d34-acd5-bef012d9f855 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:18.505473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b9488b1-a2b6-4d34-acd5-bef012d9f855 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:18.566934 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b9488b1-a2b6-4d34-acd5-bef012d9f855 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114209 Jul 28 03:42:18.568799 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 782/1513] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:42:18 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:18.581321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c8ae07d4-32b3-4b2f-b20e-bbc05485aeda tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa741fd1f0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:19.046037 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cc75baee-0371-4f73-a5c6-84830fc81ec2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:19.068328 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cc75baee-0371-4f73-a5c6-84830fc81ec2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1664 microversion: 2.1 time: 0.736099 Jul 28 03:42:19.074530 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c8ae07d4-32b3-4b2f-b20e-bbc05485aeda tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.503580 Jul 28 03:42:19.075340 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 732/1514] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:18 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1664 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:19.082181 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7ec4b94e-6904-42d4-9c6a-1679ea4f7c29 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:19.082830 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 783/1515] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:18 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:19.087528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7ec4b94e-6904-42d4-9c6a-1679ea4f7c29 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:19.099069 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ec4b94e-6904-42d4-9c6a-1679ea4f7c29 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:19.099805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ec4b94e-6904-42d4-9c6a-1679ea4f7c29 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:19.101999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ec4b94e-6904-42d4-9c6a-1679ea4f7c29 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:19.102649 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ec4b94e-6904-42d4-9c6a-1679ea4f7c29 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:19.116422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-404b1ceb-e1e9-4fe5-9a00-563d335e1d01 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:19.135270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-404b1ceb-e1e9-4fe5-9a00-563d335e1d01 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:19.136620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-404b1ceb-e1e9-4fe5-9a00-563d335e1d01 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Searching by: {'deleted': False, 'project_id': '6979063538ee4bf08537b46bfb6e4249'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:42:19.261800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-404b1ceb-e1e9-4fe5-9a00-563d335e1d01 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:19.262325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-404b1ceb-e1e9-4fe5-9a00-563d335e1d01 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:19.263175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-404b1ceb-e1e9-4fe5-9a00-563d335e1d01 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:19.263608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-404b1ceb-e1e9-4fe5-9a00-563d335e1d01 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:19.540028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-404b1ceb-e1e9-4fe5-9a00-563d335e1d01 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:42:19.707351 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-404b1ceb-e1e9-4fe5-9a00-563d335e1d01 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.621063 Jul 28 03:42:19.708247 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 784/1516] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 03:42:19 2022] GET /compute/v2.1/servers => generated 1003 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:19.713825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5dd1416a-a6da-4b33-9cc6-2864753b8e0f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:19.715052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5dd1416a-a6da-4b33-9cc6-2864753b8e0f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:19.725214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dd1416a-a6da-4b33-9cc6-2864753b8e0f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:19.725473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7ec4b94e-6904-42d4-9c6a-1679ea4f7c29 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:19.726789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dd1416a-a6da-4b33-9cc6-2864753b8e0f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:19.727816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dd1416a-a6da-4b33-9cc6-2864753b8e0f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:19.728449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dd1416a-a6da-4b33-9cc6-2864753b8e0f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:19.740772 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7ec4b94e-6904-42d4-9c6a-1679ea4f7c29 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1520 microversion: 2.1 time: 0.664644 Jul 28 03:42:19.741392 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 733/1517] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:19 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1520 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:19.764719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-06ff327f-d3bb-4f5b-ba7f-264a92f047b0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:19.777706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-06ff327f-d3bb-4f5b-ba7f-264a92f047b0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:19.795584 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06ff327f-d3bb-4f5b-ba7f-264a92f047b0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:19.796025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06ff327f-d3bb-4f5b-ba7f-264a92f047b0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:19.796827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06ff327f-d3bb-4f5b-ba7f-264a92f047b0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:19.797259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06ff327f-d3bb-4f5b-ba7f-264a92f047b0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:19.909929 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-06ff327f-d3bb-4f5b-ba7f-264a92f047b0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148081 Jul 28 03:42:19.913737 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 734/1518] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:42:19 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:19.922813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8659e78e-f731-4aa7-a01b-9af518131747 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:19.923701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8659e78e-f731-4aa7-a01b-9af518131747 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:20.253758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8659e78e-f731-4aa7-a01b-9af518131747 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:20.261857 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8659e78e-f731-4aa7-a01b-9af518131747 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1219 microversion: 2.1 time: 0.342819 Jul 28 03:42:20.265356 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 735/1519] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:19 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1219 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:20.284150 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-37d50f59-c2be-4c74-9044-77da932cbed9 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Action: 'create', calling method: .version_select at 0x7ffa749dbdc0>, body: {"pool": null} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:20.369021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5dd1416a-a6da-4b33-9cc6-2864753b8e0f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:20.388776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5dd1416a-a6da-4b33-9cc6-2864753b8e0f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:20.393500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5dd1416a-a6da-4b33-9cc6-2864753b8e0f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:20.395095 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5dd1416a-a6da-4b33-9cc6-2864753b8e0f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1704 microversion: 2.42 time: 0.685658 Jul 28 03:42:20.396188 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 785/1520] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:19 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1704 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:20.405691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-edf935f4-5800-49ed-9d0d-fea49fa50133 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa747fe670>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:20.505201 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-edf935f4-5800-49ed-9d0d-fea49fa50133 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.104082 Jul 28 03:42:20.510364 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 786/1521] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:20 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:20.522296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-68c4ab87-d165-41f9-9978-5b28daf841b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:20.522979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-68c4ab87-d165-41f9-9978-5b28daf841b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:20.556746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68c4ab87-d165-41f9-9978-5b28daf841b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:20.557352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68c4ab87-d165-41f9-9978-5b28daf841b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:20.558611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68c4ab87-d165-41f9-9978-5b28daf841b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:20.559046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68c4ab87-d165-41f9-9978-5b28daf841b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:21.164847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-68c4ab87-d165-41f9-9978-5b28daf841b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:21.214256 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-68c4ab87-d165-41f9-9978-5b28daf841b5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.695645 Jul 28 03:42:21.215979 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 787/1522] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:20 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:21.274168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44091003-2d6e-423e-a5d4-cb7f3af5b235 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:21.277676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-44091003-2d6e-423e-a5d4-cb7f3af5b235 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:21.303686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44091003-2d6e-423e-a5d4-cb7f3af5b235 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:21.315313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44091003-2d6e-423e-a5d4-cb7f3af5b235 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:21.317867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44091003-2d6e-423e-a5d4-cb7f3af5b235 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:21.318803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44091003-2d6e-423e-a5d4-cb7f3af5b235 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:21.448629 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-44091003-2d6e-423e-a5d4-cb7f3af5b235 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.217564 Jul 28 03:42:21.453264 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 788/1523] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:42:21 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments => generated 197 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:21.473713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-db50670d-e757-4418-9dcb-0082d1fcd179 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:21.474403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-db50670d-e757-4418-9dcb-0082d1fcd179 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:21.504863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db50670d-e757-4418-9dcb-0082d1fcd179 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:21.505435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db50670d-e757-4418-9dcb-0082d1fcd179 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:21.506282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db50670d-e757-4418-9dcb-0082d1fcd179 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:21.507479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db50670d-e757-4418-9dcb-0082d1fcd179 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:22.156473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-db50670d-e757-4418-9dcb-0082d1fcd179 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:22.168313 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-db50670d-e757-4418-9dcb-0082d1fcd179 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.715464 Jul 28 03:42:22.169328 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 789/1524] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:21 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:22.192681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4aa48b30-08b3-4fbe-8ced-7ed8f1ec6aae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:22.195696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4aa48b30-08b3-4fbe-8ced-7ed8f1ec6aae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:22.209696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4aa48b30-08b3-4fbe-8ced-7ed8f1ec6aae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:22.212188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4aa48b30-08b3-4fbe-8ced-7ed8f1ec6aae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:22.214643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4aa48b30-08b3-4fbe-8ced-7ed8f1ec6aae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:22.218144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4aa48b30-08b3-4fbe-8ced-7ed8f1ec6aae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:22.441953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4aa48b30-08b3-4fbe-8ced-7ed8f1ec6aae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:22.452137 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4aa48b30-08b3-4fbe-8ced-7ed8f1ec6aae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1277 microversion: 2.1 time: 0.263759 Jul 28 03:42:22.453242 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 790/1525] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:22 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1277 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:22.473755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1b4fa352-8b1a-4b29-bbbf-79d0cca5fb91 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:22.474720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1b4fa352-8b1a-4b29-bbbf-79d0cca5fb91 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:22.483078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b4fa352-8b1a-4b29-bbbf-79d0cca5fb91 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:22.483078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b4fa352-8b1a-4b29-bbbf-79d0cca5fb91 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:22.491918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b4fa352-8b1a-4b29-bbbf-79d0cca5fb91 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:22.492212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b4fa352-8b1a-4b29-bbbf-79d0cca5fb91 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:22.761771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1b4fa352-8b1a-4b29-bbbf-79d0cca5fb91 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:22.789400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1b4fa352-8b1a-4b29-bbbf-79d0cca5fb91 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:22.824394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1b4fa352-8b1a-4b29-bbbf-79d0cca5fb91 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:22.824394 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1b4fa352-8b1a-4b29-bbbf-79d0cca5fb91 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1704 microversion: 2.42 time: 0.348958 Jul 28 03:42:22.824394 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 791/1526] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:22 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1704 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:22.824394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-28940dab-d213-41b8-b53e-ce66c7d5b64f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74249700>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:22.973887 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-28940dab-d213-41b8-b53e-ce66c7d5b64f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.161060 Jul 28 03:42:22.974985 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 792/1527] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:22 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:22.995669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c52a16e-77d2-4aed-b40b-c66274d6ab44 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:23.001710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5c52a16e-77d2-4aed-b40b-c66274d6ab44 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:23.032434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c52a16e-77d2-4aed-b40b-c66274d6ab44 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:23.032779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c52a16e-77d2-4aed-b40b-c66274d6ab44 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:23.041659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c52a16e-77d2-4aed-b40b-c66274d6ab44 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:23.046862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c52a16e-77d2-4aed-b40b-c66274d6ab44 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:23.199309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5c52a16e-77d2-4aed-b40b-c66274d6ab44 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Unlocking {{(pid=126071) unlock /opt/stack/nova/nova/compute/api.py:4854}} Jul 28 03:42:23.433069 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5c52a16e-77d2-4aed-b40b-c66274d6ab44 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.454111 Jul 28 03:42:23.434909 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 793/1528] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:42:22 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:42:23.463222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80c72cb6-47eb-4b35-b22f-1631b45bfa20 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:23.466806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-80c72cb6-47eb-4b35-b22f-1631b45bfa20 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:23.485834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80c72cb6-47eb-4b35-b22f-1631b45bfa20 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:23.486481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80c72cb6-47eb-4b35-b22f-1631b45bfa20 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:23.487523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80c72cb6-47eb-4b35-b22f-1631b45bfa20 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:23.488148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80c72cb6-47eb-4b35-b22f-1631b45bfa20 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:23.633456 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-80c72cb6-47eb-4b35-b22f-1631b45bfa20 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.195905 Jul 28 03:42:23.634335 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 794/1529] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:42:23 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76/os-volume_attachments => generated 25 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:42:23.639900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d8fe5e1-b584-44b7-bcbd-f43b2a7f6039 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:23.640808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4d8fe5e1-b584-44b7-bcbd-f43b2a7f6039 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:23.647698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d8fe5e1-b584-44b7-bcbd-f43b2a7f6039 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:23.648470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d8fe5e1-b584-44b7-bcbd-f43b2a7f6039 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:23.649460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d8fe5e1-b584-44b7-bcbd-f43b2a7f6039 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:23.650084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d8fe5e1-b584-44b7-bcbd-f43b2a7f6039 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:23.865502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d8fe5e1-b584-44b7-bcbd-f43b2a7f6039 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:23.874651 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d8fe5e1-b584-44b7-bcbd-f43b2a7f6039 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.239072 Jul 28 03:42:23.875712 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 795/1530] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:23 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:23.881996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9bc2c548-1667-4428-8460-7e39214affde tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:23.882777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9bc2c548-1667-4428-8460-7e39214affde tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:23.891507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bc2c548-1667-4428-8460-7e39214affde tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:23.892078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bc2c548-1667-4428-8460-7e39214affde tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:23.892909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bc2c548-1667-4428-8460-7e39214affde tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:23.893390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bc2c548-1667-4428-8460-7e39214affde tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:24.014732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9bc2c548-1667-4428-8460-7e39214affde tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:24.043666 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9bc2c548-1667-4428-8460-7e39214affde tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1277 microversion: 2.1 time: 0.166034 Jul 28 03:42:24.048411 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 796/1531] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:23 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:24.062546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e3f1f5b3-5456-4ce6-b153-2063861a7d94 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:24.071993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e3f1f5b3-5456-4ce6-b153-2063861a7d94 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:24.094763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3f1f5b3-5456-4ce6-b153-2063861a7d94 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:24.095517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3f1f5b3-5456-4ce6-b153-2063861a7d94 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:24.096919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3f1f5b3-5456-4ce6-b153-2063861a7d94 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:24.128438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3f1f5b3-5456-4ce6-b153-2063861a7d94 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:24.598546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e3f1f5b3-5456-4ce6-b153-2063861a7d94 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:24.613222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e3f1f5b3-5456-4ce6-b153-2063861a7d94 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:24.616383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e3f1f5b3-5456-4ce6-b153-2063861a7d94 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:24.618549 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e3f1f5b3-5456-4ce6-b153-2063861a7d94 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1750 microversion: 2.42 time: 0.571441 Jul 28 03:42:24.620114 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 797/1532] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:24 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1750 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:24.625135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-137feb5a-1501-48d1-8b92-c85a159d22ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:24.625751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-137feb5a-1501-48d1-8b92-c85a159d22ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:24.631951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-137feb5a-1501-48d1-8b92-c85a159d22ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:24.634361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-137feb5a-1501-48d1-8b92-c85a159d22ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:24.635994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-137feb5a-1501-48d1-8b92-c85a159d22ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:24.638043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-137feb5a-1501-48d1-8b92-c85a159d22ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:24.684464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:25.045640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-137feb5a-1501-48d1-8b92-c85a159d22ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:25.067892 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-137feb5a-1501-48d1-8b92-c85a159d22ae tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.444543 Jul 28 03:42:25.070254 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 798/1533] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:24 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:25.080721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c352ceff-f6b1-4b8d-bf13-c04a2d1d1d5c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa746698b0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:25.228031 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c352ceff-f6b1-4b8d-bf13-c04a2d1d1d5c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.151905 Jul 28 03:42:25.230897 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 799/1534] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:25 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:25.237490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93dc54c2-6311-40d6-a908-13fb1dfe1827 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:25.238549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93dc54c2-6311-40d6-a908-13fb1dfe1827 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:25.246000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93dc54c2-6311-40d6-a908-13fb1dfe1827 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:25.246766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93dc54c2-6311-40d6-a908-13fb1dfe1827 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:25.247768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93dc54c2-6311-40d6-a908-13fb1dfe1827 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:25.248444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93dc54c2-6311-40d6-a908-13fb1dfe1827 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:25.380661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93dc54c2-6311-40d6-a908-13fb1dfe1827 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:25.389837 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93dc54c2-6311-40d6-a908-13fb1dfe1827 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1277 microversion: 2.1 time: 0.157597 Jul 28 03:42:25.398120 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 800/1535] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:25 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:25.434361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e302b0a7-cee5-422e-ad02-8f691a848d72 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:25.435292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e302b0a7-cee5-422e-ad02-8f691a848d72 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:25.443158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e302b0a7-cee5-422e-ad02-8f691a848d72 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:25.446836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e302b0a7-cee5-422e-ad02-8f691a848d72 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:25.448074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e302b0a7-cee5-422e-ad02-8f691a848d72 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:25.449530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e302b0a7-cee5-422e-ad02-8f691a848d72 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:25.693487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e302b0a7-cee5-422e-ad02-8f691a848d72 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:25.707885 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e302b0a7-cee5-422e-ad02-8f691a848d72 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.293485 Jul 28 03:42:25.708914 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 801/1536] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:25 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:25.714577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-255aebcc-1a3e-42e8-91bc-c91a19649c86 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:25.715202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-255aebcc-1a3e-42e8-91bc-c91a19649c86 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:25.722920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-255aebcc-1a3e-42e8-91bc-c91a19649c86 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:25.723372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-255aebcc-1a3e-42e8-91bc-c91a19649c86 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:25.724162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-255aebcc-1a3e-42e8-91bc-c91a19649c86 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:25.724643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-255aebcc-1a3e-42e8-91bc-c91a19649c86 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:26.808119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-255aebcc-1a3e-42e8-91bc-c91a19649c86 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:26.831982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-255aebcc-1a3e-42e8-91bc-c91a19649c86 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:26.833932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-255aebcc-1a3e-42e8-91bc-c91a19649c86 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:26.835332 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-255aebcc-1a3e-42e8-91bc-c91a19649c86 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1750 microversion: 2.42 time: 1.125187 Jul 28 03:42:26.836541 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 802/1537] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:25 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1750 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:26.841600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-21f1f692-36c1-44e6-919d-bac4b051ccda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:26.845078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-21f1f692-36c1-44e6-919d-bac4b051ccda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:26.866526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21f1f692-36c1-44e6-919d-bac4b051ccda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:26.867309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21f1f692-36c1-44e6-919d-bac4b051ccda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:26.868624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21f1f692-36c1-44e6-919d-bac4b051ccda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:26.869270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21f1f692-36c1-44e6-919d-bac4b051ccda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:27.065391 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-21f1f692-36c1-44e6-919d-bac4b051ccda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.226849 Jul 28 03:42:27.073457 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 803/1538] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:42:26 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:42:27.094423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-560e10d7-288e-473c-9908-db4046bb2092 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa741b6430>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:27.229998 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-560e10d7-288e-473c-9908-db4046bb2092 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.154368 Jul 28 03:42:27.232008 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 804/1539] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:27 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:27.243437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-48e94579-6fec-407a-bb9d-2b061c1f59e4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:27.244706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-48e94579-6fec-407a-bb9d-2b061c1f59e4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:27.257929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48e94579-6fec-407a-bb9d-2b061c1f59e4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:27.259026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48e94579-6fec-407a-bb9d-2b061c1f59e4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:27.260931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48e94579-6fec-407a-bb9d-2b061c1f59e4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:27.263626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48e94579-6fec-407a-bb9d-2b061c1f59e4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:27.453401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-48e94579-6fec-407a-bb9d-2b061c1f59e4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:27.462365 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-48e94579-6fec-407a-bb9d-2b061c1f59e4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1277 microversion: 2.1 time: 0.228856 Jul 28 03:42:27.463687 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 805/1540] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:27 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:27.484670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f96f6c2b-5027-44c1-a476-21950eed0fd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:27.484933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f96f6c2b-5027-44c1-a476-21950eed0fd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:27.497916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f96f6c2b-5027-44c1-a476-21950eed0fd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:27.498552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f96f6c2b-5027-44c1-a476-21950eed0fd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:27.499471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f96f6c2b-5027-44c1-a476-21950eed0fd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:27.499918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f96f6c2b-5027-44c1-a476-21950eed0fd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:27.853688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f96f6c2b-5027-44c1-a476-21950eed0fd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:27.879731 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f96f6c2b-5027-44c1-a476-21950eed0fd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1673 microversion: 2.1 time: 0.410364 Jul 28 03:42:27.881190 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 806/1541] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:27 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1673 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:27.889585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1b4f63eb-2674-4221-b6ba-8963cb814851 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:27.890964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1b4f63eb-2674-4221-b6ba-8963cb814851 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:27.907415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b4f63eb-2674-4221-b6ba-8963cb814851 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:27.908827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b4f63eb-2674-4221-b6ba-8963cb814851 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:27.910247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b4f63eb-2674-4221-b6ba-8963cb814851 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:27.911179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b4f63eb-2674-4221-b6ba-8963cb814851 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:28.209909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1b4f63eb-2674-4221-b6ba-8963cb814851 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:28.221369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1b4f63eb-2674-4221-b6ba-8963cb814851 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:28.223726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1b4f63eb-2674-4221-b6ba-8963cb814851 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:28.225514 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1b4f63eb-2674-4221-b6ba-8963cb814851 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1750 microversion: 2.42 time: 0.342387 Jul 28 03:42:28.240442 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 807/1542] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:27 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1750 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:28.252275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d9cc942-32f8-4793-b0d4-dcf57379644c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa79981ca0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:28.328121 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5d9cc942-32f8-4793-b0d4-dcf57379644c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.084516 Jul 28 03:42:28.329843 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 808/1543] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:28 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:42:28.493891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-265e0594-35bf-44fc-b2e7-669ccdfc3242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:28.494912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-265e0594-35bf-44fc-b2e7-669ccdfc3242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:28.497855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=48 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:28.516892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-265e0594-35bf-44fc-b2e7-669ccdfc3242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:28.517785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-265e0594-35bf-44fc-b2e7-669ccdfc3242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:28.522746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-265e0594-35bf-44fc-b2e7-669ccdfc3242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:28.523682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-265e0594-35bf-44fc-b2e7-669ccdfc3242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:28.661855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-265e0594-35bf-44fc-b2e7-669ccdfc3242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:28.673559 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-265e0594-35bf-44fc-b2e7-669ccdfc3242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1277 microversion: 2.1 time: 0.184990 Jul 28 03:42:28.674773 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 809/1544] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:28 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:28.773557 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-37d50f59-c2be-4c74-9044-77da932cbed9 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.506815 Jul 28 03:42:28.789039 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 736/1545] 10.222.0.48 () {60 vars in 1170 bytes} [Thu Jul 28 03:42:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:28.874667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1377552757", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "db476184-d60c-46a3-9670-b892a40ef885"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:28.902077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-46c19bb7-4986-4493-8513-caa0df2c6923 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:28.902711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-46c19bb7-4986-4493-8513-caa0df2c6923 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:28.915836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46c19bb7-4986-4493-8513-caa0df2c6923 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:28.916207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46c19bb7-4986-4493-8513-caa0df2c6923 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:28.917253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46c19bb7-4986-4493-8513-caa0df2c6923 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:28.917947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46c19bb7-4986-4493-8513-caa0df2c6923 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:29.014194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] validate_networks() for [('db476184-d60c-46a3-9670-b892a40ef885', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:42:29.338861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:29.373230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-46c19bb7-4986-4493-8513-caa0df2c6923 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:29.387561 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-46c19bb7-4986-4493-8513-caa0df2c6923 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1653 microversion: 2.1 time: 0.484592 Jul 28 03:42:29.404307 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 737/1546] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:28 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1653 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:29.409811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-875f81d7-94fb-4b59-abe4-99d0eb0b370c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:29.410967 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-875f81d7-94fb-4b59-abe4-99d0eb0b370c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:29.418770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-875f81d7-94fb-4b59-abe4-99d0eb0b370c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:29.419554 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-875f81d7-94fb-4b59-abe4-99d0eb0b370c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:29.420642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-875f81d7-94fb-4b59-abe4-99d0eb0b370c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:29.421270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-875f81d7-94fb-4b59-abe4-99d0eb0b370c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:30.052698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-875f81d7-94fb-4b59-abe4-99d0eb0b370c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:30.107587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-875f81d7-94fb-4b59-abe4-99d0eb0b370c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:30.115662 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-875f81d7-94fb-4b59-abe4-99d0eb0b370c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:30.128631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:42:30.129258 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-875f81d7-94fb-4b59-abe4-99d0eb0b370c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1750 microversion: 2.42 time: 0.722610 Jul 28 03:42:30.130109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:42:30.130970 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 738/1547] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:29 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1750 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:30.140562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2edb9a19-3ba9-43b0-b088-a97c2ee5c971 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74a0b310>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:30.145880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:42:30.146444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:42:30.146988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:42:30.165463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:30.169381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:30.170391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:30.175174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:30.258711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Getting quotas for project 9f7680ec7bd44a62be5017f043d4613b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:42:30.279042 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2edb9a19-3ba9-43b0-b088-a97c2ee5c971 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.145465 Jul 28 03:42:30.280836 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 739/1548] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:30 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:30.290709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:30.299656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-482b82d4-ef2b-44fc-9315-0dce9b4bc7fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:30.303285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Getting quotas for user da34b0ac72d94d2fbd00ea09d805f0fe and project 9f7680ec7bd44a62be5017f043d4613b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:42:30.305174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-482b82d4-ef2b-44fc-9315-0dce9b4bc7fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:30.337973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:30.342895 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-482b82d4-ef2b-44fc-9315-0dce9b4bc7fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:30.357635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-482b82d4-ef2b-44fc-9315-0dce9b4bc7fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:30.358400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:42:30.360247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-482b82d4-ef2b-44fc-9315-0dce9b4bc7fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:30.361221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:42:30.362076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-482b82d4-ef2b-44fc-9315-0dce9b4bc7fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:30.501616 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7f55e954-a2eb-4eed-bc99-6ee17b5b0294 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.636267 Jul 28 03:42:30.503038 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 810/1549] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:42:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:42:30.505948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:30.513891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bf7b1233-ac93-4f5d-ab53-eb5bd350c4a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:30.515896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bf7b1233-ac93-4f5d-ab53-eb5bd350c4a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:30.530501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf7b1233-ac93-4f5d-ab53-eb5bd350c4a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:30.531298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf7b1233-ac93-4f5d-ab53-eb5bd350c4a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:30.532305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf7b1233-ac93-4f5d-ab53-eb5bd350c4a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:30.532946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf7b1233-ac93-4f5d-ab53-eb5bd350c4a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:30.632314 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-482b82d4-ef2b-44fc-9315-0dce9b4bc7fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.345736 Jul 28 03:42:30.639174 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 740/1550] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:42:30 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:42:30.676946 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e3daea07-c542-47e2-9e5d-244273993c8d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:30.689263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e3daea07-c542-47e2-9e5d-244273993c8d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:30.939217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bf7b1233-ac93-4f5d-ab53-eb5bd350c4a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:30.958289 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bf7b1233-ac93-4f5d-ab53-eb5bd350c4a1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1319 microversion: 2.1 time: 0.453148 Jul 28 03:42:30.964293 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 811/1551] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:30 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:30.976315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83f7b987-1e8e-447a-b447-d04f0e959e03 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:30.977419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-83f7b987-1e8e-447a-b447-d04f0e959e03 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:30.987106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83f7b987-1e8e-447a-b447-d04f0e959e03 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:30.988025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83f7b987-1e8e-447a-b447-d04f0e959e03 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:30.989655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83f7b987-1e8e-447a-b447-d04f0e959e03 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:30.990747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83f7b987-1e8e-447a-b447-d04f0e959e03 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:31.360592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-83f7b987-1e8e-447a-b447-d04f0e959e03 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:31.379741 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-83f7b987-1e8e-447a-b447-d04f0e959e03 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1660 microversion: 2.1 time: 0.412899 Jul 28 03:42:31.394227 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 812/1552] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:30 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1660 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:31.394227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb42809f-95fb-4134-a697-db1fed14256f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:31.394227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb42809f-95fb-4134-a697-db1fed14256f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:31.400207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb42809f-95fb-4134-a697-db1fed14256f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:31.410118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb42809f-95fb-4134-a697-db1fed14256f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:31.411449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb42809f-95fb-4134-a697-db1fed14256f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:31.412274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb42809f-95fb-4134-a697-db1fed14256f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:31.716676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb42809f-95fb-4134-a697-db1fed14256f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:31.735908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb42809f-95fb-4134-a697-db1fed14256f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:31.739884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb42809f-95fb-4134-a697-db1fed14256f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:31.742107 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb42809f-95fb-4134-a697-db1fed14256f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1796 microversion: 2.42 time: 0.359813 Jul 28 03:42:31.743889 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 813/1553] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:31 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1796 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:31.749117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2555ea12-47e7-4c24-8ba7-57f62eb6608a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa743ac670>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:31.861653 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2555ea12-47e7-4c24-8ba7-57f62eb6608a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.116356 Jul 28 03:42:31.865415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e3daea07-c542-47e2-9e5d-244273993c8d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:31.869652 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 814/1554] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:31 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:31.882233 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e3daea07-c542-47e2-9e5d-244273993c8d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" status: 200 len: 1224 microversion: 2.1 time: 1.237634 Jul 28 03:42:31.894398 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 741/1555] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:30 2022] GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a => generated 1224 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:31.986454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8de21bb7-3218-4828-b503-6cde14f3356c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:31.987370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8de21bb7-3218-4828-b503-6cde14f3356c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:32.000154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8de21bb7-3218-4828-b503-6cde14f3356c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:32.000669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8de21bb7-3218-4828-b503-6cde14f3356c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:32.001550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8de21bb7-3218-4828-b503-6cde14f3356c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:32.002192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8de21bb7-3218-4828-b503-6cde14f3356c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:32.311418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8de21bb7-3218-4828-b503-6cde14f3356c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:32.334488 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8de21bb7-3218-4828-b503-6cde14f3356c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1319 microversion: 2.1 time: 0.351226 Jul 28 03:42:32.348383 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 815/1556] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:31 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:42:32.402892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a4234eca-b6d8-4083-ad6a-607affbcd3ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:32.403527 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a4234eca-b6d8-4083-ad6a-607affbcd3ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:32.415823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a4234eca-b6d8-4083-ad6a-607affbcd3ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:32.416289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a4234eca-b6d8-4083-ad6a-607affbcd3ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:32.417147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a4234eca-b6d8-4083-ad6a-607affbcd3ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:32.421915 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a4234eca-b6d8-4083-ad6a-607affbcd3ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:32.475366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-25dd5750-1691-49b0-9397-ac99d438ec7e req-dadd4a25-d384-48ec-bc3c-2b243ade19eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0", "tag": "94dab48c-bae2-4bbb-8b55-c38e13a00d51"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:32.527718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-25dd5750-1691-49b0-9397-ac99d438ec7e req-dadd4a25-d384-48ec-bc3c-2b243ade19eb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:32.528932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-25dd5750-1691-49b0-9397-ac99d438ec7e req-dadd4a25-d384-48ec-bc3c-2b243ade19eb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:32.554558 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-25dd5750-1691-49b0-9397-ac99d438ec7e req-dadd4a25-d384-48ec-bc3c-2b243ade19eb service nova] Creating event network-changed:94dab48c-bae2-4bbb-8b55-c38e13a00d51 for instance 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 on n-h1-826756-3 Jul 28 03:42:32.569605 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-25dd5750-1691-49b0-9397-ac99d438ec7e req-dadd4a25-d384-48ec-bc3c-2b243ade19eb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101757 Jul 28 03:42:32.572212 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 816/1557] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:32.781340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-28159507-db66-4988-8301-c1269951a95f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:32.782204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-28159507-db66-4988-8301-c1269951a95f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:32.796557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28159507-db66-4988-8301-c1269951a95f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:32.797302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28159507-db66-4988-8301-c1269951a95f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:32.798281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28159507-db66-4988-8301-c1269951a95f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:32.799572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28159507-db66-4988-8301-c1269951a95f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:33.338528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-28159507-db66-4988-8301-c1269951a95f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:33.368985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-28159507-db66-4988-8301-c1269951a95f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:33.375863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-28159507-db66-4988-8301-c1269951a95f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:33.381070 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-28159507-db66-4988-8301-c1269951a95f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1796 microversion: 2.42 time: 0.604385 Jul 28 03:42:33.382548 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 817/1558] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:32 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1796 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:42:33.390400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0bdefd66-92d9-4672-831a-c084bebef668 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa743ac9d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:33.431563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a4234eca-b6d8-4083-ad6a-607affbcd3ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:33.461106 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a4234eca-b6d8-4083-ad6a-607affbcd3ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 1.062432 Jul 28 03:42:33.484535 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 742/1559] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:32 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:42:33.502303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c4f83e30-ffce-474e-b947-17971fa5a54b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:33.503277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c4f83e30-ffce-474e-b947-17971fa5a54b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:33.542288 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0bdefd66-92d9-4672-831a-c084bebef668 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.157725 Jul 28 03:42:33.543794 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 818/1560] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:33 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:33.560751 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4f83e30-ffce-474e-b947-17971fa5a54b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:33.561519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4f83e30-ffce-474e-b947-17971fa5a54b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:33.562887 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4f83e30-ffce-474e-b947-17971fa5a54b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:33.563652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4f83e30-ffce-474e-b947-17971fa5a54b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:33.564473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed1157c7-17ad-478d-9ddc-b80e9069752f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:33.565464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed1157c7-17ad-478d-9ddc-b80e9069752f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:33.613366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed1157c7-17ad-478d-9ddc-b80e9069752f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:33.614237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed1157c7-17ad-478d-9ddc-b80e9069752f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:33.615226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed1157c7-17ad-478d-9ddc-b80e9069752f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:33.615661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed1157c7-17ad-478d-9ddc-b80e9069752f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:33.867602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c4f83e30-ffce-474e-b947-17971fa5a54b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:33.898563 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c4f83e30-ffce-474e-b947-17971fa5a54b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" status: 200 len: 1282 microversion: 2.1 time: 0.412167 Jul 28 03:42:33.903926 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 743/1561] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:33 2022] GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a => generated 1282 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:33.915901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-42a85918-9e04-42b7-814d-af163d755cbe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:33.917732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-42a85918-9e04-42b7-814d-af163d755cbe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:33.932633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42a85918-9e04-42b7-814d-af163d755cbe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:33.934208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42a85918-9e04-42b7-814d-af163d755cbe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:33.936075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42a85918-9e04-42b7-814d-af163d755cbe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:33.937260 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42a85918-9e04-42b7-814d-af163d755cbe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:33.963279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed1157c7-17ad-478d-9ddc-b80e9069752f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:33.980116 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed1157c7-17ad-478d-9ddc-b80e9069752f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1319 microversion: 2.1 time: 0.433690 Jul 28 03:42:33.996672 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 819/1562] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:33 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:34.407304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-08817f1e-7811-4155-9e0d-116276acf478 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:34.407947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-08817f1e-7811-4155-9e0d-116276acf478 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:34.418923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08817f1e-7811-4155-9e0d-116276acf478 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:34.424138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08817f1e-7811-4155-9e0d-116276acf478 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:34.425458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08817f1e-7811-4155-9e0d-116276acf478 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:34.426007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08817f1e-7811-4155-9e0d-116276acf478 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:34.502898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:34.957018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-08817f1e-7811-4155-9e0d-116276acf478 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:34.972572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-08817f1e-7811-4155-9e0d-116276acf478 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:34.974358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-08817f1e-7811-4155-9e0d-116276acf478 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:34.975559 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-08817f1e-7811-4155-9e0d-116276acf478 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1796 microversion: 2.42 time: 0.573804 Jul 28 03:42:35.002137 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 820/1563] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:34 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1796 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:42:35.014480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90e3a3c8-aec8-4072-9299-27a17e173b63 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa741b6f70>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:35.171679 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90e3a3c8-aec8-4072-9299-27a17e173b63 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1412 microversion: 2.1 time: 0.163147 Jul 28 03:42:35.173177 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 821/1564] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:35 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1412 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:35.178691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d64fe481-ec65-4294-b61a-6bdf72c61fec tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:35.186733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d64fe481-ec65-4294-b61a-6bdf72c61fec tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:35.205584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d64fe481-ec65-4294-b61a-6bdf72c61fec tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:35.206673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d64fe481-ec65-4294-b61a-6bdf72c61fec tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:35.208431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d64fe481-ec65-4294-b61a-6bdf72c61fec tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:35.209479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d64fe481-ec65-4294-b61a-6bdf72c61fec tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:35.326388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-42a85918-9e04-42b7-814d-af163d755cbe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:35.353524 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-42a85918-9e04-42b7-814d-af163d755cbe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 1.445850 Jul 28 03:42:35.366013 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 744/1565] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:33 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:35.386183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-edcebeb9-dc4c-4383-81a9-57fa56550446 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:35.396785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-edcebeb9-dc4c-4383-81a9-57fa56550446 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:35.412975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=70 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:35.431713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-edcebeb9-dc4c-4383-81a9-57fa56550446 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:35.432919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-edcebeb9-dc4c-4383-81a9-57fa56550446 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:35.434208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-edcebeb9-dc4c-4383-81a9-57fa56550446 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:35.437000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-edcebeb9-dc4c-4383-81a9-57fa56550446 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:35.887992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d64fe481-ec65-4294-b61a-6bdf72c61fec tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:35.917955 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d64fe481-ec65-4294-b61a-6bdf72c61fec tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" status: 200 len: 1324 microversion: 2.1 time: 0.741839 Jul 28 03:42:35.921493 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 822/1566] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:35 2022] GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a => generated 1324 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:35.941026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-569b96e5-0bbd-452b-b413-c9eb8ea0b710 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:35.944586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-569b96e5-0bbd-452b-b413-c9eb8ea0b710 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:35.964941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-569b96e5-0bbd-452b-b413-c9eb8ea0b710 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:35.969145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-569b96e5-0bbd-452b-b413-c9eb8ea0b710 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:35.971475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-569b96e5-0bbd-452b-b413-c9eb8ea0b710 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:35.972496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-569b96e5-0bbd-452b-b413-c9eb8ea0b710 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:36.113041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-edcebeb9-dc4c-4383-81a9-57fa56550446 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:36.124252 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-edcebeb9-dc4c-4383-81a9-57fa56550446 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1319 microversion: 2.1 time: 0.754109 Jul 28 03:42:36.124885 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 745/1567] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:35 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1319 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:36.136092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-f4c890a4-a9a2-47bc-96e7-07ac95d3522e req-c02e0afb-f351-4ccc-a81e-f862f0b32400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f3d5f3-4a8e-459b-b2cd-a65147c3d008", "tag": "fff12169-c69f-4e4a-a346-95ce764235e8"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:36.167228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f4c890a4-a9a2-47bc-96e7-07ac95d3522e req-c02e0afb-f351-4ccc-a81e-f862f0b32400 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:36.168740 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f4c890a4-a9a2-47bc-96e7-07ac95d3522e req-c02e0afb-f351-4ccc-a81e-f862f0b32400 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:36.202586 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-f4c890a4-a9a2-47bc-96e7-07ac95d3522e req-c02e0afb-f351-4ccc-a81e-f862f0b32400 service nova] Creating event network-changed:fff12169-c69f-4e4a-a346-95ce764235e8 for instance 14f3d5f3-4a8e-459b-b2cd-a65147c3d008 on n-h1-826756-3 Jul 28 03:42:36.212555 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-f4c890a4-a9a2-47bc-96e7-07ac95d3522e req-c02e0afb-f351-4ccc-a81e-f862f0b32400 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079716 Jul 28 03:42:36.214506 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 746/1568] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:36.224325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d8c775cb-5120-46c9-b99a-98df09de4d4c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:36.226025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d8c775cb-5120-46c9-b99a-98df09de4d4c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:36.234439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8c775cb-5120-46c9-b99a-98df09de4d4c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:36.235265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8c775cb-5120-46c9-b99a-98df09de4d4c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:36.236297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8c775cb-5120-46c9-b99a-98df09de4d4c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:36.237199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8c775cb-5120-46c9-b99a-98df09de4d4c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:36.350514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-569b96e5-0bbd-452b-b413-c9eb8ea0b710 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:36.379635 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-569b96e5-0bbd-452b-b413-c9eb8ea0b710 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.456347 Jul 28 03:42:36.382623 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 823/1569] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:35 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:36.395158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc36d100-a247-4ad3-b856-c6af5eeea8bd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa799f0c10>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:36.463235 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cc36d100-a247-4ad3-b856-c6af5eeea8bd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1421 microversion: 2.1 time: 0.076613 Jul 28 03:42:36.475796 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 824/1570] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:36 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1421 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:36.488062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-41e339c3-7a0c-49dd-b4da-8d3d57f2bf2c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:36.489135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-41e339c3-7a0c-49dd-b4da-8d3d57f2bf2c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:36.496521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41e339c3-7a0c-49dd-b4da-8d3d57f2bf2c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:36.497407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41e339c3-7a0c-49dd-b4da-8d3d57f2bf2c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:36.498886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41e339c3-7a0c-49dd-b4da-8d3d57f2bf2c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:36.500288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41e339c3-7a0c-49dd-b4da-8d3d57f2bf2c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:36.877239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-41e339c3-7a0c-49dd-b4da-8d3d57f2bf2c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:36.891462 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-41e339c3-7a0c-49dd-b4da-8d3d57f2bf2c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.414450 Jul 28 03:42:36.892882 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 825/1571] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:36 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:36.900007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e40ef5fa-e617-47ae-a40a-d614cc47b818 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa742a9e50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:36.974490 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e40ef5fa-e617-47ae-a40a-d614cc47b818 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 200 len: 1421 microversion: 2.1 time: 0.080084 Jul 28 03:42:36.977169 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 826/1572] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:42:36 2022] GET /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 1421 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:36.982943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1768429164", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f61dea9e-b85d-46b5-aa09-70f0225d6c84"}], "block_device_mapping_v2": [{"uuid": "91a4456d-1c6b-42e1-bcdd-e28b961a9e7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:37.085448 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d8c775cb-5120-46c9-b99a-98df09de4d4c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:37.097552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] validate_networks() for [('f61dea9e-b85d-46b5-aa09-70f0225d6c84', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:42:37.120848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d8c775cb-5120-46c9-b99a-98df09de4d4c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:37.135264 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d8c775cb-5120-46c9-b99a-98df09de4d4c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:37.139037 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d8c775cb-5120-46c9-b99a-98df09de4d4c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1842 microversion: 2.42 time: 0.922395 Jul 28 03:42:37.154594 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 747/1573] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:36 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1842 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:37.183647 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-de1e3091-79f9-4383-aee8-2cccd73cf15e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:37.184563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-de1e3091-79f9-4383-aee8-2cccd73cf15e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:37.234359 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de1e3091-79f9-4383-aee8-2cccd73cf15e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:37.236280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de1e3091-79f9-4383-aee8-2cccd73cf15e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:37.237914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de1e3091-79f9-4383-aee8-2cccd73cf15e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:37.240792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de1e3091-79f9-4383-aee8-2cccd73cf15e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:38.429128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:42:38.430160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:42:38.430863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:42:38.431534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:42:38.432140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:42:38.451517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:38.457322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:38.458596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:38.459447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:38.507685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Getting quotas for project 881125b6bb84430fb4f2e0c6ebf79983. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:42:38.525761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Getting quotas for user c2e3c37253bc408682e9a15c3b5a85ab and project 881125b6bb84430fb4f2e0c6ebf79983. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:42:38.623818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:42:38.628582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91a4456d-1c6b-42e1-bcdd-e28b961a9e7f',volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:42:38.721284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-de1e3091-79f9-4383-aee8-2cccd73cf15e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:38.733741 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-de1e3091-79f9-4383-aee8-2cccd73cf15e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 1.577906 Jul 28 03:42:38.740995 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 748/1574] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:37 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:38.759577 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5d515f46-4ea1-4893-92d6-6e7cbf781acd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:38.760211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5d515f46-4ea1-4893-92d6-6e7cbf781acd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:38.783083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d515f46-4ea1-4893-92d6-6e7cbf781acd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:38.783658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d515f46-4ea1-4893-92d6-6e7cbf781acd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:38.786903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d515f46-4ea1-4893-92d6-6e7cbf781acd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:38.787455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d515f46-4ea1-4893-92d6-6e7cbf781acd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:38.931458 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-087e94ba-7d0d-41fa-8aec-86c8cbdc459c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.952920 Jul 28 03:42:38.932452 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 827/1575] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:42:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1954 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:42:38.937668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9895d674-85ae-4136-8dc7-806bf1a2e6dc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa747e1940>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:39.347060 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5d515f46-4ea1-4893-92d6-6e7cbf781acd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:39.363867 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5d515f46-4ea1-4893-92d6-6e7cbf781acd tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" status: 200 len: 1324 microversion: 2.1 time: 0.618353 Jul 28 03:42:39.366727 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 749/1576] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:38 2022] GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a => generated 1324 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:39.370481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-9ea180b3-e2ef-422e-9bad-e7e32d4ad15b req-24914095-b148-4d43-9663-168635b761a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1ad11e2-ba9b-4fc3-86ca-b871f311b52a", "tag": "6a95d3ac-a87f-4069-aae1-494421f7ceaa"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:39.381921 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9ea180b3-e2ef-422e-9bad-e7e32d4ad15b req-24914095-b148-4d43-9663-168635b761a8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:39.382590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9ea180b3-e2ef-422e-9bad-e7e32d4ad15b req-24914095-b148-4d43-9663-168635b761a8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:39.402528 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-9ea180b3-e2ef-422e-9bad-e7e32d4ad15b req-24914095-b148-4d43-9663-168635b761a8 service nova] Creating event network-changed:6a95d3ac-a87f-4069-aae1-494421f7ceaa for instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a on n-h2-826756-3 Jul 28 03:42:39.410305 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-9ea180b3-e2ef-422e-9bad-e7e32d4ad15b req-24914095-b148-4d43-9663-168635b761a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044094 Jul 28 03:42:39.411509 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 750/1577] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:39.420974 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5b0113a7-9ed6-44ad-a6ab-065edf3e37c4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:39.422819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5b0113a7-9ed6-44ad-a6ab-065edf3e37c4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:39.432596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b0113a7-9ed6-44ad-a6ab-065edf3e37c4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:39.435727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b0113a7-9ed6-44ad-a6ab-065edf3e37c4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:39.437502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b0113a7-9ed6-44ad-a6ab-065edf3e37c4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:39.439643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b0113a7-9ed6-44ad-a6ab-065edf3e37c4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:39.723982 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9895d674-85ae-4136-8dc7-806bf1a2e6dc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 204 len: 0 microversion: 2.1 time: 0.789769 Jul 28 03:42:39.725115 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 828/1578] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:38 2022] DELETE /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:39.741317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b4a26ad8-91f7-4fdc-92df-d63240b81672 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:39.742569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4a26ad8-91f7-4fdc-92df-d63240b81672 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:39.760185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4a26ad8-91f7-4fdc-92df-d63240b81672 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:39.772958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4a26ad8-91f7-4fdc-92df-d63240b81672 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:39.779195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4a26ad8-91f7-4fdc-92df-d63240b81672 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:39.780606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4a26ad8-91f7-4fdc-92df-d63240b81672 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:39.862395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5b0113a7-9ed6-44ad-a6ab-065edf3e37c4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:39.915050 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5b0113a7-9ed6-44ad-a6ab-065edf3e37c4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1319 microversion: 2.1 time: 0.501927 Jul 28 03:42:39.915576 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 751/1579] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:39 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:39.926415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5bdc0c63-4096-46bd-b234-31dfb1024769 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:39.927218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5bdc0c63-4096-46bd-b234-31dfb1024769 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:39.940917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5bdc0c63-4096-46bd-b234-31dfb1024769 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:39.942061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5bdc0c63-4096-46bd-b234-31dfb1024769 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:39.949289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5bdc0c63-4096-46bd-b234-31dfb1024769 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:39.950673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5bdc0c63-4096-46bd-b234-31dfb1024769 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:40.114213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b4a26ad8-91f7-4fdc-92df-d63240b81672 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:40.131599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b4a26ad8-91f7-4fdc-92df-d63240b81672 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:40.133359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b4a26ad8-91f7-4fdc-92df-d63240b81672 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:40.134790 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b4a26ad8-91f7-4fdc-92df-d63240b81672 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1842 microversion: 2.42 time: 0.408258 Jul 28 03:42:40.140807 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 829/1580] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:39 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1842 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:40.163011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f18462c9-5ce3-433f-b63f-51f075a4bff8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:40.163642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f18462c9-5ce3-433f-b63f-51f075a4bff8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:40.184704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f18462c9-5ce3-433f-b63f-51f075a4bff8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:40.185354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f18462c9-5ce3-433f-b63f-51f075a4bff8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:40.186662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f18462c9-5ce3-433f-b63f-51f075a4bff8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:40.188161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f18462c9-5ce3-433f-b63f-51f075a4bff8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:40.249685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5bdc0c63-4096-46bd-b234-31dfb1024769 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:40.267739 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5bdc0c63-4096-46bd-b234-31dfb1024769 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.351068 Jul 28 03:42:40.289239 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 752/1581] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:39 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:40.307093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-12f9b2db-0709-4348-bcfe-cb49203d8fb8 req-81caaead-1b9b-4369-8f8c-6c7210f3fd5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "tag": "3e015ffb-f6e7-43ce-ac59-41ddf8b14cdf"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:40.361454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-12f9b2db-0709-4348-bcfe-cb49203d8fb8 req-81caaead-1b9b-4369-8f8c-6c7210f3fd5c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:40.364257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-12f9b2db-0709-4348-bcfe-cb49203d8fb8 req-81caaead-1b9b-4369-8f8c-6c7210f3fd5c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:40.380585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f18462c9-5ce3-433f-b63f-51f075a4bff8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:40.394240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f18462c9-5ce3-433f-b63f-51f075a4bff8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:40.400765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f18462c9-5ce3-433f-b63f-51f075a4bff8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:40.402253 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f18462c9-5ce3-433f-b63f-51f075a4bff8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1185 microversion: 2.25 time: 0.251277 Jul 28 03:42:40.413652 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 830/1582] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:40 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1185 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:40.416266 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-12f9b2db-0709-4348-bcfe-cb49203d8fb8 req-81caaead-1b9b-4369-8f8c-6c7210f3fd5c service nova] Creating event network-changed:3e015ffb-f6e7-43ce-ac59-41ddf8b14cdf for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:42:40.419102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e389034c-9f43-4093-b60e-201394bf9483 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:40.419830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e389034c-9f43-4093-b60e-201394bf9483 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:40.425812 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-12f9b2db-0709-4348-bcfe-cb49203d8fb8 req-81caaead-1b9b-4369-8f8c-6c7210f3fd5c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134460 Jul 28 03:42:40.427042 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 753/1583] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:40.431271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e389034c-9f43-4093-b60e-201394bf9483 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:40.432849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e389034c-9f43-4093-b60e-201394bf9483 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:40.435937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e389034c-9f43-4093-b60e-201394bf9483 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:40.436711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e389034c-9f43-4093-b60e-201394bf9483 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:40.467108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d68fd1b2-fb03-472f-8dec-2b750622a6be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:40.470476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d68fd1b2-fb03-472f-8dec-2b750622a6be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:40.487294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d68fd1b2-fb03-472f-8dec-2b750622a6be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:40.488528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d68fd1b2-fb03-472f-8dec-2b750622a6be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:40.489833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d68fd1b2-fb03-472f-8dec-2b750622a6be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:40.490553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d68fd1b2-fb03-472f-8dec-2b750622a6be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:40.506556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e389034c-9f43-4093-b60e-201394bf9483 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:42:40.755150 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e389034c-9f43-4093-b60e-201394bf9483 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 204 len: 0 microversion: 2.1 time: 0.339421 Jul 28 03:42:40.758296 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 831/1584] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:42:40 2022] DELETE /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:42:40.946580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-50304364-dace-4e01-a02b-4f8ccb6689f2 req-f85d5e6d-ce03-446f-866a-87abb324e8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0", "name": "network-vif-plugged", "status": "completed", "tag": "94dab48c-bae2-4bbb-8b55-c38e13a00d51"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:41.001796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-50304364-dace-4e01-a02b-4f8ccb6689f2 req-f85d5e6d-ce03-446f-866a-87abb324e8ee service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:41.014548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-50304364-dace-4e01-a02b-4f8ccb6689f2 req-f85d5e6d-ce03-446f-866a-87abb324e8ee service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:41.062047 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-50304364-dace-4e01-a02b-4f8ccb6689f2 req-f85d5e6d-ce03-446f-866a-87abb324e8ee service nova] Creating event network-vif-plugged:94dab48c-bae2-4bbb-8b55-c38e13a00d51 for instance 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 on n-h1-826756-3 Jul 28 03:42:41.082183 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-50304364-dace-4e01-a02b-4f8ccb6689f2 req-f85d5e6d-ce03-446f-866a-87abb324e8ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143169 Jul 28 03:42:41.083799 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 832/1585] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:41.091446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2638fc44-5795-4608-9448-0bdd50cfc9fb tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:41.093533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2638fc44-5795-4608-9448-0bdd50cfc9fb tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:41.105312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2638fc44-5795-4608-9448-0bdd50cfc9fb tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:41.106426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2638fc44-5795-4608-9448-0bdd50cfc9fb tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:41.109215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2638fc44-5795-4608-9448-0bdd50cfc9fb tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:41.110820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2638fc44-5795-4608-9448-0bdd50cfc9fb tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:41.439473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d68fd1b2-fb03-472f-8dec-2b750622a6be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:41.472869 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d68fd1b2-fb03-472f-8dec-2b750622a6be tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" status: 200 len: 1324 microversion: 2.1 time: 1.034391 Jul 28 03:42:41.484620 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 754/1586] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:40 2022] GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a => generated 1324 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:41.501615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-79177902", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f8adb240-7396-4ba1-87bd-7c26f1c16184"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:41.521505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2638fc44-5795-4608-9448-0bdd50cfc9fb tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:41.538709 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2638fc44-5795-4608-9448-0bdd50cfc9fb tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1319 microversion: 2.1 time: 0.452747 Jul 28 03:42:41.540649 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 833/1587] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:41 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:41.555291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-570de7fd-f38f-41b7-84ec-3a8ec602003a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:41.556447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-570de7fd-f38f-41b7-84ec-3a8ec602003a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:41.581342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-570de7fd-f38f-41b7-84ec-3a8ec602003a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:41.582271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-570de7fd-f38f-41b7-84ec-3a8ec602003a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:41.583314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-570de7fd-f38f-41b7-84ec-3a8ec602003a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:41.583975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-570de7fd-f38f-41b7-84ec-3a8ec602003a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:41.752506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] validate_networks() for [('f8adb240-7396-4ba1-87bd-7c26f1c16184', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:42:41.873022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:42.224628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-570de7fd-f38f-41b7-84ec-3a8ec602003a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:42.266490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-570de7fd-f38f-41b7-84ec-3a8ec602003a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:42.272387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-570de7fd-f38f-41b7-84ec-3a8ec602003a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:42.279305 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-570de7fd-f38f-41b7-84ec-3a8ec602003a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1842 microversion: 2.42 time: 0.736675 Jul 28 03:42:42.307019 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 834/1588] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:41 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1842 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:42.335692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-64798c43-e80a-4b98-81bc-8e83dec99f81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:42.335692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-64798c43-e80a-4b98-81bc-8e83dec99f81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:42.352879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64798c43-e80a-4b98-81bc-8e83dec99f81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:42.353554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64798c43-e80a-4b98-81bc-8e83dec99f81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:42.354729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64798c43-e80a-4b98-81bc-8e83dec99f81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:42.355321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64798c43-e80a-4b98-81bc-8e83dec99f81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:42.494112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-64798c43-e80a-4b98-81bc-8e83dec99f81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:42.518146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-64798c43-e80a-4b98-81bc-8e83dec99f81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:42.534972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-64798c43-e80a-4b98-81bc-8e83dec99f81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:42.536292 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-64798c43-e80a-4b98-81bc-8e83dec99f81 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1251 microversion: 2.25 time: 0.241057 Jul 28 03:42:42.537257 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 835/1589] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:42 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1251 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:42.541968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-708f27df-f30a-41de-a0b0-2a717b613de3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:42.542584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-708f27df-f30a-41de-a0b0-2a717b613de3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:42.558551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-708f27df-f30a-41de-a0b0-2a717b613de3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:42.559182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-708f27df-f30a-41de-a0b0-2a717b613de3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:42.560171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-708f27df-f30a-41de-a0b0-2a717b613de3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:42.563663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-708f27df-f30a-41de-a0b0-2a717b613de3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:42.878088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-708f27df-f30a-41de-a0b0-2a717b613de3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:42.888694 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-708f27df-f30a-41de-a0b0-2a717b613de3 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" status: 200 len: 1324 microversion: 2.1 time: 0.349962 Jul 28 03:42:42.889665 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 836/1590] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:42 2022] GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a => generated 1324 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:42.894504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5476b321-eb9c-46af-b00d-5fedc241051f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:42.895144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5476b321-eb9c-46af-b00d-5fedc241051f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:42.920403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5476b321-eb9c-46af-b00d-5fedc241051f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:42.920835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5476b321-eb9c-46af-b00d-5fedc241051f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:42.921689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5476b321-eb9c-46af-b00d-5fedc241051f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:42.922133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5476b321-eb9c-46af-b00d-5fedc241051f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:43.265421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5476b321-eb9c-46af-b00d-5fedc241051f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:43.274910 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5476b321-eb9c-46af-b00d-5fedc241051f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1319 microversion: 2.1 time: 0.384118 Jul 28 03:42:43.276133 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 837/1591] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:42 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:43.322552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d6d39a5-a5b4-44fb-9a6f-129a8e2d18ba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:43.324524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4d6d39a5-a5b4-44fb-9a6f-129a8e2d18ba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:43.339570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d6d39a5-a5b4-44fb-9a6f-129a8e2d18ba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:43.340962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d6d39a5-a5b4-44fb-9a6f-129a8e2d18ba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:43.343671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d6d39a5-a5b4-44fb-9a6f-129a8e2d18ba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:43.344917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d6d39a5-a5b4-44fb-9a6f-129a8e2d18ba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:43.706159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d6d39a5-a5b4-44fb-9a6f-129a8e2d18ba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:43.731180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d6d39a5-a5b4-44fb-9a6f-129a8e2d18ba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:43.732880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d6d39a5-a5b4-44fb-9a6f-129a8e2d18ba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:43.735017 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d6d39a5-a5b4-44fb-9a6f-129a8e2d18ba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1863 microversion: 2.42 time: 0.423023 Jul 28 03:42:43.740507 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 838/1592] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:43 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1863 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:43.741852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6ecf4a02-37f3-4a44-b1ff-5b2fc94f3f86 req-7d21fefb-1608-4184-9751-c6c09142dcdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf954030-af98-4832-a28a-03cf2a3fe8c9", "name": "network-vif-unplugged", "status": "completed", "tag": "bf305f0a-27a2-4078-b918-f102991b6796"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:43.770406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6ecf4a02-37f3-4a44-b1ff-5b2fc94f3f86 req-7d21fefb-1608-4184-9751-c6c09142dcdc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:43.770406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6ecf4a02-37f3-4a44-b1ff-5b2fc94f3f86 req-7d21fefb-1608-4184-9751-c6c09142dcdc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:43.781309 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6ecf4a02-37f3-4a44-b1ff-5b2fc94f3f86 req-7d21fefb-1608-4184-9751-c6c09142dcdc service nova] Creating event network-vif-unplugged:bf305f0a-27a2-4078-b918-f102991b6796 for instance bf954030-af98-4832-a28a-03cf2a3fe8c9 on n-h1-826756-3 Jul 28 03:42:43.787912 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6ecf4a02-37f3-4a44-b1ff-5b2fc94f3f86 req-7d21fefb-1608-4184-9751-c6c09142dcdc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050041 Jul 28 03:42:43.789116 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 839/1593] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:43.796383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5a210d5e-5242-4674-b018-23cf2a8b7700 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:43.797307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5a210d5e-5242-4674-b018-23cf2a8b7700 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:43.804979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a210d5e-5242-4674-b018-23cf2a8b7700 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:43.805603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a210d5e-5242-4674-b018-23cf2a8b7700 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:43.806515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a210d5e-5242-4674-b018-23cf2a8b7700 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:43.807080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a210d5e-5242-4674-b018-23cf2a8b7700 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:43.900316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5a210d5e-5242-4674-b018-23cf2a8b7700 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:43.910799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5a210d5e-5242-4674-b018-23cf2a8b7700 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:43.912402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5a210d5e-5242-4674-b018-23cf2a8b7700 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:43.913854 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5a210d5e-5242-4674-b018-23cf2a8b7700 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1251 microversion: 2.25 time: 0.123226 Jul 28 03:42:43.914940 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 840/1594] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:43 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1251 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:43.922267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4387fde2-29ff-4a52-b674-f55c1264c6e4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:43.923224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4387fde2-29ff-4a52-b674-f55c1264c6e4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:43.931262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4387fde2-29ff-4a52-b674-f55c1264c6e4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:43.932016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4387fde2-29ff-4a52-b674-f55c1264c6e4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:43.933077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4387fde2-29ff-4a52-b674-f55c1264c6e4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:43.933581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4387fde2-29ff-4a52-b674-f55c1264c6e4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:43.951168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:44.178333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4387fde2-29ff-4a52-b674-f55c1264c6e4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:44.191033 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4387fde2-29ff-4a52-b674-f55c1264c6e4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" status: 200 len: 1324 microversion: 2.1 time: 0.271972 Jul 28 03:42:44.205594 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 841/1595] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:43 2022] GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a => generated 1324 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:44.303569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6a6c2db5-7e0b-4626-9c73-ecca0e95677c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:44.305013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6a6c2db5-7e0b-4626-9c73-ecca0e95677c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:44.312870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a6c2db5-7e0b-4626-9c73-ecca0e95677c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:44.313785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a6c2db5-7e0b-4626-9c73-ecca0e95677c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:44.314814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a6c2db5-7e0b-4626-9c73-ecca0e95677c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:44.317071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a6c2db5-7e0b-4626-9c73-ecca0e95677c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:44.517698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6a6c2db5-7e0b-4626-9c73-ecca0e95677c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:44.540973 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6a6c2db5-7e0b-4626-9c73-ecca0e95677c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1319 microversion: 2.1 time: 0.240016 Jul 28 03:42:44.552608 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 842/1596] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:44 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:42:44.764631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93901825-8c10-4aaf-bea6-2fbf09e86fd8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:44.765402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93901825-8c10-4aaf-bea6-2fbf09e86fd8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:44.782912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93901825-8c10-4aaf-bea6-2fbf09e86fd8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:44.786183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93901825-8c10-4aaf-bea6-2fbf09e86fd8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:44.787382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93901825-8c10-4aaf-bea6-2fbf09e86fd8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:44.787973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93901825-8c10-4aaf-bea6-2fbf09e86fd8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:45.198435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:42:45.199539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93901825-8c10-4aaf-bea6-2fbf09e86fd8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:45.201251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:42:45.202833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:42:45.204955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:42:45.207487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:42:45.218176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93901825-8c10-4aaf-bea6-2fbf09e86fd8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:45.221414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93901825-8c10-4aaf-bea6-2fbf09e86fd8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:45.224118 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93901825-8c10-4aaf-bea6-2fbf09e86fd8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1863 microversion: 2.42 time: 0.463584 Jul 28 03:42:45.225736 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 843/1597] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:44 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1863 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:45.234093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-ab1a18e1-4295-4738-9341-27fb709da7cc req-ad7296e8-9056-43a2-9a4a-172d3a89d07a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "tag": "63bb8bca-6b52-40f6-ad2d-1ef5bfde276f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:45.240204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:45.241006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:45.247567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:45.249376 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:45.251808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ab1a18e1-4295-4738-9341-27fb709da7cc req-ad7296e8-9056-43a2-9a4a-172d3a89d07a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:45.252883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ab1a18e1-4295-4738-9341-27fb709da7cc req-ad7296e8-9056-43a2-9a4a-172d3a89d07a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:45.277848 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-ab1a18e1-4295-4738-9341-27fb709da7cc req-ad7296e8-9056-43a2-9a4a-172d3a89d07a service nova] Creating event network-changed:63bb8bca-6b52-40f6-ad2d-1ef5bfde276f for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:42:45.286605 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-ab1a18e1-4295-4738-9341-27fb709da7cc req-ad7296e8-9056-43a2-9a4a-172d3a89d07a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058569 Jul 28 03:42:45.288134 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 844/1598] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:45.297502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94083e5c-c04e-4cda-ae95-f77f2da29d1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:45.298065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Getting quotas for project edc9288cef154fa28f7057f25e0e3213. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:42:45.299443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-94083e5c-c04e-4cda-ae95-f77f2da29d1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:45.312222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94083e5c-c04e-4cda-ae95-f77f2da29d1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:45.314184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94083e5c-c04e-4cda-ae95-f77f2da29d1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:45.316055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94083e5c-c04e-4cda-ae95-f77f2da29d1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:45.317150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94083e5c-c04e-4cda-ae95-f77f2da29d1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:45.322832 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Getting quotas for user 670b269eb20c416e9f43f8d4e43ded45 and project edc9288cef154fa28f7057f25e0e3213. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:42:45.355405 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:42:45.357937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:42:45.417791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-94083e5c-c04e-4cda-ae95-f77f2da29d1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:45.434980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-94083e5c-c04e-4cda-ae95-f77f2da29d1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:45.438623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-94083e5c-c04e-4cda-ae95-f77f2da29d1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:45.440881 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-94083e5c-c04e-4cda-ae95-f77f2da29d1a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1251 microversion: 2.25 time: 0.150708 Jul 28 03:42:45.442743 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 845/1599] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:45 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1251 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:45.454425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0050ce13-ba82-484c-a6da-9549e8eb302a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:45.455564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0050ce13-ba82-484c-a6da-9549e8eb302a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:45.464666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0050ce13-ba82-484c-a6da-9549e8eb302a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:45.465567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0050ce13-ba82-484c-a6da-9549e8eb302a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:45.466906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0050ce13-ba82-484c-a6da-9549e8eb302a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:45.467632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0050ce13-ba82-484c-a6da-9549e8eb302a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:45.473304 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-06290d5a-1065-4b8c-bce1-90ca8318ee3c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.989981 Jul 28 03:42:45.476113 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 755/1600] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:42:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:42:45.522054 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e5870662-dd7e-4966-9da3-d79be9646094 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:45.522687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e5870662-dd7e-4966-9da3-d79be9646094 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:45.681968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e5870662-dd7e-4966-9da3-d79be9646094 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:45.710237 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e5870662-dd7e-4966-9da3-d79be9646094 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 200 len: 1206 microversion: 2.1 time: 0.224313 Jul 28 03:42:45.736732 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 756/1601] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:45 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 1206 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:45.752121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3ae8a511-d78e-4ea1-b7ec-299c9186138e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:45.753399 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3ae8a511-d78e-4ea1-b7ec-299c9186138e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:45.774323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ae8a511-d78e-4ea1-b7ec-299c9186138e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:45.775681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ae8a511-d78e-4ea1-b7ec-299c9186138e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:45.779225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ae8a511-d78e-4ea1-b7ec-299c9186138e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:45.782319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ae8a511-d78e-4ea1-b7ec-299c9186138e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:45.902580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0050ce13-ba82-484c-a6da-9549e8eb302a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:45.919454 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0050ce13-ba82-484c-a6da-9549e8eb302a tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" status: 200 len: 1324 microversion: 2.1 time: 0.475197 Jul 28 03:42:45.921102 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 846/1602] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:45 2022] GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a => generated 1324 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:45.940049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e32aa429-a73f-4e11-8d33-47d984eab9e6 req-67c7c7ec-57de-4a3a-96b9-abca6e2fa597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ad11e2-ba9b-4fc3-86ca-b871f311b52a", "name": "network-vif-plugged", "status": "completed", "tag": "6a95d3ac-a87f-4069-aae1-494421f7ceaa"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:45.992338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e32aa429-a73f-4e11-8d33-47d984eab9e6 req-67c7c7ec-57de-4a3a-96b9-abca6e2fa597 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:45.993629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e32aa429-a73f-4e11-8d33-47d984eab9e6 req-67c7c7ec-57de-4a3a-96b9-abca6e2fa597 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:46.035445 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e32aa429-a73f-4e11-8d33-47d984eab9e6 req-67c7c7ec-57de-4a3a-96b9-abca6e2fa597 service nova] Creating event network-vif-plugged:6a95d3ac-a87f-4069-aae1-494421f7ceaa for instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a on n-h2-826756-3 Jul 28 03:42:46.063271 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e32aa429-a73f-4e11-8d33-47d984eab9e6 req-67c7c7ec-57de-4a3a-96b9-abca6e2fa597 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130258 Jul 28 03:42:46.065302 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 847/1603] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:46.253041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ee49f9c8-3c03-471b-ba5f-dfef79abef3b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:46.254465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ee49f9c8-3c03-471b-ba5f-dfef79abef3b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:46.291914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee49f9c8-3c03-471b-ba5f-dfef79abef3b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:46.293949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee49f9c8-3c03-471b-ba5f-dfef79abef3b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:46.295616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee49f9c8-3c03-471b-ba5f-dfef79abef3b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:46.305532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee49f9c8-3c03-471b-ba5f-dfef79abef3b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:46.531334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3ae8a511-d78e-4ea1-b7ec-299c9186138e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:46.544247 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3ae8a511-d78e-4ea1-b7ec-299c9186138e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1319 microversion: 2.1 time: 0.805706 Jul 28 03:42:46.564458 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 757/1604] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:45 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1319 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:46.572459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-70538c72-1f4b-4169-aaae-0cbd12c34021 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:46.573083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-70538c72-1f4b-4169-aaae-0cbd12c34021 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:46.606982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70538c72-1f4b-4169-aaae-0cbd12c34021 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:46.607434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70538c72-1f4b-4169-aaae-0cbd12c34021 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:46.608226 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70538c72-1f4b-4169-aaae-0cbd12c34021 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:46.608690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70538c72-1f4b-4169-aaae-0cbd12c34021 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:46.941715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ee49f9c8-3c03-471b-ba5f-dfef79abef3b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:46.967481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ee49f9c8-3c03-471b-ba5f-dfef79abef3b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:46.970194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ee49f9c8-3c03-471b-ba5f-dfef79abef3b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:46.977888 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ee49f9c8-3c03-471b-ba5f-dfef79abef3b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1863 microversion: 2.42 time: 0.732393 Jul 28 03:42:46.978805 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 848/1605] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:46 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1863 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:42:47.016148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40af5f05-fa97-48de-826f-1463a2df2b0b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:47.017946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40af5f05-fa97-48de-826f-1463a2df2b0b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:47.032116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40af5f05-fa97-48de-826f-1463a2df2b0b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:47.034628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40af5f05-fa97-48de-826f-1463a2df2b0b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:47.035844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40af5f05-fa97-48de-826f-1463a2df2b0b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:47.036746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40af5f05-fa97-48de-826f-1463a2df2b0b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:47.257048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40af5f05-fa97-48de-826f-1463a2df2b0b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:47.272617 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40af5f05-fa97-48de-826f-1463a2df2b0b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 200 len: 1202 microversion: 2.1 time: 0.292347 Jul 28 03:42:47.274313 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 849/1606] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:46 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 1202 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:47.282209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d463f8c3-e911-469d-8653-5e7f08320d77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:47.289584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d463f8c3-e911-469d-8653-5e7f08320d77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:47.303093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d463f8c3-e911-469d-8653-5e7f08320d77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:47.303867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d463f8c3-e911-469d-8653-5e7f08320d77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:47.305099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d463f8c3-e911-469d-8653-5e7f08320d77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:47.305932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d463f8c3-e911-469d-8653-5e7f08320d77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:47.306817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-70538c72-1f4b-4169-aaae-0cbd12c34021 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:47.321349 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-70538c72-1f4b-4169-aaae-0cbd12c34021 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:47.323697 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-70538c72-1f4b-4169-aaae-0cbd12c34021 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:47.324917 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-70538c72-1f4b-4169-aaae-0cbd12c34021 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1293 microversion: 2.25 time: 0.759311 Jul 28 03:42:47.332269 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 758/1607] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:46 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1293 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:47.358671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-cc21150a-4493-47fe-8a51-4a01322339ab req-a9d27781-7a73-42a8-9433-6f55c1b9576c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf954030-af98-4832-a28a-03cf2a3fe8c9", "name": "network-vif-deleted", "tag": "bf305f0a-27a2-4078-b918-f102991b6796"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:47.390992 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-cc21150a-4493-47fe-8a51-4a01322339ab req-a9d27781-7a73-42a8-9433-6f55c1b9576c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:47.391721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-cc21150a-4493-47fe-8a51-4a01322339ab req-a9d27781-7a73-42a8-9433-6f55c1b9576c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:47.471873 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-cc21150a-4493-47fe-8a51-4a01322339ab req-a9d27781-7a73-42a8-9433-6f55c1b9576c service nova] Creating event network-vif-deleted:bf305f0a-27a2-4078-b918-f102991b6796 for instance bf954030-af98-4832-a28a-03cf2a3fe8c9 on n-h1-826756-3 Jul 28 03:42:47.482803 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-cc21150a-4493-47fe-8a51-4a01322339ab req-a9d27781-7a73-42a8-9433-6f55c1b9576c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131830 Jul 28 03:42:47.486272 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 759/1608] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 28 03:42:47.570286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-963cd55f-2146-4499-823b-24cc5b7c9e44 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:47.571330 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-963cd55f-2146-4499-823b-24cc5b7c9e44 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:47.588294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d463f8c3-e911-469d-8653-5e7f08320d77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:47.601276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-963cd55f-2146-4499-823b-24cc5b7c9e44 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:47.601728 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-963cd55f-2146-4499-823b-24cc5b7c9e44 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:47.603500 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d463f8c3-e911-469d-8653-5e7f08320d77 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" status: 200 len: 1324 microversion: 2.1 time: 0.327628 Jul 28 03:42:47.604600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-963cd55f-2146-4499-823b-24cc5b7c9e44 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:47.605391 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 850/1609] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:47 2022] GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a => generated 1324 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:47.608603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-963cd55f-2146-4499-823b-24cc5b7c9e44 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:47.983008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-963cd55f-2146-4499-823b-24cc5b7c9e44 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:48.009348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e30c20b0-c6dc-4f42-89d6-581639d52d5b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:48.011245 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-963cd55f-2146-4499-823b-24cc5b7c9e44 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1319 microversion: 2.1 time: 0.446648 Jul 28 03:42:48.012328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e30c20b0-c6dc-4f42-89d6-581639d52d5b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:48.015315 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 760/1610] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:47 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:42:48.047204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30c20b0-c6dc-4f42-89d6-581639d52d5b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:48.048120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30c20b0-c6dc-4f42-89d6-581639d52d5b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:48.049646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30c20b0-c6dc-4f42-89d6-581639d52d5b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:48.050738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e30c20b0-c6dc-4f42-89d6-581639d52d5b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:48.154656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-55bf05f3-1d4d-4f1e-be75-af9b83b9012a req-1075b64c-889c-41f3-acf9-75dc4594704f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f3d5f3-4a8e-459b-b2cd-a65147c3d008", "name": "network-vif-plugged", "status": "completed", "tag": "fff12169-c69f-4e4a-a346-95ce764235e8"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:48.225681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-55bf05f3-1d4d-4f1e-be75-af9b83b9012a req-1075b64c-889c-41f3-acf9-75dc4594704f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:48.226972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-55bf05f3-1d4d-4f1e-be75-af9b83b9012a req-1075b64c-889c-41f3-acf9-75dc4594704f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:48.252679 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-55bf05f3-1d4d-4f1e-be75-af9b83b9012a req-1075b64c-889c-41f3-acf9-75dc4594704f service nova] Creating event network-vif-plugged:fff12169-c69f-4e4a-a346-95ce764235e8 for instance 14f3d5f3-4a8e-459b-b2cd-a65147c3d008 on n-h1-826756-3 Jul 28 03:42:48.263719 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-55bf05f3-1d4d-4f1e-be75-af9b83b9012a req-1075b64c-889c-41f3-acf9-75dc4594704f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116724 Jul 28 03:42:48.265444 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 761/1611] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:48.320514 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b98ff85d-e9ff-413b-8f85-870558fd3c9f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:48.321701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b98ff85d-e9ff-413b-8f85-870558fd3c9f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:48.360320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b98ff85d-e9ff-413b-8f85-870558fd3c9f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:48.367602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b98ff85d-e9ff-413b-8f85-870558fd3c9f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:48.372241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b98ff85d-e9ff-413b-8f85-870558fd3c9f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:48.375319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b98ff85d-e9ff-413b-8f85-870558fd3c9f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:48.451711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:48.488973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:48.536782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e30c20b0-c6dc-4f42-89d6-581639d52d5b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:48.539534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:48.557435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e30c20b0-c6dc-4f42-89d6-581639d52d5b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:48.572077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e30c20b0-c6dc-4f42-89d6-581639d52d5b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:48.574769 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e30c20b0-c6dc-4f42-89d6-581639d52d5b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1884 microversion: 2.42 time: 0.571489 Jul 28 03:42:48.576583 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 851/1612] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:48 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1884 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:42:48.583852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17618d7c-7b29-48b1-8ab7-ee9e65890f8d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:48.591994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-17618d7c-7b29-48b1-8ab7-ee9e65890f8d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:48.605865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:48.618953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17618d7c-7b29-48b1-8ab7-ee9e65890f8d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:48.619414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17618d7c-7b29-48b1-8ab7-ee9e65890f8d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:48.620213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17618d7c-7b29-48b1-8ab7-ee9e65890f8d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:48.620762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17618d7c-7b29-48b1-8ab7-ee9e65890f8d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:48.728157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b98ff85d-e9ff-413b-8f85-870558fd3c9f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:48.740323 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b98ff85d-e9ff-413b-8f85-870558fd3c9f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 200 len: 1264 microversion: 2.1 time: 0.448980 Jul 28 03:42:48.750286 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 762/1613] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:48 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 1264 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:48.768845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f8d22abd-5da8-4797-b8ec-f5a6fcef3546 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:48.770566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f8d22abd-5da8-4797-b8ec-f5a6fcef3546 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:48.782689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f8d22abd-5da8-4797-b8ec-f5a6fcef3546 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:48.784491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f8d22abd-5da8-4797-b8ec-f5a6fcef3546 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:48.785976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f8d22abd-5da8-4797-b8ec-f5a6fcef3546 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:48.787797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f8d22abd-5da8-4797-b8ec-f5a6fcef3546 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:48.935245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-17618d7c-7b29-48b1-8ab7-ee9e65890f8d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:48.953095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-17618d7c-7b29-48b1-8ab7-ee9e65890f8d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:48.956890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-17618d7c-7b29-48b1-8ab7-ee9e65890f8d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:48.960909 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-17618d7c-7b29-48b1-8ab7-ee9e65890f8d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1293 microversion: 2.25 time: 0.382230 Jul 28 03:42:48.963682 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 852/1614] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:48 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1293 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:49.040765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa3c0052-9cd0-42a5-8f30-dbb62aac5cd3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:49.041595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fa3c0052-9cd0-42a5-8f30-dbb62aac5cd3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:49.062157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa3c0052-9cd0-42a5-8f30-dbb62aac5cd3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:49.063005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa3c0052-9cd0-42a5-8f30-dbb62aac5cd3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:49.064403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa3c0052-9cd0-42a5-8f30-dbb62aac5cd3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:49.065374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa3c0052-9cd0-42a5-8f30-dbb62aac5cd3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:49.306856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa3c0052-9cd0-42a5-8f30-dbb62aac5cd3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:49.319317 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fa3c0052-9cd0-42a5-8f30-dbb62aac5cd3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1319 microversion: 2.1 time: 0.287077 Jul 28 03:42:49.321718 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 853/1615] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:49 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:49.372314 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f8d22abd-5da8-4797-b8ec-f5a6fcef3546 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:49.385085 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f8d22abd-5da8-4797-b8ec-f5a6fcef3546 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" status: 200 len: 1521 microversion: 2.1 time: 0.632488 Jul 28 03:42:49.386181 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 763/1616] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:48 2022] GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a => generated 1521 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:49.415320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d51d34fc-2571-47fb-8854-655c16e5745d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.246"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:49.420670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d51d34fc-2571-47fb-8854-655c16e5745d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:49.429440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d51d34fc-2571-47fb-8854-655c16e5745d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:49.430365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d51d34fc-2571-47fb-8854-655c16e5745d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:49.431613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d51d34fc-2571-47fb-8854-655c16e5745d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:49.432447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d51d34fc-2571-47fb-8854-655c16e5745d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:49.481745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d51d34fc-2571-47fb-8854-655c16e5745d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Acquired lock "refresh_cache-623a67cb-d39e-4de8-877f-a81af9613a10" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 03:42:49.539726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-9eb196ba-963b-4906-9c3e-522db86f5ecf req-185765f9-1d26-4409-b7cf-99dd1c0df852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "tag": "643a4f2c-2609-4334-af83-0e2c8308e75c"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:49.576484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9eb196ba-963b-4906-9c3e-522db86f5ecf req-185765f9-1d26-4409-b7cf-99dd1c0df852 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:49.578485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9eb196ba-963b-4906-9c3e-522db86f5ecf req-185765f9-1d26-4409-b7cf-99dd1c0df852 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:49.623989 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-9eb196ba-963b-4906-9c3e-522db86f5ecf req-185765f9-1d26-4409-b7cf-99dd1c0df852 service nova] Creating event network-changed:643a4f2c-2609-4334-af83-0e2c8308e75c for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:42:49.643011 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-9eb196ba-963b-4906-9c3e-522db86f5ecf req-185765f9-1d26-4409-b7cf-99dd1c0df852 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108640 Jul 28 03:42:49.651027 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 764/1617] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:49.665110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-be2fb546-501b-49c3-a786-95d691007764 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:49.668701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-be2fb546-501b-49c3-a786-95d691007764 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:49.689063 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be2fb546-501b-49c3-a786-95d691007764 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:49.689528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be2fb546-501b-49c3-a786-95d691007764 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:49.702513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be2fb546-501b-49c3-a786-95d691007764 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:49.703180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be2fb546-501b-49c3-a786-95d691007764 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:51.242509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-be2fb546-501b-49c3-a786-95d691007764 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:51.312363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-be2fb546-501b-49c3-a786-95d691007764 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:51.316087 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-be2fb546-501b-49c3-a786-95d691007764 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:51.320837 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-be2fb546-501b-49c3-a786-95d691007764 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1884 microversion: 2.42 time: 1.665625 Jul 28 03:42:51.322786 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 765/1618] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:49 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1884 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:51.346958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-54d4979d-19a6-4beb-8732-2054b3bc6aec tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:51.351938 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-54d4979d-19a6-4beb-8732-2054b3bc6aec tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:51.374693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-54d4979d-19a6-4beb-8732-2054b3bc6aec tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:51.377867 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-54d4979d-19a6-4beb-8732-2054b3bc6aec tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:51.379131 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-54d4979d-19a6-4beb-8732-2054b3bc6aec tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:51.379644 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-54d4979d-19a6-4beb-8732-2054b3bc6aec tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:51.749214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-54d4979d-19a6-4beb-8732-2054b3bc6aec tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:51.763818 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-54d4979d-19a6-4beb-8732-2054b3bc6aec tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 200 len: 1306 microversion: 2.1 time: 0.437624 Jul 28 03:42:51.776389 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 766/1619] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:51 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 1306 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:51.776389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-baa6ef02-75d2-4db5-b88a-b3c09719ddbe tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:51.776887 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-baa6ef02-75d2-4db5-b88a-b3c09719ddbe tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:51.795966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-baa6ef02-75d2-4db5-b88a-b3c09719ddbe tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:51.796476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-baa6ef02-75d2-4db5-b88a-b3c09719ddbe tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:51.797271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-baa6ef02-75d2-4db5-b88a-b3c09719ddbe tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:51.797702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-baa6ef02-75d2-4db5-b88a-b3c09719ddbe tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:52.563334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-baa6ef02-75d2-4db5-b88a-b3c09719ddbe tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:52.573555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-baa6ef02-75d2-4db5-b88a-b3c09719ddbe tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:52.583865 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-baa6ef02-75d2-4db5-b88a-b3c09719ddbe tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:52.591755 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-baa6ef02-75d2-4db5-b88a-b3c09719ddbe tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1293 microversion: 2.25 time: 0.822936 Jul 28 03:42:52.597558 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 767/1620] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:51 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1293 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:52.612641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d0a560a3-893e-47af-9525-b57cdad1dc64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:52.616610 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d0a560a3-893e-47af-9525-b57cdad1dc64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:52.629147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d0a560a3-893e-47af-9525-b57cdad1dc64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:52.635839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d0a560a3-893e-47af-9525-b57cdad1dc64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:52.637186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d0a560a3-893e-47af-9525-b57cdad1dc64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:52.645844 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d0a560a3-893e-47af-9525-b57cdad1dc64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:52.689666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-d51d34fc-2571-47fb-8854-655c16e5745d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Building network info cache for instance {{(pid=126071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 03:42:53.198546 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d0a560a3-893e-47af-9525-b57cdad1dc64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:53.215676 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d0a560a3-893e-47af-9525-b57cdad1dc64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1469 microversion: 2.1 time: 0.616750 Jul 28 03:42:53.216985 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 768/1621] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:52 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1469 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:53.232474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-e7980c19-23e8-4f8d-b4e6-2b25c64952e2 req-48fbc69e-4a34-4d88-bb43-f404344f3626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38bded12-c7e6-4c2b-bf28-bcf754421d2d", "tag": "5e081790-bc24-4310-a3b5-8481a01f8989"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:53.254226 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e7980c19-23e8-4f8d-b4e6-2b25c64952e2 req-48fbc69e-4a34-4d88-bb43-f404344f3626 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:53.254956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e7980c19-23e8-4f8d-b4e6-2b25c64952e2 req-48fbc69e-4a34-4d88-bb43-f404344f3626 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:53.276751 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-e7980c19-23e8-4f8d-b4e6-2b25c64952e2 req-48fbc69e-4a34-4d88-bb43-f404344f3626 service nova] Creating event network-changed:5e081790-bc24-4310-a3b5-8481a01f8989 for instance 38bded12-c7e6-4c2b-bf28-bcf754421d2d on n-h2-826756-3 Jul 28 03:42:53.286622 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-e7980c19-23e8-4f8d-b4e6-2b25c64952e2 req-48fbc69e-4a34-4d88-bb43-f404344f3626 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068153 Jul 28 03:42:53.287922 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 769/1622] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:53.311729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-11a6f96c-cafa-41a6-be49-db50918ec5d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:53.312497 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-11a6f96c-cafa-41a6-be49-db50918ec5d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:53.331037 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-11a6f96c-cafa-41a6-be49-db50918ec5d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:53.331695 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-11a6f96c-cafa-41a6-be49-db50918ec5d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:53.334711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-11a6f96c-cafa-41a6-be49-db50918ec5d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:53.336086 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-11a6f96c-cafa-41a6-be49-db50918ec5d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:54.011947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-11a6f96c-cafa-41a6-be49-db50918ec5d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:54.024231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-11a6f96c-cafa-41a6-be49-db50918ec5d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:54.035385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-11a6f96c-cafa-41a6-be49-db50918ec5d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:54.036997 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-11a6f96c-cafa-41a6-be49-db50918ec5d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1884 microversion: 2.42 time: 0.743210 Jul 28 03:42:54.041161 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 770/1623] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:53 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1884 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:54.066812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-f1a9e598-fee5-443d-8a0d-3c2cf09f6dea req-d5fad89f-1434-4b64-9403-e1fc94cd7377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "623a67cb-d39e-4de8-877f-a81af9613a10", "tag": "62f765ff-c7d8-4877-9576-bc720cc3f64f"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:54.094077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f1a9e598-fee5-443d-8a0d-3c2cf09f6dea req-d5fad89f-1434-4b64-9403-e1fc94cd7377 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:54.094780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f1a9e598-fee5-443d-8a0d-3c2cf09f6dea req-d5fad89f-1434-4b64-9403-e1fc94cd7377 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:54.118218 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-f1a9e598-fee5-443d-8a0d-3c2cf09f6dea req-d5fad89f-1434-4b64-9403-e1fc94cd7377 service nova] Creating event network-changed:62f765ff-c7d8-4877-9576-bc720cc3f64f for instance 623a67cb-d39e-4de8-877f-a81af9613a10 on n-h2-826756-3 Jul 28 03:42:54.126247 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-f1a9e598-fee5-443d-8a0d-3c2cf09f6dea req-d5fad89f-1434-4b64-9403-e1fc94cd7377 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082127 Jul 28 03:42:54.128189 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 771/1624] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:54.146020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b45a87bf-1efd-466c-8325-e8fc3cb5728a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:54.151960 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b45a87bf-1efd-466c-8325-e8fc3cb5728a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:54.164811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b45a87bf-1efd-466c-8325-e8fc3cb5728a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:54.165641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b45a87bf-1efd-466c-8325-e8fc3cb5728a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:54.171717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b45a87bf-1efd-466c-8325-e8fc3cb5728a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:54.172579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b45a87bf-1efd-466c-8325-e8fc3cb5728a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:54.356616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-d51d34fc-2571-47fb-8854-655c16e5745d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Updating instance_info_cache with network_info: [{"id": "62f765ff-c7d8-4877-9576-bc720cc3f64f", "address": "fa:16:3e:cb:14:2d", "network": {"id": "db476184-d60c-46a3-9670-b892a40ef885", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1990725356-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9f7680ec7bd44a62be5017f043d4613b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap62f765ff-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 03:42:54.393585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d51d34fc-2571-47fb-8854-655c16e5745d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Releasing lock "refresh_cache-623a67cb-d39e-4de8-877f-a81af9613a10" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 03:42:54.395557 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d51d34fc-2571-47fb-8854-655c16e5745d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "POST /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10/action" status: 202 len: 0 microversion: 2.1 time: 4.989498 Jul 28 03:42:54.407711 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 854/1625] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:42:49 2022] POST /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10/action => generated 0 bytes in 5003 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 03:42:54.435202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e73cc75b-e7e3-48bf-a487-e41c29682ae1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:54.443470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e73cc75b-e7e3-48bf-a487-e41c29682ae1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:54.463536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e73cc75b-e7e3-48bf-a487-e41c29682ae1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:54.469205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e73cc75b-e7e3-48bf-a487-e41c29682ae1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:54.471282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e73cc75b-e7e3-48bf-a487-e41c29682ae1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:54.478381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e73cc75b-e7e3-48bf-a487-e41c29682ae1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:54.955545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e73cc75b-e7e3-48bf-a487-e41c29682ae1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:55.042227 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e73cc75b-e7e3-48bf-a487-e41c29682ae1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0" status: 200 len: 1469 microversion: 2.1 time: 0.631995 Jul 28 03:42:55.054900 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 855/1626] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:54 2022] GET /compute/v2.1/servers/1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 => generated 1469 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:55.087367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3a1f9bf-ee82-41be-9d8b-078f9b3ff492 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:55.088333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3a1f9bf-ee82-41be-9d8b-078f9b3ff492 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:55.108617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a1f9bf-ee82-41be-9d8b-078f9b3ff492 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:55.109261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a1f9bf-ee82-41be-9d8b-078f9b3ff492 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:55.110214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a1f9bf-ee82-41be-9d8b-078f9b3ff492 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:55.110770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a1f9bf-ee82-41be-9d8b-078f9b3ff492 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:55.151703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b45a87bf-1efd-466c-8325-e8fc3cb5728a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:55.173421 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b45a87bf-1efd-466c-8325-e8fc3cb5728a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 200 len: 1306 microversion: 2.1 time: 1.038647 Jul 28 03:42:55.183471 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 772/1627] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:54 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 1306 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:55.196956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a692200b-64ea-4fb9-96ae-dfdcabfd3a58 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Action: 'action', calling method: .version_select at 0x7ffa77ce0280>, body: {"addFloatingIp": {"address": "172.25.6.246"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:55.201527 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a692200b-64ea-4fb9-96ae-dfdcabfd3a58 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:55.231647 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a692200b-64ea-4fb9-96ae-dfdcabfd3a58 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:55.237021 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a692200b-64ea-4fb9-96ae-dfdcabfd3a58 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:55.238493 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a692200b-64ea-4fb9-96ae-dfdcabfd3a58 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:55.246891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a692200b-64ea-4fb9-96ae-dfdcabfd3a58 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:55.347421 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:55.353795 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a692200b-64ea-4fb9-96ae-dfdcabfd3a58 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Acquired lock "refresh_cache-d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" {{(pid=126072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 03:42:55.689204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=8 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:55.742201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3a1f9bf-ee82-41be-9d8b-078f9b3ff492 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:55.779851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3a1f9bf-ee82-41be-9d8b-078f9b3ff492 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:55.781904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3a1f9bf-ee82-41be-9d8b-078f9b3ff492 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:55.787644 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3a1f9bf-ee82-41be-9d8b-078f9b3ff492 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1293 microversion: 2.25 time: 0.740870 Jul 28 03:42:55.800617 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 856/1628] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:55 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1293 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:55.828790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93913c52-bb3d-4bbd-9b9d-ba18fa002675 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:55.858016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93913c52-bb3d-4bbd-9b9d-ba18fa002675 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:55.859377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93913c52-bb3d-4bbd-9b9d-ba18fa002675 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Searching by: {'reservation_id': 'r-jdxcv3wb', 'deleted': False, 'project_id': '6979063538ee4bf08537b46bfb6e4249'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:42:55.886366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93913c52-bb3d-4bbd-9b9d-ba18fa002675 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:55.887020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93913c52-bb3d-4bbd-9b9d-ba18fa002675 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:55.888203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93913c52-bb3d-4bbd-9b9d-ba18fa002675 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:55.888852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93913c52-bb3d-4bbd-9b9d-ba18fa002675 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:56.121283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-93913c52-bb3d-4bbd-9b9d-ba18fa002675 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:42:56.258667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93913c52-bb3d-4bbd-9b9d-ba18fa002675 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:56.277157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93913c52-bb3d-4bbd-9b9d-ba18fa002675 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:56.281452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93913c52-bb3d-4bbd-9b9d-ba18fa002675 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:56.291969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:42:56.481260 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93913c52-bb3d-4bbd-9b9d-ba18fa002675 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?reservation_id=r-jdxcv3wb" status: 200 len: 2931 microversion: 2.1 time: 0.677282 Jul 28 03:42:56.493365 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 857/1629] 10.222.0.48 () {58 vars in 1197 bytes} [Thu Jul 28 03:42:55 2022] GET /compute/v2.1/servers/detail?reservation_id=r-jdxcv3wb => generated 2931 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:56.499475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f4c1cf0-d199-4375-b7c3-721e1d048619 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:56.500281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0f4c1cf0-d199-4375-b7c3-721e1d048619 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:56.510987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f4c1cf0-d199-4375-b7c3-721e1d048619 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:56.511719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f4c1cf0-d199-4375-b7c3-721e1d048619 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:56.512817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f4c1cf0-d199-4375-b7c3-721e1d048619 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:56.513419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f4c1cf0-d199-4375-b7c3-721e1d048619 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:57.281269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0f4c1cf0-d199-4375-b7c3-721e1d048619 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:57.295641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0f4c1cf0-d199-4375-b7c3-721e1d048619 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:57.297870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0f4c1cf0-d199-4375-b7c3-721e1d048619 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:57.299509 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0f4c1cf0-d199-4375-b7c3-721e1d048619 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1884 microversion: 2.42 time: 0.805086 Jul 28 03:42:57.300812 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 858/1630] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:56 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1884 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:57.306496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f8337829-2ea2-4bbf-a22f-6f2050f6ad61 req-3f097281-27a9-4f88-90fc-9d1a0631fccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "tag": "1fcc8042-1405-4e22-b511-0d24dbaa7b21"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:42:57.318785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f8337829-2ea2-4bbf-a22f-6f2050f6ad61 req-3f097281-27a9-4f88-90fc-9d1a0631fccc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:57.319657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f8337829-2ea2-4bbf-a22f-6f2050f6ad61 req-3f097281-27a9-4f88-90fc-9d1a0631fccc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:57.374799 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f8337829-2ea2-4bbf-a22f-6f2050f6ad61 req-3f097281-27a9-4f88-90fc-9d1a0631fccc service nova] Creating event network-changed:1fcc8042-1405-4e22-b511-0d24dbaa7b21 for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:42:57.390257 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f8337829-2ea2-4bbf-a22f-6f2050f6ad61 req-3f097281-27a9-4f88-90fc-9d1a0631fccc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085590 Jul 28 03:42:57.393428 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 859/1631] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:57.404335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6cd94003-fc9b-4374-a075-458934d2bfa3 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:57.405568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6cd94003-fc9b-4374-a075-458934d2bfa3 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:57.441311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cd94003-fc9b-4374-a075-458934d2bfa3 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:57.442112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cd94003-fc9b-4374-a075-458934d2bfa3 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:57.444685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cd94003-fc9b-4374-a075-458934d2bfa3 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:57.445457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cd94003-fc9b-4374-a075-458934d2bfa3 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:58.048250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6cd94003-fc9b-4374-a075-458934d2bfa3 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:58.062915 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6cd94003-fc9b-4374-a075-458934d2bfa3 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 200 len: 1306 microversion: 2.1 time: 0.667464 Jul 28 03:42:58.063909 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 860/1632] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:57 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 1306 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:58.080063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6dd99dac-ede8-43fd-a894-224aeef0ad77 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:58.123736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.compute.server_groups [None req-6dd99dac-ede8-43fd-a894-224aeef0ad77 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Querying cell a8b3e198-f422-4bf1-ae6c-bd38905d4b84(cell1) for 2 instances {{(pid=126071) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 28 03:42:58.124786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dd99dac-ede8-43fd-a894-224aeef0ad77 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:58.125279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dd99dac-ede8-43fd-a894-224aeef0ad77 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:58.192416 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6dd99dac-ede8-43fd-a894-224aeef0ad77 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/b897bf6d-9c40-4ae5-a228-6d95f0eb5f2b" status: 200 len: 266 microversion: 2.1 time: 0.126574 Jul 28 03:42:58.204603 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 861/1633] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:42:58 2022] GET /compute/v2.1/os-server-groups/b897bf6d-9c40-4ae5-a228-6d95f0eb5f2b => generated 266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:42:58.215286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3cf489f6-47d0-4c63-9cf3-562c9ba39594 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:58.216940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3cf489f6-47d0-4c63-9cf3-562c9ba39594 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:58.233930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3cf489f6-47d0-4c63-9cf3-562c9ba39594 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:58.236067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3cf489f6-47d0-4c63-9cf3-562c9ba39594 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:58.238870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3cf489f6-47d0-4c63-9cf3-562c9ba39594 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:58.240315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3cf489f6-47d0-4c63-9cf3-562c9ba39594 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:58.488401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3cf489f6-47d0-4c63-9cf3-562c9ba39594 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:58.500239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3cf489f6-47d0-4c63-9cf3-562c9ba39594 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:58.501917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3cf489f6-47d0-4c63-9cf3-562c9ba39594 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:58.503187 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3cf489f6-47d0-4c63-9cf3-562c9ba39594 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1293 microversion: 2.25 time: 0.296623 Jul 28 03:42:58.518287 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 862/1634] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:58 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1293 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:58.521735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ad0b6c09-fa4a-4084-983b-c6e924a7cca9 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:58.523079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ad0b6c09-fa4a-4084-983b-c6e924a7cca9 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:58.543982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad0b6c09-fa4a-4084-983b-c6e924a7cca9 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:58.544617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad0b6c09-fa4a-4084-983b-c6e924a7cca9 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:58.546017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad0b6c09-fa4a-4084-983b-c6e924a7cca9 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:58.546973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad0b6c09-fa4a-4084-983b-c6e924a7cca9 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:58.805702 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ad0b6c09-fa4a-4084-983b-c6e924a7cca9 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 200 len: 1620 microversion: 2.1 time: 0.294551 Jul 28 03:42:58.806496 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 863/1635] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:58 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 1620 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:58.829216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cba38a60-c894-4a3f-8565-94102709168e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:58.831430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cba38a60-c894-4a3f-8565-94102709168e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:58.851754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cba38a60-c894-4a3f-8565-94102709168e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:58.852244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cba38a60-c894-4a3f-8565-94102709168e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:58.853119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cba38a60-c894-4a3f-8565-94102709168e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:58.853686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cba38a60-c894-4a3f-8565-94102709168e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:59.279186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cba38a60-c894-4a3f-8565-94102709168e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:59.297535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cba38a60-c894-4a3f-8565-94102709168e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:59.299886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cba38a60-c894-4a3f-8565-94102709168e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:42:59.302247 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cba38a60-c894-4a3f-8565-94102709168e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1884 microversion: 2.42 time: 0.494089 Jul 28 03:42:59.311299 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 864/1636] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:42:58 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1884 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:42:59.319518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-76174acb-988c-4922-92f3-019e070bb0ea tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:59.329335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-76174acb-988c-4922-92f3-019e070bb0ea tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] [instance: 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:59.357952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76174acb-988c-4922-92f3-019e070bb0ea tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:59.359136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76174acb-988c-4922-92f3-019e070bb0ea tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:59.360832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76174acb-988c-4922-92f3-019e070bb0ea tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:59.362021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76174acb-988c-4922-92f3-019e070bb0ea tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:59.664869 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-76174acb-988c-4922-92f3-019e070bb0ea tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0" status: 200 len: 1620 microversion: 2.1 time: 0.351555 Jul 28 03:42:59.667548 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 865/1637] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:59 2022] GET /compute/v2.1/servers/1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 => generated 1620 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:42:59.679363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-89b58b39-dd9f-47d0-9c6c-0502a830b1f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:42:59.680694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-89b58b39-dd9f-47d0-9c6c-0502a830b1f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:42:59.702388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89b58b39-dd9f-47d0-9c6c-0502a830b1f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:59.702707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89b58b39-dd9f-47d0-9c6c-0502a830b1f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:42:59.706262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89b58b39-dd9f-47d0-9c6c-0502a830b1f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:42:59.709512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89b58b39-dd9f-47d0-9c6c-0502a830b1f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:00.083203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-89b58b39-dd9f-47d0-9c6c-0502a830b1f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:00.108636 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-89b58b39-dd9f-47d0-9c6c-0502a830b1f9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 200 len: 1306 microversion: 2.1 time: 0.438167 Jul 28 03:43:00.115959 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 866/1638] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:42:59 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 1306 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:00.445455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4c2d262b-ac93-4bb1-ac8d-e8a1d2976d3c tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "a4422d11-96b3-4e3f-9f4a-58a2228a914c"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:00.449260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4c2d262b-ac93-4bb1-ac8d-e8a1d2976d3c tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:00.458731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c2d262b-ac93-4bb1-ac8d-e8a1d2976d3c tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:00.459544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c2d262b-ac93-4bb1-ac8d-e8a1d2976d3c tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:00.461015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c2d262b-ac93-4bb1-ac8d-e8a1d2976d3c tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:00.461727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c2d262b-ac93-4bb1-ac8d-e8a1d2976d3c tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:00.663695 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-4c2d262b-ac93-4bb1-ac8d-e8a1d2976d3c tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] HTTP exception thrown: Volume a4422d11-96b3-4e3f-9f4a-58a2228a914c could not be found. Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4c2d262b-ac93-4bb1-ac8d-e8a1d2976d3c tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] Request method failure captured: Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: request: PUT /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments/01c987a8-dfa2-48de-88d4-e1edfff4ddbe HTTP/1.1 Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 74 Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gVEk94cKAdQJcBvPKlp65gO5VTtM0Bqxbkg8dLLHdBRJX7WNwWAEk2keAbKTVY5m-1Hhkra8ikHFSPYvNeZ6VSsRa1YTWiKpz_-OnV5nQlbehL6FInYbTPYt8RCeXLM8Nr1e6qnLl-dgASwrbFVbmSuNP4PdS-qMn2dTsc6RwASlEE Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 1830a5613d144c1487632d8e5ee33270 Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-VolumesAdminNegativeTest-1571278621 Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1830a5613d144c1487632d8e5ee33270"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1830a5613d144c1487632d8e5ee33270"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1830a5613d144c1487632d8e5ee33270"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1830a5613d144c1487632d8e5ee33270"}]}] Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-VolumesAdminNegativeTest-1571278621 Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 1830a5613d144c1487632d8e5ee33270 Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1571278621 Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-VolumesAdminNegativeTest-1571278621-project-admin Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 1ad769dff3424340ba4a8a0999263155 Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-VolumesAdminNegativeTest-1571278621-project-admin Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: {"volumeAttachment": {"volumeId": "a4422d11-96b3-4e3f-9f4a-58a2228a914c"}} Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: exception: Volume a4422d11-96b3-4e3f-9f4a-58a2228a914c could not be found. Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': 'c44d8fc8-f642-4816-9e16-62dcc5798678', 'id': '01c987a8-dfa2-48de-88d4-e1edfff4ddbe', 'body': {'volumeAttachment': {'volumeId': 'a4422d11-96b3-4e3f-9f4a-58a2228a914c'}}} Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a4422d11-96b3-4e3f-9f4a-58a2228a914c could not be found. (HTTP 404) (Request-ID: req-818c6c2d-b040-4b1c-a0e7-9f33981bb6d9) Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:43:00.708330 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a4422d11-96b3-4e3f-9f4a-58a2228a914c could not be found. Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume a4422d11-96b3-4e3f-9f4a-58a2228a914c could not be found. Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a4422d11-96b3-4e3f-9f4a-58a2228a914c could not be found. Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4c2d262b-ac93-4bb1-ac8d-e8a1d2976d3c tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] Returning 400 to user: Volume a4422d11-96b3-4e3f-9f4a-58a2228a914c could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4c2d262b-ac93-4bb1-ac8d-e8a1d2976d3c tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] 10.222.0.48 "PUT /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments/01c987a8-dfa2-48de-88d4-e1edfff4ddbe" status: 400 len: 107 microversion: 2.1 time: 0.599272 Jul 28 03:43:00.722904 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 867/1639] 10.222.0.48 () {60 vars in 1433 bytes} [Thu Jul 28 03:43:00 2022] PUT /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments/01c987a8-dfa2-48de-88d4-e1edfff4ddbe => generated 107 bytes in 603 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:43:00.736852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-eef0605e-317e-44f7-9163-e401ae4ca5e0 req-17f4e3f7-caa1-4017-8a0e-e3fe2032d5cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da14893a-5718-4a91-9307-abd3ffb2c20e", "tag": "b35fa4af-3beb-470a-8838-d64f39ee8851"}, {"name": "network-changed", "server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "tag": "23985630-7906-4149-8966-da8b75db4ec3"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:00.748467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-eef0605e-317e-44f7-9163-e401ae4ca5e0 req-17f4e3f7-caa1-4017-8a0e-e3fe2032d5cc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:00.749379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-eef0605e-317e-44f7-9163-e401ae4ca5e0 req-17f4e3f7-caa1-4017-8a0e-e3fe2032d5cc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:00.791019 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-eef0605e-317e-44f7-9163-e401ae4ca5e0 req-17f4e3f7-caa1-4017-8a0e-e3fe2032d5cc service nova] Creating event network-changed:b35fa4af-3beb-470a-8838-d64f39ee8851 for instance da14893a-5718-4a91-9307-abd3ffb2c20e on n-h1-826756-3 Jul 28 03:43:00.792101 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-eef0605e-317e-44f7-9163-e401ae4ca5e0 req-17f4e3f7-caa1-4017-8a0e-e3fe2032d5cc service nova] Creating event network-changed:23985630-7906-4149-8966-da8b75db4ec3 for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:43:00.815446 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-eef0605e-317e-44f7-9163-e401ae4ca5e0 req-17f4e3f7-caa1-4017-8a0e-e3fe2032d5cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.092707 Jul 28 03:43:00.818009 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 868/1640] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:00.826621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c50cb97b-d690-464c-aeb8-54761c60f758 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:00.827587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c50cb97b-d690-464c-aeb8-54761c60f758 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:00.852144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c50cb97b-d690-464c-aeb8-54761c60f758 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:00.857191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c50cb97b-d690-464c-aeb8-54761c60f758 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:00.861699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c50cb97b-d690-464c-aeb8-54761c60f758 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:00.864193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c50cb97b-d690-464c-aeb8-54761c60f758 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:01.209339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c50cb97b-d690-464c-aeb8-54761c60f758 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:01.232816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c50cb97b-d690-464c-aeb8-54761c60f758 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:01.238871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c50cb97b-d690-464c-aeb8-54761c60f758 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:01.241269 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c50cb97b-d690-464c-aeb8-54761c60f758 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1281 microversion: 2.25 time: 0.421205 Jul 28 03:43:01.256874 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 869/1641] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:00 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1281 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:01.268533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1951c486-95cf-4b75-ab8c-ac7e5c4b257d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Action: 'create', calling method: .version_select at 0x7ffa7995cca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1090959123", "policies": ["anti-affinity"]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:01.319788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1951c486-95cf-4b75-ab8c-ac7e5c4b257d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:43:01.352207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1951c486-95cf-4b75-ab8c-ac7e5c4b257d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:43:01.520991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1951c486-95cf-4b75-ab8c-ac7e5c4b257d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:43:01.532846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1951c486-95cf-4b75-ab8c-ac7e5c4b257d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:43:01.557913 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1951c486-95cf-4b75-ab8c-ac7e5c4b257d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.298755 Jul 28 03:43:01.572652 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 870/1642] 10.222.0.48 () {60 vars in 1174 bytes} [Thu Jul 28 03:43:01 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:01.578691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-835011d2-1a4d-44b8-8ed8-354144af3e4a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:01.580917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-835011d2-1a4d-44b8-8ed8-354144af3e4a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:01.592239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-835011d2-1a4d-44b8-8ed8-354144af3e4a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:01.593571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-835011d2-1a4d-44b8-8ed8-354144af3e4a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:01.594881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-835011d2-1a4d-44b8-8ed8-354144af3e4a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:01.595617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-835011d2-1a4d-44b8-8ed8-354144af3e4a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:02.063172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-835011d2-1a4d-44b8-8ed8-354144af3e4a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:02.080491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-835011d2-1a4d-44b8-8ed8-354144af3e4a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:02.086326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-835011d2-1a4d-44b8-8ed8-354144af3e4a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:02.087940 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-835011d2-1a4d-44b8-8ed8-354144af3e4a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1884 microversion: 2.42 time: 0.514026 Jul 28 03:43:02.093333 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 871/1643] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:01 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1884 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:02.107960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-167f4c2b-df0d-4562-afab-43670b8f1a77 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:02.108639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-167f4c2b-df0d-4562-afab-43670b8f1a77 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:02.124914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-167f4c2b-df0d-4562-afab-43670b8f1a77 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:02.130431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-167f4c2b-df0d-4562-afab-43670b8f1a77 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:02.138046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-167f4c2b-df0d-4562-afab-43670b8f1a77 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:02.138663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-167f4c2b-df0d-4562-afab-43670b8f1a77 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:02.382106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-167f4c2b-df0d-4562-afab-43670b8f1a77 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lazy-loading 'services' on Instance uuid c44d8fc8-f642-4816-9e16-62dcc5798678 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:43:02.598274 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-167f4c2b-df0d-4562-afab-43670b8f1a77 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments/01c987a8-dfa2-48de-88d4-e1edfff4ddbe" status: 202 len: 0 microversion: 2.1 time: 0.503403 Jul 28 03:43:02.599403 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 872/1644] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 03:43:02 2022] DELETE /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments/01c987a8-dfa2-48de-88d4-e1edfff4ddbe => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:43:02.651313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c06cbc91-f1a3-4899-9b60-8fa4c58559cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:02.656130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c06cbc91-f1a3-4899-9b60-8fa4c58559cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:02.668232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c06cbc91-f1a3-4899-9b60-8fa4c58559cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:02.669846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c06cbc91-f1a3-4899-9b60-8fa4c58559cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:02.671487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c06cbc91-f1a3-4899-9b60-8fa4c58559cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:02.671928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c06cbc91-f1a3-4899-9b60-8fa4c58559cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:02.994260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c06cbc91-f1a3-4899-9b60-8fa4c58559cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:03.002894 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c06cbc91-f1a3-4899-9b60-8fa4c58559cb tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 200 len: 1306 microversion: 2.1 time: 0.399245 Jul 28 03:43:03.008203 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 873/1645] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:02 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 1306 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:03.017007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2043471139", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "39ae209d-de8d-4e95-a81a-8c3c6c9a5a14"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:03.160117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:43:03.669688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:43:03.670279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:43:03.670861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:43:03.671508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:43:03.671943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:43:03.690252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:03.690863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:03.692575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:03.693219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:03.716929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:43:03.727709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:43:03.745436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Going to run 2 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:43:03.748087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 4040cba7-343d-4675-8c2a-a7b86506a2b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:43:03.825686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:43:03.833362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:43:03.848786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:03.882541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:43:03.890100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:43:03.912062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=4040cba7-343d-4675-8c2a-a7b86506a2b1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:43:03.985750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:43:03.995386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:43:04.047080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:43:04.053373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'server_group_members'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:43:04.098170 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-772e13cd-fe1c-462d-ae41-076cac7e5efa tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.088185 Jul 28 03:43:04.102956 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 874/1646] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:43:03 2022] POST /compute/v2.1/servers => generated 32 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 28 03:43:04.109231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86f7e108-45b3-462f-b547-d00b10cb6e35 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:04.109468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-86f7e108-45b3-462f-b547-d00b10cb6e35 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:04.129255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86f7e108-45b3-462f-b547-d00b10cb6e35 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:04.129720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86f7e108-45b3-462f-b547-d00b10cb6e35 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:04.130496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86f7e108-45b3-462f-b547-d00b10cb6e35 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:04.130927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86f7e108-45b3-462f-b547-d00b10cb6e35 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:04.553342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-86f7e108-45b3-462f-b547-d00b10cb6e35 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:04.563795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-86f7e108-45b3-462f-b547-d00b10cb6e35 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:04.565400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-86f7e108-45b3-462f-b547-d00b10cb6e35 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:04.566669 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-86f7e108-45b3-462f-b547-d00b10cb6e35 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1281 microversion: 2.25 time: 0.462565 Jul 28 03:43:04.580400 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 875/1647] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:04 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1281 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:04.580400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8052dd90-64c2-4c9c-8713-069264071808 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:04.582117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8052dd90-64c2-4c9c-8713-069264071808 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:04.596716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8052dd90-64c2-4c9c-8713-069264071808 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:04.596716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8052dd90-64c2-4c9c-8713-069264071808 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:04.596716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8052dd90-64c2-4c9c-8713-069264071808 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:04.598210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8052dd90-64c2-4c9c-8713-069264071808 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:04.647552 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8052dd90-64c2-4c9c-8713-069264071808 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078763 Jul 28 03:43:04.653040 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 876/1648] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:43:04 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:04.662084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-131d0d31-fdd6-4c15-9ded-c5ebe63eb8d3 req-dae9a4ee-1385-4308-8b17-b283ee5f8acd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "tag": "c40070a3-9cac-4380-8b9c-21f0c6fe3eaa"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:04.687463 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.network.neutron [None req-a692200b-64ea-4fb9-96ae-dfdcabfd3a58 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] re-assign floating IP 172.25.6.246 from instance 623a67cb-d39e-4de8-877f-a81af9613a10 Jul 28 03:43:04.698154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-131d0d31-fdd6-4c15-9ded-c5ebe63eb8d3 req-dae9a4ee-1385-4308-8b17-b283ee5f8acd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:04.700432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-131d0d31-fdd6-4c15-9ded-c5ebe63eb8d3 req-dae9a4ee-1385-4308-8b17-b283ee5f8acd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:04.732639 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-131d0d31-fdd6-4c15-9ded-c5ebe63eb8d3 req-dae9a4ee-1385-4308-8b17-b283ee5f8acd service nova] Creating event network-changed:c40070a3-9cac-4380-8b9c-21f0c6fe3eaa for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:43:04.753177 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-131d0d31-fdd6-4c15-9ded-c5ebe63eb8d3 req-dae9a4ee-1385-4308-8b17-b283ee5f8acd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097436 Jul 28 03:43:04.756394 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 877/1649] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:04.764003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b58de1a-9ebf-4f74-8bee-74d00db71a24 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:04.765720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b58de1a-9ebf-4f74-8bee-74d00db71a24 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:04.778302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b58de1a-9ebf-4f74-8bee-74d00db71a24 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:04.778753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b58de1a-9ebf-4f74-8bee-74d00db71a24 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:04.779559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b58de1a-9ebf-4f74-8bee-74d00db71a24 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:04.781037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b58de1a-9ebf-4f74-8bee-74d00db71a24 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:04.788982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:04.866865 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-a692200b-64ea-4fb9-96ae-dfdcabfd3a58 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Building network info cache for instance {{(pid=126072) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 03:43:05.203220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b58de1a-9ebf-4f74-8bee-74d00db71a24 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:05.213076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:05.247382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b58de1a-9ebf-4f74-8bee-74d00db71a24 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:05.258232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b58de1a-9ebf-4f74-8bee-74d00db71a24 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:05.263008 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b58de1a-9ebf-4f74-8bee-74d00db71a24 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1884 microversion: 2.42 time: 0.504410 Jul 28 03:43:05.266541 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 878/1650] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:04 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1884 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:05.283420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2518783f-3c6c-4a51-bfe2-0b148004e15d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:05.283942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2518783f-3c6c-4a51-bfe2-0b148004e15d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:05.294996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2518783f-3c6c-4a51-bfe2-0b148004e15d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:05.295459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2518783f-3c6c-4a51-bfe2-0b148004e15d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:05.296273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2518783f-3c6c-4a51-bfe2-0b148004e15d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:05.296755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2518783f-3c6c-4a51-bfe2-0b148004e15d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:05.666447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2518783f-3c6c-4a51-bfe2-0b148004e15d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:05.691810 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2518783f-3c6c-4a51-bfe2-0b148004e15d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 200 len: 1306 microversion: 2.1 time: 0.423335 Jul 28 03:43:05.693449 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 879/1651] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:05 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 1306 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:05.707131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-76a81c10-8284-4c62-b937-a4d890f2101c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:05.729623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-76a81c10-8284-4c62-b937-a4d890f2101c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:05.731552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-76a81c10-8284-4c62-b937-a4d890f2101c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Searching by: {'deleted': False, 'project_id': '6979063538ee4bf08537b46bfb6e4249'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:43:05.782208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76a81c10-8284-4c62-b937-a4d890f2101c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:05.791216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76a81c10-8284-4c62-b937-a4d890f2101c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:05.794156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76a81c10-8284-4c62-b937-a4d890f2101c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:05.796145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76a81c10-8284-4c62-b937-a4d890f2101c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:05.898725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-76a81c10-8284-4c62-b937-a4d890f2101c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:43:05.977430 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-76a81c10-8284-4c62-b937-a4d890f2101c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.282040 Jul 28 03:43:05.978480 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 880/1652] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 03:43:05 2022] GET /compute/v2.1/servers => generated 1665 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:05.990587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94fb3e3f-1b75-4240-93da-83258b37f458 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:05.991205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-94fb3e3f-1b75-4240-93da-83258b37f458 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:06.019395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fb3e3f-1b75-4240-93da-83258b37f458 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:06.019852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fb3e3f-1b75-4240-93da-83258b37f458 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:06.020725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fb3e3f-1b75-4240-93da-83258b37f458 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:06.021121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fb3e3f-1b75-4240-93da-83258b37f458 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:06.519990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-94fb3e3f-1b75-4240-93da-83258b37f458 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:06.559842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-94fb3e3f-1b75-4240-93da-83258b37f458 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:06.589373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-94fb3e3f-1b75-4240-93da-83258b37f458 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:06.616254 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-94fb3e3f-1b75-4240-93da-83258b37f458 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1281 microversion: 2.25 time: 0.632816 Jul 28 03:43:06.620782 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 881/1653] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:05 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1281 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:06.661271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c7383e14-d642-4cf8-893f-46095e677f50 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:06.673349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c7383e14-d642-4cf8-893f-46095e677f50 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:06.682893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7383e14-d642-4cf8-893f-46095e677f50 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:06.683330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7383e14-d642-4cf8-893f-46095e677f50 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:06.684996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7383e14-d642-4cf8-893f-46095e677f50 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:06.685674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7383e14-d642-4cf8-893f-46095e677f50 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:06.803711 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c7383e14-d642-4cf8-893f-46095e677f50 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179068 Jul 28 03:43:06.804749 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 882/1654] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:43:06 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:06.816556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c3d580d8-fe34-4b27-8a8c-92e0b252201a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:06.824636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c3d580d8-fe34-4b27-8a8c-92e0b252201a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:06.847530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3d580d8-fe34-4b27-8a8c-92e0b252201a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:06.851123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3d580d8-fe34-4b27-8a8c-92e0b252201a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:06.855026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3d580d8-fe34-4b27-8a8c-92e0b252201a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:06.855764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3d580d8-fe34-4b27-8a8c-92e0b252201a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:07.064516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c3d580d8-fe34-4b27-8a8c-92e0b252201a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:07.089521 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c3d580d8-fe34-4b27-8a8c-92e0b252201a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 200 len: 1215 microversion: 2.1 time: 0.281415 Jul 28 03:43:07.090467 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 883/1655] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:06 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 1215 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:07.108731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-57166997-8f80-4ae5-ab3c-981c53b44512 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:07.110099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-57166997-8f80-4ae5-ab3c-981c53b44512 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:07.144873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57166997-8f80-4ae5-ab3c-981c53b44512 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:07.145505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57166997-8f80-4ae5-ab3c-981c53b44512 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:07.146545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57166997-8f80-4ae5-ab3c-981c53b44512 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:07.147098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57166997-8f80-4ae5-ab3c-981c53b44512 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:07.482935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-a692200b-64ea-4fb9-96ae-dfdcabfd3a58 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Updating instance_info_cache with network_info: [{"id": "62f765ff-c7d8-4877-9576-bc720cc3f64f", "address": "fa:16:3e:cb:14:2d", "network": {"id": "db476184-d60c-46a3-9670-b892a40ef885", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1990725356-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9f7680ec7bd44a62be5017f043d4613b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap62f765ff-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126072) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 03:43:07.521408 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-a692200b-64ea-4fb9-96ae-dfdcabfd3a58 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Building network info cache for instance {{(pid=126072) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 03:43:07.941897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-57166997-8f80-4ae5-ab3c-981c53b44512 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:07.962704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-57166997-8f80-4ae5-ab3c-981c53b44512 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:07.965746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-57166997-8f80-4ae5-ab3c-981c53b44512 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:07.967881 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-57166997-8f80-4ae5-ab3c-981c53b44512 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1884 microversion: 2.42 time: 0.875619 Jul 28 03:43:07.970648 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 884/1656] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:07 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1884 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:07.976472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-428347a3-1b7e-475f-b30d-9eddb4e2f8ba tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:07.977264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-428347a3-1b7e-475f-b30d-9eddb4e2f8ba tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:07.992338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-428347a3-1b7e-475f-b30d-9eddb4e2f8ba tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:07.993040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-428347a3-1b7e-475f-b30d-9eddb4e2f8ba tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:07.994043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-428347a3-1b7e-475f-b30d-9eddb4e2f8ba tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:07.995151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-428347a3-1b7e-475f-b30d-9eddb4e2f8ba tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:08.305510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-428347a3-1b7e-475f-b30d-9eddb4e2f8ba tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:08.324422 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-428347a3-1b7e-475f-b30d-9eddb4e2f8ba tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 200 len: 1306 microversion: 2.1 time: 0.350929 Jul 28 03:43:08.340956 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 885/1657] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:07 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 1306 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:08.363870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-48f76cc0-9f87-4c6e-8ee0-f14ae1d5d76b req-43d65780-f0e0-4d30-9fde-a2e7d106a337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da14893a-5718-4a91-9307-abd3ffb2c20e", "name": "network-vif-plugged", "status": "completed", "tag": "b35fa4af-3beb-470a-8838-d64f39ee8851"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:08.393952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-48f76cc0-9f87-4c6e-8ee0-f14ae1d5d76b req-43d65780-f0e0-4d30-9fde-a2e7d106a337 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:08.395791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-48f76cc0-9f87-4c6e-8ee0-f14ae1d5d76b req-43d65780-f0e0-4d30-9fde-a2e7d106a337 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:08.481031 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-48f76cc0-9f87-4c6e-8ee0-f14ae1d5d76b req-43d65780-f0e0-4d30-9fde-a2e7d106a337 service nova] Creating event network-vif-plugged:b35fa4af-3beb-470a-8838-d64f39ee8851 for instance da14893a-5718-4a91-9307-abd3ffb2c20e on n-h1-826756-3 Jul 28 03:43:08.495321 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-48f76cc0-9f87-4c6e-8ee0-f14ae1d5d76b req-43d65780-f0e0-4d30-9fde-a2e7d106a337 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146743 Jul 28 03:43:08.498801 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 886/1658] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:08.515800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af5d3bbb-f955-4904-876d-cca5fc3ec086 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:08.520404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-af5d3bbb-f955-4904-876d-cca5fc3ec086 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:08.537262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af5d3bbb-f955-4904-876d-cca5fc3ec086 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:08.537768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af5d3bbb-f955-4904-876d-cca5fc3ec086 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:08.539588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af5d3bbb-f955-4904-876d-cca5fc3ec086 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:08.540402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af5d3bbb-f955-4904-876d-cca5fc3ec086 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:08.876889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-af5d3bbb-f955-4904-876d-cca5fc3ec086 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:08.888167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-af5d3bbb-f955-4904-876d-cca5fc3ec086 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:08.890060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-af5d3bbb-f955-4904-876d-cca5fc3ec086 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:08.892177 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-af5d3bbb-f955-4904-876d-cca5fc3ec086 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1281 microversion: 2.25 time: 0.391728 Jul 28 03:43:08.900793 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 887/1659] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:08 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1281 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:08.905778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-adb3094c-c58f-4e58-8e0c-6dd73e8b1689 req-54476a7d-b98b-4ac6-a784-04b6f6402308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "623a67cb-d39e-4de8-877f-a81af9613a10", "tag": "62f765ff-c7d8-4877-9576-bc720cc3f64f"}, {"name": "network-changed", "server_uuid": "d1ad11e2-ba9b-4fc3-86ca-b871f311b52a", "tag": "6a95d3ac-a87f-4069-aae1-494421f7ceaa"}, {"name": "network-changed", "server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "tag": "aafba26f-665f-4f25-a548-ebfcf3f246ed"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:08.944053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-adb3094c-c58f-4e58-8e0c-6dd73e8b1689 req-54476a7d-b98b-4ac6-a784-04b6f6402308 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:08.945038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-adb3094c-c58f-4e58-8e0c-6dd73e8b1689 req-54476a7d-b98b-4ac6-a784-04b6f6402308 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:08.977677 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-adb3094c-c58f-4e58-8e0c-6dd73e8b1689 req-54476a7d-b98b-4ac6-a784-04b6f6402308 service nova] Creating event network-changed:62f765ff-c7d8-4877-9576-bc720cc3f64f for instance 623a67cb-d39e-4de8-877f-a81af9613a10 on n-h2-826756-3 Jul 28 03:43:08.981209 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-adb3094c-c58f-4e58-8e0c-6dd73e8b1689 req-54476a7d-b98b-4ac6-a784-04b6f6402308 service nova] Creating event network-changed:6a95d3ac-a87f-4069-aae1-494421f7ceaa for instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a on n-h2-826756-3 Jul 28 03:43:08.981761 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-adb3094c-c58f-4e58-8e0c-6dd73e8b1689 req-54476a7d-b98b-4ac6-a784-04b6f6402308 service nova] Creating event network-changed:aafba26f-665f-4f25-a548-ebfcf3f246ed for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:43:09.002375 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-adb3094c-c58f-4e58-8e0c-6dd73e8b1689 req-54476a7d-b98b-4ac6-a784-04b6f6402308 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.100106 Jul 28 03:43:09.004199 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 888/1660] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:09.022126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9aa43199-e126-4426-8125-21124487fdac tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:09.024798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9aa43199-e126-4426-8125-21124487fdac tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:09.033726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9aa43199-e126-4426-8125-21124487fdac tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:09.034189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9aa43199-e126-4426-8125-21124487fdac tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:09.035106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9aa43199-e126-4426-8125-21124487fdac tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:09.035658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9aa43199-e126-4426-8125-21124487fdac tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:09.205586 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9aa43199-e126-4426-8125-21124487fdac tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198584 Jul 28 03:43:09.209435 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 889/1661] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:43:09 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:09.222737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb1ae9b1-b3d4-4d1e-b613-a9a1c0ff252b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:09.223971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb1ae9b1-b3d4-4d1e-b613-a9a1c0ff252b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:09.239498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb1ae9b1-b3d4-4d1e-b613-a9a1c0ff252b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:09.239937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb1ae9b1-b3d4-4d1e-b613-a9a1c0ff252b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:09.246274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb1ae9b1-b3d4-4d1e-b613-a9a1c0ff252b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:09.247051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb1ae9b1-b3d4-4d1e-b613-a9a1c0ff252b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:09.880234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb1ae9b1-b3d4-4d1e-b613-a9a1c0ff252b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:09.893411 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb1ae9b1-b3d4-4d1e-b613-a9a1c0ff252b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 200 len: 1271 microversion: 2.1 time: 0.681992 Jul 28 03:43:09.920627 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 890/1662] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:09 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 1271 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:09.939370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5abae98f-c36f-4284-a5f6-dd3fff813fc1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:09.941076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5abae98f-c36f-4284-a5f6-dd3fff813fc1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:09.957482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5abae98f-c36f-4284-a5f6-dd3fff813fc1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:09.959376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5abae98f-c36f-4284-a5f6-dd3fff813fc1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:09.960963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5abae98f-c36f-4284-a5f6-dd3fff813fc1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:09.962008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5abae98f-c36f-4284-a5f6-dd3fff813fc1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:10.400851 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-a692200b-64ea-4fb9-96ae-dfdcabfd3a58 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Updating instance_info_cache with network_info: [{"id": "6a95d3ac-a87f-4069-aae1-494421f7ceaa", "address": "fa:16:3e:6b:c0:4c", "network": {"id": "db476184-d60c-46a3-9670-b892a40ef885", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1990725356-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9f7680ec7bd44a62be5017f043d4613b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6a95d3ac-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126072) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 03:43:10.428063 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a692200b-64ea-4fb9-96ae-dfdcabfd3a58 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Releasing lock "refresh_cache-d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" {{(pid=126072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 03:43:10.429231 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a692200b-64ea-4fb9-96ae-dfdcabfd3a58 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "POST /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a/action" status: 202 len: 0 microversion: 2.1 time: 15.244204 Jul 28 03:43:10.430267 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 773/1663] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:42:55 2022] POST /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a/action => generated 0 bytes in 15246 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 03:43:10.435508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-495258f2-8383-4aed-a8d9-b444343a981b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:10.436129 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-495258f2-8383-4aed-a8d9-b444343a981b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:10.450983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5abae98f-c36f-4284-a5f6-dd3fff813fc1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:10.457518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-495258f2-8383-4aed-a8d9-b444343a981b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:10.458551 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-495258f2-8383-4aed-a8d9-b444343a981b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:10.462520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-495258f2-8383-4aed-a8d9-b444343a981b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:10.463116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-495258f2-8383-4aed-a8d9-b444343a981b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:10.464861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5abae98f-c36f-4284-a5f6-dd3fff813fc1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:10.471274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5abae98f-c36f-4284-a5f6-dd3fff813fc1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:10.472806 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5abae98f-c36f-4284-a5f6-dd3fff813fc1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.546897 Jul 28 03:43:10.476822 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 891/1664] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:09 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:10.488832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8c081893-ff83-464f-9704-d5ff4a0ec85d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:10.489462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8c081893-ff83-464f-9704-d5ff4a0ec85d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:10.506049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c081893-ff83-464f-9704-d5ff4a0ec85d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:10.506561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c081893-ff83-464f-9704-d5ff4a0ec85d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:10.507577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c081893-ff83-464f-9704-d5ff4a0ec85d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:10.507943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c081893-ff83-464f-9704-d5ff4a0ec85d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:11.003890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8c081893-ff83-464f-9704-d5ff4a0ec85d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:11.029977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8c081893-ff83-464f-9704-d5ff4a0ec85d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:11.041621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8c081893-ff83-464f-9704-d5ff4a0ec85d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:11.047444 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8c081893-ff83-464f-9704-d5ff4a0ec85d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1281 microversion: 2.25 time: 0.566085 Jul 28 03:43:11.048465 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 892/1665] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:10 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1281 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:11.068637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f3b5f076-3996-49d1-b0e9-93a9cd17f50b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:11.078182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f3b5f076-3996-49d1-b0e9-93a9cd17f50b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:11.094482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-495258f2-8383-4aed-a8d9-b444343a981b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:11.098285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3b5f076-3996-49d1-b0e9-93a9cd17f50b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:11.099125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3b5f076-3996-49d1-b0e9-93a9cd17f50b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:11.101088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3b5f076-3996-49d1-b0e9-93a9cd17f50b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:11.101825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3b5f076-3996-49d1-b0e9-93a9cd17f50b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:11.114788 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-495258f2-8383-4aed-a8d9-b444343a981b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 200 len: 1306 microversion: 2.1 time: 0.683032 Jul 28 03:43:11.117442 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 774/1666] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:10 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 1306 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:11.139559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-21cf20b7-806e-4a25-a6ab-2cb284efd68f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Action: 'action', calling method: .version_select at 0x7ffa77afb550>, body: {"removeFloatingIp": {"address": "172.25.6.246"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:11.178106 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f3b5f076-3996-49d1-b0e9-93a9cd17f50b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125102 Jul 28 03:43:11.179321 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 893/1667] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:43:11 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:11.193416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fe092a0d-f1e4-4ed6-8e4b-848ceb9c6242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:11.194506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fe092a0d-f1e4-4ed6-8e4b-848ceb9c6242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:11.204595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe092a0d-f1e4-4ed6-8e4b-848ceb9c6242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:11.205323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe092a0d-f1e4-4ed6-8e4b-848ceb9c6242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:11.206663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe092a0d-f1e4-4ed6-8e4b-848ceb9c6242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:11.207378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe092a0d-f1e4-4ed6-8e4b-848ceb9c6242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:11.386895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fe092a0d-f1e4-4ed6-8e4b-848ceb9c6242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:11.416410 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fe092a0d-f1e4-4ed6-8e4b-848ceb9c6242 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 200 len: 1277 microversion: 2.1 time: 0.235348 Jul 28 03:43:11.423901 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 894/1668] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:11 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 1277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:11.518333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-120f31e8-7199-40dd-850f-207468856da4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:11.519383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-120f31e8-7199-40dd-850f-207468856da4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:11.543123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-120f31e8-7199-40dd-850f-207468856da4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:11.543586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-120f31e8-7199-40dd-850f-207468856da4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:11.544443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-120f31e8-7199-40dd-850f-207468856da4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:11.544896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-120f31e8-7199-40dd-850f-207468856da4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:11.795612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-21cf20b7-806e-4a25-a6ab-2cb284efd68f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:11.821423 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21cf20b7-806e-4a25-a6ab-2cb284efd68f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:11.821971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21cf20b7-806e-4a25-a6ab-2cb284efd68f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:11.822823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21cf20b7-806e-4a25-a6ab-2cb284efd68f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:11.823272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21cf20b7-806e-4a25-a6ab-2cb284efd68f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:12.208839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-120f31e8-7199-40dd-850f-207468856da4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:12.212675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:12.224047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-120f31e8-7199-40dd-850f-207468856da4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:12.225641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-120f31e8-7199-40dd-850f-207468856da4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:12.226866 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-120f31e8-7199-40dd-850f-207468856da4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.713696 Jul 28 03:43:12.227457 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 895/1669] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:11 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:43:12.259111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-8a19849c-b2f4-4b67-a72b-ccf848ad01b0 req-5ceb13ab-100f-47c6-922a-5aeb60bada17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38bded12-c7e6-4c2b-bf28-bcf754421d2d", "name": "network-vif-plugged", "status": "completed", "tag": "5e081790-bc24-4310-a3b5-8481a01f8989"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:12.298162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8a19849c-b2f4-4b67-a72b-ccf848ad01b0 req-5ceb13ab-100f-47c6-922a-5aeb60bada17 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:12.298880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8a19849c-b2f4-4b67-a72b-ccf848ad01b0 req-5ceb13ab-100f-47c6-922a-5aeb60bada17 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:12.322682 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-8a19849c-b2f4-4b67-a72b-ccf848ad01b0 req-5ceb13ab-100f-47c6-922a-5aeb60bada17 service nova] Creating event network-vif-plugged:5e081790-bc24-4310-a3b5-8481a01f8989 for instance 38bded12-c7e6-4c2b-bf28-bcf754421d2d on n-h2-826756-3 Jul 28 03:43:12.338255 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-8a19849c-b2f4-4b67-a72b-ccf848ad01b0 req-5ceb13ab-100f-47c6-922a-5aeb60bada17 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084383 Jul 28 03:43:12.343859 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 896/1670] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:12.353898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f294538-237a-4018-aded-a3efa9439ab4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:12.360066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6f294538-237a-4018-aded-a3efa9439ab4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:12.374188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f294538-237a-4018-aded-a3efa9439ab4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:12.375068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f294538-237a-4018-aded-a3efa9439ab4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:12.379206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f294538-237a-4018-aded-a3efa9439ab4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:12.380310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f294538-237a-4018-aded-a3efa9439ab4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:12.685392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6f294538-237a-4018-aded-a3efa9439ab4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:12.695764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6f294538-237a-4018-aded-a3efa9439ab4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:12.697630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6f294538-237a-4018-aded-a3efa9439ab4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:12.698863 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6f294538-237a-4018-aded-a3efa9439ab4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1281 microversion: 2.25 time: 0.353486 Jul 28 03:43:12.712445 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 897/1671] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:12 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1281 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:12.712445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e64b9c56-85be-498f-bfb1-b6b53ee25fa6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:12.712445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e64b9c56-85be-498f-bfb1-b6b53ee25fa6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:12.712445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e64b9c56-85be-498f-bfb1-b6b53ee25fa6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:12.713316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e64b9c56-85be-498f-bfb1-b6b53ee25fa6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:12.713584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e64b9c56-85be-498f-bfb1-b6b53ee25fa6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:12.714020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e64b9c56-85be-498f-bfb1-b6b53ee25fa6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:12.959474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e64b9c56-85be-498f-bfb1-b6b53ee25fa6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:12.975573 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e64b9c56-85be-498f-bfb1-b6b53ee25fa6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 200 len: 1487 microversion: 2.1 time: 0.274258 Jul 28 03:43:12.976806 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 898/1672] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:12 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 1487 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:12.984257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5aa89a0-aaa8-4bd7-8fc6-74c1ca47756f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:12.987479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b5aa89a0-aaa8-4bd7-8fc6-74c1ca47756f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:12.997640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5aa89a0-aaa8-4bd7-8fc6-74c1ca47756f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:12.998685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5aa89a0-aaa8-4bd7-8fc6-74c1ca47756f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:12.999767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5aa89a0-aaa8-4bd7-8fc6-74c1ca47756f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:13.000577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5aa89a0-aaa8-4bd7-8fc6-74c1ca47756f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:13.111660 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5aa89a0-aaa8-4bd7-8fc6-74c1ca47756f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131753 Jul 28 03:43:13.113699 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 899/1673] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:43:12 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:13.128722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-136aac02-77cc-4a9a-b4e1-a4f340a51092 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:13.139328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-136aac02-77cc-4a9a-b4e1-a4f340a51092 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:13.149259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-136aac02-77cc-4a9a-b4e1-a4f340a51092 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:13.149893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-136aac02-77cc-4a9a-b4e1-a4f340a51092 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:13.152730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-136aac02-77cc-4a9a-b4e1-a4f340a51092 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:13.153523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-136aac02-77cc-4a9a-b4e1-a4f340a51092 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:13.251210 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-21cf20b7-806e-4a25-a6ab-2cb284efd68f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] HTTP exception thrown: Floating IP 172.25.6.246 is not associated with instance 623a67cb-d39e-4de8-877f-a81af9613a10. Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-21cf20b7-806e-4a25-a6ab-2cb284efd68f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Request method failure captured: Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10/action HTTP/1.1 Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 49 Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gWDHIHQ6EQNV2zwdmq-zma3EKvgOGr_5V48VrtYy3PaIoJyY5tDaF2P6paJV8XP0iJtiy1rT7KTsS3OMNKul2WqIKH7VjMg4gY0QssEkVNelRhLpfFV0dqwHx5IRBV_-d2c0EdVOI0RgswRjgGzLIXF7Qvcrbqb2NqvhPXbRklxm3c Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 9f7680ec7bd44a62be5017f043d4613b Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1472308666 Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9f7680ec7bd44a62be5017f043d4613b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f7680ec7bd44a62be5017f043d4613b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9f7680ec7bd44a62be5017f043d4613b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f7680ec7bd44a62be5017f043d4613b"}]}] Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1472308666 Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 9f7680ec7bd44a62be5017f043d4613b Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1472308666 Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-FloatingIPsAssociationTestJSON-1472308666-project Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: da34b0ac72d94d2fbd00ea09d805f0fe Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1472308666-project Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: {"removeFloatingIp": {"address": "172.25.6.246"}} Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: exception: Floating IP 172.25.6.246 is not associated with instance 623a67cb-d39e-4de8-877f-a81af9613a10. Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '623a67cb-d39e-4de8-877f-a81af9613a10', 'body': {'removeFloatingIp': {'address': '172.25.6.246'}}} Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.246 is not associated with instance 623a67cb-d39e-4de8-877f-a81af9613a10. Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.246 is not associated with instance 623a67cb-d39e-4de8-877f-a81af9613a10. Jul 28 03:43:13.253523 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:13.263049 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-21cf20b7-806e-4a25-a6ab-2cb284efd68f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Returning 409 to user: Floating IP 172.25.6.246 is not associated with instance 623a67cb-d39e-4de8-877f-a81af9613a10. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:43:13.287723 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-21cf20b7-806e-4a25-a6ab-2cb284efd68f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "POST /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10/action" status: 409 len: 146 microversion: 2.1 time: 2.168212 Jul 28 03:43:13.297128 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 775/1674] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:43:11 2022] POST /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10/action => generated 146 bytes in 2179 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:43:13.303131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-136aac02-77cc-4a9a-b4e1-a4f340a51092 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:13.318365 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-136aac02-77cc-4a9a-b4e1-a4f340a51092 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 200 len: 1277 microversion: 2.1 time: 0.202995 Jul 28 03:43:13.319123 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 900/1675] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:13 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:13.327488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a1798eb4-939d-4206-a77f-5c91514f667a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:13.328121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a1798eb4-939d-4206-a77f-5c91514f667a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:13.332963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-18712bd9-69e6-4738-8831-4d47ccaf122e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:13.333541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-18712bd9-69e6-4738-8831-4d47ccaf122e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:13.353146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18712bd9-69e6-4738-8831-4d47ccaf122e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:13.353637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18712bd9-69e6-4738-8831-4d47ccaf122e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:13.359905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1798eb4-939d-4206-a77f-5c91514f667a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:13.365157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18712bd9-69e6-4738-8831-4d47ccaf122e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:13.366153 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18712bd9-69e6-4738-8831-4d47ccaf122e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:13.368711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1798eb4-939d-4206-a77f-5c91514f667a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:13.373494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1798eb4-939d-4206-a77f-5c91514f667a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:13.379861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1798eb4-939d-4206-a77f-5c91514f667a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:13.453505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-18712bd9-69e6-4738-8831-4d47ccaf122e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lazy-loading 'flavor' on Instance uuid da14893a-5718-4a91-9307-abd3ffb2c20e {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:43:13.737072 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-18712bd9-69e6-4738-8831-4d47ccaf122e tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "POST /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e/action" status: 202 len: 0 microversion: 2.1 time: 0.436542 Jul 28 03:43:13.744302 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 776/1676] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:43:13 2022] POST /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:43:13.785270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9af5ca2e-1807-486c-bb38-b42e9ab66838 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.246"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:13.852133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a1798eb4-939d-4206-a77f-5c91514f667a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:13.868860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a1798eb4-939d-4206-a77f-5c91514f667a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:13.871097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a1798eb4-939d-4206-a77f-5c91514f667a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:13.872383 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a1798eb4-939d-4206-a77f-5c91514f667a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.552449 Jul 28 03:43:13.885267 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 901/1677] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:13 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:13.901303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aa5d2caa-eeb5-4ac5-b83b-609079865dba tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:13.902671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aa5d2caa-eeb5-4ac5-b83b-609079865dba tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:13.913081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa5d2caa-eeb5-4ac5-b83b-609079865dba tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:13.913861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa5d2caa-eeb5-4ac5-b83b-609079865dba tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:13.915027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa5d2caa-eeb5-4ac5-b83b-609079865dba tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:13.915643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa5d2caa-eeb5-4ac5-b83b-609079865dba tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:14.064007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=32 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:14.146127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aa5d2caa-eeb5-4ac5-b83b-609079865dba tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:14.168054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aa5d2caa-eeb5-4ac5-b83b-609079865dba tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:14.170275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aa5d2caa-eeb5-4ac5-b83b-609079865dba tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:14.171465 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aa5d2caa-eeb5-4ac5-b83b-609079865dba tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1281 microversion: 2.25 time: 0.284691 Jul 28 03:43:14.174578 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 902/1678] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:13 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1281 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:14.180073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4939288-5827-479b-8f61-ca7f0c7771e9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:14.180727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4939288-5827-479b-8f61-ca7f0c7771e9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:14.187500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4939288-5827-479b-8f61-ca7f0c7771e9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:14.187964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4939288-5827-479b-8f61-ca7f0c7771e9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:14.188774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4939288-5827-479b-8f61-ca7f0c7771e9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:14.189209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4939288-5827-479b-8f61-ca7f0c7771e9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:14.308754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9af5ca2e-1807-486c-bb38-b42e9ab66838 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:14.329711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9af5ca2e-1807-486c-bb38-b42e9ab66838 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:14.330717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9af5ca2e-1807-486c-bb38-b42e9ab66838 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:14.332485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9af5ca2e-1807-486c-bb38-b42e9ab66838 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:14.333438 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9af5ca2e-1807-486c-bb38-b42e9ab66838 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:14.394217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:14.409769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a4939288-5827-479b-8f61-ca7f0c7771e9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:14.428789 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4939288-5827-479b-8f61-ca7f0c7771e9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 200 len: 1495 microversion: 2.1 time: 0.252676 Jul 28 03:43:14.445187 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 903/1679] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:14 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 1495 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:14.473171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd63d602-bbe5-42ae-ba27-381155f4525e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:14.477219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd63d602-bbe5-42ae-ba27-381155f4525e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:14.486435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:14.489422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd63d602-bbe5-42ae-ba27-381155f4525e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:14.490806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd63d602-bbe5-42ae-ba27-381155f4525e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:14.492410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd63d602-bbe5-42ae-ba27-381155f4525e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:14.493419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd63d602-bbe5-42ae-ba27-381155f4525e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:14.560609 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd63d602-bbe5-42ae-ba27-381155f4525e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113468 Jul 28 03:43:14.562094 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 904/1680] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:43:14 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:14.568208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6725a0b4-6434-486c-baa8-7fba3f6e7979 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:14.569150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6725a0b4-6434-486c-baa8-7fba3f6e7979 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:14.576767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6725a0b4-6434-486c-baa8-7fba3f6e7979 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:14.577553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6725a0b4-6434-486c-baa8-7fba3f6e7979 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:14.578521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6725a0b4-6434-486c-baa8-7fba3f6e7979 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:14.579116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6725a0b4-6434-486c-baa8-7fba3f6e7979 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:14.744448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6725a0b4-6434-486c-baa8-7fba3f6e7979 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:14.756662 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6725a0b4-6434-486c-baa8-7fba3f6e7979 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 200 len: 1277 microversion: 2.1 time: 0.192325 Jul 28 03:43:14.756662 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 905/1681] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:14 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:14.907576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f6f217f0-ed1b-4645-9caa-1efa521c5047 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:14.928164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f6f217f0-ed1b-4645-9caa-1efa521c5047 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:14.937938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6f217f0-ed1b-4645-9caa-1efa521c5047 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:14.938762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6f217f0-ed1b-4645-9caa-1efa521c5047 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:14.940111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6f217f0-ed1b-4645-9caa-1efa521c5047 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:14.941029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6f217f0-ed1b-4645-9caa-1efa521c5047 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:15.123058 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9af5ca2e-1807-486c-bb38-b42e9ab66838 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Acquired lock "refresh_cache-d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" {{(pid=126072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 03:43:15.195783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f6f217f0-ed1b-4645-9caa-1efa521c5047 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:15.237229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f6f217f0-ed1b-4645-9caa-1efa521c5047 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:15.250556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f6f217f0-ed1b-4645-9caa-1efa521c5047 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:15.253986 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f6f217f0-ed1b-4645-9caa-1efa521c5047 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.352206 Jul 28 03:43:15.255734 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 906/1682] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:14 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:43:15.265718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-75e6a84e-b018-4c61-be7e-4b3276aa8c6a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:15.267106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-75e6a84e-b018-4c61-be7e-4b3276aa8c6a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:15.288161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75e6a84e-b018-4c61-be7e-4b3276aa8c6a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:15.288899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75e6a84e-b018-4c61-be7e-4b3276aa8c6a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:15.290527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75e6a84e-b018-4c61-be7e-4b3276aa8c6a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:15.291486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75e6a84e-b018-4c61-be7e-4b3276aa8c6a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:15.539262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-75e6a84e-b018-4c61-be7e-4b3276aa8c6a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:15.561957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-75e6a84e-b018-4c61-be7e-4b3276aa8c6a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:15.566738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-75e6a84e-b018-4c61-be7e-4b3276aa8c6a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:15.569658 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-75e6a84e-b018-4c61-be7e-4b3276aa8c6a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1281 microversion: 2.25 time: 0.311225 Jul 28 03:43:15.571092 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 907/1683] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:15 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1281 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:15.581172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b4b8dfd3-261c-44a9-8d6b-208e63956af1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:15.582915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4b8dfd3-261c-44a9-8d6b-208e63956af1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:15.595702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4b8dfd3-261c-44a9-8d6b-208e63956af1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:15.597241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4b8dfd3-261c-44a9-8d6b-208e63956af1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:15.599535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4b8dfd3-261c-44a9-8d6b-208e63956af1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:15.600790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4b8dfd3-261c-44a9-8d6b-208e63956af1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:15.814252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:15.826612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b4b8dfd3-261c-44a9-8d6b-208e63956af1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:15.837450 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b4b8dfd3-261c-44a9-8d6b-208e63956af1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 200 len: 1478 microversion: 2.1 time: 0.264594 Jul 28 03:43:15.838041 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 908/1684] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:15 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 1478 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:15.858186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-812148cc-a49d-4014-b6df-f6a42ad09728 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:15.863991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-812148cc-a49d-4014-b6df-f6a42ad09728 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:15.869839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-812148cc-a49d-4014-b6df-f6a42ad09728 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:15.870427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-812148cc-a49d-4014-b6df-f6a42ad09728 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:15.871357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-812148cc-a49d-4014-b6df-f6a42ad09728 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:15.871916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-812148cc-a49d-4014-b6df-f6a42ad09728 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:15.921940 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-812148cc-a49d-4014-b6df-f6a42ad09728 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071689 Jul 28 03:43:15.928548 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 909/1685] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:43:15 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:43:15.932795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-095ab5e6-0f3b-450d-a25c-40da868b0433 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:15.934619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-095ab5e6-0f3b-450d-a25c-40da868b0433 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:15.945772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-095ab5e6-0f3b-450d-a25c-40da868b0433 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:15.946540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-095ab5e6-0f3b-450d-a25c-40da868b0433 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:15.949038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-095ab5e6-0f3b-450d-a25c-40da868b0433 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:15.949803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-095ab5e6-0f3b-450d-a25c-40da868b0433 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:16.191027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-095ab5e6-0f3b-450d-a25c-40da868b0433 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:16.209251 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-095ab5e6-0f3b-450d-a25c-40da868b0433 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 200 len: 1319 microversion: 2.1 time: 0.284259 Jul 28 03:43:16.210363 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 910/1686] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:15 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:16.217273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6533d22b-7310-48e7-ab40-b056026b537a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-538772514"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:16.220256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6533d22b-7310-48e7-ab40-b056026b537a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:16.227610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6533d22b-7310-48e7-ab40-b056026b537a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:16.228859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6533d22b-7310-48e7-ab40-b056026b537a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:16.230363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6533d22b-7310-48e7-ab40-b056026b537a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:16.231103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6533d22b-7310-48e7-ab40-b056026b537a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:16.494882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:16.512807 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6533d22b-7310-48e7-ab40-b056026b537a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "POST /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e/action" status: 202 len: 0 microversion: 2.1 time: 0.300614 Jul 28 03:43:16.514079 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 911/1687] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:43:16 2022] POST /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 03:43:16.532551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1745563218", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4becdb03-f4b9-4bc9-b3de-403ab318d4dd"}], "block_device_mapping_v2": [{"uuid": "6c51784f-79d9-4385-a510-7e404c74de75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:16.633112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] validate_networks() for [('4becdb03-f4b9-4bc9-b3de-403ab318d4dd', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:43:17.172929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:43:17.173878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:43:17.175314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:43:17.175536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:43:17.176129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:43:17.190511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:17.191225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:17.192248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:17.192867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:17.217564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Getting quotas for project 006f4f23380b45fab24edfea5be8f3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:43:17.225459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Getting quotas for user 15947ba65c714e0dbb60fc36afcb9a9c and project 006f4f23380b45fab24edfea5be8f3a7. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:43:17.312799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:43:17.315346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c51784f-79d9-4385-a510-7e404c74de75',volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:43:17.482045 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6900507c-d807-4e70-b300-a418e93232cc tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959860 Jul 28 03:43:17.483373 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 912/1688] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:43:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:43:17.497252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-558f4e36-4775-45d4-a82e-da241046b7b3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:17.501817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-558f4e36-4775-45d4-a82e-da241046b7b3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:17.517079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-558f4e36-4775-45d4-a82e-da241046b7b3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:17.517539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-558f4e36-4775-45d4-a82e-da241046b7b3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:17.518358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-558f4e36-4775-45d4-a82e-da241046b7b3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:17.518856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-558f4e36-4775-45d4-a82e-da241046b7b3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:17.809356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-558f4e36-4775-45d4-a82e-da241046b7b3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:17.823643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-558f4e36-4775-45d4-a82e-da241046b7b3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:17.825354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-558f4e36-4775-45d4-a82e-da241046b7b3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:17.826555 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-558f4e36-4775-45d4-a82e-da241046b7b3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.335933 Jul 28 03:43:17.827117 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 913/1689] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:17 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:17.832252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1288421411", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "1910a77c-9cb7-4e01-ac7e-093a589dc9ac"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:17.895603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] validate_networks() for [('1910a77c-9cb7-4e01-ac7e-093a589dc9ac', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:43:18.478346 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-9af5ca2e-1807-486c-bb38-b42e9ab66838 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Building network info cache for instance {{(pid=126072) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 03:43:18.587045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:43:18.587683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:43:18.588575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:43:18.589351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:43:18.590232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:43:18.617853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:18.617853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:18.619329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:18.620007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:18.650153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Getting quotas for project 39b785d4e7c6483e8affc1cc61a8998e. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:43:18.658356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Getting quotas for user 590f4ca3ef8640529749d54793c05f46 and project 39b785d4e7c6483e8affc1cc61a8998e. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:43:18.679659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:43:18.683042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:43:18.746263 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7c186ff1-2293-4f6f-9e5f-a64d7e50b191 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917679 Jul 28 03:43:18.747551 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 914/1690] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:43:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:43:18.753365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3c074f0-2cf6-49f3-b428-69cdc1679217 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa798f15e0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:18.861811 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d3c074f0-2cf6-49f3-b428-69cdc1679217 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f" status: 200 len: 1437 microversion: 2.1 time: 0.112687 Jul 28 03:43:18.872976 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 915/1691] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:43:18 2022] GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f => generated 1437 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:18.881917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0fcae8b4-c881-42f1-8c3a-e7e91c073014 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:18.882951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0fcae8b4-c881-42f1-8c3a-e7e91c073014 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:18.892467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fcae8b4-c881-42f1-8c3a-e7e91c073014 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:18.896719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fcae8b4-c881-42f1-8c3a-e7e91c073014 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:18.897738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fcae8b4-c881-42f1-8c3a-e7e91c073014 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:18.903854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fcae8b4-c881-42f1-8c3a-e7e91c073014 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:19.221572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0fcae8b4-c881-42f1-8c3a-e7e91c073014 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:19.237853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0fcae8b4-c881-42f1-8c3a-e7e91c073014 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:19.245866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0fcae8b4-c881-42f1-8c3a-e7e91c073014 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:19.247105 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0fcae8b4-c881-42f1-8c3a-e7e91c073014 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1477 microversion: 2.25 time: 0.372228 Jul 28 03:43:19.247690 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 916/1692] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:18 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1477 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:19.272414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8dab1bf9-0776-4eb5-b5b8-f8c9e6e78916 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:19.273041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8dab1bf9-0776-4eb5-b5b8-f8c9e6e78916 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:19.290728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dab1bf9-0776-4eb5-b5b8-f8c9e6e78916 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:19.291122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dab1bf9-0776-4eb5-b5b8-f8c9e6e78916 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:19.292031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dab1bf9-0776-4eb5-b5b8-f8c9e6e78916 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:19.292488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dab1bf9-0776-4eb5-b5b8-f8c9e6e78916 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:19.579067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8dab1bf9-0776-4eb5-b5b8-f8c9e6e78916 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:19.597363 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8dab1bf9-0776-4eb5-b5b8-f8c9e6e78916 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 200 len: 1319 microversion: 2.1 time: 0.347913 Jul 28 03:43:19.605605 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 917/1693] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:19 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:19.613689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b348d854-0c4a-4f11-9889-1cb2611dc0e6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:19.626050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b348d854-0c4a-4f11-9889-1cb2611dc0e6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:19.643070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b348d854-0c4a-4f11-9889-1cb2611dc0e6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:19.644845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b348d854-0c4a-4f11-9889-1cb2611dc0e6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:19.648065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b348d854-0c4a-4f11-9889-1cb2611dc0e6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:19.649597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b348d854-0c4a-4f11-9889-1cb2611dc0e6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:19.794692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b348d854-0c4a-4f11-9889-1cb2611dc0e6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:19.812700 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b348d854-0c4a-4f11-9889-1cb2611dc0e6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1169 microversion: 2.1 time: 0.205223 Jul 28 03:43:19.813528 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 918/1694] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:19 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1169 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:19.834940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-394be61d-e2a8-4e2d-826a-d54e9eecd6eb req-36add0a4-6d42-4fc5-aeb4-105e051224dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4040cba7-343d-4675-8c2a-a7b86506a2b1", "tag": "7a4b64f8-fe97-48ba-94bc-ee1cc308752b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:19.850137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-394be61d-e2a8-4e2d-826a-d54e9eecd6eb req-36add0a4-6d42-4fc5-aeb4-105e051224dc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:19.850943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-394be61d-e2a8-4e2d-826a-d54e9eecd6eb req-36add0a4-6d42-4fc5-aeb4-105e051224dc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:19.879965 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-394be61d-e2a8-4e2d-826a-d54e9eecd6eb req-36add0a4-6d42-4fc5-aeb4-105e051224dc service nova] Creating event network-changed:7a4b64f8-fe97-48ba-94bc-ee1cc308752b for instance 4040cba7-343d-4675-8c2a-a7b86506a2b1 on n-h2-826756-3 Jul 28 03:43:19.896415 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-394be61d-e2a8-4e2d-826a-d54e9eecd6eb req-36add0a4-6d42-4fc5-aeb4-105e051224dc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070174 Jul 28 03:43:19.899667 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 919/1695] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:19.914511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f2a56581-8265-427b-a225-27eb7046ef28 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:19.915987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f2a56581-8265-427b-a225-27eb7046ef28 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:19.964495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2a56581-8265-427b-a225-27eb7046ef28 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:19.965486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2a56581-8265-427b-a225-27eb7046ef28 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:19.972572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2a56581-8265-427b-a225-27eb7046ef28 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:19.975323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2a56581-8265-427b-a225-27eb7046ef28 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:20.116294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f2a56581-8265-427b-a225-27eb7046ef28 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:20.125386 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f2a56581-8265-427b-a225-27eb7046ef28 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1222 microversion: 2.1 time: 0.224215 Jul 28 03:43:20.139981 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 920/1696] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:19 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1222 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:20.152755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a12c2d44-8643-4767-ab83-c056026c79d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:20.156660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a12c2d44-8643-4767-ab83-c056026c79d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:20.165165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a12c2d44-8643-4767-ab83-c056026c79d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:20.165612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a12c2d44-8643-4767-ab83-c056026c79d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:20.166593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a12c2d44-8643-4767-ab83-c056026c79d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:20.167042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a12c2d44-8643-4767-ab83-c056026c79d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:20.339835 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a12c2d44-8643-4767-ab83-c056026c79d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.198119 Jul 28 03:43:20.347276 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 921/1697] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:43:20 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:43:20.354398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d3fa20d-f491-464f-8859-04a87157a3e3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:20.358276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4d3fa20d-f491-464f-8859-04a87157a3e3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:20.377014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d3fa20d-f491-464f-8859-04a87157a3e3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:20.385493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d3fa20d-f491-464f-8859-04a87157a3e3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:20.387307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d3fa20d-f491-464f-8859-04a87157a3e3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:20.389471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d3fa20d-f491-464f-8859-04a87157a3e3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:20.664389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-9af5ca2e-1807-486c-bb38-b42e9ab66838 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Updating instance_info_cache with network_info: [{"id": "6a95d3ac-a87f-4069-aae1-494421f7ceaa", "address": "fa:16:3e:6b:c0:4c", "network": {"id": "db476184-d60c-46a3-9670-b892a40ef885", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1990725356-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9f7680ec7bd44a62be5017f043d4613b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6a95d3ac-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126072) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 03:43:20.678958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9af5ca2e-1807-486c-bb38-b42e9ab66838 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Releasing lock "refresh_cache-d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" {{(pid=126072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 03:43:20.682857 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9af5ca2e-1807-486c-bb38-b42e9ab66838 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "POST /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a/action" status: 202 len: 0 microversion: 2.1 time: 6.936861 Jul 28 03:43:20.684134 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 777/1698] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:43:13 2022] POST /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a/action => generated 0 bytes in 6939 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 03:43:20.881568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d3fa20d-f491-464f-8859-04a87157a3e3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:20.899489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d3fa20d-f491-464f-8859-04a87157a3e3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:20.902327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d3fa20d-f491-464f-8859-04a87157a3e3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:20.905930 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d3fa20d-f491-464f-8859-04a87157a3e3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.559217 Jul 28 03:43:20.908384 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 922/1699] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:20 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:20.915883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-65d13ac6-e050-42e9-984e-9289cd793e94 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa740781f0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:21.101187 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-65d13ac6-e050-42e9-984e-9289cd793e94 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f" status: 200 len: 1437 microversion: 2.1 time: 0.190620 Jul 28 03:43:21.102237 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 923/1700] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:43:20 2022] GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f => generated 1437 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:21.125641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40693ab5-d3b9-41cd-91e2-0c7ff337e30a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:21.164421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40693ab5-d3b9-41cd-91e2-0c7ff337e30a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:21.181124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d9299f54-84d0-4228-a664-c922496ce004 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:21.181996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d9299f54-84d0-4228-a664-c922496ce004 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:21.196928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40693ab5-d3b9-41cd-91e2-0c7ff337e30a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:21.199721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40693ab5-d3b9-41cd-91e2-0c7ff337e30a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:21.200674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40693ab5-d3b9-41cd-91e2-0c7ff337e30a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:21.204659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40693ab5-d3b9-41cd-91e2-0c7ff337e30a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:21.211189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d9299f54-84d0-4228-a664-c922496ce004 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:21.211805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d9299f54-84d0-4228-a664-c922496ce004 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:21.212747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d9299f54-84d0-4228-a664-c922496ce004 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:21.225596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d9299f54-84d0-4228-a664-c922496ce004 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:21.842860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40693ab5-d3b9-41cd-91e2-0c7ff337e30a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:21.858295 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40693ab5-d3b9-41cd-91e2-0c7ff337e30a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1670 microversion: 2.1 time: 0.739996 Jul 28 03:43:21.863451 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 924/1701] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:21 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1670 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:21.869014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9ecbabce-971a-4fac-a01e-b39b6b2686b9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:21.876606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9ecbabce-971a-4fac-a01e-b39b6b2686b9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:21.885300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ecbabce-971a-4fac-a01e-b39b6b2686b9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:21.887271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ecbabce-971a-4fac-a01e-b39b6b2686b9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:21.888290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ecbabce-971a-4fac-a01e-b39b6b2686b9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:21.888922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ecbabce-971a-4fac-a01e-b39b6b2686b9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:22.437924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9ecbabce-971a-4fac-a01e-b39b6b2686b9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:22.450514 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9ecbabce-971a-4fac-a01e-b39b6b2686b9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 200 len: 1319 microversion: 2.1 time: 0.585342 Jul 28 03:43:22.464396 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 925/1702] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:21 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 1319 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:22.476333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e10347a6-7e38-44ad-98d7-e50c14ed97f4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:22.477317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e10347a6-7e38-44ad-98d7-e50c14ed97f4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:22.495499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e10347a6-7e38-44ad-98d7-e50c14ed97f4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:22.495946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e10347a6-7e38-44ad-98d7-e50c14ed97f4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:22.496793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e10347a6-7e38-44ad-98d7-e50c14ed97f4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:22.497228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e10347a6-7e38-44ad-98d7-e50c14ed97f4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:22.558466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e10347a6-7e38-44ad-98d7-e50c14ed97f4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:43:22.742642 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e10347a6-7e38-44ad-98d7-e50c14ed97f4 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" status: 204 len: 0 microversion: 2.1 time: 0.276067 Jul 28 03:43:22.745440 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 926/1703] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:43:22 2022] DELETE /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:43:22.768838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-810fc96b-9487-488d-92a4-2737b2d25d1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:22.770329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-810fc96b-9487-488d-92a4-2737b2d25d1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:22.784659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-810fc96b-9487-488d-92a4-2737b2d25d1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:22.785371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-810fc96b-9487-488d-92a4-2737b2d25d1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:22.787269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-810fc96b-9487-488d-92a4-2737b2d25d1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:22.788235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-810fc96b-9487-488d-92a4-2737b2d25d1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:22.956816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-810fc96b-9487-488d-92a4-2737b2d25d1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:22.972511 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-810fc96b-9487-488d-92a4-2737b2d25d1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1169 microversion: 2.1 time: 0.216918 Jul 28 03:43:22.973345 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 927/1704] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:22 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1169 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:22.984882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3c9e457-fc00-4693-ae0a-7cde66e91638 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:22.986067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3c9e457-fc00-4693-ae0a-7cde66e91638 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:23.010493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3c9e457-fc00-4693-ae0a-7cde66e91638 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:23.011290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3c9e457-fc00-4693-ae0a-7cde66e91638 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:23.012789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3c9e457-fc00-4693-ae0a-7cde66e91638 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:23.013233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3c9e457-fc00-4693-ae0a-7cde66e91638 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:23.158050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3c9e457-fc00-4693-ae0a-7cde66e91638 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:23.172722 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3c9e457-fc00-4693-ae0a-7cde66e91638 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1276 microversion: 2.1 time: 0.198132 Jul 28 03:43:23.173681 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 928/1705] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:22 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1276 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:23.192499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-167ce259-6880-4f29-b70f-e4810af3e8a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:23.193574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-167ce259-6880-4f29-b70f-e4810af3e8a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:23.234114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-167ce259-6880-4f29-b70f-e4810af3e8a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:23.234733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-167ce259-6880-4f29-b70f-e4810af3e8a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:23.241456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-167ce259-6880-4f29-b70f-e4810af3e8a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:23.242070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-167ce259-6880-4f29-b70f-e4810af3e8a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:23.327949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-d9299f54-84d0-4228-a664-c922496ce004 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid 38bded12-c7e6-4c2b-bf28-bcf754421d2d {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:43:23.361464 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d9299f54-84d0-4228-a664-c922496ce004 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1970 microversion: 2.25 time: 2.670657 Jul 28 03:43:23.376766 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 778/1706] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:20 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1970 bytes in 2686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:23.390332 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-4aa86211-bcd2-440d-b51d-5f42c70c7528 req-769cc21b-a7cf-4b81-ae11-6e6d67c317db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1ad11e2-ba9b-4fc3-86ca-b871f311b52a", "tag": "6a95d3ac-a87f-4069-aae1-494421f7ceaa"}, {"name": "network-changed", "server_uuid": "69ea9ea3-b1dc-400f-956f-e5e6c79f4677", "tag": "40a1c97c-8ac6-4d6f-838e-8a724b5ba92f"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:23.449839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4aa86211-bcd2-440d-b51d-5f42c70c7528 req-769cc21b-a7cf-4b81-ae11-6e6d67c317db service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:23.455278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4aa86211-bcd2-440d-b51d-5f42c70c7528 req-769cc21b-a7cf-4b81-ae11-6e6d67c317db service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:23.493105 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-4aa86211-bcd2-440d-b51d-5f42c70c7528 req-769cc21b-a7cf-4b81-ae11-6e6d67c317db service nova] Creating event network-changed:6a95d3ac-a87f-4069-aae1-494421f7ceaa for instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a on n-h2-826756-3 Jul 28 03:43:23.497908 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-4aa86211-bcd2-440d-b51d-5f42c70c7528 req-769cc21b-a7cf-4b81-ae11-6e6d67c317db service nova] Creating event network-changed:40a1c97c-8ac6-4d6f-838e-8a724b5ba92f for instance 69ea9ea3-b1dc-400f-956f-e5e6c79f4677 on n-h1-826756-3 Jul 28 03:43:23.517216 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-4aa86211-bcd2-440d-b51d-5f42c70c7528 req-769cc21b-a7cf-4b81-ae11-6e6d67c317db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.138888 Jul 28 03:43:23.532817 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 779/1707] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:23.539788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-990509b9-8e50-44aa-ad6c-191dce769047 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa749c4700>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:23.700789 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-990509b9-8e50-44aa-ad6c-191dce769047 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f" status: 200 len: 1437 microversion: 2.1 time: 0.166492 Jul 28 03:43:23.709207 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 780/1708] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:43:23 2022] GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f => generated 1437 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:23.714857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a2f4507c-dcf7-4ad0-9610-99cfa8f06761 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.246"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:23.717931 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a2f4507c-dcf7-4ad0-9610-99cfa8f06761 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:23.727042 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a2f4507c-dcf7-4ad0-9610-99cfa8f06761 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:23.727934 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a2f4507c-dcf7-4ad0-9610-99cfa8f06761 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:23.729048 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a2f4507c-dcf7-4ad0-9610-99cfa8f06761 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:23.729734 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a2f4507c-dcf7-4ad0-9610-99cfa8f06761 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:23.762927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a2f4507c-dcf7-4ad0-9610-99cfa8f06761 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Acquired lock "refresh_cache-623a67cb-d39e-4de8-877f-a81af9613a10" {{(pid=126072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 03:43:23.818784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-167ce259-6880-4f29-b70f-e4810af3e8a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:23.837560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:23.845400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-167ce259-6880-4f29-b70f-e4810af3e8a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:23.848772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-167ce259-6880-4f29-b70f-e4810af3e8a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:23.853064 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-167ce259-6880-4f29-b70f-e4810af3e8a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.670513 Jul 28 03:43:23.855009 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 929/1709] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:23 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:23.866421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-919ca7f8-4b6e-41e4-8137-cd88d00b43d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:23.867576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-919ca7f8-4b6e-41e4-8137-cd88d00b43d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:23.883040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-919ca7f8-4b6e-41e4-8137-cd88d00b43d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:23.884441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-919ca7f8-4b6e-41e4-8137-cd88d00b43d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:23.886108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-919ca7f8-4b6e-41e4-8137-cd88d00b43d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:23.887174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-919ca7f8-4b6e-41e4-8137-cd88d00b43d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:24.207538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-919ca7f8-4b6e-41e4-8137-cd88d00b43d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:24.226522 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-919ca7f8-4b6e-41e4-8137-cd88d00b43d9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1670 microversion: 2.1 time: 0.368569 Jul 28 03:43:24.240389 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 930/1710] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:23 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1670 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:24.240389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb8bd6c1-7cfb-4a60-ae3d-b8977bd57681 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:24.240389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb8bd6c1-7cfb-4a60-ae3d-b8977bd57681 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:24.260473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb8bd6c1-7cfb-4a60-ae3d-b8977bd57681 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:24.261267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb8bd6c1-7cfb-4a60-ae3d-b8977bd57681 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:24.263308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb8bd6c1-7cfb-4a60-ae3d-b8977bd57681 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:24.264100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb8bd6c1-7cfb-4a60-ae3d-b8977bd57681 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:24.538329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-fb8bd6c1-7cfb-4a60-ae3d-b8977bd57681 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid 38bded12-c7e6-4c2b-bf28-bcf754421d2d {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:43:24.564029 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fb8bd6c1-7cfb-4a60-ae3d-b8977bd57681 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1970 microversion: 2.25 time: 0.333565 Jul 28 03:43:24.566196 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 931/1711] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:24 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1970 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:24.573404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2a8d860-c3fd-4328-8f7d-709213f5a86c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:24.574177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2a8d860-c3fd-4328-8f7d-709213f5a86c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:24.595703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2a8d860-c3fd-4328-8f7d-709213f5a86c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:24.599071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2a8d860-c3fd-4328-8f7d-709213f5a86c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:24.610043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2a8d860-c3fd-4328-8f7d-709213f5a86c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:24.610825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2a8d860-c3fd-4328-8f7d-709213f5a86c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:25.033416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b2a8d860-c3fd-4328-8f7d-709213f5a86c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:25.051604 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b2a8d860-c3fd-4328-8f7d-709213f5a86c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 200 len: 1319 microversion: 2.1 time: 0.483352 Jul 28 03:43:25.053466 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 932/1712] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:24 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 1319 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:25.061108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-dccdedad-bf4c-4113-8aca-2404e94fc957 req-d2479ed4-be48-43b1-9060-257822e49530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da14893a-5718-4a91-9307-abd3ffb2c20e", "name": "network-vif-plugged", "status": "completed", "tag": "b35fa4af-3beb-470a-8838-d64f39ee8851"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:25.081493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-dccdedad-bf4c-4113-8aca-2404e94fc957 req-d2479ed4-be48-43b1-9060-257822e49530 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:25.082688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-dccdedad-bf4c-4113-8aca-2404e94fc957 req-d2479ed4-be48-43b1-9060-257822e49530 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:25.106216 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-dccdedad-bf4c-4113-8aca-2404e94fc957 req-d2479ed4-be48-43b1-9060-257822e49530 service nova] Creating event network-vif-plugged:b35fa4af-3beb-470a-8838-d64f39ee8851 for instance da14893a-5718-4a91-9307-abd3ffb2c20e on n-h1-826756-3 Jul 28 03:43:25.114329 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-dccdedad-bf4c-4113-8aca-2404e94fc957 req-d2479ed4-be48-43b1-9060-257822e49530 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058699 Jul 28 03:43:25.116409 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 933/1713] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:25.125529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6e429fb1-8ee5-44c8-9308-59fb706584d0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:25.126733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6e429fb1-8ee5-44c8-9308-59fb706584d0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:25.135879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e429fb1-8ee5-44c8-9308-59fb706584d0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:25.137370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e429fb1-8ee5-44c8-9308-59fb706584d0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:25.139664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e429fb1-8ee5-44c8-9308-59fb706584d0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:25.141098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e429fb1-8ee5-44c8-9308-59fb706584d0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:25.689131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6e429fb1-8ee5-44c8-9308-59fb706584d0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:25.713013 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6e429fb1-8ee5-44c8-9308-59fb706584d0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1211 microversion: 2.1 time: 0.592498 Jul 28 03:43:25.730460 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 934/1714] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:25 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1211 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:25.752923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-edd2a2f7-891d-429c-b54f-6cad77c7a1ce tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:25.754476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-edd2a2f7-891d-429c-b54f-6cad77c7a1ce tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:25.767510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edd2a2f7-891d-429c-b54f-6cad77c7a1ce tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:25.769102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edd2a2f7-891d-429c-b54f-6cad77c7a1ce tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:25.772556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edd2a2f7-891d-429c-b54f-6cad77c7a1ce tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:25.773927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edd2a2f7-891d-429c-b54f-6cad77c7a1ce tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:26.055448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-edd2a2f7-891d-429c-b54f-6cad77c7a1ce tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:26.085472 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-edd2a2f7-891d-429c-b54f-6cad77c7a1ce tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1276 microversion: 2.1 time: 0.352869 Jul 28 03:43:26.100389 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 935/1715] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:25 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1276 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:26.111125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-33789bf9-7a71-4ce9-9b01-74043150f7d0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:26.118854 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:43:26.118854 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:43:26.131065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33789bf9-7a71-4ce9-9b01-74043150f7d0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:26.135379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33789bf9-7a71-4ce9-9b01-74043150f7d0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:26.141208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33789bf9-7a71-4ce9-9b01-74043150f7d0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:26.141739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33789bf9-7a71-4ce9-9b01-74043150f7d0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:26.290302 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-33789bf9-7a71-4ce9-9b01-74043150f7d0 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.200269 Jul 28 03:43:26.315274 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 936/1716] 10.222.0.48 () {60 vars in 1217 bytes} [Thu Jul 28 03:43:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:43:26.323884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c77b767b-81e7-4951-87da-ffba6c0fbcb2 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa7985b3a0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:26.487589 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c77b767b-81e7-4951-87da-ffba6c0fbcb2 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f" status: 200 len: 1437 microversion: 2.1 time: 0.170019 Jul 28 03:43:26.490635 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 937/1717] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:43:26 2022] GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f => generated 1437 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:26.513289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f270391-3e30-47fb-885b-04530e955c89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:26.520141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8f270391-3e30-47fb-885b-04530e955c89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:26.549940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f270391-3e30-47fb-885b-04530e955c89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:26.550996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f270391-3e30-47fb-885b-04530e955c89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:26.552506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f270391-3e30-47fb-885b-04530e955c89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:26.553308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f270391-3e30-47fb-885b-04530e955c89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:27.209446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8f270391-3e30-47fb-885b-04530e955c89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:27.224135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8f270391-3e30-47fb-885b-04530e955c89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:27.230679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8f270391-3e30-47fb-885b-04530e955c89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:27.231528 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8f270391-3e30-47fb-885b-04530e955c89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.725385 Jul 28 03:43:27.262453 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 938/1718] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:26 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:27.296709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-597d0a28-65e9-4253-9475-52230f575a9c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:27.297472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-597d0a28-65e9-4253-9475-52230f575a9c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:27.303310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:27.330805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-597d0a28-65e9-4253-9475-52230f575a9c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:27.333848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-597d0a28-65e9-4253-9475-52230f575a9c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:27.338226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-597d0a28-65e9-4253-9475-52230f575a9c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:27.340769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-597d0a28-65e9-4253-9475-52230f575a9c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:27.643220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-597d0a28-65e9-4253-9475-52230f575a9c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:27.656253 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-597d0a28-65e9-4253-9475-52230f575a9c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.390948 Jul 28 03:43:27.667868 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 939/1719] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:27 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:27.672986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a7cadfbb-bdda-4210-9144-671a08bf04b0 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:27.673606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a7cadfbb-bdda-4210-9144-671a08bf04b0 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:27.690876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a7cadfbb-bdda-4210-9144-671a08bf04b0 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:27.691640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a7cadfbb-bdda-4210-9144-671a08bf04b0 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:27.692640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a7cadfbb-bdda-4210-9144-671a08bf04b0 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:27.693245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a7cadfbb-bdda-4210-9144-671a08bf04b0 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:28.002849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a7cadfbb-bdda-4210-9144-671a08bf04b0 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:28.016724 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a7cadfbb-bdda-4210-9144-671a08bf04b0 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 200 len: 1319 microversion: 2.1 time: 0.347506 Jul 28 03:43:28.023584 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 940/1720] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:27 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:28.039581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f6a105ab-f437-4240-99c6-890c1f6b195b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-826756-3", "block_migration": "auto"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:28.055699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f6a105ab-f437-4240-99c6-890c1f6b195b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:28.110646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6a105ab-f437-4240-99c6-890c1f6b195b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:28.117161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6a105ab-f437-4240-99c6-890c1f6b195b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:28.122966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6a105ab-f437-4240-99c6-890c1f6b195b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:28.125424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6a105ab-f437-4240-99c6-890c1f6b195b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:28.255878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-f6a105ab-f437-4240-99c6-890c1f6b195b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'flavor' on Instance uuid 38bded12-c7e6-4c2b-bf28-bcf754421d2d {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:43:28.317809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f6a105ab-f437-4240-99c6-890c1f6b195b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Going to try to live migrate instance to n-h1-826756-3 {{(pid=126071) live_migrate /opt/stack/nova/nova/compute/api.py:5474}} Jul 28 03:43:28.671361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:31.390842 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f6a105ab-f437-4240-99c6-890c1f6b195b tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d/action" status: 202 len: 0 microversion: 2.25 time: 3.363139 Jul 28 03:43:31.392075 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 941/1721] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 03:43:28 2022] POST /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d/action => generated 0 bytes in 3367 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:43:31.401062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c1d55d3f-e18f-4abf-a3b4-18c923ec9311 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:31.412087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c1d55d3f-e18f-4abf-a3b4-18c923ec9311 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:31.431682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1d55d3f-e18f-4abf-a3b4-18c923ec9311 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:31.433230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1d55d3f-e18f-4abf-a3b4-18c923ec9311 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:31.434617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1d55d3f-e18f-4abf-a3b4-18c923ec9311 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:31.435609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1d55d3f-e18f-4abf-a3b4-18c923ec9311 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:31.727067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c1d55d3f-e18f-4abf-a3b4-18c923ec9311 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:31.742886 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c1d55d3f-e18f-4abf-a3b4-18c923ec9311 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1199 microversion: 2.1 time: 0.348252 Jul 28 03:43:31.745111 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 942/1722] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:31 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1199 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:31.765887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9359cbe8-5d3b-419f-8457-7e189683e3b3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:31.775142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9359cbe8-5d3b-419f-8457-7e189683e3b3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:31.798384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9359cbe8-5d3b-419f-8457-7e189683e3b3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:31.800666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9359cbe8-5d3b-419f-8457-7e189683e3b3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:31.801497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9359cbe8-5d3b-419f-8457-7e189683e3b3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:31.805627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9359cbe8-5d3b-419f-8457-7e189683e3b3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:32.120055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9359cbe8-5d3b-419f-8457-7e189683e3b3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:32.134325 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9359cbe8-5d3b-419f-8457-7e189683e3b3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1318 microversion: 2.1 time: 0.387704 Jul 28 03:43:32.137229 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 943/1723] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:31 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:32.156048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-24482c47-0e78-4f7f-a5c2-94b78fdc7c75 req-1d16313f-62a9-497a-83d9-b0de34b8b9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4040cba7-343d-4675-8c2a-a7b86506a2b1", "name": "network-vif-plugged", "status": "completed", "tag": "7a4b64f8-fe97-48ba-94bc-ee1cc308752b"}, {"server_uuid": "d1ad11e2-ba9b-4fc3-86ca-b871f311b52a", "name": "network-vif-unplugged", "status": "completed", "tag": "6a95d3ac-a87f-4069-aae1-494421f7ceaa"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:32.176891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-24482c47-0e78-4f7f-a5c2-94b78fdc7c75 req-1d16313f-62a9-497a-83d9-b0de34b8b9a2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:32.177799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-24482c47-0e78-4f7f-a5c2-94b78fdc7c75 req-1d16313f-62a9-497a-83d9-b0de34b8b9a2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:32.199819 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-24482c47-0e78-4f7f-a5c2-94b78fdc7c75 req-1d16313f-62a9-497a-83d9-b0de34b8b9a2 service nova] Creating event network-vif-plugged:7a4b64f8-fe97-48ba-94bc-ee1cc308752b for instance 4040cba7-343d-4675-8c2a-a7b86506a2b1 on n-h2-826756-3 Jul 28 03:43:32.200805 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-24482c47-0e78-4f7f-a5c2-94b78fdc7c75 req-1d16313f-62a9-497a-83d9-b0de34b8b9a2 service nova] Creating event network-vif-unplugged:6a95d3ac-a87f-4069-aae1-494421f7ceaa for instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a on n-h2-826756-3 Jul 28 03:43:32.210226 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-24482c47-0e78-4f7f-a5c2-94b78fdc7c75 req-1d16313f-62a9-497a-83d9-b0de34b8b9a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.071281 Jul 28 03:43:32.217519 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 944/1724] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:32.227736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d0640b8e-1024-4215-bea8-3116ed5f45e4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa7404c0d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:32.316171 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d0640b8e-1024-4215-bea8-3116ed5f45e4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f" status: 200 len: 1437 microversion: 2.1 time: 0.096168 Jul 28 03:43:32.317889 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 945/1725] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:43:32 2022] GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f => generated 1437 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:32.328403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-96a9bcdc-2867-4918-98ef-a375ca93612a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:32.330513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-96a9bcdc-2867-4918-98ef-a375ca93612a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:32.344020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96a9bcdc-2867-4918-98ef-a375ca93612a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:32.344865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96a9bcdc-2867-4918-98ef-a375ca93612a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:32.346237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96a9bcdc-2867-4918-98ef-a375ca93612a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:32.347101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96a9bcdc-2867-4918-98ef-a375ca93612a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:33.442703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-96a9bcdc-2867-4918-98ef-a375ca93612a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:33.458093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-96a9bcdc-2867-4918-98ef-a375ca93612a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:33.459723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-96a9bcdc-2867-4918-98ef-a375ca93612a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:33.473541 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-96a9bcdc-2867-4918-98ef-a375ca93612a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 1.153224 Jul 28 03:43:33.474558 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 946/1726] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:32 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:33.489181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2798cc9e-a4d0-4648-b667-dfd92979480e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:33.490363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2798cc9e-a4d0-4648-b667-dfd92979480e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:33.506002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2798cc9e-a4d0-4648-b667-dfd92979480e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:33.506921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2798cc9e-a4d0-4648-b667-dfd92979480e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:33.507933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2798cc9e-a4d0-4648-b667-dfd92979480e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:33.512042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2798cc9e-a4d0-4648-b667-dfd92979480e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:33.727329 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=14 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:33.758775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=18,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:33.844591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2798cc9e-a4d0-4648-b667-dfd92979480e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:33.854627 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2798cc9e-a4d0-4648-b667-dfd92979480e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 200 len: 1319 microversion: 2.1 time: 0.378566 Jul 28 03:43:33.869205 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 947/1727] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:33 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 1319 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:33.875698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a5cc7ba-d792-4111-a379-94de7b1cfe76 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:33.876635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8a5cc7ba-d792-4111-a379-94de7b1cfe76 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:33.886650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a5cc7ba-d792-4111-a379-94de7b1cfe76 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:33.888037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a5cc7ba-d792-4111-a379-94de7b1cfe76 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:33.889104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a5cc7ba-d792-4111-a379-94de7b1cfe76 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:33.889868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a5cc7ba-d792-4111-a379-94de7b1cfe76 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:33.897365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:33.905826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-a2f4507c-dcf7-4ad0-9610-99cfa8f06761 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Building network info cache for instance {{(pid=126072) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 03:43:34.181278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a5cc7ba-d792-4111-a379-94de7b1cfe76 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:34.199549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a5cc7ba-d792-4111-a379-94de7b1cfe76 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:34.204226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a5cc7ba-d792-4111-a379-94de7b1cfe76 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:34.207046 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a5cc7ba-d792-4111-a379-94de7b1cfe76 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.336321 Jul 28 03:43:34.211829 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 948/1728] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:33 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:34.219271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-050f7ab8-66ad-49bc-aa3c-4e6bfe6a2fcd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:34.224200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-050f7ab8-66ad-49bc-aa3c-4e6bfe6a2fcd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:34.238280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-050f7ab8-66ad-49bc-aa3c-4e6bfe6a2fcd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:34.241804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-050f7ab8-66ad-49bc-aa3c-4e6bfe6a2fcd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:34.242722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-050f7ab8-66ad-49bc-aa3c-4e6bfe6a2fcd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:34.245139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-050f7ab8-66ad-49bc-aa3c-4e6bfe6a2fcd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:34.588561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-050f7ab8-66ad-49bc-aa3c-4e6bfe6a2fcd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:34.598142 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-050f7ab8-66ad-49bc-aa3c-4e6bfe6a2fcd tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1199 microversion: 2.1 time: 0.384848 Jul 28 03:43:34.604624 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 949/1729] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:34 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1199 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:34.614660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-484c27ed-ecef-4181-b2f2-d381f406404e req-48a836cf-20e0-4023-870d-bed47f5f2f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42fcd75-f3a9-4abb-a5fd-f8c600bbb272", "tag": "c1bcc2ac-62d4-4a34-ab01-789e5b7a9432"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:34.652193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-484c27ed-ecef-4181-b2f2-d381f406404e req-48a836cf-20e0-4023-870d-bed47f5f2f66 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:34.665013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-484c27ed-ecef-4181-b2f2-d381f406404e req-48a836cf-20e0-4023-870d-bed47f5f2f66 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:34.693048 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-484c27ed-ecef-4181-b2f2-d381f406404e req-48a836cf-20e0-4023-870d-bed47f5f2f66 service nova] Creating event network-changed:c1bcc2ac-62d4-4a34-ab01-789e5b7a9432 for instance c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 on n-h1-826756-3 Jul 28 03:43:34.700778 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-484c27ed-ecef-4181-b2f2-d381f406404e req-48a836cf-20e0-4023-870d-bed47f5f2f66 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094567 Jul 28 03:43:34.702205 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 950/1730] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:34.714332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7f458888-de20-4e30-9296-da06696443cc tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:34.717331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7f458888-de20-4e30-9296-da06696443cc tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:34.730496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f458888-de20-4e30-9296-da06696443cc tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:34.733744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f458888-de20-4e30-9296-da06696443cc tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:34.734894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f458888-de20-4e30-9296-da06696443cc tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:34.735564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f458888-de20-4e30-9296-da06696443cc tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:35.060470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7f458888-de20-4e30-9296-da06696443cc tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:35.069822 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7f458888-de20-4e30-9296-da06696443cc tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1318 microversion: 2.1 time: 0.364152 Jul 28 03:43:35.071433 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 951/1731] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:34 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:35.076673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3ffbe7ca-ccda-465b-a070-2ccf789869cf tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa7404caf0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:35.164832 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3ffbe7ca-ccda-465b-a070-2ccf789869cf tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f" status: 200 len: 1437 microversion: 2.1 time: 0.091797 Jul 28 03:43:35.166104 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 952/1732] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:43:35 2022] GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f => generated 1437 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:35.171365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-ec695c5a-6165-4524-89d8-b8b4592c6f41 req-5e0173f7-9f76-4a90-8338-096c7d0e4938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ea9ea3-b1dc-400f-956f-e5e6c79f4677", "name": "network-vif-plugged", "status": "completed", "tag": "40a1c97c-8ac6-4d6f-838e-8a724b5ba92f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:35.181994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ec695c5a-6165-4524-89d8-b8b4592c6f41 req-5e0173f7-9f76-4a90-8338-096c7d0e4938 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:35.184160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ec695c5a-6165-4524-89d8-b8b4592c6f41 req-5e0173f7-9f76-4a90-8338-096c7d0e4938 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:35.208172 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-ec695c5a-6165-4524-89d8-b8b4592c6f41 req-5e0173f7-9f76-4a90-8338-096c7d0e4938 service nova] Creating event network-vif-plugged:40a1c97c-8ac6-4d6f-838e-8a724b5ba92f for instance 69ea9ea3-b1dc-400f-956f-e5e6c79f4677 on n-h1-826756-3 Jul 28 03:43:35.243987 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-ec695c5a-6165-4524-89d8-b8b4592c6f41 req-5e0173f7-9f76-4a90-8338-096c7d0e4938 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075742 Jul 28 03:43:35.251545 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 953/1733] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:35.276177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca3d3924-f6f2-4bc0-8169-88d653088fbd tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:35.284319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca3d3924-f6f2-4bc0-8169-88d653088fbd tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:35.294723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca3d3924-f6f2-4bc0-8169-88d653088fbd tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:35.296261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca3d3924-f6f2-4bc0-8169-88d653088fbd tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:35.298104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca3d3924-f6f2-4bc0-8169-88d653088fbd tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:35.299264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca3d3924-f6f2-4bc0-8169-88d653088fbd tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:35.753600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca3d3924-f6f2-4bc0-8169-88d653088fbd tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:35.767907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca3d3924-f6f2-4bc0-8169-88d653088fbd tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:35.769885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca3d3924-f6f2-4bc0-8169-88d653088fbd tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:35.771689 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca3d3924-f6f2-4bc0-8169-88d653088fbd tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.515283 Jul 28 03:43:35.772898 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 954/1734] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:35 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:35.778210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e8bbe460-7438-4a1c-ac40-e73ef4c43a2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:35.779109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e8bbe460-7438-4a1c-ac40-e73ef4c43a2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:35.786360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8bbe460-7438-4a1c-ac40-e73ef4c43a2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:35.787185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8bbe460-7438-4a1c-ac40-e73ef4c43a2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:35.788290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8bbe460-7438-4a1c-ac40-e73ef4c43a2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:35.789006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8bbe460-7438-4a1c-ac40-e73ef4c43a2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:36.099517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e8bbe460-7438-4a1c-ac40-e73ef4c43a2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:36.112865 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e8bbe460-7438-4a1c-ac40-e73ef4c43a2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 200 len: 1319 microversion: 2.1 time: 0.338405 Jul 28 03:43:36.122327 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 955/1735] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:35 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:36.134592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d6d9f902-f637-4ddb-8c82-a2934cb49005 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:36.135536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d6d9f902-f637-4ddb-8c82-a2934cb49005 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:36.144712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6d9f902-f637-4ddb-8c82-a2934cb49005 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:36.145516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6d9f902-f637-4ddb-8c82-a2934cb49005 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:36.146820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6d9f902-f637-4ddb-8c82-a2934cb49005 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:36.147475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6d9f902-f637-4ddb-8c82-a2934cb49005 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:36.193665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:36.419505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d6d9f902-f637-4ddb-8c82-a2934cb49005 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:36.436275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d6d9f902-f637-4ddb-8c82-a2934cb49005 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:36.438117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d6d9f902-f637-4ddb-8c82-a2934cb49005 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:36.451462 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d6d9f902-f637-4ddb-8c82-a2934cb49005 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.309574 Jul 28 03:43:36.462048 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 956/1736] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:36 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:36.462581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bd73df8d-6fec-4b68-9f01-86aa4662739c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:36.463465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bd73df8d-6fec-4b68-9f01-86aa4662739c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:36.487995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd73df8d-6fec-4b68-9f01-86aa4662739c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:36.487995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd73df8d-6fec-4b68-9f01-86aa4662739c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:36.489390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd73df8d-6fec-4b68-9f01-86aa4662739c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:36.489390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd73df8d-6fec-4b68-9f01-86aa4662739c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:36.724770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-a2f4507c-dcf7-4ad0-9610-99cfa8f06761 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Updating instance_info_cache with network_info: [{"id": "62f765ff-c7d8-4877-9576-bc720cc3f64f", "address": "fa:16:3e:cb:14:2d", "network": {"id": "db476184-d60c-46a3-9670-b892a40ef885", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1990725356-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9f7680ec7bd44a62be5017f043d4613b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap62f765ff-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126072) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 03:43:36.741417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a2f4507c-dcf7-4ad0-9610-99cfa8f06761 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Releasing lock "refresh_cache-623a67cb-d39e-4de8-877f-a81af9613a10" {{(pid=126072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 03:43:36.742600 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a2f4507c-dcf7-4ad0-9610-99cfa8f06761 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "POST /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10/action" status: 202 len: 0 microversion: 2.1 time: 13.031877 Jul 28 03:43:36.743394 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 781/1737] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:43:23 2022] POST /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10/action => generated 0 bytes in 13033 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 03:43:36.750955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-757e98d3-d094-4456-bf2f-319e2d5ad751 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:36.752080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-757e98d3-d094-4456-bf2f-319e2d5ad751 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:36.759856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bd73df8d-6fec-4b68-9f01-86aa4662739c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:36.762436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-757e98d3-d094-4456-bf2f-319e2d5ad751 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:36.763288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-757e98d3-d094-4456-bf2f-319e2d5ad751 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:36.764308 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-757e98d3-d094-4456-bf2f-319e2d5ad751 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:36.765020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-757e98d3-d094-4456-bf2f-319e2d5ad751 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:36.779633 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bd73df8d-6fec-4b68-9f01-86aa4662739c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1199 microversion: 2.1 time: 0.325717 Jul 28 03:43:36.780245 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 957/1738] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:36 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1199 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:36.798407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3a103f5-788c-4b2d-9e38-71cf8d7e206d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74078790>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:36.933150 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3a103f5-788c-4b2d-9e38-71cf8d7e206d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f" status: 200 len: 1437 microversion: 2.1 time: 0.151492 Jul 28 03:43:36.941530 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 958/1739] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:43:36 2022] GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f => generated 1437 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:36.947778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2409ede0-885a-4ec7-9c55-0e9a7c0946e8 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '.version_select at 0x7ffa7409c430>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:37.531281 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-757e98d3-d094-4456-bf2f-319e2d5ad751 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:37.569456 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-757e98d3-d094-4456-bf2f-319e2d5ad751 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1318 microversion: 2.1 time: 0.823650 Jul 28 03:43:37.588621 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 782/1740] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:36 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1318 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:37.610577 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-47aa5144-b8d1-4c39-b737-dbea81dac007 req-6ea887d3-415d-4415-afa2-d53cb43a3a8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "623a67cb-d39e-4de8-877f-a81af9613a10", "tag": "62f765ff-c7d8-4877-9576-bc720cc3f64f"}, {"server_uuid": "d1ad11e2-ba9b-4fc3-86ca-b871f311b52a", "name": "network-vif-deleted", "tag": "6a95d3ac-a87f-4069-aae1-494421f7ceaa"}, {"name": "network-changed", "server_uuid": "a7a8c953-25e1-401f-89e2-dcce0c9f414b", "tag": "9ee53927-49a5-4692-82ec-07e6f6f08ed4"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:37.688874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-47aa5144-b8d1-4c39-b737-dbea81dac007 req-6ea887d3-415d-4415-afa2-d53cb43a3a8f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:37.693419 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-47aa5144-b8d1-4c39-b737-dbea81dac007 req-6ea887d3-415d-4415-afa2-d53cb43a3a8f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:37.759145 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-47aa5144-b8d1-4c39-b737-dbea81dac007 req-6ea887d3-415d-4415-afa2-d53cb43a3a8f service nova] Creating event network-changed:62f765ff-c7d8-4877-9576-bc720cc3f64f for instance 623a67cb-d39e-4de8-877f-a81af9613a10 on n-h2-826756-3 Jul 28 03:43:37.760223 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-47aa5144-b8d1-4c39-b737-dbea81dac007 req-6ea887d3-415d-4415-afa2-d53cb43a3a8f service nova] Creating event network-vif-deleted:6a95d3ac-a87f-4069-aae1-494421f7ceaa for instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a on n-h2-826756-3 Jul 28 03:43:37.767109 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-47aa5144-b8d1-4c39-b737-dbea81dac007 req-6ea887d3-415d-4415-afa2-d53cb43a3a8f service nova] Creating event network-changed:9ee53927-49a5-4692-82ec-07e6f6f08ed4 for instance a7a8c953-25e1-401f-89e2-dcce0c9f414b on n-h1-826756-3 Jul 28 03:43:37.794344 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-47aa5144-b8d1-4c39-b737-dbea81dac007 req-6ea887d3-415d-4415-afa2-d53cb43a3a8f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.207428 Jul 28 03:43:37.795320 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 783/1741] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:37.814196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-51788254-7623-486d-b2aa-1faa70c4133c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:37.815365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-51788254-7623-486d-b2aa-1faa70c4133c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:37.828435 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2409ede0-885a-4ec7-9c55-0e9a7c0946e8 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/cc4f127c-b20e-4609-9c3f-1ada01643ae6" status: 200 len: 184 microversion: 2.1 time: 0.884325 Jul 28 03:43:37.829976 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 959/1742] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Jul 28 03:43:36 2022] GET /compute/v2.1/os-floating-ips/cc4f127c-b20e-4609-9c3f-1ada01643ae6 => generated 184 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:37.839496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51788254-7623-486d-b2aa-1faa70c4133c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:37.840216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51788254-7623-486d-b2aa-1faa70c4133c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:37.841619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51788254-7623-486d-b2aa-1faa70c4133c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:37.842587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51788254-7623-486d-b2aa-1faa70c4133c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:37.862896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-00f922b4-6845-4883-a0c1-c897d5be14e5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:37.864223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-00f922b4-6845-4883-a0c1-c897d5be14e5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:37.908223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00f922b4-6845-4883-a0c1-c897d5be14e5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:37.909128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00f922b4-6845-4883-a0c1-c897d5be14e5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:37.912660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00f922b4-6845-4883-a0c1-c897d5be14e5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:37.913434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00f922b4-6845-4883-a0c1-c897d5be14e5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:38.179737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-00f922b4-6845-4883-a0c1-c897d5be14e5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:38.187958 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-00f922b4-6845-4883-a0c1-c897d5be14e5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 200 len: 1468 microversion: 2.1 time: 0.356155 Jul 28 03:43:38.195373 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 960/1743] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:37 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 1468 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:38.205124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-57949fb3-ad0b-4a98-a961-44f2010fc621 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:38.207897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-57949fb3-ad0b-4a98-a961-44f2010fc621 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:38.224673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57949fb3-ad0b-4a98-a961-44f2010fc621 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:38.225420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57949fb3-ad0b-4a98-a961-44f2010fc621 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:38.226400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57949fb3-ad0b-4a98-a961-44f2010fc621 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:38.227066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57949fb3-ad0b-4a98-a961-44f2010fc621 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:38.495659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-57949fb3-ad0b-4a98-a961-44f2010fc621 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:38.508686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-57949fb3-ad0b-4a98-a961-44f2010fc621 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:38.510483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-57949fb3-ad0b-4a98-a961-44f2010fc621 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:38.512515 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-57949fb3-ad0b-4a98-a961-44f2010fc621 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.311682 Jul 28 03:43:38.513618 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 961/1744] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:38 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:38.519616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2c28fbe9-07a1-417f-becf-1605c6ba7017 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:38.520493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2c28fbe9-07a1-417f-becf-1605c6ba7017 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:38.529325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c28fbe9-07a1-417f-becf-1605c6ba7017 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:38.530069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c28fbe9-07a1-417f-becf-1605c6ba7017 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:38.531035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c28fbe9-07a1-417f-becf-1605c6ba7017 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:38.531665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c28fbe9-07a1-417f-becf-1605c6ba7017 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:38.709069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2c28fbe9-07a1-417f-becf-1605c6ba7017 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:38.722894 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2c28fbe9-07a1-417f-becf-1605c6ba7017 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1199 microversion: 2.1 time: 0.206362 Jul 28 03:43:38.723545 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 962/1745] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:38 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1199 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:38.728504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-52f76615-e2c8-4c3e-906c-b5fd61e9a12f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.246"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:38.842199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-51788254-7623-486d-b2aa-1faa70c4133c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:38.876249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-51788254-7623-486d-b2aa-1faa70c4133c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:38.880605 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-51788254-7623-486d-b2aa-1faa70c4133c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:38.894948 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-51788254-7623-486d-b2aa-1faa70c4133c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 1.098063 Jul 28 03:43:38.908929 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 784/1746] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:37 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:38.920748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-52f76615-e2c8-4c3e-906c-b5fd61e9a12f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:38.923415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52f76615-e2c8-4c3e-906c-b5fd61e9a12f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:38.923869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52f76615-e2c8-4c3e-906c-b5fd61e9a12f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:38.925666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52f76615-e2c8-4c3e-906c-b5fd61e9a12f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:38.926498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52f76615-e2c8-4c3e-906c-b5fd61e9a12f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:38.936497 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-01711b62-f783-4443-bd22-fbe1e4b4e22c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74b01f70>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:39.018608 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-01711b62-f783-4443-bd22-fbe1e4b4e22c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f" status: 200 len: 1437 microversion: 2.1 time: 0.095111 Jul 28 03:43:39.033548 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 785/1747] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:43:38 2022] GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f => generated 1437 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:39.041897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a87b786b-4a5c-447b-9416-afa822828ed4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:39.054415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a87b786b-4a5c-447b-9416-afa822828ed4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 4040cba7-343d-4675-8c2a-a7b86506a2b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:39.064873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a87b786b-4a5c-447b-9416-afa822828ed4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:39.065792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a87b786b-4a5c-447b-9416-afa822828ed4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:39.077945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a87b786b-4a5c-447b-9416-afa822828ed4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:39.078857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a87b786b-4a5c-447b-9416-afa822828ed4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:39.400570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52f76615-e2c8-4c3e-906c-b5fd61e9a12f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Acquired lock "refresh_cache-623a67cb-d39e-4de8-877f-a81af9613a10" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 03:43:39.424936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a87b786b-4a5c-447b-9416-afa822828ed4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:39.453567 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a87b786b-4a5c-447b-9416-afa822828ed4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1" status: 200 len: 1469 microversion: 2.1 time: 0.410111 Jul 28 03:43:39.454960 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 786/1748] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:39 2022] GET /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1 => generated 1469 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:39.471994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b5a89c85-51b6-47ee-a77b-8ec662331b1d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:39.473016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b5a89c85-51b6-47ee-a77b-8ec662331b1d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:39.488044 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5a89c85-51b6-47ee-a77b-8ec662331b1d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:39.489971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5a89c85-51b6-47ee-a77b-8ec662331b1d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:39.491776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5a89c85-51b6-47ee-a77b-8ec662331b1d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:39.493194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5a89c85-51b6-47ee-a77b-8ec662331b1d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:40.359712 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b5a89c85-51b6-47ee-a77b-8ec662331b1d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:40.374067 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b5a89c85-51b6-47ee-a77b-8ec662331b1d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1318 microversion: 2.1 time: 0.911352 Jul 28 03:43:40.375189 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 787/1749] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:39 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1318 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:40.390928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5b31ad0d-22fe-4630-9989-8898a1b04625 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:40.406196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5b31ad0d-22fe-4630-9989-8898a1b04625 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:40.407681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5b31ad0d-22fe-4630-9989-8898a1b04625 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Searching by: {'reservation_id': 'r-8dmgiy9u', 'deleted': False, 'project_id': '6979063538ee4bf08537b46bfb6e4249'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:43:40.421709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b31ad0d-22fe-4630-9989-8898a1b04625 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:40.422453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b31ad0d-22fe-4630-9989-8898a1b04625 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:40.427780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b31ad0d-22fe-4630-9989-8898a1b04625 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:40.428407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b31ad0d-22fe-4630-9989-8898a1b04625 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:40.601488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-5b31ad0d-22fe-4630-9989-8898a1b04625 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:43:40.717168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5b31ad0d-22fe-4630-9989-8898a1b04625 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:40.729210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b31ad0d-22fe-4630-9989-8898a1b04625 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:40.729952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b31ad0d-22fe-4630-9989-8898a1b04625 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:40.975139 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5b31ad0d-22fe-4630-9989-8898a1b04625 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?reservation_id=r-8dmgiy9u" status: 200 len: 2930 microversion: 2.1 time: 0.596432 Jul 28 03:43:40.976059 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 788/1750] 10.222.0.48 () {58 vars in 1197 bytes} [Thu Jul 28 03:43:40 2022] GET /compute/v2.1/servers/detail?reservation_id=r-8dmgiy9u => generated 2930 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:41.019307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7060c47c-7047-47ab-b43f-bbd9cd42b59c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:41.020728 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7060c47c-7047-47ab-b43f-bbd9cd42b59c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:41.032676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7060c47c-7047-47ab-b43f-bbd9cd42b59c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:41.033409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7060c47c-7047-47ab-b43f-bbd9cd42b59c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:41.034848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7060c47c-7047-47ab-b43f-bbd9cd42b59c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:41.035548 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7060c47c-7047-47ab-b43f-bbd9cd42b59c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:41.301198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-52f76615-e2c8-4c3e-906c-b5fd61e9a12f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Building network info cache for instance {{(pid=126071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 03:43:41.358699 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7060c47c-7047-47ab-b43f-bbd9cd42b59c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:41.376546 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7060c47c-7047-47ab-b43f-bbd9cd42b59c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:41.378670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7060c47c-7047-47ab-b43f-bbd9cd42b59c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:41.380527 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7060c47c-7047-47ab-b43f-bbd9cd42b59c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.370425 Jul 28 03:43:41.381445 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 789/1751] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:40 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:41.404769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e587ceaf-2065-455a-aa68-c2aeedc0052d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:41.412641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e587ceaf-2065-455a-aa68-c2aeedc0052d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:41.425462 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e587ceaf-2065-455a-aa68-c2aeedc0052d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:41.426179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e587ceaf-2065-455a-aa68-c2aeedc0052d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:41.427075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e587ceaf-2065-455a-aa68-c2aeedc0052d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:41.427527 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e587ceaf-2065-455a-aa68-c2aeedc0052d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:41.823726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e587ceaf-2065-455a-aa68-c2aeedc0052d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:41.837369 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e587ceaf-2065-455a-aa68-c2aeedc0052d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1199 microversion: 2.1 time: 0.446126 Jul 28 03:43:41.853286 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 790/1752] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:41 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1199 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:41.864918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-58414f13-e281-4083-933d-b798dd411135 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:41.865812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-58414f13-e281-4083-933d-b798dd411135 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:41.876238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-58414f13-e281-4083-933d-b798dd411135 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:41.877027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-58414f13-e281-4083-933d-b798dd411135 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:41.879344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-58414f13-e281-4083-933d-b798dd411135 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:41.879816 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-58414f13-e281-4083-933d-b798dd411135 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:42.341358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-52f76615-e2c8-4c3e-906c-b5fd61e9a12f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Updating instance_info_cache with network_info: [{"id": "62f765ff-c7d8-4877-9576-bc720cc3f64f", "address": "fa:16:3e:cb:14:2d", "network": {"id": "db476184-d60c-46a3-9670-b892a40ef885", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1990725356-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9f7680ec7bd44a62be5017f043d4613b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap62f765ff-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 03:43:42.369365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-58414f13-e281-4083-933d-b798dd411135 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:42.377037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52f76615-e2c8-4c3e-906c-b5fd61e9a12f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Releasing lock "refresh_cache-623a67cb-d39e-4de8-877f-a81af9613a10" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 03:43:42.381858 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-52f76615-e2c8-4c3e-906c-b5fd61e9a12f tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "POST /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10/action" status: 202 len: 0 microversion: 2.1 time: 3.656374 Jul 28 03:43:42.385514 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 963/1753] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:43:38 2022] POST /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10/action => generated 0 bytes in 3661 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 03:43:42.392130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-58414f13-e281-4083-933d-b798dd411135 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:42.395916 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-58414f13-e281-4083-933d-b798dd411135 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:42.398070 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-58414f13-e281-4083-933d-b798dd411135 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.543164 Jul 28 03:43:42.408411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1b468fe-9b17-4f9b-a2db-2eeccb8dbdff tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa7988d8b0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:42.430398 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 791/1754] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:41 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:42.437921 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f6e750ef-2332-4c51-8f09-0eca3f8a02a2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:42.507601 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.compute.server_groups [None req-f6e750ef-2332-4c51-8f09-0eca3f8a02a2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Querying cell a8b3e198-f422-4bf1-ae6c-bd38905d4b84(cell1) for 2 instances {{(pid=126072) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 28 03:43:42.508832 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f6e750ef-2332-4c51-8f09-0eca3f8a02a2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:42.509534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f6e750ef-2332-4c51-8f09-0eca3f8a02a2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:42.517078 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1b468fe-9b17-4f9b-a2db-2eeccb8dbdff tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f" status: 200 len: 1437 microversion: 2.1 time: 0.125404 Jul 28 03:43:42.518117 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 964/1755] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:43:42 2022] GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f => generated 1437 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:42.550933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4179273c-1040-4893-bf4a-c040a437ecd6 req-12095db6-9e4e-4320-87eb-4ac75ebf26fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "623a67cb-d39e-4de8-877f-a81af9613a10", "tag": "62f765ff-c7d8-4877-9576-bc720cc3f64f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:42.560249 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f6e750ef-2332-4c51-8f09-0eca3f8a02a2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/39ae209d-de8d-4e95-a81a-8c3c6c9a5a14" status: 200 len: 271 microversion: 2.1 time: 0.127883 Jul 28 03:43:42.561950 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 792/1756] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:43:42 2022] GET /compute/v2.1/os-server-groups/39ae209d-de8d-4e95-a81a-8c3c6c9a5a14 => generated 271 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:42.567241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dcc7a461-9b47-493b-a1c4-28643085864b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:42.568318 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dcc7a461-9b47-493b-a1c4-28643085864b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:42.575495 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dcc7a461-9b47-493b-a1c4-28643085864b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:42.577059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dcc7a461-9b47-493b-a1c4-28643085864b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:42.577477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dcc7a461-9b47-493b-a1c4-28643085864b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:42.578016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dcc7a461-9b47-493b-a1c4-28643085864b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:42.597221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4179273c-1040-4893-bf4a-c040a437ecd6 req-12095db6-9e4e-4320-87eb-4ac75ebf26fc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:42.598061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4179273c-1040-4893-bf4a-c040a437ecd6 req-12095db6-9e4e-4320-87eb-4ac75ebf26fc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:42.640265 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4179273c-1040-4893-bf4a-c040a437ecd6 req-12095db6-9e4e-4320-87eb-4ac75ebf26fc service nova] Creating event network-changed:62f765ff-c7d8-4877-9576-bc720cc3f64f for instance 623a67cb-d39e-4de8-877f-a81af9613a10 on n-h2-826756-3 Jul 28 03:43:42.658761 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4179273c-1040-4893-bf4a-c040a437ecd6 req-12095db6-9e4e-4320-87eb-4ac75ebf26fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130612 Jul 28 03:43:42.660007 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 965/1757] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:42.684613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b4485e4-a08b-4be4-b829-2b618fc7cf50 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:42.688501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5b4485e4-a08b-4be4-b829-2b618fc7cf50 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:42.706074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b4485e4-a08b-4be4-b829-2b618fc7cf50 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:42.707563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b4485e4-a08b-4be4-b829-2b618fc7cf50 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:42.709394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b4485e4-a08b-4be4-b829-2b618fc7cf50 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:42.710543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b4485e4-a08b-4be4-b829-2b618fc7cf50 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:42.746823 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-5b4485e4-a08b-4be4-b829-2b618fc7cf50 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] HTTP exception thrown: Instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a could not be found. Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b4485e4-a08b-4be4-b829-2b618fc7cf50 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Request method failure captured: Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a HTTP/1.1 Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gWDHIHQ6EQNV2zwdmq-zma3EKvgOGr_5V48VrtYy3PaIoJyY5tDaF2P6paJV8XP0iJtiy1rT7KTsS3OMNKul2WqIKH7VjMg4gY0QssEkVNelRhLpfFV0dqwHx5IRBV_-d2c0EdVOI0RgswRjgGzLIXF7Qvcrbqb2NqvhPXbRklxm3c Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 9f7680ec7bd44a62be5017f043d4613b Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1472308666 Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9f7680ec7bd44a62be5017f043d4613b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f7680ec7bd44a62be5017f043d4613b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9f7680ec7bd44a62be5017f043d4613b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f7680ec7bd44a62be5017f043d4613b"}]}] Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1472308666 Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 9f7680ec7bd44a62be5017f043d4613b Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1472308666 Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FloatingIPsAssociationTestJSON-1472308666-project Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da34b0ac72d94d2fbd00ea09d805f0fe Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1472308666-project Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a could not be found. Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd1ad11e2-ba9b-4fc3-86ca-b871f311b52a'} Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a could not be found. Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:43:42.750682 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:43:42.760805 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a could not be found. Jul 28 03:43:42.760805 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:42.760805 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:43:42.760805 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:42.760805 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:42.760805 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:43:42.760805 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:43:42.760805 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:43:42.760805 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:43:42.760805 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a could not be found. Jul 28 03:43:42.760805 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:42.766339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b4485e4-a08b-4be4-b829-2b618fc7cf50 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Returning 404 to user: Instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:43:42.767952 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5b4485e4-a08b-4be4-b829-2b618fc7cf50 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" status: 404 len: 111 microversion: 2.1 time: 0.105845 Jul 28 03:43:42.769525 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 966/1758] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:43:42 2022] DELETE /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:43:42.779097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-75e4e5fc-e3dc-4f9f-a52a-bb711235eadd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:42.780560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-75e4e5fc-e3dc-4f9f-a52a-bb711235eadd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:42.792693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75e4e5fc-e3dc-4f9f-a52a-bb711235eadd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:42.793848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75e4e5fc-e3dc-4f9f-a52a-bb711235eadd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:42.795538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75e4e5fc-e3dc-4f9f-a52a-bb711235eadd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:42.796559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75e4e5fc-e3dc-4f9f-a52a-bb711235eadd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:42.915641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dcc7a461-9b47-493b-a1c4-28643085864b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:42.953231 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dcc7a461-9b47-493b-a1c4-28643085864b tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1318 microversion: 2.1 time: 0.376121 Jul 28 03:43:42.964416 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 793/1759] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:42 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:42.981233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-51746190-7e3c-42a1-be1a-52d4d12c0737 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:42.981544 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-51746190-7e3c-42a1-be1a-52d4d12c0737 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] [instance: 4040cba7-343d-4675-8c2a-a7b86506a2b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:42.998859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51746190-7e3c-42a1-be1a-52d4d12c0737 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:43.013613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51746190-7e3c-42a1-be1a-52d4d12c0737 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:43.018980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51746190-7e3c-42a1-be1a-52d4d12c0737 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:43.023834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-51746190-7e3c-42a1-be1a-52d4d12c0737 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:43.163914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-75e4e5fc-e3dc-4f9f-a52a-bb711235eadd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:43.175264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-75e4e5fc-e3dc-4f9f-a52a-bb711235eadd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:43.179029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-75e4e5fc-e3dc-4f9f-a52a-bb711235eadd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:43.180814 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-75e4e5fc-e3dc-4f9f-a52a-bb711235eadd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.409655 Jul 28 03:43:43.181944 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 967/1760] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:42 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:43.198811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb3e7fa0-59d9-480c-9420-5605ee651888 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:43.199762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eb3e7fa0-59d9-480c-9420-5605ee651888 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: d1ad11e2-ba9b-4fc3-86ca-b871f311b52a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:43.207865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb3e7fa0-59d9-480c-9420-5605ee651888 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:43.209271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb3e7fa0-59d9-480c-9420-5605ee651888 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:43.211190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb3e7fa0-59d9-480c-9420-5605ee651888 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:43.211892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb3e7fa0-59d9-480c-9420-5605ee651888 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:43.255997 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-eb3e7fa0-59d9-480c-9420-5605ee651888 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] HTTP exception thrown: Instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a could not be found. Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb3e7fa0-59d9-480c-9420-5605ee651888 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Request method failure captured: Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a HTTP/1.1 Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gWDHIHQ6EQNV2zwdmq-zma3EKvgOGr_5V48VrtYy3PaIoJyY5tDaF2P6paJV8XP0iJtiy1rT7KTsS3OMNKul2WqIKH7VjMg4gY0QssEkVNelRhLpfFV0dqwHx5IRBV_-d2c0EdVOI0RgswRjgGzLIXF7Qvcrbqb2NqvhPXbRklxm3c Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 9f7680ec7bd44a62be5017f043d4613b Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1472308666 Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9f7680ec7bd44a62be5017f043d4613b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f7680ec7bd44a62be5017f043d4613b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9f7680ec7bd44a62be5017f043d4613b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f7680ec7bd44a62be5017f043d4613b"}]}] Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1472308666 Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 9f7680ec7bd44a62be5017f043d4613b Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1472308666 Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FloatingIPsAssociationTestJSON-1472308666-project Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da34b0ac72d94d2fbd00ea09d805f0fe Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1472308666-project Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a could not be found. Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd1ad11e2-ba9b-4fc3-86ca-b871f311b52a'} Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a could not be found. Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a could not be found. Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:43.258830 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:43:43.271503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:43.271503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:43.271503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:43:43.271503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:43:43.271503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:43:43.271503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:43:43.271503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a could not be found. Jul 28 03:43:43.271503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:43:43.276527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb3e7fa0-59d9-480c-9420-5605ee651888 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Returning 404 to user: Instance d1ad11e2-ba9b-4fc3-86ca-b871f311b52a could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:43:43.278785 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb3e7fa0-59d9-480c-9420-5605ee651888 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a" status: 404 len: 111 microversion: 2.1 time: 0.095269 Jul 28 03:43:43.286549 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 968/1761] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:43 2022] GET /compute/v2.1/servers/d1ad11e2-ba9b-4fc3-86ca-b871f311b52a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:43:43.293689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-04c57a89-eb2f-4228-9f93-bd784d053ad0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:43.294943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-04c57a89-eb2f-4228-9f93-bd784d053ad0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:43.310952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04c57a89-eb2f-4228-9f93-bd784d053ad0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:43.311952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04c57a89-eb2f-4228-9f93-bd784d053ad0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:43.313446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04c57a89-eb2f-4228-9f93-bd784d053ad0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:43.314150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04c57a89-eb2f-4228-9f93-bd784d053ad0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:43.537725 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-51746190-7e3c-42a1-be1a-52d4d12c0737 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1" status: 200 len: 1620 microversion: 2.1 time: 0.579795 Jul 28 03:43:43.548304 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 794/1762] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:42 2022] GET /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1 => generated 1620 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:43.567630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-68190d20-e164-49aa-91cf-e7196ed7e080 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '.version_select at 0x7ffa74411af0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:43.756771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-04c57a89-eb2f-4228-9f93-bd784d053ad0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:43.787071 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-04c57a89-eb2f-4228-9f93-bd784d053ad0 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1199 microversion: 2.1 time: 0.498466 Jul 28 03:43:43.788034 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 969/1763] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:43 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1199 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:43.798891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-01ac9b78-0b1e-442b-b38d-991ceb64ca05 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:43.806478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-01ac9b78-0b1e-442b-b38d-991ceb64ca05 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:43.820161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01ac9b78-0b1e-442b-b38d-991ceb64ca05 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:43.823147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01ac9b78-0b1e-442b-b38d-991ceb64ca05 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:43.825828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01ac9b78-0b1e-442b-b38d-991ceb64ca05 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:43.829656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01ac9b78-0b1e-442b-b38d-991ceb64ca05 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:44.387412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-01ac9b78-0b1e-442b-b38d-991ceb64ca05 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:44.412161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-01ac9b78-0b1e-442b-b38d-991ceb64ca05 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:44.415884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-01ac9b78-0b1e-442b-b38d-991ceb64ca05 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:44.418471 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-01ac9b78-0b1e-442b-b38d-991ceb64ca05 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.628782 Jul 28 03:43:44.420142 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 970/1764] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:43 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:44.429360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-02269d3c-1577-472b-bdfd-cd10a60da0f3 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74061940>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:44.555598 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-02269d3c-1577-472b-bdfd-cd10a60da0f3 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f" status: 200 len: 1437 microversion: 2.1 time: 0.133324 Jul 28 03:43:44.557113 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 971/1765] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:43:44 2022] GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f => generated 1437 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:44.568985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-253a5f19-bb2b-4eec-8c84-49f5ca366dec tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:44.570468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-253a5f19-bb2b-4eec-8c84-49f5ca366dec tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:44.583515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-253a5f19-bb2b-4eec-8c84-49f5ca366dec tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:44.585680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-253a5f19-bb2b-4eec-8c84-49f5ca366dec tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:44.587609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-253a5f19-bb2b-4eec-8c84-49f5ca366dec tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:44.588725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-253a5f19-bb2b-4eec-8c84-49f5ca366dec tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:44.625376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:44.832703 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-253a5f19-bb2b-4eec-8c84-49f5ca366dec tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 200 len: 1619 microversion: 2.1 time: 0.273707 Jul 28 03:43:44.835395 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 972/1766] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:44 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 1619 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:44.842714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d654ef24-2c40-4cf2-a03c-cc8218c54578 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:44.845066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d654ef24-2c40-4cf2-a03c-cc8218c54578 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:44.858460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d654ef24-2c40-4cf2-a03c-cc8218c54578 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:44.859645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d654ef24-2c40-4cf2-a03c-cc8218c54578 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:44.861351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d654ef24-2c40-4cf2-a03c-cc8218c54578 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:44.863573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d654ef24-2c40-4cf2-a03c-cc8218c54578 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:45.072684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d654ef24-2c40-4cf2-a03c-cc8218c54578 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:45.083142 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d654ef24-2c40-4cf2-a03c-cc8218c54578 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1318 microversion: 2.1 time: 0.246274 Jul 28 03:43:45.093932 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 973/1767] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:44 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:45.093932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-735a219a-6bf2-44eb-9100-762d3f46366f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:45.093932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-735a219a-6bf2-44eb-9100-762d3f46366f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:45.097460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-735a219a-6bf2-44eb-9100-762d3f46366f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:45.097920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-735a219a-6bf2-44eb-9100-762d3f46366f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:45.098754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-735a219a-6bf2-44eb-9100-762d3f46366f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:45.099212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-735a219a-6bf2-44eb-9100-762d3f46366f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:45.271197 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-68190d20-e164-49aa-91cf-e7196ed7e080 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/cc4f127c-b20e-4609-9c3f-1ada01643ae6" status: 202 len: 0 microversion: 2.1 time: 1.720197 Jul 28 03:43:45.276406 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 795/1768] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:43:43 2022] DELETE /compute/v2.1/os-floating-ips/cc4f127c-b20e-4609-9c3f-1ada01643ae6 => generated 0 bytes in 1723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:43:45.279071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fa4b24b2-f63b-494d-8519-a9de00176b61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:45.280194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fa4b24b2-f63b-494d-8519-a9de00176b61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:45.290207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa4b24b2-f63b-494d-8519-a9de00176b61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:45.290653 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa4b24b2-f63b-494d-8519-a9de00176b61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:45.292849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa4b24b2-f63b-494d-8519-a9de00176b61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:45.293604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa4b24b2-f63b-494d-8519-a9de00176b61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:45.293784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-735a219a-6bf2-44eb-9100-762d3f46366f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:45.302561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-735a219a-6bf2-44eb-9100-762d3f46366f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:45.304432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-735a219a-6bf2-44eb-9100-762d3f46366f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:45.305601 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-735a219a-6bf2-44eb-9100-762d3f46366f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.220741 Jul 28 03:43:45.306167 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 974/1769] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:45 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:45.310636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1876822237", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "928e7a74-9453-46fe-a1dd-ebc281e8ea52"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:45.373737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:43:45.491123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fa4b24b2-f63b-494d-8519-a9de00176b61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:45.500662 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fa4b24b2-f63b-494d-8519-a9de00176b61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1199 microversion: 2.1 time: 0.226794 Jul 28 03:43:45.501523 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 796/1770] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:45 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1199 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:45.506445 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-941957bc-e4b4-4d6c-8a02-2c40f2f6969b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:45.506961 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-941957bc-e4b4-4d6c-8a02-2c40f2f6969b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:45.515410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-941957bc-e4b4-4d6c-8a02-2c40f2f6969b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:45.516107 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-941957bc-e4b4-4d6c-8a02-2c40f2f6969b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:45.517878 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-941957bc-e4b4-4d6c-8a02-2c40f2f6969b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:45.518558 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-941957bc-e4b4-4d6c-8a02-2c40f2f6969b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:45.561333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-941957bc-e4b4-4d6c-8a02-2c40f2f6969b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:43:45.663738 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-941957bc-e4b4-4d6c-8a02-2c40f2f6969b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "DELETE /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 204 len: 0 microversion: 2.1 time: 0.160566 Jul 28 03:43:45.665020 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 797/1771] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:43:45 2022] DELETE /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:43:45.672489 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7368e01a-38fa-4991-952b-e4585bc07b47 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:45.673214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7368e01a-38fa-4991-952b-e4585bc07b47 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:45.680077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7368e01a-38fa-4991-952b-e4585bc07b47 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:45.680639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7368e01a-38fa-4991-952b-e4585bc07b47 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:45.681461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7368e01a-38fa-4991-952b-e4585bc07b47 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:45.681917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7368e01a-38fa-4991-952b-e4585bc07b47 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:45.685216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:45.957473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7368e01a-38fa-4991-952b-e4585bc07b47 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:45.971720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7368e01a-38fa-4991-952b-e4585bc07b47 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:45.975065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7368e01a-38fa-4991-952b-e4585bc07b47 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:45.977426 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7368e01a-38fa-4991-952b-e4585bc07b47 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.310387 Jul 28 03:43:45.984669 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 798/1772] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:45 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:45.985560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7b2a930f-e6d9-4235-b96b-7e225b499cdf tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa742b4d30>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:46.055020 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7b2a930f-e6d9-4235-b96b-7e225b499cdf tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f" status: 200 len: 1446 microversion: 2.1 time: 0.075027 Jul 28 03:43:46.064159 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 799/1773] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:43:45 2022] GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f => generated 1446 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:46.069982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-97147095-5d78-4a87-8b20-08d2446be78b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:46.069982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-97147095-5d78-4a87-8b20-08d2446be78b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:46.077031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-97147095-5d78-4a87-8b20-08d2446be78b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:46.077757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-97147095-5d78-4a87-8b20-08d2446be78b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:46.078286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-97147095-5d78-4a87-8b20-08d2446be78b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:46.078816 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-97147095-5d78-4a87-8b20-08d2446be78b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:46.081846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:43:46.087647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:43:46.087647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:43:46.087647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:43:46.087647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:43:46.106530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:46.106978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:46.108002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:46.108470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:46.129918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:43:46.138368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:43:46.164396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:43:46.169221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:43:46.250291 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0b13bf7b-3dd7-4e62-8c8e-39a2e7023980 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942620 Jul 28 03:43:46.251179 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 975/1774] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:43:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:43:46.262901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5a3f25fa-9833-4b0b-bae0-73147229dd0c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa7404ce50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:46.298402 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-97147095-5d78-4a87-8b20-08d2446be78b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:46.307662 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-97147095-5d78-4a87-8b20-08d2446be78b tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1526 microversion: 2.1 time: 0.241998 Jul 28 03:43:46.308809 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 800/1775] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:46 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1526 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:46.314104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-199fc322-01c8-4138-b705-0efa9e837557 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:46.314964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-199fc322-01c8-4138-b705-0efa9e837557 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:46.330014 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-199fc322-01c8-4138-b705-0efa9e837557 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:46.330807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-199fc322-01c8-4138-b705-0efa9e837557 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:46.332117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-199fc322-01c8-4138-b705-0efa9e837557 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:46.333366 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-199fc322-01c8-4138-b705-0efa9e837557 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:46.339718 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5a3f25fa-9833-4b0b-bae0-73147229dd0c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f" status: 200 len: 1446 microversion: 2.1 time: 0.086775 Jul 28 03:43:46.341701 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 976/1776] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:43:46 2022] GET /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f => generated 1446 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:46.358924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0782a6f9-9c36-4f57-90ae-4e665c269ea4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:46.359545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0782a6f9-9c36-4f57-90ae-4e665c269ea4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:46.452333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0782a6f9-9c36-4f57-90ae-4e665c269ea4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:46.473376 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0782a6f9-9c36-4f57-90ae-4e665c269ea4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1217 microversion: 2.1 time: 0.129312 Jul 28 03:43:46.474410 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 977/1777] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:46 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:46.480003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3c3f92c7-67fa-4e49-a1d4-126d6a8314e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:46.481216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3c3f92c7-67fa-4e49-a1d4-126d6a8314e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:46.491706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c3f92c7-67fa-4e49-a1d4-126d6a8314e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:46.492789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c3f92c7-67fa-4e49-a1d4-126d6a8314e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:46.494295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c3f92c7-67fa-4e49-a1d4-126d6a8314e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:46.495063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c3f92c7-67fa-4e49-a1d4-126d6a8314e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:46.625351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-199fc322-01c8-4138-b705-0efa9e837557 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:46.634730 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-199fc322-01c8-4138-b705-0efa9e837557 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1318 microversion: 2.1 time: 0.323963 Jul 28 03:43:46.647581 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 801/1778] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:46 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:46.653462 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-70f557bd-a8a4-4eea-9f3b-37be435c21c9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa742c0790>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:46.718032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3c3f92c7-67fa-4e49-a1d4-126d6a8314e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:46.730640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3c3f92c7-67fa-4e49-a1d4-126d6a8314e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:46.732671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3c3f92c7-67fa-4e49-a1d4-126d6a8314e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:46.733956 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3c3f92c7-67fa-4e49-a1d4-126d6a8314e0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.258394 Jul 28 03:43:46.735096 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 978/1779] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:46 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:46.758223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-ab04c14b-b8a4-4bfd-813d-2a9ba91b0944 req-6348b890-3ac6-41e1-bb77-e044e6ce968f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7a8c953-25e1-401f-89e2-dcce0c9f414b", "name": "network-vif-plugged", "status": "completed", "tag": "9ee53927-49a5-4692-82ec-07e6f6f08ed4"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:46.775308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ab04c14b-b8a4-4bfd-813d-2a9ba91b0944 req-6348b890-3ac6-41e1-bb77-e044e6ce968f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:46.775823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ab04c14b-b8a4-4bfd-813d-2a9ba91b0944 req-6348b890-3ac6-41e1-bb77-e044e6ce968f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:46.790705 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-ab04c14b-b8a4-4bfd-813d-2a9ba91b0944 req-6348b890-3ac6-41e1-bb77-e044e6ce968f service nova] Creating event network-vif-plugged:9ee53927-49a5-4692-82ec-07e6f6f08ed4 for instance a7a8c953-25e1-401f-89e2-dcce0c9f414b on n-h1-826756-3 Jul 28 03:43:46.796334 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-ab04c14b-b8a4-4bfd-813d-2a9ba91b0944 req-6348b890-3ac6-41e1-bb77-e044e6ce968f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059880 Jul 28 03:43:46.800745 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 979/1780] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:46.806348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d6af9d0-9ffa-4884-bbe8-2c813aa83807 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:46.807220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8d6af9d0-9ffa-4884-bbe8-2c813aa83807 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:46.814510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d6af9d0-9ffa-4884-bbe8-2c813aa83807 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:46.815168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d6af9d0-9ffa-4884-bbe8-2c813aa83807 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:46.816076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d6af9d0-9ffa-4884-bbe8-2c813aa83807 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:46.816703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d6af9d0-9ffa-4884-bbe8-2c813aa83807 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:47.095037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8d6af9d0-9ffa-4884-bbe8-2c813aa83807 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:47.113212 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8d6af9d0-9ffa-4884-bbe8-2c813aa83807 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1199 microversion: 2.1 time: 0.310396 Jul 28 03:43:47.115223 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 980/1781] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:46 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1199 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:47.137031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62d02215-e21d-4b76-93e9-ccac09eb5822 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:47.138605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-62d02215-e21d-4b76-93e9-ccac09eb5822 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:47.149268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62d02215-e21d-4b76-93e9-ccac09eb5822 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:47.149975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62d02215-e21d-4b76-93e9-ccac09eb5822 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:47.151325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62d02215-e21d-4b76-93e9-ccac09eb5822 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:47.152170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62d02215-e21d-4b76-93e9-ccac09eb5822 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:47.378172 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-70f557bd-a8a4-4eea-9f3b-37be435c21c9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f" status: 204 len: 0 microversion: 2.1 time: 0.729368 Jul 28 03:43:47.378764 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 802/1782] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:46 2022] DELETE /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f => generated 0 bytes in 731 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:43:47.389113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ce246519-9a1f-4ae1-84af-75b2e2cd82ed tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:47.389962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ce246519-9a1f-4ae1-84af-75b2e2cd82ed tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:47.400892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce246519-9a1f-4ae1-84af-75b2e2cd82ed tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:47.401709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce246519-9a1f-4ae1-84af-75b2e2cd82ed tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:47.403104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce246519-9a1f-4ae1-84af-75b2e2cd82ed tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:47.403802 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce246519-9a1f-4ae1-84af-75b2e2cd82ed tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:47.427746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62d02215-e21d-4b76-93e9-ccac09eb5822 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:47.443676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62d02215-e21d-4b76-93e9-ccac09eb5822 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:47.445285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62d02215-e21d-4b76-93e9-ccac09eb5822 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:47.446476 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-62d02215-e21d-4b76-93e9-ccac09eb5822 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.329726 Jul 28 03:43:47.447045 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 981/1783] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:47 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:47.451537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62b6d3a2-e414-43cb-aa44-bc011acd71be tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:47.452024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-62b6d3a2-e414-43cb-aa44-bc011acd71be tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:47.458916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62b6d3a2-e414-43cb-aa44-bc011acd71be tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:47.459353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62b6d3a2-e414-43cb-aa44-bc011acd71be tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:47.460120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62b6d3a2-e414-43cb-aa44-bc011acd71be tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:47.460589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62b6d3a2-e414-43cb-aa44-bc011acd71be tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:47.489660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-62b6d3a2-e414-43cb-aa44-bc011acd71be tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:43:47.610240 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-62b6d3a2-e414-43cb-aa44-bc011acd71be tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 204 len: 0 microversion: 2.1 time: 0.160882 Jul 28 03:43:47.610714 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 982/1784] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:43:47 2022] DELETE /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:43:47.611586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ce246519-9a1f-4ae1-84af-75b2e2cd82ed tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:47.618285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf1c63bd-0cbc-4f96-b35c-eb7e5ef56949 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:47.619276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cf1c63bd-0cbc-4f96-b35c-eb7e5ef56949 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:47.631039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf1c63bd-0cbc-4f96-b35c-eb7e5ef56949 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:47.631849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf1c63bd-0cbc-4f96-b35c-eb7e5ef56949 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:47.633256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf1c63bd-0cbc-4f96-b35c-eb7e5ef56949 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:47.634251 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ce246519-9a1f-4ae1-84af-75b2e2cd82ed tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1526 microversion: 2.1 time: 0.253843 Jul 28 03:43:47.634380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf1c63bd-0cbc-4f96-b35c-eb7e5ef56949 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:47.635653 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 803/1785] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:47 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1526 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:47.659493 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c4de73ee-b608-440f-b3d4-65e6ded82f61 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:47.660101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c4de73ee-b608-440f-b3d4-65e6ded82f61 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:47.669406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4de73ee-b608-440f-b3d4-65e6ded82f61 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:47.669854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4de73ee-b608-440f-b3d4-65e6ded82f61 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:47.670994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4de73ee-b608-440f-b3d4-65e6ded82f61 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:47.671431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4de73ee-b608-440f-b3d4-65e6ded82f61 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:47.727574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf1c63bd-0cbc-4f96-b35c-eb7e5ef56949 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:47.741996 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf1c63bd-0cbc-4f96-b35c-eb7e5ef56949 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1221 microversion: 2.1 time: 0.129193 Jul 28 03:43:47.744324 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 983/1786] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:47 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:47.749683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1179410891", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f8adb240-7396-4ba1-87bd-7c26f1c16184"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:47.759653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:47.836736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] validate_networks() for [('f8adb240-7396-4ba1-87bd-7c26f1c16184', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:43:47.847533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c4de73ee-b608-440f-b3d4-65e6ded82f61 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:47.855809 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c4de73ee-b608-440f-b3d4-65e6ded82f61 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1318 microversion: 2.1 time: 0.200235 Jul 28 03:43:47.861608 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 804/1787] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:47 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:47.866400 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ad954541-2ea7-4e8b-b221-ba31e88cc3b7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:47.867066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ad954541-2ea7-4e8b-b221-ba31e88cc3b7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:47.873855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad954541-2ea7-4e8b-b221-ba31e88cc3b7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:47.874388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad954541-2ea7-4e8b-b221-ba31e88cc3b7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:47.875231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad954541-2ea7-4e8b-b221-ba31e88cc3b7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:47.875725 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad954541-2ea7-4e8b-b221-ba31e88cc3b7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:48.027610 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ad954541-2ea7-4e8b-b221-ba31e88cc3b7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:48.043766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ad954541-2ea7-4e8b-b221-ba31e88cc3b7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:48.047052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ad954541-2ea7-4e8b-b221-ba31e88cc3b7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:48.048792 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ad954541-2ea7-4e8b-b221-ba31e88cc3b7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.190584 Jul 28 03:43:48.049568 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 805/1788] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:47 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:48.144568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-83a4d569-9c8d-4033-946a-6e478cf96a1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:48.145314 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-83a4d569-9c8d-4033-946a-6e478cf96a1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:48.153509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83a4d569-9c8d-4033-946a-6e478cf96a1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:48.154222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83a4d569-9c8d-4033-946a-6e478cf96a1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:48.155593 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83a4d569-9c8d-4033-946a-6e478cf96a1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:48.156232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83a4d569-9c8d-4033-946a-6e478cf96a1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:48.345537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:43:48.346418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:43:48.346624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:43:48.347119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:43:48.347890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:43:48.355099 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-83a4d569-9c8d-4033-946a-6e478cf96a1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:48.368144 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-83a4d569-9c8d-4033-946a-6e478cf96a1f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1199 microversion: 2.1 time: 0.229541 Jul 28 03:43:48.372324 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 806/1789] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:48 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1199 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:43:48.374894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:48.375343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:48.376136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:48.376615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:48.396955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Getting quotas for project edc9288cef154fa28f7057f25e0e3213. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:43:48.403144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Getting quotas for user 670b269eb20c416e9f43f8d4e43ded45 and project edc9288cef154fa28f7057f25e0e3213. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:43:48.417399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:43:48.419794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:43:48.472917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bba53703-11bf-41d1-b34d-1d0891923ad0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:48.473753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bba53703-11bf-41d1-b34d-1d0891923ad0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:48.476878 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e9016a25-61cd-451c-b9e1-dec5717a60c4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730967 Jul 28 03:43:48.480871 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bba53703-11bf-41d1-b34d-1d0891923ad0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:48.482027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bba53703-11bf-41d1-b34d-1d0891923ad0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:48.483019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bba53703-11bf-41d1-b34d-1d0891923ad0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:48.483733 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bba53703-11bf-41d1-b34d-1d0891923ad0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:48.487369 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 984/1790] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:43:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:43:48.494528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1d15cf0f-8df3-4617-8c3c-7528e3c654e7 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:48.495826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1d15cf0f-8df3-4617-8c3c-7528e3c654e7 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:48.592468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1d15cf0f-8df3-4617-8c3c-7528e3c654e7 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:48.607889 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1d15cf0f-8df3-4617-8c3c-7528e3c654e7 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1208 microversion: 2.1 time: 0.118775 Jul 28 03:43:48.610053 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 985/1791] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:48 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1208 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:48.661813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-52c022b0-7858-40d7-a548-ac16e0ac0e8d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:48.662731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-52c022b0-7858-40d7-a548-ac16e0ac0e8d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:48.678290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52c022b0-7858-40d7-a548-ac16e0ac0e8d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:48.678867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52c022b0-7858-40d7-a548-ac16e0ac0e8d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:48.687102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52c022b0-7858-40d7-a548-ac16e0ac0e8d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:48.688429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52c022b0-7858-40d7-a548-ac16e0ac0e8d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:48.918530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bba53703-11bf-41d1-b34d-1d0891923ad0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:48.939738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bba53703-11bf-41d1-b34d-1d0891923ad0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:48.941918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bba53703-11bf-41d1-b34d-1d0891923ad0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:48.943775 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bba53703-11bf-41d1-b34d-1d0891923ad0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.476413 Jul 28 03:43:48.943987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-52c022b0-7858-40d7-a548-ac16e0ac0e8d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:48.945021 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 807/1792] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:48 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:43:48.950479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6e9db13d-c6b7-4501-bf92-d9bdfa86466a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:48.951374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6e9db13d-c6b7-4501-bf92-d9bdfa86466a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:48.959940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e9db13d-c6b7-4501-bf92-d9bdfa86466a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:48.960571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e9db13d-c6b7-4501-bf92-d9bdfa86466a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:48.961230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e9db13d-c6b7-4501-bf92-d9bdfa86466a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:48.961656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e9db13d-c6b7-4501-bf92-d9bdfa86466a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:48.965265 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-52c022b0-7858-40d7-a548-ac16e0ac0e8d tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1526 microversion: 2.1 time: 0.312142 Jul 28 03:43:48.971203 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 986/1793] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:48 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1526 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:43:48.983256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-84ad52b3-999e-412f-861b-a6e89bace2e7 req-844e36e1-3e98-4b1e-a2d3-b1a2ab2c4676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42fcd75-f3a9-4abb-a5fd-f8c600bbb272", "name": "network-vif-plugged", "status": "completed", "tag": "c1bcc2ac-62d4-4a34-ab01-789e5b7a9432"}, {"server_uuid": "da14893a-5718-4a91-9307-abd3ffb2c20e", "name": "network-vif-unplugged", "status": "completed", "tag": "b35fa4af-3beb-470a-8838-d64f39ee8851"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:49.004457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-84ad52b3-999e-412f-861b-a6e89bace2e7 req-844e36e1-3e98-4b1e-a2d3-b1a2ab2c4676 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:49.005207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-84ad52b3-999e-412f-861b-a6e89bace2e7 req-844e36e1-3e98-4b1e-a2d3-b1a2ab2c4676 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:49.024545 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-84ad52b3-999e-412f-861b-a6e89bace2e7 req-844e36e1-3e98-4b1e-a2d3-b1a2ab2c4676 service nova] Creating event network-vif-plugged:c1bcc2ac-62d4-4a34-ab01-789e5b7a9432 for instance c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 on n-h1-826756-3 Jul 28 03:43:49.025069 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-84ad52b3-999e-412f-861b-a6e89bace2e7 req-844e36e1-3e98-4b1e-a2d3-b1a2ab2c4676 service nova] Creating event network-vif-unplugged:b35fa4af-3beb-470a-8838-d64f39ee8851 for instance da14893a-5718-4a91-9307-abd3ffb2c20e on n-h1-826756-3 Jul 28 03:43:49.032914 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-84ad52b3-999e-412f-861b-a6e89bace2e7 req-844e36e1-3e98-4b1e-a2d3-b1a2ab2c4676 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.061783 Jul 28 03:43:49.033911 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 987/1794] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:49.039892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6640bef9-aae5-49dc-b2ab-7d9044404e2a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:49.040637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6640bef9-aae5-49dc-b2ab-7d9044404e2a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:49.051339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6640bef9-aae5-49dc-b2ab-7d9044404e2a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:49.051932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6640bef9-aae5-49dc-b2ab-7d9044404e2a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:49.052686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6640bef9-aae5-49dc-b2ab-7d9044404e2a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:49.053125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6640bef9-aae5-49dc-b2ab-7d9044404e2a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:49.058023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6e9db13d-c6b7-4501-bf92-d9bdfa86466a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:49.067326 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6e9db13d-c6b7-4501-bf92-d9bdfa86466a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1269 microversion: 2.1 time: 0.120200 Jul 28 03:43:49.083254 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 808/1795] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:48 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1269 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:49.089121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-46ecd563-9657-44bc-bf88-b20c2c03ac69 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:49.090330 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-46ecd563-9657-44bc-bf88-b20c2c03ac69 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:49.107274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46ecd563-9657-44bc-bf88-b20c2c03ac69 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:49.108683 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46ecd563-9657-44bc-bf88-b20c2c03ac69 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:49.110227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46ecd563-9657-44bc-bf88-b20c2c03ac69 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:49.111113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46ecd563-9657-44bc-bf88-b20c2c03ac69 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:49.261358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6640bef9-aae5-49dc-b2ab-7d9044404e2a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:49.272054 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6640bef9-aae5-49dc-b2ab-7d9044404e2a tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1318 microversion: 2.1 time: 0.236594 Jul 28 03:43:49.272909 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 988/1796] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:49 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:49.402732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-75c7cafd-4c29-4c2e-a09f-c850ef588133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:49.405029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-75c7cafd-4c29-4c2e-a09f-c850ef588133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:49.414297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75c7cafd-4c29-4c2e-a09f-c850ef588133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:49.414897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75c7cafd-4c29-4c2e-a09f-c850ef588133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:49.415824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75c7cafd-4c29-4c2e-a09f-c850ef588133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:49.416407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75c7cafd-4c29-4c2e-a09f-c850ef588133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:49.551134 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-46ecd563-9657-44bc-bf88-b20c2c03ac69 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:49.564320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-46ecd563-9657-44bc-bf88-b20c2c03ac69 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:49.567153 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-46ecd563-9657-44bc-bf88-b20c2c03ac69 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:49.569264 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-46ecd563-9657-44bc-bf88-b20c2c03ac69 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.484341 Jul 28 03:43:49.570557 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 809/1797] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:49 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:49.635212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-75c7cafd-4c29-4c2e-a09f-c850ef588133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:49.635862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-98363d35-b09c-4bfa-b10f-1747974c7893 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:49.638194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-98363d35-b09c-4bfa-b10f-1747974c7893 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:49.648473 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-75c7cafd-4c29-4c2e-a09f-c850ef588133 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1199 microversion: 2.1 time: 0.253160 Jul 28 03:43:49.649685 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 989/1798] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:49 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1199 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:49.664968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98363d35-b09c-4bfa-b10f-1747974c7893 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:49.667987 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98363d35-b09c-4bfa-b10f-1747974c7893 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:49.671190 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98363d35-b09c-4bfa-b10f-1747974c7893 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:49.672398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98363d35-b09c-4bfa-b10f-1747974c7893 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:49.807140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-98363d35-b09c-4bfa-b10f-1747974c7893 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:49.819503 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-98363d35-b09c-4bfa-b10f-1747974c7893 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1204 microversion: 2.1 time: 0.191021 Jul 28 03:43:49.826597 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 810/1799] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:49 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1204 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:43:49.987411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-122a6ccc-a8b6-42cf-9141-0de1bcc5a371 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:49.988728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-122a6ccc-a8b6-42cf-9141-0de1bcc5a371 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:50.001260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-122a6ccc-a8b6-42cf-9141-0de1bcc5a371 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:50.001813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-122a6ccc-a8b6-42cf-9141-0de1bcc5a371 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:50.002513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0ce0f320-d952-498f-84b7-f418cf982170 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:50.002880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-122a6ccc-a8b6-42cf-9141-0de1bcc5a371 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:50.003323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-122a6ccc-a8b6-42cf-9141-0de1bcc5a371 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:50.006157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0ce0f320-d952-498f-84b7-f418cf982170 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:50.016590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ce0f320-d952-498f-84b7-f418cf982170 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:50.017380 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ce0f320-d952-498f-84b7-f418cf982170 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:50.018360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ce0f320-d952-498f-84b7-f418cf982170 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:50.018975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ce0f320-d952-498f-84b7-f418cf982170 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:50.281080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-122a6ccc-a8b6-42cf-9141-0de1bcc5a371 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:50.300824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-122a6ccc-a8b6-42cf-9141-0de1bcc5a371 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:50.305477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-122a6ccc-a8b6-42cf-9141-0de1bcc5a371 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:50.307476 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-122a6ccc-a8b6-42cf-9141-0de1bcc5a371 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.325615 Jul 28 03:43:50.308498 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 990/1800] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:49 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:50.313578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-04caf173-d3a4-46bb-9aa6-710d1db422f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:50.315095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-04caf173-d3a4-46bb-9aa6-710d1db422f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:50.321138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04caf173-d3a4-46bb-9aa6-710d1db422f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:50.321594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04caf173-d3a4-46bb-9aa6-710d1db422f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:50.322395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04caf173-d3a4-46bb-9aa6-710d1db422f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:50.322992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04caf173-d3a4-46bb-9aa6-710d1db422f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:50.400999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-04caf173-d3a4-46bb-9aa6-710d1db422f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:50.414990 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-04caf173-d3a4-46bb-9aa6-710d1db422f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1275 microversion: 2.1 time: 0.105019 Jul 28 03:43:50.416898 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 991/1801] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:50 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1275 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:50.422201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0a7bcaa3-614a-43a5-a492-db76f46cd5e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:50.422823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0a7bcaa3-614a-43a5-a492-db76f46cd5e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:50.436200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a7bcaa3-614a-43a5-a492-db76f46cd5e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:50.436723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a7bcaa3-614a-43a5-a492-db76f46cd5e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:50.437760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a7bcaa3-614a-43a5-a492-db76f46cd5e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:50.438038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0ce0f320-d952-498f-84b7-f418cf982170 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:50.438276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a7bcaa3-614a-43a5-a492-db76f46cd5e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:50.456309 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0ce0f320-d952-498f-84b7-f418cf982170 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1526 microversion: 2.1 time: 0.462420 Jul 28 03:43:50.472735 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 811/1802] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:49 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1526 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:50.598453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7eac6adf-005d-4098-8476-ce3bba701483 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:50.599431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7eac6adf-005d-4098-8476-ce3bba701483 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:50.616175 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:50.625293 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7eac6adf-005d-4098-8476-ce3bba701483 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:50.626363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7eac6adf-005d-4098-8476-ce3bba701483 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:50.629111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7eac6adf-005d-4098-8476-ce3bba701483 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:50.629776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7eac6adf-005d-4098-8476-ce3bba701483 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:50.711793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:50.770682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0a7bcaa3-614a-43a5-a492-db76f46cd5e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:50.788613 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0a7bcaa3-614a-43a5-a492-db76f46cd5e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1507 microversion: 2.1 time: 0.369798 Jul 28 03:43:50.790270 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 992/1803] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:50 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1507 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:50.798688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a566e96a-ee85-49d3-8f51-bbf8291f3171 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:50.803072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a566e96a-ee85-49d3-8f51-bbf8291f3171 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:50.835305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a566e96a-ee85-49d3-8f51-bbf8291f3171 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:50.839897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a566e96a-ee85-49d3-8f51-bbf8291f3171 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:50.844050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a566e96a-ee85-49d3-8f51-bbf8291f3171 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:50.845750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a566e96a-ee85-49d3-8f51-bbf8291f3171 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:50.993629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:51.306271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7eac6adf-005d-4098-8476-ce3bba701483 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:51.313286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a566e96a-ee85-49d3-8f51-bbf8291f3171 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:51.327802 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7eac6adf-005d-4098-8476-ce3bba701483 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:51.329536 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7eac6adf-005d-4098-8476-ce3bba701483 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:51.332860 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7eac6adf-005d-4098-8476-ce3bba701483 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.738003 Jul 28 03:43:51.333048 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a566e96a-ee85-49d3-8f51-bbf8291f3171 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1199 microversion: 2.1 time: 0.537338 Jul 28 03:43:51.333836 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 812/1804] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:50 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:43:51.335324 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 993/1805] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:50 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1199 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:51.349279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-4a9a5ab3-a70b-4d17-aa66-3c8b3cd5aab7 req-3b39c745-c289-4bb4-a2cb-bca9c99873ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "623a67cb-d39e-4de8-877f-a81af9613a10", "name": "network-vif-deleted", "tag": "62f765ff-c7d8-4877-9576-bc720cc3f64f"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:51.355045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5aaac4a0-a1f3-43a8-9703-c121bcb812f6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:51.357617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5aaac4a0-a1f3-43a8-9703-c121bcb812f6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:51.368123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4a9a5ab3-a70b-4d17-aa66-3c8b3cd5aab7 req-3b39c745-c289-4bb4-a2cb-bca9c99873ff service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:51.369845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4a9a5ab3-a70b-4d17-aa66-3c8b3cd5aab7 req-3b39c745-c289-4bb4-a2cb-bca9c99873ff service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:51.384871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5aaac4a0-a1f3-43a8-9703-c121bcb812f6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:51.387256 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-4a9a5ab3-a70b-4d17-aa66-3c8b3cd5aab7 req-3b39c745-c289-4bb4-a2cb-bca9c99873ff service nova] Creating event network-vif-deleted:62f765ff-c7d8-4877-9576-bc720cc3f64f for instance 623a67cb-d39e-4de8-877f-a81af9613a10 on n-h2-826756-3 Jul 28 03:43:51.390138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5aaac4a0-a1f3-43a8-9703-c121bcb812f6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:51.393414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5aaac4a0-a1f3-43a8-9703-c121bcb812f6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:51.395153 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-4a9a5ab3-a70b-4d17-aa66-3c8b3cd5aab7 req-3b39c745-c289-4bb4-a2cb-bca9c99873ff service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059870 Jul 28 03:43:51.395776 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 813/1806] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:51.396327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5aaac4a0-a1f3-43a8-9703-c121bcb812f6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:51.402201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-431b004b-8804-48f6-ba2f-a16bd038e5ad tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:51.403406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-431b004b-8804-48f6-ba2f-a16bd038e5ad tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:51.413555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-431b004b-8804-48f6-ba2f-a16bd038e5ad tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:51.414562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-431b004b-8804-48f6-ba2f-a16bd038e5ad tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:51.415717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-431b004b-8804-48f6-ba2f-a16bd038e5ad tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:51.416854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-431b004b-8804-48f6-ba2f-a16bd038e5ad tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:51.558180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5aaac4a0-a1f3-43a8-9703-c121bcb812f6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:51.574174 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5aaac4a0-a1f3-43a8-9703-c121bcb812f6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1266 microversion: 2.1 time: 0.236556 Jul 28 03:43:51.575401 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 994/1807] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:51 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:51.594058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06a6c196-9910-4083-bf46-9954c13f997c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:51.597427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-06a6c196-9910-4083-bf46-9954c13f997c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:51.616612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06a6c196-9910-4083-bf46-9954c13f997c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:51.621699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06a6c196-9910-4083-bf46-9954c13f997c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:51.623771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06a6c196-9910-4083-bf46-9954c13f997c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:51.624507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06a6c196-9910-4083-bf46-9954c13f997c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:51.798601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-06a6c196-9910-4083-bf46-9954c13f997c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:51.815146 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-06a6c196-9910-4083-bf46-9954c13f997c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1275 microversion: 2.1 time: 0.237297 Jul 28 03:43:51.815764 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 995/1808] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:51 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1275 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:51.821749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c41edc16-1d20-401d-b468-c157440c5bd8 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:51.822368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c41edc16-1d20-401d-b468-c157440c5bd8 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:51.845919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c41edc16-1d20-401d-b468-c157440c5bd8 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:51.846461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c41edc16-1d20-401d-b468-c157440c5bd8 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:51.848484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c41edc16-1d20-401d-b468-c157440c5bd8 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:51.848923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c41edc16-1d20-401d-b468-c157440c5bd8 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:51.918548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c41edc16-1d20-401d-b468-c157440c5bd8 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:51.919004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c41edc16-1d20-401d-b468-c157440c5bd8 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:51.919481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-c41edc16-1d20-401d-b468-c157440c5bd8 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lazy-loading 'fault' on Instance uuid 623a67cb-d39e-4de8-877f-a81af9613a10 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:43:52.065960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c41edc16-1d20-401d-b468-c157440c5bd8 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da34b0ac72d94d2fbd00ea09d805f0fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7680ec7bd44a62be5017f043d4613b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:52.085929 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c41edc16-1d20-401d-b468-c157440c5bd8 tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 200 len: 1314 microversion: 2.1 time: 0.268666 Jul 28 03:43:52.086862 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 996/1809] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:51 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:52.099576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-431b004b-8804-48f6-ba2f-a16bd038e5ad tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:52.135075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-431b004b-8804-48f6-ba2f-a16bd038e5ad tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:52.138632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-431b004b-8804-48f6-ba2f-a16bd038e5ad tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:52.141483 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-431b004b-8804-48f6-ba2f-a16bd038e5ad tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.743509 Jul 28 03:43:52.143414 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 814/1810] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:51 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:52.360743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-201d75f2-fb0a-4cc4-92bc-8c9b740e2c06 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:52.361694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-201d75f2-fb0a-4cc4-92bc-8c9b740e2c06 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:52.377035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bc0e698d-c90c-445d-9fb7-2ce38d00a850 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:52.378063 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bc0e698d-c90c-445d-9fb7-2ce38d00a850 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:52.394150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-201d75f2-fb0a-4cc4-92bc-8c9b740e2c06 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:52.394737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-201d75f2-fb0a-4cc4-92bc-8c9b740e2c06 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:52.397518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-201d75f2-fb0a-4cc4-92bc-8c9b740e2c06 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:52.397811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc0e698d-c90c-445d-9fb7-2ce38d00a850 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:52.398266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc0e698d-c90c-445d-9fb7-2ce38d00a850 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:52.399260 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc0e698d-c90c-445d-9fb7-2ce38d00a850 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:52.399877 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc0e698d-c90c-445d-9fb7-2ce38d00a850 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:52.404155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-201d75f2-fb0a-4cc4-92bc-8c9b740e2c06 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:52.980768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-201d75f2-fb0a-4cc4-92bc-8c9b740e2c06 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:52.993707 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-201d75f2-fb0a-4cc4-92bc-8c9b740e2c06 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1199 microversion: 2.1 time: 0.639841 Jul 28 03:43:53.011136 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 997/1811] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:52 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1199 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:53.016915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b979ff5-0040-4962-a149-a75d1b2fe56a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:53.017970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b979ff5-0040-4962-a149-a75d1b2fe56a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:53.059918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b979ff5-0040-4962-a149-a75d1b2fe56a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:53.062256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b979ff5-0040-4962-a149-a75d1b2fe56a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:53.068189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b979ff5-0040-4962-a149-a75d1b2fe56a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:53.078038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b979ff5-0040-4962-a149-a75d1b2fe56a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:53.238811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7b979ff5-0040-4962-a149-a75d1b2fe56a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:53.253088 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b979ff5-0040-4962-a149-a75d1b2fe56a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1266 microversion: 2.1 time: 0.239578 Jul 28 03:43:53.254875 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 998/1812] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:53 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:53.266616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa87caa4-105f-41d0-8896-8c1047276e29 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:53.268502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fa87caa4-105f-41d0-8896-8c1047276e29 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:53.277907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa87caa4-105f-41d0-8896-8c1047276e29 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:53.278459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa87caa4-105f-41d0-8896-8c1047276e29 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:53.279634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa87caa4-105f-41d0-8896-8c1047276e29 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:53.280225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa87caa4-105f-41d0-8896-8c1047276e29 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:53.423297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bc0e698d-c90c-445d-9fb7-2ce38d00a850 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:53.442638 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bc0e698d-c90c-445d-9fb7-2ce38d00a850 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:53.450322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bc0e698d-c90c-445d-9fb7-2ce38d00a850 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:53.450322 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bc0e698d-c90c-445d-9fb7-2ce38d00a850 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 1.076293 Jul 28 03:43:53.461274 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 815/1813] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:52 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:53.466867 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-ff234805-73a9-4ba3-9175-3aea72328dd9 req-b1c81463-c32a-44ee-a53b-762397565d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da14893a-5718-4a91-9307-abd3ffb2c20e", "name": "network-vif-deleted", "tag": "b35fa4af-3beb-470a-8838-d64f39ee8851"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:53.480017 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-ff234805-73a9-4ba3-9175-3aea72328dd9 req-b1c81463-c32a-44ee-a53b-762397565d2d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:53.480504 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-ff234805-73a9-4ba3-9175-3aea72328dd9 req-b1c81463-c32a-44ee-a53b-762397565d2d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:53.496378 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-ff234805-73a9-4ba3-9175-3aea72328dd9 req-b1c81463-c32a-44ee-a53b-762397565d2d service nova] Creating event network-vif-deleted:b35fa4af-3beb-470a-8838-d64f39ee8851 for instance da14893a-5718-4a91-9307-abd3ffb2c20e on n-h1-826756-3 Jul 28 03:43:53.505048 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-ff234805-73a9-4ba3-9175-3aea72328dd9 req-b1c81463-c32a-44ee-a53b-762397565d2d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041291 Jul 28 03:43:53.506016 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 816/1814] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:53.512575 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bb1f6edf-1f66-4b8c-abe3-1cb1931ffece tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:53.513747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bb1f6edf-1f66-4b8c-abe3-1cb1931ffece tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] [instance: 623a67cb-d39e-4de8-877f-a81af9613a10] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:53.526524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb1f6edf-1f66-4b8c-abe3-1cb1931ffece tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:53.527605 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb1f6edf-1f66-4b8c-abe3-1cb1931ffece tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:53.528458 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb1f6edf-1f66-4b8c-abe3-1cb1931ffece tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:53.528900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb1f6edf-1f66-4b8c-abe3-1cb1931ffece tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:53.529610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa87caa4-105f-41d0-8896-8c1047276e29 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:53.544103 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fa87caa4-105f-41d0-8896-8c1047276e29 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.286533 Jul 28 03:43:53.547444 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 999/1815] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:53 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:53.557105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ff0e986d-0b40-4dc6-91f8-aae3a6e4201b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:53.558696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ff0e986d-0b40-4dc6-91f8-aae3a6e4201b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:53.562803 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-bb1f6edf-1f66-4b8c-abe3-1cb1931ffece tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] HTTP exception thrown: Instance 623a67cb-d39e-4de8-877f-a81af9613a10 could not be found. Jul 28 03:43:53.568230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff0e986d-0b40-4dc6-91f8-aae3a6e4201b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bb1f6edf-1f66-4b8c-abe3-1cb1931ffece tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Request method failure captured: Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 HTTP/1.1 Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gWDHIHQ6EQNV2zwdmq-zma3EKvgOGr_5V48VrtYy3PaIoJyY5tDaF2P6paJV8XP0iJtiy1rT7KTsS3OMNKul2WqIKH7VjMg4gY0QssEkVNelRhLpfFV0dqwHx5IRBV_-d2c0EdVOI0RgswRjgGzLIXF7Qvcrbqb2NqvhPXbRklxm3c Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 9f7680ec7bd44a62be5017f043d4613b Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1472308666 Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9f7680ec7bd44a62be5017f043d4613b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f7680ec7bd44a62be5017f043d4613b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9f7680ec7bd44a62be5017f043d4613b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f7680ec7bd44a62be5017f043d4613b"}]}] Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1472308666 Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 9f7680ec7bd44a62be5017f043d4613b Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1472308666 Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-FloatingIPsAssociationTestJSON-1472308666-project Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: da34b0ac72d94d2fbd00ea09d805f0fe Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1472308666-project Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 623a67cb-d39e-4de8-877f-a81af9613a10 could not be found. Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '623a67cb-d39e-4de8-877f-a81af9613a10'} Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 623a67cb-d39e-4de8-877f-a81af9613a10 could not be found. Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 623a67cb-d39e-4de8-877f-a81af9613a10 could not be found. Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:53.568522 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:43:53.575942 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:53.575942 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:53.575942 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:43:53.575942 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:43:53.575942 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:43:53.575942 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:43:53.575942 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 623a67cb-d39e-4de8-877f-a81af9613a10 could not be found. Jul 28 03:43:53.575942 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:53.575942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bb1f6edf-1f66-4b8c-abe3-1cb1931ffece tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] Returning 404 to user: Instance 623a67cb-d39e-4de8-877f-a81af9613a10 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:43:53.575942 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bb1f6edf-1f66-4b8c-abe3-1cb1931ffece tempest-FloatingIPsAssociationTestJSON-1472308666 tempest-FloatingIPsAssociationTestJSON-1472308666-project] 10.222.0.48 "GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10" status: 404 len: 111 microversion: 2.1 time: 0.063103 Jul 28 03:43:53.575942 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 817/1816] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:53 2022] GET /compute/v2.1/servers/623a67cb-d39e-4de8-877f-a81af9613a10 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:43:53.577338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff0e986d-0b40-4dc6-91f8-aae3a6e4201b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:53.578585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff0e986d-0b40-4dc6-91f8-aae3a6e4201b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:53.579368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff0e986d-0b40-4dc6-91f8-aae3a6e4201b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:53.745920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-10fd0817-f9fb-4fdc-9486-3a8436e360b3 tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d1dc1e1a-cb6c-4ebc-b4b2-c4c21aa18e7a"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:53.748529 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-10fd0817-f9fb-4fdc-9486-3a8436e360b3 tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:53.757218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-10fd0817-f9fb-4fdc-9486-3a8436e360b3 tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:53.757850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-10fd0817-f9fb-4fdc-9486-3a8436e360b3 tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:53.758638 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-10fd0817-f9fb-4fdc-9486-3a8436e360b3 tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:53.759080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-10fd0817-f9fb-4fdc-9486-3a8436e360b3 tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:53.826344 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-10fd0817-f9fb-4fdc-9486-3a8436e360b3 tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] HTTP exception thrown: Volume 64360b28-aec8-4c52-9a7d-9a8c2cc90137 could not be found. Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-10fd0817-f9fb-4fdc-9486-3a8436e360b3 tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] Request method failure captured: Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: request: PUT /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b/os-volume_attachments/64360b28-aec8-4c52-9a7d-9a8c2cc90137 HTTP/1.1 Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 74 Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gVEk94cKAdQJcBvPKlp65gO5VTtM0Bqxbkg8dLLHdBRJX7WNwWAEk2keAbKTVY5m-1Hhkra8ikHFSPYvNeZ6VSsRa1YTWiKpz_-OnV5nQlbehL6FInYbTPYt8RCeXLM8Nr1e6qnLl-dgASwrbFVbmSuNP4PdS-qMn2dTsc6RwASlEE Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 1830a5613d144c1487632d8e5ee33270 Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-VolumesAdminNegativeTest-1571278621 Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1830a5613d144c1487632d8e5ee33270"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1830a5613d144c1487632d8e5ee33270"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1830a5613d144c1487632d8e5ee33270"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1830a5613d144c1487632d8e5ee33270"}]}] Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-VolumesAdminNegativeTest-1571278621 Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 1830a5613d144c1487632d8e5ee33270 Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1571278621 Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-VolumesAdminNegativeTest-1571278621-project-admin Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 1ad769dff3424340ba4a8a0999263155 Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-VolumesAdminNegativeTest-1571278621-project-admin Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: {"volumeAttachment": {"volumeId": "d1dc1e1a-cb6c-4ebc-b4b2-c4c21aa18e7a"}} Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: exception: Volume 64360b28-aec8-4c52-9a7d-9a8c2cc90137 could not be found. Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'server_id': 'a7a8c953-25e1-401f-89e2-dcce0c9f414b', 'id': '64360b28-aec8-4c52-9a7d-9a8c2cc90137', 'body': {'volumeAttachment': {'volumeId': 'd1dc1e1a-cb6c-4ebc-b4b2-c4c21aa18e7a'}}} Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64360b28-aec8-4c52-9a7d-9a8c2cc90137 could not be found. (HTTP 404) (Request-ID: req-a1be4c31-ca79-46d2-8013-68367e55c40a) Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:43:53.832080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64360b28-aec8-4c52-9a7d-9a8c2cc90137 could not be found. Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64360b28-aec8-4c52-9a7d-9a8c2cc90137 could not be found. Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64360b28-aec8-4c52-9a7d-9a8c2cc90137 could not be found. Jul 28 03:43:53.845356 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:43:53.859934 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-10fd0817-f9fb-4fdc-9486-3a8436e360b3 tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] Returning 404 to user: Volume 64360b28-aec8-4c52-9a7d-9a8c2cc90137 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:43:53.861575 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-10fd0817-f9fb-4fdc-9486-3a8436e360b3 tempest-VolumesAdminNegativeTest-1571278621 tempest-VolumesAdminNegativeTest-1571278621-project-admin] 10.222.0.48 "PUT /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b/os-volume_attachments/64360b28-aec8-4c52-9a7d-9a8c2cc90137" status: 404 len: 109 microversion: 2.1 time: 0.119059 Jul 28 03:43:53.871901 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 818/1817] 10.222.0.48 () {60 vars in 1433 bytes} [Thu Jul 28 03:43:53 2022] PUT /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b/os-volume_attachments/64360b28-aec8-4c52-9a7d-9a8c2cc90137 => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:43:53.990365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ff0e986d-0b40-4dc6-91f8-aae3a6e4201b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:54.009708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ff0e986d-0b40-4dc6-91f8-aae3a6e4201b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:54.014579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ff0e986d-0b40-4dc6-91f8-aae3a6e4201b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:54.020834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aa9279d0-6ef0-406f-815f-4cff22e774de tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:54.021446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-aa9279d0-6ef0-406f-815f-4cff22e774de tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:54.032718 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa9279d0-6ef0-406f-815f-4cff22e774de tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:54.033416 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa9279d0-6ef0-406f-815f-4cff22e774de tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:54.037625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa9279d0-6ef0-406f-815f-4cff22e774de tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:54.038508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa9279d0-6ef0-406f-815f-4cff22e774de tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:54.039475 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ff0e986d-0b40-4dc6-91f8-aae3a6e4201b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.480520 Jul 28 03:43:54.046761 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1000/1818] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:53 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:54.067393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:54.279971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a056c06-6988-4c33-b13d-d0fc09ed9c96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:54.280819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9a056c06-6988-4c33-b13d-d0fc09ed9c96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:54.295200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a056c06-6988-4c33-b13d-d0fc09ed9c96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:54.295941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a056c06-6988-4c33-b13d-d0fc09ed9c96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:54.297475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a056c06-6988-4c33-b13d-d0fc09ed9c96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:54.298488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a056c06-6988-4c33-b13d-d0fc09ed9c96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:54.544296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-aa9279d0-6ef0-406f-815f-4cff22e774de tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:54.563647 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aa9279d0-6ef0-406f-815f-4cff22e774de tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1382 microversion: 2.1 time: 0.546765 Jul 28 03:43:54.564933 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 819/1819] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:54 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1382 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:43:54.570544 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-c6ecbeca-69cb-43ae-93b4-30719a0b8d63 req-916e485e-71c7-4d63-9e83-ec2f624955b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38bded12-c7e6-4c2b-bf28-bcf754421d2d", "name": "network-vif-unplugged", "status": "completed", "tag": "5e081790-bc24-4310-a3b5-8481a01f8989"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:54.610037 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c6ecbeca-69cb-43ae-93b4-30719a0b8d63 req-916e485e-71c7-4d63-9e83-ec2f624955b4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:54.612063 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c6ecbeca-69cb-43ae-93b4-30719a0b8d63 req-916e485e-71c7-4d63-9e83-ec2f624955b4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:54.644602 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-c6ecbeca-69cb-43ae-93b4-30719a0b8d63 req-916e485e-71c7-4d63-9e83-ec2f624955b4 service nova] Creating event network-vif-unplugged:5e081790-bc24-4310-a3b5-8481a01f8989 for instance 38bded12-c7e6-4c2b-bf28-bcf754421d2d on n-h2-826756-3 Jul 28 03:43:54.665675 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-c6ecbeca-69cb-43ae-93b4-30719a0b8d63 req-916e485e-71c7-4d63-9e83-ec2f624955b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094008 Jul 28 03:43:54.666614 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 820/1820] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:54.679932 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-649d7b65-0ff7-40fe-91b6-f8a01027f4d7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:54.681756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-649d7b65-0ff7-40fe-91b6-f8a01027f4d7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:54.697227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-649d7b65-0ff7-40fe-91b6-f8a01027f4d7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:54.698095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-649d7b65-0ff7-40fe-91b6-f8a01027f4d7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:54.701831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-649d7b65-0ff7-40fe-91b6-f8a01027f4d7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:54.702416 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-649d7b65-0ff7-40fe-91b6-f8a01027f4d7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:54.819731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9a056c06-6988-4c33-b13d-d0fc09ed9c96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:54.850753 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9a056c06-6988-4c33-b13d-d0fc09ed9c96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.577293 Jul 28 03:43:54.864532 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1001/1821] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:54 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:54.890099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c7464487-8cc4-45e6-ab90-43c770baf395 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:54.890981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c7464487-8cc4-45e6-ab90-43c770baf395 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:54.912889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7464487-8cc4-45e6-ab90-43c770baf395 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:54.913697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7464487-8cc4-45e6-ab90-43c770baf395 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:54.917695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7464487-8cc4-45e6-ab90-43c770baf395 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:54.920556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7464487-8cc4-45e6-ab90-43c770baf395 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:55.381286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c7464487-8cc4-45e6-ab90-43c770baf395 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:55.401558 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c7464487-8cc4-45e6-ab90-43c770baf395 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.529969 Jul 28 03:43:55.402184 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1002/1822] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:54 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:55.631185 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-649d7b65-0ff7-40fe-91b6-f8a01027f4d7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:55.679808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-649d7b65-0ff7-40fe-91b6-f8a01027f4d7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:55.686117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-649d7b65-0ff7-40fe-91b6-f8a01027f4d7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:55.689643 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-649d7b65-0ff7-40fe-91b6-f8a01027f4d7 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 1.021080 Jul 28 03:43:55.692124 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 821/1823] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:54 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:55.703231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ad5ab4bc-1fe7-4fb9-9853-fb52a5c2155e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:55.705013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ad5ab4bc-1fe7-4fb9-9853-fb52a5c2155e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:55.716865 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad5ab4bc-1fe7-4fb9-9853-fb52a5c2155e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:55.718470 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad5ab4bc-1fe7-4fb9-9853-fb52a5c2155e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:55.720913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad5ab4bc-1fe7-4fb9-9853-fb52a5c2155e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:55.722342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad5ab4bc-1fe7-4fb9-9853-fb52a5c2155e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:55.744845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d766b538-44a2-422f-a461-fe1ea593de22 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:55.745466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d766b538-44a2-422f-a461-fe1ea593de22 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:55.758852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d766b538-44a2-422f-a461-fe1ea593de22 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:55.759187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d766b538-44a2-422f-a461-fe1ea593de22 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:55.760556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d766b538-44a2-422f-a461-fe1ea593de22 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:55.761003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d766b538-44a2-422f-a461-fe1ea593de22 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:56.210493 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d766b538-44a2-422f-a461-fe1ea593de22 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1533 microversion: 2.1 time: 0.790840 Jul 28 03:43:56.213439 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1003/1824] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:55 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1533 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:56.225801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1f5c4525-5613-4f32-bcd8-ccbfb36fc937 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:56.227290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1f5c4525-5613-4f32-bcd8-ccbfb36fc937 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:56.242393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f5c4525-5613-4f32-bcd8-ccbfb36fc937 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:56.243175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f5c4525-5613-4f32-bcd8-ccbfb36fc937 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:56.245134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f5c4525-5613-4f32-bcd8-ccbfb36fc937 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:56.248048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f5c4525-5613-4f32-bcd8-ccbfb36fc937 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:56.578547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ad5ab4bc-1fe7-4fb9-9853-fb52a5c2155e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:56.622586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ad5ab4bc-1fe7-4fb9-9853-fb52a5c2155e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:56.633776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ad5ab4bc-1fe7-4fb9-9853-fb52a5c2155e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:56.636959 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ad5ab4bc-1fe7-4fb9-9853-fb52a5c2155e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.942265 Jul 28 03:43:56.638838 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 822/1825] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:55 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:56.698848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dcd77b7c-343b-461f-942a-9d1c03ebb228 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:56.699911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dcd77b7c-343b-461f-942a-9d1c03ebb228 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:56.739476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dcd77b7c-343b-461f-942a-9d1c03ebb228 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:56.746466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dcd77b7c-343b-461f-942a-9d1c03ebb228 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:56.748170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dcd77b7c-343b-461f-942a-9d1c03ebb228 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:56.748664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dcd77b7c-343b-461f-942a-9d1c03ebb228 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:56.789582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1f5c4525-5613-4f32-bcd8-ccbfb36fc937 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:56.821036 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1f5c4525-5613-4f32-bcd8-ccbfb36fc937 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.599741 Jul 28 03:43:56.825358 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1004/1826] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:56 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:56.834830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4d46735-fe55-4099-bbc3-e3e2ee2e6d76 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:56.836379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e4d46735-fe55-4099-bbc3-e3e2ee2e6d76 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:56.879486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4d46735-fe55-4099-bbc3-e3e2ee2e6d76 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:56.880154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4d46735-fe55-4099-bbc3-e3e2ee2e6d76 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:56.882139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4d46735-fe55-4099-bbc3-e3e2ee2e6d76 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:56.885971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4d46735-fe55-4099-bbc3-e3e2ee2e6d76 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:57.309888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e4d46735-fe55-4099-bbc3-e3e2ee2e6d76 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:57.331207 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e4d46735-fe55-4099-bbc3-e3e2ee2e6d76 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.502689 Jul 28 03:43:57.336302 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1005/1827] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:56 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:57.345459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b827076e-42dc-4171-a025-0c70bde1fd2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:57.346739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b827076e-42dc-4171-a025-0c70bde1fd2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:57.361437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b827076e-42dc-4171-a025-0c70bde1fd2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:57.362016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b827076e-42dc-4171-a025-0c70bde1fd2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:57.362875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b827076e-42dc-4171-a025-0c70bde1fd2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:57.365331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b827076e-42dc-4171-a025-0c70bde1fd2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:57.403488 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dcd77b7c-343b-461f-942a-9d1c03ebb228 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1533 microversion: 2.1 time: 0.718023 Jul 28 03:43:57.404627 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 823/1828] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:56 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1533 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:57.411201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-02054a02-65cb-4b71-a8c1-a472a9c64ed5 req-d2df811c-7975-4d22-ae18-1e6ad5bb85ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13887dd8-a0f8-4555-bc49-9d459ec1638d", "tag": "5ecc8b82-95a8-4fcb-8d59-54f537783af7"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:57.425108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-02054a02-65cb-4b71-a8c1-a472a9c64ed5 req-d2df811c-7975-4d22-ae18-1e6ad5bb85ff service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:57.426707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-02054a02-65cb-4b71-a8c1-a472a9c64ed5 req-d2df811c-7975-4d22-ae18-1e6ad5bb85ff service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:57.454932 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-02054a02-65cb-4b71-a8c1-a472a9c64ed5 req-d2df811c-7975-4d22-ae18-1e6ad5bb85ff service nova] Creating event network-changed:5ecc8b82-95a8-4fcb-8d59-54f537783af7 for instance 13887dd8-a0f8-4555-bc49-9d459ec1638d on n-h2-826756-3 Jul 28 03:43:57.465775 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-02054a02-65cb-4b71-a8c1-a472a9c64ed5 req-d2df811c-7975-4d22-ae18-1e6ad5bb85ff service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059308 Jul 28 03:43:57.466890 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 824/1829] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:57.473233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5be0bcda-f011-4c59-b12c-80470e2d06ae tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:57.476589 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:43:57.476589 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:43:57.479078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5be0bcda-f011-4c59-b12c-80470e2d06ae tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:57.479795 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5be0bcda-f011-4c59-b12c-80470e2d06ae tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:57.481478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5be0bcda-f011-4c59-b12c-80470e2d06ae tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:57.482456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5be0bcda-f011-4c59-b12c-80470e2d06ae tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:57.526594 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5be0bcda-f011-4c59-b12c-80470e2d06ae tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.057820 Jul 28 03:43:57.527566 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 825/1830] 10.222.0.48 () {58 vars in 1176 bytes} [Thu Jul 28 03:43:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:43:57.556830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3608d228-65eb-4c02-9287-3a4463d54c72 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-826756-3", "block_migration": false, "disk_over_commit": false}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:43:57.572145 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3608d228-65eb-4c02-9287-3a4463d54c72 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:57.592447 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3608d228-65eb-4c02-9287-3a4463d54c72 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:57.593171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3608d228-65eb-4c02-9287-3a4463d54c72 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:57.597639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3608d228-65eb-4c02-9287-3a4463d54c72 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:57.598792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3608d228-65eb-4c02-9287-3a4463d54c72 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:57.674732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-3608d228-65eb-4c02-9287-3a4463d54c72 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lazy-loading 'flavor' on Instance uuid c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:43:57.705951 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3608d228-65eb-4c02-9287-3a4463d54c72 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Going to try to live migrate instance to n-h2-826756-3 {{(pid=126072) live_migrate /opt/stack/nova/nova/compute/api.py:5474}} Jul 28 03:43:57.964760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b827076e-42dc-4171-a025-0c70bde1fd2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:58.017385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b827076e-42dc-4171-a025-0c70bde1fd2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:58.030935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b827076e-42dc-4171-a025-0c70bde1fd2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:58.033471 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b827076e-42dc-4171-a025-0c70bde1fd2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.695612 Jul 28 03:43:58.054535 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1006/1831] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:57 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:58.085699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2e649c21-fd64-48d9-a0b9-34d3d79e7713 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:58.086341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2e649c21-fd64-48d9-a0b9-34d3d79e7713 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:58.107771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e649c21-fd64-48d9-a0b9-34d3d79e7713 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:58.109843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e649c21-fd64-48d9-a0b9-34d3d79e7713 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:58.111005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e649c21-fd64-48d9-a0b9-34d3d79e7713 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:58.115109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e649c21-fd64-48d9-a0b9-34d3d79e7713 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:58.386115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:58.599397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=16 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:43:59.427821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2e649c21-fd64-48d9-a0b9-34d3d79e7713 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:59.447436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2e649c21-fd64-48d9-a0b9-34d3d79e7713 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:59.453948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2e649c21-fd64-48d9-a0b9-34d3d79e7713 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:59.456388 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2e649c21-fd64-48d9-a0b9-34d3d79e7713 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 1.400256 Jul 28 03:43:59.459827 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1007/1832] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:43:58 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:43:59.471754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-21d88aef-d6a6-46a2-ba6a-bcf2c60e8fd0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:59.472840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-21d88aef-d6a6-46a2-ba6a-bcf2c60e8fd0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:59.483468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21d88aef-d6a6-46a2-ba6a-bcf2c60e8fd0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:59.484715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21d88aef-d6a6-46a2-ba6a-bcf2c60e8fd0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:59.486517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21d88aef-d6a6-46a2-ba6a-bcf2c60e8fd0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:59.487638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21d88aef-d6a6-46a2-ba6a-bcf2c60e8fd0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:59.844805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-21d88aef-d6a6-46a2-ba6a-bcf2c60e8fd0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:43:59.860148 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-21d88aef-d6a6-46a2-ba6a-bcf2c60e8fd0 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.398459 Jul 28 03:43:59.861192 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1008/1833] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:59 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:43:59.887593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4c4efed-d420-4232-a506-32ec3d9cecae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:43:59.888776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4c4efed-d420-4232-a506-32ec3d9cecae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:43:59.909824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c4efed-d420-4232-a506-32ec3d9cecae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:59.915060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c4efed-d420-4232-a506-32ec3d9cecae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:59.916502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c4efed-d420-4232-a506-32ec3d9cecae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:43:59.917235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c4efed-d420-4232-a506-32ec3d9cecae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:43:59.953758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:00.259578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a4c4efed-d420-4232-a506-32ec3d9cecae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:00.280142 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4c4efed-d420-4232-a506-32ec3d9cecae tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.416920 Jul 28 03:44:00.281930 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1009/1834] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:43:59 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:00.304868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b40dc84b-75cc-475b-b94b-0a278e64ccf9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:00.306950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b40dc84b-75cc-475b-b94b-0a278e64ccf9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:00.329008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b40dc84b-75cc-475b-b94b-0a278e64ccf9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:00.330689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b40dc84b-75cc-475b-b94b-0a278e64ccf9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:00.332061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b40dc84b-75cc-475b-b94b-0a278e64ccf9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:00.333351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b40dc84b-75cc-475b-b94b-0a278e64ccf9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:00.913557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b40dc84b-75cc-475b-b94b-0a278e64ccf9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:00.926900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b40dc84b-75cc-475b-b94b-0a278e64ccf9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:00.936906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b40dc84b-75cc-475b-b94b-0a278e64ccf9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:00.943015 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b40dc84b-75cc-475b-b94b-0a278e64ccf9 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.658899 Jul 28 03:44:00.944581 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1010/1835] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:00 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:00.971640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-aff76ac5-1cc3-475f-8a9d-c5849658ea32 req-ed527133-cacc-499e-965e-4a7007d7c848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38bded12-c7e6-4c2b-bf28-bcf754421d2d", "tag": "5e081790-bc24-4310-a3b5-8481a01f8989"}, {"name": "network-changed", "server_uuid": "2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f", "tag": "c8fa4d49-4763-4f59-8a0d-2644a14e4d87"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:01.070320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-aff76ac5-1cc3-475f-8a9d-c5849658ea32 req-ed527133-cacc-499e-965e-4a7007d7c848 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:01.072995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-aff76ac5-1cc3-475f-8a9d-c5849658ea32 req-ed527133-cacc-499e-965e-4a7007d7c848 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:01.100201 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-aff76ac5-1cc3-475f-8a9d-c5849658ea32 req-ed527133-cacc-499e-965e-4a7007d7c848 service nova] Creating event network-changed:5e081790-bc24-4310-a3b5-8481a01f8989 for instance 38bded12-c7e6-4c2b-bf28-bcf754421d2d on n-h2-826756-3 Jul 28 03:44:01.101101 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-aff76ac5-1cc3-475f-8a9d-c5849658ea32 req-ed527133-cacc-499e-965e-4a7007d7c848 service nova] Creating event network-changed:c8fa4d49-4763-4f59-8a0d-2644a14e4d87 for instance 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f on n-h2-826756-3 Jul 28 03:44:01.110715 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-aff76ac5-1cc3-475f-8a9d-c5849658ea32 req-ed527133-cacc-499e-965e-4a7007d7c848 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.163909 Jul 28 03:44:01.112035 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1011/1836] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:01.119998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7eb6ef94-bc67-4f66-9ea4-bb1138e1794d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:01.121009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7eb6ef94-bc67-4f66-9ea4-bb1138e1794d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:01.129668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7eb6ef94-bc67-4f66-9ea4-bb1138e1794d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:01.130795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7eb6ef94-bc67-4f66-9ea4-bb1138e1794d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:01.135056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7eb6ef94-bc67-4f66-9ea4-bb1138e1794d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:01.135955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7eb6ef94-bc67-4f66-9ea4-bb1138e1794d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:01.209218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7eb6ef94-bc67-4f66-9ea4-bb1138e1794d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:44:01.433926 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7eb6ef94-bc67-4f66-9ea4-bb1138e1794d tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 204 len: 0 microversion: 2.1 time: 0.312139 Jul 28 03:44:01.439063 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1012/1837] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:44:01 2022] DELETE /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:44:01.454056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97300d07-e43a-4e99-80a2-21b718ae64d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:01.456071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-97300d07-e43a-4e99-80a2-21b718ae64d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:01.471852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97300d07-e43a-4e99-80a2-21b718ae64d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:01.472717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97300d07-e43a-4e99-80a2-21b718ae64d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:01.474167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97300d07-e43a-4e99-80a2-21b718ae64d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:01.474963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97300d07-e43a-4e99-80a2-21b718ae64d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:01.936379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-97300d07-e43a-4e99-80a2-21b718ae64d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:01.951461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-97300d07-e43a-4e99-80a2-21b718ae64d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:01.955201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-97300d07-e43a-4e99-80a2-21b718ae64d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:01.957522 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-97300d07-e43a-4e99-80a2-21b718ae64d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.513719 Jul 28 03:44:01.961323 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1013/1838] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:01 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:01.985677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9b6f4235-cb58-4045-b2ba-63c0ca1e38e5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:01.988849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9b6f4235-cb58-4045-b2ba-63c0ca1e38e5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:02.008898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b6f4235-cb58-4045-b2ba-63c0ca1e38e5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:02.009700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b6f4235-cb58-4045-b2ba-63c0ca1e38e5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:02.011181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b6f4235-cb58-4045-b2ba-63c0ca1e38e5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:02.016870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b6f4235-cb58-4045-b2ba-63c0ca1e38e5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:02.190834 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3608d228-65eb-4c02-9287-3a4463d54c72 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272/action" status: 202 len: 0 microversion: 2.1 time: 4.646643 Jul 28 03:44:02.193537 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 826/1839] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:43:57 2022] POST /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272/action => generated 0 bytes in 4652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:44:02.203536 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-16bf873a-bf45-456e-aa62-1dc5f9c7b4d3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:02.204806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-16bf873a-bf45-456e-aa62-1dc5f9c7b4d3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:02.227706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16bf873a-bf45-456e-aa62-1dc5f9c7b4d3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:02.229011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16bf873a-bf45-456e-aa62-1dc5f9c7b4d3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:02.230760 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16bf873a-bf45-456e-aa62-1dc5f9c7b4d3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:02.231736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16bf873a-bf45-456e-aa62-1dc5f9c7b4d3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:02.332763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9b6f4235-cb58-4045-b2ba-63c0ca1e38e5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:02.348991 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9b6f4235-cb58-4045-b2ba-63c0ca1e38e5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.383676 Jul 28 03:44:02.368666 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1014/1840] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:01 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:02.382562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-723a7408-6a3d-4d0e-a438-ddfe3d3c6e26 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:02.383286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-723a7408-6a3d-4d0e-a438-ddfe3d3c6e26 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:02.391678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-723a7408-6a3d-4d0e-a438-ddfe3d3c6e26 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:02.392125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-723a7408-6a3d-4d0e-a438-ddfe3d3c6e26 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:02.392962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-723a7408-6a3d-4d0e-a438-ddfe3d3c6e26 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:02.393464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-723a7408-6a3d-4d0e-a438-ddfe3d3c6e26 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:02.624899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-723a7408-6a3d-4d0e-a438-ddfe3d3c6e26 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:02.633975 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-723a7408-6a3d-4d0e-a438-ddfe3d3c6e26 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1513 microversion: 2.1 time: 0.262260 Jul 28 03:44:02.647908 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1015/1841] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:02 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:02.653480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d7863978-50cc-4835-8c7d-353a09ed6f56 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:02.654192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d7863978-50cc-4835-8c7d-353a09ed6f56 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:02.661936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7863978-50cc-4835-8c7d-353a09ed6f56 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:02.662406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7863978-50cc-4835-8c7d-353a09ed6f56 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:02.663191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7863978-50cc-4835-8c7d-353a09ed6f56 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:02.663622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7863978-50cc-4835-8c7d-353a09ed6f56 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:02.885395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d7863978-50cc-4835-8c7d-353a09ed6f56 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:02.904998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d7863978-50cc-4835-8c7d-353a09ed6f56 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:02.908189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d7863978-50cc-4835-8c7d-353a09ed6f56 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:02.912050 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d7863978-50cc-4835-8c7d-353a09ed6f56 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.262788 Jul 28 03:44:02.913311 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1016/1842] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:02 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:02.919747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e91d5ab7-7dbf-43f0-8005-6fa6a5f9823d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:02.920583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e91d5ab7-7dbf-43f0-8005-6fa6a5f9823d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:02.935740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e91d5ab7-7dbf-43f0-8005-6fa6a5f9823d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:02.936636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e91d5ab7-7dbf-43f0-8005-6fa6a5f9823d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:02.937798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e91d5ab7-7dbf-43f0-8005-6fa6a5f9823d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:02.939692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e91d5ab7-7dbf-43f0-8005-6fa6a5f9823d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:03.240822 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-16bf873a-bf45-456e-aa62-1dc5f9c7b4d3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:03.265356 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-16bf873a-bf45-456e-aa62-1dc5f9c7b4d3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 1.069562 Jul 28 03:44:03.267446 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 827/1843] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:02 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:03.282580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4a07e8e2-1636-4ca7-93bf-86be8d97e7f7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:03.286377 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4a07e8e2-1636-4ca7-93bf-86be8d97e7f7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:03.305300 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:03.327441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e91d5ab7-7dbf-43f0-8005-6fa6a5f9823d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:03.330127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a07e8e2-1636-4ca7-93bf-86be8d97e7f7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:03.330620 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a07e8e2-1636-4ca7-93bf-86be8d97e7f7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:03.338296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a07e8e2-1636-4ca7-93bf-86be8d97e7f7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:03.338890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a07e8e2-1636-4ca7-93bf-86be8d97e7f7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:03.355101 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e91d5ab7-7dbf-43f0-8005-6fa6a5f9823d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.439739 Jul 28 03:44:03.356585 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1017/1844] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:02 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:03.398570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ba8cc8c-2b19-4bd6-ab15-9bb488e4ae5d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:03.402842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ba8cc8c-2b19-4bd6-ab15-9bb488e4ae5d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:03.423799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ba8cc8c-2b19-4bd6-ab15-9bb488e4ae5d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:03.424891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ba8cc8c-2b19-4bd6-ab15-9bb488e4ae5d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:03.427082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ba8cc8c-2b19-4bd6-ab15-9bb488e4ae5d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:03.428089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ba8cc8c-2b19-4bd6-ab15-9bb488e4ae5d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:03.823083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2ba8cc8c-2b19-4bd6-ab15-9bb488e4ae5d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:03.835808 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ba8cc8c-2b19-4bd6-ab15-9bb488e4ae5d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.451499 Jul 28 03:44:03.849884 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1018/1845] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:03 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:44:03.858589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93261298-b980-4246-a224-4bbdc52f1ae0 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:03.859486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93261298-b980-4246-a224-4bbdc52f1ae0 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:03.867267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93261298-b980-4246-a224-4bbdc52f1ae0 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:03.867806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93261298-b980-4246-a224-4bbdc52f1ae0 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:03.868893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93261298-b980-4246-a224-4bbdc52f1ae0 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:03.869397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93261298-b980-4246-a224-4bbdc52f1ae0 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:03.939448 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4a07e8e2-1636-4ca7-93bf-86be8d97e7f7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:03.959187 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4a07e8e2-1636-4ca7-93bf-86be8d97e7f7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:03.963011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4a07e8e2-1636-4ca7-93bf-86be8d97e7f7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:03.964996 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4a07e8e2-1636-4ca7-93bf-86be8d97e7f7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.694625 Jul 28 03:44:03.966866 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 828/1846] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:03 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:03.975029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9a95282c-4ed2-4e06-a67c-3769c0f5e970 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:03.976325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9a95282c-4ed2-4e06-a67c-3769c0f5e970 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:03.984747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a95282c-4ed2-4e06-a67c-3769c0f5e970 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:03.985758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a95282c-4ed2-4e06-a67c-3769c0f5e970 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:03.986947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a95282c-4ed2-4e06-a67c-3769c0f5e970 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:03.987765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a95282c-4ed2-4e06-a67c-3769c0f5e970 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:04.155819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93261298-b980-4246-a224-4bbdc52f1ae0 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:04.169095 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93261298-b980-4246-a224-4bbdc52f1ae0 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1513 microversion: 2.1 time: 0.316938 Jul 28 03:44:04.169747 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1019/1847] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:03 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1513 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:04.314047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1b041991-df4f-45a3-b20a-caba31c04b3b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:04.317703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1b041991-df4f-45a3-b20a-caba31c04b3b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:04.356071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b041991-df4f-45a3-b20a-caba31c04b3b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:04.357326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b041991-df4f-45a3-b20a-caba31c04b3b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:04.359601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b041991-df4f-45a3-b20a-caba31c04b3b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:04.360779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b041991-df4f-45a3-b20a-caba31c04b3b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:04.475224 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9a95282c-4ed2-4e06-a67c-3769c0f5e970 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:04.499624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9a95282c-4ed2-4e06-a67c-3769c0f5e970 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:04.503706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9a95282c-4ed2-4e06-a67c-3769c0f5e970 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:04.506585 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9a95282c-4ed2-4e06-a67c-3769c0f5e970 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.537501 Jul 28 03:44:04.518090 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 829/1848] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:03 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:04.530611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-159dba45-d240-4132-af36-99d626c6368c req-ce17cb0a-57ad-4942-8d72-bf384ec8b8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7a8c953-25e1-401f-89e2-dcce0c9f414b", "name": "network-vif-deleted", "tag": "9ee53927-49a5-4692-82ec-07e6f6f08ed4"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:04.558527 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-159dba45-d240-4132-af36-99d626c6368c req-ce17cb0a-57ad-4942-8d72-bf384ec8b8d5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:04.558868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-159dba45-d240-4132-af36-99d626c6368c req-ce17cb0a-57ad-4942-8d72-bf384ec8b8d5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:04.588235 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-159dba45-d240-4132-af36-99d626c6368c req-ce17cb0a-57ad-4942-8d72-bf384ec8b8d5 service nova] Creating event network-vif-deleted:9ee53927-49a5-4692-82ec-07e6f6f08ed4 for instance a7a8c953-25e1-401f-89e2-dcce0c9f414b on n-h1-826756-3 Jul 28 03:44:04.601692 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-159dba45-d240-4132-af36-99d626c6368c req-ce17cb0a-57ad-4942-8d72-bf384ec8b8d5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084779 Jul 28 03:44:04.602356 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 830/1849] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:04.608130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4e1e5ba9-8cc6-4192-8289-2931d636c301 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:04.609332 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4e1e5ba9-8cc6-4192-8289-2931d636c301 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:04.617912 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e1e5ba9-8cc6-4192-8289-2931d636c301 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:04.618704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e1e5ba9-8cc6-4192-8289-2931d636c301 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:04.619502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e1e5ba9-8cc6-4192-8289-2931d636c301 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:04.619927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e1e5ba9-8cc6-4192-8289-2931d636c301 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:04.737133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1b041991-df4f-45a3-b20a-caba31c04b3b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:04.752862 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1b041991-df4f-45a3-b20a-caba31c04b3b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.459301 Jul 28 03:44:04.754385 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1020/1850] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:04 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:44:04.871214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ffd47b50-eaf0-4b1c-b673-324b5ca8e6e1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:04.871214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ffd47b50-eaf0-4b1c-b673-324b5ca8e6e1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:04.886099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffd47b50-eaf0-4b1c-b673-324b5ca8e6e1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:04.886542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffd47b50-eaf0-4b1c-b673-324b5ca8e6e1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:04.887726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffd47b50-eaf0-4b1c-b673-324b5ca8e6e1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:04.888396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffd47b50-eaf0-4b1c-b673-324b5ca8e6e1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:04.894879 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4e1e5ba9-8cc6-4192-8289-2931d636c301 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:04.908029 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4e1e5ba9-8cc6-4192-8289-2931d636c301 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.304105 Jul 28 03:44:04.909141 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 831/1851] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:04 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:05.011084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-96125001-c6ee-4f39-b047-1c1b3f1f0f6e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:05.011708 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-96125001-c6ee-4f39-b047-1c1b3f1f0f6e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:05.024924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96125001-c6ee-4f39-b047-1c1b3f1f0f6e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:05.028819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96125001-c6ee-4f39-b047-1c1b3f1f0f6e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:05.064166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96125001-c6ee-4f39-b047-1c1b3f1f0f6e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:05.090485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96125001-c6ee-4f39-b047-1c1b3f1f0f6e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:05.266116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ffd47b50-eaf0-4b1c-b673-324b5ca8e6e1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:05.281024 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ffd47b50-eaf0-4b1c-b673-324b5ca8e6e1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.421147 Jul 28 03:44:05.282799 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1021/1852] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:04 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:05.294364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-82d5aec6-f1fe-4c05-8ac2-6d71018af869 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:05.295615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-82d5aec6-f1fe-4c05-8ac2-6d71018af869 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:05.307463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:05.311030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82d5aec6-f1fe-4c05-8ac2-6d71018af869 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:05.312051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82d5aec6-f1fe-4c05-8ac2-6d71018af869 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:05.313613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82d5aec6-f1fe-4c05-8ac2-6d71018af869 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:05.314542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82d5aec6-f1fe-4c05-8ac2-6d71018af869 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:05.407159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82d5aec6-f1fe-4c05-8ac2-6d71018af869 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:05.408289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82d5aec6-f1fe-4c05-8ac2-6d71018af869 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:05.410504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-82d5aec6-f1fe-4c05-8ac2-6d71018af869 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lazy-loading 'fault' on Instance uuid a7a8c953-25e1-401f-89e2-dcce0c9f414b {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:44:05.494350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-96125001-c6ee-4f39-b047-1c1b3f1f0f6e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:05.515214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-96125001-c6ee-4f39-b047-1c1b3f1f0f6e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:05.517806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-96125001-c6ee-4f39-b047-1c1b3f1f0f6e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:05.519331 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-96125001-c6ee-4f39-b047-1c1b3f1f0f6e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.512617 Jul 28 03:44:05.519500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82d5aec6-f1fe-4c05-8ac2-6d71018af869 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:05.520669 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 832/1853] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:05 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:05.564164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a2fa2285-69f1-48ed-9173-490287e46641 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:05.567029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a2fa2285-69f1-48ed-9173-490287e46641 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:05.576239 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-82d5aec6-f1fe-4c05-8ac2-6d71018af869 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 200 len: 1308 microversion: 2.1 time: 0.291290 Jul 28 03:44:05.592575 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1022/1854] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:05 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:05.598628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a2fa2285-69f1-48ed-9173-490287e46641 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:05.602560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a2fa2285-69f1-48ed-9173-490287e46641 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:05.609433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a2fa2285-69f1-48ed-9173-490287e46641 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:05.610913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a2fa2285-69f1-48ed-9173-490287e46641 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:05.780282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62bc6e13-51e1-4eed-8cea-856c7211b78f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:05.783186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-62bc6e13-51e1-4eed-8cea-856c7211b78f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:05.806885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62bc6e13-51e1-4eed-8cea-856c7211b78f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:05.807731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62bc6e13-51e1-4eed-8cea-856c7211b78f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:05.808631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62bc6e13-51e1-4eed-8cea-856c7211b78f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:05.809059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62bc6e13-51e1-4eed-8cea-856c7211b78f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:05.908919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a2fa2285-69f1-48ed-9173-490287e46641 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:05.933739 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a2fa2285-69f1-48ed-9173-490287e46641 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:05.937765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a2fa2285-69f1-48ed-9173-490287e46641 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:05.942007 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a2fa2285-69f1-48ed-9173-490287e46641 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.384427 Jul 28 03:44:05.960717 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 833/1855] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:05 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:44:05.966526 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-81713ec9-b9d2-4c33-a935-da5090ea7045 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:05.967165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-81713ec9-b9d2-4c33-a935-da5090ea7045 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:05.975014 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81713ec9-b9d2-4c33-a935-da5090ea7045 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:05.975594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81713ec9-b9d2-4c33-a935-da5090ea7045 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:05.980100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81713ec9-b9d2-4c33-a935-da5090ea7045 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:05.980657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81713ec9-b9d2-4c33-a935-da5090ea7045 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:06.056961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62bc6e13-51e1-4eed-8cea-856c7211b78f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:06.073252 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-62bc6e13-51e1-4eed-8cea-856c7211b78f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.300134 Jul 28 03:44:06.074593 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1023/1856] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:05 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:06.227288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-81713ec9-b9d2-4c33-a935-da5090ea7045 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:06.237977 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-81713ec9-b9d2-4c33-a935-da5090ea7045 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.275873 Jul 28 03:44:06.238702 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 834/1857] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:05 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:06.322561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fdd17416-6d29-419c-8dff-c34bc2ab16dd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:06.323576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fdd17416-6d29-419c-8dff-c34bc2ab16dd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:06.335048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fdd17416-6d29-419c-8dff-c34bc2ab16dd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:06.336221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fdd17416-6d29-419c-8dff-c34bc2ab16dd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:06.338298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fdd17416-6d29-419c-8dff-c34bc2ab16dd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:06.339080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fdd17416-6d29-419c-8dff-c34bc2ab16dd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:06.542531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fdd17416-6d29-419c-8dff-c34bc2ab16dd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:06.546554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:06.559788 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fdd17416-6d29-419c-8dff-c34bc2ab16dd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.242608 Jul 28 03:44:06.564016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1a69cfb2-ae06-45a1-aa54-56ff4ad99bb0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:06.564686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1a69cfb2-ae06-45a1-aa54-56ff4ad99bb0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:06.573186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1a69cfb2-ae06-45a1-aa54-56ff4ad99bb0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:06.573837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1a69cfb2-ae06-45a1-aa54-56ff4ad99bb0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:06.574702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1a69cfb2-ae06-45a1-aa54-56ff4ad99bb0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:06.575126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1a69cfb2-ae06-45a1-aa54-56ff4ad99bb0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:06.576969 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1024/1858] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:06 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:06.611513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9b7d1e8b-37dd-4089-bf38-60ef5158bf25 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:06.612192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9b7d1e8b-37dd-4089-bf38-60ef5158bf25 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: a7a8c953-25e1-401f-89e2-dcce0c9f414b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:06.619552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b7d1e8b-37dd-4089-bf38-60ef5158bf25 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:06.620215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b7d1e8b-37dd-4089-bf38-60ef5158bf25 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:06.621527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b7d1e8b-37dd-4089-bf38-60ef5158bf25 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:06.621976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b7d1e8b-37dd-4089-bf38-60ef5158bf25 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:06.643665 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-9b7d1e8b-37dd-4089-bf38-60ef5158bf25 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] HTTP exception thrown: Instance a7a8c953-25e1-401f-89e2-dcce0c9f414b could not be found. Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9b7d1e8b-37dd-4089-bf38-60ef5158bf25 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Request method failure captured: Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b HTTP/1.1 Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gUtKMh69amoegtKcXFpSRXNWhCR_J72C9T3wBIUXCcZYnI866G7Hj47se4lymzcz1CmIVNhCptypRMH5Cn24V6BsvujrRDT2z39QPwdOl_TQaomqVDehjSJNfrAmOpx6a3VoCztDAqjzBydmw8Xcnr0vE3tJFjCIRgv39nxAAqBoaA Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 39b785d4e7c6483e8affc1cc61a8998e Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-VolumesAdminNegativeTest-503451687 Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/39b785d4e7c6483e8affc1cc61a8998e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39b785d4e7c6483e8affc1cc61a8998e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_39b785d4e7c6483e8affc1cc61a8998e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39b785d4e7c6483e8affc1cc61a8998e"}]}] Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-VolumesAdminNegativeTest-503451687 Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 39b785d4e7c6483e8affc1cc61a8998e Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-503451687 Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-VolumesAdminNegativeTest-503451687-project Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 590f4ca3ef8640529749d54793c05f46 Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-VolumesAdminNegativeTest-503451687-project Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance a7a8c953-25e1-401f-89e2-dcce0c9f414b could not be found. Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a7a8c953-25e1-401f-89e2-dcce0c9f414b'} Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7a8c953-25e1-401f-89e2-dcce0c9f414b could not be found. Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7a8c953-25e1-401f-89e2-dcce0c9f414b could not be found. Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:06.646207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:06.657562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:06.657562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:06.657562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:06.657562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:06.657562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:06.657562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7a8c953-25e1-401f-89e2-dcce0c9f414b could not be found. Jul 28 03:44:06.657562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:06.657562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9b7d1e8b-37dd-4089-bf38-60ef5158bf25 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Returning 404 to user: Instance a7a8c953-25e1-401f-89e2-dcce0c9f414b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:06.657562 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9b7d1e8b-37dd-4089-bf38-60ef5158bf25 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b" status: 404 len: 111 microversion: 2.1 time: 0.045216 Jul 28 03:44:06.657562 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1025/1859] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:06 2022] GET /compute/v2.1/servers/a7a8c953-25e1-401f-89e2-dcce0c9f414b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:44:06.839470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3d1f80c1-b575-47c3-bef5-cf8374560c17 req-3a3edc72-4b50-4e63-84d5-a22ab2aaa7db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-plugged", "status": "completed", "tag": "aafba26f-665f-4f25-a548-ebfcf3f246ed"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:06.863892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3d1f80c1-b575-47c3-bef5-cf8374560c17 req-3a3edc72-4b50-4e63-84d5-a22ab2aaa7db service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:06.865029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3d1f80c1-b575-47c3-bef5-cf8374560c17 req-3a3edc72-4b50-4e63-84d5-a22ab2aaa7db service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:06.894896 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3d1f80c1-b575-47c3-bef5-cf8374560c17 req-3a3edc72-4b50-4e63-84d5-a22ab2aaa7db service nova] Creating event network-vif-plugged:aafba26f-665f-4f25-a548-ebfcf3f246ed for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:44:06.904177 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3d1f80c1-b575-47c3-bef5-cf8374560c17 req-3a3edc72-4b50-4e63-84d5-a22ab2aaa7db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069275 Jul 28 03:44:06.905844 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1026/1860] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:44:06.986598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa06b213-3125-4f04-8754-5bfd463e5ee0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:06.991913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1a69cfb2-ae06-45a1-aa54-56ff4ad99bb0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:06.993383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fa06b213-3125-4f04-8754-5bfd463e5ee0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:07.011493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa06b213-3125-4f04-8754-5bfd463e5ee0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:07.012271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa06b213-3125-4f04-8754-5bfd463e5ee0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:07.013783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa06b213-3125-4f04-8754-5bfd463e5ee0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:07.021157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1a69cfb2-ae06-45a1-aa54-56ff4ad99bb0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:07.021963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa06b213-3125-4f04-8754-5bfd463e5ee0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:07.023056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1a69cfb2-ae06-45a1-aa54-56ff4ad99bb0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:07.026736 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1a69cfb2-ae06-45a1-aa54-56ff4ad99bb0 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.468593 Jul 28 03:44:07.038435 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 835/1861] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:06 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:44:07.111070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1c10277f-2ce5-42e7-918a-e0a386fca3d4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:07.112255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1c10277f-2ce5-42e7-918a-e0a386fca3d4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:07.130880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1c10277f-2ce5-42e7-918a-e0a386fca3d4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:07.131334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1c10277f-2ce5-42e7-918a-e0a386fca3d4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:07.133067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1c10277f-2ce5-42e7-918a-e0a386fca3d4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:07.133695 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1c10277f-2ce5-42e7-918a-e0a386fca3d4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:07.206577 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:07.413817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa06b213-3125-4f04-8754-5bfd463e5ee0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:07.430102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa06b213-3125-4f04-8754-5bfd463e5ee0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:07.432987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa06b213-3125-4f04-8754-5bfd463e5ee0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:07.435610 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fa06b213-3125-4f04-8754-5bfd463e5ee0 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.465257 Jul 28 03:44:07.436626 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1027/1862] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:06 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:07.445098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-29ebd8cd-9215-422b-9f4a-dcf886ed34f7 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:07.446216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-29ebd8cd-9215-422b-9f4a-dcf886ed34f7 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:07.455767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ebd8cd-9215-422b-9f4a-dcf886ed34f7 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:07.456911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ebd8cd-9215-422b-9f4a-dcf886ed34f7 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:07.458152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ebd8cd-9215-422b-9f4a-dcf886ed34f7 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:07.458709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ebd8cd-9215-422b-9f4a-dcf886ed34f7 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:07.496598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:07.561485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1c10277f-2ce5-42e7-918a-e0a386fca3d4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:07.583077 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1c10277f-2ce5-42e7-918a-e0a386fca3d4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.479266 Jul 28 03:44:07.588054 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 836/1863] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:07 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:07.612920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0ff065f1-e38a-434b-9d49-7493f1e24008 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:07.614757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0ff065f1-e38a-434b-9d49-7493f1e24008 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:07.630340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ff065f1-e38a-434b-9d49-7493f1e24008 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:07.631427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ff065f1-e38a-434b-9d49-7493f1e24008 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:07.633030 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ff065f1-e38a-434b-9d49-7493f1e24008 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:07.633791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ff065f1-e38a-434b-9d49-7493f1e24008 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:07.741675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-29ebd8cd-9215-422b-9f4a-dcf886ed34f7 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:07.756916 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-29ebd8cd-9215-422b-9f4a-dcf886ed34f7 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.318514 Jul 28 03:44:07.757740 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1028/1864] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:07 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:07.922804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0ff065f1-e38a-434b-9d49-7493f1e24008 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:07.961730 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0ff065f1-e38a-434b-9d49-7493f1e24008 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.364369 Jul 28 03:44:07.963126 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 837/1865] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:07 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:08.065785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed06bdce-0875-47e4-8ee7-c22715f1f2f6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:08.068763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed06bdce-0875-47e4-8ee7-c22715f1f2f6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:08.093299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed06bdce-0875-47e4-8ee7-c22715f1f2f6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:08.099274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed06bdce-0875-47e4-8ee7-c22715f1f2f6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:08.101610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed06bdce-0875-47e4-8ee7-c22715f1f2f6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:08.103235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed06bdce-0875-47e4-8ee7-c22715f1f2f6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:08.482557 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-40dc8e4f-8d42-4333-bd70-ec7558b88d9b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:08.484822 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-40dc8e4f-8d42-4333-bd70-ec7558b88d9b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:08.497587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40dc8e4f-8d42-4333-bd70-ec7558b88d9b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:08.498980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40dc8e4f-8d42-4333-bd70-ec7558b88d9b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:08.501914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40dc8e4f-8d42-4333-bd70-ec7558b88d9b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:08.502964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40dc8e4f-8d42-4333-bd70-ec7558b88d9b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:08.748608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed06bdce-0875-47e4-8ee7-c22715f1f2f6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:08.779373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed06bdce-0875-47e4-8ee7-c22715f1f2f6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:08.791758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed06bdce-0875-47e4-8ee7-c22715f1f2f6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:08.793591 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed06bdce-0875-47e4-8ee7-c22715f1f2f6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.741485 Jul 28 03:44:08.794485 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1029/1866] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:08 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:08.808724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-40dc8e4f-8d42-4333-bd70-ec7558b88d9b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:08.823597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c4ce50a8-4c2f-4df5-8266-21d6b190ff7a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:08.824995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c4ce50a8-4c2f-4df5-8266-21d6b190ff7a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:08.833942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-40dc8e4f-8d42-4333-bd70-ec7558b88d9b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:08.836044 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-40dc8e4f-8d42-4333-bd70-ec7558b88d9b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:08.837549 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-40dc8e4f-8d42-4333-bd70-ec7558b88d9b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.364958 Jul 28 03:44:08.838022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4ce50a8-4c2f-4df5-8266-21d6b190ff7a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:08.838684 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 838/1867] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:08 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:08.839005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4ce50a8-4c2f-4df5-8266-21d6b190ff7a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:08.840199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4ce50a8-4c2f-4df5-8266-21d6b190ff7a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:08.840979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4ce50a8-4c2f-4df5-8266-21d6b190ff7a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:08.845485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a63d390f-d667-4567-bf0c-7587d560986e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:08.846269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a63d390f-d667-4567-bf0c-7587d560986e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:08.853875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a63d390f-d667-4567-bf0c-7587d560986e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:08.854384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a63d390f-d667-4567-bf0c-7587d560986e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:08.855806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a63d390f-d667-4567-bf0c-7587d560986e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:08.856249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a63d390f-d667-4567-bf0c-7587d560986e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:09.182291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a63d390f-d667-4567-bf0c-7587d560986e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:09.191873 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a63d390f-d667-4567-bf0c-7587d560986e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.351869 Jul 28 03:44:09.205953 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 839/1868] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:08 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:09.215827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a6850454-966e-4910-854f-e856035d80ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:09.217809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a6850454-966e-4910-854f-e856035d80ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:09.229878 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a6850454-966e-4910-854f-e856035d80ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:09.230639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a6850454-966e-4910-854f-e856035d80ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:09.232142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a6850454-966e-4910-854f-e856035d80ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:09.232773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a6850454-966e-4910-854f-e856035d80ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:09.233187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c4ce50a8-4c2f-4df5-8266-21d6b190ff7a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:09.243760 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c4ce50a8-4c2f-4df5-8266-21d6b190ff7a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.447870 Jul 28 03:44:09.244395 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1030/1869] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:08 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:09.250769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-083adab5-32ba-4d18-bac4-aaea89abe70d req-56e8adeb-0a70-4fad-a674-fe98cdf2e036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-plugged", "status": "completed", "tag": "1fcc8042-1405-4e22-b511-0d24dbaa7b21"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:09.299927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-083adab5-32ba-4d18-bac4-aaea89abe70d req-56e8adeb-0a70-4fad-a674-fe98cdf2e036 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:09.301182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-083adab5-32ba-4d18-bac4-aaea89abe70d req-56e8adeb-0a70-4fad-a674-fe98cdf2e036 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:09.329611 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-083adab5-32ba-4d18-bac4-aaea89abe70d req-56e8adeb-0a70-4fad-a674-fe98cdf2e036 service nova] Creating event network-vif-plugged:1fcc8042-1405-4e22-b511-0d24dbaa7b21 for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:44:09.337208 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-083adab5-32ba-4d18-bac4-aaea89abe70d req-56e8adeb-0a70-4fad-a674-fe98cdf2e036 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090293 Jul 28 03:44:09.338568 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1031/1870] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:09.503542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a6850454-966e-4910-854f-e856035d80ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:09.523876 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a6850454-966e-4910-854f-e856035d80ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.319832 Jul 28 03:44:09.533261 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 840/1871] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:09 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:09.828884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e171f866-2348-40db-aee6-a4bbfb3f502b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:09.831282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e171f866-2348-40db-aee6-a4bbfb3f502b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:09.843056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e171f866-2348-40db-aee6-a4bbfb3f502b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:09.844749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e171f866-2348-40db-aee6-a4bbfb3f502b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:09.846495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e171f866-2348-40db-aee6-a4bbfb3f502b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:09.847304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e171f866-2348-40db-aee6-a4bbfb3f502b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:09.881417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4e182726-f033-4e15-90fe-f6a9face60cd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:09.893654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4e182726-f033-4e15-90fe-f6a9face60cd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:09.913281 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e182726-f033-4e15-90fe-f6a9face60cd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:09.914228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e182726-f033-4e15-90fe-f6a9face60cd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:09.915335 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e182726-f033-4e15-90fe-f6a9face60cd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:09.916481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e182726-f033-4e15-90fe-f6a9face60cd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:10.317478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4e182726-f033-4e15-90fe-f6a9face60cd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:10.334135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4e182726-f033-4e15-90fe-f6a9face60cd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:10.336714 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4e182726-f033-4e15-90fe-f6a9face60cd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:10.339376 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4e182726-f033-4e15-90fe-f6a9face60cd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.465405 Jul 28 03:44:10.341202 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 841/1872] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:09 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:10.362522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1e2eb64d-3a77-48d5-bcb0-d2d1785d2b7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:10.363870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1e2eb64d-3a77-48d5-bcb0-d2d1785d2b7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:10.375789 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e2eb64d-3a77-48d5-bcb0-d2d1785d2b7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:10.377143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e2eb64d-3a77-48d5-bcb0-d2d1785d2b7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:10.380455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e2eb64d-3a77-48d5-bcb0-d2d1785d2b7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:10.381607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e2eb64d-3a77-48d5-bcb0-d2d1785d2b7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:10.915848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1e2eb64d-3a77-48d5-bcb0-d2d1785d2b7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:10.933652 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1e2eb64d-3a77-48d5-bcb0-d2d1785d2b7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.590777 Jul 28 03:44:10.957781 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 842/1873] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:10 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:10.984939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c72ca6e9-17df-4d97-b06c-1f2186e4a9c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:10.987197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c72ca6e9-17df-4d97-b06c-1f2186e4a9c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:11.013041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c72ca6e9-17df-4d97-b06c-1f2186e4a9c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:11.014436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c72ca6e9-17df-4d97-b06c-1f2186e4a9c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:11.015973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c72ca6e9-17df-4d97-b06c-1f2186e4a9c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:11.018673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c72ca6e9-17df-4d97-b06c-1f2186e4a9c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:11.242580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e171f866-2348-40db-aee6-a4bbfb3f502b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:11.267784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e171f866-2348-40db-aee6-a4bbfb3f502b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:11.273716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e171f866-2348-40db-aee6-a4bbfb3f502b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:11.276674 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e171f866-2348-40db-aee6-a4bbfb3f502b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 1.454011 Jul 28 03:44:11.301453 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1032/1874] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:09 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:44:11.311518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-34ffdaaa-f863-408e-b8fc-0138caeccab5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:11.312559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-34ffdaaa-f863-408e-b8fc-0138caeccab5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:11.332529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34ffdaaa-f863-408e-b8fc-0138caeccab5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:11.350048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34ffdaaa-f863-408e-b8fc-0138caeccab5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:11.352453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34ffdaaa-f863-408e-b8fc-0138caeccab5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:11.352933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34ffdaaa-f863-408e-b8fc-0138caeccab5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:11.762507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-34ffdaaa-f863-408e-b8fc-0138caeccab5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:11.777883 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-34ffdaaa-f863-408e-b8fc-0138caeccab5 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.475078 Jul 28 03:44:11.778488 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1033/1875] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:11 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:11.796395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-909f5b33-8b92-43fb-a9e7-8e5df3b334b4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:11.796395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-909f5b33-8b92-43fb-a9e7-8e5df3b334b4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:11.813596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-909f5b33-8b92-43fb-a9e7-8e5df3b334b4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:11.815041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-909f5b33-8b92-43fb-a9e7-8e5df3b334b4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:11.817132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-909f5b33-8b92-43fb-a9e7-8e5df3b334b4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:11.822214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-909f5b33-8b92-43fb-a9e7-8e5df3b334b4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:12.288584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-909f5b33-8b92-43fb-a9e7-8e5df3b334b4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:12.308520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-909f5b33-8b92-43fb-a9e7-8e5df3b334b4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:12.314316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-909f5b33-8b92-43fb-a9e7-8e5df3b334b4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:12.316746 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-909f5b33-8b92-43fb-a9e7-8e5df3b334b4 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.536968 Jul 28 03:44:12.318597 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1034/1876] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:11 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:12.331687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0fcddee1-c6b0-4ee3-a0ef-b5531f77339a req-d33d5695-b8fc-4d4b-b3f0-2a8f9ee5bc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-plugged", "status": "completed", "tag": "c40070a3-9cac-4380-8b9c-21f0c6fe3eaa"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:12.349361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0fcddee1-c6b0-4ee3-a0ef-b5531f77339a req-d33d5695-b8fc-4d4b-b3f0-2a8f9ee5bc2d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:12.350104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0fcddee1-c6b0-4ee3-a0ef-b5531f77339a req-d33d5695-b8fc-4d4b-b3f0-2a8f9ee5bc2d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:12.373986 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0fcddee1-c6b0-4ee3-a0ef-b5531f77339a req-d33d5695-b8fc-4d4b-b3f0-2a8f9ee5bc2d service nova] Creating event network-vif-plugged:c40070a3-9cac-4380-8b9c-21f0c6fe3eaa for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:44:12.382980 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0fcddee1-c6b0-4ee3-a0ef-b5531f77339a req-d33d5695-b8fc-4d4b-b3f0-2a8f9ee5bc2d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062701 Jul 28 03:44:12.385677 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1035/1877] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:12.393779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c715608-b885-41b7-a941-9060f2075447 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:12.399231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c715608-b885-41b7-a941-9060f2075447 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:12.421907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c715608-b885-41b7-a941-9060f2075447 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:12.422598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c715608-b885-41b7-a941-9060f2075447 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:12.424122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c715608-b885-41b7-a941-9060f2075447 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:12.433840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c715608-b885-41b7-a941-9060f2075447 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:12.477681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c72ca6e9-17df-4d97-b06c-1f2186e4a9c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:12.513076 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c72ca6e9-17df-4d97-b06c-1f2186e4a9c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 1.546818 Jul 28 03:44:12.513790 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 843/1878] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:10 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:12.554955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-16e40214-6858-43af-88a4-a3c69b35b9a4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:12.560056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-16e40214-6858-43af-88a4-a3c69b35b9a4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:12.572876 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16e40214-6858-43af-88a4-a3c69b35b9a4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:12.573439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16e40214-6858-43af-88a4-a3c69b35b9a4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:12.574306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16e40214-6858-43af-88a4-a3c69b35b9a4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:12.579350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16e40214-6858-43af-88a4-a3c69b35b9a4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:12.933748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-16e40214-6858-43af-88a4-a3c69b35b9a4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:12.947327 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-16e40214-6858-43af-88a4-a3c69b35b9a4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:12.949650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-16e40214-6858-43af-88a4-a3c69b35b9a4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:12.950939 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-16e40214-6858-43af-88a4-a3c69b35b9a4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.427197 Jul 28 03:44:12.964473 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 844/1879] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:12 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:12.964473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5ded6ed3-6206-48fa-a1d3-cdd7d63bf6e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:12.965206 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5ded6ed3-6206-48fa-a1d3-cdd7d63bf6e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:12.981074 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5ded6ed3-6206-48fa-a1d3-cdd7d63bf6e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:12.982275 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5ded6ed3-6206-48fa-a1d3-cdd7d63bf6e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:12.985216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5ded6ed3-6206-48fa-a1d3-cdd7d63bf6e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:12.990023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5ded6ed3-6206-48fa-a1d3-cdd7d63bf6e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:13.001445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c715608-b885-41b7-a941-9060f2075447 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:13.009438 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c715608-b885-41b7-a941-9060f2075447 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.621205 Jul 28 03:44:13.022769 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1036/1880] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:12 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:13.022769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3f3c41e-36d1-4a84-b3a1-dd2649745b96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:13.022769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d3f3c41e-36d1-4a84-b3a1-dd2649745b96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:13.038100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3f3c41e-36d1-4a84-b3a1-dd2649745b96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:13.041222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3f3c41e-36d1-4a84-b3a1-dd2649745b96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:13.044091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3f3c41e-36d1-4a84-b3a1-dd2649745b96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:13.049237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3f3c41e-36d1-4a84-b3a1-dd2649745b96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:13.073568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5ded6ed3-6206-48fa-a1d3-cdd7d63bf6e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:44:13.289341 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5ded6ed3-6206-48fa-a1d3-cdd7d63bf6e5 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 204 len: 0 microversion: 2.1 time: 0.331486 Jul 28 03:44:13.293452 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 845/1881] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:44:12 2022] DELETE /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:44:13.322521 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-96c7171c-fb21-4844-9308-ba298faa4a42 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:13.324386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-96c7171c-fb21-4844-9308-ba298faa4a42 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:13.340960 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96c7171c-fb21-4844-9308-ba298faa4a42 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:13.341724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96c7171c-fb21-4844-9308-ba298faa4a42 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:13.343288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96c7171c-fb21-4844-9308-ba298faa4a42 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:13.344398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96c7171c-fb21-4844-9308-ba298faa4a42 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:13.643862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d3f3c41e-36d1-4a84-b3a1-dd2649745b96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:13.663305 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d3f3c41e-36d1-4a84-b3a1-dd2649745b96 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.647183 Jul 28 03:44:13.673154 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1037/1882] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:13 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:13.688105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8bc09d36-d285-4665-b4c4-a7c66ff4b50b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:13.688953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8bc09d36-d285-4665-b4c4-a7c66ff4b50b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:13.699955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bc09d36-d285-4665-b4c4-a7c66ff4b50b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:13.700600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bc09d36-d285-4665-b4c4-a7c66ff4b50b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:13.701518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bc09d36-d285-4665-b4c4-a7c66ff4b50b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:13.702064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bc09d36-d285-4665-b4c4-a7c66ff4b50b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:13.750422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-96c7171c-fb21-4844-9308-ba298faa4a42 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:13.782658 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-96c7171c-fb21-4844-9308-ba298faa4a42 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 200 len: 1679 microversion: 2.1 time: 0.481885 Jul 28 03:44:13.784652 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 846/1883] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:13 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 1679 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:13.802416 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-84957fac-5360-4b0e-be14-b4653020531c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:13.808760 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-84957fac-5360-4b0e-be14-b4653020531c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:13.826109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-84957fac-5360-4b0e-be14-b4653020531c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:13.827243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-84957fac-5360-4b0e-be14-b4653020531c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:13.831010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-84957fac-5360-4b0e-be14-b4653020531c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:13.832162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-84957fac-5360-4b0e-be14-b4653020531c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:14.199684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-84957fac-5360-4b0e-be14-b4653020531c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:14.228186 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-84957fac-5360-4b0e-be14-b4653020531c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.441284 Jul 28 03:44:14.248924 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 847/1884] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:13 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:14.264249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0ff647c1-2860-4639-a3b2-1a6fd702b523 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:14.265911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0ff647c1-2860-4639-a3b2-1a6fd702b523 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:14.288927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ff647c1-2860-4639-a3b2-1a6fd702b523 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:14.291225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ff647c1-2860-4639-a3b2-1a6fd702b523 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:14.294906 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ff647c1-2860-4639-a3b2-1a6fd702b523 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:14.297548 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ff647c1-2860-4639-a3b2-1a6fd702b523 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:14.346921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8bc09d36-d285-4665-b4c4-a7c66ff4b50b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:14.364066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8bc09d36-d285-4665-b4c4-a7c66ff4b50b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:14.372580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8bc09d36-d285-4665-b4c4-a7c66ff4b50b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:14.374513 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8bc09d36-d285-4665-b4c4-a7c66ff4b50b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.699614 Jul 28 03:44:14.375576 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1038/1885] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:13 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:14.389328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e7672701-2c11-4561-a7ab-cedd93eb0e61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:14.396543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e7672701-2c11-4561-a7ab-cedd93eb0e61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:14.415207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7672701-2c11-4561-a7ab-cedd93eb0e61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:14.420106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7672701-2c11-4561-a7ab-cedd93eb0e61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:14.421424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7672701-2c11-4561-a7ab-cedd93eb0e61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:14.423606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7672701-2c11-4561-a7ab-cedd93eb0e61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:14.845809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e7672701-2c11-4561-a7ab-cedd93eb0e61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:14.856608 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e7672701-2c11-4561-a7ab-cedd93eb0e61 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.478776 Jul 28 03:44:14.857723 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1039/1886] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:14 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:14.865050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e07a083a-4c92-4343-a689-4c89ba3d9611 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:14.866141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e07a083a-4c92-4343-a689-4c89ba3d9611 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:14.874248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e07a083a-4c92-4343-a689-4c89ba3d9611 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:14.875168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e07a083a-4c92-4343-a689-4c89ba3d9611 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:14.876232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e07a083a-4c92-4343-a689-4c89ba3d9611 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:14.877032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e07a083a-4c92-4343-a689-4c89ba3d9611 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:15.102908 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0ff647c1-2860-4639-a3b2-1a6fd702b523 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:15.125095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0ff647c1-2860-4639-a3b2-1a6fd702b523 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:15.135139 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0ff647c1-2860-4639-a3b2-1a6fd702b523 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:15.142019 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0ff647c1-2860-4639-a3b2-1a6fd702b523 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.890716 Jul 28 03:44:15.144975 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 848/1887] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:14 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:15.179114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3a1c1695-28a6-4552-aeb3-1233395ea55e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:15.190901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3a1c1695-28a6-4552-aeb3-1233395ea55e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:15.217972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a1c1695-28a6-4552-aeb3-1233395ea55e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:15.220090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a1c1695-28a6-4552-aeb3-1233395ea55e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:15.221890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a1c1695-28a6-4552-aeb3-1233395ea55e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:15.222636 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a1c1695-28a6-4552-aeb3-1233395ea55e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:15.278609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e07a083a-4c92-4343-a689-4c89ba3d9611 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:15.296981 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e07a083a-4c92-4343-a689-4c89ba3d9611 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.437512 Jul 28 03:44:15.298058 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1040/1888] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:14 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:15.360949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1fd8c8a-bb3f-489c-bd17-9e7795c2d188 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:15.362177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1fd8c8a-bb3f-489c-bd17-9e7795c2d188 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:15.380092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1fd8c8a-bb3f-489c-bd17-9e7795c2d188 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:15.381097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1fd8c8a-bb3f-489c-bd17-9e7795c2d188 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:15.384609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1fd8c8a-bb3f-489c-bd17-9e7795c2d188 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:15.385446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1fd8c8a-bb3f-489c-bd17-9e7795c2d188 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:15.785332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b1fd8c8a-bb3f-489c-bd17-9e7795c2d188 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:15.809178 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1fd8c8a-bb3f-489c-bd17-9e7795c2d188 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.471694 Jul 28 03:44:15.820978 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1041/1889] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:15 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:15.836497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-450bc419-9217-420b-a33b-df84fbf5249a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:15.842815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-450bc419-9217-420b-a33b-df84fbf5249a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:15.857052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-450bc419-9217-420b-a33b-df84fbf5249a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:15.859922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-450bc419-9217-420b-a33b-df84fbf5249a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:15.861631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-450bc419-9217-420b-a33b-df84fbf5249a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:15.862822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-450bc419-9217-420b-a33b-df84fbf5249a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:16.382519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-450bc419-9217-420b-a33b-df84fbf5249a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:16.410153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-450bc419-9217-420b-a33b-df84fbf5249a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:16.412101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-450bc419-9217-420b-a33b-df84fbf5249a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:16.413404 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-450bc419-9217-420b-a33b-df84fbf5249a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1487 microversion: 2.25 time: 0.590526 Jul 28 03:44:16.414354 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1042/1890] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:15 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1487 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:16.419597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bc39e132-8063-448b-9e69-00cb4dfeeaff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:16.420826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bc39e132-8063-448b-9e69-00cb4dfeeaff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:16.443114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc39e132-8063-448b-9e69-00cb4dfeeaff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:16.444026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc39e132-8063-448b-9e69-00cb4dfeeaff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:16.445210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc39e132-8063-448b-9e69-00cb4dfeeaff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:16.445852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc39e132-8063-448b-9e69-00cb4dfeeaff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:16.624993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3a1c1695-28a6-4552-aeb3-1233395ea55e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:16.637617 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3a1c1695-28a6-4552-aeb3-1233395ea55e tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 200 len: 1679 microversion: 2.1 time: 1.490282 Jul 28 03:44:16.639787 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 849/1891] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:15 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 1679 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:16.650422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7f8f58ab-409b-4507-ab70-47f2b5a0c520 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:16.651499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7f8f58ab-409b-4507-ab70-47f2b5a0c520 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:16.667534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f8f58ab-409b-4507-ab70-47f2b5a0c520 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:16.670304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f8f58ab-409b-4507-ab70-47f2b5a0c520 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:16.673495 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f8f58ab-409b-4507-ab70-47f2b5a0c520 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:16.674752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f8f58ab-409b-4507-ab70-47f2b5a0c520 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:17.102704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bc39e132-8063-448b-9e69-00cb4dfeeaff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:17.122045 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bc39e132-8063-448b-9e69-00cb4dfeeaff tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.699223 Jul 28 03:44:17.123047 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1043/1892] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:16 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:17.131991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7aa0d80f-29b3-4423-be21-b9c7e5a85d72 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:17.132687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7aa0d80f-29b3-4423-be21-b9c7e5a85d72 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:17.160199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7aa0d80f-29b3-4423-be21-b9c7e5a85d72 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:17.161231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7aa0d80f-29b3-4423-be21-b9c7e5a85d72 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:17.166848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7aa0d80f-29b3-4423-be21-b9c7e5a85d72 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:17.167597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7aa0d80f-29b3-4423-be21-b9c7e5a85d72 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:17.174664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:17.554123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7f8f58ab-409b-4507-ab70-47f2b5a0c520 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:17.568672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7f8f58ab-409b-4507-ab70-47f2b5a0c520 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:17.581327 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7f8f58ab-409b-4507-ab70-47f2b5a0c520 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:17.583117 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7f8f58ab-409b-4507-ab70-47f2b5a0c520 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.941445 Jul 28 03:44:17.600502 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 850/1893] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:16 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:17.612824 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cb08a642-0186-4862-9d36-85208a280bf3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:17.615583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cb08a642-0186-4862-9d36-85208a280bf3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:17.621378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7aa0d80f-29b3-4423-be21-b9c7e5a85d72 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:17.623402 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cb08a642-0186-4862-9d36-85208a280bf3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:17.624070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cb08a642-0186-4862-9d36-85208a280bf3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:17.625302 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cb08a642-0186-4862-9d36-85208a280bf3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:17.627373 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cb08a642-0186-4862-9d36-85208a280bf3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:17.644245 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7aa0d80f-29b3-4423-be21-b9c7e5a85d72 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.520010 Jul 28 03:44:17.650820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:17.658840 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1044/1894] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:17 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:17.669721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44f1ec1d-ea87-4d7c-9e72-ace4bc07c788 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:17.670730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-44f1ec1d-ea87-4d7c-9e72-ace4bc07c788 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:17.694291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44f1ec1d-ea87-4d7c-9e72-ace4bc07c788 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:17.703948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44f1ec1d-ea87-4d7c-9e72-ace4bc07c788 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:17.705929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44f1ec1d-ea87-4d7c-9e72-ace4bc07c788 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:17.706555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44f1ec1d-ea87-4d7c-9e72-ace4bc07c788 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:18.271623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44f1ec1d-ea87-4d7c-9e72-ace4bc07c788 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:18.303683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44f1ec1d-ea87-4d7c-9e72-ace4bc07c788 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:18.321587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44f1ec1d-ea87-4d7c-9e72-ace4bc07c788 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:18.333706 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-44f1ec1d-ea87-4d7c-9e72-ace4bc07c788 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1477 microversion: 2.25 time: 0.661667 Jul 28 03:44:18.349682 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1045/1895] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:17 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1477 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:18.379743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cb08a642-0186-4862-9d36-85208a280bf3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:18.381436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93357130-921e-4eb4-9c89-74e679b82d8f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:18.382600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93357130-921e-4eb4-9c89-74e679b82d8f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:18.398796 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cb08a642-0186-4862-9d36-85208a280bf3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.795192 Jul 28 03:44:18.399422 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 851/1896] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:17 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:18.400946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93357130-921e-4eb4-9c89-74e679b82d8f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:18.401706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93357130-921e-4eb4-9c89-74e679b82d8f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:18.403005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93357130-921e-4eb4-9c89-74e679b82d8f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:18.403664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93357130-921e-4eb4-9c89-74e679b82d8f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:18.415732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b3cb4eab-5749-429b-8a08-7cf08e50a8ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:18.416397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b3cb4eab-5749-429b-8a08-7cf08e50a8ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:18.444754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3cb4eab-5749-429b-8a08-7cf08e50a8ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:18.445212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3cb4eab-5749-429b-8a08-7cf08e50a8ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:18.446020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3cb4eab-5749-429b-8a08-7cf08e50a8ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:18.446460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3cb4eab-5749-429b-8a08-7cf08e50a8ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:18.739958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93357130-921e-4eb4-9c89-74e679b82d8f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590f4ca3ef8640529749d54793c05f46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39b785d4e7c6483e8affc1cc61a8998e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:18.756785 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93357130-921e-4eb4-9c89-74e679b82d8f tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 200 len: 1612 microversion: 2.1 time: 0.402076 Jul 28 03:44:18.770671 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1046/1897] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:18 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 1612 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:18.788794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5eb73c59-1e63-4210-b866-e6188fdc2654 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '.version_select at 0x7ffa67aa4e50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:18.794298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5eb73c59-1e63-4210-b866-e6188fdc2654 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:18.794753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5eb73c59-1e63-4210-b866-e6188fdc2654 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:18.809403 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5eb73c59-1e63-4210-b866-e6188fdc2654 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 3619 microversion: 2.25 time: 0.033179 Jul 28 03:44:18.811272 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1047/1898] 10.222.0.48 () {60 vars in 1184 bytes} [Thu Jul 28 03:44:18 2022] GET /compute/v2.1/os-migrations => generated 3619 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:18.819683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d1c51776-4e34-4abd-8554-ee5b9fe03bfe tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:18.822373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d1c51776-4e34-4abd-8554-ee5b9fe03bfe tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:18.830470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1c51776-4e34-4abd-8554-ee5b9fe03bfe tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:18.831472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1c51776-4e34-4abd-8554-ee5b9fe03bfe tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:18.833391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1c51776-4e34-4abd-8554-ee5b9fe03bfe tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:18.834130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1c51776-4e34-4abd-8554-ee5b9fe03bfe tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:19.002225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b3cb4eab-5749-429b-8a08-7cf08e50a8ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:19.033271 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b3cb4eab-5749-429b-8a08-7cf08e50a8ce tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.632299 Jul 28 03:44:19.045057 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 852/1899] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:18 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:19.079382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9d22995a-a91f-4c57-be72-1fd1d9ff00dc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:19.081499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9d22995a-a91f-4c57-be72-1fd1d9ff00dc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:19.102349 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d22995a-a91f-4c57-be72-1fd1d9ff00dc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:19.108116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d22995a-a91f-4c57-be72-1fd1d9ff00dc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:19.109314 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d22995a-a91f-4c57-be72-1fd1d9ff00dc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:19.109936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d22995a-a91f-4c57-be72-1fd1d9ff00dc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:19.624326 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9d22995a-a91f-4c57-be72-1fd1d9ff00dc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:19.649572 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9d22995a-a91f-4c57-be72-1fd1d9ff00dc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.581843 Jul 28 03:44:19.651012 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 853/1900] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:19 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:19.662011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bc6fae9b-d775-44ff-a494-24eec75c0071 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:19.665824 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bc6fae9b-d775-44ff-a494-24eec75c0071 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:19.681875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc6fae9b-d775-44ff-a494-24eec75c0071 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:19.693661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc6fae9b-d775-44ff-a494-24eec75c0071 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:19.695917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc6fae9b-d775-44ff-a494-24eec75c0071 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:19.697029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc6fae9b-d775-44ff-a494-24eec75c0071 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:19.933603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d1c51776-4e34-4abd-8554-ee5b9fe03bfe tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:19.967396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d1c51776-4e34-4abd-8554-ee5b9fe03bfe tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:19.975977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d1c51776-4e34-4abd-8554-ee5b9fe03bfe tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:19.984329 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d1c51776-4e34-4abd-8554-ee5b9fe03bfe tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 1.171855 Jul 28 03:44:19.985421 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1048/1901] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:18 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:19.997960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f6058a91-7e80-47ce-b627-764c6778186c req-1af29af9-84fe-4309-8b8f-d17736e19ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38bded12-c7e6-4c2b-bf28-bcf754421d2d", "name": "network-vif-unplugged", "status": "completed", "tag": "5e081790-bc24-4310-a3b5-8481a01f8989"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:20.024140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-bc6fae9b-d775-44ff-a494-24eec75c0071 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] Lazy-loading 'services' on Instance uuid 38bded12-c7e6-4c2b-bf28-bcf754421d2d {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:44:20.031385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f6058a91-7e80-47ce-b627-764c6778186c req-1af29af9-84fe-4309-8b8f-d17736e19ae3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:20.033212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f6058a91-7e80-47ce-b627-764c6778186c req-1af29af9-84fe-4309-8b8f-d17736e19ae3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:20.050669 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bc6fae9b-d775-44ff-a494-24eec75c0071 tempest-LiveAutoBlockMigrationV225Test-1701629270 tempest-LiveAutoBlockMigrationV225Test-1701629270-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1970 microversion: 2.25 time: 0.394400 Jul 28 03:44:20.059759 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f6058a91-7e80-47ce-b627-764c6778186c req-1af29af9-84fe-4309-8b8f-d17736e19ae3 service nova] Creating event network-vif-unplugged:5e081790-bc24-4310-a3b5-8481a01f8989 for instance 38bded12-c7e6-4c2b-bf28-bcf754421d2d on n-h2-826756-3 Jul 28 03:44:20.073963 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 854/1902] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:19 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1970 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:20.087695 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-df8b1e50-d75b-4b08-930c-d6bc7d3a9b38 req-d5ccc093-5252-4836-a305-4b6eaab80ee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44d8fc8-f642-4816-9e16-62dcc5798678", "name": "network-vif-deleted", "tag": "6a86d23f-b83d-46cb-ba4a-d646641993f9"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:20.108181 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f6058a91-7e80-47ce-b627-764c6778186c req-1af29af9-84fe-4309-8b8f-d17736e19ae3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114985 Jul 28 03:44:20.111910 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1049/1903] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:20.130260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1dbb49bb-a80a-442f-9282-d8a20a9319f9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:20.130710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-df8b1e50-d75b-4b08-930c-d6bc7d3a9b38 req-d5ccc093-5252-4836-a305-4b6eaab80ee3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:20.131413 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-df8b1e50-d75b-4b08-930c-d6bc7d3a9b38 req-d5ccc093-5252-4836-a305-4b6eaab80ee3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:20.136176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1dbb49bb-a80a-442f-9282-d8a20a9319f9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:20.163917 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-df8b1e50-d75b-4b08-930c-d6bc7d3a9b38 req-d5ccc093-5252-4836-a305-4b6eaab80ee3 service nova] Creating event network-vif-deleted:6a86d23f-b83d-46cb-ba4a-d646641993f9 for instance c44d8fc8-f642-4816-9e16-62dcc5798678 on n-h1-826756-3 Jul 28 03:44:20.173859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1dbb49bb-a80a-442f-9282-d8a20a9319f9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:20.178294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1dbb49bb-a80a-442f-9282-d8a20a9319f9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:20.183888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1dbb49bb-a80a-442f-9282-d8a20a9319f9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:20.184382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1dbb49bb-a80a-442f-9282-d8a20a9319f9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:20.188462 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-df8b1e50-d75b-4b08-930c-d6bc7d3a9b38 req-d5ccc093-5252-4836-a305-4b6eaab80ee3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108909 Jul 28 03:44:20.189149 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 855/1904] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:20.533043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4cafd2a8-15d4-4bbf-9d7f-8ba22327408e tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] Action: 'create', calling method: .version_select at 0x7ffa74201af0>, body: {"pool": null} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:20.922566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1dbb49bb-a80a-442f-9282-d8a20a9319f9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:20.936040 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1dbb49bb-a80a-442f-9282-d8a20a9319f9 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.818883 Jul 28 03:44:20.938479 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1050/1905] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:20 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:20.949269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a8fcb71a-f973-4f05-a9f4-177aff99f7e3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:20.962343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a8fcb71a-f973-4f05-a9f4-177aff99f7e3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] [instance: c44d8fc8-f642-4816-9e16-62dcc5798678] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:20.982015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8fcb71a-f973-4f05-a9f4-177aff99f7e3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:20.982629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8fcb71a-f973-4f05-a9f4-177aff99f7e3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:20.984245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8fcb71a-f973-4f05-a9f4-177aff99f7e3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:20.986369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8fcb71a-f973-4f05-a9f4-177aff99f7e3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:21.024996 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-a8fcb71a-f973-4f05-a9f4-177aff99f7e3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] HTTP exception thrown: Instance c44d8fc8-f642-4816-9e16-62dcc5798678 could not be found. Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a8fcb71a-f973-4f05-a9f4-177aff99f7e3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Request method failure captured: Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 HTTP/1.1 Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gUtKMh69amoegtKcXFpSRXNWhCR_J72C9T3wBIUXCcZYnI866G7Hj47se4lymzcz1CmIVNhCptypRMH5Cn24V6BsvujrRDT2z39QPwdOl_TQaomqVDehjSJNfrAmOpx6a3VoCztDAqjzBydmw8Xcnr0vE3tJFjCIRgv39nxAAqBoaA Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 39b785d4e7c6483e8affc1cc61a8998e Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-VolumesAdminNegativeTest-503451687 Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/39b785d4e7c6483e8affc1cc61a8998e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39b785d4e7c6483e8affc1cc61a8998e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_39b785d4e7c6483e8affc1cc61a8998e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/39b785d4e7c6483e8affc1cc61a8998e"}]}] Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-VolumesAdminNegativeTest-503451687 Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 39b785d4e7c6483e8affc1cc61a8998e Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-503451687 Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-VolumesAdminNegativeTest-503451687-project Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 590f4ca3ef8640529749d54793c05f46 Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-VolumesAdminNegativeTest-503451687-project Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c44d8fc8-f642-4816-9e16-62dcc5798678 could not be found. Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c44d8fc8-f642-4816-9e16-62dcc5798678'} Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c44d8fc8-f642-4816-9e16-62dcc5798678 could not be found. Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c44d8fc8-f642-4816-9e16-62dcc5798678 could not be found. Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:21.032451 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:21.040666 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:21.040666 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:21.040666 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:21.040666 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:21.040666 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:21.040666 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c44d8fc8-f642-4816-9e16-62dcc5798678 could not be found. Jul 28 03:44:21.040666 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:21.040666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a8fcb71a-f973-4f05-a9f4-177aff99f7e3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Returning 404 to user: Instance c44d8fc8-f642-4816-9e16-62dcc5798678 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:21.043361 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a8fcb71a-f973-4f05-a9f4-177aff99f7e3 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678" status: 404 len: 111 microversion: 2.1 time: 0.102757 Jul 28 03:44:21.044385 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1051/1906] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:20 2022] GET /compute/v2.1/servers/c44d8fc8-f642-4816-9e16-62dcc5798678 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:44:21.067068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f04b414-5fb2-4219-89d4-2e1b4c02247f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:21.069750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2f04b414-5fb2-4219-89d4-2e1b4c02247f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:21.088221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f04b414-5fb2-4219-89d4-2e1b4c02247f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:21.089045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f04b414-5fb2-4219-89d4-2e1b4c02247f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:21.093005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f04b414-5fb2-4219-89d4-2e1b4c02247f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:21.094622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f04b414-5fb2-4219-89d4-2e1b4c02247f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:21.440115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2f04b414-5fb2-4219-89d4-2e1b4c02247f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:21.450762 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2f04b414-5fb2-4219-89d4-2e1b4c02247f tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.404871 Jul 28 03:44:21.453099 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1052/1907] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:21 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:21.460721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-49f0c537-316a-431f-9f6b-784689f12b40 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:21.461832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-49f0c537-316a-431f-9f6b-784689f12b40 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:21.473878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49f0c537-316a-431f-9f6b-784689f12b40 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:21.475045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49f0c537-316a-431f-9f6b-784689f12b40 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:21.476757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49f0c537-316a-431f-9f6b-784689f12b40 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:21.478020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49f0c537-316a-431f-9f6b-784689f12b40 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:21.581414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-49f0c537-316a-431f-9f6b-784689f12b40 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:44:21.848282 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-49f0c537-316a-431f-9f6b-784689f12b40 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "DELETE /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 204 len: 0 microversion: 2.25 time: 0.393061 Jul 28 03:44:21.849002 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1053/1908] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:44:21 2022] DELETE /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:44:21.858809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7838e095-18b0-49ae-8d24-b4849e91f253 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:21.859515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7838e095-18b0-49ae-8d24-b4849e91f253 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:21.882935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7838e095-18b0-49ae-8d24-b4849e91f253 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:21.883395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7838e095-18b0-49ae-8d24-b4849e91f253 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:21.884195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7838e095-18b0-49ae-8d24-b4849e91f253 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:21.884667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7838e095-18b0-49ae-8d24-b4849e91f253 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:22.274442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7838e095-18b0-49ae-8d24-b4849e91f253 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:22.309572 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7838e095-18b0-49ae-8d24-b4849e91f253 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.454812 Jul 28 03:44:22.312209 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1054/1909] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:21 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:22.324000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-846ed113-9b89-449d-806c-7a8b16deaa89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:22.325344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-846ed113-9b89-449d-806c-7a8b16deaa89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:22.334569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-846ed113-9b89-449d-806c-7a8b16deaa89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:22.335675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-846ed113-9b89-449d-806c-7a8b16deaa89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:22.337946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-846ed113-9b89-449d-806c-7a8b16deaa89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:22.338799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-846ed113-9b89-449d-806c-7a8b16deaa89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:22.747146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-846ed113-9b89-449d-806c-7a8b16deaa89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:22.760216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-846ed113-9b89-449d-806c-7a8b16deaa89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:22.762405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-846ed113-9b89-449d-806c-7a8b16deaa89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:22.763912 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-846ed113-9b89-449d-806c-7a8b16deaa89 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.449827 Jul 28 03:44:22.764876 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1055/1910] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:22 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:22.770175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-60f94665-8a37-4ded-9ab8-2a359bed8ee4 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] Calling method '.version_select at 0x7ffa67aba1f0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:22.807197 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-60f94665-8a37-4ded-9ab8-2a359bed8ee4 tempest-VolumesAdminNegativeTest-503451687 tempest-VolumesAdminNegativeTest-503451687-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110000269" status: 202 len: 0 microversion: 2.1 time: 0.041031 Jul 28 03:44:22.808297 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1056/1911] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 03:44:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110000269 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:44:22.824413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-071ed87b-3bca-4bf0-8870-3feff0109c10 req-35953d19-6b67-4124-84e8-6c28b8d27771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-plugged", "status": "completed", "tag": "23985630-7906-4149-8966-da8b75db4ec3"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:22.857172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-071ed87b-3bca-4bf0-8870-3feff0109c10 req-35953d19-6b67-4124-84e8-6c28b8d27771 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:22.858138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-071ed87b-3bca-4bf0-8870-3feff0109c10 req-35953d19-6b67-4124-84e8-6c28b8d27771 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:22.888684 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-071ed87b-3bca-4bf0-8870-3feff0109c10 req-35953d19-6b67-4124-84e8-6c28b8d27771 service nova] Creating event network-vif-plugged:23985630-7906-4149-8966-da8b75db4ec3 for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:44:22.901917 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-071ed87b-3bca-4bf0-8870-3feff0109c10 req-35953d19-6b67-4124-84e8-6c28b8d27771 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092123 Jul 28 03:44:22.905266 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1057/1912] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:22.912917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-34cadb23-7798-4ff7-adf9-6dcd94ac88ec tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:22.915131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-34cadb23-7798-4ff7-adf9-6dcd94ac88ec tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:22.945657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34cadb23-7798-4ff7-adf9-6dcd94ac88ec tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:22.949882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34cadb23-7798-4ff7-adf9-6dcd94ac88ec tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:22.953253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34cadb23-7798-4ff7-adf9-6dcd94ac88ec tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:22.960342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34cadb23-7798-4ff7-adf9-6dcd94ac88ec tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:23.309765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-34cadb23-7798-4ff7-adf9-6dcd94ac88ec tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:23.333271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-34cadb23-7798-4ff7-adf9-6dcd94ac88ec tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:23.341817 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4cafd2a8-15d4-4bbf-9d7f-8ba22327408e tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.145115 Jul 28 03:44:23.343402 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 856/1913] 10.222.0.48 () {60 vars in 1170 bytes} [Thu Jul 28 03:44:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:23.344780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-34cadb23-7798-4ff7-adf9-6dcd94ac88ec tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:23.350838 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-34cadb23-7798-4ff7-adf9-6dcd94ac88ec tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1483 microversion: 2.25 time: 0.440044 Jul 28 03:44:23.351909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-098cef4a-c475-4ba2-b4cb-84531a81030c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:23.354143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-098cef4a-c475-4ba2-b4cb-84531a81030c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:23.364239 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1058/1914] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:22 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1483 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:23.368390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-098cef4a-c475-4ba2-b4cb-84531a81030c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:23.369670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-098cef4a-c475-4ba2-b4cb-84531a81030c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:23.371387 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-098cef4a-c475-4ba2-b4cb-84531a81030c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:23.372383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-098cef4a-c475-4ba2-b4cb-84531a81030c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:23.392205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1f7fdf79-0e7c-4129-a76b-494c9c4077af req-cbbc8df5-b381-466e-899c-df600d267e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38bded12-c7e6-4c2b-bf28-bcf754421d2d", "tag": "5e081790-bc24-4310-a3b5-8481a01f8989"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:23.447548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1f7fdf79-0e7c-4129-a76b-494c9c4077af req-cbbc8df5-b381-466e-899c-df600d267e21 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:23.448948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1f7fdf79-0e7c-4129-a76b-494c9c4077af req-cbbc8df5-b381-466e-899c-df600d267e21 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:23.479629 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1f7fdf79-0e7c-4129-a76b-494c9c4077af req-cbbc8df5-b381-466e-899c-df600d267e21 service nova] Creating event network-changed:5e081790-bc24-4310-a3b5-8481a01f8989 for instance 38bded12-c7e6-4c2b-bf28-bcf754421d2d on n-h2-826756-3 Jul 28 03:44:23.499138 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1f7fdf79-0e7c-4129-a76b-494c9c4077af req-cbbc8df5-b381-466e-899c-df600d267e21 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118951 Jul 28 03:44:23.500507 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1059/1915] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:23.520326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6da21649-015a-4977-8753-1a6c9220e747 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:23.521473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6da21649-015a-4977-8753-1a6c9220e747 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:23.529496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da21649-015a-4977-8753-1a6c9220e747 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:23.530263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da21649-015a-4977-8753-1a6c9220e747 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:23.531236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da21649-015a-4977-8753-1a6c9220e747 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:23.531849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da21649-015a-4977-8753-1a6c9220e747 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:23.755097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6da21649-015a-4977-8753-1a6c9220e747 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:23.776123 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6da21649-015a-4977-8753-1a6c9220e747 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.271884 Jul 28 03:44:23.778027 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1060/1916] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:23 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:23.789181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-767f6df3-8e99-48b0-bee9-a242cd0c030f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:23.791016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-767f6df3-8e99-48b0-bee9-a242cd0c030f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:23.811421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-767f6df3-8e99-48b0-bee9-a242cd0c030f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:23.812330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-767f6df3-8e99-48b0-bee9-a242cd0c030f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:23.813409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-767f6df3-8e99-48b0-bee9-a242cd0c030f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:23.814146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-767f6df3-8e99-48b0-bee9-a242cd0c030f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:23.992146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-098cef4a-c475-4ba2-b4cb-84531a81030c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:24.025735 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-098cef4a-c475-4ba2-b4cb-84531a81030c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.679772 Jul 28 03:44:24.028793 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 857/1917] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:23 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:24.037909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bf2300d3-7683-42b5-9669-b146a1222b3e tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] Calling method '.version_select at 0x7ffa74411040>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:24.616652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-767f6df3-8e99-48b0-bee9-a242cd0c030f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:24.632515 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bf2300d3-7683-42b5-9669-b146a1222b3e tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/d216a06c-59de-4dc4-b14b-4741b321ffb3" status: 200 len: 142 microversion: 2.1 time: 0.601870 Jul 28 03:44:24.634790 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 858/1918] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Jul 28 03:44:24 2022] GET /compute/v2.1/os-floating-ips/d216a06c-59de-4dc4-b14b-4741b321ffb3 => generated 142 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:24.641701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-16b6f478-57a9-4b06-a430-e1e23175d2d3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:24.647035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-16b6f478-57a9-4b06-a430-e1e23175d2d3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:24.647563 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-767f6df3-8e99-48b0-bee9-a242cd0c030f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.866022 Jul 28 03:44:24.650187 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1061/1919] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:23 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:24.665594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-727be37b-be96-4027-84b2-c7087765772f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:24.666693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-727be37b-be96-4027-84b2-c7087765772f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:24.666880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16b6f478-57a9-4b06-a430-e1e23175d2d3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:24.669369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16b6f478-57a9-4b06-a430-e1e23175d2d3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:24.670491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16b6f478-57a9-4b06-a430-e1e23175d2d3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:24.672988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16b6f478-57a9-4b06-a430-e1e23175d2d3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:24.683980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-727be37b-be96-4027-84b2-c7087765772f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:24.688090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-727be37b-be96-4027-84b2-c7087765772f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:24.690563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-727be37b-be96-4027-84b2-c7087765772f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:24.695570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-727be37b-be96-4027-84b2-c7087765772f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:24.949647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-727be37b-be96-4027-84b2-c7087765772f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:24.965724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-727be37b-be96-4027-84b2-c7087765772f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:24.971826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-727be37b-be96-4027-84b2-c7087765772f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:24.974792 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-727be37b-be96-4027-84b2-c7087765772f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1483 microversion: 2.25 time: 0.322894 Jul 28 03:44:24.976228 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1062/1920] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:24 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1483 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:24.984578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59c759b9-8a1e-46e6-a80b-a91b2b758b4f tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] Calling method '.version_select at 0x7ffa67aa4310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:25.334726 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59c759b9-8a1e-46e6-a80b-a91b2b758b4f tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.357096 Jul 28 03:44:25.335426 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1063/1921] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Jul 28 03:44:24 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:25.341810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47ff2706-e50b-456e-9fa9-9572366ab13a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:25.344369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-47ff2706-e50b-456e-9fa9-9572366ab13a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:25.355099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47ff2706-e50b-456e-9fa9-9572366ab13a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:25.355953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47ff2706-e50b-456e-9fa9-9572366ab13a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:25.357396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47ff2706-e50b-456e-9fa9-9572366ab13a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:25.357952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47ff2706-e50b-456e-9fa9-9572366ab13a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:25.389357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:25.586840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-47ff2706-e50b-456e-9fa9-9572366ab13a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:25.603034 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-47ff2706-e50b-456e-9fa9-9572366ab13a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.266096 Jul 28 03:44:25.617336 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1064/1922] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:25 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:25.645934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9003182f-1338-412b-a096-7c37f9f2f3ab tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:25.647171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9003182f-1338-412b-a096-7c37f9f2f3ab tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:25.659901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9003182f-1338-412b-a096-7c37f9f2f3ab tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:25.660719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9003182f-1338-412b-a096-7c37f9f2f3ab tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:25.662279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9003182f-1338-412b-a096-7c37f9f2f3ab tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:25.663074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9003182f-1338-412b-a096-7c37f9f2f3ab tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:25.770159 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-16b6f478-57a9-4b06-a430-e1e23175d2d3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:25.783715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-16b6f478-57a9-4b06-a430-e1e23175d2d3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:25.791996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-16b6f478-57a9-4b06-a430-e1e23175d2d3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:25.795131 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-16b6f478-57a9-4b06-a430-e1e23175d2d3 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 1.159086 Jul 28 03:44:25.799601 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 859/1923] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:24 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:25.805046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-22bd9feb-4edf-44a3-915c-42984ca59547 req-7b21b0e6-0d21-4a71-a2b5-a057aebd7587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38bded12-c7e6-4c2b-bf28-bcf754421d2d", "name": "network-vif-plugged", "status": "completed", "tag": "5e081790-bc24-4310-a3b5-8481a01f8989"}, {"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-plugged", "status": "completed", "tag": "63bb8bca-6b52-40f6-ad2d-1ef5bfde276f"}, {"server_uuid": "13887dd8-a0f8-4555-bc49-9d459ec1638d", "name": "network-vif-plugged", "status": "completed", "tag": "5ecc8b82-95a8-4fcb-8d59-54f537783af7"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:25.843783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-22bd9feb-4edf-44a3-915c-42984ca59547 req-7b21b0e6-0d21-4a71-a2b5-a057aebd7587 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:25.845075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-22bd9feb-4edf-44a3-915c-42984ca59547 req-7b21b0e6-0d21-4a71-a2b5-a057aebd7587 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:25.884839 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-22bd9feb-4edf-44a3-915c-42984ca59547 req-7b21b0e6-0d21-4a71-a2b5-a057aebd7587 service nova] Creating event network-vif-plugged:5e081790-bc24-4310-a3b5-8481a01f8989 for instance 38bded12-c7e6-4c2b-bf28-bcf754421d2d on n-h2-826756-3 Jul 28 03:44:25.885552 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-22bd9feb-4edf-44a3-915c-42984ca59547 req-7b21b0e6-0d21-4a71-a2b5-a057aebd7587 service nova] Creating event network-vif-plugged:63bb8bca-6b52-40f6-ad2d-1ef5bfde276f for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:44:25.886014 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-22bd9feb-4edf-44a3-915c-42984ca59547 req-7b21b0e6-0d21-4a71-a2b5-a057aebd7587 service nova] Creating event network-vif-plugged:5ecc8b82-95a8-4fcb-8d59-54f537783af7 for instance 13887dd8-a0f8-4555-bc49-9d459ec1638d on n-h2-826756-3 Jul 28 03:44:25.914728 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-22bd9feb-4edf-44a3-915c-42984ca59547 req-7b21b0e6-0d21-4a71-a2b5-a057aebd7587 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.113304 Jul 28 03:44:25.915936 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 860/1924] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:25.928199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c77970fb-3b58-491a-a1b6-a7125c69c6e9 tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] Calling method '.version_select at 0x7ffa7424c820>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:26.099215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9003182f-1338-412b-a096-7c37f9f2f3ab tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:26.122648 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9003182f-1338-412b-a096-7c37f9f2f3ab tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.503031 Jul 28 03:44:26.124871 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1065/1925] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:25 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:26.180018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb46b158-2111-4bb8-bcba-57ff41e5e4b9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:26.182494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb46b158-2111-4bb8-bcba-57ff41e5e4b9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:26.197520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb46b158-2111-4bb8-bcba-57ff41e5e4b9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:26.198304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb46b158-2111-4bb8-bcba-57ff41e5e4b9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:26.199713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb46b158-2111-4bb8-bcba-57ff41e5e4b9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:26.200792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb46b158-2111-4bb8-bcba-57ff41e5e4b9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:26.600591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb46b158-2111-4bb8-bcba-57ff41e5e4b9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:26.612487 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb46b158-2111-4bb8-bcba-57ff41e5e4b9 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.470898 Jul 28 03:44:26.613976 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1066/1926] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:26 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:26.619985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83b04f6f-b53b-49ef-9321-51895ab64e42 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:26.621459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-83b04f6f-b53b-49ef-9321-51895ab64e42 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:26.646370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83b04f6f-b53b-49ef-9321-51895ab64e42 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:26.660837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83b04f6f-b53b-49ef-9321-51895ab64e42 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:26.662218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83b04f6f-b53b-49ef-9321-51895ab64e42 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:26.662918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83b04f6f-b53b-49ef-9321-51895ab64e42 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:27.081882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-83b04f6f-b53b-49ef-9321-51895ab64e42 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:27.106681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-83b04f6f-b53b-49ef-9321-51895ab64e42 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:27.109133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-83b04f6f-b53b-49ef-9321-51895ab64e42 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:27.111228 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-83b04f6f-b53b-49ef-9321-51895ab64e42 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1483 microversion: 2.25 time: 0.495497 Jul 28 03:44:27.114193 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1067/1927] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:26 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1483 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:27.122308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a8eee4b3-7045-4cf6-bcef-5dd4fb53ee7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:27.123529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a8eee4b3-7045-4cf6-bcef-5dd4fb53ee7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:27.134253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8eee4b3-7045-4cf6-bcef-5dd4fb53ee7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:27.135487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8eee4b3-7045-4cf6-bcef-5dd4fb53ee7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:27.137779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8eee4b3-7045-4cf6-bcef-5dd4fb53ee7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:27.140406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8eee4b3-7045-4cf6-bcef-5dd4fb53ee7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:27.421646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a8eee4b3-7045-4cf6-bcef-5dd4fb53ee7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:27.434026 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a8eee4b3-7045-4cf6-bcef-5dd4fb53ee7d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.316853 Jul 28 03:44:27.435103 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1068/1928] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:27 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:27.441457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-68f96424-f6c4-4279-9ba4-2d6006dca7a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:27.443512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-68f96424-f6c4-4279-9ba4-2d6006dca7a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:27.465050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:27.467828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68f96424-f6c4-4279-9ba4-2d6006dca7a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:27.485040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68f96424-f6c4-4279-9ba4-2d6006dca7a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:27.490598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68f96424-f6c4-4279-9ba4-2d6006dca7a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:27.494075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68f96424-f6c4-4279-9ba4-2d6006dca7a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:27.869117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-68f96424-f6c4-4279-9ba4-2d6006dca7a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:27.886589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-68f96424-f6c4-4279-9ba4-2d6006dca7a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:27.890410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-68f96424-f6c4-4279-9ba4-2d6006dca7a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:27.892999 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-68f96424-f6c4-4279-9ba4-2d6006dca7a2 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.456440 Jul 28 03:44:27.906033 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1069/1929] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:27 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:27.906033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c7ef44c-ef30-4ed9-a431-72a2bee36dd6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:27.906033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5c7ef44c-ef30-4ed9-a431-72a2bee36dd6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:27.915633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c7ef44c-ef30-4ed9-a431-72a2bee36dd6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:27.915633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c7ef44c-ef30-4ed9-a431-72a2bee36dd6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:27.917272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c7ef44c-ef30-4ed9-a431-72a2bee36dd6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:27.918243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c7ef44c-ef30-4ed9-a431-72a2bee36dd6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:28.192692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5c7ef44c-ef30-4ed9-a431-72a2bee36dd6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:28.207798 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5c7ef44c-ef30-4ed9-a431-72a2bee36dd6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1317 microversion: 2.1 time: 0.311382 Jul 28 03:44:28.208416 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1070/1930] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:27 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:28.213996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1486700d-8ce7-46ef-8892-57ee4d241054 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:28.214900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1486700d-8ce7-46ef-8892-57ee4d241054 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:28.224861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1486700d-8ce7-46ef-8892-57ee4d241054 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:28.225964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1486700d-8ce7-46ef-8892-57ee4d241054 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:28.227692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1486700d-8ce7-46ef-8892-57ee4d241054 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:28.228578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1486700d-8ce7-46ef-8892-57ee4d241054 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:28.446161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1486700d-8ce7-46ef-8892-57ee4d241054 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:28.458450 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1486700d-8ce7-46ef-8892-57ee4d241054 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.247820 Jul 28 03:44:28.460491 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1071/1931] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:28 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:28.469500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-5a013e5d-3912-43df-aebc-6c014831c495 req-1ad31baf-5e41-4e28-9ef9-30bdb990175a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-plugged", "status": "completed", "tag": "643a4f2c-2609-4334-af83-0e2c8308e75c"}, {"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-plugged", "status": "completed", "tag": "3e015ffb-f6e7-43ce-ac59-41ddf8b14cdf"}, {"server_uuid": "2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f", "name": "network-vif-plugged", "status": "completed", "tag": "c8fa4d49-4763-4f59-8a0d-2644a14e4d87"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:28.490479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5a013e5d-3912-43df-aebc-6c014831c495 req-1ad31baf-5e41-4e28-9ef9-30bdb990175a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:28.491730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5a013e5d-3912-43df-aebc-6c014831c495 req-1ad31baf-5e41-4e28-9ef9-30bdb990175a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:28.521618 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5a013e5d-3912-43df-aebc-6c014831c495 req-1ad31baf-5e41-4e28-9ef9-30bdb990175a service nova] Creating event network-vif-plugged:643a4f2c-2609-4334-af83-0e2c8308e75c for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:44:28.522471 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5a013e5d-3912-43df-aebc-6c014831c495 req-1ad31baf-5e41-4e28-9ef9-30bdb990175a service nova] Creating event network-vif-plugged:3e015ffb-f6e7-43ce-ac59-41ddf8b14cdf for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:44:28.523872 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5a013e5d-3912-43df-aebc-6c014831c495 req-1ad31baf-5e41-4e28-9ef9-30bdb990175a service nova] Creating event network-vif-plugged:c8fa4d49-4763-4f59-8a0d-2644a14e4d87 for instance 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f on n-h2-826756-3 Jul 28 03:44:28.536447 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-5a013e5d-3912-43df-aebc-6c014831c495 req-1ad31baf-5e41-4e28-9ef9-30bdb990175a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.073626 Jul 28 03:44:28.537841 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1072/1932] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:28.545923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bac81774-b442-4975-917d-a07183698119 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:28.546648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bac81774-b442-4975-917d-a07183698119 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:28.555540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bac81774-b442-4975-917d-a07183698119 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:28.556172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bac81774-b442-4975-917d-a07183698119 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:28.559271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bac81774-b442-4975-917d-a07183698119 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:28.559767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bac81774-b442-4975-917d-a07183698119 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:28.681256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bac81774-b442-4975-917d-a07183698119 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:28.696876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bac81774-b442-4975-917d-a07183698119 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:28.700157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bac81774-b442-4975-917d-a07183698119 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:28.702099 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bac81774-b442-4975-917d-a07183698119 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1441 microversion: 2.25 time: 0.162203 Jul 28 03:44:28.708406 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1073/1933] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:28 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1441 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:28.708770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-078d7ab7-6543-4a8a-af0e-02219953195b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:28.709767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-078d7ab7-6543-4a8a-af0e-02219953195b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:28.717875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-078d7ab7-6543-4a8a-af0e-02219953195b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:28.718336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-078d7ab7-6543-4a8a-af0e-02219953195b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:28.719793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-078d7ab7-6543-4a8a-af0e-02219953195b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:28.720372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-078d7ab7-6543-4a8a-af0e-02219953195b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:28.976291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-078d7ab7-6543-4a8a-af0e-02219953195b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:28.987713 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-078d7ab7-6543-4a8a-af0e-02219953195b tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.283276 Jul 28 03:44:28.990996 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1074/1934] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:28 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:29.007736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f6715ddf-829e-416d-9ac0-f9d00ff810da req-536c639f-f95c-4104-ab86-8079392d21a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38bded12-c7e6-4c2b-bf28-bcf754421d2d", "name": "network-vif-deleted", "tag": "5e081790-bc24-4310-a3b5-8481a01f8989"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:29.039162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f6715ddf-829e-416d-9ac0-f9d00ff810da req-536c639f-f95c-4104-ab86-8079392d21a6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:29.040205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f6715ddf-829e-416d-9ac0-f9d00ff810da req-536c639f-f95c-4104-ab86-8079392d21a6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:29.077550 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f6715ddf-829e-416d-9ac0-f9d00ff810da req-536c639f-f95c-4104-ab86-8079392d21a6 service nova] Creating event network-vif-deleted:5e081790-bc24-4310-a3b5-8481a01f8989 for instance 38bded12-c7e6-4c2b-bf28-bcf754421d2d on n-h2-826756-3 Jul 28 03:44:29.089208 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f6715ddf-829e-416d-9ac0-f9d00ff810da req-536c639f-f95c-4104-ab86-8079392d21a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096166 Jul 28 03:44:29.090731 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1075/1935] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:29.108241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-20aff18a-beb5-474e-a665-883cf7339beb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:29.109521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-20aff18a-beb5-474e-a665-883cf7339beb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:29.123230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20aff18a-beb5-474e-a665-883cf7339beb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:29.123817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20aff18a-beb5-474e-a665-883cf7339beb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:29.125227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20aff18a-beb5-474e-a665-883cf7339beb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:29.125905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20aff18a-beb5-474e-a665-883cf7339beb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:29.450227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-20aff18a-beb5-474e-a665-883cf7339beb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:29.467633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-20aff18a-beb5-474e-a665-883cf7339beb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:29.469875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-20aff18a-beb5-474e-a665-883cf7339beb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:29.471598 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-20aff18a-beb5-474e-a665-883cf7339beb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.379003 Jul 28 03:44:29.473010 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1076/1936] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:29 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:29.482128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2b9376b1-a906-48b1-9ed8-e17af195eded tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:29.482437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2b9376b1-a906-48b1-9ed8-e17af195eded tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:29.505722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b9376b1-a906-48b1-9ed8-e17af195eded tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:29.507203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b9376b1-a906-48b1-9ed8-e17af195eded tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:29.515948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b9376b1-a906-48b1-9ed8-e17af195eded tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:29.522473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b9376b1-a906-48b1-9ed8-e17af195eded tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:29.725671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2b9376b1-a906-48b1-9ed8-e17af195eded tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:29.741918 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2b9376b1-a906-48b1-9ed8-e17af195eded tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1466 microversion: 2.1 time: 0.265173 Jul 28 03:44:29.743039 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1077/1937] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:29 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1466 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:29.748845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b235e5e3-8726-450a-ac53-d87e3ac53690 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:29.749598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b235e5e3-8726-450a-ac53-d87e3ac53690 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:29.757669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b235e5e3-8726-450a-ac53-d87e3ac53690 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:29.758218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b235e5e3-8726-450a-ac53-d87e3ac53690 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:29.759100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b235e5e3-8726-450a-ac53-d87e3ac53690 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:29.759600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b235e5e3-8726-450a-ac53-d87e3ac53690 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:29.793373 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c77970fb-3b58-491a-a1b6-a7125c69c6e9 tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/d216a06c-59de-4dc4-b14b-4741b321ffb3" status: 202 len: 0 microversion: 2.1 time: 3.875252 Jul 28 03:44:29.797158 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 861/1938] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:44:25 2022] DELETE /compute/v2.1/os-floating-ips/d216a06c-59de-4dc4-b14b-4741b321ffb3 => generated 0 bytes in 3877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:44:29.798484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0a6e9ebc-c39e-4ad7-8444-0c8690c7bc00 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:29.799265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0a6e9ebc-c39e-4ad7-8444-0c8690c7bc00 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:29.810091 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a6e9ebc-c39e-4ad7-8444-0c8690c7bc00 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:29.810525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a6e9ebc-c39e-4ad7-8444-0c8690c7bc00 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:29.811322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a6e9ebc-c39e-4ad7-8444-0c8690c7bc00 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:29.811752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a6e9ebc-c39e-4ad7-8444-0c8690c7bc00 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:29.965927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0a6e9ebc-c39e-4ad7-8444-0c8690c7bc00 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:29.987535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0a6e9ebc-c39e-4ad7-8444-0c8690c7bc00 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:29.989125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0a6e9ebc-c39e-4ad7-8444-0c8690c7bc00 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:29.990333 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0a6e9ebc-c39e-4ad7-8444-0c8690c7bc00 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1266 microversion: 2.25 time: 0.195657 Jul 28 03:44:30.000452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b235e5e3-8726-450a-ac53-d87e3ac53690 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:30.005283 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 862/1939] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:29 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:30.010006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f79150c4-302d-479c-96eb-0d4be4fa3013 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:30.010925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f79150c4-302d-479c-96eb-0d4be4fa3013 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:30.014348 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b235e5e3-8726-450a-ac53-d87e3ac53690 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.269728 Jul 28 03:44:30.015168 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1078/1940] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:29 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:30.031397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f79150c4-302d-479c-96eb-0d4be4fa3013 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:30.037678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-26b46080-f1b5-472b-b881-f389a02744a5 tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] Action: 'create', calling method: .version_select at 0x7ffa67ae7f70>, body: {"pool": null} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:30.038437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f79150c4-302d-479c-96eb-0d4be4fa3013 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:30.039611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f79150c4-302d-479c-96eb-0d4be4fa3013 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:30.040259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f79150c4-302d-479c-96eb-0d4be4fa3013 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:30.413686 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f79150c4-302d-479c-96eb-0d4be4fa3013 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1617 microversion: 2.1 time: 0.407682 Jul 28 03:44:30.416371 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 863/1941] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:30 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1617 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:30.426305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5be87a1c-0f9b-45e3-965e-ecf6a32d1b9c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:30.431767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5be87a1c-0f9b-45e3-965e-ecf6a32d1b9c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:30.456289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5be87a1c-0f9b-45e3-965e-ecf6a32d1b9c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:30.457101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5be87a1c-0f9b-45e3-965e-ecf6a32d1b9c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:30.459476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5be87a1c-0f9b-45e3-965e-ecf6a32d1b9c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:30.460252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5be87a1c-0f9b-45e3-965e-ecf6a32d1b9c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:30.822066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5be87a1c-0f9b-45e3-965e-ecf6a32d1b9c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:30.837338 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5be87a1c-0f9b-45e3-965e-ecf6a32d1b9c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.419311 Jul 28 03:44:30.853658 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 864/1942] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:30 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:30.860046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e6f4878f-ac1c-45cb-9889-1236bd9321c6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:30.861219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e6f4878f-ac1c-45cb-9889-1236bd9321c6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:30.870518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6f4878f-ac1c-45cb-9889-1236bd9321c6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:30.871247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6f4878f-ac1c-45cb-9889-1236bd9321c6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:30.873797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6f4878f-ac1c-45cb-9889-1236bd9321c6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:30.874691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6f4878f-ac1c-45cb-9889-1236bd9321c6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:31.273873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e6f4878f-ac1c-45cb-9889-1236bd9321c6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:31.288643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e6f4878f-ac1c-45cb-9889-1236bd9321c6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:31.291283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e6f4878f-ac1c-45cb-9889-1236bd9321c6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:31.293162 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e6f4878f-ac1c-45cb-9889-1236bd9321c6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1872 microversion: 2.42 time: 0.438070 Jul 28 03:44:31.308536 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 865/1943] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:30 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1872 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:31.315172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2111104635", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["928e7a74-9453-46fe-a1dd-ebc281e8ea52"]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:31.418548 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:44:31.830844 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:44:31.831824 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:44:31.832140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:44:31.833227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:44:31.834151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:44:31.850208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:31.851101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:31.852197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:31.853077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:31.878630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:44:31.894128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:44:31.919747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:44:31.926519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:44:32.046760 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9eba674d-a417-433a-ba7f-548b71939682 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738215 Jul 28 03:44:32.049204 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 866/1944] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:44:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:44:32.060792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-220ba1ee-f441-4f1c-8ea5-1b9ef39a5e9d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:32.062359 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-220ba1ee-f441-4f1c-8ea5-1b9ef39a5e9d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:32.071706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-220ba1ee-f441-4f1c-8ea5-1b9ef39a5e9d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:32.073588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-220ba1ee-f441-4f1c-8ea5-1b9ef39a5e9d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:32.074688 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-220ba1ee-f441-4f1c-8ea5-1b9ef39a5e9d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:32.075531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-220ba1ee-f441-4f1c-8ea5-1b9ef39a5e9d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:32.217873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-220ba1ee-f441-4f1c-8ea5-1b9ef39a5e9d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:32.229385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-220ba1ee-f441-4f1c-8ea5-1b9ef39a5e9d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:32.232763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-220ba1ee-f441-4f1c-8ea5-1b9ef39a5e9d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:32.234590 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-220ba1ee-f441-4f1c-8ea5-1b9ef39a5e9d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1266 microversion: 2.25 time: 0.183331 Jul 28 03:44:32.235769 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 867/1945] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:32 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:32.240690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b4326039-5bb4-4761-b924-ed2fb82cb685 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:32.241635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b4326039-5bb4-4761-b924-ed2fb82cb685 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:32.251836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b4326039-5bb4-4761-b924-ed2fb82cb685 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:32.253944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b4326039-5bb4-4761-b924-ed2fb82cb685 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:32.255100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b4326039-5bb4-4761-b924-ed2fb82cb685 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:32.255865 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b4326039-5bb4-4761-b924-ed2fb82cb685 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:32.581964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b4326039-5bb4-4761-b924-ed2fb82cb685 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:32.604209 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b4326039-5bb4-4761-b924-ed2fb82cb685 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1308 microversion: 2.1 time: 0.366859 Jul 28 03:44:32.615179 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 868/1946] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:32 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1308 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:32.624525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-03f9d1f4-9d3c-481f-9a46-1669b55b0c6c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:32.625391 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-03f9d1f4-9d3c-481f-9a46-1669b55b0c6c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:32.643278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03f9d1f4-9d3c-481f-9a46-1669b55b0c6c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:32.646057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03f9d1f4-9d3c-481f-9a46-1669b55b0c6c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:32.647135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03f9d1f4-9d3c-481f-9a46-1669b55b0c6c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:32.647699 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03f9d1f4-9d3c-481f-9a46-1669b55b0c6c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:32.876136 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-26b46080-f1b5-472b-b881-f389a02744a5 tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.858283 Jul 28 03:44:32.878919 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1079/1947] 10.222.0.48 () {60 vars in 1170 bytes} [Thu Jul 28 03:44:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:32.893358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83bfb916-13f5-4b69-bf4e-5fed39a8d1f8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:32.896009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-83bfb916-13f5-4b69-bf4e-5fed39a8d1f8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:32.924540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83bfb916-13f5-4b69-bf4e-5fed39a8d1f8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:32.926981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83bfb916-13f5-4b69-bf4e-5fed39a8d1f8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:32.934707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83bfb916-13f5-4b69-bf4e-5fed39a8d1f8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:32.937516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83bfb916-13f5-4b69-bf4e-5fed39a8d1f8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:33.083298 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-03f9d1f4-9d3c-481f-9a46-1669b55b0c6c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:33.100514 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-03f9d1f4-9d3c-481f-9a46-1669b55b0c6c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.483570 Jul 28 03:44:33.101522 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 869/1948] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:32 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:33.111173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-99dbf742-e633-4030-a5b7-11cb891cd98d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:33.124292 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-99dbf742-e633-4030-a5b7-11cb891cd98d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:33.155051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:33.308387 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-99dbf742-e633-4030-a5b7-11cb891cd98d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:33.324934 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-99dbf742-e633-4030-a5b7-11cb891cd98d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1217 microversion: 2.1 time: 0.220433 Jul 28 03:44:33.326850 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 870/1949] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:33 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1217 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:33.337868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d9df6a51-a56f-4d0f-b593-fb31cbfd6096 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:33.339457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d9df6a51-a56f-4d0f-b593-fb31cbfd6096 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:33.369943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d9df6a51-a56f-4d0f-b593-fb31cbfd6096 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:33.372083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d9df6a51-a56f-4d0f-b593-fb31cbfd6096 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:33.373788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d9df6a51-a56f-4d0f-b593-fb31cbfd6096 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:33.374721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d9df6a51-a56f-4d0f-b593-fb31cbfd6096 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:33.456130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-83bfb916-13f5-4b69-bf4e-5fed39a8d1f8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:33.469523 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-83bfb916-13f5-4b69-bf4e-5fed39a8d1f8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.587985 Jul 28 03:44:33.470709 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1080/1950] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:32 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:33.476804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-38799c8e-62ee-4402-b3fe-9273738de973 tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] Calling method '.version_select at 0x7ffa67a9c5e0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:33.687539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d9df6a51-a56f-4d0f-b593-fb31cbfd6096 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:33.732857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d9df6a51-a56f-4d0f-b593-fb31cbfd6096 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:33.736205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d9df6a51-a56f-4d0f-b593-fb31cbfd6096 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:33.738897 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d9df6a51-a56f-4d0f-b593-fb31cbfd6096 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 2827 microversion: 2.42 time: 0.409830 Jul 28 03:44:33.740161 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 871/1951] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:33 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 2827 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:33.763116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9182ba64-aba2-4154-bd1f-e5122cf62c82 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:33.765561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9182ba64-aba2-4154-bd1f-e5122cf62c82 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:33.777405 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9182ba64-aba2-4154-bd1f-e5122cf62c82 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:33.778582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9182ba64-aba2-4154-bd1f-e5122cf62c82 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:33.780662 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9182ba64-aba2-4154-bd1f-e5122cf62c82 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:33.782471 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9182ba64-aba2-4154-bd1f-e5122cf62c82 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:34.028254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9182ba64-aba2-4154-bd1f-e5122cf62c82 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:34.066789 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9182ba64-aba2-4154-bd1f-e5122cf62c82 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.323465 Jul 28 03:44:34.078171 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 872/1952] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:33 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:34.087016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-70d98218-0188-4618-8d3c-e03d8a5673f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:34.092446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-70d98218-0188-4618-8d3c-e03d8a5673f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:34.116630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70d98218-0188-4618-8d3c-e03d8a5673f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:34.118254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70d98218-0188-4618-8d3c-e03d8a5673f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:34.119847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70d98218-0188-4618-8d3c-e03d8a5673f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:34.120769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70d98218-0188-4618-8d3c-e03d8a5673f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:34.284931 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-70d98218-0188-4618-8d3c-e03d8a5673f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:34.291162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:34.300505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-70d98218-0188-4618-8d3c-e03d8a5673f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:34.302460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-70d98218-0188-4618-8d3c-e03d8a5673f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:34.304084 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-70d98218-0188-4618-8d3c-e03d8a5673f8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1266 microversion: 2.25 time: 0.224193 Jul 28 03:44:34.305296 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 873/1953] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:34 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:34.310731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8e981f11-068a-4753-8629-ec91ee1030ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:34.311717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8e981f11-068a-4753-8629-ec91ee1030ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:34.319928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e981f11-068a-4753-8629-ec91ee1030ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:34.320736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e981f11-068a-4753-8629-ec91ee1030ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:34.321713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e981f11-068a-4753-8629-ec91ee1030ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:34.322307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e981f11-068a-4753-8629-ec91ee1030ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:34.513793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8e981f11-068a-4753-8629-ec91ee1030ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:34.530672 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8e981f11-068a-4753-8629-ec91ee1030ae tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1488 microversion: 2.1 time: 0.223313 Jul 28 03:44:34.531956 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 874/1954] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:34 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1488 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:34.544435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d849aedc-4245-431a-86eb-ce86ef64001a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:34.545606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d849aedc-4245-431a-86eb-ce86ef64001a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:34.555203 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d849aedc-4245-431a-86eb-ce86ef64001a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:34.556073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d849aedc-4245-431a-86eb-ce86ef64001a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:34.557062 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d849aedc-4245-431a-86eb-ce86ef64001a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:34.557603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d849aedc-4245-431a-86eb-ce86ef64001a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:34.866418 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d849aedc-4245-431a-86eb-ce86ef64001a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.330951 Jul 28 03:44:34.873940 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 875/1955] 10.222.0.48 () {60 vars in 1316 bytes} [Thu Jul 28 03:44:34 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b/os-interface => generated 1828 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:34.899082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-87020a0a-b72d-4487-b709-7cc2ae3de003 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:34.900208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-87020a0a-b72d-4487-b709-7cc2ae3de003 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:34.910778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-87020a0a-b72d-4487-b709-7cc2ae3de003 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:34.911847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-87020a0a-b72d-4487-b709-7cc2ae3de003 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:34.914476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-87020a0a-b72d-4487-b709-7cc2ae3de003 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:34.915588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-87020a0a-b72d-4487-b709-7cc2ae3de003 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:35.540812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-87020a0a-b72d-4487-b709-7cc2ae3de003 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:35.553337 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-87020a0a-b72d-4487-b709-7cc2ae3de003 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.676516 Jul 28 03:44:35.553943 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 876/1956] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:34 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:35.568464 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6688f890-1704-41c1-a917-72664cc67375 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:35.570121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6688f890-1704-41c1-a917-72664cc67375 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:35.597456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6688f890-1704-41c1-a917-72664cc67375 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:35.597905 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6688f890-1704-41c1-a917-72664cc67375 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:35.598693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6688f890-1704-41c1-a917-72664cc67375 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:35.599129 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6688f890-1704-41c1-a917-72664cc67375 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:35.749750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6688f890-1704-41c1-a917-72664cc67375 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:35.772129 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6688f890-1704-41c1-a917-72664cc67375 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1277 microversion: 2.1 time: 0.216466 Jul 28 03:44:35.784763 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 877/1957] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:35 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1277 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:35.790854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4715eb05-2ea7-4d3d-8f5e-f268cce1f534 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:35.791724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4715eb05-2ea7-4d3d-8f5e-f268cce1f534 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:35.806627 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4715eb05-2ea7-4d3d-8f5e-f268cce1f534 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:35.807296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4715eb05-2ea7-4d3d-8f5e-f268cce1f534 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:35.808483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4715eb05-2ea7-4d3d-8f5e-f268cce1f534 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:35.809115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4715eb05-2ea7-4d3d-8f5e-f268cce1f534 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:35.813599 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-38799c8e-62ee-4402-b3fe-9273738de973 tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/3c6bb8b9-7147-400b-bdf6-add643813032" status: 202 len: 0 microversion: 2.1 time: 2.340795 Jul 28 03:44:35.816803 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1081/1958] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:44:33 2022] DELETE /compute/v2.1/os-floating-ips/3c6bb8b9-7147-400b-bdf6-add643813032 => generated 0 bytes in 2346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:44:35.832743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e3474920-0a69-4e5d-bce7-303e76cd2fb6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-887252887"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:35.843288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e3474920-0a69-4e5d-bce7-303e76cd2fb6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:35.852589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3474920-0a69-4e5d-bce7-303e76cd2fb6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:35.853046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3474920-0a69-4e5d-bce7-303e76cd2fb6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:35.856202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3474920-0a69-4e5d-bce7-303e76cd2fb6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:35.858014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3474920-0a69-4e5d-bce7-303e76cd2fb6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:36.228934 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e3474920-0a69-4e5d-bce7-303e76cd2fb6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "POST /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f/action" status: 202 len: 0 microversion: 2.1 time: 0.407151 Jul 28 03:44:36.239947 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1082/1959] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:44:35 2022] POST /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 03:44:36.239947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3920c53d-bb2c-468d-b923-fefed39bd3a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:36.239947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3920c53d-bb2c-468d-b923-fefed39bd3a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:36.246647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3920c53d-bb2c-468d-b923-fefed39bd3a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:36.247108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3920c53d-bb2c-468d-b923-fefed39bd3a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:36.247897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3920c53d-bb2c-468d-b923-fefed39bd3a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:36.248427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3920c53d-bb2c-468d-b923-fefed39bd3a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:36.276274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:36.336932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3920c53d-bb2c-468d-b923-fefed39bd3a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:36.349138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3920c53d-bb2c-468d-b923-fefed39bd3a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:36.352707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3920c53d-bb2c-468d-b923-fefed39bd3a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:36.354675 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3920c53d-bb2c-468d-b923-fefed39bd3a5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1266 microversion: 2.25 time: 0.122215 Jul 28 03:44:36.355892 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1083/1960] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:36 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:36.361686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b7c7b59d-4878-4af3-a447-9697f8dd7c66 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:36.362588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b7c7b59d-4878-4af3-a447-9697f8dd7c66 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:36.370834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7c7b59d-4878-4af3-a447-9697f8dd7c66 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:36.371676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7c7b59d-4878-4af3-a447-9697f8dd7c66 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:36.372729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7c7b59d-4878-4af3-a447-9697f8dd7c66 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:36.373413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7c7b59d-4878-4af3-a447-9697f8dd7c66 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:36.647923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b7c7b59d-4878-4af3-a447-9697f8dd7c66 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:36.662908 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b7c7b59d-4878-4af3-a447-9697f8dd7c66 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.304602 Jul 28 03:44:36.665467 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1084/1961] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:36 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:36.676806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6abeadb8-454d-4067-9942-f916ac628d24 tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] Calling method '.version_select at 0x7ffa67ac0af0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:36.773579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG neutronclient.v2_0.client [None req-6abeadb8-454d-4067-9942-f916ac628d24 tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3c6bb8b9-7147-400b-bdf6-add643813032 could not be found", "detail": ""}} {{(pid=126071) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:44:36.774624 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-6abeadb8-454d-4067-9942-f916ac628d24 tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] HTTP exception thrown: Floating IP not found for ID 3c6bb8b9-7147-400b-bdf6-add643813032 Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6abeadb8-454d-4067-9942-f916ac628d24 tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] Request method failure captured: Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-floating-ips/3c6bb8b9-7147-400b-bdf6-add643813032 HTTP/1.1 Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gYTpCHVuhXLyYqlesUJfdrS0iej3KxQGvR4jBR1LMBHTfJ_AtCTKuqa2iPgwK3KMmsKrN7GwmhfeCv_0LW0OAydPo6WG6BgY-urMlsG-j7c9fTxlNOf7XJVTp5H4D-UWtPM5ZJJDnZzSO70O9_RIOAllEbq53LRmrehUHg0LGjoevY Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 385caa831c5f4771aa1099023969d5f0 Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FloatingIPsTestJSON-1383372128 Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/385caa831c5f4771aa1099023969d5f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/385caa831c5f4771aa1099023969d5f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_385caa831c5f4771aa1099023969d5f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/385caa831c5f4771aa1099023969d5f0"}]}] Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FloatingIPsTestJSON-1383372128 Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 385caa831c5f4771aa1099023969d5f0 Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1383372128 Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FloatingIPsTestJSON-1383372128-project Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: acbb3f47756445bba471a0267f708606 Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FloatingIPsTestJSON-1383372128-project Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: exception: Floating IP not found for ID 3c6bb8b9-7147-400b-bdf6-add643813032 Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '3c6bb8b9-7147-400b-bdf6-add643813032'} Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3c6bb8b9-7147-400b-bdf6-add643813032 could not be found Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-08b4c03a-21d9-467e-9e04-776a445b808a'] Jul 28 03:44:36.778398 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3c6bb8b9-7147-400b-bdf6-add643813032. Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3c6bb8b9-7147-400b-bdf6-add643813032 Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3c6bb8b9-7147-400b-bdf6-add643813032 Jul 28 03:44:36.786832 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:36.792706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6abeadb8-454d-4067-9942-f916ac628d24 tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] Returning 404 to user: Floating IP not found for ID 3c6bb8b9-7147-400b-bdf6-add643813032 {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:36.793233 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6abeadb8-454d-4067-9942-f916ac628d24 tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/3c6bb8b9-7147-400b-bdf6-add643813032" status: 404 len: 111 microversion: 2.1 time: 0.127300 Jul 28 03:44:36.797844 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1085/1962] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Jul 28 03:44:36 2022] GET /compute/v2.1/os-floating-ips/3c6bb8b9-7147-400b-bdf6-add643813032 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:44:36.805541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-09e014f4-4513-4daa-9867-81b77dfdb08b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa7409c280>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:36.865002 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-09e014f4-4513-4daa-9867-81b77dfdb08b tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/e12660cb-4b71-4017-bfc8-f0bf29bac605" status: 200 len: 1411 microversion: 2.1 time: 0.065452 Jul 28 03:44:36.876423 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1086/1963] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:44:36 2022] GET /compute/v2.1/images/e12660cb-4b71-4017-bfc8-f0bf29bac605 => generated 1411 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:36.876423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-954fb698-5bf7-4b13-8aab-b6b5c55309d2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:36.876423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-954fb698-5bf7-4b13-8aab-b6b5c55309d2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:36.895589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-954fb698-5bf7-4b13-8aab-b6b5c55309d2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:36.898341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-954fb698-5bf7-4b13-8aab-b6b5c55309d2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:36.899248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-954fb698-5bf7-4b13-8aab-b6b5c55309d2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:36.899707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-954fb698-5bf7-4b13-8aab-b6b5c55309d2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:37.009321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-954fb698-5bf7-4b13-8aab-b6b5c55309d2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:37.023972 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-954fb698-5bf7-4b13-8aab-b6b5c55309d2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1275 microversion: 2.1 time: 0.155527 Jul 28 03:44:37.025707 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1087/1964] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:36 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:37.035761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5e978e9d-7767-48a1-b2d7-093ebbbd064d tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] Calling method '.version_select at 0x7ffa67ae7e50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:37.123551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG neutronclient.v2_0.client [None req-5e978e9d-7767-48a1-b2d7-093ebbbd064d tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3c6bb8b9-7147-400b-bdf6-add643813032 could not be found", "detail": ""}} {{(pid=126071) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:44:37.125302 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-5e978e9d-7767-48a1-b2d7-093ebbbd064d tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] HTTP exception thrown: Floating IP not found for ID 3c6bb8b9-7147-400b-bdf6-add643813032 Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5e978e9d-7767-48a1-b2d7-093ebbbd064d tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] Request method failure captured: Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/os-floating-ips/3c6bb8b9-7147-400b-bdf6-add643813032 HTTP/1.1 Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gYTpCHVuhXLyYqlesUJfdrS0iej3KxQGvR4jBR1LMBHTfJ_AtCTKuqa2iPgwK3KMmsKrN7GwmhfeCv_0LW0OAydPo6WG6BgY-urMlsG-j7c9fTxlNOf7XJVTp5H4D-UWtPM5ZJJDnZzSO70O9_RIOAllEbq53LRmrehUHg0LGjoevY Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 385caa831c5f4771aa1099023969d5f0 Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FloatingIPsTestJSON-1383372128 Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/385caa831c5f4771aa1099023969d5f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/385caa831c5f4771aa1099023969d5f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_385caa831c5f4771aa1099023969d5f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/385caa831c5f4771aa1099023969d5f0"}]}] Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FloatingIPsTestJSON-1383372128 Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 385caa831c5f4771aa1099023969d5f0 Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1383372128 Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FloatingIPsTestJSON-1383372128-project Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: acbb3f47756445bba471a0267f708606 Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FloatingIPsTestJSON-1383372128-project Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: exception: Floating IP not found for ID 3c6bb8b9-7147-400b-bdf6-add643813032 Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '3c6bb8b9-7147-400b-bdf6-add643813032'} Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3c6bb8b9-7147-400b-bdf6-add643813032 could not be found Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a80d01b6-86b9-4f33-b628-994e77679e60'] Jul 28 03:44:37.129942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3c6bb8b9-7147-400b-bdf6-add643813032. Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3c6bb8b9-7147-400b-bdf6-add643813032 Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3c6bb8b9-7147-400b-bdf6-add643813032 Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5e978e9d-7767-48a1-b2d7-093ebbbd064d tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] Returning 404 to user: Floating IP not found for ID 3c6bb8b9-7147-400b-bdf6-add643813032 {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:37.139053 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5e978e9d-7767-48a1-b2d7-093ebbbd064d tempest-FloatingIPsTestJSON-1383372128 tempest-FloatingIPsTestJSON-1383372128-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/3c6bb8b9-7147-400b-bdf6-add643813032" status: 404 len: 111 microversion: 2.1 time: 0.108600 Jul 28 03:44:37.156031 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1088/1965] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:44:37 2022] DELETE /compute/v2.1/os-floating-ips/3c6bb8b9-7147-400b-bdf6-add643813032 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:44:37.174239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3494cf9d-0b2a-48a8-bd9e-ad2d4cff035f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa67aba8b0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:37.244377 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4715eb05-2ea7-4d3d-8f5e-f268cce1f534 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:37.261545 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3494cf9d-0b2a-48a8-bd9e-ad2d4cff035f tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/e12660cb-4b71-4017-bfc8-f0bf29bac605" status: 200 len: 1411 microversion: 2.1 time: 0.118608 Jul 28 03:44:37.271029 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1089/1966] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:44:37 2022] GET /compute/v2.1/images/e12660cb-4b71-4017-bfc8-f0bf29bac605 => generated 1411 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:37.271029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a230061a-2897-47fa-ab48-2d8ef9d2e0fa req-72b9e279-0a83-4b70-93e2-f0dd76b32d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42fcd75-f3a9-4abb-a5fd-f8c600bbb272", "name": "network-vif-unplugged", "status": "completed", "tag": "c1bcc2ac-62d4-4a34-ab01-789e5b7a9432"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:37.277391 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4715eb05-2ea7-4d3d-8f5e-f268cce1f534 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 1.490922 Jul 28 03:44:37.278403 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 878/1967] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:35 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:37.293917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-148299614", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f76c85a0-c616-4cd2-a4d5-29a90d49abe8"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:37.310661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a230061a-2897-47fa-ab48-2d8ef9d2e0fa req-72b9e279-0a83-4b70-93e2-f0dd76b32d67 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:37.316877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a230061a-2897-47fa-ab48-2d8ef9d2e0fa req-72b9e279-0a83-4b70-93e2-f0dd76b32d67 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:37.344613 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a230061a-2897-47fa-ab48-2d8ef9d2e0fa req-72b9e279-0a83-4b70-93e2-f0dd76b32d67 service nova] Creating event network-vif-unplugged:c1bcc2ac-62d4-4a34-ab01-789e5b7a9432 for instance c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 on n-h1-826756-3 Jul 28 03:44:37.354632 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a230061a-2897-47fa-ab48-2d8ef9d2e0fa req-72b9e279-0a83-4b70-93e2-f0dd76b32d67 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089612 Jul 28 03:44:37.356018 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1090/1968] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:37.370497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-226357b4-43b5-497b-98a8-902e32ef9a3d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa67abaa60>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:37.521878 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] validate_networks() for [('f76c85a0-c616-4cd2-a4d5-29a90d49abe8', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:44:37.765865 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-226357b4-43b5-497b-98a8-902e32ef9a3d tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/images/e12660cb-4b71-4017-bfc8-f0bf29bac605" status: 204 len: 0 microversion: 2.1 time: 0.407311 Jul 28 03:44:37.766816 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1091/1969] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:37 2022] DELETE /compute/v2.1/images/e12660cb-4b71-4017-bfc8-f0bf29bac605 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:44:37.772667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-68e14282-e3f2-48cd-8d54-8ba60ba25e45 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:37.773836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-68e14282-e3f2-48cd-8d54-8ba60ba25e45 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:37.782001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68e14282-e3f2-48cd-8d54-8ba60ba25e45 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:37.782792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68e14282-e3f2-48cd-8d54-8ba60ba25e45 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:37.783981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68e14282-e3f2-48cd-8d54-8ba60ba25e45 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:37.784656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68e14282-e3f2-48cd-8d54-8ba60ba25e45 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:37.901803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68e14282-e3f2-48cd-8d54-8ba60ba25e45 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:37.907264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68e14282-e3f2-48cd-8d54-8ba60ba25e45 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:37.908403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-68e14282-e3f2-48cd-8d54-8ba60ba25e45 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lazy-loading 'fault' on Instance uuid 38bded12-c7e6-4c2b-bf28-bcf754421d2d {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:44:38.146584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-68e14282-e3f2-48cd-8d54-8ba60ba25e45 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:38.179661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-68e14282-e3f2-48cd-8d54-8ba60ba25e45 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:38.187418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-68e14282-e3f2-48cd-8d54-8ba60ba25e45 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:38.190076 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-68e14282-e3f2-48cd-8d54-8ba60ba25e45 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 200 len: 1194 microversion: 2.25 time: 0.421350 Jul 28 03:44:38.209594 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1092/1970] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:37 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 1194 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:38.216110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6cb2e9d0-5c00-475b-a623-485ca72217ee tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa67ae7160>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:38.257991 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-6cb2e9d0-5c00-475b-a623-485ca72217ee tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] HTTP exception thrown: Image not found. Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6cb2e9d0-5c00-475b-a623-485ca72217ee tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Request method failure captured: Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/images/e12660cb-4b71-4017-bfc8-f0bf29bac605 HTTP/1.1 Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gURW2DZ_bd0B85qqpr6BuKnecwrMH1ox8Mm4qGEky3ekGbdUgGPac090nRaevuibwJaohBZAx3PeqFchI9xZbKihW-Gz06JcziQauKwCN1_Nd5A1tP2PF1UBhASwJUz8vCgrO1Gi1ADDGQ0-EVjqZdTCNrEovFKKogJJCQSqMjlTKk Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}] Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesTestJSON-921835921 Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 670b269eb20c416e9f43f8d4e43ded45 Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: exception: Image not found. Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'e12660cb-4b71-4017-bfc8-f0bf29bac605'} Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e12660cb-4b71-4017-bfc8-f0bf29bac605 Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 03:44:38.261651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e12660cb-4b71-4017-bfc8-f0bf29bac605 could not be found. Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6cb2e9d0-5c00-475b-a623-485ca72217ee tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Returning 404 to user: Image not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6cb2e9d0-5c00-475b-a623-485ca72217ee tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/images/e12660cb-4b71-4017-bfc8-f0bf29bac605" status: 404 len: 62 microversion: 2.1 time: 0.058727 Jul 28 03:44:38.273624 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1093/1971] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:44:38 2022] GET /compute/v2.1/images/e12660cb-4b71-4017-bfc8-f0bf29bac605 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:44:38.289534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2b2d49f-df9e-4455-b625-17b17a3d1347 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:38.289534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2b2d49f-df9e-4455-b625-17b17a3d1347 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:38.306460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2b2d49f-df9e-4455-b625-17b17a3d1347 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:38.307982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2b2d49f-df9e-4455-b625-17b17a3d1347 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:38.315547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2b2d49f-df9e-4455-b625-17b17a3d1347 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:38.319464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2b2d49f-df9e-4455-b625-17b17a3d1347 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:38.590841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b2b2d49f-df9e-4455-b625-17b17a3d1347 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:38.605261 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b2b2d49f-df9e-4455-b625-17b17a3d1347 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1275 microversion: 2.1 time: 0.339083 Jul 28 03:44:38.606757 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1094/1972] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:38 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1275 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:38.621871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2222bf5c-b62f-4b12-bb93-7dd64a810416 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:38.625589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2222bf5c-b62f-4b12-bb93-7dd64a810416 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:38.645148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2222bf5c-b62f-4b12-bb93-7dd64a810416 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:38.646056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2222bf5c-b62f-4b12-bb93-7dd64a810416 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:38.647249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2222bf5c-b62f-4b12-bb93-7dd64a810416 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:38.648250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2222bf5c-b62f-4b12-bb93-7dd64a810416 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:39.260879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2222bf5c-b62f-4b12-bb93-7dd64a810416 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:39.277458 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2222bf5c-b62f-4b12-bb93-7dd64a810416 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1506 microversion: 2.1 time: 0.665699 Jul 28 03:44:39.279080 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1095/1973] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:38 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1506 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:39.289041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-302d8108-e801-4f28-a5a4-0513b89e8ec6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:39.290382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-302d8108-e801-4f28-a5a4-0513b89e8ec6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:39.302130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-302d8108-e801-4f28-a5a4-0513b89e8ec6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:39.303591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-302d8108-e801-4f28-a5a4-0513b89e8ec6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:39.305511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-302d8108-e801-4f28-a5a4-0513b89e8ec6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:39.306720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-302d8108-e801-4f28-a5a4-0513b89e8ec6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:40.190196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-302d8108-e801-4f28-a5a4-0513b89e8ec6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:40.245960 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-302d8108-e801-4f28-a5a4-0513b89e8ec6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.963720 Jul 28 03:44:40.258027 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1096/1974] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:39 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:40.279196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2d9f3a6e-c8fc-4eec-b72e-5f85e68336b5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:40.282576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2d9f3a6e-c8fc-4eec-b72e-5f85e68336b5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 38bded12-c7e6-4c2b-bf28-bcf754421d2d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:40.306961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d9f3a6e-c8fc-4eec-b72e-5f85e68336b5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:40.307711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d9f3a6e-c8fc-4eec-b72e-5f85e68336b5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:40.313037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d9f3a6e-c8fc-4eec-b72e-5f85e68336b5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:40.319251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d9f3a6e-c8fc-4eec-b72e-5f85e68336b5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:40.384796 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-2d9f3a6e-c8fc-4eec-b72e-5f85e68336b5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] HTTP exception thrown: Instance 38bded12-c7e6-4c2b-bf28-bcf754421d2d could not be found. Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2d9f3a6e-c8fc-4eec-b72e-5f85e68336b5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Request method failure captured: Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d HTTP/1.1 Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRTlOQD0JbHLWV1qE11jK-cWmq9h6So3GdIK_l_LgG0zJSGUGbuNujelyC2c7ii7FUgmuEMG6OMyr31fUe0nK66LkIG3wld16Oot0uEKF9_vJd2kCcf4CyhUJhOkEkiL25lS9B0yAPfzfwOMFHm2nFD-4FHQcDCugv6eWkRt6zp4NM Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.25 Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 881125b6bb84430fb4f2e0c6ebf79983 Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1142275898 Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/881125b6bb84430fb4f2e0c6ebf79983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/881125b6bb84430fb4f2e0c6ebf79983"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_881125b6bb84430fb4f2e0c6ebf79983"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/881125b6bb84430fb4f2e0c6ebf79983"}]}] Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1142275898 Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 881125b6bb84430fb4f2e0c6ebf79983 Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1142275898 Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-LiveAutoBlockMigrationV225Test-1142275898-project Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: c2e3c37253bc408682e9a15c3b5a85ab Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1142275898-project Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 38bded12-c7e6-4c2b-bf28-bcf754421d2d could not be found. Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '38bded12-c7e6-4c2b-bf28-bcf754421d2d'} Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38bded12-c7e6-4c2b-bf28-bcf754421d2d could not be found. Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38bded12-c7e6-4c2b-bf28-bcf754421d2d could not be found. Jul 28 03:44:40.393206 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:40.405340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:40.405340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:40.405340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:40.405340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:40.405340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:40.405340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:40.405340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:40.405340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38bded12-c7e6-4c2b-bf28-bcf754421d2d could not be found. Jul 28 03:44:40.405340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:40.405340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2d9f3a6e-c8fc-4eec-b72e-5f85e68336b5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Returning 404 to user: Instance 38bded12-c7e6-4c2b-bf28-bcf754421d2d could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:40.411081 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2d9f3a6e-c8fc-4eec-b72e-5f85e68336b5 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d" status: 404 len: 111 microversion: 2.25 time: 0.153636 Jul 28 03:44:40.415111 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1097/1975] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:40 2022] GET /compute/v2.1/servers/38bded12-c7e6-4c2b-bf28-bcf754421d2d => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:44:40.457659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-db21699d-527a-4fce-aeff-9de4fbd707b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:40.461775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-db21699d-527a-4fce-aeff-9de4fbd707b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:40.507285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db21699d-527a-4fce-aeff-9de4fbd707b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:40.508334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db21699d-527a-4fce-aeff-9de4fbd707b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:40.509446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db21699d-527a-4fce-aeff-9de4fbd707b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:40.509956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db21699d-527a-4fce-aeff-9de4fbd707b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:40.924335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-db21699d-527a-4fce-aeff-9de4fbd707b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:40.941599 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-db21699d-527a-4fce-aeff-9de4fbd707b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1275 microversion: 2.1 time: 0.522603 Jul 28 03:44:40.942205 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1098/1976] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:40 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1275 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:40.956216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2d56a79-23ad-4331-95ee-a8891a033165 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:40.960472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2d56a79-23ad-4331-95ee-a8891a033165 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:40.976169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2d56a79-23ad-4331-95ee-a8891a033165 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:40.979991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2d56a79-23ad-4331-95ee-a8891a033165 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:40.984155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2d56a79-23ad-4331-95ee-a8891a033165 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:40.986914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2d56a79-23ad-4331-95ee-a8891a033165 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:41.704390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:44:41.705962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:44:41.707840 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:44:41.708797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:44:41.709517 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:44:41.737171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:41.758720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:41.763308 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:41.767759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:41.850718 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Getting quotas for project b7bee0b59b0b43ce80623b7aca24111a. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:44:41.871289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Getting quotas for user 26b9a63a13e1420aa3b7f299456c65e6 and project b7bee0b59b0b43ce80623b7aca24111a. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:44:41.900896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:44:41.915572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:44:42.022058 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b1fb6821-4370-429b-9c9e-f45f39463421 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.741889 Jul 28 03:44:42.023315 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 879/1977] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:44:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 4744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:44:42.040476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-28d0a932-97e9-4fd7-91ea-cbd5db90fe2b req-6f53493e-a252-4bb8-ae29-f85c88f957a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c42fcd75-f3a9-4abb-a5fd-f8c600bbb272", "tag": "c1bcc2ac-62d4-4a34-ab01-789e5b7a9432"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:42.075029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-28d0a932-97e9-4fd7-91ea-cbd5db90fe2b req-6f53493e-a252-4bb8-ae29-f85c88f957a7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:42.084239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-28d0a932-97e9-4fd7-91ea-cbd5db90fe2b req-6f53493e-a252-4bb8-ae29-f85c88f957a7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:42.105499 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-28d0a932-97e9-4fd7-91ea-cbd5db90fe2b req-6f53493e-a252-4bb8-ae29-f85c88f957a7 service nova] Creating event network-changed:c1bcc2ac-62d4-4a34-ab01-789e5b7a9432 for instance c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 on n-h1-826756-3 Jul 28 03:44:42.125789 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-28d0a932-97e9-4fd7-91ea-cbd5db90fe2b req-6f53493e-a252-4bb8-ae29-f85c88f957a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100869 Jul 28 03:44:42.135097 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 880/1978] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:42.154834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ee5cad51-3a09-4986-b6c0-acc88713d8e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:42.156116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ee5cad51-3a09-4986-b6c0-acc88713d8e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:42.177876 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ee5cad51-3a09-4986-b6c0-acc88713d8e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:42.182490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ee5cad51-3a09-4986-b6c0-acc88713d8e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:42.186201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ee5cad51-3a09-4986-b6c0-acc88713d8e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:42.193662 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ee5cad51-3a09-4986-b6c0-acc88713d8e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:44.000307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ee5cad51-3a09-4986-b6c0-acc88713d8e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:44.023862 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ee5cad51-3a09-4986-b6c0-acc88713d8e4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 1.886492 Jul 28 03:44:44.027756 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 881/1979] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:42 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:44.055972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-a380b8e2-e8ef-4f9d-846a-674459e3c9b2 req-e36d03b2-42a6-48ce-a5b7-f940bbabee2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f", "name": "network-vif-plugged", "status": "completed", "tag": "c8fa4d49-4763-4f59-8a0d-2644a14e4d87"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:44.065666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b2d56a79-23ad-4331-95ee-a8891a033165 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:44.088147 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b2d56a79-23ad-4331-95ee-a8891a033165 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1488 microversion: 2.1 time: 3.144469 Jul 28 03:44:44.102651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a380b8e2-e8ef-4f9d-846a-674459e3c9b2 req-e36d03b2-42a6-48ce-a5b7-f940bbabee2b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:44.109445 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1099/1980] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:40 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1488 bytes in 3166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:44.110582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a380b8e2-e8ef-4f9d-846a-674459e3c9b2 req-e36d03b2-42a6-48ce-a5b7-f940bbabee2b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:44.131890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ba7b318-f0bc-49ea-a4ca-a84b54d3683d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:44.133483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ba7b318-f0bc-49ea-a4ca-a84b54d3683d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:44.175109 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-a380b8e2-e8ef-4f9d-846a-674459e3c9b2 req-e36d03b2-42a6-48ce-a5b7-f940bbabee2b service nova] Creating event network-vif-plugged:c8fa4d49-4763-4f59-8a0d-2644a14e4d87 for instance 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f on n-h2-826756-3 Jul 28 03:44:44.185884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ba7b318-f0bc-49ea-a4ca-a84b54d3683d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:44.187614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ba7b318-f0bc-49ea-a4ca-a84b54d3683d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:44.189482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ba7b318-f0bc-49ea-a4ca-a84b54d3683d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:44.195519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ba7b318-f0bc-49ea-a4ca-a84b54d3683d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:44.205866 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-a380b8e2-e8ef-4f9d-846a-674459e3c9b2 req-e36d03b2-42a6-48ce-a5b7-f940bbabee2b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175799 Jul 28 03:44:44.206871 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 882/1981] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:44.217505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-be9219e2-c4cc-438d-932f-48a2a9def1e1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:44.221620 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-be9219e2-c4cc-438d-932f-48a2a9def1e1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:44.247867 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be9219e2-c4cc-438d-932f-48a2a9def1e1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:44.251913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be9219e2-c4cc-438d-932f-48a2a9def1e1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:44.252847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be9219e2-c4cc-438d-932f-48a2a9def1e1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:44.256624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be9219e2-c4cc-438d-932f-48a2a9def1e1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:44.701670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-be9219e2-c4cc-438d-932f-48a2a9def1e1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:44.745499 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-be9219e2-c4cc-438d-932f-48a2a9def1e1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1210 microversion: 2.1 time: 0.535452 Jul 28 03:44:44.770704 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 883/1982] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:44 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1210 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:44.813155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2f442852-5480-4078-b649-304a181e98fd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:44.814074 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2f442852-5480-4078-b649-304a181e98fd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:44.868223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f442852-5480-4078-b649-304a181e98fd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:44.874307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f442852-5480-4078-b649-304a181e98fd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:44.897376 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f442852-5480-4078-b649-304a181e98fd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:44.900833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f442852-5480-4078-b649-304a181e98fd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:45.070441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2f442852-5480-4078-b649-304a181e98fd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:44:45.250585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ba7b318-f0bc-49ea-a4ca-a84b54d3683d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:45.302009 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ba7b318-f0bc-49ea-a4ca-a84b54d3683d tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1317 microversion: 2.1 time: 1.190127 Jul 28 03:44:45.305641 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1100/1983] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:44 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1317 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:45.324580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-11b1a18c-5e04-4ea2-b2e6-4626a58acf6a req-edf02f79-c535-42d1-a0e7-1eb7fbc6c18c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "tag": "3e015ffb-f6e7-43ce-ac59-41ddf8b14cdf"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:45.351537 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2f442852-5480-4078-b649-304a181e98fd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 204 len: 0 microversion: 2.1 time: 0.561080 Jul 28 03:44:45.352944 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 884/1984] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:44:44 2022] DELETE /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:44:45.360602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-449fd88c-4dbe-4664-a57e-42d0d95250bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:45.361937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-449fd88c-4dbe-4664-a57e-42d0d95250bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:45.370635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-11b1a18c-5e04-4ea2-b2e6-4626a58acf6a req-edf02f79-c535-42d1-a0e7-1eb7fbc6c18c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:45.371085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-11b1a18c-5e04-4ea2-b2e6-4626a58acf6a req-edf02f79-c535-42d1-a0e7-1eb7fbc6c18c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:45.371424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-449fd88c-4dbe-4664-a57e-42d0d95250bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:45.372169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-449fd88c-4dbe-4664-a57e-42d0d95250bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:45.373211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-449fd88c-4dbe-4664-a57e-42d0d95250bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:45.373931 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-449fd88c-4dbe-4664-a57e-42d0d95250bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:45.433905 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-11b1a18c-5e04-4ea2-b2e6-4626a58acf6a req-edf02f79-c535-42d1-a0e7-1eb7fbc6c18c service nova] Creating event network-changed:3e015ffb-f6e7-43ce-ac59-41ddf8b14cdf for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:44:45.472663 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-11b1a18c-5e04-4ea2-b2e6-4626a58acf6a req-edf02f79-c535-42d1-a0e7-1eb7fbc6c18c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143753 Jul 28 03:44:45.474516 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1101/1985] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:45.496566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-98996f66-b1ae-43a4-86b4-935fdb5bbb48 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa67ad3430>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:45.583922 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-98996f66-b1ae-43a4-86b4-935fdb5bbb48 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] HTTP exception thrown: Image not found. Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-98996f66-b1ae-43a4-86b4-935fdb5bbb48 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Request method failure captured: Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/images/e12660cb-4b71-4017-bfc8-f0bf29bac605 HTTP/1.1 Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gURW2DZ_bd0B85qqpr6BuKnecwrMH1ox8Mm4qGEky3ekGbdUgGPac090nRaevuibwJaohBZAx3PeqFchI9xZbKihW-Gz06JcziQauKwCN1_Nd5A1tP2PF1UBhASwJUz8vCgrO1Gi1ADDGQ0-EVjqZdTCNrEovFKKogJJCQSqMjlTKk Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}] Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesTestJSON-921835921 Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 670b269eb20c416e9f43f8d4e43ded45 Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: exception: Image not found. Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'e12660cb-4b71-4017-bfc8-f0bf29bac605'} Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e12660cb-4b71-4017-bfc8-f0bf29bac605 to delete Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e12660cb-4b71-4017-bfc8-f0bf29bac605 could not be found. Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:45.585864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-98996f66-b1ae-43a4-86b4-935fdb5bbb48 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Returning 404 to user: Image not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-98996f66-b1ae-43a4-86b4-935fdb5bbb48 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/images/e12660cb-4b71-4017-bfc8-f0bf29bac605" status: 404 len: 62 microversion: 2.1 time: 0.111213 Jul 28 03:44:45.601197 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1102/1986] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:45 2022] DELETE /compute/v2.1/images/e12660cb-4b71-4017-bfc8-f0bf29bac605 => generated 62 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:44:45.613145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7820d2dc-5fe9-45e0-879a-e71d03b44244 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:45.613820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7820d2dc-5fe9-45e0-879a-e71d03b44244 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:45.648081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7820d2dc-5fe9-45e0-879a-e71d03b44244 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:45.648983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7820d2dc-5fe9-45e0-879a-e71d03b44244 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:45.659173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7820d2dc-5fe9-45e0-879a-e71d03b44244 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:45.659988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7820d2dc-5fe9-45e0-879a-e71d03b44244 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:45.784575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7820d2dc-5fe9-45e0-879a-e71d03b44244 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:44:46.113714 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.compute.api [None req-7820d2dc-5fe9-45e0-879a-e71d03b44244 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Instance is already in deleting state, ignoring this request Jul 28 03:44:46.115262 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7820d2dc-5fe9-45e0-879a-e71d03b44244 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 204 len: 0 microversion: 2.1 time: 0.522794 Jul 28 03:44:46.116306 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1103/1987] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:44:45 2022] DELETE /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:44:46.154454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-197cf454-48ac-4c02-b2af-14b6531c2a37 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:46.156988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-197cf454-48ac-4c02-b2af-14b6531c2a37 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:46.168130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-197cf454-48ac-4c02-b2af-14b6531c2a37 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:46.175463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-197cf454-48ac-4c02-b2af-14b6531c2a37 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:46.176792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-197cf454-48ac-4c02-b2af-14b6531c2a37 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:46.177436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-197cf454-48ac-4c02-b2af-14b6531c2a37 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:46.662699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-197cf454-48ac-4c02-b2af-14b6531c2a37 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:46.672053 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-197cf454-48ac-4c02-b2af-14b6531c2a37 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1272 microversion: 2.1 time: 0.529579 Jul 28 03:44:46.677412 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1104/1988] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:46 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1272 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:46.685271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-02eb5d01-22f5-437c-80ca-63737bdd8c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:46.686163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-02eb5d01-22f5-437c-80ca-63737bdd8c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:46.693248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02eb5d01-22f5-437c-80ca-63737bdd8c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:46.693697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02eb5d01-22f5-437c-80ca-63737bdd8c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:46.694993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02eb5d01-22f5-437c-80ca-63737bdd8c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:46.695708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02eb5d01-22f5-437c-80ca-63737bdd8c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:46.892332 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-449fd88c-4dbe-4664-a57e-42d0d95250bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:46.908135 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-449fd88c-4dbe-4664-a57e-42d0d95250bf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 1.553290 Jul 28 03:44:46.914916 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 885/1989] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:45 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:46.928874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ac77316c-8734-49f9-9f5f-ff74971340f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:46.930303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ac77316c-8734-49f9-9f5f-ff74971340f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:46.944993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac77316c-8734-49f9-9f5f-ff74971340f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:46.946683 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac77316c-8734-49f9-9f5f-ff74971340f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:46.957023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac77316c-8734-49f9-9f5f-ff74971340f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:46.957023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac77316c-8734-49f9-9f5f-ff74971340f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:47.441810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-02eb5d01-22f5-437c-80ca-63737bdd8c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:47.452753 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-02eb5d01-22f5-437c-80ca-63737bdd8c62 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1494 microversion: 2.1 time: 0.773857 Jul 28 03:44:47.460892 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1105/1990] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:46 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1494 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:47.699654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c245bf4a-64ef-4cd3-8726-85f61de2c6fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:47.700443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c245bf4a-64ef-4cd3-8726-85f61de2c6fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:47.712042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c245bf4a-64ef-4cd3-8726-85f61de2c6fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:47.725201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c245bf4a-64ef-4cd3-8726-85f61de2c6fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:47.726061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c245bf4a-64ef-4cd3-8726-85f61de2c6fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:47.726501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c245bf4a-64ef-4cd3-8726-85f61de2c6fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:47.846344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c245bf4a-64ef-4cd3-8726-85f61de2c6fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:47.855916 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c245bf4a-64ef-4cd3-8726-85f61de2c6fe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1272 microversion: 2.1 time: 0.160213 Jul 28 03:44:47.856549 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1106/1991] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:47 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:47.952771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7587634f-a61b-4b43-a10c-a2b5de615ef8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:47.953346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7587634f-a61b-4b43-a10c-a2b5de615ef8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:47.971095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7587634f-a61b-4b43-a10c-a2b5de615ef8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:47.971635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7587634f-a61b-4b43-a10c-a2b5de615ef8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:47.972566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7587634f-a61b-4b43-a10c-a2b5de615ef8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:47.973012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7587634f-a61b-4b43-a10c-a2b5de615ef8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:47.976417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:48.125257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ac77316c-8734-49f9-9f5f-ff74971340f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:48.145405 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ac77316c-8734-49f9-9f5f-ff74971340f1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1317 microversion: 2.1 time: 1.227802 Jul 28 03:44:48.146106 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 886/1992] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:46 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1317 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:48.250612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-3831d00a-6307-4685-a106-53c940c878d3 req-aa3682ba-0c8a-4de9-9b87-debbfc497981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f", "name": "network-vif-unplugged", "status": "completed", "tag": "c8fa4d49-4763-4f59-8a0d-2644a14e4d87"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:48.306983 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3831d00a-6307-4685-a106-53c940c878d3 req-aa3682ba-0c8a-4de9-9b87-debbfc497981 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:48.310193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3831d00a-6307-4685-a106-53c940c878d3 req-aa3682ba-0c8a-4de9-9b87-debbfc497981 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:48.311781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7587634f-a61b-4b43-a10c-a2b5de615ef8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:48.324980 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7587634f-a61b-4b43-a10c-a2b5de615ef8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.376069 Jul 28 03:44:48.326765 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1107/1993] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:47 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:48.356146 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-3831d00a-6307-4685-a106-53c940c878d3 req-aa3682ba-0c8a-4de9-9b87-debbfc497981 service nova] Creating event network-vif-unplugged:c8fa4d49-4763-4f59-8a0d-2644a14e4d87 for instance 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f on n-h2-826756-3 Jul 28 03:44:48.379361 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-3831d00a-6307-4685-a106-53c940c878d3 req-aa3682ba-0c8a-4de9-9b87-debbfc497981 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154318 Jul 28 03:44:48.381357 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 887/1994] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:48.491331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0d8e6501-adee-47dd-a4ab-c465b56c51d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:48.492135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0d8e6501-adee-47dd-a4ab-c465b56c51d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:48.503146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d8e6501-adee-47dd-a4ab-c465b56c51d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:48.503983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d8e6501-adee-47dd-a4ab-c465b56c51d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:48.505142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d8e6501-adee-47dd-a4ab-c465b56c51d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:48.505837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d8e6501-adee-47dd-a4ab-c465b56c51d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:48.694098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0d8e6501-adee-47dd-a4ab-c465b56c51d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:48.705424 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0d8e6501-adee-47dd-a4ab-c465b56c51d1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1494 microversion: 2.1 time: 0.219828 Jul 28 03:44:48.706949 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1108/1995] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:48 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1494 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:44:48.893817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7d692bb8-53a3-4823-b907-4073cb920282 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:48.894976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7d692bb8-53a3-4823-b907-4073cb920282 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:48.906392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7d692bb8-53a3-4823-b907-4073cb920282 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:48.907337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7d692bb8-53a3-4823-b907-4073cb920282 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:48.908331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7d692bb8-53a3-4823-b907-4073cb920282 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:48.908985 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7d692bb8-53a3-4823-b907-4073cb920282 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:48.979608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f0790be-c576-416e-bd49-7ae37528af11 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:48.980868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6f0790be-c576-416e-bd49-7ae37528af11 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:49.014682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f0790be-c576-416e-bd49-7ae37528af11 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:49.015848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f0790be-c576-416e-bd49-7ae37528af11 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:49.026211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f0790be-c576-416e-bd49-7ae37528af11 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:49.027389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f0790be-c576-416e-bd49-7ae37528af11 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:49.086368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6f0790be-c576-416e-bd49-7ae37528af11 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:44:49.262463 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6f0790be-c576-416e-bd49-7ae37528af11 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 204 len: 0 microversion: 2.25 time: 0.285652 Jul 28 03:44:49.268750 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1109/1996] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:44:48 2022] DELETE /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:44:49.280379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cdae2d7c-e5ea-423e-9b93-00307ad8bfdf tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:49.282130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cdae2d7c-e5ea-423e-9b93-00307ad8bfdf tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:49.315004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cdae2d7c-e5ea-423e-9b93-00307ad8bfdf tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:49.315821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cdae2d7c-e5ea-423e-9b93-00307ad8bfdf tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:49.317093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cdae2d7c-e5ea-423e-9b93-00307ad8bfdf tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:49.317906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cdae2d7c-e5ea-423e-9b93-00307ad8bfdf tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:49.630083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7d692bb8-53a3-4823-b907-4073cb920282 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:49.649285 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7d692bb8-53a3-4823-b907-4073cb920282 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1272 microversion: 2.1 time: 0.760842 Jul 28 03:44:49.650481 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 888/1997] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:48 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1272 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:49.664212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-80820e45-eb57-43a2-9823-0946709d1f2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:49.664212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-80820e45-eb57-43a2-9823-0946709d1f2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:49.678701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-80820e45-eb57-43a2-9823-0946709d1f2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:49.679398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-80820e45-eb57-43a2-9823-0946709d1f2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:49.684982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-80820e45-eb57-43a2-9823-0946709d1f2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:49.685452 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-80820e45-eb57-43a2-9823-0946709d1f2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:49.764021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cdae2d7c-e5ea-423e-9b93-00307ad8bfdf tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:49.777062 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cdae2d7c-e5ea-423e-9b93-00307ad8bfdf tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1317 microversion: 2.1 time: 0.509909 Jul 28 03:44:49.777685 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1110/1998] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:49 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:49.794514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b812c15d-a2de-4e39-9c04-763ca978a1a1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:49.795372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b812c15d-a2de-4e39-9c04-763ca978a1a1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:49.807938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b812c15d-a2de-4e39-9c04-763ca978a1a1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:49.808737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b812c15d-a2de-4e39-9c04-763ca978a1a1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:49.809695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b812c15d-a2de-4e39-9c04-763ca978a1a1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:49.810304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b812c15d-a2de-4e39-9c04-763ca978a1a1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:50.265995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b812c15d-a2de-4e39-9c04-763ca978a1a1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:50.274449 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b812c15d-a2de-4e39-9c04-763ca978a1a1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.495666 Jul 28 03:44:50.292969 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1111/1999] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:49 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:50.305582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-37352316-088c-44ba-8c79-c210fa327822 req-47838a01-2845-4fd7-9724-c4f54d9faae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42fcd75-f3a9-4abb-a5fd-f8c600bbb272", "name": "network-vif-unplugged", "status": "completed", "tag": "c1bcc2ac-62d4-4a34-ab01-789e5b7a9432"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:50.325553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-37352316-088c-44ba-8c79-c210fa327822 req-47838a01-2845-4fd7-9724-c4f54d9faae7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:50.334060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-37352316-088c-44ba-8c79-c210fa327822 req-47838a01-2845-4fd7-9724-c4f54d9faae7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:50.357657 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-37352316-088c-44ba-8c79-c210fa327822 req-47838a01-2845-4fd7-9724-c4f54d9faae7 service nova] Creating event network-vif-unplugged:c1bcc2ac-62d4-4a34-ab01-789e5b7a9432 for instance c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 on n-h1-826756-3 Jul 28 03:44:50.365536 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-37352316-088c-44ba-8c79-c210fa327822 req-47838a01-2845-4fd7-9724-c4f54d9faae7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070962 Jul 28 03:44:50.366198 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1112/2000] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:50.371636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-58978a2b-c616-4472-833d-74f4e7cf5475 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:50.372394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-58978a2b-c616-4472-833d-74f4e7cf5475 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:50.398339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58978a2b-c616-4472-833d-74f4e7cf5475 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:50.398805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58978a2b-c616-4472-833d-74f4e7cf5475 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:50.399589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58978a2b-c616-4472-833d-74f4e7cf5475 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:50.400018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58978a2b-c616-4472-833d-74f4e7cf5475 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:50.958431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-58978a2b-c616-4472-833d-74f4e7cf5475 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:50.970174 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-58978a2b-c616-4472-833d-74f4e7cf5475 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1494 microversion: 2.1 time: 0.601880 Jul 28 03:44:50.971218 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1113/2001] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:50 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1494 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:50.979487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1cc1a037-8723-40ed-9b0e-be09fbfa1a43 req-6a15a2a4-385b-4220-b200-486b78cd1318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42fcd75-f3a9-4abb-a5fd-f8c600bbb272", "name": "network-vif-unplugged", "status": "completed", "tag": "c1bcc2ac-62d4-4a34-ab01-789e5b7a9432"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:50.993943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1cc1a037-8723-40ed-9b0e-be09fbfa1a43 req-6a15a2a4-385b-4220-b200-486b78cd1318 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:50.995010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1cc1a037-8723-40ed-9b0e-be09fbfa1a43 req-6a15a2a4-385b-4220-b200-486b78cd1318 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:51.018734 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1cc1a037-8723-40ed-9b0e-be09fbfa1a43 req-6a15a2a4-385b-4220-b200-486b78cd1318 service nova] Creating event network-vif-unplugged:c1bcc2ac-62d4-4a34-ab01-789e5b7a9432 for instance c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 on n-h1-826756-3 Jul 28 03:44:51.045534 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1cc1a037-8723-40ed-9b0e-be09fbfa1a43 req-6a15a2a4-385b-4220-b200-486b78cd1318 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068936 Jul 28 03:44:51.052214 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1114/2002] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:51.064649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2d28d922-13e5-46c0-a87d-7079aeffba4d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:51.065791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2d28d922-13e5-46c0-a87d-7079aeffba4d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:51.074339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d28d922-13e5-46c0-a87d-7079aeffba4d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:51.075054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d28d922-13e5-46c0-a87d-7079aeffba4d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:51.076277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d28d922-13e5-46c0-a87d-7079aeffba4d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:51.077138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d28d922-13e5-46c0-a87d-7079aeffba4d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:51.083674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-80820e45-eb57-43a2-9823-0946709d1f2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:51.100199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-80820e45-eb57-43a2-9823-0946709d1f2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:51.102456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-80820e45-eb57-43a2-9823-0946709d1f2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:51.105255 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-80820e45-eb57-43a2-9823-0946709d1f2a tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1731 microversion: 2.25 time: 1.452127 Jul 28 03:44:51.107108 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 889/2003] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:49 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1731 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:51.115693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7d5c3a4a-d99f-4c1d-9a9f-c23485d0a4bd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:51.117382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7d5c3a4a-d99f-4c1d-9a9f-c23485d0a4bd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:51.128828 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7d5c3a4a-d99f-4c1d-9a9f-c23485d0a4bd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:51.130155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7d5c3a4a-d99f-4c1d-9a9f-c23485d0a4bd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:51.131576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7d5c3a4a-d99f-4c1d-9a9f-c23485d0a4bd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:51.132632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7d5c3a4a-d99f-4c1d-9a9f-c23485d0a4bd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:51.229147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2d28d922-13e5-46c0-a87d-7079aeffba4d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:51.247970 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2d28d922-13e5-46c0-a87d-7079aeffba4d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1272 microversion: 2.1 time: 0.191922 Jul 28 03:44:51.255461 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1115/2004] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:51 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:51.324067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-35f4fd0a-0582-4a49-ac30-5d48f601bf37 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:51.325293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-35f4fd0a-0582-4a49-ac30-5d48f601bf37 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:51.353118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35f4fd0a-0582-4a49-ac30-5d48f601bf37 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:51.353662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35f4fd0a-0582-4a49-ac30-5d48f601bf37 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:51.358277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35f4fd0a-0582-4a49-ac30-5d48f601bf37 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:51.358934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35f4fd0a-0582-4a49-ac30-5d48f601bf37 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:51.734291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-35f4fd0a-0582-4a49-ac30-5d48f601bf37 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:51.766741 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-35f4fd0a-0582-4a49-ac30-5d48f601bf37 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.468277 Jul 28 03:44:51.767417 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1116/2005] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:51 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:51.789392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a80ab7da-f119-4603-b350-ad607d807290 req-086c1677-ea44-40e9-8a40-1dbf8d950787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282080fd-6332-429d-b6cd-3f760b08a955", "tag": "ddc6e41a-3432-46c0-ac89-3875e939f2a8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:51.814258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a80ab7da-f119-4603-b350-ad607d807290 req-086c1677-ea44-40e9-8a40-1dbf8d950787 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:51.815331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a80ab7da-f119-4603-b350-ad607d807290 req-086c1677-ea44-40e9-8a40-1dbf8d950787 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:51.818903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:51.834736 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a80ab7da-f119-4603-b350-ad607d807290 req-086c1677-ea44-40e9-8a40-1dbf8d950787 service nova] Creating event network-changed:ddc6e41a-3432-46c0-ac89-3875e939f2a8 for instance 282080fd-6332-429d-b6cd-3f760b08a955 on n-h2-826756-3 Jul 28 03:44:51.843591 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a80ab7da-f119-4603-b350-ad607d807290 req-086c1677-ea44-40e9-8a40-1dbf8d950787 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074102 Jul 28 03:44:51.845898 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1117/2006] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:51.895896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=14 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:52.007245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-efd17ce6-37ae-4160-aaf0-68a47bb9ac7a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:52.008644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-efd17ce6-37ae-4160-aaf0-68a47bb9ac7a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:52.020435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efd17ce6-37ae-4160-aaf0-68a47bb9ac7a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:52.024210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efd17ce6-37ae-4160-aaf0-68a47bb9ac7a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:52.026007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efd17ce6-37ae-4160-aaf0-68a47bb9ac7a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:52.026757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efd17ce6-37ae-4160-aaf0-68a47bb9ac7a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:52.034028 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7d5c3a4a-d99f-4c1d-9a9f-c23485d0a4bd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:52.045712 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7d5c3a4a-d99f-4c1d-9a9f-c23485d0a4bd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1317 microversion: 2.1 time: 0.937084 Jul 28 03:44:52.046317 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 890/2007] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:51 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1317 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:52.135940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c6c650cb-fede-4481-846d-447fcb987069 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:52.137351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c6c650cb-fede-4481-846d-447fcb987069 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:52.156190 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6c650cb-fede-4481-846d-447fcb987069 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:52.156665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6c650cb-fede-4481-846d-447fcb987069 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:52.157442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6c650cb-fede-4481-846d-447fcb987069 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:52.157876 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6c650cb-fede-4481-846d-447fcb987069 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:52.729383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-efd17ce6-37ae-4160-aaf0-68a47bb9ac7a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:52.754001 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-efd17ce6-37ae-4160-aaf0-68a47bb9ac7a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1494 microversion: 2.1 time: 0.753752 Jul 28 03:44:52.758272 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1118/2008] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:51 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1494 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:44:52.765860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-28b19eeb-785b-4da4-8186-a988b498e601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:52.767946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-28b19eeb-785b-4da4-8186-a988b498e601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:52.785939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28b19eeb-785b-4da4-8186-a988b498e601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:52.786609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28b19eeb-785b-4da4-8186-a988b498e601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:52.789419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28b19eeb-785b-4da4-8186-a988b498e601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:52.790698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28b19eeb-785b-4da4-8186-a988b498e601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:53.046022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-28b19eeb-785b-4da4-8186-a988b498e601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:53.062863 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-28b19eeb-785b-4da4-8186-a988b498e601 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1314 microversion: 2.1 time: 0.302688 Jul 28 03:44:53.064817 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1119/2009] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:52 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:53.073972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cd086ce9-88aa-4b3a-8628-d4778689edb1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:53.075076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cd086ce9-88aa-4b3a-8628-d4778689edb1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:53.082139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd086ce9-88aa-4b3a-8628-d4778689edb1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:53.082633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd086ce9-88aa-4b3a-8628-d4778689edb1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:53.083433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd086ce9-88aa-4b3a-8628-d4778689edb1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:53.084067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd086ce9-88aa-4b3a-8628-d4778689edb1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:53.357122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cd086ce9-88aa-4b3a-8628-d4778689edb1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:53.377351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c6c650cb-fede-4481-846d-447fcb987069 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:53.385697 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:53.393587 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cd086ce9-88aa-4b3a-8628-d4778689edb1 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1392 microversion: 2.1 time: 0.323656 Jul 28 03:44:53.394664 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1120/2010] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:53 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1392 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:53.401454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c6c650cb-fede-4481-846d-447fcb987069 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:53.403322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c6c650cb-fede-4481-846d-447fcb987069 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:53.405992 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c6c650cb-fede-4481-846d-447fcb987069 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1731 microversion: 2.25 time: 1.274253 Jul 28 03:44:53.407148 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 891/2011] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:52 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1731 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:53.432010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4a295cf-524c-4ea5-9686-d68825d2ee12 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:53.434444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4a295cf-524c-4ea5-9686-d68825d2ee12 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:53.448287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4a295cf-524c-4ea5-9686-d68825d2ee12 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:53.448771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4a295cf-524c-4ea5-9686-d68825d2ee12 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:53.458305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4a295cf-524c-4ea5-9686-d68825d2ee12 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:53.458897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4a295cf-524c-4ea5-9686-d68825d2ee12 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:53.704293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f4a295cf-524c-4ea5-9686-d68825d2ee12 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:53.718583 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4a295cf-524c-4ea5-9686-d68825d2ee12 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1317 microversion: 2.1 time: 0.297418 Jul 28 03:44:53.720684 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1121/2012] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:53 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:53.797006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-73029825-9972-411e-a242-1e39c8491129 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:53.801675 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-73029825-9972-411e-a242-1e39c8491129 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:53.815169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73029825-9972-411e-a242-1e39c8491129 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:53.818720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73029825-9972-411e-a242-1e39c8491129 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:53.820029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73029825-9972-411e-a242-1e39c8491129 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:53.820802 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73029825-9972-411e-a242-1e39c8491129 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:53.965460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-bf6daad9-0d06-46f6-9633-f5ec6722f5ee req-2a783190-b37a-44fc-89d1-a2bfecf623e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f", "name": "network-vif-deleted", "tag": "c8fa4d49-4763-4f59-8a0d-2644a14e4d87"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:53.998744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bf6daad9-0d06-46f6-9633-f5ec6722f5ee req-2a783190-b37a-44fc-89d1-a2bfecf623e7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:53.999552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bf6daad9-0d06-46f6-9633-f5ec6722f5ee req-2a783190-b37a-44fc-89d1-a2bfecf623e7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:54.035988 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-bf6daad9-0d06-46f6-9633-f5ec6722f5ee req-2a783190-b37a-44fc-89d1-a2bfecf623e7 service nova] Creating event network-vif-deleted:c8fa4d49-4763-4f59-8a0d-2644a14e4d87 for instance 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f on n-h2-826756-3 Jul 28 03:44:54.060598 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-bf6daad9-0d06-46f6-9633-f5ec6722f5ee req-2a783190-b37a-44fc-89d1-a2bfecf623e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093810 Jul 28 03:44:54.066201 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1122/2013] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:44:54.091155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1559d204-5e5d-417d-806c-2bc867b873ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:54.091866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1559d204-5e5d-417d-806c-2bc867b873ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:54.114976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1559d204-5e5d-417d-806c-2bc867b873ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:54.115431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1559d204-5e5d-417d-806c-2bc867b873ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:54.116222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1559d204-5e5d-417d-806c-2bc867b873ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:54.116690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1559d204-5e5d-417d-806c-2bc867b873ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:54.157217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-73029825-9972-411e-a242-1e39c8491129 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:54.198557 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-73029825-9972-411e-a242-1e39c8491129 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1293 microversion: 2.1 time: 0.409547 Jul 28 03:44:54.199130 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 892/2014] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:53 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1293 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:54.429315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fca542f3-35cc-422f-bae1-20def0e9634d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:54.430022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fca542f3-35cc-422f-bae1-20def0e9634d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:54.446805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fca542f3-35cc-422f-bae1-20def0e9634d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:54.447265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fca542f3-35cc-422f-bae1-20def0e9634d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:54.448261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fca542f3-35cc-422f-bae1-20def0e9634d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:54.451598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fca542f3-35cc-422f-bae1-20def0e9634d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:54.475945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1559d204-5e5d-417d-806c-2bc867b873ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:54.519314 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1559d204-5e5d-417d-806c-2bc867b873ff tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1314 microversion: 2.1 time: 0.427407 Jul 28 03:44:54.524686 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1123/2015] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:54 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:44:54.569406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4705fd22-f5f2-4e89-8b97-20836543529d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:54.573001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4705fd22-f5f2-4e89-8b97-20836543529d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:54.594427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:54.605586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4705fd22-f5f2-4e89-8b97-20836543529d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:54.606902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4705fd22-f5f2-4e89-8b97-20836543529d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:54.608535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4705fd22-f5f2-4e89-8b97-20836543529d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:54.609835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4705fd22-f5f2-4e89-8b97-20836543529d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:54.893846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4705fd22-f5f2-4e89-8b97-20836543529d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:54.898050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:44:54.932235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4705fd22-f5f2-4e89-8b97-20836543529d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:54.942523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4705fd22-f5f2-4e89-8b97-20836543529d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:54.951635 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4705fd22-f5f2-4e89-8b97-20836543529d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1665 microversion: 2.25 time: 0.403296 Jul 28 03:44:54.953052 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1124/2016] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:54 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1665 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:54.989772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-01d36f7e-1329-4320-96fb-8d71aaf5a1b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:54.992658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-01d36f7e-1329-4320-96fb-8d71aaf5a1b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:55.019489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01d36f7e-1329-4320-96fb-8d71aaf5a1b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:55.056598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01d36f7e-1329-4320-96fb-8d71aaf5a1b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:55.063573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01d36f7e-1329-4320-96fb-8d71aaf5a1b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:55.069594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01d36f7e-1329-4320-96fb-8d71aaf5a1b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:55.218589 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fca542f3-35cc-422f-bae1-20def0e9634d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:55.261876 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fca542f3-35cc-422f-bae1-20def0e9634d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1382 microversion: 2.1 time: 0.836459 Jul 28 03:44:55.298582 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 893/2017] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:54 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1382 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:55.310247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cbcecfc7-8b4c-43a2-b6a9-3229b20c8d2a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:55.312284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cbcecfc7-8b4c-43a2-b6a9-3229b20c8d2a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:55.338666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cbcecfc7-8b4c-43a2-b6a9-3229b20c8d2a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:55.345660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cbcecfc7-8b4c-43a2-b6a9-3229b20c8d2a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:55.349827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cbcecfc7-8b4c-43a2-b6a9-3229b20c8d2a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:55.352474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cbcecfc7-8b4c-43a2-b6a9-3229b20c8d2a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:55.447831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cbcecfc7-8b4c-43a2-b6a9-3229b20c8d2a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:55.456757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cbcecfc7-8b4c-43a2-b6a9-3229b20c8d2a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:55.460902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-cbcecfc7-8b4c-43a2-b6a9-3229b20c8d2a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lazy-loading 'fault' on Instance uuid 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:44:55.551466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-01d36f7e-1329-4320-96fb-8d71aaf5a1b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:55.568278 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-01d36f7e-1329-4320-96fb-8d71aaf5a1b4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1317 microversion: 2.1 time: 0.613300 Jul 28 03:44:55.569931 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1125/2018] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:54 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:55.584474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d342883d-30ec-4534-b12f-acdd35b85139 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '.version_select at 0x7ffa67ad3310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:55.591064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d342883d-30ec-4534-b12f-acdd35b85139 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:55.593898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d342883d-30ec-4534-b12f-acdd35b85139 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:55.625548 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d342883d-30ec-4534-b12f-acdd35b85139 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 2704 microversion: 2.1 time: 0.045065 Jul 28 03:44:55.626877 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1126/2019] 10.222.0.48 () {58 vars in 1143 bytes} [Thu Jul 28 03:44:55 2022] GET /compute/v2.1/os-migrations => generated 2704 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:55.637794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d7971ad-9b62-45b8-83fd-cd459d3a28b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:55.638445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d7971ad-9b62-45b8-83fd-cd459d3a28b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:55.638987 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cbcecfc7-8b4c-43a2-b6a9-3229b20c8d2a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '670b269eb20c416e9f43f8d4e43ded45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc9288cef154fa28f7057f25e0e3213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:55.653571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d7971ad-9b62-45b8-83fd-cd459d3a28b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:55.663493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d7971ad-9b62-45b8-83fd-cd459d3a28b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:55.664503 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cbcecfc7-8b4c-43a2-b6a9-3229b20c8d2a tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 200 len: 1298 microversion: 2.1 time: 0.362421 Jul 28 03:44:55.665217 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 894/2020] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:55 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 1298 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:55.672737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d7971ad-9b62-45b8-83fd-cd459d3a28b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:55.673916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d7971ad-9b62-45b8-83fd-cd459d3a28b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:55.683774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-651cb6fe-740a-49e5-88a8-5f06db2d1ae1 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:55.686901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-651cb6fe-740a-49e5-88a8-5f06db2d1ae1 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:55.701437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-651cb6fe-740a-49e5-88a8-5f06db2d1ae1 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:55.702086 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-651cb6fe-740a-49e5-88a8-5f06db2d1ae1 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:55.703040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-651cb6fe-740a-49e5-88a8-5f06db2d1ae1 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:55.703643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-651cb6fe-740a-49e5-88a8-5f06db2d1ae1 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:56.177828 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-651cb6fe-740a-49e5-88a8-5f06db2d1ae1 tempest-LiveMigrationTest-1478070292 tempest-LiveMigrationTest-1478070292-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1533 microversion: 2.1 time: 0.507272 Jul 28 03:44:56.179099 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 895/2021] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:55 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1533 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:56.195196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f981f3a1-788f-4f71-8100-c40fe594157d tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Calling method '.version_select at 0x7ffa743f6670>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:56.211649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9d7971ad-9b62-45b8-83fd-cd459d3a28b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:56.232202 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d7971ad-9b62-45b8-83fd-cd459d3a28b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1314 microversion: 2.1 time: 0.603772 Jul 28 03:44:56.232828 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1127/2022] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:55 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:56.260846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca8ae9d1-ef2d-4226-991b-1106d95e849b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:56.261484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca8ae9d1-ef2d-4226-991b-1106d95e849b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:56.281007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca8ae9d1-ef2d-4226-991b-1106d95e849b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:56.281738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca8ae9d1-ef2d-4226-991b-1106d95e849b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:56.282885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca8ae9d1-ef2d-4226-991b-1106d95e849b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:56.283500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca8ae9d1-ef2d-4226-991b-1106d95e849b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:56.284462 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f981f3a1-788f-4f71-8100-c40fe594157d tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "GET /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc" status: 200 len: 637 microversion: 2.1 time: 0.102197 Jul 28 03:44:56.286124 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 896/2023] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:44:56 2022] GET /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc => generated 637 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:56.292220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-bcaa60dd-dbe0-47f3-9e61-f2b196283e90 req-0ade4124-de8d-4f6f-a13b-26fd5c70064a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcbae58d-a326-4197-a350-9278d664d3e7", "name": "network-vif-deleted", "tag": "1c43a93b-de22-40be-a837-98a92e1f0f4c"}, {"name": "network-changed", "server_uuid": "8d40c5c9-5144-44f2-8688-f63a70730fd6", "tag": "84847337-6d11-4405-a1fb-e06f3e62221d"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:56.322228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-bcaa60dd-dbe0-47f3-9e61-f2b196283e90 req-0ade4124-de8d-4f6f-a13b-26fd5c70064a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:56.322756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-bcaa60dd-dbe0-47f3-9e61-f2b196283e90 req-0ade4124-de8d-4f6f-a13b-26fd5c70064a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:56.352383 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-bcaa60dd-dbe0-47f3-9e61-f2b196283e90 req-0ade4124-de8d-4f6f-a13b-26fd5c70064a service nova] Creating event network-vif-deleted:1c43a93b-de22-40be-a837-98a92e1f0f4c for instance fcbae58d-a326-4197-a350-9278d664d3e7 on n-h2-826756-3 Jul 28 03:44:56.353509 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-bcaa60dd-dbe0-47f3-9e61-f2b196283e90 req-0ade4124-de8d-4f6f-a13b-26fd5c70064a service nova] Creating event network-changed:84847337-6d11-4405-a1fb-e06f3e62221d for instance 8d40c5c9-5144-44f2-8688-f63a70730fd6 on n-h1-826756-3 Jul 28 03:44:56.381676 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-bcaa60dd-dbe0-47f3-9e61-f2b196283e90 req-0ade4124-de8d-4f6f-a13b-26fd5c70064a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.093978 Jul 28 03:44:56.386584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca8ae9d1-ef2d-4226-991b-1106d95e849b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:56.388525 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 897/2024] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:44:56.392493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca8ae9d1-ef2d-4226-991b-1106d95e849b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:56.392983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-ca8ae9d1-ef2d-4226-991b-1106d95e849b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lazy-loading 'fault' on Instance uuid fcbae58d-a326-4197-a350-9278d664d3e7 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:44:56.400245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bf0870ef-d6a5-4b3a-aaa8-c1d4882f6c48 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:56.401583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bf0870ef-d6a5-4b3a-aaa8-c1d4882f6c48 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:56.430512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf0870ef-d6a5-4b3a-aaa8-c1d4882f6c48 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:56.435931 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf0870ef-d6a5-4b3a-aaa8-c1d4882f6c48 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:56.437381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf0870ef-d6a5-4b3a-aaa8-c1d4882f6c48 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:56.438238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf0870ef-d6a5-4b3a-aaa8-c1d4882f6c48 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:56.475671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca8ae9d1-ef2d-4226-991b-1106d95e849b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:56.489708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca8ae9d1-ef2d-4226-991b-1106d95e849b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:56.492495 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bf0870ef-d6a5-4b3a-aaa8-c1d4882f6c48 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:44:56.493217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca8ae9d1-ef2d-4226-991b-1106d95e849b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:56.494155 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca8ae9d1-ef2d-4226-991b-1106d95e849b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 200 len: 1376 microversion: 2.25 time: 0.244899 Jul 28 03:44:56.495390 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1128/2025] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:56 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 1376 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:44:56.501766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c095118a-e840-422a-9da4-c3fd3642cb03 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Action: 'update_all', calling method: .version_select at 0x7ffa67ad3700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:56.601098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-c095118a-e840-422a-9da4-c3fd3642cb03 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:44:56.612922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-c095118a-e840-422a-9da4-c3fd3642cb03 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for user 2e13960671284dbfbb1384b0caf13707 and project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:44:56.664752 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bf0870ef-d6a5-4b3a-aaa8-c1d4882f6c48 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 204 len: 0 microversion: 2.1 time: 0.273695 Jul 28 03:44:56.667060 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 898/2026] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:44:56 2022] DELETE /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:44:56.676429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1bfbf5b3-cfdd-46ad-8281-3a390d313a90 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:56.679005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1bfbf5b3-cfdd-46ad-8281-3a390d313a90 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:56.707348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1bfbf5b3-cfdd-46ad-8281-3a390d313a90 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:56.707905 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1bfbf5b3-cfdd-46ad-8281-3a390d313a90 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:56.708716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1bfbf5b3-cfdd-46ad-8281-3a390d313a90 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:56.709148 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1bfbf5b3-cfdd-46ad-8281-3a390d313a90 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:57.037956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1bfbf5b3-cfdd-46ad-8281-3a390d313a90 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:57.050542 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1bfbf5b3-cfdd-46ad-8281-3a390d313a90 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1317 microversion: 2.1 time: 0.379497 Jul 28 03:44:57.051474 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 899/2027] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:56 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:57.076902 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c095118a-e840-422a-9da4-c3fd3642cb03 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.579514 Jul 28 03:44:57.082225 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1129/2028] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:44:56 2022] PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata => generated 61 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:44:57.082426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8a51878c-640e-4f97-96a2-dcdc0840349a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:57.083553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8a51878c-640e-4f97-96a2-dcdc0840349a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:57.086898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62328e24-47fd-4b69-8994-5dc722910308 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:57.089019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-62328e24-47fd-4b69-8994-5dc722910308 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:57.099986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a51878c-640e-4f97-96a2-dcdc0840349a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:57.100537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a51878c-640e-4f97-96a2-dcdc0840349a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:57.101671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a51878c-640e-4f97-96a2-dcdc0840349a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:57.102134 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a51878c-640e-4f97-96a2-dcdc0840349a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:57.105813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62328e24-47fd-4b69-8994-5dc722910308 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:57.106756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62328e24-47fd-4b69-8994-5dc722910308 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:57.108277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62328e24-47fd-4b69-8994-5dc722910308 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:57.108826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62328e24-47fd-4b69-8994-5dc722910308 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:57.133546 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-62328e24-47fd-4b69-8994-5dc722910308 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] HTTP exception thrown: Instance 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f could not be found. Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62328e24-47fd-4b69-8994-5dc722910308 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Request method failure captured: Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f HTTP/1.1 Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gURW2DZ_bd0B85qqpr6BuKnecwrMH1ox8Mm4qGEky3ekGbdUgGPac090nRaevuibwJaohBZAx3PeqFchI9xZbKihW-Gz06JcziQauKwCN1_Nd5A1tP2PF1UBhASwJUz8vCgrO1Gi1ADDGQ0-EVjqZdTCNrEovFKKogJJCQSqMjlTKk Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}] Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesTestJSON-921835921 Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 670b269eb20c416e9f43f8d4e43ded45 Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f could not be found. Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f'} Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f could not be found. Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f could not be found. Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.137410 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:57.143529 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:57.143529 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:57.143529 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:57.143529 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:57.143529 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f could not be found. Jul 28 03:44:57.143529 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.143529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62328e24-47fd-4b69-8994-5dc722910308 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Returning 404 to user: Instance 2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:57.143529 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-62328e24-47fd-4b69-8994-5dc722910308 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f" status: 404 len: 111 microversion: 2.1 time: 0.060390 Jul 28 03:44:57.143529 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1130/2029] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:57 2022] GET /compute/v2.1/servers/2ef0dd5b-4bb3-43ce-aeab-58e7c662c90f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:44:57.151340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-936ea21b-88e1-4885-939a-d1d71f5ea71f tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Calling method '.version_select at 0x7ffa67ac0700>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:57.527151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8a51878c-640e-4f97-96a2-dcdc0840349a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:57.546527 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8a51878c-640e-4f97-96a2-dcdc0840349a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1388 microversion: 2.1 time: 0.493767 Jul 28 03:44:57.547031 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 900/2030] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:57 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1388 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:57.575197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f4af6dc3-4c0c-4fb2-b4cf-1780b514b0ed tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa742b4430>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:57.679846 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-f4af6dc3-4c0c-4fb2-b4cf-1780b514b0ed tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] HTTP exception thrown: Image not found. Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f4af6dc3-4c0c-4fb2-b4cf-1780b514b0ed tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Request method failure captured: Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f HTTP/1.1 Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gURW2DZ_bd0B85qqpr6BuKnecwrMH1ox8Mm4qGEky3ekGbdUgGPac090nRaevuibwJaohBZAx3PeqFchI9xZbKihW-Gz06JcziQauKwCN1_Nd5A1tP2PF1UBhASwJUz8vCgrO1Gi1ADDGQ0-EVjqZdTCNrEovFKKogJJCQSqMjlTKk Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}] Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesTestJSON-921835921 Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 670b269eb20c416e9f43f8d4e43ded45 Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: exception: Image not found. Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '575bddb7-87c8-48e3-8289-8f33c3b42f7f'} Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 575bddb7-87c8-48e3-8289-8f33c3b42f7f to delete Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 575bddb7-87c8-48e3-8289-8f33c3b42f7f could not be found. Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.682171 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:44:57.688220 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.693198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f4af6dc3-4c0c-4fb2-b4cf-1780b514b0ed tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Returning 404 to user: Image not found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:57.695419 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f4af6dc3-4c0c-4fb2-b4cf-1780b514b0ed tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f" status: 404 len: 62 microversion: 2.1 time: 0.147442 Jul 28 03:44:57.699415 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 901/2031] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:57 2022] DELETE /compute/v2.1/images/575bddb7-87c8-48e3-8289-8f33c3b42f7f => generated 62 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:44:57.711880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7fc233df-faf1-45e9-a015-6ffba6c36ab3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:57.715044 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7fc233df-faf1-45e9-a015-6ffba6c36ab3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:57.731269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fc233df-faf1-45e9-a015-6ffba6c36ab3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:57.732163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fc233df-faf1-45e9-a015-6ffba6c36ab3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:57.733320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fc233df-faf1-45e9-a015-6ffba6c36ab3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:57.734491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fc233df-faf1-45e9-a015-6ffba6c36ab3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:57.739343 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-936ea21b-88e1-4885-939a-d1d71f5ea71f tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "DELETE /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.594848 Jul 28 03:44:57.739992 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1131/2032] 10.222.0.48 () {58 vars in 1296 bytes} [Thu Jul 28 03:44:57 2022] DELETE /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata/os_version => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:44:57.750206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-16825ca2-0809-47ec-9e09-bd3a7379c72c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:57.750890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-16825ca2-0809-47ec-9e09-bd3a7379c72c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: fcbae58d-a326-4197-a350-9278d664d3e7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:57.762753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16825ca2-0809-47ec-9e09-bd3a7379c72c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:57.763211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16825ca2-0809-47ec-9e09-bd3a7379c72c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:57.764030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16825ca2-0809-47ec-9e09-bd3a7379c72c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:57.767696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16825ca2-0809-47ec-9e09-bd3a7379c72c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:57.816431 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-16825ca2-0809-47ec-9e09-bd3a7379c72c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] HTTP exception thrown: Instance fcbae58d-a326-4197-a350-9278d664d3e7 could not be found. Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-16825ca2-0809-47ec-9e09-bd3a7379c72c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Request method failure captured: Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 HTTP/1.1 Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRTlOQD0JbHLWV1qE11jK-cWmq9h6So3GdIK_l_LgG0zJSGUGbuNujelyC2c7ii7FUgmuEMG6OMyr31fUe0nK66LkIG3wld16Oot0uEKF9_vJd2kCcf4CyhUJhOkEkiL25lS9B0yAPfzfwOMFHm2nFD-4FHQcDCugv6eWkRt6zp4NM Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.25 Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 881125b6bb84430fb4f2e0c6ebf79983 Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1142275898 Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/881125b6bb84430fb4f2e0c6ebf79983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/881125b6bb84430fb4f2e0c6ebf79983"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_881125b6bb84430fb4f2e0c6ebf79983"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/881125b6bb84430fb4f2e0c6ebf79983"}]}] Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1142275898 Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 881125b6bb84430fb4f2e0c6ebf79983 Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1142275898 Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-LiveAutoBlockMigrationV225Test-1142275898-project Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: c2e3c37253bc408682e9a15c3b5a85ab Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1142275898-project Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance fcbae58d-a326-4197-a350-9278d664d3e7 could not be found. Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'fcbae58d-a326-4197-a350-9278d664d3e7'} Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcbae58d-a326-4197-a350-9278d664d3e7 could not be found. Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcbae58d-a326-4197-a350-9278d664d3e7 could not be found. Jul 28 03:44:57.818688 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.823946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:57.823946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.823946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:57.823946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:57.823946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:57.823946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:57.823946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:57.823946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcbae58d-a326-4197-a350-9278d664d3e7 could not be found. Jul 28 03:44:57.823946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.825544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-16825ca2-0809-47ec-9e09-bd3a7379c72c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Returning 404 to user: Instance fcbae58d-a326-4197-a350-9278d664d3e7 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:57.826674 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-16825ca2-0809-47ec-9e09-bd3a7379c72c tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7" status: 404 len: 111 microversion: 2.25 time: 0.080848 Jul 28 03:44:57.827831 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1132/2033] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:44:57 2022] GET /compute/v2.1/servers/fcbae58d-a326-4197-a350-9278d664d3e7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:44:57.837670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e486bdef-b649-4682-83ca-7c32eb1bd5b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:57.838974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e486bdef-b649-4682-83ca-7c32eb1bd5b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:57.849425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e486bdef-b649-4682-83ca-7c32eb1bd5b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:57.851200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e486bdef-b649-4682-83ca-7c32eb1bd5b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:57.853453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e486bdef-b649-4682-83ca-7c32eb1bd5b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:57.854358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e486bdef-b649-4682-83ca-7c32eb1bd5b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:57.871279 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e486bdef-b649-4682-83ca-7c32eb1bd5b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] HTTP exception thrown: Instance da14893a-5718-4a91-9307-abd3ffb2c20e could not be found. Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e486bdef-b649-4682-83ca-7c32eb1bd5b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Request method failure captured: Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e HTTP/1.1 Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gURW2DZ_bd0B85qqpr6BuKnecwrMH1ox8Mm4qGEky3ekGbdUgGPac090nRaevuibwJaohBZAx3PeqFchI9xZbKihW-Gz06JcziQauKwCN1_Nd5A1tP2PF1UBhASwJUz8vCgrO1Gi1ADDGQ0-EVjqZdTCNrEovFKKogJJCQSqMjlTKk Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}] Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesTestJSON-921835921 Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 670b269eb20c416e9f43f8d4e43ded45 Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance da14893a-5718-4a91-9307-abd3ffb2c20e could not be found. Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'da14893a-5718-4a91-9307-abd3ffb2c20e'} Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da14893a-5718-4a91-9307-abd3ffb2c20e could not be found. Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:44:57.873582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da14893a-5718-4a91-9307-abd3ffb2c20e could not be found. Jul 28 03:44:57.878176 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.878176 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:57.878176 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.878176 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:57.878176 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:57.878176 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:57.878176 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:57.878176 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:57.878176 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da14893a-5718-4a91-9307-abd3ffb2c20e could not be found. Jul 28 03:44:57.878176 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:57.884183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e486bdef-b649-4682-83ca-7c32eb1bd5b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Returning 404 to user: Instance da14893a-5718-4a91-9307-abd3ffb2c20e could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:57.885586 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e486bdef-b649-4682-83ca-7c32eb1bd5b1 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 404 len: 111 microversion: 2.1 time: 0.056202 Jul 28 03:44:57.887905 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1133/2034] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:44:57 2022] DELETE /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:44:57.894332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-526d11c0-269f-44ba-989e-79d2a395759e tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Calling method '.version_select at 0x7ffa7994c040>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:57.955045 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-526d11c0-269f-44ba-989e-79d2a395759e tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "GET /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata" status: 200 len: 37 microversion: 2.1 time: 0.065342 Jul 28 03:44:57.955932 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1134/2035] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Jul 28 03:44:57 2022] GET /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata => generated 37 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:44:57.961834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b8cdb988-161b-4514-996b-94cb62358c84 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '.version_select at 0x7ffa67a9c040>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:57.992671 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b8cdb988-161b-4514-996b-94cb62358c84 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659129971" status: 204 len: 0 microversion: 2.25 time: 0.034958 Jul 28 03:44:57.994053 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1135/2036] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Jul 28 03:44:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659129971 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:44:58.003004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-346edfc1-ee07-4b68-b776-1073738d3e2c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:58.004500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-346edfc1-ee07-4b68-b776-1073738d3e2c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: da14893a-5718-4a91-9307-abd3ffb2c20e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:58.013560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-346edfc1-ee07-4b68-b776-1073738d3e2c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:58.014346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-346edfc1-ee07-4b68-b776-1073738d3e2c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:58.016097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-346edfc1-ee07-4b68-b776-1073738d3e2c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:58.016926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-346edfc1-ee07-4b68-b776-1073738d3e2c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:58.041442 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-346edfc1-ee07-4b68-b776-1073738d3e2c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] HTTP exception thrown: Instance da14893a-5718-4a91-9307-abd3ffb2c20e could not be found. Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-346edfc1-ee07-4b68-b776-1073738d3e2c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Request method failure captured: Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e HTTP/1.1 Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gURW2DZ_bd0B85qqpr6BuKnecwrMH1ox8Mm4qGEky3ekGbdUgGPac090nRaevuibwJaohBZAx3PeqFchI9xZbKihW-Gz06JcziQauKwCN1_Nd5A1tP2PF1UBhASwJUz8vCgrO1Gi1ADDGQ0-EVjqZdTCNrEovFKKogJJCQSqMjlTKk Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}] Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesTestJSON-921835921 Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 670b269eb20c416e9f43f8d4e43ded45 Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance da14893a-5718-4a91-9307-abd3ffb2c20e could not be found. Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'da14893a-5718-4a91-9307-abd3ffb2c20e'} Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da14893a-5718-4a91-9307-abd3ffb2c20e could not be found. Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da14893a-5718-4a91-9307-abd3ffb2c20e could not be found. Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.045076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:58.054216 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:58.054216 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:58.054216 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:58.054216 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:58.054216 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da14893a-5718-4a91-9307-abd3ffb2c20e could not be found. Jul 28 03:44:58.054216 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.058456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-346edfc1-ee07-4b68-b776-1073738d3e2c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Returning 404 to user: Instance da14893a-5718-4a91-9307-abd3ffb2c20e could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:58.061599 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-346edfc1-ee07-4b68-b776-1073738d3e2c tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e" status: 404 len: 111 microversion: 2.1 time: 0.065228 Jul 28 03:44:58.063023 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1136/2037] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:57 2022] GET /compute/v2.1/servers/da14893a-5718-4a91-9307-abd3ffb2c20e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:44:58.072066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2771c7bb-1d9d-45f5-97fc-25dcd27b7ed8 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Action: 'update_all', calling method: .version_select at 0x7ffa67ac0790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:58.167858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2771c7bb-1d9d-45f5-97fc-25dcd27b7ed8 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:44:58.174750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2771c7bb-1d9d-45f5-97fc-25dcd27b7ed8 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for user 2e13960671284dbfbb1384b0caf13707 and project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:44:58.252991 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7fc233df-faf1-45e9-a015-6ffba6c36ab3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:58.283899 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7fc233df-faf1-45e9-a015-6ffba6c36ab3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1314 microversion: 2.1 time: 0.578645 Jul 28 03:44:58.292858 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 902/2038] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:57 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:58.306892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-00a75da8-bc6e-48b0-b013-47c90f3f08c6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa74268e50>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:58.411107 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-00a75da8-bc6e-48b0-b013-47c90f3f08c6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] HTTP exception thrown: Image not found. Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-00a75da8-bc6e-48b0-b013-47c90f3f08c6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Request method failure captured: Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 HTTP/1.1 Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gURW2DZ_bd0B85qqpr6BuKnecwrMH1ox8Mm4qGEky3ekGbdUgGPac090nRaevuibwJaohBZAx3PeqFchI9xZbKihW-Gz06JcziQauKwCN1_Nd5A1tP2PF1UBhASwJUz8vCgrO1Gi1ADDGQ0-EVjqZdTCNrEovFKKogJJCQSqMjlTKk Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}] Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesTestJSON-921835921 Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 670b269eb20c416e9f43f8d4e43ded45 Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: exception: Image not found. Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '9637de5f-ee80-43d1-b8f9-d8fa9c1bca69'} Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 to delete Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 could not be found. Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.413364 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-00a75da8-bc6e-48b0-b013-47c90f3f08c6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Returning 404 to user: Image not found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-00a75da8-bc6e-48b0-b013-47c90f3f08c6 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69" status: 404 len: 62 microversion: 2.1 time: 0.120447 Jul 28 03:44:58.420102 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 903/2039] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:58 2022] DELETE /compute/v2.1/images/9637de5f-ee80-43d1-b8f9-d8fa9c1bca69 => generated 62 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:44:58.424822 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-59530224-4a9c-49e0-b295-4c2deef96776 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:58.424822 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-59530224-4a9c-49e0-b295-4c2deef96776 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:58.434805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59530224-4a9c-49e0-b295-4c2deef96776 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:58.435260 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59530224-4a9c-49e0-b295-4c2deef96776 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:58.436312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59530224-4a9c-49e0-b295-4c2deef96776 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:58.436780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59530224-4a9c-49e0-b295-4c2deef96776 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:58.718316 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2771c7bb-1d9d-45f5-97fc-25dcd27b7ed8 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.652916 Jul 28 03:44:58.718786 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1137/2040] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:44:58 2022] PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata => generated 61 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:44:58.726785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-addc2eca-2f48-435e-9386-06c1281b3c31 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:58.727402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-addc2eca-2f48-435e-9386-06c1281b3c31 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:58.734958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-addc2eca-2f48-435e-9386-06c1281b3c31 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:58.735514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-addc2eca-2f48-435e-9386-06c1281b3c31 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:58.736547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-addc2eca-2f48-435e-9386-06c1281b3c31 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:58.737066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-addc2eca-2f48-435e-9386-06c1281b3c31 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:58.756386 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-addc2eca-2f48-435e-9386-06c1281b3c31 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] HTTP exception thrown: Instance bf954030-af98-4832-a28a-03cf2a3fe8c9 could not be found. Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-addc2eca-2f48-435e-9386-06c1281b3c31 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Request method failure captured: Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 HTTP/1.1 Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gURW2DZ_bd0B85qqpr6BuKnecwrMH1ox8Mm4qGEky3ekGbdUgGPac090nRaevuibwJaohBZAx3PeqFchI9xZbKihW-Gz06JcziQauKwCN1_Nd5A1tP2PF1UBhASwJUz8vCgrO1Gi1ADDGQ0-EVjqZdTCNrEovFKKogJJCQSqMjlTKk Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}] Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesTestJSON-921835921 Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 670b269eb20c416e9f43f8d4e43ded45 Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance bf954030-af98-4832-a28a-03cf2a3fe8c9 could not be found. Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'bf954030-af98-4832-a28a-03cf2a3fe8c9'} Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf954030-af98-4832-a28a-03cf2a3fe8c9 could not be found. Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:44:58.758332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf954030-af98-4832-a28a-03cf2a3fe8c9 could not be found. Jul 28 03:44:58.766960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.766960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:58.766960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.766960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:58.766960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:58.766960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:58.766960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:58.766960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:58.766960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf954030-af98-4832-a28a-03cf2a3fe8c9 could not be found. Jul 28 03:44:58.766960 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:58.766960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-addc2eca-2f48-435e-9386-06c1281b3c31 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Returning 404 to user: Instance bf954030-af98-4832-a28a-03cf2a3fe8c9 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:58.766960 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-addc2eca-2f48-435e-9386-06c1281b3c31 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 404 len: 111 microversion: 2.1 time: 0.039094 Jul 28 03:44:58.766960 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1138/2041] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:44:58 2022] DELETE /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:44:58.776067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eab2b896-981d-4731-90c9-dfac2aeccb76 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:58.776998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eab2b896-981d-4731-90c9-dfac2aeccb76 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:58.784222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eab2b896-981d-4731-90c9-dfac2aeccb76 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:58.785083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eab2b896-981d-4731-90c9-dfac2aeccb76 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:58.786274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eab2b896-981d-4731-90c9-dfac2aeccb76 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:58.787208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eab2b896-981d-4731-90c9-dfac2aeccb76 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:59.142567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eab2b896-981d-4731-90c9-dfac2aeccb76 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:59.150594 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eab2b896-981d-4731-90c9-dfac2aeccb76 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1388 microversion: 2.1 time: 0.382431 Jul 28 03:44:59.165898 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1139/2042] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:58 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1388 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:59.171801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-65544dfe-8464-4ad6-9a3c-752cadbbad70 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Calling method '.version_select at 0x7ffa67ac0d30>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:59.192093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-59530224-4a9c-49e0-b295-4c2deef96776 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:59.206659 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-59530224-4a9c-49e0-b295-4c2deef96776 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1317 microversion: 2.1 time: 0.788057 Jul 28 03:44:59.241006 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 904/2043] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:58 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1317 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:59.248682 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-65544dfe-8464-4ad6-9a3c-752cadbbad70 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "GET /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.080039 Jul 28 03:44:59.252620 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1140/2044] 10.222.0.48 () {58 vars in 1290 bytes} [Thu Jul 28 03:44:59 2022] GET /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata/os_distro => generated 33 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:44:59.259738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-90708dee-99ad-4cb8-b411-face71e2dcdd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:59.260398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-90708dee-99ad-4cb8-b411-face71e2dcdd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: bf954030-af98-4832-a28a-03cf2a3fe8c9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:59.269119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90708dee-99ad-4cb8-b411-face71e2dcdd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:59.271968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90708dee-99ad-4cb8-b411-face71e2dcdd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:59.272885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90708dee-99ad-4cb8-b411-face71e2dcdd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:59.274566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90708dee-99ad-4cb8-b411-face71e2dcdd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:59.275091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e765ab02-ff4e-4c9a-b508-a7dd91970188 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Action: 'update_all', calling method: .version_select at 0x7ffa67ad30d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:44:59.321206 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-90708dee-99ad-4cb8-b411-face71e2dcdd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] HTTP exception thrown: Instance bf954030-af98-4832-a28a-03cf2a3fe8c9 could not be found. Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-90708dee-99ad-4cb8-b411-face71e2dcdd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Request method failure captured: Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 HTTP/1.1 Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gURW2DZ_bd0B85qqpr6BuKnecwrMH1ox8Mm4qGEky3ekGbdUgGPac090nRaevuibwJaohBZAx3PeqFchI9xZbKihW-Gz06JcziQauKwCN1_Nd5A1tP2PF1UBhASwJUz8vCgrO1Gi1ADDGQ0-EVjqZdTCNrEovFKKogJJCQSqMjlTKk Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}] Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesTestJSON-921835921 Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 670b269eb20c416e9f43f8d4e43ded45 Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance bf954030-af98-4832-a28a-03cf2a3fe8c9 could not be found. Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'bf954030-af98-4832-a28a-03cf2a3fe8c9'} Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf954030-af98-4832-a28a-03cf2a3fe8c9 could not be found. Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf954030-af98-4832-a28a-03cf2a3fe8c9 could not be found. Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.322886 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:59.328189 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:59.328189 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:59.328189 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:59.328189 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:59.328189 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf954030-af98-4832-a28a-03cf2a3fe8c9 could not be found. Jul 28 03:44:59.328189 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.328189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-90708dee-99ad-4cb8-b411-face71e2dcdd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Returning 404 to user: Instance bf954030-af98-4832-a28a-03cf2a3fe8c9 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:59.328189 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-90708dee-99ad-4cb8-b411-face71e2dcdd tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9" status: 404 len: 111 microversion: 2.1 time: 0.082037 Jul 28 03:44:59.328189 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 905/2045] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:59 2022] GET /compute/v2.1/servers/bf954030-af98-4832-a28a-03cf2a3fe8c9 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:44:59.345840 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-36d34537-b230-44e7-9a1f-b42042ca78d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:59.346356 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-36d34537-b230-44e7-9a1f-b42042ca78d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:59.353463 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-36d34537-b230-44e7-9a1f-b42042ca78d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:59.355777 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-36d34537-b230-44e7-9a1f-b42042ca78d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:59.356865 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-36d34537-b230-44e7-9a1f-b42042ca78d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:59.359322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-36d34537-b230-44e7-9a1f-b42042ca78d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:59.375170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e765ab02-ff4e-4c9a-b508-a7dd91970188 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:44:59.382456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e765ab02-ff4e-4c9a-b508-a7dd91970188 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for user 2e13960671284dbfbb1384b0caf13707 and project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:44:59.749010 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e765ab02-ff4e-4c9a-b508-a7dd91970188 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.479810 Jul 28 03:44:59.755904 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1141/2046] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:44:59 2022] PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata => generated 61 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:44:59.762104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a7d24821-2387-4b8f-8411-f9d0aef7b4f4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '.version_select at 0x7ffa67a9cf70>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:59.793819 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-a7d24821-2387-4b8f-8411-f9d0aef7b4f4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] HTTP exception thrown: Image not found. Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a7d24821-2387-4b8f-8411-f9d0aef7b4f4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Request method failure captured: Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b HTTP/1.1 Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gURW2DZ_bd0B85qqpr6BuKnecwrMH1ox8Mm4qGEky3ekGbdUgGPac090nRaevuibwJaohBZAx3PeqFchI9xZbKihW-Gz06JcziQauKwCN1_Nd5A1tP2PF1UBhASwJUz8vCgrO1Gi1ADDGQ0-EVjqZdTCNrEovFKKogJJCQSqMjlTKk Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}] Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesTestJSON-921835921 Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 670b269eb20c416e9f43f8d4e43ded45 Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: exception: Image not found. Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c4e4f54a-be55-438e-ab0b-c9088ae9cf5b'} Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c4e4f54a-be55-438e-ab0b-c9088ae9cf5b to delete Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c4e4f54a-be55-438e-ab0b-c9088ae9cf5b could not be found. Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.797416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a7d24821-2387-4b8f-8411-f9d0aef7b4f4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Returning 404 to user: Image not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a7d24821-2387-4b8f-8411-f9d0aef7b4f4 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b" status: 404 len: 62 microversion: 2.1 time: 0.042256 Jul 28 03:44:59.802991 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1142/2047] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:59 2022] DELETE /compute/v2.1/images/c4e4f54a-be55-438e-ab0b-c9088ae9cf5b => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:44:59.807925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-010d75fd-b008-4e9c-b656-5795bc9764c2 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Calling method '.version_select at 0x7ffa67ac00d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:59.858239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-36d34537-b230-44e7-9a1f-b42042ca78d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:44:59.893799 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-36d34537-b230-44e7-9a1f-b42042ca78d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1314 microversion: 2.1 time: 0.567696 Jul 28 03:44:59.894087 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-010d75fd-b008-4e9c-b656-5795bc9764c2 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "GET /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.091656 Jul 28 03:44:59.894848 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1143/2048] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Jul 28 03:44:59 2022] GET /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata => generated 61 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:44:59.900924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4e0f637-98c9-4c1d-80a3-55380ccd76bc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:59.901585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d4e0f637-98c9-4c1d-80a3-55380ccd76bc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:59.910080 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 906/2049] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:44:59 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:44:59.920542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-727c72b7-7e67-4661-a307-802bd73b2e5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:44:59.921411 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-727c72b7-7e67-4661-a307-802bd73b2e5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:44:59.924712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4e0f637-98c9-4c1d-80a3-55380ccd76bc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:59.926168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4e0f637-98c9-4c1d-80a3-55380ccd76bc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:59.928674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4e0f637-98c9-4c1d-80a3-55380ccd76bc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:59.929115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4e0f637-98c9-4c1d-80a3-55380ccd76bc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:59.941409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-727c72b7-7e67-4661-a307-802bd73b2e5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:59.942182 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-727c72b7-7e67-4661-a307-802bd73b2e5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:59.944285 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-727c72b7-7e67-4661-a307-802bd73b2e5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:44:59.945843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-727c72b7-7e67-4661-a307-802bd73b2e5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:44:59.955864 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-d4e0f637-98c9-4c1d-80a3-55380ccd76bc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] HTTP exception thrown: Instance 9a436784-353a-401e-877a-fcc0ac2fceb7 could not be found. Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4e0f637-98c9-4c1d-80a3-55380ccd76bc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Request method failure captured: Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 HTTP/1.1 Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gURW2DZ_bd0B85qqpr6BuKnecwrMH1ox8Mm4qGEky3ekGbdUgGPac090nRaevuibwJaohBZAx3PeqFchI9xZbKihW-Gz06JcziQauKwCN1_Nd5A1tP2PF1UBhASwJUz8vCgrO1Gi1ADDGQ0-EVjqZdTCNrEovFKKogJJCQSqMjlTKk Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}] Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesTestJSON-921835921 Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 670b269eb20c416e9f43f8d4e43ded45 Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesTestJSON-921835921-project Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 9a436784-353a-401e-877a-fcc0ac2fceb7 could not be found. Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9a436784-353a-401e-877a-fcc0ac2fceb7'} Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a436784-353a-401e-877a-fcc0ac2fceb7 could not be found. Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:44:59.958986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a436784-353a-401e-877a-fcc0ac2fceb7 could not be found. Jul 28 03:44:59.964770 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.964770 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:44:59.964770 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.964770 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:44:59.964770 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:44:59.964770 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:44:59.964770 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:44:59.964770 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:44:59.964770 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a436784-353a-401e-877a-fcc0ac2fceb7 could not be found. Jul 28 03:44:59.964770 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:44:59.968207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4e0f637-98c9-4c1d-80a3-55380ccd76bc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Returning 404 to user: Instance 9a436784-353a-401e-877a-fcc0ac2fceb7 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:44:59.969651 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d4e0f637-98c9-4c1d-80a3-55380ccd76bc tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 404 len: 111 microversion: 2.1 time: 0.073281 Jul 28 03:44:59.970462 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1144/2050] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:44:59 2022] DELETE /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:44:59.993437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7f3901a3-1196-4014-8487-962da1b7d1c2 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Action: 'update_all', calling method: .version_select at 0x7ffa740aa280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:00.012069 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-727c72b7-7e67-4661-a307-802bd73b2e5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:45:00.066771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7f3901a3-1196-4014-8487-962da1b7d1c2 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:00.075590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7f3901a3-1196-4014-8487-962da1b7d1c2 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for user 2e13960671284dbfbb1384b0caf13707 and project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:00.159275 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:00.181955 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-727c72b7-7e67-4661-a307-802bd73b2e5d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "DELETE /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 204 len: 0 microversion: 2.25 time: 0.268331 Jul 28 03:45:00.183324 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 907/2051] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:44:59 2022] DELETE /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:45:00.191152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-40fea5db-d350-49dd-82bd-138c46d19e79 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:00.192593 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-40fea5db-d350-49dd-82bd-138c46d19e79 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] [instance: 9a436784-353a-401e-877a-fcc0ac2fceb7] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:00.201978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40fea5db-d350-49dd-82bd-138c46d19e79 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:00.202592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40fea5db-d350-49dd-82bd-138c46d19e79 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:00.203684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40fea5db-d350-49dd-82bd-138c46d19e79 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:00.205274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40fea5db-d350-49dd-82bd-138c46d19e79 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:00.223813 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-40fea5db-d350-49dd-82bd-138c46d19e79 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] HTTP exception thrown: Instance 9a436784-353a-401e-877a-fcc0ac2fceb7 could not be found. Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-40fea5db-d350-49dd-82bd-138c46d19e79 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Request method failure captured: Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 HTTP/1.1 Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gURW2DZ_bd0B85qqpr6BuKnecwrMH1ox8Mm4qGEky3ekGbdUgGPac090nRaevuibwJaohBZAx3PeqFchI9xZbKihW-Gz06JcziQauKwCN1_Nd5A1tP2PF1UBhASwJUz8vCgrO1Gi1ADDGQ0-EVjqZdTCNrEovFKKogJJCQSqMjlTKk Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_edc9288cef154fa28f7057f25e0e3213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/edc9288cef154fa28f7057f25e0e3213"}]}] Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesTestJSON-921835921 Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: edc9288cef154fa28f7057f25e0e3213 Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesTestJSON-921835921 Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesTestJSON-921835921-project Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 670b269eb20c416e9f43f8d4e43ded45 Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesTestJSON-921835921-project Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 9a436784-353a-401e-877a-fcc0ac2fceb7 could not be found. Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '9a436784-353a-401e-877a-fcc0ac2fceb7'} Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a436784-353a-401e-877a-fcc0ac2fceb7 could not be found. Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a436784-353a-401e-877a-fcc0ac2fceb7 could not be found. Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:00.225752 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:00.238534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:00.238534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:00.238534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:00.238534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:00.238534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a436784-353a-401e-877a-fcc0ac2fceb7 could not be found. Jul 28 03:45:00.238534 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:00.238534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-40fea5db-d350-49dd-82bd-138c46d19e79 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] Returning 404 to user: Instance 9a436784-353a-401e-877a-fcc0ac2fceb7 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:00.238534 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-40fea5db-d350-49dd-82bd-138c46d19e79 tempest-ImagesTestJSON-921835921 tempest-ImagesTestJSON-921835921-project] 10.222.0.48 "GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7" status: 404 len: 111 microversion: 2.1 time: 0.043942 Jul 28 03:45:00.238534 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 908/2052] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:00 2022] GET /compute/v2.1/servers/9a436784-353a-401e-877a-fcc0ac2fceb7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:45:00.238534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-abc3f257-b87e-4f5e-b3c2-509f2494cc4f req-fcbabe43-bb1b-47cb-9081-21766697f73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c42fcd75-f3a9-4abb-a5fd-f8c600bbb272", "name": "network-vif-deleted", "tag": "c1bcc2ac-62d4-4a34-ab01-789e5b7a9432"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:00.249470 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-abc3f257-b87e-4f5e-b3c2-509f2494cc4f req-fcbabe43-bb1b-47cb-9081-21766697f73d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:00.249944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-abc3f257-b87e-4f5e-b3c2-509f2494cc4f req-fcbabe43-bb1b-47cb-9081-21766697f73d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:00.268739 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-abc3f257-b87e-4f5e-b3c2-509f2494cc4f req-fcbabe43-bb1b-47cb-9081-21766697f73d service nova] Creating event network-vif-deleted:c1bcc2ac-62d4-4a34-ab01-789e5b7a9432 for instance c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 on n-h2-826756-3 Jul 28 03:45:00.275483 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-abc3f257-b87e-4f5e-b3c2-509f2494cc4f req-fcbabe43-bb1b-47cb-9081-21766697f73d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043694 Jul 28 03:45:00.276411 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 909/2053] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:00.282239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-77cc751e-670e-4459-8348-3c473be49ddf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:00.283369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-77cc751e-670e-4459-8348-3c473be49ddf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:00.296938 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77cc751e-670e-4459-8348-3c473be49ddf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:00.298236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77cc751e-670e-4459-8348-3c473be49ddf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:00.299507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77cc751e-670e-4459-8348-3c473be49ddf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:00.300710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77cc751e-670e-4459-8348-3c473be49ddf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:00.333226 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:00.448150 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-77cc751e-670e-4459-8348-3c473be49ddf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:00.458722 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7f3901a3-1196-4014-8487-962da1b7d1c2 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.486298 Jul 28 03:45:00.459087 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-77cc751e-670e-4459-8348-3c473be49ddf tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1184 microversion: 2.1 time: 0.180942 Jul 28 03:45:00.459781 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1145/2054] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:44:59 2022] PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata => generated 61 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:45:00.470739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-239fbc84-be84-407c-aa84-3e982239347d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:00.471878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-239fbc84-be84-407c-aa84-3e982239347d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:00.476574 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 910/2055] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:00 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1184 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:00.482539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ee2988da-3187-495d-af1f-13c8af15933a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:00.486777 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ee2988da-3187-495d-af1f-13c8af15933a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:00.488234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-239fbc84-be84-407c-aa84-3e982239347d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:00.488822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-239fbc84-be84-407c-aa84-3e982239347d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:00.489912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-239fbc84-be84-407c-aa84-3e982239347d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:00.490371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-239fbc84-be84-407c-aa84-3e982239347d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:00.501665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ee2988da-3187-495d-af1f-13c8af15933a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:00.502085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ee2988da-3187-495d-af1f-13c8af15933a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:00.503178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ee2988da-3187-495d-af1f-13c8af15933a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:00.503781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ee2988da-3187-495d-af1f-13c8af15933a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:00.881833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-239fbc84-be84-407c-aa84-3e982239347d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:00.910542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-239fbc84-be84-407c-aa84-3e982239347d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:00.913133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-239fbc84-be84-407c-aa84-3e982239347d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:00.914632 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-239fbc84-be84-407c-aa84-3e982239347d tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1549 microversion: 2.25 time: 0.451856 Jul 28 03:45:00.915380 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1146/2056] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:45:00 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1549 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:45:00.945528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-174993f8-a922-439b-9669-dbe63d1ab4db tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Action: 'update_all', calling method: .version_select at 0x7ffa740aa040>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:00.951696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ee2988da-3187-495d-af1f-13c8af15933a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:00.965050 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ee2988da-3187-495d-af1f-13c8af15933a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1317 microversion: 2.1 time: 0.486585 Jul 28 03:45:00.966968 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 911/2057] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:00 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:00.973459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-999140d5-7cea-4dfb-8790-27340ee8f9c6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:00.975201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-999140d5-7cea-4dfb-8790-27340ee8f9c6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:00.991788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-999140d5-7cea-4dfb-8790-27340ee8f9c6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:00.993550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-999140d5-7cea-4dfb-8790-27340ee8f9c6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:00.995284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-999140d5-7cea-4dfb-8790-27340ee8f9c6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:00.997183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-999140d5-7cea-4dfb-8790-27340ee8f9c6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:01.046434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-174993f8-a922-439b-9669-dbe63d1ab4db tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:01.065388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-174993f8-a922-439b-9669-dbe63d1ab4db tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for user 2e13960671284dbfbb1384b0caf13707 and project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:01.410231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-999140d5-7cea-4dfb-8790-27340ee8f9c6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:01.431761 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-999140d5-7cea-4dfb-8790-27340ee8f9c6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1314 microversion: 2.1 time: 0.463471 Jul 28 03:45:01.435420 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 912/2058] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:00 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:01.485462 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4bb10115-fbc2-40da-a8d7-1a04ae25764c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:01.486129 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4bb10115-fbc2-40da-a8d7-1a04ae25764c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:01.500454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bb10115-fbc2-40da-a8d7-1a04ae25764c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:01.501018 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bb10115-fbc2-40da-a8d7-1a04ae25764c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:01.502027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bb10115-fbc2-40da-a8d7-1a04ae25764c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:01.502470 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bb10115-fbc2-40da-a8d7-1a04ae25764c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:01.687250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4bb10115-fbc2-40da-a8d7-1a04ae25764c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:01.712790 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4bb10115-fbc2-40da-a8d7-1a04ae25764c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1184 microversion: 2.1 time: 0.231713 Jul 28 03:45:01.713263 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 913/2059] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:01 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1184 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:01.821109 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-174993f8-a922-439b-9669-dbe63d1ab4db tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata" status: 200 len: 64 microversion: 2.1 time: 0.902192 Jul 28 03:45:01.822043 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1147/2060] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:45:00 2022] PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata => generated 64 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:45:01.836944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-713f3231-082a-40de-9b1b-1a8434575a21 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Calling method '.version_select at 0x7ffa74217b80>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:01.930311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9d21e9d3-6645-4bec-8967-30d8faee7b09 req-e356101d-d8bc-4099-b487-d8f7a96a48d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d40c5c9-5144-44f2-8688-f63a70730fd6", "name": "network-vif-plugged", "status": "completed", "tag": "84847337-6d11-4405-a1fb-e06f3e62221d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:01.942238 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-713f3231-082a-40de-9b1b-1a8434575a21 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "GET /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata" status: 200 len: 64 microversion: 2.1 time: 0.113562 Jul 28 03:45:01.943954 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 914/2061] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Jul 28 03:45:01 2022] GET /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata => generated 64 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:45:01.950839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fd348d50-6c0a-4ef9-8a3c-281cd166a3e1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:01.952621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fd348d50-6c0a-4ef9-8a3c-281cd166a3e1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:01.961263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd348d50-6c0a-4ef9-8a3c-281cd166a3e1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:01.962117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd348d50-6c0a-4ef9-8a3c-281cd166a3e1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:01.963092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd348d50-6c0a-4ef9-8a3c-281cd166a3e1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:01.963727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd348d50-6c0a-4ef9-8a3c-281cd166a3e1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:01.998881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9d21e9d3-6645-4bec-8967-30d8faee7b09 req-e356101d-d8bc-4099-b487-d8f7a96a48d0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:02.001753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9d21e9d3-6645-4bec-8967-30d8faee7b09 req-e356101d-d8bc-4099-b487-d8f7a96a48d0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:02.050318 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9d21e9d3-6645-4bec-8967-30d8faee7b09 req-e356101d-d8bc-4099-b487-d8f7a96a48d0 service nova] Creating event network-vif-plugged:84847337-6d11-4405-a1fb-e06f3e62221d for instance 8d40c5c9-5144-44f2-8688-f63a70730fd6 on n-h1-826756-3 Jul 28 03:45:02.063889 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9d21e9d3-6645-4bec-8967-30d8faee7b09 req-e356101d-d8bc-4099-b487-d8f7a96a48d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168245 Jul 28 03:45:02.066311 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1148/2062] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:02.079567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb4904e2-b6c7-4ffe-a2d4-a9412799a591 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Action: 'update_all', calling method: .version_select at 0x7ffa79957820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:02.115564 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fd348d50-6c0a-4ef9-8a3c-281cd166a3e1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:02.135460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fd348d50-6c0a-4ef9-8a3c-281cd166a3e1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:02.139765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fd348d50-6c0a-4ef9-8a3c-281cd166a3e1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:02.143129 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fd348d50-6c0a-4ef9-8a3c-281cd166a3e1 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 200 len: 1507 microversion: 2.25 time: 0.197896 Jul 28 03:45:02.147308 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 915/2063] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:45:01 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 1507 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:45:02.164008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fef228b5-b01f-4468-b0b6-4227f9dd1d30 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:02.165421 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fef228b5-b01f-4468-b0b6-4227f9dd1d30 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:02.178258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fef228b5-b01f-4468-b0b6-4227f9dd1d30 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:02.179005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fef228b5-b01f-4468-b0b6-4227f9dd1d30 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:02.180302 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fef228b5-b01f-4468-b0b6-4227f9dd1d30 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:02.183458 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fef228b5-b01f-4468-b0b6-4227f9dd1d30 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:02.188268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-bb4904e2-b6c7-4ffe-a2d4-a9412799a591 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:02.201240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-bb4904e2-b6c7-4ffe-a2d4-a9412799a591 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for user 2e13960671284dbfbb1384b0caf13707 and project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:02.562832 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fef228b5-b01f-4468-b0b6-4227f9dd1d30 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:02.579664 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fef228b5-b01f-4468-b0b6-4227f9dd1d30 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1317 microversion: 2.1 time: 0.430611 Jul 28 03:45:02.605070 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 916/2064] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:02 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:02.854985 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb4904e2-b6c7-4ffe-a2d4-a9412799a591 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.783163 Jul 28 03:45:02.857695 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1149/2065] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:45:02 2022] PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata => generated 61 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:45:02.863700 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f53b7885-6ac2-4d94-bde2-0db563f7091e tempest-ListImageFiltersNegativeTestJSON-719034943 tempest-ListImageFiltersNegativeTestJSON-719034943-project] Calling method '.version_select at 0x7ffa742179d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:02.891462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6a2584f1-f8fe-4741-b901-7603c646201a req-d82a0f03-7fbf-448b-9292-7a45957061af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "291f9510-9d09-47ee-bc90-13a457673493", "name": "network-vif-deleted", "tag": "e5a92ce3-6306-4cbb-9e4b-5d834b786894"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:02.919063 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-f53b7885-6ac2-4d94-bde2-0db563f7091e tempest-ListImageFiltersNegativeTestJSON-719034943 tempest-ListImageFiltersNegativeTestJSON-719034943-project] HTTP exception thrown: Image not found. Jul 28 03:45:02.920947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6a2584f1-f8fe-4741-b901-7603c646201a req-d82a0f03-7fbf-448b-9292-7a45957061af service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:02.922044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6a2584f1-f8fe-4741-b901-7603c646201a req-d82a0f03-7fbf-448b-9292-7a45957061af service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f53b7885-6ac2-4d94-bde2-0db563f7091e tempest-ListImageFiltersNegativeTestJSON-719034943 tempest-ListImageFiltersNegativeTestJSON-719034943-project] Request method failure captured: Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/images/c2d02fcc-67f1-4b23-a5e2-ca1ddfe03061 HTTP/1.1 Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gY--HbGTy6cJwghUr76Dd-5yOlf-_ZdTdu5iSNv4_1TiEb-ZlGVy9R5aFnSZ8UM8Ae3P8jPQjMz2T412beYnZgjjkurQJ3WDMhovlbe4NAKNRUnHcsMndpd5ie4Hlvdw0_keHnBDW-ayNNZwmQ49O01fwfR350X60EBN68cpblGYpM Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 89724abc427a43d8ab29b7962c08c841 Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-719034943 Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/89724abc427a43d8ab29b7962c08c841"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89724abc427a43d8ab29b7962c08c841"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_89724abc427a43d8ab29b7962c08c841"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89724abc427a43d8ab29b7962c08c841"}]}] Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-719034943 Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 89724abc427a43d8ab29b7962c08c841 Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-719034943 Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ListImageFiltersNegativeTestJSON-719034943-project Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 28f758d8e93e48649b3b50df92810500 Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-719034943-project Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: exception: Image not found. Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'c2d02fcc-67f1-4b23-a5e2-ca1ddfe03061'} Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c2d02fcc-67f1-4b23-a5e2-ca1ddfe03061 Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 03:45:02.924144 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c2d02fcc-67f1-4b23-a5e2-ca1ddfe03061 could not be found. Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:02.928981 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f53b7885-6ac2-4d94-bde2-0db563f7091e tempest-ListImageFiltersNegativeTestJSON-719034943 tempest-ListImageFiltersNegativeTestJSON-719034943-project] Returning 404 to user: Image not found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:02.937897 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f53b7885-6ac2-4d94-bde2-0db563f7091e tempest-ListImageFiltersNegativeTestJSON-719034943 tempest-ListImageFiltersNegativeTestJSON-719034943-project] 10.222.0.48 "GET /compute/v2.1/images/c2d02fcc-67f1-4b23-a5e2-ca1ddfe03061" status: 404 len: 62 microversion: 2.1 time: 0.324361 Jul 28 03:45:02.937897 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 917/2066] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:45:02 2022] GET /compute/v2.1/images/c2d02fcc-67f1-4b23-a5e2-ca1ddfe03061 => generated 62 bytes in 329 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:45:02.943727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d414aa02-417f-4c58-b32f-f0c176427881 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:02.944340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d414aa02-417f-4c58-b32f-f0c176427881 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:02.956261 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6a2584f1-f8fe-4741-b901-7603c646201a req-d82a0f03-7fbf-448b-9292-7a45957061af service nova] Creating event network-vif-deleted:e5a92ce3-6306-4cbb-9e4b-5d834b786894 for instance 291f9510-9d09-47ee-bc90-13a457673493 on n-h1-826756-3 Jul 28 03:45:02.970064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d414aa02-417f-4c58-b32f-f0c176427881 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:02.970855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d414aa02-417f-4c58-b32f-f0c176427881 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:02.976226 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6a2584f1-f8fe-4741-b901-7603c646201a req-d82a0f03-7fbf-448b-9292-7a45957061af service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107296 Jul 28 03:45:02.977303 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1150/2067] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:02.982622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d414aa02-417f-4c58-b32f-f0c176427881 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:02.983220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d414aa02-417f-4c58-b32f-f0c176427881 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:02.994755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b992fb1f-66ad-408b-a7be-4a70e85d0ad4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:02.996048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b992fb1f-66ad-408b-a7be-4a70e85d0ad4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:03.013217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b992fb1f-66ad-408b-a7be-4a70e85d0ad4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:03.016634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b992fb1f-66ad-408b-a7be-4a70e85d0ad4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:03.017697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b992fb1f-66ad-408b-a7be-4a70e85d0ad4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:03.018219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b992fb1f-66ad-408b-a7be-4a70e85d0ad4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:03.265427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b992fb1f-66ad-408b-a7be-4a70e85d0ad4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:03.284385 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b992fb1f-66ad-408b-a7be-4a70e85d0ad4 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1184 microversion: 2.1 time: 0.305667 Jul 28 03:45:03.285037 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1151/2068] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:02 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1184 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:03.312323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4fccc3bb-c80e-4247-9ff5-fe33ab63990c tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Action: 'update', calling method: .version_select at 0x7ffa79993820>, body: {"meta": {"os_version": "alt"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:03.346911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d414aa02-417f-4c58-b32f-f0c176427881 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:03.356666 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d414aa02-417f-4c58-b32f-f0c176427881 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1314 microversion: 2.1 time: 0.420264 Jul 28 03:45:03.358019 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 918/2069] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:02 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:03.365753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4a02a8cd-1ba2-4ed4-923c-b6b0a44e0cdd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:03.366266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4a02a8cd-1ba2-4ed4-923c-b6b0a44e0cdd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 291f9510-9d09-47ee-bc90-13a457673493] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:03.417955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-4fccc3bb-c80e-4247-9ff5-fe33ab63990c tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:03.432495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-4fccc3bb-c80e-4247-9ff5-fe33ab63990c tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for user 2e13960671284dbfbb1384b0caf13707 and project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:03.441234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a02a8cd-1ba2-4ed4-923c-b6b0a44e0cdd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:03.442787 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a02a8cd-1ba2-4ed4-923c-b6b0a44e0cdd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:03.445580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a02a8cd-1ba2-4ed4-923c-b6b0a44e0cdd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:03.449295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a02a8cd-1ba2-4ed4-923c-b6b0a44e0cdd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:03.521897 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-4a02a8cd-1ba2-4ed4-923c-b6b0a44e0cdd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] HTTP exception thrown: Instance 291f9510-9d09-47ee-bc90-13a457673493 could not be found. Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4a02a8cd-1ba2-4ed4-923c-b6b0a44e0cdd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Request method failure captured: Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 HTTP/1.1 Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gRTlOQD0JbHLWV1qE11jK-cWmq9h6So3GdIK_l_LgG0zJSGUGbuNujelyC2c7ii7FUgmuEMG6OMyr31fUe0nK66LkIG3wld16Oot0uEKF9_vJd2kCcf4CyhUJhOkEkiL25lS9B0yAPfzfwOMFHm2nFD-4FHQcDCugv6eWkRt6zp4NM Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Openstack-Nova-Api-Version: 2.25 Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 881125b6bb84430fb4f2e0c6ebf79983 Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1142275898 Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/881125b6bb84430fb4f2e0c6ebf79983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/881125b6bb84430fb4f2e0c6ebf79983"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_881125b6bb84430fb4f2e0c6ebf79983"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/881125b6bb84430fb4f2e0c6ebf79983"}]}] Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1142275898 Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 881125b6bb84430fb4f2e0c6ebf79983 Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1142275898 Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-LiveAutoBlockMigrationV225Test-1142275898-project Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: c2e3c37253bc408682e9a15c3b5a85ab Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1142275898-project Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 291f9510-9d09-47ee-bc90-13a457673493 could not be found. Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '291f9510-9d09-47ee-bc90-13a457673493'} Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 291f9510-9d09-47ee-bc90-13a457673493 could not be found. Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 291f9510-9d09-47ee-bc90-13a457673493 could not be found. Jul 28 03:45:03.534317 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:03.541370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:03.541370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:03.541370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:03.541370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:03.541370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:03.541370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:03.541370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:03.541370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 291f9510-9d09-47ee-bc90-13a457673493 could not be found. Jul 28 03:45:03.541370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:03.544409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4a02a8cd-1ba2-4ed4-923c-b6b0a44e0cdd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Returning 404 to user: Instance 291f9510-9d09-47ee-bc90-13a457673493 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:03.545516 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4a02a8cd-1ba2-4ed4-923c-b6b0a44e0cdd tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493" status: 404 len: 111 microversion: 2.25 time: 0.186074 Jul 28 03:45:03.549086 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 919/2070] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:45:03 2022] GET /compute/v2.1/servers/291f9510-9d09-47ee-bc90-13a457673493 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:45:03.561735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-42abc2b1-57d7-49d1-82c3-4c8ba4da29fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:03.562643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-42abc2b1-57d7-49d1-82c3-4c8ba4da29fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:03.570270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42abc2b1-57d7-49d1-82c3-4c8ba4da29fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:03.573053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42abc2b1-57d7-49d1-82c3-4c8ba4da29fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:03.578157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42abc2b1-57d7-49d1-82c3-4c8ba4da29fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:03.578879 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42abc2b1-57d7-49d1-82c3-4c8ba4da29fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:03.654887 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-42abc2b1-57d7-49d1-82c3-4c8ba4da29fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:45:03.888507 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-42abc2b1-57d7-49d1-82c3-4c8ba4da29fa tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "DELETE /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 204 len: 0 microversion: 2.25 time: 0.334390 Jul 28 03:45:03.892732 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 920/2071] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:45:03 2022] DELETE /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:45:03.898214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-25dd591c-fc73-4c73-a8b1-55f547e0a8b1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:03.899385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-25dd591c-fc73-4c73-a8b1-55f547e0a8b1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:03.909788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25dd591c-fc73-4c73-a8b1-55f547e0a8b1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:03.910384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25dd591c-fc73-4c73-a8b1-55f547e0a8b1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:03.911348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25dd591c-fc73-4c73-a8b1-55f547e0a8b1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:03.912051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25dd591c-fc73-4c73-a8b1-55f547e0a8b1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:03.923211 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4fccc3bb-c80e-4247-9ff5-fe33ab63990c tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.636723 Jul 28 03:45:03.924259 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1152/2072] 10.222.0.48 () {60 vars in 1313 bytes} [Thu Jul 28 03:45:03 2022] PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata/os_version => generated 31 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:45:03.929939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0658bb8f-3697-46b0-9938-f2792207fae8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:03.931028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0658bb8f-3697-46b0-9938-f2792207fae8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:03.943725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0658bb8f-3697-46b0-9938-f2792207fae8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:03.944660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0658bb8f-3697-46b0-9938-f2792207fae8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:03.946062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0658bb8f-3697-46b0-9938-f2792207fae8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:03.946781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0658bb8f-3697-46b0-9938-f2792207fae8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:04.241167 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-25dd591c-fc73-4c73-a8b1-55f547e0a8b1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:04.254423 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-25dd591c-fc73-4c73-a8b1-55f547e0a8b1 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1317 microversion: 2.1 time: 0.363391 Jul 28 03:45:04.255705 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 921/2073] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:03 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:04.262604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aed286a0-3b0b-4ee9-aadb-fa2cff1d4b71 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Calling method '.version_select at 0x7ffa741cf820>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:04.321105 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aed286a0-3b0b-4ee9-aadb-fa2cff1d4b71 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "GET /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata" status: 200 len: 58 microversion: 2.1 time: 0.063930 Jul 28 03:45:04.324698 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 922/2074] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Jul 28 03:45:04 2022] GET /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata => generated 58 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:45:04.336340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-35857b37-ac22-408b-9e37-a424703f02ac req-36712da8-79b9-4261-b368-e27662d7a27b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282080fd-6332-429d-b6cd-3f760b08a955", "name": "network-vif-plugged", "status": "completed", "tag": "ddc6e41a-3432-46c0-ac89-3875e939f2a8"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:04.351560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-35857b37-ac22-408b-9e37-a424703f02ac req-36712da8-79b9-4261-b368-e27662d7a27b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:04.351866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-35857b37-ac22-408b-9e37-a424703f02ac req-36712da8-79b9-4261-b368-e27662d7a27b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:04.631776 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-35857b37-ac22-408b-9e37-a424703f02ac req-36712da8-79b9-4261-b368-e27662d7a27b service nova] Creating event network-vif-plugged:ddc6e41a-3432-46c0-ac89-3875e939f2a8 for instance 282080fd-6332-429d-b6cd-3f760b08a955 on n-h2-826756-3 Jul 28 03:45:04.637699 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-35857b37-ac22-408b-9e37-a424703f02ac req-36712da8-79b9-4261-b368-e27662d7a27b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.311462 Jul 28 03:45:04.638409 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 923/2075] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:04.646598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2a4be5ee-fcb2-478f-be4e-75884f9ca765 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:04.647710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2a4be5ee-fcb2-478f-be4e-75884f9ca765 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:04.655729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a4be5ee-fcb2-478f-be4e-75884f9ca765 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:04.656685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a4be5ee-fcb2-478f-be4e-75884f9ca765 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:04.657917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a4be5ee-fcb2-478f-be4e-75884f9ca765 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:04.658567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a4be5ee-fcb2-478f-be4e-75884f9ca765 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:04.737678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0658bb8f-3697-46b0-9938-f2792207fae8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:04.751811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0658bb8f-3697-46b0-9938-f2792207fae8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:04.756669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0658bb8f-3697-46b0-9938-f2792207fae8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:04.766730 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0658bb8f-3697-46b0-9938-f2792207fae8 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1565 microversion: 2.25 time: 0.840782 Jul 28 03:45:04.767432 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1153/2076] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:45:03 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1565 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:45:04.772945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90be8c8b-bf7b-4172-966f-08efbe9197ad tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Action: 'update_all', calling method: .version_select at 0x7ffa799938b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:04.785004 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2a4be5ee-fcb2-478f-be4e-75884f9ca765 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:04.825443 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2a4be5ee-fcb2-478f-be4e-75884f9ca765 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1184 microversion: 2.1 time: 0.185093 Jul 28 03:45:04.828856 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 924/2077] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:04 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1184 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:04.855717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ba3d623c-ee43-400d-b53c-e070b8937969 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:04.859953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ba3d623c-ee43-400d-b53c-e070b8937969 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:04.903498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba3d623c-ee43-400d-b53c-e070b8937969 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:04.904339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba3d623c-ee43-400d-b53c-e070b8937969 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:04.905346 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba3d623c-ee43-400d-b53c-e070b8937969 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:04.905654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-90be8c8b-bf7b-4172-966f-08efbe9197ad tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:04.909049 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba3d623c-ee43-400d-b53c-e070b8937969 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:04.925803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-90be8c8b-bf7b-4172-966f-08efbe9197ad tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for user 2e13960671284dbfbb1384b0caf13707 and project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:04.946134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:05.197430 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ba3d623c-ee43-400d-b53c-e070b8937969 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:05.213212 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ba3d623c-ee43-400d-b53c-e070b8937969 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1500 microversion: 2.1 time: 0.382193 Jul 28 03:45:05.214284 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 925/2078] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:04 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1500 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:05.242530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4a98a320-95c1-4197-8d74-5e72d637e8d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:05.245897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4a98a320-95c1-4197-8d74-5e72d637e8d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:05.263391 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a98a320-95c1-4197-8d74-5e72d637e8d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:05.264719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a98a320-95c1-4197-8d74-5e72d637e8d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:05.266235 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a98a320-95c1-4197-8d74-5e72d637e8d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:05.267860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a98a320-95c1-4197-8d74-5e72d637e8d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:05.360426 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90be8c8b-bf7b-4172-966f-08efbe9197ad tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata" status: 200 len: 61 microversion: 2.1 time: 0.591421 Jul 28 03:45:05.361641 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1154/2079] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:45:04 2022] PUT /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata => generated 61 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:45:05.368260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d70ea16-74cc-48c3-854b-2846b074d4c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:05.369127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d70ea16-74cc-48c3-854b-2846b074d4c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:05.377409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d70ea16-74cc-48c3-854b-2846b074d4c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:05.389489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d70ea16-74cc-48c3-854b-2846b074d4c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:05.391090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d70ea16-74cc-48c3-854b-2846b074d4c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:05.392226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d70ea16-74cc-48c3-854b-2846b074d4c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:05.541358 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.network.security_group_api [None req-4a98a320-95c1-4197-8d74-5e72d637e8d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Removing security group fd467b19-f2d7-4e72-87c3-fd0e6978601f from port 84847337-6d11-4405-a1fb-e06f3e62221d Jul 28 03:45:05.618808 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 03:45:05.619278 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 03:45:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6/action (ip 10.222.0.48) !!! Jul 28 03:45:05.779597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9d70ea16-74cc-48c3-854b-2846b074d4c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:05.792928 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d70ea16-74cc-48c3-854b-2846b074d4c2 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1317 microversion: 2.1 time: 0.429760 Jul 28 03:45:05.793832 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1155/2080] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:05 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:05.823151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b616025c-4c4f-49f0-8e7e-f3396d2c08ac tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Action: 'create', calling method: .version_select at 0x7ffa7494ce50>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:05.957691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b616025c-4c4f-49f0-8e7e-f3396d2c08ac tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:05.964835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b616025c-4c4f-49f0-8e7e-f3396d2c08ac tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Getting quotas for user 2e13960671284dbfbb1384b0caf13707 and project 96e6a0107be04b60b52f80b61d029b14. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:06.280368 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4a98a320-95c1-4197-8d74-5e72d637e8d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6/action" status: 202 len: 0 microversion: 2.1 time: 1.048370 Jul 28 03:45:06.284541 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 926/2081] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:45:05 2022] POST /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6/action => generated 0 bytes in 1054 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:45:06.291195 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a1afe243-3422-4ed3-b196-a9bb7c2ff547 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:06.304439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a1afe243-3422-4ed3-b196-a9bb7c2ff547 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:06.321246 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a1afe243-3422-4ed3-b196-a9bb7c2ff547 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:06.337245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a1afe243-3422-4ed3-b196-a9bb7c2ff547 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:06.350625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a1afe243-3422-4ed3-b196-a9bb7c2ff547 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:06.353178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a1afe243-3422-4ed3-b196-a9bb7c2ff547 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:06.724076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a1afe243-3422-4ed3-b196-a9bb7c2ff547 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:06.745837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a1afe243-3422-4ed3-b196-a9bb7c2ff547 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:06.748085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a1afe243-3422-4ed3-b196-a9bb7c2ff547 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:06.752809 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a1afe243-3422-4ed3-b196-a9bb7c2ff547 tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1523 microversion: 2.25 time: 0.464219 Jul 28 03:45:06.755246 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 927/2082] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:45:06 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1523 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:45:06.765881 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-183b9d1d-37c9-4942-b1e0-1ab57d87d19a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:06.770629 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-183b9d1d-37c9-4942-b1e0-1ab57d87d19a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:06.782018 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-183b9d1d-37c9-4942-b1e0-1ab57d87d19a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:06.782903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-183b9d1d-37c9-4942-b1e0-1ab57d87d19a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:06.783277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-183b9d1d-37c9-4942-b1e0-1ab57d87d19a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:06.792274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-183b9d1d-37c9-4942-b1e0-1ab57d87d19a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:06.846401 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b616025c-4c4f-49f0-8e7e-f3396d2c08ac tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "POST /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata" status: 200 len: 85 microversion: 2.1 time: 1.049343 Jul 28 03:45:06.848645 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1156/2083] 10.222.0.48 () {60 vars in 1281 bytes} [Thu Jul 28 03:45:05 2022] POST /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata => generated 85 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:45:06.896091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3a823fca-9709-4844-986d-2499d06b8fea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:06.901111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3a823fca-9709-4844-986d-2499d06b8fea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:06.939463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a823fca-9709-4844-986d-2499d06b8fea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:06.940252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a823fca-9709-4844-986d-2499d06b8fea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:06.943508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a823fca-9709-4844-986d-2499d06b8fea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:06.946629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a823fca-9709-4844-986d-2499d06b8fea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:06.971618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-183b9d1d-37c9-4942-b1e0-1ab57d87d19a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:06.982944 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-183b9d1d-37c9-4942-b1e0-1ab57d87d19a tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1184 microversion: 2.1 time: 0.225347 Jul 28 03:45:06.989500 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 928/2084] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:06 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1184 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:07.000633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-1c5f824b-fb2c-4c9e-a598-d6d27fd39d34 req-f3ae5049-cfd1-4a62-b9a9-44d485c26288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d40c5c9-5144-44f2-8688-f63a70730fd6", "tag": "84847337-6d11-4405-a1fb-e06f3e62221d"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:07.026090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1c5f824b-fb2c-4c9e-a598-d6d27fd39d34 req-f3ae5049-cfd1-4a62-b9a9-44d485c26288 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:07.028622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1c5f824b-fb2c-4c9e-a598-d6d27fd39d34 req-f3ae5049-cfd1-4a62-b9a9-44d485c26288 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:07.068958 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-1c5f824b-fb2c-4c9e-a598-d6d27fd39d34 req-f3ae5049-cfd1-4a62-b9a9-44d485c26288 service nova] Creating event network-changed:84847337-6d11-4405-a1fb-e06f3e62221d for instance 8d40c5c9-5144-44f2-8688-f63a70730fd6 on n-h1-826756-3 Jul 28 03:45:07.077943 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-1c5f824b-fb2c-4c9e-a598-d6d27fd39d34 req-f3ae5049-cfd1-4a62-b9a9-44d485c26288 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086615 Jul 28 03:45:07.090257 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 929/2085] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:07.338538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3a823fca-9709-4844-986d-2499d06b8fea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:07.352888 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3a823fca-9709-4844-986d-2499d06b8fea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1458 microversion: 2.1 time: 0.502235 Jul 28 03:45:07.356388 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1157/2086] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:06 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1458 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:07.380106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af845ddd-8a3c-4300-b5d8-2a8bb9a76135 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:07.386773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-af845ddd-8a3c-4300-b5d8-2a8bb9a76135 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:07.413142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af845ddd-8a3c-4300-b5d8-2a8bb9a76135 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:07.416665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-707270e6-81ec-45d8-a23e-8f648958a4b7 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Action: 'create', calling method: .version_select at 0x7ffa74281ca0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOFXa0vuSfYBQS3q56p0KzV4+KvYHxGP8w9CdWTEg60NckrSOWhXZAWDLyMLaV1KQXMWSpXdlDp4jATExJRBfBDBS425c9QbmNzZgce7zplDF0SdnSX/TmI+AFZtIiXvw=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:07.425502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af845ddd-8a3c-4300-b5d8-2a8bb9a76135 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:07.434338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af845ddd-8a3c-4300-b5d8-2a8bb9a76135 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:07.435530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af845ddd-8a3c-4300-b5d8-2a8bb9a76135 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:07.437034 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-707270e6-81ec-45d8-a23e-8f648958a4b7 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-707270e6-81ec-45d8-a23e-8f648958a4b7 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Request method failure captured: Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 257 Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gZC5alfY6Hnph4zKWOe8YjkOU2tEBgLvVP54pk49lZTpZk-5BriNK-7sHubNAgqL3K93CYFWcrfhJm8Ego17txso6-EHsK5Zh8qKOl1QlSznzGnP88Ud0FkPzq0zYDDnRu1OvtFQuAUQWtejWarGW3HImgkOxG3FEJsQg5o_WvQKCg Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}] Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 84b2f07a9c79483fa2fdb495d2061175 Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOFXa0vuSfYBQS3q56p0KzV4+KvYHxGP8w9CdWTEg60NckrSOWhXZAWDLyMLaV1KQXMWSpXdlDp4jATExJRBfBDBS425c9QbmNzZgce7zplDF0SdnSX/TmI+AFZtIiXvw=="}} Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOFXa0vuSfYBQS3q56p0KzV4+KvYHxGP8w9CdWTEg60NckrSOWhXZAWDLyMLaV1KQXMWSpXdlDp4jATExJRBfBDBS425c9QbmNzZgce7zplDF0SdnSX/TmI+AFZtIiXvw=='}}} Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in import_key_pair Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6744, in _validate_new_key_pair Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:45:07.447284 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-707270e6-81ec-45d8-a23e-8f648958a4b7 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-707270e6-81ec-45d8-a23e-8f648958a4b7 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.359303 Jul 28 03:45:07.457080 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 930/2087] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:45:07 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 362 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:45:07.466962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-48c5cf6d-28a1-4d2e-9ddc-0cc2f9133bd1 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] Calling method '.version_select at 0x7ffa742df820>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:07.830978 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-48c5cf6d-28a1-4d2e-9ddc-0cc2f9133bd1 tempest-ImagesMetadataTestJSON-131855978 tempest-ImagesMetadataTestJSON-131855978-project] 10.222.0.48 "GET /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata" status: 200 len: 85 microversion: 2.1 time: 0.376069 Jul 28 03:45:07.833416 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 931/2088] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Jul 28 03:45:07 2022] GET /compute/v2.1/images/f8168ace-b963-4053-93d7-f895102eb8cc/metadata => generated 85 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:45:07.847222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-7479aed3-1aaa-402e-a795-3ad814f27760 req-b01ef096-c8b1-429b-9ca2-5fd1fda62e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712656b5-8470-4486-baf2-1c412846c8fc", "name": "network-vif-deleted", "tag": "e54d0f2b-04e3-4f2a-b2ad-ca1a7f88a7e9"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:07.864336 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-7479aed3-1aaa-402e-a795-3ad814f27760 req-b01ef096-c8b1-429b-9ca2-5fd1fda62e44 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:07.865296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-7479aed3-1aaa-402e-a795-3ad814f27760 req-b01ef096-c8b1-429b-9ca2-5fd1fda62e44 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:07.885496 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-7479aed3-1aaa-402e-a795-3ad814f27760 req-b01ef096-c8b1-429b-9ca2-5fd1fda62e44 service nova] Creating event network-vif-deleted:e54d0f2b-04e3-4f2a-b2ad-ca1a7f88a7e9 for instance 712656b5-8470-4486-baf2-1c412846c8fc on n-h1-826756-3 Jul 28 03:45:07.893793 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-7479aed3-1aaa-402e-a795-3ad814f27760 req-b01ef096-c8b1-429b-9ca2-5fd1fda62e44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058186 Jul 28 03:45:07.897173 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 932/2089] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:07.902826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3e677886-094e-4ea3-a403-628625384e87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:07.903476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3e677886-094e-4ea3-a403-628625384e87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:07.912873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-af845ddd-8a3c-4300-b5d8-2a8bb9a76135 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:07.913600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e677886-094e-4ea3-a403-628625384e87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:07.913600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e677886-094e-4ea3-a403-628625384e87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:07.914301 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e677886-094e-4ea3-a403-628625384e87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:07.914741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e677886-094e-4ea3-a403-628625384e87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:07.936382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:07.941594 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-af845ddd-8a3c-4300-b5d8-2a8bb9a76135 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1467 microversion: 2.1 time: 0.560570 Jul 28 03:45:07.959372 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1158/2090] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:07 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1467 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:07.975298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2e4398d0-ff13-4247-8b54-d8d6fe9e7898 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Action: 'create', calling method: .version_select at 0x7ffa79957940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1228771403", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:08.025754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2e4398d0-ff13-4247-8b54-d8d6fe9e7898 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Getting quotas for project c54582cfd94649a28b928d82f900ef5c. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:08.038351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2e4398d0-ff13-4247-8b54-d8d6fe9e7898 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Getting quotas for user 84b2f07a9c79483fa2fdb495d2061175 and project c54582cfd94649a28b928d82f900ef5c. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:08.082714 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-2e4398d0-ff13-4247-8b54-d8d6fe9e7898 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2e4398d0-ff13-4247-8b54-d8d6fe9e7898 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Request method failure captured: Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 2167 Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gZC5alfY6Hnph4zKWOe8YjkOU2tEBgLvVP54pk49lZTpZk-5BriNK-7sHubNAgqL3K93CYFWcrfhJm8Ego17txso6-EHsK5Zh8qKOl1QlSznzGnP88Ud0FkPzq0zYDDnRu1OvtFQuAUQWtejWarGW3HImgkOxG3FEJsQg5o_WvQKCg Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}] Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 84b2f07a9c79483fa2fdb495d2061175 Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1228771403", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:45:08.101932 n-d-826756-3 devstack@n-api.service[126071]: exception: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1228771403', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 75, in generate_fingerprint Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6783, in import_key_pair Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6856, in _generate_fingerprint Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 81, in generate_fingerprint Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:08.104694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:08.108192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2e4398d0-ff13-4247-8b54-d8d6fe9e7898 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:08.122142 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2e4398d0-ff13-4247-8b54-d8d6fe9e7898 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.147578 Jul 28 03:45:08.122142 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1159/2091] 10.222.0.48 () {60 vars in 1160 bytes} [Thu Jul 28 03:45:07 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:45:08.128911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3b51d74-6101-4584-b7eb-becdb0506b8f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:08.129568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3b51d74-6101-4584-b7eb-becdb0506b8f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:08.151400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3b51d74-6101-4584-b7eb-becdb0506b8f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:08.151860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3b51d74-6101-4584-b7eb-becdb0506b8f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:08.152701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3b51d74-6101-4584-b7eb-becdb0506b8f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:08.153136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3b51d74-6101-4584-b7eb-becdb0506b8f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:08.165116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3e677886-094e-4ea3-a403-628625384e87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:08.180896 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3e677886-094e-4ea3-a403-628625384e87 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.282490 Jul 28 03:45:08.182137 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 933/2092] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:07 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:08.204105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2079664e-c1f4-45fa-ad5d-4ca723121630 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:08.216428 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2079664e-c1f4-45fa-ad5d-4ca723121630 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:08.243280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2079664e-c1f4-45fa-ad5d-4ca723121630 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:08.243725 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2079664e-c1f4-45fa-ad5d-4ca723121630 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:08.247416 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2079664e-c1f4-45fa-ad5d-4ca723121630 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:08.247756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2079664e-c1f4-45fa-ad5d-4ca723121630 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:08.336397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3b51d74-6101-4584-b7eb-becdb0506b8f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:08.336862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3b51d74-6101-4584-b7eb-becdb0506b8f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:08.337387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-b3b51d74-6101-4584-b7eb-becdb0506b8f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lazy-loading 'fault' on Instance uuid 712656b5-8470-4486-baf2-1c412846c8fc {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:45:08.549468 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2079664e-c1f4-45fa-ad5d-4ca723121630 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1618 microversion: 2.1 time: 0.365876 Jul 28 03:45:08.553289 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 934/2093] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:08 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1618 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:08.569414 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-49cc14ef-b803-4297-be2b-b01293e6b657 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:08.570381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-49cc14ef-b803-4297-be2b-b01293e6b657 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:08.583487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-49cc14ef-b803-4297-be2b-b01293e6b657 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:08.586136 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-49cc14ef-b803-4297-be2b-b01293e6b657 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:08.588303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-49cc14ef-b803-4297-be2b-b01293e6b657 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:08.590295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-49cc14ef-b803-4297-be2b-b01293e6b657 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:08.642388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3b51d74-6101-4584-b7eb-becdb0506b8f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:08.652216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3b51d74-6101-4584-b7eb-becdb0506b8f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:08.657967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3b51d74-6101-4584-b7eb-becdb0506b8f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c2e3c37253bc408682e9a15c3b5a85ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881125b6bb84430fb4f2e0c6ebf79983', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:08.662257 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3b51d74-6101-4584-b7eb-becdb0506b8f tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 200 len: 1352 microversion: 2.25 time: 0.546024 Jul 28 03:45:08.665369 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1160/2094] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:45:08 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 1352 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:45:08.690440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8e1baeb9-633b-4470-8e6c-864fdab3e8f1 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Action: 'create', calling method: .version_select at 0x7ffa740aae50>, body: {"keypair": {"name": "tempest-keypair-756225744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnF6iX5ApUfJTlB0iBDGUWZrnzupNJo0rqA6msXcd567nklQBoxMyNsU8V9cQIA0ek2d49FiFnVoRDfjNlpR3H624vsM6MSuPrN7A5iipy1Ng9OHEGx3lpkPeyc4qEqMQ=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:08.779580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-8e1baeb9-633b-4470-8e6c-864fdab3e8f1 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Getting quotas for project c54582cfd94649a28b928d82f900ef5c. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:08.787660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-49cc14ef-b803-4297-be2b-b01293e6b657 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:08.804278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-8e1baeb9-633b-4470-8e6c-864fdab3e8f1 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Getting quotas for user 84b2f07a9c79483fa2fdb495d2061175 and project c54582cfd94649a28b928d82f900ef5c. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:08.817274 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-49cc14ef-b803-4297-be2b-b01293e6b657 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 200 len: 1184 microversion: 2.1 time: 0.261859 Jul 28 03:45:08.821997 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 935/2095] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:08 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 1184 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:08.835167 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dffe6ea5-0392-4b61-a016-f0da1f40b01a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:08.839764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dffe6ea5-0392-4b61-a016-f0da1f40b01a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:08.859683 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dffe6ea5-0392-4b61-a016-f0da1f40b01a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:08.860303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dffe6ea5-0392-4b61-a016-f0da1f40b01a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:08.861059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dffe6ea5-0392-4b61-a016-f0da1f40b01a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:08.861506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dffe6ea5-0392-4b61-a016-f0da1f40b01a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:08.879755 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8e1baeb9-633b-4470-8e6c-864fdab3e8f1 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.209387 Jul 28 03:45:08.889044 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1161/2096] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:45:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:08.897473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-184861539", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "928e7a74-9453-46fe-a1dd-ebc281e8ea52"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:09.044216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dffe6ea5-0392-4b61-a016-f0da1f40b01a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:09.055739 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dffe6ea5-0392-4b61-a016-f0da1f40b01a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.232539 Jul 28 03:45:09.057863 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 936/2097] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:08 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:09.063968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eebc2173-d04e-451d-971e-999f34dc0ba3 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Action: 'create', calling method: .version_select at 0x7ffa742df8b0>, body: {"keypair": {"name": "tempest-keypair-756225744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7uxgc2ztRTwIYcEcShXl3I8vwQ8Njsk7hdtvoAfpfkJeurr+/1RB1w3fhV5SMX/Sf+2Un75u8eydzwrpxwAvXxPdlQamCPD4sh8CHDA+j2gcuPh81erjQG8K2MIvxBwQ=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:09.075132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:45:09.086349 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-eebc2173-d04e-451d-971e-999f34dc0ba3 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Getting quotas for project c54582cfd94649a28b928d82f900ef5c. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:09.093263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-eebc2173-d04e-451d-971e-999f34dc0ba3 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Getting quotas for user 84b2f07a9c79483fa2fdb495d2061175 and project c54582cfd94649a28b928d82f900ef5c. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:09.131978 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-eebc2173-d04e-451d-971e-999f34dc0ba3 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] HTTP exception thrown: Key pair 'tempest-keypair-756225744' already exists. Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eebc2173-d04e-451d-971e-999f34dc0ba3 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Request method failure captured: Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 272 Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gZC5alfY6Hnph4zKWOe8YjkOU2tEBgLvVP54pk49lZTpZk-5BriNK-7sHubNAgqL3K93CYFWcrfhJm8Ego17txso6-EHsK5Zh8qKOl1QlSznzGnP88Ud0FkPzq0zYDDnRu1OvtFQuAUQWtejWarGW3HImgkOxG3FEJsQg5o_WvQKCg Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}] Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 84b2f07a9c79483fa2fdb495d2061175 Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: {"keypair": {"name": "tempest-keypair-756225744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7uxgc2ztRTwIYcEcShXl3I8vwQ8Njsk7hdtvoAfpfkJeurr+/1RB1w3fhV5SMX/Sf+2Un75u8eydzwrpxwAvXxPdlQamCPD4sh8CHDA+j2gcuPh81erjQG8K2MIvxBwQ=="}} Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: exception: Key pair 'tempest-keypair-756225744' already exists. Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-756225744', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7uxgc2ztRTwIYcEcShXl3I8vwQ8Njsk7hdtvoAfpfkJeurr+/1RB1w3fhV5SMX/Sf+2Un75u8eydzwrpxwAvXxPdlQamCPD4sh8CHDA+j2gcuPh81erjQG8K2MIvxBwQ=='}}} Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result.read() Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '84b2f07a9c79483fa2fdb495d2061175-tempest-keypair-756225744' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 28 03:45:09.175397 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi session.flush() Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result.read() Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 28 03:45:09.183063 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '84b2f07a9c79483fa2fdb495d2061175-tempest-keypair-756225744' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 28, 3, 45, 9, 119684), 'updated_at': None, 'name': 'tempest-keypair-756225744', 'user_id': '84b2f07a9c79483fa2fdb495d2061175', 'fingerprint': '73:11:22:64:32:1a:ff:c2:fc:10:48:69:94:25:0c:ae', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7uxgc2ztRTwIYcEcShXl3I8vwQ8Njsk7hdtvoAfpfkJeurr+/1RB1w3fhV5SMX/Sf+2Un75u8eydzwrpxwAvXxPdlQamCPD4sh8CHDA+j2gcuPh81erjQG8K2MIvxBwQ==', 'type': 'ssh'}] Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6786, in import_key_pair Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi keypair.create() Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._create() Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-756225744' already exists. Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 28 03:45:09.195401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-756225744' already exists. Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-756225744' already exists. Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eebc2173-d04e-451d-971e-999f34dc0ba3 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Returning 409 to user: Key pair 'tempest-keypair-756225744' already exists. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-eebc2173-d04e-451d-971e-999f34dc0ba3 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.118178 Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 937/2098] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:45:09 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d8601621-6ed6-46c7-bcdc-1ef6caf139f0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:09.207594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d8601621-6ed6-46c7-bcdc-1ef6caf139f0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:09.214401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8601621-6ed6-46c7-bcdc-1ef6caf139f0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:09.214401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8601621-6ed6-46c7-bcdc-1ef6caf139f0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:09.214401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8601621-6ed6-46c7-bcdc-1ef6caf139f0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:09.214984 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8601621-6ed6-46c7-bcdc-1ef6caf139f0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:09.425313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d8601621-6ed6-46c7-bcdc-1ef6caf139f0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:09.435106 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d8601621-6ed6-46c7-bcdc-1ef6caf139f0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.255550 Jul 28 03:45:09.436950 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 938/2099] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:09 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:09.443564 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c8c74383-593d-4c55-b364-65f62eee3244 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Calling method '.version_select at 0x7ffa74b3cdc0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:09.490294 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c8c74383-593d-4c55-b364-65f62eee3244 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-756225744" status: 202 len: 0 microversion: 2.1 time: 0.051750 Jul 28 03:45:09.492949 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 939/2100] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 03:45:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-756225744 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:45:09.520767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-283e65f9-6fbe-47ed-b83e-27804407fb8d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:09.522305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-283e65f9-6fbe-47ed-b83e-27804407fb8d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:09.540371 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-283e65f9-6fbe-47ed-b83e-27804407fb8d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:09.542483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-283e65f9-6fbe-47ed-b83e-27804407fb8d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:09.544382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-283e65f9-6fbe-47ed-b83e-27804407fb8d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:09.545457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-283e65f9-6fbe-47ed-b83e-27804407fb8d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:09.894979 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-283e65f9-6fbe-47ed-b83e-27804407fb8d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:09.909844 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-283e65f9-6fbe-47ed-b83e-27804407fb8d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.414471 Jul 28 03:45:09.939401 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 940/2101] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:09 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:09.954546 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d5567e1b-d037-4811-aa13-4bdcc229a367 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Action: 'create', calling method: .version_select at 0x7ffa749db820>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLxI6HvLQtFGvDiWMtnPjpy03y9ZvnhR1GuMY4QMTQDnkwkvFIYR7EbbHKEBks0aKr1NcLYPisfnzASdeEL3n+evXv2WMw0v7K/DFcEKA8rGcE6kIlf9Xf4jm4Yw/1SBA=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d5567e1b-d037-4811-aa13-4bdcc229a367 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Request method failure captured: Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 247 Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gZC5alfY6Hnph4zKWOe8YjkOU2tEBgLvVP54pk49lZTpZk-5BriNK-7sHubNAgqL3K93CYFWcrfhJm8Ego17txso6-EHsK5Zh8qKOl1QlSznzGnP88Ud0FkPzq0zYDDnRu1OvtFQuAUQWtejWarGW3HImgkOxG3FEJsQg5o_WvQKCg Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}] Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 84b2f07a9c79483fa2fdb495d2061175 Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLxI6HvLQtFGvDiWMtnPjpy03y9ZvnhR1GuMY4QMTQDnkwkvFIYR7EbbHKEBks0aKr1NcLYPisfnzASdeEL3n+evXv2WMw0v7K/DFcEKA8rGcE6kIlf9Xf4jm4Yw/1SBA=="}} Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLxI6HvLQtFGvDiWMtnPjpy03y9ZvnhR1GuMY4QMTQDnkwkvFIYR7EbbHKEBks0aKr1NcLYPisfnzASdeEL3n+evXv2WMw0v7K/DFcEKA8rGcE6kIlf9Xf4jm4Yw/1SBA=='}}} Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi '' Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:45:09.962665 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d5567e1b-d037-4811-aa13-4bdcc229a367 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d5567e1b-d037-4811-aa13-4bdcc229a367 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.022856 Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 941/2102] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:45:09 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ba95cf73-7ffb-4377-b78b-f36825d6505b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:09.974740 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ba95cf73-7ffb-4377-b78b-f36825d6505b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] [instance: 712656b5-8470-4486-baf2-1c412846c8fc] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:09.989718 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba95cf73-7ffb-4377-b78b-f36825d6505b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:09.990364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba95cf73-7ffb-4377-b78b-f36825d6505b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:09.991426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba95cf73-7ffb-4377-b78b-f36825d6505b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:09.992080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba95cf73-7ffb-4377-b78b-f36825d6505b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:10.015457 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-ba95cf73-7ffb-4377-b78b-f36825d6505b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] HTTP exception thrown: Instance 712656b5-8470-4486-baf2-1c412846c8fc could not be found. Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ba95cf73-7ffb-4377-b78b-f36825d6505b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Request method failure captured: Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc HTTP/1.1 Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gRTlOQD0JbHLWV1qE11jK-cWmq9h6So3GdIK_l_LgG0zJSGUGbuNujelyC2c7ii7FUgmuEMG6OMyr31fUe0nK66LkIG3wld16Oot0uEKF9_vJd2kCcf4CyhUJhOkEkiL25lS9B0yAPfzfwOMFHm2nFD-4FHQcDCugv6eWkRt6zp4NM Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Openstack-Nova-Api-Version: 2.25 Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 881125b6bb84430fb4f2e0c6ebf79983 Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1142275898 Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/881125b6bb84430fb4f2e0c6ebf79983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/881125b6bb84430fb4f2e0c6ebf79983"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_881125b6bb84430fb4f2e0c6ebf79983"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/881125b6bb84430fb4f2e0c6ebf79983"}]}] Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1142275898 Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 881125b6bb84430fb4f2e0c6ebf79983 Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1142275898 Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-LiveAutoBlockMigrationV225Test-1142275898-project Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: c2e3c37253bc408682e9a15c3b5a85ab Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1142275898-project Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 712656b5-8470-4486-baf2-1c412846c8fc could not be found. Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '712656b5-8470-4486-baf2-1c412846c8fc'} Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 712656b5-8470-4486-baf2-1c412846c8fc could not be found. Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 712656b5-8470-4486-baf2-1c412846c8fc could not be found. Jul 28 03:45:10.017781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.022578 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:10.022578 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.022578 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.022578 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:10.022578 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:10.022578 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:10.022578 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:10.022578 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 712656b5-8470-4486-baf2-1c412846c8fc could not be found. Jul 28 03:45:10.022578 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.022578 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ba95cf73-7ffb-4377-b78b-f36825d6505b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] Returning 404 to user: Instance 712656b5-8470-4486-baf2-1c412846c8fc could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:10.022578 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ba95cf73-7ffb-4377-b78b-f36825d6505b tempest-LiveAutoBlockMigrationV225Test-1142275898 tempest-LiveAutoBlockMigrationV225Test-1142275898-project] 10.222.0.48 "GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc" status: 404 len: 111 microversion: 2.25 time: 0.055133 Jul 28 03:45:10.025851 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 942/2103] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:45:09 2022] GET /compute/v2.1/servers/712656b5-8470-4486-baf2-1c412846c8fc => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:45:10.045101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4c8e7ef0-1821-42ea-adac-622d8e1a8579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:10.045743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4c8e7ef0-1821-42ea-adac-622d8e1a8579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: c42fcd75-f3a9-4abb-a5fd-f8c600bbb272] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:10.066939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c8e7ef0-1821-42ea-adac-622d8e1a8579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:10.067703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c8e7ef0-1821-42ea-adac-622d8e1a8579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:10.069129 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c8e7ef0-1821-42ea-adac-622d8e1a8579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:10.070646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c8e7ef0-1821-42ea-adac-622d8e1a8579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:10.099125 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-4c8e7ef0-1821-42ea-adac-622d8e1a8579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] HTTP exception thrown: Instance c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 could not be found. Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4c8e7ef0-1821-42ea-adac-622d8e1a8579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Request method failure captured: Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 HTTP/1.1 Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gRj0FqWwOpoVP2owSAjguA3DsRSH6TIya9-EWnkVZtCqS6_h7OguHt7IKpgIppQJgCNK59gVYl5A3h0uP6xrW2p02Mq2gZGLXlakDqP8yRhNLK_Qn7CVTwPof3e13rGjG9FrhmvYn5-vT0oEdd65tn_XGfH3Y79dIB8lYgZeg0LH6c Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 006f4f23380b45fab24edfea5be8f3a7 Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-LiveMigrationTest-1436833818 Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/006f4f23380b45fab24edfea5be8f3a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/006f4f23380b45fab24edfea5be8f3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_006f4f23380b45fab24edfea5be8f3a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/006f4f23380b45fab24edfea5be8f3a7"}]}] Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-LiveMigrationTest-1436833818 Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 006f4f23380b45fab24edfea5be8f3a7 Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-LiveMigrationTest-1436833818 Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-LiveMigrationTest-1436833818-project Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 15947ba65c714e0dbb60fc36afcb9a9c Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-LiveMigrationTest-1436833818-project Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 could not be found. Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'c42fcd75-f3a9-4abb-a5fd-f8c600bbb272'} Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 could not be found. Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 could not be found. Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:10.102812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.107636 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.107636 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:10.107636 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:10.107636 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:10.107636 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:10.107636 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 could not be found. Jul 28 03:45:10.107636 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.107636 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4c8e7ef0-1821-42ea-adac-622d8e1a8579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Returning 404 to user: Instance c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:10.107636 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4c8e7ef0-1821-42ea-adac-622d8e1a8579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272" status: 404 len: 111 microversion: 2.1 time: 0.078546 Jul 28 03:45:10.113293 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 943/2104] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:10 2022] GET /compute/v2.1/servers/c42fcd75-f3a9-4abb-a5fd-f8c600bbb272 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:45:10.124273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4938e5d6-5b68-442d-90bd-db2e7acb7c8f tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Action: 'create', calling method: .version_select at 0x7ffa74a335e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1664804265", "public_key": " "}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:10.198643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-4938e5d6-5b68-442d-90bd-db2e7acb7c8f tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Getting quotas for project c54582cfd94649a28b928d82f900ef5c. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:10.212303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-4938e5d6-5b68-442d-90bd-db2e7acb7c8f tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Getting quotas for user 84b2f07a9c79483fa2fdb495d2061175 and project c54582cfd94649a28b928d82f900ef5c. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:10.257698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:45:10.259012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:45:10.260430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:45:10.261241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:45:10.261929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:45:10.295254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:10.299009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:10.300735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:10.301285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:10.360934 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-4938e5d6-5b68-442d-90bd-db2e7acb7c8f tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4938e5d6-5b68-442d-90bd-db2e7acb7c8f tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Request method failure captured: Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 95 Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gZC5alfY6Hnph4zKWOe8YjkOU2tEBgLvVP54pk49lZTpZk-5BriNK-7sHubNAgqL3K93CYFWcrfhJm8Ego17txso6-EHsK5Zh8qKOl1QlSznzGnP88Ud0FkPzq0zYDDnRu1OvtFQuAUQWtejWarGW3HImgkOxG3FEJsQg5o_WvQKCg Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}] Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 84b2f07a9c79483fa2fdb495d2061175 Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1664804265", "public_key": " "}} Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: exception: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1664804265', 'public_key': ' '}}} Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 75, in generate_fingerprint Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6783, in import_key_pair Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6856, in _generate_fingerprint Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 81, in generate_fingerprint Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.363690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4938e5d6-5b68-442d-90bd-db2e7acb7c8f tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4938e5d6-5b68-442d-90bd-db2e7acb7c8f tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.250393 Jul 28 03:45:10.384145 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 944/2105] 10.222.0.48 () {60 vars in 1158 bytes} [Thu Jul 28 03:45:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 262 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:45:10.391655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for project 6979063538ee4bf08537b46bfb6e4249. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:10.393169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1895478815", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f76c85a0-c616-4cd2-a4d5-29a90d49abe8"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:10.394780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Getting quotas for user ff63655143224ba9831e8dcb7a4d2e37 and project 6979063538ee4bf08537b46bfb6e4249. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:10.424523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:45:10.434924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:45:10.527776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] validate_networks() for [('f76c85a0-c616-4cd2-a4d5-29a90d49abe8', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:45:10.546547 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-22a2a66b-90e7-45d0-97f8-83f67a438491 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.661646 Jul 28 03:45:10.547624 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1162/2106] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:45:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:45:10.568286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aa671052-180a-49bf-a285-5bc269140093 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Action: 'create', calling method: .version_select at 0x7ffa67ae7670>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDdKx5ahMUyh6dHsF1lEGv8AmLoB9aK5SN5PNNUso/tH0Lxgqx7gbNUysY/oG4zkBe1hsZJsT9SszhoRw472CnmIRAMtJtab/jYGJP6QMlHeeWQX1I/Kqj/CDilgd4XmA=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aa671052-180a-49bf-a285-5bc269140093 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Request method failure captured: Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 507 Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gZC5alfY6Hnph4zKWOe8YjkOU2tEBgLvVP54pk49lZTpZk-5BriNK-7sHubNAgqL3K93CYFWcrfhJm8Ego17txso6-EHsK5Zh8qKOl1QlSznzGnP88Ud0FkPzq0zYDDnRu1OvtFQuAUQWtejWarGW3HImgkOxG3FEJsQg5o_WvQKCg Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}] Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 84b2f07a9c79483fa2fdb495d2061175 Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDdKx5ahMUyh6dHsF1lEGv8AmLoB9aK5SN5PNNUso/tH0Lxgqx7gbNUysY/oG4zkBe1hsZJsT9SszhoRw472CnmIRAMtJtab/jYGJP6QMlHeeWQX1I/Kqj/CDilgd4XmA=="}} Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDdKx5ahMUyh6dHsF1lEGv8AmLoB9aK5SN5PNNUso/tH0Lxgqx7gbNUysY/oG4zkBe1hsZJsT9SszhoRw472CnmIRAMtJtab/jYGJP6QMlHeeWQX1I/Kqj/CDilgd4XmA=='}}} Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 28 03:45:10.573265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 28 03:45:10.577266 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.593475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aa671052-180a-49bf-a285-5bc269140093 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:10.596148 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aa671052-180a-49bf-a285-5bc269140093 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.042014 Jul 28 03:45:10.597439 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1163/2107] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:45:10 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:45:10.602800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a2ba0895-b616-46c9-bcd6-cff7943d7aa5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:10.609763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a2ba0895-b616-46c9-bcd6-cff7943d7aa5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:10.770207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a2ba0895-b616-46c9-bcd6-cff7943d7aa5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:10.779320 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a2ba0895-b616-46c9-bcd6-cff7943d7aa5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1216 microversion: 2.1 time: 0.180457 Jul 28 03:45:10.784312 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1164/2108] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:10 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1216 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:10.790063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-50f2b99d-1a85-4e32-9665-6faf5fd241e7 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Action: 'create', calling method: .version_select at 0x7ffa79997430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1333256980", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:10.838583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-50f2b99d-1a85-4e32-9665-6faf5fd241e7 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Getting quotas for project c54582cfd94649a28b928d82f900ef5c. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:10.853511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-50f2b99d-1a85-4e32-9665-6faf5fd241e7 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Getting quotas for user 84b2f07a9c79483fa2fdb495d2061175 and project c54582cfd94649a28b928d82f900ef5c. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:10.925283 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-50f2b99d-1a85-4e32-9665-6faf5fd241e7 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-50f2b99d-1a85-4e32-9665-6faf5fd241e7 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Request method failure captured: Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 118 Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gZC5alfY6Hnph4zKWOe8YjkOU2tEBgLvVP54pk49lZTpZk-5BriNK-7sHubNAgqL3K93CYFWcrfhJm8Ego17txso6-EHsK5Zh8qKOl1QlSznzGnP88Ud0FkPzq0zYDDnRu1OvtFQuAUQWtejWarGW3HImgkOxG3FEJsQg5o_WvQKCg Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}] Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 84b2f07a9c79483fa2fdb495d2061175 Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1333256980", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: exception: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1333256980', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 75, in generate_fingerprint Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6783, in import_key_pair Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6856, in _generate_fingerprint Jul 28 03:45:10.941538 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 81, in generate_fingerprint Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-50f2b99d-1a85-4e32-9665-6faf5fd241e7 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:10.952756 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-50f2b99d-1a85-4e32-9665-6faf5fd241e7 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.158656 Jul 28 03:45:10.966901 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1165/2109] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:45:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:45:10.977821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb698da8-65d0-4f0a-a714-4158cfb200e2 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Calling method '.version_select at 0x7ffa7998f5e0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:11.059171 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-eb698da8-65d0-4f0a-a714-4158cfb200e2 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1239805940 not found for user 84b2f07a9c79483fa2fdb495d2061175 Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb698da8-65d0-4f0a-a714-4158cfb200e2 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Request method failure captured: Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1239805940 HTTP/1.1 Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gZC5alfY6Hnph4zKWOe8YjkOU2tEBgLvVP54pk49lZTpZk-5BriNK-7sHubNAgqL3K93CYFWcrfhJm8Ego17txso6-EHsK5Zh8qKOl1QlSznzGnP88Ud0FkPzq0zYDDnRu1OvtFQuAUQWtejWarGW3HImgkOxG3FEJsQg5o_WvQKCg Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c54582cfd94649a28b928d82f900ef5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c54582cfd94649a28b928d82f900ef5c"}]}] Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: c54582cfd94649a28b928d82f900ef5c Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-78104519 Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 84b2f07a9c79483fa2fdb495d2061175 Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-KeyPairsNegativeTestJSON-78104519-project Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: exception: Keypair tempest-keypair-non-existent-1239805940 not found for user 84b2f07a9c79483fa2fdb495d2061175 Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'tempest-keypair-non-existent-1239805940'} Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6870, in delete_key_pair Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6891, in get_key_pair Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1239805940 not found for user 84b2f07a9c79483fa2fdb495d2061175 Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:11.076114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1239805940 not found for user 84b2f07a9c79483fa2fdb495d2061175 Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1239805940 not found for user 84b2f07a9c79483fa2fdb495d2061175 Jul 28 03:45:11.081892 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:11.084591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb698da8-65d0-4f0a-a714-4158cfb200e2 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1239805940 not found for user 84b2f07a9c79483fa2fdb495d2061175 {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:11.086907 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb698da8-65d0-4f0a-a714-4158cfb200e2 tempest-KeyPairsNegativeTestJSON-78104519 tempest-KeyPairsNegativeTestJSON-78104519-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1239805940" status: 404 len: 145 microversion: 2.1 time: 0.121589 Jul 28 03:45:11.092925 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1166/2110] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Jul 28 03:45:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1239805940 => generated 145 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:45:11.809320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cfa37b5c-2236-4d68-a6df-6f2b76fcb18b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:11.811334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cfa37b5c-2236-4d68-a6df-6f2b76fcb18b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:11.850758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfa37b5c-2236-4d68-a6df-6f2b76fcb18b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:11.851554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfa37b5c-2236-4d68-a6df-6f2b76fcb18b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:11.852704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfa37b5c-2236-4d68-a6df-6f2b76fcb18b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:11.853246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfa37b5c-2236-4d68-a6df-6f2b76fcb18b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:12.151589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cfa37b5c-2236-4d68-a6df-6f2b76fcb18b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:12.176334 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cfa37b5c-2236-4d68-a6df-6f2b76fcb18b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1220 microversion: 2.1 time: 0.371943 Jul 28 03:45:12.182114 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1167/2111] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:11 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1220 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:13.075315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:45:13.076043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:45:13.076224 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:45:13.076664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:45:13.077312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:45:13.093290 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:13.097326 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:13.100527 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:13.101729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:13.144735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Getting quotas for project b7bee0b59b0b43ce80623b7aca24111a. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:13.159397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Getting quotas for user 26b9a63a13e1420aa3b7f299456c65e6 and project b7bee0b59b0b43ce80623b7aca24111a. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:13.176553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:13.201614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:45:13.209526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06fa8812-5d40-40d3-af24-93fe26736f96 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:13.210938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-06fa8812-5d40-40d3-af24-93fe26736f96 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:13.217391 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:45:13.227164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06fa8812-5d40-40d3-af24-93fe26736f96 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:13.227634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06fa8812-5d40-40d3-af24-93fe26736f96 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:13.228506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06fa8812-5d40-40d3-af24-93fe26736f96 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:13.228940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06fa8812-5d40-40d3-af24-93fe26736f96 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:13.315341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:13.338793 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-67b9f416-b60c-4d7b-91ba-fd05c27fadea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.961302 Jul 28 03:45:13.339877 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 945/2112] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:45:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:45:13.352653 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4b29d577-6a0c-460f-b568-dc88b0ff794a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:13.353728 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4b29d577-6a0c-460f-b568-dc88b0ff794a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:13.521218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4b29d577-6a0c-460f-b568-dc88b0ff794a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:13.556680 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4b29d577-6a0c-460f-b568-dc88b0ff794a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1215 microversion: 2.1 time: 0.207989 Jul 28 03:45:13.560468 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 946/2113] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:13 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1215 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:13.648127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-06fa8812-5d40-40d3-af24-93fe26736f96 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:13.667521 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-06fa8812-5d40-40d3-af24-93fe26736f96 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1274 microversion: 2.1 time: 0.460127 Jul 28 03:45:13.670728 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1168/2114] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:13 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1274 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:14.586119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f95d89af-0b45-46c2-81a1-b298ea318c8c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:14.587641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f95d89af-0b45-46c2-81a1-b298ea318c8c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:14.714647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc22b96c-082a-4a9a-aa90-f1331523db35 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:14.715285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dc22b96c-082a-4a9a-aa90-f1331523db35 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:14.738815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc22b96c-082a-4a9a-aa90-f1331523db35 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:14.740215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc22b96c-082a-4a9a-aa90-f1331523db35 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:14.741950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc22b96c-082a-4a9a-aa90-f1331523db35 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:14.748499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc22b96c-082a-4a9a-aa90-f1331523db35 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:15.373570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f95d89af-0b45-46c2-81a1-b298ea318c8c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:15.391562 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f95d89af-0b45-46c2-81a1-b298ea318c8c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1215 microversion: 2.1 time: 0.809956 Jul 28 03:45:15.394996 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 947/2115] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:14 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1215 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:15.519581 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ff32ddc2-cb4f-45d3-b4ae-20b18a7cfbbb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74b45940>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:15.613358 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ff32ddc2-cb4f-45d3-b4ae-20b18a7cfbbb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/466518cb-c8da-4961-8302-f178e5706d53" status: 200 len: 662 microversion: 2.1 time: 0.099959 Jul 28 03:45:15.618616 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 948/2116] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:45:15 2022] GET /compute/v2.1/images/466518cb-c8da-4961-8302-f178e5706d53 => generated 662 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:45:15.649832 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-811d6af2-57b4-465c-b1cc-3bc2a861b69a tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74b3cd30>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:15.772600 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-811d6af2-57b4-465c-b1cc-3bc2a861b69a tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/466518cb-c8da-4961-8302-f178e5706d53" status: 200 len: 662 microversion: 2.1 time: 0.130343 Jul 28 03:45:15.778328 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 949/2117] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:45:15 2022] GET /compute/v2.1/images/466518cb-c8da-4961-8302-f178e5706d53 => generated 662 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:16.133466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dc22b96c-082a-4a9a-aa90-f1331523db35 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:16.173765 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc22b96c-082a-4a9a-aa90-f1331523db35 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1316 microversion: 2.1 time: 1.463475 Jul 28 03:45:16.193071 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1169/2118] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:14 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1316 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:16.425324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-96835e70-d3e1-4fb7-8253-5011e8dab2a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:16.430029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-96835e70-d3e1-4fb7-8253-5011e8dab2a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:16.474409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96835e70-d3e1-4fb7-8253-5011e8dab2a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:16.489624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96835e70-d3e1-4fb7-8253-5011e8dab2a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:16.491725 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96835e70-d3e1-4fb7-8253-5011e8dab2a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:16.496027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96835e70-d3e1-4fb7-8253-5011e8dab2a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:17.044071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-96835e70-d3e1-4fb7-8253-5011e8dab2a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:17.073735 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-96835e70-d3e1-4fb7-8253-5011e8dab2a3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1285 microversion: 2.1 time: 0.662005 Jul 28 03:45:17.086268 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 950/2119] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:16 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1285 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:17.207071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-606505b8-76a2-4a8f-8d95-4b6d8735cb28 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:17.207757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-606505b8-76a2-4a8f-8d95-4b6d8735cb28 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:17.235180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-606505b8-76a2-4a8f-8d95-4b6d8735cb28 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:17.236964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-606505b8-76a2-4a8f-8d95-4b6d8735cb28 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:17.238048 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-606505b8-76a2-4a8f-8d95-4b6d8735cb28 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:17.238909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-606505b8-76a2-4a8f-8d95-4b6d8735cb28 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:17.549986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f6ce7c53-8bee-4281-949c-7f57e3e2d985 tempest-ListImagesTestJSON-585070655 tempest-ListImagesTestJSON-585070655-project] Calling method '.version_select at 0x7ffa743ac280>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:17.715133 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f6ce7c53-8bee-4281-949c-7f57e3e2d985 tempest-ListImagesTestJSON-585070655 tempest-ListImagesTestJSON-585070655-project] 10.222.0.48 "GET /compute/v2.1/images/5d43adf9-af92-4117-9ed9-35547daa1220" status: 200 len: 784 microversion: 2.1 time: 0.721995 Jul 28 03:45:17.740810 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1170/2120] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:45:16 2022] GET /compute/v2.1/images/5d43adf9-af92-4117-9ed9-35547daa1220 => generated 784 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:45:17.773073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-360d837d-a63f-45a8-b125-85eae4767c15 tempest-ListImagesTestJSON-585070655 tempest-ListImagesTestJSON-585070655-project] Calling method '.version_select at 0x7ffa67ae7af0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:18.110835 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-360d837d-a63f-45a8-b125-85eae4767c15 tempest-ListImagesTestJSON-585070655 tempest-ListImagesTestJSON-585070655-project] 10.222.0.48 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.365992 Jul 28 03:45:18.112615 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1171/2121] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 03:45:17 2022] GET /compute/v2.1/images => generated 445 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:18.151964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6deb41f7-5c45-4507-b760-af586a00869f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:18.160296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6deb41f7-5c45-4507-b760-af586a00869f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:18.196374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6deb41f7-5c45-4507-b760-af586a00869f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:18.198093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6deb41f7-5c45-4507-b760-af586a00869f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:18.201071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6deb41f7-5c45-4507-b760-af586a00869f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:18.203828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6deb41f7-5c45-4507-b760-af586a00869f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:18.464567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6deb41f7-5c45-4507-b760-af586a00869f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:18.481998 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6deb41f7-5c45-4507-b760-af586a00869f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1273 microversion: 2.1 time: 0.349609 Jul 28 03:45:18.483586 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1172/2122] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:18 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1273 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:18.490448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a955587-cc45-4b63-893e-0a054c087659 tempest-ListImagesTestJSON-585070655 tempest-ListImagesTestJSON-585070655-project] Calling method '.version_select at 0x7ffa743acaf0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:18.598200 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a955587-cc45-4b63-893e-0a054c087659 tempest-ListImagesTestJSON-585070655 tempest-ListImagesTestJSON-585070655-project] 10.222.0.48 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.109222 Jul 28 03:45:18.601599 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1173/2123] 10.222.0.48 () {58 vars in 1143 bytes} [Thu Jul 28 03:45:18 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:18.612901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-047f7661-b795-4713-ace1-f64f974141f0 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa741b68b0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:18.727277 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-047f7661-b795-4713-ace1-f64f974141f0 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/93d6f045-5a09-4083-bf89-512cd020b7f5" status: 200 len: 662 microversion: 2.1 time: 0.122710 Jul 28 03:45:18.729899 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1174/2124] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:45:18 2022] GET /compute/v2.1/images/93d6f045-5a09-4083-bf89-512cd020b7f5 => generated 662 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:18.747315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7531aafc-15d3-4092-af84-803ecf97b494 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa79993940>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:18.751562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-606505b8-76a2-4a8f-8d95-4b6d8735cb28 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:18.763754 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-606505b8-76a2-4a8f-8d95-4b6d8735cb28 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1316 microversion: 2.1 time: 1.560926 Jul 28 03:45:18.769592 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 951/2125] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:17 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1316 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:18.848032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-f5f49b17-ef13-4ce5-a627-f9da00844770 req-4722ae20-cbe3-4887-a066-79fc3c69a757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc36884b-386a-4747-88cc-1fe01a50d0fa", "tag": "e29dc25a-08f7-4ebe-9dc3-6ba12d95d4d0"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:18.872611 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7531aafc-15d3-4092-af84-803ecf97b494 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/93d6f045-5a09-4083-bf89-512cd020b7f5" status: 200 len: 662 microversion: 2.1 time: 0.130420 Jul 28 03:45:18.891264 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1175/2126] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:45:18 2022] GET /compute/v2.1/images/93d6f045-5a09-4083-bf89-512cd020b7f5 => generated 662 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:45:18.914881 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f5f49b17-ef13-4ce5-a627-f9da00844770 req-4722ae20-cbe3-4887-a066-79fc3c69a757 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:18.915613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f5f49b17-ef13-4ce5-a627-f9da00844770 req-4722ae20-cbe3-4887-a066-79fc3c69a757 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:18.954851 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-f5f49b17-ef13-4ce5-a627-f9da00844770 req-4722ae20-cbe3-4887-a066-79fc3c69a757 service nova] Creating event network-changed:e29dc25a-08f7-4ebe-9dc3-6ba12d95d4d0 for instance fc36884b-386a-4747-88cc-1fe01a50d0fa on n-h1-826756-3 Jul 28 03:45:18.965700 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-f5f49b17-ef13-4ce5-a627-f9da00844770 req-4722ae20-cbe3-4887-a066-79fc3c69a757 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127876 Jul 28 03:45:18.966933 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 952/2127] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:45:19.526571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ea97f8a-43dc-4425-9c0d-1797a7bb51ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:19.527706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ea97f8a-43dc-4425-9c0d-1797a7bb51ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:19.544238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ea97f8a-43dc-4425-9c0d-1797a7bb51ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:19.544929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ea97f8a-43dc-4425-9c0d-1797a7bb51ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:19.546067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ea97f8a-43dc-4425-9c0d-1797a7bb51ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:19.552722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ea97f8a-43dc-4425-9c0d-1797a7bb51ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:19.655228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-76d00a61-ae17-4cff-a73a-f2e697871307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:19.655823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-76d00a61-ae17-4cff-a73a-f2e697871307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:19.662400 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76d00a61-ae17-4cff-a73a-f2e697871307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:19.663170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76d00a61-ae17-4cff-a73a-f2e697871307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:19.664124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76d00a61-ae17-4cff-a73a-f2e697871307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:19.664973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76d00a61-ae17-4cff-a73a-f2e697871307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:19.694425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-76d00a61-ae17-4cff-a73a-f2e697871307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:45:19.722966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ea97f8a-43dc-4425-9c0d-1797a7bb51ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:19.735021 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ea97f8a-43dc-4425-9c0d-1797a7bb51ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1273 microversion: 2.1 time: 0.214607 Jul 28 03:45:19.737193 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1176/2128] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:19 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1273 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:19.795272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d5fbbc2d-997d-4ef2-9ce7-82bc75e44f64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:19.795900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d5fbbc2d-997d-4ef2-9ce7-82bc75e44f64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:19.806198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5fbbc2d-997d-4ef2-9ce7-82bc75e44f64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:19.809011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5fbbc2d-997d-4ef2-9ce7-82bc75e44f64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:19.810108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5fbbc2d-997d-4ef2-9ce7-82bc75e44f64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:19.817158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5fbbc2d-997d-4ef2-9ce7-82bc75e44f64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:19.898769 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-76d00a61-ae17-4cff-a73a-f2e697871307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "DELETE /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 204 len: 0 microversion: 2.1 time: 0.248442 Jul 28 03:45:19.900508 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 953/2129] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:45:19 2022] DELETE /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:45:19.915124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0e69039e-c194-49f3-a95b-19846a3d398d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:19.915890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0e69039e-c194-49f3-a95b-19846a3d398d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:19.942735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e69039e-c194-49f3-a95b-19846a3d398d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:19.943165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e69039e-c194-49f3-a95b-19846a3d398d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:19.944027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e69039e-c194-49f3-a95b-19846a3d398d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:19.946783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e69039e-c194-49f3-a95b-19846a3d398d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:20.327499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:20.705135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d5fbbc2d-997d-4ef2-9ce7-82bc75e44f64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:20.708789 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0e69039e-c194-49f3-a95b-19846a3d398d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:20.717257 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0e69039e-c194-49f3-a95b-19846a3d398d tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1668 microversion: 2.1 time: 0.809104 Jul 28 03:45:20.721262 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 954/2130] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:19 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1668 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:20.723654 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d5fbbc2d-997d-4ef2-9ce7-82bc75e44f64 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1316 microversion: 2.1 time: 0.932262 Jul 28 03:45:20.738686 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1177/2131] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:19 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1316 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:20.753553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5a84dc7c-79ee-4466-964c-d9b5d77cfd8d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74874430>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:20.776629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-34c660be-fda2-4ebf-94e1-039dc21d0582 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:20.777408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-34c660be-fda2-4ebf-94e1-039dc21d0582 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:20.802255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34c660be-fda2-4ebf-94e1-039dc21d0582 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:20.802974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34c660be-fda2-4ebf-94e1-039dc21d0582 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:20.805542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34c660be-fda2-4ebf-94e1-039dc21d0582 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:20.808824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34c660be-fda2-4ebf-94e1-039dc21d0582 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:20.830740 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5a84dc7c-79ee-4466-964c-d9b5d77cfd8d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/63d3f827-b791-477e-8d8c-4b2545bde230" status: 200 len: 662 microversion: 2.1 time: 0.083483 Jul 28 03:45:20.831348 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 955/2132] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:45:20 2022] GET /compute/v2.1/images/63d3f827-b791-477e-8d8c-4b2545bde230 => generated 662 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:20.846700 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6b55ea6d-5aa6-49a5-817a-cfaa3739353f tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa7488d940>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:20.885186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=56 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:20.916661 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6b55ea6d-5aa6-49a5-817a-cfaa3739353f tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/63d3f827-b791-477e-8d8c-4b2545bde230" status: 200 len: 662 microversion: 2.1 time: 0.075706 Jul 28 03:45:20.917938 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 956/2133] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:45:20 2022] GET /compute/v2.1/images/63d3f827-b791-477e-8d8c-4b2545bde230 => generated 662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:21.131302 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-736810658", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:21.226735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:45:21.588973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-34c660be-fda2-4ebf-94e1-039dc21d0582 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:21.618503 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-34c660be-fda2-4ebf-94e1-039dc21d0582 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1315 microversion: 2.1 time: 0.847083 Jul 28 03:45:21.635903 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1178/2134] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:20 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1315 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:21.765227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8e95a037-5c18-48d3-bd6f-487f9f0044a6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:21.769098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8e95a037-5c18-48d3-bd6f-487f9f0044a6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:21.796489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e95a037-5c18-48d3-bd6f-487f9f0044a6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:21.797349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e95a037-5c18-48d3-bd6f-487f9f0044a6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:21.800647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e95a037-5c18-48d3-bd6f-487f9f0044a6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:21.803543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e95a037-5c18-48d3-bd6f-487f9f0044a6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:21.862222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:45:21.862939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:45:21.863601 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:45:21.864170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:45:21.864772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:45:21.884690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:21.885883 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:21.887545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:21.890374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:21.939265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Getting quotas for project 3de20bc29dcc4c14ba831114cde254a4. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:21.960632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Getting quotas for user 359d811b77824998b1683a3983542882 and project 3de20bc29dcc4c14ba831114cde254a4. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:22.028456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:45:22.067918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 58a40da4-0f01-4368-835f-9c3b550eb137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:45:22.149785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8e95a037-5c18-48d3-bd6f-487f9f0044a6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:22.181182 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8e95a037-5c18-48d3-bd6f-487f9f0044a6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1316 microversion: 2.1 time: 0.437223 Jul 28 03:45:22.188064 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1179/2135] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:21 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:22.197880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-16092166-9ea0-48fa-a6d1-e31c81952dd8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:22.198888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-16092166-9ea0-48fa-a6d1-e31c81952dd8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:22.208437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16092166-9ea0-48fa-a6d1-e31c81952dd8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:22.209684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16092166-9ea0-48fa-a6d1-e31c81952dd8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:22.209945 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b7ff43da-deab-433f-8968-daabf5e9dc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077434 Jul 28 03:45:22.212626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16092166-9ea0-48fa-a6d1-e31c81952dd8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:22.213689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16092166-9ea0-48fa-a6d1-e31c81952dd8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:22.215997 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 957/2136] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:45:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:45:22.481289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2140680130", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:22.589719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:45:22.618721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-16092166-9ea0-48fa-a6d1-e31c81952dd8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:22.632475 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-16092166-9ea0-48fa-a6d1-e31c81952dd8 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1668 microversion: 2.1 time: 0.442398 Jul 28 03:45:22.639706 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1180/2137] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:22 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1668 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:22.654578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-999d4271-015a-4c40-89a5-a2bf1aaea2d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:22.655211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-999d4271-015a-4c40-89a5-a2bf1aaea2d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:22.663088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-999d4271-015a-4c40-89a5-a2bf1aaea2d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:22.664241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-999d4271-015a-4c40-89a5-a2bf1aaea2d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:22.665849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-999d4271-015a-4c40-89a5-a2bf1aaea2d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:22.666726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-999d4271-015a-4c40-89a5-a2bf1aaea2d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:23.374515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-999d4271-015a-4c40-89a5-a2bf1aaea2d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:23.395977 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-999d4271-015a-4c40-89a5-a2bf1aaea2d7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1315 microversion: 2.1 time: 0.754617 Jul 28 03:45:23.397996 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1181/2138] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:22 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:23.411330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ddb1b95-43fb-4579-964e-67c5c3807c38 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:23.412341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ddb1b95-43fb-4579-964e-67c5c3807c38 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:23.439813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ddb1b95-43fb-4579-964e-67c5c3807c38 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:23.441856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ddb1b95-43fb-4579-964e-67c5c3807c38 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:23.443950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ddb1b95-43fb-4579-964e-67c5c3807c38 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:23.444925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ddb1b95-43fb-4579-964e-67c5c3807c38 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:23.916123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ddb1b95-43fb-4579-964e-67c5c3807c38 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:23.927525 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ddb1b95-43fb-4579-964e-67c5c3807c38 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1316 microversion: 2.1 time: 0.527339 Jul 28 03:45:23.928842 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1182/2139] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:23 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:23.955590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5e2a40a2-b2bb-47eb-840b-833229353958 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:23.958840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5e2a40a2-b2bb-47eb-840b-833229353958 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:23.980227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e2a40a2-b2bb-47eb-840b-833229353958 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:23.982628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e2a40a2-b2bb-47eb-840b-833229353958 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:23.984185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e2a40a2-b2bb-47eb-840b-833229353958 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:23.984662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e2a40a2-b2bb-47eb-840b-833229353958 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:24.108205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5e2a40a2-b2bb-47eb-840b-833229353958 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:24.127804 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5e2a40a2-b2bb-47eb-840b-833229353958 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1600 microversion: 2.1 time: 0.196287 Jul 28 03:45:24.129442 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1183/2140] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:23 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1600 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:24.366426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:45:24.367127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:45:24.367345 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:45:24.367953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:45:24.368486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:45:24.380206 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:24.380988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:24.381875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:24.382716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:24.406588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Getting quotas for project 3de20bc29dcc4c14ba831114cde254a4. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:45:24.413587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Getting quotas for user 359d811b77824998b1683a3983542882 and project 3de20bc29dcc4c14ba831114cde254a4. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:45:24.432110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-95d866b3-500e-4ad3-a845-bb6ad8842b56 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:24.434242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-95d866b3-500e-4ad3-a845-bb6ad8842b56 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:24.437505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:45:24.440743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:45:24.447073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95d866b3-500e-4ad3-a845-bb6ad8842b56 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:24.448489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95d866b3-500e-4ad3-a845-bb6ad8842b56 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:24.451406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95d866b3-500e-4ad3-a845-bb6ad8842b56 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:24.452374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95d866b3-500e-4ad3-a845-bb6ad8842b56 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:24.511256 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b48846e0-3789-4c59-a751-68d4f3eb88a7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.036383 Jul 28 03:45:24.512280 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 958/2141] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:45:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:45:24.530709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d7da07a3-edb3-46b4-823b-0117c14d475e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:24.531642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d7da07a3-edb3-46b4-823b-0117c14d475e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:24.711178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-95d866b3-500e-4ad3-a845-bb6ad8842b56 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:24.723527 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-95d866b3-500e-4ad3-a845-bb6ad8842b56 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1315 microversion: 2.1 time: 0.296510 Jul 28 03:45:24.740991 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1184/2142] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:24 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:24.964722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ba1b1158-c4af-4181-8c2c-11a933af0da8 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:24.965550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ba1b1158-c4af-4181-8c2c-11a933af0da8 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:24.973824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:24.975727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba1b1158-c4af-4181-8c2c-11a933af0da8 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:24.976750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba1b1158-c4af-4181-8c2c-11a933af0da8 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:24.977856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba1b1158-c4af-4181-8c2c-11a933af0da8 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:24.978454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba1b1158-c4af-4181-8c2c-11a933af0da8 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:25.128861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d7da07a3-edb3-46b4-823b-0117c14d475e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:25.139813 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d7da07a3-edb3-46b4-823b-0117c14d475e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1218 microversion: 2.1 time: 0.613421 Jul 28 03:45:25.144631 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 959/2143] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:24 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1218 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:25.172078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d13e7a9c-ee78-4f6f-8d5d-2ec97c0ec810 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:25.172896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d13e7a9c-ee78-4f6f-8d5d-2ec97c0ec810 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:25.185424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d13e7a9c-ee78-4f6f-8d5d-2ec97c0ec810 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:25.186113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d13e7a9c-ee78-4f6f-8d5d-2ec97c0ec810 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:25.187185 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d13e7a9c-ee78-4f6f-8d5d-2ec97c0ec810 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:25.188006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d13e7a9c-ee78-4f6f-8d5d-2ec97c0ec810 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:25.209451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ba1b1158-c4af-4181-8c2c-11a933af0da8 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:25.227492 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ba1b1158-c4af-4181-8c2c-11a933af0da8 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1316 microversion: 2.1 time: 0.266408 Jul 28 03:45:25.240427 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1185/2144] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:24 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:25.533588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d13e7a9c-ee78-4f6f-8d5d-2ec97c0ec810 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:25.564292 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d13e7a9c-ee78-4f6f-8d5d-2ec97c0ec810 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1600 microversion: 2.1 time: 0.400213 Jul 28 03:45:25.567724 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 960/2145] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:25 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1600 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:25.757716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e7c183df-c536-4102-abfc-f99f7188daee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:25.758721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e7c183df-c536-4102-abfc-f99f7188daee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:25.768409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7c183df-c536-4102-abfc-f99f7188daee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:25.769251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7c183df-c536-4102-abfc-f99f7188daee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:25.770401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7c183df-c536-4102-abfc-f99f7188daee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:25.770992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7c183df-c536-4102-abfc-f99f7188daee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:26.004733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e7c183df-c536-4102-abfc-f99f7188daee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:26.014298 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e7c183df-c536-4102-abfc-f99f7188daee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1315 microversion: 2.1 time: 0.268050 Jul 28 03:45:26.015878 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1186/2146] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:25 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:26.173863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1499079e-f38e-41d0-a5d2-2a7520472812 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:26.174864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1499079e-f38e-41d0-a5d2-2a7520472812 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:26.195083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1499079e-f38e-41d0-a5d2-2a7520472812 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:26.200751 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1499079e-f38e-41d0-a5d2-2a7520472812 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:26.207899 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1499079e-f38e-41d0-a5d2-2a7520472812 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:26.209056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1499079e-f38e-41d0-a5d2-2a7520472812 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:26.256414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ebc855f8-9bb4-4929-8a89-cf0e10b9e99a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:26.257455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ebc855f8-9bb4-4929-8a89-cf0e10b9e99a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:26.275042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebc855f8-9bb4-4929-8a89-cf0e10b9e99a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:26.276803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebc855f8-9bb4-4929-8a89-cf0e10b9e99a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:26.279862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebc855f8-9bb4-4929-8a89-cf0e10b9e99a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:26.280460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebc855f8-9bb4-4929-8a89-cf0e10b9e99a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:26.767003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ebc855f8-9bb4-4929-8a89-cf0e10b9e99a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:26.780541 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ebc855f8-9bb4-4929-8a89-cf0e10b9e99a tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1316 microversion: 2.1 time: 0.531204 Jul 28 03:45:26.785399 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1187/2147] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:26 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:26.792019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9f8a6373-aacf-40b0-93cc-251bc47070a6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:26.792019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9f8a6373-aacf-40b0-93cc-251bc47070a6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:26.807332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f8a6373-aacf-40b0-93cc-251bc47070a6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:26.807903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f8a6373-aacf-40b0-93cc-251bc47070a6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:26.813237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f8a6373-aacf-40b0-93cc-251bc47070a6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:26.814008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f8a6373-aacf-40b0-93cc-251bc47070a6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:26.957521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9f8a6373-aacf-40b0-93cc-251bc47070a6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:26.974092 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9f8a6373-aacf-40b0-93cc-251bc47070a6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1600 microversion: 2.1 time: 0.187452 Jul 28 03:45:27.000518 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1188/2148] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:26 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:27.044187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa1644e3-1c80-4f5b-8dfc-c39804605fcb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:27.046996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fa1644e3-1c80-4f5b-8dfc-c39804605fcb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:27.068895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa1644e3-1c80-4f5b-8dfc-c39804605fcb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:27.071085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa1644e3-1c80-4f5b-8dfc-c39804605fcb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:27.076019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa1644e3-1c80-4f5b-8dfc-c39804605fcb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:27.079384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa1644e3-1c80-4f5b-8dfc-c39804605fcb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:27.148266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1499079e-f38e-41d0-a5d2-2a7520472812 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:27.161725 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1499079e-f38e-41d0-a5d2-2a7520472812 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1270 microversion: 2.1 time: 1.001394 Jul 28 03:45:27.163978 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 961/2149] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:26 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1270 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:27.829127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-16ac2ba9-f5ec-497f-824d-80afdf5cb37f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:27.831795 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-16ac2ba9-f5ec-497f-824d-80afdf5cb37f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:27.873481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16ac2ba9-f5ec-497f-824d-80afdf5cb37f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:27.882742 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16ac2ba9-f5ec-497f-824d-80afdf5cb37f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:27.886747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16ac2ba9-f5ec-497f-824d-80afdf5cb37f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:27.888567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16ac2ba9-f5ec-497f-824d-80afdf5cb37f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:28.130684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa1644e3-1c80-4f5b-8dfc-c39804605fcb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:28.186671 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fa1644e3-1c80-4f5b-8dfc-c39804605fcb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1315 microversion: 2.1 time: 1.144821 Jul 28 03:45:28.188501 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1189/2150] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:27 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1315 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:28.208943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-ece92eaf-dbdb-46f0-b7fc-043f1d9fb59e req-e12c77b9-604b-4af1-b76b-e5763c06ac60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76", "name": "network-vif-deleted", "tag": "a8b69e61-4d26-492e-8d90-78fee625d19c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:28.243466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ece92eaf-dbdb-46f0-b7fc-043f1d9fb59e req-e12c77b9-604b-4af1-b76b-e5763c06ac60 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:28.249224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ece92eaf-dbdb-46f0-b7fc-043f1d9fb59e req-e12c77b9-604b-4af1-b76b-e5763c06ac60 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:28.253081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:28.275585 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-ece92eaf-dbdb-46f0-b7fc-043f1d9fb59e req-e12c77b9-604b-4af1-b76b-e5763c06ac60 service nova] Creating event network-vif-deleted:a8b69e61-4d26-492e-8d90-78fee625d19c for instance 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 on n-h1-826756-3 Jul 28 03:45:28.291980 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-ece92eaf-dbdb-46f0-b7fc-043f1d9fb59e req-e12c77b9-604b-4af1-b76b-e5763c06ac60 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101220 Jul 28 03:45:28.295720 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1190/2151] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:28.306455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15860d99-08fd-4f40-aaf8-111d2d9f168e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:28.309261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15860d99-08fd-4f40-aaf8-111d2d9f168e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:28.333985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15860d99-08fd-4f40-aaf8-111d2d9f168e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:28.341826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15860d99-08fd-4f40-aaf8-111d2d9f168e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:28.343333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15860d99-08fd-4f40-aaf8-111d2d9f168e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:28.362681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15860d99-08fd-4f40-aaf8-111d2d9f168e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:28.471765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15860d99-08fd-4f40-aaf8-111d2d9f168e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:28.472677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15860d99-08fd-4f40-aaf8-111d2d9f168e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:28.473403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-15860d99-08fd-4f40-aaf8-111d2d9f168e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lazy-loading 'fault' on Instance uuid 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:45:29.010780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-15860d99-08fd-4f40-aaf8-111d2d9f168e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:29.035246 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15860d99-08fd-4f40-aaf8-111d2d9f168e tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 200 len: 1325 microversion: 2.1 time: 0.737647 Jul 28 03:45:29.044461 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1191/2152] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:28 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 1325 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:29.050968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d44fef9-edd1-4da5-b901-a34527429099 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:29.055970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6d44fef9-edd1-4da5-b901-a34527429099 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:29.076552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d44fef9-edd1-4da5-b901-a34527429099 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:29.079624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d44fef9-edd1-4da5-b901-a34527429099 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:29.080883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d44fef9-edd1-4da5-b901-a34527429099 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:29.081555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d44fef9-edd1-4da5-b901-a34527429099 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:29.432427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6d44fef9-edd1-4da5-b901-a34527429099 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:29.443237 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d44fef9-edd1-4da5-b901-a34527429099 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1276 microversion: 2.1 time: 0.397071 Jul 28 03:45:29.447039 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1192/2153] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:29 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1276 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:29.468843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3d589ffc-b436-4589-bd38-971d8a4825ef tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:29.470074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3d589ffc-b436-4589-bd38-971d8a4825ef tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:29.477345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d589ffc-b436-4589-bd38-971d8a4825ef tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:29.477800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d589ffc-b436-4589-bd38-971d8a4825ef tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:29.478600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d589ffc-b436-4589-bd38-971d8a4825ef tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:29.479034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d589ffc-b436-4589-bd38-971d8a4825ef tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:29.998270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3d589ffc-b436-4589-bd38-971d8a4825ef tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:30.003512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-16ac2ba9-f5ec-497f-824d-80afdf5cb37f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:30.015200 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3d589ffc-b436-4589-bd38-971d8a4825ef tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1315 microversion: 2.1 time: 0.566975 Jul 28 03:45:30.015805 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1193/2154] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:29 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:30.019652 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-16ac2ba9-f5ec-497f-824d-80afdf5cb37f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1316 microversion: 2.1 time: 2.214133 Jul 28 03:45:30.020834 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 962/2155] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:27 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1316 bytes in 2217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:30.083166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-54497e8f-13c0-44ab-adb6-0dc3d2e08bdb tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:30.083796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-54497e8f-13c0-44ab-adb6-0dc3d2e08bdb tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:30.092932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-54497e8f-13c0-44ab-adb6-0dc3d2e08bdb tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:30.093959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-54497e8f-13c0-44ab-adb6-0dc3d2e08bdb tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:30.095862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-54497e8f-13c0-44ab-adb6-0dc3d2e08bdb tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:30.106825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-54497e8f-13c0-44ab-adb6-0dc3d2e08bdb tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:30.133208 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-54497e8f-13c0-44ab-adb6-0dc3d2e08bdb tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] HTTP exception thrown: Instance 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 could not be found. Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-54497e8f-13c0-44ab-adb6-0dc3d2e08bdb tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Request method failure captured: Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 HTTP/1.1 Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRj0FqWwOpoVP2owSAjguA3DsRSH6TIya9-EWnkVZtCqS6_h7OguHt7IKpgIppQJgCNK59gVYl5A3h0uP6xrW2p02Mq2gZGLXlakDqP8yRhNLK_Qn7CVTwPof3e13rGjG9FrhmvYn5-vT0oEdd65tn_XGfH3Y79dIB8lYgZeg0LH6c Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 006f4f23380b45fab24edfea5be8f3a7 Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-LiveMigrationTest-1436833818 Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/006f4f23380b45fab24edfea5be8f3a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/006f4f23380b45fab24edfea5be8f3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_006f4f23380b45fab24edfea5be8f3a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/006f4f23380b45fab24edfea5be8f3a7"}]}] Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-LiveMigrationTest-1436833818 Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 006f4f23380b45fab24edfea5be8f3a7 Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-LiveMigrationTest-1436833818 Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-LiveMigrationTest-1436833818-project Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 15947ba65c714e0dbb60fc36afcb9a9c Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-LiveMigrationTest-1436833818-project Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 could not be found. Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76'} Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 could not be found. Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 could not be found. Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:30.136257 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:30.139564 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:30.139564 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:30.139564 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:30.139564 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:30.139564 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:30.139564 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 could not be found. Jul 28 03:45:30.139564 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:30.143560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-54497e8f-13c0-44ab-adb6-0dc3d2e08bdb tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Returning 404 to user: Instance 57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:30.144913 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-54497e8f-13c0-44ab-adb6-0dc3d2e08bdb tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76" status: 404 len: 111 microversion: 2.1 time: 0.067049 Jul 28 03:45:30.146171 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1194/2156] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:30 2022] GET /compute/v2.1/servers/57bb2f65-04f7-4ede-b8f9-b9da5e4b7e76 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:45:30.157214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2f887a04-81aa-4ed7-9e1a-fb036337b076 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '.version_select at 0x7ffa74269c10>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:30.198115 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2f887a04-81aa-4ed7-9e1a-fb036337b076 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382115356" status: 202 len: 0 microversion: 2.1 time: 0.046403 Jul 28 03:45:30.199642 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 963/2157] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 03:45:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382115356 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:45:30.325610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-5791f418-fab4-4061-bef8-11d4af384903 req-749752a6-6091-47fe-96a4-fc0fcba07904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc36884b-386a-4747-88cc-1fe01a50d0fa", "name": "network-vif-plugged", "status": "completed", "tag": "e29dc25a-08f7-4ebe-9dc3-6ba12d95d4d0"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:30.350842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5791f418-fab4-4061-bef8-11d4af384903 req-749752a6-6091-47fe-96a4-fc0fcba07904 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:30.351686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5791f418-fab4-4061-bef8-11d4af384903 req-749752a6-6091-47fe-96a4-fc0fcba07904 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:30.366133 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5791f418-fab4-4061-bef8-11d4af384903 req-749752a6-6091-47fe-96a4-fc0fcba07904 service nova] Creating event network-vif-plugged:e29dc25a-08f7-4ebe-9dc3-6ba12d95d4d0 for instance fc36884b-386a-4747-88cc-1fe01a50d0fa on n-h1-826756-3 Jul 28 03:45:30.373924 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-5791f418-fab4-4061-bef8-11d4af384903 req-749752a6-6091-47fe-96a4-fc0fcba07904 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051374 Jul 28 03:45:30.380219 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1195/2158] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:30.474437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a214576a-3de0-4f05-9cba-f75c5df1f1eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:30.474882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a214576a-3de0-4f05-9cba-f75c5df1f1eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:30.495002 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a214576a-3de0-4f05-9cba-f75c5df1f1eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:30.495467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a214576a-3de0-4f05-9cba-f75c5df1f1eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:30.496564 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a214576a-3de0-4f05-9cba-f75c5df1f1eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:30.496994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a214576a-3de0-4f05-9cba-f75c5df1f1eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:30.522030 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:30.774713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a214576a-3de0-4f05-9cba-f75c5df1f1eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:30.787110 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a214576a-3de0-4f05-9cba-f75c5df1f1eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1276 microversion: 2.1 time: 0.320267 Jul 28 03:45:30.811211 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 964/2159] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:30 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1276 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:30.939297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-72a80268-c651-4e4d-bdd0-68a97bc4621f req-d04e7076-4aa5-4251-9e8f-15ed9b8978ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35fa1b51-1663-49af-b9e3-2aca487ece39", "tag": "b22bdd6c-d4ca-481d-b617-ff52448c390d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:30.962503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-72a80268-c651-4e4d-bdd0-68a97bc4621f req-d04e7076-4aa5-4251-9e8f-15ed9b8978ea service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:30.963045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-72a80268-c651-4e4d-bdd0-68a97bc4621f req-d04e7076-4aa5-4251-9e8f-15ed9b8978ea service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:30.992702 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-72a80268-c651-4e4d-bdd0-68a97bc4621f req-d04e7076-4aa5-4251-9e8f-15ed9b8978ea service nova] Creating event network-changed:b22bdd6c-d4ca-481d-b617-ff52448c390d for instance 35fa1b51-1663-49af-b9e3-2aca487ece39 on n-h1-826756-3 Jul 28 03:45:31.001313 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-72a80268-c651-4e4d-bdd0-68a97bc4621f req-d04e7076-4aa5-4251-9e8f-15ed9b8978ea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067275 Jul 28 03:45:31.002307 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1196/2160] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:31.037543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e831b9ea-5618-4bbe-8835-b7ce397d37fb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:31.038163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e831b9ea-5618-4bbe-8835-b7ce397d37fb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:31.055471 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e831b9ea-5618-4bbe-8835-b7ce397d37fb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:31.055920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e831b9ea-5618-4bbe-8835-b7ce397d37fb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:31.057107 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e831b9ea-5618-4bbe-8835-b7ce397d37fb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:31.057546 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e831b9ea-5618-4bbe-8835-b7ce397d37fb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:31.060157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-10ecde62-f223-4c6a-8dc2-9f564a0ef5b7 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:31.061092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-10ecde62-f223-4c6a-8dc2-9f564a0ef5b7 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:31.068912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10ecde62-f223-4c6a-8dc2-9f564a0ef5b7 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:31.081168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10ecde62-f223-4c6a-8dc2-9f564a0ef5b7 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:31.082470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10ecde62-f223-4c6a-8dc2-9f564a0ef5b7 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:31.083110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10ecde62-f223-4c6a-8dc2-9f564a0ef5b7 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:31.547357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-10ecde62-f223-4c6a-8dc2-9f564a0ef5b7 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:31.561873 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-10ecde62-f223-4c6a-8dc2-9f564a0ef5b7 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1316 microversion: 2.1 time: 0.505805 Jul 28 03:45:31.562366 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1197/2161] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:31 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:31.708328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e831b9ea-5618-4bbe-8835-b7ce397d37fb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:31.727535 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e831b9ea-5618-4bbe-8835-b7ce397d37fb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1315 microversion: 2.1 time: 0.694056 Jul 28 03:45:31.728405 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 965/2162] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:31 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:31.812223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9bb17630-102b-4721-87ed-0c253eeb5b7e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:31.813910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9bb17630-102b-4721-87ed-0c253eeb5b7e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:31.825975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bb17630-102b-4721-87ed-0c253eeb5b7e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:31.828295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bb17630-102b-4721-87ed-0c253eeb5b7e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:31.829675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bb17630-102b-4721-87ed-0c253eeb5b7e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:31.830750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bb17630-102b-4721-87ed-0c253eeb5b7e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:32.091031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9bb17630-102b-4721-87ed-0c253eeb5b7e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:32.105665 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9bb17630-102b-4721-87ed-0c253eeb5b7e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1276 microversion: 2.1 time: 0.299651 Jul 28 03:45:32.107556 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1198/2163] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:31 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1276 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:32.586916 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a753813b-5656-4ee1-ad69-89e82c88e11c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:32.587775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a753813b-5656-4ee1-ad69-89e82c88e11c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:32.603702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a753813b-5656-4ee1-ad69-89e82c88e11c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:32.609166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a753813b-5656-4ee1-ad69-89e82c88e11c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:32.615029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a753813b-5656-4ee1-ad69-89e82c88e11c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:32.616328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a753813b-5656-4ee1-ad69-89e82c88e11c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:32.750008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9563d6e1-b8ea-4856-a453-140b7eec657c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:32.750955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9563d6e1-b8ea-4856-a453-140b7eec657c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:32.763861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9563d6e1-b8ea-4856-a453-140b7eec657c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:32.764644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9563d6e1-b8ea-4856-a453-140b7eec657c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:32.765458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9563d6e1-b8ea-4856-a453-140b7eec657c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:32.766040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9563d6e1-b8ea-4856-a453-140b7eec657c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:33.335006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a753813b-5656-4ee1-ad69-89e82c88e11c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:33.366402 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a753813b-5656-4ee1-ad69-89e82c88e11c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1466 microversion: 2.1 time: 0.786261 Jul 28 03:45:33.367365 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 966/2164] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:32 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1466 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:33.372582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-4501d938-b75c-447d-ae59-324070ae11e5 req-087903e3-01c8-4391-96f3-d50d9fdd67ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a40da4-0f01-4368-835f-9c3b550eb137", "tag": "efeda983-f05c-4f23-9d79-30d55c7ec8d7"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:33.399440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4501d938-b75c-447d-ae59-324070ae11e5 req-087903e3-01c8-4391-96f3-d50d9fdd67ff service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:33.403270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4501d938-b75c-447d-ae59-324070ae11e5 req-087903e3-01c8-4391-96f3-d50d9fdd67ff service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:33.454064 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-4501d938-b75c-447d-ae59-324070ae11e5 req-087903e3-01c8-4391-96f3-d50d9fdd67ff service nova] Creating event network-changed:efeda983-f05c-4f23-9d79-30d55c7ec8d7 for instance 58a40da4-0f01-4368-835f-9c3b550eb137 on n-h1-826756-3 Jul 28 03:45:33.468711 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-4501d938-b75c-447d-ae59-324070ae11e5 req-087903e3-01c8-4391-96f3-d50d9fdd67ff service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097643 Jul 28 03:45:33.472331 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 967/2165] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:33.488974 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f1d698d0-291d-40cf-b942-301fbab2ad2d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:33.496562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f1d698d0-291d-40cf-b942-301fbab2ad2d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:33.511875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9563d6e1-b8ea-4856-a453-140b7eec657c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:33.522932 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1d698d0-291d-40cf-b942-301fbab2ad2d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:33.523942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1d698d0-291d-40cf-b942-301fbab2ad2d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:33.525517 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1d698d0-291d-40cf-b942-301fbab2ad2d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:33.527943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1d698d0-291d-40cf-b942-301fbab2ad2d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:33.529248 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9563d6e1-b8ea-4856-a453-140b7eec657c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1315 microversion: 2.1 time: 0.783932 Jul 28 03:45:33.559225 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1199/2166] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:32 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:33.579826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cbbcc5f6-328c-440f-ae80-f4aecaeab342 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:33.581034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cbbcc5f6-328c-440f-ae80-f4aecaeab342 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:33.618189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbbcc5f6-328c-440f-ae80-f4aecaeab342 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:33.619128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbbcc5f6-328c-440f-ae80-f4aecaeab342 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:33.620484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbbcc5f6-328c-440f-ae80-f4aecaeab342 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:33.621302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbbcc5f6-328c-440f-ae80-f4aecaeab342 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:34.029252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f1d698d0-291d-40cf-b942-301fbab2ad2d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:34.047244 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f1d698d0-291d-40cf-b942-301fbab2ad2d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1318 microversion: 2.1 time: 0.570419 Jul 28 03:45:34.049114 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 968/2167] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:33 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:34.062736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-911f3578-a7a7-42d0-845a-2ebad26ef06c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:34.063243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-911f3578-a7a7-42d0-845a-2ebad26ef06c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:34.086801 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-911f3578-a7a7-42d0-845a-2ebad26ef06c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:34.087533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-911f3578-a7a7-42d0-845a-2ebad26ef06c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:34.088498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-911f3578-a7a7-42d0-845a-2ebad26ef06c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:34.089072 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-911f3578-a7a7-42d0-845a-2ebad26ef06c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:34.166355 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-911f3578-a7a7-42d0-845a-2ebad26ef06c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:45:34.254630 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cbbcc5f6-328c-440f-ae80-f4aecaeab342 tempest-ServersOnMultiNodesTest-1668766171 tempest-ServersOnMultiNodesTest-1668766171-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1617 microversion: 2.1 time: 0.693141 Jul 28 03:45:34.262002 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1200/2168] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:33 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1617 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:34.291151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-413a761c-df4b-4da8-9c16-6fb6cc7de418 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:34.292128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-413a761c-df4b-4da8-9c16-6fb6cc7de418 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:34.303753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-413a761c-df4b-4da8-9c16-6fb6cc7de418 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:34.304639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-413a761c-df4b-4da8-9c16-6fb6cc7de418 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:34.308387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-413a761c-df4b-4da8-9c16-6fb6cc7de418 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:34.308923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-413a761c-df4b-4da8-9c16-6fb6cc7de418 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:34.345897 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-911f3578-a7a7-42d0-845a-2ebad26ef06c tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 204 len: 0 microversion: 2.1 time: 0.291753 Jul 28 03:45:34.346843 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 969/2169] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:45:34 2022] DELETE /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:45:34.359870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-92e92208-d27f-49d2-8935-6cd74cda7003 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:34.360664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-92e92208-d27f-49d2-8935-6cd74cda7003 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:34.368072 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92e92208-d27f-49d2-8935-6cd74cda7003 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:34.368954 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92e92208-d27f-49d2-8935-6cd74cda7003 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:34.370219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92e92208-d27f-49d2-8935-6cd74cda7003 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:34.370689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92e92208-d27f-49d2-8935-6cd74cda7003 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:34.393408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-413a761c-df4b-4da8-9c16-6fb6cc7de418 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:45:34.396927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:34.616133 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-413a761c-df4b-4da8-9c16-6fb6cc7de418 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 204 len: 0 microversion: 2.1 time: 0.328504 Jul 28 03:45:34.624993 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1201/2170] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:45:34 2022] DELETE /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:45:34.640877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80d82690-ed59-4dc3-8407-efe9c4a6205e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:34.641670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-80d82690-ed59-4dc3-8407-efe9c4a6205e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:34.667542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80d82690-ed59-4dc3-8407-efe9c4a6205e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:34.667878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80d82690-ed59-4dc3-8407-efe9c4a6205e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:34.668966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80d82690-ed59-4dc3-8407-efe9c4a6205e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:34.670075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80d82690-ed59-4dc3-8407-efe9c4a6205e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:34.964172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-80d82690-ed59-4dc3-8407-efe9c4a6205e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:34.980051 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-80d82690-ed59-4dc3-8407-efe9c4a6205e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1315 microversion: 2.1 time: 0.346947 Jul 28 03:45:34.993837 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1202/2171] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:34 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:34.999243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-047b390f-c053-47fd-82f1-f29a4556d7dd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:35.000082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-047b390f-c053-47fd-82f1-f29a4556d7dd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:35.007555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-047b390f-c053-47fd-82f1-f29a4556d7dd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:35.008211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-047b390f-c053-47fd-82f1-f29a4556d7dd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:35.009180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-047b390f-c053-47fd-82f1-f29a4556d7dd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:35.011146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-047b390f-c053-47fd-82f1-f29a4556d7dd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:35.017864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-92e92208-d27f-49d2-8935-6cd74cda7003 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:35.029357 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-92e92208-d27f-49d2-8935-6cd74cda7003 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1482 microversion: 2.1 time: 0.676565 Jul 28 03:45:35.031185 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 970/2172] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:34 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1482 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:35.070057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3a08a420-9bc7-452a-84ad-7093e8f2afe6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:35.071060 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3a08a420-9bc7-452a-84ad-7093e8f2afe6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:35.087900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a08a420-9bc7-452a-84ad-7093e8f2afe6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:35.088762 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a08a420-9bc7-452a-84ad-7093e8f2afe6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:35.090446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a08a420-9bc7-452a-84ad-7093e8f2afe6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:35.091435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a08a420-9bc7-452a-84ad-7093e8f2afe6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:35.133598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=32 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:35.375117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-047b390f-c053-47fd-82f1-f29a4556d7dd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:35.387334 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-047b390f-c053-47fd-82f1-f29a4556d7dd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1472 microversion: 2.1 time: 0.391967 Jul 28 03:45:35.392007 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1203/2173] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:34 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1472 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:35.596215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3a08a420-9bc7-452a-84ad-7093e8f2afe6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:35.606357 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3a08a420-9bc7-452a-84ad-7093e8f2afe6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1318 microversion: 2.1 time: 0.541657 Jul 28 03:45:35.609719 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 971/2174] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:35 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:36.003451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-03099e68-b7f5-42e5-aa63-20653f03601d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:36.004315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-03099e68-b7f5-42e5-aa63-20653f03601d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:36.018344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03099e68-b7f5-42e5-aa63-20653f03601d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:36.019242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03099e68-b7f5-42e5-aa63-20653f03601d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:36.020485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03099e68-b7f5-42e5-aa63-20653f03601d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:36.021130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03099e68-b7f5-42e5-aa63-20653f03601d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:36.070948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-98ac7217-70ee-443c-848b-0627fd2fa307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:36.075310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-98ac7217-70ee-443c-848b-0627fd2fa307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:36.106225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:36.125364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98ac7217-70ee-443c-848b-0627fd2fa307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:36.126218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98ac7217-70ee-443c-848b-0627fd2fa307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:36.132195 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98ac7217-70ee-443c-848b-0627fd2fa307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:36.135116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98ac7217-70ee-443c-848b-0627fd2fa307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:36.543620 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-98ac7217-70ee-443c-848b-0627fd2fa307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:36.561075 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-98ac7217-70ee-443c-848b-0627fd2fa307 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1482 microversion: 2.1 time: 0.504014 Jul 28 03:45:36.562266 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 972/2175] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:36 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1482 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:36.597161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d3fe8a89-99bf-4693-b41a-b0448d2daa84 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:36.597960 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d3fe8a89-99bf-4693-b41a-b0448d2daa84 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:36.626439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d3fe8a89-99bf-4693-b41a-b0448d2daa84 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:36.629488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d3fe8a89-99bf-4693-b41a-b0448d2daa84 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:36.630449 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d3fe8a89-99bf-4693-b41a-b0448d2daa84 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:36.631010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d3fe8a89-99bf-4693-b41a-b0448d2daa84 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:37.178001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-03099e68-b7f5-42e5-aa63-20653f03601d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:37.200336 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-03099e68-b7f5-42e5-aa63-20653f03601d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1315 microversion: 2.1 time: 1.195878 Jul 28 03:45:37.218288 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1204/2176] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:35 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1315 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:37.232830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0950e2ad-2e48-40f7-b848-0894fd1a73a2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:37.233565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0950e2ad-2e48-40f7-b848-0894fd1a73a2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:37.242160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0950e2ad-2e48-40f7-b848-0894fd1a73a2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:37.242673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0950e2ad-2e48-40f7-b848-0894fd1a73a2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:37.243464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0950e2ad-2e48-40f7-b848-0894fd1a73a2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:37.245538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0950e2ad-2e48-40f7-b848-0894fd1a73a2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:37.958179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0950e2ad-2e48-40f7-b848-0894fd1a73a2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:37.968907 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0950e2ad-2e48-40f7-b848-0894fd1a73a2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1318 microversion: 2.1 time: 0.749285 Jul 28 03:45:37.969944 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1205/2177] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:37 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1318 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:37.991547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-be2c78e6-17e1-4d4a-a016-086bdfe5e2d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:37.992718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-be2c78e6-17e1-4d4a-a016-086bdfe5e2d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:38.012596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be2c78e6-17e1-4d4a-a016-086bdfe5e2d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:38.013075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be2c78e6-17e1-4d4a-a016-086bdfe5e2d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:38.014252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be2c78e6-17e1-4d4a-a016-086bdfe5e2d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:38.014411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be2c78e6-17e1-4d4a-a016-086bdfe5e2d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:38.575965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be2c78e6-17e1-4d4a-a016-086bdfe5e2d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:38.588451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be2c78e6-17e1-4d4a-a016-086bdfe5e2d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:38.590088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be2c78e6-17e1-4d4a-a016-086bdfe5e2d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:38.591439 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-be2c78e6-17e1-4d4a-a016-086bdfe5e2d4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 2945 microversion: 2.42 time: 0.620498 Jul 28 03:45:38.592334 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1206/2178] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:45:37 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 2945 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:45:38.666486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d3fe8a89-99bf-4693-b41a-b0448d2daa84 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:38.696956 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d3fe8a89-99bf-4693-b41a-b0448d2daa84 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1472 microversion: 2.1 time: 2.105835 Jul 28 03:45:38.699990 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 973/2179] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:36 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1472 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:38.715397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-90b880a3-4b48-4393-b372-04b7ce64f180 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:38.717216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-90b880a3-4b48-4393-b372-04b7ce64f180 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:38.730486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90b880a3-4b48-4393-b372-04b7ce64f180 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:38.731263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90b880a3-4b48-4393-b372-04b7ce64f180 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:38.733573 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90b880a3-4b48-4393-b372-04b7ce64f180 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:38.734390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90b880a3-4b48-4393-b372-04b7ce64f180 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:38.876601 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90b880a3-4b48-4393-b372-04b7ce64f180 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:38.877727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90b880a3-4b48-4393-b372-04b7ce64f180 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:38.880615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-90b880a3-4b48-4393-b372-04b7ce64f180 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lazy-loading 'fault' on Instance uuid fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:45:38.950187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-674d024c-ed7e-4913-876c-4354a7011e58 req-ff97db2e-5315-42f2-b11c-04d5a5008b8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f1d50cc-a245-45b8-a35d-7e6dcc1d2015", "tag": "42fe0509-4544-4491-a652-a3e7790cc649"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:38.974796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-674d024c-ed7e-4913-876c-4354a7011e58 req-ff97db2e-5315-42f2-b11c-04d5a5008b8e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:38.975843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-674d024c-ed7e-4913-876c-4354a7011e58 req-ff97db2e-5315-42f2-b11c-04d5a5008b8e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:39.014775 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-674d024c-ed7e-4913-876c-4354a7011e58 req-ff97db2e-5315-42f2-b11c-04d5a5008b8e service nova] Creating event network-changed:42fe0509-4544-4491-a652-a3e7790cc649 for instance 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 on n-h2-826756-3 Jul 28 03:45:39.025733 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-674d024c-ed7e-4913-876c-4354a7011e58 req-ff97db2e-5315-42f2-b11c-04d5a5008b8e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.415421 Jul 28 03:45:39.026798 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1207/2180] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:39.065148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c3eaa18e-d3bc-4491-bfc9-09fa1eb5246d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:39.092827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c3eaa18e-d3bc-4491-bfc9-09fa1eb5246d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:39.126844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3eaa18e-d3bc-4491-bfc9-09fa1eb5246d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:39.127814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3eaa18e-d3bc-4491-bfc9-09fa1eb5246d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:39.130173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3eaa18e-d3bc-4491-bfc9-09fa1eb5246d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:39.131341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3eaa18e-d3bc-4491-bfc9-09fa1eb5246d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:39.170426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:39.300853 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-90b880a3-4b48-4393-b372-04b7ce64f180 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:39.315780 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-90b880a3-4b48-4393-b372-04b7ce64f180 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 200 len: 1299 microversion: 2.1 time: 0.613180 Jul 28 03:45:39.321659 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 974/2181] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:38 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 1299 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:39.331872 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b9d2eb6d-5197-4819-b063-4f0bf703efb4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:39.335345 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b9d2eb6d-5197-4819-b063-4f0bf703efb4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:39.385045 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9d2eb6d-5197-4819-b063-4f0bf703efb4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:39.387680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9d2eb6d-5197-4819-b063-4f0bf703efb4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:39.390569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9d2eb6d-5197-4819-b063-4f0bf703efb4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:39.394116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9d2eb6d-5197-4819-b063-4f0bf703efb4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:39.846557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c3eaa18e-d3bc-4491-bfc9-09fa1eb5246d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:39.866135 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c3eaa18e-d3bc-4491-bfc9-09fa1eb5246d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1315 microversion: 2.1 time: 0.837695 Jul 28 03:45:39.882805 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1208/2182] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:39 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1315 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:39.898121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-11f87221-4290-4603-bd1b-81ac4373281a tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:39.902987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-11f87221-4290-4603-bd1b-81ac4373281a tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:39.923381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11f87221-4290-4603-bd1b-81ac4373281a tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:39.924938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11f87221-4290-4603-bd1b-81ac4373281a tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:39.926015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11f87221-4290-4603-bd1b-81ac4373281a tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:39.926651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11f87221-4290-4603-bd1b-81ac4373281a tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:40.209770 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b9d2eb6d-5197-4819-b063-4f0bf703efb4 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.886194 Jul 28 03:45:40.223637 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 975/2183] 10.222.0.48 () {60 vars in 1316 bytes} [Thu Jul 28 03:45:39 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b/os-interface => generated 1828 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:45:40.245931 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dd78f6dd-89c5-49b8-ae23-88cb83e43f15 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:40.246797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dd78f6dd-89c5-49b8-ae23-88cb83e43f15 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:40.256162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd78f6dd-89c5-49b8-ae23-88cb83e43f15 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:40.262936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd78f6dd-89c5-49b8-ae23-88cb83e43f15 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:40.265886 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd78f6dd-89c5-49b8-ae23-88cb83e43f15 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:40.266293 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd78f6dd-89c5-49b8-ae23-88cb83e43f15 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:40.413762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-11f87221-4290-4603-bd1b-81ac4373281a tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:40.429623 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-11f87221-4290-4603-bd1b-81ac4373281a tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1318 microversion: 2.1 time: 0.540841 Jul 28 03:45:40.430234 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1209/2184] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:39 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1318 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:40.440253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-da9d82b5-384e-4e4e-bcf1-4c502f162b47 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:40.440910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-da9d82b5-384e-4e4e-bcf1-4c502f162b47 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:40.457739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da9d82b5-384e-4e4e-bcf1-4c502f162b47 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:40.467381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da9d82b5-384e-4e4e-bcf1-4c502f162b47 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:40.469677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da9d82b5-384e-4e4e-bcf1-4c502f162b47 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:40.473814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da9d82b5-384e-4e4e-bcf1-4c502f162b47 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:40.513749 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-da9d82b5-384e-4e4e-bcf1-4c502f162b47 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] HTTP exception thrown: Instance fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 could not be found. Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-da9d82b5-384e-4e4e-bcf1-4c502f162b47 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Request method failure captured: Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 HTTP/1.1 Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRj0FqWwOpoVP2owSAjguA3DsRSH6TIya9-EWnkVZtCqS6_h7OguHt7IKpgIppQJgCNK59gVYl5A3h0uP6xrW2p02Mq2gZGLXlakDqP8yRhNLK_Qn7CVTwPof3e13rGjG9FrhmvYn5-vT0oEdd65tn_XGfH3Y79dIB8lYgZeg0LH6c Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 006f4f23380b45fab24edfea5be8f3a7 Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-LiveMigrationTest-1436833818 Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/006f4f23380b45fab24edfea5be8f3a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/006f4f23380b45fab24edfea5be8f3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_006f4f23380b45fab24edfea5be8f3a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/006f4f23380b45fab24edfea5be8f3a7"}]}] Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-LiveMigrationTest-1436833818 Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 006f4f23380b45fab24edfea5be8f3a7 Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-LiveMigrationTest-1436833818 Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-LiveMigrationTest-1436833818-project Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 15947ba65c714e0dbb60fc36afcb9a9c Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-LiveMigrationTest-1436833818-project Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 could not be found. Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24'} Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 could not be found. Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 could not be found. Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:40.515951 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:40.519275 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:40.519275 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:40.519275 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:40.519275 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:40.519275 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:40.519275 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 could not be found. Jul 28 03:45:40.519275 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:40.524379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-da9d82b5-384e-4e4e-bcf1-4c502f162b47 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Returning 404 to user: Instance fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:40.529426 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-da9d82b5-384e-4e4e-bcf1-4c502f162b47 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24" status: 404 len: 111 microversion: 2.1 time: 0.096048 Jul 28 03:45:40.533356 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1210/2185] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:40 2022] GET /compute/v2.1/servers/fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:45:40.551875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6abea4df-33d5-46e5-a0a3-069685dd9579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:40.552607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6abea4df-33d5-46e5-a0a3-069685dd9579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:40.560754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6abea4df-33d5-46e5-a0a3-069685dd9579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:40.561868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6abea4df-33d5-46e5-a0a3-069685dd9579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:40.562897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6abea4df-33d5-46e5-a0a3-069685dd9579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:40.563586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6abea4df-33d5-46e5-a0a3-069685dd9579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:40.633144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6abea4df-33d5-46e5-a0a3-069685dd9579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:45:40.850755 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6abea4df-33d5-46e5-a0a3-069685dd9579 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 204 len: 0 microversion: 2.1 time: 0.304863 Jul 28 03:45:40.850755 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1211/2186] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:45:40 2022] DELETE /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:45:41.213241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-61bee944-6eaa-4953-bee4-4f15ca20eb4d tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Calling method '.version_select at 0x7ffa740aaaf0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:41.257962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG neutronclient.v2_0.client [None req-61bee944-6eaa-4953-bee4-4f15ca20eb4d tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d835357b-b82a-43ef-9654-e42e51f68c44 does not exist", "detail": ""}} {{(pid=126071) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:45:41.259000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.security_group_api [None req-61bee944-6eaa-4953-bee4-4f15ca20eb4d tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Neutron security group d835357b-b82a-43ef-9654-e42e51f68c44 not found {{(pid=126071) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 03:45:41.260024 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-61bee944-6eaa-4953-bee4-4f15ca20eb4d tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] HTTP exception thrown: Security group d835357b-b82a-43ef-9654-e42e51f68c44 does not exist Jul 28 03:45:41.260024 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-ac0075bc-6c07-4fe6-9483-939c14d3545c'] Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-61bee944-6eaa-4953-bee4-4f15ca20eb4d tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Request method failure captured: Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/os-security-groups/d835357b-b82a-43ef-9654-e42e51f68c44 HTTP/1.1 Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gZkuLXoouO_UBdx9ICalLhvSTdd1SVluQuxRCmOBzNBZ0wkFpRe8HHAkLAq1Ynufff1_KgR2-5ZCUo-o-1WiWl3v98s-89wwA5ML1RHoUIE26Ncdul3Rrms2wOVsSlKYVBuEw9UCuk6bNY-Oq3zoQlO1HVbUW8ptrx4sXcE8-e-tH0 Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 5359628bfd5346ba82457ec8a1fdd05b Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-343747188 Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5359628bfd5346ba82457ec8a1fdd05b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5359628bfd5346ba82457ec8a1fdd05b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5359628bfd5346ba82457ec8a1fdd05b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5359628bfd5346ba82457ec8a1fdd05b"}]}] Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-343747188 Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 5359628bfd5346ba82457ec8a1fdd05b Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-343747188 Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupsNegativeTestJSON-343747188-project Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 75afb2be2c664e47a3d4bb98ce9543c1 Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-343747188-project Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: exception: Security group d835357b-b82a-43ef-9654-e42e51f68c44 does not exist Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-ac0075bc-6c07-4fe6-9483-939c14d3545c'] Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd835357b-b82a-43ef-9654-e42e51f68c44'} Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:45:41.282613 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d835357b-b82a-43ef-9654-e42e51f68c44 does not exist Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac0075bc-6c07-4fe6-9483-939c14d3545c'] Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d835357b-b82a-43ef-9654-e42e51f68c44 does not exist Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac0075bc-6c07-4fe6-9483-939c14d3545c'] Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d835357b-b82a-43ef-9654-e42e51f68c44 does not exist Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac0075bc-6c07-4fe6-9483-939c14d3545c'] Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d835357b-b82a-43ef-9654-e42e51f68c44 does not exist Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac0075bc-6c07-4fe6-9483-939c14d3545c'] Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-61bee944-6eaa-4953-bee4-4f15ca20eb4d tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Returning 404 to user: Security group d835357b-b82a-43ef-9654-e42e51f68c44 does not exist Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-ac0075bc-6c07-4fe6-9483-939c14d3545c'] {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:41.285836 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-61bee944-6eaa-4953-bee4-4f15ca20eb4d tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/d835357b-b82a-43ef-9654-e42e51f68c44" status: 404 len: 194 microversion: 2.1 time: 0.432790 Jul 28 03:45:41.290185 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1212/2187] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:45:40 2022] DELETE /compute/v2.1/os-security-groups/d835357b-b82a-43ef-9654-e42e51f68c44 => generated 194 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:45:41.299749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7969c0e8-f112-4b91-b5ab-88c59f0b0146 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:41.302261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7969c0e8-f112-4b91-b5ab-88c59f0b0146 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:41.321050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7969c0e8-f112-4b91-b5ab-88c59f0b0146 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:41.321966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7969c0e8-f112-4b91-b5ab-88c59f0b0146 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:41.323593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7969c0e8-f112-4b91-b5ab-88c59f0b0146 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:41.324265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7969c0e8-f112-4b91-b5ab-88c59f0b0146 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:41.635575 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dd78f6dd-89c5-49b8-ae23-88cb83e43f15 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:41.656304 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dd78f6dd-89c5-49b8-ae23-88cb83e43f15 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1472 microversion: 2.1 time: 1.430366 Jul 28 03:45:41.667981 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 976/2188] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:40 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1472 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:41.741415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7969c0e8-f112-4b91-b5ab-88c59f0b0146 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:41.752987 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7969c0e8-f112-4b91-b5ab-88c59f0b0146 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1499 microversion: 2.1 time: 0.463518 Jul 28 03:45:41.768809 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1213/2189] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:41 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1499 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:41.784265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-37be6400-e64d-4187-a295-456a1ac78722 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:41.785191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-37be6400-e64d-4187-a295-456a1ac78722 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:41.807186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37be6400-e64d-4187-a295-456a1ac78722 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:41.807992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37be6400-e64d-4187-a295-456a1ac78722 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:41.809185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37be6400-e64d-4187-a295-456a1ac78722 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:41.809843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37be6400-e64d-4187-a295-456a1ac78722 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:42.069180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-91d5d5c8-45b5-4f73-b64d-a5a269e785ab req-8a8df26a-0f7e-4df1-8c2f-c0240db7a310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35fa1b51-1663-49af-b9e3-2aca487ece39", "name": "network-vif-plugged", "status": "completed", "tag": "b22bdd6c-d4ca-481d-b617-ff52448c390d"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:42.109627 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-91d5d5c8-45b5-4f73-b64d-a5a269e785ab req-8a8df26a-0f7e-4df1-8c2f-c0240db7a310 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:42.111363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-91d5d5c8-45b5-4f73-b64d-a5a269e785ab req-8a8df26a-0f7e-4df1-8c2f-c0240db7a310 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:42.139518 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-91d5d5c8-45b5-4f73-b64d-a5a269e785ab req-8a8df26a-0f7e-4df1-8c2f-c0240db7a310 service nova] Creating event network-vif-plugged:b22bdd6c-d4ca-481d-b617-ff52448c390d for instance 35fa1b51-1663-49af-b9e3-2aca487ece39 on n-h1-826756-3 Jul 28 03:45:42.177928 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-91d5d5c8-45b5-4f73-b64d-a5a269e785ab req-8a8df26a-0f7e-4df1-8c2f-c0240db7a310 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.501668 Jul 28 03:45:42.180861 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 977/2190] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:42.205039 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f5a31023-d6d9-4934-b743-895b1290abc9 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.021761 Jul 28 03:45:42.218954 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 978/2191] 10.222.0.48 () {58 vars in 1164 bytes} [Thu Jul 28 03:45:42 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 03:45:42.255596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-07fd1e3f-ce34-493a-aaa8-322e61bb9c01 req-118142fd-4d13-424f-a22a-0140f5933b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24", "name": "network-vif-deleted", "tag": "341becb1-9ad4-4e21-893d-15bc21d8044e"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:42.296927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-37be6400-e64d-4187-a295-456a1ac78722 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:42.309079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-07fd1e3f-ce34-493a-aaa8-322e61bb9c01 req-118142fd-4d13-424f-a22a-0140f5933b6a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:42.311045 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-37be6400-e64d-4187-a295-456a1ac78722 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1315 microversion: 2.1 time: 0.540432 Jul 28 03:45:42.312109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-07fd1e3f-ce34-493a-aaa8-322e61bb9c01 req-118142fd-4d13-424f-a22a-0140f5933b6a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:42.314960 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1214/2192] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:41 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:42.328025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-46c36fb5-0d4a-4c53-bf4b-ba9fc453f5aa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:42.329573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-46c36fb5-0d4a-4c53-bf4b-ba9fc453f5aa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:42.347491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46c36fb5-0d4a-4c53-bf4b-ba9fc453f5aa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:42.348208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46c36fb5-0d4a-4c53-bf4b-ba9fc453f5aa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:42.349105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46c36fb5-0d4a-4c53-bf4b-ba9fc453f5aa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:42.349693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46c36fb5-0d4a-4c53-bf4b-ba9fc453f5aa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:42.359776 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-07fd1e3f-ce34-493a-aaa8-322e61bb9c01 req-118142fd-4d13-424f-a22a-0140f5933b6a service nova] Creating event network-vif-deleted:341becb1-9ad4-4e21-893d-15bc21d8044e for instance fd946ff6-d8b9-42f6-a46b-cc05ca2b7f24 on n-h2-826756-3 Jul 28 03:45:42.366939 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-07fd1e3f-ce34-493a-aaa8-322e61bb9c01 req-118142fd-4d13-424f-a22a-0140f5933b6a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143236 Jul 28 03:45:42.368258 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 979/2193] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:42.375525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3ab2918e-0af4-4ede-bb29-151f30bd5187 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Calling method '.version_select at 0x7ffa74832550>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:42.643027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-46c36fb5-0d4a-4c53-bf4b-ba9fc453f5aa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:42.660204 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-46c36fb5-0d4a-4c53-bf4b-ba9fc453f5aa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1318 microversion: 2.1 time: 0.341727 Jul 28 03:45:42.661441 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1215/2194] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:42 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:42.709401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d399b0d5-4ca7-44e2-a842-04ed039efa07 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:42.710049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d399b0d5-4ca7-44e2-a842-04ed039efa07 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:42.721471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d399b0d5-4ca7-44e2-a842-04ed039efa07 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:42.721970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d399b0d5-4ca7-44e2-a842-04ed039efa07 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:42.724052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d399b0d5-4ca7-44e2-a842-04ed039efa07 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:42.724977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d399b0d5-4ca7-44e2-a842-04ed039efa07 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:42.811451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d399b0d5-4ca7-44e2-a842-04ed039efa07 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:42.813058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d399b0d5-4ca7-44e2-a842-04ed039efa07 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:42.814089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-d399b0d5-4ca7-44e2-a842-04ed039efa07 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lazy-loading 'fault' on Instance uuid fc36884b-386a-4747-88cc-1fe01a50d0fa {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:45:42.902152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d399b0d5-4ca7-44e2-a842-04ed039efa07 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:42.926724 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d399b0d5-4ca7-44e2-a842-04ed039efa07 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 200 len: 1306 microversion: 2.1 time: 0.228987 Jul 28 03:45:42.941437 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1216/2195] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:42 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 1306 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:42.980128 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3ab2918e-0af4-4ede-bb29-151f30bd5187 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.604493 Jul 28 03:45:42.981946 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 980/2196] 10.222.0.48 () {58 vars in 1158 bytes} [Thu Jul 28 03:45:42 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:42.983023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-22c032f3-0b73-48f6-bfac-9a1712d88f43 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:42.984892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-22c032f3-0b73-48f6-bfac-9a1712d88f43 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:43.006061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9c3d5f1c-8959-4dd8-88e9-b14695ce0ce6 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Calling method '.version_select at 0x7ffa74269310>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:43.008290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22c032f3-0b73-48f6-bfac-9a1712d88f43 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:43.009770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22c032f3-0b73-48f6-bfac-9a1712d88f43 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:43.010847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22c032f3-0b73-48f6-bfac-9a1712d88f43 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:43.012108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22c032f3-0b73-48f6-bfac-9a1712d88f43 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:43.299387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-22c032f3-0b73-48f6-bfac-9a1712d88f43 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:43.313821 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-22c032f3-0b73-48f6-bfac-9a1712d88f43 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1499 microversion: 2.1 time: 0.349352 Jul 28 03:45:43.328207 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1217/2197] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:42 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1499 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:43.351111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4e12f27-3a3d-4dff-9134-690d49ed7226 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:43.352702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4e12f27-3a3d-4dff-9134-690d49ed7226 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:43.362724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4e12f27-3a3d-4dff-9134-690d49ed7226 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:43.363484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4e12f27-3a3d-4dff-9134-690d49ed7226 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:43.364702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4e12f27-3a3d-4dff-9134-690d49ed7226 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:43.365437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4e12f27-3a3d-4dff-9134-690d49ed7226 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:43.415498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG neutronclient.v2_0.client [None req-9c3d5f1c-8959-4dd8-88e9-b14695ce0ce6 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=126072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:45:43.416460 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-9c3d5f1c-8959-4dd8-88e9-b14695ce0ce6 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 28 03:45:43.416460 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-dd9d832e-9e63-4ce4-a159-f7e66256e56b'] Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9c3d5f1c-8959-4dd8-88e9-b14695ce0ce6 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Request method failure captured: Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/os-security-groups/44f55a95-dc7a-4a0c-956e-2112a4a76f83 HTTP/1.1 Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gZkuLXoouO_UBdx9ICalLhvSTdd1SVluQuxRCmOBzNBZ0wkFpRe8HHAkLAq1Ynufff1_KgR2-5ZCUo-o-1WiWl3v98s-89wwA5ML1RHoUIE26Ncdul3Rrms2wOVsSlKYVBuEw9UCuk6bNY-Oq3zoQlO1HVbUW8ptrx4sXcE8-e-tH0 Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 5359628bfd5346ba82457ec8a1fdd05b Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-343747188 Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5359628bfd5346ba82457ec8a1fdd05b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5359628bfd5346ba82457ec8a1fdd05b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5359628bfd5346ba82457ec8a1fdd05b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5359628bfd5346ba82457ec8a1fdd05b"}]}] Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-343747188 Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 5359628bfd5346ba82457ec8a1fdd05b Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-343747188 Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-SecurityGroupsNegativeTestJSON-343747188-project Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 75afb2be2c664e47a3d4bb98ce9543c1 Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-343747188-project Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: exception: Insufficient rights for removing default security group. Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-dd9d832e-9e63-4ce4-a159-f7e66256e56b'] Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '44f55a95-dc7a-4a0c-956e-2112a4a76f83'} Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:45:43.432158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd9d832e-9e63-4ce4-a159-f7e66256e56b'] Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd9d832e-9e63-4ce4-a159-f7e66256e56b'] Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd9d832e-9e63-4ce4-a159-f7e66256e56b'] Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd9d832e-9e63-4ce4-a159-f7e66256e56b'] Jul 28 03:45:43.435817 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.440229 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9c3d5f1c-8959-4dd8-88e9-b14695ce0ce6 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 28 03:45:43.440229 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-dd9d832e-9e63-4ce4-a159-f7e66256e56b'] {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:43.441910 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9c3d5f1c-8959-4dd8-88e9-b14695ce0ce6 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/44f55a95-dc7a-4a0c-956e-2112a4a76f83" status: 400 len: 182 microversion: 2.1 time: 0.445364 Jul 28 03:45:43.443617 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 981/2198] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:45:42 2022] DELETE /compute/v2.1/os-security-groups/44f55a95-dc7a-4a0c-956e-2112a4a76f83 => generated 182 bytes in 450 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:45:43.461200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c0c33ff3-2100-4678-b009-a70abb6aefc2 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Calling method '.version_select at 0x7ffa7488db80>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:43.544280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG neutronclient.v2_0.client [None req-c0c33ff3-2100-4678-b009-a70abb6aefc2 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dc1b4e02-3159-4279-a9f1-d7a11b63d4db does not exist", "detail": ""}} {{(pid=126072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:45:43.550420 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.security_group_api [None req-c0c33ff3-2100-4678-b009-a70abb6aefc2 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Neutron security group dc1b4e02-3159-4279-a9f1-d7a11b63d4db not found {{(pid=126072) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 03:45:43.551617 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-c0c33ff3-2100-4678-b009-a70abb6aefc2 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] HTTP exception thrown: Security group dc1b4e02-3159-4279-a9f1-d7a11b63d4db does not exist Jul 28 03:45:43.551617 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-b0f5ffc0-4093-48c7-9e65-2112a619206f'] Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c0c33ff3-2100-4678-b009-a70abb6aefc2 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Request method failure captured: Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-security-groups/dc1b4e02-3159-4279-a9f1-d7a11b63d4db HTTP/1.1 Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gZkuLXoouO_UBdx9ICalLhvSTdd1SVluQuxRCmOBzNBZ0wkFpRe8HHAkLAq1Ynufff1_KgR2-5ZCUo-o-1WiWl3v98s-89wwA5ML1RHoUIE26Ncdul3Rrms2wOVsSlKYVBuEw9UCuk6bNY-Oq3zoQlO1HVbUW8ptrx4sXcE8-e-tH0 Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 5359628bfd5346ba82457ec8a1fdd05b Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-343747188 Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5359628bfd5346ba82457ec8a1fdd05b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5359628bfd5346ba82457ec8a1fdd05b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5359628bfd5346ba82457ec8a1fdd05b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5359628bfd5346ba82457ec8a1fdd05b"}]}] Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-343747188 Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 5359628bfd5346ba82457ec8a1fdd05b Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-343747188 Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-SecurityGroupsNegativeTestJSON-343747188-project Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 75afb2be2c664e47a3d4bb98ce9543c1 Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-343747188-project Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: exception: Security group dc1b4e02-3159-4279-a9f1-d7a11b63d4db does not exist Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-b0f5ffc0-4093-48c7-9e65-2112a619206f'] Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'dc1b4e02-3159-4279-a9f1-d7a11b63d4db'} Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:45:43.554348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dc1b4e02-3159-4279-a9f1-d7a11b63d4db does not exist Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0f5ffc0-4093-48c7-9e65-2112a619206f'] Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dc1b4e02-3159-4279-a9f1-d7a11b63d4db does not exist Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0f5ffc0-4093-48c7-9e65-2112a619206f'] Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dc1b4e02-3159-4279-a9f1-d7a11b63d4db does not exist Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0f5ffc0-4093-48c7-9e65-2112a619206f'] Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dc1b4e02-3159-4279-a9f1-d7a11b63d4db does not exist Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0f5ffc0-4093-48c7-9e65-2112a619206f'] Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c0c33ff3-2100-4678-b009-a70abb6aefc2 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Returning 404 to user: Security group dc1b4e02-3159-4279-a9f1-d7a11b63d4db does not exist Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-b0f5ffc0-4093-48c7-9e65-2112a619206f'] {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:43.560865 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c0c33ff3-2100-4678-b009-a70abb6aefc2 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/dc1b4e02-3159-4279-a9f1-d7a11b63d4db" status: 404 len: 194 microversion: 2.1 time: 0.098775 Jul 28 03:45:43.571064 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 982/2199] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 03:45:43 2022] GET /compute/v2.1/os-security-groups/dc1b4e02-3159-4279-a9f1-d7a11b63d4db => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:45:43.584913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-83e671a1-6f7e-4196-9174-fb6808944ba5 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Action: 'update', calling method: .version_select at 0x7ffa74832700>, body: {"security_group": {"name": "tempest-sg-1307335306", "description": "tempest-description-1817916056"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:43.622247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a4e12f27-3a3d-4dff-9134-690d49ed7226 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:43.632414 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4e12f27-3a3d-4dff-9134-690d49ed7226 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1315 microversion: 2.1 time: 0.289301 Jul 28 03:45:43.633376 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1218/2200] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:43 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:43.692753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a23e19f8-db56-4f4f-a2a9-e4c7b05a8234 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:43.693770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a23e19f8-db56-4f4f-a2a9-e4c7b05a8234 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:43.700972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a23e19f8-db56-4f4f-a2a9-e4c7b05a8234 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:43.701978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a23e19f8-db56-4f4f-a2a9-e4c7b05a8234 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:43.702901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a23e19f8-db56-4f4f-a2a9-e4c7b05a8234 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:43.703337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a23e19f8-db56-4f4f-a2a9-e4c7b05a8234 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:43.823698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG neutronclient.v2_0.client [None req-83e671a1-6f7e-4196-9174-fb6808944ba5 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0d36b3e2-e7fe-45f5-96ee-d0dc841c5d87 does not exist", "detail": ""}} {{(pid=126072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:45:43.824560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.security_group_api [None req-83e671a1-6f7e-4196-9174-fb6808944ba5 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Neutron security group 0d36b3e2-e7fe-45f5-96ee-d0dc841c5d87 not found {{(pid=126072) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 03:45:43.825190 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-83e671a1-6f7e-4196-9174-fb6808944ba5 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] HTTP exception thrown: Security group 0d36b3e2-e7fe-45f5-96ee-d0dc841c5d87 does not exist Jul 28 03:45:43.825190 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-d79a416f-e0dd-47c0-ba71-18a0ff8dc666'] Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-83e671a1-6f7e-4196-9174-fb6808944ba5 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Request method failure captured: Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: request: PUT /compute/v2.1/os-security-groups/0d36b3e2-e7fe-45f5-96ee-d0dc841c5d87 HTTP/1.1 Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 102 Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gZkuLXoouO_UBdx9ICalLhvSTdd1SVluQuxRCmOBzNBZ0wkFpRe8HHAkLAq1Ynufff1_KgR2-5ZCUo-o-1WiWl3v98s-89wwA5ML1RHoUIE26Ncdul3Rrms2wOVsSlKYVBuEw9UCuk6bNY-Oq3zoQlO1HVbUW8ptrx4sXcE8-e-tH0 Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 5359628bfd5346ba82457ec8a1fdd05b Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-343747188 Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5359628bfd5346ba82457ec8a1fdd05b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5359628bfd5346ba82457ec8a1fdd05b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5359628bfd5346ba82457ec8a1fdd05b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5359628bfd5346ba82457ec8a1fdd05b"}]}] Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-343747188 Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 5359628bfd5346ba82457ec8a1fdd05b Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-343747188 Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-SecurityGroupsNegativeTestJSON-343747188-project Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 75afb2be2c664e47a3d4bb98ce9543c1 Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-343747188-project Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: {"security_group": {"name": "tempest-sg-1307335306", "description": "tempest-description-1817916056"}} Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: exception: Security group 0d36b3e2-e7fe-45f5-96ee-d0dc841c5d87 does not exist Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-d79a416f-e0dd-47c0-ba71-18a0ff8dc666'] Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '0d36b3e2-e7fe-45f5-96ee-d0dc841c5d87', 'body': {'security_group': {'name': 'tempest-sg-1307335306', 'description': 'tempest-description-1817916056'}}} Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:45:43.833198 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0d36b3e2-e7fe-45f5-96ee-d0dc841c5d87 does not exist Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d79a416f-e0dd-47c0-ba71-18a0ff8dc666'] Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0d36b3e2-e7fe-45f5-96ee-d0dc841c5d87 does not exist Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d79a416f-e0dd-47c0-ba71-18a0ff8dc666'] Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0d36b3e2-e7fe-45f5-96ee-d0dc841c5d87 does not exist Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d79a416f-e0dd-47c0-ba71-18a0ff8dc666'] Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0d36b3e2-e7fe-45f5-96ee-d0dc841c5d87 does not exist Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d79a416f-e0dd-47c0-ba71-18a0ff8dc666'] Jul 28 03:45:43.836728 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:43.839043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-83e671a1-6f7e-4196-9174-fb6808944ba5 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] Returning 404 to user: Security group 0d36b3e2-e7fe-45f5-96ee-d0dc841c5d87 does not exist Jul 28 03:45:43.839043 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-d79a416f-e0dd-47c0-ba71-18a0ff8dc666'] {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:43.839984 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-83e671a1-6f7e-4196-9174-fb6808944ba5 tempest-SecurityGroupsNegativeTestJSON-343747188 tempest-SecurityGroupsNegativeTestJSON-343747188-project] 10.222.0.48 "PUT /compute/v2.1/os-security-groups/0d36b3e2-e7fe-45f5-96ee-d0dc841c5d87" status: 404 len: 194 microversion: 2.1 time: 0.267773 Jul 28 03:45:43.852437 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 983/2201] 10.222.0.48 () {60 vars in 1290 bytes} [Thu Jul 28 03:45:43 2022] PUT /compute/v2.1/os-security-groups/0d36b3e2-e7fe-45f5-96ee-d0dc841c5d87 => generated 194 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:45:43.963120 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ac019bb1-7885-4b31-b1d2-0d1f26d0d29f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:43.963966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ac019bb1-7885-4b31-b1d2-0d1f26d0d29f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: fc36884b-386a-4747-88cc-1fe01a50d0fa] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:43.987176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac019bb1-7885-4b31-b1d2-0d1f26d0d29f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:43.989122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac019bb1-7885-4b31-b1d2-0d1f26d0d29f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:43.990218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac019bb1-7885-4b31-b1d2-0d1f26d0d29f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:43.990806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac019bb1-7885-4b31-b1d2-0d1f26d0d29f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:44.022233 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-ac019bb1-7885-4b31-b1d2-0d1f26d0d29f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] HTTP exception thrown: Instance fc36884b-386a-4747-88cc-1fe01a50d0fa could not be found. Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ac019bb1-7885-4b31-b1d2-0d1f26d0d29f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Request method failure captured: Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa HTTP/1.1 Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gV7mA-YMFAnKldeINQgvLPHsWGEsLjGMUv3-B_tN9Ugj2i5DM_RX_Ep1KaxrbWm2Z8GsdcNggENEnCgcmkkVtQS2Dy-vjfuBjPxxxa-2cT3j6wuhgPkDKW43EOn0zr7zrVFK5Xpu4YAhRd8TK-PW3z8gnBOwf36svmLpKa7gl0y4n0 Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}] Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ff63655143224ba9831e8dcb7a4d2e37 Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance fc36884b-386a-4747-88cc-1fe01a50d0fa could not be found. Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'fc36884b-386a-4747-88cc-1fe01a50d0fa'} Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc36884b-386a-4747-88cc-1fe01a50d0fa could not be found. Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc36884b-386a-4747-88cc-1fe01a50d0fa could not be found. Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:44.061088 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:44.065383 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:44.065383 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:44.065383 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:44.065383 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:44.065383 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:44.065383 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc36884b-386a-4747-88cc-1fe01a50d0fa could not be found. Jul 28 03:45:44.065383 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:44.065383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ac019bb1-7885-4b31-b1d2-0d1f26d0d29f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Returning 404 to user: Instance fc36884b-386a-4747-88cc-1fe01a50d0fa could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:44.065383 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ac019bb1-7885-4b31-b1d2-0d1f26d0d29f tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa" status: 404 len: 111 microversion: 2.1 time: 0.106269 Jul 28 03:45:44.068132 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 984/2202] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:43 2022] GET /compute/v2.1/servers/fc36884b-386a-4747-88cc-1fe01a50d0fa => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:45:44.079557 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-450c4b8f-eb20-4628-a9d9-b815b1c24b73 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:44.079661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-450c4b8f-eb20-4628-a9d9-b815b1c24b73 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:44.101386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-450c4b8f-eb20-4628-a9d9-b815b1c24b73 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:44.101862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-450c4b8f-eb20-4628-a9d9-b815b1c24b73 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:44.102949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-450c4b8f-eb20-4628-a9d9-b815b1c24b73 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:44.103679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-450c4b8f-eb20-4628-a9d9-b815b1c24b73 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:44.186313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-450c4b8f-eb20-4628-a9d9-b815b1c24b73 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:45:44.303455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:44.369271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a23e19f8-db56-4f4f-a2a9-e4c7b05a8234 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:44.394792 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a23e19f8-db56-4f4f-a2a9-e4c7b05a8234 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1318 microversion: 2.1 time: 0.705782 Jul 28 03:45:44.396594 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1219/2203] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:43 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1318 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:45:44.398672 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-450c4b8f-eb20-4628-a9d9-b815b1c24b73 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "DELETE /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 204 len: 0 microversion: 2.1 time: 0.329033 Jul 28 03:45:44.404438 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 985/2204] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:45:44 2022] DELETE /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:45:44.407807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-679c96b7-8be8-43cb-9bd2-9b02a49e85f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:44.410783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-679c96b7-8be8-43cb-9bd2-9b02a49e85f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:44.414173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-018a4b38-c340-450c-bfdb-b9b793face93 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:44.414802 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-018a4b38-c340-450c-bfdb-b9b793face93 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:44.431888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-018a4b38-c340-450c-bfdb-b9b793face93 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:44.432313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-018a4b38-c340-450c-bfdb-b9b793face93 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:44.434260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-679c96b7-8be8-43cb-9bd2-9b02a49e85f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:44.436260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-679c96b7-8be8-43cb-9bd2-9b02a49e85f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:44.438135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-018a4b38-c340-450c-bfdb-b9b793face93 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:44.441938 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-018a4b38-c340-450c-bfdb-b9b793face93 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:44.442412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-679c96b7-8be8-43cb-9bd2-9b02a49e85f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:44.443924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-679c96b7-8be8-43cb-9bd2-9b02a49e85f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:46.035878 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-018a4b38-c340-450c-bfdb-b9b793face93 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:46.046889 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-018a4b38-c340-450c-bfdb-b9b793face93 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1473 microversion: 2.1 time: 1.641047 Jul 28 03:45:46.064327 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 986/2205] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:44 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1473 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:46.070834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-679c96b7-8be8-43cb-9bd2-9b02a49e85f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15947ba65c714e0dbb60fc36afcb9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '006f4f23380b45fab24edfea5be8f3a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:46.071739 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9a98bceb-7e64-4d8a-857a-058fea15dffb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:46.072761 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9a98bceb-7e64-4d8a-857a-058fea15dffb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:46.084094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a98bceb-7e64-4d8a-857a-058fea15dffb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:46.085008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a98bceb-7e64-4d8a-857a-058fea15dffb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:46.086288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a98bceb-7e64-4d8a-857a-058fea15dffb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:46.086899 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a98bceb-7e64-4d8a-857a-058fea15dffb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:46.100749 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-679c96b7-8be8-43cb-9bd2-9b02a49e85f6 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 200 len: 1499 microversion: 2.1 time: 1.699717 Jul 28 03:45:46.101667 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1220/2206] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:44 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 1499 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:46.132286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4f994d19-1705-4b85-b5fc-6553edf88694 req-7803c094-6db8-413f-a6fe-92b466ffc33f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a40da4-0f01-4368-835f-9c3b550eb137", "name": "network-vif-plugged", "status": "completed", "tag": "efeda983-f05c-4f23-9d79-30d55c7ec8d7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:46.154938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4f994d19-1705-4b85-b5fc-6553edf88694 req-7803c094-6db8-413f-a6fe-92b466ffc33f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:46.155389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4f994d19-1705-4b85-b5fc-6553edf88694 req-7803c094-6db8-413f-a6fe-92b466ffc33f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:46.226989 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4f994d19-1705-4b85-b5fc-6553edf88694 req-7803c094-6db8-413f-a6fe-92b466ffc33f service nova] Creating event network-vif-plugged:efeda983-f05c-4f23-9d79-30d55c7ec8d7 for instance 58a40da4-0f01-4368-835f-9c3b550eb137 on n-h1-826756-3 Jul 28 03:45:46.246779 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4f994d19-1705-4b85-b5fc-6553edf88694 req-7803c094-6db8-413f-a6fe-92b466ffc33f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128414 Jul 28 03:45:46.254864 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1221/2207] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:46.303883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47db772c-512d-451d-bed0-84477bb8cdc2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:46.309633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-47db772c-512d-451d-bed0-84477bb8cdc2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:46.349623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47db772c-512d-451d-bed0-84477bb8cdc2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:46.350109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47db772c-512d-451d-bed0-84477bb8cdc2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:46.350826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47db772c-512d-451d-bed0-84477bb8cdc2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:46.351264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47db772c-512d-451d-bed0-84477bb8cdc2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:46.778533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9a98bceb-7e64-4d8a-857a-058fea15dffb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:46.799218 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9a98bceb-7e64-4d8a-857a-058fea15dffb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1502 microversion: 2.1 time: 0.733321 Jul 28 03:45:46.802131 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 987/2208] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:46 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1502 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:46.808262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-ec03a46f-e5c1-46da-b30a-8ae9ca045488 req-d543a333-8457-4183-a8c0-7e54f40bfd71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc36884b-386a-4747-88cc-1fe01a50d0fa", "name": "network-vif-deleted", "tag": "e29dc25a-08f7-4ebe-9dc3-6ba12d95d4d0"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:46.824141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-ec03a46f-e5c1-46da-b30a-8ae9ca045488 req-d543a333-8457-4183-a8c0-7e54f40bfd71 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:46.825384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-ec03a46f-e5c1-46da-b30a-8ae9ca045488 req-d543a333-8457-4183-a8c0-7e54f40bfd71 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:46.857326 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-ec03a46f-e5c1-46da-b30a-8ae9ca045488 req-d543a333-8457-4183-a8c0-7e54f40bfd71 service nova] Creating event network-vif-deleted:e29dc25a-08f7-4ebe-9dc3-6ba12d95d4d0 for instance fc36884b-386a-4747-88cc-1fe01a50d0fa on n-h1-826756-3 Jul 28 03:45:46.863129 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-ec03a46f-e5c1-46da-b30a-8ae9ca045488 req-d543a333-8457-4183-a8c0-7e54f40bfd71 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058842 Jul 28 03:45:46.864595 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 988/2209] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:47.200675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-47db772c-512d-451d-bed0-84477bb8cdc2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:47.216053 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-47db772c-512d-451d-bed0-84477bb8cdc2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1318 microversion: 2.1 time: 0.956089 Jul 28 03:45:47.216761 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1222/2210] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:46 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1318 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:47.310967 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b786754a-76e5-4281-92ba-6ff7c2664092 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Action: 'create', calling method: .version_select at 0x7ffa7488df70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1801252970", "description": "tempest-description-686926279"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:47.394340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c40132eb-6646-44d3-a6ce-c3a812b2aa51 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Calling method '.version_select at 0x7ffa742a9310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:47.545311 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c40132eb-6646-44d3-a6ce-c3a812b2aa51 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/1cf069faf2784e888ff74e4709dc94c9" status: 200 len: 371 microversion: 2.1 time: 0.322715 Jul 28 03:45:47.554752 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1223/2211] 10.222.0.48 () {58 vars in 1242 bytes} [Thu Jul 28 03:45:47 2022] GET /compute/v2.1/os-quota-sets/1cf069faf2784e888ff74e4709dc94c9 => generated 371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:47.566288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-12ea4664-9e6b-4ea1-861b-606a3928352a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:47.566836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-12ea4664-9e6b-4ea1-861b-606a3928352a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:47.592317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12ea4664-9e6b-4ea1-861b-606a3928352a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:47.595686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12ea4664-9e6b-4ea1-861b-606a3928352a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:47.596852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12ea4664-9e6b-4ea1-861b-606a3928352a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:47.599554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12ea4664-9e6b-4ea1-861b-606a3928352a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:47.826116 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-12ea4664-9e6b-4ea1-861b-606a3928352a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39/action" status: 202 len: 0 microversion: 2.1 time: 0.269699 Jul 28 03:45:47.826783 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1224/2212] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:45:47 2022] POST /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:45:47.842045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-81550dc2-651d-4b45-85db-929ba72f2142 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:47.842943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-81550dc2-651d-4b45-85db-929ba72f2142 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:47.858466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81550dc2-651d-4b45-85db-929ba72f2142 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:47.865519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81550dc2-651d-4b45-85db-929ba72f2142 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:47.866624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81550dc2-651d-4b45-85db-929ba72f2142 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:47.867213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81550dc2-651d-4b45-85db-929ba72f2142 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:47.872188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:48.197681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-81550dc2-651d-4b45-85db-929ba72f2142 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:48.222692 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-81550dc2-651d-4b45-85db-929ba72f2142 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1473 microversion: 2.1 time: 0.390306 Jul 28 03:45:48.224696 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1225/2213] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:47 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1473 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:48.238583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abe2c29e-05fd-491a-a15f-327308ac6c68 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:48.253401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-abe2c29e-05fd-491a-a15f-327308ac6c68 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] [instance: 2cda1bf7-ab8a-4567-a8d6-54697a316461] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:48.277289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abe2c29e-05fd-491a-a15f-327308ac6c68 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:48.278249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abe2c29e-05fd-491a-a15f-327308ac6c68 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:48.279257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abe2c29e-05fd-491a-a15f-327308ac6c68 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:48.284314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abe2c29e-05fd-491a-a15f-327308ac6c68 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:48.342160 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-abe2c29e-05fd-491a-a15f-327308ac6c68 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] HTTP exception thrown: Instance 2cda1bf7-ab8a-4567-a8d6-54697a316461 could not be found. Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abe2c29e-05fd-491a-a15f-327308ac6c68 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Request method failure captured: Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 HTTP/1.1 Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRj0FqWwOpoVP2owSAjguA3DsRSH6TIya9-EWnkVZtCqS6_h7OguHt7IKpgIppQJgCNK59gVYl5A3h0uP6xrW2p02Mq2gZGLXlakDqP8yRhNLK_Qn7CVTwPof3e13rGjG9FrhmvYn5-vT0oEdd65tn_XGfH3Y79dIB8lYgZeg0LH6c Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 006f4f23380b45fab24edfea5be8f3a7 Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-LiveMigrationTest-1436833818 Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/006f4f23380b45fab24edfea5be8f3a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/006f4f23380b45fab24edfea5be8f3a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_006f4f23380b45fab24edfea5be8f3a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/006f4f23380b45fab24edfea5be8f3a7"}]}] Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-LiveMigrationTest-1436833818 Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 006f4f23380b45fab24edfea5be8f3a7 Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-LiveMigrationTest-1436833818 Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-LiveMigrationTest-1436833818-project Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 15947ba65c714e0dbb60fc36afcb9a9c Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-LiveMigrationTest-1436833818-project Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2cda1bf7-ab8a-4567-a8d6-54697a316461 could not be found. Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2cda1bf7-ab8a-4567-a8d6-54697a316461'} Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cda1bf7-ab8a-4567-a8d6-54697a316461 could not be found. Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cda1bf7-ab8a-4567-a8d6-54697a316461 could not be found. Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:48.343917 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:48.348068 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:48.348068 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:48.348068 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:48.348068 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:48.348068 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:48.348068 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cda1bf7-ab8a-4567-a8d6-54697a316461 could not be found. Jul 28 03:45:48.348068 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:45:48.367919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abe2c29e-05fd-491a-a15f-327308ac6c68 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] Returning 404 to user: Instance 2cda1bf7-ab8a-4567-a8d6-54697a316461 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:48.370776 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-abe2c29e-05fd-491a-a15f-327308ac6c68 tempest-LiveMigrationTest-1436833818 tempest-LiveMigrationTest-1436833818-project] 10.222.0.48 "GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461" status: 404 len: 111 microversion: 2.1 time: 0.143601 Jul 28 03:45:48.374769 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1226/2214] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:48 2022] GET /compute/v2.1/servers/2cda1bf7-ab8a-4567-a8d6-54697a316461 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:45:48.396670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-75caf125-9ee9-4d7a-ac4f-3f76ede20533 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Action: 'update', calling method: .version_select at 0x7ffa7994c040>, body: {"quota_set": {"ram": "5120"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:48.528312 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b786754a-76e5-4281-92ba-6ff7c2664092 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.662177 Jul 28 03:45:48.538466 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 989/2215] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:45:46 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:48.543745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-75fe5661-c730-4f73-87bf-49c5c151632a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:48.544484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-75fe5661-c730-4f73-87bf-49c5c151632a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:48.558948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75fe5661-c730-4f73-87bf-49c5c151632a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:48.559398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75fe5661-c730-4f73-87bf-49c5c151632a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:48.560186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75fe5661-c730-4f73-87bf-49c5c151632a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:48.562790 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75fe5661-c730-4f73-87bf-49c5c151632a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:48.578885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:48.588415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75caf125-9ee9-4d7a-ac4f-3f76ede20533 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:48.588875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75caf125-9ee9-4d7a-ac4f-3f76ede20533 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:48.589702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75caf125-9ee9-4d7a-ac4f-3f76ede20533 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:48.592758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75caf125-9ee9-4d7a-ac4f-3f76ede20533 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:48.720416 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-75caf125-9ee9-4d7a-ac4f-3f76ede20533 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/1cf069faf2784e888ff74e4709dc94c9" status: 200 len: 328 microversion: 2.1 time: 0.342616 Jul 28 03:45:48.723459 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1227/2216] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Jul 28 03:45:48 2022] PUT /compute/v2.1/os-quota-sets/1cf069faf2784e888ff74e4709dc94c9 => generated 328 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:48.730974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-30855daf-e5e0-41a2-9a0e-a74837d64956 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:48.732686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-30855daf-e5e0-41a2-9a0e-a74837d64956 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:48.745032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30855daf-e5e0-41a2-9a0e-a74837d64956 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:48.745758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30855daf-e5e0-41a2-9a0e-a74837d64956 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:48.746716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30855daf-e5e0-41a2-9a0e-a74837d64956 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:48.747326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30855daf-e5e0-41a2-9a0e-a74837d64956 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:48.889379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-75fe5661-c730-4f73-87bf-49c5c151632a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:48.906494 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-75fe5661-c730-4f73-87bf-49c5c151632a tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1487 microversion: 2.1 time: 0.366722 Jul 28 03:45:48.908221 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 990/2217] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:48 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1487 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:48.941201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d2281d1d-34d9-46cd-9aac-70a91e96e0be tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Action: 'create', calling method: .version_select at 0x7ffa74874430>, body: {"security_group_rule": {"parent_group_id": "8675e27d-71a3-4956-9af5-f44dd0d563fb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:49.174546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-30855daf-e5e0-41a2-9a0e-a74837d64956 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:49.188473 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-30855daf-e5e0-41a2-9a0e-a74837d64956 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1318 microversion: 2.1 time: 0.460056 Jul 28 03:45:49.189308 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1228/2218] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:48 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1318 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:49.204713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19915b71-b0de-4afb-90fa-18f5f766ec9f tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:49.228864 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-19915b71-b0de-4afb-90fa-18f5f766ec9f tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-quota-sets/1cf069faf2784e888ff74e4709dc94c9" status: 202 len: 0 microversion: 2.1 time: 0.037924 Jul 28 03:45:49.230352 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1229/2219] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:45:49 2022] DELETE /compute/v2.1/os-quota-sets/1cf069faf2784e888ff74e4709dc94c9 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:45:49.238227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-80671703-e494-421c-8604-3c7a1f30d3e1 req-d3792ff9-3569-494c-a93c-ca4ad44e6896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cda1bf7-ab8a-4567-a8d6-54697a316461", "name": "network-vif-deleted", "tag": "c89c0e09-fda3-4512-826c-85a6f08cc121"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:49.267176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-80671703-e494-421c-8604-3c7a1f30d3e1 req-d3792ff9-3569-494c-a93c-ca4ad44e6896 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:49.267644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-80671703-e494-421c-8604-3c7a1f30d3e1 req-d3792ff9-3569-494c-a93c-ca4ad44e6896 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:49.308784 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-80671703-e494-421c-8604-3c7a1f30d3e1 req-d3792ff9-3569-494c-a93c-ca4ad44e6896 service nova] Creating event network-vif-deleted:c89c0e09-fda3-4512-826c-85a6f08cc121 for instance 2cda1bf7-ab8a-4567-a8d6-54697a316461 on n-h2-826756-3 Jul 28 03:45:49.324122 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-80671703-e494-421c-8604-3c7a1f30d3e1 req-d3792ff9-3569-494c-a93c-ca4ad44e6896 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091769 Jul 28 03:45:49.325906 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1230/2220] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:49.335434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3396bfb-c353-4f25-8e1b-7abbdcfafdda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:49.336414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d3396bfb-c353-4f25-8e1b-7abbdcfafdda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:49.345309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3396bfb-c353-4f25-8e1b-7abbdcfafdda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:49.345918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3396bfb-c353-4f25-8e1b-7abbdcfafdda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:49.346924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3396bfb-c353-4f25-8e1b-7abbdcfafdda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:49.354000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3396bfb-c353-4f25-8e1b-7abbdcfafdda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:49.404309 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d2281d1d-34d9-46cd-9aac-70a91e96e0be tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.494202 Jul 28 03:45:49.406787 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 991/2221] 10.222.0.48 () {60 vars in 1195 bytes} [Thu Jul 28 03:45:48 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:49.423756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5247ed41-be7d-4100-996d-3a50062c3e41 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Calling method '.version_select at 0x7ffa7488d550>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:49.426393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-d3396bfb-c353-4f25-8e1b-7abbdcfafdda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lazy-loading 'flavor' on Instance uuid 35fa1b51-1663-49af-b9e3-2aca487ece39 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:45:49.607012 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5247ed41-be7d-4100-996d-3a50062c3e41 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/1cf069faf2784e888ff74e4709dc94c9" status: 200 len: 371 microversion: 2.1 time: 0.198860 Jul 28 03:45:49.618174 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 992/2222] 10.222.0.48 () {58 vars in 1242 bytes} [Thu Jul 28 03:45:49 2022] GET /compute/v2.1/os-quota-sets/1cf069faf2784e888ff74e4709dc94c9 => generated 371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:49.641624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5c6039f9-cfbe-4968-8a66-bed3826c6896 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:49.642648 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5c6039f9-cfbe-4968-8a66-bed3826c6896 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:49.651609 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5c6039f9-cfbe-4968-8a66-bed3826c6896 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:49.653151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5c6039f9-cfbe-4968-8a66-bed3826c6896 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:49.654250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5c6039f9-cfbe-4968-8a66-bed3826c6896 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:49.654958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5c6039f9-cfbe-4968-8a66-bed3826c6896 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:49.723831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5c6039f9-cfbe-4968-8a66-bed3826c6896 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:49.725160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5c6039f9-cfbe-4968-8a66-bed3826c6896 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:49.725849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-5c6039f9-cfbe-4968-8a66-bed3826c6896 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lazy-loading 'fault' on Instance uuid 282080fd-6332-429d-b6cd-3f760b08a955 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:45:49.839951 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5c6039f9-cfbe-4968-8a66-bed3826c6896 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:49.862650 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5c6039f9-cfbe-4968-8a66-bed3826c6896 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 200 len: 1307 microversion: 2.1 time: 0.242069 Jul 28 03:45:49.863251 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 993/2223] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:49 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 1307 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:49.889287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-882fe3c5-1f4d-4907-b345-1f6015975fb4 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Action: 'create', calling method: .version_select at 0x7ffa749cb8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1924424766", "description": "tempest-description-1387322379"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:50.169092 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d3396bfb-c353-4f25-8e1b-7abbdcfafdda tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39/action" status: 202 len: 0 microversion: 2.1 time: 0.840774 Jul 28 03:45:50.170713 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1231/2224] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:45:49 2022] POST /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39/action => generated 0 bytes in 844 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:45:50.181862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-871279fb-9fa9-4016-b0f3-9b278b514fab tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Calling method '.version_select at 0x7ffa747da310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:50.190085 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-882fe3c5-1f4d-4907-b345-1f6015975fb4 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.315824 Jul 28 03:45:50.191557 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 994/2225] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:45:49 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:50.203690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-974bbe78-e8b9-48df-b534-c3e6bb3e08a2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:50.206865 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-974bbe78-e8b9-48df-b534-c3e6bb3e08a2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:50.225206 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-974bbe78-e8b9-48df-b534-c3e6bb3e08a2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:50.225826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-974bbe78-e8b9-48df-b534-c3e6bb3e08a2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:50.226717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-974bbe78-e8b9-48df-b534-c3e6bb3e08a2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:50.227166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-974bbe78-e8b9-48df-b534-c3e6bb3e08a2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:50.515848 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-871279fb-9fa9-4016-b0f3-9b278b514fab tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/52922e2867f24e4fbee0122bcdae50e8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.338173 Jul 28 03:45:50.518020 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1232/2226] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 03:45:50 2022] GET /compute/v2.1/os-quota-sets/52922e2867f24e4fbee0122bcdae50e8/defaults => generated 371 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:50.524754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-974bbe78-e8b9-48df-b534-c3e6bb3e08a2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:50.536804 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-974bbe78-e8b9-48df-b534-c3e6bb3e08a2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1493 microversion: 2.1 time: 0.342955 Jul 28 03:45:50.540852 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 995/2227] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:50 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1493 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:50.549866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1b9115d2-0e16-4290-9569-6139a68b4116 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:50.554434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1b9115d2-0e16-4290-9569-6139a68b4116 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:50.559434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-25df9237-5af6-4888-aded-f32c4408ace2 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Action: 'create', calling method: .version_select at 0x7ffa747da790>, body: {"security_group_rule": {"parent_group_id": "a0cbd7d1-3f7d-4298-ad79-a8f453e38d75", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:50.569375 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b9115d2-0e16-4290-9569-6139a68b4116 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:50.570115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b9115d2-0e16-4290-9569-6139a68b4116 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:50.573009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b9115d2-0e16-4290-9569-6139a68b4116 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:50.574068 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b9115d2-0e16-4290-9569-6139a68b4116 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:50.958307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1b9115d2-0e16-4290-9569-6139a68b4116 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:50.967480 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1b9115d2-0e16-4290-9569-6139a68b4116 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1318 microversion: 2.1 time: 0.425148 Jul 28 03:45:50.982218 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 996/2228] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:50 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1318 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:50.987578 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fd80d9a1-558f-47f2-99fa-e38b17b90bca tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:50.988615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fd80d9a1-558f-47f2-99fa-e38b17b90bca tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 282080fd-6332-429d-b6cd-3f760b08a955] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:50.995440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd80d9a1-558f-47f2-99fa-e38b17b90bca tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:50.996456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd80d9a1-558f-47f2-99fa-e38b17b90bca tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:50.997449 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd80d9a1-558f-47f2-99fa-e38b17b90bca tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:50.998162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd80d9a1-558f-47f2-99fa-e38b17b90bca tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:51.016037 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-fd80d9a1-558f-47f2-99fa-e38b17b90bca tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] HTTP exception thrown: Instance 282080fd-6332-429d-b6cd-3f760b08a955 could not be found. Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fd80d9a1-558f-47f2-99fa-e38b17b90bca tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Request method failure captured: Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 HTTP/1.1 Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gV7mA-YMFAnKldeINQgvLPHsWGEsLjGMUv3-B_tN9Ugj2i5DM_RX_Ep1KaxrbWm2Z8GsdcNggENEnCgcmkkVtQS2Dy-vjfuBjPxxxa-2cT3j6wuhgPkDKW43EOn0zr7zrVFK5Xpu4YAhRd8TK-PW3z8gnBOwf36svmLpKa7gl0y4n0 Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}] Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ff63655143224ba9831e8dcb7a4d2e37 Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 282080fd-6332-429d-b6cd-3f760b08a955 could not be found. Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '282080fd-6332-429d-b6cd-3f760b08a955'} Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 282080fd-6332-429d-b6cd-3f760b08a955 could not be found. Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 282080fd-6332-429d-b6cd-3f760b08a955 could not be found. Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:51.018563 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:51.023412 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:51.023412 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:51.023412 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:51.023412 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:51.023412 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:51.023412 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 282080fd-6332-429d-b6cd-3f760b08a955 could not be found. Jul 28 03:45:51.023412 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:51.023412 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fd80d9a1-558f-47f2-99fa-e38b17b90bca tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Returning 404 to user: Instance 282080fd-6332-429d-b6cd-3f760b08a955 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:51.023412 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fd80d9a1-558f-47f2-99fa-e38b17b90bca tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955" status: 404 len: 111 microversion: 2.1 time: 0.036573 Jul 28 03:45:51.025795 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 997/2229] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:50 2022] GET /compute/v2.1/servers/282080fd-6332-429d-b6cd-3f760b08a955 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:45:51.033675 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-64caafa3-e35b-4db4-8cf4-4794631bf738 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Action: 'update', calling method: .version_select at 0x7ffa749cb160>, body: {"quota_set": {"ram": "5120"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:51.097626 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-25df9237-5af6-4888-aded-f32c4408ace2 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.578262 Jul 28 03:45:51.098287 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1233/2230] 10.222.0.48 () {60 vars in 1195 bytes} [Thu Jul 28 03:45:50 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:51.103441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-77e7531c-b27b-4da6-b86c-edaabbec41c5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:51.104072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-77e7531c-b27b-4da6-b86c-edaabbec41c5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:51.116963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77e7531c-b27b-4da6-b86c-edaabbec41c5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:51.135556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77e7531c-b27b-4da6-b86c-edaabbec41c5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:51.137005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77e7531c-b27b-4da6-b86c-edaabbec41c5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:51.137621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77e7531c-b27b-4da6-b86c-edaabbec41c5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:51.195612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-77e7531c-b27b-4da6-b86c-edaabbec41c5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:45:51.309652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64caafa3-e35b-4db4-8cf4-4794631bf738 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:51.310105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64caafa3-e35b-4db4-8cf4-4794631bf738 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:51.316181 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64caafa3-e35b-4db4-8cf4-4794631bf738 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:51.316780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64caafa3-e35b-4db4-8cf4-4794631bf738 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:51.336625 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-77e7531c-b27b-4da6-b86c-edaabbec41c5 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "DELETE /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 204 len: 0 microversion: 2.1 time: 0.236368 Jul 28 03:45:51.339696 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1234/2231] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:45:51 2022] DELETE /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:45:51.359925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74e0dd8a-5543-4c72-b475-161f7436d592 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Action: 'create', calling method: .version_select at 0x7ffa79997550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-464126687", "description": "tempest-description-2067296250"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:51.454475 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-64caafa3-e35b-4db4-8cf4-4794631bf738 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/f5ac1bf1c47f4424b4ac6f20c191f1f0" status: 200 len: 328 microversion: 2.1 time: 0.426703 Jul 28 03:45:51.455336 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 998/2232] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Jul 28 03:45:51 2022] PUT /compute/v2.1/os-quota-sets/f5ac1bf1c47f4424b4ac6f20c191f1f0 => generated 328 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:51.466467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4132de60-31eb-41d1-9dc8-fd8c6b3895c3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:51.467768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4132de60-31eb-41d1-9dc8-fd8c6b3895c3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:51.486482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4132de60-31eb-41d1-9dc8-fd8c6b3895c3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:51.486827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4132de60-31eb-41d1-9dc8-fd8c6b3895c3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:51.487803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4132de60-31eb-41d1-9dc8-fd8c6b3895c3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:51.494300 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4132de60-31eb-41d1-9dc8-fd8c6b3895c3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:51.940617 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4132de60-31eb-41d1-9dc8-fd8c6b3895c3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:51.975011 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4132de60-31eb-41d1-9dc8-fd8c6b3895c3 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1472 microversion: 2.1 time: 0.517031 Jul 28 03:45:51.977776 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 999/2233] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:51 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1472 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:52.004250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-d08dd4ed-dd82-4bea-b70b-c40502005e09 req-7a671f53-59de-4ae7-9519-702a192a1c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282080fd-6332-429d-b6cd-3f760b08a955", "name": "network-vif-deleted", "tag": "ddc6e41a-3432-46c0-ac89-3875e939f2a8"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:52.021692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-d08dd4ed-dd82-4bea-b70b-c40502005e09 req-7a671f53-59de-4ae7-9519-702a192a1c98 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:52.023953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-d08dd4ed-dd82-4bea-b70b-c40502005e09 req-7a671f53-59de-4ae7-9519-702a192a1c98 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:52.065916 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-d08dd4ed-dd82-4bea-b70b-c40502005e09 req-7a671f53-59de-4ae7-9519-702a192a1c98 service nova] Creating event network-vif-deleted:ddc6e41a-3432-46c0-ac89-3875e939f2a8 for instance 282080fd-6332-429d-b6cd-3f760b08a955 on n-h2-826756-3 Jul 28 03:45:52.079348 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-d08dd4ed-dd82-4bea-b70b-c40502005e09 req-7a671f53-59de-4ae7-9519-702a192a1c98 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097956 Jul 28 03:45:52.082006 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1000/2234] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:52.097772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-045bbc5b-0ca3-4bbf-b40b-15ce2abf53ee tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Calling method '.version_select at 0x7ffa749cbe50>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:52.166025 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74e0dd8a-5543-4c72-b475-161f7436d592 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.823419 Jul 28 03:45:52.167438 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1235/2235] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:45:51 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:52.179195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-131cf97f-0eca-44dd-b518-23df1aed3793 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:52.180278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-131cf97f-0eca-44dd-b518-23df1aed3793 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:52.196683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-131cf97f-0eca-44dd-b518-23df1aed3793 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:52.197155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-131cf97f-0eca-44dd-b518-23df1aed3793 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:52.197945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-131cf97f-0eca-44dd-b518-23df1aed3793 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:52.198703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-131cf97f-0eca-44dd-b518-23df1aed3793 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:52.214802 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-045bbc5b-0ca3-4bbf-b40b-15ce2abf53ee tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:52.216594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-045bbc5b-0ca3-4bbf-b40b-15ce2abf53ee tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:52.217836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-045bbc5b-0ca3-4bbf-b40b-15ce2abf53ee tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:52.218549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-045bbc5b-0ca3-4bbf-b40b-15ce2abf53ee tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:52.253797 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-045bbc5b-0ca3-4bbf-b40b-15ce2abf53ee tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/f5ac1bf1c47f4424b4ac6f20c191f1f0/detail" status: 200 len: 916 microversion: 2.1 time: 0.169497 Jul 28 03:45:52.270742 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1001/2236] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:45:52 2022] GET /compute/v2.1/os-quota-sets/f5ac1bf1c47f4424b4ac6f20c191f1f0/detail => generated 916 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:52.298435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-54da713f-4416-48f1-b305-ddbbbc5c83b8 req-1d7dad15-246c-4d3d-96fb-7850a06a61a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1d50cc-a245-45b8-a35d-7e6dcc1d2015", "name": "network-vif-plugged", "status": "completed", "tag": "42fe0509-4544-4491-a652-a3e7790cc649"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:52.315422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-54da713f-4416-48f1-b305-ddbbbc5c83b8 req-1d7dad15-246c-4d3d-96fb-7850a06a61a3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:52.316562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-54da713f-4416-48f1-b305-ddbbbc5c83b8 req-1d7dad15-246c-4d3d-96fb-7850a06a61a3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:52.332919 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-54da713f-4416-48f1-b305-ddbbbc5c83b8 req-1d7dad15-246c-4d3d-96fb-7850a06a61a3 service nova] Creating event network-vif-plugged:42fe0509-4544-4491-a652-a3e7790cc649 for instance 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 on n-h2-826756-3 Jul 28 03:45:52.339055 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-54da713f-4416-48f1-b305-ddbbbc5c83b8 req-1d7dad15-246c-4d3d-96fb-7850a06a61a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058511 Jul 28 03:45:52.339963 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1002/2237] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:52.347667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1f8bf5df-b81c-4cb6-8151-21bf773a2737 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:52.348756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1f8bf5df-b81c-4cb6-8151-21bf773a2737 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:52.357409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f8bf5df-b81c-4cb6-8151-21bf773a2737 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:52.358981 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f8bf5df-b81c-4cb6-8151-21bf773a2737 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:52.361334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f8bf5df-b81c-4cb6-8151-21bf773a2737 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:52.362001 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f8bf5df-b81c-4cb6-8151-21bf773a2737 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:52.554696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-131cf97f-0eca-44dd-b518-23df1aed3793 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:52.564964 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-131cf97f-0eca-44dd-b518-23df1aed3793 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1514 microversion: 2.1 time: 0.396100 Jul 28 03:45:52.565135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1f8bf5df-b81c-4cb6-8151-21bf773a2737 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:52.565775 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1236/2238] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:52 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1514 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:52.572718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-795391cc-7312-4f3c-8022-1c587328c313 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Action: 'create', calling method: .version_select at 0x7ffa742a98b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1302257448", "description": "tempest-description-1770003206"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:52.574140 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1f8bf5df-b81c-4cb6-8151-21bf773a2737 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1318 microversion: 2.1 time: 0.231796 Jul 28 03:45:52.585106 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1003/2239] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:52 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:52.592218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3f2e20b7-e443-42ea-9046-5a31ba7845b1 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74b455e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:52.665511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f2e20b7-e443-42ea-9046-5a31ba7845b1 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:52.665927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f2e20b7-e443-42ea-9046-5a31ba7845b1 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:52.666944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f2e20b7-e443-42ea-9046-5a31ba7845b1 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:52.667386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f2e20b7-e443-42ea-9046-5a31ba7845b1 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:52.711207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f2e20b7-e443-42ea-9046-5a31ba7845b1 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:52.712081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f2e20b7-e443-42ea-9046-5a31ba7845b1 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:52.713339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f2e20b7-e443-42ea-9046-5a31ba7845b1 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:52.714365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f2e20b7-e443-42ea-9046-5a31ba7845b1 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:52.865182 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3f2e20b7-e443-42ea-9046-5a31ba7845b1 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/f5ac1bf1c47f4424b4ac6f20c191f1f0?user_id=4f598a960d95433bba42aa005f1006b4" status: 200 len: 328 microversion: 2.1 time: 0.276983 Jul 28 03:45:52.868100 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1004/2240] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:45:52 2022] PUT /compute/v2.1/os-quota-sets/f5ac1bf1c47f4424b4ac6f20c191f1f0?user_id=4f598a960d95433bba42aa005f1006b4 => generated 328 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:52.882042 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b4865509-4693-4420-bc4e-16fd21a8747e tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Calling method '.version_select at 0x7ffa7483de50>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:53.028559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:53.101207 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b4865509-4693-4420-bc4e-16fd21a8747e tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/f5ac1bf1c47f4424b4ac6f20c191f1f0?user_id=4f598a960d95433bba42aa005f1006b4" status: 200 len: 370 microversion: 2.1 time: 0.224933 Jul 28 03:45:53.110634 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1005/2241] 10.222.0.48 () {58 vars in 1323 bytes} [Thu Jul 28 03:45:52 2022] GET /compute/v2.1/os-quota-sets/f5ac1bf1c47f4424b4ac6f20c191f1f0?user_id=4f598a960d95433bba42aa005f1006b4 => generated 370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:53.130580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-62e81deb-7904-4c25-85b0-886efc7a2411 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:53.131218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-62e81deb-7904-4c25-85b0-886efc7a2411 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:53.169918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-62e81deb-7904-4c25-85b0-886efc7a2411 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:53.170386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-62e81deb-7904-4c25-85b0-886efc7a2411 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:53.171200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-62e81deb-7904-4c25-85b0-886efc7a2411 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:53.171652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-62e81deb-7904-4c25-85b0-886efc7a2411 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:53.605968 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-795391cc-7312-4f3c-8022-1c587328c313 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.038589 Jul 28 03:45:53.614139 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1237/2242] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:45:52 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:53.614139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e17293db-9a4a-40fb-a3a6-ab6e3c8ae191 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:53.614139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e17293db-9a4a-40fb-a3a6-ab6e3c8ae191 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:53.640662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e17293db-9a4a-40fb-a3a6-ab6e3c8ae191 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:53.641309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e17293db-9a4a-40fb-a3a6-ab6e3c8ae191 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:53.644720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e17293db-9a4a-40fb-a3a6-ab6e3c8ae191 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:53.645551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e17293db-9a4a-40fb-a3a6-ab6e3c8ae191 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:54.196659 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-62e81deb-7904-4c25-85b0-886efc7a2411 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:54.203288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e17293db-9a4a-40fb-a3a6-ab6e3c8ae191 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:54.218094 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e17293db-9a4a-40fb-a3a6-ab6e3c8ae191 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1509 microversion: 2.1 time: 0.609792 Jul 28 03:45:54.224621 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-62e81deb-7904-4c25-85b0-886efc7a2411 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1472 microversion: 2.1 time: 1.115835 Jul 28 03:45:54.225353 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1006/2243] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:53 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1472 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:54.237035 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1238/2244] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:53 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1509 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:54.248130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06caebe9-be7a-4e24-8ea7-e16c782e05ea tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Action: 'create', calling method: .version_select at 0x7ffa67ad3c10>, body: {"security_group_rule": {"parent_group_id": "046e001a-1cf5-47bb-8d2c-627f52e0831a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "af6ab0a1-e23f-445f-8dcb-ae05ce82e16a"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:54.257430 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-82e241f5-9398-4233-825f-20af79517708 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:54.258425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-82e241f5-9398-4233-825f-20af79517708 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:54.270928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-82e241f5-9398-4233-825f-20af79517708 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:54.274808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-82e241f5-9398-4233-825f-20af79517708 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:54.275857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-82e241f5-9398-4233-825f-20af79517708 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:54.279999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-82e241f5-9398-4233-825f-20af79517708 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:54.911294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-82e241f5-9398-4233-825f-20af79517708 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:54.923870 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-82e241f5-9398-4233-825f-20af79517708 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1318 microversion: 2.1 time: 0.696942 Jul 28 03:45:54.929221 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1007/2245] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:54 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1318 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:54.939299 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1007bc81-9b42-47bd-a17e-82861080f3fe tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Calling method '.version_select at 0x7ffa7483d160>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:55.009584 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-06caebe9-be7a-4e24-8ea7-e16c782e05ea tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.771100 Jul 28 03:45:55.011296 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1239/2246] 10.222.0.48 () {60 vars in 1195 bytes} [Thu Jul 28 03:45:54 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:55.040867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dbfc0885-0f1c-4e59-953f-fed6a8c8a9db tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Action: 'create', calling method: .version_select at 0x7ffa74703310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1216274759", "description": "tempest-description-1497579218"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:55.262418 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dbfc0885-0f1c-4e59-953f-fed6a8c8a9db tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.241478 Jul 28 03:45:55.264905 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1240/2247] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:45:55 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:55.283455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-23734262-7ab8-4907-98cd-920e27da1d36 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:55.287352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-23734262-7ab8-4907-98cd-920e27da1d36 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:55.300392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23734262-7ab8-4907-98cd-920e27da1d36 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:55.301217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23734262-7ab8-4907-98cd-920e27da1d36 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:55.302362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23734262-7ab8-4907-98cd-920e27da1d36 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:55.303298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23734262-7ab8-4907-98cd-920e27da1d36 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:55.630042 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1007bc81-9b42-47bd-a17e-82861080f3fe tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/52922e2867f24e4fbee0122bcdae50e8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.699579 Jul 28 03:45:55.630532 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1008/2248] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 03:45:54 2022] GET /compute/v2.1/os-quota-sets/52922e2867f24e4fbee0122bcdae50e8/defaults => generated 371 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:55.638902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-23734262-7ab8-4907-98cd-920e27da1d36 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:55.650243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bacbfd42-79f7-40e9-9b3c-756ce46d62a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:55.651051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bacbfd42-79f7-40e9-9b3c-756ce46d62a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:55.655398 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-23734262-7ab8-4907-98cd-920e27da1d36 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 200 len: 1472 microversion: 2.1 time: 0.389062 Jul 28 03:45:55.657363 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1241/2249] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:55 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:55.676868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bacbfd42-79f7-40e9-9b3c-756ce46d62a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:55.681342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-11755e4d-5fef-4751-8a45-3eb75ecb1627 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Action: 'create', calling method: .version_select at 0x7ffa67af1a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1617850629", "description": "tempest-description-1177635516"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:55.686503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bacbfd42-79f7-40e9-9b3c-756ce46d62a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:55.687376 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bacbfd42-79f7-40e9-9b3c-756ce46d62a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:55.692673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bacbfd42-79f7-40e9-9b3c-756ce46d62a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:56.099806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bacbfd42-79f7-40e9-9b3c-756ce46d62a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:56.115066 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bacbfd42-79f7-40e9-9b3c-756ce46d62a9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1509 microversion: 2.1 time: 0.483305 Jul 28 03:45:56.117670 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1009/2250] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:55 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:56.137597 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-45d5dd5e-873e-4f46-aac2-df4d4b1d7d4f req-73bcb440-6393-45ab-b093-09d0ff667dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35fa1b51-1663-49af-b9e3-2aca487ece39", "name": "network-vif-plugged", "status": "completed", "tag": "b22bdd6c-d4ca-481d-b617-ff52448c390d"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:56.161577 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-45d5dd5e-873e-4f46-aac2-df4d4b1d7d4f req-73bcb440-6393-45ab-b093-09d0ff667dd7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:56.162897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-45d5dd5e-873e-4f46-aac2-df4d4b1d7d4f req-73bcb440-6393-45ab-b093-09d0ff667dd7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:56.176560 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-45d5dd5e-873e-4f46-aac2-df4d4b1d7d4f req-73bcb440-6393-45ab-b093-09d0ff667dd7 service nova] Creating event network-vif-plugged:b22bdd6c-d4ca-481d-b617-ff52448c390d for instance 35fa1b51-1663-49af-b9e3-2aca487ece39 on n-h1-826756-3 Jul 28 03:45:56.183083 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-45d5dd5e-873e-4f46-aac2-df4d4b1d7d4f req-73bcb440-6393-45ab-b093-09d0ff667dd7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048457 Jul 28 03:45:56.184318 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1010/2251] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:56.191175 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e708505d-7be8-4460-be8a-8dad51e9b946 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Action: 'update', calling method: .version_select at 0x7ffa74269e50>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:56.638669 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-11755e4d-5fef-4751-8a45-3eb75ecb1627 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.979686 Jul 28 03:45:56.646649 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1242/2252] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:45:55 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:56.646649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-89d31741-6cc6-48d7-9d9b-5a7bc38263fa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:56.647011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-89d31741-6cc6-48d7-9d9b-5a7bc38263fa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:56.666804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e708505d-7be8-4460-be8a-8dad51e9b946 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:56.670088 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e708505d-7be8-4460-be8a-8dad51e9b946 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:56.671027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89d31741-6cc6-48d7-9d9b-5a7bc38263fa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:56.674406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e708505d-7be8-4460-be8a-8dad51e9b946 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:56.679415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89d31741-6cc6-48d7-9d9b-5a7bc38263fa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:56.681880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89d31741-6cc6-48d7-9d9b-5a7bc38263fa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:56.684999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89d31741-6cc6-48d7-9d9b-5a7bc38263fa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:56.686126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e708505d-7be8-4460-be8a-8dad51e9b946 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:57.000715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-89d31741-6cc6-48d7-9d9b-5a7bc38263fa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:57.014263 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-89d31741-6cc6-48d7-9d9b-5a7bc38263fa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1467 microversion: 2.1 time: 0.372885 Jul 28 03:45:57.015562 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1243/2253] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:56 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1467 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:57.022158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c188e9f2-4aef-4487-90a1-5ffab08c0141 req-f1aa247b-2706-4127-af98-c0fdf6b2733b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13887dd8-a0f8-4555-bc49-9d459ec1638d", "name": "network-vif-deleted", "tag": "5ecc8b82-95a8-4fcb-8d59-54f537783af7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:57.035411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c188e9f2-4aef-4487-90a1-5ffab08c0141 req-f1aa247b-2706-4127-af98-c0fdf6b2733b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:57.036015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c188e9f2-4aef-4487-90a1-5ffab08c0141 req-f1aa247b-2706-4127-af98-c0fdf6b2733b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:57.056034 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c188e9f2-4aef-4487-90a1-5ffab08c0141 req-f1aa247b-2706-4127-af98-c0fdf6b2733b service nova] Creating event network-vif-deleted:5ecc8b82-95a8-4fcb-8d59-54f537783af7 for instance 13887dd8-a0f8-4555-bc49-9d459ec1638d on n-h2-826756-3 Jul 28 03:45:57.063189 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c188e9f2-4aef-4487-90a1-5ffab08c0141 req-f1aa247b-2706-4127-af98-c0fdf6b2733b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044639 Jul 28 03:45:57.064290 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1244/2254] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:57.073464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-46a017ca-895f-4bac-a3ee-940ffbc6aafe tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Action: 'create', calling method: .version_select at 0x7ffa745f01f0>, body: {"security_group_rule": {"parent_group_id": "784f3596-12bc-437f-83c2-4109d22f7dc3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9786559b-8515-44f8-b723-369687b99a3e"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:57.098607 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e708505d-7be8-4460-be8a-8dad51e9b946 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/52922e2867f24e4fbee0122bcdae50e8" status: 200 len: 329 microversion: 2.1 time: 0.911873 Jul 28 03:45:57.100394 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1011/2255] 10.222.0.48 () {60 vars in 1263 bytes} [Thu Jul 28 03:45:56 2022] PUT /compute/v2.1/os-quota-sets/52922e2867f24e4fbee0122bcdae50e8 => generated 329 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:57.109894 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-56b3720a-c1b7-46c5-ac92-6e76c6ecbe0c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:57.110817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-56b3720a-c1b7-46c5-ac92-6e76c6ecbe0c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 13887dd8-a0f8-4555-bc49-9d459ec1638d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:57.121773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-56b3720a-c1b7-46c5-ac92-6e76c6ecbe0c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:57.122227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-56b3720a-c1b7-46c5-ac92-6e76c6ecbe0c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:57.123013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-56b3720a-c1b7-46c5-ac92-6e76c6ecbe0c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:57.123467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-56b3720a-c1b7-46c5-ac92-6e76c6ecbe0c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:57.145105 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-56b3720a-c1b7-46c5-ac92-6e76c6ecbe0c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] HTTP exception thrown: Instance 13887dd8-a0f8-4555-bc49-9d459ec1638d could not be found. Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-56b3720a-c1b7-46c5-ac92-6e76c6ecbe0c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Request method failure captured: Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d HTTP/1.1 Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gV7mA-YMFAnKldeINQgvLPHsWGEsLjGMUv3-B_tN9Ugj2i5DM_RX_Ep1KaxrbWm2Z8GsdcNggENEnCgcmkkVtQS2Dy-vjfuBjPxxxa-2cT3j6wuhgPkDKW43EOn0zr7zrVFK5Xpu4YAhRd8TK-PW3z8gnBOwf36svmLpKa7gl0y4n0 Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}] Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ff63655143224ba9831e8dcb7a4d2e37 Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 13887dd8-a0f8-4555-bc49-9d459ec1638d could not be found. Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '13887dd8-a0f8-4555-bc49-9d459ec1638d'} Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13887dd8-a0f8-4555-bc49-9d459ec1638d could not be found. Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13887dd8-a0f8-4555-bc49-9d459ec1638d could not be found. Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:45:57.147195 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:57.150605 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:45:57.150605 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:45:57.150605 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:45:57.150605 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:45:57.150605 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:45:57.150605 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13887dd8-a0f8-4555-bc49-9d459ec1638d could not be found. Jul 28 03:45:57.150605 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:45:57.152647 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-56b3720a-c1b7-46c5-ac92-6e76c6ecbe0c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Returning 404 to user: Instance 13887dd8-a0f8-4555-bc49-9d459ec1638d could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:45:57.153737 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-56b3720a-c1b7-46c5-ac92-6e76c6ecbe0c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d" status: 404 len: 111 microversion: 2.1 time: 0.052123 Jul 28 03:45:57.154517 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1012/2256] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:57 2022] GET /compute/v2.1/servers/13887dd8-a0f8-4555-bc49-9d459ec1638d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:45:57.174751 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-243414ae-bdd8-4005-ade4-e0e7efe45a6c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:57.176247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-243414ae-bdd8-4005-ade4-e0e7efe45a6c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 58a40da4-0f01-4368-835f-9c3b550eb137] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:57.192652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-243414ae-bdd8-4005-ade4-e0e7efe45a6c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:57.193425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-243414ae-bdd8-4005-ade4-e0e7efe45a6c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:57.195162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-243414ae-bdd8-4005-ade4-e0e7efe45a6c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:57.195800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-243414ae-bdd8-4005-ade4-e0e7efe45a6c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:57.833202 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-46a017ca-895f-4bac-a3ee-940ffbc6aafe tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.767038 Jul 28 03:45:57.834438 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1245/2257] 10.222.0.48 () {60 vars in 1195 bytes} [Thu Jul 28 03:45:57 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:57.839585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-098e4edf-7c7a-4a16-b233-b4dc0f936c85 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Action: 'update', calling method: .version_select at 0x7ffa746885e0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:57.920520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-243414ae-bdd8-4005-ade4-e0e7efe45a6c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:57.931181 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:57.939538 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-243414ae-bdd8-4005-ade4-e0e7efe45a6c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137" status: 200 len: 1467 microversion: 2.1 time: 0.778933 Jul 28 03:45:57.939538 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1013/2258] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:57 2022] GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137 => generated 1467 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:57.951169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d2e4ae1e-ddba-4408-aff3-990af033cd42 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:57.953105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d2e4ae1e-ddba-4408-aff3-990af033cd42 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:57.975415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2e4ae1e-ddba-4408-aff3-990af033cd42 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:57.983517 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2e4ae1e-ddba-4408-aff3-990af033cd42 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:57.987933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2e4ae1e-ddba-4408-aff3-990af033cd42 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:57.988729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2e4ae1e-ddba-4408-aff3-990af033cd42 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:58.219205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-098e4edf-7c7a-4a16-b233-b4dc0f936c85 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:58.221810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-098e4edf-7c7a-4a16-b233-b4dc0f936c85 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:58.222975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-098e4edf-7c7a-4a16-b233-b4dc0f936c85 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:58.224255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-098e4edf-7c7a-4a16-b233-b4dc0f936c85 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:58.401752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d2e4ae1e-ddba-4408-aff3-990af033cd42 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:58.413760 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d2e4ae1e-ddba-4408-aff3-990af033cd42 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1509 microversion: 2.1 time: 0.472849 Jul 28 03:45:58.429613 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1014/2259] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:57 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1509 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:58.435233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-afd551ea-9519-4928-b313-72f5cfc251ec tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:58.436164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-afd551ea-9519-4928-b313-72f5cfc251ec tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 4040cba7-343d-4675-8c2a-a7b86506a2b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:58.443212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afd551ea-9519-4928-b313-72f5cfc251ec tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:58.444203 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afd551ea-9519-4928-b313-72f5cfc251ec tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:58.445233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afd551ea-9519-4928-b313-72f5cfc251ec tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:58.445784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afd551ea-9519-4928-b313-72f5cfc251ec tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:58.480621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-afd551ea-9519-4928-b313-72f5cfc251ec tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 4040cba7-343d-4675-8c2a-a7b86506a2b1] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:45:58.620518 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-afd551ea-9519-4928-b313-72f5cfc251ec tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1" status: 204 len: 0 microversion: 2.1 time: 0.188061 Jul 28 03:45:58.621680 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1015/2260] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:45:58 2022] DELETE /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:45:58.629168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-99195bf7-57b5-4c4d-91fd-ef789f0d0d8d tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Calling method '.version_select at 0x7ffa74832f70>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:58.695763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=14,nova_api:DELETE=2,nova_api:UPDATE=13 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:45:58.787525 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-098e4edf-7c7a-4a16-b233-b4dc0f936c85 tempest-QuotasAdminTestJSON-2085030769 tempest-QuotasAdminTestJSON-2085030769-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/52922e2867f24e4fbee0122bcdae50e8" status: 200 len: 329 microversion: 2.1 time: 0.951653 Jul 28 03:45:58.798275 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1246/2261] 10.222.0.48 () {60 vars in 1263 bytes} [Thu Jul 28 03:45:57 2022] PUT /compute/v2.1/os-quota-sets/52922e2867f24e4fbee0122bcdae50e8 => generated 329 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:58.805085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a537278-44f5-4083-ac92-3b5bb14e2ea6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1581930060"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:45:58.809895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1a537278-44f5-4083-ac92-3b5bb14e2ea6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 58a40da4-0f01-4368-835f-9c3b550eb137] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:58.821072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a537278-44f5-4083-ac92-3b5bb14e2ea6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:58.821935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a537278-44f5-4083-ac92-3b5bb14e2ea6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:58.823036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a537278-44f5-4083-ac92-3b5bb14e2ea6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:58.823695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a537278-44f5-4083-ac92-3b5bb14e2ea6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:59.069296 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-99195bf7-57b5-4c4d-91fd-ef789f0d0d8d tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/9786559b-8515-44f8-b723-369687b99a3e" status: 202 len: 0 microversion: 2.1 time: 0.445693 Jul 28 03:45:59.075038 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1016/2262] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:45:58 2022] DELETE /compute/v2.1/os-security-groups/9786559b-8515-44f8-b723-369687b99a3e => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:45:59.081616 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b8638bdf-a6e7-43dc-b18e-76dfa0a7f670 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:59.083866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b8638bdf-a6e7-43dc-b18e-76dfa0a7f670 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:59.101570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b8638bdf-a6e7-43dc-b18e-76dfa0a7f670 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:59.106575 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b8638bdf-a6e7-43dc-b18e-76dfa0a7f670 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:59.112945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b8638bdf-a6e7-43dc-b18e-76dfa0a7f670 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:59.112945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b8638bdf-a6e7-43dc-b18e-76dfa0a7f670 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:59.166030 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b8638bdf-a6e7-43dc-b18e-76dfa0a7f670 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:45:59.205213 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1a537278-44f5-4083-ac92-3b5bb14e2ea6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "POST /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137/action" status: 202 len: 0 microversion: 2.1 time: 0.403686 Jul 28 03:45:59.206631 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1247/2263] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:45:58 2022] POST /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 03:45:59.225223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-69fe69ba-bd80-4b21-819b-9d0abe865b99 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Calling method '.version_select at 0x7ffa745f0280>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:59.288980 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b8638bdf-a6e7-43dc-b18e-76dfa0a7f670 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "DELETE /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 204 len: 0 microversion: 2.1 time: 0.211616 Jul 28 03:45:59.290985 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1017/2264] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:45:59 2022] DELETE /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:45:59.297954 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-65aad468-8570-4c4e-8ddf-50428f19892b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa745b0040>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:59.377814 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-65aad468-8570-4c4e-8ddf-50428f19892b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef" status: 200 len: 1455 microversion: 2.1 time: 0.085282 Jul 28 03:45:59.380568 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1018/2265] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:45:59 2022] GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:59.386593 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ed410f6b-465b-4a92-b708-1302d99e090c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:59.387661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ed410f6b-465b-4a92-b708-1302d99e090c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 4040cba7-343d-4675-8c2a-a7b86506a2b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:59.418342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed410f6b-465b-4a92-b708-1302d99e090c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:59.418783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed410f6b-465b-4a92-b708-1302d99e090c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:59.419571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed410f6b-465b-4a92-b708-1302d99e090c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:59.420010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed410f6b-465b-4a92-b708-1302d99e090c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:59.548321 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-69fe69ba-bd80-4b21-819b-9d0abe865b99 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/784f3596-12bc-437f-83c2-4109d22f7dc3" status: 200 len: 248 microversion: 2.1 time: 0.340030 Jul 28 03:45:59.549367 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1248/2266] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 03:45:59 2022] GET /compute/v2.1/os-security-groups/784f3596-12bc-437f-83c2-4109d22f7dc3 => generated 248 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:45:59.565484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-694e2633-cf6e-4d0d-b5da-aea2585a264b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:45:59.566496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-694e2633-cf6e-4d0d-b5da-aea2585a264b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:45:59.595967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-694e2633-cf6e-4d0d-b5da-aea2585a264b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:59.596529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-694e2633-cf6e-4d0d-b5da-aea2585a264b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:59.615449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-694e2633-cf6e-4d0d-b5da-aea2585a264b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:45:59.616726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-694e2633-cf6e-4d0d-b5da-aea2585a264b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:45:59.789281 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ed410f6b-465b-4a92-b708-1302d99e090c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:45:59.803028 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ed410f6b-465b-4a92-b708-1302d99e090c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1" status: 200 len: 1475 microversion: 2.1 time: 0.421045 Jul 28 03:45:59.803627 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1019/2267] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:59 2022] GET /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1 => generated 1475 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:45:59.808303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ed109b99-a34e-4a2d-a105-2bca7c1b90b7 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Action: 'create', calling method: .version_select at 0x7ffa745b0af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1671479835", "description": "tempest-description-1513376741"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:00.139039 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ed109b99-a34e-4a2d-a105-2bca7c1b90b7 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.334198 Jul 28 03:46:00.140163 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1020/2268] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:45:59 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:00.154863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2f683201-9f64-4961-9f92-f236f7bcfd85 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Action: 'create', calling method: .version_select at 0x7ffa7488da60>, body: {"security_group_rule": {"parent_group_id": "c9e20a14-b9f2-4b36-a665-b603a179068e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:00.843357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-694e2633-cf6e-4d0d-b5da-aea2585a264b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:00.860483 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-694e2633-cf6e-4d0d-b5da-aea2585a264b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1509 microversion: 2.1 time: 1.299274 Jul 28 03:46:00.877177 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1249/2269] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:45:59 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1509 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:00.897821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9297aef7-6ab1-437d-9fa4-ac539a55219f tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa7453b550>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:00.981315 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9297aef7-6ab1-437d-9fa4-ac539a55219f tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef" status: 200 len: 1455 microversion: 2.1 time: 0.102679 Jul 28 03:46:00.989077 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1250/2270] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:00 2022] GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:00.994131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bbdef408-89b6-46d0-9296-5d0e9536fec4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:00.994748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bbdef408-89b6-46d0-9296-5d0e9536fec4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 4040cba7-343d-4675-8c2a-a7b86506a2b1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:01.015337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbdef408-89b6-46d0-9296-5d0e9536fec4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:01.018363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbdef408-89b6-46d0-9296-5d0e9536fec4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:01.019338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbdef408-89b6-46d0-9296-5d0e9536fec4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:01.023304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbdef408-89b6-46d0-9296-5d0e9536fec4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:01.028396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:01.175761 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2f683201-9f64-4961-9f92-f236f7bcfd85 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.025309 Jul 28 03:46:01.178107 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1021/2271] 10.222.0.48 () {60 vars in 1195 bytes} [Thu Jul 28 03:46:00 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:46:01.190949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-84582bcc-559d-428c-bd99-0b1b33ea1913 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Action: 'create', calling method: .version_select at 0x7ffa74917040>, body: {"security_group_rule": {"parent_group_id": "c9e20a14-b9f2-4b36-a665-b603a179068e", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:01.438404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bbdef408-89b6-46d0-9296-5d0e9536fec4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:01.457494 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bbdef408-89b6-46d0-9296-5d0e9536fec4 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1" status: 200 len: 1475 microversion: 2.1 time: 0.467187 Jul 28 03:46:01.471463 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1251/2272] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:00 2022] GET /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1 => generated 1475 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:01.895561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-35420dd2-b3e8-457f-9b08-78a35e6ba4b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:01.896217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-35420dd2-b3e8-457f-9b08-78a35e6ba4b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:01.916748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35420dd2-b3e8-457f-9b08-78a35e6ba4b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:01.917565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35420dd2-b3e8-457f-9b08-78a35e6ba4b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:01.919124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35420dd2-b3e8-457f-9b08-78a35e6ba4b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:01.920919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35420dd2-b3e8-457f-9b08-78a35e6ba4b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:02.512179 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-84582bcc-559d-428c-bd99-0b1b33ea1913 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.326439 Jul 28 03:46:02.514624 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1022/2273] 10.222.0.48 () {60 vars in 1195 bytes} [Thu Jul 28 03:46:01 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:02.535505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-36783e87-9a15-4bd7-a95d-5ec885b91b71 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa745b0af0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:02.613170 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-36783e87-9a15-4bd7-a95d-5ec885b91b71 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef" status: 200 len: 1455 microversion: 2.1 time: 0.097171 Jul 28 03:46:02.624177 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1023/2274] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:02 2022] GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef => generated 1455 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:02.632262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-58ebdcfd-28e7-4428-8242-eb2628d24077 req-e412f867-c492-495b-87f7-2cc35bcefc44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4040cba7-343d-4675-8c2a-a7b86506a2b1", "name": "network-vif-deleted", "tag": "7a4b64f8-fe97-48ba-94bc-ee1cc308752b"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:02.643480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-58ebdcfd-28e7-4428-8242-eb2628d24077 req-e412f867-c492-495b-87f7-2cc35bcefc44 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:02.644337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-58ebdcfd-28e7-4428-8242-eb2628d24077 req-e412f867-c492-495b-87f7-2cc35bcefc44 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:02.657820 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-58ebdcfd-28e7-4428-8242-eb2628d24077 req-e412f867-c492-495b-87f7-2cc35bcefc44 service nova] Creating event network-vif-deleted:7a4b64f8-fe97-48ba-94bc-ee1cc308752b for instance 4040cba7-343d-4675-8c2a-a7b86506a2b1 on n-h2-826756-3 Jul 28 03:46:02.664873 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-58ebdcfd-28e7-4428-8242-eb2628d24077 req-e412f867-c492-495b-87f7-2cc35bcefc44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038342 Jul 28 03:46:02.665869 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1024/2275] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:02.672947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2a092c27-9d2b-4901-b902-2d89938aef98 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:02.674075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2a092c27-9d2b-4901-b902-2d89938aef98 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 4040cba7-343d-4675-8c2a-a7b86506a2b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:02.681867 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a092c27-9d2b-4901-b902-2d89938aef98 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:02.685019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a092c27-9d2b-4901-b902-2d89938aef98 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:02.686400 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a092c27-9d2b-4901-b902-2d89938aef98 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:02.687043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a092c27-9d2b-4901-b902-2d89938aef98 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:02.727435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a092c27-9d2b-4901-b902-2d89938aef98 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:02.728859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a092c27-9d2b-4901-b902-2d89938aef98 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:02.729533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-2a092c27-9d2b-4901-b902-2d89938aef98 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lazy-loading 'fault' on Instance uuid 4040cba7-343d-4675-8c2a-a7b86506a2b1 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:46:02.968123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2a092c27-9d2b-4901-b902-2d89938aef98 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:02.995397 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2a092c27-9d2b-4901-b902-2d89938aef98 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1" status: 200 len: 1309 microversion: 2.1 time: 0.325006 Jul 28 03:46:02.999397 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1025/2276] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:02 2022] GET /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1 => generated 1309 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:03.024388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a2963b05-ab89-47bb-a929-a6e678f91aeb tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Calling method '.version_select at 0x7ffa748743a0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:03.132429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-35420dd2-b3e8-457f-9b08-78a35e6ba4b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:03.147608 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-35420dd2-b3e8-457f-9b08-78a35e6ba4b7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1509 microversion: 2.1 time: 1.257975 Jul 28 03:46:03.161897 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1252/2277] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:01 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1509 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:03.275609 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a2963b05-ab89-47bb-a929-a6e678f91aeb tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/c9e20a14-b9f2-4b36-a665-b603a179068e" status: 200 len: 665 microversion: 2.1 time: 0.271197 Jul 28 03:46:03.276772 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1026/2278] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 03:46:02 2022] GET /compute/v2.1/os-security-groups/c9e20a14-b9f2-4b36-a665-b603a179068e => generated 665 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:03.290066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51e50088-c0f6-4944-b921-379514e72390 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Calling method '.version_select at 0x7ffa799f0790>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:03.632488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-27e410eb-176f-48a5-9335-15d2e9635c13 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa749cba60>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:03.730874 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-27e410eb-176f-48a5-9335-15d2e9635c13 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef" status: 200 len: 1455 microversion: 2.1 time: 0.097426 Jul 28 03:46:03.731819 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1027/2279] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:03 2022] GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:04.022511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fd3bd2e9-abd9-4794-b990-bf71fa872d19 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:04.023157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fd3bd2e9-abd9-4794-b990-bf71fa872d19 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 4040cba7-343d-4675-8c2a-a7b86506a2b1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:04.048656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd3bd2e9-abd9-4794-b990-bf71fa872d19 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:04.051782 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd3bd2e9-abd9-4794-b990-bf71fa872d19 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:04.056266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd3bd2e9-abd9-4794-b990-bf71fa872d19 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:04.057243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd3bd2e9-abd9-4794-b990-bf71fa872d19 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:04.106436 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-fd3bd2e9-abd9-4794-b990-bf71fa872d19 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] HTTP exception thrown: Instance 4040cba7-343d-4675-8c2a-a7b86506a2b1 could not be found. Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fd3bd2e9-abd9-4794-b990-bf71fa872d19 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Request method failure captured: Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1 HTTP/1.1 Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gV7mA-YMFAnKldeINQgvLPHsWGEsLjGMUv3-B_tN9Ugj2i5DM_RX_Ep1KaxrbWm2Z8GsdcNggENEnCgcmkkVtQS2Dy-vjfuBjPxxxa-2cT3j6wuhgPkDKW43EOn0zr7zrVFK5Xpu4YAhRd8TK-PW3z8gnBOwf36svmLpKa7gl0y4n0 Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}] Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ff63655143224ba9831e8dcb7a4d2e37 Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 4040cba7-343d-4675-8c2a-a7b86506a2b1 could not be found. Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '4040cba7-343d-4675-8c2a-a7b86506a2b1'} Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4040cba7-343d-4675-8c2a-a7b86506a2b1 could not be found. Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4040cba7-343d-4675-8c2a-a7b86506a2b1 could not be found. Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:04.115064 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:04.119486 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:04.119486 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:04.119486 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:04.119486 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:46:04.119486 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:46:04.119486 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4040cba7-343d-4675-8c2a-a7b86506a2b1 could not be found. Jul 28 03:46:04.119486 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:04.120953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fd3bd2e9-abd9-4794-b990-bf71fa872d19 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Returning 404 to user: Instance 4040cba7-343d-4675-8c2a-a7b86506a2b1 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:46:04.122326 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fd3bd2e9-abd9-4794-b990-bf71fa872d19 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1" status: 404 len: 111 microversion: 2.1 time: 0.105053 Jul 28 03:46:04.123491 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1028/2280] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:04 2022] GET /compute/v2.1/servers/4040cba7-343d-4675-8c2a-a7b86506a2b1 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:46:04.169755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d00458a0-c999-45fa-b362-5d4c09b4d362 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:04.173775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d00458a0-c999-45fa-b362-5d4c09b4d362 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 69ea9ea3-b1dc-400f-956f-e5e6c79f4677] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:04.183444 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51e50088-c0f6-4944-b921-379514e72390 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/cc0a1010-ed46-44ca-a6c5-c466a1f6274e" status: 202 len: 0 microversion: 2.1 time: 0.897288 Jul 28 03:46:04.188174 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1253/2281] 10.222.0.48 () {58 vars in 1287 bytes} [Thu Jul 28 03:46:03 2022] DELETE /compute/v2.1/os-security-group-rules/cc0a1010-ed46-44ca-a6c5-c466a1f6274e => generated 0 bytes in 902 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:04.194243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c75d4c62-d2f2-42b2-9859-b0a6f0c048e0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:04.194853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c75d4c62-d2f2-42b2-9859-b0a6f0c048e0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:04.205152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d00458a0-c999-45fa-b362-5d4c09b4d362 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:04.208003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d00458a0-c999-45fa-b362-5d4c09b4d362 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:04.212695 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d00458a0-c999-45fa-b362-5d4c09b4d362 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:04.216191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c75d4c62-d2f2-42b2-9859-b0a6f0c048e0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:04.216750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d00458a0-c999-45fa-b362-5d4c09b4d362 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:04.217523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c75d4c62-d2f2-42b2-9859-b0a6f0c048e0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:04.219110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c75d4c62-d2f2-42b2-9859-b0a6f0c048e0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:04.220960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c75d4c62-d2f2-42b2-9859-b0a6f0c048e0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:04.308718 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-d00458a0-c999-45fa-b362-5d4c09b4d362 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] HTTP exception thrown: Instance 69ea9ea3-b1dc-400f-956f-e5e6c79f4677 could not be found. Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d00458a0-c999-45fa-b362-5d4c09b4d362 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Request method failure captured: Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 HTTP/1.1 Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gV7mA-YMFAnKldeINQgvLPHsWGEsLjGMUv3-B_tN9Ugj2i5DM_RX_Ep1KaxrbWm2Z8GsdcNggENEnCgcmkkVtQS2Dy-vjfuBjPxxxa-2cT3j6wuhgPkDKW43EOn0zr7zrVFK5Xpu4YAhRd8TK-PW3z8gnBOwf36svmLpKa7gl0y4n0 Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}] Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ff63655143224ba9831e8dcb7a4d2e37 Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 69ea9ea3-b1dc-400f-956f-e5e6c79f4677 could not be found. Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '69ea9ea3-b1dc-400f-956f-e5e6c79f4677'} Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ea9ea3-b1dc-400f-956f-e5e6c79f4677 could not be found. Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ea9ea3-b1dc-400f-956f-e5e6c79f4677 could not be found. Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:04.316073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:04.319923 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:04.319923 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:04.319923 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:04.319923 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:46:04.319923 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:46:04.319923 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ea9ea3-b1dc-400f-956f-e5e6c79f4677 could not be found. Jul 28 03:46:04.319923 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:04.340180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d00458a0-c999-45fa-b362-5d4c09b4d362 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Returning 404 to user: Instance 69ea9ea3-b1dc-400f-956f-e5e6c79f4677 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:46:04.342619 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d00458a0-c999-45fa-b362-5d4c09b4d362 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677" status: 404 len: 111 microversion: 2.1 time: 0.213068 Jul 28 03:46:04.351100 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1029/2282] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:04 2022] GET /compute/v2.1/servers/69ea9ea3-b1dc-400f-956f-e5e6c79f4677 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:46:04.375955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4f793a23-c06b-4e93-84ff-a6b6ad37ca60 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Calling method '.version_select at 0x7ffa74917790>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:05.231412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c75d4c62-d2f2-42b2-9859-b0a6f0c048e0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:05.241967 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c75d4c62-d2f2-42b2-9859-b0a6f0c048e0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1509 microversion: 2.1 time: 1.052197 Jul 28 03:46:05.250534 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1254/2283] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:04 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1509 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:05.276674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-45c023d3-fb4b-47e8-a5e1-d389a7b59c40 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:05.338610 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4f793a23-c06b-4e93-84ff-a6b6ad37ca60 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/c9e20a14-b9f2-4b36-a665-b603a179068e" status: 202 len: 0 microversion: 2.1 time: 0.986159 Jul 28 03:46:05.339214 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1030/2284] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:46:04 2022] DELETE /compute/v2.1/os-security-groups/c9e20a14-b9f2-4b36-a665-b603a179068e => generated 0 bytes in 988 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:05.343963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-348dbcb8-4129-4a93-9117-9bb2bcef118d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74281700>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:05.372227 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-45c023d3-fb4b-47e8-a5e1-d389a7b59c40 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/39ae209d-de8d-4e95-a81a-8c3c6c9a5a14" status: 204 len: 0 microversion: 2.1 time: 0.104469 Jul 28 03:46:05.375424 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1255/2285] 10.222.0.48 () {58 vars in 1266 bytes} [Thu Jul 28 03:46:05 2022] DELETE /compute/v2.1/os-server-groups/39ae209d-de8d-4e95-a81a-8c3c6c9a5a14 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:46:05.389651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-45ff41c7-1fe6-4ea3-bd21-1fe4dcbc2062 req-6719b32e-f87c-462c-86d0-84c6d6ca49b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ea9ea3-b1dc-400f-956f-e5e6c79f4677", "name": "network-vif-deleted", "tag": "40a1c97c-8ac6-4d6f-838e-8a724b5ba92f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:05.417834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-45ff41c7-1fe6-4ea3-bd21-1fe4dcbc2062 req-6719b32e-f87c-462c-86d0-84c6d6ca49b3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:05.421358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-45ff41c7-1fe6-4ea3-bd21-1fe4dcbc2062 req-6719b32e-f87c-462c-86d0-84c6d6ca49b3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:05.445722 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-45ff41c7-1fe6-4ea3-bd21-1fe4dcbc2062 req-6719b32e-f87c-462c-86d0-84c6d6ca49b3 service nova] Creating event network-vif-deleted:40a1c97c-8ac6-4d6f-838e-8a724b5ba92f for instance 69ea9ea3-b1dc-400f-956f-e5e6c79f4677 on n-h1-826756-3 Jul 28 03:46:05.453771 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-45ff41c7-1fe6-4ea3-bd21-1fe4dcbc2062 req-6719b32e-f87c-462c-86d0-84c6d6ca49b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075812 Jul 28 03:46:05.455742 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1256/2286] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:05.462704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3a82a3f-4c77-4d27-b1ff-e2199194862c tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Calling method '.version_select at 0x7ffa79997af0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:05.991035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG neutronclient.v2_0.client [None req-b3a82a3f-4c77-4d27-b1ff-e2199194862c tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9786559b-8515-44f8-b723-369687b99a3e does not exist", "detail": ""}} {{(pid=126071) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:46:05.992173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.security_group_api [None req-b3a82a3f-4c77-4d27-b1ff-e2199194862c tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Neutron security group 9786559b-8515-44f8-b723-369687b99a3e not found {{(pid=126071) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 03:46:05.993099 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-b3a82a3f-4c77-4d27-b1ff-e2199194862c tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] HTTP exception thrown: Security group 9786559b-8515-44f8-b723-369687b99a3e does not exist Jul 28 03:46:05.993099 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-38af84c7-5a28-4bb2-ae99-c49e00eae0be'] Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3a82a3f-4c77-4d27-b1ff-e2199194862c tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Request method failure captured: Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/os-security-groups/9786559b-8515-44f8-b723-369687b99a3e HTTP/1.1 Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gZpkyn6voYSPVe75ntbBb6LBb7Sl57WU_qqnOSz5kE2PE5ftCj7c4OHtoWKhu_9vx_dl6A3wXrkC-haxg8CPKXe7ycVpMfSYW-XAx-UiYHYeI_ephdFDk4z5dMynIVkdPNQF0UfXcMcpmEQRVdHoAaBQoQoPJyqm2JKa8UE-Q-D87o Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: bf6e596cf9f2453aa21876dfca919c6c Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-821574230 Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bf6e596cf9f2453aa21876dfca919c6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6e596cf9f2453aa21876dfca919c6c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bf6e596cf9f2453aa21876dfca919c6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bf6e596cf9f2453aa21876dfca919c6c"}]}] Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupRulesTestJSON-821574230 Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: bf6e596cf9f2453aa21876dfca919c6c Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-821574230 Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupRulesTestJSON-821574230-project Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 4c5c38cece85479ebc80bd1d98d2c7b6 Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupRulesTestJSON-821574230-project Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: exception: Security group 9786559b-8515-44f8-b723-369687b99a3e does not exist Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-38af84c7-5a28-4bb2-ae99-c49e00eae0be'] Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9786559b-8515-44f8-b723-369687b99a3e'} Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:46:05.996452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9786559b-8515-44f8-b723-369687b99a3e does not exist Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38af84c7-5a28-4bb2-ae99-c49e00eae0be'] Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9786559b-8515-44f8-b723-369687b99a3e does not exist Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38af84c7-5a28-4bb2-ae99-c49e00eae0be'] Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9786559b-8515-44f8-b723-369687b99a3e does not exist Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38af84c7-5a28-4bb2-ae99-c49e00eae0be'] Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9786559b-8515-44f8-b723-369687b99a3e does not exist Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38af84c7-5a28-4bb2-ae99-c49e00eae0be'] Jul 28 03:46:06.000914 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:06.005075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3a82a3f-4c77-4d27-b1ff-e2199194862c tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Returning 404 to user: Security group 9786559b-8515-44f8-b723-369687b99a3e does not exist Jul 28 03:46:06.005075 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-38af84c7-5a28-4bb2-ae99-c49e00eae0be'] {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:46:06.006251 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3a82a3f-4c77-4d27-b1ff-e2199194862c tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/9786559b-8515-44f8-b723-369687b99a3e" status: 404 len: 194 microversion: 2.1 time: 0.549101 Jul 28 03:46:06.008153 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1257/2287] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:46:05 2022] DELETE /compute/v2.1/os-security-groups/9786559b-8515-44f8-b723-369687b99a3e => generated 194 bytes in 551 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:46:06.020213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f9c4bc07-f7e6-4b24-ae1d-e454542db166 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:06.021973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f9c4bc07-f7e6-4b24-ae1d-e454542db166 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:06.039424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9c4bc07-f7e6-4b24-ae1d-e454542db166 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:06.040204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9c4bc07-f7e6-4b24-ae1d-e454542db166 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:06.041209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9c4bc07-f7e6-4b24-ae1d-e454542db166 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:06.041838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9c4bc07-f7e6-4b24-ae1d-e454542db166 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:06.100233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f9c4bc07-f7e6-4b24-ae1d-e454542db166 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:46:06.268983 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f9c4bc07-f7e6-4b24-ae1d-e454542db166 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0" status: 204 len: 0 microversion: 2.1 time: 0.259219 Jul 28 03:46:06.270670 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1258/2288] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:46:06 2022] DELETE /compute/v2.1/servers/1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:46:06.277218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f9b8b243-240d-4ec6-95a8-cf033360d566 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Calling method '.version_select at 0x7ffa799970d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:06.698098 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=11 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:06.939081 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f9b8b243-240d-4ec6-95a8-cf033360d566 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/784f3596-12bc-437f-83c2-4109d22f7dc3" status: 202 len: 0 microversion: 2.1 time: 0.666968 Jul 28 03:46:06.940177 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1259/2289] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:46:06 2022] DELETE /compute/v2.1/os-security-groups/784f3596-12bc-437f-83c2-4109d22f7dc3 => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:06.945162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1aee5802-c8a8-49a4-9476-fab1763209e9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:06.946114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1aee5802-c8a8-49a4-9476-fab1763209e9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:06.963769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1aee5802-c8a8-49a4-9476-fab1763209e9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:06.968950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1aee5802-c8a8-49a4-9476-fab1763209e9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:06.973314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1aee5802-c8a8-49a4-9476-fab1763209e9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:06.974000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1aee5802-c8a8-49a4-9476-fab1763209e9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:07.085346 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=62 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:07.479611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1aee5802-c8a8-49a4-9476-fab1763209e9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:07.492047 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1aee5802-c8a8-49a4-9476-fab1763209e9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1509 microversion: 2.1 time: 0.547220 Jul 28 03:46:07.493035 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1260/2290] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:06 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1509 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:07.500191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-540a416e-69bf-4cc5-bfd3-c2296c3a4858 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:07.504210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-540a416e-69bf-4cc5-bfd3-c2296c3a4858 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:07.515545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-540a416e-69bf-4cc5-bfd3-c2296c3a4858 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:07.520273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-540a416e-69bf-4cc5-bfd3-c2296c3a4858 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:07.521472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-540a416e-69bf-4cc5-bfd3-c2296c3a4858 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:07.533161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-540a416e-69bf-4cc5-bfd3-c2296c3a4858 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:07.593301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-540a416e-69bf-4cc5-bfd3-c2296c3a4858 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:46:07.826005 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-540a416e-69bf-4cc5-bfd3-c2296c3a4858 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "DELETE /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 204 len: 0 microversion: 2.1 time: 0.331389 Jul 28 03:46:07.827755 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1261/2291] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:46:07 2022] DELETE /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:46:07.833991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6ab20fc7-75c3-435e-85e5-418f79fcaa1f tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Calling method '.version_select at 0x7ffa745e1a60>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:08.248969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:08.527577 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6ab20fc7-75c3-435e-85e5-418f79fcaa1f tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/af6ab0a1-e23f-445f-8dcb-ae05ce82e16a" status: 202 len: 0 microversion: 2.1 time: 0.697798 Jul 28 03:46:08.529321 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1262/2292] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:46:07 2022] DELETE /compute/v2.1/os-security-groups/af6ab0a1-e23f-445f-8dcb-ae05ce82e16a => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:08.779190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=44 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:09.010939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d4a3e49-a819-425c-a7b7-5a0834ec4841 tempest-SecurityGroupsTestAdminJSON-1855271459 tempest-SecurityGroupsTestAdminJSON-1855271459-project] Action: 'create', calling method: .version_select at 0x7ffa746548b0>, body: {"security_group": {"name": "tempest-securitygroup-247170529", "description": "tempest-description-1943241105"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:10.901027 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d4a3e49-a819-425c-a7b7-5a0834ec4841 tempest-SecurityGroupsTestAdminJSON-1855271459 tempest-SecurityGroupsTestAdminJSON-1855271459-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.369988 Jul 28 03:46:10.902179 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1263/2293] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:46:08 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:10.924971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2d40059-7be0-4fe8-b7e7-7924329e90e6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:10.939333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2d40059-7be0-4fe8-b7e7-7924329e90e6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:10.964397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2d40059-7be0-4fe8-b7e7-7924329e90e6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:10.965216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2d40059-7be0-4fe8-b7e7-7924329e90e6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:10.966215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2d40059-7be0-4fe8-b7e7-7924329e90e6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:10.968550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2d40059-7be0-4fe8-b7e7-7924329e90e6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:11.165791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b2d40059-7be0-4fe8-b7e7-7924329e90e6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:11.175033 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b2d40059-7be0-4fe8-b7e7-7924329e90e6 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0" status: 200 len: 1433 microversion: 2.1 time: 0.271339 Jul 28 03:46:11.179300 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1264/2294] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:10 2022] GET /compute/v2.1/servers/1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 => generated 1433 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:11.187645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5aff31d9-487c-4716-ade6-cddc69f672e5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:11.190751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5aff31d9-487c-4716-ade6-cddc69f672e5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:11.234859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5aff31d9-487c-4716-ade6-cddc69f672e5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:11.235318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5aff31d9-487c-4716-ade6-cddc69f672e5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:11.236115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5aff31d9-487c-4716-ade6-cddc69f672e5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:11.236587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5aff31d9-487c-4716-ade6-cddc69f672e5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:12.061674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5aff31d9-487c-4716-ade6-cddc69f672e5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:12.084829 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5aff31d9-487c-4716-ade6-cddc69f672e5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1509 microversion: 2.1 time: 0.891800 Jul 28 03:46:12.091242 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1265/2295] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:11 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1509 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:12.117547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-656c4dd1-feaa-445e-9d4a-b5d2cd1fa404 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Calling method '.version_select at 0x7ffa79981f70>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:13.433349 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-656c4dd1-feaa-445e-9d4a-b5d2cd1fa404 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/046e001a-1cf5-47bb-8d2c-627f52e0831a" status: 202 len: 0 microversion: 2.1 time: 1.340914 Jul 28 03:46:13.435033 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1266/2296] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:46:12 2022] DELETE /compute/v2.1/os-security-groups/046e001a-1cf5-47bb-8d2c-627f52e0831a => generated 0 bytes in 1343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:13.447341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b99f4594-795f-491c-919f-0f9dc85cb159 req-248196ce-9ac3-409c-bdaa-b0faaf4b0a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a40da4-0f01-4368-835f-9c3b550eb137", "name": "network-vif-plugged", "status": "completed", "tag": "efeda983-f05c-4f23-9d79-30d55c7ec8d7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:13.500861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b99f4594-795f-491c-919f-0f9dc85cb159 req-248196ce-9ac3-409c-bdaa-b0faaf4b0a1a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:13.527010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b99f4594-795f-491c-919f-0f9dc85cb159 req-248196ce-9ac3-409c-bdaa-b0faaf4b0a1a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:13.563037 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b99f4594-795f-491c-919f-0f9dc85cb159 req-248196ce-9ac3-409c-bdaa-b0faaf4b0a1a service nova] Creating event network-vif-plugged:efeda983-f05c-4f23-9d79-30d55c7ec8d7 for instance 58a40da4-0f01-4368-835f-9c3b550eb137 on n-h1-826756-3 Jul 28 03:46:13.584145 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b99f4594-795f-491c-919f-0f9dc85cb159 req-248196ce-9ac3-409c-bdaa-b0faaf4b0a1a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139386 Jul 28 03:46:13.585319 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1267/2297] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:13.616980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bfaf4dc2-ed74-4b5e-ad73-bd9553c5b899 tempest-SecurityGroupsTestAdminJSON-1855271459 tempest-SecurityGroupsTestAdminJSON-1855271459-project] Action: 'create', calling method: .version_select at 0x7ffa742a9d30>, body: {"security_group": {"name": "tempest-securitygroup-1875141161", "description": "tempest-description-75818589"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:14.194473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=14,nova_api:UPDATE=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:14.248102 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:15.253437 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bfaf4dc2-ed74-4b5e-ad73-bd9553c5b899 tempest-SecurityGroupsTestAdminJSON-1855271459 tempest-SecurityGroupsTestAdminJSON-1855271459-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.664008 Jul 28 03:46:15.254835 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1268/2298] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:46:13 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:15.272454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-2b3b9f07-cb05-4610-8832-13f9cbd422c0 req-c79d0bd3-5eff-4b81-83bd-4fa1871d5d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0", "name": "network-vif-deleted", "tag": "94dab48c-bae2-4bbb-8b55-c38e13a00d51"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:15.294036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2b3b9f07-cb05-4610-8832-13f9cbd422c0 req-c79d0bd3-5eff-4b81-83bd-4fa1871d5d83 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:15.294910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2b3b9f07-cb05-4610-8832-13f9cbd422c0 req-c79d0bd3-5eff-4b81-83bd-4fa1871d5d83 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:15.310159 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-2b3b9f07-cb05-4610-8832-13f9cbd422c0 req-c79d0bd3-5eff-4b81-83bd-4fa1871d5d83 service nova] Creating event network-vif-deleted:94dab48c-bae2-4bbb-8b55-c38e13a00d51 for instance 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 on n-h1-826756-3 Jul 28 03:46:15.326964 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-2b3b9f07-cb05-4610-8832-13f9cbd422c0 req-c79d0bd3-5eff-4b81-83bd-4fa1871d5d83 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070604 Jul 28 03:46:15.327880 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1269/2299] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:15.334779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59009f32-77f0-4d00-8959-445586184d2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:15.336332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59009f32-77f0-4d00-8959-445586184d2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:15.343149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59009f32-77f0-4d00-8959-445586184d2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:15.345035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59009f32-77f0-4d00-8959-445586184d2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:15.346149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59009f32-77f0-4d00-8959-445586184d2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:15.346735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59009f32-77f0-4d00-8959-445586184d2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:15.363820 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-59009f32-77f0-4d00-8959-445586184d2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] HTTP exception thrown: Instance 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 could not be found. Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59009f32-77f0-4d00-8959-445586184d2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Request method failure captured: Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 HTTP/1.1 Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gV7mA-YMFAnKldeINQgvLPHsWGEsLjGMUv3-B_tN9Ugj2i5DM_RX_Ep1KaxrbWm2Z8GsdcNggENEnCgcmkkVtQS2Dy-vjfuBjPxxxa-2cT3j6wuhgPkDKW43EOn0zr7zrVFK5Xpu4YAhRd8TK-PW3z8gnBOwf36svmLpKa7gl0y4n0 Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}] Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ff63655143224ba9831e8dcb7a4d2e37 Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 could not be found. Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0'} Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 could not be found. Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 could not be found. Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:15.365992 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:15.369979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:15.369979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:15.369979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:15.369979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:46:15.369979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:46:15.369979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 could not be found. Jul 28 03:46:15.369979 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:15.369979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59009f32-77f0-4d00-8959-445586184d2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Returning 404 to user: Instance 1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:46:15.371693 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59009f32-77f0-4d00-8959-445586184d2b tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0" status: 404 len: 111 microversion: 2.1 time: 0.039919 Jul 28 03:46:15.372675 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1270/2300] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:15 2022] GET /compute/v2.1/servers/1c51b86b-2331-4a0d-8b20-6ddb4e7ad4b0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:46:15.381364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e389771f-a2d8-497f-b316-ea467c3a93be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:15.381989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e389771f-a2d8-497f-b316-ea467c3a93be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:15.396230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e389771f-a2d8-497f-b316-ea467c3a93be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:15.397289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e389771f-a2d8-497f-b316-ea467c3a93be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:15.398483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e389771f-a2d8-497f-b316-ea467c3a93be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:15.399067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e389771f-a2d8-497f-b316-ea467c3a93be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:15.692878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e389771f-a2d8-497f-b316-ea467c3a93be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:15.727938 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e389771f-a2d8-497f-b316-ea467c3a93be tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1509 microversion: 2.1 time: 0.354047 Jul 28 03:46:15.739028 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1271/2301] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:15 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1509 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:15.773980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e3a41d0-1c66-411e-afc4-f51a75dc7262 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Calling method '.version_select at 0x7ffa799f0310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:16.182723 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e3a41d0-1c66-411e-afc4-f51a75dc7262 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/a0cbd7d1-3f7d-4298-ad79-a8f453e38d75" status: 202 len: 0 microversion: 2.1 time: 0.441600 Jul 28 03:46:16.186655 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1272/2302] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:46:15 2022] DELETE /compute/v2.1/os-security-groups/a0cbd7d1-3f7d-4298-ad79-a8f453e38d75 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:16.509130 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-348dbcb8-4129-4a93-9117-9bb2bcef118d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef" status: 200 len: 1455 microversion: 2.1 time: 11.168788 Jul 28 03:46:16.512457 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1031/2303] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:05 2022] GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef => generated 1455 bytes in 11172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:16.739787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a7e46d21-dcb6-4348-84e3-38c04d0784ab tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Action: 'create', calling method: .version_select at 0x7ffa67aba0d0>, body: {"keypair": {"name": "tempest-keypair-864694195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOekBlLH0daRgUkG5EYK3ILBLadAqyzWH8zD/jpnaFGBVURqcoLc7tFQpEwoCl0Qik6kkNMnwol7WFjQPhPD1Su8/3lqsWHeLs4Z5bpwrc2cnYskZszNT/ssfinRpwtyw=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:16.809508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-a7e46d21-dcb6-4348-84e3-38c04d0784ab tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Getting quotas for project 26210555ced44d06a160aa424cd9fca3. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:16.826290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-a7e46d21-dcb6-4348-84e3-38c04d0784ab tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Getting quotas for user 4e69403b3e7b4dbfb0111dc335f67ddc and project 26210555ced44d06a160aa424cd9fca3. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:16.919178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ad7d7960-20e8-4cc5-897d-aa009e5d3e01 tempest-SecurityGroupsTestAdminJSON-952897593 tempest-SecurityGroupsTestAdminJSON-952897593-project-admin] Action: 'create', calling method: .version_select at 0x7ffa74917f70>, body: {"security_group": {"name": "tempest-securitygroup-1911566275", "description": "tempest-description-1965104203"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:16.926251 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a7e46d21-dcb6-4348-84e3-38c04d0784ab tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.738271 Jul 28 03:46:16.934623 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1273/2304] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:46:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:16.964775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5412826e-49d3-4474-8dcd-5a7634dd2e70 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:16.966157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5412826e-49d3-4474-8dcd-5a7634dd2e70 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 14f3d5f3-4a8e-459b-b2cd-a65147c3d008] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:16.996670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5412826e-49d3-4474-8dcd-5a7634dd2e70 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:16.998474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5412826e-49d3-4474-8dcd-5a7634dd2e70 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:17.000904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5412826e-49d3-4474-8dcd-5a7634dd2e70 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:17.005098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5412826e-49d3-4474-8dcd-5a7634dd2e70 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:17.069580 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-5412826e-49d3-4474-8dcd-5a7634dd2e70 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] HTTP exception thrown: Instance 14f3d5f3-4a8e-459b-b2cd-a65147c3d008 could not be found. Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5412826e-49d3-4474-8dcd-5a7634dd2e70 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Request method failure captured: Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 HTTP/1.1 Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gV7mA-YMFAnKldeINQgvLPHsWGEsLjGMUv3-B_tN9Ugj2i5DM_RX_Ep1KaxrbWm2Z8GsdcNggENEnCgcmkkVtQS2Dy-vjfuBjPxxxa-2cT3j6wuhgPkDKW43EOn0zr7zrVFK5Xpu4YAhRd8TK-PW3z8gnBOwf36svmLpKa7gl0y4n0 Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}] Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ff63655143224ba9831e8dcb7a4d2e37 Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 14f3d5f3-4a8e-459b-b2cd-a65147c3d008 could not be found. Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '14f3d5f3-4a8e-459b-b2cd-a65147c3d008'} Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f3d5f3-4a8e-459b-b2cd-a65147c3d008 could not be found. Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f3d5f3-4a8e-459b-b2cd-a65147c3d008 could not be found. Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:17.086663 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:17.090388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:17.090388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:17.090388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:17.090388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:46:17.090388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:46:17.090388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f3d5f3-4a8e-459b-b2cd-a65147c3d008 could not be found. Jul 28 03:46:17.090388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:17.095085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5412826e-49d3-4474-8dcd-5a7634dd2e70 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Returning 404 to user: Instance 14f3d5f3-4a8e-459b-b2cd-a65147c3d008 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:46:17.103372 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5412826e-49d3-4474-8dcd-5a7634dd2e70 tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008" status: 404 len: 111 microversion: 2.1 time: 0.166482 Jul 28 03:46:17.107064 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1274/2305] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:16 2022] GET /compute/v2.1/servers/14f3d5f3-4a8e-459b-b2cd-a65147c3d008 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:46:17.128243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-99cbd4e1-9360-403e-953b-a0e3589512e5 req-6b4bace6-29ba-4b21-bbe4-709ad01033ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f3d5f3-4a8e-459b-b2cd-a65147c3d008", "name": "network-vif-unplugged", "status": "completed", "tag": "fff12169-c69f-4e4a-a346-95ce764235e8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:17.204292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-99cbd4e1-9360-403e-953b-a0e3589512e5 req-6b4bace6-29ba-4b21-bbe4-709ad01033ec service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:17.205405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-99cbd4e1-9360-403e-953b-a0e3589512e5 req-6b4bace6-29ba-4b21-bbe4-709ad01033ec service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:17.248599 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-99cbd4e1-9360-403e-953b-a0e3589512e5 req-6b4bace6-29ba-4b21-bbe4-709ad01033ec service nova] Creating event network-vif-unplugged:fff12169-c69f-4e4a-a346-95ce764235e8 for instance 14f3d5f3-4a8e-459b-b2cd-a65147c3d008 on n-h1-826756-3 Jul 28 03:46:17.264978 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-99cbd4e1-9360-403e-953b-a0e3589512e5 req-6b4bace6-29ba-4b21-bbe4-709ad01033ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156140 Jul 28 03:46:17.271519 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1275/2306] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:17.278855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-887733be-45e6-46d2-9ad2-bfad66230d69 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] Calling method '.version_select at 0x7ffa74895e50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:17.802477 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ad7d7960-20e8-4cc5-897d-aa009e5d3e01 tempest-SecurityGroupsTestAdminJSON-952897593 tempest-SecurityGroupsTestAdminJSON-952897593-project-admin] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.288163 Jul 28 03:46:17.806262 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1032/2307] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:46:16 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:17.832244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-03949ccd-890a-4710-a96e-88ada0b197ea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:17.838099 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-03949ccd-890a-4710-a96e-88ada0b197ea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:17.866894 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03949ccd-890a-4710-a96e-88ada0b197ea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:17.869353 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03949ccd-890a-4710-a96e-88ada0b197ea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:17.871132 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03949ccd-890a-4710-a96e-88ada0b197ea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:17.873202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03949ccd-890a-4710-a96e-88ada0b197ea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:18.268177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-03949ccd-890a-4710-a96e-88ada0b197ea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:18.284719 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-03949ccd-890a-4710-a96e-88ada0b197ea tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1506 microversion: 2.1 time: 0.476384 Jul 28 03:46:18.290636 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1033/2308] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:17 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1506 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:18.301433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-65881f92-f2ef-4fc3-93f1-ce9d266e9ede tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:18.318661 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-887733be-45e6-46d2-9ad2-bfad66230d69 tempest-SecurityGroupRulesTestJSON-821574230 tempest-SecurityGroupRulesTestJSON-821574230-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/8675e27d-71a3-4956-9af5-f44dd0d563fb" status: 202 len: 0 microversion: 2.1 time: 1.044826 Jul 28 03:46:18.320651 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1276/2309] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:46:17 2022] DELETE /compute/v2.1/os-security-groups/8675e27d-71a3-4956-9af5-f44dd0d563fb => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:18.327228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-07151f0a-9c5d-40c8-8142-fdf48426ed82 req-b05062d8-be74-4dcd-ab16-a32595c02bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f3d5f3-4a8e-459b-b2cd-a65147c3d008", "name": "network-vif-deleted", "tag": "fff12169-c69f-4e4a-a346-95ce764235e8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:18.376849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-07151f0a-9c5d-40c8-8142-fdf48426ed82 req-b05062d8-be74-4dcd-ab16-a32595c02bdc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:18.378715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-07151f0a-9c5d-40c8-8142-fdf48426ed82 req-b05062d8-be74-4dcd-ab16-a32595c02bdc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:18.413969 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-07151f0a-9c5d-40c8-8142-fdf48426ed82 req-b05062d8-be74-4dcd-ab16-a32595c02bdc service nova] Creating event network-vif-deleted:fff12169-c69f-4e4a-a346-95ce764235e8 for instance 14f3d5f3-4a8e-459b-b2cd-a65147c3d008 on n-h1-826756-3 Jul 28 03:46:18.423643 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-07151f0a-9c5d-40c8-8142-fdf48426ed82 req-b05062d8-be74-4dcd-ab16-a32595c02bdc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101394 Jul 28 03:46:18.429559 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-65881f92-f2ef-4fc3-93f1-ce9d266e9ede tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/b897bf6d-9c40-4ae5-a228-6d95f0eb5f2b" status: 204 len: 0 microversion: 2.1 time: 0.133781 Jul 28 03:46:18.430456 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1034/2310] 10.222.0.48 () {58 vars in 1266 bytes} [Thu Jul 28 03:46:18 2022] DELETE /compute/v2.1/os-server-groups/b897bf6d-9c40-4ae5-a228-6d95f0eb5f2b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:46:18.432671 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1277/2311] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:18.442842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-956edef5-bca3-446d-b6a8-b4036c78b4b9 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa745b0040>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:18.447401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-28d33218-c44b-49ea-a1a4-788f47eb4584 tempest-SecurityGroupsTestAdminJSON-952897593 tempest-SecurityGroupsTestAdminJSON-952897593-project-admin] Action: 'create', calling method: .version_select at 0x7ffa74616940>, body: {"security_group": {"name": "tempest-securitygroup-1498823507", "description": "tempest-description-1419570708"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:18.539806 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-956edef5-bca3-446d-b6a8-b4036c78b4b9 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef" status: 200 len: 1455 microversion: 2.1 time: 0.107962 Jul 28 03:46:18.548570 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1035/2312] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:18 2022] GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:18.556659 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c1995b6d-8b10-47b7-b1be-fbd974a0abdd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:18.564328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c1995b6d-8b10-47b7-b1be-fbd974a0abdd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:18.581383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c1995b6d-8b10-47b7-b1be-fbd974a0abdd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:18.582239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c1995b6d-8b10-47b7-b1be-fbd974a0abdd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:18.583320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c1995b6d-8b10-47b7-b1be-fbd974a0abdd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:18.584016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c1995b6d-8b10-47b7-b1be-fbd974a0abdd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:18.645274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c1995b6d-8b10-47b7-b1be-fbd974a0abdd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:46:18.867196 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c1995b6d-8b10-47b7-b1be-fbd974a0abdd tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "DELETE /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 204 len: 0 microversion: 2.1 time: 0.315803 Jul 28 03:46:18.870283 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1036/2313] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:46:18 2022] DELETE /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:46:18.882749 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bc12b2eb-4ea6-4d41-b641-27610e7dab4c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:18.911451 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bc12b2eb-4ea6-4d41-b641-27610e7dab4c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:18.926243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc12b2eb-4ea6-4d41-b641-27610e7dab4c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:18.931979 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc12b2eb-4ea6-4d41-b641-27610e7dab4c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:18.933795 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc12b2eb-4ea6-4d41-b641-27610e7dab4c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:18.935383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc12b2eb-4ea6-4d41-b641-27610e7dab4c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:19.256257 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-28d33218-c44b-49ea-a1a4-788f47eb4584 tempest-SecurityGroupsTestAdminJSON-952897593 tempest-SecurityGroupsTestAdminJSON-952897593-project-admin] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.821656 Jul 28 03:46:19.257707 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1278/2314] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:46:18 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:19.274104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2e03b354-c4d4-487d-8a88-cee058e4c43b tempest-SecurityGroupsTestAdminJSON-952897593 tempest-SecurityGroupsTestAdminJSON-952897593-project-admin] Calling method '.version_select at 0x7ffa67abaa60>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:19.301796 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bc12b2eb-4ea6-4d41-b641-27610e7dab4c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:19.313423 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bc12b2eb-4ea6-4d41-b641-27610e7dab4c tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1472 microversion: 2.1 time: 0.437621 Jul 28 03:46:19.327874 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1037/2315] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:18 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1472 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:19.333326 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f581f868-71d5-4e64-a6b9-7cafabdcfa07 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:19.347433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f581f868-71d5-4e64-a6b9-7cafabdcfa07 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:19.358612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f581f868-71d5-4e64-a6b9-7cafabdcfa07 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:19.359323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f581f868-71d5-4e64-a6b9-7cafabdcfa07 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:19.360384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f581f868-71d5-4e64-a6b9-7cafabdcfa07 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:19.361111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f581f868-71d5-4e64-a6b9-7cafabdcfa07 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:19.746821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f581f868-71d5-4e64-a6b9-7cafabdcfa07 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:19.770972 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f581f868-71d5-4e64-a6b9-7cafabdcfa07 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1506 microversion: 2.1 time: 0.441458 Jul 28 03:46:19.771664 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1038/2316] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:19 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:19.776181 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b2dc6fca-0810-4460-83ee-90b23044f4b6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74657310>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:19.864417 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b2dc6fca-0810-4460-83ee-90b23044f4b6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef" status: 200 len: 1455 microversion: 2.1 time: 0.091781 Jul 28 03:46:19.870597 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1039/2317] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:19 2022] GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:20.268811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1867685772", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:20.376938 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:46:20.824334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:46:20.825180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:46:20.825868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:46:20.826430 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:46:20.826930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:46:20.851298 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:20.852168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:20.853350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:20.853999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:20.875994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Getting quotas for project da4a22e4560a4210bb58942cec62c091. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:20.888748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Getting quotas for user ac9d734be6ee4b549f9ed389c276f54a and project da4a22e4560a4210bb58942cec62c091. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:20.917485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:46:20.920370 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:46:20.995400 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-69772b48-f608-4d3e-8a48-5ee35fdff502 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989630 Jul 28 03:46:20.997264 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1040/2318] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:46:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:46:21.009426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-4a303025-c5a5-4f59-870c-a7d0d12778ca req-19479387-d85b-4484-a53d-f30470003588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35fa1b51-1663-49af-b9e3-2aca487ece39", "name": "network-vif-unplugged", "status": "completed", "tag": "b22bdd6c-d4ca-481d-b617-ff52448c390d"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:21.025891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4a303025-c5a5-4f59-870c-a7d0d12778ca req-19479387-d85b-4484-a53d-f30470003588 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:21.026759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4a303025-c5a5-4f59-870c-a7d0d12778ca req-19479387-d85b-4484-a53d-f30470003588 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:21.043520 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-4a303025-c5a5-4f59-870c-a7d0d12778ca req-19479387-d85b-4484-a53d-f30470003588 service nova] Creating event network-vif-unplugged:b22bdd6c-d4ca-481d-b617-ff52448c390d for instance 35fa1b51-1663-49af-b9e3-2aca487ece39 on n-h1-826756-3 Jul 28 03:46:21.058311 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-4a303025-c5a5-4f59-870c-a7d0d12778ca req-19479387-d85b-4484-a53d-f30470003588 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058577 Jul 28 03:46:21.060103 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1041/2319] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:21.097851 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0fa5608d-b6d4-4736-a5f5-ce567b853b6e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:21.101502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0fa5608d-b6d4-4736-a5f5-ce567b853b6e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:21.135445 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fa5608d-b6d4-4736-a5f5-ce567b853b6e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:21.136178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fa5608d-b6d4-4736-a5f5-ce567b853b6e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:21.137205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fa5608d-b6d4-4736-a5f5-ce567b853b6e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:21.137833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fa5608d-b6d4-4736-a5f5-ce567b853b6e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:21.451819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0fa5608d-b6d4-4736-a5f5-ce567b853b6e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff63655143224ba9831e8dcb7a4d2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6979063538ee4bf08537b46bfb6e4249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:21.461470 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0fa5608d-b6d4-4736-a5f5-ce567b853b6e tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 200 len: 1472 microversion: 2.1 time: 0.399224 Jul 28 03:46:21.462343 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1042/2320] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:21 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 1472 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:21.467422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b0ce2c54-a282-46be-a6a5-e6a9636b2546 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:21.468309 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b0ce2c54-a282-46be-a6a5-e6a9636b2546 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:21.475522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0ce2c54-a282-46be-a6a5-e6a9636b2546 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:21.476289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0ce2c54-a282-46be-a6a5-e6a9636b2546 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:21.477567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0ce2c54-a282-46be-a6a5-e6a9636b2546 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:21.478090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0ce2c54-a282-46be-a6a5-e6a9636b2546 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:21.731487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b0ce2c54-a282-46be-a6a5-e6a9636b2546 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:21.745198 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b0ce2c54-a282-46be-a6a5-e6a9636b2546 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1506 microversion: 2.1 time: 0.276487 Jul 28 03:46:21.760852 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1043/2321] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:21 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:21.766183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aa5db470-6566-4183-8fe7-55b5bcec291c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa749cbdc0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:21.849716 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aa5db470-6566-4183-8fe7-55b5bcec291c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef" status: 200 len: 1455 microversion: 2.1 time: 0.087375 Jul 28 03:46:21.850514 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1044/2322] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:21 2022] GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:21.856050 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c6cd87f5-310d-4c9f-ae0e-451cafce75b0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:21.857199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c6cd87f5-310d-4c9f-ae0e-451cafce75b0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:21.865646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6cd87f5-310d-4c9f-ae0e-451cafce75b0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:21.866342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6cd87f5-310d-4c9f-ae0e-451cafce75b0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:21.867334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6cd87f5-310d-4c9f-ae0e-451cafce75b0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:21.867821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6cd87f5-310d-4c9f-ae0e-451cafce75b0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:21.954490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c6cd87f5-310d-4c9f-ae0e-451cafce75b0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:21.965787 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c6cd87f5-310d-4c9f-ae0e-451cafce75b0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1217 microversion: 2.1 time: 0.113814 Jul 28 03:46:21.967046 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1045/2323] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:21 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:21.985821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1476811414", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "7285cafe-dd89-49a5-8167-007f36b1e607"}], "security_groups": [{"name": "tempest-securitygroup--467878622"}], "key_name": "tempest-keypair-864694195", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:22.178617 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] validate_networks() for [('7285cafe-dd89-49a5-8167-007f36b1e607', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:46:24.285972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Getting quotas for project 26210555ced44d06a160aa424cd9fca3. Resources: dict_keys(['metadata_items']) {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:24.301090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Getting quotas for user 4e69403b3e7b4dbfb0111dc335f67ddc and project 26210555ced44d06a160aa424cd9fca3. Resources: dict_keys(['metadata_items']) {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:24.323038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:46:24.323989 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:46:24.331306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:46:24.332676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:46:24.333339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:46:24.347256 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:24.348049 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:24.349178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:24.349965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:24.383162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Getting quotas for project 26210555ced44d06a160aa424cd9fca3. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:24.400539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Getting quotas for user 4e69403b3e7b4dbfb0111dc335f67ddc and project 26210555ced44d06a160aa424cd9fca3. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:24.424445 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2e03b354-c4d4-487d-8a88-cee058e4c43b tempest-SecurityGroupsTestAdminJSON-952897593 tempest-SecurityGroupsTestAdminJSON-952897593-project-admin] 10.222.0.48 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11611 microversion: 2.1 time: 5.158234 Jul 28 03:46:24.426849 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1279/2324] 10.222.0.48 () {58 vars in 1191 bytes} [Thu Jul 28 03:46:19 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11611 bytes in 5161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:46:24.434391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1cb3bf73-4414-4058-a9d4-7cb30ec147bc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:24.435869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1cb3bf73-4414-4058-a9d4-7cb30ec147bc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] [instance: 928e7a74-9453-46fe-a1dd-ebc281e8ea52] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:24.454537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:46:24.464426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:46:24.464873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cb3bf73-4414-4058-a9d4-7cb30ec147bc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:24.466824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cb3bf73-4414-4058-a9d4-7cb30ec147bc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:24.471397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cb3bf73-4414-4058-a9d4-7cb30ec147bc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:24.474610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cb3bf73-4414-4058-a9d4-7cb30ec147bc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:24.509790 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-1cb3bf73-4414-4058-a9d4-7cb30ec147bc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] HTTP exception thrown: Instance 928e7a74-9453-46fe-a1dd-ebc281e8ea52 could not be found. Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1cb3bf73-4414-4058-a9d4-7cb30ec147bc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Request method failure captured: Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 HTTP/1.1 Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gV7mA-YMFAnKldeINQgvLPHsWGEsLjGMUv3-B_tN9Ugj2i5DM_RX_Ep1KaxrbWm2Z8GsdcNggENEnCgcmkkVtQS2Dy-vjfuBjPxxxa-2cT3j6wuhgPkDKW43EOn0zr7zrVFK5Xpu4YAhRd8TK-PW3z8gnBOwf36svmLpKa7gl0y4n0 Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6979063538ee4bf08537b46bfb6e4249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6979063538ee4bf08537b46bfb6e4249"}]}] Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 6979063538ee4bf08537b46bfb6e4249 Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1219189706 Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ff63655143224ba9831e8dcb7a4d2e37 Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersOnMultiNodesTest-1219189706-project Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 928e7a74-9453-46fe-a1dd-ebc281e8ea52 could not be found. Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '928e7a74-9453-46fe-a1dd-ebc281e8ea52'} Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 928e7a74-9453-46fe-a1dd-ebc281e8ea52 could not be found. Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 928e7a74-9453-46fe-a1dd-ebc281e8ea52 could not be found. Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:24.513314 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:24.517202 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:24.517202 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:24.517202 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:24.517202 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:46:24.517202 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:46:24.517202 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 928e7a74-9453-46fe-a1dd-ebc281e8ea52 could not be found. Jul 28 03:46:24.517202 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:46:24.525690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1cb3bf73-4414-4058-a9d4-7cb30ec147bc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] Returning 404 to user: Instance 928e7a74-9453-46fe-a1dd-ebc281e8ea52 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:46:24.536721 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1cb3bf73-4414-4058-a9d4-7cb30ec147bc tempest-ServersOnMultiNodesTest-1219189706 tempest-ServersOnMultiNodesTest-1219189706-project] 10.222.0.48 "GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52" status: 404 len: 111 microversion: 2.1 time: 0.101120 Jul 28 03:46:24.540127 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1280/2325] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:24 2022] GET /compute/v2.1/servers/928e7a74-9453-46fe-a1dd-ebc281e8ea52 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:46:24.571053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-21d14816-ce3b-4e69-b5ae-7503fb322c35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:24.571430 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-353adb70-8f4a-4dda-a9d0-36eb33d722c1 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.602952 Jul 28 03:46:24.572077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-21d14816-ce3b-4e69-b5ae-7503fb322c35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:24.572759 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1046/2326] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:46:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 2605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:46:24.581108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0bb995d4-1552-4f16-84ca-6aa079b76bb9 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74657dc0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:24.586852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21d14816-ce3b-4e69-b5ae-7503fb322c35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:24.587312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21d14816-ce3b-4e69-b5ae-7503fb322c35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:24.588100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21d14816-ce3b-4e69-b5ae-7503fb322c35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:24.588564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21d14816-ce3b-4e69-b5ae-7503fb322c35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:24.699540 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0bb995d4-1552-4f16-84ca-6aa079b76bb9 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef" status: 200 len: 1455 microversion: 2.1 time: 0.125393 Jul 28 03:46:24.707516 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1047/2327] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:24 2022] GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:24.724245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-908fad10-1665-47b4-ac28-f60d6cc40eef tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:24.725052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-908fad10-1665-47b4-ac28-f60d6cc40eef tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:24.750405 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-908fad10-1665-47b4-ac28-f60d6cc40eef tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:24.751478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-908fad10-1665-47b4-ac28-f60d6cc40eef tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:24.752686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-908fad10-1665-47b4-ac28-f60d6cc40eef tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:24.753331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-908fad10-1665-47b4-ac28-f60d6cc40eef tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:24.963790 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-908fad10-1665-47b4-ac28-f60d6cc40eef tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:24.980712 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-908fad10-1665-47b4-ac28-f60d6cc40eef tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1271 microversion: 2.1 time: 0.272387 Jul 28 03:46:24.982990 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1048/2328] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:24 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1271 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:25.015191 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-a6b287a0-9b6f-4eda-ae88-0939fd1dde83 req-6928eaff-0177-47c2-9518-1bc96706f4a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928e7a74-9453-46fe-a1dd-ebc281e8ea52", "name": "network-vif-deleted", "tag": "d259e9d8-82aa-4835-8762-c43089b17976"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:25.053838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a6b287a0-9b6f-4eda-ae88-0939fd1dde83 req-6928eaff-0177-47c2-9518-1bc96706f4a9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:25.054062 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a6b287a0-9b6f-4eda-ae88-0939fd1dde83 req-6928eaff-0177-47c2-9518-1bc96706f4a9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:25.064317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-21d14816-ce3b-4e69-b5ae-7503fb322c35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:25.087105 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-21d14816-ce3b-4e69-b5ae-7503fb322c35 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 200 len: 1449 microversion: 2.1 time: 0.537659 Jul 28 03:46:25.103279 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1281/2329] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:24 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 1449 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:25.115036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-132e1fd1-0ad5-4bc5-a208-39f519159fe1 tempest-SecurityGroupsTestAdminJSON-1855271459 tempest-SecurityGroupsTestAdminJSON-1855271459-project] Calling method '.version_select at 0x7ffa67abad30>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:25.122338 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-a6b287a0-9b6f-4eda-ae88-0939fd1dde83 req-6928eaff-0177-47c2-9518-1bc96706f4a9 service nova] Creating event network-vif-deleted:d259e9d8-82aa-4835-8762-c43089b17976 for instance 928e7a74-9453-46fe-a1dd-ebc281e8ea52 on n-h1-826756-3 Jul 28 03:46:25.137387 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-a6b287a0-9b6f-4eda-ae88-0939fd1dde83 req-6928eaff-0177-47c2-9518-1bc96706f4a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137498 Jul 28 03:46:25.141044 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1049/2330] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:25.155477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cb9513de-92d0-4250-b0e2-062c41c096c0 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:25.156785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cb9513de-92d0-4250-b0e2-062c41c096c0 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:25.321515 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cb9513de-92d0-4250-b0e2-062c41c096c0 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:25.334778 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cb9513de-92d0-4250-b0e2-062c41c096c0 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1277 microversion: 2.1 time: 0.187575 Jul 28 03:46:25.335326 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1050/2331] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:25 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:25.344330 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a72ad772-957d-4f7a-a4b7-7ade0cfe7a43 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:25.345772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a72ad772-957d-4f7a-a4b7-7ade0cfe7a43 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:25.355768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a72ad772-957d-4f7a-a4b7-7ade0cfe7a43 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:25.356661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a72ad772-957d-4f7a-a4b7-7ade0cfe7a43 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:25.357737 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a72ad772-957d-4f7a-a4b7-7ade0cfe7a43 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:25.358471 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a72ad772-957d-4f7a-a4b7-7ade0cfe7a43 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:25.775274 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-132e1fd1-0ad5-4bc5-a208-39f519159fe1 tempest-SecurityGroupsTestAdminJSON-1855271459 tempest-SecurityGroupsTestAdminJSON-1855271459-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.670499 Jul 28 03:46:25.775879 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1282/2332] 10.222.0.48 () {58 vars in 1191 bytes} [Thu Jul 28 03:46:25 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:25.781579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d850692-6e24-4995-ac9e-101bb0573bf3 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74249700>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:25.880262 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d850692-6e24-4995-ac9e-101bb0573bf3 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef" status: 200 len: 1455 microversion: 2.1 time: 0.102496 Jul 28 03:46:25.881447 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1283/2333] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:25 2022] GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:25.900421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b4b451ba-0fb9-4391-8240-43b7c2d5a0a1 tempest-SecurityGroupsTestAdminJSON-952897593 tempest-SecurityGroupsTestAdminJSON-952897593-project-admin] Calling method '.version_select at 0x7ffa799f0dc0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:25.964556 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a72ad772-957d-4f7a-a4b7-7ade0cfe7a43 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:25.982943 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a72ad772-957d-4f7a-a4b7-7ade0cfe7a43 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.645124 Jul 28 03:46:25.984699 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1051/2334] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:25 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:26.009172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3d4f7540-d4d1-4e1c-936d-0781409bcab6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:26.010645 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3d4f7540-d4d1-4e1c-936d-0781409bcab6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:26.022488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3d4f7540-d4d1-4e1c-936d-0781409bcab6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:26.023292 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3d4f7540-d4d1-4e1c-936d-0781409bcab6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:26.023657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3d4f7540-d4d1-4e1c-936d-0781409bcab6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:26.024266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3d4f7540-d4d1-4e1c-936d-0781409bcab6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:26.385277 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b4b451ba-0fb9-4391-8240-43b7c2d5a0a1 tempest-SecurityGroupsTestAdminJSON-952897593 tempest-SecurityGroupsTestAdminJSON-952897593-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/b15513da-651b-49eb-ad49-03d91ab1dbca" status: 202 len: 0 microversion: 2.1 time: 0.502543 Jul 28 03:46:26.386758 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1284/2335] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:46:25 2022] DELETE /compute/v2.1/os-security-groups/b15513da-651b-49eb-ad49-03d91ab1dbca => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:26.393045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-12f547ef-4c8b-44bf-b81c-e06470c2b36c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:26.393660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-12f547ef-4c8b-44bf-b81c-e06470c2b36c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:26.409774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12f547ef-4c8b-44bf-b81c-e06470c2b36c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:26.410724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12f547ef-4c8b-44bf-b81c-e06470c2b36c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:26.412046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12f547ef-4c8b-44bf-b81c-e06470c2b36c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:26.412746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12f547ef-4c8b-44bf-b81c-e06470c2b36c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:26.675906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-12f547ef-4c8b-44bf-b81c-e06470c2b36c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:26.678828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:26.692093 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-12f547ef-4c8b-44bf-b81c-e06470c2b36c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.302600 Jul 28 03:46:26.693194 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1285/2336] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:26 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:26.708586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f88bac7f-fefa-4560-95aa-4e81a5e25ecd tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:26.709561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f88bac7f-fefa-4560-95aa-4e81a5e25ecd tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:26.723063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f88bac7f-fefa-4560-95aa-4e81a5e25ecd tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:26.727135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f88bac7f-fefa-4560-95aa-4e81a5e25ecd tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:26.730272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f88bac7f-fefa-4560-95aa-4e81a5e25ecd tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:26.732965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f88bac7f-fefa-4560-95aa-4e81a5e25ecd tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:26.856909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:26.911263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f88bac7f-fefa-4560-95aa-4e81a5e25ecd tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:26.936754 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f88bac7f-fefa-4560-95aa-4e81a5e25ecd tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1337 microversion: 2.1 time: 0.242174 Jul 28 03:46:26.942974 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1286/2337] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:26 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1337 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:26.961282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-588b6eb7-48d9-498b-8f17-1ab5938139ee tempest-SecurityGroupsTestAdminJSON-952897593 tempest-SecurityGroupsTestAdminJSON-952897593-project-admin] Calling method '.version_select at 0x7ffa7453b3a0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:27.010479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3d4f7540-d4d1-4e1c-936d-0781409bcab6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:27.028117 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3d4f7540-d4d1-4e1c-936d-0781409bcab6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1271 microversion: 2.1 time: 1.023692 Jul 28 03:46:27.029298 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1052/2338] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:26 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1271 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:27.034202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5e8915ec-0333-4c41-bad6-80d6eb855dee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:27.035109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5e8915ec-0333-4c41-bad6-80d6eb855dee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:27.048720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e8915ec-0333-4c41-bad6-80d6eb855dee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:27.049586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e8915ec-0333-4c41-bad6-80d6eb855dee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:27.051125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e8915ec-0333-4c41-bad6-80d6eb855dee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:27.051908 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e8915ec-0333-4c41-bad6-80d6eb855dee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:27.352451 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-588b6eb7-48d9-498b-8f17-1ab5938139ee tempest-SecurityGroupsTestAdminJSON-952897593 tempest-SecurityGroupsTestAdminJSON-952897593-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/b0aff1a4-2107-4b33-b7fe-0bdf591236f4" status: 202 len: 0 microversion: 2.1 time: 0.407332 Jul 28 03:46:27.353397 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1287/2339] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:46:26 2022] DELETE /compute/v2.1/os-security-groups/b0aff1a4-2107-4b33-b7fe-0bdf591236f4 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:27.360404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d6b4214f-7125-43a6-a9bb-d2a99d5c019b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa741fdaf0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:27.472989 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d6b4214f-7125-43a6-a9bb-d2a99d5c019b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef" status: 200 len: 1464 microversion: 2.1 time: 0.112043 Jul 28 03:46:27.474762 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1288/2340] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:27 2022] GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef => generated 1464 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:27.493572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c41f3655-95e3-4901-8b4d-c4c074ba228b tempest-SecurityGroupsTestAdminJSON-1855271459 tempest-SecurityGroupsTestAdminJSON-1855271459-project] Calling method '.version_select at 0x7ffa74110550>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:27.644337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5e8915ec-0333-4c41-bad6-80d6eb855dee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:27.653086 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5e8915ec-0333-4c41-bad6-80d6eb855dee tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.622538 Jul 28 03:46:27.654214 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1053/2341] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:27 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:27.675021 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e19fe3c4-e4dc-4c4c-9020-b7fd347930da tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74917160>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:27.734092 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e19fe3c4-e4dc-4c4c-9020-b7fd347930da tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef" status: 200 len: 1464 microversion: 2.1 time: 0.063894 Jul 28 03:46:27.736105 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1054/2342] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:27 2022] GET /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef => generated 1464 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:27.746791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e17b90bf-8b5c-43ff-a1d9-698432312cf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:27.747645 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e17b90bf-8b5c-43ff-a1d9-698432312cf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:27.758710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e17b90bf-8b5c-43ff-a1d9-698432312cf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:27.759591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e17b90bf-8b5c-43ff-a1d9-698432312cf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:27.760724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e17b90bf-8b5c-43ff-a1d9-698432312cf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:27.762166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e17b90bf-8b5c-43ff-a1d9-698432312cf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:27.887945 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c41f3655-95e3-4901-8b4d-c4c074ba228b tempest-SecurityGroupsTestAdminJSON-1855271459 tempest-SecurityGroupsTestAdminJSON-1855271459-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/3de530af-4a73-49d5-9f6a-233c16fb7aaa" status: 202 len: 0 microversion: 2.1 time: 0.407645 Jul 28 03:46:27.890553 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1289/2343] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:46:27 2022] DELETE /compute/v2.1/os-security-groups/3de530af-4a73-49d5-9f6a-233c16fb7aaa => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:27.897579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b4cf592-625a-4871-9628-7f37defeb4e5 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:27.898659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5b4cf592-625a-4871-9628-7f37defeb4e5 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 58a40da4-0f01-4368-835f-9c3b550eb137] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:27.912710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b4cf592-625a-4871-9628-7f37defeb4e5 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:27.913426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b4cf592-625a-4871-9628-7f37defeb4e5 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:27.914816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b4cf592-625a-4871-9628-7f37defeb4e5 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:27.916152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b4cf592-625a-4871-9628-7f37defeb4e5 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:28.191633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5b4cf592-625a-4871-9628-7f37defeb4e5 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:28.216104 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5b4cf592-625a-4871-9628-7f37defeb4e5 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137" status: 200 len: 1467 microversion: 2.1 time: 0.318341 Jul 28 03:46:28.219861 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1290/2344] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:27 2022] GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137 => generated 1467 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:28.232213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9e1ed1a4-e647-4ff4-a6b8-7d88788cd696 tempest-SecurityGroupsTestAdminJSON-1855271459 tempest-SecurityGroupsTestAdminJSON-1855271459-project] Calling method '.version_select at 0x7ffa741fd0d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:28.553244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e17b90bf-8b5c-43ff-a1d9-698432312cf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:28.576536 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e17b90bf-8b5c-43ff-a1d9-698432312cf6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.835939 Jul 28 03:46:28.591098 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1055/2345] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:27 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:28.601471 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b7c95f43-25b4-4a37-9874-1bb877c3df51 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:28.602545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b7c95f43-25b4-4a37-9874-1bb877c3df51 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:28.603818 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9e1ed1a4-e647-4ff4-a6b8-7d88788cd696 tempest-SecurityGroupsTestAdminJSON-1855271459 tempest-SecurityGroupsTestAdminJSON-1855271459-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/7525c1f2-0664-4831-96cf-944047944e96" status: 202 len: 0 microversion: 2.1 time: 0.382726 Jul 28 03:46:28.604864 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1291/2346] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:46:28 2022] DELETE /compute/v2.1/os-security-groups/7525c1f2-0664-4831-96cf-944047944e96 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:28.613576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc797d35-58d4-42ad-9c8e-4e9400434941 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:28.614487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dc797d35-58d4-42ad-9c8e-4e9400434941 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:28.617567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7c95f43-25b4-4a37-9874-1bb877c3df51 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:28.618227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7c95f43-25b4-4a37-9874-1bb877c3df51 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:28.619355 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7c95f43-25b4-4a37-9874-1bb877c3df51 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:28.620241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7c95f43-25b4-4a37-9874-1bb877c3df51 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:28.628141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc797d35-58d4-42ad-9c8e-4e9400434941 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:28.632803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc797d35-58d4-42ad-9c8e-4e9400434941 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:28.633819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc797d35-58d4-42ad-9c8e-4e9400434941 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:28.634293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc797d35-58d4-42ad-9c8e-4e9400434941 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:28.889862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dc797d35-58d4-42ad-9c8e-4e9400434941 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:28.901794 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc797d35-58d4-42ad-9c8e-4e9400434941 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1313 microversion: 2.1 time: 0.293253 Jul 28 03:46:28.904659 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1292/2347] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:28 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:28.926893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d1f6093-8999-4e7b-84f7-0810705646eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1372872874"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:28.945729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d1f6093-8999-4e7b-84f7-0810705646eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:28.956252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=4,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:28.961639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d1f6093-8999-4e7b-84f7-0810705646eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:28.962106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d1f6093-8999-4e7b-84f7-0810705646eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:28.962904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d1f6093-8999-4e7b-84f7-0810705646eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:28.963347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d1f6093-8999-4e7b-84f7-0810705646eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:29.002720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b7c95f43-25b4-4a37-9874-1bb877c3df51 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:29.011398 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b7c95f43-25b4-4a37-9874-1bb877c3df51 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1335 microversion: 2.1 time: 0.431914 Jul 28 03:46:29.027204 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1056/2348] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:28 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1335 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:29.034526 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cd1e3063-8324-4b77-8d42-bed399e85880 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:29.051296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd1e3063-8324-4b77-8d42-bed399e85880 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:29.052502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd1e3063-8324-4b77-8d42-bed399e85880 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:29.098436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:29.106050 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cd1e3063-8324-4b77-8d42-bed399e85880 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Going to try to stop instance {{(pid=126072) force_stop /opt/stack/nova/nova/compute/api.py:2753}} Jul 28 03:46:29.183902 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cd1e3063-8324-4b77-8d42-bed399e85880 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.154475 Jul 28 03:46:29.188785 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1057/2349] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:46:29 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:29.195061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c37bf50b-6adc-422c-800a-748eb918debe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:29.196075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c37bf50b-6adc-422c-800a-748eb918debe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:29.203805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c37bf50b-6adc-422c-800a-748eb918debe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:29.205004 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c37bf50b-6adc-422c-800a-748eb918debe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:29.206217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c37bf50b-6adc-422c-800a-748eb918debe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:29.207100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c37bf50b-6adc-422c-800a-748eb918debe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:29.426839 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d1f6093-8999-4e7b-84f7-0810705646eb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "POST /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015/action" status: 202 len: 0 microversion: 2.1 time: 0.520607 Jul 28 03:46:29.428021 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1293/2350] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:46:28 2022] POST /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 03:46:29.447504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-92f744fd-fbbf-4336-a5aa-59e443c28dc0 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa741fd160>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:29.521184 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-92f744fd-fbbf-4336-a5aa-59e443c28dc0 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.085784 Jul 28 03:46:29.523312 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1294/2351] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:29 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:29.532970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c37bf50b-6adc-422c-800a-748eb918debe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:29.545978 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c37bf50b-6adc-422c-800a-748eb918debe tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 0.355476 Jul 28 03:46:29.547271 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1058/2352] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:29 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:29.926324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c9b9e89b-9d3b-4040-a66b-89846014d961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:29.927088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c9b9e89b-9d3b-4040-a66b-89846014d961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:29.944547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9b9e89b-9d3b-4040-a66b-89846014d961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:29.953816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9b9e89b-9d3b-4040-a66b-89846014d961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:29.955474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9b9e89b-9d3b-4040-a66b-89846014d961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:29.956087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9b9e89b-9d3b-4040-a66b-89846014d961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:30.048232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-35506d9b-83a7-4cd0-9fad-ee8c704325d4 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:30.048891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-35506d9b-83a7-4cd0-9fad-ee8c704325d4 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:30.064113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-35506d9b-83a7-4cd0-9fad-ee8c704325d4 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:30.064607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-35506d9b-83a7-4cd0-9fad-ee8c704325d4 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:30.065407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-35506d9b-83a7-4cd0-9fad-ee8c704325d4 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:30.065850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-35506d9b-83a7-4cd0-9fad-ee8c704325d4 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:30.197378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c9b9e89b-9d3b-4040-a66b-89846014d961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:30.211577 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c9b9e89b-9d3b-4040-a66b-89846014d961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1313 microversion: 2.1 time: 0.290540 Jul 28 03:46:30.225069 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1295/2353] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:29 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:30.549974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d205320d-2bc0-40fe-8693-7bfc4773ac15 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74703d30>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:30.675152 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d205320d-2bc0-40fe-8693-7bfc4773ac15 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.132182 Jul 28 03:46:30.675919 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1296/2354] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:30 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:30.690719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6da6fd45-21e2-4d89-bb5b-7610c2e64ae0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:30.690719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6da6fd45-21e2-4d89-bb5b-7610c2e64ae0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:30.700884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da6fd45-21e2-4d89-bb5b-7610c2e64ae0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:30.701344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da6fd45-21e2-4d89-bb5b-7610c2e64ae0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:30.702179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da6fd45-21e2-4d89-bb5b-7610c2e64ae0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:30.702640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da6fd45-21e2-4d89-bb5b-7610c2e64ae0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:30.899242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-35506d9b-83a7-4cd0-9fad-ee8c704325d4 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:30.919521 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-35506d9b-83a7-4cd0-9fad-ee8c704325d4 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1402 microversion: 2.1 time: 0.872394 Jul 28 03:46:30.936978 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1059/2355] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:30 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1402 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:31.071888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6da6fd45-21e2-4d89-bb5b-7610c2e64ae0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:31.100553 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6da6fd45-21e2-4d89-bb5b-7610c2e64ae0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 0.422265 Jul 28 03:46:31.102058 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1297/2356] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:30 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:31.114539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-88544943-412d-40d1-bb7e-0b50b32dab64 req-f5fdd57f-cd4e-4388-aafd-e22b6172d6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ce84a29-c300-4be9-934b-93e5af74e3eb", "tag": "e6b88eec-69c4-4857-90b1-4a08af8688ff"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:31.150230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-88544943-412d-40d1-bb7e-0b50b32dab64 req-f5fdd57f-cd4e-4388-aafd-e22b6172d6a6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:31.151417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-88544943-412d-40d1-bb7e-0b50b32dab64 req-f5fdd57f-cd4e-4388-aafd-e22b6172d6a6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:31.181155 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-88544943-412d-40d1-bb7e-0b50b32dab64 req-f5fdd57f-cd4e-4388-aafd-e22b6172d6a6 service nova] Creating event network-changed:e6b88eec-69c4-4857-90b1-4a08af8688ff for instance 6ce84a29-c300-4be9-934b-93e5af74e3eb on n-h1-826756-3 Jul 28 03:46:31.193478 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-88544943-412d-40d1-bb7e-0b50b32dab64 req-f5fdd57f-cd4e-4388-aafd-e22b6172d6a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089441 Jul 28 03:46:31.195900 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1298/2357] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:31.241986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0898812-a6ca-4c9f-826a-b7f386d9c3cd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:31.243725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e0898812-a6ca-4c9f-826a-b7f386d9c3cd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:31.258901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0898812-a6ca-4c9f-826a-b7f386d9c3cd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:31.260121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0898812-a6ca-4c9f-826a-b7f386d9c3cd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:31.261600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0898812-a6ca-4c9f-826a-b7f386d9c3cd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:31.264778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0898812-a6ca-4c9f-826a-b7f386d9c3cd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:31.341117 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-23c3dbe8-fe4b-4913-88be-328339b560ed tempest-TenantUsagesNegativeTestJSON-1811676189 tempest-TenantUsagesNegativeTestJSON-1811676189-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-27T03%3A46%3A30.856792&end=2022-07-29T03%3A46%3A30.856792" status: 404 len: 112 microversion: - time: 0.399644 Jul 28 03:46:31.342341 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1060/2358] 10.222.0.48 () {58 vars in 1316 bytes} [Thu Jul 28 03:46:30 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-27T03%3A46%3A30.856792&end=2022-07-29T03%3A46%3A30.856792 => generated 112 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 03:46:31.357591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d5176985-75ab-40c9-b87b-1159dce723ff tempest-TenantUsagesNegativeTestJSON-1811676189 tempest-TenantUsagesNegativeTestJSON-1811676189-project-admin] Calling method '.version_select at 0x7ffa74584f70>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:31.376594 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-d5176985-75ab-40c9-b87b-1159dce723ff tempest-TenantUsagesNegativeTestJSON-1811676189 tempest-TenantUsagesNegativeTestJSON-1811676189-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d5176985-75ab-40c9-b87b-1159dce723ff tempest-TenantUsagesNegativeTestJSON-1811676189 tempest-TenantUsagesNegativeTestJSON-1811676189-project-admin] Request method failure captured: Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-simple-tenant-usage/ce8dc799fc5d48d48689a8c247f13455?start=2022-07-29T03%3A46%3A30.856792&end=2022-07-27T03%3A46%3A30.856792 HTTP/1.1 Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gaWVkMQ2juxxw35F3w0EYeZ3Fa59W9glOHtqAqxwguWK_gdCTIuKVReL0f6_zBXM7pTnxqn-QbN5kKrVigU-6SwLxHmCNChA7l0FwE45V407daNDvkuYA2CZePLZ4DCK_jedXV7Hz0JOMq0_bLslVtSpCjZDM7ch6xD3W3YTfYhr0Y Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ef4e988269f24308baf1730180f4b479 Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1811676189 Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,admin,member Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,admin,member Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ef4e988269f24308baf1730180f4b479"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ef4e988269f24308baf1730180f4b479"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ef4e988269f24308baf1730180f4b479"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ef4e988269f24308baf1730180f4b479"}]}] Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1811676189 Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ef4e988269f24308baf1730180f4b479 Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1811676189 Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-TenantUsagesNegativeTestJSON-1811676189-project-admin Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 251e6f37e8dc4658b0cde39f3b99a34a Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1811676189-project-admin Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid start time. The start time cannot occur after the end time. Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'ce8dc799fc5d48d48689a8c247f13455'} Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 28 03:46:31.386792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:31.391623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d5176985-75ab-40c9-b87b-1159dce723ff tempest-TenantUsagesNegativeTestJSON-1811676189 tempest-TenantUsagesNegativeTestJSON-1811676189-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:46:31.394055 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d5176985-75ab-40c9-b87b-1159dce723ff tempest-TenantUsagesNegativeTestJSON-1811676189 tempest-TenantUsagesNegativeTestJSON-1811676189-project-admin] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage/ce8dc799fc5d48d48689a8c247f13455?start=2022-07-29T03%3A46%3A30.856792&end=2022-07-27T03%3A46%3A30.856792" status: 400 len: 111 microversion: 2.1 time: 0.044468 Jul 28 03:46:31.396132 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1061/2359] 10.222.0.48 () {58 vars in 1412 bytes} [Thu Jul 28 03:46:31 2022] GET /compute/v2.1/os-simple-tenant-usage/ce8dc799fc5d48d48689a8c247f13455?start=2022-07-29T03%3A46%3A30.856792&end=2022-07-27T03%3A46%3A30.856792 => generated 111 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:46:31.519487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e0898812-a6ca-4c9f-826a-b7f386d9c3cd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:31.534388 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e0898812-a6ca-4c9f-826a-b7f386d9c3cd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1313 microversion: 2.1 time: 0.300701 Jul 28 03:46:31.550693 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1299/2360] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:31 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:31.702660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a1867a41-5b03-49ac-98c3-3b1864263508 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa745d6670>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:31.789666 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a1867a41-5b03-49ac-98c3-3b1864263508 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.093969 Jul 28 03:46:31.792060 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1300/2361] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:31 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:31.931915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-576df9d9-ca8a-454e-b34b-d9116d33eea8 req-93f0d2c7-a3a9-45f7-be1e-42680bb86e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a40da4-0f01-4368-835f-9c3b550eb137", "name": "network-vif-unplugged", "status": "completed", "tag": "efeda983-f05c-4f23-9d79-30d55c7ec8d7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:31.950929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-576df9d9-ca8a-454e-b34b-d9116d33eea8 req-93f0d2c7-a3a9-45f7-be1e-42680bb86e5f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:31.953295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-576df9d9-ca8a-454e-b34b-d9116d33eea8 req-93f0d2c7-a3a9-45f7-be1e-42680bb86e5f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:31.989472 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-576df9d9-ca8a-454e-b34b-d9116d33eea8 req-93f0d2c7-a3a9-45f7-be1e-42680bb86e5f service nova] Creating event network-vif-unplugged:efeda983-f05c-4f23-9d79-30d55c7ec8d7 for instance 58a40da4-0f01-4368-835f-9c3b550eb137 on n-h1-826756-3 Jul 28 03:46:32.000460 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-576df9d9-ca8a-454e-b34b-d9116d33eea8 req-93f0d2c7-a3a9-45f7-be1e-42680bb86e5f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078626 Jul 28 03:46:32.003956 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1301/2362] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:46:32.012663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3c53987a-2110-4f40-9fa7-58b7bb46cde7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:32.019736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3c53987a-2110-4f40-9fa7-58b7bb46cde7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:32.034514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c53987a-2110-4f40-9fa7-58b7bb46cde7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:32.037976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c53987a-2110-4f40-9fa7-58b7bb46cde7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:32.039246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c53987a-2110-4f40-9fa7-58b7bb46cde7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:32.045157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c53987a-2110-4f40-9fa7-58b7bb46cde7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:32.095645 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1886ca2b-e00f-4f7c-b8ec-0825a01ff93b tempest-TenantUsagesNegativeTestJSON-2068331598 tempest-TenantUsagesNegativeTestJSON-2068331598-project] Calling method '.version_select at 0x7ffa74281dc0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:32.105503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1886ca2b-e00f-4f7c-b8ec-0825a01ff93b tempest-TenantUsagesNegativeTestJSON-2068331598 tempest-TenantUsagesNegativeTestJSON-2068331598-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '4d0e7213ca594a65a650d4d6092b3f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce8dc799fc5d48d48689a8c247f13455', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1886ca2b-e00f-4f7c-b8ec-0825a01ff93b tempest-TenantUsagesNegativeTestJSON-2068331598 tempest-TenantUsagesNegativeTestJSON-2068331598-project] Request method failure captured: Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-27T03%3A46%3A30.856792&end=2022-07-29T03%3A46%3A30.856792&detailed=1 HTTP/1.1 Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gaUj_6XdxqsONiE1oMfLBnSUWpfv8vLD4nkL43xYhyoVNKDbQJGBEL11so6uueUtUN5fFYTW0IlIZPwzW1o0bhkGQ2W-v-kUorlm_OYfsuaDEZtuWw4YWkjcDoszJE0DM8H7yA-zLDHiA8iQlzxIreOV5gozeQIRGUAhZbcrxdKDq0 Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ce8dc799fc5d48d48689a8c247f13455 Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2068331598 Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ce8dc799fc5d48d48689a8c247f13455"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce8dc799fc5d48d48689a8c247f13455"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ce8dc799fc5d48d48689a8c247f13455"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ce8dc799fc5d48d48689a8c247f13455"}]}] Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2068331598 Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ce8dc799fc5d48d48689a8c247f13455 Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2068331598 Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-TenantUsagesNegativeTestJSON-2068331598-project Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 4d0e7213ca594a65a650d4d6092b3f3b Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2068331598-project Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: action_args: {} Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:46:32.107324 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:46:32.112926 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 28 03:46:32.112926 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:32.112926 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:46:32.112926 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:32.112926 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:46:32.112926 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:46:32.112926 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:46:32.112926 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:46:32.112926 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:46:32.112926 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 28 03:46:32.112926 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:46:32.112926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1886ca2b-e00f-4f7c-b8ec-0825a01ff93b tempest-TenantUsagesNegativeTestJSON-2068331598 tempest-TenantUsagesNegativeTestJSON-2068331598-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:46:32.112926 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1886ca2b-e00f-4f7c-b8ec-0825a01ff93b tempest-TenantUsagesNegativeTestJSON-2068331598 tempest-TenantUsagesNegativeTestJSON-2068331598-project] 10.222.0.48 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-27T03%3A46%3A30.856792&end=2022-07-29T03%3A46%3A30.856792&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.698565 Jul 28 03:46:32.126541 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1062/2363] 10.222.0.48 () {58 vars in 1335 bytes} [Thu Jul 28 03:46:31 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-27T03%3A46%3A30.856792&end=2022-07-29T03%3A46%3A30.856792&detailed=1 => generated 123 bytes in 715 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:46:32.142297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a0749a9f-d2f5-46cc-be56-e951bb3f7680 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:32.143868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a0749a9f-d2f5-46cc-be56-e951bb3f7680 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:32.172275 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a0749a9f-d2f5-46cc-be56-e951bb3f7680 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:32.176210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a0749a9f-d2f5-46cc-be56-e951bb3f7680 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:32.177536 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a0749a9f-d2f5-46cc-be56-e951bb3f7680 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:32.178058 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a0749a9f-d2f5-46cc-be56-e951bb3f7680 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:32.490691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3c53987a-2110-4f40-9fa7-58b7bb46cde7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:32.502059 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3c53987a-2110-4f40-9fa7-58b7bb46cde7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1402 microversion: 2.1 time: 0.496698 Jul 28 03:46:32.516619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a0749a9f-d2f5-46cc-be56-e951bb3f7680 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:32.519620 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1302/2364] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:32 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1402 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:32.527516 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a0749a9f-d2f5-46cc-be56-e951bb3f7680 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 0.399570 Jul 28 03:46:32.540605 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1063/2365] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:32 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:32.571442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f63a8a11-cc15-4243-adf7-12aaed856c7c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:32.573747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f63a8a11-cc15-4243-adf7-12aaed856c7c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:32.596177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:32.604898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f63a8a11-cc15-4243-adf7-12aaed856c7c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:32.605860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f63a8a11-cc15-4243-adf7-12aaed856c7c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:32.606732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f63a8a11-cc15-4243-adf7-12aaed856c7c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:32.607174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f63a8a11-cc15-4243-adf7-12aaed856c7c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:32.930186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a8c88fee-ce9a-4c5a-b216-c9a16c7f60d3 tempest-AZV2TestJSON-80006552 tempest-AZV2TestJSON-80006552-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:32.931919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8c88fee-ce9a-4c5a-b216-c9a16c7f60d3 tempest-AZV2TestJSON-80006552 tempest-AZV2TestJSON-80006552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:32.932661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8c88fee-ce9a-4c5a-b216-c9a16c7f60d3 tempest-AZV2TestJSON-80006552 tempest-AZV2TestJSON-80006552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:32.933711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8c88fee-ce9a-4c5a-b216-c9a16c7f60d3 tempest-AZV2TestJSON-80006552 tempest-AZV2TestJSON-80006552-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:32.934394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8c88fee-ce9a-4c5a-b216-c9a16c7f60d3 tempest-AZV2TestJSON-80006552 tempest-AZV2TestJSON-80006552-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:33.042098 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a8c88fee-ce9a-4c5a-b216-c9a16c7f60d3 tempest-AZV2TestJSON-80006552 tempest-AZV2TestJSON-80006552-project] 10.222.0.48 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.519382 Jul 28 03:46:33.063296 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1303/2366] 10.222.0.48 () {58 vars in 1164 bytes} [Thu Jul 28 03:46:32 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:46:33.070362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-818b294a-a158-4367-a61e-1b174e985677 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa746163a0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:33.133761 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-818b294a-a158-4367-a61e-1b174e985677 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.068972 Jul 28 03:46:33.135731 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1304/2367] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:33 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:33.189180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f63a8a11-cc15-4243-adf7-12aaed856c7c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:33.201447 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f63a8a11-cc15-4243-adf7-12aaed856c7c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1313 microversion: 2.1 time: 0.644264 Jul 28 03:46:33.209886 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1064/2368] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:32 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1313 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:33.262812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e2fb0967-0bc7-45ee-b4b4-755c7a627441 req-d9c662ea-dd74-429f-b3ed-c64b11951584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb90f51f-bde2-4468-bc8d-06533d38ac7e", "tag": "1bb348f3-d6bf-460d-abb8-7ba8994f5a22"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:33.298154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e2fb0967-0bc7-45ee-b4b4-755c7a627441 req-d9c662ea-dd74-429f-b3ed-c64b11951584 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:33.299482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e2fb0967-0bc7-45ee-b4b4-755c7a627441 req-d9c662ea-dd74-429f-b3ed-c64b11951584 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:33.317169 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e2fb0967-0bc7-45ee-b4b4-755c7a627441 req-d9c662ea-dd74-429f-b3ed-c64b11951584 service nova] Creating event network-changed:1bb348f3-d6bf-460d-abb8-7ba8994f5a22 for instance eb90f51f-bde2-4468-bc8d-06533d38ac7e on n-h1-826756-3 Jul 28 03:46:33.337534 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e2fb0967-0bc7-45ee-b4b4-755c7a627441 req-d9c662ea-dd74-429f-b3ed-c64b11951584 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078085 Jul 28 03:46:33.338429 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1305/2369] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:33.531737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-81447ca0-c4a2-4df2-9d9c-38c73b0df24b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:33.533521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-81447ca0-c4a2-4df2-9d9c-38c73b0df24b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:33.551657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81447ca0-c4a2-4df2-9d9c-38c73b0df24b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:33.555150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81447ca0-c4a2-4df2-9d9c-38c73b0df24b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:33.556029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81447ca0-c4a2-4df2-9d9c-38c73b0df24b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:33.556515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81447ca0-c4a2-4df2-9d9c-38c73b0df24b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:33.804531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-587779e7-4d46-477a-ab6e-aaa99a16eece tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Action: 'create', calling method: .version_select at 0x7ffa748368b0>, body: {"keypair": {"name": "tempest-keypair-1853344831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2WPc7Ppq9hu5FLIA79yRWUt8/r2OUJjkGSKZDd4NM4OY25ukSn3PK793kwstdFjxqtX0Pb2PceBeibweQrn5/3BzUcABZ6urCwsyLHcthAJPnlstp0+zAp6GKAaAkXlA=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:33.825915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-81447ca0-c4a2-4df2-9d9c-38c73b0df24b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:33.836613 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-81447ca0-c4a2-4df2-9d9c-38c73b0df24b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1402 microversion: 2.1 time: 0.311465 Jul 28 03:46:33.843027 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1306/2370] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:33 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1402 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:33.847579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-587779e7-4d46-477a-ab6e-aaa99a16eece tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Getting quotas for project 5522494893404e359f22e1b73235ea00. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:33.851992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-41e72951-c3d8-4e73-9973-db51d501f26b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:33.852884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-41e72951-c3d8-4e73-9973-db51d501f26b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:33.861160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-587779e7-4d46-477a-ab6e-aaa99a16eece tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Getting quotas for user 90777d3ef3754951a185c774dd07a9ec and project 5522494893404e359f22e1b73235ea00. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:33.866999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41e72951-c3d8-4e73-9973-db51d501f26b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:33.868029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41e72951-c3d8-4e73-9973-db51d501f26b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:33.869146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41e72951-c3d8-4e73-9973-db51d501f26b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:33.869750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41e72951-c3d8-4e73-9973-db51d501f26b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:33.919256 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-587779e7-4d46-477a-ab6e-aaa99a16eece tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.578164 Jul 28 03:46:33.922902 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1065/2371] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:46:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:33.936311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9e8b263b-ac7a-4750-aca1-e29bfee66a3f tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Calling method '.version_select at 0x7ffa745c8b80>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:33.953266 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9e8b263b-ac7a-4750-aca1-e29bfee66a3f tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1853344831" status: 200 len: 498 microversion: 2.1 time: 0.025870 Jul 28 03:46:33.954687 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1066/2372] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 03:46:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1853344831 => generated 498 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:33.971010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3a0b47ee-d342-4024-9958-8a1a2f8e66a3 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Calling method '.version_select at 0x7ffa7451e820>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:34.011315 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3a0b47ee-d342-4024-9958-8a1a2f8e66a3 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853344831" status: 202 len: 0 microversion: 2.1 time: 0.045331 Jul 28 03:46:34.019129 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1067/2373] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 03:46:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853344831 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:34.024648 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-845a517e-1de0-4983-af7b-f94713df4e74 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Action: 'create', calling method: .version_select at 0x7ffa745c89d0>, body: {"keypair": {"name": "tempest-keypair-2113056604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/2wdOlbKgdaqEPijl48rtJO+Z00a1+W6HCEoWiqjqw0xgDh4e+uhPsqW3fXxScjYUGl+zdeIy1JG+6w1oO8bGgTXCHDtyvEG/V3t5qJGilZtSSyYm4u6yrRY95z4BzLQ=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:34.085123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-845a517e-1de0-4983-af7b-f94713df4e74 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Getting quotas for project 5522494893404e359f22e1b73235ea00. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:34.092463 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-845a517e-1de0-4983-af7b-f94713df4e74 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Getting quotas for user 90777d3ef3754951a185c774dd07a9ec and project 5522494893404e359f22e1b73235ea00. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:34.166062 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-845a517e-1de0-4983-af7b-f94713df4e74 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145107 Jul 28 03:46:34.167845 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1068/2374] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:46:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:34.176634 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b15116b8-1928-45d7-851a-4484d4bd2d86 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74502700>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:34.221303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-41e72951-c3d8-4e73-9973-db51d501f26b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:34.232920 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-41e72951-c3d8-4e73-9973-db51d501f26b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 0.388461 Jul 28 03:46:34.256441 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1307/2375] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:33 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:34.261500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1e104d60-0552-4bd3-b490-b4ab8b2feee1 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Calling method '.version_select at 0x7ffa742490d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:34.304512 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1e104d60-0552-4bd3-b490-b4ab8b2feee1 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113056604" status: 202 len: 0 microversion: 2.1 time: 0.046584 Jul 28 03:46:34.305508 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1308/2376] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 03:46:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113056604 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:34.314544 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b15116b8-1928-45d7-851a-4484d4bd2d86 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.143031 Jul 28 03:46:34.316491 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1069/2377] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:34 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:34.321084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb2f1be2-c826-4ec2-9200-2683e481f012 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:34.321972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb2f1be2-c826-4ec2-9200-2683e481f012 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:34.339222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb2f1be2-c826-4ec2-9200-2683e481f012 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:34.339762 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-87c6ee41-c35f-44d4-a1ea-4cf1808d8825 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Action: 'create', calling method: .version_select at 0x7ffa745c83a0>, body: {"keypair": {"name": "tempest-keypair-1122673260", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:34.340577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb2f1be2-c826-4ec2-9200-2683e481f012 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:34.344236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb2f1be2-c826-4ec2-9200-2683e481f012 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:34.345288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb2f1be2-c826-4ec2-9200-2683e481f012 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:34.376401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:34.410734 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-87c6ee41-c35f-44d4-a1ea-4cf1808d8825 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Getting quotas for project 5522494893404e359f22e1b73235ea00. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:34.427457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-87c6ee41-c35f-44d4-a1ea-4cf1808d8825 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Getting quotas for user 90777d3ef3754951a185c774dd07a9ec and project 5522494893404e359f22e1b73235ea00. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:34.489645 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-87c6ee41-c35f-44d4-a1ea-4cf1808d8825 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.169369 Jul 28 03:46:34.490534 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1070/2378] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:46:34 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:34.502519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6994c8c7-ecee-41b8-8bba-f28e96033f21 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Calling method '.version_select at 0x7ffa7451eca0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:34.527450 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6994c8c7-ecee-41b8-8bba-f28e96033f21 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122673260" status: 202 len: 0 microversion: 2.1 time: 0.029511 Jul 28 03:46:34.539089 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1071/2379] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 03:46:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1122673260 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:46:34.547595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d3833c34-d0ea-45de-b990-a04853d5b2b3 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Action: 'create', calling method: .version_select at 0x7ffa745029d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-143030713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOF7VWoQy7UwyCbgQcAPffWKjFjnOFGkO6IvM7ls63XiNbveo1yNEmeYvGU2oRSEpl5rIwp3WwUuYNNimkolvMQfyCmQG7cURLquScON0ddq/TFXNWMSAxaK0DkNQhTG/g=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:34.615971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-d3833c34-d0ea-45de-b990-a04853d5b2b3 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Getting quotas for project 5522494893404e359f22e1b73235ea00. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:34.627962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-d3833c34-d0ea-45de-b990-a04853d5b2b3 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Getting quotas for user 90777d3ef3754951a185c774dd07a9ec and project 5522494893404e359f22e1b73235ea00. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:34.685502 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d3833c34-d0ea-45de-b990-a04853d5b2b3 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.142341 Jul 28 03:46:34.699141 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1072/2380] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:46:34 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:34.707282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-275aa4bf-7447-4b3b-b61d-dcbfa0f16f8a tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Action: 'create', calling method: .version_select at 0x7ffa7469ec10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2047490806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMf7cDdJuUS/fxKru1H2g9MCw8t3RTH9SrQqWtEw03vD+1qGMWsDFsinxd57FE8ZL2Sqbx0F5jrSRzbwbNxH9c2hfoYAY07H1gxwmKqjIEFkiDtsSUPuw21XpJS+rmdxA=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:34.734576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-275aa4bf-7447-4b3b-b61d-dcbfa0f16f8a tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Getting quotas for project 5522494893404e359f22e1b73235ea00. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:34.744213 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-275aa4bf-7447-4b3b-b61d-dcbfa0f16f8a tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Getting quotas for user 90777d3ef3754951a185c774dd07a9ec and project 5522494893404e359f22e1b73235ea00. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:34.791406 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-275aa4bf-7447-4b3b-b61d-dcbfa0f16f8a tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.090569 Jul 28 03:46:34.801814 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1073/2381] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:46:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:34.808790 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dd473221-da99-40fb-ad3d-d5a13b6ae069 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Action: 'create', calling method: .version_select at 0x7ffa745c81f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-633154729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/4JTmdwAeHEzF9yn4312B53tSm9P9Xis8e18JReP1lf3VTNuZAm7xj6xdcuwZ9ZwtvmuD5FwmMoDTpljtied5Ue1o8GGJ+e4xVZWkk4sE8S5snzrhggiQt3FqC3gW+5w=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:34.815443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fb2f1be2-c826-4ec2-9200-2683e481f012 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:34.823982 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fb2f1be2-c826-4ec2-9200-2683e481f012 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1313 microversion: 2.1 time: 0.513869 Jul 28 03:46:34.825012 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1309/2382] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:34 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:34.843351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-dd473221-da99-40fb-ad3d-d5a13b6ae069 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Getting quotas for project 5522494893404e359f22e1b73235ea00. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:34.851726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-dd473221-da99-40fb-ad3d-d5a13b6ae069 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Getting quotas for user 90777d3ef3754951a185c774dd07a9ec and project 5522494893404e359f22e1b73235ea00. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:34.862290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c7b97a7d-80f5-4da3-9bab-85166b7a848f tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:34.863384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c7b97a7d-80f5-4da3-9bab-85166b7a848f tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:34.874210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7b97a7d-80f5-4da3-9bab-85166b7a848f tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:34.880239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7b97a7d-80f5-4da3-9bab-85166b7a848f tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:34.883689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7b97a7d-80f5-4da3-9bab-85166b7a848f tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:34.884893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7b97a7d-80f5-4da3-9bab-85166b7a848f tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:34.888943 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dd473221-da99-40fb-ad3d-d5a13b6ae069 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.084176 Jul 28 03:46:34.892593 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1074/2383] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:46:34 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:34.908970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-92e8d129-b4a0-43a1-9840-5f1219d4bb78 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Calling method '.version_select at 0x7ffa746579d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:34.916578 n-d-826756-3 devstack@n-api.service[126072]: WARNING oslo_db.sqlalchemy.utils [None req-92e8d129-b4a0-43a1-9840-5f1219d4bb78 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 03:46:34.926209 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-92e8d129-b4a0-43a1-9840-5f1219d4bb78 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.026771 Jul 28 03:46:34.936815 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1075/2384] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:46:34 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:34.942050 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-87d26c49-070c-42b2-9e7c-2477cfc2b0ab req-9aa74033-1e99-4e08-93dc-c858886412b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1d50cc-a245-45b8-a35d-7e6dcc1d2015", "name": "network-vif-plugged", "status": "completed", "tag": "42fe0509-4544-4491-a652-a3e7790cc649"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:34.958342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-87d26c49-070c-42b2-9e7c-2477cfc2b0ab req-9aa74033-1e99-4e08-93dc-c858886412b3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:34.958793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-87d26c49-070c-42b2-9e7c-2477cfc2b0ab req-9aa74033-1e99-4e08-93dc-c858886412b3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:34.983023 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-87d26c49-070c-42b2-9e7c-2477cfc2b0ab req-9aa74033-1e99-4e08-93dc-c858886412b3 service nova] Creating event network-vif-plugged:42fe0509-4544-4491-a652-a3e7790cc649 for instance 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 on n-h2-826756-3 Jul 28 03:46:34.988961 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-87d26c49-070c-42b2-9e7c-2477cfc2b0ab req-9aa74033-1e99-4e08-93dc-c858886412b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050535 Jul 28 03:46:34.989913 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1076/2385] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:34.995418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ad3046a5-3b5a-4fb1-b8df-0b97206c630e tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Calling method '.version_select at 0x7ffa74281550>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:35.020145 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ad3046a5-3b5a-4fb1-b8df-0b97206c630e tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-633154729" status: 202 len: 0 microversion: 2.1 time: 0.028956 Jul 28 03:46:35.021127 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1077/2386] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:46:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-633154729 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:35.038236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fc994155-5698-4fce-be1d-c1e00b1cc3a9 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Calling method '.version_select at 0x7ffa745b7dc0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:35.072371 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fc994155-5698-4fce-be1d-c1e00b1cc3a9 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2047490806" status: 202 len: 0 microversion: 2.1 time: 0.046932 Jul 28 03:46:35.073023 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1078/2387] 10.222.0.48 () {58 vars in 1278 bytes} [Thu Jul 28 03:46:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2047490806 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:46:35.084896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d712b314-800f-4672-bb22-9c2279a26424 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] Calling method '.version_select at 0x7ffa7451e0d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:35.110721 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d712b314-800f-4672-bb22-9c2279a26424 tempest-KeyPairsV2TestJSON-1595970809 tempest-KeyPairsV2TestJSON-1595970809-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-143030713" status: 202 len: 0 microversion: 2.1 time: 0.031288 Jul 28 03:46:35.111802 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1079/2388] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:46:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-143030713 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:35.219289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c7b97a7d-80f5-4da3-9bab-85166b7a848f tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:35.273464 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-66acd70a-71a0-47a1-985a-73df83841077 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:35.274245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-66acd70a-71a0-47a1-985a-73df83841077 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:35.276178 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c7b97a7d-80f5-4da3-9bab-85166b7a848f tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1402 microversion: 2.1 time: 0.417979 Jul 28 03:46:35.279688 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1310/2389] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:34 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1402 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:35.301482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:35.339791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b66632f5-9b6f-40f2-9f33-5dcbc7ee3c61 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74688310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:35.346983 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66acd70a-71a0-47a1-985a-73df83841077 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:35.346983 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66acd70a-71a0-47a1-985a-73df83841077 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:35.346983 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66acd70a-71a0-47a1-985a-73df83841077 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:35.346983 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66acd70a-71a0-47a1-985a-73df83841077 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:35.453285 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b66632f5-9b6f-40f2-9f33-5dcbc7ee3c61 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.120540 Jul 28 03:46:35.464276 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1311/2390] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:35 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:35.659884 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-66acd70a-71a0-47a1-985a-73df83841077 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:35.676489 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-66acd70a-71a0-47a1-985a-73df83841077 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 0.415137 Jul 28 03:46:35.680204 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1080/2391] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:35 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:35.853528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-01588363-c31b-4558-8c89-a17c75bb146b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:35.854887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-01588363-c31b-4558-8c89-a17c75bb146b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:35.867185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01588363-c31b-4558-8c89-a17c75bb146b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:35.870737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01588363-c31b-4558-8c89-a17c75bb146b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:35.873342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01588363-c31b-4558-8c89-a17c75bb146b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:35.874313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01588363-c31b-4558-8c89-a17c75bb146b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:36.298597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-01588363-c31b-4558-8c89-a17c75bb146b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:36.301100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c9fc5d4f-7a9e-42dc-95c5-513c3a4d149d tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:36.302404 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c9fc5d4f-7a9e-42dc-95c5-513c3a4d149d tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:36.310801 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-01588363-c31b-4558-8c89-a17c75bb146b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1313 microversion: 2.1 time: 0.464870 Jul 28 03:46:36.315153 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9fc5d4f-7a9e-42dc-95c5-513c3a4d149d tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:36.315864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9fc5d4f-7a9e-42dc-95c5-513c3a4d149d tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:36.316892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9fc5d4f-7a9e-42dc-95c5-513c3a4d149d tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:36.317511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9fc5d4f-7a9e-42dc-95c5-513c3a4d149d tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:36.327847 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1312/2392] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:35 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:36.474064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-49770bcb-bda0-4d4f-9efa-f0bcaf9e4cfa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa747039d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:36.626153 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-49770bcb-bda0-4d4f-9efa-f0bcaf9e4cfa tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.157736 Jul 28 03:46:36.628709 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1313/2393] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:36 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:36.914895 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c9fc5d4f-7a9e-42dc-95c5-513c3a4d149d tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:36.935421 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c9fc5d4f-7a9e-42dc-95c5-513c3a4d149d tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1402 microversion: 2.1 time: 0.637685 Jul 28 03:46:36.936058 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1081/2394] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:36 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1402 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:37.017505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-3f6bd216-a668-4cb9-a8d2-5909b3afa568 req-81b32028-8b79-4394-abbb-1fbd6faa7b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ce84a29-c300-4be9-934b-93e5af74e3eb", "name": "network-vif-plugged", "status": "completed", "tag": "e6b88eec-69c4-4857-90b1-4a08af8688ff"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:37.044708 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3f6bd216-a668-4cb9-a8d2-5909b3afa568 req-81b32028-8b79-4394-abbb-1fbd6faa7b37 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:37.046166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3f6bd216-a668-4cb9-a8d2-5909b3afa568 req-81b32028-8b79-4394-abbb-1fbd6faa7b37 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:37.067127 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-3f6bd216-a668-4cb9-a8d2-5909b3afa568 req-81b32028-8b79-4394-abbb-1fbd6faa7b37 service nova] Creating event network-vif-plugged:e6b88eec-69c4-4857-90b1-4a08af8688ff for instance 6ce84a29-c300-4be9-934b-93e5af74e3eb on n-h1-826756-3 Jul 28 03:46:37.107532 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-3f6bd216-a668-4cb9-a8d2-5909b3afa568 req-81b32028-8b79-4394-abbb-1fbd6faa7b37 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080724 Jul 28 03:46:37.114701 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1082/2395] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:46:37.301895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6285774e-7f5d-4e18-a156-69c4f3d6db2d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:37.303005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6285774e-7f5d-4e18-a156-69c4f3d6db2d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:37.327337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6285774e-7f5d-4e18-a156-69c4f3d6db2d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:37.328214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6285774e-7f5d-4e18-a156-69c4f3d6db2d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:37.329892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6285774e-7f5d-4e18-a156-69c4f3d6db2d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:37.336107 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-542fd01d-386e-4a18-8043-64caad3b3886 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:37.337243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6285774e-7f5d-4e18-a156-69c4f3d6db2d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:37.338518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-542fd01d-386e-4a18-8043-64caad3b3886 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:37.371611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-542fd01d-386e-4a18-8043-64caad3b3886 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:37.375587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-542fd01d-386e-4a18-8043-64caad3b3886 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:37.376914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-542fd01d-386e-4a18-8043-64caad3b3886 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:37.386353 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-542fd01d-386e-4a18-8043-64caad3b3886 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:37.707633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-542fd01d-386e-4a18-8043-64caad3b3886 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:37.718910 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-542fd01d-386e-4a18-8043-64caad3b3886 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1313 microversion: 2.1 time: 0.390406 Jul 28 03:46:37.721434 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1083/2396] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:37 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:37.733539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3f2d922e-8046-4683-a2b9-7ce6218a0a0e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa745b75e0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:37.784431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6285774e-7f5d-4e18-a156-69c4f3d6db2d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:37.792815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:37.795572 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6285774e-7f5d-4e18-a156-69c4f3d6db2d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 1.098793 Jul 28 03:46:37.798268 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1314/2397] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:36 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:37.873636 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3f2d922e-8046-4683-a2b9-7ce6218a0a0e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.150652 Jul 28 03:46:37.886741 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1084/2398] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:37 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:37.956190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-21ebaf55-f298-4b6d-8a70-4c5a1a177737 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:37.956848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-21ebaf55-f298-4b6d-8a70-4c5a1a177737 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:37.965906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21ebaf55-f298-4b6d-8a70-4c5a1a177737 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:37.967020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21ebaf55-f298-4b6d-8a70-4c5a1a177737 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:37.967923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21ebaf55-f298-4b6d-8a70-4c5a1a177737 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:37.968502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21ebaf55-f298-4b6d-8a70-4c5a1a177737 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:38.268007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-21ebaf55-f298-4b6d-8a70-4c5a1a177737 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:38.284108 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-21ebaf55-f298-4b6d-8a70-4c5a1a177737 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1402 microversion: 2.1 time: 0.331784 Jul 28 03:46:38.287240 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1315/2399] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:37 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1402 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:38.742975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-90b6e5ae-db05-4810-96a0-e9e5a56cc199 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:38.744228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-90b6e5ae-db05-4810-96a0-e9e5a56cc199 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:38.770690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90b6e5ae-db05-4810-96a0-e9e5a56cc199 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:38.774888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90b6e5ae-db05-4810-96a0-e9e5a56cc199 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:38.780849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90b6e5ae-db05-4810-96a0-e9e5a56cc199 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:38.781563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90b6e5ae-db05-4810-96a0-e9e5a56cc199 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:38.827531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6a129997-d9be-4930-8d7a-7bd1df1c8ad8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:38.831420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6a129997-d9be-4930-8d7a-7bd1df1c8ad8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:38.848860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a129997-d9be-4930-8d7a-7bd1df1c8ad8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:38.850623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a129997-d9be-4930-8d7a-7bd1df1c8ad8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:38.853190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a129997-d9be-4930-8d7a-7bd1df1c8ad8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:38.855748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a129997-d9be-4930-8d7a-7bd1df1c8ad8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:39.175682 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-90b6e5ae-db05-4810-96a0-e9e5a56cc199 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:39.187229 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-90b6e5ae-db05-4810-96a0-e9e5a56cc199 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1463 microversion: 2.1 time: 0.448925 Jul 28 03:46:39.200984 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1085/2400] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:38 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1463 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:39.212043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-64f0f764-951a-48d7-a9f8-ea1682341678 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74874430>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:39.268445 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-64f0f764-951a-48d7-a9f8-ea1682341678 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.065800 Jul 28 03:46:39.269618 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1086/2401] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:39 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:39.355181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6a129997-d9be-4930-8d7a-7bd1df1c8ad8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:39.367720 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6a129997-d9be-4930-8d7a-7bd1df1c8ad8 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1678 microversion: 2.1 time: 0.544626 Jul 28 03:46:39.368859 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1316/2402] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:38 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1678 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:39.381524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8944deb9-bbe3-41ea-b78d-ed3eb7afb134 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:39.382468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8944deb9-bbe3-41ea-b78d-ed3eb7afb134 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:39.394684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8944deb9-bbe3-41ea-b78d-ed3eb7afb134 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:39.395381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8944deb9-bbe3-41ea-b78d-ed3eb7afb134 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:39.398457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8944deb9-bbe3-41ea-b78d-ed3eb7afb134 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:39.398998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8944deb9-bbe3-41ea-b78d-ed3eb7afb134 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:39.724561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8944deb9-bbe3-41ea-b78d-ed3eb7afb134 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:39.732966 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8944deb9-bbe3-41ea-b78d-ed3eb7afb134 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1402 microversion: 2.1 time: 0.362777 Jul 28 03:46:39.737390 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1317/2403] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:39 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1402 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:39.762176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4bb0a79a-bec0-43f4-81b4-4a11944a23c9 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:39.762800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4bb0a79a-bec0-43f4-81b4-4a11944a23c9 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:39.771077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bb0a79a-bec0-43f4-81b4-4a11944a23c9 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:39.772144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bb0a79a-bec0-43f4-81b4-4a11944a23c9 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:39.773141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bb0a79a-bec0-43f4-81b4-4a11944a23c9 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:39.773737 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bb0a79a-bec0-43f4-81b4-4a11944a23c9 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:39.909491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ae929e4a-d8d2-4037-b7f2-8fd06a0b93bd tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Action: 'create', calling method: .version_select at 0x7ffa67abaa60>, body: {"keypair": {"name": "tempest-keypair-1176065560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAv/ZrPnVE6OizUSng6brYMWu/2sOE946JsV9RF32p88ZoWkj1kl3AHb3pSFfGhwYa8ySpQ5Pc8JaR8rGG6TJDAuGahCr8QqXtJ9ckaB4NFEx4i364m9QJGEZ12cKnIvIw=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:39.953246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ae929e4a-d8d2-4037-b7f2-8fd06a0b93bd tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:39.973215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ae929e4a-d8d2-4037-b7f2-8fd06a0b93bd tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for user e5786be0dead465d9d5d5ba1d6e82cd4 and project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:40.043525 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ae929e4a-d8d2-4037-b7f2-8fd06a0b93bd tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.304462 Jul 28 03:46:40.058954 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1318/2404] 10.222.0.48 () {62 vars in 1199 bytes} [Thu Jul 28 03:46:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 321 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 03:46:40.076599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-703288b8-7d46-4a6f-8d5a-d201aa49c759 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Calling method '.version_select at 0x7ffa743139d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:40.116394 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-703288b8-7d46-4a6f-8d5a-d201aa49c759 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1176065560" status: 200 len: 513 microversion: 2.2 time: 0.056160 Jul 28 03:46:40.124476 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1319/2405] 10.222.0.48 () {60 vars in 1258 bytes} [Thu Jul 28 03:46:40 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1176065560 => generated 513 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:40.155681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e3173ec-f5ae-461e-8acc-7ef983c19a6c tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Calling method '.version_select at 0x7ffa74249a60>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:40.220168 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e3173ec-f5ae-461e-8acc-7ef983c19a6c tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176065560" status: 204 len: 0 microversion: 2.2 time: 0.094075 Jul 28 03:46:40.222082 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1320/2406] 10.222.0.48 () {60 vars in 1261 bytes} [Thu Jul 28 03:46:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176065560 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:46:40.235548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b79ced4-25e5-49ab-8bfe-9353d5ecfcd4 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Action: 'create', calling method: .version_select at 0x7ffa74aee280>, body: {"keypair": {"name": "tempest-keypair-1527714103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXSbbtrTp1ZSfJ7QKn2RqRitJJLJdovHWUqKiAuXxauz3mZnECRSdxwPDJVpc7aW1mbku3nA/wdwOXkHVh2V4tXl3R9q1v3KGgy+JmqznTLsSjbp2jFJxwwZ9sGJ87SXQ=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:40.291643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7b79ced4-25e5-49ab-8bfe-9353d5ecfcd4 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:40.311933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7b79ced4-25e5-49ab-8bfe-9353d5ecfcd4 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for user e5786be0dead465d9d5d5ba1d6e82cd4 and project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:40.397416 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b79ced4-25e5-49ab-8bfe-9353d5ecfcd4 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.159209 Jul 28 03:46:40.397652 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1321/2407] 10.222.0.48 () {62 vars in 1199 bytes} [Thu Jul 28 03:46:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 167 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 03:46:40.411125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9aa5c8a1-53d8-4b07-a806-cd02e84d53a5 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa7998fa60>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:40.527866 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4bb0a79a-bec0-43f4-81b4-4a11944a23c9 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1614 microversion: 2.1 time: 1.256979 Jul 28 03:46:40.533264 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1087/2408] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:39 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1614 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:40.540682 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3c01bcf4-251c-4a7d-8e72-15ed92faa6e6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:40.543078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3c01bcf4-251c-4a7d-8e72-15ed92faa6e6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:40.568342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c01bcf4-251c-4a7d-8e72-15ed92faa6e6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:40.568827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c01bcf4-251c-4a7d-8e72-15ed92faa6e6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:40.570151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c01bcf4-251c-4a7d-8e72-15ed92faa6e6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:40.570592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c01bcf4-251c-4a7d-8e72-15ed92faa6e6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:40.585867 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9aa5c8a1-53d8-4b07-a806-cd02e84d53a5 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.184758 Jul 28 03:46:40.594063 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1322/2409] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:40 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:40.602461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b70bf8e-abf3-4992-bfff-96240d8e7084 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Calling method '.version_select at 0x7ffa74117a60>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:40.685508 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b70bf8e-abf3-4992-bfff-96240d8e7084 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527714103" status: 204 len: 0 microversion: 2.2 time: 0.077935 Jul 28 03:46:40.700190 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1323/2410] 10.222.0.48 () {60 vars in 1261 bytes} [Thu Jul 28 03:46:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527714103 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:46:40.719468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9706368b-1067-47a7-90bc-8308bef28f85 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:40.723064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9706368b-1067-47a7-90bc-8308bef28f85 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:40.756216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9706368b-1067-47a7-90bc-8308bef28f85 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:40.760298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9706368b-1067-47a7-90bc-8308bef28f85 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:40.764587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9706368b-1067-47a7-90bc-8308bef28f85 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:40.765435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9706368b-1067-47a7-90bc-8308bef28f85 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:40.799158 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3c01bcf4-251c-4a7d-8e72-15ed92faa6e6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:40.808709 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3c01bcf4-251c-4a7d-8e72-15ed92faa6e6 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1655 microversion: 2.1 time: 0.272907 Jul 28 03:46:40.822041 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1088/2411] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:40 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1655 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:40.834574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-96a6df56-358e-4565-9fdd-54379b3efd55 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Action: 'create', calling method: .version_select at 0x7ffa74502f70>, body: {"keypair": {"name": "tempest-keypair-540842474", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:40.882273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-96a6df56-358e-4565-9fdd-54379b3efd55 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:40.891395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-96a6df56-358e-4565-9fdd-54379b3efd55 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for user e5786be0dead465d9d5d5ba1d6e82cd4 and project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:40.894597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9706368b-1067-47a7-90bc-8308bef28f85 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '91b68f66bd734611a37932f904d14539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60fef00bbe244e6b4f34710d8c49b38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:40.895085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9706368b-1067-47a7-90bc-8308bef28f85 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] flavor_id is None. Assuming migration. {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4188}} Jul 28 03:46:40.896546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9706368b-1067-47a7-90bc-8308bef28f85 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 03:46:40.925975 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-96a6df56-358e-4565-9fdd-54379b3efd55 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.095739 Jul 28 03:46:40.928646 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1089/2412] 10.222.0.48 () {62 vars in 1199 bytes} [Thu Jul 28 03:46:40 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 03:46:40.936197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e0f3b6c7-a3ce-4f34-bfc4-9fc9c7d10e40 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:40.937109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e0f3b6c7-a3ce-4f34-bfc4-9fc9c7d10e40 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:40.944720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e0f3b6c7-a3ce-4f34-bfc4-9fc9c7d10e40 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:40.945169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e0f3b6c7-a3ce-4f34-bfc4-9fc9c7d10e40 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:40.945946 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e0f3b6c7-a3ce-4f34-bfc4-9fc9c7d10e40 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:40.946541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e0f3b6c7-a3ce-4f34-bfc4-9fc9c7d10e40 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:41.472831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e0f3b6c7-a3ce-4f34-bfc4-9fc9c7d10e40 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:41.486033 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e0f3b6c7-a3ce-4f34-bfc4-9fc9c7d10e40 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1402 microversion: 2.1 time: 0.554506 Jul 28 03:46:41.487560 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1090/2413] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:40 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1402 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:41.496621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8ece2a25-1cf6-4b71-9a6c-5072fe4fee36 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:41.519736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8ece2a25-1cf6-4b71-9a6c-5072fe4fee36 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:41.520212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8ece2a25-1cf6-4b71-9a6c-5072fe4fee36 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:41.567238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8ece2a25-1cf6-4b71-9a6c-5072fe4fee36 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Going to try to start instance {{(pid=126072) start /opt/stack/nova/nova/compute/api.py:2776}} Jul 28 03:46:41.570144 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9706368b-1067-47a7-90bc-8308bef28f85 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb/action" status: 202 len: 0 microversion: 2.1 time: 0.867906 Jul 28 03:46:41.578520 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1324/2414] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:46:40 2022] POST /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb/action => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:41.591216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d67adc3-e3e0-4edf-9310-4efac4bf8ae5 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Calling method '.version_select at 0x7ffa67abaca0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:41.648402 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8d67adc3-e3e0-4edf-9310-4efac4bf8ae5 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-540842474" status: 204 len: 0 microversion: 2.2 time: 0.067292 Jul 28 03:46:41.657248 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1325/2415] 10.222.0.48 () {60 vars in 1258 bytes} [Thu Jul 28 03:46:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-540842474 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:46:41.667331 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8ece2a25-1cf6-4b71-9a6c-5072fe4fee36 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.178496 Jul 28 03:46:41.668183 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1091/2416] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:46:41 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:41.668306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3109ea82-9c22-4599-a017-65d849a2a582 req-25190e77-b8c1-4c3d-b373-f27d59e12b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb90f51f-bde2-4468-bc8d-06533d38ac7e", "name": "network-vif-plugged", "status": "completed", "tag": "1bb348f3-d6bf-460d-abb8-7ba8994f5a22"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:41.673381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-092dc736-91b9-4481-88e1-2a333b793f12 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:41.674012 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-092dc736-91b9-4481-88e1-2a333b793f12 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:41.702532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3109ea82-9c22-4599-a017-65d849a2a582 req-25190e77-b8c1-4c3d-b373-f27d59e12b60 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:41.704279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3109ea82-9c22-4599-a017-65d849a2a582 req-25190e77-b8c1-4c3d-b373-f27d59e12b60 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:41.706770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-092dc736-91b9-4481-88e1-2a333b793f12 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:41.707785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-092dc736-91b9-4481-88e1-2a333b793f12 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:41.708988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-092dc736-91b9-4481-88e1-2a333b793f12 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:41.713021 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-092dc736-91b9-4481-88e1-2a333b793f12 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:41.741415 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3109ea82-9c22-4599-a017-65d849a2a582 req-25190e77-b8c1-4c3d-b373-f27d59e12b60 service nova] Creating event network-vif-plugged:1bb348f3-d6bf-460d-abb8-7ba8994f5a22 for instance eb90f51f-bde2-4468-bc8d-06533d38ac7e on n-h1-826756-3 Jul 28 03:46:41.757414 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3109ea82-9c22-4599-a017-65d849a2a582 req-25190e77-b8c1-4c3d-b373-f27d59e12b60 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098301 Jul 28 03:46:41.760533 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1326/2417] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:41.774971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3dcc0529-8035-42bb-8b3c-e47cd3831271 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74688e50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:41.911429 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3dcc0529-8035-42bb-8b3c-e47cd3831271 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.147619 Jul 28 03:46:41.914073 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1327/2418] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:41 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:41.925458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c2692cb9-0e5b-4949-91af-ef3da65d1823 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Action: 'create', calling method: .version_select at 0x7ffa67aba1f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-642837379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyUqdn1/LwfVzM/DnMmy2W60MHnqB5/QPn2StWZNzORYNQ+H6RI7ODZEurfkk9G8ZUvhQ8g8I9IIJL1X9HXTM3MZGg7OfQuJFBVoZFB8XDk6EpNySoZaTbtlSLG5mTyKg=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:41.968879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-c2692cb9-0e5b-4949-91af-ef3da65d1823 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:41.982764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-c2692cb9-0e5b-4949-91af-ef3da65d1823 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for user e5786be0dead465d9d5d5ba1d6e82cd4 and project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:42.064764 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c2692cb9-0e5b-4949-91af-ef3da65d1823 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.149418 Jul 28 03:46:42.065530 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1328/2419] 10.222.0.48 () {62 vars in 1199 bytes} [Thu Jul 28 03:46:41 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 03:46:42.081225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a57e43f8-c86c-4457-ac4d-290103688cb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:42.082115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a57e43f8-c86c-4457-ac4d-290103688cb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:42.091409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a57e43f8-c86c-4457-ac4d-290103688cb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:42.092333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a57e43f8-c86c-4457-ac4d-290103688cb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:42.096120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a57e43f8-c86c-4457-ac4d-290103688cb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:42.097858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a57e43f8-c86c-4457-ac4d-290103688cb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:42.583774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-092dc736-91b9-4481-88e1-2a333b793f12 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:42.585935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a57e43f8-c86c-4457-ac4d-290103688cb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:42.598213 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-092dc736-91b9-4481-88e1-2a333b793f12 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1472 microversion: 2.1 time: 0.928884 Jul 28 03:46:42.599237 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1092/2420] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:41 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1472 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:42.604056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2a40191b-a0af-4cd2-9c81-5e34ca2f6264 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Action: 'create', calling method: .version_select at 0x7ffa74874670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1106234634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNusKaUcBxDcwmI2PiilzkelHVsL+G5y8+Vdtjn6FlD/oQviEofwFnvYJYJSO3H5K8h7k9l0dvn8h9lvRPqkBndM5Hk9Nw6vX9lOmaZZIv+z7YSZUvyjH6+xc7Pdz3yDpw=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:42.608122 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a57e43f8-c86c-4457-ac4d-290103688cb7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1664 microversion: 2.1 time: 0.530673 Jul 28 03:46:42.613204 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1329/2421] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:42 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1664 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:42.627706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d5a9e606-a863-40af-ad86-cc62be2bb80b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:42.628894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d5a9e606-a863-40af-ad86-cc62be2bb80b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:42.649537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-2a40191b-a0af-4cd2-9c81-5e34ca2f6264 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:42.660163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:42.667034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5a9e606-a863-40af-ad86-cc62be2bb80b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:42.667857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5a9e606-a863-40af-ad86-cc62be2bb80b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:42.668323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-2a40191b-a0af-4cd2-9c81-5e34ca2f6264 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for user e5786be0dead465d9d5d5ba1d6e82cd4 and project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:42.670984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5a9e606-a863-40af-ad86-cc62be2bb80b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:42.671432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5a9e606-a863-40af-ad86-cc62be2bb80b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:42.741076 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2a40191b-a0af-4cd2-9c81-5e34ca2f6264 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.140683 Jul 28 03:46:42.742528 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1093/2422] 10.222.0.48 () {62 vars in 1199 bytes} [Thu Jul 28 03:46:42 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 03:46:42.757331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b0ac20a0-2b3f-41bc-bd24-62cb2e1c4031 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Action: 'create', calling method: .version_select at 0x7ffa745b7c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-250508175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2WY58unO2m37upsxWeVztZT+O/d7dNBS8CMVS/4CzRTnIyL5YPzurfPazfbitumeRnD3ASfBX625kAceJbG8wnsOEVwKqpNSUcTztRoG7yDr4JZEUULAypYpk1rK+yRA=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:42.801500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-b0ac20a0-2b3f-41bc-bd24-62cb2e1c4031 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:42.814381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-b0ac20a0-2b3f-41bc-bd24-62cb2e1c4031 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for user e5786be0dead465d9d5d5ba1d6e82cd4 and project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:42.891357 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b0ac20a0-2b3f-41bc-bd24-62cb2e1c4031 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.139582 Jul 28 03:46:42.894079 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1094/2423] 10.222.0.48 () {62 vars in 1199 bytes} [Thu Jul 28 03:46:42 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 03:46:42.902701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fb6f952f-9c16-40dc-a6bd-0f8cd3004f1c tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Calling method '.version_select at 0x7ffa748ec040>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:42.915540 n-d-826756-3 devstack@n-api.service[126072]: WARNING oslo_db.sqlalchemy.utils [None req-fb6f952f-9c16-40dc-a6bd-0f8cd3004f1c tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 03:46:42.933194 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fb6f952f-9c16-40dc-a6bd-0f8cd3004f1c tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.034136 Jul 28 03:46:42.934601 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1095/2424] 10.222.0.48 () {60 vars in 1177 bytes} [Thu Jul 28 03:46:42 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:42.944980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a3ee102a-3404-4658-b0bd-8b92f584b696 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74502670>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:42.962396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:43.027110 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a3ee102a-3404-4658-b0bd-8b92f584b696 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.090985 Jul 28 03:46:43.028294 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1096/2425] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:42 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:43.033454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6ae4a899-f708-4b11-a371-e2ff96677f7b tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Calling method '.version_select at 0x7ffa74874820>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:43.071114 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6ae4a899-f708-4b11-a371-e2ff96677f7b tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-250508175" status: 204 len: 0 microversion: 2.2 time: 0.040917 Jul 28 03:46:43.075010 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1097/2426] 10.222.0.48 () {60 vars in 1318 bytes} [Thu Jul 28 03:46:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-250508175 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:46:43.082947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-82b11426-2ced-4b15-8a5e-48372551cd4d tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Calling method '.version_select at 0x7ffa745b7dc0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:43.127231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d5a9e606-a863-40af-ad86-cc62be2bb80b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:43.139749 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d5a9e606-a863-40af-ad86-cc62be2bb80b tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1402 microversion: 2.1 time: 0.524979 Jul 28 03:46:43.140462 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1330/2427] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:42 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1402 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:43.166156 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-82b11426-2ced-4b15-8a5e-48372551cd4d tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1106234634" status: 204 len: 0 microversion: 2.2 time: 0.089058 Jul 28 03:46:43.166754 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1098/2428] 10.222.0.48 () {60 vars in 1321 bytes} [Thu Jul 28 03:46:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1106234634 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:46:43.175505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bf448eef-9978-4b0b-808a-3f9fd4b79977 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Calling method '.version_select at 0x7ffa746fa940>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:43.221491 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bf448eef-9978-4b0b-808a-3f9fd4b79977 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-642837379" status: 204 len: 0 microversion: 2.2 time: 0.049726 Jul 28 03:46:43.222100 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1331/2429] 10.222.0.48 () {60 vars in 1318 bytes} [Thu Jul 28 03:46:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-642837379 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:46:43.234562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6094b9ba-c4a1-406e-8b71-3fe0c16911a1 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Action: 'create', calling method: .version_select at 0x7ffa748363a0>, body: {"keypair": {"name": "tempest-keypair-1400536722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgTndCrcET/iPXqIPiouDVqYQkze6q3uVrXkhPWCFNGk2ZMuo3ZWwK0OGNDbZlw4r5RY5d/FXjwmAfmGfB2M0Dw+M51NMhGbTHRSSfeu579/wBczB2PCwEziuYvsG6DNQ=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:43.279427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-6094b9ba-c4a1-406e-8b71-3fe0c16911a1 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:43.294781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-6094b9ba-c4a1-406e-8b71-3fe0c16911a1 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for user e5786be0dead465d9d5d5ba1d6e82cd4 and project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:43.348692 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6094b9ba-c4a1-406e-8b71-3fe0c16911a1 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.117754 Jul 28 03:46:43.349317 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1099/2430] 10.222.0.48 () {62 vars in 1199 bytes} [Thu Jul 28 03:46:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 28 03:46:43.369274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-319fd93f-aff6-4f4c-83c9-0849990b25f1 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Calling method '.version_select at 0x7ffa67a6fca0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:43.389286 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-319fd93f-aff6-4f4c-83c9-0849990b25f1 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1400536722" status: 200 len: 513 microversion: 2.2 time: 0.033080 Jul 28 03:46:43.390598 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1332/2431] 10.222.0.48 () {60 vars in 1258 bytes} [Thu Jul 28 03:46:43 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1400536722 => generated 513 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:46:43.413642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6c244583-3c68-43ac-b690-ce61fbce57df tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Calling method '.version_select at 0x7ffa746579d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:43.418461 n-d-826756-3 devstack@n-api.service[126072]: WARNING oslo_db.sqlalchemy.utils [None req-6c244583-3c68-43ac-b690-ce61fbce57df tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 03:46:43.426768 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6c244583-3c68-43ac-b690-ce61fbce57df tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.026060 Jul 28 03:46:43.428555 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1100/2432] 10.222.0.48 () {60 vars in 1177 bytes} [Thu Jul 28 03:46:43 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:43.443701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1e917b1c-e5a5-4ef9-8974-4fb5377f2490 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Calling method '.version_select at 0x7ffa6798d0d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:43.472590 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1e917b1c-e5a5-4ef9-8974-4fb5377f2490 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400536722" status: 204 len: 0 microversion: 2.2 time: 0.037208 Jul 28 03:46:43.473941 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1333/2433] 10.222.0.48 () {60 vars in 1261 bytes} [Thu Jul 28 03:46:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400536722 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:46:43.485142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-14f368fa-41ab-4e6d-9b30-70e948e2adc9 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Action: 'create', calling method: .version_select at 0x7ffa7451e280>, body: {"keypair": {"name": "tempest-keypair-1025605535", "type": "x509"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:43.529078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-14f368fa-41ab-4e6d-9b30-70e948e2adc9 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:43.562241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-14f368fa-41ab-4e6d-9b30-70e948e2adc9 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for user e5786be0dead465d9d5d5ba1d6e82cd4 and project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:43.620313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-82e87898-938b-44eb-bbd9-e2d669a95084 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:43.621987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-82e87898-938b-44eb-bbd9-e2d669a95084 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:43.630524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.processutils [None req-14f368fa-41ab-4e6d-9b30-70e948e2adc9 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp1ox_fakc/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1ox_fakc/temp.key -subj /CN=e5786be0dead465d9d5d5ba1d6e82cd4 -extensions v3_req_client {{(pid=126072) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 28 03:46:43.634099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82e87898-938b-44eb-bbd9-e2d669a95084 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:43.636125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82e87898-938b-44eb-bbd9-e2d669a95084 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:43.637071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82e87898-938b-44eb-bbd9-e2d669a95084 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:43.645059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82e87898-938b-44eb-bbd9-e2d669a95084 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:44.143322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.processutils [None req-14f368fa-41ab-4e6d-9b30-70e948e2adc9 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp1ox_fakc/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1ox_fakc/temp.key -subj /CN=e5786be0dead465d9d5d5ba1d6e82cd4 -extensions v3_req_client" returned: 0 in 0.512s {{(pid=126072) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 28 03:46:44.145178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.processutils [None req-14f368fa-41ab-4e6d-9b30-70e948e2adc9 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp1ox_fakc/temp.key -password pass: {{(pid=126072) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 28 03:46:44.226631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.processutils [None req-14f368fa-41ab-4e6d-9b30-70e948e2adc9 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp1ox_fakc/temp.key -password pass:" returned: 0 in 0.074s {{(pid=126072) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 28 03:46:44.326275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82e87898-938b-44eb-bbd9-e2d669a95084 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:44.341064 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-82e87898-938b-44eb-bbd9-e2d669a95084 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1472 microversion: 2.1 time: 0.721128 Jul 28 03:46:44.345067 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1334/2434] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:43 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1472 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:44.352937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-878f1e8c-4324-41b3-b700-ed9900d78e90 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:44.357578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-878f1e8c-4324-41b3-b700-ed9900d78e90 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:44.367994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-14f368fa-41ab-4e6d-9b30-70e948e2adc9 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:44.385840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-878f1e8c-4324-41b3-b700-ed9900d78e90 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:44.390867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-878f1e8c-4324-41b3-b700-ed9900d78e90 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:44.393978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-878f1e8c-4324-41b3-b700-ed9900d78e90 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:44.395202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-878f1e8c-4324-41b3-b700-ed9900d78e90 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:44.442027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-14f368fa-41ab-4e6d-9b30-70e948e2adc9 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Getting quotas for user e5786be0dead465d9d5d5ba1d6e82cd4 and project 3126a4aef9d945b885e065f7fc019c45. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:44.506679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:44.540367 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-14f368fa-41ab-4e6d-9b30-70e948e2adc9 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.060881 Jul 28 03:46:44.545315 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1101/2435] 10.222.0.48 () {62 vars in 1198 bytes} [Thu Jul 28 03:46:43 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1066 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:46:44.561518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c486caff-8c59-4f12-8a24-eb928aef502d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74657790>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:44.690128 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c486caff-8c59-4f12-8a24-eb928aef502d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.143288 Jul 28 03:46:44.700386 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1102/2436] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:44 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:44.705755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5367cbc4-019d-43e9-a1be-5d73eb53b869 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:44.707011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5367cbc4-019d-43e9-a1be-5d73eb53b869 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:44.716681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5367cbc4-019d-43e9-a1be-5d73eb53b869 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:44.716936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5367cbc4-019d-43e9-a1be-5d73eb53b869 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:44.718124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5367cbc4-019d-43e9-a1be-5d73eb53b869 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:44.718765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5367cbc4-019d-43e9-a1be-5d73eb53b869 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:44.756699 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:44.913841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-878f1e8c-4324-41b3-b700-ed9900d78e90 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:44.930368 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-878f1e8c-4324-41b3-b700-ed9900d78e90 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1664 microversion: 2.1 time: 0.583772 Jul 28 03:46:44.931450 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1335/2437] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:44 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1664 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:44.966534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4406b0ad-4586-4cd7-a822-b23e1fcb351b tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Calling method '.version_select at 0x7ffa6798d550>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:45.005520 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4406b0ad-4586-4cd7-a822-b23e1fcb351b tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs/tempest-keypair-1025605535" status: 200 len: 1534 microversion: 2.2 time: 0.064547 Jul 28 03:46:45.006140 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1336/2438] 10.222.0.48 () {60 vars in 1258 bytes} [Thu Jul 28 03:46:44 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1025605535 => generated 1534 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:45.017757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4f393e67-f955-4125-ad62-765fd6996cb0 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Calling method '.version_select at 0x7ffa67a6f4c0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:45.028039 n-d-826756-3 devstack@n-api.service[126071]: WARNING oslo_db.sqlalchemy.utils [None req-4f393e67-f955-4125-ad62-765fd6996cb0 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 03:46:45.059782 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4f393e67-f955-4125-ad62-765fd6996cb0 tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.038716 Jul 28 03:46:45.069663 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1337/2439] 10.222.0.48 () {60 vars in 1177 bytes} [Thu Jul 28 03:46:45 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:45.111319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1ad52d84-501e-4fe5-b96d-28a686af56df tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] Calling method '.version_select at 0x7ffa741bfb80>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:45.174114 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1ad52d84-501e-4fe5-b96d-28a686af56df tempest-KeyPairsV22TestJSON-1509486115 tempest-KeyPairsV22TestJSON-1509486115-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025605535" status: 204 len: 0 microversion: 2.2 time: 0.082355 Jul 28 03:46:45.181965 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1338/2440] 10.222.0.48 () {60 vars in 1261 bytes} [Thu Jul 28 03:46:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025605535 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:46:45.378303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4026d554-c632-4749-a9c8-40626b7132bc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:45.382354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4026d554-c632-4749-a9c8-40626b7132bc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:45.399705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4026d554-c632-4749-a9c8-40626b7132bc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:45.412059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4026d554-c632-4749-a9c8-40626b7132bc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:45.414292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4026d554-c632-4749-a9c8-40626b7132bc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:45.418976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4026d554-c632-4749-a9c8-40626b7132bc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:45.480763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5367cbc4-019d-43e9-a1be-5d73eb53b869 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:45.500745 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5367cbc4-019d-43e9-a1be-5d73eb53b869 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1588 microversion: 2.1 time: 0.792265 Jul 28 03:46:45.502217 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1103/2441] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:44 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1588 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:45.525920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8a940a45-e947-4e0a-b79c-528600e5d133 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:45.527031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8a940a45-e947-4e0a-b79c-528600e5d133 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:45.552406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a940a45-e947-4e0a-b79c-528600e5d133 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:45.553252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a940a45-e947-4e0a-b79c-528600e5d133 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:45.554324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a940a45-e947-4e0a-b79c-528600e5d133 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:45.554998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a940a45-e947-4e0a-b79c-528600e5d133 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:46.225904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4026d554-c632-4749-a9c8-40626b7132bc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:46.244133 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4026d554-c632-4749-a9c8-40626b7132bc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1472 microversion: 2.1 time: 0.878852 Jul 28 03:46:46.254148 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8a940a45-e947-4e0a-b79c-528600e5d133 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.733392 Jul 28 03:46:46.254842 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1104/2442] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:46:45 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e/os-interface => generated 285 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:46.262253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a612c399-c95c-4209-ad80-29dbc76e8a9e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa7484d1f0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:46.268285 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1339/2443] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:45 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1472 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:46.289176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86992e89-f300-4d59-aa3e-86e93d933c4c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:46.291580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-86992e89-f300-4d59-aa3e-86e93d933c4c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:46.312283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86992e89-f300-4d59-aa3e-86e93d933c4c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:46.312760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86992e89-f300-4d59-aa3e-86e93d933c4c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:46.313559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86992e89-f300-4d59-aa3e-86e93d933c4c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:46.313994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86992e89-f300-4d59-aa3e-86e93d933c4c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:46.359131 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a612c399-c95c-4209-ad80-29dbc76e8a9e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.101163 Jul 28 03:46:46.361240 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1105/2444] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:46 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:46.614307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-86992e89-f300-4d59-aa3e-86e93d933c4c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:46.631076 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-86992e89-f300-4d59-aa3e-86e93d933c4c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.358604 Jul 28 03:46:46.632452 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1340/2445] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:46 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:46.660607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0d3a49e2-37c1-4550-9145-ad3fb378f60c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:46.662390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0d3a49e2-37c1-4550-9145-ad3fb378f60c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:46.691395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d3a49e2-37c1-4550-9145-ad3fb378f60c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:46.691875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d3a49e2-37c1-4550-9145-ad3fb378f60c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:46.692801 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d3a49e2-37c1-4550-9145-ad3fb378f60c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:46.693250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d3a49e2-37c1-4550-9145-ad3fb378f60c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:47.299179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4a4efe2-32a2-46ef-a201-ccc1e026cb49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:47.299825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d4a4efe2-32a2-46ef-a201-ccc1e026cb49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:47.327166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4a4efe2-32a2-46ef-a201-ccc1e026cb49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:47.327628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4a4efe2-32a2-46ef-a201-ccc1e026cb49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:47.328519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4a4efe2-32a2-46ef-a201-ccc1e026cb49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:47.330122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4a4efe2-32a2-46ef-a201-ccc1e026cb49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:47.688168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d4a4efe2-32a2-46ef-a201-ccc1e026cb49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:47.699305 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d4a4efe2-32a2-46ef-a201-ccc1e026cb49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1472 microversion: 2.1 time: 0.427366 Jul 28 03:46:47.699909 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1341/2446] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:47 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1472 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:47.708891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-089ecac2-5f84-4b7a-8ca8-5f2fb06b2642 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6798d8b0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:47.799367 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-089ecac2-5f84-4b7a-8ca8-5f2fb06b2642 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.095012 Jul 28 03:46:47.800577 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1342/2447] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:47 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:48.268762 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0d3a49e2-37c1-4550-9145-ad3fb378f60c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:48.268762 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0d3a49e2-37c1-4550-9145-ad3fb378f60c tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 1.612765 Jul 28 03:46:48.268762 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1106/2448] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:46 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:48.296887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4c8cfd5c-4933-4dfb-8967-3f6a17626a39 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:48.297475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4c8cfd5c-4933-4dfb-8967-3f6a17626a39 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:48.315144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c8cfd5c-4933-4dfb-8967-3f6a17626a39 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:48.315869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c8cfd5c-4933-4dfb-8967-3f6a17626a39 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:48.317091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c8cfd5c-4933-4dfb-8967-3f6a17626a39 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:48.317523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c8cfd5c-4933-4dfb-8967-3f6a17626a39 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:48.728730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2534788d-ef47-4597-b846-a0b3e2dfbd0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:48.729741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2534788d-ef47-4597-b846-a0b3e2dfbd0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:48.737723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2534788d-ef47-4597-b846-a0b3e2dfbd0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:48.738544 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2534788d-ef47-4597-b846-a0b3e2dfbd0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:48.739581 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2534788d-ef47-4597-b846-a0b3e2dfbd0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:48.740227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2534788d-ef47-4597-b846-a0b3e2dfbd0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:48.879311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4c8cfd5c-4933-4dfb-8967-3f6a17626a39 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:48.918836 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4c8cfd5c-4933-4dfb-8967-3f6a17626a39 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.625761 Jul 28 03:46:48.928943 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1343/2449] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:48 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:48.961081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc691485-49a1-4693-9077-e8499bd1f93b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6798d820>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:49.050342 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cc691485-49a1-4693-9077-e8499bd1f93b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.119195 Jul 28 03:46:49.062640 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1344/2450] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:48 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:49.073700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-150ed199-6376-4686-b3fa-4e88a2860fe5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:49.075389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-150ed199-6376-4686-b3fa-4e88a2860fe5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:49.090560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150ed199-6376-4686-b3fa-4e88a2860fe5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:49.091934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150ed199-6376-4686-b3fa-4e88a2860fe5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:49.094152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150ed199-6376-4686-b3fa-4e88a2860fe5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:49.095201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150ed199-6376-4686-b3fa-4e88a2860fe5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:49.180170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2534788d-ef47-4597-b846-a0b3e2dfbd0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:49.188507 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2534788d-ef47-4597-b846-a0b3e2dfbd0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1477 microversion: 2.1 time: 0.463910 Jul 28 03:46:49.200452 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1107/2451] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:48 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1477 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:49.696798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-150ed199-6376-4686-b3fa-4e88a2860fe5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:49.755818 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-150ed199-6376-4686-b3fa-4e88a2860fe5 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.670276 Jul 28 03:46:49.765130 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1345/2452] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:49 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:49.782641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5d78d7fe-d4ba-4efe-b382-c8bc158cf0d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:49.783952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5d78d7fe-d4ba-4efe-b382-c8bc158cf0d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:49.794398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d78d7fe-d4ba-4efe-b382-c8bc158cf0d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:49.796885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d78d7fe-d4ba-4efe-b382-c8bc158cf0d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:49.799666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d78d7fe-d4ba-4efe-b382-c8bc158cf0d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:49.800474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d78d7fe-d4ba-4efe-b382-c8bc158cf0d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:50.489181 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5d78d7fe-d4ba-4efe-b382-c8bc158cf0d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:50.500695 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5d78d7fe-d4ba-4efe-b382-c8bc158cf0d3 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.722304 Jul 28 03:46:50.509164 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1108/2453] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:49 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:50.524979 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2fc7163d-9002-41e1-bbfe-be3731bb3985 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74217940>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:50.639928 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2fc7163d-9002-41e1-bbfe-be3731bb3985 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.128682 Jul 28 03:46:50.641738 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1109/2454] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:50 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:50.651220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d2f40d90-e3e6-4798-a538-706866b29376 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:50.655928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d2f40d90-e3e6-4798-a538-706866b29376 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:50.674533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2f40d90-e3e6-4798-a538-706866b29376 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:50.676314 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2f40d90-e3e6-4798-a538-706866b29376 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:50.684003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2f40d90-e3e6-4798-a538-706866b29376 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:50.685228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2f40d90-e3e6-4798-a538-706866b29376 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:51.009451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-058fcdc9-71f8-457a-8272-18d151a081d0 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Action: 'create', calling method: .version_select at 0x7ffa679f5940>, body: {"keypair": {"name": "tempest-keypair-1182726196", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtze07ZcEdaML1elG6cwBWSIvsLfaRloaWr5M7bVQpuCPyT+FhajRwr+JuiPnzKu/BTfN0utg+JTfUn8A2pgl+0Qd2dex+HzTobZHozQPDENkrJ2McrL/dey7BTtj+8+g=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:51.041577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-058fcdc9-71f8-457a-8272-18d151a081d0 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Getting quotas for project 759506bd247a40d59e76d660d408755e. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:46:51.062228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-058fcdc9-71f8-457a-8272-18d151a081d0 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Getting quotas for user 4289787d6b5e412e8ab5928df4ca9bd7 and project 759506bd247a40d59e76d660d408755e. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:46:51.160034 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-058fcdc9-71f8-457a-8272-18d151a081d0 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.172322 Jul 28 03:46:51.161587 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1346/2455] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:46:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:51.166846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f1eb684a-447d-4ebe-b161-e78af6b1f64b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:51.169007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f1eb684a-447d-4ebe-b161-e78af6b1f64b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:51.186664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1eb684a-447d-4ebe-b161-e78af6b1f64b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:51.189100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1eb684a-447d-4ebe-b161-e78af6b1f64b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:51.190207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1eb684a-447d-4ebe-b161-e78af6b1f64b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:51.192214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1eb684a-447d-4ebe-b161-e78af6b1f64b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:51.261334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-f1eb684a-447d-4ebe-b161-e78af6b1f64b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lazy-loading 'flavor' on Instance uuid cb4b8ffa-dbe6-4e90-a8f5-728addf73aae {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:46:51.310448 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d2f40d90-e3e6-4798-a538-706866b29376 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:51.340434 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d2f40d90-e3e6-4798-a538-706866b29376 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1477 microversion: 2.1 time: 0.691409 Jul 28 03:46:51.341546 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1110/2456] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:50 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1477 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:51.356550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:51.374644 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0b1190d0-a175-4f78-902c-f14aa1ecfba8 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:51.384013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0b1190d0-a175-4f78-902c-f14aa1ecfba8 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:51.425475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b1190d0-a175-4f78-902c-f14aa1ecfba8 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:51.432041 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f1eb684a-447d-4ebe-b161-e78af6b1f64b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.268847 Jul 28 03:46:51.434029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b1190d0-a175-4f78-902c-f14aa1ecfba8 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:51.437872 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1347/2457] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:46:51 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:46:51.449868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b1190d0-a175-4f78-902c-f14aa1ecfba8 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:51.456195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-8bb21420-fa16-45f2-accd-9c070aac0c8a req-fdf0695e-d2aa-4c5f-bf7a-ba66889b6f11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb90f51f-bde2-4468-bc8d-06533d38ac7e", "tag": "1bb348f3-d6bf-460d-abb8-7ba8994f5a22"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:51.462469 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b1190d0-a175-4f78-902c-f14aa1ecfba8 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:51.482221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8bb21420-fa16-45f2-accd-9c070aac0c8a req-fdf0695e-d2aa-4c5f-bf7a-ba66889b6f11 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:51.482931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8bb21420-fa16-45f2-accd-9c070aac0c8a req-fdf0695e-d2aa-4c5f-bf7a-ba66889b6f11 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:51.516561 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-8bb21420-fa16-45f2-accd-9c070aac0c8a req-fdf0695e-d2aa-4c5f-bf7a-ba66889b6f11 service nova] Creating event network-changed:1bb348f3-d6bf-460d-abb8-7ba8994f5a22 for instance eb90f51f-bde2-4468-bc8d-06533d38ac7e on n-h1-826756-3 Jul 28 03:46:51.534009 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-8bb21420-fa16-45f2-accd-9c070aac0c8a req-fdf0695e-d2aa-4c5f-bf7a-ba66889b6f11 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090634 Jul 28 03:46:51.540663 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1348/2458] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:46:51.587690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-407eaaeb-5d9d-4c7d-b2bb-82e13e93065b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:51.597823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-407eaaeb-5d9d-4c7d-b2bb-82e13e93065b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:51.629328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-407eaaeb-5d9d-4c7d-b2bb-82e13e93065b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:51.630251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-407eaaeb-5d9d-4c7d-b2bb-82e13e93065b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:51.631952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-407eaaeb-5d9d-4c7d-b2bb-82e13e93065b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:51.641773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-407eaaeb-5d9d-4c7d-b2bb-82e13e93065b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:52.250371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-407eaaeb-5d9d-4c7d-b2bb-82e13e93065b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:52.270150 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-407eaaeb-5d9d-4c7d-b2bb-82e13e93065b tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1676 microversion: 2.1 time: 0.709970 Jul 28 03:46:52.271065 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1349/2459] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:51 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1676 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:52.291576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce757581-6b70-424a-874f-a6d34b1978ce tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa67940550>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:52.432058 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce757581-6b70-424a-874f-a6d34b1978ce tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.157773 Jul 28 03:46:52.441402 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1350/2460] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:52 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:52.454406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a701f91a-4132-4e98-b93c-1dca3943d734 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:52.457675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a701f91a-4132-4e98-b93c-1dca3943d734 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:52.475849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a701f91a-4132-4e98-b93c-1dca3943d734 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:52.479790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a701f91a-4132-4e98-b93c-1dca3943d734 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:52.481208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a701f91a-4132-4e98-b93c-1dca3943d734 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:52.483204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a701f91a-4132-4e98-b93c-1dca3943d734 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:52.621601 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0b1190d0-a175-4f78-902c-f14aa1ecfba8 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:52.636917 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0b1190d0-a175-4f78-902c-f14aa1ecfba8 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1588 microversion: 2.1 time: 1.285658 Jul 28 03:46:52.638229 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1111/2461] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:51 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1588 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:53.294619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-23875843-e22e-4eed-8281-88384d964f14 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:53.295250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-23875843-e22e-4eed-8281-88384d964f14 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:53.315601 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23875843-e22e-4eed-8281-88384d964f14 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:53.316067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23875843-e22e-4eed-8281-88384d964f14 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:53.317812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23875843-e22e-4eed-8281-88384d964f14 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:53.318259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23875843-e22e-4eed-8281-88384d964f14 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:53.878763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a701f91a-4132-4e98-b93c-1dca3943d734 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:53.887802 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a701f91a-4132-4e98-b93c-1dca3943d734 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1477 microversion: 2.1 time: 1.444924 Jul 28 03:46:53.897109 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1351/2462] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:52 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1477 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:53.922506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-02a8135d-78f0-464f-a6d4-1acf9b0b9029 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6798d310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:54.012242 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-02a8135d-78f0-464f-a6d4-1acf9b0b9029 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.094851 Jul 28 03:46:54.013007 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1352/2463] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:53 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:54.485438 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=66 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:46:54.926845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-23875843-e22e-4eed-8281-88384d964f14 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:54.929186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-56a85fd7-5ba8-4610-b7a1-111796bb6490 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:54.931367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-56a85fd7-5ba8-4610-b7a1-111796bb6490 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:54.941901 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-23875843-e22e-4eed-8281-88384d964f14 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1659 microversion: 2.1 time: 1.651193 Jul 28 03:46:54.942793 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1112/2464] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:53 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1659 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:46:54.967038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56a85fd7-5ba8-4610-b7a1-111796bb6490 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:54.971749 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4d71d613-611a-4838-982b-52a1afbb1d3e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:54.973111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4d71d613-611a-4838-982b-52a1afbb1d3e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:54.979660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56a85fd7-5ba8-4610-b7a1-111796bb6490 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:54.984267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56a85fd7-5ba8-4610-b7a1-111796bb6490 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:54.987551 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4d71d613-611a-4838-982b-52a1afbb1d3e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:54.989591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4d71d613-611a-4838-982b-52a1afbb1d3e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:54.990628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4d71d613-611a-4838-982b-52a1afbb1d3e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:54.991265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4d71d613-611a-4838-982b-52a1afbb1d3e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:55.001933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56a85fd7-5ba8-4610-b7a1-111796bb6490 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:55.185589 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4d71d613-611a-4838-982b-52a1afbb1d3e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action" status: 202 len: 0 microversion: 2.1 time: 0.222039 Jul 28 03:46:55.187118 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1113/2465] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:46:54 2022] POST /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:46:55.208309 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d4adada1-afe3-4e63-9b13-5d6f73a7b7bc tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa7469ee50>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:55.435109 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d4adada1-afe3-4e63-9b13-5d6f73a7b7bc tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.244949 Jul 28 03:46:55.438336 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1114/2466] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:55 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:55.455983 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fe4746e1-c759-4d8e-bf3b-3bf18a4926c1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:55.461217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fe4746e1-c759-4d8e-bf3b-3bf18a4926c1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:55.484928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe4746e1-c759-4d8e-bf3b-3bf18a4926c1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:55.487459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe4746e1-c759-4d8e-bf3b-3bf18a4926c1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:55.490227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe4746e1-c759-4d8e-bf3b-3bf18a4926c1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:55.495763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe4746e1-c759-4d8e-bf3b-3bf18a4926c1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:55.755367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-56a85fd7-5ba8-4610-b7a1-111796bb6490 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:55.778591 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-56a85fd7-5ba8-4610-b7a1-111796bb6490 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1477 microversion: 2.1 time: 0.856545 Jul 28 03:46:55.783232 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1353/2467] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:54 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1477 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:56.332874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fe4746e1-c759-4d8e-bf3b-3bf18a4926c1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:56.343631 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fe4746e1-c759-4d8e-bf3b-3bf18a4926c1 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1665 microversion: 2.1 time: 0.903104 Jul 28 03:46:56.350222 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1115/2468] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:55 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1665 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:56.451292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f60d0387-78d8-40f9-b8bf-8130cea8f382 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa741174c0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:56.557805 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f60d0387-78d8-40f9-b8bf-8130cea8f382 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.110343 Jul 28 03:46:56.558717 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1354/2469] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:56 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:56.800712 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0583c707-13ae-44fd-9b1c-38fd456be307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:56.801328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0583c707-13ae-44fd-9b1c-38fd456be307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:56.821943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0583c707-13ae-44fd-9b1c-38fd456be307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:56.822294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0583c707-13ae-44fd-9b1c-38fd456be307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:56.831771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0583c707-13ae-44fd-9b1c-38fd456be307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:56.839163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0583c707-13ae-44fd-9b1c-38fd456be307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:57.482623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2138c9be-1251-488d-ba10-ccdf4e3fdcb5 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] Action: 'create', calling method: .version_select at 0x7ffa745d68b0>, body: {"pool": null} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:58.014898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0583c707-13ae-44fd-9b1c-38fd456be307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:58.034536 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0583c707-13ae-44fd-9b1c-38fd456be307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1477 microversion: 2.1 time: 1.237683 Jul 28 03:46:58.038416 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1116/2470] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:56 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1477 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:58.047212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b1b57df3-233e-4a65-87d9-147f3576b3cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:58.048091 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b1b57df3-233e-4a65-87d9-147f3576b3cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:46:58.071083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b1b57df3-233e-4a65-87d9-147f3576b3cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:58.072653 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b1b57df3-233e-4a65-87d9-147f3576b3cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:58.075771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b1b57df3-233e-4a65-87d9-147f3576b3cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:46:58.076396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b1b57df3-233e-4a65-87d9-147f3576b3cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:46:58.649223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b1b57df3-233e-4a65-87d9-147f3576b3cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:46:58.698817 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b1b57df3-233e-4a65-87d9-147f3576b3cb tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1665 microversion: 2.1 time: 0.653160 Jul 28 03:46:58.704582 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1117/2471] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:46:58 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1665 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:58.740007 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-580decfd-92e9-459f-85a3-5bf4dcc44b66 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74522b80>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:46:58.942482 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-580decfd-92e9-459f-85a3-5bf4dcc44b66 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1455 microversion: 2.1 time: 0.234168 Jul 28 03:46:58.950710 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1118/2472] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:46:58 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1455 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:46:59.004151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "a5330ca8-c4b2-4792-bc07-cb0b076cc98c"}], "security_groups": [{"name": "tempest-securitygroup--1183013519"}], "key_name": "tempest-keypair-1182726196", "user_data": "}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:46:59.395068 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] validate_networks() for [('a5330ca8-c4b2-4792-bc07-cb0b076cc98c', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:47:00.601465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:47:00.602148 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:47:00.602694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:47:00.603204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:47:00.603720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:47:00.630605 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:00.631199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:00.633952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:00.634693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:00.718926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Getting quotas for project 759506bd247a40d59e76d660d408755e. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:47:00.753264 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Getting quotas for user 4289787d6b5e412e8ab5928df4ca9bd7 and project 759506bd247a40d59e76d660d408755e. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:47:00.792542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:47:00.795962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:47:00.911165 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bfbf1d0c-b485-4605-b20d-a855ab5e6dbd tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.911931 Jul 28 03:47:00.912210 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1119/2473] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:46:58 2022] POST /compute/v2.1/servers => generated 409 bytes in 1914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:47:00.917237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b7000e3f-be9f-4174-8936-03bb0720c961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:00.918044 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b7000e3f-be9f-4174-8936-03bb0720c961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:00.926323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7000e3f-be9f-4174-8936-03bb0720c961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:00.926779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7000e3f-be9f-4174-8936-03bb0720c961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:00.927732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7000e3f-be9f-4174-8936-03bb0720c961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:00.928185 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7000e3f-be9f-4174-8936-03bb0720c961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:01.106462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=16 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:01.224573 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b7000e3f-be9f-4174-8936-03bb0720c961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:01.243241 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b7000e3f-be9f-4174-8936-03bb0720c961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1477 microversion: 2.1 time: 0.329883 Jul 28 03:47:01.244200 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1120/2474] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:00 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1477 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:01.249220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-20af49df-f833-4f22-8c46-78b05103b10f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:01.250388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-20af49df-f833-4f22-8c46-78b05103b10f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:01.269394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20af49df-f833-4f22-8c46-78b05103b10f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:01.269849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20af49df-f833-4f22-8c46-78b05103b10f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:01.270647 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20af49df-f833-4f22-8c46-78b05103b10f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:01.271084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20af49df-f833-4f22-8c46-78b05103b10f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:01.521067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-20af49df-f833-4f22-8c46-78b05103b10f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:01.535178 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-20af49df-f833-4f22-8c46-78b05103b10f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.289339 Jul 28 03:47:01.552074 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1121/2475] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:01 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:01.557748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-37765fb1-66ff-4060-a43b-c087f3475e20 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74522310>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:01.577851 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2138c9be-1251-488d-ba10-ccdf4e3fdcb5 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.557105 Jul 28 03:47:01.587625 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1355/2476] 10.222.0.48 () {60 vars in 1170 bytes} [Thu Jul 28 03:46:57 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:47:01.593333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a9afcee1-cc45-46c4-893b-3c98d965df7e tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:01.594546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a9afcee1-cc45-46c4-893b-3c98d965df7e tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:01.618761 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-37765fb1-66ff-4060-a43b-c087f3475e20 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1464 microversion: 2.1 time: 0.064793 Jul 28 03:47:01.620121 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1122/2477] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:01 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1464 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:01.636725 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f5bb7428-90ee-47ae-b520-76ce038e7130 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:01.637537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f5bb7428-90ee-47ae-b520-76ce038e7130 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:01.647010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f5bb7428-90ee-47ae-b520-76ce038e7130 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:01.647917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f5bb7428-90ee-47ae-b520-76ce038e7130 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:01.649341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f5bb7428-90ee-47ae-b520-76ce038e7130 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:01.650148 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f5bb7428-90ee-47ae-b520-76ce038e7130 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:01.851999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f5bb7428-90ee-47ae-b520-76ce038e7130 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:01.863687 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f5bb7428-90ee-47ae-b520-76ce038e7130 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1668 microversion: 2.1 time: 0.233381 Jul 28 03:47:01.864700 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1123/2478] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:01 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1668 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:01.870364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8d7ea75f-10d0-4410-b8fb-3d132426222a tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] Action: 'create', calling method: .version_select at 0x7ffa746570d0>, body: {"pool": null} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:01.919353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a9afcee1-cc45-46c4-893b-3c98d965df7e tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4289787d6b5e412e8ab5928df4ca9bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759506bd247a40d59e76d660d408755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:01.927953 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a9afcee1-cc45-46c4-893b-3c98d965df7e tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 200 len: 1226 microversion: 2.1 time: 0.338752 Jul 28 03:47:01.958751 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1356/2479] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:01 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 1226 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:01.968438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-53b8a368-8949-41a7-8d97-ff9ea2f6f553 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa679571f0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:02.038557 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-53b8a368-8949-41a7-8d97-ff9ea2f6f553 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 200 len: 1464 microversion: 2.1 time: 0.076958 Jul 28 03:47:02.039725 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1357/2480] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:01 2022] GET /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 1464 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:02.045688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:02.046373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:02.055922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:02.056575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:02.057454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:02.058682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:02.102895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:47:02.111700 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.compute.api [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Working on deleting snapshot 391ac139-79c5-4e4c-b72f-932de42380de from shelved instance... Jul 28 03:47:03.264326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Doing local delete in cell a8b3e198-f422-4bf1-ae6c-bd38905d4b84(cell1) {{(pid=126071) _delete /opt/stack/nova/nova/compute/api.py:2535}} Jul 28 03:47:03.265408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:03.265927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:03.266428 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.compute.api [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 28 03:47:03.272694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] deallocate_for_instance() {{(pid=126071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 03:47:04.510319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Updating instance_info_cache with network_info: [] {{(pid=126071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 03:47:04.568564 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8d7ea75f-10d0-4410-b8fb-3d132426222a tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.702458 Jul 28 03:47:04.569154 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1124/2481] 10.222.0.48 () {60 vars in 1170 bytes} [Thu Jul 28 03:47:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:04.578152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-97225b6f-c908-4539-9ccf-6e4e0b7ffad2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:04.578917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-97225b6f-c908-4539-9ccf-6e4e0b7ffad2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:04.601932 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-97225b6f-c908-4539-9ccf-6e4e0b7ffad2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:04.602692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-97225b6f-c908-4539-9ccf-6e4e0b7ffad2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:04.603789 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-97225b6f-c908-4539-9ccf-6e4e0b7ffad2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:04.604981 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-97225b6f-c908-4539-9ccf-6e4e0b7ffad2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:05.087076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-97225b6f-c908-4539-9ccf-6e4e0b7ffad2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:05.125006 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-97225b6f-c908-4539-9ccf-6e4e0b7ffad2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1467 microversion: 2.1 time: 0.538339 Jul 28 03:47:05.128139 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1125/2482] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:04 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1467 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:05.162367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-00af413d-f1c1-4b61-8a91-d14dbb761456 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:05.163603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-00af413d-f1c1-4b61-8a91-d14dbb761456 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:05.185238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00af413d-f1c1-4b61-8a91-d14dbb761456 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:05.185978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00af413d-f1c1-4b61-8a91-d14dbb761456 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:05.188203 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00af413d-f1c1-4b61-8a91-d14dbb761456 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:05.188957 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00af413d-f1c1-4b61-8a91-d14dbb761456 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:05.198040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:05.271907 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ae5694d3-f15c-4193-8d57-958c1e3f6781 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "DELETE /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 204 len: 0 microversion: 2.1 time: 3.229929 Jul 28 03:47:05.272574 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1358/2483] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:47:02 2022] DELETE /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 0 bytes in 3232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:05.282044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4cc34555-0013-4290-aeef-4d588a0665ff tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:05.282756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4cc34555-0013-4290-aeef-4d588a0665ff tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:05.298088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cc34555-0013-4290-aeef-4d588a0665ff tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:05.299266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cc34555-0013-4290-aeef-4d588a0665ff tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:05.300037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cc34555-0013-4290-aeef-4d588a0665ff tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:05.300541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cc34555-0013-4290-aeef-4d588a0665ff tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:05.476077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4cc34555-0013-4290-aeef-4d588a0665ff tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4289787d6b5e412e8ab5928df4ca9bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759506bd247a40d59e76d660d408755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:05.484857 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4cc34555-0013-4290-aeef-4d588a0665ff tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 200 len: 1352 microversion: 2.1 time: 0.207173 Jul 28 03:47:05.485374 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1359/2484] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:05 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 1352 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:05.560459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-00af413d-f1c1-4b61-8a91-d14dbb761456 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:05.587884 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-00af413d-f1c1-4b61-8a91-d14dbb761456 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1477 microversion: 2.1 time: 0.458234 Jul 28 03:47:05.588586 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1126/2485] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:05 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1477 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:05.590087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-03371212-9425-4879-956a-f45d57cd2649 req-0249f8de-a5da-4d0b-8827-bdc120c44bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35fa1b51-1663-49af-b9e3-2aca487ece39", "name": "network-vif-deleted", "tag": "b22bdd6c-d4ca-481d-b617-ff52448c390d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:05.593696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3a8afc2a-cd23-4c60-abcb-98eb6ae05c22 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] Action: 'create', calling method: .version_select at 0x7ffa7485ddc0>, body: {"pool": null} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:05.606463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-03371212-9425-4879-956a-f45d57cd2649 req-0249f8de-a5da-4d0b-8827-bdc120c44bb4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:05.606905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-03371212-9425-4879-956a-f45d57cd2649 req-0249f8de-a5da-4d0b-8827-bdc120c44bb4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:05.619824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.compute.server_external_events [req-03371212-9425-4879-956a-f45d57cd2649 req-0249f8de-a5da-4d0b-8827-bdc120c44bb4 service nova] Unable to find a host for instance 35fa1b51-1663-49af-b9e3-2aca487ece39. Dropping event network-vif-deleted {{(pid=126071) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 03:47:05.620774 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-03371212-9425-4879-956a-f45d57cd2649 req-0249f8de-a5da-4d0b-8827-bdc120c44bb4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.134264 Jul 28 03:47:05.621383 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1360/2486] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 135 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 03:47:05.687576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-986849023", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "0969d9fa-8714-4f2d-95bc-e8ae1d38fd03"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:05.757550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] validate_networks() for [('0969d9fa-8714-4f2d-95bc-e8ae1d38fd03', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:47:06.368197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:47:06.368784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:47:06.369363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:47:06.369842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:47:06.370408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:47:06.380319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:06.380875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:06.381748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:06.386094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:06.410051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Getting quotas for project 0363dea81e364b0dbd3bed54f05183a8. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:47:06.429190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Getting quotas for user 848ccf5a5a7749ecb55a5a431a5f3145 and project 0363dea81e364b0dbd3bed54f05183a8. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:47:06.451565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:47:06.454164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:47:06.534715 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d6e4ee93-5a79-497e-ac73-83960f935c6c tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908685 Jul 28 03:47:06.535479 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1361/2487] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:47:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:47:06.548036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-727f4bcb-9f32-4a04-abb2-49f4d8874eae req-3e93b36c-048b-4a51-b303-da9f556210b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1d50cc-a245-45b8-a35d-7e6dcc1d2015", "name": "network-vif-unplugged", "status": "completed", "tag": "42fe0509-4544-4491-a652-a3e7790cc649"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:06.584804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-727f4bcb-9f32-4a04-abb2-49f4d8874eae req-3e93b36c-048b-4a51-b303-da9f556210b8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:06.588952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-727f4bcb-9f32-4a04-abb2-49f4d8874eae req-3e93b36c-048b-4a51-b303-da9f556210b8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:06.616896 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-727f4bcb-9f32-4a04-abb2-49f4d8874eae req-3e93b36c-048b-4a51-b303-da9f556210b8 service nova] Creating event network-vif-unplugged:42fe0509-4544-4491-a652-a3e7790cc649 for instance 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 on n-h2-826756-3 Jul 28 03:47:06.630307 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-727f4bcb-9f32-4a04-abb2-49f4d8874eae req-3e93b36c-048b-4a51-b303-da9f556210b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093556 Jul 28 03:47:06.631570 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1362/2488] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:06.644086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4ca16c0-cc4e-4b7b-aa98-a663a1d31453 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1431519146"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:06.657016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d4ca16c0-cc4e-4b7b-aa98-a663a1d31453 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 58a40da4-0f01-4368-835f-9c3b550eb137] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:06.666301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4ca16c0-cc4e-4b7b-aa98-a663a1d31453 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:06.666665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4ca16c0-cc4e-4b7b-aa98-a663a1d31453 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:06.667458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4ca16c0-cc4e-4b7b-aa98-a663a1d31453 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:06.667901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4ca16c0-cc4e-4b7b-aa98-a663a1d31453 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:06.992906 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d4ca16c0-cc4e-4b7b-aa98-a663a1d31453 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "POST /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137/action" status: 202 len: 0 microversion: 2.1 time: 0.359619 Jul 28 03:47:06.994418 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1363/2489] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:47:06 2022] POST /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 03:47:07.000334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3caf2575-bfb2-48aa-ab67-c653c1258bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:07.001445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3caf2575-bfb2-48aa-ab67-c653c1258bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 35fa1b51-1663-49af-b9e3-2aca487ece39] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:07.009704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3caf2575-bfb2-48aa-ab67-c653c1258bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:07.010522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3caf2575-bfb2-48aa-ab67-c653c1258bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:07.011535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3caf2575-bfb2-48aa-ab67-c653c1258bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:07.012187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3caf2575-bfb2-48aa-ab67-c653c1258bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:07.047026 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-3caf2575-bfb2-48aa-ab67-c653c1258bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] HTTP exception thrown: Instance 35fa1b51-1663-49af-b9e3-2aca487ece39 could not be found. Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3caf2575-bfb2-48aa-ab67-c653c1258bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Request method failure captured: Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 HTTP/1.1 Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRDP1iWHaD9HAxV7lPiGaBCA98FdCzWWfXnmkEsHPedE1oooQh-xW9JE4w71iBHhRDCvimx8IG2PwPLfvOCapZtWjeVe5xWcXBjyRkBb6hdFDwPdZkSK1ZEyvKcvyrl85YENZuOv85xnb6f8tNb_2DFAB_r9-AWzlzrWYMd8S2Gojo Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: b7bee0b59b0b43ce80623b7aca24111a Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7bee0b59b0b43ce80623b7aca24111a"}]}] Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: b7bee0b59b0b43ce80623b7aca24111a Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-1388238885-project Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 26b9a63a13e1420aa3b7f299456c65e6 Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-1388238885-project Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 35fa1b51-1663-49af-b9e3-2aca487ece39 could not be found. Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '35fa1b51-1663-49af-b9e3-2aca487ece39'} Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35fa1b51-1663-49af-b9e3-2aca487ece39 could not be found. Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35fa1b51-1663-49af-b9e3-2aca487ece39 could not be found. Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:07.053066 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:07.056898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:07.056898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:07.056898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:07.056898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:47:07.056898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:47:07.056898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35fa1b51-1663-49af-b9e3-2aca487ece39 could not be found. Jul 28 03:47:07.056898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:07.062298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3caf2575-bfb2-48aa-ab67-c653c1258bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Returning 404 to user: Instance 35fa1b51-1663-49af-b9e3-2aca487ece39 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:47:07.065571 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3caf2575-bfb2-48aa-ab67-c653c1258bb2 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39" status: 404 len: 111 microversion: 2.1 time: 0.068447 Jul 28 03:47:07.069482 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1364/2490] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:06 2022] GET /compute/v2.1/servers/35fa1b51-1663-49af-b9e3-2aca487ece39 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:47:07.078467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b31644ee-6b49-4798-866b-82e0f723ee56 req-7bcbeeea-f0a8-4ce2-a438-3fb11ca7f981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb362b3-647a-479e-951d-e49d4d370136", "tag": "3c19fad7-bd41-4df7-b15a-7f21e44fbf8e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:07.103699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b31644ee-6b49-4798-866b-82e0f723ee56 req-7bcbeeea-f0a8-4ce2-a438-3fb11ca7f981 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:07.105672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b31644ee-6b49-4798-866b-82e0f723ee56 req-7bcbeeea-f0a8-4ce2-a438-3fb11ca7f981 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:07.134123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=18,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:07.136894 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b31644ee-6b49-4798-866b-82e0f723ee56 req-7bcbeeea-f0a8-4ce2-a438-3fb11ca7f981 service nova] Creating event network-changed:3c19fad7-bd41-4df7-b15a-7f21e44fbf8e for instance dbb362b3-647a-479e-951d-e49d4d370136 on n-h2-826756-3 Jul 28 03:47:07.143724 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b31644ee-6b49-4798-866b-82e0f723ee56 req-7bcbeeea-f0a8-4ce2-a438-3fb11ca7f981 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073900 Jul 28 03:47:07.144825 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1365/2491] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:07.150460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-10585476-69e7-412c-bc5e-24b30632e434 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:07.151318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-10585476-69e7-412c-bc5e-24b30632e434 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:07.158568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10585476-69e7-412c-bc5e-24b30632e434 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:07.159149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10585476-69e7-412c-bc5e-24b30632e434 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:07.160116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10585476-69e7-412c-bc5e-24b30632e434 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:07.160683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10585476-69e7-412c-bc5e-24b30632e434 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:07.645105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-10585476-69e7-412c-bc5e-24b30632e434 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4289787d6b5e412e8ab5928df4ca9bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759506bd247a40d59e76d660d408755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:07.654605 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-10585476-69e7-412c-bc5e-24b30632e434 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 200 len: 1352 microversion: 2.1 time: 0.508430 Jul 28 03:47:07.655356 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1366/2492] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:07 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 1352 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:07.661601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9c900e8-b22f-46ba-8903-b0e91f9ee961 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:07.662471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9c900e8-b22f-46ba-8903-b0e91f9ee961 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:07.666566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:07.674396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9c900e8-b22f-46ba-8903-b0e91f9ee961 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:07.674396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9c900e8-b22f-46ba-8903-b0e91f9ee961 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:07.674396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9c900e8-b22f-46ba-8903-b0e91f9ee961 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:07.674396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9c900e8-b22f-46ba-8903-b0e91f9ee961 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:07.758988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b9c900e8-b22f-46ba-8903-b0e91f9ee961 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:07.769601 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9c900e8-b22f-46ba-8903-b0e91f9ee961 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1211 microversion: 2.1 time: 0.112876 Jul 28 03:47:07.770226 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1367/2493] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:07 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1211 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:07.774942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6ef8e50b-365c-4b8d-a297-b81c7b19e17a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:07.775610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6ef8e50b-365c-4b8d-a297-b81c7b19e17a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:07.782395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ef8e50b-365c-4b8d-a297-b81c7b19e17a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:07.782844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ef8e50b-365c-4b8d-a297-b81c7b19e17a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:07.783620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ef8e50b-365c-4b8d-a297-b81c7b19e17a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:07.784049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ef8e50b-365c-4b8d-a297-b81c7b19e17a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:07.966074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6ef8e50b-365c-4b8d-a297-b81c7b19e17a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:07.974494 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6ef8e50b-365c-4b8d-a297-b81c7b19e17a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1477 microversion: 2.1 time: 0.203114 Jul 28 03:47:07.975074 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1368/2494] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:07 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1477 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:07.980038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e02e3e65-fad6-42f9-8663-b77b1df8a37d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa67957550>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:07.990726 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3a8afc2a-cd23-4c60-abcb-98eb6ae05c22 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.400937 Jul 28 03:47:07.991262 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1127/2495] 10.222.0.48 () {60 vars in 1170 bytes} [Thu Jul 28 03:47:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:07.996153 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-babd94c4-2177-4fd1-bc6f-159a9639b5b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:07.996924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-babd94c4-2177-4fd1-bc6f-159a9639b5b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:08.007486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-babd94c4-2177-4fd1-bc6f-159a9639b5b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:08.008241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-babd94c4-2177-4fd1-bc6f-159a9639b5b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:08.009091 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-babd94c4-2177-4fd1-bc6f-159a9639b5b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:08.009585 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-babd94c4-2177-4fd1-bc6f-159a9639b5b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:08.034269 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e02e3e65-fad6-42f9-8663-b77b1df8a37d tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.057852 Jul 28 03:47:08.035198 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1369/2496] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:07 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:08.039344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-babd94c4-2177-4fd1-bc6f-159a9639b5b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:47:08.042336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa45f8c8-bfbc-49ef-b3c2-8928ef176677 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] Action: 'create', calling method: .version_select at 0x7ffa6798d3a0>, body: {"pool": null} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:08.146693 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-babd94c4-2177-4fd1-bc6f-159a9639b5b0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 204 len: 0 microversion: 2.1 time: 0.153681 Jul 28 03:47:08.147798 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1128/2497] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:47:07 2022] DELETE /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:08.159417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c1fed44b-0e63-4332-9aed-eadd24050cd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:08.160065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c1fed44b-0e63-4332-9aed-eadd24050cd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:08.166530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c1fed44b-0e63-4332-9aed-eadd24050cd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:08.166980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c1fed44b-0e63-4332-9aed-eadd24050cd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:08.167839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c1fed44b-0e63-4332-9aed-eadd24050cd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:08.168210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c1fed44b-0e63-4332-9aed-eadd24050cd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:08.284077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c1fed44b-0e63-4332-9aed-eadd24050cd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:08.304185 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c1fed44b-0e63-4332-9aed-eadd24050cd0 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1464 microversion: 2.1 time: 0.150305 Jul 28 03:47:08.319340 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1129/2498] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:08 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1464 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:08.680608 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-666c9ccc-2b2c-42b4-8c56-2ebe7a1ada53 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:08.681274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-666c9ccc-2b2c-42b4-8c56-2ebe7a1ada53 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:08.690138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-666c9ccc-2b2c-42b4-8c56-2ebe7a1ada53 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:08.690701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-666c9ccc-2b2c-42b4-8c56-2ebe7a1ada53 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:08.691539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-666c9ccc-2b2c-42b4-8c56-2ebe7a1ada53 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:08.692305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-666c9ccc-2b2c-42b4-8c56-2ebe7a1ada53 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:08.974965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-666c9ccc-2b2c-42b4-8c56-2ebe7a1ada53 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4289787d6b5e412e8ab5928df4ca9bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759506bd247a40d59e76d660d408755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:08.984939 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-666c9ccc-2b2c-42b4-8c56-2ebe7a1ada53 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 200 len: 1352 microversion: 2.1 time: 0.312075 Jul 28 03:47:08.989316 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1130/2499] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:08 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 1352 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:08.994500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-62654875-ba69-436b-8ce1-afabe46b9d59 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:08.995151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-62654875-ba69-436b-8ce1-afabe46b9d59 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:09.016410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-62654875-ba69-436b-8ce1-afabe46b9d59 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:09.016410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-62654875-ba69-436b-8ce1-afabe46b9d59 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:09.017804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-62654875-ba69-436b-8ce1-afabe46b9d59 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:09.018409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-62654875-ba69-436b-8ce1-afabe46b9d59 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:09.125544 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-62654875-ba69-436b-8ce1-afabe46b9d59 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:09.134808 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-62654875-ba69-436b-8ce1-afabe46b9d59 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1267 microversion: 2.1 time: 0.143806 Jul 28 03:47:09.135660 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1131/2500] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:08 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:09.143587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c4fc7b93-96d8-49dc-9235-1479365e256b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:09.144679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c4fc7b93-96d8-49dc-9235-1479365e256b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:09.166665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4fc7b93-96d8-49dc-9235-1479365e256b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:09.167133 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4fc7b93-96d8-49dc-9235-1479365e256b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:09.167922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4fc7b93-96d8-49dc-9235-1479365e256b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:09.168443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4fc7b93-96d8-49dc-9235-1479365e256b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:09.358672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c4fc7b93-96d8-49dc-9235-1479365e256b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:09.373517 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c4fc7b93-96d8-49dc-9235-1479365e256b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1477 microversion: 2.1 time: 0.236111 Jul 28 03:47:09.388850 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1132/2501] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:09 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1477 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:09.399441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-be2cbf5e-5d2d-4b1a-baab-1ee16f54109c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74522280>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:09.462472 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-be2cbf5e-5d2d-4b1a-baab-1ee16f54109c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.070988 Jul 28 03:47:09.472111 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1133/2502] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:09 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:09.479627 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3b10a499-384c-4f92-a820-8775608db206 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:09.480817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3b10a499-384c-4f92-a820-8775608db206 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:09.488766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b10a499-384c-4f92-a820-8775608db206 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:09.489496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b10a499-384c-4f92-a820-8775608db206 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:09.490518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b10a499-384c-4f92-a820-8775608db206 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:09.491140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b10a499-384c-4f92-a820-8775608db206 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:09.598363 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fa45f8c8-bfbc-49ef-b3c2-8928ef176677 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.561848 Jul 28 03:47:09.600623 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1370/2503] 10.222.0.48 () {60 vars in 1170 bytes} [Thu Jul 28 03:47:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:09.614665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca6a2abf-1dfb-47d3-b55a-aa42441d7cf4 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] Calling method '.version_select at 0x7ffa74239280>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:09.730539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3b10a499-384c-4f92-a820-8775608db206 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:09.748673 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3b10a499-384c-4f92-a820-8775608db206 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1464 microversion: 2.1 time: 0.274752 Jul 28 03:47:09.795023 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1134/2504] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:09 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1464 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:10.010563 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca6a2abf-1dfb-47d3-b55a-aa42441d7cf4 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips/88aa091c-f80c-4e82-a0be-b6ac2a252058" status: 200 len: 142 microversion: 2.1 time: 0.402827 Jul 28 03:47:10.011765 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1371/2505] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Jul 28 03:47:09 2022] GET /compute/v2.1/os-floating-ips/88aa091c-f80c-4e82-a0be-b6ac2a252058 => generated 142 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:47:10.021097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3524c83a-f1d5-4d26-8aa2-5af19346fc3d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:10.025765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3524c83a-f1d5-4d26-8aa2-5af19346fc3d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:10.026408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ac20cfbc-0124-4a51-9226-7b8ad184ef42 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] Calling method '.version_select at 0x7ffa67957160>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:10.060761 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3524c83a-f1d5-4d26-8aa2-5af19346fc3d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:10.061278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3524c83a-f1d5-4d26-8aa2-5af19346fc3d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:10.062183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3524c83a-f1d5-4d26-8aa2-5af19346fc3d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:10.062628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3524c83a-f1d5-4d26-8aa2-5af19346fc3d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:10.677600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:10.769589 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:11.129320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3524c83a-f1d5-4d26-8aa2-5af19346fc3d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4289787d6b5e412e8ab5928df4ca9bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759506bd247a40d59e76d660d408755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:11.149138 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3524c83a-f1d5-4d26-8aa2-5af19346fc3d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 200 len: 1352 microversion: 2.1 time: 1.139850 Jul 28 03:47:11.153122 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1135/2506] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:10 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 1352 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:11.162761 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-da008e49-d61e-4e0f-9fda-c5509d38d4d5 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:11.164074 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-da008e49-d61e-4e0f-9fda-c5509d38d4d5 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:11.188434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-da008e49-d61e-4e0f-9fda-c5509d38d4d5 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:11.190709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-da008e49-d61e-4e0f-9fda-c5509d38d4d5 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:11.192590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-da008e49-d61e-4e0f-9fda-c5509d38d4d5 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:11.193453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-da008e49-d61e-4e0f-9fda-c5509d38d4d5 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:11.339840 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-da008e49-d61e-4e0f-9fda-c5509d38d4d5 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:11.364383 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ac20cfbc-0124-4a51-9226-7b8ad184ef42 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/88aa091c-f80c-4e82-a0be-b6ac2a252058" status: 202 len: 0 microversion: 2.1 time: 1.343914 Jul 28 03:47:11.365298 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1372/2507] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:47:10 2022] DELETE /compute/v2.1/os-floating-ips/88aa091c-f80c-4e82-a0be-b6ac2a252058 => generated 0 bytes in 1346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:47:11.375387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-96243458-3676-48cb-9b41-85992e204022 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:11.379164 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-da008e49-d61e-4e0f-9fda-c5509d38d4d5 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1273 microversion: 2.1 time: 0.220923 Jul 28 03:47:11.380313 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1136/2508] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:11 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:11.383310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-96243458-3676-48cb-9b41-85992e204022 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:11.404943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-64efa2cc-a8f2-4ea6-9662-02913d8ab950 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa745c8af0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:11.410752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96243458-3676-48cb-9b41-85992e204022 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:11.411528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96243458-3676-48cb-9b41-85992e204022 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:11.412366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96243458-3676-48cb-9b41-85992e204022 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:11.412939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96243458-3676-48cb-9b41-85992e204022 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:11.458593 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-64efa2cc-a8f2-4ea6-9662-02913d8ab950 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.073430 Jul 28 03:47:11.459486 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1137/2509] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:11 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:11.466285 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-175f35e5-88b3-43e2-b328-bc48c1c28572 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:11.467228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-175f35e5-88b3-43e2-b328-bc48c1c28572 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:11.474517 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-175f35e5-88b3-43e2-b328-bc48c1c28572 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:11.474957 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-175f35e5-88b3-43e2-b328-bc48c1c28572 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:11.475707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-175f35e5-88b3-43e2-b328-bc48c1c28572 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:11.476319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-175f35e5-88b3-43e2-b328-bc48c1c28572 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:11.594112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-96243458-3676-48cb-9b41-85992e204022 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:11.602792 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-96243458-3676-48cb-9b41-85992e204022 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1477 microversion: 2.1 time: 0.236218 Jul 28 03:47:11.603703 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1373/2510] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:11 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1477 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:11.608679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9f54ab85-8c6d-4874-b8e2-acedd3099902 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] Calling method '.version_select at 0x7ffa67959af0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:11.677488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-175f35e5-88b3-43e2-b328-bc48c1c28572 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:11.689180 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-175f35e5-88b3-43e2-b328-bc48c1c28572 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1464 microversion: 2.1 time: 0.228077 Jul 28 03:47:11.690768 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1138/2511] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:11 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1464 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:11.858032 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9f54ab85-8c6d-4874-b8e2-acedd3099902 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.252971 Jul 28 03:47:11.858754 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1374/2512] 10.222.0.48 () {58 vars in 1164 bytes} [Thu Jul 28 03:47:11 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:47:11.875316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-25c70237-4c91-44f2-8e69-cca3fefa253a tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] Calling method '.version_select at 0x7ffa745c8280>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:12.160945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a435103f-2aef-4243-801f-813cf2a9e41d req-7e73f353-3757-4d62-b4d5-cc4df80932b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a40da4-0f01-4368-835f-9c3b550eb137", "name": "network-vif-plugged", "status": "completed", "tag": "efeda983-f05c-4f23-9d79-30d55c7ec8d7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:12.195860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a435103f-2aef-4243-801f-813cf2a9e41d req-7e73f353-3757-4d62-b4d5-cc4df80932b0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:12.197205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a435103f-2aef-4243-801f-813cf2a9e41d req-7e73f353-3757-4d62-b4d5-cc4df80932b0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:12.214443 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a435103f-2aef-4243-801f-813cf2a9e41d req-7e73f353-3757-4d62-b4d5-cc4df80932b0 service nova] Creating event network-vif-plugged:efeda983-f05c-4f23-9d79-30d55c7ec8d7 for instance 58a40da4-0f01-4368-835f-9c3b550eb137 on n-h1-826756-3 Jul 28 03:47:12.223059 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a435103f-2aef-4243-801f-813cf2a9e41d req-7e73f353-3757-4d62-b4d5-cc4df80932b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069349 Jul 28 03:47:12.224306 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1375/2513] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:12.240958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ec6442ca-61b9-4e52-b0e7-c6e98f84f92c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:12.242299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ec6442ca-61b9-4e52-b0e7-c6e98f84f92c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:12.250607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec6442ca-61b9-4e52-b0e7-c6e98f84f92c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:12.251071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec6442ca-61b9-4e52-b0e7-c6e98f84f92c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:12.252104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec6442ca-61b9-4e52-b0e7-c6e98f84f92c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:12.253378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec6442ca-61b9-4e52-b0e7-c6e98f84f92c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:12.463098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ec6442ca-61b9-4e52-b0e7-c6e98f84f92c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4289787d6b5e412e8ab5928df4ca9bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759506bd247a40d59e76d660d408755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:12.482153 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ec6442ca-61b9-4e52-b0e7-c6e98f84f92c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 200 len: 1352 microversion: 2.1 time: 0.255958 Jul 28 03:47:12.483859 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1376/2514] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:12 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 1352 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:12.500598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9ca1ff55-59c4-4fb7-8c69-45bf9491df9a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:12.504176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9ca1ff55-59c4-4fb7-8c69-45bf9491df9a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:12.523368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ca1ff55-59c4-4fb7-8c69-45bf9491df9a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:12.524046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ca1ff55-59c4-4fb7-8c69-45bf9491df9a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:12.525072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ca1ff55-59c4-4fb7-8c69-45bf9491df9a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:12.525762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ca1ff55-59c4-4fb7-8c69-45bf9491df9a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:12.685263 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-25c70237-4c91-44f2-8e69-cca3fefa253a tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.814264 Jul 28 03:47:12.686746 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1139/2515] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Jul 28 03:47:11 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:12.697735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5b79ef97-e2aa-4af4-a5db-9063ea537120 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa74502550>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:12.727929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9ca1ff55-59c4-4fb7-8c69-45bf9491df9a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:12.738348 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9ca1ff55-59c4-4fb7-8c69-45bf9491df9a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1315 microversion: 2.1 time: 0.252806 Jul 28 03:47:12.740887 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1377/2516] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:12 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:12.747368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-09d2a312-a95f-467f-ae85-f3f1ab1b76c4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:12.748317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-09d2a312-a95f-467f-ae85-f3f1ab1b76c4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:12.764182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09d2a312-a95f-467f-ae85-f3f1ab1b76c4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:12.764182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09d2a312-a95f-467f-ae85-f3f1ab1b76c4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:12.768940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09d2a312-a95f-467f-ae85-f3f1ab1b76c4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:12.770076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09d2a312-a95f-467f-ae85-f3f1ab1b76c4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:12.799938 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5b79ef97-e2aa-4af4-a5db-9063ea537120 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.111587 Jul 28 03:47:12.802229 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1140/2517] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:12 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:12.818311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0d38365b-9006-4ad8-90b0-b786398a8ea9 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] Calling method '.version_select at 0x7ffa74653790>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:13.027518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-09d2a312-a95f-467f-ae85-f3f1ab1b76c4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:13.037401 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-09d2a312-a95f-467f-ae85-f3f1ab1b76c4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1476 microversion: 2.1 time: 0.294763 Jul 28 03:47:13.044316 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1378/2518] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:12 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1476 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:13.049662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c4fcd0da-fb3f-4d70-a73b-25431ab24598 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:13.050543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c4fcd0da-fb3f-4d70-a73b-25431ab24598 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:13.062473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4fcd0da-fb3f-4d70-a73b-25431ab24598 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:13.063414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4fcd0da-fb3f-4d70-a73b-25431ab24598 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:13.064613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4fcd0da-fb3f-4d70-a73b-25431ab24598 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:13.065243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4fcd0da-fb3f-4d70-a73b-25431ab24598 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:13.185595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c4fcd0da-fb3f-4d70-a73b-25431ab24598 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:13.196986 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c4fcd0da-fb3f-4d70-a73b-25431ab24598 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 200 len: 1464 microversion: 2.1 time: 0.151238 Jul 28 03:47:13.197761 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1379/2519] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:13 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:13.505872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce9d9e4c-fcac-4007-a2c6-a71792ddb108 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:13.506658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ce9d9e4c-fcac-4007-a2c6-a71792ddb108 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:13.513471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce9d9e4c-fcac-4007-a2c6-a71792ddb108 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:13.514178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce9d9e4c-fcac-4007-a2c6-a71792ddb108 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:13.516573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce9d9e4c-fcac-4007-a2c6-a71792ddb108 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:13.518181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce9d9e4c-fcac-4007-a2c6-a71792ddb108 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:13.748926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ce9d9e4c-fcac-4007-a2c6-a71792ddb108 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4289787d6b5e412e8ab5928df4ca9bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759506bd247a40d59e76d660d408755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:13.764857 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce9d9e4c-fcac-4007-a2c6-a71792ddb108 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 200 len: 1352 microversion: 2.1 time: 0.262871 Jul 28 03:47:13.766664 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1380/2520] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:13 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 1352 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:13.772066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-042acd32-c3b5-40b7-b878-4300bf1c8bf3 req-d00a36e0-e768-4212-a2e5-c158216f7c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d40c5c9-5144-44f2-8688-f63a70730fd6", "name": "network-vif-deleted", "tag": "84847337-6d11-4405-a1fb-e06f3e62221d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:13.791990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-042acd32-c3b5-40b7-b878-4300bf1c8bf3 req-d00a36e0-e768-4212-a2e5-c158216f7c8a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:13.792399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-042acd32-c3b5-40b7-b878-4300bf1c8bf3 req-d00a36e0-e768-4212-a2e5-c158216f7c8a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:13.808915 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-042acd32-c3b5-40b7-b878-4300bf1c8bf3 req-d00a36e0-e768-4212-a2e5-c158216f7c8a service nova] Creating event network-vif-deleted:84847337-6d11-4405-a1fb-e06f3e62221d for instance 8d40c5c9-5144-44f2-8688-f63a70730fd6 on n-h1-826756-3 Jul 28 03:47:13.816529 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-042acd32-c3b5-40b7-b878-4300bf1c8bf3 req-d00a36e0-e768-4212-a2e5-c158216f7c8a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048361 Jul 28 03:47:13.817526 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1381/2521] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:13.830552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-450c7dea-7625-4317-9580-66e72b2df81b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:13.831729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-450c7dea-7625-4317-9580-66e72b2df81b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:13.840781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-450c7dea-7625-4317-9580-66e72b2df81b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:13.841512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-450c7dea-7625-4317-9580-66e72b2df81b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:13.842541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-450c7dea-7625-4317-9580-66e72b2df81b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:13.843198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-450c7dea-7625-4317-9580-66e72b2df81b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:14.064232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-450c7dea-7625-4317-9580-66e72b2df81b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:14.072233 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-450c7dea-7625-4317-9580-66e72b2df81b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1315 microversion: 2.1 time: 0.253439 Jul 28 03:47:14.084386 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1382/2522] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:13 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:14.091700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3f2a1720-ac9d-423d-b08d-c0adb3a19be2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa67925d30>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:14.184345 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3f2a1720-ac9d-423d-b08d-c0adb3a19be2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.110043 Jul 28 03:47:14.185281 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1383/2523] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:14 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:14.191080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-205eae7f-6557-4777-a474-b95dd1e00ca5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:14.192015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-205eae7f-6557-4777-a474-b95dd1e00ca5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:14.199606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-205eae7f-6557-4777-a474-b95dd1e00ca5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:14.200338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-205eae7f-6557-4777-a474-b95dd1e00ca5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:14.201435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-205eae7f-6557-4777-a474-b95dd1e00ca5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:14.202061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-205eae7f-6557-4777-a474-b95dd1e00ca5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:14.402337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-205eae7f-6557-4777-a474-b95dd1e00ca5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:14.419525 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-205eae7f-6557-4777-a474-b95dd1e00ca5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1476 microversion: 2.1 time: 0.232942 Jul 28 03:47:14.420648 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1384/2524] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:14 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1476 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:14.425749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ebe6b0a0-a3d6-4037-8658-1e47a83eb389 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:14.426365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ebe6b0a0-a3d6-4037-8658-1e47a83eb389 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 8d40c5c9-5144-44f2-8688-f63a70730fd6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:14.433082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebe6b0a0-a3d6-4037-8658-1e47a83eb389 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:14.433647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebe6b0a0-a3d6-4037-8658-1e47a83eb389 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:14.434632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebe6b0a0-a3d6-4037-8658-1e47a83eb389 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:14.435138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebe6b0a0-a3d6-4037-8658-1e47a83eb389 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:14.459007 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-ebe6b0a0-a3d6-4037-8658-1e47a83eb389 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] HTTP exception thrown: Instance 8d40c5c9-5144-44f2-8688-f63a70730fd6 could not be found. Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ebe6b0a0-a3d6-4037-8658-1e47a83eb389 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Request method failure captured: Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 HTTP/1.1 Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRDP1iWHaD9HAxV7lPiGaBCA98FdCzWWfXnmkEsHPedE1oooQh-xW9JE4w71iBHhRDCvimx8IG2PwPLfvOCapZtWjeVe5xWcXBjyRkBb6hdFDwPdZkSK1ZEyvKcvyrl85YENZuOv85xnb6f8tNb_2DFAB_r9-AWzlzrWYMd8S2Gojo Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: b7bee0b59b0b43ce80623b7aca24111a Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7bee0b59b0b43ce80623b7aca24111a"}]}] Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: b7bee0b59b0b43ce80623b7aca24111a Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-1388238885-project Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 26b9a63a13e1420aa3b7f299456c65e6 Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-1388238885-project Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 8d40c5c9-5144-44f2-8688-f63a70730fd6 could not be found. Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8d40c5c9-5144-44f2-8688-f63a70730fd6'} Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d40c5c9-5144-44f2-8688-f63a70730fd6 could not be found. Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d40c5c9-5144-44f2-8688-f63a70730fd6 could not be found. Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:14.461982 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:14.466245 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:14.466245 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:14.466245 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:14.466245 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:47:14.466245 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:47:14.466245 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d40c5c9-5144-44f2-8688-f63a70730fd6 could not be found. Jul 28 03:47:14.466245 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:14.467428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ebe6b0a0-a3d6-4037-8658-1e47a83eb389 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Returning 404 to user: Instance 8d40c5c9-5144-44f2-8688-f63a70730fd6 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:47:14.468581 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ebe6b0a0-a3d6-4037-8658-1e47a83eb389 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6" status: 404 len: 111 microversion: 2.1 time: 0.046779 Jul 28 03:47:14.469964 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1385/2525] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:14 2022] GET /compute/v2.1/servers/8d40c5c9-5144-44f2-8688-f63a70730fd6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:47:14.476883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-69dd369e-0aef-4fdc-9d8a-8391d0e00572 req-11d64664-dab2-4eca-855b-c6d66fe2373a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb362b3-647a-479e-951d-e49d4d370136", "name": "network-vif-plugged", "status": "completed", "tag": "3c19fad7-bd41-4df7-b15a-7f21e44fbf8e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:14.488314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-69dd369e-0aef-4fdc-9d8a-8391d0e00572 req-11d64664-dab2-4eca-855b-c6d66fe2373a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:14.488886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-69dd369e-0aef-4fdc-9d8a-8391d0e00572 req-11d64664-dab2-4eca-855b-c6d66fe2373a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:14.503299 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-69dd369e-0aef-4fdc-9d8a-8391d0e00572 req-11d64664-dab2-4eca-855b-c6d66fe2373a service nova] Creating event network-vif-plugged:3c19fad7-bd41-4df7-b15a-7f21e44fbf8e for instance dbb362b3-647a-479e-951d-e49d4d370136 on n-h2-826756-3 Jul 28 03:47:14.509902 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-69dd369e-0aef-4fdc-9d8a-8391d0e00572 req-11d64664-dab2-4eca-855b-c6d66fe2373a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037875 Jul 28 03:47:14.512494 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1386/2526] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:14.521620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-827e1097-e682-4107-becc-84a371a8b29e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:14.522792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-827e1097-e682-4107-becc-84a371a8b29e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:14.532480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-827e1097-e682-4107-becc-84a371a8b29e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:14.533257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-827e1097-e682-4107-becc-84a371a8b29e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:14.534285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-827e1097-e682-4107-becc-84a371a8b29e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:14.534964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-827e1097-e682-4107-becc-84a371a8b29e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:14.567408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-827e1097-e682-4107-becc-84a371a8b29e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:47:14.722107 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-827e1097-e682-4107-becc-84a371a8b29e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 204 len: 0 microversion: 2.1 time: 0.205881 Jul 28 03:47:14.724252 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1387/2527] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:47:14 2022] DELETE /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:14.749346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf5b9f12-7dd8-4484-b6ba-327124b0dd19 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:14.750293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cf5b9f12-7dd8-4484-b6ba-327124b0dd19 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:14.759747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf5b9f12-7dd8-4484-b6ba-327124b0dd19 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:14.760203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf5b9f12-7dd8-4484-b6ba-327124b0dd19 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:14.761083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf5b9f12-7dd8-4484-b6ba-327124b0dd19 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:14.761610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf5b9f12-7dd8-4484-b6ba-327124b0dd19 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:14.969079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf5b9f12-7dd8-4484-b6ba-327124b0dd19 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:14.980284 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf5b9f12-7dd8-4484-b6ba-327124b0dd19 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1507 microversion: 2.1 time: 0.246927 Jul 28 03:47:14.993896 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1388/2528] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:14 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:14.997810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9548c24f-a2e1-49ec-8814-695cda157ca5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:14.999923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9548c24f-a2e1-49ec-8814-695cda157ca5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:15.022507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9548c24f-a2e1-49ec-8814-695cda157ca5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:15.023193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9548c24f-a2e1-49ec-8814-695cda157ca5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:15.024067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9548c24f-a2e1-49ec-8814-695cda157ca5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:15.052458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9548c24f-a2e1-49ec-8814-695cda157ca5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:15.071904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:15.291937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9548c24f-a2e1-49ec-8814-695cda157ca5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4289787d6b5e412e8ab5928df4ca9bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759506bd247a40d59e76d660d408755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:15.300995 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9548c24f-a2e1-49ec-8814-695cda157ca5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 200 len: 1352 microversion: 2.1 time: 0.309376 Jul 28 03:47:15.313449 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1389/2529] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:14 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 1352 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:15.321308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e828364c-d811-46c0-941e-396870f56a63 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:15.321935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e828364c-d811-46c0-941e-396870f56a63 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:15.334030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e828364c-d811-46c0-941e-396870f56a63 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:15.334872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e828364c-d811-46c0-941e-396870f56a63 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:15.335718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e828364c-d811-46c0-941e-396870f56a63 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:15.336160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e828364c-d811-46c0-941e-396870f56a63 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:15.587326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e828364c-d811-46c0-941e-396870f56a63 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:15.600021 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e828364c-d811-46c0-941e-396870f56a63 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1315 microversion: 2.1 time: 0.285262 Jul 28 03:47:15.601513 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1390/2530] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:15 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:15.613828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-180d7c1b-0fde-4655-a8cf-21f48f7e39b0 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa67957700>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:15.679861 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-180d7c1b-0fde-4655-a8cf-21f48f7e39b0 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.075335 Jul 28 03:47:15.681469 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1391/2531] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:15 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:15.689181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c1703c97-0e1f-47d5-99b3-0d6fac9b8fd1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:15.690716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c1703c97-0e1f-47d5-99b3-0d6fac9b8fd1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:15.712910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1703c97-0e1f-47d5-99b3-0d6fac9b8fd1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:15.713910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1703c97-0e1f-47d5-99b3-0d6fac9b8fd1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:15.714866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1703c97-0e1f-47d5-99b3-0d6fac9b8fd1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:15.715455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1703c97-0e1f-47d5-99b3-0d6fac9b8fd1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:15.902574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c1703c97-0e1f-47d5-99b3-0d6fac9b8fd1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:15.918862 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c1703c97-0e1f-47d5-99b3-0d6fac9b8fd1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1476 microversion: 2.1 time: 0.235555 Jul 28 03:47:15.922332 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1392/2532] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:15 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1476 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:15.932001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e53c1b1a-8788-466d-a11d-ff8676e1b338 req-3bd5ffaa-da5e-41a8-a25b-d274220373f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ce84a29-c300-4be9-934b-93e5af74e3eb", "name": "network-vif-unplugged", "status": "completed", "tag": "e6b88eec-69c4-4857-90b1-4a08af8688ff"}, {"name": "network-changed", "server_uuid": "6ce84a29-c300-4be9-934b-93e5af74e3eb", "tag": "e6b88eec-69c4-4857-90b1-4a08af8688ff"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:15.951424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e53c1b1a-8788-466d-a11d-ff8676e1b338 req-3bd5ffaa-da5e-41a8-a25b-d274220373f6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:15.952321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e53c1b1a-8788-466d-a11d-ff8676e1b338 req-3bd5ffaa-da5e-41a8-a25b-d274220373f6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:15.971825 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e53c1b1a-8788-466d-a11d-ff8676e1b338 req-3bd5ffaa-da5e-41a8-a25b-d274220373f6 service nova] Creating event network-vif-unplugged:e6b88eec-69c4-4857-90b1-4a08af8688ff for instance 6ce84a29-c300-4be9-934b-93e5af74e3eb on n-h2-826756-3 Jul 28 03:47:15.972681 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e53c1b1a-8788-466d-a11d-ff8676e1b338 req-3bd5ffaa-da5e-41a8-a25b-d274220373f6 service nova] Creating event network-changed:e6b88eec-69c4-4857-90b1-4a08af8688ff for instance 6ce84a29-c300-4be9-934b-93e5af74e3eb on n-h2-826756-3 Jul 28 03:47:15.985487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-e53c1b1a-8788-466d-a11d-ff8676e1b338 req-3bd5ffaa-da5e-41a8-a25b-d274220373f6 service nova] Instance 6ce84a29-c300-4be9-934b-93e5af74e3eb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:47:16.001943 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e53c1b1a-8788-466d-a11d-ff8676e1b338 req-3bd5ffaa-da5e-41a8-a25b-d274220373f6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.075251 Jul 28 03:47:16.002959 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1393/2533] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:16.013187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f8124ff1-9da9-4cc7-ac76-900396396f41 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:16.014863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f8124ff1-9da9-4cc7-ac76-900396396f41 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:16.053131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8124ff1-9da9-4cc7-ac76-900396396f41 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:16.053131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8124ff1-9da9-4cc7-ac76-900396396f41 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:16.053131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8124ff1-9da9-4cc7-ac76-900396396f41 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:16.053131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8124ff1-9da9-4cc7-ac76-900396396f41 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:16.365106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f8124ff1-9da9-4cc7-ac76-900396396f41 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:16.381208 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f8124ff1-9da9-4cc7-ac76-900396396f41 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1507 microversion: 2.1 time: 0.375972 Jul 28 03:47:16.382054 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1394/2534] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:16 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1507 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:16.411746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d1c0e423-b16e-4cfc-a944-d62b6c4158f7 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:16.412403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d1c0e423-b16e-4cfc-a944-d62b6c4158f7 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:16.418977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:16.423091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1c0e423-b16e-4cfc-a944-d62b6c4158f7 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:16.423552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1c0e423-b16e-4cfc-a944-d62b6c4158f7 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:16.424449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1c0e423-b16e-4cfc-a944-d62b6c4158f7 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:16.424835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1c0e423-b16e-4cfc-a944-d62b6c4158f7 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:16.461898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:16.678275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d1c0e423-b16e-4cfc-a944-d62b6c4158f7 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4289787d6b5e412e8ab5928df4ca9bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759506bd247a40d59e76d660d408755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:16.697379 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d1c0e423-b16e-4cfc-a944-d62b6c4158f7 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 200 len: 1352 microversion: 2.1 time: 0.290133 Jul 28 03:47:16.699178 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1395/2535] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:16 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 1352 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:16.705186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-35f85950-bc74-481a-817a-f8adace96314 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:16.706051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-35f85950-bc74-481a-817a-f8adace96314 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:16.713844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35f85950-bc74-481a-817a-f8adace96314 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:16.714648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35f85950-bc74-481a-817a-f8adace96314 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:16.716629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35f85950-bc74-481a-817a-f8adace96314 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:16.717308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35f85950-bc74-481a-817a-f8adace96314 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:16.746186 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0d38365b-9006-4ad8-90b0-b786398a8ea9 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/fa228570-0246-49bd-b490-4660b81648ab" status: 202 len: 0 microversion: 2.1 time: 3.942342 Jul 28 03:47:16.748104 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1141/2536] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:47:12 2022] DELETE /compute/v2.1/os-floating-ips/fa228570-0246-49bd-b490-4660b81648ab => generated 0 bytes in 3945 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:47:16.755000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-f14106f3-2675-47bd-b591-ffc3cfa8745c req-61d22c09-464f-4d3b-9889-5bbcd5352dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed6431d-350b-4d4b-9fd9-9aa50ebe098b", "name": "network-vif-unplugged", "status": "completed", "tag": "37c1e27c-7161-48a0-8289-9627fdc1847a"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:16.765024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:16.786169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f14106f3-2675-47bd-b591-ffc3cfa8745c req-61d22c09-464f-4d3b-9889-5bbcd5352dd4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:16.791570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f14106f3-2675-47bd-b591-ffc3cfa8745c req-61d22c09-464f-4d3b-9889-5bbcd5352dd4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:16.861950 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-f14106f3-2675-47bd-b591-ffc3cfa8745c req-61d22c09-464f-4d3b-9889-5bbcd5352dd4 service nova] Creating event network-vif-unplugged:37c1e27c-7161-48a0-8289-9627fdc1847a for instance 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b on n-h1-826756-3 Jul 28 03:47:16.872106 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-f14106f3-2675-47bd-b591-ffc3cfa8745c req-61d22c09-464f-4d3b-9889-5bbcd5352dd4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122029 Jul 28 03:47:16.881190 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1142/2537] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:16.890521 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8f0ef6da-039c-4074-a863-e237e27c0e92 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa746570d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:17.060793 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8f0ef6da-039c-4074-a863-e237e27c0e92 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.177028 Jul 28 03:47:17.071189 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1143/2538] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:16 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:17.083452 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8a131298-49da-45e0-9817-3fedcb56dd49 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] Calling method '.version_select at 0x7ffa7458adc0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:17.147789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-35f85950-bc74-481a-817a-f8adace96314 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:17.163697 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-35f85950-bc74-481a-817a-f8adace96314 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1315 microversion: 2.1 time: 0.462791 Jul 28 03:47:17.181648 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1396/2539] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:16 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:17.199200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b037b966-ba9f-4fc7-a22e-287b03006189 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:17.199777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b037b966-ba9f-4fc7-a22e-287b03006189 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:17.208432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b037b966-ba9f-4fc7-a22e-287b03006189 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:17.208432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b037b966-ba9f-4fc7-a22e-287b03006189 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:17.208432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b037b966-ba9f-4fc7-a22e-287b03006189 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:17.208432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b037b966-ba9f-4fc7-a22e-287b03006189 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:17.451235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b037b966-ba9f-4fc7-a22e-287b03006189 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:17.466793 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b037b966-ba9f-4fc7-a22e-287b03006189 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1476 microversion: 2.1 time: 0.283305 Jul 28 03:47:17.467687 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1397/2540] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:17 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1476 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:17.473348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-92ed7756-a349-461c-8a20-65887edc9d30 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:17.473968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-92ed7756-a349-461c-8a20-65887edc9d30 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:17.485422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92ed7756-a349-461c-8a20-65887edc9d30 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:17.485871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92ed7756-a349-461c-8a20-65887edc9d30 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:17.487093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92ed7756-a349-461c-8a20-65887edc9d30 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:17.487527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92ed7756-a349-461c-8a20-65887edc9d30 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:17.667597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-92ed7756-a349-461c-8a20-65887edc9d30 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:17.678580 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-92ed7756-a349-461c-8a20-65887edc9d30 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 200 len: 1507 microversion: 2.1 time: 0.209588 Jul 28 03:47:17.679479 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1398/2541] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:17 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 1507 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:17.733217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ff70b37e-66d5-4a45-8817-41fede426033 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:17.734103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ff70b37e-66d5-4a45-8817-41fede426033 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:17.740863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff70b37e-66d5-4a45-8817-41fede426033 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:17.741574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff70b37e-66d5-4a45-8817-41fede426033 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:17.742533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff70b37e-66d5-4a45-8817-41fede426033 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:17.743142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff70b37e-66d5-4a45-8817-41fede426033 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:17.926994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ff70b37e-66d5-4a45-8817-41fede426033 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4289787d6b5e412e8ab5928df4ca9bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759506bd247a40d59e76d660d408755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:17.938546 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ff70b37e-66d5-4a45-8817-41fede426033 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 200 len: 1542 microversion: 2.1 time: 0.209145 Jul 28 03:47:17.940418 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1399/2542] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:17 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 1542 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:17.963985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6daf6935-c7cb-4201-bef1-bca7d7009ed8 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:17.964939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6daf6935-c7cb-4201-bef1-bca7d7009ed8 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:17.973206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6daf6935-c7cb-4201-bef1-bca7d7009ed8 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:17.973952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6daf6935-c7cb-4201-bef1-bca7d7009ed8 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:17.974799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6daf6935-c7cb-4201-bef1-bca7d7009ed8 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:17.975307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6daf6935-c7cb-4201-bef1-bca7d7009ed8 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:18.106867 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6daf6935-c7cb-4201-bef1-bca7d7009ed8 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147412 Jul 28 03:47:18.108259 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1400/2543] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:47:17 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:18.126323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-63699dff-f605-4ea0-a80c-07adc6c0ff9b req-af15bf23-3ddf-459e-8259-b9cfb2304287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ed93de2-c2ab-4e53-85e7-229b5c03d494", "tag": "409e0ac3-c679-4f86-b97b-eb6284e28502"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:18.145684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-63699dff-f605-4ea0-a80c-07adc6c0ff9b req-af15bf23-3ddf-459e-8259-b9cfb2304287 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:18.147051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-63699dff-f605-4ea0-a80c-07adc6c0ff9b req-af15bf23-3ddf-459e-8259-b9cfb2304287 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:18.163480 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-63699dff-f605-4ea0-a80c-07adc6c0ff9b req-af15bf23-3ddf-459e-8259-b9cfb2304287 service nova] Creating event network-changed:409e0ac3-c679-4f86-b97b-eb6284e28502 for instance 2ed93de2-c2ab-4e53-85e7-229b5c03d494 on n-h2-826756-3 Jul 28 03:47:18.171313 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-63699dff-f605-4ea0-a80c-07adc6c0ff9b req-af15bf23-3ddf-459e-8259-b9cfb2304287 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060696 Jul 28 03:47:18.172819 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1401/2544] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:18.182659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ee24bc02-39c0-4685-ac2b-754c9e9b946c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa679571f0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:18.287606 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ee24bc02-39c0-4685-ac2b-754c9e9b946c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.113330 Jul 28 03:47:18.288942 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1402/2545] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:18 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:18.295258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8bfeae66-8a53-4cf6-8490-aef1396b970b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:18.296652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8bfeae66-8a53-4cf6-8490-aef1396b970b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:18.304681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bfeae66-8a53-4cf6-8490-aef1396b970b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:18.305590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bfeae66-8a53-4cf6-8490-aef1396b970b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:18.307435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bfeae66-8a53-4cf6-8490-aef1396b970b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:18.308046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bfeae66-8a53-4cf6-8490-aef1396b970b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:18.663235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8bfeae66-8a53-4cf6-8490-aef1396b970b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:18.678870 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8bfeae66-8a53-4cf6-8490-aef1396b970b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1315 microversion: 2.1 time: 0.388066 Jul 28 03:47:18.685118 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1403/2546] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:18 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:18.695637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af30b690-d4bb-4426-bdde-3d83d8a36e9f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:18.699774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-af30b690-d4bb-4426-bdde-3d83d8a36e9f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:18.720312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af30b690-d4bb-4426-bdde-3d83d8a36e9f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:18.721010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af30b690-d4bb-4426-bdde-3d83d8a36e9f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:18.722235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af30b690-d4bb-4426-bdde-3d83d8a36e9f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:18.722876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af30b690-d4bb-4426-bdde-3d83d8a36e9f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:19.660672 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8a131298-49da-45e0-9817-3fedcb56dd49 tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/59e34714-e753-4b27-b6c4-99d4ec740f25" status: 202 len: 0 microversion: 2.1 time: 2.587154 Jul 28 03:47:19.661275 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1144/2547] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:47:17 2022] DELETE /compute/v2.1/os-floating-ips/59e34714-e753-4b27-b6c4-99d4ec740f25 => generated 0 bytes in 2589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:47:19.671576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cebe7707-fc02-40e1-8f90-bb6183dcf43f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:19.672334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cebe7707-fc02-40e1-8f90-bb6183dcf43f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:19.682852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cebe7707-fc02-40e1-8f90-bb6183dcf43f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:19.683306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cebe7707-fc02-40e1-8f90-bb6183dcf43f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:19.684094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cebe7707-fc02-40e1-8f90-bb6183dcf43f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:19.684561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cebe7707-fc02-40e1-8f90-bb6183dcf43f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:19.704007 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-cebe7707-fc02-40e1-8f90-bb6183dcf43f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] HTTP exception thrown: Instance 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b could not be found. Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cebe7707-fc02-40e1-8f90-bb6183dcf43f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Request method failure captured: Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b HTTP/1.1 Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gRDP1iWHaD9HAxV7lPiGaBCA98FdCzWWfXnmkEsHPedE1oooQh-xW9JE4w71iBHhRDCvimx8IG2PwPLfvOCapZtWjeVe5xWcXBjyRkBb6hdFDwPdZkSK1ZEyvKcvyrl85YENZuOv85xnb6f8tNb_2DFAB_r9-AWzlzrWYMd8S2Gojo Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: b7bee0b59b0b43ce80623b7aca24111a Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7bee0b59b0b43ce80623b7aca24111a"}]}] Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: b7bee0b59b0b43ce80623b7aca24111a Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerActionsTestJSON-1388238885-project Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 26b9a63a13e1420aa3b7f299456c65e6 Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerActionsTestJSON-1388238885-project Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b could not be found. Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '7ed6431d-350b-4d4b-9fd9-9aa50ebe098b'} Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b could not be found. Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b could not be found. Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:19.705840 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:19.710734 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:19.710734 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:19.710734 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:19.710734 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:47:19.710734 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:47:19.710734 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b could not be found. Jul 28 03:47:19.710734 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:19.711160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-af30b690-d4bb-4426-bdde-3d83d8a36e9f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:19.712480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cebe7707-fc02-40e1-8f90-bb6183dcf43f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Returning 404 to user: Instance 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:47:19.713753 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cebe7707-fc02-40e1-8f90-bb6183dcf43f tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b" status: 404 len: 111 microversion: 2.1 time: 0.051326 Jul 28 03:47:19.714339 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1145/2548] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:19 2022] GET /compute/v2.1/servers/7ed6431d-350b-4d4b-9fd9-9aa50ebe098b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:47:19.719266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-667c0a31-661b-4a4b-9668-286236209cda tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa741ab040>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:19.724387 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-af30b690-d4bb-4426-bdde-3d83d8a36e9f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1476 microversion: 2.1 time: 1.032305 Jul 28 03:47:19.729469 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1404/2549] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:18 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1476 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:19.743525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1f65ecea-24d3-42b1-8726-3f9a0ce47a9a tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] Calling method '.version_select at 0x7ffa67959af0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:19.790530 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-667c0a31-661b-4a4b-9668-286236209cda tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.074920 Jul 28 03:47:19.791232 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1146/2550] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:19 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:19.799852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-efc8985b-17d8-4abb-b302-45f61d669e18 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:19.802089 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-efc8985b-17d8-4abb-b302-45f61d669e18 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:19.811920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-efc8985b-17d8-4abb-b302-45f61d669e18 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:19.813139 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-efc8985b-17d8-4abb-b302-45f61d669e18 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:19.814553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-efc8985b-17d8-4abb-b302-45f61d669e18 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:19.817818 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-efc8985b-17d8-4abb-b302-45f61d669e18 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:20.005182 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-efc8985b-17d8-4abb-b302-45f61d669e18 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:20.014009 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-efc8985b-17d8-4abb-b302-45f61d669e18 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1315 microversion: 2.1 time: 0.221376 Jul 28 03:47:20.014621 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1147/2551] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:19 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:20.019531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5565891a-7fcb-411a-85b0-9e2a0e5fc70e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:20.020300 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5565891a-7fcb-411a-85b0-9e2a0e5fc70e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:20.027085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5565891a-7fcb-411a-85b0-9e2a0e5fc70e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:20.027790 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5565891a-7fcb-411a-85b0-9e2a0e5fc70e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:20.028773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5565891a-7fcb-411a-85b0-9e2a0e5fc70e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:20.029204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5565891a-7fcb-411a-85b0-9e2a0e5fc70e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:20.059868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5565891a-7fcb-411a-85b0-9e2a0e5fc70e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:47:20.212840 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5565891a-7fcb-411a-85b0-9e2a0e5fc70e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "DELETE /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 204 len: 0 microversion: 2.1 time: 0.196478 Jul 28 03:47:20.217312 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1148/2552] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:47:20 2022] DELETE /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:20.235613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-988eed30-2346-4165-9dba-36d549ce174d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:20.237108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-988eed30-2346-4165-9dba-36d549ce174d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:20.252003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-988eed30-2346-4165-9dba-36d549ce174d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:20.253269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-988eed30-2346-4165-9dba-36d549ce174d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:20.255603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-988eed30-2346-4165-9dba-36d549ce174d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:20.257107 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-988eed30-2346-4165-9dba-36d549ce174d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:20.534664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-988eed30-2346-4165-9dba-36d549ce174d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:20.543128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:20.546619 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-988eed30-2346-4165-9dba-36d549ce174d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1494 microversion: 2.1 time: 0.318011 Jul 28 03:47:20.547948 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1149/2553] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:20 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1494 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:20.554397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-f63efbb8-f695-4dde-a392-95ff8dbcf8f3 req-775eb315-0835-431e-88d3-568b763b53f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ed6431d-350b-4d4b-9fd9-9aa50ebe098b", "name": "network-vif-deleted", "tag": "37c1e27c-7161-48a0-8289-9627fdc1847a"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:20.568754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f63efbb8-f695-4dde-a392-95ff8dbcf8f3 req-775eb315-0835-431e-88d3-568b763b53f6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:20.568754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f63efbb8-f695-4dde-a392-95ff8dbcf8f3 req-775eb315-0835-431e-88d3-568b763b53f6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:20.605462 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-f63efbb8-f695-4dde-a392-95ff8dbcf8f3 req-775eb315-0835-431e-88d3-568b763b53f6 service nova] Creating event network-vif-deleted:37c1e27c-7161-48a0-8289-9627fdc1847a for instance 7ed6431d-350b-4d4b-9fd9-9aa50ebe098b on n-h1-826756-3 Jul 28 03:47:20.620466 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-f63efbb8-f695-4dde-a392-95ff8dbcf8f3 req-775eb315-0835-431e-88d3-568b763b53f6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070057 Jul 28 03:47:20.621443 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1150/2554] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:20.756182 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f810e740-cbaf-4c2e-8d2f-a5d1417a920e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:20.757237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f810e740-cbaf-4c2e-8d2f-a5d1417a920e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:20.776155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f810e740-cbaf-4c2e-8d2f-a5d1417a920e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:20.777404 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f810e740-cbaf-4c2e-8d2f-a5d1417a920e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:20.778583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f810e740-cbaf-4c2e-8d2f-a5d1417a920e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:20.779152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f810e740-cbaf-4c2e-8d2f-a5d1417a920e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:21.301232 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1f65ecea-24d3-42b1-8726-3f9a0ce47a9a tempest-FloatingIPDetailsTestJSON-1851074309 tempest-FloatingIPDetailsTestJSON-1851074309-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/d0548c2c-11e4-4123-b2b4-c16f3828e017" status: 202 len: 0 microversion: 2.1 time: 1.570117 Jul 28 03:47:21.302881 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1405/2555] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:47:19 2022] DELETE /compute/v2.1/os-floating-ips/d0548c2c-11e4-4123-b2b4-c16f3828e017 => generated 0 bytes in 1573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:47:21.308706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4517c65-35ad-4a31-9942-adcc7433dc81 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa67938670>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:21.448073 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d4517c65-35ad-4a31-9942-adcc7433dc81 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.143809 Jul 28 03:47:21.448723 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1406/2556] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:21 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:21.457934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1e523e86-6d39-4f2f-a1f8-2702555c5a67 req-69979966-f132-44b2-88c0-a4417be51fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbb362b3-647a-479e-951d-e49d4d370136", "tag": "3c19fad7-bd41-4df7-b15a-7f21e44fbf8e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:21.482720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1e523e86-6d39-4f2f-a1f8-2702555c5a67 req-69979966-f132-44b2-88c0-a4417be51fbd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:21.490340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1e523e86-6d39-4f2f-a1f8-2702555c5a67 req-69979966-f132-44b2-88c0-a4417be51fbd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:21.522540 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1e523e86-6d39-4f2f-a1f8-2702555c5a67 req-69979966-f132-44b2-88c0-a4417be51fbd service nova] Creating event network-changed:3c19fad7-bd41-4df7-b15a-7f21e44fbf8e for instance dbb362b3-647a-479e-951d-e49d4d370136 on n-h2-826756-3 Jul 28 03:47:21.533291 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1e523e86-6d39-4f2f-a1f8-2702555c5a67 req-69979966-f132-44b2-88c0-a4417be51fbd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083290 Jul 28 03:47:21.536442 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1407/2557] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:21.549429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e997b122-c590-49f3-8bc3-722b4eafbfb2 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:21.550412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e997b122-c590-49f3-8bc3-722b4eafbfb2 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:21.572875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e997b122-c590-49f3-8bc3-722b4eafbfb2 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:21.573693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e997b122-c590-49f3-8bc3-722b4eafbfb2 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:21.574967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e997b122-c590-49f3-8bc3-722b4eafbfb2 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:21.575578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e997b122-c590-49f3-8bc3-722b4eafbfb2 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:21.746661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f810e740-cbaf-4c2e-8d2f-a5d1417a920e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:21.759958 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f810e740-cbaf-4c2e-8d2f-a5d1417a920e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1474 microversion: 2.1 time: 1.008457 Jul 28 03:47:21.761103 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1151/2558] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:20 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1474 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:21.767255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ec23a9be-cd9d-475e-99a3-6bca916b2272 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:21.768151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ec23a9be-cd9d-475e-99a3-6bca916b2272 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:21.792675 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ec23a9be-cd9d-475e-99a3-6bca916b2272 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:21.793535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ec23a9be-cd9d-475e-99a3-6bca916b2272 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:21.794499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ec23a9be-cd9d-475e-99a3-6bca916b2272 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:21.795079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ec23a9be-cd9d-475e-99a3-6bca916b2272 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:21.915914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e997b122-c590-49f3-8bc3-722b4eafbfb2 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:21.929902 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e997b122-c590-49f3-8bc3-722b4eafbfb2 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1315 microversion: 2.1 time: 0.391854 Jul 28 03:47:21.936328 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1408/2559] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:21 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:22.012505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ec23a9be-cd9d-475e-99a3-6bca916b2272 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:22.026003 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ec23a9be-cd9d-475e-99a3-6bca916b2272 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1494 microversion: 2.1 time: 0.263495 Jul 28 03:47:22.027158 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1152/2560] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:21 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1494 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:22.040919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6c3c60ac-eda6-4f30-8816-7238eb7f947a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:22.046261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6c3c60ac-eda6-4f30-8816-7238eb7f947a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:22.048009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6c3c60ac-eda6-4f30-8816-7238eb7f947a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Searching by: {'deleted': False, 'project_id': '26210555ced44d06a160aa424cd9fca3'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:47:22.065191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c3c60ac-eda6-4f30-8816-7238eb7f947a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:22.066060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c3c60ac-eda6-4f30-8816-7238eb7f947a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:22.069549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c3c60ac-eda6-4f30-8816-7238eb7f947a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:22.071690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c3c60ac-eda6-4f30-8816-7238eb7f947a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:22.117075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-6c3c60ac-eda6-4f30-8816-7238eb7f947a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:47:22.179628 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6c3c60ac-eda6-4f30-8816-7238eb7f947a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.142898 Jul 28 03:47:22.191159 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1409/2561] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 03:47:22 2022] GET /compute/v2.1/servers => generated 340 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:22.195767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c2d0a8ce-50db-4a0c-9911-e0bfa10554c7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:22.203107 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c2d0a8ce-50db-4a0c-9911-e0bfa10554c7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:22.204281 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c2d0a8ce-50db-4a0c-9911-e0bfa10554c7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Searching by: {'deleted': False, 'project_id': '26210555ced44d06a160aa424cd9fca3'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:47:22.217496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2d0a8ce-50db-4a0c-9911-e0bfa10554c7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:22.220713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2d0a8ce-50db-4a0c-9911-e0bfa10554c7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:22.223847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2d0a8ce-50db-4a0c-9911-e0bfa10554c7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:22.225428 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2d0a8ce-50db-4a0c-9911-e0bfa10554c7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:22.486615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-c2d0a8ce-50db-4a0c-9911-e0bfa10554c7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:47:22.490993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-49de76f5-b0be-4a75-85b9-6acf52fc046f tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6792fa60>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:22.656467 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-49de76f5-b0be-4a75-85b9-6acf52fc046f tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.190206 Jul 28 03:47:22.657068 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1410/2562] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:22 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:22.662808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c2d0a8ce-50db-4a0c-9911-e0bfa10554c7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:22.676525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2d0a8ce-50db-4a0c-9911-e0bfa10554c7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:22.677367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2d0a8ce-50db-4a0c-9911-e0bfa10554c7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:22.786813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4bd4f0a0-fcb1-4c91-99b2-777bfc3856c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:22.787843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4bd4f0a0-fcb1-4c91-99b2-777bfc3856c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:22.806800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4bd4f0a0-fcb1-4c91-99b2-777bfc3856c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:22.806800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4bd4f0a0-fcb1-4c91-99b2-777bfc3856c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:22.806800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4bd4f0a0-fcb1-4c91-99b2-777bfc3856c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:22.806800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4bd4f0a0-fcb1-4c91-99b2-777bfc3856c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:22.905974 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c2d0a8ce-50db-4a0c-9911-e0bfa10554c7 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 0.715057 Jul 28 03:47:22.924313 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1153/2563] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:47:22 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:22.930354 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-20d5fa8d-734b-4b17-9c58-ac1ec9561128 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:22.944844 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-20d5fa8d-734b-4b17-9c58-ac1ec9561128 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018950 Jul 28 03:47:22.954027 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1154/2564] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:47:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:22.977792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fa035e7e-22d1-4f73-8305-91b34996c70d tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:22.978947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fa035e7e-22d1-4f73-8305-91b34996c70d tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:22.990882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa035e7e-22d1-4f73-8305-91b34996c70d tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:22.994365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa035e7e-22d1-4f73-8305-91b34996c70d tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:22.998663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa035e7e-22d1-4f73-8305-91b34996c70d tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:22.999474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa035e7e-22d1-4f73-8305-91b34996c70d tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:23.275567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4bd4f0a0-fcb1-4c91-99b2-777bfc3856c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:23.299606 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4bd4f0a0-fcb1-4c91-99b2-777bfc3856c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1474 microversion: 2.1 time: 0.518514 Jul 28 03:47:23.303755 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1411/2565] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:22 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1474 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:23.311276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b31d4aec-32b1-4de8-a6d0-28f5d89ef383 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:23.314777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b31d4aec-32b1-4de8-a6d0-28f5d89ef383 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:23.339581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b31d4aec-32b1-4de8-a6d0-28f5d89ef383 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:23.340943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b31d4aec-32b1-4de8-a6d0-28f5d89ef383 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:23.342694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b31d4aec-32b1-4de8-a6d0-28f5d89ef383 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:23.350930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b31d4aec-32b1-4de8-a6d0-28f5d89ef383 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:23.624090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fa035e7e-22d1-4f73-8305-91b34996c70d tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:23.639664 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fa035e7e-22d1-4f73-8305-91b34996c70d tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1315 microversion: 2.1 time: 0.665441 Jul 28 03:47:23.641105 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1155/2566] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:22 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:23.681999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b1a26334-528a-449b-a132-1a05499e5be7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa741eadc0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:23.682601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b31d4aec-32b1-4de8-a6d0-28f5d89ef383 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:23.689213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:23.715951 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b31d4aec-32b1-4de8-a6d0-28f5d89ef383 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1494 microversion: 2.1 time: 0.410222 Jul 28 03:47:23.742570 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1412/2567] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:23 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1494 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:23.758771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-126123b5-2dad-4079-a447-f40a1daba275 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:23.760691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-126123b5-2dad-4079-a447-f40a1daba275 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:23.774904 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b1a26334-528a-449b-a132-1a05499e5be7 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.102651 Jul 28 03:47:23.776584 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1156/2568] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:23 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:23.778579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-126123b5-2dad-4079-a447-f40a1daba275 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:23.779293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-126123b5-2dad-4079-a447-f40a1daba275 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:23.780589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-126123b5-2dad-4079-a447-f40a1daba275 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:23.783671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-126123b5-2dad-4079-a447-f40a1daba275 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:23.868609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-126123b5-2dad-4079-a447-f40a1daba275 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:47:24.142813 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-126123b5-2dad-4079-a447-f40a1daba275 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "DELETE /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 204 len: 0 microversion: 2.1 time: 0.398116 Jul 28 03:47:24.148403 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1413/2569] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:47:23 2022] DELETE /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:24.181969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-da893f85-a93e-463f-b95c-4f84c94fc6b9 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:24.189399 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-da893f85-a93e-463f-b95c-4f84c94fc6b9 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:24.215910 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-da893f85-a93e-463f-b95c-4f84c94fc6b9 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:24.216689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-da893f85-a93e-463f-b95c-4f84c94fc6b9 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:24.218022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-da893f85-a93e-463f-b95c-4f84c94fc6b9 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:24.218718 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-da893f85-a93e-463f-b95c-4f84c94fc6b9 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:24.335609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-82d51b7b-2bcf-4eb7-be5f-4f8959cfe6ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:24.336563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-82d51b7b-2bcf-4eb7-be5f-4f8959cfe6ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:24.355139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82d51b7b-2bcf-4eb7-be5f-4f8959cfe6ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:24.357218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82d51b7b-2bcf-4eb7-be5f-4f8959cfe6ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:24.362374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82d51b7b-2bcf-4eb7-be5f-4f8959cfe6ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:24.364615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82d51b7b-2bcf-4eb7-be5f-4f8959cfe6ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:25.042307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-da893f85-a93e-463f-b95c-4f84c94fc6b9 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:25.067317 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-da893f85-a93e-463f-b95c-4f84c94fc6b9 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1713 microversion: 2.1 time: 0.915990 Jul 28 03:47:25.085709 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1157/2570] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:24 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1713 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:25.102661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-de0bc3ab-f9a9-40d8-96a9-1fb6f7e4c0ff tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:25.108724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-de0bc3ab-f9a9-40d8-96a9-1fb6f7e4c0ff tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:25.135243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de0bc3ab-f9a9-40d8-96a9-1fb6f7e4c0ff tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:25.136046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de0bc3ab-f9a9-40d8-96a9-1fb6f7e4c0ff tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:25.137321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de0bc3ab-f9a9-40d8-96a9-1fb6f7e4c0ff tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:25.138286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de0bc3ab-f9a9-40d8-96a9-1fb6f7e4c0ff tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:25.304783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82d51b7b-2bcf-4eb7-be5f-4f8959cfe6ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:25.321184 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-82d51b7b-2bcf-4eb7-be5f-4f8959cfe6ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1471 microversion: 2.1 time: 0.981900 Jul 28 03:47:25.337952 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1414/2571] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:24 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1471 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:25.343356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d0d3c22-c861-4d9f-a829-cf23758aa5c9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:25.344251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4d0d3c22-c861-4d9f-a829-cf23758aa5c9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:25.352330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d0d3c22-c861-4d9f-a829-cf23758aa5c9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:25.353125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d0d3c22-c861-4d9f-a829-cf23758aa5c9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:25.354071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d0d3c22-c861-4d9f-a829-cf23758aa5c9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:25.354667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d0d3c22-c861-4d9f-a829-cf23758aa5c9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:25.871297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d0d3c22-c861-4d9f-a829-cf23758aa5c9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:25.889657 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d0d3c22-c861-4d9f-a829-cf23758aa5c9 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1494 microversion: 2.1 time: 0.550184 Jul 28 03:47:25.906526 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1415/2572] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:25 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1494 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:25.911585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1d07105-d885-4db9-bd94-b7d9afa06730 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa67957280>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:25.991398 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1d07105-d885-4db9-bd94-b7d9afa06730 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.083260 Jul 28 03:47:26.009208 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1416/2573] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:25 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:26.021681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ffff3169-b546-475b-b7b7-f2b6600e2e8b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:26.022256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ffff3169-b546-475b-b7b7-f2b6600e2e8b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:26.037711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffff3169-b546-475b-b7b7-f2b6600e2e8b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:26.038161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffff3169-b546-475b-b7b7-f2b6600e2e8b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:26.038952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffff3169-b546-475b-b7b7-f2b6600e2e8b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:26.039399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffff3169-b546-475b-b7b7-f2b6600e2e8b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:26.084269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-de0bc3ab-f9a9-40d8-96a9-1fb6f7e4c0ff tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:26.096141 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-de0bc3ab-f9a9-40d8-96a9-1fb6f7e4c0ff tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1315 microversion: 2.1 time: 1.008830 Jul 28 03:47:26.096786 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1158/2574] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:25 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1315 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:26.126637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-528e728f-ce62-4fdc-b709-4d45453bc9c5 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:26.144822 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-528e728f-ce62-4fdc-b709-4d45453bc9c5 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:26.153985 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-528e728f-ce62-4fdc-b709-4d45453bc9c5 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:26.154446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-528e728f-ce62-4fdc-b709-4d45453bc9c5 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:26.155311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-528e728f-ce62-4fdc-b709-4d45453bc9c5 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:26.155757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-528e728f-ce62-4fdc-b709-4d45453bc9c5 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:26.233609 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ffff3169-b546-475b-b7b7-f2b6600e2e8b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "POST /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb/action" status: 204 len: 0 microversion: 2.1 time: 0.222896 Jul 28 03:47:26.241103 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1417/2575] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:47:26 2022] POST /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb/action => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:26.251359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-16087acf-3e03-421a-97e6-969c5e53abc0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:26.252065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-16087acf-3e03-421a-97e6-969c5e53abc0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:26.278591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16087acf-3e03-421a-97e6-969c5e53abc0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:26.279053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16087acf-3e03-421a-97e6-969c5e53abc0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:26.280185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16087acf-3e03-421a-97e6-969c5e53abc0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:26.281124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16087acf-3e03-421a-97e6-969c5e53abc0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:26.951695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-16087acf-3e03-421a-97e6-969c5e53abc0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:26.964733 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-16087acf-3e03-421a-97e6-969c5e53abc0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1471 microversion: 2.1 time: 0.717678 Jul 28 03:47:26.965584 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1418/2576] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:26 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1471 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:26.974953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6cfc8f6e-9e64-4fbe-b604-2040f5205439 req-9e67d4a2-ce44-4958-b0a6-40692f03c59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed93de2-c2ab-4e53-85e7-229b5c03d494", "name": "network-vif-plugged", "status": "completed", "tag": "409e0ac3-c679-4f86-b97b-eb6284e28502"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:27.014734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6cfc8f6e-9e64-4fbe-b604-2040f5205439 req-9e67d4a2-ce44-4958-b0a6-40692f03c59a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:27.015516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6cfc8f6e-9e64-4fbe-b604-2040f5205439 req-9e67d4a2-ce44-4958-b0a6-40692f03c59a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:27.073616 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6cfc8f6e-9e64-4fbe-b604-2040f5205439 req-9e67d4a2-ce44-4958-b0a6-40692f03c59a service nova] Creating event network-vif-plugged:409e0ac3-c679-4f86-b97b-eb6284e28502 for instance 2ed93de2-c2ab-4e53-85e7-229b5c03d494 on n-h2-826756-3 Jul 28 03:47:27.090474 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6cfc8f6e-9e64-4fbe-b604-2040f5205439 req-9e67d4a2-ce44-4958-b0a6-40692f03c59a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122970 Jul 28 03:47:27.101873 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1419/2577] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:27.119717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a50c1ac9-9530-4f77-ae57-69eb1a363552 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:27.121090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a50c1ac9-9530-4f77-ae57-69eb1a363552 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:27.143310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a50c1ac9-9530-4f77-ae57-69eb1a363552 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:27.144111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a50c1ac9-9530-4f77-ae57-69eb1a363552 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:27.145566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a50c1ac9-9530-4f77-ae57-69eb1a363552 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:27.146339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a50c1ac9-9530-4f77-ae57-69eb1a363552 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:27.220722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a50c1ac9-9530-4f77-ae57-69eb1a363552 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:27.221872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a50c1ac9-9530-4f77-ae57-69eb1a363552 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:27.223168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-a50c1ac9-9530-4f77-ae57-69eb1a363552 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lazy-loading 'fault' on Instance uuid 472d1cfd-d5de-4031-81b3-d6d3b2a6be21 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:47:27.420518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a50c1ac9-9530-4f77-ae57-69eb1a363552 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:27.429369 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a50c1ac9-9530-4f77-ae57-69eb1a363552 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 200 len: 1305 microversion: 2.1 time: 0.325528 Jul 28 03:47:27.436105 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1420/2578] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:27 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 1305 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:27.448420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2834bc47-9489-4dd5-b77d-3dcea03d8415 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa679570d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:27.575626 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2834bc47-9489-4dd5-b77d-3dcea03d8415 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.134991 Jul 28 03:47:27.577083 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1421/2579] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:27 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:27.587427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-cec8e7d4-22b4-4625-a3e3-c496b0a598bd req-0af2a417-9288-4dfc-813b-39bece06cc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "472d1cfd-d5de-4031-81b3-d6d3b2a6be21", "name": "network-vif-deleted", "tag": "8b7c5c8d-e7eb-4dee-995a-2f41bedd4e40"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:27.616700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cec8e7d4-22b4-4625-a3e3-c496b0a598bd req-0af2a417-9288-4dfc-813b-39bece06cc3e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:27.617737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cec8e7d4-22b4-4625-a3e3-c496b0a598bd req-0af2a417-9288-4dfc-813b-39bece06cc3e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:27.644145 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-cec8e7d4-22b4-4625-a3e3-c496b0a598bd req-0af2a417-9288-4dfc-813b-39bece06cc3e service nova] Creating event network-vif-deleted:8b7c5c8d-e7eb-4dee-995a-2f41bedd4e40 for instance 472d1cfd-d5de-4031-81b3-d6d3b2a6be21 on n-h2-826756-3 Jul 28 03:47:27.657481 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-cec8e7d4-22b4-4625-a3e3-c496b0a598bd req-0af2a417-9288-4dfc-813b-39bece06cc3e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076704 Jul 28 03:47:27.658617 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1422/2580] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:27.670541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc9e0987-c2d5-4923-9cb9-d2876847a76a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:27.672619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dc9e0987-c2d5-4923-9cb9-d2876847a76a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:27.687111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:27.695774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc9e0987-c2d5-4923-9cb9-d2876847a76a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:27.697195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc9e0987-c2d5-4923-9cb9-d2876847a76a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:27.699144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc9e0987-c2d5-4923-9cb9-d2876847a76a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:27.700966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc9e0987-c2d5-4923-9cb9-d2876847a76a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:28.006971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-528e728f-ce62-4fdc-b709-4d45453bc9c5 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:28.025698 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-528e728f-ce62-4fdc-b709-4d45453bc9c5 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1713 microversion: 2.1 time: 1.902923 Jul 28 03:47:28.026328 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1159/2581] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:26 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1713 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:28.044695 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b2303b2d-049f-4b30-9769-54284c58451e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:28.053841 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b2303b2d-049f-4b30-9769-54284c58451e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:28.088614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b2303b2d-049f-4b30-9769-54284c58451e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:28.089461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b2303b2d-049f-4b30-9769-54284c58451e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:28.090503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b2303b2d-049f-4b30-9769-54284c58451e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:28.091171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b2303b2d-049f-4b30-9769-54284c58451e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:28.950250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dc9e0987-c2d5-4923-9cb9-d2876847a76a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:28.959408 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc9e0987-c2d5-4923-9cb9-d2876847a76a tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1315 microversion: 2.1 time: 1.295960 Jul 28 03:47:28.977043 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1423/2582] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:27 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1315 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:28.984163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8743d427-1339-4199-a8b6-157a99c5062d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:29.001044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8743d427-1339-4199-a8b6-157a99c5062d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: 472d1cfd-d5de-4031-81b3-d6d3b2a6be21] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:29.014468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8743d427-1339-4199-a8b6-157a99c5062d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:29.015228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8743d427-1339-4199-a8b6-157a99c5062d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:29.021701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8743d427-1339-4199-a8b6-157a99c5062d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:29.023168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8743d427-1339-4199-a8b6-157a99c5062d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:29.067616 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-8743d427-1339-4199-a8b6-157a99c5062d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] HTTP exception thrown: Instance 472d1cfd-d5de-4031-81b3-d6d3b2a6be21 could not be found. Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8743d427-1339-4199-a8b6-157a99c5062d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Request method failure captured: Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 HTTP/1.1 Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRDP1iWHaD9HAxV7lPiGaBCA98FdCzWWfXnmkEsHPedE1oooQh-xW9JE4w71iBHhRDCvimx8IG2PwPLfvOCapZtWjeVe5xWcXBjyRkBb6hdFDwPdZkSK1ZEyvKcvyrl85YENZuOv85xnb6f8tNb_2DFAB_r9-AWzlzrWYMd8S2Gojo Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: b7bee0b59b0b43ce80623b7aca24111a Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7bee0b59b0b43ce80623b7aca24111a"}]}] Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: b7bee0b59b0b43ce80623b7aca24111a Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-1388238885-project Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 26b9a63a13e1420aa3b7f299456c65e6 Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-1388238885-project Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 472d1cfd-d5de-4031-81b3-d6d3b2a6be21 could not be found. Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '472d1cfd-d5de-4031-81b3-d6d3b2a6be21'} Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 472d1cfd-d5de-4031-81b3-d6d3b2a6be21 could not be found. Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 472d1cfd-d5de-4031-81b3-d6d3b2a6be21 could not be found. Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:29.075418 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:29.079051 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:29.079051 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:29.079051 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:29.079051 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:47:29.079051 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:47:29.079051 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 472d1cfd-d5de-4031-81b3-d6d3b2a6be21 could not be found. Jul 28 03:47:29.079051 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:29.082377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8743d427-1339-4199-a8b6-157a99c5062d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Returning 404 to user: Instance 472d1cfd-d5de-4031-81b3-d6d3b2a6be21 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:47:29.084252 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8743d427-1339-4199-a8b6-157a99c5062d tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21" status: 404 len: 111 microversion: 2.1 time: 0.105777 Jul 28 03:47:29.085557 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1424/2583] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:28 2022] GET /compute/v2.1/servers/472d1cfd-d5de-4031-81b3-d6d3b2a6be21 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:47:29.106576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6c6e0e23-41f8-4eef-8533-1fd0379fc936 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6788faf0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:29.203459 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6c6e0e23-41f8-4eef-8533-1fd0379fc936 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.116543 Jul 28 03:47:29.204584 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1425/2584] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:29 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:29.209876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-92df7b85-51b5-4472-9a9d-e4369c0238a0 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:29.211560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-92df7b85-51b5-4472-9a9d-e4369c0238a0 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:29.218832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92df7b85-51b5-4472-9a9d-e4369c0238a0 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:29.220052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92df7b85-51b5-4472-9a9d-e4369c0238a0 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:29.221874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92df7b85-51b5-4472-9a9d-e4369c0238a0 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:29.222627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92df7b85-51b5-4472-9a9d-e4369c0238a0 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:29.413482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-92df7b85-51b5-4472-9a9d-e4369c0238a0 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:29.445668 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-92df7b85-51b5-4472-9a9d-e4369c0238a0 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1646 microversion: 2.1 time: 0.239331 Jul 28 03:47:29.459417 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1426/2585] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:29 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1646 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:29.459417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-42bf90de-ce71-429c-b056-0aebe5d6bcd7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:29.459417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-42bf90de-ce71-429c-b056-0aebe5d6bcd7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:29.487344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42bf90de-ce71-429c-b056-0aebe5d6bcd7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:29.487810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42bf90de-ce71-429c-b056-0aebe5d6bcd7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:29.492517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42bf90de-ce71-429c-b056-0aebe5d6bcd7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:29.493049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42bf90de-ce71-429c-b056-0aebe5d6bcd7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:29.554143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-42bf90de-ce71-429c-b056-0aebe5d6bcd7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:47:29.707512 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-42bf90de-ce71-429c-b056-0aebe5d6bcd7 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 204 len: 0 microversion: 2.1 time: 0.252801 Jul 28 03:47:29.712304 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1427/2586] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:47:29 2022] DELETE /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:29.749044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-96c23718-5bac-457e-95bc-15b3120905fc req-c3902632-55f4-4093-8ea7-49c5a232597d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ce84a29-c300-4be9-934b-93e5af74e3eb", "name": "network-vif-plugged", "status": "completed", "tag": "e6b88eec-69c4-4857-90b1-4a08af8688ff"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:29.777978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-96c23718-5bac-457e-95bc-15b3120905fc req-c3902632-55f4-4093-8ea7-49c5a232597d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:29.779264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-96c23718-5bac-457e-95bc-15b3120905fc req-c3902632-55f4-4093-8ea7-49c5a232597d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:29.801937 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-96c23718-5bac-457e-95bc-15b3120905fc req-c3902632-55f4-4093-8ea7-49c5a232597d service nova] Creating event network-vif-plugged:e6b88eec-69c4-4857-90b1-4a08af8688ff for instance 6ce84a29-c300-4be9-934b-93e5af74e3eb on n-h2-826756-3 Jul 28 03:47:29.808762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-96c23718-5bac-457e-95bc-15b3120905fc req-c3902632-55f4-4093-8ea7-49c5a232597d service nova] Instance 6ce84a29-c300-4be9-934b-93e5af74e3eb is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:47:29.823811 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-96c23718-5bac-457e-95bc-15b3120905fc req-c3902632-55f4-4093-8ea7-49c5a232597d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108941 Jul 28 03:47:29.830332 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1428/2587] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:29.836575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-001ddcf0-98b1-4967-b4d8-fa431eb28add tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:29.837739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-001ddcf0-98b1-4967-b4d8-fa431eb28add tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:29.845345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-001ddcf0-98b1-4967-b4d8-fa431eb28add tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:29.846233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-001ddcf0-98b1-4967-b4d8-fa431eb28add tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:29.847088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-001ddcf0-98b1-4967-b4d8-fa431eb28add tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:29.847907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-001ddcf0-98b1-4967-b4d8-fa431eb28add tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:29.912752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b2303b2d-049f-4b30-9769-54284c58451e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:29.937093 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b2303b2d-049f-4b30-9769-54284c58451e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1471 microversion: 2.1 time: 1.896242 Jul 28 03:47:29.959235 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1160/2588] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:28 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1471 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:29.991619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-610a2dd7-6b38-452e-9d53-9d4e691c5bf6 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:30.005596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-610a2dd7-6b38-452e-9d53-9d4e691c5bf6 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:30.022871 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-610a2dd7-6b38-452e-9d53-9d4e691c5bf6 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:30.023744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-610a2dd7-6b38-452e-9d53-9d4e691c5bf6 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:30.025776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-610a2dd7-6b38-452e-9d53-9d4e691c5bf6 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:30.026978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-610a2dd7-6b38-452e-9d53-9d4e691c5bf6 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:30.114023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-001ddcf0-98b1-4967-b4d8-fa431eb28add tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:30.118535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:30.134884 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-001ddcf0-98b1-4967-b4d8-fa431eb28add tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1674 microversion: 2.1 time: 0.302860 Jul 28 03:47:30.143317 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1429/2589] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:29 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1674 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:30.227931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4effa0fc-872f-4f3d-845e-706fe20b6adb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa67957820>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:30.304236 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4effa0fc-872f-4f3d-845e-706fe20b6adb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1455 microversion: 2.1 time: 0.086199 Jul 28 03:47:30.309939 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1430/2590] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:30 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:30.468505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b6617f14-a799-46ef-a921-9dcfa8e34f46 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:30.469305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b6617f14-a799-46ef-a921-9dcfa8e34f46 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:30.479115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6617f14-a799-46ef-a921-9dcfa8e34f46 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:30.480327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6617f14-a799-46ef-a921-9dcfa8e34f46 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:30.480815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6617f14-a799-46ef-a921-9dcfa8e34f46 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:30.481515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6617f14-a799-46ef-a921-9dcfa8e34f46 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:30.592401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b6617f14-a799-46ef-a921-9dcfa8e34f46 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:30.619173 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b6617f14-a799-46ef-a921-9dcfa8e34f46 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1646 microversion: 2.1 time: 0.155087 Jul 28 03:47:30.632388 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1431/2591] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:30 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1646 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:30.678959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-610a2dd7-6b38-452e-9d53-9d4e691c5bf6 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:30.701019 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-610a2dd7-6b38-452e-9d53-9d4e691c5bf6 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1315 microversion: 2.1 time: 0.713906 Jul 28 03:47:30.724380 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1161/2592] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:29 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:30.793643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f55e9ac4-09fd-4fa5-94fa-9d17f01112d8 req-182647cf-861a-4eff-9982-efafcfe2dad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb90f51f-bde2-4468-bc8d-06533d38ac7e", "name": "network-vif-deleted", "tag": "1bb348f3-d6bf-460d-abb8-7ba8994f5a22"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:30.807484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f55e9ac4-09fd-4fa5-94fa-9d17f01112d8 req-182647cf-861a-4eff-9982-efafcfe2dad5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:30.807975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f55e9ac4-09fd-4fa5-94fa-9d17f01112d8 req-182647cf-861a-4eff-9982-efafcfe2dad5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:30.825835 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f55e9ac4-09fd-4fa5-94fa-9d17f01112d8 req-182647cf-861a-4eff-9982-efafcfe2dad5 service nova] Creating event network-vif-deleted:1bb348f3-d6bf-460d-abb8-7ba8994f5a22 for instance eb90f51f-bde2-4468-bc8d-06533d38ac7e on n-h1-826756-3 Jul 28 03:47:30.834542 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f55e9ac4-09fd-4fa5-94fa-9d17f01112d8 req-182647cf-861a-4eff-9982-efafcfe2dad5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046790 Jul 28 03:47:30.836409 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1432/2593] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:30.967849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e571646d-1304-488f-b582-d0377e19497b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:30.968845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e571646d-1304-488f-b582-d0377e19497b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:30.980068 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e571646d-1304-488f-b582-d0377e19497b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:30.980835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e571646d-1304-488f-b582-d0377e19497b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:30.988282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e571646d-1304-488f-b582-d0377e19497b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:30.989393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e571646d-1304-488f-b582-d0377e19497b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:31.186421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3c30c4b7-8ff0-40d9-9066-5384995cf13e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:31.191645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3c30c4b7-8ff0-40d9-9066-5384995cf13e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:31.210202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c30c4b7-8ff0-40d9-9066-5384995cf13e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:31.210752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c30c4b7-8ff0-40d9-9066-5384995cf13e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:31.211568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c30c4b7-8ff0-40d9-9066-5384995cf13e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:31.212025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c30c4b7-8ff0-40d9-9066-5384995cf13e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:31.396056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e571646d-1304-488f-b582-d0377e19497b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:31.410747 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e571646d-1304-488f-b582-d0377e19497b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1471 microversion: 2.1 time: 0.447060 Jul 28 03:47:31.424912 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1162/2594] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:30 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1471 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:31.444095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-516cbe39-5165-49f7-9b3d-269b728cacf2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa741ea820>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:31.528334 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-516cbe39-5165-49f7-9b3d-269b728cacf2 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1464 microversion: 2.1 time: 0.101222 Jul 28 03:47:31.529664 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1163/2595] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:31 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1464 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:31.551717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eafea319-410f-41c4-beca-4ecc9bb6399e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa798c5b80>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:31.695558 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-eafea319-410f-41c4-beca-4ecc9bb6399e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 200 len: 1464 microversion: 2.1 time: 0.148820 Jul 28 03:47:31.696276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3c30c4b7-8ff0-40d9-9066-5384995cf13e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:31.700672 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1164/2596] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:31 2022] GET /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:31.725171 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3c30c4b7-8ff0-40d9-9066-5384995cf13e tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1674 microversion: 2.1 time: 0.540057 Jul 28 03:47:31.726749 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1433/2597] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:31 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1674 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:31.728798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e6633b5a-1cc6-48ad-8771-f5f144729cf2 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:31.732214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e6633b5a-1cc6-48ad-8771-f5f144729cf2 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:31.742491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-be0737b3-e860-49ae-a4e2-2f22bfa5d841 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:31.745398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-be0737b3-e860-49ae-a4e2-2f22bfa5d841 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 58a40da4-0f01-4368-835f-9c3b550eb137] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:31.754243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6633b5a-1cc6-48ad-8771-f5f144729cf2 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:31.757472 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6633b5a-1cc6-48ad-8771-f5f144729cf2 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:31.759052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6633b5a-1cc6-48ad-8771-f5f144729cf2 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:31.761077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6633b5a-1cc6-48ad-8771-f5f144729cf2 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:31.770762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be0737b3-e860-49ae-a4e2-2f22bfa5d841 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:31.771535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be0737b3-e860-49ae-a4e2-2f22bfa5d841 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:31.773166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be0737b3-e860-49ae-a4e2-2f22bfa5d841 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:31.785548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be0737b3-e860-49ae-a4e2-2f22bfa5d841 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:31.817250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6633b5a-1cc6-48ad-8771-f5f144729cf2 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:31.818029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6633b5a-1cc6-48ad-8771-f5f144729cf2 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:31.818853 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-e6633b5a-1cc6-48ad-8771-f5f144729cf2 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lazy-loading 'fault' on Instance uuid eb90f51f-bde2-4468-bc8d-06533d38ac7e {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:47:31.893398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e6633b5a-1cc6-48ad-8771-f5f144729cf2 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e69403b3e7b4dbfb0111dc335f67ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26210555ced44d06a160aa424cd9fca3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:31.913355 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e6633b5a-1cc6-48ad-8771-f5f144729cf2 tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 200 len: 1367 microversion: 2.1 time: 0.210160 Jul 28 03:47:31.914189 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1165/2598] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:31 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:31.924132 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-803de42a-71b2-4b4f-b565-52fc4aad7df1 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:31.925473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-803de42a-71b2-4b4f-b565-52fc4aad7df1 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:31.941549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-803de42a-71b2-4b4f-b565-52fc4aad7df1 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:31.942321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-803de42a-71b2-4b4f-b565-52fc4aad7df1 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:31.943952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-803de42a-71b2-4b4f-b565-52fc4aad7df1 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:31.944821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-803de42a-71b2-4b4f-b565-52fc4aad7df1 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:32.088781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:32.197180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-803de42a-71b2-4b4f-b565-52fc4aad7df1 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:32.209995 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-803de42a-71b2-4b4f-b565-52fc4aad7df1 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1504 microversion: 2.1 time: 0.293894 Jul 28 03:47:32.212284 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1166/2599] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:31 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:32.233410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-603e5e81-a6e7-4f03-81bf-1719b8ccc39e tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:32.233941 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-603e5e81-a6e7-4f03-81bf-1719b8ccc39e tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:32.243858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-603e5e81-a6e7-4f03-81bf-1719b8ccc39e tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:32.244570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-603e5e81-a6e7-4f03-81bf-1719b8ccc39e tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:32.245771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-603e5e81-a6e7-4f03-81bf-1719b8ccc39e tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:32.246325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-603e5e81-a6e7-4f03-81bf-1719b8ccc39e tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:32.397276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:32.410529 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-603e5e81-a6e7-4f03-81bf-1719b8ccc39e tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.181202 Jul 28 03:47:32.416952 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1167/2600] 10.222.0.48 () {58 vars in 1296 bytes} [Thu Jul 28 03:47:32 2022] DELETE /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494/os-server-password => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:47:32.438080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-92b42735-d38a-42c2-841f-df126135bc0f tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:32.439625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-92b42735-d38a-42c2-841f-df126135bc0f tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:32.463029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92b42735-d38a-42c2-841f-df126135bc0f tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:32.464506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92b42735-d38a-42c2-841f-df126135bc0f tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:32.468738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92b42735-d38a-42c2-841f-df126135bc0f tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:32.469351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92b42735-d38a-42c2-841f-df126135bc0f tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:32.533382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be0737b3-e860-49ae-a4e2-2f22bfa5d841 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:32.554095 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-be0737b3-e860-49ae-a4e2-2f22bfa5d841 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137" status: 200 len: 1467 microversion: 2.1 time: 0.825572 Jul 28 03:47:32.560765 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1434/2601] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:31 2022] GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137 => generated 1467 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:32.571906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5721ac5b-d330-456c-a7bf-513475034f09 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:32.572799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5721ac5b-d330-456c-a7bf-513475034f09 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:32.588094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5721ac5b-d330-456c-a7bf-513475034f09 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:32.589701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5721ac5b-d330-456c-a7bf-513475034f09 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:32.589880 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-92b42735-d38a-42c2-841f-df126135bc0f tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.162207 Jul 28 03:47:32.597489 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1168/2602] 10.222.0.48 () {58 vars in 1293 bytes} [Thu Jul 28 03:47:32 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494/os-server-password => generated 16 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:47:32.612885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5721ac5b-d330-456c-a7bf-513475034f09 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:32.613742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5721ac5b-d330-456c-a7bf-513475034f09 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:32.619169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e1fb892d-27b3-40b0-beec-5fbc31427fc8 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa745b0700>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:32.646443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:32.809297 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e1fb892d-27b3-40b0-beec-5fbc31427fc8 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images?changes-since=2022-07-28T03%3A45%3A19Z" status: 200 len: 1904 microversion: 2.1 time: 0.206010 Jul 28 03:47:32.809297 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1169/2603] 10.222.0.48 () {58 vars in 1199 bytes} [Thu Jul 28 03:47:32 2022] GET /compute/v2.1/images?changes-since=2022-07-28T03%3A45%3A19Z => generated 1904 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:32.821809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-737304de-0e5d-402d-b857-411da4cf0974 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:32.821809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-737304de-0e5d-402d-b857-411da4cf0974 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:32.824342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-737304de-0e5d-402d-b857-411da4cf0974 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:32.824342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-737304de-0e5d-402d-b857-411da4cf0974 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:32.825313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-737304de-0e5d-402d-b857-411da4cf0974 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:32.829368 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-737304de-0e5d-402d-b857-411da4cf0974 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:32.831639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:32.865858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-737304de-0e5d-402d-b857-411da4cf0974 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:47:32.967038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5721ac5b-d330-456c-a7bf-513475034f09 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:33.002217 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5721ac5b-d330-456c-a7bf-513475034f09 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1463 microversion: 2.1 time: 0.439882 Jul 28 03:47:33.017949 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1435/2604] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:32 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1463 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:33.025837 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-737304de-0e5d-402d-b857-411da4cf0974 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 204 len: 0 microversion: 2.1 time: 0.214025 Jul 28 03:47:33.028517 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1170/2605] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:47:32 2022] DELETE /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:33.029161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d5717f8-b034-4762-9d5f-827c79705651 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:33.029814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d5717f8-b034-4762-9d5f-827c79705651 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:33.050565 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c270f79a-09d3-4bc3-88c5-52837d5b2ab5 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa745c8550>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:33.064956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d5717f8-b034-4762-9d5f-827c79705651 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:33.065273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d5717f8-b034-4762-9d5f-827c79705651 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:33.067511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d5717f8-b034-4762-9d5f-827c79705651 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:33.068502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d5717f8-b034-4762-9d5f-827c79705651 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:33.211716 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c270f79a-09d3-4bc3-88c5-52837d5b2ab5 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2080327848" status: 200 len: 485 microversion: 2.1 time: 0.180122 Jul 28 03:47:33.212671 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1171/2606] 10.222.0.48 () {58 vars in 1231 bytes} [Thu Jul 28 03:47:33 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2080327848 => generated 485 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:33.223721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8df96630-22ec-415f-bae0-b04a3022d81a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:33.226195 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8df96630-22ec-415f-bae0-b04a3022d81a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] [instance: eb90f51f-bde2-4468-bc8d-06533d38ac7e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:33.232674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8df96630-22ec-415f-bae0-b04a3022d81a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:33.233213 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8df96630-22ec-415f-bae0-b04a3022d81a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:33.234386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8df96630-22ec-415f-bae0-b04a3022d81a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:33.234886 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8df96630-22ec-415f-bae0-b04a3022d81a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:33.252794 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-8df96630-22ec-415f-bae0-b04a3022d81a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] HTTP exception thrown: Instance eb90f51f-bde2-4468-bc8d-06533d38ac7e could not be found. Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8df96630-22ec-415f-bae0-b04a3022d81a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Request method failure captured: Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e HTTP/1.1 Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gaGCDDVgFkOBRJbtUR3IiNZXcjyMWKdIWS6_m_-S3EoIf6JuyxBEEuZnc5BjRRZdGe41haeiBHV3X0p9j8MVz_hsTDhf2X-ecPiHVSqe8PcoHW58ji1FTIr_p9A3mMyw9M1Z7QPghExfTn9spF8S0lOcDMcYbY8WUNiiTYzaLDZxJw Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 26210555ced44d06a160aa424cd9fca3 Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersTestManualDisk-1287912083 Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26210555ced44d06a160aa424cd9fca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26210555ced44d06a160aa424cd9fca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26210555ced44d06a160aa424cd9fca3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26210555ced44d06a160aa424cd9fca3"}]}] Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersTestManualDisk-1287912083 Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 26210555ced44d06a160aa424cd9fca3 Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersTestManualDisk-1287912083 Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersTestManualDisk-1287912083-project Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 4e69403b3e7b4dbfb0111dc335f67ddc Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersTestManualDisk-1287912083-project Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance eb90f51f-bde2-4468-bc8d-06533d38ac7e could not be found. Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'eb90f51f-bde2-4468-bc8d-06533d38ac7e'} Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb90f51f-bde2-4468-bc8d-06533d38ac7e could not be found. Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb90f51f-bde2-4468-bc8d-06533d38ac7e could not be found. Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:33.254878 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:33.265474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:33.265474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:33.265474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:33.265474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:47:33.265474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:47:33.265474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb90f51f-bde2-4468-bc8d-06533d38ac7e could not be found. Jul 28 03:47:33.265474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:33.265474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8df96630-22ec-415f-bae0-b04a3022d81a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Returning 404 to user: Instance eb90f51f-bde2-4468-bc8d-06533d38ac7e could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:47:33.265474 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8df96630-22ec-415f-bae0-b04a3022d81a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e" status: 404 len: 111 microversion: 2.1 time: 0.040328 Jul 28 03:47:33.265474 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1172/2607] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:33 2022] GET /compute/v2.1/servers/eb90f51f-bde2-4468-bc8d-06533d38ac7e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:47:33.265474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f285b7f3-878c-42be-b0ea-63c01cbd4bd9 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:33.265474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f285b7f3-878c-42be-b0ea-63c01cbd4bd9 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:33.273518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f285b7f3-878c-42be-b0ea-63c01cbd4bd9 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:33.274318 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f285b7f3-878c-42be-b0ea-63c01cbd4bd9 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:33.275418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f285b7f3-878c-42be-b0ea-63c01cbd4bd9 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:33.276025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f285b7f3-878c-42be-b0ea-63c01cbd4bd9 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:33.339274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7d5717f8-b034-4762-9d5f-827c79705651 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:33.354433 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d5717f8-b034-4762-9d5f-827c79705651 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1674 microversion: 2.1 time: 0.334674 Jul 28 03:47:33.355504 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1436/2608] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:33 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1674 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:33.364104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-619e7e7c-47a5-4e62-b97a-aef2ad6f5ccf tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:33.365258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-619e7e7c-47a5-4e62-b97a-aef2ad6f5ccf tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:33.376422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-619e7e7c-47a5-4e62-b97a-aef2ad6f5ccf tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:33.377204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-619e7e7c-47a5-4e62-b97a-aef2ad6f5ccf tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:33.378586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-619e7e7c-47a5-4e62-b97a-aef2ad6f5ccf tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:33.379324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-619e7e7c-47a5-4e62-b97a-aef2ad6f5ccf tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:33.626419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-619e7e7c-47a5-4e62-b97a-aef2ad6f5ccf tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:33.641378 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-619e7e7c-47a5-4e62-b97a-aef2ad6f5ccf tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1510 microversion: 2.1 time: 0.283810 Jul 28 03:47:33.643668 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1437/2609] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:33 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1510 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:33.655453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43321907-f164-4045-ac5a-692a064e04db tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6789d700>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:33.700519 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f285b7f3-878c-42be-b0ea-63c01cbd4bd9 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1614 microversion: 2.1 time: 0.439989 Jul 28 03:47:33.703699 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1173/2610] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:33 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1614 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:33.715037 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a69223b9-6bce-411d-b50e-1869805a945a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] Calling method '.version_select at 0x7ffa798c54c0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:33.768719 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43321907-f164-4045-ac5a-692a064e04db tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images?server=58a40da4-0f01-4368-835f-9c3b550eb137" status: 200 len: 958 microversion: 2.1 time: 0.123262 Jul 28 03:47:33.769511 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1438/2611] 10.222.0.48 () {58 vars in 1209 bytes} [Thu Jul 28 03:47:33 2022] GET /compute/v2.1/images?server=58a40da4-0f01-4368-835f-9c3b550eb137 => generated 958 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:33.774275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-28085cc5-b92c-4fae-9b7d-6e75566979a3 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Calling method '.version_select at 0x7ffa6789d4c0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:33.778910 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a69223b9-6bce-411d-b50e-1869805a945a tempest-ServersTestManualDisk-1287912083 tempest-ServersTestManualDisk-1287912083-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-864694195" status: 202 len: 0 microversion: 2.1 time: 0.072833 Jul 28 03:47:33.780689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28085cc5-b92c-4fae-9b7d-6e75566979a3 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:33.781226 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1174/2612] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 03:47:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-864694195 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:47:33.781419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28085cc5-b92c-4fae-9b7d-6e75566979a3 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:33.788826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4a203d20-825c-48b8-8539-1cb1ad2450ed tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa741caca0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:33.793404 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-28085cc5-b92c-4fae-9b7d-6e75566979a3 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.022810 Jul 28 03:47:33.796600 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1439/2613] 10.222.0.48 () {58 vars in 1143 bytes} [Thu Jul 28 03:47:33 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:33.911097 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4a203d20-825c-48b8-8539-1cb1ad2450ed tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 485 microversion: 2.1 time: 0.128637 Jul 28 03:47:33.926157 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1175/2614] 10.222.0.48 () {58 vars in 1317 bytes} [Thu Jul 28 03:47:33 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 485 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:33.932436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f66c9e5e-5d07-4e58-a02d-15cfcc4d9f5e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6793c280>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:33.969215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-ac018e04-6bf9-47ca-9159-1b86f69d9155 req-788b791e-0476-4803-b2dc-40e9bfca0f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4b8ffa-dbe6-4e90-a8f5-728addf73aae", "name": "network-vif-deleted", "tag": "3931df07-76f1-4feb-a179-d48d42b61b21"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:33.985937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-ac018e04-6bf9-47ca-9159-1b86f69d9155 req-788b791e-0476-4803-b2dc-40e9bfca0f99 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:33.987085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-ac018e04-6bf9-47ca-9159-1b86f69d9155 req-788b791e-0476-4803-b2dc-40e9bfca0f99 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:34.037247 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-ac018e04-6bf9-47ca-9159-1b86f69d9155 req-788b791e-0476-4803-b2dc-40e9bfca0f99 service nova] Creating event network-vif-deleted:3931df07-76f1-4feb-a179-d48d42b61b21 for instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae on n-h2-826756-3 Jul 28 03:47:34.050560 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f66c9e5e-5d07-4e58-a02d-15cfcc4d9f5e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 485 microversion: 2.1 time: 0.124374 Jul 28 03:47:34.051727 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1440/2615] 10.222.0.48 () {58 vars in 1303 bytes} [Thu Jul 28 03:47:33 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 485 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:34.065639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4cd25c3b-5dc0-4af9-bd72-ef320a73bfe3 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6789d9d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:34.066043 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-ac018e04-6bf9-47ca-9159-1b86f69d9155 req-788b791e-0476-4803-b2dc-40e9bfca0f99 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086717 Jul 28 03:47:34.067129 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1176/2616] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:47:34.096884 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-8188142", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:34.204417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:47:34.287221 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4cd25c3b-5dc0-4af9-bd72-ef320a73bfe3 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3283 microversion: 2.1 time: 0.225475 Jul 28 03:47:34.299188 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1441/2617] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Jul 28 03:47:34 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3283 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:34.311565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51bbe833-f9b0-4d40-b7b1-0898179cd7ca tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6793c040>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:34.453966 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51bbe833-f9b0-4d40-b7b1-0898179cd7ca tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.152775 Jul 28 03:47:34.461503 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1442/2618] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Jul 28 03:47:34 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:34.474283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b65c6f7-aacb-46e9-ac31-980739cd10ce tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:34.476887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5b65c6f7-aacb-46e9-ac31-980739cd10ce tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:34.491249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b65c6f7-aacb-46e9-ac31-980739cd10ce tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:34.491992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b65c6f7-aacb-46e9-ac31-980739cd10ce tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:34.493037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b65c6f7-aacb-46e9-ac31-980739cd10ce tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:34.493683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b65c6f7-aacb-46e9-ac31-980739cd10ce tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:34.675331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:47:34.675968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:47:34.676319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:47:34.677987 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:47:34.680681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:47:34.715748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5b65c6f7-aacb-46e9-ac31-980739cd10ce tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:34.721424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:34.723101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:34.724814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:34.725519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:34.736711 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5b65c6f7-aacb-46e9-ac31-980739cd10ce tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1606 microversion: 2.1 time: 0.271033 Jul 28 03:47:34.738453 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1443/2619] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:34 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1606 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:34.768553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43383d31-8dbe-4b98-b717-7f650fc5c4cb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6786b790>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:34.770215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Getting quotas for project da4a22e4560a4210bb58942cec62c091. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:47:34.783889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Getting quotas for user ac9d734be6ee4b549f9ed389c276f54a and project da4a22e4560a4210bb58942cec62c091. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:47:34.837450 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:47:34.842016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:47:34.947614 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43383d31-8dbe-4b98-b717-7f650fc5c4cb tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.206373 Jul 28 03:47:34.948502 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1444/2620] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:47:34 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:34.948949 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d140186a-e060-4d1e-bbcf-29e247b7c871 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854374 Jul 28 03:47:34.962429 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1177/2621] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:47:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:47:34.977268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-7c92ae46-f91e-4756-be32-799851d7cc98 req-af85675e-cebe-48c9-ac7d-8b3f59f79d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a40da4-0f01-4368-835f-9c3b550eb137", "name": "network-vif-unplugged", "status": "completed", "tag": "efeda983-f05c-4f23-9d79-30d55c7ec8d7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:34.980028 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-04b96f43-f43f-4b38-b848-b0aa631bb8ed tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:34.982887 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-04b96f43-f43f-4b38-b848-b0aa631bb8ed tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:35.017903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04b96f43-f43f-4b38-b848-b0aa631bb8ed tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:35.022102 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04b96f43-f43f-4b38-b848-b0aa631bb8ed tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:35.024130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7c92ae46-f91e-4756-be32-799851d7cc98 req-af85675e-cebe-48c9-ac7d-8b3f59f79d12 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:35.024774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04b96f43-f43f-4b38-b848-b0aa631bb8ed tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:35.025420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7c92ae46-f91e-4756-be32-799851d7cc98 req-af85675e-cebe-48c9-ac7d-8b3f59f79d12 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:35.025581 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04b96f43-f43f-4b38-b848-b0aa631bb8ed tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:35.050609 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-7c92ae46-f91e-4756-be32-799851d7cc98 req-af85675e-cebe-48c9-ac7d-8b3f59f79d12 service nova] Creating event network-vif-unplugged:efeda983-f05c-4f23-9d79-30d55c7ec8d7 for instance 58a40da4-0f01-4368-835f-9c3b550eb137 on n-h1-826756-3 Jul 28 03:47:35.065119 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-7c92ae46-f91e-4756-be32-799851d7cc98 req-af85675e-cebe-48c9-ac7d-8b3f59f79d12 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110873 Jul 28 03:47:35.067070 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1445/2622] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:35.079102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-875f534b-b7a0-4630-9e7e-4079a4882955 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:35.080461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-875f534b-b7a0-4630-9e7e-4079a4882955 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:35.305062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-875f534b-b7a0-4630-9e7e-4079a4882955 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:35.317716 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-875f534b-b7a0-4630-9e7e-4079a4882955 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1210 microversion: 2.1 time: 0.248068 Jul 28 03:47:35.318880 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1446/2623] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:35 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1210 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:35.324510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-938011ef-3d6f-4eb3-92d2-34d0e1600776 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6786b820>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:35.521551 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-938011ef-3d6f-4eb3-92d2-34d0e1600776 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/detail?changes-since=2022-07-28T03%3A45%3A13Z" status: 200 len: 6336 microversion: 2.1 time: 0.201250 Jul 28 03:47:35.524804 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1447/2624] 10.222.0.48 () {58 vars in 1220 bytes} [Thu Jul 28 03:47:35 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-28T03%3A45%3A13Z => generated 6336 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:35.549387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-009e3040-2338-4f99-af2d-2302b22ed7ab tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa678f11f0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:35.579834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-04b96f43-f43f-4b38-b848-b0aa631bb8ed tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:35.590414 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-04b96f43-f43f-4b38-b848-b0aa631bb8ed tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1510 microversion: 2.1 time: 0.626073 Jul 28 03:47:35.596629 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1178/2625] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:34 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1510 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:35.680468 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-009e3040-2338-4f99-af2d-2302b22ed7ab tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2080327848" status: 200 len: 665 microversion: 2.1 time: 0.134891 Jul 28 03:47:35.681058 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1448/2626] 10.222.0.48 () {58 vars in 1252 bytes} [Thu Jul 28 03:47:35 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2080327848 => generated 665 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:47:35.703983 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-834dd988-159b-41c4-9939-f83132fae192 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa743f68b0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:35.775534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7af7c300-e94c-4e79-86f7-25d26ee599ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:35.776678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7af7c300-e94c-4e79-86f7-25d26ee599ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:35.806162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7af7c300-e94c-4e79-86f7-25d26ee599ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:35.807099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7af7c300-e94c-4e79-86f7-25d26ee599ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:35.808733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7af7c300-e94c-4e79-86f7-25d26ee599ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:35.809368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7af7c300-e94c-4e79-86f7-25d26ee599ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:35.836678 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-834dd988-159b-41c4-9939-f83132fae192 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1467 microversion: 2.1 time: 0.138137 Jul 28 03:47:35.837285 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1179/2627] 10.222.0.48 () {58 vars in 1338 bytes} [Thu Jul 28 03:47:35 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fv2.1%2Fservers%2F6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1467 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:35.855155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9c6e9d05-ff1b-4486-8100-deeaad3efa8c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa7426f4c0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:35.941009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7af7c300-e94c-4e79-86f7-25d26ee599ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:35.941728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7af7c300-e94c-4e79-86f7-25d26ee599ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:35.943332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-7af7c300-e94c-4e79-86f7-25d26ee599ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lazy-loading 'fault' on Instance uuid cb4b8ffa-dbe6-4e90-a8f5-728addf73aae {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:47:36.089256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7af7c300-e94c-4e79-86f7-25d26ee599ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26b9a63a13e1420aa3b7f299456c65e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7bee0b59b0b43ce80623b7aca24111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:36.103366 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9c6e9d05-ff1b-4486-8100-deeaad3efa8c tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1467 microversion: 2.1 time: 0.255159 Jul 28 03:47:36.106789 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1180/2628] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jul 28 03:47:35 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.48%2Fcompute%2Fservers%2F6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1467 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:36.109120 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7af7c300-e94c-4e79-86f7-25d26ee599ba tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 200 len: 1327 microversion: 2.1 time: 0.344807 Jul 28 03:47:36.109693 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1449/2629] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:35 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 1327 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:36.127448 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1f2d400e-b19e-4413-9209-df0c2aa283b5 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa741caaf0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:36.291825 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1f2d400e-b19e-4413-9209-df0c2aa283b5 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7111 microversion: 2.1 time: 0.168776 Jul 28 03:47:36.309021 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1181/2630] 10.222.0.48 () {58 vars in 1170 bytes} [Thu Jul 28 03:47:36 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7111 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:36.315265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3ff2b416-48b1-49e5-a6c2-ce48a68a08d0 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6792fa60>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:36.361168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ff5968e9-d07f-421c-8a5a-4496ac0a5bea tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:36.362173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ff5968e9-d07f-421c-8a5a-4496ac0a5bea tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:36.370857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff5968e9-d07f-421c-8a5a-4496ac0a5bea tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:36.371582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff5968e9-d07f-421c-8a5a-4496ac0a5bea tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:36.372660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff5968e9-d07f-421c-8a5a-4496ac0a5bea tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:36.373706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff5968e9-d07f-421c-8a5a-4496ac0a5bea tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:36.516932 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3ff2b416-48b1-49e5-a6c2-ce48a68a08d0 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4377 microversion: 2.1 time: 0.205235 Jul 28 03:47:36.517970 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1450/2631] 10.222.0.48 () {58 vars in 1170 bytes} [Thu Jul 28 03:47:36 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4377 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:36.541010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e51682d0-f39b-4c62-ba62-9b23ab076456 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6786b0d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:36.620115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ff5968e9-d07f-421c-8a5a-4496ac0a5bea tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:36.625392 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e51682d0-f39b-4c62-ba62-9b23ab076456 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/5d43adf9-af92-4117-9ed9-35547daa1220" status: 200 len: 784 microversion: 2.1 time: 0.092679 Jul 28 03:47:36.627044 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1451/2632] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:47:36 2022] GET /compute/v2.1/images/5d43adf9-af92-4117-9ed9-35547daa1220 => generated 784 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:36.637347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06d803e4-bf81-431c-9a97-e530a25ee83b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:36.638927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-06d803e4-bf81-431c-9a97-e530a25ee83b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:36.648025 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ff5968e9-d07f-421c-8a5a-4496ac0a5bea tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1214 microversion: 2.1 time: 0.286030 Jul 28 03:47:36.649170 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1182/2633] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:36 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1214 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:36.654744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a418130c-5926-4e8d-8721-b00f97957eee tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa741ead30>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:36.669445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06d803e4-bf81-431c-9a97-e530a25ee83b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:36.670911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06d803e4-bf81-431c-9a97-e530a25ee83b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:36.674023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06d803e4-bf81-431c-9a97-e530a25ee83b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:36.674887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06d803e4-bf81-431c-9a97-e530a25ee83b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:36.834505 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a418130c-5926-4e8d-8721-b00f97957eee tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.183317 Jul 28 03:47:36.840125 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1183/2634] 10.222.0.48 () {58 vars in 1158 bytes} [Thu Jul 28 03:47:36 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:36.856093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-78e97da7-a362-435b-ae32-079144f85260 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa741ca280>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:36.999564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-06d803e4-bf81-431c-9a97-e530a25ee83b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '848ccf5a5a7749ecb55a5a431a5f3145', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0363dea81e364b0dbd3bed54f05183a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:37.011501 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-06d803e4-bf81-431c-9a97-e530a25ee83b tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 200 len: 1468 microversion: 2.1 time: 0.382275 Jul 28 03:47:37.012557 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1452/2635] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:36 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 1468 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:37.030623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0e495e42-d2ed-4c09-b72d-491d835d15ee req-29b25e09-f59b-4890-b6e7-fee0fecfde1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed93de2-c2ab-4e53-85e7-229b5c03d494", "name": "network-vif-deleted", "tag": "409e0ac3-c679-4f86-b97b-eb6284e28502"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:37.051004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0e495e42-d2ed-4c09-b72d-491d835d15ee req-29b25e09-f59b-4890-b6e7-fee0fecfde1e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:37.054770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0e495e42-d2ed-4c09-b72d-491d835d15ee req-29b25e09-f59b-4890-b6e7-fee0fecfde1e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:37.070995 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0e495e42-d2ed-4c09-b72d-491d835d15ee req-29b25e09-f59b-4890-b6e7-fee0fecfde1e service nova] Creating event network-vif-deleted:409e0ac3-c679-4f86-b97b-eb6284e28502 for instance 2ed93de2-c2ab-4e53-85e7-229b5c03d494 on n-h2-826756-3 Jul 28 03:47:37.077543 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0e495e42-d2ed-4c09-b72d-491d835d15ee req-29b25e09-f59b-4890-b6e7-fee0fecfde1e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063564 Jul 28 03:47:37.078729 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1453/2636] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:37.141471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e31d256c-ed69-45a3-9e3d-d0f121d76c26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:37.142502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e31d256c-ed69-45a3-9e3d-d0f121d76c26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] [instance: cb4b8ffa-dbe6-4e90-a8f5-728addf73aae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:37.151969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e31d256c-ed69-45a3-9e3d-d0f121d76c26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:37.157043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e31d256c-ed69-45a3-9e3d-d0f121d76c26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:37.158430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e31d256c-ed69-45a3-9e3d-d0f121d76c26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:37.159011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e31d256c-ed69-45a3-9e3d-d0f121d76c26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:37.203691 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e31d256c-ed69-45a3-9e3d-d0f121d76c26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] HTTP exception thrown: Instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae could not be found. Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e31d256c-ed69-45a3-9e3d-d0f121d76c26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Request method failure captured: Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae HTTP/1.1 Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gRDP1iWHaD9HAxV7lPiGaBCA98FdCzWWfXnmkEsHPedE1oooQh-xW9JE4w71iBHhRDCvimx8IG2PwPLfvOCapZtWjeVe5xWcXBjyRkBb6hdFDwPdZkSK1ZEyvKcvyrl85YENZuOv85xnb6f8tNb_2DFAB_r9-AWzlzrWYMd8S2Gojo Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: b7bee0b59b0b43ce80623b7aca24111a Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b7bee0b59b0b43ce80623b7aca24111a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b7bee0b59b0b43ce80623b7aca24111a"}]}] Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: b7bee0b59b0b43ce80623b7aca24111a Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-1388238885 Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-1388238885-project Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 26b9a63a13e1420aa3b7f299456c65e6 Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-1388238885-project Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae could not be found. Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'cb4b8ffa-dbe6-4e90-a8f5-728addf73aae'} Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae could not be found. Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae could not be found. Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:37.207337 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:37.215496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:37.215496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:37.215496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:37.215496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:47:37.215496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:47:37.215496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae could not be found. Jul 28 03:47:37.215496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:37.215496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e31d256c-ed69-45a3-9e3d-d0f121d76c26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Returning 404 to user: Instance cb4b8ffa-dbe6-4e90-a8f5-728addf73aae could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:47:37.215496 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e31d256c-ed69-45a3-9e3d-d0f121d76c26 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae" status: 404 len: 111 microversion: 2.1 time: 0.072712 Jul 28 03:47:37.215496 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1454/2637] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:37 2022] GET /compute/v2.1/servers/cb4b8ffa-dbe6-4e90-a8f5-728addf73aae => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:47:37.239174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-99e92fd4-d5e6-4ffc-abee-28ae9b22fa83 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] Calling method '.version_select at 0x7ffa6792f5e0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:37.270336 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-99e92fd4-d5e6-4ffc-abee-28ae9b22fa83 tempest-ServerActionsTestJSON-1388238885 tempest-ServerActionsTestJSON-1388238885-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-450577607" status: 202 len: 0 microversion: 2.1 time: 0.054881 Jul 28 03:47:37.271408 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1455/2638] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 03:47:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-450577607 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:47:37.682468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd2c1d71-633e-4709-9124-6a9154e8c74a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:37.683119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd2c1d71-633e-4709-9124-6a9154e8c74a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:37.695980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd2c1d71-633e-4709-9124-6a9154e8c74a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:37.698037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd2c1d71-633e-4709-9124-6a9154e8c74a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:37.703752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd2c1d71-633e-4709-9124-6a9154e8c74a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:37.704228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd2c1d71-633e-4709-9124-6a9154e8c74a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:37.928238 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-78e97da7-a362-435b-ae32-079144f85260 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "DELETE /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581" status: 204 len: 0 microversion: 2.1 time: 1.076971 Jul 28 03:47:37.929605 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1184/2639] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:36 2022] DELETE /compute/v2.1/images/23d8b3e7-adbb-4611-ad18-4c001c39b581 => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:37.942436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7184d9e4-1262-4c8b-bd9e-daad8ec0c09b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa797fcca0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:37.945888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dd2c1d71-633e-4709-9124-6a9154e8c74a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:37.955191 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd2c1d71-633e-4709-9124-6a9154e8c74a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1268 microversion: 2.1 time: 0.277995 Jul 28 03:47:37.956421 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1456/2640] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:37 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1268 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:38.034558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b6c566d-16e3-488c-a6ce-394a6443f6e4 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:38.035910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3b6c566d-16e3-488c-a6ce-394a6443f6e4 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] [instance: 2ed93de2-c2ab-4e53-85e7-229b5c03d494] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:38.055412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b6c566d-16e3-488c-a6ce-394a6443f6e4 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:38.055871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b6c566d-16e3-488c-a6ce-394a6443f6e4 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:38.056756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b6c566d-16e3-488c-a6ce-394a6443f6e4 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:38.057193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b6c566d-16e3-488c-a6ce-394a6443f6e4 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:38.103992 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-3b6c566d-16e3-488c-a6ce-394a6443f6e4 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] HTTP exception thrown: Instance 2ed93de2-c2ab-4e53-85e7-229b5c03d494 could not be found. Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b6c566d-16e3-488c-a6ce-394a6443f6e4 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Request method failure captured: Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 HTTP/1.1 Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ga4mQ-q2yCFT0CDtaS4eUtCJFcc0lSagK2965fhZ1nW560A52JYmkODpf1Vc77dpNzgqUhdEIPIbsba3zSly0KNIjWDHAJmOCvsHfww-SEtzDmqnRPfHPGLHVJWoUOa83PaBNcHwgXRuj8Nmg9kU872AjLIe8wY-lKwwEqvpfSFyos Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 0363dea81e364b0dbd3bed54f05183a8 Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerPasswordTestJSON-1062981074 Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0363dea81e364b0dbd3bed54f05183a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0363dea81e364b0dbd3bed54f05183a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0363dea81e364b0dbd3bed54f05183a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0363dea81e364b0dbd3bed54f05183a8"}]}] Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerPasswordTestJSON-1062981074 Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 0363dea81e364b0dbd3bed54f05183a8 Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1062981074 Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerPasswordTestJSON-1062981074-project Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 848ccf5a5a7749ecb55a5a431a5f3145 Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerPasswordTestJSON-1062981074-project Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2ed93de2-c2ab-4e53-85e7-229b5c03d494 could not be found. Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2ed93de2-c2ab-4e53-85e7-229b5c03d494'} Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed93de2-c2ab-4e53-85e7-229b5c03d494 could not be found. Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed93de2-c2ab-4e53-85e7-229b5c03d494 could not be found. Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:38.106543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:38.112292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:38.112292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:38.112292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:38.112292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:47:38.112292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:47:38.112292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed93de2-c2ab-4e53-85e7-229b5c03d494 could not be found. Jul 28 03:47:38.112292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:38.112292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b6c566d-16e3-488c-a6ce-394a6443f6e4 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] Returning 404 to user: Instance 2ed93de2-c2ab-4e53-85e7-229b5c03d494 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:47:38.114380 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3b6c566d-16e3-488c-a6ce-394a6443f6e4 tempest-ServerPasswordTestJSON-1062981074 tempest-ServerPasswordTestJSON-1062981074-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494" status: 404 len: 111 microversion: 2.1 time: 0.077798 Jul 28 03:47:38.115585 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1457/2641] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:38 2022] GET /compute/v2.1/servers/2ed93de2-c2ab-4e53-85e7-229b5c03d494 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:47:38.674446 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7184d9e4-1262-4c8b-bd9e-daad8ec0c09b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "DELETE /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf" status: 204 len: 0 microversion: 2.1 time: 0.736351 Jul 28 03:47:38.675217 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1185/2642] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:37 2022] DELETE /compute/v2.1/images/9d5a82a4-9c33-4385-8e01-6a19bef37aaf => generated 0 bytes in 738 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:38.686490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f0ee459-73f3-40ea-84f0-ec5d03c72da6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6786bd30>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:38.979122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4b131957-c425-40e2-9fab-cafc17926045 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:38.981029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4b131957-c425-40e2-9fab-cafc17926045 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:38.995748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b131957-c425-40e2-9fab-cafc17926045 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:38.997001 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b131957-c425-40e2-9fab-cafc17926045 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:38.998139 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b131957-c425-40e2-9fab-cafc17926045 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:39.000676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b131957-c425-40e2-9fab-cafc17926045 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:39.274169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4b131957-c425-40e2-9fab-cafc17926045 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:39.293616 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4b131957-c425-40e2-9fab-cafc17926045 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1268 microversion: 2.1 time: 0.320434 Jul 28 03:47:39.294277 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1186/2643] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:38 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1268 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:39.539022 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f0ee459-73f3-40ea-84f0-ec5d03c72da6 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "DELETE /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef" status: 204 len: 0 microversion: 2.1 time: 0.858331 Jul 28 03:47:39.542023 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1458/2644] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:38 2022] DELETE /compute/v2.1/images/349c6892-ad62-42ab-98e0-30b5dd82daef => generated 0 bytes in 862 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:39.556421 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aa517cd7-346d-48ab-ac12-d419e7608f3e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:39.556912 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-aa517cd7-346d-48ab-ac12-d419e7608f3e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:39.570080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa517cd7-346d-48ab-ac12-d419e7608f3e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:39.570532 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa517cd7-346d-48ab-ac12-d419e7608f3e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:39.571414 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa517cd7-346d-48ab-ac12-d419e7608f3e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:39.571956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aa517cd7-346d-48ab-ac12-d419e7608f3e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:39.631881 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-aa517cd7-346d-48ab-ac12-d419e7608f3e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:47:39.906776 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aa517cd7-346d-48ab-ac12-d419e7608f3e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 204 len: 0 microversion: 2.1 time: 0.359999 Jul 28 03:47:39.907917 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1187/2645] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:47:39 2022] DELETE /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:39.923686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1d23c6e-136d-482d-a3a6-9422494d8c17 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:39.924710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1d23c6e-136d-482d-a3a6-9422494d8c17 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:39.936825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1d23c6e-136d-482d-a3a6-9422494d8c17 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:39.937855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1d23c6e-136d-482d-a3a6-9422494d8c17 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:39.939439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1d23c6e-136d-482d-a3a6-9422494d8c17 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:39.940512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1d23c6e-136d-482d-a3a6-9422494d8c17 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:40.327234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1746614b-c76f-4fdb-896f-7c9b1d9c4506 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:40.331317 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1746614b-c76f-4fdb-896f-7c9b1d9c4506 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:40.370857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:40.386583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1746614b-c76f-4fdb-896f-7c9b1d9c4506 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:40.391185 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1746614b-c76f-4fdb-896f-7c9b1d9c4506 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:40.393759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1746614b-c76f-4fdb-896f-7c9b1d9c4506 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:40.396184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1746614b-c76f-4fdb-896f-7c9b1d9c4506 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:40.409453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b1d23c6e-136d-482d-a3a6-9422494d8c17 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:40.428341 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1d23c6e-136d-482d-a3a6-9422494d8c17 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1473 microversion: 2.1 time: 0.515136 Jul 28 03:47:40.430004 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1459/2646] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:39 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1473 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:41.191550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1746614b-c76f-4fdb-896f-7c9b1d9c4506 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:41.209710 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1746614b-c76f-4fdb-896f-7c9b1d9c4506 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1310 microversion: 2.1 time: 0.893669 Jul 28 03:47:41.220538 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1188/2647] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:40 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1310 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:41.461768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0baff7a3-d187-4600-ab1a-8b89e0f13fe3 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:41.464735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0baff7a3-d187-4600-ab1a-8b89e0f13fe3 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:41.524374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0baff7a3-d187-4600-ab1a-8b89e0f13fe3 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:41.533400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0baff7a3-d187-4600-ab1a-8b89e0f13fe3 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:41.535321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0baff7a3-d187-4600-ab1a-8b89e0f13fe3 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:41.536463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0baff7a3-d187-4600-ab1a-8b89e0f13fe3 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:42.093172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0baff7a3-d187-4600-ab1a-8b89e0f13fe3 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:42.107645 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0baff7a3-d187-4600-ab1a-8b89e0f13fe3 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1473 microversion: 2.1 time: 0.653812 Jul 28 03:47:42.111172 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1460/2648] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:41 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1473 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:42.249001 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e34d1f44-da13-43b1-9d75-bf2af128054c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:42.265744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e34d1f44-da13-43b1-9d75-bf2af128054c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:42.292438 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e34d1f44-da13-43b1-9d75-bf2af128054c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:42.293112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e34d1f44-da13-43b1-9d75-bf2af128054c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:42.294339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e34d1f44-da13-43b1-9d75-bf2af128054c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:42.296154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e34d1f44-da13-43b1-9d75-bf2af128054c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:42.649130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e34d1f44-da13-43b1-9d75-bf2af128054c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:42.662371 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e34d1f44-da13-43b1-9d75-bf2af128054c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1310 microversion: 2.1 time: 0.424583 Jul 28 03:47:42.664793 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1189/2649] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:42 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1310 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:43.134315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bc9f2517-fb95-4467-a24b-10c3464b2343 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:43.136955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bc9f2517-fb95-4467-a24b-10c3464b2343 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:43.165649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc9f2517-fb95-4467-a24b-10c3464b2343 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:43.166355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc9f2517-fb95-4467-a24b-10c3464b2343 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:43.168678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc9f2517-fb95-4467-a24b-10c3464b2343 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:43.170571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc9f2517-fb95-4467-a24b-10c3464b2343 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:43.480276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bc9f2517-fb95-4467-a24b-10c3464b2343 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:43.491607 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bc9f2517-fb95-4467-a24b-10c3464b2343 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1473 microversion: 2.1 time: 0.361738 Jul 28 03:47:43.499591 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1461/2650] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:43 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1473 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:43.690352 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-62ec4171-3dfb-4229-9a41-0346a5818b4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:43.690918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-62ec4171-3dfb-4229-9a41-0346a5818b4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:43.706232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-62ec4171-3dfb-4229-9a41-0346a5818b4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:43.706933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-62ec4171-3dfb-4229-9a41-0346a5818b4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:43.708432 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-62ec4171-3dfb-4229-9a41-0346a5818b4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:43.712388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-62ec4171-3dfb-4229-9a41-0346a5818b4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:44.252702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-451d684e-e367-4c93-b67d-cdaebc5043a5 req-5e96a275-64c6-40b1-bdad-aeb69cac1c3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022dc911-465a-4044-8ac3-52bf6cdf8612", "tag": "70fad463-b5e0-490a-be92-a6a1e4248f1c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:44.286455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-451d684e-e367-4c93-b67d-cdaebc5043a5 req-5e96a275-64c6-40b1-bdad-aeb69cac1c3d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:44.287168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-451d684e-e367-4c93-b67d-cdaebc5043a5 req-5e96a275-64c6-40b1-bdad-aeb69cac1c3d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:44.305202 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-451d684e-e367-4c93-b67d-cdaebc5043a5 req-5e96a275-64c6-40b1-bdad-aeb69cac1c3d service nova] Creating event network-changed:70fad463-b5e0-490a-be92-a6a1e4248f1c for instance 022dc911-465a-4044-8ac3-52bf6cdf8612 on n-h1-826756-3 Jul 28 03:47:44.310988 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-451d684e-e367-4c93-b67d-cdaebc5043a5 req-5e96a275-64c6-40b1-bdad-aeb69cac1c3d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073658 Jul 28 03:47:44.313079 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1462/2651] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:44.527809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9446faf8-b91f-4e8d-9291-7018ca8e0225 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:44.529710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9446faf8-b91f-4e8d-9291-7018ca8e0225 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:44.541293 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-62ec4171-3dfb-4229-9a41-0346a5818b4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:44.552263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9446faf8-b91f-4e8d-9291-7018ca8e0225 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:44.555585 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-62ec4171-3dfb-4229-9a41-0346a5818b4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1310 microversion: 2.1 time: 0.870549 Jul 28 03:47:44.556190 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1190/2652] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:43 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1310 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:44.557076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9446faf8-b91f-4e8d-9291-7018ca8e0225 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:44.557901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9446faf8-b91f-4e8d-9291-7018ca8e0225 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:44.558496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9446faf8-b91f-4e8d-9291-7018ca8e0225 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:44.776338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9446faf8-b91f-4e8d-9291-7018ca8e0225 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:44.780573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:44.786487 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9446faf8-b91f-4e8d-9291-7018ca8e0225 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1473 microversion: 2.1 time: 0.265038 Jul 28 03:47:44.787161 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1463/2653] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:44 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1473 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:45.581950 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3e706829-d1fc-4269-86fc-4b5327558694 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:45.582729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3e706829-d1fc-4269-86fc-4b5327558694 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:45.586561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:45.588765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:45.593930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e706829-d1fc-4269-86fc-4b5327558694 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:45.594373 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e706829-d1fc-4269-86fc-4b5327558694 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:45.595813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e706829-d1fc-4269-86fc-4b5327558694 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:45.596266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e706829-d1fc-4269-86fc-4b5327558694 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:45.817982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-30874144-a11d-48b6-9939-8d28cb5deb9e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:45.818594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-30874144-a11d-48b6-9939-8d28cb5deb9e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:45.821424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:45.828239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30874144-a11d-48b6-9939-8d28cb5deb9e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:45.829041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30874144-a11d-48b6-9939-8d28cb5deb9e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:45.829827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30874144-a11d-48b6-9939-8d28cb5deb9e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:45.830464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30874144-a11d-48b6-9939-8d28cb5deb9e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:45.921858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-30874144-a11d-48b6-9939-8d28cb5deb9e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:45.935457 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-30874144-a11d-48b6-9939-8d28cb5deb9e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 200 len: 1431 microversion: 2.1 time: 0.121690 Jul 28 03:47:45.937305 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1464/2654] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:45 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 1431 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:46.230971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3e706829-d1fc-4269-86fc-4b5327558694 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:46.247133 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3e706829-d1fc-4269-86fc-4b5327558694 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1310 microversion: 2.1 time: 0.669517 Jul 28 03:47:46.262016 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1191/2655] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:45 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1310 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:46.432049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-267991a0-fe93-4edb-8487-a1150a18c113 req-5f3bfc8f-09fb-4910-8f43-93859ba322ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f1d50cc-a245-45b8-a35d-7e6dcc1d2015", "name": "network-vif-deleted", "tag": "42fe0509-4544-4491-a652-a3e7790cc649"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:46.469020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-267991a0-fe93-4edb-8487-a1150a18c113 req-5f3bfc8f-09fb-4910-8f43-93859ba322ef service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:46.469479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-267991a0-fe93-4edb-8487-a1150a18c113 req-5f3bfc8f-09fb-4910-8f43-93859ba322ef service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:46.485878 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-267991a0-fe93-4edb-8487-a1150a18c113 req-5f3bfc8f-09fb-4910-8f43-93859ba322ef service nova] Creating event network-vif-deleted:42fe0509-4544-4491-a652-a3e7790cc649 for instance 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 on n-h2-826756-3 Jul 28 03:47:46.506407 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-267991a0-fe93-4edb-8487-a1150a18c113 req-5f3bfc8f-09fb-4910-8f43-93859ba322ef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090738 Jul 28 03:47:46.513238 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1465/2656] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:46.961058 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e3085cb7-07f1-4599-830d-758285d44351 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:46.962165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e3085cb7-07f1-4599-830d-758285d44351 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:46.982885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3085cb7-07f1-4599-830d-758285d44351 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:46.983544 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3085cb7-07f1-4599-830d-758285d44351 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:46.984946 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3085cb7-07f1-4599-830d-758285d44351 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:46.985679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3085cb7-07f1-4599-830d-758285d44351 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:47.030142 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-e3085cb7-07f1-4599-830d-758285d44351 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] HTTP exception thrown: Instance 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 could not be found. Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e3085cb7-07f1-4599-830d-758285d44351 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Request method failure captured: Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 HTTP/1.1 Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gZIOMsuLi221kxrqMisj2iXQrSrABAuwIX8jel7l3MqjJ1Iv0G_YwV8btplNlMUVkwOseQEdjuEBDoWmdvvdyQtaI2CqcTlnJwi_tNZNtVpS-lD06jTLmNND7SzRDb2P_ElCq0vfLKBI5x2XC-N-hKiiWQgtDU4c7YrdjU_oiFU0F4 Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 3de20bc29dcc4c14ba831114cde254a4 Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ListImageFiltersTestJSON-1307109230 Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3de20bc29dcc4c14ba831114cde254a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3de20bc29dcc4c14ba831114cde254a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3de20bc29dcc4c14ba831114cde254a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3de20bc29dcc4c14ba831114cde254a4"}]}] Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ListImageFiltersTestJSON-1307109230 Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 3de20bc29dcc4c14ba831114cde254a4 Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1307109230 Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ListImageFiltersTestJSON-1307109230-project Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 359d811b77824998b1683a3983542882 Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ListImageFiltersTestJSON-1307109230-project Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 could not be found. Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '6f1d50cc-a245-45b8-a35d-7e6dcc1d2015'} Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 could not be found. Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 could not be found. Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:47.032498 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:47.037544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:47.037544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:47.037544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:47.037544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:47:47.037544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:47:47.037544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 could not be found. Jul 28 03:47:47.037544 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:47:47.039978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e3085cb7-07f1-4599-830d-758285d44351 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Returning 404 to user: Instance 6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:47:47.041085 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e3085cb7-07f1-4599-830d-758285d44351 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015" status: 404 len: 111 microversion: 2.1 time: 0.087202 Jul 28 03:47:47.041812 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1192/2657] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:46 2022] GET /compute/v2.1/servers/6f1d50cc-a245-45b8-a35d-7e6dcc1d2015 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:47:47.065517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-495bce9b-9aff-43e3-8c2d-0b257fc9a17f tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:47.065517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-495bce9b-9aff-43e3-8c2d-0b257fc9a17f tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 58a40da4-0f01-4368-835f-9c3b550eb137] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:47.081140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-495bce9b-9aff-43e3-8c2d-0b257fc9a17f tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:47.081956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-495bce9b-9aff-43e3-8c2d-0b257fc9a17f tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:47.083378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-495bce9b-9aff-43e3-8c2d-0b257fc9a17f tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:47.084153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-495bce9b-9aff-43e3-8c2d-0b257fc9a17f tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:47.163337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-495bce9b-9aff-43e3-8c2d-0b257fc9a17f tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 58a40da4-0f01-4368-835f-9c3b550eb137] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:47:47.270349 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-60d3fbf4-a0ae-4da4-8172-5896aa60c695 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:47.271008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-60d3fbf4-a0ae-4da4-8172-5896aa60c695 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:47.284909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-60d3fbf4-a0ae-4da4-8172-5896aa60c695 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:47.285447 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-60d3fbf4-a0ae-4da4-8172-5896aa60c695 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:47.286511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-60d3fbf4-a0ae-4da4-8172-5896aa60c695 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:47.288965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-60d3fbf4-a0ae-4da4-8172-5896aa60c695 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:47.371171 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-495bce9b-9aff-43e3-8c2d-0b257fc9a17f tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "DELETE /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137" status: 204 len: 0 microversion: 2.1 time: 0.322710 Jul 28 03:47:47.371899 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1466/2658] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:47:47 2022] DELETE /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:47.387176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97fe9c87-92f2-4337-bf87-9f7229128ec4 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:47.387963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-97fe9c87-92f2-4337-bf87-9f7229128ec4 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 58a40da4-0f01-4368-835f-9c3b550eb137] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:47.418964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97fe9c87-92f2-4337-bf87-9f7229128ec4 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:47.419349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97fe9c87-92f2-4337-bf87-9f7229128ec4 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:47.420280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97fe9c87-92f2-4337-bf87-9f7229128ec4 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:47.421004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97fe9c87-92f2-4337-bf87-9f7229128ec4 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:47.797635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-60d3fbf4-a0ae-4da4-8172-5896aa60c695 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:47.829660 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-60d3fbf4-a0ae-4da4-8172-5896aa60c695 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1310 microversion: 2.1 time: 0.564123 Jul 28 03:47:47.830671 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1193/2659] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:47 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1310 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:48.013703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-97fe9c87-92f2-4337-bf87-9f7229128ec4 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:48.021898 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-97fe9c87-92f2-4337-bf87-9f7229128ec4 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137" status: 200 len: 1473 microversion: 2.1 time: 0.645092 Jul 28 03:47:48.033402 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1467/2660] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:47 2022] GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137 => generated 1473 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:48.853823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4ddfabea-04a2-429e-894c-ff693cdf36b6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:48.854459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4ddfabea-04a2-429e-894c-ff693cdf36b6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:48.868074 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ddfabea-04a2-429e-894c-ff693cdf36b6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:48.868796 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ddfabea-04a2-429e-894c-ff693cdf36b6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:48.869922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ddfabea-04a2-429e-894c-ff693cdf36b6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:48.873749 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ddfabea-04a2-429e-894c-ff693cdf36b6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:49.088083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4bf22ce5-5ef7-438d-b811-59da068f4409 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:49.090674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4bf22ce5-5ef7-438d-b811-59da068f4409 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 58a40da4-0f01-4368-835f-9c3b550eb137] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:49.101435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4bf22ce5-5ef7-438d-b811-59da068f4409 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:49.112120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4bf22ce5-5ef7-438d-b811-59da068f4409 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:49.113870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4bf22ce5-5ef7-438d-b811-59da068f4409 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:49.115429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4bf22ce5-5ef7-438d-b811-59da068f4409 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:49.701730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4ddfabea-04a2-429e-894c-ff693cdf36b6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:49.725280 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4ddfabea-04a2-429e-894c-ff693cdf36b6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1310 microversion: 2.1 time: 0.876476 Jul 28 03:47:49.739272 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1194/2661] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:48 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1310 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:49.749154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4bf22ce5-5ef7-438d-b811-59da068f4409 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:49.781010 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4bf22ce5-5ef7-438d-b811-59da068f4409 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137" status: 200 len: 1473 microversion: 2.1 time: 0.729687 Jul 28 03:47:49.796398 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1468/2662] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:49 2022] GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137 => generated 1473 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:50.098540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eb499fa6-957a-45ac-bef1-0a943e9887a8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:50.101378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-eb499fa6-957a-45ac-bef1-0a943e9887a8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:50.123814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb499fa6-957a-45ac-bef1-0a943e9887a8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:50.127876 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb499fa6-957a-45ac-bef1-0a943e9887a8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:50.131585 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb499fa6-957a-45ac-bef1-0a943e9887a8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:50.135325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb499fa6-957a-45ac-bef1-0a943e9887a8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:50.207204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:50.218782 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-eb499fa6-957a-45ac-bef1-0a943e9887a8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:47:50.454009 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-eb499fa6-957a-45ac-bef1-0a943e9887a8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 204 len: 0 microversion: 2.42 time: 0.712892 Jul 28 03:47:50.455363 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1195/2663] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:47:49 2022] DELETE /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 0 bytes in 715 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:47:50.485013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-36b5774a-7072-4ce2-8dd0-2b454370caef tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:50.488006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-36b5774a-7072-4ce2-8dd0-2b454370caef tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:50.522046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36b5774a-7072-4ce2-8dd0-2b454370caef tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:50.524785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36b5774a-7072-4ce2-8dd0-2b454370caef tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:50.526471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36b5774a-7072-4ce2-8dd0-2b454370caef tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:50.538116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36b5774a-7072-4ce2-8dd0-2b454370caef tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:50.756491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9cef4120-3172-4c62-9520-a80653e76679 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:50.757228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9cef4120-3172-4c62-9520-a80653e76679 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:50.778500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9cef4120-3172-4c62-9520-a80653e76679 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:50.782974 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9cef4120-3172-4c62-9520-a80653e76679 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:50.783945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9cef4120-3172-4c62-9520-a80653e76679 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:50.784431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9cef4120-3172-4c62-9520-a80653e76679 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:51.118086 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9cef4120-3172-4c62-9520-a80653e76679 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:51.149013 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9cef4120-3172-4c62-9520-a80653e76679 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1310 microversion: 2.1 time: 0.401429 Jul 28 03:47:51.160907 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1196/2664] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:50 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1310 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:47:51.214776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bb4fb1b5-816b-4bb1-b7b8-34df1bc7887e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:51.217674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bb4fb1b5-816b-4bb1-b7b8-34df1bc7887e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 58a40da4-0f01-4368-835f-9c3b550eb137] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:51.242978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb4fb1b5-816b-4bb1-b7b8-34df1bc7887e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:51.243391 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb4fb1b5-816b-4bb1-b7b8-34df1bc7887e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:51.244389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb4fb1b5-816b-4bb1-b7b8-34df1bc7887e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:51.246678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb4fb1b5-816b-4bb1-b7b8-34df1bc7887e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:51.331220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb4fb1b5-816b-4bb1-b7b8-34df1bc7887e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:51.332094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb4fb1b5-816b-4bb1-b7b8-34df1bc7887e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:51.332783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-bb4fb1b5-816b-4bb1-b7b8-34df1bc7887e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lazy-loading 'fault' on Instance uuid 58a40da4-0f01-4368-835f-9c3b550eb137 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:47:51.396061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bb4fb1b5-816b-4bb1-b7b8-34df1bc7887e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '359d811b77824998b1683a3983542882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3de20bc29dcc4c14ba831114cde254a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:51.412238 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bb4fb1b5-816b-4bb1-b7b8-34df1bc7887e tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137" status: 200 len: 1307 microversion: 2.1 time: 0.233466 Jul 28 03:47:51.412899 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1197/2665] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:51 2022] GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137 => generated 1307 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:51.428917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-b0bb0677-bfe8-4439-a13e-c2b54a3d9d9d req-a5ff062b-1da6-482e-992e-2f76f0c3f2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022dc911-465a-4044-8ac3-52bf6cdf8612", "name": "network-vif-plugged", "status": "completed", "tag": "70fad463-b5e0-490a-be92-a6a1e4248f1c"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:51.469251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b0bb0677-bfe8-4439-a13e-c2b54a3d9d9d req-a5ff062b-1da6-482e-992e-2f76f0c3f2b8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:51.470766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b0bb0677-bfe8-4439-a13e-c2b54a3d9d9d req-a5ff062b-1da6-482e-992e-2f76f0c3f2b8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:51.503408 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-b0bb0677-bfe8-4439-a13e-c2b54a3d9d9d req-a5ff062b-1da6-482e-992e-2f76f0c3f2b8 service nova] Creating event network-vif-plugged:70fad463-b5e0-490a-be92-a6a1e4248f1c for instance 022dc911-465a-4044-8ac3-52bf6cdf8612 on n-h1-826756-3 Jul 28 03:47:51.519585 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-b0bb0677-bfe8-4439-a13e-c2b54a3d9d9d req-a5ff062b-1da6-482e-992e-2f76f0c3f2b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096940 Jul 28 03:47:51.521080 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1198/2666] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:51.528250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-c2de338b-4d50-4532-9e39-46c4d3cf6c3e req-50e85a5c-7f27-4e78-9bdf-4fc8e238bcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a40da4-0f01-4368-835f-9c3b550eb137", "name": "network-vif-deleted", "tag": "efeda983-f05c-4f23-9d79-30d55c7ec8d7"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:51.543904 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c2de338b-4d50-4532-9e39-46c4d3cf6c3e req-50e85a5c-7f27-4e78-9bdf-4fc8e238bcd5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:51.544711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c2de338b-4d50-4532-9e39-46c4d3cf6c3e req-50e85a5c-7f27-4e78-9bdf-4fc8e238bcd5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:51.561293 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-c2de338b-4d50-4532-9e39-46c4d3cf6c3e req-50e85a5c-7f27-4e78-9bdf-4fc8e238bcd5 service nova] Creating event network-vif-deleted:efeda983-f05c-4f23-9d79-30d55c7ec8d7 for instance 58a40da4-0f01-4368-835f-9c3b550eb137 on n-h1-826756-3 Jul 28 03:47:51.567573 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-c2de338b-4d50-4532-9e39-46c4d3cf6c3e req-50e85a5c-7f27-4e78-9bdf-4fc8e238bcd5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044243 Jul 28 03:47:51.568083 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1199/2667] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:51.993080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-36b5774a-7072-4ce2-8dd0-2b454370caef tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:52.024435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-36b5774a-7072-4ce2-8dd0-2b454370caef tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:52.026708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-36b5774a-7072-4ce2-8dd0-2b454370caef tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:52.030899 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-36b5774a-7072-4ce2-8dd0-2b454370caef tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 2951 microversion: 2.42 time: 1.570785 Jul 28 03:47:52.051848 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1469/2668] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:47:50 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 2951 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:52.186824 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-40585665-276a-4cd7-8257-bf3edb4ea9d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:52.187630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-40585665-276a-4cd7-8257-bf3edb4ea9d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:52.212020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40585665-276a-4cd7-8257-bf3edb4ea9d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:52.213684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40585665-276a-4cd7-8257-bf3edb4ea9d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:52.220086 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40585665-276a-4cd7-8257-bf3edb4ea9d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:52.221773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40585665-276a-4cd7-8257-bf3edb4ea9d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:52.451058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cd85c9ed-25a1-4d43-9ab2-d052894d034b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:52.452703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cd85c9ed-25a1-4d43-9ab2-d052894d034b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] [instance: 58a40da4-0f01-4368-835f-9c3b550eb137] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:52.472300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd85c9ed-25a1-4d43-9ab2-d052894d034b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:52.477369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd85c9ed-25a1-4d43-9ab2-d052894d034b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:52.479282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd85c9ed-25a1-4d43-9ab2-d052894d034b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:52.480742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd85c9ed-25a1-4d43-9ab2-d052894d034b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:52.513848 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-cd85c9ed-25a1-4d43-9ab2-d052894d034b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] HTTP exception thrown: Instance 58a40da4-0f01-4368-835f-9c3b550eb137 could not be found. Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cd85c9ed-25a1-4d43-9ab2-d052894d034b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Request method failure captured: Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137 HTTP/1.1 Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gZIOMsuLi221kxrqMisj2iXQrSrABAuwIX8jel7l3MqjJ1Iv0G_YwV8btplNlMUVkwOseQEdjuEBDoWmdvvdyQtaI2CqcTlnJwi_tNZNtVpS-lD06jTLmNND7SzRDb2P_ElCq0vfLKBI5x2XC-N-hKiiWQgtDU4c7YrdjU_oiFU0F4 Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 3de20bc29dcc4c14ba831114cde254a4 Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ListImageFiltersTestJSON-1307109230 Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3de20bc29dcc4c14ba831114cde254a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3de20bc29dcc4c14ba831114cde254a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3de20bc29dcc4c14ba831114cde254a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3de20bc29dcc4c14ba831114cde254a4"}]}] Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ListImageFiltersTestJSON-1307109230 Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 3de20bc29dcc4c14ba831114cde254a4 Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1307109230 Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ListImageFiltersTestJSON-1307109230-project Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 359d811b77824998b1683a3983542882 Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ListImageFiltersTestJSON-1307109230-project Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 58a40da4-0f01-4368-835f-9c3b550eb137 could not be found. Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '58a40da4-0f01-4368-835f-9c3b550eb137'} Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a40da4-0f01-4368-835f-9c3b550eb137 could not be found. Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a40da4-0f01-4368-835f-9c3b550eb137 could not be found. Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:52.528879 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:52.534747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:52.534747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:52.534747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:52.534747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:47:52.534747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:47:52.534747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a40da4-0f01-4368-835f-9c3b550eb137 could not be found. Jul 28 03:47:52.534747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:52.541555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cd85c9ed-25a1-4d43-9ab2-d052894d034b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Returning 404 to user: Instance 58a40da4-0f01-4368-835f-9c3b550eb137 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:47:52.544249 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cd85c9ed-25a1-4d43-9ab2-d052894d034b tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137" status: 404 len: 111 microversion: 2.1 time: 0.105171 Jul 28 03:47:52.546329 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1470/2669] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:52 2022] GET /compute/v2.1/servers/58a40da4-0f01-4368-835f-9c3b550eb137 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:47:52.565072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c3f6ec09-1f52-434b-8c51-b84dc59a1c23 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6785aaf0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:52.753092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-40585665-276a-4cd7-8257-bf3edb4ea9d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:52.763856 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-40585665-276a-4cd7-8257-bf3edb4ea9d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1310 microversion: 2.1 time: 0.585028 Jul 28 03:47:52.767783 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1200/2670] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:52 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1310 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:53.066756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c7f05c8a-01a5-4c74-a943-e8a253940356 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:53.067475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c7f05c8a-01a5-4c74-a943-e8a253940356 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:53.084268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c7f05c8a-01a5-4c74-a943-e8a253940356 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:53.085258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c7f05c8a-01a5-4c74-a943-e8a253940356 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:53.086649 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c7f05c8a-01a5-4c74-a943-e8a253940356 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:53.087658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c7f05c8a-01a5-4c74-a943-e8a253940356 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:53.403043 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c3f6ec09-1f52-434b-8c51-b84dc59a1c23 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "DELETE /compute/v2.1/images/63d3f827-b791-477e-8d8c-4b2545bde230" status: 204 len: 0 microversion: 2.1 time: 0.849669 Jul 28 03:47:53.404906 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1471/2671] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:52 2022] DELETE /compute/v2.1/images/63d3f827-b791-477e-8d8c-4b2545bde230 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:53.418046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca64087f-81b0-4f24-9cd1-0a1671574957 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa678759d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:53.738210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c7f05c8a-01a5-4c74-a943-e8a253940356 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:53.753632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c7f05c8a-01a5-4c74-a943-e8a253940356 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:53.755232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c7f05c8a-01a5-4c74-a943-e8a253940356 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:53.762238 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c7f05c8a-01a5-4c74-a943-e8a253940356 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 2951 microversion: 2.42 time: 0.699657 Jul 28 03:47:53.762836 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1201/2672] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:47:53 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 2951 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:53.788847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-264512a0-9d47-4038-8576-03914e535122 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:53.789827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-264512a0-9d47-4038-8576-03914e535122 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:53.799784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-264512a0-9d47-4038-8576-03914e535122 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:53.800248 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-264512a0-9d47-4038-8576-03914e535122 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:53.805591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-264512a0-9d47-4038-8576-03914e535122 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:53.806340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-264512a0-9d47-4038-8576-03914e535122 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:53.869585 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca64087f-81b0-4f24-9cd1-0a1671574957 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "DELETE /compute/v2.1/images/93d6f045-5a09-4083-bf89-512cd020b7f5" status: 204 len: 0 microversion: 2.1 time: 0.458248 Jul 28 03:47:53.870621 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1472/2673] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:53 2022] DELETE /compute/v2.1/images/93d6f045-5a09-4083-bf89-512cd020b7f5 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:47:53.894800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-18c4b21f-3239-4f3a-9f95-a54d88ebcc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] Calling method '.version_select at 0x7ffa6793c040>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:54.380762 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-18c4b21f-3239-4f3a-9f95-a54d88ebcc25 tempest-ListImageFiltersTestJSON-1307109230 tempest-ListImageFiltersTestJSON-1307109230-project] 10.222.0.48 "DELETE /compute/v2.1/images/466518cb-c8da-4961-8302-f178e5706d53" status: 204 len: 0 microversion: 2.1 time: 0.504408 Jul 28 03:47:54.381357 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1473/2674] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:53 2022] DELETE /compute/v2.1/images/466518cb-c8da-4961-8302-f178e5706d53 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:47:54.585723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-264512a0-9d47-4038-8576-03914e535122 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:54.601962 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-264512a0-9d47-4038-8576-03914e535122 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1459 microversion: 2.1 time: 0.817159 Jul 28 03:47:54.605083 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1202/2675] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:53 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1459 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:54.628434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-50315896-9df0-499b-8997-3b9c4a4ecd79 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:54.632387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-50315896-9df0-499b-8997-3b9c4a4ecd79 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:54.681252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50315896-9df0-499b-8997-3b9c4a4ecd79 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:54.681923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50315896-9df0-499b-8997-3b9c4a4ecd79 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:54.683298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50315896-9df0-499b-8997-3b9c4a4ecd79 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:54.683875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50315896-9df0-499b-8997-3b9c4a4ecd79 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:54.794410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b4daf4a5-58fc-477f-b4dd-306899560fbb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:54.795012 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b4daf4a5-58fc-477f-b4dd-306899560fbb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:54.820652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b4daf4a5-58fc-477f-b4dd-306899560fbb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:54.821532 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b4daf4a5-58fc-477f-b4dd-306899560fbb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:54.822857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b4daf4a5-58fc-477f-b4dd-306899560fbb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:54.825541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b4daf4a5-58fc-477f-b4dd-306899560fbb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:55.087242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-50315896-9df0-499b-8997-3b9c4a4ecd79 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:55.102516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-50315896-9df0-499b-8997-3b9c4a4ecd79 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Old instance type m1.heat2, new instance type m1.heat {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 03:47:55.115217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-50315896-9df0-499b-8997-3b9c4a4ecd79 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:47:55.117366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-50315896-9df0-499b-8997-3b9c4a4ecd79 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:47:55.119369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-50315896-9df0-499b-8997-3b9c4a4ecd79 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:47:55.120520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-50315896-9df0-499b-8997-3b9c4a4ecd79 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:47:55.121348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-50315896-9df0-499b-8997-3b9c4a4ecd79 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:47:55.338611 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-50315896-9df0-499b-8997-3b9c4a4ecd79 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "POST /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612/action" status: 202 len: 0 microversion: 2.1 time: 0.716933 Jul 28 03:47:55.339610 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1474/2676] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:47:54 2022] POST /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:47:55.610819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3453d99d-7960-415d-b0dc-b90eeecfa089 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Action: 'create', calling method: .version_select at 0x7ffa678bb3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-663673355", "description": "tempest-description-1125790469"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:56.074016 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3453d99d-7960-415d-b0dc-b90eeecfa089 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.732516 Jul 28 03:47:56.084000 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1475/2677] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:47:55 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:56.089292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6e46fb59-2898-4540-965a-47c6f48b93fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:56.090039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6e46fb59-2898-4540-965a-47c6f48b93fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:56.115192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e46fb59-2898-4540-965a-47c6f48b93fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:56.115989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e46fb59-2898-4540-965a-47c6f48b93fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:56.117138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e46fb59-2898-4540-965a-47c6f48b93fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:56.117730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e46fb59-2898-4540-965a-47c6f48b93fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:56.351711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b4daf4a5-58fc-477f-b4dd-306899560fbb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:56.385789 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b4daf4a5-58fc-477f-b4dd-306899560fbb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:56.414951 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b4daf4a5-58fc-477f-b4dd-306899560fbb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:56.426080 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b4daf4a5-58fc-477f-b4dd-306899560fbb tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 2951 microversion: 2.42 time: 1.634134 Jul 28 03:47:56.428126 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1203/2678] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:47:54 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 2951 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:56.461117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f3c9073b-1a1a-4730-9b88-3a06d1e4d653 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Action: 'create', calling method: .version_select at 0x7ffa741ca280>, body: {"security_group_rule": {"parent_group_id": "64734551-83db-4724-bfac-ecc8faae7f2d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:56.470934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6e46fb59-2898-4540-965a-47c6f48b93fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:56.490312 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6e46fb59-2898-4540-965a-47c6f48b93fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1468 microversion: 2.1 time: 0.404197 Jul 28 03:47:56.506083 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1476/2679] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:56 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1468 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:57.358100 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f3c9073b-1a1a-4730-9b88-3a06d1e4d653 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.925329 Jul 28 03:47:57.365364 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1204/2680] 10.222.0.48 () {60 vars in 1195 bytes} [Thu Jul 28 03:47:56 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:57.371428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4b24e87-63cc-4e90-afbe-a4757bf3ad97 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Action: 'create', calling method: .version_select at 0x7ffa67815e50>, body: {"security_group_rule": {"parent_group_id": "64734551-83db-4724-bfac-ecc8faae7f2d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:57.460080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cd214ec6-10fe-4d34-b29a-bb46d01bad2f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:57.462501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cd214ec6-10fe-4d34-b29a-bb46d01bad2f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:57.475611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd214ec6-10fe-4d34-b29a-bb46d01bad2f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:57.478097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd214ec6-10fe-4d34-b29a-bb46d01bad2f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:57.480236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd214ec6-10fe-4d34-b29a-bb46d01bad2f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:57.481231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd214ec6-10fe-4d34-b29a-bb46d01bad2f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:57.849607 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e4b24e87-63cc-4e90-afbe-a4757bf3ad97 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] HTTP exception thrown: This rule already exists in group 64734551-83db-4724-bfac-ecc8faae7f2d Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4b24e87-63cc-4e90-afbe-a4757bf3ad97 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Request method failure captured: Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 138 Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gbqPeJx0IYdqgpNVkzexDZ767FN5WkVko-LuiYjPRr3VyRHAhWxDipypOrNUXNo0RSxSFtbzc0mn3fQgYsd-XoGgdVNupqZKLmF9CUJ0He5efW6p9sxtEKw0wSF58ZED58GqcD7HjMU8Ix5K5AbFtg1QUtBfCjMXhZJF2eC9sxiA28 Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}] Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: af66789684d74192b82fcfb3b850f2ca Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: {"security_group_rule": {"parent_group_id": "64734551-83db-4724-bfac-ecc8faae7f2d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: exception: This rule already exists in group 64734551-83db-4724-bfac-ecc8faae7f2d Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'security_group_rule': {'parent_group_id': '64734551-83db-4724-bfac-ecc8faae7f2d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 64734551-83db-4724-bfac-ecc8faae7f2d Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 64734551-83db-4724-bfac-ecc8faae7f2d Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:47:57.851150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:47:57.862701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:47:57.862701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:47:57.862701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 64734551-83db-4724-bfac-ecc8faae7f2d Jul 28 03:47:57.862701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:47:57.862701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4b24e87-63cc-4e90-afbe-a4757bf3ad97 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Returning 400 to user: This rule already exists in group 64734551-83db-4724-bfac-ecc8faae7f2d {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:47:57.862701 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e4b24e87-63cc-4e90-afbe-a4757bf3ad97 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.486332 Jul 28 03:47:57.862701 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1477/2681] 10.222.0.48 () {60 vars in 1195 bytes} [Thu Jul 28 03:47:57 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 488 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:47:57.871564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-91cc386f-171f-49b9-b596-aadf96dfe69a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:57.876808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-91cc386f-171f-49b9-b596-aadf96dfe69a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:47:57.903319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:47:57.911133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91cc386f-171f-49b9-b596-aadf96dfe69a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:57.913370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91cc386f-171f-49b9-b596-aadf96dfe69a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:57.918829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91cc386f-171f-49b9-b596-aadf96dfe69a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:47:57.924611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91cc386f-171f-49b9-b596-aadf96dfe69a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:47:58.266158 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd214ec6-10fe-4d34-b29a-bb46d01bad2f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:58.346092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd214ec6-10fe-4d34-b29a-bb46d01bad2f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:58.359221 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd214ec6-10fe-4d34-b29a-bb46d01bad2f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:58.371925 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cd214ec6-10fe-4d34-b29a-bb46d01bad2f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 2951 microversion: 2.42 time: 0.908683 Jul 28 03:47:58.377370 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1205/2682] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:47:57 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 2951 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:47:58.422467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b2731a74-deb9-4c1c-a34e-8ca199ea822d tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Calling method '.version_select at 0x7ffa749be0d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:58.979519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-91cc386f-171f-49b9-b596-aadf96dfe69a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:47:58.994668 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-91cc386f-171f-49b9-b596-aadf96dfe69a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1468 microversion: 2.1 time: 1.138799 Jul 28 03:47:58.998271 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1478/2683] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:47:57 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1468 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:47:59.009758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-91cc386f-171f-49b9-b596-aadf96dfe69a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:59.013700 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-91cc386f-171f-49b9-b596-aadf96dfe69a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001363 Jul 28 03:47:59.019308 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1479/2684] 10.222.0.48 () {56 vars in 886 bytes} [Thu Jul 28 03:47:58 2022] GET /compute/ => generated 377 bytes in 20 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 28 03:47:59.135470 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b2731a74-deb9-4c1c-a34e-8ca199ea822d tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/ef4c6bda-ccf5-424d-acaf-748692d65162" status: 202 len: 0 microversion: 2.1 time: 0.755931 Jul 28 03:47:59.136966 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1206/2685] 10.222.0.48 () {58 vars in 1287 bytes} [Thu Jul 28 03:47:58 2022] DELETE /compute/v2.1/os-security-group-rules/ef4c6bda-ccf5-424d-acaf-748692d65162 => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:47:59.147770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-396a5327-5101-407b-a4fa-ad0054bf564b tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Action: 'create', calling method: .version_select at 0x7ffa67875280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-305983498", "description": "tempest-description-1470428738"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:47:59.956831 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-396a5327-5101-407b-a4fa-ad0054bf564b tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.813621 Jul 28 03:47:59.965890 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1480/2686] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:47:59 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:47:59.972143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-78a1c1c3-8fd0-4c59-8470-1167091c925e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:47:59.973149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-78a1c1c3-8fd0-4c59-8470-1167091c925e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:00.020889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78a1c1c3-8fd0-4c59-8470-1167091c925e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:00.021863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78a1c1c3-8fd0-4c59-8470-1167091c925e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:00.022136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78a1c1c3-8fd0-4c59-8470-1167091c925e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:00.022576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78a1c1c3-8fd0-4c59-8470-1167091c925e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:00.113703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8a40b2dd-fab5-429e-991d-defca341aa52 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] Calling method '.version_select at 0x7ffa7981e3a0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:00.199900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a40b2dd-fab5-429e-991d-defca341aa52 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:00.203026 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a40b2dd-fab5-429e-991d-defca341aa52 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:00.205358 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a40b2dd-fab5-429e-991d-defca341aa52 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:00.208708 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a40b2dd-fab5-429e-991d-defca341aa52 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:00.286806 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8a40b2dd-fab5-429e-991d-defca341aa52 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] 10.222.0.48 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.970941 Jul 28 03:48:00.291617 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1207/2687] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Jul 28 03:47:59 2022] GET /compute/v2.1/limits => generated 511 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:48:00.304592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-10e59b07-3836-457d-92da-c3ae62f1d5d1 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Action: 'create', calling method: .version_select at 0x7ffa749bea60>, body: {"security_group_rule": {"parent_group_id": "8c59f73e-e634-4563-b87f-403755707f37", "ip_protocol": "tcp", "from_port": 1673508857, "to_port": 22}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:00.411203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-78a1c1c3-8fd0-4c59-8470-1167091c925e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:00.424235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-78a1c1c3-8fd0-4c59-8470-1167091c925e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:00.444323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-78a1c1c3-8fd0-4c59-8470-1167091c925e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:00.448687 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-78a1c1c3-8fd0-4c59-8470-1167091c925e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 2909 microversion: 2.42 time: 0.480788 Jul 28 03:48:00.454932 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1481/2688] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:47:59 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 2909 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:00.467307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f7580388-8bce-4227-a3e0-7f146a16e54b req-0d756460-af94-4640-8406-5d986c085c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-unplugged", "status": "completed", "tag": "aafba26f-665f-4f25-a548-ebfcf3f246ed"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:00.514084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f7580388-8bce-4227-a3e0-7f146a16e54b req-0d756460-af94-4640-8406-5d986c085c08 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:00.519318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f7580388-8bce-4227-a3e0-7f146a16e54b req-0d756460-af94-4640-8406-5d986c085c08 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:00.578277 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f7580388-8bce-4227-a3e0-7f146a16e54b req-0d756460-af94-4640-8406-5d986c085c08 service nova] Creating event network-vif-unplugged:aafba26f-665f-4f25-a548-ebfcf3f246ed for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:48:00.606943 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f7580388-8bce-4227-a3e0-7f146a16e54b req-0d756460-af94-4640-8406-5d986c085c08 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150122 Jul 28 03:48:00.609518 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1482/2689] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:00.620175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51c3c76f-3a5c-43ce-844b-1b6be96689d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:00.626813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-51c3c76f-3a5c-43ce-844b-1b6be96689d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:00.652261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51c3c76f-3a5c-43ce-844b-1b6be96689d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:00.653179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51c3c76f-3a5c-43ce-844b-1b6be96689d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:00.654148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51c3c76f-3a5c-43ce-844b-1b6be96689d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:00.654799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51c3c76f-3a5c-43ce-844b-1b6be96689d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:00.901925 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-10e59b07-3836-457d-92da-c3ae62f1d5d1 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] HTTP exception thrown: Invalid port range 1673508857:22. Former value cannot be greater than the later Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-10e59b07-3836-457d-92da-c3ae62f1d5d1 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Request method failure captured: Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 146 Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gbqPeJx0IYdqgpNVkzexDZ767FN5WkVko-LuiYjPRr3VyRHAhWxDipypOrNUXNo0RSxSFtbzc0mn3fQgYsd-XoGgdVNupqZKLmF9CUJ0He5efW6p9sxtEKw0wSF58ZED58GqcD7HjMU8Ix5K5AbFtg1QUtBfCjMXhZJF2eC9sxiA28 Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}] Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: af66789684d74192b82fcfb3b850f2ca Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: {"security_group_rule": {"parent_group_id": "8c59f73e-e634-4563-b87f-403755707f37", "ip_protocol": "tcp", "from_port": 1673508857, "to_port": 22}} Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid port range 1673508857:22. Former value cannot be greater than the later Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8c59f73e-e634-4563-b87f-403755707f37', 'ip_protocol': 'tcp', 'from_port': 1673508857, 'to_port': 22}}} Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1673508857:22. Former value cannot be greater than the later Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1673508857:22. Former value cannot be greater than the later Jul 28 03:48:00.904003 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:00.909190 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:00.909190 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:00.909190 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:00.909190 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:00.909190 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:00.909190 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:48:00.909190 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:48:00.909190 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1673508857:22. Former value cannot be greater than the later Jul 28 03:48:00.909190 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:00.909190 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-10e59b07-3836-457d-92da-c3ae62f1d5d1 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Returning 400 to user: Invalid port range 1673508857:22. Former value cannot be greater than the later {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:48:00.909190 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-10e59b07-3836-457d-92da-c3ae62f1d5d1 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.611542 Jul 28 03:48:00.909190 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1208/2690] 10.222.0.48 () {60 vars in 1195 bytes} [Thu Jul 28 03:48:00 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 613 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:48:00.917288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8b591812-4935-45de-b714-4bff5ca789c6 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-453751395", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:01.039515 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-8b591812-4935-45de-b714-4bff5ca789c6 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:48:01.514892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-51c3c76f-3a5c-43ce-844b-1b6be96689d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:01.535343 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51c3c76f-3a5c-43ce-844b-1b6be96689d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1468 microversion: 2.1 time: 0.922892 Jul 28 03:48:01.537405 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1483/2691] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:00 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1468 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:01.545185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9f25dce2-03c3-4e25-88eb-c2c5c6756d70 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Action: 'create', calling method: .version_select at 0x7ffa6782a790>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-681602821", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:01.553077 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-9f25dce2-03c3-4e25-88eb-c2c5c6756d70 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] HTTP exception thrown: Security group id should be uuid Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9f25dce2-03c3-4e25-88eb-c2c5c6756d70 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Request method failure captured: Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 130 Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gbqPeJx0IYdqgpNVkzexDZ767FN5WkVko-LuiYjPRr3VyRHAhWxDipypOrNUXNo0RSxSFtbzc0mn3fQgYsd-XoGgdVNupqZKLmF9CUJ0He5efW6p9sxtEKw0wSF58ZED58GqcD7HjMU8Ix5K5AbFtg1QUtBfCjMXhZJF2eC9sxiA28 Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}] Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: af66789684d74192b82fcfb3b850f2ca Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-681602821", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: exception: Security group id should be uuid Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-681602821', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:48:01.556390 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:48:01.560737 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 28 03:48:01.560737 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:01.566423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9f25dce2-03c3-4e25-88eb-c2c5c6756d70 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Returning 400 to user: Security group id should be uuid {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:48:01.568561 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9f25dce2-03c3-4e25-88eb-c2c5c6756d70 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.026639 Jul 28 03:48:01.574706 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1484/2692] 10.222.0.48 () {60 vars in 1195 bytes} [Thu Jul 28 03:48:01 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:48:01.577228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9f25dce2-03c3-4e25-88eb-c2c5c6756d70 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:01.588473 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9f25dce2-03c3-4e25-88eb-c2c5c6756d70 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.007764 Jul 28 03:48:01.589064 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1485/2693] 10.222.0.48 () {56 vars in 886 bytes} [Thu Jul 28 03:48:01 2022] GET /compute/ => generated 377 bytes in 14 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 28 03:48:01.595032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e9eb10b0-87f4-4da8-83ed-0b46d80c4661 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:01.596015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e9eb10b0-87f4-4da8-83ed-0b46d80c4661 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:01.606042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9eb10b0-87f4-4da8-83ed-0b46d80c4661 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:01.606914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9eb10b0-87f4-4da8-83ed-0b46d80c4661 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:01.608088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9eb10b0-87f4-4da8-83ed-0b46d80c4661 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:01.608878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9eb10b0-87f4-4da8-83ed-0b46d80c4661 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:01.929804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e9eb10b0-87f4-4da8-83ed-0b46d80c4661 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:01.952084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e9eb10b0-87f4-4da8-83ed-0b46d80c4661 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:01.954262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e9eb10b0-87f4-4da8-83ed-0b46d80c4661 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:01.955932 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e9eb10b0-87f4-4da8-83ed-0b46d80c4661 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 2909 microversion: 2.42 time: 0.365657 Jul 28 03:48:01.958513 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1486/2694] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:01 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 2909 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:01.964921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2e940bff-4799-4171-aa62-aef6973bd265 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Action: 'create', calling method: .version_select at 0x7ffa6780c700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-876016870", "description": "tempest-description-1872353687"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:02.308899 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-8b591812-4935-45de-b714-4bff5ca789c6 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] Getting quotas for project 0ef6a1fbfa6846fd9a7fabe9c3ae9b27. Resources: dict_keys(['metadata_items']) {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:48:02.322681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-8b591812-4935-45de-b714-4bff5ca789c6 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] Getting quotas for user 9e2be7f3ee8f48e3a8e6b72d31b0e741 and project 0ef6a1fbfa6846fd9a7fabe9c3ae9b27. Resources: dict_keys(['metadata_items']) {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:48:02.363894 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-8b591812-4935-45de-b714-4bff5ca789c6 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8b591812-4935-45de-b714-4bff5ca789c6 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] Request method failure captured: Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 1751 Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gbv4oTGMtwaC-M5yiIzTrMU8UW2My19lbehlqoJ01YEITKVv0h_70RrxlPapm8lPzRfhUgJTSxS-DHwoKSastzdIR-xM5I1KCGHoWtTsiR2kxH-DLME-ZBGUcL330eCcoT0MCl9YPN8RGQ4HcPYps5aaUt1eSWzgAZw8XU3VJt_JuA Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 0ef6a1fbfa6846fd9a7fabe9c3ae9b27 Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1346658002 Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0ef6a1fbfa6846fd9a7fabe9c3ae9b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0ef6a1fbfa6846fd9a7fabe9c3ae9b27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0ef6a1fbfa6846fd9a7fabe9c3ae9b27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0ef6a1fbfa6846fd9a7fabe9c3ae9b27"}]}] Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1346658002 Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 0ef6a1fbfa6846fd9a7fabe9c3ae9b27 Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1346658002 Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 9e2be7f3ee8f48e3a8e6b72d31b0e741 Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-453751395", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:48:02.366171 n-d-826756-3 devstack@n-api.service[126072]: exception: Maximum number of metadata items exceeds 128 Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-453751395', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 465, in _check_metadata_properties_quota Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2195, in create Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1713, in _create_instance Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 472, in _check_metadata_properties_quota Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:48:02.368243 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 28 03:48:02.370773 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:02.372953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8b591812-4935-45de-b714-4bff5ca789c6 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:48:02.374077 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8b591812-4935-45de-b714-4bff5ca789c6 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.466988 Jul 28 03:48:02.375215 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1209/2695] 10.222.0.48 () {60 vars in 1148 bytes} [Thu Jul 28 03:48:00 2022] POST /compute/v2.1/servers => generated 87 bytes in 1468 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:48:02.377649 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8b591812-4935-45de-b714-4bff5ca789c6 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:02.380505 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8b591812-4935-45de-b714-4bff5ca789c6 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] 10.222.0.48 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.003238 Jul 28 03:48:02.381090 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1210/2696] 10.222.0.48 () {54 vars in 1035 bytes} [Thu Jul 28 03:48:02 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 28 03:48:02.388250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8b591812-4935-45de-b714-4bff5ca789c6 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:02.389567 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8b591812-4935-45de-b714-4bff5ca789c6 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001721 Jul 28 03:48:02.391002 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1211/2697] 10.222.0.48 () {54 vars in 1041 bytes} [Thu Jul 28 03:48:02 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:02.399434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8b591812-4935-45de-b714-4bff5ca789c6 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:02.400907 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8b591812-4935-45de-b714-4bff5ca789c6 tempest-AbsoluteLimitsNegativeTestJSON-1346658002 tempest-AbsoluteLimitsNegativeTestJSON-1346658002-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001832 Jul 28 03:48:02.401715 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1212/2698] 10.222.0.48 () {56 vars in 886 bytes} [Thu Jul 28 03:48:02 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 28 03:48:02.497279 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2e940bff-4799-4171-aa62-aef6973bd265 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.537236 Jul 28 03:48:02.497889 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1487/2699] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:48:01 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:02.514719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4e5f7f8a-79d1-4c84-8843-34938f233b92 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Action: 'create', calling method: .version_select at 0x7ffa7980e0d0>, body: {"security_group_rule": {"parent_group_id": "1fe10d04-f6a0-4a94-ab13-ada5df5b1b5c", "ip_protocol": "tempest-999-1644450327", "from_port": 22, "to_port": 22}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:02.561903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2c00fe0d-bfde-4aef-9e33-e34fd4ec9fa5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:02.562739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2c00fe0d-bfde-4aef-9e33-e34fd4ec9fa5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:02.574321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c00fe0d-bfde-4aef-9e33-e34fd4ec9fa5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:02.575312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c00fe0d-bfde-4aef-9e33-e34fd4ec9fa5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:02.576448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c00fe0d-bfde-4aef-9e33-e34fd4ec9fa5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:02.577978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c00fe0d-bfde-4aef-9e33-e34fd4ec9fa5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:03.018322 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-4e5f7f8a-79d1-4c84-8843-34938f233b92 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] HTTP exception thrown: Invalid IP protocol tempest-999-1644450327. Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4e5f7f8a-79d1-4c84-8843-34938f233b92 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Request method failure captured: Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 157 Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gbqPeJx0IYdqgpNVkzexDZ767FN5WkVko-LuiYjPRr3VyRHAhWxDipypOrNUXNo0RSxSFtbzc0mn3fQgYsd-XoGgdVNupqZKLmF9CUJ0He5efW6p9sxtEKw0wSF58ZED58GqcD7HjMU8Ix5K5AbFtg1QUtBfCjMXhZJF2eC9sxiA28 Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}] Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: af66789684d74192b82fcfb3b850f2ca Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: {"security_group_rule": {"parent_group_id": "1fe10d04-f6a0-4a94-ab13-ada5df5b1b5c", "ip_protocol": "tempest-999-1644450327", "from_port": 22, "to_port": 22}} Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid IP protocol tempest-999-1644450327. Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1fe10d04-f6a0-4a94-ab13-ada5df5b1b5c', 'ip_protocol': 'tempest-999-1644450327', 'from_port': 22, 'to_port': 22}}} Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1644450327. Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1644450327. Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:03.019978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:03.026785 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:03.026785 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:03.026785 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:03.026785 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:03.026785 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:48:03.026785 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:48:03.026785 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1644450327. Jul 28 03:48:03.026785 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:03.026785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4e5f7f8a-79d1-4c84-8843-34938f233b92 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Returning 400 to user: Invalid IP protocol tempest-999-1644450327. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:48:03.026785 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4e5f7f8a-79d1-4c84-8843-34938f233b92 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.512363 Jul 28 03:48:03.026785 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1213/2700] 10.222.0.48 () {60 vars in 1195 bytes} [Thu Jul 28 03:48:02 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 516 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:48:03.034644 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-df181c7f-06d0-4ff3-a66a-c81ff4848cbe req-e0219207-fff6-4e11-99c9-2e54bbf251c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-unplugged", "status": "completed", "tag": "c40070a3-9cac-4380-8b9c-21f0c6fe3eaa"}, {"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-unplugged", "status": "completed", "tag": "1fcc8042-1405-4e22-b511-0d24dbaa7b21"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:03.071669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2c00fe0d-bfde-4aef-9e33-e34fd4ec9fa5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:03.093701 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2c00fe0d-bfde-4aef-9e33-e34fd4ec9fa5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1468 microversion: 2.1 time: 0.538817 Jul 28 03:48:03.096164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-df181c7f-06d0-4ff3-a66a-c81ff4848cbe req-e0219207-fff6-4e11-99c9-2e54bbf251c1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:03.102579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-df181c7f-06d0-4ff3-a66a-c81ff4848cbe req-e0219207-fff6-4e11-99c9-2e54bbf251c1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:03.107817 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1488/2701] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:02 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1468 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:03.133156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47ca7654-8af6-4623-b3d6-5905a07ed448 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:03.133808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-47ca7654-8af6-4623-b3d6-5905a07ed448 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:03.148262 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-df181c7f-06d0-4ff3-a66a-c81ff4848cbe req-e0219207-fff6-4e11-99c9-2e54bbf251c1 service nova] Creating event network-vif-unplugged:c40070a3-9cac-4380-8b9c-21f0c6fe3eaa for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:48:03.148755 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-df181c7f-06d0-4ff3-a66a-c81ff4848cbe req-e0219207-fff6-4e11-99c9-2e54bbf251c1 service nova] Creating event network-vif-unplugged:1fcc8042-1405-4e22-b511-0d24dbaa7b21 for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:48:03.157642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47ca7654-8af6-4623-b3d6-5905a07ed448 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:03.165681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47ca7654-8af6-4623-b3d6-5905a07ed448 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:03.168841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47ca7654-8af6-4623-b3d6-5905a07ed448 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:03.170859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47ca7654-8af6-4623-b3d6-5905a07ed448 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:03.178600 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-df181c7f-06d0-4ff3-a66a-c81ff4848cbe req-e0219207-fff6-4e11-99c9-2e54bbf251c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.150475 Jul 28 03:48:03.183450 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1214/2702] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:03.194256 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b1cdc27-3fa6-45ab-a963-8ce6c58b7ad0 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Action: 'create', calling method: .version_select at 0x7ffa7980e4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1087100073", "description": "tempest-description-1197110836"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:03.223574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:03.525304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-47ca7654-8af6-4623-b3d6-5905a07ed448 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:03.569033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-47ca7654-8af6-4623-b3d6-5905a07ed448 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:03.582728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-47ca7654-8af6-4623-b3d6-5905a07ed448 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:03.587694 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-47ca7654-8af6-4623-b3d6-5905a07ed448 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 2863 microversion: 2.42 time: 0.474187 Jul 28 03:48:03.591687 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1489/2703] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:03 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 2863 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:03.839138 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2b1cdc27-3fa6-45ab-a963-8ce6c58b7ad0 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.653413 Jul 28 03:48:03.840014 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1215/2704] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:48:03 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:03.856172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abdf477a-4f18-4f99-a03f-f2e0acae177d tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Action: 'create', calling method: .version_select at 0x7ffa677511f0>, body: {"security_group_rule": {"parent_group_id": "f698fd49-ddee-4932-bb1e-b55a81c4af06", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:04.012176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-95cc1290-a3d8-4888-b380-e4b2ff639a1c req-1b4849a0-ce39-48a2-aef8-dd965d54bcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-deleted", "tag": "3e015ffb-f6e7-43ce-ac59-41ddf8b14cdf"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:04.047225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-95cc1290-a3d8-4888-b380-e4b2ff639a1c req-1b4849a0-ce39-48a2-aef8-dd965d54bcd9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:04.054294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-95cc1290-a3d8-4888-b380-e4b2ff639a1c req-1b4849a0-ce39-48a2-aef8-dd965d54bcd9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:04.097546 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-95cc1290-a3d8-4888-b380-e4b2ff639a1c req-1b4849a0-ce39-48a2-aef8-dd965d54bcd9 service nova] Creating event network-vif-deleted:3e015ffb-f6e7-43ce-ac59-41ddf8b14cdf for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:48:04.113945 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-95cc1290-a3d8-4888-b380-e4b2ff639a1c req-1b4849a0-ce39-48a2-aef8-dd965d54bcd9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106503 Jul 28 03:48:04.116593 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1216/2705] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:04.142664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6d783ede-1177-4215-823e-56a35a3dbc8d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:04.144239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6d783ede-1177-4215-823e-56a35a3dbc8d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:04.161524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6d783ede-1177-4215-823e-56a35a3dbc8d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:04.164768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6d783ede-1177-4215-823e-56a35a3dbc8d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:04.193524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6d783ede-1177-4215-823e-56a35a3dbc8d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:04.194521 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6d783ede-1177-4215-823e-56a35a3dbc8d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:04.241868 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-abdf477a-4f18-4f99-a03f-f2e0acae177d tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abdf477a-4f18-4f99-a03f-f2e0acae177d tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Request method failure captured: Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 138 Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gbqPeJx0IYdqgpNVkzexDZ767FN5WkVko-LuiYjPRr3VyRHAhWxDipypOrNUXNo0RSxSFtbzc0mn3fQgYsd-XoGgdVNupqZKLmF9CUJ0He5efW6p9sxtEKw0wSF58ZED58GqcD7HjMU8Ix5K5AbFtg1QUtBfCjMXhZJF2eC9sxiA28 Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}] Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: af66789684d74192b82fcfb3b850f2ca Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: {"security_group_rule": {"parent_group_id": "f698fd49-ddee-4932-bb1e-b55a81c4af06", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f698fd49-ddee-4932-bb1e-b55a81c4af06', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 03:48:04.244460 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:04.248269 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:04.248269 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:04.248269 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:04.248269 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:04.248269 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:04.248269 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:48:04.248269 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:48:04.248269 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 28 03:48:04.248269 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:04.249868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abdf477a-4f18-4f99-a03f-f2e0acae177d tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:48:04.251262 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-abdf477a-4f18-4f99-a03f-f2e0acae177d tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.399786 Jul 28 03:48:04.253310 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1490/2706] 10.222.0.48 () {60 vars in 1195 bytes} [Thu Jul 28 03:48:03 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 403 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:48:04.266388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0c58e6a7-d2b8-4baa-89a2-79fbcf5bad14 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Action: 'create', calling method: .version_select at 0x7ffa6780cee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-76915189", "description": "tempest-description-1137298863"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:04.848081 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0c58e6a7-d2b8-4baa-89a2-79fbcf5bad14 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.587575 Jul 28 03:48:04.850198 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1491/2707] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:48:04 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:04.864124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1817724-4978-4da0-b0bb-ffdc87b93583 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:04.865426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1817724-4978-4da0-b0bb-ffdc87b93583 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:04.890704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1817724-4978-4da0-b0bb-ffdc87b93583 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:04.896866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1817724-4978-4da0-b0bb-ffdc87b93583 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:04.900567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1817724-4978-4da0-b0bb-ffdc87b93583 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:04.905438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1817724-4978-4da0-b0bb-ffdc87b93583 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:05.154151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6d783ede-1177-4215-823e-56a35a3dbc8d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:05.175964 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6d783ede-1177-4215-823e-56a35a3dbc8d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1473 microversion: 2.1 time: 1.039574 Jul 28 03:48:05.193157 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1217/2708] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:04 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1473 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:05.222196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d24b32a7-7690-4b53-846e-3d27fab1a91d tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Action: 'create', calling method: .version_select at 0x7ffa74148670>, body: {"security_group_rule": {"parent_group_id": "f02bdae2-b6b8-40df-83b9-760cbafcaf1c", "ip_protocol": "tcp", "from_port": 22, "to_port": 695686068}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:05.406196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b1817724-4978-4da0-b0bb-ffdc87b93583 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:05.435899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b1817724-4978-4da0-b0bb-ffdc87b93583 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:05.448823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b1817724-4978-4da0-b0bb-ffdc87b93583 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:05.451498 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1817724-4978-4da0-b0bb-ffdc87b93583 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 2572 microversion: 2.42 time: 0.599664 Jul 28 03:48:05.452770 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1492/2709] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:04 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 2572 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:05.794777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b58d7c0-2499-491f-9241-9093754d880e tempest-ExtensionsTest-1846724913 tempest-ExtensionsTest-1846724913-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:05.797532 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b58d7c0-2499-491f-9241-9093754d880e tempest-ExtensionsTest-1846724913 tempest-ExtensionsTest-1846724913-project] 10.222.0.48 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.332574 Jul 28 03:48:05.799457 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1493/2710] 10.222.0.48 () {58 vars in 1170 bytes} [Thu Jul 28 03:48:05 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:05.811974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b2388d24-8a01-49f7-806d-7deae91b1e17 req-219f63b8-768e-4028-8be7-e407287f226c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-unplugged", "status": "completed", "tag": "23985630-7906-4149-8966-da8b75db4ec3"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:05.832723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b2388d24-8a01-49f7-806d-7deae91b1e17 req-219f63b8-768e-4028-8be7-e407287f226c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:05.834514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b2388d24-8a01-49f7-806d-7deae91b1e17 req-219f63b8-768e-4028-8be7-e407287f226c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:05.862185 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b2388d24-8a01-49f7-806d-7deae91b1e17 req-219f63b8-768e-4028-8be7-e407287f226c service nova] Creating event network-vif-unplugged:23985630-7906-4149-8966-da8b75db4ec3 for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:48:05.877765 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b2388d24-8a01-49f7-806d-7deae91b1e17 req-219f63b8-768e-4028-8be7-e407287f226c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071143 Jul 28 03:48:05.880383 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1494/2711] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:05.906134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4f3ca439-0924-4186-8c24-1ad6626c0556 tempest-ExtensionsTest-1846724913 tempest-ExtensionsTest-1846724913-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:05.914361 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4f3ca439-0924-4186-8c24-1ad6626c0556 tempest-ExtensionsTest-1846724913 tempest-ExtensionsTest-1846724913-project] 10.222.0.48 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.030989 Jul 28 03:48:05.916308 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1495/2712] 10.222.0.48 () {58 vars in 1134 bytes} [Thu Jul 28 03:48:05 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:48:05.991768 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-d24b32a7-7690-4b53-846e-3d27fab1a91d tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] HTTP exception thrown: Invalid port range 22:695686068. Valid TCP ports should be between 1-65535 Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d24b32a7-7690-4b53-846e-3d27fab1a91d tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Request method failure captured: Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 145 Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gbqPeJx0IYdqgpNVkzexDZ767FN5WkVko-LuiYjPRr3VyRHAhWxDipypOrNUXNo0RSxSFtbzc0mn3fQgYsd-XoGgdVNupqZKLmF9CUJ0He5efW6p9sxtEKw0wSF58ZED58GqcD7HjMU8Ix5K5AbFtg1QUtBfCjMXhZJF2eC9sxiA28 Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}] Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: af66789684d74192b82fcfb3b850f2ca Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: {"security_group_rule": {"parent_group_id": "f02bdae2-b6b8-40df-83b9-760cbafcaf1c", "ip_protocol": "tcp", "from_port": 22, "to_port": 695686068}} Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid port range 22:695686068. Valid TCP ports should be between 1-65535 Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f02bdae2-b6b8-40df-83b9-760cbafcaf1c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 695686068}}} Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:695686068. Valid TCP ports should be between 1-65535 Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:695686068. Valid TCP ports should be between 1-65535 Jul 28 03:48:05.993482 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:05.997862 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:05.997862 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:05.997862 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:05.997862 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:05.997862 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:05.997862 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:48:05.997862 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:48:05.997862 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:695686068. Valid TCP ports should be between 1-65535 Jul 28 03:48:05.997862 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:05.997862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d24b32a7-7690-4b53-846e-3d27fab1a91d tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Returning 400 to user: Invalid port range 22:695686068. Valid TCP ports should be between 1-65535 {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:48:05.997862 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d24b32a7-7690-4b53-846e-3d27fab1a91d tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.799748 Jul 28 03:48:06.000269 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1218/2713] 10.222.0.48 () {60 vars in 1195 bytes} [Thu Jul 28 03:48:05 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 806 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:48:06.005631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-24cbb6df-36ba-43ea-830b-11531cd03442 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Action: 'create', calling method: .version_select at 0x7ffa67761040>, body: {"security_group_rule": {"parent_group_id": "7882817e-a065-4e2f-976a-42d6b606c3d3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:06.212144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG neutronclient.v2_0.client [None req-24cbb6df-36ba-43ea-830b-11531cd03442 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7882817e-a065-4e2f-976a-42d6b606c3d3 does not exist", "detail": ""}} {{(pid=126071) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:48:06.212769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.security_group_api [None req-24cbb6df-36ba-43ea-830b-11531cd03442 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Neutron security group 7882817e-a065-4e2f-976a-42d6b606c3d3 not found {{(pid=126071) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 03:48:06.213461 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-24cbb6df-36ba-43ea-830b-11531cd03442 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] HTTP exception thrown: Security group 7882817e-a065-4e2f-976a-42d6b606c3d3 does not exist Jul 28 03:48:06.213461 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-6fc5deab-633b-4bae-bab7-9b46cf81cd8c'] Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-24cbb6df-36ba-43ea-830b-11531cd03442 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Request method failure captured: Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 138 Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gbqPeJx0IYdqgpNVkzexDZ767FN5WkVko-LuiYjPRr3VyRHAhWxDipypOrNUXNo0RSxSFtbzc0mn3fQgYsd-XoGgdVNupqZKLmF9CUJ0He5efW6p9sxtEKw0wSF58ZED58GqcD7HjMU8Ix5K5AbFtg1QUtBfCjMXhZJF2eC9sxiA28 Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}] Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: af66789684d74192b82fcfb3b850f2ca Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: {"security_group_rule": {"parent_group_id": "7882817e-a065-4e2f-976a-42d6b606c3d3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: exception: Security group 7882817e-a065-4e2f-976a-42d6b606c3d3 does not exist Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-6fc5deab-633b-4bae-bab7-9b46cf81cd8c'] Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7882817e-a065-4e2f-976a-42d6b606c3d3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:48:06.215730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7882817e-a065-4e2f-976a-42d6b606c3d3 does not exist Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6fc5deab-633b-4bae-bab7-9b46cf81cd8c'] Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7882817e-a065-4e2f-976a-42d6b606c3d3 does not exist Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6fc5deab-633b-4bae-bab7-9b46cf81cd8c'] Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7882817e-a065-4e2f-976a-42d6b606c3d3 does not exist Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6fc5deab-633b-4bae-bab7-9b46cf81cd8c'] Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7882817e-a065-4e2f-976a-42d6b606c3d3 does not exist Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6fc5deab-633b-4bae-bab7-9b46cf81cd8c'] Jul 28 03:48:06.219306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:06.222723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d136928d-71f9-487e-9905-ee38dab89f37 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:06.225486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-24cbb6df-36ba-43ea-830b-11531cd03442 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Returning 404 to user: Security group 7882817e-a065-4e2f-976a-42d6b606c3d3 does not exist Jul 28 03:48:06.225486 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-6fc5deab-633b-4bae-bab7-9b46cf81cd8c'] {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:48:06.225850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d136928d-71f9-487e-9905-ee38dab89f37 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:06.226958 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-24cbb6df-36ba-43ea-830b-11531cd03442 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.225782 Jul 28 03:48:06.228230 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1496/2714] 10.222.0.48 () {60 vars in 1195 bytes} [Thu Jul 28 03:48:06 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:48:06.242129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d69d146b-883b-45a6-93f8-3248447764ed tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Calling method '.version_select at 0x7ffa67740700>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:06.264229 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d136928d-71f9-487e-9905-ee38dab89f37 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:06.273118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d136928d-71f9-487e-9905-ee38dab89f37 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:06.274858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d136928d-71f9-487e-9905-ee38dab89f37 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:06.277913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d136928d-71f9-487e-9905-ee38dab89f37 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:06.345251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG neutronclient.v2_0.client [None req-d69d146b-883b-45a6-93f8-3248447764ed tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 5d24c137-f2a1-4eab-8962-ab1150ee9f80 does not exist", "detail": ""}} {{(pid=126071) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:48:06.348993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.security_group_api [None req-d69d146b-883b-45a6-93f8-3248447764ed tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Neutron security group rule 5d24c137-f2a1-4eab-8962-ab1150ee9f80 not found {{(pid=126071) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 28 03:48:06.349479 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-d69d146b-883b-45a6-93f8-3248447764ed tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] HTTP exception thrown: Security group rule 5d24c137-f2a1-4eab-8962-ab1150ee9f80 does not exist Jul 28 03:48:06.349479 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-33b190a0-8d9f-4833-a731-342eb17644d1'] Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d69d146b-883b-45a6-93f8-3248447764ed tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Request method failure captured: Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/os-security-group-rules/5d24c137-f2a1-4eab-8962-ab1150ee9f80 HTTP/1.1 Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gbqPeJx0IYdqgpNVkzexDZ767FN5WkVko-LuiYjPRr3VyRHAhWxDipypOrNUXNo0RSxSFtbzc0mn3fQgYsd-XoGgdVNupqZKLmF9CUJ0He5efW6p9sxtEKw0wSF58ZED58GqcD7HjMU8Ix5K5AbFtg1QUtBfCjMXhZJF2eC9sxiA28 Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_db0e85f2b9424deeb66f7246491c4d91"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/db0e85f2b9424deeb66f7246491c4d91"}]}] Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: db0e85f2b9424deeb66f7246491c4d91 Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454 Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: af66789684d74192b82fcfb3b850f2ca Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: exception: Security group rule 5d24c137-f2a1-4eab-8962-ab1150ee9f80 does not exist Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-33b190a0-8d9f-4833-a731-342eb17644d1'] Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '5d24c137-f2a1-4eab-8962-ab1150ee9f80'} Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:48:06.353161 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 5d24c137-f2a1-4eab-8962-ab1150ee9f80 does not exist Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33b190a0-8d9f-4833-a731-342eb17644d1'] Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 5d24c137-f2a1-4eab-8962-ab1150ee9f80 does not exist Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33b190a0-8d9f-4833-a731-342eb17644d1'] Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 5d24c137-f2a1-4eab-8962-ab1150ee9f80 does not exist Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33b190a0-8d9f-4833-a731-342eb17644d1'] Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 5d24c137-f2a1-4eab-8962-ab1150ee9f80 does not exist Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33b190a0-8d9f-4833-a731-342eb17644d1'] Jul 28 03:48:06.356870 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:06.360721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d69d146b-883b-45a6-93f8-3248447764ed tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Returning 404 to user: Security group rule 5d24c137-f2a1-4eab-8962-ab1150ee9f80 does not exist Jul 28 03:48:06.360721 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-33b190a0-8d9f-4833-a731-342eb17644d1'] {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:48:06.362032 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d69d146b-883b-45a6-93f8-3248447764ed tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-group-rules/5d24c137-f2a1-4eab-8962-ab1150ee9f80" status: 404 len: 199 microversion: 2.1 time: 0.126463 Jul 28 03:48:06.364598 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1497/2715] 10.222.0.48 () {58 vars in 1287 bytes} [Thu Jul 28 03:48:06 2022] DELETE /compute/v2.1/os-security-group-rules/5d24c137-f2a1-4eab-8962-ab1150ee9f80 => generated 199 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:48:06.381784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb1b32d1-f1e3-4811-b794-0ee874afd9cc tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Calling method '.version_select at 0x7ffa67761310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:07.086944 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb1b32d1-f1e3-4811-b794-0ee874afd9cc tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/f02bdae2-b6b8-40df-83b9-760cbafcaf1c" status: 202 len: 0 microversion: 2.1 time: 0.716556 Jul 28 03:48:07.091108 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1498/2716] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:48:06 2022] DELETE /compute/v2.1/os-security-groups/f02bdae2-b6b8-40df-83b9-760cbafcaf1c => generated 0 bytes in 718 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:48:07.092662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-13c508f7-173c-4620-b7dc-d69fc5a96f8c req-78d522d5-3e58-4752-85e7-e56ed6762cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-deleted", "tag": "c40070a3-9cac-4380-8b9c-21f0c6fe3eaa"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:07.129311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-13c508f7-173c-4620-b7dc-d69fc5a96f8c req-78d522d5-3e58-4752-85e7-e56ed6762cb5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:07.130037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-13c508f7-173c-4620-b7dc-d69fc5a96f8c req-78d522d5-3e58-4752-85e7-e56ed6762cb5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:07.161916 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-13c508f7-173c-4620-b7dc-d69fc5a96f8c req-78d522d5-3e58-4752-85e7-e56ed6762cb5 service nova] Creating event network-vif-deleted:c40070a3-9cac-4380-8b9c-21f0c6fe3eaa for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:48:07.168496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d136928d-71f9-487e-9905-ee38dab89f37 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:07.171819 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-13c508f7-173c-4620-b7dc-d69fc5a96f8c req-78d522d5-3e58-4752-85e7-e56ed6762cb5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082839 Jul 28 03:48:07.173155 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1499/2717] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:07.189424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fe0d8b4a-0639-4c67-aff9-4cfff7ff78e5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:07.191818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fe0d8b4a-0639-4c67-aff9-4cfff7ff78e5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:07.195824 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d136928d-71f9-487e-9905-ee38dab89f37 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1473 microversion: 2.1 time: 0.980204 Jul 28 03:48:07.208237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe0d8b4a-0639-4c67-aff9-4cfff7ff78e5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:07.213263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe0d8b4a-0639-4c67-aff9-4cfff7ff78e5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:07.214573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe0d8b4a-0639-4c67-aff9-4cfff7ff78e5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:07.215513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe0d8b4a-0639-4c67-aff9-4cfff7ff78e5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:07.227980 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1219/2718] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:06 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1473 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:07.249706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6f247852-fe89-4356-b937-d49c13cdca5e tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Calling method '.version_select at 0x7ffa745b7c10>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:08.221894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fe0d8b4a-0639-4c67-aff9-4cfff7ff78e5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:08.238299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fe0d8b4a-0639-4c67-aff9-4cfff7ff78e5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:08.248577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fe0d8b4a-0639-4c67-aff9-4cfff7ff78e5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:08.251096 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fe0d8b4a-0639-4c67-aff9-4cfff7ff78e5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 2526 microversion: 2.42 time: 1.076185 Jul 28 03:48:08.265469 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1500/2719] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:07 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 2526 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:08.266391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7dd0023e-8563-4559-ab7d-e70034d7d585 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:08.267517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7dd0023e-8563-4559-ab7d-e70034d7d585 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:08.291635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7dd0023e-8563-4559-ab7d-e70034d7d585 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:08.292412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7dd0023e-8563-4559-ab7d-e70034d7d585 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:08.293464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7dd0023e-8563-4559-ab7d-e70034d7d585 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:08.295264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7dd0023e-8563-4559-ab7d-e70034d7d585 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:08.355765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7dd0023e-8563-4559-ab7d-e70034d7d585 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:48:08.537136 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7dd0023e-8563-4559-ab7d-e70034d7d585 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 204 len: 0 microversion: 2.1 time: 0.274297 Jul 28 03:48:08.538904 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1501/2720] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:48:08 2022] DELETE /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:48:08.548272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-977295ad-62b2-4c61-8b0d-727a193067f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:08.550389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-977295ad-62b2-4c61-8b0d-727a193067f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:08.558590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-977295ad-62b2-4c61-8b0d-727a193067f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:08.559436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-977295ad-62b2-4c61-8b0d-727a193067f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:08.560831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-977295ad-62b2-4c61-8b0d-727a193067f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:08.561520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-977295ad-62b2-4c61-8b0d-727a193067f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:08.601326 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6f247852-fe89-4356-b937-d49c13cdca5e tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/f698fd49-ddee-4932-bb1e-b55a81c4af06" status: 202 len: 0 microversion: 2.1 time: 1.370955 Jul 28 03:48:08.608012 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1220/2721] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:48:07 2022] DELETE /compute/v2.1/os-security-groups/f698fd49-ddee-4932-bb1e-b55a81c4af06 => generated 0 bytes in 1379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:48:08.623213 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3494ce85-5aaa-43e4-8392-5d119069d067 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:08.624184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3494ce85-5aaa-43e4-8392-5d119069d067 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:08.644307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3494ce85-5aaa-43e4-8392-5d119069d067 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:08.645202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3494ce85-5aaa-43e4-8392-5d119069d067 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:08.646813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3494ce85-5aaa-43e4-8392-5d119069d067 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:08.647415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3494ce85-5aaa-43e4-8392-5d119069d067 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:09.020120 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3494ce85-5aaa-43e4-8392-5d119069d067 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4289787d6b5e412e8ab5928df4ca9bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759506bd247a40d59e76d660d408755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:09.033347 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3494ce85-5aaa-43e4-8392-5d119069d067 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 200 len: 1665 microversion: 2.1 time: 0.423706 Jul 28 03:48:09.033980 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1221/2722] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:08 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 1665 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:09.070278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c781c156-ca14-43c3-9e8e-be01f490463c tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Calling method '.version_select at 0x7ffa7985a820>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:09.335861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-977295ad-62b2-4c61-8b0d-727a193067f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:09.380760 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-977295ad-62b2-4c61-8b0d-727a193067f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1473 microversion: 2.1 time: 0.837334 Jul 28 03:48:09.386066 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1502/2723] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:08 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1473 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:09.409187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-150d837b-6445-4ab7-87ad-d3d1bc78a640 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:09.415380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-150d837b-6445-4ab7-87ad-d3d1bc78a640 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:09.443255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150d837b-6445-4ab7-87ad-d3d1bc78a640 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:09.446925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150d837b-6445-4ab7-87ad-d3d1bc78a640 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:09.453427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150d837b-6445-4ab7-87ad-d3d1bc78a640 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:09.456524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150d837b-6445-4ab7-87ad-d3d1bc78a640 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:09.550265 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c781c156-ca14-43c3-9e8e-be01f490463c tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/1fe10d04-f6a0-4a94-ab13-ada5df5b1b5c" status: 202 len: 0 microversion: 2.1 time: 0.494336 Jul 28 03:48:09.551442 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1222/2724] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:48:09 2022] DELETE /compute/v2.1/os-security-groups/1fe10d04-f6a0-4a94-ab13-ada5df5b1b5c => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:48:09.557788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-8a639c8f-67ae-419b-b9bc-889112ac4ea7 req-8db4e56e-a7a9-4a1c-9a1d-1ae97827bd72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-deleted", "tag": "1fcc8042-1405-4e22-b511-0d24dbaa7b21"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:09.602122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-8a639c8f-67ae-419b-b9bc-889112ac4ea7 req-8db4e56e-a7a9-4a1c-9a1d-1ae97827bd72 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:09.602979 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-8a639c8f-67ae-419b-b9bc-889112ac4ea7 req-8db4e56e-a7a9-4a1c-9a1d-1ae97827bd72 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:09.636187 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-8a639c8f-67ae-419b-b9bc-889112ac4ea7 req-8db4e56e-a7a9-4a1c-9a1d-1ae97827bd72 service nova] Creating event network-vif-deleted:1fcc8042-1405-4e22-b511-0d24dbaa7b21 for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:48:09.649542 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-8a639c8f-67ae-419b-b9bc-889112ac4ea7 req-8db4e56e-a7a9-4a1c-9a1d-1ae97827bd72 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096330 Jul 28 03:48:09.650989 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1223/2725] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:09.658321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9476b1a7-74ad-43b8-88e8-57787f426c59 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Calling method '.version_select at 0x7ffa741ca280>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:09.994636 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9476b1a7-74ad-43b8-88e8-57787f426c59 tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/8c59f73e-e634-4563-b87f-403755707f37" status: 202 len: 0 microversion: 2.1 time: 0.340949 Jul 28 03:48:09.995238 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1224/2726] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:48:09 2022] DELETE /compute/v2.1/os-security-groups/8c59f73e-e634-4563-b87f-403755707f37 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:48:10.006470 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6be6640b-7b43-4f5c-ba89-704f4ca5c95a tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] Calling method '.version_select at 0x7ffa79819af0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:10.034895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-150d837b-6445-4ab7-87ad-d3d1bc78a640 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:10.052035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-150d837b-6445-4ab7-87ad-d3d1bc78a640 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:10.067236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-150d837b-6445-4ab7-87ad-d3d1bc78a640 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:10.068836 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-150d837b-6445-4ab7-87ad-d3d1bc78a640 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 2366 microversion: 2.42 time: 0.679144 Jul 28 03:48:10.070568 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1503/2727] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:09 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 2366 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:10.090940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-01c524ee-1ca5-4b10-9669-d04e681a9ee5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:10.102526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-01c524ee-1ca5-4b10-9669-d04e681a9ee5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:10.141667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01c524ee-1ca5-4b10-9669-d04e681a9ee5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:10.142895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01c524ee-1ca5-4b10-9669-d04e681a9ee5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:10.144329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01c524ee-1ca5-4b10-9669-d04e681a9ee5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:10.151073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01c524ee-1ca5-4b10-9669-d04e681a9ee5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:10.242989 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:10.738003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-01c524ee-1ca5-4b10-9669-d04e681a9ee5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4289787d6b5e412e8ab5928df4ca9bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759506bd247a40d59e76d660d408755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:10.752643 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-01c524ee-1ca5-4b10-9669-d04e681a9ee5 tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 200 len: 1665 microversion: 2.1 time: 0.676965 Jul 28 03:48:10.753628 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1504/2728] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:10 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 1665 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:10.770682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b436cfd5-613c-4b2f-9dd8-eaf77441a76a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:10.771313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b436cfd5-613c-4b2f-9dd8-eaf77441a76a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:10.789426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b436cfd5-613c-4b2f-9dd8-eaf77441a76a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:10.793677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b436cfd5-613c-4b2f-9dd8-eaf77441a76a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:10.795335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b436cfd5-613c-4b2f-9dd8-eaf77441a76a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:10.795942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b436cfd5-613c-4b2f-9dd8-eaf77441a76a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:10.974564 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6be6640b-7b43-4f5c-ba89-704f4ca5c95a tempest-SecurityGroupRulesNegativeTestJSON-1079495454 tempest-SecurityGroupRulesNegativeTestJSON-1079495454-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/64734551-83db-4724-bfac-ecc8faae7f2d" status: 202 len: 0 microversion: 2.1 time: 0.973775 Jul 28 03:48:10.975792 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1225/2729] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:48:09 2022] DELETE /compute/v2.1/os-security-groups/64734551-83db-4724-bfac-ecc8faae7f2d => generated 0 bytes in 976 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:48:10.980725 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d57eaccc-a0a8-4e39-b515-a4665ba4beab tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] Calling method '.version_select at 0x7ffa74217790>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:11.147363 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d57eaccc-a0a8-4e39-b515-a4665ba4beab tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/91e58114-d396-4b5a-8ec6-e48dc5e11df5" status: 200 len: 351 microversion: 2.1 time: 0.170195 Jul 28 03:48:11.148148 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1226/2730] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:48:10 2022] GET /compute/v2.1/os-volumes/91e58114-d396-4b5a-8ec6-e48dc5e11df5 => generated 351 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:11.154802 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1fd8c9cd-f677-4c88-9b95-1e5fac0c6142 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:11.158289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1fd8c9cd-f677-4c88-9b95-1e5fac0c6142 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:11.160596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:11.172981 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1fd8c9cd-f677-4c88-9b95-1e5fac0c6142 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:11.173440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1fd8c9cd-f677-4c88-9b95-1e5fac0c6142 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:11.174233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1fd8c9cd-f677-4c88-9b95-1e5fac0c6142 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:11.181178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1fd8c9cd-f677-4c88-9b95-1e5fac0c6142 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:11.417705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b436cfd5-613c-4b2f-9dd8-eaf77441a76a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:11.427203 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b436cfd5-613c-4b2f-9dd8-eaf77441a76a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1473 microversion: 2.1 time: 0.671694 Jul 28 03:48:11.433133 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1505/2731] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:10 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1473 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:11.775572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb64427e-0771-4d5c-abba-a0b01357b19c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:11.776158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb64427e-0771-4d5c-abba-a0b01357b19c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:11.794759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb64427e-0771-4d5c-abba-a0b01357b19c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:11.810026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb64427e-0771-4d5c-abba-a0b01357b19c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:11.810971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb64427e-0771-4d5c-abba-a0b01357b19c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:11.811417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb64427e-0771-4d5c-abba-a0b01357b19c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:12.347690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:12.749033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb64427e-0771-4d5c-abba-a0b01357b19c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4289787d6b5e412e8ab5928df4ca9bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759506bd247a40d59e76d660d408755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:12.775033 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb64427e-0771-4d5c-abba-a0b01357b19c tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 200 len: 1665 microversion: 2.1 time: 1.004581 Jul 28 03:48:12.775631 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1506/2732] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:11 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 1665 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:12.803174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-895572722", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "6ebb296e-16ab-4b71-8374-eccd21117a00"}, {"uuid": "fac8b12d-229c-4ae8-bc46-d4fc5233564a"}, {"uuid": "6ebb296e-16ab-4b71-8374-eccd21117a00"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:12.919493 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1fd8c9cd-f677-4c88-9b95-1e5fac0c6142 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:12.945433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1fd8c9cd-f677-4c88-9b95-1e5fac0c6142 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:12.954440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1fd8c9cd-f677-4c88-9b95-1e5fac0c6142 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:12.960118 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1fd8c9cd-f677-4c88-9b95-1e5fac0c6142 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 2253 microversion: 2.42 time: 1.809055 Jul 28 03:48:12.972737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] validate_networks() for [('6ebb296e-16ab-4b71-8374-eccd21117a00', None, None, None, None, None), ('fac8b12d-229c-4ae8-bc46-d4fc5233564a', None, None, None, None, None), ('6ebb296e-16ab-4b71-8374-eccd21117a00', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:48:12.978846 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1227/2733] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:11 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 2253 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:13.001978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6475b0fb-8eaa-4f02-b1e0-4e70123a3130 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:13.002929 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6475b0fb-8eaa-4f02-b1e0-4e70123a3130 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:13.026798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6475b0fb-8eaa-4f02-b1e0-4e70123a3130 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:13.028520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6475b0fb-8eaa-4f02-b1e0-4e70123a3130 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:13.044164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6475b0fb-8eaa-4f02-b1e0-4e70123a3130 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:13.057432 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6475b0fb-8eaa-4f02-b1e0-4e70123a3130 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:13.880590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6475b0fb-8eaa-4f02-b1e0-4e70123a3130 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:13.889684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:13.905662 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6475b0fb-8eaa-4f02-b1e0-4e70123a3130 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1473 microversion: 2.1 time: 0.924272 Jul 28 03:48:13.907327 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1228/2734] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:12 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1473 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:13.923365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-9185351d-5818-4d25-a132-d7c52f068684 req-1c2763ea-e618-4727-bfb2-e2e478467750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-deleted", "tag": "aafba26f-665f-4f25-a548-ebfcf3f246ed"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:13.956900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9185351d-5818-4d25-a132-d7c52f068684 req-1c2763ea-e618-4727-bfb2-e2e478467750 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:13.959131 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9185351d-5818-4d25-a132-d7c52f068684 req-1c2763ea-e618-4727-bfb2-e2e478467750 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:14.033330 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-9185351d-5818-4d25-a132-d7c52f068684 req-1c2763ea-e618-4727-bfb2-e2e478467750 service nova] Creating event network-vif-deleted:aafba26f-665f-4f25-a548-ebfcf3f246ed for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:48:14.051886 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-9185351d-5818-4d25-a132-d7c52f068684 req-1c2763ea-e618-4727-bfb2-e2e478467750 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141758 Jul 28 03:48:14.065053 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1229/2735] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:14.079835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-131aef0f-fe93-4bfa-bcdf-98a56ab2f49d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:14.085798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-131aef0f-fe93-4bfa-bcdf-98a56ab2f49d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:14.110635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-131aef0f-fe93-4bfa-bcdf-98a56ab2f49d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:14.112016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-131aef0f-fe93-4bfa-bcdf-98a56ab2f49d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:14.119525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-131aef0f-fe93-4bfa-bcdf-98a56ab2f49d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:14.120377 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-131aef0f-fe93-4bfa-bcdf-98a56ab2f49d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:14.587742 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-131aef0f-fe93-4bfa-bcdf-98a56ab2f49d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4289787d6b5e412e8ab5928df4ca9bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '759506bd247a40d59e76d660d408755e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:14.653006 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-131aef0f-fe93-4bfa-bcdf-98a56ab2f49d tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 200 len: 1311 microversion: 2.1 time: 0.560200 Jul 28 03:48:14.654280 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1230/2736] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:14 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 1311 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:14.706811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ccbfbe58-5d21-44e6-9270-5bda76cf5a6c tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] Calling method '.version_select at 0x7ffa74141af0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:14.832405 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ccbfbe58-5d21-44e6-9270-5bda76cf5a6c tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/eee85627-49dc-41f1-b699-7acf6569f54b" status: 200 len: 351 microversion: 2.1 time: 0.161349 Jul 28 03:48:14.834351 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1231/2737] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:48:14 2022] GET /compute/v2.1/os-volumes/eee85627-49dc-41f1-b699-7acf6569f54b => generated 351 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:14.873282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-757c8dcc-edb4-485f-bdef-39b25f784c0a req-76722da5-3bf7-4855-8a01-20d4e2e7deb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbb362b3-647a-479e-951d-e49d4d370136", "name": "network-vif-deleted", "tag": "3c19fad7-bd41-4df7-b15a-7f21e44fbf8e"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:14.958549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-757c8dcc-edb4-485f-bdef-39b25f784c0a req-76722da5-3bf7-4855-8a01-20d4e2e7deb6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:14.959218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-757c8dcc-edb4-485f-bdef-39b25f784c0a req-76722da5-3bf7-4855-8a01-20d4e2e7deb6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:14.986324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:48:14.988427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:48:14.989615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:48:14.990736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:48:14.991671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:48:15.017860 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-757c8dcc-edb4-485f-bdef-39b25f784c0a req-76722da5-3bf7-4855-8a01-20d4e2e7deb6 service nova] Creating event network-vif-deleted:3c19fad7-bd41-4df7-b15a-7f21e44fbf8e for instance dbb362b3-647a-479e-951d-e49d4d370136 on n-h2-826756-3 Jul 28 03:48:15.029311 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-757c8dcc-edb4-485f-bdef-39b25f784c0a req-76722da5-3bf7-4855-8a01-20d4e2e7deb6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192971 Jul 28 03:48:15.030212 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1232/2738] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:15.039970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:15.045518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:15.052941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:15.055486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:15.075706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-66b95923-a97d-4dff-a762-fb3273d375a5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:15.079436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-66b95923-a97d-4dff-a762-fb3273d375a5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:15.103436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66b95923-a97d-4dff-a762-fb3273d375a5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:15.105629 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66b95923-a97d-4dff-a762-fb3273d375a5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:15.106852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66b95923-a97d-4dff-a762-fb3273d375a5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:15.109081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-66b95923-a97d-4dff-a762-fb3273d375a5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:15.130496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Getting quotas for project a6bba8696d304edbb658461d3f313beb. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:48:15.148460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Getting quotas for user 9290ff8a6a524900894b16523e9a2fb8 and project a6bba8696d304edbb658461d3f313beb. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:48:15.180949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:48:15.188061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:48:15.339074 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f78ee0aa-d4e2-43aa-a197-63e230482ef0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.556906 Jul 28 03:48:15.356880 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1507/2739] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:48:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:48:15.377887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-75e36af9-cd8d-440b-885e-a1dd97b5da99 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:15.379269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-75e36af9-cd8d-440b-885e-a1dd97b5da99 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:15.403654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75e36af9-cd8d-440b-885e-a1dd97b5da99 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:15.412404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75e36af9-cd8d-440b-885e-a1dd97b5da99 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:15.414458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75e36af9-cd8d-440b-885e-a1dd97b5da99 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:15.416151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75e36af9-cd8d-440b-885e-a1dd97b5da99 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:15.594280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-66b95923-a97d-4dff-a762-fb3273d375a5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:15.612882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-66b95923-a97d-4dff-a762-fb3273d375a5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:15.617745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-66b95923-a97d-4dff-a762-fb3273d375a5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:15.622070 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-66b95923-a97d-4dff-a762-fb3273d375a5 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1983 microversion: 2.42 time: 0.555076 Jul 28 03:48:15.624394 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1233/2740] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:15 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1983 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:15.639443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3def4676-70f4-44cc-a4b3-04c7d2bdba0d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:15.668244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3def4676-70f4-44cc-a4b3-04c7d2bdba0d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:15.971322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-75e36af9-cd8d-440b-885e-a1dd97b5da99 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:15.986099 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-75e36af9-cd8d-440b-885e-a1dd97b5da99 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1473 microversion: 2.1 time: 0.623769 Jul 28 03:48:15.995376 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1508/2741] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:15 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1473 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:16.005301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b2e113c-0937-4f42-a7d2-5948bbd742cb tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:16.007985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b2e113c-0937-4f42-a7d2-5948bbd742cb tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] [instance: dbb362b3-647a-479e-951d-e49d4d370136] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:16.027255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2e113c-0937-4f42-a7d2-5948bbd742cb tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:16.035292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2e113c-0937-4f42-a7d2-5948bbd742cb tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:16.042290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2e113c-0937-4f42-a7d2-5948bbd742cb tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:16.043038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2e113c-0937-4f42-a7d2-5948bbd742cb tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:16.117496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3def4676-70f4-44cc-a4b3-04c7d2bdba0d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:16.122920 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-7b2e113c-0937-4f42-a7d2-5948bbd742cb tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] HTTP exception thrown: Instance dbb362b3-647a-479e-951d-e49d4d370136 could not be found. Jul 28 03:48:16.126261 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3def4676-70f4-44cc-a4b3-04c7d2bdba0d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1212 microversion: 2.1 time: 0.499591 Jul 28 03:48:16.130519 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1234/2742] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:15 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1212 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b2e113c-0937-4f42-a7d2-5948bbd742cb tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Request method failure captured: Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 HTTP/1.1 Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gapk-wGC_cweUnGP1uh6P96j-SGgs7BuKXWfqTQSVtIDz0blbl7YzJTrKHDUaoE5ObUARshb1UxpC7RZB5kM9mPiVZ56uZufUoq7S7FjvyJo3Xhs35Q-oiRmHbz1NBNBnLssp8k7YT8j3PUBCCzH3TA4R2uWjeHnMG-lm1r5r2uzHs Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 759506bd247a40d59e76d660d408755e Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestFqdnHostnames-779315097 Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/759506bd247a40d59e76d660d408755e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/759506bd247a40d59e76d660d408755e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_759506bd247a40d59e76d660d408755e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/759506bd247a40d59e76d660d408755e"}]}] Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestFqdnHostnames-779315097 Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 759506bd247a40d59e76d660d408755e Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-779315097 Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestFqdnHostnames-779315097-project Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 4289787d6b5e412e8ab5928df4ca9bd7 Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestFqdnHostnames-779315097-project Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance dbb362b3-647a-479e-951d-e49d4d370136 could not be found. Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'dbb362b3-647a-479e-951d-e49d4d370136'} Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbb362b3-647a-479e-951d-e49d4d370136 could not be found. Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbb362b3-647a-479e-951d-e49d4d370136 could not be found. Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:16.141178 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:16.147909 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:16.147909 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:16.147909 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:16.147909 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:48:16.147909 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:48:16.147909 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbb362b3-647a-479e-951d-e49d4d370136 could not be found. Jul 28 03:48:16.147909 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:48:16.150874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-0e4d4313-64cc-4e5a-8c82-02358b8211a7 req-7d690e1d-22a2-4ea0-8d86-6793e2bec285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee94e075-7edd-436d-ae33-6e33bde0472b", "name": "network-vif-deleted", "tag": "23985630-7906-4149-8966-da8b75db4ec3"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:16.153566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b2e113c-0937-4f42-a7d2-5948bbd742cb tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Returning 404 to user: Instance dbb362b3-647a-479e-951d-e49d4d370136 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:48:16.160699 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b2e113c-0937-4f42-a7d2-5948bbd742cb tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136" status: 404 len: 111 microversion: 2.1 time: 0.163293 Jul 28 03:48:16.163923 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1509/2743] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:15 2022] GET /compute/v2.1/servers/dbb362b3-647a-479e-951d-e49d4d370136 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:48:16.177629 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-0e4d4313-64cc-4e5a-8c82-02358b8211a7 req-7d690e1d-22a2-4ea0-8d86-6793e2bec285 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:16.178079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-0e4d4313-64cc-4e5a-8c82-02358b8211a7 req-7d690e1d-22a2-4ea0-8d86-6793e2bec285 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:16.183177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d58e79d6-0bed-4881-acfb-5fa23542430a tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] Calling method '.version_select at 0x7ffa6770b4c0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:16.248504 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-0e4d4313-64cc-4e5a-8c82-02358b8211a7 req-7d690e1d-22a2-4ea0-8d86-6793e2bec285 service nova] Creating event network-vif-deleted:23985630-7906-4149-8966-da8b75db4ec3 for instance ee94e075-7edd-436d-ae33-6e33bde0472b on n-h2-826756-3 Jul 28 03:48:16.272178 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d58e79d6-0bed-4881-acfb-5fa23542430a tempest-ServersTestFqdnHostnames-779315097 tempest-ServersTestFqdnHostnames-779315097-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182726196" status: 202 len: 0 microversion: 2.1 time: 0.101373 Jul 28 03:48:16.273239 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1510/2744] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 03:48:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182726196 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:48:16.274900 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-0e4d4313-64cc-4e5a-8c82-02358b8211a7 req-7d690e1d-22a2-4ea0-8d86-6793e2bec285 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139646 Jul 28 03:48:16.275713 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1235/2745] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:16.663366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ba03742-5350-4e3e-84b3-27a5c53718d7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:16.667368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5ba03742-5350-4e3e-84b3-27a5c53718d7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:16.680128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ba03742-5350-4e3e-84b3-27a5c53718d7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:16.684877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ba03742-5350-4e3e-84b3-27a5c53718d7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:16.686197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ba03742-5350-4e3e-84b3-27a5c53718d7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:16.689724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ba03742-5350-4e3e-84b3-27a5c53718d7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:16.878642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ba03742-5350-4e3e-84b3-27a5c53718d7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:16.894665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ba03742-5350-4e3e-84b3-27a5c53718d7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:16.897890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ba03742-5350-4e3e-84b3-27a5c53718d7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:16.901464 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ba03742-5350-4e3e-84b3-27a5c53718d7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.241495 Jul 28 03:48:16.903522 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1511/2746] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:16 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:17.014393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8c0f6c3a-d6e4-4b76-9a1c-85cd8352a032 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:17.015270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8c0f6c3a-d6e4-4b76-9a1c-85cd8352a032 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:17.031283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c0f6c3a-d6e4-4b76-9a1c-85cd8352a032 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:17.043779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c0f6c3a-d6e4-4b76-9a1c-85cd8352a032 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:17.052004 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c0f6c3a-d6e4-4b76-9a1c-85cd8352a032 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:17.054019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c0f6c3a-d6e4-4b76-9a1c-85cd8352a032 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:17.154245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6e62d2cb-0453-49ce-aa30-d801ab2568c9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:17.155676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6e62d2cb-0453-49ce-aa30-d801ab2568c9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:17.168464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e62d2cb-0453-49ce-aa30-d801ab2568c9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:17.170325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e62d2cb-0453-49ce-aa30-d801ab2568c9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:17.173951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e62d2cb-0453-49ce-aa30-d801ab2568c9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:17.174943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e62d2cb-0453-49ce-aa30-d801ab2568c9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:17.392373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6e62d2cb-0453-49ce-aa30-d801ab2568c9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:17.404330 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6e62d2cb-0453-49ce-aa30-d801ab2568c9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1264 microversion: 2.1 time: 0.258739 Jul 28 03:48:17.405304 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1512/2747] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:17 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:17.930347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b8877cda-66b4-40b1-bafe-0ee0d360af58 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:17.931192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b8877cda-66b4-40b1-bafe-0ee0d360af58 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:17.945619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8877cda-66b4-40b1-bafe-0ee0d360af58 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:17.946492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8877cda-66b4-40b1-bafe-0ee0d360af58 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:17.947507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8877cda-66b4-40b1-bafe-0ee0d360af58 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:17.948101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8877cda-66b4-40b1-bafe-0ee0d360af58 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:18.108942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8c0f6c3a-d6e4-4b76-9a1c-85cd8352a032 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:18.134645 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8c0f6c3a-d6e4-4b76-9a1c-85cd8352a032 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1473 microversion: 2.1 time: 1.110550 Jul 28 03:48:18.135365 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1236/2748] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:17 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1473 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:18.350735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c1bde2bc-6229-4b35-95a6-808f44a81bf5 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] Calling method '.version_select at 0x7ffa74141d30>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:18.496904 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c1bde2bc-6229-4b35-95a6-808f44a81bf5 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e4d5e4d3-04e0-4f81-b4de-e1faec8cf09d" status: 200 len: 351 microversion: 2.1 time: 0.156047 Jul 28 03:48:18.497865 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1237/2749] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:48:18 2022] GET /compute/v2.1/os-volumes/e4d5e4d3-04e0-4f81-b4de-e1faec8cf09d => generated 351 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:18.502669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dc6fe349-995f-4cec-826c-c7fb858ff0b4 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:18.503695 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dc6fe349-995f-4cec-826c-c7fb858ff0b4 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:18.518507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc6fe349-995f-4cec-826c-c7fb858ff0b4 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:18.518869 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc6fe349-995f-4cec-826c-c7fb858ff0b4 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:18.519655 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc6fe349-995f-4cec-826c-c7fb858ff0b4 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:18.520093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc6fe349-995f-4cec-826c-c7fb858ff0b4 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:18.557324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8877cda-66b4-40b1-bafe-0ee0d360af58 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:18.564017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8877cda-66b4-40b1-bafe-0ee0d360af58 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:18.573712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8877cda-66b4-40b1-bafe-0ee0d360af58 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:18.575174 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b8877cda-66b4-40b1-bafe-0ee0d360af58 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.648787 Jul 28 03:48:18.577717 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1513/2750] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:17 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:48:18.583741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3e596da-d793-4889-8536-a6b748413e48 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] Calling method '.version_select at 0x7ffa67875700>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:18.755914 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d3e596da-d793-4889-8536-a6b748413e48 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.176914 Jul 28 03:48:18.756791 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1514/2751] 10.222.0.48 () {58 vars in 1134 bytes} [Thu Jul 28 03:48:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:18.770702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c780e775-7912-414c-bd92-7d834a3062a7 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] Calling method '.version_select at 0x7ffa67740f70>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:18.942208 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c780e775-7912-414c-bd92-7d834a3062a7 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.175277 Jul 28 03:48:18.951717 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1515/2752] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Jul 28 03:48:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:18.958397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7199f13a-221a-48c4-b88a-662b68c52cb6 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] Calling method '.version_select at 0x7ffa67740790>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:19.011174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dc6fe349-995f-4cec-826c-c7fb858ff0b4 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:19.025832 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dc6fe349-995f-4cec-826c-c7fb858ff0b4 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1270 microversion: 2.1 time: 0.526687 Jul 28 03:48:19.026352 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1238/2753] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:18 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1270 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:19.154287 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7199f13a-221a-48c4-b88a-662b68c52cb6 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.197962 Jul 28 03:48:19.159254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4ddef849-8800-4034-943e-bb764195f4f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:19.160549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4ddef849-8800-4034-943e-bb764195f4f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:19.164389 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1516/2754] 10.222.0.48 () {58 vars in 1134 bytes} [Thu Jul 28 03:48:18 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:19.169040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ddef849-8800-4034-943e-bb764195f4f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:19.173627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-acb54753-f742-4eb1-80a5-8e6a7b7d71ba tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] Calling method '.version_select at 0x7ffa6782aca0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:19.174226 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ddef849-8800-4034-943e-bb764195f4f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:19.175269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ddef849-8800-4034-943e-bb764195f4f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:19.175788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ddef849-8800-4034-943e-bb764195f4f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:19.378786 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-acb54753-f742-4eb1-80a5-8e6a7b7d71ba tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.211678 Jul 28 03:48:19.389345 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1517/2755] 10.222.0.48 () {58 vars in 1167 bytes} [Thu Jul 28 03:48:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:19.394519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4c96668-2aa1-4b4f-96cc-5e98d1b5e390 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] Calling method '.version_select at 0x7ffa677064c0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:19.574178 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e4c96668-2aa1-4b4f-96cc-5e98d1b5e390 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.183426 Jul 28 03:48:19.574853 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1518/2756] 10.222.0.48 () {58 vars in 1170 bytes} [Thu Jul 28 03:48:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:19.590175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c4b648d-058e-4b97-b152-d30082e58db4 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] Calling method '.version_select at 0x7ffa6782a310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:19.806067 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c4b648d-058e-4b97-b152-d30082e58db4 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.221202 Jul 28 03:48:19.806658 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1519/2757] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 03:48:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:19.811812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e2fc5f54-a00b-43a4-9c24-77d9648b114b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:19.812611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e2fc5f54-a00b-43a4-9c24-77d9648b114b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:19.835886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2fc5f54-a00b-43a4-9c24-77d9648b114b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:19.836393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2fc5f54-a00b-43a4-9c24-77d9648b114b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:19.839677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2fc5f54-a00b-43a4-9c24-77d9648b114b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:19.840154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2fc5f54-a00b-43a4-9c24-77d9648b114b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:20.184615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e2fc5f54-a00b-43a4-9c24-77d9648b114b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:20.200438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e2fc5f54-a00b-43a4-9c24-77d9648b114b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:20.202259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e2fc5f54-a00b-43a4-9c24-77d9648b114b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:20.203509 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e2fc5f54-a00b-43a4-9c24-77d9648b114b tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.395909 Jul 28 03:48:20.204083 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1520/2758] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:19 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:20.240139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dabf7322-a4d6-4ae8-bae9-fb31bde09756 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] Calling method '.version_select at 0x7ffa6782aca0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:20.413318 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dabf7322-a4d6-4ae8-bae9-fb31bde09756 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.179066 Jul 28 03:48:20.414208 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1521/2759] 10.222.0.48 () {58 vars in 1188 bytes} [Thu Jul 28 03:48:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:20.419574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0b30f8b4-fb79-4786-ba58-c682e38bb51e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:20.420246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0b30f8b4-fb79-4786-ba58-c682e38bb51e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:20.445883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b30f8b4-fb79-4786-ba58-c682e38bb51e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:20.446463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b30f8b4-fb79-4786-ba58-c682e38bb51e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:20.447301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b30f8b4-fb79-4786-ba58-c682e38bb51e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:20.447744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b30f8b4-fb79-4786-ba58-c682e38bb51e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:20.464588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:20.671811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0b30f8b4-fb79-4786-ba58-c682e38bb51e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:20.682270 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0b30f8b4-fb79-4786-ba58-c682e38bb51e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1270 microversion: 2.1 time: 0.266961 Jul 28 03:48:20.687527 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1522/2760] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:20 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1270 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:20.696149 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4ddef849-8800-4034-943e-bb764195f4f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:20.706572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f1521f3-d52f-495d-9c07-7193e77f3d68 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] Calling method '.version_select at 0x7ffa6782aca0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:20.707938 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4ddef849-8800-4034-943e-bb764195f4f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1473 microversion: 2.1 time: 1.551684 Jul 28 03:48:20.726490 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1239/2761] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:19 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1473 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:20.842535 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0f1521f3-d52f-495d-9c07-7193e77f3d68 tempest-VolumesTestJSON-196090711 tempest-VolumesTestJSON-196090711-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.151091 Jul 28 03:48:20.843280 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1523/2762] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 03:48:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:21.228388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0e61347f-403f-41c1-945d-84ce71f964d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:21.229218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0e61347f-403f-41c1-945d-84ce71f964d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:21.243840 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e61347f-403f-41c1-945d-84ce71f964d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:21.248888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e61347f-403f-41c1-945d-84ce71f964d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:21.250145 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e61347f-403f-41c1-945d-84ce71f964d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:21.254479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e61347f-403f-41c1-945d-84ce71f964d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:21.646240 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0e61347f-403f-41c1-945d-84ce71f964d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:21.661750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0e61347f-403f-41c1-945d-84ce71f964d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:21.672650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0e61347f-403f-41c1-945d-84ce71f964d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:21.674500 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0e61347f-403f-41c1-945d-84ce71f964d6 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.450327 Jul 28 03:48:21.701280 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1240/2763] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:21 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:21.719226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-105a0e37-61ae-460f-9e9b-a0f89e69a47e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:21.720188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-105a0e37-61ae-460f-9e9b-a0f89e69a47e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:21.733496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4fef2cdc-d5f5-4df4-bf29-94009ec4bfec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:21.737919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4fef2cdc-d5f5-4df4-bf29-94009ec4bfec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:21.741928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-105a0e37-61ae-460f-9e9b-a0f89e69a47e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:21.742385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-105a0e37-61ae-460f-9e9b-a0f89e69a47e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:21.743180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-105a0e37-61ae-460f-9e9b-a0f89e69a47e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:21.743619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-105a0e37-61ae-460f-9e9b-a0f89e69a47e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:21.761537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4fef2cdc-d5f5-4df4-bf29-94009ec4bfec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:21.762015 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4fef2cdc-d5f5-4df4-bf29-94009ec4bfec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:21.762943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4fef2cdc-d5f5-4df4-bf29-94009ec4bfec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:21.763336 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4fef2cdc-d5f5-4df4-bf29-94009ec4bfec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:22.359598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4fef2cdc-d5f5-4df4-bf29-94009ec4bfec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:22.372933 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4fef2cdc-d5f5-4df4-bf29-94009ec4bfec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1473 microversion: 2.1 time: 0.643250 Jul 28 03:48:22.374542 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1241/2764] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:21 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1473 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:22.708921 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5f89f7a7-5b13-4241-af51-7f1ee32c2952 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:22.709540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5f89f7a7-5b13-4241-af51-7f1ee32c2952 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:22.721245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5f89f7a7-5b13-4241-af51-7f1ee32c2952 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:22.721820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5f89f7a7-5b13-4241-af51-7f1ee32c2952 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:22.722714 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5f89f7a7-5b13-4241-af51-7f1ee32c2952 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:22.723536 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5f89f7a7-5b13-4241-af51-7f1ee32c2952 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:23.126663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5f89f7a7-5b13-4241-af51-7f1ee32c2952 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:23.143164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5f89f7a7-5b13-4241-af51-7f1ee32c2952 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:23.147754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5f89f7a7-5b13-4241-af51-7f1ee32c2952 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:23.154266 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5f89f7a7-5b13-4241-af51-7f1ee32c2952 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.448693 Jul 28 03:48:23.172532 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1242/2765] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:22 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:23.395381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3a13be48-a631-494f-b4a9-5e0487ed12d1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:23.396247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3a13be48-a631-494f-b4a9-5e0487ed12d1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:23.409246 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a13be48-a631-494f-b4a9-5e0487ed12d1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:23.409887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-105a0e37-61ae-460f-9e9b-a0f89e69a47e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:23.412467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a13be48-a631-494f-b4a9-5e0487ed12d1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:23.419121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a13be48-a631-494f-b4a9-5e0487ed12d1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:23.419997 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3a13be48-a631-494f-b4a9-5e0487ed12d1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:23.420307 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-105a0e37-61ae-460f-9e9b-a0f89e69a47e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1312 microversion: 2.1 time: 1.705128 Jul 28 03:48:23.426317 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1524/2766] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:21 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1312 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:23.901848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3a13be48-a631-494f-b4a9-5e0487ed12d1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:23.916846 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3a13be48-a631-494f-b4a9-5e0487ed12d1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1472 microversion: 2.1 time: 0.521100 Jul 28 03:48:23.918165 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1243/2767] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:23 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1472 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:24.178936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fc1238c6-565c-4fcf-90b3-9470b49638d1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:24.179919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fc1238c6-565c-4fcf-90b3-9470b49638d1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:24.197569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc1238c6-565c-4fcf-90b3-9470b49638d1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:24.198356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc1238c6-565c-4fcf-90b3-9470b49638d1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:24.200506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc1238c6-565c-4fcf-90b3-9470b49638d1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:24.203428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc1238c6-565c-4fcf-90b3-9470b49638d1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:24.446769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9bc1c451-a205-4fce-9502-29c3b3afeace tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:24.447389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9bc1c451-a205-4fce-9502-29c3b3afeace tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:24.463359 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9bc1c451-a205-4fce-9502-29c3b3afeace tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:24.463814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9bc1c451-a205-4fce-9502-29c3b3afeace tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:24.464928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9bc1c451-a205-4fce-9502-29c3b3afeace tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:24.465364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9bc1c451-a205-4fce-9502-29c3b3afeace tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:24.543541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc1238c6-565c-4fcf-90b3-9470b49638d1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:24.576415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc1238c6-565c-4fcf-90b3-9470b49638d1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:24.584600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc1238c6-565c-4fcf-90b3-9470b49638d1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:24.585889 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fc1238c6-565c-4fcf-90b3-9470b49638d1 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.411541 Jul 28 03:48:24.590626 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1525/2768] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:24 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:24.944584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4937708-fe5c-4fcc-8ed4-e18f36bf6d29 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:24.946536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4937708-fe5c-4fcc-8ed4-e18f36bf6d29 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:24.961916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4937708-fe5c-4fcc-8ed4-e18f36bf6d29 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:24.962639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4937708-fe5c-4fcc-8ed4-e18f36bf6d29 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:24.966413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4937708-fe5c-4fcc-8ed4-e18f36bf6d29 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:24.970184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4937708-fe5c-4fcc-8ed4-e18f36bf6d29 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:25.098905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:25.167177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:26.125345 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:26.137527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a4937708-fe5c-4fcc-8ed4-e18f36bf6d29 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:26.143993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9bc1c451-a205-4fce-9502-29c3b3afeace tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:26.154720 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4937708-fe5c-4fcc-8ed4-e18f36bf6d29 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1472 microversion: 2.1 time: 1.214989 Jul 28 03:48:26.155239 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1526/2769] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:24 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1472 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:26.168705 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9bc1c451-a205-4fce-9502-29c3b3afeace tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1333 microversion: 2.1 time: 1.715263 Jul 28 03:48:26.168705 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1244/2770] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:24 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1333 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:26.183003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-3f9132d7-652f-47e6-a6bc-7b6fc03c125b req-08f83eb1-c5bf-4b89-8e0a-1297850bda0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022dc911-465a-4044-8ac3-52bf6cdf8612", "name": "network-vif-unplugged", "status": "completed", "tag": "70fad463-b5e0-490a-be92-a6a1e4248f1c"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:26.185927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a178272c-6937-4782-b94b-b1cd12ecef4e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:26.186560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a178272c-6937-4782-b94b-b1cd12ecef4e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:26.213855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a178272c-6937-4782-b94b-b1cd12ecef4e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:26.214312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a178272c-6937-4782-b94b-b1cd12ecef4e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:26.215105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a178272c-6937-4782-b94b-b1cd12ecef4e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:26.215579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a178272c-6937-4782-b94b-b1cd12ecef4e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:26.227010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3f9132d7-652f-47e6-a6bc-7b6fc03c125b req-08f83eb1-c5bf-4b89-8e0a-1297850bda0f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:26.241483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3f9132d7-652f-47e6-a6bc-7b6fc03c125b req-08f83eb1-c5bf-4b89-8e0a-1297850bda0f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:26.300691 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-3f9132d7-652f-47e6-a6bc-7b6fc03c125b req-08f83eb1-c5bf-4b89-8e0a-1297850bda0f service nova] Creating event network-vif-unplugged:70fad463-b5e0-490a-be92-a6a1e4248f1c for instance 022dc911-465a-4044-8ac3-52bf6cdf8612 on n-h2-826756-3 Jul 28 03:48:26.331374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [req-3f9132d7-652f-47e6-a6bc-7b6fc03c125b req-08f83eb1-c5bf-4b89-8e0a-1297850bda0f service nova] Instance 022dc911-465a-4044-8ac3-52bf6cdf8612 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:48:26.362657 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-3f9132d7-652f-47e6-a6bc-7b6fc03c125b req-08f83eb1-c5bf-4b89-8e0a-1297850bda0f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.194787 Jul 28 03:48:26.363731 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1245/2771] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:26.461811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a178272c-6937-4782-b94b-b1cd12ecef4e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:26.483386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a178272c-6937-4782-b94b-b1cd12ecef4e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:26.489113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a178272c-6937-4782-b94b-b1cd12ecef4e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:26.491043 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a178272c-6937-4782-b94b-b1cd12ecef4e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.313824 Jul 28 03:48:26.492254 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1527/2772] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:26 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:27.191393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1512b732-bd7c-4e98-ba70-26cf2df961d3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:27.192266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1512b732-bd7c-4e98-ba70-26cf2df961d3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:27.192668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a3ffb10f-a076-498b-a090-b9835064da1d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:27.202022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a3ffb10f-a076-498b-a090-b9835064da1d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:27.227273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1512b732-bd7c-4e98-ba70-26cf2df961d3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:27.235268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1512b732-bd7c-4e98-ba70-26cf2df961d3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:27.239804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3ffb10f-a076-498b-a090-b9835064da1d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:27.240079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1512b732-bd7c-4e98-ba70-26cf2df961d3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:27.241314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1512b732-bd7c-4e98-ba70-26cf2df961d3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:27.242602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3ffb10f-a076-498b-a090-b9835064da1d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:27.243465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3ffb10f-a076-498b-a090-b9835064da1d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:27.243916 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a3ffb10f-a076-498b-a090-b9835064da1d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:28.012331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1512b732-bd7c-4e98-ba70-26cf2df961d3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:28.029379 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1512b732-bd7c-4e98-ba70-26cf2df961d3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1472 microversion: 2.1 time: 0.852638 Jul 28 03:48:28.042262 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1528/2773] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:27 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1472 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:28.066307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-36b51cee-ffc8-4e8b-86e7-50590dfa158e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:28.068822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-36b51cee-ffc8-4e8b-86e7-50590dfa158e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:28.105580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:28.107572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36b51cee-ffc8-4e8b-86e7-50590dfa158e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:28.110723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36b51cee-ffc8-4e8b-86e7-50590dfa158e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:28.114186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36b51cee-ffc8-4e8b-86e7-50590dfa158e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:28.115460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36b51cee-ffc8-4e8b-86e7-50590dfa158e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:28.436542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a3ffb10f-a076-498b-a090-b9835064da1d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:28.445764 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a3ffb10f-a076-498b-a090-b9835064da1d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 1.269946 Jul 28 03:48:28.446318 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1246/2774] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:27 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:28.631836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-36b51cee-ffc8-4e8b-86e7-50590dfa158e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:28.646448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-36b51cee-ffc8-4e8b-86e7-50590dfa158e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:28.651611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-36b51cee-ffc8-4e8b-86e7-50590dfa158e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:28.656516 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-36b51cee-ffc8-4e8b-86e7-50590dfa158e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.612837 Jul 28 03:48:28.672381 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1529/2775] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:28 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:29.058453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-62cc11b9-0751-4ed8-a750-411e42719e05 req-9ef900d5-1980-44dc-845e-0f1734dbd34b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "022dc911-465a-4044-8ac3-52bf6cdf8612", "tag": "70fad463-b5e0-490a-be92-a6a1e4248f1c"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:29.065168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3fb0e82a-feb9-406b-bfa3-e2190aa74d6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:29.066047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3fb0e82a-feb9-406b-bfa3-e2190aa74d6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:29.116142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fb0e82a-feb9-406b-bfa3-e2190aa74d6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:29.125129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fb0e82a-feb9-406b-bfa3-e2190aa74d6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:29.131641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fb0e82a-feb9-406b-bfa3-e2190aa74d6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:29.135496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-62cc11b9-0751-4ed8-a750-411e42719e05 req-9ef900d5-1980-44dc-845e-0f1734dbd34b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:29.135942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-62cc11b9-0751-4ed8-a750-411e42719e05 req-9ef900d5-1980-44dc-845e-0f1734dbd34b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:29.138018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fb0e82a-feb9-406b-bfa3-e2190aa74d6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:29.202011 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-62cc11b9-0751-4ed8-a750-411e42719e05 req-9ef900d5-1980-44dc-845e-0f1734dbd34b service nova] Creating event network-changed:70fad463-b5e0-490a-be92-a6a1e4248f1c for instance 022dc911-465a-4044-8ac3-52bf6cdf8612 on n-h2-826756-3 Jul 28 03:48:29.240618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [req-62cc11b9-0751-4ed8-a750-411e42719e05 req-9ef900d5-1980-44dc-845e-0f1734dbd34b service nova] Instance 022dc911-465a-4044-8ac3-52bf6cdf8612 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:48:29.290306 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-62cc11b9-0751-4ed8-a750-411e42719e05 req-9ef900d5-1980-44dc-845e-0f1734dbd34b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238056 Jul 28 03:48:29.296628 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1247/2776] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:29.468436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1cdc59bb-df98-49c4-94fa-64ea39121879 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:29.470230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1cdc59bb-df98-49c4-94fa-64ea39121879 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:29.486646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1cdc59bb-df98-49c4-94fa-64ea39121879 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:29.487337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1cdc59bb-df98-49c4-94fa-64ea39121879 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:29.488985 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1cdc59bb-df98-49c4-94fa-64ea39121879 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:29.494255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1cdc59bb-df98-49c4-94fa-64ea39121879 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:30.037618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3fb0e82a-feb9-406b-bfa3-e2190aa74d6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:30.057712 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3fb0e82a-feb9-406b-bfa3-e2190aa74d6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1472 microversion: 2.1 time: 0.997183 Jul 28 03:48:30.058322 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1530/2777] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:29 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1472 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:30.084967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f59b108c-c40e-478f-a500-d4fb9a2abfd7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:30.091799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f59b108c-c40e-478f-a500-d4fb9a2abfd7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:30.130217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f59b108c-c40e-478f-a500-d4fb9a2abfd7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:30.132036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f59b108c-c40e-478f-a500-d4fb9a2abfd7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:30.137344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f59b108c-c40e-478f-a500-d4fb9a2abfd7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:30.140112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f59b108c-c40e-478f-a500-d4fb9a2abfd7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:30.938771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f59b108c-c40e-478f-a500-d4fb9a2abfd7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:30.950304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f59b108c-c40e-478f-a500-d4fb9a2abfd7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:30.958729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f59b108c-c40e-478f-a500-d4fb9a2abfd7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:30.963179 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f59b108c-c40e-478f-a500-d4fb9a2abfd7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.894713 Jul 28 03:48:30.964049 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1531/2778] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:30 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:31.086628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dada4a2f-084f-4cde-9858-223eb32d71e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:31.087302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dada4a2f-084f-4cde-9858-223eb32d71e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:31.105647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dada4a2f-084f-4cde-9858-223eb32d71e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:31.107384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dada4a2f-084f-4cde-9858-223eb32d71e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:31.111798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dada4a2f-084f-4cde-9858-223eb32d71e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:31.114416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dada4a2f-084f-4cde-9858-223eb32d71e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:31.856540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1cdc59bb-df98-49c4-94fa-64ea39121879 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:31.873765 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1cdc59bb-df98-49c4-94fa-64ea39121879 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 2.402309 Jul 28 03:48:31.874827 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1248/2779] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:29 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 2412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:31.990438 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ce61447e-4f27-48de-a5d3-cd73d8767040 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:31.991059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ce61447e-4f27-48de-a5d3-cd73d8767040 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:32.004002 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce61447e-4f27-48de-a5d3-cd73d8767040 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:32.004643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce61447e-4f27-48de-a5d3-cd73d8767040 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:32.005702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce61447e-4f27-48de-a5d3-cd73d8767040 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:32.006335 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce61447e-4f27-48de-a5d3-cd73d8767040 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:32.667835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ce61447e-4f27-48de-a5d3-cd73d8767040 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:32.678369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ce61447e-4f27-48de-a5d3-cd73d8767040 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:32.684754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ce61447e-4f27-48de-a5d3-cd73d8767040 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:32.693279 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ce61447e-4f27-48de-a5d3-cd73d8767040 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.706940 Jul 28 03:48:32.697033 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1249/2780] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:31 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:32.906141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-86fae496-7c1e-4639-9f43-277091c849af tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:32.906798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-86fae496-7c1e-4639-9f43-277091c849af tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:32.921476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86fae496-7c1e-4639-9f43-277091c849af tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:32.921928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86fae496-7c1e-4639-9f43-277091c849af tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:32.925108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86fae496-7c1e-4639-9f43-277091c849af tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:32.925621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86fae496-7c1e-4639-9f43-277091c849af tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:33.159912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dada4a2f-084f-4cde-9858-223eb32d71e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:33.191033 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dada4a2f-084f-4cde-9858-223eb32d71e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1472 microversion: 2.1 time: 2.106994 Jul 28 03:48:33.211274 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1532/2781] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:31 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1472 bytes in 2130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:33.722451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ccdcd58b-e5d8-473d-a700-dce0735ef6d8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:33.723253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ccdcd58b-e5d8-473d-a700-dce0735ef6d8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:33.735645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccdcd58b-e5d8-473d-a700-dce0735ef6d8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:33.740954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccdcd58b-e5d8-473d-a700-dce0735ef6d8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:33.741808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccdcd58b-e5d8-473d-a700-dce0735ef6d8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:33.742359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccdcd58b-e5d8-473d-a700-dce0735ef6d8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:33.837224 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-86fae496-7c1e-4639-9f43-277091c849af tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:33.854845 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-86fae496-7c1e-4639-9f43-277091c849af tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 0.952554 Jul 28 03:48:33.855755 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1250/2782] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:32 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:33.943699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ccdcd58b-e5d8-473d-a700-dce0735ef6d8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:33.971745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ccdcd58b-e5d8-473d-a700-dce0735ef6d8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:33.990300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ccdcd58b-e5d8-473d-a700-dce0735ef6d8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:34.004299 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ccdcd58b-e5d8-473d-a700-dce0735ef6d8 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.273876 Jul 28 03:48:34.020377 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1533/2783] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:33 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:34.069776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-5ecb7031-abec-48c9-b60b-e992b422f752 req-18075046-48ca-4ecc-925c-9770d610871c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a708e336-67ea-42c9-9d6d-8f77b8b67e7a", "tag": "71bfcf7a-bfbe-4642-8ceb-23481c7dd9ae"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:34.102173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5ecb7031-abec-48c9-b60b-e992b422f752 req-18075046-48ca-4ecc-925c-9770d610871c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:34.102410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5ecb7031-abec-48c9-b60b-e992b422f752 req-18075046-48ca-4ecc-925c-9770d610871c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:34.110691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:34.167554 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-5ecb7031-abec-48c9-b60b-e992b422f752 req-18075046-48ca-4ecc-925c-9770d610871c service nova] Creating event network-changed:71bfcf7a-bfbe-4642-8ceb-23481c7dd9ae for instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a on n-h2-826756-3 Jul 28 03:48:34.180040 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-5ecb7031-abec-48c9-b60b-e992b422f752 req-18075046-48ca-4ecc-925c-9770d610871c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113998 Jul 28 03:48:34.181238 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1251/2784] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:34.214307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2df9091a-fdc0-42c3-887e-1aef2f9e234f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:34.215943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2df9091a-fdc0-42c3-887e-1aef2f9e234f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:34.227727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2df9091a-fdc0-42c3-887e-1aef2f9e234f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:34.237243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2df9091a-fdc0-42c3-887e-1aef2f9e234f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:34.239729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2df9091a-fdc0-42c3-887e-1aef2f9e234f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:34.245112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2df9091a-fdc0-42c3-887e-1aef2f9e234f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:34.882051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-20a1be8d-7217-4670-807d-591adc6d3d32 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:34.882986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-20a1be8d-7217-4670-807d-591adc6d3d32 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:34.906284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20a1be8d-7217-4670-807d-591adc6d3d32 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:34.906764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20a1be8d-7217-4670-807d-591adc6d3d32 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:34.907696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20a1be8d-7217-4670-807d-591adc6d3d32 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:34.910661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20a1be8d-7217-4670-807d-591adc6d3d32 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:35.130427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2df9091a-fdc0-42c3-887e-1aef2f9e234f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:35.139053 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2df9091a-fdc0-42c3-887e-1aef2f9e234f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1470 microversion: 2.1 time: 0.928632 Jul 28 03:48:35.150768 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1534/2785] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:34 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1470 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:35.156200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2abe8f4f-662a-43c5-8e62-58a1bbfabbba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:35.157100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2abe8f4f-662a-43c5-8e62-58a1bbfabbba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:35.170786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2abe8f4f-662a-43c5-8e62-58a1bbfabbba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:35.170944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2abe8f4f-662a-43c5-8e62-58a1bbfabbba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:35.171620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2abe8f4f-662a-43c5-8e62-58a1bbfabbba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:35.172054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2abe8f4f-662a-43c5-8e62-58a1bbfabbba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:35.353991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2abe8f4f-662a-43c5-8e62-58a1bbfabbba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:35.372915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2abe8f4f-662a-43c5-8e62-58a1bbfabbba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:35.377175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2abe8f4f-662a-43c5-8e62-58a1bbfabbba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:35.378368 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2abe8f4f-662a-43c5-8e62-58a1bbfabbba tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.225915 Jul 28 03:48:35.414223 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1535/2786] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:35 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:36.175574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-28d90966-6483-49d0-ac0e-7b1929c8ba87 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:36.176190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-28d90966-6483-49d0-ac0e-7b1929c8ba87 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:36.198571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28d90966-6483-49d0-ac0e-7b1929c8ba87 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:36.199021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28d90966-6483-49d0-ac0e-7b1929c8ba87 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:36.210700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28d90966-6483-49d0-ac0e-7b1929c8ba87 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:36.211164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28d90966-6483-49d0-ac0e-7b1929c8ba87 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:36.398464 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-20a1be8d-7217-4670-807d-591adc6d3d32 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:36.420181 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-20a1be8d-7217-4670-807d-591adc6d3d32 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 1.540607 Jul 28 03:48:36.425378 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1252/2787] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:34 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:36.432051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cd7614be-5936-4d34-924a-a4e0fd908cca tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:36.458212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cd7614be-5936-4d34-924a-a4e0fd908cca tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:36.488255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd7614be-5936-4d34-924a-a4e0fd908cca tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:36.492533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd7614be-5936-4d34-924a-a4e0fd908cca tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:36.496125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd7614be-5936-4d34-924a-a4e0fd908cca tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:36.497666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd7614be-5936-4d34-924a-a4e0fd908cca tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:36.584986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-28d90966-6483-49d0-ac0e-7b1929c8ba87 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:36.593602 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-28d90966-6483-49d0-ac0e-7b1929c8ba87 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1467 microversion: 2.1 time: 0.421941 Jul 28 03:48:36.599191 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1536/2788] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:36 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1467 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:36.615790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-84376875-c2bc-48cb-b5b1-5b969ca774e8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:36.616387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-84376875-c2bc-48cb-b5b1-5b969ca774e8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:36.628768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84376875-c2bc-48cb-b5b1-5b969ca774e8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:36.629161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84376875-c2bc-48cb-b5b1-5b969ca774e8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:36.630030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84376875-c2bc-48cb-b5b1-5b969ca774e8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:36.630667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84376875-c2bc-48cb-b5b1-5b969ca774e8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:36.715329 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-84376875-c2bc-48cb-b5b1-5b969ca774e8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "POST /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612/action" status: 204 len: 0 microversion: 2.1 time: 0.101618 Jul 28 03:48:36.716800 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1537/2789] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:48:36 2022] POST /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612/action => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:48:36.727175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1de673e2-4b31-4db0-af66-419c2aae6092 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:36.728150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1de673e2-4b31-4db0-af66-419c2aae6092 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:36.735623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1de673e2-4b31-4db0-af66-419c2aae6092 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:36.736578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1de673e2-4b31-4db0-af66-419c2aae6092 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:36.737916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1de673e2-4b31-4db0-af66-419c2aae6092 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:36.738686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1de673e2-4b31-4db0-af66-419c2aae6092 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:36.933015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1de673e2-4b31-4db0-af66-419c2aae6092 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:36.935883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:36.950501 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1de673e2-4b31-4db0-af66-419c2aae6092 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1467 microversion: 2.1 time: 0.228192 Jul 28 03:48:36.961004 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1538/2790] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:36 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1467 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:37.275207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd7614be-5936-4d34-924a-a4e0fd908cca tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:37.284889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd7614be-5936-4d34-924a-a4e0fd908cca tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:37.304842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd7614be-5936-4d34-924a-a4e0fd908cca tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:37.314106 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cd7614be-5936-4d34-924a-a4e0fd908cca tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.887228 Jul 28 03:48:37.325745 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1253/2791] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:36 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:37.442840 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c2ab3ad5-eaa3-4cb5-8afb-707096c5a041 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:37.443454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c2ab3ad5-eaa3-4cb5-8afb-707096c5a041 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:37.450200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2ab3ad5-eaa3-4cb5-8afb-707096c5a041 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:37.454671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2ab3ad5-eaa3-4cb5-8afb-707096c5a041 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:37.465486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2ab3ad5-eaa3-4cb5-8afb-707096c5a041 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:37.466301 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2ab3ad5-eaa3-4cb5-8afb-707096c5a041 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:37.509777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1743113564", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "c540e59d-0550-4ece-8b64-1987a84fa206"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:37.637875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] validate_networks() for [('c540e59d-0550-4ece-8b64-1987a84fa206', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:48:39.159897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c2ab3ad5-eaa3-4cb5-8afb-707096c5a041 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:39.171718 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c2ab3ad5-eaa3-4cb5-8afb-707096c5a041 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 1.733072 Jul 28 03:48:39.175073 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1254/2792] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:37 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:39.196755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0d2d696b-ec6c-490a-a3f5-508983db658c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:39.198626 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0d2d696b-ec6c-490a-a3f5-508983db658c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:39.214277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d2d696b-ec6c-490a-a3f5-508983db658c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:39.214731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d2d696b-ec6c-490a-a3f5-508983db658c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:39.215523 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d2d696b-ec6c-490a-a3f5-508983db658c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:39.220888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d2d696b-ec6c-490a-a3f5-508983db658c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:39.402484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:48:39.402962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:48:39.405732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:48:39.406170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:48:39.406599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:48:39.439047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:39.439220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:39.440035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:39.445610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:39.510629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Getting quotas for project 34ed8cbcca694b8794992388d95bf072. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:48:39.526257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Getting quotas for user 67fcd8c3ec5441e582a4852f0f1184b6 and project 34ed8cbcca694b8794992388d95bf072. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:48:39.561242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:48:39.566313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:48:39.689107 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6b33da97-fb92-4e20-a7f2-27453d210be7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.473665 Jul 28 03:48:39.690632 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1539/2793] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:48:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:48:39.699956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d271abf9-ef51-4571-aae4-fba93ed8d1c7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:39.701383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d271abf9-ef51-4571-aae4-fba93ed8d1c7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:39.715330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d271abf9-ef51-4571-aae4-fba93ed8d1c7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:39.716264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d271abf9-ef51-4571-aae4-fba93ed8d1c7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:39.717859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d271abf9-ef51-4571-aae4-fba93ed8d1c7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:39.718695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d271abf9-ef51-4571-aae4-fba93ed8d1c7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:39.833115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d271abf9-ef51-4571-aae4-fba93ed8d1c7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:39.857052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d271abf9-ef51-4571-aae4-fba93ed8d1c7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:39.862177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d271abf9-ef51-4571-aae4-fba93ed8d1c7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:39.864565 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d271abf9-ef51-4571-aae4-fba93ed8d1c7 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.172156 Jul 28 03:48:39.865404 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1540/2794] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:39 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:39.873744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-924c595b-dc4d-4a41-8e46-cdef0c687316 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:39.875829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-924c595b-dc4d-4a41-8e46-cdef0c687316 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:39.998766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-924c595b-dc4d-4a41-8e46-cdef0c687316 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:40.006942 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-924c595b-dc4d-4a41-8e46-cdef0c687316 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1215 microversion: 2.1 time: 0.140041 Jul 28 03:48:40.009304 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1541/2795] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:39 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:40.197604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ea1aa2b2-fb20-40c7-8dec-7f3e08f18de6 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:40.198791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ea1aa2b2-fb20-40c7-8dec-7f3e08f18de6 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:40.203643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0d2d696b-ec6c-490a-a3f5-508983db658c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:40.214329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea1aa2b2-fb20-40c7-8dec-7f3e08f18de6 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:40.214919 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0d2d696b-ec6c-490a-a3f5-508983db658c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1467 microversion: 2.1 time: 1.038548 Jul 28 03:48:40.215505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea1aa2b2-fb20-40c7-8dec-7f3e08f18de6 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:40.220819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea1aa2b2-fb20-40c7-8dec-7f3e08f18de6 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:40.224044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea1aa2b2-fb20-40c7-8dec-7f3e08f18de6 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:40.229345 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1255/2796] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:39 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1467 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:40.502171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ea1aa2b2-fb20-40c7-8dec-7f3e08f18de6 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:40.511996 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ea1aa2b2-fb20-40c7-8dec-7f3e08f18de6 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 0.320332 Jul 28 03:48:40.513405 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1542/2797] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:40 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:40.887921 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fd855d17-2974-4d71-8865-f560ee510584 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:40.888741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fd855d17-2974-4d71-8865-f560ee510584 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:40.908597 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd855d17-2974-4d71-8865-f560ee510584 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:40.909377 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd855d17-2974-4d71-8865-f560ee510584 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:40.910368 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd855d17-2974-4d71-8865-f560ee510584 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:40.911153 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd855d17-2974-4d71-8865-f560ee510584 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:41.040660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bc140571-5949-4581-accd-f1760203f2a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:41.041708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bc140571-5949-4581-accd-f1760203f2a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:41.056977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc140571-5949-4581-accd-f1760203f2a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:41.057797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc140571-5949-4581-accd-f1760203f2a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:41.058883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc140571-5949-4581-accd-f1760203f2a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:41.059537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc140571-5949-4581-accd-f1760203f2a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:41.143477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bc140571-5949-4581-accd-f1760203f2a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:41.154720 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bc140571-5949-4581-accd-f1760203f2a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1267 microversion: 2.1 time: 0.129074 Jul 28 03:48:41.155901 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1543/2798] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:41 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1267 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:41.240695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d8bdad1b-063f-4fd1-9eb2-eff1e5b5da49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:41.241313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d8bdad1b-063f-4fd1-9eb2-eff1e5b5da49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:41.248892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fd855d17-2974-4d71-8865-f560ee510584 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:41.254019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8bdad1b-063f-4fd1-9eb2-eff1e5b5da49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:41.254474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8bdad1b-063f-4fd1-9eb2-eff1e5b5da49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:41.255256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8bdad1b-063f-4fd1-9eb2-eff1e5b5da49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:41.255690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8bdad1b-063f-4fd1-9eb2-eff1e5b5da49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:41.267387 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fd855d17-2974-4d71-8865-f560ee510584 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:41.269080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fd855d17-2974-4d71-8865-f560ee510584 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:41.274772 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fd855d17-2974-4d71-8865-f560ee510584 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.388844 Jul 28 03:48:41.277149 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1256/2799] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:40 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:41.534192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-27f0933c-e1dc-46d4-82bf-5b20b445b744 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:41.535329 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-27f0933c-e1dc-46d4-82bf-5b20b445b744 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:41.548754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=58 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:41.567214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27f0933c-e1dc-46d4-82bf-5b20b445b744 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:41.567855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27f0933c-e1dc-46d4-82bf-5b20b445b744 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:41.569261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27f0933c-e1dc-46d4-82bf-5b20b445b744 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:41.570039 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27f0933c-e1dc-46d4-82bf-5b20b445b744 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:41.591552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d8bdad1b-063f-4fd1-9eb2-eff1e5b5da49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:41.624155 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d8bdad1b-063f-4fd1-9eb2-eff1e5b5da49 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1467 microversion: 2.1 time: 0.387123 Jul 28 03:48:41.644582 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1544/2800] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:41 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1467 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:41.659827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-fe3917e9-8b7d-4121-83b9-d9b82ccd92e6 req-46cb5f79-8f18-49c3-8503-57eba8894f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022dc911-465a-4044-8ac3-52bf6cdf8612", "name": "network-vif-plugged", "status": "completed", "tag": "70fad463-b5e0-490a-be92-a6a1e4248f1c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:41.681951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fe3917e9-8b7d-4121-83b9-d9b82ccd92e6 req-46cb5f79-8f18-49c3-8503-57eba8894f68 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:41.682910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fe3917e9-8b7d-4121-83b9-d9b82ccd92e6 req-46cb5f79-8f18-49c3-8503-57eba8894f68 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:41.703573 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-fe3917e9-8b7d-4121-83b9-d9b82ccd92e6 req-46cb5f79-8f18-49c3-8503-57eba8894f68 service nova] Creating event network-vif-plugged:70fad463-b5e0-490a-be92-a6a1e4248f1c for instance 022dc911-465a-4044-8ac3-52bf6cdf8612 on n-h2-826756-3 Jul 28 03:48:41.715685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-fe3917e9-8b7d-4121-83b9-d9b82ccd92e6 req-46cb5f79-8f18-49c3-8503-57eba8894f68 service nova] Instance 022dc911-465a-4044-8ac3-52bf6cdf8612 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:48:41.731228 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-fe3917e9-8b7d-4121-83b9-d9b82ccd92e6 req-46cb5f79-8f18-49c3-8503-57eba8894f68 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085084 Jul 28 03:48:41.733037 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1545/2801] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:41.958185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4881c729-06d0-4714-9a97-4aa89be764ed req-cbd048bb-036e-44bf-8320-b33590277aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a708e336-67ea-42c9-9d6d-8f77b8b67e7a", "tag": "f763a531-4acb-48d9-be72-22782928289c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:41.996851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4881c729-06d0-4714-9a97-4aa89be764ed req-cbd048bb-036e-44bf-8320-b33590277aec service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:41.999947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4881c729-06d0-4714-9a97-4aa89be764ed req-cbd048bb-036e-44bf-8320-b33590277aec service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:42.043411 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4881c729-06d0-4714-9a97-4aa89be764ed req-cbd048bb-036e-44bf-8320-b33590277aec service nova] Creating event network-changed:f763a531-4acb-48d9-be72-22782928289c for instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a on n-h2-826756-3 Jul 28 03:48:42.065311 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4881c729-06d0-4714-9a97-4aa89be764ed req-cbd048bb-036e-44bf-8320-b33590277aec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112823 Jul 28 03:48:42.067339 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1546/2802] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:48:42.177258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-848e7691-cc59-42e9-8851-9d66e6c12bb4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:42.178581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-848e7691-cc59-42e9-8851-9d66e6c12bb4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:42.187976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-848e7691-cc59-42e9-8851-9d66e6c12bb4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:42.189028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-848e7691-cc59-42e9-8851-9d66e6c12bb4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:42.191194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-848e7691-cc59-42e9-8851-9d66e6c12bb4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:42.191886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-848e7691-cc59-42e9-8851-9d66e6c12bb4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:42.308659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-848e7691-cc59-42e9-8851-9d66e6c12bb4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:42.323946 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-848e7691-cc59-42e9-8851-9d66e6c12bb4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1273 microversion: 2.1 time: 0.148046 Jul 28 03:48:42.332004 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1547/2803] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:42 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:42.349383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e91a871-730a-4363-b93c-f235da047398 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:42.350937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0e91a871-730a-4363-b93c-f235da047398 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:42.358686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e91a871-730a-4363-b93c-f235da047398 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:42.359463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e91a871-730a-4363-b93c-f235da047398 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:42.361103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e91a871-730a-4363-b93c-f235da047398 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:42.362051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e91a871-730a-4363-b93c-f235da047398 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:42.465634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0e91a871-730a-4363-b93c-f235da047398 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:42.488216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0e91a871-730a-4363-b93c-f235da047398 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:42.490309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0e91a871-730a-4363-b93c-f235da047398 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:42.491899 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0e91a871-730a-4363-b93c-f235da047398 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.158611 Jul 28 03:48:42.493174 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1548/2804] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:42 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:42.648184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c236d57b-b20a-4a1e-ab27-5e7d7d1c505e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:42.648896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c236d57b-b20a-4a1e-ab27-5e7d7d1c505e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:42.660062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c236d57b-b20a-4a1e-ab27-5e7d7d1c505e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:42.662402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c236d57b-b20a-4a1e-ab27-5e7d7d1c505e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:42.663388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c236d57b-b20a-4a1e-ab27-5e7d7d1c505e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:42.663837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c236d57b-b20a-4a1e-ab27-5e7d7d1c505e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:42.983288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c236d57b-b20a-4a1e-ab27-5e7d7d1c505e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:42.996015 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c236d57b-b20a-4a1e-ab27-5e7d7d1c505e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1467 microversion: 2.1 time: 0.351998 Jul 28 03:48:42.999989 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1549/2805] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:42 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1467 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:43.587695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f1c322ba-3583-49b4-b334-589985d71546 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Action: 'create', calling method: .version_select at 0x7ffa67800f70>, body: {"keypair": {"name": "tempest-keypair-814177108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKetEnDauQgY3GknHuWxKd1jvKzTK+PASGKEdM7HC4LTU9bWYocNqTS12crTUea9ad8SAe0fm8krsE1pnGPr00Uk+tJl1XH9nmMEmdp06Zy1zmZJd7ZhHIj8b8lut+umkQ=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:43.627055 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-27f0933c-e1dc-46d4-82bf-5b20b445b744 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:43.639662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f1c322ba-3583-49b4-b334-589985d71546 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for project 781ab005138547038def64d108937e3e. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:48:43.640631 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-27f0933c-e1dc-46d4-82bf-5b20b445b744 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 2.111133 Jul 28 03:48:43.653501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f1c322ba-3583-49b4-b334-589985d71546 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for user d20381abd9784627887af3cb97cd68a8 and project 781ab005138547038def64d108937e3e. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:48:43.669233 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1257/2806] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:41 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:43.682397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a66cf0f7-f93b-44bd-9cba-4c71f4abcf6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:43.684066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a66cf0f7-f93b-44bd-9cba-4c71f4abcf6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:43.693522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a66cf0f7-f93b-44bd-9cba-4c71f4abcf6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:43.694999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a66cf0f7-f93b-44bd-9cba-4c71f4abcf6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:43.696615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a66cf0f7-f93b-44bd-9cba-4c71f4abcf6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:43.697335 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a66cf0f7-f93b-44bd-9cba-4c71f4abcf6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:43.711648 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f1c322ba-3583-49b4-b334-589985d71546 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.709256 Jul 28 03:48:43.712541 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1550/2807] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:48:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:43.733689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-61fc717f-5598-4878-8a0b-b9dbd012f64a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:43.739330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61fc717f-5598-4878-8a0b-b9dbd012f64a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:43.751281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61fc717f-5598-4878-8a0b-b9dbd012f64a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:43.752407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61fc717f-5598-4878-8a0b-b9dbd012f64a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:43.753217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61fc717f-5598-4878-8a0b-b9dbd012f64a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:43.753667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61fc717f-5598-4878-8a0b-b9dbd012f64a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:43.898364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-61fc717f-5598-4878-8a0b-b9dbd012f64a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:43.912412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-61fc717f-5598-4878-8a0b-b9dbd012f64a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:43.934825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-61fc717f-5598-4878-8a0b-b9dbd012f64a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:43.943963 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-61fc717f-5598-4878-8a0b-b9dbd012f64a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1602 microversion: 2.42 time: 0.218879 Jul 28 03:48:43.944605 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1551/2808] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:43 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1602 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:44.024196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-82c26007-f52b-473a-aaef-e4bf39f4c307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:44.024937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-82c26007-f52b-473a-aaef-e4bf39f4c307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:44.049425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82c26007-f52b-473a-aaef-e4bf39f4c307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:44.053436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82c26007-f52b-473a-aaef-e4bf39f4c307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:44.056024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82c26007-f52b-473a-aaef-e4bf39f4c307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:44.058345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82c26007-f52b-473a-aaef-e4bf39f4c307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:44.261115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a66cf0f7-f93b-44bd-9cba-4c71f4abcf6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:44.273534 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a66cf0f7-f93b-44bd-9cba-4c71f4abcf6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1273 microversion: 2.1 time: 0.602914 Jul 28 03:48:44.276390 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1258/2809] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:43 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1273 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:44.632497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82c26007-f52b-473a-aaef-e4bf39f4c307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:44.645190 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-82c26007-f52b-473a-aaef-e4bf39f4c307 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1459 microversion: 2.1 time: 0.624913 Jul 28 03:48:44.656433 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1552/2810] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:44 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1459 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:44.677553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83f5fff0-f077-4624-8ea3-dc02a6267be4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:44.678441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-83f5fff0-f077-4624-8ea3-dc02a6267be4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:44.679040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7ea8fb92-ce1a-43e9-82ea-f3ef8c41ffbd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:44.680066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7ea8fb92-ce1a-43e9-82ea-f3ef8c41ffbd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:44.689785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83f5fff0-f077-4624-8ea3-dc02a6267be4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:44.693265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83f5fff0-f077-4624-8ea3-dc02a6267be4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:44.694547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83f5fff0-f077-4624-8ea3-dc02a6267be4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:44.695158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83f5fff0-f077-4624-8ea3-dc02a6267be4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:44.709212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ea8fb92-ce1a-43e9-82ea-f3ef8c41ffbd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:44.718698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ea8fb92-ce1a-43e9-82ea-f3ef8c41ffbd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:44.719959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ea8fb92-ce1a-43e9-82ea-f3ef8c41ffbd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:44.720711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ea8fb92-ce1a-43e9-82ea-f3ef8c41ffbd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:45.356823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-83f5fff0-f077-4624-8ea3-dc02a6267be4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:45.368656 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-83f5fff0-f077-4624-8ea3-dc02a6267be4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1459 microversion: 2.1 time: 0.694797 Jul 28 03:48:45.370087 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1553/2811] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:44 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1459 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:45.399795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3d2d3a75-f3c8-4201-8e88-5ee2595ffd3a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:45.405308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3d2d3a75-f3c8-4201-8e88-5ee2595ffd3a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:45.414424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d2d3a75-f3c8-4201-8e88-5ee2595ffd3a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:45.415179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d2d3a75-f3c8-4201-8e88-5ee2595ffd3a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:45.416227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d2d3a75-f3c8-4201-8e88-5ee2595ffd3a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:45.417304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d2d3a75-f3c8-4201-8e88-5ee2595ffd3a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:45.474489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d2d3a75-f3c8-4201-8e88-5ee2595ffd3a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:45.476239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d2d3a75-f3c8-4201-8e88-5ee2595ffd3a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:45.477293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-3d2d3a75-f3c8-4201-8e88-5ee2595ffd3a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lazy-loading 'fault' on Instance uuid ee94e075-7edd-436d-ae33-6e33bde0472b {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:48:45.727013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3d2d3a75-f3c8-4201-8e88-5ee2595ffd3a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:45.783416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3d2d3a75-f3c8-4201-8e88-5ee2595ffd3a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:45.792872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3d2d3a75-f3c8-4201-8e88-5ee2595ffd3a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c241cd30b794493abc7fa1d15987c92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1d6ebac92a1492b8b85a2b30f7c145c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:45.801478 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3d2d3a75-f3c8-4201-8e88-5ee2595ffd3a tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 200 len: 1607 microversion: 2.42 time: 0.428071 Jul 28 03:48:45.803896 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1554/2812] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:45 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 1607 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:48:45.829970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-84485a01-5c63-49ba-9a48-ffd1ae545d59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:45.844054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-84485a01-5c63-49ba-9a48-ffd1ae545d59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:45.881518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84485a01-5c63-49ba-9a48-ffd1ae545d59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:45.891088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84485a01-5c63-49ba-9a48-ffd1ae545d59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:45.894494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84485a01-5c63-49ba-9a48-ffd1ae545d59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:45.902324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84485a01-5c63-49ba-9a48-ffd1ae545d59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:46.191448 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7ea8fb92-ce1a-43e9-82ea-f3ef8c41ffbd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:46.204798 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7ea8fb92-ce1a-43e9-82ea-f3ef8c41ffbd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 1.537120 Jul 28 03:48:46.214330 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1259/2813] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:44 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:46.248671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8e89361f-cd57-4745-8e16-660832447a78 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Action: 'create', calling method: .version_select at 0x7ffa74141ee0>, body: {"keypair": {"name": "tempest-keypair-1493708872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCjt4Fb1JiLaDHHfusYDXg0rtHreBaawYc6sIUmuB5+IRThRaBMETjtssAEbMl3KWuVMOB+Of84pScJMOqU+iwZB77JVnYxUw21JOBNC0/TZx5Kvtvle6pMxsG0jV+jWA=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:46.331520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-8e89361f-cd57-4745-8e16-660832447a78 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Getting quotas for project da4a22e4560a4210bb58942cec62c091. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:48:46.355490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-8e89361f-cd57-4745-8e16-660832447a78 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Getting quotas for user ac9d734be6ee4b549f9ed389c276f54a and project da4a22e4560a4210bb58942cec62c091. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:48:46.416962 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8e89361f-cd57-4745-8e16-660832447a78 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.200696 Jul 28 03:48:46.418198 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1260/2814] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:48:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:46.732443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-84485a01-5c63-49ba-9a48-ffd1ae545d59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:46.744869 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-84485a01-5c63-49ba-9a48-ffd1ae545d59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1273 microversion: 2.1 time: 0.925457 Jul 28 03:48:46.746066 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1555/2815] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:45 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1273 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:46.827348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-778c424c-b618-4440-98fe-4f1be1f95a87 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:46.828032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-778c424c-b618-4440-98fe-4f1be1f95a87 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:46.845664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-778c424c-b618-4440-98fe-4f1be1f95a87 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:46.846127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-778c424c-b618-4440-98fe-4f1be1f95a87 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:46.846921 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-778c424c-b618-4440-98fe-4f1be1f95a87 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:46.847353 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-778c424c-b618-4440-98fe-4f1be1f95a87 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:46.870542 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-778c424c-b618-4440-98fe-4f1be1f95a87 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] HTTP exception thrown: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-778c424c-b618-4440-98fe-4f1be1f95a87 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Request method failure captured: Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b HTTP/1.1 Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gU6vn2BvYMqnkzzar2rp1yt7t9FfUd-pdgbml049O1PMfwOMNwsmVj59ndGhWWwsTBG6QZVEj1MdsKY6i8i5umLCr0ghuTiSq2P4Nqln4AW8bt5hIttYF4ANrn1qRIXo28VWZ6olJy1vJWy7yymhuNlMeIL8db8Izo2olPMvYJAtLc Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Openstack-Nova-Api-Version: 2.42 Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: a1d6ebac92a1492b8b85a2b30f7c145c Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1325577351 Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a1d6ebac92a1492b8b85a2b30f7c145c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1d6ebac92a1492b8b85a2b30f7c145c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a1d6ebac92a1492b8b85a2b30f7c145c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1d6ebac92a1492b8b85a2b30f7c145c"}]}] Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1325577351 Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: a1d6ebac92a1492b8b85a2b30f7c145c Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1325577351 Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-TaggedBootDevicesTest_v242-1325577351-project Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: c241cd30b794493abc7fa1d15987c92a Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1325577351-project Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'ee94e075-7edd-436d-ae33-6e33bde0472b'} Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:46.871792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:48:46.875875 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:46.875875 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:48:46.875875 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:48:46.875875 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:48:46.875875 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:48:46.875875 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:48:46.875875 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:48:46.875875 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:48:46.892773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-778c424c-b618-4440-98fe-4f1be1f95a87 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Returning 404 to user: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:48:46.894548 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-778c424c-b618-4440-98fe-4f1be1f95a87 tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 404 len: 111 microversion: 2.42 time: 0.070854 Jul 28 03:48:46.898901 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1261/2816] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:48:46 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:48:46.909599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a67db92c-598e-4611-a183-e17e9aecb51f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '.version_select at 0x7ffa678bbca0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:46.948064 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a67db92c-598e-4611-a183-e17e9aecb51f tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-62642133" status: 204 len: 0 microversion: 2.42 time: 0.047593 Jul 28 03:48:46.952395 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1556/2817] 10.222.0.48 () {60 vars in 1256 bytes} [Thu Jul 28 03:48:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-62642133 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:48:47.242661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d2571e22-fd25-42d6-8337-af6adfe302d5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:47.243365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d2571e22-fd25-42d6-8337-af6adfe302d5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:47.250630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2571e22-fd25-42d6-8337-af6adfe302d5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:47.251172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2571e22-fd25-42d6-8337-af6adfe302d5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:47.252050 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2571e22-fd25-42d6-8337-af6adfe302d5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:47.252652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2571e22-fd25-42d6-8337-af6adfe302d5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:47.770579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8586e62e-e885-4615-b80f-0aae6a3a2209 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:47.771403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8586e62e-e885-4615-b80f-0aae6a3a2209 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:47.792917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8586e62e-e885-4615-b80f-0aae6a3a2209 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:47.793478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8586e62e-e885-4615-b80f-0aae6a3a2209 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:47.794593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8586e62e-e885-4615-b80f-0aae6a3a2209 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:47.795043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8586e62e-e885-4615-b80f-0aae6a3a2209 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:48.047980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8586e62e-e885-4615-b80f-0aae6a3a2209 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:48.065363 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8586e62e-e885-4615-b80f-0aae6a3a2209 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1273 microversion: 2.1 time: 0.301798 Jul 28 03:48:48.081019 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1557/2818] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:47 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1273 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:48.425418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d2571e22-fd25-42d6-8337-af6adfe302d5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:48.438969 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d2571e22-fd25-42d6-8337-af6adfe302d5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 1.200483 Jul 28 03:48:48.441190 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1262/2819] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:47 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:49.125439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5aca5ded-d506-40e6-88a7-c3ce5fce1983 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:49.133184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5aca5ded-d506-40e6-88a7-c3ce5fce1983 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:49.173073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5aca5ded-d506-40e6-88a7-c3ce5fce1983 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:49.173073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5aca5ded-d506-40e6-88a7-c3ce5fce1983 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:49.173378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5aca5ded-d506-40e6-88a7-c3ce5fce1983 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:49.174133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5aca5ded-d506-40e6-88a7-c3ce5fce1983 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:49.359178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-55f31b00-0453-48d5-9e51-edf883c3a6e2 req-62bba2a2-6812-4185-a96b-d8b633ec27ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a708e336-67ea-42c9-9d6d-8f77b8b67e7a", "tag": "5915ad92-8743-4e27-9bba-e7865a64aa58"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:49.409146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-55f31b00-0453-48d5-9e51-edf883c3a6e2 req-62bba2a2-6812-4185-a96b-d8b633ec27ce service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:49.411401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-55f31b00-0453-48d5-9e51-edf883c3a6e2 req-62bba2a2-6812-4185-a96b-d8b633ec27ce service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:49.466521 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-55f31b00-0453-48d5-9e51-edf883c3a6e2 req-62bba2a2-6812-4185-a96b-d8b633ec27ce service nova] Creating event network-changed:5915ad92-8743-4e27-9bba-e7865a64aa58 for instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a on n-h2-826756-3 Jul 28 03:48:49.477843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:49.487990 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-55f31b00-0453-48d5-9e51-edf883c3a6e2 req-62bba2a2-6812-4185-a96b-d8b633ec27ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136339 Jul 28 03:48:49.493019 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1263/2820] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:48:49.505657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-50e355cd-49d3-4d44-a3e5-bb24aabaee65 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:49.506910 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-50e355cd-49d3-4d44-a3e5-bb24aabaee65 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:49.531264 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50e355cd-49d3-4d44-a3e5-bb24aabaee65 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:49.533409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50e355cd-49d3-4d44-a3e5-bb24aabaee65 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:49.535687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50e355cd-49d3-4d44-a3e5-bb24aabaee65 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:49.542180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50e355cd-49d3-4d44-a3e5-bb24aabaee65 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:49.652628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5aca5ded-d506-40e6-88a7-c3ce5fce1983 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:49.661349 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5aca5ded-d506-40e6-88a7-c3ce5fce1983 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1315 microversion: 2.1 time: 0.571129 Jul 28 03:48:49.676246 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1558/2821] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:49 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:49.684216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-867590219", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "693f524d-65ea-4c5a-b83d-05789d71bfe6"}], "security_groups": [{"name": "tempest-securitygroup--1445437364"}], "key_name": "tempest-keypair-814177108", "user_data": "}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:50.001426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] validate_networks() for [('693f524d-65ea-4c5a-b83d-05789d71bfe6', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:48:50.183406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-50e355cd-49d3-4d44-a3e5-bb24aabaee65 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:50.195639 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-50e355cd-49d3-4d44-a3e5-bb24aabaee65 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 0.699258 Jul 28 03:48:50.196647 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1264/2822] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:49 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:50.683397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6235049a-d058-4549-8d2d-16b2a7ba4618 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:50.685880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6235049a-d058-4549-8d2d-16b2a7ba4618 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:50.717936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6235049a-d058-4549-8d2d-16b2a7ba4618 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:50.720256 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6235049a-d058-4549-8d2d-16b2a7ba4618 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:50.726221 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6235049a-d058-4549-8d2d-16b2a7ba4618 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:50.726970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6235049a-d058-4549-8d2d-16b2a7ba4618 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:51.591801 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6235049a-d058-4549-8d2d-16b2a7ba4618 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:51.619833 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6235049a-d058-4549-8d2d-16b2a7ba4618 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1315 microversion: 2.1 time: 0.940259 Jul 28 03:48:51.620481 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1265/2823] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:50 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1315 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:51.627555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-76ef13b6-03f2-43a0-ac2f-1a6f84260951 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:51.640120 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-76ef13b6-03f2-43a0-ac2f-1a6f84260951 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:51.647740 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76ef13b6-03f2-43a0-ac2f-1a6f84260951 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:51.660559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76ef13b6-03f2-43a0-ac2f-1a6f84260951 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:51.663365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76ef13b6-03f2-43a0-ac2f-1a6f84260951 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:51.663994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76ef13b6-03f2-43a0-ac2f-1a6f84260951 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:52.361638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:48:52.364556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:48:52.365328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:48:52.366133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:48:52.366777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:48:52.380449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:52.381342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:52.383983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:52.384753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:52.409859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for project 781ab005138547038def64d108937e3e. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:48:52.421263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for user d20381abd9784627887af3cb97cd68a8 and project 781ab005138547038def64d108937e3e. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:48:52.426659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:52.448108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:48:52.451955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:48:52.587471 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-336051a7-861c-4c71-b9a4-461ccab4c600 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.907535 Jul 28 03:48:52.588172 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1559/2824] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:48:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 2911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:48:52.604293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-28159d20-c40c-44b4-a1ae-d7a8ed555a50 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:52.605498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-28159d20-c40c-44b4-a1ae-d7a8ed555a50 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:52.853479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-28159d20-c40c-44b4-a1ae-d7a8ed555a50 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:52.871263 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-28159d20-c40c-44b4-a1ae-d7a8ed555a50 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1240 microversion: 2.1 time: 0.269512 Jul 28 03:48:52.872705 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1560/2825] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:52 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1240 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:52.888116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-69931ac5-a2c2-4653-a058-ec5e560b7ab2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:52.889910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-69931ac5-a2c2-4653-a058-ec5e560b7ab2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:52.913378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69931ac5-a2c2-4653-a058-ec5e560b7ab2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:52.913940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69931ac5-a2c2-4653-a058-ec5e560b7ab2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:52.918884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69931ac5-a2c2-4653-a058-ec5e560b7ab2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:52.920892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69931ac5-a2c2-4653-a058-ec5e560b7ab2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:53.008188 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-76ef13b6-03f2-43a0-ac2f-1a6f84260951 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:53.019122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:53.028786 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-76ef13b6-03f2-43a0-ac2f-1a6f84260951 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 1.396393 Jul 28 03:48:53.030481 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1266/2826] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:51 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:53.046871 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-a962c4d9-4586-4eac-b573-ef41f1b1d5ee req-61a48222-8bee-4eac-b669-94a540635db5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df82d7cd-a14e-41f7-8d5b-59e62a9a4352", "tag": "17276987-87af-4329-abc8-eda36f9496ad"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:53.119631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a962c4d9-4586-4eac-b573-ef41f1b1d5ee req-61a48222-8bee-4eac-b669-94a540635db5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:53.120094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a962c4d9-4586-4eac-b573-ef41f1b1d5ee req-61a48222-8bee-4eac-b669-94a540635db5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:53.171438 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-a962c4d9-4586-4eac-b573-ef41f1b1d5ee req-61a48222-8bee-4eac-b669-94a540635db5 service nova] Creating event network-changed:17276987-87af-4329-abc8-eda36f9496ad for instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 on n-h1-826756-3 Jul 28 03:48:53.232164 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-a962c4d9-4586-4eac-b573-ef41f1b1d5ee req-61a48222-8bee-4eac-b669-94a540635db5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199422 Jul 28 03:48:53.244968 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1267/2827] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:53.251602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3119116b-f50e-492b-b249-fe9ccec823bd tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Calling method '.version_select at 0x7ffa741caf70>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:53.263006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3119116b-f50e-492b-b249-fe9ccec823bd tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:53.265963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3119116b-f50e-492b-b249-fe9ccec823bd tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:53.302271 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3119116b-f50e-492b-b249-fe9ccec823bd tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] 10.222.0.48 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.054035 Jul 28 03:48:53.304427 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1268/2828] 10.222.0.48 () {58 vars in 1143 bytes} [Thu Jul 28 03:48:53 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:53.329902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b74e28fe-d2fa-4c96-9a5c-84db04696595 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:53.339214 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b74e28fe-d2fa-4c96-9a5c-84db04696595 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014027 Jul 28 03:48:53.340457 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1269/2829] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:48:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:48:53.359499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c618a35d-f553-4a13-b12a-9a8f39843ec1 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1468240912", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:53.363718 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:48:53.363718 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:48:53.397924 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c618a35d-f553-4a13-b12a-9a8f39843ec1 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.046167 Jul 28 03:48:53.401067 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1270/2830] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jul 28 03:48:53 2022] POST /compute/v2.1/flavors => generated 499 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:48:53.436624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-964342b5-716c-4196-8a38-0eca833e971a tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:53.471990 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-964342b5-716c-4196-8a38-0eca833e971a tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.055099 Jul 28 03:48:53.474633 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1271/2831] 10.222.0.48 () {58 vars in 1182 bytes} [Thu Jul 28 03:48:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:48:53.661214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-69931ac5-a2c2-4653-a058-ec5e560b7ab2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:53.681837 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-69931ac5-a2c2-4653-a058-ec5e560b7ab2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1315 microversion: 2.1 time: 0.802251 Jul 28 03:48:53.687716 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1561/2832] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:52 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:53.797499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-867916651", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "25b236a5-6057-4b96-be4b-132cf93d1f91"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:48:53.897623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-33f517ac-358e-4407-9187-b6b65e3a6e1e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:53.898488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-33f517ac-358e-4407-9187-b6b65e3a6e1e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:53.929378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:48:53.935796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33f517ac-358e-4407-9187-b6b65e3a6e1e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:53.936476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33f517ac-358e-4407-9187-b6b65e3a6e1e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:53.941532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33f517ac-358e-4407-9187-b6b65e3a6e1e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:53.946665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33f517ac-358e-4407-9187-b6b65e3a6e1e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:54.255817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-33f517ac-358e-4407-9187-b6b65e3a6e1e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:54.271103 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-33f517ac-358e-4407-9187-b6b65e3a6e1e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1244 microversion: 2.1 time: 0.376390 Jul 28 03:48:54.274303 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1562/2833] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:53 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1244 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:48:54.292189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f81eb4d6-1dbc-409d-8306-77a7f1b3ef5d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:54.293219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f81eb4d6-1dbc-409d-8306-77a7f1b3ef5d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:54.321938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f81eb4d6-1dbc-409d-8306-77a7f1b3ef5d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:54.326514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f81eb4d6-1dbc-409d-8306-77a7f1b3ef5d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:54.330414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f81eb4d6-1dbc-409d-8306-77a7f1b3ef5d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:54.331142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f81eb4d6-1dbc-409d-8306-77a7f1b3ef5d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:54.941886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f81eb4d6-1dbc-409d-8306-77a7f1b3ef5d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:54.951342 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f81eb4d6-1dbc-409d-8306-77a7f1b3ef5d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 0.673507 Jul 28 03:48:54.958985 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1563/2834] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:54 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:54.968373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2527fca3-834f-4fd3-a9ac-5ab53818ef28 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:54.969234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2527fca3-834f-4fd3-a9ac-5ab53818ef28 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:54.981532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2527fca3-834f-4fd3-a9ac-5ab53818ef28 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:54.982417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2527fca3-834f-4fd3-a9ac-5ab53818ef28 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:54.983019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2527fca3-834f-4fd3-a9ac-5ab53818ef28 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:54.983442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2527fca3-834f-4fd3-a9ac-5ab53818ef28 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:55.303955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:48:55.305691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:48:55.306186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:48:55.306799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:48:55.307671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:48:55.322380 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:55.323457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:55.325122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:55.326942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:55.357175 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Getting quotas for project da4a22e4560a4210bb58942cec62c091. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:48:55.372251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Getting quotas for user ac9d734be6ee4b549f9ed389c276f54a and project da4a22e4560a4210bb58942cec62c091. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:48:55.391484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:48:55.396131 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:48:55.494540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2527fca3-834f-4fd3-a9ac-5ab53818ef28 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:55.518482 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2527fca3-834f-4fd3-a9ac-5ab53818ef28 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1315 microversion: 2.1 time: 0.550647 Jul 28 03:48:55.521648 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1564/2835] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:54 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:55.542546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a0c035d2-c775-4ccd-9058-f42e27fc314b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:55.544843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a0c035d2-c775-4ccd-9058-f42e27fc314b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:55.569022 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-93841a66-c9ce-4451-a567-4af715156e80 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.772956 Jul 28 03:48:55.570139 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1272/2836] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:48:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:48:55.583310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0c035d2-c775-4ccd-9058-f42e27fc314b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:55.588366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0c035d2-c775-4ccd-9058-f42e27fc314b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:55.589914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cd2c8962-a3a1-4a2d-af17-126197f997ee tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:55.591772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cd2c8962-a3a1-4a2d-af17-126197f997ee tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:55.593421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0c035d2-c775-4ccd-9058-f42e27fc314b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:55.596580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0c035d2-c775-4ccd-9058-f42e27fc314b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:55.890473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a0c035d2-c775-4ccd-9058-f42e27fc314b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:55.906702 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a0c035d2-c775-4ccd-9058-f42e27fc314b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1298 microversion: 2.1 time: 0.382781 Jul 28 03:48:55.907358 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1565/2837] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:55 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1298 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:55.945891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd2c8962-a3a1-4a2d-af17-126197f997ee tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:55.969958 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cd2c8962-a3a1-4a2d-af17-126197f997ee tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1278 microversion: 2.1 time: 0.388403 Jul 28 03:48:55.972521 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1273/2838] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:55 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1278 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:55.992852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-84f9b4ac-9411-4500-abae-b22e5240e4c1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:55.993514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-84f9b4ac-9411-4500-abae-b22e5240e4c1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:56.004332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84f9b4ac-9411-4500-abae-b22e5240e4c1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:56.004759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84f9b4ac-9411-4500-abae-b22e5240e4c1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:56.017419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84f9b4ac-9411-4500-abae-b22e5240e4c1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:56.018260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84f9b4ac-9411-4500-abae-b22e5240e4c1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:56.548093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-42177b8a-1874-428e-b46d-a6f382243067 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:56.557147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-42177b8a-1874-428e-b46d-a6f382243067 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:56.581202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42177b8a-1874-428e-b46d-a6f382243067 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:56.581738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42177b8a-1874-428e-b46d-a6f382243067 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:56.582548 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42177b8a-1874-428e-b46d-a6f382243067 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:56.583014 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42177b8a-1874-428e-b46d-a6f382243067 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:56.671547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-84f9b4ac-9411-4500-abae-b22e5240e4c1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:56.692414 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-84f9b4ac-9411-4500-abae-b22e5240e4c1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 0.703259 Jul 28 03:48:56.695191 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1566/2839] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:55 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:56.958673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-27770eb2-0cb5-44f3-a1fe-5e1045a5b3f4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:56.962302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-27770eb2-0cb5-44f3-a1fe-5e1045a5b3f4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:57.006425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27770eb2-0cb5-44f3-a1fe-5e1045a5b3f4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:57.014305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27770eb2-0cb5-44f3-a1fe-5e1045a5b3f4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:57.016311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27770eb2-0cb5-44f3-a1fe-5e1045a5b3f4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:57.021787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27770eb2-0cb5-44f3-a1fe-5e1045a5b3f4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:57.240279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-27770eb2-0cb5-44f3-a1fe-5e1045a5b3f4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:57.266765 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-27770eb2-0cb5-44f3-a1fe-5e1045a5b3f4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1298 microversion: 2.1 time: 0.334341 Jul 28 03:48:57.269219 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1567/2840] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:56 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1298 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:57.294079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e896d96-7363-4ff6-81d0-bd17943dd1c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:57.306331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e896d96-7363-4ff6-81d0-bd17943dd1c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:57.319057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e896d96-7363-4ff6-81d0-bd17943dd1c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:57.319845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e896d96-7363-4ff6-81d0-bd17943dd1c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:57.321515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e896d96-7363-4ff6-81d0-bd17943dd1c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:57.322150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e896d96-7363-4ff6-81d0-bd17943dd1c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:57.453503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e896d96-7363-4ff6-81d0-bd17943dd1c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:57.480165 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e896d96-7363-4ff6-81d0-bd17943dd1c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1330 microversion: 2.1 time: 0.210465 Jul 28 03:48:57.483801 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1568/2841] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:57 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1330 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:57.523116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-42177b8a-1874-428e-b46d-a6f382243067 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:57.538303 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-42177b8a-1874-428e-b46d-a6f382243067 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1315 microversion: 2.1 time: 0.997722 Jul 28 03:48:57.542847 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1274/2842] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:56 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1315 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:57.727154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5a9b2dc2-b509-4297-aa13-f1fa27ee90ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:57.727992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5a9b2dc2-b509-4297-aa13-f1fa27ee90ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:57.762689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a9b2dc2-b509-4297-aa13-f1fa27ee90ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:57.764854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a9b2dc2-b509-4297-aa13-f1fa27ee90ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:57.767357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a9b2dc2-b509-4297-aa13-f1fa27ee90ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:57.767987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a9b2dc2-b509-4297-aa13-f1fa27ee90ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:58.306726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ad02528b-c4df-4d20-a46c-f7ba1ed72490 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:58.308002 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ad02528b-c4df-4d20-a46c-f7ba1ed72490 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:58.319491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad02528b-c4df-4d20-a46c-f7ba1ed72490 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:58.320306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad02528b-c4df-4d20-a46c-f7ba1ed72490 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:58.321415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad02528b-c4df-4d20-a46c-f7ba1ed72490 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:58.322095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad02528b-c4df-4d20-a46c-f7ba1ed72490 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:58.483278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ad02528b-c4df-4d20-a46c-f7ba1ed72490 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:58.496071 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ad02528b-c4df-4d20-a46c-f7ba1ed72490 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1298 microversion: 2.1 time: 0.194093 Jul 28 03:48:58.497470 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1275/2843] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:58 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1298 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:58.509117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-12f59209-d678-4fca-8d41-b7d2813a111b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:58.510208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-12f59209-d678-4fca-8d41-b7d2813a111b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:58.521602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-12f59209-d678-4fca-8d41-b7d2813a111b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:58.522276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-12f59209-d678-4fca-8d41-b7d2813a111b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:58.523867 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-12f59209-d678-4fca-8d41-b7d2813a111b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:58.524543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-12f59209-d678-4fca-8d41-b7d2813a111b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:58.755496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-12f59209-d678-4fca-8d41-b7d2813a111b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:58.760259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:48:58.768469 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-12f59209-d678-4fca-8d41-b7d2813a111b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1336 microversion: 2.1 time: 0.264570 Jul 28 03:48:58.782957 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1276/2844] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:58 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1336 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:58.790794 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7707441d-0f93-4e14-b8e1-224e7ce0bba2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:58.793428 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7707441d-0f93-4e14-b8e1-224e7ce0bba2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:58.804051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7707441d-0f93-4e14-b8e1-224e7ce0bba2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:58.804906 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7707441d-0f93-4e14-b8e1-224e7ce0bba2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:58.806529 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7707441d-0f93-4e14-b8e1-224e7ce0bba2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:58.807193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7707441d-0f93-4e14-b8e1-224e7ce0bba2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:58.925022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5a9b2dc2-b509-4297-aa13-f1fa27ee90ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:48:58.950006 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5a9b2dc2-b509-4297-aa13-f1fa27ee90ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 1.228294 Jul 28 03:48:58.951921 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1569/2845] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:57 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:48:59.530795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-02b4c617-898e-44ec-90b5-74196c8462ce tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:48:59.531933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-02b4c617-898e-44ec-90b5-74196c8462ce tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:48:59.601374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02b4c617-898e-44ec-90b5-74196c8462ce tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:59.602095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02b4c617-898e-44ec-90b5-74196c8462ce tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:48:59.607003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02b4c617-898e-44ec-90b5-74196c8462ce tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:48:59.608632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02b4c617-898e-44ec-90b5-74196c8462ce tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:00.596315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-02b4c617-898e-44ec-90b5-74196c8462ce tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:00.604619 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-02b4c617-898e-44ec-90b5-74196c8462ce tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1366 microversion: 2.1 time: 1.087071 Jul 28 03:49:00.608755 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1570/2846] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:59 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1366 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:00.613938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4c13ad8-4f61-41e2-a145-09b21681b98e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:00.614647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4c13ad8-4f61-41e2-a145-09b21681b98e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:00.639011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c13ad8-4f61-41e2-a145-09b21681b98e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:00.639474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c13ad8-4f61-41e2-a145-09b21681b98e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:00.640281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c13ad8-4f61-41e2-a145-09b21681b98e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:00.641943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c13ad8-4f61-41e2-a145-09b21681b98e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:00.674989 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-a4c13ad8-4f61-41e2-a145-09b21681b98e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] HTTP exception thrown: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4c13ad8-4f61-41e2-a145-09b21681b98e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Request method failure captured: Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b HTTP/1.1 Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gU6vn2BvYMqnkzzar2rp1yt7t9FfUd-pdgbml049O1PMfwOMNwsmVj59ndGhWWwsTBG6QZVEj1MdsKY6i8i5umLCr0ghuTiSq2P4Nqln4AW8bt5hIttYF4ANrn1qRIXo28VWZ6olJy1vJWy7yymhuNlMeIL8db8Izo2olPMvYJAtLc Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.42 Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a1d6ebac92a1492b8b85a2b30f7c145c Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1325577351 Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a1d6ebac92a1492b8b85a2b30f7c145c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1d6ebac92a1492b8b85a2b30f7c145c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a1d6ebac92a1492b8b85a2b30f7c145c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1d6ebac92a1492b8b85a2b30f7c145c"}]}] Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1325577351 Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a1d6ebac92a1492b8b85a2b30f7c145c Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1325577351 Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TaggedBootDevicesTest_v242-1325577351-project Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: c241cd30b794493abc7fa1d15987c92a Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1325577351-project Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'ee94e075-7edd-436d-ae33-6e33bde0472b'} Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:49:00.677069 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:49:00.682194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:49:00.682194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:00.682194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:49:00.682194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:00.682194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:00.682194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:49:00.682194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:49:00.682194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:49:00.682194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:49:00.682194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:49:00.682194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:00.683296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4c13ad8-4f61-41e2-a145-09b21681b98e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Returning 404 to user: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:49:00.683465 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4c13ad8-4f61-41e2-a145-09b21681b98e tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 404 len: 111 microversion: 2.42 time: 0.073382 Jul 28 03:49:00.687562 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1571/2847] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:49:00 2022] DELETE /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:49:00.698765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d0a291b9-0f03-4703-89e5-ac0da80ac7d2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:00.699408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d0a291b9-0f03-4703-89e5-ac0da80ac7d2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:00.713260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0a291b9-0f03-4703-89e5-ac0da80ac7d2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:00.713719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0a291b9-0f03-4703-89e5-ac0da80ac7d2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:00.714539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0a291b9-0f03-4703-89e5-ac0da80ac7d2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:00.719481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0a291b9-0f03-4703-89e5-ac0da80ac7d2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:00.856045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d0a291b9-0f03-4703-89e5-ac0da80ac7d2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:00.867750 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d0a291b9-0f03-4703-89e5-ac0da80ac7d2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1336 microversion: 2.1 time: 0.178913 Jul 28 03:49:00.868383 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1572/2848] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:00 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1336 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:00.894703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f914ce8-46a2-4a25-9893-e4330015a959 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:00.895337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f914ce8-46a2-4a25-9893-e4330015a959 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:00.908114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7707441d-0f93-4e14-b8e1-224e7ce0bba2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:00.911065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f914ce8-46a2-4a25-9893-e4330015a959 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:00.913557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f914ce8-46a2-4a25-9893-e4330015a959 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:00.914370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f914ce8-46a2-4a25-9893-e4330015a959 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:00.917051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f914ce8-46a2-4a25-9893-e4330015a959 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:00.918135 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7707441d-0f93-4e14-b8e1-224e7ce0bba2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1315 microversion: 2.1 time: 2.133960 Jul 28 03:49:00.918835 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1277/2849] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:48:58 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1315 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:00.927395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fde083c0-ba74-4900-9149-9492f2d1425c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:00.939443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fde083c0-ba74-4900-9149-9492f2d1425c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] [instance: ee94e075-7edd-436d-ae33-6e33bde0472b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:00.967363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fde083c0-ba74-4900-9149-9492f2d1425c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:00.968816 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fde083c0-ba74-4900-9149-9492f2d1425c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:00.971767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fde083c0-ba74-4900-9149-9492f2d1425c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:00.974724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fde083c0-ba74-4900-9149-9492f2d1425c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:01.030216 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-fde083c0-ba74-4900-9149-9492f2d1425c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] HTTP exception thrown: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fde083c0-ba74-4900-9149-9492f2d1425c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Request method failure captured: Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b HTTP/1.1 Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gU6vn2BvYMqnkzzar2rp1yt7t9FfUd-pdgbml049O1PMfwOMNwsmVj59ndGhWWwsTBG6QZVEj1MdsKY6i8i5umLCr0ghuTiSq2P4Nqln4AW8bt5hIttYF4ANrn1qRIXo28VWZ6olJy1vJWy7yymhuNlMeIL8db8Izo2olPMvYJAtLc Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Openstack-Nova-Api-Version: 2.42 Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: a1d6ebac92a1492b8b85a2b30f7c145c Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1325577351 Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a1d6ebac92a1492b8b85a2b30f7c145c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1d6ebac92a1492b8b85a2b30f7c145c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a1d6ebac92a1492b8b85a2b30f7c145c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a1d6ebac92a1492b8b85a2b30f7c145c"}]}] Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1325577351 Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: a1d6ebac92a1492b8b85a2b30f7c145c Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1325577351 Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-TaggedBootDevicesTest_v242-1325577351-project Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: c241cd30b794493abc7fa1d15987c92a Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1325577351-project Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'ee94e075-7edd-436d-ae33-6e33bde0472b'} Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:01.043409 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:49:01.053918 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:01.053918 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:01.053918 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:49:01.053918 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:49:01.053918 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:49:01.053918 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:49:01.053918 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. Jul 28 03:49:01.053918 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:01.061022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fde083c0-ba74-4900-9149-9492f2d1425c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] Returning 404 to user: Instance ee94e075-7edd-436d-ae33-6e33bde0472b could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:49:01.062213 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fde083c0-ba74-4900-9149-9492f2d1425c tempest-TaggedBootDevicesTest_v242-1325577351 tempest-TaggedBootDevicesTest_v242-1325577351-project] 10.222.0.48 "GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b" status: 404 len: 111 microversion: 2.42 time: 0.138840 Jul 28 03:49:01.067278 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1278/2850] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:00 2022] GET /compute/v2.1/servers/ee94e075-7edd-436d-ae33-6e33bde0472b => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:49:01.779366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f914ce8-46a2-4a25-9893-e4330015a959 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:01.792497 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f914ce8-46a2-4a25-9893-e4330015a959 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 0.902164 Jul 28 03:49:01.793386 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1573/2851] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:00 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:01.808520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-14c8190f-7e8f-405f-a129-4b97e24fe2af req-d251bf1f-41f4-472b-8ca5-8f4c6af5adfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df82d7cd-a14e-41f7-8d5b-59e62a9a4352", "name": "network-vif-plugged", "status": "completed", "tag": "17276987-87af-4329-abc8-eda36f9496ad"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:01.833056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-14c8190f-7e8f-405f-a129-4b97e24fe2af req-d251bf1f-41f4-472b-8ca5-8f4c6af5adfb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:01.834777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-14c8190f-7e8f-405f-a129-4b97e24fe2af req-d251bf1f-41f4-472b-8ca5-8f4c6af5adfb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:01.836886 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-10621f77-e22b-457a-8b10-543d343f22f3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Action: 'create', calling method: .version_select at 0x7ffa741abd30>, body: {"keypair": {"name": "tempest-keypair-1573393649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3KHD9qbB5QJkvu2jPq/hSFRkjj+3aTGzoZ8RltqQomDo118flqYtC8ciXExzITNcad2CL5jOmF0qpudNhyVle/VjhMUp22N1RNY2boFx2azld2U/SdcBymJ2QTgoHifw=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:01.860960 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-14c8190f-7e8f-405f-a129-4b97e24fe2af req-d251bf1f-41f4-472b-8ca5-8f4c6af5adfb service nova] Creating event network-vif-plugged:17276987-87af-4329-abc8-eda36f9496ad for instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 on n-h1-826756-3 Jul 28 03:49:01.869741 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-14c8190f-7e8f-405f-a129-4b97e24fe2af req-d251bf1f-41f4-472b-8ca5-8f4c6af5adfb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074843 Jul 28 03:49:01.881560 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1574/2852] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:01.889801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0701479e-0a84-467c-8257-fded1df1adde tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:01.890596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0701479e-0a84-467c-8257-fded1df1adde tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:01.903003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-10621f77-e22b-457a-8b10-543d343f22f3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Getting quotas for project 2d4337b4b2c44fa99ab41728c08e3954. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:49:01.904574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0701479e-0a84-467c-8257-fded1df1adde tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:01.905042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0701479e-0a84-467c-8257-fded1df1adde tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:01.905846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0701479e-0a84-467c-8257-fded1df1adde tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:01.906278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0701479e-0a84-467c-8257-fded1df1adde tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:01.945609 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-10621f77-e22b-457a-8b10-543d343f22f3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Getting quotas for user 95da7dd0ca314d3fa4b630ff50fadf61 and project 2d4337b4b2c44fa99ab41728c08e3954. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:49:02.032748 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-10621f77-e22b-457a-8b10-543d343f22f3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.935931 Jul 28 03:49:02.033531 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1279/2853] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:49:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:02.038373 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a7b628d2-1110-4ad3-878f-086076fc8120 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:02.039180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a7b628d2-1110-4ad3-878f-086076fc8120 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:02.055669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7b628d2-1110-4ad3-878f-086076fc8120 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:02.056115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7b628d2-1110-4ad3-878f-086076fc8120 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:02.059576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7b628d2-1110-4ad3-878f-086076fc8120 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:02.060028 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7b628d2-1110-4ad3-878f-086076fc8120 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:02.398124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:02.659395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0701479e-0a84-467c-8257-fded1df1adde tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:02.687621 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0701479e-0a84-467c-8257-fded1df1adde tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1366 microversion: 2.1 time: 0.803762 Jul 28 03:49:02.696561 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1575/2854] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:01 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1366 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:02.710490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1df70557-0c39-472f-9517-0019860fdac0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:02.713623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1df70557-0c39-472f-9517-0019860fdac0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:02.737505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1df70557-0c39-472f-9517-0019860fdac0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:02.738304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1df70557-0c39-472f-9517-0019860fdac0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:02.739289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1df70557-0c39-472f-9517-0019860fdac0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:02.740409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1df70557-0c39-472f-9517-0019860fdac0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:02.862107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=20 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:02.974481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a7b628d2-1110-4ad3-878f-086076fc8120 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:02.988481 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a7b628d2-1110-4ad3-878f-086076fc8120 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1378 microversion: 2.1 time: 0.953590 Jul 28 03:49:02.989344 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1280/2855] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:02 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1378 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:03.001428 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0cd0b45d-dd31-4ac2-b8de-64b8242ebea7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:03.006344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0cd0b45d-dd31-4ac2-b8de-64b8242ebea7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:03.026925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0cd0b45d-dd31-4ac2-b8de-64b8242ebea7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:03.027737 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0cd0b45d-dd31-4ac2-b8de-64b8242ebea7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:03.028953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0cd0b45d-dd31-4ac2-b8de-64b8242ebea7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:03.029506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0cd0b45d-dd31-4ac2-b8de-64b8242ebea7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:03.808091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1df70557-0c39-472f-9517-0019860fdac0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:03.825788 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1df70557-0c39-472f-9517-0019860fdac0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1315 microversion: 2.1 time: 1.125742 Jul 28 03:49:03.826630 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1576/2856] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:02 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1315 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:03.842680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66e32e75-2266-4c56-a3bc-cff2bad32c6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:03.849732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-66e32e75-2266-4c56-a3bc-cff2bad32c6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:03.875653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66e32e75-2266-4c56-a3bc-cff2bad32c6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:03.876421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66e32e75-2266-4c56-a3bc-cff2bad32c6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:03.878846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66e32e75-2266-4c56-a3bc-cff2bad32c6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:03.880461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66e32e75-2266-4c56-a3bc-cff2bad32c6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:04.216623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0cd0b45d-dd31-4ac2-b8de-64b8242ebea7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:04.235477 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0cd0b45d-dd31-4ac2-b8de-64b8242ebea7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 1.242168 Jul 28 03:49:04.250769 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1281/2857] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:02 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:04.258697 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7c2f5c2c-639e-4460-ba51-ec69f7696b9c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:04.260106 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7c2f5c2c-639e-4460-ba51-ec69f7696b9c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:04.266582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-66e32e75-2266-4c56-a3bc-cff2bad32c6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:04.294575 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-66e32e75-2266-4c56-a3bc-cff2bad32c6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1366 microversion: 2.1 time: 0.466296 Jul 28 03:49:04.298701 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1577/2858] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:03 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1366 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:04.307963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c2f5c2c-639e-4460-ba51-ec69f7696b9c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:04.308861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c2f5c2c-639e-4460-ba51-ec69f7696b9c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:04.310568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c2f5c2c-639e-4460-ba51-ec69f7696b9c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:04.312157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c2f5c2c-639e-4460-ba51-ec69f7696b9c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:04.860062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ea59ebc3-598d-4702-859d-a7859894cfbb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:04.861012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ea59ebc3-598d-4702-859d-a7859894cfbb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:04.879306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea59ebc3-598d-4702-859d-a7859894cfbb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:04.889317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea59ebc3-598d-4702-859d-a7859894cfbb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:04.890197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea59ebc3-598d-4702-859d-a7859894cfbb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:04.890637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea59ebc3-598d-4702-859d-a7859894cfbb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:05.129633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7c2f5c2c-639e-4460-ba51-ec69f7696b9c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:05.144465 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7c2f5c2c-639e-4460-ba51-ec69f7696b9c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1378 microversion: 2.1 time: 0.890853 Jul 28 03:49:05.147733 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1282/2859] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:04 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1378 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:05.259199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8395701d-ec67-4cc2-abd4-9cc12a5789f0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:05.260022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8395701d-ec67-4cc2-abd4-9cc12a5789f0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:05.273943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8395701d-ec67-4cc2-abd4-9cc12a5789f0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:05.274679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8395701d-ec67-4cc2-abd4-9cc12a5789f0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:05.281138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8395701d-ec67-4cc2-abd4-9cc12a5789f0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:05.281857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8395701d-ec67-4cc2-abd4-9cc12a5789f0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:05.349962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:05.832878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ea59ebc3-598d-4702-859d-a7859894cfbb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:05.857766 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ea59ebc3-598d-4702-859d-a7859894cfbb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1503 microversion: 2.1 time: 1.002023 Jul 28 03:49:05.863506 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1578/2860] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:04 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1503 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:05.873202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-dbdb5370-a2c2-4c83-8acb-dc8f55ce68c3 req-706ab5be-c48c-4b96-8539-98ab56e801b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a314625b-adb1-45fa-9483-b084005a11b6", "tag": "64ff1826-6714-4cbc-a27d-442eaec6ddd7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:05.914596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-dbdb5370-a2c2-4c83-8acb-dc8f55ce68c3 req-706ab5be-c48c-4b96-8539-98ab56e801b7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:05.915308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-dbdb5370-a2c2-4c83-8acb-dc8f55ce68c3 req-706ab5be-c48c-4b96-8539-98ab56e801b7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:05.956133 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-dbdb5370-a2c2-4c83-8acb-dc8f55ce68c3 req-706ab5be-c48c-4b96-8539-98ab56e801b7 service nova] Creating event network-changed:64ff1826-6714-4cbc-a27d-442eaec6ddd7 for instance a314625b-adb1-45fa-9483-b084005a11b6 on n-h2-826756-3 Jul 28 03:49:05.985023 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-dbdb5370-a2c2-4c83-8acb-dc8f55ce68c3 req-706ab5be-c48c-4b96-8539-98ab56e801b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113357 Jul 28 03:49:05.991199 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1579/2861] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:05.997291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-61dec1f5-5bbd-4f73-a9a9-3b0e3475545c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:06.005655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61dec1f5-5bbd-4f73-a9a9-3b0e3475545c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:06.029786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61dec1f5-5bbd-4f73-a9a9-3b0e3475545c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:06.030384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61dec1f5-5bbd-4f73-a9a9-3b0e3475545c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:06.038570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61dec1f5-5bbd-4f73-a9a9-3b0e3475545c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:06.039424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61dec1f5-5bbd-4f73-a9a9-3b0e3475545c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:06.054618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:06.466505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-61dec1f5-5bbd-4f73-a9a9-3b0e3475545c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:06.486690 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-61dec1f5-5bbd-4f73-a9a9-3b0e3475545c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1366 microversion: 2.1 time: 0.492906 Jul 28 03:49:06.489164 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1580/2862] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:05 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1366 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:06.511401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fe2752c0-bba1-4341-8abf-fae8bfe6d56b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:06.516005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fe2752c0-bba1-4341-8abf-fae8bfe6d56b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:06.536961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe2752c0-bba1-4341-8abf-fae8bfe6d56b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:06.538909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe2752c0-bba1-4341-8abf-fae8bfe6d56b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:06.539987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe2752c0-bba1-4341-8abf-fae8bfe6d56b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:06.541390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe2752c0-bba1-4341-8abf-fae8bfe6d56b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:06.609181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fe2752c0-bba1-4341-8abf-fae8bfe6d56b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:49:06.665990 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8395701d-ec67-4cc2-abd4-9cc12a5789f0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:06.680900 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8395701d-ec67-4cc2-abd4-9cc12a5789f0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 1.427025 Jul 28 03:49:06.685549 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1283/2863] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:05 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:06.891994 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fe2752c0-bba1-4341-8abf-fae8bfe6d56b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "DELETE /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 204 len: 0 microversion: 2.1 time: 0.388614 Jul 28 03:49:06.894853 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1581/2864] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:49:06 2022] DELETE /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:49:06.916070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf0dc94b-4fe7-4374-8341-feee184d7125 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:06.916884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cf0dc94b-4fe7-4374-8341-feee184d7125 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:06.959671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf0dc94b-4fe7-4374-8341-feee184d7125 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:06.960222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf0dc94b-4fe7-4374-8341-feee184d7125 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:06.961740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf0dc94b-4fe7-4374-8341-feee184d7125 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:06.961740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf0dc94b-4fe7-4374-8341-feee184d7125 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:07.403440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf0dc94b-4fe7-4374-8341-feee184d7125 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:07.418982 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf0dc94b-4fe7-4374-8341-feee184d7125 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1378 microversion: 2.1 time: 0.522587 Jul 28 03:49:07.420025 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1582/2865] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:06 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1378 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:07.430239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-76440a8f-f32f-4829-861a-038735728f30 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:07.439676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-76440a8f-f32f-4829-861a-038735728f30 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:07.469225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76440a8f-f32f-4829-861a-038735728f30 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:07.469993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76440a8f-f32f-4829-861a-038735728f30 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:07.470810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76440a8f-f32f-4829-861a-038735728f30 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:07.471259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76440a8f-f32f-4829-861a-038735728f30 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:07.553262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1604319428", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "7250c56a-6226-476f-9b0b-31c3a0f0be31"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:07.686738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] validate_networks() for [('7250c56a-6226-476f-9b0b-31c3a0f0be31', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:49:07.865104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-76440a8f-f32f-4829-861a-038735728f30 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:07.874922 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-76440a8f-f32f-4829-861a-038735728f30 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1509 microversion: 2.1 time: 0.451877 Jul 28 03:49:07.882274 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1583/2866] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:07 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1509 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:07.893253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-58b11da4-39f1-460c-bd4b-85e8d4ca1cff tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:07.895144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-58b11da4-39f1-460c-bd4b-85e8d4ca1cff tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:07.910771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58b11da4-39f1-460c-bd4b-85e8d4ca1cff tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:07.913494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58b11da4-39f1-460c-bd4b-85e8d4ca1cff tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:07.914522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58b11da4-39f1-460c-bd4b-85e8d4ca1cff tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:07.923419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58b11da4-39f1-460c-bd4b-85e8d4ca1cff tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:08.356990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-58b11da4-39f1-460c-bd4b-85e8d4ca1cff tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:08.366760 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-58b11da4-39f1-460c-bd4b-85e8d4ca1cff tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1366 microversion: 2.1 time: 0.483292 Jul 28 03:49:08.373095 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1584/2867] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:07 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1366 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:08.390921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f2583b23-7c41-47c9-87a5-3485dc24d431 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:08.392667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f2583b23-7c41-47c9-87a5-3485dc24d431 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:08.423375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2583b23-7c41-47c9-87a5-3485dc24d431 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:08.425000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2583b23-7c41-47c9-87a5-3485dc24d431 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:08.426646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2583b23-7c41-47c9-87a5-3485dc24d431 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:08.430659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2583b23-7c41-47c9-87a5-3485dc24d431 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:08.960436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f2583b23-7c41-47c9-87a5-3485dc24d431 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:08.978881 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f2583b23-7c41-47c9-87a5-3485dc24d431 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 0.603918 Jul 28 03:49:08.984769 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1585/2868] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:08 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:08.997709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-abc891b3-1bb3-42cf-af8d-b20e3e8364fd req-216b7909-2bbd-410c-8600-be498d4d5a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed99415-e36a-431c-a33c-c609912af752", "tag": "fe3c986d-7298-4555-ba29-5e1b4c7e6981"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:09.031363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-abc891b3-1bb3-42cf-af8d-b20e3e8364fd req-216b7909-2bbd-410c-8600-be498d4d5a78 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:09.031820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-abc891b3-1bb3-42cf-af8d-b20e3e8364fd req-216b7909-2bbd-410c-8600-be498d4d5a78 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:09.085771 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-abc891b3-1bb3-42cf-af8d-b20e3e8364fd req-216b7909-2bbd-410c-8600-be498d4d5a78 service nova] Creating event network-changed:fe3c986d-7298-4555-ba29-5e1b4c7e6981 for instance bed99415-e36a-431c-a33c-c609912af752 on n-h1-826756-3 Jul 28 03:49:09.114818 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-abc891b3-1bb3-42cf-af8d-b20e3e8364fd req-216b7909-2bbd-410c-8600-be498d4d5a78 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126177 Jul 28 03:49:09.116902 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1586/2869] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:09.152430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bfdf14cf-8498-4be8-8165-13ea4f0c57f8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:09.153388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bfdf14cf-8498-4be8-8165-13ea4f0c57f8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:09.172627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfdf14cf-8498-4be8-8165-13ea4f0c57f8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:09.185174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfdf14cf-8498-4be8-8165-13ea4f0c57f8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:09.186489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfdf14cf-8498-4be8-8165-13ea4f0c57f8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:09.187092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfdf14cf-8498-4be8-8165-13ea4f0c57f8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:09.606347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bfdf14cf-8498-4be8-8165-13ea4f0c57f8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:09.615045 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bfdf14cf-8498-4be8-8165-13ea4f0c57f8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1378 microversion: 2.1 time: 0.495122 Jul 28 03:49:09.619645 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1587/2870] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:09 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1378 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:09.626221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d5adc64c-4545-4451-9b9c-6f3f71741e00 req-7cdb8bc1-f9cd-4410-bcf0-d2a85a418d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a708e336-67ea-42c9-9d6d-8f77b8b67e7a", "name": "network-vif-plugged", "status": "completed", "tag": "f763a531-4acb-48d9-be72-22782928289c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:09.657054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d5adc64c-4545-4451-9b9c-6f3f71741e00 req-7cdb8bc1-f9cd-4410-bcf0-d2a85a418d2e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:09.658018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d5adc64c-4545-4451-9b9c-6f3f71741e00 req-7cdb8bc1-f9cd-4410-bcf0-d2a85a418d2e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:09.692648 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-d5adc64c-4545-4451-9b9c-6f3f71741e00 req-7cdb8bc1-f9cd-4410-bcf0-d2a85a418d2e service nova] Creating event network-vif-plugged:f763a531-4acb-48d9-be72-22782928289c for instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a on n-h2-826756-3 Jul 28 03:49:09.699085 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d5adc64c-4545-4451-9b9c-6f3f71741e00 req-7cdb8bc1-f9cd-4410-bcf0-d2a85a418d2e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077868 Jul 28 03:49:09.700411 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1588/2871] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:09.709901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-49bc51d7-19e6-40bf-bc76-b4b459bb850d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:09.716127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-49bc51d7-19e6-40bf-bc76-b4b459bb850d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:09.746742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49bc51d7-19e6-40bf-bc76-b4b459bb850d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:09.747270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49bc51d7-19e6-40bf-bc76-b4b459bb850d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:09.748114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49bc51d7-19e6-40bf-bc76-b4b459bb850d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:09.750688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49bc51d7-19e6-40bf-bc76-b4b459bb850d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:10.078507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-49bc51d7-19e6-40bf-bc76-b4b459bb850d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:10.106976 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-49bc51d7-19e6-40bf-bc76-b4b459bb850d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1509 microversion: 2.1 time: 0.403958 Jul 28 03:49:10.110656 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1589/2872] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:09 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1509 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:10.134116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f6facea-6d67-46a2-ad9f-2973f2b9c92e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:10.135134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0f6facea-6d67-46a2-ad9f-2973f2b9c92e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:10.162337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f6facea-6d67-46a2-ad9f-2973f2b9c92e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:10.162963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f6facea-6d67-46a2-ad9f-2973f2b9c92e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:10.164046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f6facea-6d67-46a2-ad9f-2973f2b9c92e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:10.164664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f6facea-6d67-46a2-ad9f-2973f2b9c92e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:10.641338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0f6facea-6d67-46a2-ad9f-2973f2b9c92e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:10.664691 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0f6facea-6d67-46a2-ad9f-2973f2b9c92e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1366 microversion: 2.1 time: 0.542013 Jul 28 03:49:10.694666 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1590/2873] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:10 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1366 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:10.714761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0448ffe4-da69-4466-a4bd-bb63fd506176 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:10.721264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0448ffe4-da69-4466-a4bd-bb63fd506176 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:10.742731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0448ffe4-da69-4466-a4bd-bb63fd506176 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:10.744522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0448ffe4-da69-4466-a4bd-bb63fd506176 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:10.745983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0448ffe4-da69-4466-a4bd-bb63fd506176 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:10.746773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0448ffe4-da69-4466-a4bd-bb63fd506176 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:11.279287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0448ffe4-da69-4466-a4bd-bb63fd506176 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:11.289256 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0448ffe4-da69-4466-a4bd-bb63fd506176 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 0.593056 Jul 28 03:49:11.295214 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1591/2874] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:10 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:11.300645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5dbd75e8-4818-4e9f-8d5d-f885bda5f255 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:11.301615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5dbd75e8-4818-4e9f-8d5d-f885bda5f255 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:11.326223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dbd75e8-4818-4e9f-8d5d-f885bda5f255 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:11.327346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dbd75e8-4818-4e9f-8d5d-f885bda5f255 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:11.329329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dbd75e8-4818-4e9f-8d5d-f885bda5f255 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:11.334875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dbd75e8-4818-4e9f-8d5d-f885bda5f255 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:11.690754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5dbd75e8-4818-4e9f-8d5d-f885bda5f255 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:11.701321 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5dbd75e8-4818-4e9f-8d5d-f885bda5f255 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1378 microversion: 2.1 time: 0.404453 Jul 28 03:49:11.720558 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1592/2875] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:11 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1378 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:11.746694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-054308d2-788d-4868-a8fc-93bed5f088f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:11.749927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-054308d2-788d-4868-a8fc-93bed5f088f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:11.763670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-054308d2-788d-4868-a8fc-93bed5f088f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:11.764123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-054308d2-788d-4868-a8fc-93bed5f088f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:11.764948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-054308d2-788d-4868-a8fc-93bed5f088f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:11.765378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-054308d2-788d-4868-a8fc-93bed5f088f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:11.882552 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:49:11.883572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:49:11.884283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:49:11.884876 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:49:11.885432 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:49:11.888188 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:11.911739 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:11.913734 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:11.915041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:11.916273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:11.946993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Getting quotas for project 9fd8cc62d97c4953bab14a1ccb1a751a. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:49:11.954249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Getting quotas for user 750dca90c8b741aba52530a583e1ed81 and project 9fd8cc62d97c4953bab14a1ccb1a751a. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:49:12.000207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:49:12.007009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:49:12.157252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-054308d2-788d-4868-a8fc-93bed5f088f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:12.160580 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-14bf5faf-dabb-4631-a6e2-6b49305eddc1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 5.473815 Jul 28 03:49:12.171240 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-054308d2-788d-4868-a8fc-93bed5f088f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 200 len: 1509 microversion: 2.1 time: 0.447271 Jul 28 03:49:12.171450 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1284/2876] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:49:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 5485 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:49:12.176431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ad78b59a-7381-4e1c-94fa-0e5dee642b52 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:12.187219 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1593/2877] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:11 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 1509 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:12.191149 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ad78b59a-7381-4e1c-94fa-0e5dee642b52 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:12.197669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-70adb1d5-91f2-4b29-8ee4-5ff9d77f0ec4 req-e48bc0e4-54fe-4372-87e0-4197c11b4b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a708e336-67ea-42c9-9d6d-8f77b8b67e7a", "name": "network-vif-plugged", "status": "completed", "tag": "71bfcf7a-bfbe-4642-8ceb-23481c7dd9ae"}, {"server_uuid": "a708e336-67ea-42c9-9d6d-8f77b8b67e7a", "name": "network-vif-plugged", "status": "completed", "tag": "5915ad92-8743-4e27-9bba-e7865a64aa58"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:12.211319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-70adb1d5-91f2-4b29-8ee4-5ff9d77f0ec4 req-e48bc0e4-54fe-4372-87e0-4197c11b4b44 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:12.212385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-70adb1d5-91f2-4b29-8ee4-5ff9d77f0ec4 req-e48bc0e4-54fe-4372-87e0-4197c11b4b44 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:12.232902 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-70adb1d5-91f2-4b29-8ee4-5ff9d77f0ec4 req-e48bc0e4-54fe-4372-87e0-4197c11b4b44 service nova] Creating event network-vif-plugged:71bfcf7a-bfbe-4642-8ceb-23481c7dd9ae for instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a on n-h2-826756-3 Jul 28 03:49:12.233949 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-70adb1d5-91f2-4b29-8ee4-5ff9d77f0ec4 req-e48bc0e4-54fe-4372-87e0-4197c11b4b44 service nova] Creating event network-vif-plugged:5915ad92-8743-4e27-9bba-e7865a64aa58 for instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a on n-h2-826756-3 Jul 28 03:49:12.241041 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-70adb1d5-91f2-4b29-8ee4-5ff9d77f0ec4 req-e48bc0e4-54fe-4372-87e0-4197c11b4b44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052003 Jul 28 03:49:12.242489 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1594/2878] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:12.248814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad78b59a-7381-4e1c-94fa-0e5dee642b52 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:12.249258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad78b59a-7381-4e1c-94fa-0e5dee642b52 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:12.250249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad78b59a-7381-4e1c-94fa-0e5dee642b52 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:12.251006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ad78b59a-7381-4e1c-94fa-0e5dee642b52 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:12.257365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fe341741-7033-4586-9cf8-2138f0340ea6 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:12.261103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fe341741-7033-4586-9cf8-2138f0340ea6 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:12.381481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fe341741-7033-4586-9cf8-2138f0340ea6 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:12.403283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fe341741-7033-4586-9cf8-2138f0340ea6 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:12.405289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fe341741-7033-4586-9cf8-2138f0340ea6 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:12.406245 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fe341741-7033-4586-9cf8-2138f0340ea6 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1259 microversion: 2.21 time: 0.162395 Jul 28 03:49:12.406828 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1595/2879] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:12 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:12.432390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9bf6a0c-96c2-47ce-8824-7f99a410769c tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:12.439092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9bf6a0c-96c2-47ce-8824-7f99a410769c tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:12.453967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9bf6a0c-96c2-47ce-8824-7f99a410769c tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:12.456978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9bf6a0c-96c2-47ce-8824-7f99a410769c tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:12.462110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9bf6a0c-96c2-47ce-8824-7f99a410769c tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:12.463493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9bf6a0c-96c2-47ce-8824-7f99a410769c tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:13.723534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b9bf6a0c-96c2-47ce-8824-7f99a410769c tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:13.736867 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9bf6a0c-96c2-47ce-8824-7f99a410769c tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 1.311973 Jul 28 03:49:13.738884 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1596/2880] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:12 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:13.746017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f6f34281-726b-498d-9a9c-ef4015610101 req-77d613ac-6e80-439f-871f-f95730604db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df82d7cd-a14e-41f7-8d5b-59e62a9a4352", "name": "network-vif-deleted", "tag": "17276987-87af-4329-abc8-eda36f9496ad"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:13.769904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f6f34281-726b-498d-9a9c-ef4015610101 req-77d613ac-6e80-439f-871f-f95730604db7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:13.770863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f6f34281-726b-498d-9a9c-ef4015610101 req-77d613ac-6e80-439f-871f-f95730604db7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:13.805512 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f6f34281-726b-498d-9a9c-ef4015610101 req-77d613ac-6e80-439f-871f-f95730604db7 service nova] Creating event network-vif-deleted:17276987-87af-4329-abc8-eda36f9496ad for instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 on n-h1-826756-3 Jul 28 03:49:13.814107 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f6f34281-726b-498d-9a9c-ef4015610101 req-77d613ac-6e80-439f-871f-f95730604db7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073009 Jul 28 03:49:13.815744 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1597/2881] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:13.827718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-30b6cbdf-e0fe-4d91-b9a0-c7e7067b3a15 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:13.829988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-30b6cbdf-e0fe-4d91-b9a0-c7e7067b3a15 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:13.844997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30b6cbdf-e0fe-4d91-b9a0-c7e7067b3a15 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:13.845984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30b6cbdf-e0fe-4d91-b9a0-c7e7067b3a15 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:13.847086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30b6cbdf-e0fe-4d91-b9a0-c7e7067b3a15 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:13.847901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30b6cbdf-e0fe-4d91-b9a0-c7e7067b3a15 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:14.037652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ad78b59a-7381-4e1c-94fa-0e5dee642b52 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:14.042144 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ad78b59a-7381-4e1c-94fa-0e5dee642b52 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1366 microversion: 2.1 time: 1.869601 Jul 28 03:49:14.049057 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1285/2882] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:12 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1366 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:14.073070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ceda0bf7-5d43-4ed6-8529-45ab9f9c306d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:14.077251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ceda0bf7-5d43-4ed6-8529-45ab9f9c306d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:14.099830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ceda0bf7-5d43-4ed6-8529-45ab9f9c306d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:14.103834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ceda0bf7-5d43-4ed6-8529-45ab9f9c306d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:14.105661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ceda0bf7-5d43-4ed6-8529-45ab9f9c306d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:14.106373 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ceda0bf7-5d43-4ed6-8529-45ab9f9c306d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:14.147387 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-ceda0bf7-5d43-4ed6-8529-45ab9f9c306d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ceda0bf7-5d43-4ed6-8529-45ab9f9c306d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 HTTP/1.1 Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'df82d7cd-a14e-41f7-8d5b-59e62a9a4352'} Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:49:14.151658 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:14.156637 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:14.156637 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:49:14.156637 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:49:14.156637 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:49:14.156637 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:49:14.156637 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:49:14.156637 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:14.160536 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ceda0bf7-5d43-4ed6-8529-45ab9f9c306d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:49:14.177086 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ceda0bf7-5d43-4ed6-8529-45ab9f9c306d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 404 len: 111 microversion: 2.1 time: 0.125696 Jul 28 03:49:14.177932 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1286/2883] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:14 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:49:14.198785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fac6424a-d20e-4789-8b35-a8ac6e80da18 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:14.200114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fac6424a-d20e-4789-8b35-a8ac6e80da18 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:14.224168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fac6424a-d20e-4789-8b35-a8ac6e80da18 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:14.226453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fac6424a-d20e-4789-8b35-a8ac6e80da18 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:14.232139 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fac6424a-d20e-4789-8b35-a8ac6e80da18 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:14.243985 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fac6424a-d20e-4789-8b35-a8ac6e80da18 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:14.267739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-30b6cbdf-e0fe-4d91-b9a0-c7e7067b3a15 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:14.271254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:14.296090 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-30b6cbdf-e0fe-4d91-b9a0-c7e7067b3a15 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1378 microversion: 2.1 time: 0.473339 Jul 28 03:49:14.299138 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1598/2884] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:13 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1378 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:14.519925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2068728212", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "c540e59d-0550-4ece-8b64-1987a84fa206"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:14.558354 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fac6424a-d20e-4789-8b35-a8ac6e80da18 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:14.583748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fac6424a-d20e-4789-8b35-a8ac6e80da18 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:14.592660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fac6424a-d20e-4789-8b35-a8ac6e80da18 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:14.595313 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fac6424a-d20e-4789-8b35-a8ac6e80da18 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1319 microversion: 2.21 time: 0.410881 Jul 28 03:49:14.599111 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1287/2885] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:14 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:14.666044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] validate_networks() for [('c540e59d-0550-4ece-8b64-1987a84fa206', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:49:14.759523 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-40370e84-11a5-439f-b19e-6643774d8d83 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:14.760537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-40370e84-11a5-439f-b19e-6643774d8d83 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:14.776943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40370e84-11a5-439f-b19e-6643774d8d83 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:14.776943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40370e84-11a5-439f-b19e-6643774d8d83 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:14.776943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40370e84-11a5-439f-b19e-6643774d8d83 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:14.779043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40370e84-11a5-439f-b19e-6643774d8d83 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:15.765938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:49:15.766940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:49:15.767737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:49:15.768475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:49:15.769755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:49:15.787321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:15.788832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:15.790748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:15.791575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:15.818807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:15.847702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Getting quotas for project 34ed8cbcca694b8794992388d95bf072. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:49:15.875942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Getting quotas for user 67fcd8c3ec5441e582a4852f0f1184b6 and project 34ed8cbcca694b8794992388d95bf072. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:49:15.909518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-40370e84-11a5-439f-b19e-6643774d8d83 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:15.924091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:49:15.931553 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-40370e84-11a5-439f-b19e-6643774d8d83 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1354 microversion: 2.1 time: 1.176428 Jul 28 03:49:15.932404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:49:15.947138 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1288/2886] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:14 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1354 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:15.990020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-aa07824b-f138-421a-a57f-acc74381c9ed req-ecfb0d5f-91a5-4d08-b894-e87fb564bbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed99415-e36a-431c-a33c-c609912af752", "name": "network-vif-plugged", "status": "completed", "tag": "fe3c986d-7298-4555-ba29-5e1b4c7e6981"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:16.065257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-aa07824b-f138-421a-a57f-acc74381c9ed req-ecfb0d5f-91a5-4d08-b894-e87fb564bbd3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:16.066270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-aa07824b-f138-421a-a57f-acc74381c9ed req-ecfb0d5f-91a5-4d08-b894-e87fb564bbd3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:16.115640 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-aa07824b-f138-421a-a57f-acc74381c9ed req-ecfb0d5f-91a5-4d08-b894-e87fb564bbd3 service nova] Creating event network-vif-plugged:fe3c986d-7298-4555-ba29-5e1b4c7e6981 for instance bed99415-e36a-431c-a33c-c609912af752 on n-h1-826756-3 Jul 28 03:49:16.144892 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-aa07824b-f138-421a-a57f-acc74381c9ed req-ecfb0d5f-91a5-4d08-b894-e87fb564bbd3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187365 Jul 28 03:49:16.148855 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1289/2887] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:16.162964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3b235501-8d2d-4c0c-a526-c6bd4ad7b599 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:16.164175 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3b235501-8d2d-4c0c-a526-c6bd4ad7b599 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:16.168450 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-81ad73cd-4a00-40d9-881f-2b204feb5861 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.654852 Jul 28 03:49:16.173466 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1599/2888] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:49:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:49:16.183865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d190d1f7-6dcd-480c-be67-b880298e8345 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:16.184429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b235501-8d2d-4c0c-a526-c6bd4ad7b599 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:16.185637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b235501-8d2d-4c0c-a526-c6bd4ad7b599 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:16.186704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b235501-8d2d-4c0c-a526-c6bd4ad7b599 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:16.187292 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b235501-8d2d-4c0c-a526-c6bd4ad7b599 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:16.188201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d190d1f7-6dcd-480c-be67-b880298e8345 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:16.208769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d190d1f7-6dcd-480c-be67-b880298e8345 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:16.210881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d190d1f7-6dcd-480c-be67-b880298e8345 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:16.212234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d190d1f7-6dcd-480c-be67-b880298e8345 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:16.213956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d190d1f7-6dcd-480c-be67-b880298e8345 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:16.901815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d190d1f7-6dcd-480c-be67-b880298e8345 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:16.910942 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d190d1f7-6dcd-480c-be67-b880298e8345 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1378 microversion: 2.1 time: 0.735137 Jul 28 03:49:16.932170 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1600/2889] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:16 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1378 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:16.946048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43cc3964-5bd3-431d-8a6d-3bf9c287664a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:16.947094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-43cc3964-5bd3-431d-8a6d-3bf9c287664a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:16.968558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43cc3964-5bd3-431d-8a6d-3bf9c287664a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:16.969474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43cc3964-5bd3-431d-8a6d-3bf9c287664a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:16.971202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43cc3964-5bd3-431d-8a6d-3bf9c287664a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:16.972016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43cc3964-5bd3-431d-8a6d-3bf9c287664a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:17.048008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3b235501-8d2d-4c0c-a526-c6bd4ad7b599 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:17.066876 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3b235501-8d2d-4c0c-a526-c6bd4ad7b599 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1366 microversion: 2.1 time: 0.916493 Jul 28 03:49:17.067550 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1290/2890] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:16 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1366 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:17.087922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ccde67df-e610-4be1-a249-79f488942dd0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:17.097499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ccde67df-e610-4be1-a249-79f488942dd0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:17.177289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-43cc3964-5bd3-431d-8a6d-3bf9c287664a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:17.189741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-43cc3964-5bd3-431d-8a6d-3bf9c287664a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:17.191198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-43cc3964-5bd3-431d-8a6d-3bf9c287664a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:17.201549 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43cc3964-5bd3-431d-8a6d-3bf9c287664a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1317 microversion: 2.21 time: 0.258906 Jul 28 03:49:17.203462 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1601/2891] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:16 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:17.231928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7dd74ee5-e7bb-4aa8-b420-e05395605785 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:17.235526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7dd74ee5-e7bb-4aa8-b420-e05395605785 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:17.254602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ccde67df-e610-4be1-a249-79f488942dd0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:17.258328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=23 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:17.273787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7dd74ee5-e7bb-4aa8-b420-e05395605785 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:17.277913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7dd74ee5-e7bb-4aa8-b420-e05395605785 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:17.282430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7dd74ee5-e7bb-4aa8-b420-e05395605785 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:17.284472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7dd74ee5-e7bb-4aa8-b420-e05395605785 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:17.284681 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ccde67df-e610-4be1-a249-79f488942dd0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1215 microversion: 2.1 time: 0.202056 Jul 28 03:49:17.289545 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1291/2892] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:17 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1215 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:17.627829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7dd74ee5-e7bb-4aa8-b420-e05395605785 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:17.656808 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7dd74ee5-e7bb-4aa8-b420-e05395605785 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1804 microversion: 2.1 time: 0.447364 Jul 28 03:49:17.659291 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1602/2893] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:17 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1804 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:17.686649 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4fe3a63b-7a46-433d-b7d5-c3134e1a84b0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:17.687697 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4fe3a63b-7a46-433d-b7d5-c3134e1a84b0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:17.698412 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4fe3a63b-7a46-433d-b7d5-c3134e1a84b0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:17.699418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4fe3a63b-7a46-433d-b7d5-c3134e1a84b0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:17.700944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4fe3a63b-7a46-433d-b7d5-c3134e1a84b0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:17.701525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4fe3a63b-7a46-433d-b7d5-c3134e1a84b0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:17.747140 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4fe3a63b-7a46-433d-b7d5-c3134e1a84b0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a/ips" status: 200 len: 218 microversion: 2.1 time: 0.066004 Jul 28 03:49:17.762115 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1292/2894] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:49:17 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a/ips => generated 218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:17.785387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-71d1e7c6-897f-473c-80b2-e03eea567607 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:17.786204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-71d1e7c6-897f-473c-80b2-e03eea567607 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:17.798807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71d1e7c6-897f-473c-80b2-e03eea567607 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:17.799532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71d1e7c6-897f-473c-80b2-e03eea567607 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:17.800518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71d1e7c6-897f-473c-80b2-e03eea567607 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:17.800958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71d1e7c6-897f-473c-80b2-e03eea567607 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:17.854858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-71d1e7c6-897f-473c-80b2-e03eea567607 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:49:17.958736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5b44046d-9787-47a0-95a9-6b59a3f82914 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:17.959668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5b44046d-9787-47a0-95a9-6b59a3f82914 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:17.984770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b44046d-9787-47a0-95a9-6b59a3f82914 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:17.985353 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b44046d-9787-47a0-95a9-6b59a3f82914 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:17.992324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b44046d-9787-47a0-95a9-6b59a3f82914 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:17.993097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b44046d-9787-47a0-95a9-6b59a3f82914 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:18.127743 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-71d1e7c6-897f-473c-80b2-e03eea567607 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 204 len: 0 microversion: 2.1 time: 0.362407 Jul 28 03:49:18.129685 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1603/2895] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:49:17 2022] DELETE /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:49:18.163019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a132be67-a33c-4b43-9ae9-67142cf5ce75 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:18.168841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a132be67-a33c-4b43-9ae9-67142cf5ce75 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:18.193092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a132be67-a33c-4b43-9ae9-67142cf5ce75 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:18.197187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a132be67-a33c-4b43-9ae9-67142cf5ce75 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:18.204212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a132be67-a33c-4b43-9ae9-67142cf5ce75 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:18.206163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a132be67-a33c-4b43-9ae9-67142cf5ce75 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:18.566599 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5b44046d-9787-47a0-95a9-6b59a3f82914 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:18.586183 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5b44046d-9787-47a0-95a9-6b59a3f82914 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1378 microversion: 2.1 time: 0.632698 Jul 28 03:49:18.588614 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1293/2896] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:17 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1378 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:18.600838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-121922e7-2886-4ee8-9644-14e32536fd11 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:18.605102 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-121922e7-2886-4ee8-9644-14e32536fd11 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:18.626210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-121922e7-2886-4ee8-9644-14e32536fd11 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:18.626666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-121922e7-2886-4ee8-9644-14e32536fd11 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:18.633068 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-121922e7-2886-4ee8-9644-14e32536fd11 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:18.633733 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-121922e7-2886-4ee8-9644-14e32536fd11 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:18.810406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a132be67-a33c-4b43-9ae9-67142cf5ce75 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:18.829618 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a132be67-a33c-4b43-9ae9-67142cf5ce75 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1366 microversion: 2.1 time: 0.690658 Jul 28 03:49:18.848198 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1604/2897] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:18 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1366 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:18.852384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-297f0b04-8897-455d-b513-dc5929295ec1 req-d4f40f92-92f5-429e-b5ec-de88c163bfc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a314625b-adb1-45fa-9483-b084005a11b6", "name": "network-vif-plugged", "status": "completed", "tag": "64ff1826-6714-4cbc-a27d-442eaec6ddd7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:18.890860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-297f0b04-8897-455d-b513-dc5929295ec1 req-d4f40f92-92f5-429e-b5ec-de88c163bfc2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:18.892264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-297f0b04-8897-455d-b513-dc5929295ec1 req-d4f40f92-92f5-429e-b5ec-de88c163bfc2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:18.941918 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-297f0b04-8897-455d-b513-dc5929295ec1 req-d4f40f92-92f5-429e-b5ec-de88c163bfc2 service nova] Creating event network-vif-plugged:64ff1826-6714-4cbc-a27d-442eaec6ddd7 for instance a314625b-adb1-45fa-9483-b084005a11b6 on n-h2-826756-3 Jul 28 03:49:18.952332 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-297f0b04-8897-455d-b513-dc5929295ec1 req-d4f40f92-92f5-429e-b5ec-de88c163bfc2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114583 Jul 28 03:49:18.957631 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1605/2898] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:18.975672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-61579f6f-1994-4f9d-b992-c9af114f51f7 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:18.976404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61579f6f-1994-4f9d-b992-c9af114f51f7 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:18.999148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61579f6f-1994-4f9d-b992-c9af114f51f7 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:19.002958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61579f6f-1994-4f9d-b992-c9af114f51f7 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:19.006617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61579f6f-1994-4f9d-b992-c9af114f51f7 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:19.007248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61579f6f-1994-4f9d-b992-c9af114f51f7 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:19.262909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-61579f6f-1994-4f9d-b992-c9af114f51f7 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:19.272843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-61579f6f-1994-4f9d-b992-c9af114f51f7 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:19.274734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-61579f6f-1994-4f9d-b992-c9af114f51f7 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:19.275980 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-61579f6f-1994-4f9d-b992-c9af114f51f7 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1359 microversion: 2.21 time: 0.314433 Jul 28 03:49:19.277525 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1606/2899] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:18 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1359 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:19.303212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70d693b3-7477-4c7e-ab4b-db53d337464b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:19.309012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-70d693b3-7477-4c7e-ab4b-db53d337464b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:19.327497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70d693b3-7477-4c7e-ab4b-db53d337464b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:19.327957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70d693b3-7477-4c7e-ab4b-db53d337464b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:19.328817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70d693b3-7477-4c7e-ab4b-db53d337464b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:19.329262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70d693b3-7477-4c7e-ab4b-db53d337464b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:19.484607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-70d693b3-7477-4c7e-ab4b-db53d337464b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:19.507667 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-70d693b3-7477-4c7e-ab4b-db53d337464b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1273 microversion: 2.1 time: 0.205587 Jul 28 03:49:19.511427 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1607/2900] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:19 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1273 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:19.614721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-121922e7-2886-4ee8-9644-14e32536fd11 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:19.625779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8516b552-1001-41e2-8126-9dc7c34d7d19 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:19.627420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8516b552-1001-41e2-8126-9dc7c34d7d19 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:19.643081 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-121922e7-2886-4ee8-9644-14e32536fd11 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1810 microversion: 2.1 time: 1.053446 Jul 28 03:49:19.645249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8516b552-1001-41e2-8126-9dc7c34d7d19 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:19.645921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8516b552-1001-41e2-8126-9dc7c34d7d19 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:19.647249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8516b552-1001-41e2-8126-9dc7c34d7d19 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:19.648239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8516b552-1001-41e2-8126-9dc7c34d7d19 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:19.650995 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1294/2901] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:18 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1810 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:19.863052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-71ad12b0-1243-405a-94d6-1676c211c969 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:19.864779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-71ad12b0-1243-405a-94d6-1676c211c969 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:19.898634 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-71ad12b0-1243-405a-94d6-1676c211c969 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:19.899383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-71ad12b0-1243-405a-94d6-1676c211c969 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:19.905452 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-71ad12b0-1243-405a-94d6-1676c211c969 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:19.909688 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-71ad12b0-1243-405a-94d6-1676c211c969 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:20.065017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8516b552-1001-41e2-8126-9dc7c34d7d19 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:20.077158 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8516b552-1001-41e2-8126-9dc7c34d7d19 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1528 microversion: 2.1 time: 0.466187 Jul 28 03:49:20.094894 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1608/2902] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:19 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1528 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:20.104536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d056af8f-cc62-433d-bcc5-b17469798462 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:20.105568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d056af8f-cc62-433d-bcc5-b17469798462 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:20.120927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d056af8f-cc62-433d-bcc5-b17469798462 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:20.121792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d056af8f-cc62-433d-bcc5-b17469798462 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:20.122817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d056af8f-cc62-433d-bcc5-b17469798462 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:20.123573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d056af8f-cc62-433d-bcc5-b17469798462 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:20.348176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d056af8f-cc62-433d-bcc5-b17469798462 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:20.369844 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d056af8f-cc62-433d-bcc5-b17469798462 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1528 microversion: 2.1 time: 0.271970 Jul 28 03:49:20.371259 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1609/2903] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:20 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1528 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:20.405315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f5ee81a-3674-435e-8797-81e75bea0b60 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:20.405951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f5ee81a-3674-435e-8797-81e75bea0b60 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:20.428716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f5ee81a-3674-435e-8797-81e75bea0b60 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:20.429174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f5ee81a-3674-435e-8797-81e75bea0b60 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:20.429986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f5ee81a-3674-435e-8797-81e75bea0b60 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:20.430427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f5ee81a-3674-435e-8797-81e75bea0b60 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:20.595940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-71ad12b0-1243-405a-94d6-1676c211c969 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:20.608905 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-71ad12b0-1243-405a-94d6-1676c211c969 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1366 microversion: 2.1 time: 0.755085 Jul 28 03:49:20.631755 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1295/2904] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:19 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1366 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:20.645204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-41fd0526-b04c-4301-8762-bbd28b310044 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:20.646832 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:49:20.646832 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:49:20.690046 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-41fd0526-b04c-4301-8762-bbd28b310044 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/25b236a5-6057-4b96-be4b-132cf93d1f91" status: 202 len: 0 microversion: 2.1 time: 0.053741 Jul 28 03:49:20.690890 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1296/2905] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:49:20 2022] DELETE /compute/v2.1/flavors/25b236a5-6057-4b96-be4b-132cf93d1f91 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:49:20.698061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-59398c2d-b831-43c3-ae4c-15e24c479c26 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:20.699358 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-59398c2d-b831-43c3-ae4c-15e24c479c26 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:20.728770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59398c2d-b831-43c3-ae4c-15e24c479c26 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:20.730971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59398c2d-b831-43c3-ae4c-15e24c479c26 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:20.734312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59398c2d-b831-43c3-ae4c-15e24c479c26 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:20.735187 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59398c2d-b831-43c3-ae4c-15e24c479c26 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:20.768231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f5ee81a-3674-435e-8797-81e75bea0b60 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:20.802967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f5ee81a-3674-435e-8797-81e75bea0b60 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:20.809445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f5ee81a-3674-435e-8797-81e75bea0b60 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:20.812297 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f5ee81a-3674-435e-8797-81e75bea0b60 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1359 microversion: 2.21 time: 0.433000 Jul 28 03:49:20.813521 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1610/2906] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:20 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1359 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:20.819281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ee57e55-eac7-41c1-a232-ddbf7caca72d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:20.820259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ee57e55-eac7-41c1-a232-ddbf7caca72d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:20.838389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ee57e55-eac7-41c1-a232-ddbf7caca72d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:20.841011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ee57e55-eac7-41c1-a232-ddbf7caca72d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:20.843141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ee57e55-eac7-41c1-a232-ddbf7caca72d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:20.843141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ee57e55-eac7-41c1-a232-ddbf7caca72d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:21.150029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ee57e55-eac7-41c1-a232-ddbf7caca72d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:21.160638 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ee57e55-eac7-41c1-a232-ddbf7caca72d tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1810 microversion: 2.1 time: 0.345071 Jul 28 03:49:21.161390 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1611/2907] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:20 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1810 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:21.183550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2aa64aa2-0bf5-4bed-87e0-071ba6cd70f6 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:21.224375 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2aa64aa2-0bf5-4bed-87e0-071ba6cd70f6 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061370 Jul 28 03:49:21.226322 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1612/2908] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:49:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:21.250467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f78d68d2-0fa0-49d2-b367-4f4f78d43bc3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:21.253425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f78d68d2-0fa0-49d2-b367-4f4f78d43bc3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:21.272000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78d68d2-0fa0-49d2-b367-4f4f78d43bc3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:21.277282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78d68d2-0fa0-49d2-b367-4f4f78d43bc3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:21.278812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78d68d2-0fa0-49d2-b367-4f4f78d43bc3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:21.279523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78d68d2-0fa0-49d2-b367-4f4f78d43bc3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:21.335253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f78d68d2-0fa0-49d2-b367-4f4f78d43bc3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:21.361083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f78d68d2-0fa0-49d2-b367-4f4f78d43bc3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Old instance type tempest-test_resize_flavor_-1468240912, new instance type m1.heat {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 03:49:21.374287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f78d68d2-0fa0-49d2-b367-4f4f78d43bc3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:49:21.374756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f78d68d2-0fa0-49d2-b367-4f4f78d43bc3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:49:21.375617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f78d68d2-0fa0-49d2-b367-4f4f78d43bc3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:49:21.377670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f78d68d2-0fa0-49d2-b367-4f4f78d43bc3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:49:21.377670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f78d68d2-0fa0-49d2-b367-4f4f78d43bc3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:49:21.403151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-59398c2d-b831-43c3-ae4c-15e24c479c26 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:21.417295 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-59398c2d-b831-43c3-ae4c-15e24c479c26 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1315 microversion: 2.1 time: 0.724974 Jul 28 03:49:21.419282 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1297/2909] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:20 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:21.505775 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f78d68d2-0fa0-49d2-b367-4f4f78d43bc3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "POST /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752/action" status: 202 len: 0 microversion: 2.1 time: 0.265524 Jul 28 03:49:21.506760 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1613/2910] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:49:21 2022] POST /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:49:21.515496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-db399cc0-3e19-4d57-ae89-549c4d5dc960 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:21.516184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-db399cc0-3e19-4d57-ae89-549c4d5dc960 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:21.534621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db399cc0-3e19-4d57-ae89-549c4d5dc960 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:21.541243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db399cc0-3e19-4d57-ae89-549c4d5dc960 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:21.546301 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db399cc0-3e19-4d57-ae89-549c4d5dc960 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:21.550103 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db399cc0-3e19-4d57-ae89-549c4d5dc960 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:21.631003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43c1ac9f-0ee8-4d33-976b-1037da9ac50c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:21.632737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-43c1ac9f-0ee8-4d33-976b-1037da9ac50c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:21.644061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43c1ac9f-0ee8-4d33-976b-1037da9ac50c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:21.645503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43c1ac9f-0ee8-4d33-976b-1037da9ac50c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:21.647306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43c1ac9f-0ee8-4d33-976b-1037da9ac50c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:21.648801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43c1ac9f-0ee8-4d33-976b-1037da9ac50c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:21.932726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:22.147775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-43c1ac9f-0ee8-4d33-976b-1037da9ac50c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:22.159215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:22.190769 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43c1ac9f-0ee8-4d33-976b-1037da9ac50c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1366 microversion: 2.1 time: 0.564445 Jul 28 03:49:22.192296 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1614/2911] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:21 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1366 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:22.259364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-235a7dff-293d-4638-8730-720da374b8aa tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:22.264239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-235a7dff-293d-4638-8730-720da374b8aa tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:22.277726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-235a7dff-293d-4638-8730-720da374b8aa tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:22.278533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-235a7dff-293d-4638-8730-720da374b8aa tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:22.280110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-235a7dff-293d-4638-8730-720da374b8aa tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:22.280798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-235a7dff-293d-4638-8730-720da374b8aa tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:22.528198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-235a7dff-293d-4638-8730-720da374b8aa tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:22.557354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-235a7dff-293d-4638-8730-720da374b8aa tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:22.559153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-235a7dff-293d-4638-8730-720da374b8aa tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:22.575955 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-235a7dff-293d-4638-8730-720da374b8aa tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1359 microversion: 2.21 time: 0.364932 Jul 28 03:49:22.576991 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1615/2912] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:22 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1359 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:22.591408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fcf0e40f-6c5e-4025-a3c3-2c8f9a2949e8 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:22.592224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fcf0e40f-6c5e-4025-a3c3-2c8f9a2949e8 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:22.608891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcf0e40f-6c5e-4025-a3c3-2c8f9a2949e8 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:22.609363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcf0e40f-6c5e-4025-a3c3-2c8f9a2949e8 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:22.610191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcf0e40f-6c5e-4025-a3c3-2c8f9a2949e8 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:22.610635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcf0e40f-6c5e-4025-a3c3-2c8f9a2949e8 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:22.863021 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-db399cc0-3e19-4d57-ae89-549c4d5dc960 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:22.874712 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-db399cc0-3e19-4d57-ae89-549c4d5dc960 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1537 microversion: 2.1 time: 1.363594 Jul 28 03:49:22.882530 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1298/2913] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:21 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1537 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:22.889040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c4648a53-8ba7-483f-a365-f49d550c6f70 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:22.895097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c4648a53-8ba7-483f-a365-f49d550c6f70 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:22.917595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4648a53-8ba7-483f-a365-f49d550c6f70 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:22.918234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4648a53-8ba7-483f-a365-f49d550c6f70 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:22.920913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4648a53-8ba7-483f-a365-f49d550c6f70 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:22.929803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c4648a53-8ba7-483f-a365-f49d550c6f70 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:22.960339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:23.407672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fcf0e40f-6c5e-4025-a3c3-2c8f9a2949e8 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:23.422960 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fcf0e40f-6c5e-4025-a3c3-2c8f9a2949e8 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1810 microversion: 2.1 time: 0.841171 Jul 28 03:49:23.425001 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1616/2914] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:22 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1810 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:23.461246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6a655643-1dfb-4546-90bf-ab2e821e48f0 req-20d48ec7-84b5-4580-9f5e-bef82506f2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ed1f699-679f-49f8-b652-f2d476d3be28", "tag": "fc3835af-4c27-44e3-be2b-f09de6fbd1f5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:23.492652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c4648a53-8ba7-483f-a365-f49d550c6f70 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:23.493167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6a655643-1dfb-4546-90bf-ab2e821e48f0 req-20d48ec7-84b5-4580-9f5e-bef82506f2b8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:23.493799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6a655643-1dfb-4546-90bf-ab2e821e48f0 req-20d48ec7-84b5-4580-9f5e-bef82506f2b8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:23.502013 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c4648a53-8ba7-483f-a365-f49d550c6f70 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1315 microversion: 2.1 time: 0.617611 Jul 28 03:49:23.510428 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1299/2915] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:22 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1315 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:23.516961 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7c21caae-4f90-4788-ada7-f72ccd910be0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:23.526129 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7c21caae-4f90-4788-ada7-f72ccd910be0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:23.530712 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6a655643-1dfb-4546-90bf-ab2e821e48f0 req-20d48ec7-84b5-4580-9f5e-bef82506f2b8 service nova] Creating event network-changed:fc3835af-4c27-44e3-be2b-f09de6fbd1f5 for instance 2ed1f699-679f-49f8-b652-f2d476d3be28 on n-h1-826756-3 Jul 28 03:49:23.542966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c21caae-4f90-4788-ada7-f72ccd910be0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:23.544510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c21caae-4f90-4788-ada7-f72ccd910be0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:23.548088 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c21caae-4f90-4788-ada7-f72ccd910be0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:23.550516 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6a655643-1dfb-4546-90bf-ab2e821e48f0 req-20d48ec7-84b5-4580-9f5e-bef82506f2b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098098 Jul 28 03:49:23.550852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c21caae-4f90-4788-ada7-f72ccd910be0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:23.553547 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1617/2916] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:23.602562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e87f9336-6322-4f72-9535-692b3e9864d1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:23.603270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e87f9336-6322-4f72-9535-692b3e9864d1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:23.624500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e87f9336-6322-4f72-9535-692b3e9864d1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:23.624991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e87f9336-6322-4f72-9535-692b3e9864d1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:23.625805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e87f9336-6322-4f72-9535-692b3e9864d1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:23.626252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e87f9336-6322-4f72-9535-692b3e9864d1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:24.088037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e87f9336-6322-4f72-9535-692b3e9864d1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:24.102904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e87f9336-6322-4f72-9535-692b3e9864d1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:24.104787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e87f9336-6322-4f72-9535-692b3e9864d1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:24.108393 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e87f9336-6322-4f72-9535-692b3e9864d1 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1359 microversion: 2.21 time: 0.510086 Jul 28 03:49:24.112399 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1618/2917] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:23 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1359 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:24.123825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b46caebb-1e97-4008-94ca-8c3622561c72 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:24.128735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b46caebb-1e97-4008-94ca-8c3622561c72 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:24.143277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b46caebb-1e97-4008-94ca-8c3622561c72 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:24.147931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b46caebb-1e97-4008-94ca-8c3622561c72 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:24.149198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b46caebb-1e97-4008-94ca-8c3622561c72 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:24.149999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b46caebb-1e97-4008-94ca-8c3622561c72 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:24.206272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7c21caae-4f90-4788-ada7-f72ccd910be0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:24.218170 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7c21caae-4f90-4788-ada7-f72ccd910be0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1554 microversion: 2.1 time: 0.705815 Jul 28 03:49:24.224109 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1300/2918] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:23 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1554 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:24.242188 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-8f465bcc-c85a-455f-b869-fea7e079c29a req-189cd56e-254b-4c02-9091-60ae7fceffee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a708e336-67ea-42c9-9d6d-8f77b8b67e7a", "name": "network-vif-unplugged", "status": "completed", "tag": "f763a531-4acb-48d9-be72-22782928289c"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:24.278061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-8f465bcc-c85a-455f-b869-fea7e079c29a req-189cd56e-254b-4c02-9091-60ae7fceffee service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:24.290413 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-8f465bcc-c85a-455f-b869-fea7e079c29a req-189cd56e-254b-4c02-9091-60ae7fceffee service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:24.330008 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-8f465bcc-c85a-455f-b869-fea7e079c29a req-189cd56e-254b-4c02-9091-60ae7fceffee service nova] Creating event network-vif-unplugged:f763a531-4acb-48d9-be72-22782928289c for instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a on n-h2-826756-3 Jul 28 03:49:24.351856 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-8f465bcc-c85a-455f-b869-fea7e079c29a req-189cd56e-254b-4c02-9091-60ae7fceffee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122848 Jul 28 03:49:24.354680 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1301/2919] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:24.380757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a122be30-cc80-4d47-85e0-727c9b20b4b5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:24.381356 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a122be30-cc80-4d47-85e0-727c9b20b4b5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:24.408769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a122be30-cc80-4d47-85e0-727c9b20b4b5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:24.409228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a122be30-cc80-4d47-85e0-727c9b20b4b5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:24.410012 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a122be30-cc80-4d47-85e0-727c9b20b4b5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:24.410447 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a122be30-cc80-4d47-85e0-727c9b20b4b5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:24.615230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b46caebb-1e97-4008-94ca-8c3622561c72 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:24.625700 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b46caebb-1e97-4008-94ca-8c3622561c72 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1537 microversion: 2.1 time: 0.511873 Jul 28 03:49:24.637111 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1619/2920] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:24 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1537 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:24.644446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d971943c-b649-49a4-bb91-b54eccce94e5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:24.645592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d971943c-b649-49a4-bb91-b54eccce94e5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:24.667427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d971943c-b649-49a4-bb91-b54eccce94e5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:24.668591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d971943c-b649-49a4-bb91-b54eccce94e5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:24.670652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d971943c-b649-49a4-bb91-b54eccce94e5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:24.671260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d971943c-b649-49a4-bb91-b54eccce94e5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:24.833344 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a122be30-cc80-4d47-85e0-727c9b20b4b5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.475886 Jul 28 03:49:24.833951 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1302/2921] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:49:24 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-interface => generated 284 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:24.854892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b897b755-30a6-40f6-a560-823fae956974 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:24.855572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b897b755-30a6-40f6-a560-823fae956974 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:24.874422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b897b755-30a6-40f6-a560-823fae956974 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:24.874880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b897b755-30a6-40f6-a560-823fae956974 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:24.877904 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b897b755-30a6-40f6-a560-823fae956974 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:24.882179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b897b755-30a6-40f6-a560-823fae956974 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:25.479632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d971943c-b649-49a4-bb91-b54eccce94e5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:25.488870 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d971943c-b649-49a4-bb91-b54eccce94e5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1789 microversion: 2.1 time: 0.850126 Jul 28 03:49:25.490018 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1620/2922] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:24 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1789 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:25.496121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62210444-cdd2-48cc-b379-af0e942735ff tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:25.497318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-62210444-cdd2-48cc-b379-af0e942735ff tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:25.506974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62210444-cdd2-48cc-b379-af0e942735ff tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:25.508378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62210444-cdd2-48cc-b379-af0e942735ff tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:25.509491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62210444-cdd2-48cc-b379-af0e942735ff tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:25.510168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62210444-cdd2-48cc-b379-af0e942735ff tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:25.758055 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b897b755-30a6-40f6-a560-823fae956974 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:25.766171 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b897b755-30a6-40f6-a560-823fae956974 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1315 microversion: 2.1 time: 0.915202 Jul 28 03:49:25.770501 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1303/2923] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:24 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1315 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:25.784512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-6e9a2013-6646-4dde-8e2b-672bd88f2b22 req-825b20be-29f0-4e1e-8368-4cbb3edf64b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a708e336-67ea-42c9-9d6d-8f77b8b67e7a", "name": "network-vif-deleted", "tag": "5915ad92-8743-4e27-9bba-e7865a64aa58"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:25.805012 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-6e9a2013-6646-4dde-8e2b-672bd88f2b22 req-825b20be-29f0-4e1e-8368-4cbb3edf64b4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:25.805884 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-6e9a2013-6646-4dde-8e2b-672bd88f2b22 req-825b20be-29f0-4e1e-8368-4cbb3edf64b4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:25.835246 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-6e9a2013-6646-4dde-8e2b-672bd88f2b22 req-825b20be-29f0-4e1e-8368-4cbb3edf64b4 service nova] Creating event network-vif-deleted:5915ad92-8743-4e27-9bba-e7865a64aa58 for instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a on n-h2-826756-3 Jul 28 03:49:25.838675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:25.845259 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-6e9a2013-6646-4dde-8e2b-672bd88f2b22 req-825b20be-29f0-4e1e-8368-4cbb3edf64b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072838 Jul 28 03:49:25.845725 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1304/2924] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:25.850931 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-466cfd28-b700-4cfd-844a-9f57f13a5061 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:25.851635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-466cfd28-b700-4cfd-844a-9f57f13a5061 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:25.858559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-466cfd28-b700-4cfd-844a-9f57f13a5061 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:25.859008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-466cfd28-b700-4cfd-844a-9f57f13a5061 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:25.859796 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-466cfd28-b700-4cfd-844a-9f57f13a5061 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:25.860234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-466cfd28-b700-4cfd-844a-9f57f13a5061 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:25.900018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:26.071837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62210444-cdd2-48cc-b379-af0e942735ff tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:26.093767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62210444-cdd2-48cc-b379-af0e942735ff tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:26.120269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62210444-cdd2-48cc-b379-af0e942735ff tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:26.124577 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-62210444-cdd2-48cc-b379-af0e942735ff tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1359 microversion: 2.21 time: 0.632823 Jul 28 03:49:26.126464 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1621/2925] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:25 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1359 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:26.375847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-466cfd28-b700-4cfd-844a-9f57f13a5061 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:26.383510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-33be30c2-ba00-4d1c-9d0a-c0759fbf9388 req-e6f506ec-7485-45eb-8aac-08ffa848b960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a708e336-67ea-42c9-9d6d-8f77b8b67e7a", "name": "network-vif-unplugged", "status": "completed", "tag": "71bfcf7a-bfbe-4642-8ceb-23481c7dd9ae"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:26.387398 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-466cfd28-b700-4cfd-844a-9f57f13a5061 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1537 microversion: 2.1 time: 0.540454 Jul 28 03:49:26.390523 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1305/2926] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:25 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1537 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:26.397281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-33be30c2-ba00-4d1c-9d0a-c0759fbf9388 req-e6f506ec-7485-45eb-8aac-08ffa848b960 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:26.397943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-33be30c2-ba00-4d1c-9d0a-c0759fbf9388 req-e6f506ec-7485-45eb-8aac-08ffa848b960 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:26.434033 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-33be30c2-ba00-4d1c-9d0a-c0759fbf9388 req-e6f506ec-7485-45eb-8aac-08ffa848b960 service nova] Creating event network-vif-unplugged:71bfcf7a-bfbe-4642-8ceb-23481c7dd9ae for instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a on n-h2-826756-3 Jul 28 03:49:26.455837 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-33be30c2-ba00-4d1c-9d0a-c0759fbf9388 req-e6f506ec-7485-45eb-8aac-08ffa848b960 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076608 Jul 28 03:49:26.457416 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1622/2927] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:49:26.518729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d78aee55-2631-45d5-b824-730e4b55de34 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:26.519506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d78aee55-2631-45d5-b824-730e4b55de34 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:26.543848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d78aee55-2631-45d5-b824-730e4b55de34 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:26.545178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d78aee55-2631-45d5-b824-730e4b55de34 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:26.546303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d78aee55-2631-45d5-b824-730e4b55de34 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:26.546974 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d78aee55-2631-45d5-b824-730e4b55de34 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:26.793240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7e663b6c-5032-4a13-99ae-7915dc1dce1b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:26.796103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7e663b6c-5032-4a13-99ae-7915dc1dce1b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:26.817239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e663b6c-5032-4a13-99ae-7915dc1dce1b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:26.818007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e663b6c-5032-4a13-99ae-7915dc1dce1b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:26.818961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e663b6c-5032-4a13-99ae-7915dc1dce1b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:26.819844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e663b6c-5032-4a13-99ae-7915dc1dce1b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:27.283564 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:27.319248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7e663b6c-5032-4a13-99ae-7915dc1dce1b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:27.333198 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7e663b6c-5032-4a13-99ae-7915dc1dce1b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1315 microversion: 2.1 time: 0.549415 Jul 28 03:49:27.352116 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1623/2928] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:26 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1315 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:27.359322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce65da9b-ca80-4516-9557-203707303f3a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:27.361921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ce65da9b-ca80-4516-9557-203707303f3a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:27.377415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce65da9b-ca80-4516-9557-203707303f3a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:27.378708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce65da9b-ca80-4516-9557-203707303f3a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:27.379526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce65da9b-ca80-4516-9557-203707303f3a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:27.379967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce65da9b-ca80-4516-9557-203707303f3a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:27.771225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ce65da9b-ca80-4516-9557-203707303f3a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:27.782959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ce65da9b-ca80-4516-9557-203707303f3a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:27.785626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ce65da9b-ca80-4516-9557-203707303f3a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:27.787048 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce65da9b-ca80-4516-9557-203707303f3a tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1359 microversion: 2.21 time: 0.433503 Jul 28 03:49:27.788161 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1624/2929] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:27 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1359 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:27.794291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-460c942f-c31f-4255-a54c-bfebb9f91da3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:27.795232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-460c942f-c31f-4255-a54c-bfebb9f91da3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:27.803048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-460c942f-c31f-4255-a54c-bfebb9f91da3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:27.803876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-460c942f-c31f-4255-a54c-bfebb9f91da3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:27.805124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-460c942f-c31f-4255-a54c-bfebb9f91da3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:27.805777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-460c942f-c31f-4255-a54c-bfebb9f91da3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:28.099820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-460c942f-c31f-4255-a54c-bfebb9f91da3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:28.113993 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-460c942f-c31f-4255-a54c-bfebb9f91da3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1537 microversion: 2.1 time: 0.324294 Jul 28 03:49:28.124392 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1625/2930] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:27 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1537 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:28.131227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-263a08a9-3efd-4656-b5a8-680b469bf38b req-7bce6bd4-2a62-44d7-a48c-0c86e2463484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c47b71f0-424f-4b3b-ae6c-9f38a83a43e0", "tag": "c298f163-bf0d-4e1a-8620-2badd0279e63"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:28.139044 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d78aee55-2631-45d5-b824-730e4b55de34 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:28.141424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-263a08a9-3efd-4656-b5a8-680b469bf38b req-7bce6bd4-2a62-44d7-a48c-0c86e2463484 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:28.141873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-263a08a9-3efd-4656-b5a8-680b469bf38b req-7bce6bd4-2a62-44d7-a48c-0c86e2463484 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:28.162327 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d78aee55-2631-45d5-b824-730e4b55de34 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1675 microversion: 2.1 time: 1.653162 Jul 28 03:49:28.163235 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-263a08a9-3efd-4656-b5a8-680b469bf38b req-7bce6bd4-2a62-44d7-a48c-0c86e2463484 service nova] Creating event network-changed:c298f163-bf0d-4e1a-8620-2badd0279e63 for instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 on n-h1-826756-3 Jul 28 03:49:28.169182 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1306/2931] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:26 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1675 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:28.195477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-87576e11-55d1-4f82-a7d2-711c241e33b7 req-84138215-ec07-47db-82f7-21b3c2af8a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a314625b-adb1-45fa-9483-b084005a11b6", "tag": "64ff1826-6714-4cbc-a27d-442eaec6ddd7"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:28.206736 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-263a08a9-3efd-4656-b5a8-680b469bf38b req-7bce6bd4-2a62-44d7-a48c-0c86e2463484 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090222 Jul 28 03:49:28.207730 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1626/2932] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:28.246261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-87576e11-55d1-4f82-a7d2-711c241e33b7 req-84138215-ec07-47db-82f7-21b3c2af8a12 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:28.246719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-87576e11-55d1-4f82-a7d2-711c241e33b7 req-84138215-ec07-47db-82f7-21b3c2af8a12 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:28.281523 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-87576e11-55d1-4f82-a7d2-711c241e33b7 req-84138215-ec07-47db-82f7-21b3c2af8a12 service nova] Creating event network-changed:64ff1826-6714-4cbc-a27d-442eaec6ddd7 for instance a314625b-adb1-45fa-9483-b084005a11b6 on n-h2-826756-3 Jul 28 03:49:28.300402 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-87576e11-55d1-4f82-a7d2-711c241e33b7 req-84138215-ec07-47db-82f7-21b3c2af8a12 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129787 Jul 28 03:49:28.308098 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1307/2933] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:28.363046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ea77fd5-e885-4b49-a1c7-e5f0f966fc87 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:28.363996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ea77fd5-e885-4b49-a1c7-e5f0f966fc87 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:28.405681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ea77fd5-e885-4b49-a1c7-e5f0f966fc87 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:28.406470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ea77fd5-e885-4b49-a1c7-e5f0f966fc87 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:28.407856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ea77fd5-e885-4b49-a1c7-e5f0f966fc87 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:28.408668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ea77fd5-e885-4b49-a1c7-e5f0f966fc87 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:28.811069 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d8860a9c-69ac-4262-afc8-feed5f12c030 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:28.811782 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d8860a9c-69ac-4262-afc8-feed5f12c030 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:28.820512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8860a9c-69ac-4262-afc8-feed5f12c030 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:28.827518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8860a9c-69ac-4262-afc8-feed5f12c030 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:28.830844 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8860a9c-69ac-4262-afc8-feed5f12c030 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:28.832807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8860a9c-69ac-4262-afc8-feed5f12c030 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:29.249682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ea77fd5-e885-4b49-a1c7-e5f0f966fc87 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:29.262156 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ea77fd5-e885-4b49-a1c7-e5f0f966fc87 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1315 microversion: 2.1 time: 0.906773 Jul 28 03:49:29.264290 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1627/2934] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:28 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1315 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:29.280664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b38c380-0b29-48ba-9716-dd815e539cce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:29.282567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3b38c380-0b29-48ba-9716-dd815e539cce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:29.291377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b38c380-0b29-48ba-9716-dd815e539cce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:29.293423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b38c380-0b29-48ba-9716-dd815e539cce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:29.294995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b38c380-0b29-48ba-9716-dd815e539cce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:29.295661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b38c380-0b29-48ba-9716-dd815e539cce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:29.906222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d8860a9c-69ac-4262-afc8-feed5f12c030 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:29.921672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d8860a9c-69ac-4262-afc8-feed5f12c030 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:29.927458 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d8860a9c-69ac-4262-afc8-feed5f12c030 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:29.931178 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d8860a9c-69ac-4262-afc8-feed5f12c030 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1359 microversion: 2.21 time: 1.124827 Jul 28 03:49:29.931945 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1308/2935] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:28 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1359 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:29.940792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-23316632-e02d-4c85-91f0-c118224fe5e9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:29.946064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-23316632-e02d-4c85-91f0-c118224fe5e9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:29.962734 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23316632-e02d-4c85-91f0-c118224fe5e9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:29.965079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23316632-e02d-4c85-91f0-c118224fe5e9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:29.966114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23316632-e02d-4c85-91f0-c118224fe5e9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:29.973651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23316632-e02d-4c85-91f0-c118224fe5e9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:30.275263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3b38c380-0b29-48ba-9716-dd815e539cce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:30.286556 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3b38c380-0b29-48ba-9716-dd815e539cce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1537 microversion: 2.1 time: 1.019142 Jul 28 03:49:30.287508 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1628/2936] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:29 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1537 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:30.301174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-29ec55e4-5abd-465c-8739-7b9eecc7d257 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:30.305186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-29ec55e4-5abd-465c-8739-7b9eecc7d257 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:30.321447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ec55e4-5abd-465c-8739-7b9eecc7d257 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:30.324550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ec55e4-5abd-465c-8739-7b9eecc7d257 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:30.327398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ec55e4-5abd-465c-8739-7b9eecc7d257 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:30.328855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ec55e4-5abd-465c-8739-7b9eecc7d257 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:30.496228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-23316632-e02d-4c85-91f0-c118224fe5e9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:30.509879 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-23316632-e02d-4c85-91f0-c118224fe5e9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1654 microversion: 2.1 time: 0.575575 Jul 28 03:49:30.510752 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1309/2937] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:29 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1654 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:30.516109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-0fa6d8a1-b1b4-4718-86f7-0c0590316e9f req-09bcbb8a-681c-4dec-8604-60ac802155f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a708e336-67ea-42c9-9d6d-8f77b8b67e7a", "name": "network-vif-deleted", "tag": "f763a531-4acb-48d9-be72-22782928289c"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:30.526513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-0fa6d8a1-b1b4-4718-86f7-0c0590316e9f req-09bcbb8a-681c-4dec-8604-60ac802155f9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:30.527515 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-0fa6d8a1-b1b4-4718-86f7-0c0590316e9f req-09bcbb8a-681c-4dec-8604-60ac802155f9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:30.540111 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-0fa6d8a1-b1b4-4718-86f7-0c0590316e9f req-09bcbb8a-681c-4dec-8604-60ac802155f9 service nova] Creating event network-vif-deleted:f763a531-4acb-48d9-be72-22782928289c for instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a on n-h2-826756-3 Jul 28 03:49:30.545934 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-0fa6d8a1-b1b4-4718-86f7-0c0590316e9f req-09bcbb8a-681c-4dec-8604-60ac802155f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033394 Jul 28 03:49:30.547223 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1310/2938] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:30.960186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ee0b9d8a-f740-49af-a5da-e6e2fc7300c3 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:30.961947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ee0b9d8a-f740-49af-a5da-e6e2fc7300c3 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:30.976197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ee0b9d8a-f740-49af-a5da-e6e2fc7300c3 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:30.978322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ee0b9d8a-f740-49af-a5da-e6e2fc7300c3 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:30.979963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ee0b9d8a-f740-49af-a5da-e6e2fc7300c3 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:30.980977 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ee0b9d8a-f740-49af-a5da-e6e2fc7300c3 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:31.054147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-29ec55e4-5abd-465c-8739-7b9eecc7d257 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:31.065531 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-29ec55e4-5abd-465c-8739-7b9eecc7d257 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1315 microversion: 2.1 time: 0.774430 Jul 28 03:49:31.066136 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1629/2939] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:30 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:31.264561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6408db38-7397-4cc8-a79a-484ffad91884 req-6a5db3ea-25c8-48a3-8841-13f39a069af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed1f699-679f-49f8-b652-f2d476d3be28", "name": "network-vif-plugged", "status": "completed", "tag": "fc3835af-4c27-44e3-be2b-f09de6fbd1f5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:31.287304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6408db38-7397-4cc8-a79a-484ffad91884 req-6a5db3ea-25c8-48a3-8841-13f39a069af0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:31.287995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6408db38-7397-4cc8-a79a-484ffad91884 req-6a5db3ea-25c8-48a3-8841-13f39a069af0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:31.310481 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6408db38-7397-4cc8-a79a-484ffad91884 req-6a5db3ea-25c8-48a3-8841-13f39a069af0 service nova] Creating event network-vif-plugged:fc3835af-4c27-44e3-be2b-f09de6fbd1f5 for instance 2ed1f699-679f-49f8-b652-f2d476d3be28 on n-h1-826756-3 Jul 28 03:49:31.323128 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6408db38-7397-4cc8-a79a-484ffad91884 req-6a5db3ea-25c8-48a3-8841-13f39a069af0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062314 Jul 28 03:49:31.323747 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1630/2940] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:49:31.329721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ad4e2e78-a555-46c2-beb6-fb9df12cce7d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:31.348087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ad4e2e78-a555-46c2-beb6-fb9df12cce7d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:31.354930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad4e2e78-a555-46c2-beb6-fb9df12cce7d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:31.355415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad4e2e78-a555-46c2-beb6-fb9df12cce7d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:31.356215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad4e2e78-a555-46c2-beb6-fb9df12cce7d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:31.356681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad4e2e78-a555-46c2-beb6-fb9df12cce7d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:31.939331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ee0b9d8a-f740-49af-a5da-e6e2fc7300c3 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:31.956821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ee0b9d8a-f740-49af-a5da-e6e2fc7300c3 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:31.966744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ee0b9d8a-f740-49af-a5da-e6e2fc7300c3 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:31.968782 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ee0b9d8a-f740-49af-a5da-e6e2fc7300c3 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1359 microversion: 2.21 time: 1.014946 Jul 28 03:49:31.983019 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1311/2941] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:30 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1359 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:32.009816 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3ed354be-66b5-46f0-bae3-e682dca86975 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:32.015325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3ed354be-66b5-46f0-bae3-e682dca86975 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:32.061433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ed354be-66b5-46f0-bae3-e682dca86975 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:32.068278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ed354be-66b5-46f0-bae3-e682dca86975 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:32.072140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ed354be-66b5-46f0-bae3-e682dca86975 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:32.085533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ed354be-66b5-46f0-bae3-e682dca86975 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:32.204793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ad4e2e78-a555-46c2-beb6-fb9df12cce7d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:32.218886 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ad4e2e78-a555-46c2-beb6-fb9df12cce7d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1537 microversion: 2.1 time: 0.888253 Jul 28 03:49:32.219909 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1631/2942] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:31 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1537 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:32.242081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-db507ed3-32f5-430b-b65c-88b160cea111 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:32.242814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-db507ed3-32f5-430b-b65c-88b160cea111 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:32.243436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ed354be-66b5-46f0-bae3-e682dca86975 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:32.244163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ed354be-66b5-46f0-bae3-e682dca86975 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:32.244665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-3ed354be-66b5-46f0-bae3-e682dca86975 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lazy-loading 'fault' on Instance uuid a708e336-67ea-42c9-9d6d-8f77b8b67e7a {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:49:32.250433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db507ed3-32f5-430b-b65c-88b160cea111 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:32.251416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db507ed3-32f5-430b-b65c-88b160cea111 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:32.252469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db507ed3-32f5-430b-b65c-88b160cea111 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:32.253120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db507ed3-32f5-430b-b65c-88b160cea111 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:32.351913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3ed354be-66b5-46f0-bae3-e682dca86975 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:32.363476 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3ed354be-66b5-46f0-bae3-e682dca86975 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 200 len: 1302 microversion: 2.1 time: 0.379037 Jul 28 03:49:32.364083 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1312/2943] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:31 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 1302 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:32.595017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-db507ed3-32f5-430b-b65c-88b160cea111 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:32.610647 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-db507ed3-32f5-430b-b65c-88b160cea111 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1315 microversion: 2.1 time: 0.389269 Jul 28 03:49:32.611419 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1632/2944] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:32 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:32.632024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-e073cf1d-8981-40b3-b635-5305cbe8f823 req-4a34b90e-bd90-4e26-aa08-8a0ce663c9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a708e336-67ea-42c9-9d6d-8f77b8b67e7a", "name": "network-vif-deleted", "tag": "71bfcf7a-bfbe-4642-8ceb-23481c7dd9ae"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:32.663950 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e073cf1d-8981-40b3-b635-5305cbe8f823 req-4a34b90e-bd90-4e26-aa08-8a0ce663c9b0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:32.667720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e073cf1d-8981-40b3-b635-5305cbe8f823 req-4a34b90e-bd90-4e26-aa08-8a0ce663c9b0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:32.706577 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-e073cf1d-8981-40b3-b635-5305cbe8f823 req-4a34b90e-bd90-4e26-aa08-8a0ce663c9b0 service nova] Creating event network-vif-deleted:71bfcf7a-bfbe-4642-8ceb-23481c7dd9ae for instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a on n-h2-826756-3 Jul 28 03:49:32.722557 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-e073cf1d-8981-40b3-b635-5305cbe8f823 req-4a34b90e-bd90-4e26-aa08-8a0ce663c9b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093246 Jul 28 03:49:32.723602 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1313/2945] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:33.007847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bcae7faf-b7d5-4e36-83a5-08249fc63c79 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:33.008931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bcae7faf-b7d5-4e36-83a5-08249fc63c79 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:33.020142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcae7faf-b7d5-4e36-83a5-08249fc63c79 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:33.020630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcae7faf-b7d5-4e36-83a5-08249fc63c79 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:33.025941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcae7faf-b7d5-4e36-83a5-08249fc63c79 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:33.026889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcae7faf-b7d5-4e36-83a5-08249fc63c79 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:33.253089 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8bd3a79f-c4eb-4110-afde-d1376c8266f5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:33.253731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8bd3a79f-c4eb-4110-afde-d1376c8266f5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:33.271298 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bd3a79f-c4eb-4110-afde-d1376c8266f5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:33.272201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bd3a79f-c4eb-4110-afde-d1376c8266f5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:33.273196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bd3a79f-c4eb-4110-afde-d1376c8266f5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:33.274043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bd3a79f-c4eb-4110-afde-d1376c8266f5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:33.693866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bcae7faf-b7d5-4e36-83a5-08249fc63c79 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:33.712964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bcae7faf-b7d5-4e36-83a5-08249fc63c79 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:33.718315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bcae7faf-b7d5-4e36-83a5-08249fc63c79 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:33.720281 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bcae7faf-b7d5-4e36-83a5-08249fc63c79 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1359 microversion: 2.21 time: 0.716045 Jul 28 03:49:33.720927 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1633/2946] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:33 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1359 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:33.742147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-277e87d5-3f1d-416c-a2c3-d32af1c1aecd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:33.742838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-277e87d5-3f1d-416c-a2c3-d32af1c1aecd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:33.751243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-277e87d5-3f1d-416c-a2c3-d32af1c1aecd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:33.752310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-277e87d5-3f1d-416c-a2c3-d32af1c1aecd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:33.753394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-277e87d5-3f1d-416c-a2c3-d32af1c1aecd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:33.754308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-277e87d5-3f1d-416c-a2c3-d32af1c1aecd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:33.761644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:33.777971 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-277e87d5-3f1d-416c-a2c3-d32af1c1aecd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] HTTP exception thrown: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-277e87d5-3f1d-416c-a2c3-d32af1c1aecd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Request method failure captured: Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a HTTP/1.1 Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gbzast_Oajy2o3oVjsoD8MDbWSFl4PqFZGSQpsKNTVljzKZyP2UJX4BAxzxg3EsGRB2XT5e3x-qUGwamy-ARdlY8sfsrY521TPXpeV_ldCG8ULveXBZhf0u1_buTMn7D47ZmSu58ltI8i9b48HujdQhlDaP4tEIoJaU35Xpg1nbRGQ Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a6bba8696d304edbb658461d3f313beb Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestMultiNic-915001081 Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a6bba8696d304edbb658461d3f313beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6bba8696d304edbb658461d3f313beb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a6bba8696d304edbb658461d3f313beb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6bba8696d304edbb658461d3f313beb"}]}] Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestMultiNic-915001081 Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a6bba8696d304edbb658461d3f313beb Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestMultiNic-915001081 Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestMultiNic-915001081-project Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 9290ff8a6a524900894b16523e9a2fb8 Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestMultiNic-915001081-project Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a708e336-67ea-42c9-9d6d-8f77b8b67e7a'} Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:49:33.779786 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:33.784167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:33.784167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:49:33.784167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:49:33.784167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:49:33.784167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:49:33.784167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:49:33.784167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:33.787551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-277e87d5-3f1d-416c-a2c3-d32af1c1aecd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Returning 404 to user: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:49:33.788817 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-277e87d5-3f1d-416c-a2c3-d32af1c1aecd tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 404 len: 111 microversion: 2.1 time: 0.054083 Jul 28 03:49:33.791631 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1634/2947] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:33 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:49:33.804104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-da8ec2eb-1fe5-4b68-a47c-342d0d4b6438 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:33.806320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-da8ec2eb-1fe5-4b68-a47c-342d0d4b6438 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:33.825680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da8ec2eb-1fe5-4b68-a47c-342d0d4b6438 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:33.827164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da8ec2eb-1fe5-4b68-a47c-342d0d4b6438 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:33.828477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da8ec2eb-1fe5-4b68-a47c-342d0d4b6438 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:33.829395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da8ec2eb-1fe5-4b68-a47c-342d0d4b6438 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:33.914232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8bd3a79f-c4eb-4110-afde-d1376c8266f5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:33.926505 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8bd3a79f-c4eb-4110-afde-d1376c8266f5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1542 microversion: 2.1 time: 0.683324 Jul 28 03:49:33.927543 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1314/2948] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:33 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1542 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:34.236699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-da8ec2eb-1fe5-4b68-a47c-342d0d4b6438 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:34.247227 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-da8ec2eb-1fe5-4b68-a47c-342d0d4b6438 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1315 microversion: 2.1 time: 0.452790 Jul 28 03:49:34.248138 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1635/2949] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:33 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:34.745240 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7e6baaea-c5ac-4cee-af38-cce56cdb26c9 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:34.745901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7e6baaea-c5ac-4cee-af38-cce56cdb26c9 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:34.755149 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7e6baaea-c5ac-4cee-af38-cce56cdb26c9 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:34.755604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7e6baaea-c5ac-4cee-af38-cce56cdb26c9 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:34.761724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7e6baaea-c5ac-4cee-af38-cce56cdb26c9 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:34.761949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7e6baaea-c5ac-4cee-af38-cce56cdb26c9 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:34.948787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-42f93ca0-ff3d-4c1d-bfbf-ce601af1bc59 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:34.949501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-42f93ca0-ff3d-4c1d-bfbf-ce601af1bc59 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:34.960461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42f93ca0-ff3d-4c1d-bfbf-ce601af1bc59 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:34.961162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42f93ca0-ff3d-4c1d-bfbf-ce601af1bc59 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:34.962106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42f93ca0-ff3d-4c1d-bfbf-ce601af1bc59 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:34.962707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42f93ca0-ff3d-4c1d-bfbf-ce601af1bc59 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:35.063295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7e6baaea-c5ac-4cee-af38-cce56cdb26c9 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:35.073836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7e6baaea-c5ac-4cee-af38-cce56cdb26c9 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:35.075438 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7e6baaea-c5ac-4cee-af38-cce56cdb26c9 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:35.076671 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7e6baaea-c5ac-4cee-af38-cce56cdb26c9 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1551 microversion: 2.21 time: 0.335358 Jul 28 03:49:35.077248 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1315/2950] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:34 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1551 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:35.102073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b62cb3ca-67b0-43b1-88f4-0d123691b806 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:35.102889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b62cb3ca-67b0-43b1-88f4-0d123691b806 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:35.109705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b62cb3ca-67b0-43b1-88f4-0d123691b806 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:35.110399 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b62cb3ca-67b0-43b1-88f4-0d123691b806 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:35.111426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b62cb3ca-67b0-43b1-88f4-0d123691b806 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:35.112024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b62cb3ca-67b0-43b1-88f4-0d123691b806 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:35.144469 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b62cb3ca-67b0-43b1-88f4-0d123691b806 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:49:35.269175 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b62cb3ca-67b0-43b1-88f4-0d123691b806 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 204 len: 0 microversion: 2.21 time: 0.169810 Jul 28 03:49:35.273619 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1316/2951] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:49:35 2022] DELETE /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 03:49:35.285953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-61d4ff10-ea9b-4819-81bf-47cb1524754e req-45884a9d-0b87-445a-a8bc-50dd34f55696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47b71f0-424f-4b3b-ae6c-9f38a83a43e0", "name": "network-vif-plugged", "status": "completed", "tag": "c298f163-bf0d-4e1a-8620-2badd0279e63"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:35.301872 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-61d4ff10-ea9b-4819-81bf-47cb1524754e req-45884a9d-0b87-445a-a8bc-50dd34f55696 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:35.302587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-61d4ff10-ea9b-4819-81bf-47cb1524754e req-45884a9d-0b87-445a-a8bc-50dd34f55696 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:35.324851 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-61d4ff10-ea9b-4819-81bf-47cb1524754e req-45884a9d-0b87-445a-a8bc-50dd34f55696 service nova] Creating event network-vif-plugged:c298f163-bf0d-4e1a-8620-2badd0279e63 for instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 on n-h1-826756-3 Jul 28 03:49:35.359622 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-61d4ff10-ea9b-4819-81bf-47cb1524754e req-45884a9d-0b87-445a-a8bc-50dd34f55696 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084234 Jul 28 03:49:35.361368 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1317/2952] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:35.377310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d8fe8a26-4d94-49a2-93f2-7bdbf2a7690d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:35.377310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d8fe8a26-4d94-49a2-93f2-7bdbf2a7690d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:35.418844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-42f93ca0-ff3d-4c1d-bfbf-ce601af1bc59 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:35.427808 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-42f93ca0-ff3d-4c1d-bfbf-ce601af1bc59 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1542 microversion: 2.1 time: 0.482931 Jul 28 03:49:35.428604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8fe8a26-4d94-49a2-93f2-7bdbf2a7690d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:35.429563 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1636/2953] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:34 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1542 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:35.430757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8fe8a26-4d94-49a2-93f2-7bdbf2a7690d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:35.431721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8fe8a26-4d94-49a2-93f2-7bdbf2a7690d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:35.434387 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8fe8a26-4d94-49a2-93f2-7bdbf2a7690d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:35.439446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f6a3223-f57c-4f2e-aff3-6b9c3eb49c8f tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:35.440363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8f6a3223-f57c-4f2e-aff3-6b9c3eb49c8f tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:35.457528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f6a3223-f57c-4f2e-aff3-6b9c3eb49c8f tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:35.458688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f6a3223-f57c-4f2e-aff3-6b9c3eb49c8f tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:35.459786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f6a3223-f57c-4f2e-aff3-6b9c3eb49c8f tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:35.460248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f6a3223-f57c-4f2e-aff3-6b9c3eb49c8f tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:35.477687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:35.655176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d8fe8a26-4d94-49a2-93f2-7bdbf2a7690d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:35.667100 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d8fe8a26-4d94-49a2-93f2-7bdbf2a7690d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1315 microversion: 2.1 time: 0.301090 Jul 28 03:49:35.667428 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1318/2954] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:35 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:35.939244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8f6a3223-f57c-4f2e-aff3-6b9c3eb49c8f tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:35.955279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8f6a3223-f57c-4f2e-aff3-6b9c3eb49c8f tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:35.959662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8f6a3223-f57c-4f2e-aff3-6b9c3eb49c8f tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:35.963340 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8f6a3223-f57c-4f2e-aff3-6b9c3eb49c8f tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1557 microversion: 2.21 time: 0.530340 Jul 28 03:49:35.965048 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1637/2955] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:35 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1557 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:49:36.452174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-33c7f158-51a8-471f-a49e-d7841348b7c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:36.453338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-33c7f158-51a8-471f-a49e-d7841348b7c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:36.473706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33c7f158-51a8-471f-a49e-d7841348b7c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:36.474300 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33c7f158-51a8-471f-a49e-d7841348b7c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:36.475410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33c7f158-51a8-471f-a49e-d7841348b7c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:36.475980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33c7f158-51a8-471f-a49e-d7841348b7c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:36.692529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3f96c880-0548-470f-819f-ec8c15eb37b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:36.693636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3f96c880-0548-470f-819f-ec8c15eb37b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:36.713399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f96c880-0548-470f-819f-ec8c15eb37b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:36.714561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f96c880-0548-470f-819f-ec8c15eb37b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:36.716474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f96c880-0548-470f-819f-ec8c15eb37b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:36.717699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f96c880-0548-470f-819f-ec8c15eb37b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:36.867428 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-33c7f158-51a8-471f-a49e-d7841348b7c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:36.878072 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-33c7f158-51a8-471f-a49e-d7841348b7c3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1542 microversion: 2.1 time: 0.430811 Jul 28 03:49:36.896205 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1319/2956] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:36 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1542 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:36.987344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b91b9e9b-10e3-43b5-8506-2c439fa20f3b tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:36.988366 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b91b9e9b-10e3-43b5-8506-2c439fa20f3b tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:36.991778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:37.005397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b91b9e9b-10e3-43b5-8506-2c439fa20f3b tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:37.006951 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b91b9e9b-10e3-43b5-8506-2c439fa20f3b tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:37.008101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b91b9e9b-10e3-43b5-8506-2c439fa20f3b tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:37.008806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b91b9e9b-10e3-43b5-8506-2c439fa20f3b tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:37.095966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3f96c880-0548-470f-819f-ec8c15eb37b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:37.106833 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3f96c880-0548-470f-819f-ec8c15eb37b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1315 microversion: 2.1 time: 0.420626 Jul 28 03:49:37.108246 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1638/2957] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:36 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:37.568685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b91b9e9b-10e3-43b5-8506-2c439fa20f3b tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:37.583505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b91b9e9b-10e3-43b5-8506-2c439fa20f3b tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:37.586058 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b91b9e9b-10e3-43b5-8506-2c439fa20f3b tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:37.588138 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b91b9e9b-10e3-43b5-8506-2c439fa20f3b tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1557 microversion: 2.21 time: 0.604827 Jul 28 03:49:37.602761 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1320/2958] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:36 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1557 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:37.903760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-42884617-6c37-4190-b334-a0d0a8c3784b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:37.904506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-42884617-6c37-4190-b334-a0d0a8c3784b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:37.907644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:37.918407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42884617-6c37-4190-b334-a0d0a8c3784b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:37.922482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42884617-6c37-4190-b334-a0d0a8c3784b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:37.923218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42884617-6c37-4190-b334-a0d0a8c3784b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:37.924910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42884617-6c37-4190-b334-a0d0a8c3784b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:38.150467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b825cf46-9efb-4f93-8561-52b69e1e3b8d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:38.151092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b825cf46-9efb-4f93-8561-52b69e1e3b8d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:38.166856 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b825cf46-9efb-4f93-8561-52b69e1e3b8d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:38.176955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b825cf46-9efb-4f93-8561-52b69e1e3b8d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:38.179810 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b825cf46-9efb-4f93-8561-52b69e1e3b8d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:38.180337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b825cf46-9efb-4f93-8561-52b69e1e3b8d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:38.362314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-42884617-6c37-4190-b334-a0d0a8c3784b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:38.371704 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-42884617-6c37-4190-b334-a0d0a8c3784b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1542 microversion: 2.1 time: 0.472251 Jul 28 03:49:38.392808 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1639/2959] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:37 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1542 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:38.614451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-069b46c9-1a3f-4adf-9a99-72b3c914b5dc tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:38.615080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-069b46c9-1a3f-4adf-9a99-72b3c914b5dc tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:38.630736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-069b46c9-1a3f-4adf-9a99-72b3c914b5dc tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:38.631201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-069b46c9-1a3f-4adf-9a99-72b3c914b5dc tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:38.632000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-069b46c9-1a3f-4adf-9a99-72b3c914b5dc tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:38.632466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-069b46c9-1a3f-4adf-9a99-72b3c914b5dc tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:38.810859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b825cf46-9efb-4f93-8561-52b69e1e3b8d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:38.838309 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b825cf46-9efb-4f93-8561-52b69e1e3b8d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1503 microversion: 2.1 time: 0.699507 Jul 28 03:49:38.858377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-069b46c9-1a3f-4adf-9a99-72b3c914b5dc tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:38.866290 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1321/2960] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:38 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1503 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:38.869278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-069b46c9-1a3f-4adf-9a99-72b3c914b5dc tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:38.870892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-069b46c9-1a3f-4adf-9a99-72b3c914b5dc tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '750dca90c8b741aba52530a583e1ed81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fd8cc62d97c4953bab14a1ccb1a751a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:38.872098 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-069b46c9-1a3f-4adf-9a99-72b3c914b5dc tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 200 len: 1515 microversion: 2.21 time: 0.262750 Jul 28 03:49:38.877997 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-d2f1eda1-1e05-4b6f-88c7-ae48a86bd00b req-1af058bc-dc4d-4b14-89a0-eec6781defb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed1f699-679f-49f8-b652-f2d476d3be28", "name": "network-vif-deleted", "tag": "fc3835af-4c27-44e3-be2b-f09de6fbd1f5"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:38.885378 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1640/2961] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:38 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:49:38.927598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-d2f1eda1-1e05-4b6f-88c7-ae48a86bd00b req-1af058bc-dc4d-4b14-89a0-eec6781defb5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:38.929893 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-d2f1eda1-1e05-4b6f-88c7-ae48a86bd00b req-1af058bc-dc4d-4b14-89a0-eec6781defb5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:38.958568 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-d2f1eda1-1e05-4b6f-88c7-ae48a86bd00b req-1af058bc-dc4d-4b14-89a0-eec6781defb5 service nova] Creating event network-vif-deleted:fc3835af-4c27-44e3-be2b-f09de6fbd1f5 for instance 2ed1f699-679f-49f8-b652-f2d476d3be28 on n-h1-826756-3 Jul 28 03:49:38.969793 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-d2f1eda1-1e05-4b6f-88c7-ae48a86bd00b req-1af058bc-dc4d-4b14-89a0-eec6781defb5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101080 Jul 28 03:49:38.972788 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1322/2962] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:39.409738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5259d12e-496a-42df-8f09-89364b84895c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:39.410369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5259d12e-496a-42df-8f09-89364b84895c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:39.431344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5259d12e-496a-42df-8f09-89364b84895c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:39.431865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5259d12e-496a-42df-8f09-89364b84895c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:39.437020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5259d12e-496a-42df-8f09-89364b84895c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:39.439770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5259d12e-496a-42df-8f09-89364b84895c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:39.834301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5259d12e-496a-42df-8f09-89364b84895c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:39.844298 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5259d12e-496a-42df-8f09-89364b84895c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1542 microversion: 2.1 time: 0.438558 Jul 28 03:49:39.845444 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1641/2963] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:39 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1542 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:39.910974 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ab35f658-12af-4986-b280-fb21510e7ed0 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:39.911877 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ab35f658-12af-4986-b280-fb21510e7ed0 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:39.928974 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ab35f658-12af-4986-b280-fb21510e7ed0 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:39.940815 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ab35f658-12af-4986-b280-fb21510e7ed0 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:39.942411 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ab35f658-12af-4986-b280-fb21510e7ed0 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:39.944570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ab35f658-12af-4986-b280-fb21510e7ed0 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:40.000923 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-ab35f658-12af-4986-b280-fb21510e7ed0 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] HTTP exception thrown: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ab35f658-12af-4986-b280-fb21510e7ed0 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Request method failure captured: Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 HTTP/1.1 Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcxn-VNyQK6BEXcEG3jd8GNZQcpOBJD9DCaJ0F8QlvCENAlhobzLl34Rb_q1XfjZ1OQM_R8hlydotlD8LXFgIyuCadjpynyukq-tfba2gmLxiDZHxli8vrqiRZN8sSnHJTRfIhoH7XJXCY0pK0qDs8L9ujULE_pMPBpHgO-ciCtW6U Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Openstack-Nova-Api-Version: 2.21 Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 9fd8cc62d97c4953bab14a1ccb1a751a Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1282209626 Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fd8cc62d97c4953bab14a1ccb1a751a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fd8cc62d97c4953bab14a1ccb1a751a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fd8cc62d97c4953bab14a1ccb1a751a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fd8cc62d97c4953bab14a1ccb1a751a"}]}] Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-InstanceActionsV221TestJSON-1282209626 Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 9fd8cc62d97c4953bab14a1ccb1a751a Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1282209626 Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-InstanceActionsV221TestJSON-1282209626-project Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 750dca90c8b741aba52530a583e1ed81 Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-InstanceActionsV221TestJSON-1282209626-project Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '2ed1f699-679f-49f8-b652-f2d476d3be28'} Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.002799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:49:40.007210 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.007210 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:40.007210 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:49:40.007210 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:49:40.007210 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:49:40.007210 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:49:40.007210 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.007210 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.010227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ab35f658-12af-4986-b280-fb21510e7ed0 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Returning 404 to user: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:49:40.013711 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ab35f658-12af-4986-b280-fb21510e7ed0 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 404 len: 111 microversion: 2.21 time: 0.106269 Jul 28 03:49:40.022936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f28e974f-7698-421d-a831-58c7792c3042 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '.version_select at 0x7ffa67a6f940>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:40.023534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f28e974f-7698-421d-a831-58c7792c3042 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:40.029514 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1323/2964] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:39 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:49:40.046382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f28e974f-7698-421d-a831-58c7792c3042 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:40.047149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f28e974f-7698-421d-a831-58c7792c3042 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:40.048214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f28e974f-7698-421d-a831-58c7792c3042 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:40.048851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f28e974f-7698-421d-a831-58c7792c3042 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:40.241248 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f28e974f-7698-421d-a831-58c7792c3042 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.222294 Jul 28 03:49:40.251842 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1642/2965] 10.222.0.48 () {60 vars in 1337 bytes} [Thu Jul 28 03:49:40 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28/os-instance-actions => generated 611 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:49:40.257077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9a296dcf-bbc3-4b58-a021-8bcbda5dbfd5 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:40.257647 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9a296dcf-bbc3-4b58-a021-8bcbda5dbfd5 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:40.283735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a296dcf-bbc3-4b58-a021-8bcbda5dbfd5 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:40.284187 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a296dcf-bbc3-4b58-a021-8bcbda5dbfd5 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:40.285005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a296dcf-bbc3-4b58-a021-8bcbda5dbfd5 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:40.285444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a296dcf-bbc3-4b58-a021-8bcbda5dbfd5 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:40.310467 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-9a296dcf-bbc3-4b58-a021-8bcbda5dbfd5 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] HTTP exception thrown: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9a296dcf-bbc3-4b58-a021-8bcbda5dbfd5 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Request method failure captured: Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 HTTP/1.1 Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcxn-VNyQK6BEXcEG3jd8GNZQcpOBJD9DCaJ0F8QlvCENAlhobzLl34Rb_q1XfjZ1OQM_R8hlydotlD8LXFgIyuCadjpynyukq-tfba2gmLxiDZHxli8vrqiRZN8sSnHJTRfIhoH7XJXCY0pK0qDs8L9ujULE_pMPBpHgO-ciCtW6U Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Openstack-Nova-Api-Version: 2.21 Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 9fd8cc62d97c4953bab14a1ccb1a751a Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1282209626 Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fd8cc62d97c4953bab14a1ccb1a751a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fd8cc62d97c4953bab14a1ccb1a751a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fd8cc62d97c4953bab14a1ccb1a751a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fd8cc62d97c4953bab14a1ccb1a751a"}]}] Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-InstanceActionsV221TestJSON-1282209626 Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 9fd8cc62d97c4953bab14a1ccb1a751a Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1282209626 Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-InstanceActionsV221TestJSON-1282209626-project Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 750dca90c8b741aba52530a583e1ed81 Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-InstanceActionsV221TestJSON-1282209626-project Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '2ed1f699-679f-49f8-b652-f2d476d3be28'} Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:49:40.312331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:49:40.316825 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.316825 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.316825 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:49:40.316825 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.316825 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:40.316825 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:49:40.316825 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:49:40.316825 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:49:40.316825 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:49:40.316825 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.316825 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.324231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9a296dcf-bbc3-4b58-a021-8bcbda5dbfd5 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Returning 404 to user: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:49:40.325254 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9a296dcf-bbc3-4b58-a021-8bcbda5dbfd5 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 404 len: 111 microversion: 2.21 time: 0.072233 Jul 28 03:49:40.340267 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1324/2966] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:49:40 2022] DELETE /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:49:40.346200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7ddd7936-d042-4f54-a2b2-996ae95c2884 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:40.346988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7ddd7936-d042-4f54-a2b2-996ae95c2884 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] [instance: 2ed1f699-679f-49f8-b652-f2d476d3be28] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:40.358886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ddd7936-d042-4f54-a2b2-996ae95c2884 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:40.359602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ddd7936-d042-4f54-a2b2-996ae95c2884 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:40.373615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ddd7936-d042-4f54-a2b2-996ae95c2884 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:40.374457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ddd7936-d042-4f54-a2b2-996ae95c2884 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:40.403582 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-7ddd7936-d042-4f54-a2b2-996ae95c2884 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] HTTP exception thrown: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7ddd7936-d042-4f54-a2b2-996ae95c2884 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Request method failure captured: Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 HTTP/1.1 Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gcxn-VNyQK6BEXcEG3jd8GNZQcpOBJD9DCaJ0F8QlvCENAlhobzLl34Rb_q1XfjZ1OQM_R8hlydotlD8LXFgIyuCadjpynyukq-tfba2gmLxiDZHxli8vrqiRZN8sSnHJTRfIhoH7XJXCY0pK0qDs8L9ujULE_pMPBpHgO-ciCtW6U Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.21 Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 9fd8cc62d97c4953bab14a1ccb1a751a Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1282209626 Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9fd8cc62d97c4953bab14a1ccb1a751a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fd8cc62d97c4953bab14a1ccb1a751a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9fd8cc62d97c4953bab14a1ccb1a751a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9fd8cc62d97c4953bab14a1ccb1a751a"}]}] Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-InstanceActionsV221TestJSON-1282209626 Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 9fd8cc62d97c4953bab14a1ccb1a751a Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1282209626 Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-InstanceActionsV221TestJSON-1282209626-project Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 750dca90c8b741aba52530a583e1ed81 Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-InstanceActionsV221TestJSON-1282209626-project Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2ed1f699-679f-49f8-b652-f2d476d3be28'} Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.405626 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:49:40.410934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.410934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:49:40.410934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:49:40.410934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:49:40.410934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:49:40.410934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:49:40.410934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. Jul 28 03:49:40.410934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:49:40.410934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7ddd7936-d042-4f54-a2b2-996ae95c2884 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] Returning 404 to user: Instance 2ed1f699-679f-49f8-b652-f2d476d3be28 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:49:40.411755 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7ddd7936-d042-4f54-a2b2-996ae95c2884 tempest-InstanceActionsV221TestJSON-1282209626 tempest-InstanceActionsV221TestJSON-1282209626-project] 10.222.0.48 "GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28" status: 404 len: 111 microversion: 2.21 time: 0.068772 Jul 28 03:49:40.413988 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1643/2967] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:49:40 2022] GET /compute/v2.1/servers/2ed1f699-679f-49f8-b652-f2d476d3be28 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:49:40.876272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-741083ae-8fe8-429a-bff2-953c5172123a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:40.877362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-741083ae-8fe8-429a-bff2-953c5172123a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:40.920335 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-741083ae-8fe8-429a-bff2-953c5172123a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:40.922989 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-741083ae-8fe8-429a-bff2-953c5172123a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:40.924983 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-741083ae-8fe8-429a-bff2-953c5172123a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:40.927247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-741083ae-8fe8-429a-bff2-953c5172123a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:41.314747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-741083ae-8fe8-429a-bff2-953c5172123a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:41.323351 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-741083ae-8fe8-429a-bff2-953c5172123a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1542 microversion: 2.1 time: 0.454998 Jul 28 03:49:41.324216 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1325/2968] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:40 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1542 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:41.827674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-405e4b87-8527-4741-b0d7-62fc0f92ea2e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9046dead-3d0a-4987-909d-a6b6f064b2f0"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:41.830256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-405e4b87-8527-4741-b0d7-62fc0f92ea2e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:41.845371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-405e4b87-8527-4741-b0d7-62fc0f92ea2e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:41.845875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-405e4b87-8527-4741-b0d7-62fc0f92ea2e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:41.846713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-405e4b87-8527-4741-b0d7-62fc0f92ea2e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:41.847154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-405e4b87-8527-4741-b0d7-62fc0f92ea2e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:42.288871 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-405e4b87-8527-4741-b0d7-62fc0f92ea2e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "POST /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.465233 Jul 28 03:49:42.290389 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1644/2969] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 03:49:41 2022] POST /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0/os-volume_attachments => generated 194 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:42.352922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e98771aa-47e1-4a35-a210-5cfe7f081ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:42.353611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e98771aa-47e1-4a35-a210-5cfe7f081ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:42.375967 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e98771aa-47e1-4a35-a210-5cfe7f081ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:42.392999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e98771aa-47e1-4a35-a210-5cfe7f081ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:42.398499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e98771aa-47e1-4a35-a210-5cfe7f081ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:42.399454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e98771aa-47e1-4a35-a210-5cfe7f081ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:43.112662 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e98771aa-47e1-4a35-a210-5cfe7f081ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:43.135132 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e98771aa-47e1-4a35-a210-5cfe7f081ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1542 microversion: 2.1 time: 0.793500 Jul 28 03:49:43.136280 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1326/2970] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:42 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1542 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:43.425077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-653165433", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "4ce94da5-d637-40da-b10a-c2da1a5a47a0"}, {"uuid": "27f99b0d-e7a8-4570-8da6-5c1d0abfc854"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:43.603639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] validate_networks() for [('4ce94da5-d637-40da-b10a-c2da1a5a47a0', None, None, None, None, None), ('27f99b0d-e7a8-4570-8da6-5c1d0abfc854', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:49:44.160631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e06586d3-3a56-4ce0-8685-793d2acffc25 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:44.162195 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e06586d3-3a56-4ce0-8685-793d2acffc25 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:44.198449 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e06586d3-3a56-4ce0-8685-793d2acffc25 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:44.204819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e06586d3-3a56-4ce0-8685-793d2acffc25 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:44.208539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e06586d3-3a56-4ce0-8685-793d2acffc25 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:44.211992 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e06586d3-3a56-4ce0-8685-793d2acffc25 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:45.338499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:49:45.339152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:49:45.340225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:49:45.340935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:49:45.341621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:49:45.380373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:45.382286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:45.395781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:45.396566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:45.444615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Getting quotas for project a6bba8696d304edbb658461d3f313beb. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:49:45.461381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Getting quotas for user 9290ff8a6a524900894b16523e9a2fb8 and project a6bba8696d304edbb658461d3f313beb. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:49:45.500752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:49:45.513208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:49:45.605205 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b03b85e1-02c8-4bd1-8f2f-bd8ccba260f7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.187266 Jul 28 03:49:45.608825 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1645/2971] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:49:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:49:45.621193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1a98e41-2d8a-4699-9918-b35a0d62e180 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:45.622156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1a98e41-2d8a-4699-9918-b35a0d62e180 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:45.680869 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e06586d3-3a56-4ce0-8685-793d2acffc25 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:45.690963 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e06586d3-3a56-4ce0-8685-793d2acffc25 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1542 microversion: 2.1 time: 1.536299 Jul 28 03:49:45.711605 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1327/2972] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:44 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1542 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:45.754009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b1a98e41-2d8a-4699-9918-b35a0d62e180 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:45.764884 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1a98e41-2d8a-4699-9918-b35a0d62e180 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1212 microversion: 2.1 time: 0.147806 Jul 28 03:49:45.767889 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1646/2973] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:45 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1212 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:46.721648 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-67f1f549-0429-4c6c-ba20-720e18b2f0f1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:46.722435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-67f1f549-0429-4c6c-ba20-720e18b2f0f1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:46.739986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67f1f549-0429-4c6c-ba20-720e18b2f0f1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:46.742925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67f1f549-0429-4c6c-ba20-720e18b2f0f1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:46.747081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67f1f549-0429-4c6c-ba20-720e18b2f0f1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:46.749384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67f1f549-0429-4c6c-ba20-720e18b2f0f1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:46.793530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-21c23b58-e294-48bd-8efc-5161f2158ef8 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:46.794987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-21c23b58-e294-48bd-8efc-5161f2158ef8 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:46.956651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-21c23b58-e294-48bd-8efc-5161f2158ef8 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:46.971421 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-21c23b58-e294-48bd-8efc-5161f2158ef8 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1212 microversion: 2.1 time: 0.187112 Jul 28 03:49:46.972623 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1647/2974] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:46 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1212 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:47.367378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-67f1f549-0429-4c6c-ba20-720e18b2f0f1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:47.380813 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-67f1f549-0429-4c6c-ba20-720e18b2f0f1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1542 microversion: 2.1 time: 0.666679 Jul 28 03:49:47.387447 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1328/2975] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:46 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1542 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:47.848203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1682380414", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b9f1d749-673c-48f8-94bb-c05605a68481"}], "security_groups": [{"name": "tempest-securitygroup--792951546"}], "key_name": "tempest-keypair-1573393649", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "a57b8f64-ba45-4ee7-ac97-75f1cc141996", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:47.992869 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bcae7bb7-8d77-4929-8511-3f2e012145d2 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:47.994147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bcae7bb7-8d77-4929-8511-3f2e012145d2 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:48.011201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcae7bb7-8d77-4929-8511-3f2e012145d2 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:48.011969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcae7bb7-8d77-4929-8511-3f2e012145d2 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:48.013075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcae7bb7-8d77-4929-8511-3f2e012145d2 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:48.013784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcae7bb7-8d77-4929-8511-3f2e012145d2 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:48.234378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] validate_networks() for [('b9f1d749-673c-48f8-94bb-c05605a68481', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:49:48.429812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bcae7bb7-8d77-4929-8511-3f2e012145d2 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:48.439619 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bcae7bb7-8d77-4929-8511-3f2e012145d2 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1264 microversion: 2.1 time: 0.451499 Jul 28 03:49:48.444169 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1329/2976] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:47 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1264 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:48.457316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cc93d065-a4e9-4abc-99af-0940066167a2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:48.460048 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cc93d065-a4e9-4abc-99af-0940066167a2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:48.475633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cc93d065-a4e9-4abc-99af-0940066167a2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:48.478500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cc93d065-a4e9-4abc-99af-0940066167a2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:48.479626 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cc93d065-a4e9-4abc-99af-0940066167a2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:48.484379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cc93d065-a4e9-4abc-99af-0940066167a2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:49.174546 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cc93d065-a4e9-4abc-99af-0940066167a2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:49.188597 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cc93d065-a4e9-4abc-99af-0940066167a2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1542 microversion: 2.1 time: 0.742930 Jul 28 03:49:49.190406 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1330/2977] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:48 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1542 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:49.306471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Getting quotas for project 2d4337b4b2c44fa99ab41728c08e3954. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:49:49.331075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Getting quotas for user 95da7dd0ca314d3fa4b630ff50fadf61 and project 2d4337b4b2c44fa99ab41728c08e3954. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:49:49.363098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:49:49.377570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:49:49.378797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:49:49.379470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:49:49.380293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:49:49.402884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:49.413121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:49.415010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:49.427386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:49.470117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9aff3e7d-06db-4844-8553-655514c147d0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:49.470793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9aff3e7d-06db-4844-8553-655514c147d0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:49.481895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Getting quotas for project 2d4337b4b2c44fa99ab41728c08e3954. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:49:49.485348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9aff3e7d-06db-4844-8553-655514c147d0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:49.485805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9aff3e7d-06db-4844-8553-655514c147d0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:49.486680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9aff3e7d-06db-4844-8553-655514c147d0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:49.487133 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9aff3e7d-06db-4844-8553-655514c147d0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:49.489630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Getting quotas for user 95da7dd0ca314d3fa4b630ff50fadf61 and project 2d4337b4b2c44fa99ab41728c08e3954. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:49:49.615573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:49:49.618224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a57b8f64-ba45-4ee7-ac97-75f1cc141996',volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:49:49.717605 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9aff3e7d-06db-4844-8553-655514c147d0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:49.757212 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9aff3e7d-06db-4844-8553-655514c147d0 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1270 microversion: 2.1 time: 0.287261 Jul 28 03:49:49.761578 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1331/2978] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:49 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1270 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:49.987238 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1f7b63ef-85b8-40b8-947f-0e839a19e842 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.143882 Jul 28 03:49:49.994219 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1648/2979] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:49:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 2146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:49:50.001518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fab7ddee-304f-4ea5-b97e-8b08c21715a6 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:50.002149 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fab7ddee-304f-4ea5-b97e-8b08c21715a6 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:50.219232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-52c537f8-b89d-4b20-9baf-aa0e8980e51a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:50.220895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-52c537f8-b89d-4b20-9baf-aa0e8980e51a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:50.233095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52c537f8-b89d-4b20-9baf-aa0e8980e51a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:50.233549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52c537f8-b89d-4b20-9baf-aa0e8980e51a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:50.234377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52c537f8-b89d-4b20-9baf-aa0e8980e51a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:50.234782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52c537f8-b89d-4b20-9baf-aa0e8980e51a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:50.338870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fab7ddee-304f-4ea5-b97e-8b08c21715a6 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:50.357450 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fab7ddee-304f-4ea5-b97e-8b08c21715a6 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1122 microversion: 2.1 time: 0.356105 Jul 28 03:49:50.358216 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1332/2980] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:49 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1122 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:50.783773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bb82b039-5ea2-41d3-be21-405919fb3a5f tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:50.784647 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bb82b039-5ea2-41d3-be21-405919fb3a5f tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:50.798076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb82b039-5ea2-41d3-be21-405919fb3a5f tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:50.800624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb82b039-5ea2-41d3-be21-405919fb3a5f tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:50.801671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb82b039-5ea2-41d3-be21-405919fb3a5f tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:50.802365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb82b039-5ea2-41d3-be21-405919fb3a5f tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:50.831688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-52c537f8-b89d-4b20-9baf-aa0e8980e51a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:50.849611 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-52c537f8-b89d-4b20-9baf-aa0e8980e51a tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1541 microversion: 2.1 time: 0.635199 Jul 28 03:49:50.850667 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1649/2981] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:50 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1541 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:51.251631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bb82b039-5ea2-41d3-be21-405919fb3a5f tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:51.273925 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bb82b039-5ea2-41d3-be21-405919fb3a5f tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1312 microversion: 2.1 time: 0.495722 Jul 28 03:49:51.287941 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1333/2982] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:50 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1312 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:51.381586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d6187490-a9ac-4c0d-9a83-4c91d265c2b1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:51.382113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d6187490-a9ac-4c0d-9a83-4c91d265c2b1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:51.397534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6187490-a9ac-4c0d-9a83-4c91d265c2b1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:51.398290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6187490-a9ac-4c0d-9a83-4c91d265c2b1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:51.399243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6187490-a9ac-4c0d-9a83-4c91d265c2b1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:51.399842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6187490-a9ac-4c0d-9a83-4c91d265c2b1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:51.636797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d6187490-a9ac-4c0d-9a83-4c91d265c2b1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:51.655637 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d6187490-a9ac-4c0d-9a83-4c91d265c2b1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1164 microversion: 2.1 time: 0.277966 Jul 28 03:49:51.657067 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1650/2983] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:51 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1164 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:51.871535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1008a223-edf0-4da1-b940-61309de997f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:51.872333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1008a223-edf0-4da1-b940-61309de997f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:51.891612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1008a223-edf0-4da1-b940-61309de997f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:51.896831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1008a223-edf0-4da1-b940-61309de997f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:51.899925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1008a223-edf0-4da1-b940-61309de997f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:51.904053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1008a223-edf0-4da1-b940-61309de997f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:52.298295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9ea24774-9169-46e9-afa3-dac38df288a3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:52.299647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9ea24774-9169-46e9-afa3-dac38df288a3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:52.314130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ea24774-9169-46e9-afa3-dac38df288a3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:52.317234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ea24774-9169-46e9-afa3-dac38df288a3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:52.320933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ea24774-9169-46e9-afa3-dac38df288a3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:52.322015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ea24774-9169-46e9-afa3-dac38df288a3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:52.500119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1008a223-edf0-4da1-b940-61309de997f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:52.517856 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1008a223-edf0-4da1-b940-61309de997f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1541 microversion: 2.1 time: 0.648617 Jul 28 03:49:52.520488 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1334/2984] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:51 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1541 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:52.680962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a7ef12d5-821e-4846-a5c4-b5dbc5202555 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:52.681491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a7ef12d5-821e-4846-a5c4-b5dbc5202555 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:52.696693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7ef12d5-821e-4846-a5c4-b5dbc5202555 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:52.697435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7ef12d5-821e-4846-a5c4-b5dbc5202555 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:52.701808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7ef12d5-821e-4846-a5c4-b5dbc5202555 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:52.706202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7ef12d5-821e-4846-a5c4-b5dbc5202555 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:53.492344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9ea24774-9169-46e9-afa3-dac38df288a3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:53.509393 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9ea24774-9169-46e9-afa3-dac38df288a3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 1.218401 Jul 28 03:49:53.510027 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1651/2985] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:52 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:53.522969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-668840f0-b53d-4a0e-9c58-4f061306ffac req-c83926fe-1a63-47c6-a127-31d30a05654b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed99415-e36a-431c-a33c-c609912af752", "name": "network-vif-unplugged", "status": "completed", "tag": "fe3c986d-7298-4555-ba29-5e1b4c7e6981"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:53.546521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-668840f0-b53d-4a0e-9c58-4f061306ffac req-c83926fe-1a63-47c6-a127-31d30a05654b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:53.547050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-668840f0-b53d-4a0e-9c58-4f061306ffac req-c83926fe-1a63-47c6-a127-31d30a05654b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:53.579754 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-668840f0-b53d-4a0e-9c58-4f061306ffac req-c83926fe-1a63-47c6-a127-31d30a05654b service nova] Creating event network-vif-unplugged:fe3c986d-7298-4555-ba29-5e1b4c7e6981 for instance bed99415-e36a-431c-a33c-c609912af752 on n-h2-826756-3 Jul 28 03:49:53.609435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-668840f0-b53d-4a0e-9c58-4f061306ffac req-c83926fe-1a63-47c6-a127-31d30a05654b service nova] Instance bed99415-e36a-431c-a33c-c609912af752 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:49:53.637057 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-668840f0-b53d-4a0e-9c58-4f061306ffac req-c83926fe-1a63-47c6-a127-31d30a05654b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107894 Jul 28 03:49:53.637982 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1652/2986] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:53.669467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a7ef12d5-821e-4846-a5c4-b5dbc5202555 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:53.681851 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a7ef12d5-821e-4846-a5c4-b5dbc5202555 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1238 microversion: 2.1 time: 1.004982 Jul 28 03:49:53.696258 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1335/2987] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:52 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1238 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:53.701585 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8f11fc56-d3ec-49fd-9c1e-69964f1d2d39 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:53.702243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8f11fc56-d3ec-49fd-9c1e-69964f1d2d39 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:53.708711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8f11fc56-d3ec-49fd-9c1e-69964f1d2d39 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:53.709163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8f11fc56-d3ec-49fd-9c1e-69964f1d2d39 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:53.709962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8f11fc56-d3ec-49fd-9c1e-69964f1d2d39 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:53.710375 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8f11fc56-d3ec-49fd-9c1e-69964f1d2d39 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:53.858356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9618ac86-ef5c-48bd-bcc2-2cc69bf32bd7 tempest-PortsAdminExtendedAttrsTestJSON-842469049 tempest-PortsAdminExtendedAttrsTestJSON-842469049-project-admin] Calling method '.version_select at 0x7ffa74688160>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:53.859533 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:49:53.859533 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:49:53.860803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9618ac86-ef5c-48bd-bcc2-2cc69bf32bd7 tempest-PortsAdminExtendedAttrsTestJSON-842469049 tempest-PortsAdminExtendedAttrsTestJSON-842469049-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:53.861436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9618ac86-ef5c-48bd-bcc2-2cc69bf32bd7 tempest-PortsAdminExtendedAttrsTestJSON-842469049 tempest-PortsAdminExtendedAttrsTestJSON-842469049-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:53.878342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9618ac86-ef5c-48bd-bcc2-2cc69bf32bd7 tempest-PortsAdminExtendedAttrsTestJSON-842469049 tempest-PortsAdminExtendedAttrsTestJSON-842469049-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:53.879042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9618ac86-ef5c-48bd-bcc2-2cc69bf32bd7 tempest-PortsAdminExtendedAttrsTestJSON-842469049 tempest-PortsAdminExtendedAttrsTestJSON-842469049-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:53.891168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9618ac86-ef5c-48bd-bcc2-2cc69bf32bd7 tempest-PortsAdminExtendedAttrsTestJSON-842469049 tempest-PortsAdminExtendedAttrsTestJSON-842469049-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:53.891870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9618ac86-ef5c-48bd-bcc2-2cc69bf32bd7 tempest-PortsAdminExtendedAttrsTestJSON-842469049 tempest-PortsAdminExtendedAttrsTestJSON-842469049-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:53.899187 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9618ac86-ef5c-48bd-bcc2-2cc69bf32bd7 tempest-PortsAdminExtendedAttrsTestJSON-842469049 tempest-PortsAdminExtendedAttrsTestJSON-842469049-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.256471 Jul 28 03:49:53.900102 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1653/2988] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:49:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:54.530622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-212c6dd9-48c2-4f7d-b9c2-97f5b2758c62 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:54.532243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-212c6dd9-48c2-4f7d-b9c2-97f5b2758c62 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:54.541499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8f11fc56-d3ec-49fd-9c1e-69964f1d2d39 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:54.552058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-212c6dd9-48c2-4f7d-b9c2-97f5b2758c62 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:54.553659 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8f11fc56-d3ec-49fd-9c1e-69964f1d2d39 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1541 microversion: 2.1 time: 0.856248 Jul 28 03:49:54.567969 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1336/2989] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:53 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1541 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:54.569151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-212c6dd9-48c2-4f7d-b9c2-97f5b2758c62 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:54.570244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-212c6dd9-48c2-4f7d-b9c2-97f5b2758c62 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:54.570924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-212c6dd9-48c2-4f7d-b9c2-97f5b2758c62 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:54.615188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:54.705802 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b3f21329-faaa-42f5-9a58-2e1668c5e8d0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:54.707871 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b3f21329-faaa-42f5-9a58-2e1668c5e8d0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:54.718704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3f21329-faaa-42f5-9a58-2e1668c5e8d0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:54.719796 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3f21329-faaa-42f5-9a58-2e1668c5e8d0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:54.723486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3f21329-faaa-42f5-9a58-2e1668c5e8d0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:54.724268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3f21329-faaa-42f5-9a58-2e1668c5e8d0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:54.889470 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b3f21329-faaa-42f5-9a58-2e1668c5e8d0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:54.903823 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b3f21329-faaa-42f5-9a58-2e1668c5e8d0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1238 microversion: 2.1 time: 0.203032 Jul 28 03:49:54.916631 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1337/2990] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:54 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1238 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:54.967487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-212c6dd9-48c2-4f7d-b9c2-97f5b2758c62 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:54.994765 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-212c6dd9-48c2-4f7d-b9c2-97f5b2758c62 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 0.466894 Jul 28 03:49:54.997238 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1654/2991] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:54 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:55.576114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ce355081-cb47-43b1-8044-d8fe579de815 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:55.577439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ce355081-cb47-43b1-8044-d8fe579de815 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:55.591988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce355081-cb47-43b1-8044-d8fe579de815 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:55.599385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce355081-cb47-43b1-8044-d8fe579de815 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:55.600577 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce355081-cb47-43b1-8044-d8fe579de815 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:55.603775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce355081-cb47-43b1-8044-d8fe579de815 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:55.622104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:55.680536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-2020c4d1-19b1-4f87-89e8-f87a22229fda req-52c45841-2032-492c-a55b-b5ff80b7a443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed99415-e36a-431c-a33c-c609912af752", "tag": "fe3c986d-7298-4555-ba29-5e1b4c7e6981"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:55.714574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2020c4d1-19b1-4f87-89e8-f87a22229fda req-52c45841-2032-492c-a55b-b5ff80b7a443 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:55.715022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2020c4d1-19b1-4f87-89e8-f87a22229fda req-52c45841-2032-492c-a55b-b5ff80b7a443 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:55.767039 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-2020c4d1-19b1-4f87-89e8-f87a22229fda req-52c45841-2032-492c-a55b-b5ff80b7a443 service nova] Creating event network-changed:fe3c986d-7298-4555-ba29-5e1b4c7e6981 for instance bed99415-e36a-431c-a33c-c609912af752 on n-h2-826756-3 Jul 28 03:49:55.799755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-2020c4d1-19b1-4f87-89e8-f87a22229fda req-52c45841-2032-492c-a55b-b5ff80b7a443 service nova] Instance bed99415-e36a-431c-a33c-c609912af752 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:49:55.824423 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-2020c4d1-19b1-4f87-89e8-f87a22229fda req-52c45841-2032-492c-a55b-b5ff80b7a443 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148135 Jul 28 03:49:55.835673 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1655/2992] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:49:55.925971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a07a916-1056-4982-af2c-bd630223186e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:55.926679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8a07a916-1056-4982-af2c-bd630223186e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:55.944977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a07a916-1056-4982-af2c-bd630223186e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:55.945672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a07a916-1056-4982-af2c-bd630223186e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:55.946699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a07a916-1056-4982-af2c-bd630223186e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:55.950513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a07a916-1056-4982-af2c-bd630223186e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:56.250856 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ce355081-cb47-43b1-8044-d8fe579de815 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:56.261656 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ce355081-cb47-43b1-8044-d8fe579de815 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1541 microversion: 2.1 time: 0.690168 Jul 28 03:49:56.262260 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1338/2993] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:55 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1541 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:56.281667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-20f382ea-079e-472d-ae09-6939854498f9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:56.282305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-20f382ea-079e-472d-ae09-6939854498f9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:56.305077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20f382ea-079e-472d-ae09-6939854498f9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:56.305908 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20f382ea-079e-472d-ae09-6939854498f9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:56.307242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20f382ea-079e-472d-ae09-6939854498f9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:56.308077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-20f382ea-079e-472d-ae09-6939854498f9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:56.884907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a07a916-1056-4982-af2c-bd630223186e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:56.894840 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a07a916-1056-4982-af2c-bd630223186e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1305 microversion: 2.1 time: 0.973125 Jul 28 03:49:56.899693 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1656/2994] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:55 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1305 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:56.914122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b4c7b890-f99c-4d44-8f51-50b8bf0fe94c req-510a7fc8-2c24-45cf-aac5-c83ad110e10e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42d51e5-d212-4768-bcef-1990cc448e06", "tag": "db626bfd-ae49-44f5-aa50-749c509840c2"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:56.930299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b4c7b890-f99c-4d44-8f51-50b8bf0fe94c req-510a7fc8-2c24-45cf-aac5-c83ad110e10e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:56.931143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b4c7b890-f99c-4d44-8f51-50b8bf0fe94c req-510a7fc8-2c24-45cf-aac5-c83ad110e10e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:56.945756 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b4c7b890-f99c-4d44-8f51-50b8bf0fe94c req-510a7fc8-2c24-45cf-aac5-c83ad110e10e service nova] Creating event network-changed:db626bfd-ae49-44f5-aa50-749c509840c2 for instance e42d51e5-d212-4768-bcef-1990cc448e06 on n-h2-826756-3 Jul 28 03:49:56.952341 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b4c7b890-f99c-4d44-8f51-50b8bf0fe94c req-510a7fc8-2c24-45cf-aac5-c83ad110e10e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050907 Jul 28 03:49:56.953810 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1657/2995] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:49:57.285727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ec4c60b3-e848-4170-8866-fe1d40efeaf1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:57.286998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ec4c60b3-e848-4170-8866-fe1d40efeaf1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:57.300787 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-20f382ea-079e-472d-ae09-6939854498f9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:57.303623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec4c60b3-e848-4170-8866-fe1d40efeaf1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:57.304207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec4c60b3-e848-4170-8866-fe1d40efeaf1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:57.312179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec4c60b3-e848-4170-8866-fe1d40efeaf1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:57.312952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec4c60b3-e848-4170-8866-fe1d40efeaf1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:57.314256 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-20f382ea-079e-472d-ae09-6939854498f9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 1.050860 Jul 28 03:49:57.320774 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1339/2996] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:56 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:57.668445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ec4c60b3-e848-4170-8866-fe1d40efeaf1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:57.686329 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ec4c60b3-e848-4170-8866-fe1d40efeaf1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1473 microversion: 2.1 time: 0.407717 Jul 28 03:49:57.688083 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1658/2997] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:57 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1473 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:57.915618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-46137fc7-14fd-4168-88db-79f5eb1d3589 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:57.916208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-46137fc7-14fd-4168-88db-79f5eb1d3589 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:57.925620 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46137fc7-14fd-4168-88db-79f5eb1d3589 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:57.925800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46137fc7-14fd-4168-88db-79f5eb1d3589 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:57.926445 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46137fc7-14fd-4168-88db-79f5eb1d3589 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:57.926955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46137fc7-14fd-4168-88db-79f5eb1d3589 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:58.342247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40564bf7-9907-4c9e-b10b-6c5527e570b3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:58.343586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40564bf7-9907-4c9e-b10b-6c5527e570b3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:58.359317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40564bf7-9907-4c9e-b10b-6c5527e570b3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:58.361294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40564bf7-9907-4c9e-b10b-6c5527e570b3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:58.364276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40564bf7-9907-4c9e-b10b-6c5527e570b3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:58.366969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40564bf7-9907-4c9e-b10b-6c5527e570b3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:59.312151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40564bf7-9907-4c9e-b10b-6c5527e570b3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:59.320871 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40564bf7-9907-4c9e-b10b-6c5527e570b3 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 0.982891 Jul 28 03:49:59.321700 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1659/2998] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:58 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:49:59.326712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43e246b3-aac5-463a-8fe5-f4ad2011eb4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:59.327585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-43e246b3-aac5-463a-8fe5-f4ad2011eb4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:59.335016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43e246b3-aac5-463a-8fe5-f4ad2011eb4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:59.335735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43e246b3-aac5-463a-8fe5-f4ad2011eb4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:59.336717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43e246b3-aac5-463a-8fe5-f4ad2011eb4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:59.337314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43e246b3-aac5-463a-8fe5-f4ad2011eb4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:59.366933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-46137fc7-14fd-4168-88db-79f5eb1d3589 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:59.377278 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-46137fc7-14fd-4168-88db-79f5eb1d3589 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1305 microversion: 2.1 time: 1.465652 Jul 28 03:49:59.383715 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1340/2999] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:57 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1305 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:59.397634 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d2975002-57cb-4f14-96ef-60153abf4678 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:59.398463 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d2975002-57cb-4f14-96ef-60153abf4678 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:59.408874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2975002-57cb-4f14-96ef-60153abf4678 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:59.409706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2975002-57cb-4f14-96ef-60153abf4678 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:59.410912 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2975002-57cb-4f14-96ef-60153abf4678 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:59.411648 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2975002-57cb-4f14-96ef-60153abf4678 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:59.447030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:59.454776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d2975002-57cb-4f14-96ef-60153abf4678 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:49:59.500254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=20 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:49:59.627935 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d2975002-57cb-4f14-96ef-60153abf4678 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 204 len: 0 microversion: 2.1 time: 0.240896 Jul 28 03:49:59.629423 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1341/3000] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:49:59 2022] DELETE /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:49:59.642225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cf050156-40f8-47bf-82a5-1e1458eaef83 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:49:59.643848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cf050156-40f8-47bf-82a5-1e1458eaef83 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:59.652182 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cf050156-40f8-47bf-82a5-1e1458eaef83 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:59.652660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cf050156-40f8-47bf-82a5-1e1458eaef83 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:59.653480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cf050156-40f8-47bf-82a5-1e1458eaef83 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:59.655269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cf050156-40f8-47bf-82a5-1e1458eaef83 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:59.731839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-43e246b3-aac5-463a-8fe5-f4ad2011eb4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:49:59.747970 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43e246b3-aac5-463a-8fe5-f4ad2011eb4e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1470 microversion: 2.1 time: 0.424816 Jul 28 03:49:59.750095 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1660/3001] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:59 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1470 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:49:59.777368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d6af87c6-3561-4780-9a06-2d838cd0cce9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:49:59.785523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d6af87c6-3561-4780-9a06-2d838cd0cce9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:49:59.799108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6af87c6-3561-4780-9a06-2d838cd0cce9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:59.800759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6af87c6-3561-4780-9a06-2d838cd0cce9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:59.801851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6af87c6-3561-4780-9a06-2d838cd0cce9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:59.802568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6af87c6-3561-4780-9a06-2d838cd0cce9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:59.928547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6af87c6-3561-4780-9a06-2d838cd0cce9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:59.929323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6af87c6-3561-4780-9a06-2d838cd0cce9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:59.932977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6af87c6-3561-4780-9a06-2d838cd0cce9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:49:59.933820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6af87c6-3561-4780-9a06-2d838cd0cce9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:49:59.996512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-d6af87c6-3561-4780-9a06-2d838cd0cce9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Getting quotas for project da4a22e4560a4210bb58942cec62c091. Resources: {'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:50:00.011714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-d6af87c6-3561-4780-9a06-2d838cd0cce9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Getting quotas for user ac9d734be6ee4b549f9ed389c276f54a and project da4a22e4560a4210bb58942cec62c091. Resources: {'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:50:00.068737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:00.250028 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d6af87c6-3561-4780-9a06-2d838cd0cce9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "POST /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752/action" status: 202 len: 0 microversion: 2.1 time: 0.479758 Jul 28 03:50:00.251749 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1661/3002] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:49:59 2022] POST /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:50:00.264477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-76cd9cb4-2ef7-4b4f-b2d2-0337a4140ed4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:00.265597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-76cd9cb4-2ef7-4b4f-b2d2-0337a4140ed4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:00.276629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76cd9cb4-2ef7-4b4f-b2d2-0337a4140ed4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:00.277399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76cd9cb4-2ef7-4b4f-b2d2-0337a4140ed4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:00.278387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76cd9cb4-2ef7-4b4f-b2d2-0337a4140ed4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:00.278985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76cd9cb4-2ef7-4b4f-b2d2-0337a4140ed4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:00.346970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:00.696861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cf050156-40f8-47bf-82a5-1e1458eaef83 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:00.727843 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cf050156-40f8-47bf-82a5-1e1458eaef83 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1555 microversion: 2.1 time: 1.092964 Jul 28 03:50:00.735897 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1342/3003] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:49:59 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1555 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:00.776525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-038b69c7-4453-4c23-8a65-9dfad13b5829 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:00.777898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-038b69c7-4453-4c23-8a65-9dfad13b5829 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:00.799152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-038b69c7-4453-4c23-8a65-9dfad13b5829 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:00.800179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-038b69c7-4453-4c23-8a65-9dfad13b5829 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:00.801481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-038b69c7-4453-4c23-8a65-9dfad13b5829 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:00.802107 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-038b69c7-4453-4c23-8a65-9dfad13b5829 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:01.051254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-76cd9cb4-2ef7-4b4f-b2d2-0337a4140ed4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:01.064344 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-76cd9cb4-2ef7-4b4f-b2d2-0337a4140ed4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1469 microversion: 2.1 time: 0.805181 Jul 28 03:50:01.067033 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1662/3004] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:00 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1469 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:01.076101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8e57f162-d567-4bdc-8c12-ae87a8068f4d tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:01.084408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8e57f162-d567-4bdc-8c12-ae87a8068f4d tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:01.101068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e57f162-d567-4bdc-8c12-ae87a8068f4d tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:01.101793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e57f162-d567-4bdc-8c12-ae87a8068f4d tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:01.102748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e57f162-d567-4bdc-8c12-ae87a8068f4d tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:01.106819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e57f162-d567-4bdc-8c12-ae87a8068f4d tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:01.321969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-038b69c7-4453-4c23-8a65-9dfad13b5829 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:01.333030 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-038b69c7-4453-4c23-8a65-9dfad13b5829 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 0.595275 Jul 28 03:50:01.336380 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1343/3005] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:00 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:01.346520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-41ec0532-4307-4cf3-99eb-f5163556692a req-741db088-6f27-4884-9e84-de114c080827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed99415-e36a-431c-a33c-c609912af752", "name": "network-vif-plugged", "status": "completed", "tag": "fe3c986d-7298-4555-ba29-5e1b4c7e6981"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:01.376539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-41ec0532-4307-4cf3-99eb-f5163556692a req-741db088-6f27-4884-9e84-de114c080827 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:01.377257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-41ec0532-4307-4cf3-99eb-f5163556692a req-741db088-6f27-4884-9e84-de114c080827 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:01.403787 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-41ec0532-4307-4cf3-99eb-f5163556692a req-741db088-6f27-4884-9e84-de114c080827 service nova] Creating event network-vif-plugged:fe3c986d-7298-4555-ba29-5e1b4c7e6981 for instance bed99415-e36a-431c-a33c-c609912af752 on n-h2-826756-3 Jul 28 03:50:01.423219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [req-41ec0532-4307-4cf3-99eb-f5163556692a req-741db088-6f27-4884-9e84-de114c080827 service nova] Instance bed99415-e36a-431c-a33c-c609912af752 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:50:01.446598 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-41ec0532-4307-4cf3-99eb-f5163556692a req-741db088-6f27-4884-9e84-de114c080827 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106296 Jul 28 03:50:01.447247 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1344/3006] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:01.570239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-af0aec13-d290-458b-b20c-2b754d0a7f54 req-46aa34c8-cb0b-4aaa-9362-ed74ae018e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e42d51e5-d212-4768-bcef-1990cc448e06", "tag": "4612f5a9-e8fb-4fac-8539-f4d3f8624a31"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:01.598921 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-af0aec13-d290-458b-b20c-2b754d0a7f54 req-46aa34c8-cb0b-4aaa-9362-ed74ae018e6c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:01.602078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-af0aec13-d290-458b-b20c-2b754d0a7f54 req-46aa34c8-cb0b-4aaa-9362-ed74ae018e6c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:01.619280 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-af0aec13-d290-458b-b20c-2b754d0a7f54 req-46aa34c8-cb0b-4aaa-9362-ed74ae018e6c service nova] Creating event network-changed:4612f5a9-e8fb-4fac-8539-f4d3f8624a31 for instance e42d51e5-d212-4768-bcef-1990cc448e06 on n-h2-826756-3 Jul 28 03:50:01.625837 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-af0aec13-d290-458b-b20c-2b754d0a7f54 req-46aa34c8-cb0b-4aaa-9362-ed74ae018e6c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059633 Jul 28 03:50:01.626812 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1345/3007] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:50:01.768277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-873df779-5e81-407d-a995-68d1ed9be194 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:01.769145 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-873df779-5e81-407d-a995-68d1ed9be194 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:01.779759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-873df779-5e81-407d-a995-68d1ed9be194 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:01.780990 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-873df779-5e81-407d-a995-68d1ed9be194 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:01.782118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-873df779-5e81-407d-a995-68d1ed9be194 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:01.782635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-873df779-5e81-407d-a995-68d1ed9be194 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:02.208876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8e57f162-d567-4bdc-8c12-ae87a8068f4d tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:02.232611 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8e57f162-d567-4bdc-8c12-ae87a8068f4d tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1293 microversion: 2.1 time: 1.163238 Jul 28 03:50:02.234218 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1663/3008] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:01 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1293 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:02.248238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ec3faf6d-f4e8-4c06-b94e-6440fdfe8acb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:02.256783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ec3faf6d-f4e8-4c06-b94e-6440fdfe8acb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:02.271881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec3faf6d-f4e8-4c06-b94e-6440fdfe8acb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:02.273325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec3faf6d-f4e8-4c06-b94e-6440fdfe8acb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:02.276978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec3faf6d-f4e8-4c06-b94e-6440fdfe8acb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:02.277899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec3faf6d-f4e8-4c06-b94e-6440fdfe8acb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:02.833910 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-873df779-5e81-407d-a995-68d1ed9be194 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:02.851306 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-873df779-5e81-407d-a995-68d1ed9be194 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1555 microversion: 2.1 time: 1.091949 Jul 28 03:50:02.852571 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1346/3009] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:01 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1555 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:02.862522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8c4e86da-23a4-4ed2-a204-f9205a80a9ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:02.863459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8c4e86da-23a4-4ed2-a204-f9205a80a9ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:02.870951 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c4e86da-23a4-4ed2-a204-f9205a80a9ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:02.871592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c4e86da-23a4-4ed2-a204-f9205a80a9ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:02.872639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c4e86da-23a4-4ed2-a204-f9205a80a9ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:02.873348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c4e86da-23a4-4ed2-a204-f9205a80a9ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:03.300576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8c4e86da-23a4-4ed2-a204-f9205a80a9ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:03.315199 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8c4e86da-23a4-4ed2-a204-f9205a80a9ae tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 0.461140 Jul 28 03:50:03.316275 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1347/3010] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:02 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:03.340016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6f8f732b-5f1e-4532-9f03-61788e39d464 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:03.341118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6f8f732b-5f1e-4532-9f03-61788e39d464 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:03.350776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f8f732b-5f1e-4532-9f03-61788e39d464 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:03.352977 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f8f732b-5f1e-4532-9f03-61788e39d464 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:03.354304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f8f732b-5f1e-4532-9f03-61788e39d464 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:03.355110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f8f732b-5f1e-4532-9f03-61788e39d464 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:03.537444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ec3faf6d-f4e8-4c06-b94e-6440fdfe8acb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:03.549866 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ec3faf6d-f4e8-4c06-b94e-6440fdfe8acb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1469 microversion: 2.1 time: 1.312521 Jul 28 03:50:03.553363 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1664/3011] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:02 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1469 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:03.565200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-744a4d58-d783-46a9-b67d-5962c70e3d3f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:03.568209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-744a4d58-d783-46a9-b67d-5962c70e3d3f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:03.581580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-744a4d58-d783-46a9-b67d-5962c70e3d3f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:03.582034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-744a4d58-d783-46a9-b67d-5962c70e3d3f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:03.582831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-744a4d58-d783-46a9-b67d-5962c70e3d3f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:03.583275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-744a4d58-d783-46a9-b67d-5962c70e3d3f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:03.647728 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-744a4d58-d783-46a9-b67d-5962c70e3d3f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/ips" status: 200 len: 148 microversion: 2.1 time: 0.092797 Jul 28 03:50:03.649238 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1665/3012] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:50:03 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/ips => generated 148 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:03.663507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9b266617-7d60-47bf-9d7d-01eb12b2c061 req-1aa93d1d-480f-4760-988d-28ab4000f914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f57a0500-5de5-48e7-bc4e-c25234ca8fa6", "tag": "f50067a7-443a-48a2-a22b-703b731470d5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:03.689514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9b266617-7d60-47bf-9d7d-01eb12b2c061 req-1aa93d1d-480f-4760-988d-28ab4000f914 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:03.690438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9b266617-7d60-47bf-9d7d-01eb12b2c061 req-1aa93d1d-480f-4760-988d-28ab4000f914 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:03.729891 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9b266617-7d60-47bf-9d7d-01eb12b2c061 req-1aa93d1d-480f-4760-988d-28ab4000f914 service nova] Creating event network-changed:f50067a7-443a-48a2-a22b-703b731470d5 for instance f57a0500-5de5-48e7-bc4e-c25234ca8fa6 on n-h2-826756-3 Jul 28 03:50:03.743669 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9b266617-7d60-47bf-9d7d-01eb12b2c061 req-1aa93d1d-480f-4760-988d-28ab4000f914 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084795 Jul 28 03:50:03.744336 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1666/3013] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:03.861426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6f8f732b-5f1e-4532-9f03-61788e39d464 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:03.874829 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6f8f732b-5f1e-4532-9f03-61788e39d464 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1293 microversion: 2.1 time: 0.540018 Jul 28 03:50:03.879189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9cfad4f-a054-4cf0-8a24-3479e76b2eb2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:03.885887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9cfad4f-a054-4cf0-8a24-3479e76b2eb2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:03.886211 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1348/3014] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:03 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1293 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:03.901200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9cfad4f-a054-4cf0-8a24-3479e76b2eb2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:03.901703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9cfad4f-a054-4cf0-8a24-3479e76b2eb2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:03.902526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9cfad4f-a054-4cf0-8a24-3479e76b2eb2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:03.902974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9cfad4f-a054-4cf0-8a24-3479e76b2eb2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:04.341583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-32e4edc8-393a-48b7-8e82-938f09aa957e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:04.342479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-32e4edc8-393a-48b7-8e82-938f09aa957e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:04.351251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-32e4edc8-393a-48b7-8e82-938f09aa957e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:04.352003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-32e4edc8-393a-48b7-8e82-938f09aa957e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:04.353019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-32e4edc8-393a-48b7-8e82-938f09aa957e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:04.353724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-32e4edc8-393a-48b7-8e82-938f09aa957e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:04.567562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-32e4edc8-393a-48b7-8e82-938f09aa957e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:04.573260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b9cfad4f-a054-4cf0-8a24-3479e76b2eb2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:04.587162 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-32e4edc8-393a-48b7-8e82-938f09aa957e tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 0.249007 Jul 28 03:50:04.590845 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9cfad4f-a054-4cf0-8a24-3479e76b2eb2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1555 microversion: 2.1 time: 0.719356 Jul 28 03:50:04.606768 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1667/3015] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:03 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1555 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:04.607274 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1349/3016] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:04 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:04.613607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-de476f38-b1a0-4c1a-95a0-dd6fb520b292 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:04.614377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-de476f38-b1a0-4c1a-95a0-dd6fb520b292 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:04.623284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de476f38-b1a0-4c1a-95a0-dd6fb520b292 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:04.624281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de476f38-b1a0-4c1a-95a0-dd6fb520b292 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:04.626115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de476f38-b1a0-4c1a-95a0-dd6fb520b292 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:04.627572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de476f38-b1a0-4c1a-95a0-dd6fb520b292 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:04.867910 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-1e6a9321-b7c6-4a23-bf09-97ea2dfee99c req-e3fb0cb1-260b-4a2d-b591-4557c0804808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c47b71f0-424f-4b3b-ae6c-9f38a83a43e0", "name": "network-vif-deleted", "tag": "c298f163-bf0d-4e1a-8620-2badd0279e63"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:04.884264 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1e6a9321-b7c6-4a23-bf09-97ea2dfee99c req-e3fb0cb1-260b-4a2d-b591-4557c0804808 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:04.884731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1e6a9321-b7c6-4a23-bf09-97ea2dfee99c req-e3fb0cb1-260b-4a2d-b591-4557c0804808 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:04.906433 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-1e6a9321-b7c6-4a23-bf09-97ea2dfee99c req-e3fb0cb1-260b-4a2d-b591-4557c0804808 service nova] Creating event network-vif-deleted:c298f163-bf0d-4e1a-8620-2badd0279e63 for instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 on n-h1-826756-3 Jul 28 03:50:04.913846 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-1e6a9321-b7c6-4a23-bf09-97ea2dfee99c req-e3fb0cb1-260b-4a2d-b591-4557c0804808 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049527 Jul 28 03:50:04.915502 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1350/3017] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:04.926193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-514183e1-3829-41f3-9511-76efadfc45c9 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:04.926896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-514183e1-3829-41f3-9511-76efadfc45c9 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:04.934762 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-514183e1-3829-41f3-9511-76efadfc45c9 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:04.936510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-514183e1-3829-41f3-9511-76efadfc45c9 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:04.938251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-514183e1-3829-41f3-9511-76efadfc45c9 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:04.939649 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-514183e1-3829-41f3-9511-76efadfc45c9 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:05.339399 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-514183e1-3829-41f3-9511-76efadfc45c9 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:05.352468 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-514183e1-3829-41f3-9511-76efadfc45c9 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1293 microversion: 2.1 time: 0.434687 Jul 28 03:50:05.361783 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1351/3018] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:04 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1293 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:05.460116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-de476f38-b1a0-4c1a-95a0-dd6fb520b292 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:05.475462 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-de476f38-b1a0-4c1a-95a0-dd6fb520b292 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1469 microversion: 2.1 time: 0.867073 Jul 28 03:50:05.482454 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1668/3019] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:04 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1469 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:05.616018 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-02e4fc6f-5f64-4f7a-bd8d-2d547aba16b1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:05.617603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-02e4fc6f-5f64-4f7a-bd8d-2d547aba16b1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:05.620875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0f4c00b-06c7-46db-9343-5f45766f42ea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:05.621690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e0f4c00b-06c7-46db-9343-5f45766f42ea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:05.632998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0f4c00b-06c7-46db-9343-5f45766f42ea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:05.633848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0f4c00b-06c7-46db-9343-5f45766f42ea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:05.634893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0f4c00b-06c7-46db-9343-5f45766f42ea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:05.635615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0f4c00b-06c7-46db-9343-5f45766f42ea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:05.636493 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02e4fc6f-5f64-4f7a-bd8d-2d547aba16b1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:05.648999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02e4fc6f-5f64-4f7a-bd8d-2d547aba16b1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:05.650199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02e4fc6f-5f64-4f7a-bd8d-2d547aba16b1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:05.653754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02e4fc6f-5f64-4f7a-bd8d-2d547aba16b1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:05.918542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e0f4c00b-06c7-46db-9343-5f45766f42ea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:05.950213 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e0f4c00b-06c7-46db-9343-5f45766f42ea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1346 microversion: 2.1 time: 0.333921 Jul 28 03:50:05.951168 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1669/3020] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:05 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1346 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:06.227134 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-02e4fc6f-5f64-4f7a-bd8d-2d547aba16b1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:06.246470 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-02e4fc6f-5f64-4f7a-bd8d-2d547aba16b1 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 0.635003 Jul 28 03:50:06.250453 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1352/3021] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:05 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:06.388826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-efcd5538-4b2b-45c1-a450-9432878ab7d7 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:06.389705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-efcd5538-4b2b-45c1-a450-9432878ab7d7 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:06.410823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efcd5538-4b2b-45c1-a450-9432878ab7d7 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:06.411629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efcd5538-4b2b-45c1-a450-9432878ab7d7 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:06.413619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efcd5538-4b2b-45c1-a450-9432878ab7d7 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:06.414814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efcd5538-4b2b-45c1-a450-9432878ab7d7 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:06.436475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:06.495592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-baff9402-0dbd-44d7-a17c-aa3657ba3930 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4553306-07a9-43fd-9c5b-33fe1c8547ac"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:06.498258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-baff9402-0dbd-44d7-a17c-aa3657ba3930 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:06.505870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-baff9402-0dbd-44d7-a17c-aa3657ba3930 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:06.506322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-baff9402-0dbd-44d7-a17c-aa3657ba3930 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:06.507884 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-baff9402-0dbd-44d7-a17c-aa3657ba3930 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:06.508325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-baff9402-0dbd-44d7-a17c-aa3657ba3930 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:06.938090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:06.967391 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-baff9402-0dbd-44d7-a17c-aa3657ba3930 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "POST /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.475657 Jul 28 03:50:06.985583 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1353/3022] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 03:50:06 2022] POST /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments => generated 194 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:06.995149 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-41169d90-214b-42d5-9ae1-27161574609d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:06.995903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-41169d90-214b-42d5-9ae1-27161574609d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:07.018058 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41169d90-214b-42d5-9ae1-27161574609d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:07.018337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41169d90-214b-42d5-9ae1-27161574609d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:07.019188 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41169d90-214b-42d5-9ae1-27161574609d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:07.021530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41169d90-214b-42d5-9ae1-27161574609d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:07.333630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-efcd5538-4b2b-45c1-a450-9432878ab7d7 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:07.350263 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-efcd5538-4b2b-45c1-a450-9432878ab7d7 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1293 microversion: 2.1 time: 0.965368 Jul 28 03:50:07.365766 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1670/3023] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:06 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1293 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:07.380231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-04cf688e-384b-47f0-9d07-c4db90629298 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:07.381741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-04cf688e-384b-47f0-9d07-c4db90629298 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:07.407877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04cf688e-384b-47f0-9d07-c4db90629298 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:07.408677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04cf688e-384b-47f0-9d07-c4db90629298 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:07.409646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04cf688e-384b-47f0-9d07-c4db90629298 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:07.410936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04cf688e-384b-47f0-9d07-c4db90629298 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:07.864708 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-41169d90-214b-42d5-9ae1-27161574609d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:07.877637 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-41169d90-214b-42d5-9ae1-27161574609d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1535 microversion: 2.1 time: 0.889863 Jul 28 03:50:07.878564 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1354/3024] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:06 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1535 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:07.894275 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2607bf19-50f6-4a8b-91c6-e7819ff08f64 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:07.896169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2607bf19-50f6-4a8b-91c6-e7819ff08f64 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:07.916669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:07.938408 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2607bf19-50f6-4a8b-91c6-e7819ff08f64 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:07.939405 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2607bf19-50f6-4a8b-91c6-e7819ff08f64 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:07.940775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2607bf19-50f6-4a8b-91c6-e7819ff08f64 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:07.941556 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2607bf19-50f6-4a8b-91c6-e7819ff08f64 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:08.439833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2607bf19-50f6-4a8b-91c6-e7819ff08f64 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:08.451851 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2607bf19-50f6-4a8b-91c6-e7819ff08f64 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 0.568861 Jul 28 03:50:08.452489 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1355/3025] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:07 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:08.458510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-47549ba3-0295-47bc-9eea-15fb1bc39b43 req-97733d2d-fbd8-40f1-bab5-6ad5f27eb8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed99415-e36a-431c-a33c-c609912af752", "name": "network-vif-unplugged", "status": "completed", "tag": "fe3c986d-7298-4555-ba29-5e1b4c7e6981"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:08.471115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-47549ba3-0295-47bc-9eea-15fb1bc39b43 req-97733d2d-fbd8-40f1-bab5-6ad5f27eb8dd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:08.471996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-47549ba3-0295-47bc-9eea-15fb1bc39b43 req-97733d2d-fbd8-40f1-bab5-6ad5f27eb8dd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:08.489642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-04cf688e-384b-47f0-9d07-c4db90629298 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:08.508489 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-47549ba3-0295-47bc-9eea-15fb1bc39b43 req-97733d2d-fbd8-40f1-bab5-6ad5f27eb8dd service nova] Creating event network-vif-unplugged:fe3c986d-7298-4555-ba29-5e1b4c7e6981 for instance bed99415-e36a-431c-a33c-c609912af752 on n-h1-826756-3 Jul 28 03:50:08.518668 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-04cf688e-384b-47f0-9d07-c4db90629298 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1346 microversion: 2.1 time: 1.151352 Jul 28 03:50:08.522380 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [req-47549ba3-0295-47bc-9eea-15fb1bc39b43 req-97733d2d-fbd8-40f1-bab5-6ad5f27eb8dd service nova] Instance bed99415-e36a-431c-a33c-c609912af752 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:50:08.546409 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-47549ba3-0295-47bc-9eea-15fb1bc39b43 req-97733d2d-fbd8-40f1-bab5-6ad5f27eb8dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092196 Jul 28 03:50:08.547422 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1356/3026] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:08.548393 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1671/3027] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:07 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1346 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:08.554592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ef33aeb2-f444-4965-8151-8e5dd1cb99ff tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:08.555891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ef33aeb2-f444-4965-8151-8e5dd1cb99ff tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:08.563561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ef33aeb2-f444-4965-8151-8e5dd1cb99ff tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:08.564619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ef33aeb2-f444-4965-8151-8e5dd1cb99ff tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:08.565919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ef33aeb2-f444-4965-8151-8e5dd1cb99ff tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:08.566912 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ef33aeb2-f444-4965-8151-8e5dd1cb99ff tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:08.900238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-64cb9a9a-239d-40b5-b60c-09457685857c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:08.900940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-64cb9a9a-239d-40b5-b60c-09457685857c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:08.920542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64cb9a9a-239d-40b5-b60c-09457685857c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:08.924008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64cb9a9a-239d-40b5-b60c-09457685857c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:08.924255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ef33aeb2-f444-4965-8151-8e5dd1cb99ff tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:08.925688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64cb9a9a-239d-40b5-b60c-09457685857c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:08.926307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64cb9a9a-239d-40b5-b60c-09457685857c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:08.936896 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ef33aeb2-f444-4965-8151-8e5dd1cb99ff tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1293 microversion: 2.1 time: 0.386458 Jul 28 03:50:08.938972 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1357/3028] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:08 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1293 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:09.482960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-64cb9a9a-239d-40b5-b60c-09457685857c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:09.484039 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c2fdfd59-708f-46f0-864e-32739b5ee63a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:09.485307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c2fdfd59-708f-46f0-864e-32739b5ee63a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:09.499941 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-64cb9a9a-239d-40b5-b60c-09457685857c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1535 microversion: 2.1 time: 0.603600 Jul 28 03:50:09.502432 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1672/3029] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:08 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1535 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:09.514629 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2fdfd59-708f-46f0-864e-32739b5ee63a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:09.515586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2fdfd59-708f-46f0-864e-32739b5ee63a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:09.518140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2fdfd59-708f-46f0-864e-32739b5ee63a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:09.522815 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2fdfd59-708f-46f0-864e-32739b5ee63a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:09.553482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d9e7e55c-0c57-4ee5-8005-e9cff1a9ba6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:09.553482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d9e7e55c-0c57-4ee5-8005-e9cff1a9ba6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:09.568376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9e7e55c-0c57-4ee5-8005-e9cff1a9ba6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:09.568826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9e7e55c-0c57-4ee5-8005-e9cff1a9ba6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:09.569625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9e7e55c-0c57-4ee5-8005-e9cff1a9ba6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:09.570074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9e7e55c-0c57-4ee5-8005-e9cff1a9ba6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:09.833314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d9e7e55c-0c57-4ee5-8005-e9cff1a9ba6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:09.854547 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d9e7e55c-0c57-4ee5-8005-e9cff1a9ba6a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1346 microversion: 2.1 time: 0.305892 Jul 28 03:50:09.855475 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1673/3030] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:09 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1346 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:09.962787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3121bd34-7060-4f4f-a56f-f4883cc08d1f tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:09.963757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3121bd34-7060-4f4f-a56f-f4883cc08d1f tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:09.977996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:09.980061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3121bd34-7060-4f4f-a56f-f4883cc08d1f tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:09.980747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3121bd34-7060-4f4f-a56f-f4883cc08d1f tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:09.983316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3121bd34-7060-4f4f-a56f-f4883cc08d1f tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:09.983771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3121bd34-7060-4f4f-a56f-f4883cc08d1f tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:10.175892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c2fdfd59-708f-46f0-864e-32739b5ee63a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:10.190897 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c2fdfd59-708f-46f0-864e-32739b5ee63a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 0.712685 Jul 28 03:50:10.191867 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1358/3031] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:09 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:10.523157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7dea1f2f-66a4-476b-be90-dfa7cd021522 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:10.524008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7dea1f2f-66a4-476b-be90-dfa7cd021522 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:10.546068 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7dea1f2f-66a4-476b-be90-dfa7cd021522 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:10.546778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7dea1f2f-66a4-476b-be90-dfa7cd021522 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:10.547767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7dea1f2f-66a4-476b-be90-dfa7cd021522 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:10.548417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7dea1f2f-66a4-476b-be90-dfa7cd021522 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:10.608794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3121bd34-7060-4f4f-a56f-f4883cc08d1f tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:10.618095 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3121bd34-7060-4f4f-a56f-f4883cc08d1f tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1293 microversion: 2.1 time: 0.659247 Jul 28 03:50:10.625273 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1674/3032] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:09 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1293 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:10.641602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e0e043f7-dc3a-497b-bac8-fffd8d29b95d req-747bbb87-45fa-420e-a28a-f1002f4611ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed99415-e36a-431c-a33c-c609912af752", "tag": "fe3c986d-7298-4555-ba29-5e1b4c7e6981"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:10.665202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e0e043f7-dc3a-497b-bac8-fffd8d29b95d req-747bbb87-45fa-420e-a28a-f1002f4611ec service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:10.665738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e0e043f7-dc3a-497b-bac8-fffd8d29b95d req-747bbb87-45fa-420e-a28a-f1002f4611ec service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:10.714510 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e0e043f7-dc3a-497b-bac8-fffd8d29b95d req-747bbb87-45fa-420e-a28a-f1002f4611ec service nova] Creating event network-changed:fe3c986d-7298-4555-ba29-5e1b4c7e6981 for instance bed99415-e36a-431c-a33c-c609912af752 on n-h1-826756-3 Jul 28 03:50:10.730752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-e0e043f7-dc3a-497b-bac8-fffd8d29b95d req-747bbb87-45fa-420e-a28a-f1002f4611ec service nova] Instance bed99415-e36a-431c-a33c-c609912af752 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:50:10.763588 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e0e043f7-dc3a-497b-bac8-fffd8d29b95d req-747bbb87-45fa-420e-a28a-f1002f4611ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136951 Jul 28 03:50:10.768954 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1675/3033] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:10.878271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-61fc3012-c8d6-439e-81b1-fd146cf71f19 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:10.879002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61fc3012-c8d6-439e-81b1-fd146cf71f19 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:10.887120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61fc3012-c8d6-439e-81b1-fd146cf71f19 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:10.887577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61fc3012-c8d6-439e-81b1-fd146cf71f19 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:10.896244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61fc3012-c8d6-439e-81b1-fd146cf71f19 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:10.916879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61fc3012-c8d6-439e-81b1-fd146cf71f19 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:11.131441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7dea1f2f-66a4-476b-be90-dfa7cd021522 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:11.168044 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7dea1f2f-66a4-476b-be90-dfa7cd021522 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1535 microversion: 2.1 time: 0.648539 Jul 28 03:50:11.192658 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1359/3034] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:10 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1535 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:11.212541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d2aab513-6909-43ef-aeef-9445f5288a84 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:11.216500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d2aab513-6909-43ef-aeef-9445f5288a84 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:11.255840 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2aab513-6909-43ef-aeef-9445f5288a84 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:11.256398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2aab513-6909-43ef-aeef-9445f5288a84 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:11.257234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2aab513-6909-43ef-aeef-9445f5288a84 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:11.257749 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2aab513-6909-43ef-aeef-9445f5288a84 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:11.261377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-61fc3012-c8d6-439e-81b1-fd146cf71f19 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:11.276949 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-61fc3012-c8d6-439e-81b1-fd146cf71f19 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 200 len: 1346 microversion: 2.1 time: 0.404518 Jul 28 03:50:11.289068 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1676/3035] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:10 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 1346 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:11.478141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-609893496", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:11.615350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] validate_networks() for [('89e6a438-5ad0-4d83-8f71-3f4222c4b6a4', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:50:11.691635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d2aab513-6909-43ef-aeef-9445f5288a84 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:11.702021 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d2aab513-6909-43ef-aeef-9445f5288a84 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 0.494353 Jul 28 03:50:11.703181 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1360/3036] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:11 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:11.708933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6d10de9a-0e01-45d3-801c-b0f89c76a242 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:11.709562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6d10de9a-0e01-45d3-801c-b0f89c76a242 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:11.717567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6d10de9a-0e01-45d3-801c-b0f89c76a242 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:11.718027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6d10de9a-0e01-45d3-801c-b0f89c76a242 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:11.718811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6d10de9a-0e01-45d3-801c-b0f89c76a242 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:11.719746 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6d10de9a-0e01-45d3-801c-b0f89c76a242 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:12.091948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6d10de9a-0e01-45d3-801c-b0f89c76a242 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:12.101966 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6d10de9a-0e01-45d3-801c-b0f89c76a242 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1293 microversion: 2.1 time: 0.397541 Jul 28 03:50:12.102575 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1361/3037] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:11 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1293 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:12.222802 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0678f990-2f6c-4c5c-9b11-f2c25410e121 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:12.223493 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0678f990-2f6c-4c5c-9b11-f2c25410e121 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:12.244641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0678f990-2f6c-4c5c-9b11-f2c25410e121 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:12.245143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0678f990-2f6c-4c5c-9b11-f2c25410e121 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:12.245924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0678f990-2f6c-4c5c-9b11-f2c25410e121 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:12.246352 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0678f990-2f6c-4c5c-9b11-f2c25410e121 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:12.764069 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0678f990-2f6c-4c5c-9b11-f2c25410e121 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:12.773416 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0678f990-2f6c-4c5c-9b11-f2c25410e121 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1535 microversion: 2.1 time: 0.555699 Jul 28 03:50:12.782543 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1362/3038] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:12 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1535 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:12.801711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f081608d-fac0-463c-aa4d-886d2f530b36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:12.808127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f081608d-fac0-463c-aa4d-886d2f530b36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:12.826262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f081608d-fac0-463c-aa4d-886d2f530b36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:12.828245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f081608d-fac0-463c-aa4d-886d2f530b36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:12.831436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f081608d-fac0-463c-aa4d-886d2f530b36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:12.835328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f081608d-fac0-463c-aa4d-886d2f530b36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:12.879299 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-f081608d-fac0-463c-aa4d-886d2f530b36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f081608d-fac0-463c-aa4d-886d2f530b36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 HTTP/1.1 Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'c47b71f0-424f-4b3b-ae6c-9f38a83a43e0'} Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:12.882714 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:12.887068 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:12.887068 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:12.887068 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:12.887068 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:50:12.887068 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:50:12.887068 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:50:12.887068 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:12.887531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f081608d-fac0-463c-aa4d-886d2f530b36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:12.888143 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f081608d-fac0-463c-aa4d-886d2f530b36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 404 len: 111 microversion: 2.1 time: 0.104131 Jul 28 03:50:12.896412 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1363/3039] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:12 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:50:12.907349 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a407195b-1529-4b1d-8dca-b769c977aed9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:12.911452 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a407195b-1529-4b1d-8dca-b769c977aed9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:12.927866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a407195b-1529-4b1d-8dca-b769c977aed9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:12.931670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a407195b-1529-4b1d-8dca-b769c977aed9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:12.934681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a407195b-1529-4b1d-8dca-b769c977aed9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:12.935146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a407195b-1529-4b1d-8dca-b769c977aed9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:13.851060 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a407195b-1529-4b1d-8dca-b769c977aed9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:13.863930 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a407195b-1529-4b1d-8dca-b769c977aed9 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 0.965282 Jul 28 03:50:13.865226 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1364/3040] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:12 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:13.867079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:50:13.867543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:50:13.867991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:50:13.868666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:50:13.869090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:50:13.877737 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9f52a7ca-06bd-44de-a213-0cf2253df8be tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:13.878925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9f52a7ca-06bd-44de-a213-0cf2253df8be tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:13.882883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:13.883342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:13.894538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f52a7ca-06bd-44de-a213-0cf2253df8be tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:13.895994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:13.896622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:13.896964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f52a7ca-06bd-44de-a213-0cf2253df8be tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:13.898041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f52a7ca-06bd-44de-a213-0cf2253df8be tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:13.902033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f52a7ca-06bd-44de-a213-0cf2253df8be tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:13.953223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Getting quotas for project 14a740ef28ff4ceaa9879883f86d0da5. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:50:13.969711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Getting quotas for user 0b9f8f65f4724b7899491e805177cf1d and project 14a740ef28ff4ceaa9879883f86d0da5. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:50:14.007059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:50:14.017260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:50:14.109711 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f829e80f-d34b-48df-ad00-63a744b9f794 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.780838 Jul 28 03:50:14.114266 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1677/3041] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:50:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 2784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:50:14.129481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e23a613-382a-41ea-8f8f-c2165f14bfe4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:14.136810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0e23a613-382a-41ea-8f8f-c2165f14bfe4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:14.152895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e23a613-382a-41ea-8f8f-c2165f14bfe4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:14.153687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e23a613-382a-41ea-8f8f-c2165f14bfe4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:14.154710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e23a613-382a-41ea-8f8f-c2165f14bfe4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:14.157378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e23a613-382a-41ea-8f8f-c2165f14bfe4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:14.204454 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-0e23a613-382a-41ea-8f8f-c2165f14bfe4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e23a613-382a-41ea-8f8f-c2165f14bfe4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0/os-volume_attachments HTTP/1.1 Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': 'c47b71f0-424f-4b3b-ae6c-9f38a83a43e0'} Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:50:14.209158 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:50:14.213928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:50:14.213928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:14.213928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:14.213928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:14.213928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:14.213928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:14.213928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:14.213928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:50:14.213928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:50:14.213928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:50:14.213928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:14.215752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e23a613-382a-41ea-8f8f-c2165f14bfe4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:14.226664 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0e23a613-382a-41ea-8f8f-c2165f14bfe4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.110024 Jul 28 03:50:14.228521 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1678/3042] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:50:14 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0/os-volume_attachments => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:50:14.245841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d907bcb6-ec7f-4a7d-ac69-566f1a202ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:14.247564 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9f52a7ca-06bd-44de-a213-0cf2253df8be tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:14.247732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d907bcb6-ec7f-4a7d-ac69-566f1a202ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:14.275931 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9f52a7ca-06bd-44de-a213-0cf2253df8be tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1293 microversion: 2.1 time: 0.400096 Jul 28 03:50:14.276603 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1365/3043] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:13 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1293 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:14.286418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d907bcb6-ec7f-4a7d-ac69-566f1a202ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:14.292185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d907bcb6-ec7f-4a7d-ac69-566f1a202ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:14.296944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d907bcb6-ec7f-4a7d-ac69-566f1a202ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:14.311734 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3e6d54e1-aa28-48fd-8416-d0a4294d9f03 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:14.315506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3e6d54e1-aa28-48fd-8416-d0a4294d9f03 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:14.318194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d907bcb6-ec7f-4a7d-ac69-566f1a202ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:14.591426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3e6d54e1-aa28-48fd-8416-d0a4294d9f03 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:14.600339 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3e6d54e1-aa28-48fd-8416-d0a4294d9f03 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1213 microversion: 2.1 time: 0.317394 Jul 28 03:50:14.603811 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1366/3044] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:14 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1213 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:14.765694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-546871242", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "c540e59d-0550-4ece-8b64-1987a84fa206"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:14.877988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] validate_networks() for [('c540e59d-0550-4ece-8b64-1987a84fa206', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:50:15.271479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d907bcb6-ec7f-4a7d-ac69-566f1a202ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:15.294385 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d907bcb6-ec7f-4a7d-ac69-566f1a202ee4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1535 microversion: 2.1 time: 1.062704 Jul 28 03:50:15.299966 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1679/3045] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:14 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1535 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:15.318803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-babe3365-d045-43d9-bfa6-ebbfc2a17678 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:15.319921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-babe3365-d045-43d9-bfa6-ebbfc2a17678 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:15.329975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-babe3365-d045-43d9-bfa6-ebbfc2a17678 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:15.330847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-babe3365-d045-43d9-bfa6-ebbfc2a17678 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:15.331935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-babe3365-d045-43d9-bfa6-ebbfc2a17678 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:15.332675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-babe3365-d045-43d9-bfa6-ebbfc2a17678 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:16.072712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-babe3365-d045-43d9-bfa6-ebbfc2a17678 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:16.081648 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-babe3365-d045-43d9-bfa6-ebbfc2a17678 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 0.779007 Jul 28 03:50:16.092673 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1680/3046] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:15 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:16.100641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-91f8bac4-9412-4af6-9a26-0ded373d5e99 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:16.109770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-91f8bac4-9412-4af6-9a26-0ded373d5e99 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:16.121979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91f8bac4-9412-4af6-9a26-0ded373d5e99 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:16.122588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91f8bac4-9412-4af6-9a26-0ded373d5e99 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:16.138996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91f8bac4-9412-4af6-9a26-0ded373d5e99 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:16.145401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91f8bac4-9412-4af6-9a26-0ded373d5e99 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:16.387113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:50:16.387632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:50:16.387981 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:50:16.388399 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:50:16.390278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:50:16.412065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:16.413166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:16.416707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:16.417168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:16.470137 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Getting quotas for project 34ed8cbcca694b8794992388d95bf072. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:50:16.488033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Getting quotas for user 67fcd8c3ec5441e582a4852f0f1184b6 and project 34ed8cbcca694b8794992388d95bf072. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:50:16.527552 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:50:16.534579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:50:16.655018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-91f8bac4-9412-4af6-9a26-0ded373d5e99 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:16.666148 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-763bb79f-0150-4cd0-af61-fe1a567585a9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.906759 Jul 28 03:50:16.667233 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1367/3047] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:50:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:50:16.679294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-003437b4-e857-4ef2-b2f3-dac0107e052e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:16.680258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-003437b4-e857-4ef2-b2f3-dac0107e052e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:16.686925 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-91f8bac4-9412-4af6-9a26-0ded373d5e99 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1293 microversion: 2.1 time: 0.592866 Jul 28 03:50:16.696872 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1681/3048] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:16 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1293 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:16.737424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-003437b4-e857-4ef2-b2f3-dac0107e052e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:16.754463 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-003437b4-e857-4ef2-b2f3-dac0107e052e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:16.755825 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-003437b4-e857-4ef2-b2f3-dac0107e052e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:16.763686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-003437b4-e857-4ef2-b2f3-dac0107e052e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:16.897060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-550419793", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "3180c803-d610-4370-bdd1-6fffd42aed30"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:16.991653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] validate_networks() for [('3180c803-d610-4370-bdd1-6fffd42aed30', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:50:17.066735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-003437b4-e857-4ef2-b2f3-dac0107e052e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:17.078791 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-003437b4-e857-4ef2-b2f3-dac0107e052e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1271 microversion: 2.1 time: 0.410295 Jul 28 03:50:17.084744 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1368/3049] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:16 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1271 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:17.100429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-edd61e6f-19a2-4e50-b289-95dcc6ce4418 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:17.101297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-edd61e6f-19a2-4e50-b289-95dcc6ce4418 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:17.115493 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-edd61e6f-19a2-4e50-b289-95dcc6ce4418 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:17.119990 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-edd61e6f-19a2-4e50-b289-95dcc6ce4418 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:17.123781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-edd61e6f-19a2-4e50-b289-95dcc6ce4418 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:17.124569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-edd61e6f-19a2-4e50-b289-95dcc6ce4418 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:17.463429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-edd61e6f-19a2-4e50-b289-95dcc6ce4418 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:17.480946 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-edd61e6f-19a2-4e50-b289-95dcc6ce4418 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1528 microversion: 2.1 time: 0.390736 Jul 28 03:50:17.483167 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1369/3050] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:17 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1528 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:17.499169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-653c002c-12c4-4678-a419-b8bc3891adac tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:17.500962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-653c002c-12c4-4678-a419-b8bc3891adac tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:17.638811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:50:17.639465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:50:17.640099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:50:17.641145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:50:17.642043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:50:17.654031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:17.655243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:17.656805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:17.658196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:17.662069 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-653c002c-12c4-4678-a419-b8bc3891adac tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:17.683945 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-653c002c-12c4-4678-a419-b8bc3891adac tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 200 len: 1214 microversion: 2.1 time: 0.197402 Jul 28 03:50:17.684622 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1370/3051] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:17 2022] GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 1214 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:17.696550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-828af0fe-ccb1-4ac7-98e9-f3696b8e82b2 req-b73605cc-ea89-443d-b9fb-be4d2b0fb480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42d51e5-d212-4768-bcef-1990cc448e06", "name": "network-vif-plugged", "status": "completed", "tag": "4612f5a9-e8fb-4fac-8539-f4d3f8624a31"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:17.720711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-828af0fe-ccb1-4ac7-98e9-f3696b8e82b2 req-b73605cc-ea89-443d-b9fb-be4d2b0fb480 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:17.721170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-828af0fe-ccb1-4ac7-98e9-f3696b8e82b2 req-b73605cc-ea89-443d-b9fb-be4d2b0fb480 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:17.724979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Getting quotas for project 76cc5b82a9a440b9be30a49d71e0ec5c. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:50:17.738974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Getting quotas for user 468992e0518a48e290cbf3cdd8ac6af7 and project 76cc5b82a9a440b9be30a49d71e0ec5c. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:50:17.751609 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-828af0fe-ccb1-4ac7-98e9-f3696b8e82b2 req-b73605cc-ea89-443d-b9fb-be4d2b0fb480 service nova] Creating event network-vif-plugged:4612f5a9-e8fb-4fac-8539-f4d3f8624a31 for instance e42d51e5-d212-4768-bcef-1990cc448e06 on n-h2-826756-3 Jul 28 03:50:17.759713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:50:17.763266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:50:17.770842 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-828af0fe-ccb1-4ac7-98e9-f3696b8e82b2 req-b73605cc-ea89-443d-b9fb-be4d2b0fb480 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083917 Jul 28 03:50:17.771517 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1371/3052] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:17.779870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b7b0b553-52c4-47d4-b85d-4482d99b3138 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:17.786764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b7b0b553-52c4-47d4-b85d-4482d99b3138 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:17.823803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7b0b553-52c4-47d4-b85d-4482d99b3138 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:17.824394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7b0b553-52c4-47d4-b85d-4482d99b3138 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:17.825260 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7b0b553-52c4-47d4-b85d-4482d99b3138 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:17.825705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7b0b553-52c4-47d4-b85d-4482d99b3138 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:17.883158 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aba1c6a6-0dd7-42d0-8522-76f42e2634ff tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.172527 Jul 28 03:50:17.884136 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1682/3053] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:50:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:50:17.895895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06c57ef8-c19b-4b20-8cc1-d529b4b621a3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:17.896560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-06c57ef8-c19b-4b20-8cc1-d529b4b621a3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:17.917111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06c57ef8-c19b-4b20-8cc1-d529b4b621a3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:17.922694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06c57ef8-c19b-4b20-8cc1-d529b4b621a3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:17.928131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06c57ef8-c19b-4b20-8cc1-d529b4b621a3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:17.928582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06c57ef8-c19b-4b20-8cc1-d529b4b621a3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:18.328701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b7b0b553-52c4-47d4-b85d-4482d99b3138 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:18.343385 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b7b0b553-52c4-47d4-b85d-4482d99b3138 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 0.570363 Jul 28 03:50:18.345130 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1372/3054] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:17 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:18.354979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-06c57ef8-c19b-4b20-8cc1-d529b4b621a3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:18.360585 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ca19b1f3-9ec2-4ab2-a5df-c7d2f48b3048 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:18.365877 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ca19b1f3-9ec2-4ab2-a5df-c7d2f48b3048 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:18.368828 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-06c57ef8-c19b-4b20-8cc1-d529b4b621a3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1528 microversion: 2.1 time: 0.478618 Jul 28 03:50:18.371775 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1683/3055] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:17 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1528 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:18.388327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c451431f-0923-4d35-9dbb-fd446148aa6b tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:18.389329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c451431f-0923-4d35-9dbb-fd446148aa6b tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:18.401589 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ca19b1f3-9ec2-4ab2-a5df-c7d2f48b3048 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:18.405177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ca19b1f3-9ec2-4ab2-a5df-c7d2f48b3048 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:18.406438 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ca19b1f3-9ec2-4ab2-a5df-c7d2f48b3048 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:18.408900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ca19b1f3-9ec2-4ab2-a5df-c7d2f48b3048 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:18.420937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c451431f-0923-4d35-9dbb-fd446148aa6b tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:18.422532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c451431f-0923-4d35-9dbb-fd446148aa6b tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:18.426349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c451431f-0923-4d35-9dbb-fd446148aa6b tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:18.427781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c451431f-0923-4d35-9dbb-fd446148aa6b tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:18.502772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ca19b1f3-9ec2-4ab2-a5df-c7d2f48b3048 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:50:18.592960 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:18.710517 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ca19b1f3-9ec2-4ab2-a5df-c7d2f48b3048 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "DELETE /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 204 len: 0 microversion: 2.1 time: 0.360072 Jul 28 03:50:18.715838 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1373/3056] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:50:18 2022] DELETE /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:50:18.725035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3f725e98-cde7-424e-a5b6-a355041d15c1 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:18.726174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3f725e98-cde7-424e-a5b6-a355041d15c1 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:18.868578 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3f725e98-cde7-424e-a5b6-a355041d15c1 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:18.892390 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3f725e98-cde7-424e-a5b6-a355041d15c1 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1223 microversion: 2.1 time: 0.173890 Jul 28 03:50:18.914952 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1374/3057] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:18 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1223 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:18.923507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dc3b131f-b90e-45eb-96ba-d81987c93693 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:18.936729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dc3b131f-b90e-45eb-96ba-d81987c93693 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:18.946174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc3b131f-b90e-45eb-96ba-d81987c93693 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:18.950661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc3b131f-b90e-45eb-96ba-d81987c93693 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:18.952614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc3b131f-b90e-45eb-96ba-d81987c93693 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:18.956429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc3b131f-b90e-45eb-96ba-d81987c93693 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:19.032491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c451431f-0923-4d35-9dbb-fd446148aa6b tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:19.045298 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c451431f-0923-4d35-9dbb-fd446148aa6b tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1293 microversion: 2.1 time: 0.672076 Jul 28 03:50:19.048070 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1684/3058] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:18 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1293 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:19.064024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40e4b676-7014-428c-8359-0c0a613a7839 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:19.066965 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:50:19.066965 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:50:19.093592 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-40e4b676-7014-428c-8359-0c0a613a7839 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] HTTP exception thrown: Flavor 25b236a5-6057-4b96-be4b-132cf93d1f91 could not be found. Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40e4b676-7014-428c-8359-0c0a613a7839 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Request method failure captured: Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/flavors/25b236a5-6057-4b96-be4b-132cf93d1f91 HTTP/1.1 Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gaLAD94ZRb3pKvn6d85qdHVtOD3R5BSKAtwfaE0gLjrnBl1QXXx2gBhqmTCLEJPb1-MEQ7BMYYkSVWs240RaUtogtoMVB8mtI8W1dn2eXaPMcxRLhck7CaTi6v7vKzBPfwoOBGt8QvsVtFs-1yPIGyWPo6mOUGmD67_2cj5yB_qnec Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: c60fef00bbe244e6b4f34710d8c49b38 Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-MigrationsAdminTest-2045450230 Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c60fef00bbe244e6b4f34710d8c49b38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c60fef00bbe244e6b4f34710d8c49b38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c60fef00bbe244e6b4f34710d8c49b38"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c60fef00bbe244e6b4f34710d8c49b38"}]}] Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-MigrationsAdminTest-2045450230 Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: c60fef00bbe244e6b4f34710d8c49b38 Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-MigrationsAdminTest-2045450230 Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-MigrationsAdminTest-2045450230-project-admin Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 91b68f66bd734611a37932f904d14539 Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-MigrationsAdminTest-2045450230-project-admin Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: exception: Flavor 25b236a5-6057-4b96-be4b-132cf93d1f91 could not be found. Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '25b236a5-6057-4b96-be4b-132cf93d1f91'} Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 25b236a5-6057-4b96-be4b-132cf93d1f91 could not be found. Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 25b236a5-6057-4b96-be4b-132cf93d1f91 could not be found. Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:19.100540 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:19.105820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:19.105820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:19.105820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:19.105820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:19.105820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:50:19.105820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:50:19.105820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 25b236a5-6057-4b96-be4b-132cf93d1f91 could not be found. Jul 28 03:50:19.105820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:19.105820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40e4b676-7014-428c-8359-0c0a613a7839 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Returning 404 to user: Flavor 25b236a5-6057-4b96-be4b-132cf93d1f91 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:19.112831 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40e4b676-7014-428c-8359-0c0a613a7839 tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/25b236a5-6057-4b96-be4b-132cf93d1f91" status: 404 len: 109 microversion: 2.1 time: 0.052839 Jul 28 03:50:19.113592 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1685/3059] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:50:19 2022] DELETE /compute/v2.1/flavors/25b236a5-6057-4b96-be4b-132cf93d1f91 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:50:19.117081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dc3b131f-b90e-45eb-96ba-d81987c93693 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:19.132392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d545fe3-88ad-4d8e-8c3b-60301fb606aa tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:19.137374 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dc3b131f-b90e-45eb-96ba-d81987c93693 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1271 microversion: 2.1 time: 0.214218 Jul 28 03:50:19.147266 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1375/3060] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:18 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1271 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:19.151247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4d545fe3-88ad-4d8e-8c3b-60301fb606aa tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:19.177814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d545fe3-88ad-4d8e-8c3b-60301fb606aa tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:19.190794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d545fe3-88ad-4d8e-8c3b-60301fb606aa tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:19.191922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d545fe3-88ad-4d8e-8c3b-60301fb606aa tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:19.192552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d545fe3-88ad-4d8e-8c3b-60301fb606aa tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:19.372586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-129dd0ac-04bb-4e69-a2dc-70eaf910e015 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:19.373439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-129dd0ac-04bb-4e69-a2dc-70eaf910e015 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:19.377701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d545fe3-88ad-4d8e-8c3b-60301fb606aa tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:19.393389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-129dd0ac-04bb-4e69-a2dc-70eaf910e015 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:19.396842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-129dd0ac-04bb-4e69-a2dc-70eaf910e015 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:19.399369 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d545fe3-88ad-4d8e-8c3b-60301fb606aa tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 200 len: 1272 microversion: 2.1 time: 0.284623 Jul 28 03:50:19.405690 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1686/3061] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:19 2022] GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 1272 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:19.410479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-129dd0ac-04bb-4e69-a2dc-70eaf910e015 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:19.417057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-129dd0ac-04bb-4e69-a2dc-70eaf910e015 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:19.421492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1859530422", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:19.524078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:50:19.983735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:50:19.984880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:50:19.985518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:50:19.986089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:50:19.986698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:50:20.002326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:20.006976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:20.008087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:20.008774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:20.055433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Getting quotas for project da4a22e4560a4210bb58942cec62c091. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:50:20.063918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Getting quotas for user ac9d734be6ee4b549f9ed389c276f54a and project da4a22e4560a4210bb58942cec62c091. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:50:20.101674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:50:20.104381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:50:20.232608 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c734d3ee-94aa-4faf-ab20-4ac67e333dd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825597 Jul 28 03:50:20.233278 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1687/3062] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:50:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:50:20.249582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-44daca6a-362b-4420-9a3b-c50c68ca846f req-b853055d-79c1-4804-8c80-2459358685ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42d51e5-d212-4768-bcef-1990cc448e06", "name": "network-vif-plugged", "status": "completed", "tag": "db626bfd-ae49-44f5-aa50-749c509840c2"}, {"server_uuid": "f57a0500-5de5-48e7-bc4e-c25234ca8fa6", "name": "network-vif-plugged", "status": "completed", "tag": "f50067a7-443a-48a2-a22b-703b731470d5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:20.280048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:20.283202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-44daca6a-362b-4420-9a3b-c50c68ca846f req-b853055d-79c1-4804-8c80-2459358685ab service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:20.285898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-44daca6a-362b-4420-9a3b-c50c68ca846f req-b853055d-79c1-4804-8c80-2459358685ab service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:20.312137 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-44daca6a-362b-4420-9a3b-c50c68ca846f req-b853055d-79c1-4804-8c80-2459358685ab service nova] Creating event network-vif-plugged:db626bfd-ae49-44f5-aa50-749c509840c2 for instance e42d51e5-d212-4768-bcef-1990cc448e06 on n-h2-826756-3 Jul 28 03:50:20.312749 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-44daca6a-362b-4420-9a3b-c50c68ca846f req-b853055d-79c1-4804-8c80-2459358685ab service nova] Creating event network-vif-plugged:f50067a7-443a-48a2-a22b-703b731470d5 for instance f57a0500-5de5-48e7-bc4e-c25234ca8fa6 on n-h2-826756-3 Jul 28 03:50:20.320580 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-44daca6a-362b-4420-9a3b-c50c68ca846f req-b853055d-79c1-4804-8c80-2459358685ab service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081581 Jul 28 03:50:20.322031 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1688/3063] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:20.330244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0c0984c7-0871-4838-93eb-a0d71ad05d50 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:20.331243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0c0984c7-0871-4838-93eb-a0d71ad05d50 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:20.341006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c0984c7-0871-4838-93eb-a0d71ad05d50 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:20.341891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c0984c7-0871-4838-93eb-a0d71ad05d50 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:20.342875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c0984c7-0871-4838-93eb-a0d71ad05d50 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:20.343838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c0984c7-0871-4838-93eb-a0d71ad05d50 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:20.623915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0c0984c7-0871-4838-93eb-a0d71ad05d50 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:20.641696 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0c0984c7-0871-4838-93eb-a0d71ad05d50 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1281 microversion: 2.1 time: 0.317846 Jul 28 03:50:20.665662 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1689/3064] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:20 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1281 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:20.671626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1ef5e8b-139a-4b5b-9baf-43320e26b08c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:20.672419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1ef5e8b-139a-4b5b-9baf-43320e26b08c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:20.709734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1ef5e8b-139a-4b5b-9baf-43320e26b08c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:20.710215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1ef5e8b-139a-4b5b-9baf-43320e26b08c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:20.711185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1ef5e8b-139a-4b5b-9baf-43320e26b08c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:20.711661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1ef5e8b-139a-4b5b-9baf-43320e26b08c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:21.343901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b1ef5e8b-139a-4b5b-9baf-43320e26b08c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:21.378748 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1ef5e8b-139a-4b5b-9baf-43320e26b08c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1293 microversion: 2.1 time: 0.711314 Jul 28 03:50:21.390853 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1690/3065] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:20 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1293 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:21.402648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-088fd14c-66b3-42cc-9c07-af36522e5888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:21.403194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-088fd14c-66b3-42cc-9c07-af36522e5888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:21.430798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-088fd14c-66b3-42cc-9c07-af36522e5888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:21.432920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-088fd14c-66b3-42cc-9c07-af36522e5888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:21.433983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-088fd14c-66b3-42cc-9c07-af36522e5888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:21.435853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-088fd14c-66b3-42cc-9c07-af36522e5888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:21.459194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-129dd0ac-04bb-4e69-a2dc-70eaf910e015 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:21.475549 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-129dd0ac-04bb-4e69-a2dc-70eaf910e015 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 2.108651 Jul 28 03:50:21.476540 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1376/3066] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:19 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:21.487851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:21.514611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-93d4b0b0-b7e3-4fcd-bc66-7a8ef180d366 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:21.515142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-93d4b0b0-b7e3-4fcd-bc66-7a8ef180d366 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:21.536268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-93d4b0b0-b7e3-4fcd-bc66-7a8ef180d366 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:21.539471 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-93d4b0b0-b7e3-4fcd-bc66-7a8ef180d366 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:21.541425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-93d4b0b0-b7e3-4fcd-bc66-7a8ef180d366 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:21.546455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-93d4b0b0-b7e3-4fcd-bc66-7a8ef180d366 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:21.847022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-93d4b0b0-b7e3-4fcd-bc66-7a8ef180d366 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:21.871979 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-93d4b0b0-b7e3-4fcd-bc66-7a8ef180d366 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1209 microversion: 2.1 time: 0.393570 Jul 28 03:50:21.874361 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1377/3067] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:21 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1209 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:21.892443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-67957808-2f21-4fea-83f8-0d7f17cd0994 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:21.894954 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-67957808-2f21-4fea-83f8-0d7f17cd0994 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:21.920428 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67957808-2f21-4fea-83f8-0d7f17cd0994 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:21.921369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67957808-2f21-4fea-83f8-0d7f17cd0994 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:21.922940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67957808-2f21-4fea-83f8-0d7f17cd0994 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:21.923412 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67957808-2f21-4fea-83f8-0d7f17cd0994 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:21.950945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-088fd14c-66b3-42cc-9c07-af36522e5888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:21.971513 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-088fd14c-66b3-42cc-9c07-af36522e5888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1313 microversion: 2.1 time: 0.578972 Jul 28 03:50:21.972999 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1691/3068] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:21 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1313 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:21.989518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-be0fdcbf-4764-4172-b238-261cd89d4916 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:21.990851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-be0fdcbf-4764-4172-b238-261cd89d4916 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:22.009504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be0fdcbf-4764-4172-b238-261cd89d4916 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:22.010608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be0fdcbf-4764-4172-b238-261cd89d4916 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:22.012168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be0fdcbf-4764-4172-b238-261cd89d4916 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:22.017861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be0fdcbf-4764-4172-b238-261cd89d4916 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:22.153018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be0fdcbf-4764-4172-b238-261cd89d4916 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:22.171514 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-be0fdcbf-4764-4172-b238-261cd89d4916 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1281 microversion: 2.1 time: 0.196570 Jul 28 03:50:22.186207 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1692/3069] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:21 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1281 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:22.404240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fbee714e-f862-4b69-88b5-df8107b25cb0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:22.405772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fbee714e-f862-4b69-88b5-df8107b25cb0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:22.416374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbee714e-f862-4b69-88b5-df8107b25cb0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:22.416912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbee714e-f862-4b69-88b5-df8107b25cb0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:22.417558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbee714e-f862-4b69-88b5-df8107b25cb0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:22.418022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbee714e-f862-4b69-88b5-df8107b25cb0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:22.593365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-67957808-2f21-4fea-83f8-0d7f17cd0994 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:22.616519 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-67957808-2f21-4fea-83f8-0d7f17cd0994 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 200 len: 1314 microversion: 2.1 time: 0.738713 Jul 28 03:50:22.621067 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1378/3070] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:21 2022] GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:22.646442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ea4c9a04-9f0e-428a-8c31-f87abf887be7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:22.648891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ea4c9a04-9f0e-428a-8c31-f87abf887be7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:22.670930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea4c9a04-9f0e-428a-8c31-f87abf887be7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:22.672384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea4c9a04-9f0e-428a-8c31-f87abf887be7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:22.673902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea4c9a04-9f0e-428a-8c31-f87abf887be7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:22.675031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea4c9a04-9f0e-428a-8c31-f87abf887be7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:22.801548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fbee714e-f862-4b69-88b5-df8107b25cb0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:22.812037 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fbee714e-f862-4b69-88b5-df8107b25cb0 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1293 microversion: 2.1 time: 0.412323 Jul 28 03:50:22.815516 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1693/3071] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:22 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1293 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:22.824614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3848038c-2bfe-4166-a6c2-967dc28a476e req-ca0f481a-5bb1-48e7-ab64-60206fa958a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed99415-e36a-431c-a33c-c609912af752", "name": "network-vif-plugged", "status": "completed", "tag": "fe3c986d-7298-4555-ba29-5e1b4c7e6981"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:22.859683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3848038c-2bfe-4166-a6c2-967dc28a476e req-ca0f481a-5bb1-48e7-ab64-60206fa958a3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:22.860264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3848038c-2bfe-4166-a6c2-967dc28a476e req-ca0f481a-5bb1-48e7-ab64-60206fa958a3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:22.888398 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3848038c-2bfe-4166-a6c2-967dc28a476e req-ca0f481a-5bb1-48e7-ab64-60206fa958a3 service nova] Creating event network-vif-plugged:fe3c986d-7298-4555-ba29-5e1b4c7e6981 for instance bed99415-e36a-431c-a33c-c609912af752 on n-h1-826756-3 Jul 28 03:50:22.897061 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3848038c-2bfe-4166-a6c2-967dc28a476e req-ca0f481a-5bb1-48e7-ab64-60206fa958a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079875 Jul 28 03:50:22.898511 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1694/3072] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:22.906507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a8e01ec-94c0-4d10-ad37-a98a1f782f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:22.907761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9a8e01ec-94c0-4d10-ad37-a98a1f782f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:22.920470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a8e01ec-94c0-4d10-ad37-a98a1f782f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:22.921683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a8e01ec-94c0-4d10-ad37-a98a1f782f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:22.923602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a8e01ec-94c0-4d10-ad37-a98a1f782f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:22.925507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a8e01ec-94c0-4d10-ad37-a98a1f782f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:23.070134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9a8e01ec-94c0-4d10-ad37-a98a1f782f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:23.081786 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9a8e01ec-94c0-4d10-ad37-a98a1f782f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1265 microversion: 2.1 time: 0.181368 Jul 28 03:50:23.082538 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1695/3073] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:22 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:23.089486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8da733dd-c9a0-4589-a3f6-0fa475692533 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:23.090111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8da733dd-c9a0-4589-a3f6-0fa475692533 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:23.108034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8da733dd-c9a0-4589-a3f6-0fa475692533 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:23.108034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8da733dd-c9a0-4589-a3f6-0fa475692533 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:23.108695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8da733dd-c9a0-4589-a3f6-0fa475692533 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:23.109650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8da733dd-c9a0-4589-a3f6-0fa475692533 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:23.231672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ea4c9a04-9f0e-428a-8c31-f87abf887be7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:23.248827 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ea4c9a04-9f0e-428a-8c31-f87abf887be7 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1333 microversion: 2.1 time: 0.622682 Jul 28 03:50:23.250260 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1379/3074] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:22 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1333 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:23.255914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-b4aa9c2f-36a6-480b-8ca6-78b5181b4d1e req-fb3ab535-b6df-41f3-beb1-1576c953c1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852ef6b3-2db0-4d01-9af9-b8bcda4937e4", "tag": "05bc4f93-611a-42fa-b8c2-db24a22c3131"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:23.270390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b4aa9c2f-36a6-480b-8ca6-78b5181b4d1e req-fb3ab535-b6df-41f3-beb1-1576c953c1f9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:23.273618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-b4aa9c2f-36a6-480b-8ca6-78b5181b4d1e req-fb3ab535-b6df-41f3-beb1-1576c953c1f9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:23.296198 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-b4aa9c2f-36a6-480b-8ca6-78b5181b4d1e req-fb3ab535-b6df-41f3-beb1-1576c953c1f9 service nova] Creating event network-changed:05bc4f93-611a-42fa-b8c2-db24a22c3131 for instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 on n-h1-826756-3 Jul 28 03:50:23.305285 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-b4aa9c2f-36a6-480b-8ca6-78b5181b4d1e req-fb3ab535-b6df-41f3-beb1-1576c953c1f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051186 Jul 28 03:50:23.309113 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1380/3075] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:23.317063 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-829a46e0-055d-43a4-a5ee-1f0e88267875 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:23.320813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-829a46e0-055d-43a4-a5ee-1f0e88267875 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:23.330513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-829a46e0-055d-43a4-a5ee-1f0e88267875 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:23.331727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-829a46e0-055d-43a4-a5ee-1f0e88267875 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:23.333058 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-829a46e0-055d-43a4-a5ee-1f0e88267875 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:23.334552 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-829a46e0-055d-43a4-a5ee-1f0e88267875 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:23.607703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8da733dd-c9a0-4589-a3f6-0fa475692533 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:23.620637 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8da733dd-c9a0-4589-a3f6-0fa475692533 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1313 microversion: 2.1 time: 0.536474 Jul 28 03:50:23.622201 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1696/3076] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:23 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:23.654047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a0d3b9ec-4f2b-4436-9512-98cd6b713e60 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:23.656898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a0d3b9ec-4f2b-4436-9512-98cd6b713e60 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:23.675368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0d3b9ec-4f2b-4436-9512-98cd6b713e60 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:23.676091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0d3b9ec-4f2b-4436-9512-98cd6b713e60 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:23.677439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0d3b9ec-4f2b-4436-9512-98cd6b713e60 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:23.678257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0d3b9ec-4f2b-4436-9512-98cd6b713e60 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:23.731425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-829a46e0-055d-43a4-a5ee-1f0e88267875 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:23.760105 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-829a46e0-055d-43a4-a5ee-1f0e88267875 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1323 microversion: 2.1 time: 0.447707 Jul 28 03:50:23.760995 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1381/3077] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:23 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1323 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:23.845087 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7fb15d07-e728-4ff7-8554-d93a2b5b7052 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:23.847643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7fb15d07-e728-4ff7-8554-d93a2b5b7052 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:23.884953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fb15d07-e728-4ff7-8554-d93a2b5b7052 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:23.889939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fb15d07-e728-4ff7-8554-d93a2b5b7052 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:23.892455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fb15d07-e728-4ff7-8554-d93a2b5b7052 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:23.896040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7fb15d07-e728-4ff7-8554-d93a2b5b7052 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:23.972325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a0d3b9ec-4f2b-4436-9512-98cd6b713e60 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:23.983574 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a0d3b9ec-4f2b-4436-9512-98cd6b713e60 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 200 len: 1314 microversion: 2.1 time: 0.341507 Jul 28 03:50:23.984306 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1697/3078] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:23 2022] GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:24.115307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b22f5e9-6453-458d-b68a-4e276ba9e7ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:24.127086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b22f5e9-6453-458d-b68a-4e276ba9e7ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:24.155571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b22f5e9-6453-458d-b68a-4e276ba9e7ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:24.156329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b22f5e9-6453-458d-b68a-4e276ba9e7ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:24.163533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b22f5e9-6453-458d-b68a-4e276ba9e7ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:24.167343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b22f5e9-6453-458d-b68a-4e276ba9e7ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:24.326060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b22f5e9-6453-458d-b68a-4e276ba9e7ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:24.337716 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b22f5e9-6453-458d-b68a-4e276ba9e7ae tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1283 microversion: 2.1 time: 0.233896 Jul 28 03:50:24.355595 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1698/3079] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:24 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1283 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:24.360766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0eca7c76-306b-4132-aeb9-60ef3282b750 req-9b5a6d04-91d5-48c9-b764-b5f65365d3da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b9af60f-ae9a-44b4-ab96-f43afbc198d5", "tag": "429f22a0-45cf-4946-8f46-5b7f631d5396"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:24.373478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0eca7c76-306b-4132-aeb9-60ef3282b750 req-9b5a6d04-91d5-48c9-b764-b5f65365d3da service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:24.373894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0eca7c76-306b-4132-aeb9-60ef3282b750 req-9b5a6d04-91d5-48c9-b764-b5f65365d3da service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:24.374257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7fb15d07-e728-4ff7-8554-d93a2b5b7052 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:24.383211 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7fb15d07-e728-4ff7-8554-d93a2b5b7052 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1293 microversion: 2.1 time: 0.546177 Jul 28 03:50:24.384118 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1382/3080] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:23 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1293 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:24.390286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9abed3da-60cd-44dd-bc9c-bec40f0a542a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:24.390956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9abed3da-60cd-44dd-bc9c-bec40f0a542a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:24.398088 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9abed3da-60cd-44dd-bc9c-bec40f0a542a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:24.398865 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9abed3da-60cd-44dd-bc9c-bec40f0a542a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:24.399880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9abed3da-60cd-44dd-bc9c-bec40f0a542a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:24.400582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9abed3da-60cd-44dd-bc9c-bec40f0a542a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:24.412895 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0eca7c76-306b-4132-aeb9-60ef3282b750 req-9b5a6d04-91d5-48c9-b764-b5f65365d3da service nova] Creating event network-changed:429f22a0-45cf-4946-8f46-5b7f631d5396 for instance 4b9af60f-ae9a-44b4-ab96-f43afbc198d5 on n-h1-826756-3 Jul 28 03:50:24.426219 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0eca7c76-306b-4132-aeb9-60ef3282b750 req-9b5a6d04-91d5-48c9-b764-b5f65365d3da service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068520 Jul 28 03:50:24.427446 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1699/3081] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:24.652592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ebdce3a-6f2a-4bef-8ab5-8305903c8c53 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:24.654988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5ebdce3a-6f2a-4bef-8ab5-8305903c8c53 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:24.670708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ebdce3a-6f2a-4bef-8ab5-8305903c8c53 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:24.672678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ebdce3a-6f2a-4bef-8ab5-8305903c8c53 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:24.674083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ebdce3a-6f2a-4bef-8ab5-8305903c8c53 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:24.675697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ebdce3a-6f2a-4bef-8ab5-8305903c8c53 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:24.785798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9abed3da-60cd-44dd-bc9c-bec40f0a542a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:24.832314 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9abed3da-60cd-44dd-bc9c-bec40f0a542a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1669 microversion: 2.1 time: 0.444306 Jul 28 03:50:24.836521 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1383/3082] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:24 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1669 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:24.857481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d55f5bbb-aa08-4e90-9eee-308c23339035 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:24.858302 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d55f5bbb-aa08-4e90-9eee-308c23339035 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:24.870070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d55f5bbb-aa08-4e90-9eee-308c23339035 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:24.871411 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d55f5bbb-aa08-4e90-9eee-308c23339035 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:24.873041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d55f5bbb-aa08-4e90-9eee-308c23339035 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:24.873752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d55f5bbb-aa08-4e90-9eee-308c23339035 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:24.945694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ebdce3a-6f2a-4bef-8ab5-8305903c8c53 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:24.959281 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ebdce3a-6f2a-4bef-8ab5-8305903c8c53 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1313 microversion: 2.1 time: 0.312720 Jul 28 03:50:24.964612 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1700/3083] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:24 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:25.000086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-995ed27d-decd-4da3-a586-ce48a6e2fee5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:25.001482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-995ed27d-decd-4da3-a586-ce48a6e2fee5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:25.022531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-995ed27d-decd-4da3-a586-ce48a6e2fee5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:25.022989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-995ed27d-decd-4da3-a586-ce48a6e2fee5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:25.023964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-995ed27d-decd-4da3-a586-ce48a6e2fee5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:25.026333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-995ed27d-decd-4da3-a586-ce48a6e2fee5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:25.082634 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-995ed27d-decd-4da3-a586-ce48a6e2fee5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06/ips" status: 200 len: 180 microversion: 2.1 time: 0.120905 Jul 28 03:50:25.093517 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1701/3084] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:50:24 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06/ips => generated 180 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:25.099212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e35a644a-252c-4d3d-a9b5-6b7d2585f5af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:25.104581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e35a644a-252c-4d3d-a9b5-6b7d2585f5af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:25.119769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e35a644a-252c-4d3d-a9b5-6b7d2585f5af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:25.120504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e35a644a-252c-4d3d-a9b5-6b7d2585f5af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:25.121496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e35a644a-252c-4d3d-a9b5-6b7d2585f5af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:25.122008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e35a644a-252c-4d3d-a9b5-6b7d2585f5af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:25.363937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d55f5bbb-aa08-4e90-9eee-308c23339035 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:25.375569 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d55f5bbb-aa08-4e90-9eee-308c23339035 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1323 microversion: 2.1 time: 0.535887 Jul 28 03:50:25.377582 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1384/3085] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:24 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1323 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:25.387830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-296a2acd-e7e0-4035-af11-a5b2daeb0d3b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:25.388829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-296a2acd-e7e0-4035-af11-a5b2daeb0d3b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:25.397741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-296a2acd-e7e0-4035-af11-a5b2daeb0d3b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:25.398621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-296a2acd-e7e0-4035-af11-a5b2daeb0d3b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:25.400009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-296a2acd-e7e0-4035-af11-a5b2daeb0d3b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:25.401057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-296a2acd-e7e0-4035-af11-a5b2daeb0d3b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:25.446696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-296a2acd-e7e0-4035-af11-a5b2daeb0d3b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:50:25.608642 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-296a2acd-e7e0-4035-af11-a5b2daeb0d3b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 204 len: 0 microversion: 2.1 time: 0.226477 Jul 28 03:50:25.610403 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1385/3086] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:50:25 2022] DELETE /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:50:25.624390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bcadca73-eb2d-4e1c-97c7-7a6cf3aba6e6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:25.625498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bcadca73-eb2d-4e1c-97c7-7a6cf3aba6e6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:25.634446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcadca73-eb2d-4e1c-97c7-7a6cf3aba6e6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:25.635220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcadca73-eb2d-4e1c-97c7-7a6cf3aba6e6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:25.636277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcadca73-eb2d-4e1c-97c7-7a6cf3aba6e6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:25.637252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcadca73-eb2d-4e1c-97c7-7a6cf3aba6e6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:25.875130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e35a644a-252c-4d3d-a9b5-6b7d2585f5af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:25.884651 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e35a644a-252c-4d3d-a9b5-6b7d2585f5af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 200 len: 1314 microversion: 2.1 time: 0.789647 Jul 28 03:50:25.899466 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1702/3087] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:25 2022] GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 1314 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:25.899466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a88c323-4682-4c07-9bf7-1958f7bec3d8 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:25.899466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9a88c323-4682-4c07-9bf7-1958f7bec3d8 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:25.916370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a88c323-4682-4c07-9bf7-1958f7bec3d8 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:25.919256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a88c323-4682-4c07-9bf7-1958f7bec3d8 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:25.920130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a88c323-4682-4c07-9bf7-1958f7bec3d8 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:25.920612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a88c323-4682-4c07-9bf7-1958f7bec3d8 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:26.271240 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bcadca73-eb2d-4e1c-97c7-7a6cf3aba6e6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:26.293963 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bcadca73-eb2d-4e1c-97c7-7a6cf3aba6e6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1271 microversion: 2.1 time: 0.680938 Jul 28 03:50:26.298793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9a88c323-4682-4c07-9bf7-1958f7bec3d8 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:26.308645 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1386/3088] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:25 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1271 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:26.315541 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9a88c323-4682-4c07-9bf7-1958f7bec3d8 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1484 microversion: 2.1 time: 0.425775 Jul 28 03:50:26.328564 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1703/3089] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:25 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1484 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:26.328564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-307f73df-ef72-447a-bf52-4c15c9a8551e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:26.328564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-307f73df-ef72-447a-bf52-4c15c9a8551e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:26.329870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c6940091-a231-47fa-b0e6-a6b7b81b8f4b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:26.331041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c6940091-a231-47fa-b0e6-a6b7b81b8f4b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:26.348163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6940091-a231-47fa-b0e6-a6b7b81b8f4b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:26.351624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-307f73df-ef72-447a-bf52-4c15c9a8551e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:26.351858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6940091-a231-47fa-b0e6-a6b7b81b8f4b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:26.353419 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6940091-a231-47fa-b0e6-a6b7b81b8f4b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:26.354261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6940091-a231-47fa-b0e6-a6b7b81b8f4b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:26.354575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-307f73df-ef72-447a-bf52-4c15c9a8551e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:26.355575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-307f73df-ef72-447a-bf52-4c15c9a8551e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:26.360619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-307f73df-ef72-447a-bf52-4c15c9a8551e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:26.450678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:26.692167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-307f73df-ef72-447a-bf52-4c15c9a8551e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:26.694970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c6940091-a231-47fa-b0e6-a6b7b81b8f4b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:26.703717 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-307f73df-ef72-447a-bf52-4c15c9a8551e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1313 microversion: 2.1 time: 0.386304 Jul 28 03:50:26.707886 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c6940091-a231-47fa-b0e6-a6b7b81b8f4b tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1675 microversion: 2.1 time: 0.396765 Jul 28 03:50:26.708836 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1704/3090] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:26 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:26.714985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ad0cab8-fa9f-4b7f-9939-4d0da1d17d19 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Action: 'create', calling method: .version_select at 0x7ffa746fae50>, body: {"keypair": {"name": "tempest-keypair-1210621033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLH1gIifKWzlckoEOdSPr9B5/Cv6Xikv6XUdfvHSVPaEhaq7GvzU/8YBULhYA5CMP5EAO9wbCwSXP9zRa2ugq0abLfr0T0X4tq+Xe8pe346UxS6zA7jmDpW4xeDUfSv9A=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:26.721423 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1387/3091] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:26 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1675 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:26.729607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0e9ba638-3905-4d00-9437-e73ed3be2335 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:26.731689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0e9ba638-3905-4d00-9437-e73ed3be2335 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:26.741787 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e9ba638-3905-4d00-9437-e73ed3be2335 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:26.742571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e9ba638-3905-4d00-9437-e73ed3be2335 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:26.743646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e9ba638-3905-4d00-9437-e73ed3be2335 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:26.744325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e9ba638-3905-4d00-9437-e73ed3be2335 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:26.756707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-5ad0cab8-fa9f-4b7f-9939-4d0da1d17d19 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for project 781ab005138547038def64d108937e3e. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:50:26.763695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-5ad0cab8-fa9f-4b7f-9939-4d0da1d17d19 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for user d20381abd9784627887af3cb97cd68a8 and project 781ab005138547038def64d108937e3e. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:50:26.819141 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ad0cab8-fa9f-4b7f-9939-4d0da1d17d19 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108870 Jul 28 03:50:26.829653 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1705/3092] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:50:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:26.841970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-105f06af-97c1-4540-bba2-8f0ae6940c02 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:26.842617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-105f06af-97c1-4540-bba2-8f0ae6940c02 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:26.866811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-105f06af-97c1-4540-bba2-8f0ae6940c02 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:26.867372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-105f06af-97c1-4540-bba2-8f0ae6940c02 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:26.868218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-105f06af-97c1-4540-bba2-8f0ae6940c02 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:26.870500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-105f06af-97c1-4540-bba2-8f0ae6940c02 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:26.947661 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0e9ba638-3905-4d00-9437-e73ed3be2335 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.224948 Jul 28 03:50:26.949007 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1388/3093] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:50:26 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6/os-interface => generated 284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:26.955538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-225ca334-692e-4982-8682-89e49ea614ff req-a6d86792-2096-43de-b101-7082290cad70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5d8efe8-31af-4052-80af-189387e88134", "tag": "4501bc0b-758b-4585-8209-f282991da4d7"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:26.969131 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:26.982292 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-225ca334-692e-4982-8682-89e49ea614ff req-a6d86792-2096-43de-b101-7082290cad70 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:26.983945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-225ca334-692e-4982-8682-89e49ea614ff req-a6d86792-2096-43de-b101-7082290cad70 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:27.016278 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-225ca334-692e-4982-8682-89e49ea614ff req-a6d86792-2096-43de-b101-7082290cad70 service nova] Creating event network-changed:4501bc0b-758b-4585-8209-f282991da4d7 for instance c5d8efe8-31af-4052-80af-189387e88134 on n-h1-826756-3 Jul 28 03:50:27.025122 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-225ca334-692e-4982-8682-89e49ea614ff req-a6d86792-2096-43de-b101-7082290cad70 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074332 Jul 28 03:50:27.043699 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1389/3094] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:27.062566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6f1040a0-9b12-44a7-b21f-8e373ffb2f9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:27.063870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6f1040a0-9b12-44a7-b21f-8e373ffb2f9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:27.091477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f1040a0-9b12-44a7-b21f-8e373ffb2f9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:27.093418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f1040a0-9b12-44a7-b21f-8e373ffb2f9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:27.095667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f1040a0-9b12-44a7-b21f-8e373ffb2f9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:27.096286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f1040a0-9b12-44a7-b21f-8e373ffb2f9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:27.135178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:27.631780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-105f06af-97c1-4540-bba2-8f0ae6940c02 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:27.667691 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-105f06af-97c1-4540-bba2-8f0ae6940c02 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1323 microversion: 2.1 time: 0.842043 Jul 28 03:50:27.669023 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1706/3095] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:26 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1323 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:27.705965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3486a1bc-8b8f-4b6a-ace2-7e34da9d47f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:27.710234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3486a1bc-8b8f-4b6a-ace2-7e34da9d47f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:27.747978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3486a1bc-8b8f-4b6a-ace2-7e34da9d47f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:27.751113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3486a1bc-8b8f-4b6a-ace2-7e34da9d47f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:27.754997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3486a1bc-8b8f-4b6a-ace2-7e34da9d47f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:27.757165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3486a1bc-8b8f-4b6a-ace2-7e34da9d47f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:28.082927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6f1040a0-9b12-44a7-b21f-8e373ffb2f9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:28.099579 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6f1040a0-9b12-44a7-b21f-8e373ffb2f9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 200 len: 1314 microversion: 2.1 time: 1.053982 Jul 28 03:50:28.113973 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1390/3096] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:27 2022] GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 1314 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:28.129566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4bffbfd1-4f37-49d3-acb4-737f8ff04636 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:28.130737 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4bffbfd1-4f37-49d3-acb4-737f8ff04636 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:28.138613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bffbfd1-4f37-49d3-acb4-737f8ff04636 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:28.139463 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bffbfd1-4f37-49d3-acb4-737f8ff04636 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:28.140513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bffbfd1-4f37-49d3-acb4-737f8ff04636 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:28.141251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bffbfd1-4f37-49d3-acb4-737f8ff04636 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:28.197034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3486a1bc-8b8f-4b6a-ace2-7e34da9d47f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:28.209430 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3486a1bc-8b8f-4b6a-ace2-7e34da9d47f4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1313 microversion: 2.1 time: 0.533152 Jul 28 03:50:28.215044 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1707/3097] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:27 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:28.220884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ffd530f-56bd-448a-bbc0-3e53583c065e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:28.224283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5ffd530f-56bd-448a-bbc0-3e53583c065e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:28.240383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ffd530f-56bd-448a-bbc0-3e53583c065e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:28.241140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ffd530f-56bd-448a-bbc0-3e53583c065e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:28.242327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ffd530f-56bd-448a-bbc0-3e53583c065e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:28.248204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ffd530f-56bd-448a-bbc0-3e53583c065e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:28.527155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ffd530f-56bd-448a-bbc0-3e53583c065e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:28.548118 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ffd530f-56bd-448a-bbc0-3e53583c065e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1313 microversion: 2.1 time: 0.331458 Jul 28 03:50:28.564497 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1708/3098] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:28 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:28.694980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a44e53bf-6180-4a63-ad8b-fbc1702c1f2e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:28.696555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a44e53bf-6180-4a63-ad8b-fbc1702c1f2e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:28.710166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a44e53bf-6180-4a63-ad8b-fbc1702c1f2e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:28.711006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a44e53bf-6180-4a63-ad8b-fbc1702c1f2e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:28.712091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a44e53bf-6180-4a63-ad8b-fbc1702c1f2e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:28.713896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a44e53bf-6180-4a63-ad8b-fbc1702c1f2e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:28.887963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=12 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:28.991366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a44e53bf-6180-4a63-ad8b-fbc1702c1f2e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:29.000091 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a44e53bf-6180-4a63-ad8b-fbc1702c1f2e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1323 microversion: 2.1 time: 0.309969 Jul 28 03:50:29.000734 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1709/3099] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:28 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1323 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:29.134127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0fe5704d-372e-4a5a-b4bd-5bb350a61099 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:29.134127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0fe5704d-372e-4a5a-b4bd-5bb350a61099 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:29.141528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fe5704d-372e-4a5a-b4bd-5bb350a61099 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:29.142251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fe5704d-372e-4a5a-b4bd-5bb350a61099 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:29.143469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fe5704d-372e-4a5a-b4bd-5bb350a61099 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:29.144064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fe5704d-372e-4a5a-b4bd-5bb350a61099 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:29.407704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0fe5704d-372e-4a5a-b4bd-5bb350a61099 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:29.413321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:29.425619 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0fe5704d-372e-4a5a-b4bd-5bb350a61099 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 200 len: 1314 microversion: 2.1 time: 0.296470 Jul 28 03:50:29.426549 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1710/3100] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:29 2022] GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:29.432385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ac27771e-81cf-4c26-8b4c-5f785e87529e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:29.433667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ac27771e-81cf-4c26-8b4c-5f785e87529e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:29.441741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac27771e-81cf-4c26-8b4c-5f785e87529e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:29.442534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac27771e-81cf-4c26-8b4c-5f785e87529e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:29.443895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac27771e-81cf-4c26-8b4c-5f785e87529e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:29.444572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac27771e-81cf-4c26-8b4c-5f785e87529e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:29.597998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4bffbfd1-4f37-49d3-acb4-737f8ff04636 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:29.616147 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4bffbfd1-4f37-49d3-acb4-737f8ff04636 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1675 microversion: 2.1 time: 1.500174 Jul 28 03:50:29.627967 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1391/3101] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:28 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1675 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:29.638011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-ef41f87c-f4a4-492d-b868-9134a616c24f req-fb99e4ba-d471-4cd1-9d01-d11a30dc0d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852ef6b3-2db0-4d01-9af9-b8bcda4937e4", "name": "network-vif-plugged", "status": "completed", "tag": "05bc4f93-611a-42fa-b8c2-db24a22c3131"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:29.654268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-ef41f87c-f4a4-492d-b868-9134a616c24f req-fb99e4ba-d471-4cd1-9d01-d11a30dc0d9b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:29.654766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-ef41f87c-f4a4-492d-b868-9134a616c24f req-fb99e4ba-d471-4cd1-9d01-d11a30dc0d9b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:29.667469 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-ef41f87c-f4a4-492d-b868-9134a616c24f req-fb99e4ba-d471-4cd1-9d01-d11a30dc0d9b service nova] Creating event network-vif-plugged:05bc4f93-611a-42fa-b8c2-db24a22c3131 for instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 on n-h1-826756-3 Jul 28 03:50:29.675192 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-ef41f87c-f4a4-492d-b868-9134a616c24f req-fb99e4ba-d471-4cd1-9d01-d11a30dc0d9b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045070 Jul 28 03:50:29.676447 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1392/3102] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:29.686390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fc3745c4-9201-4cdf-96a2-13edd376e80a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:29.688199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fc3745c4-9201-4cdf-96a2-13edd376e80a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:29.695073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc3745c4-9201-4cdf-96a2-13edd376e80a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:29.695785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc3745c4-9201-4cdf-96a2-13edd376e80a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:29.697343 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc3745c4-9201-4cdf-96a2-13edd376e80a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:29.698000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc3745c4-9201-4cdf-96a2-13edd376e80a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:29.855711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ac27771e-81cf-4c26-8b4c-5f785e87529e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:29.867840 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ac27771e-81cf-4c26-8b4c-5f785e87529e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1313 microversion: 2.1 time: 0.439649 Jul 28 03:50:29.876448 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1711/3103] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:29 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:30.023827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90f75ea2-6988-4325-9608-0178ee5b2cc5 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:30.031255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-90f75ea2-6988-4325-9608-0178ee5b2cc5 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:30.037241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:30.044109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90f75ea2-6988-4325-9608-0178ee5b2cc5 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:30.044692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90f75ea2-6988-4325-9608-0178ee5b2cc5 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:30.045722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90f75ea2-6988-4325-9608-0178ee5b2cc5 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:30.046376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90f75ea2-6988-4325-9608-0178ee5b2cc5 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:30.286217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-90f75ea2-6988-4325-9608-0178ee5b2cc5 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:30.294664 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90f75ea2-6988-4325-9608-0178ee5b2cc5 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1323 microversion: 2.1 time: 0.275558 Jul 28 03:50:30.295457 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1712/3104] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:30 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1323 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:30.329075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fc3745c4-9201-4cdf-96a2-13edd376e80a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:30.337954 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fc3745c4-9201-4cdf-96a2-13edd376e80a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1313 microversion: 2.1 time: 0.660029 Jul 28 03:50:30.338660 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1393/3105] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:29 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:30.446862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df4f00e6-bb18-4206-a2f2-fc3b8f1f9057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:30.448477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-df4f00e6-bb18-4206-a2f2-fc3b8f1f9057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:30.456311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df4f00e6-bb18-4206-a2f2-fc3b8f1f9057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:30.456898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df4f00e6-bb18-4206-a2f2-fc3b8f1f9057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:30.457960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df4f00e6-bb18-4206-a2f2-fc3b8f1f9057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:30.458639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df4f00e6-bb18-4206-a2f2-fc3b8f1f9057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:30.640387 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7ceba939-991e-4728-82ab-3508635a41c5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:30.641255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-df4f00e6-bb18-4206-a2f2-fc3b8f1f9057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:30.642224 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7ceba939-991e-4728-82ab-3508635a41c5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:30.651057 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-df4f00e6-bb18-4206-a2f2-fc3b8f1f9057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 200 len: 1314 microversion: 2.1 time: 0.208485 Jul 28 03:50:30.652113 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1713/3106] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:30 2022] GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:30.657233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ceba939-991e-4728-82ab-3508635a41c5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:30.657696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ceba939-991e-4728-82ab-3508635a41c5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:30.658499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ceba939-991e-4728-82ab-3508635a41c5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:30.658933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ceba939-991e-4728-82ab-3508635a41c5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:30.890781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-619f899c-ee4f-4cf1-8de0-ba48a8938f69 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:30.892404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-619f899c-ee4f-4cf1-8de0-ba48a8938f69 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:30.901734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-619f899c-ee4f-4cf1-8de0-ba48a8938f69 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:30.902768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-619f899c-ee4f-4cf1-8de0-ba48a8938f69 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:30.903939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-619f899c-ee4f-4cf1-8de0-ba48a8938f69 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:30.904827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-619f899c-ee4f-4cf1-8de0-ba48a8938f69 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:31.103353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-619f899c-ee4f-4cf1-8de0-ba48a8938f69 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:31.113409 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-619f899c-ee4f-4cf1-8de0-ba48a8938f69 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1313 microversion: 2.1 time: 0.226583 Jul 28 03:50:31.114024 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1714/3107] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:30 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:31.318143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0aed85c4-cd36-41df-aa68-010aff7464de tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:31.319827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0aed85c4-cd36-41df-aa68-010aff7464de tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:31.329170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0aed85c4-cd36-41df-aa68-010aff7464de tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:31.329598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0aed85c4-cd36-41df-aa68-010aff7464de tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:31.330625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0aed85c4-cd36-41df-aa68-010aff7464de tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:31.331128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0aed85c4-cd36-41df-aa68-010aff7464de tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:31.560494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0aed85c4-cd36-41df-aa68-010aff7464de tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:31.580600 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0aed85c4-cd36-41df-aa68-010aff7464de tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1323 microversion: 2.1 time: 0.267214 Jul 28 03:50:31.582157 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1715/3108] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:31 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1323 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:31.588593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6252c92b-b1f0-470e-a505-01a2c83b0ed7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:31.590739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6252c92b-b1f0-470e-a505-01a2c83b0ed7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:31.600554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6252c92b-b1f0-470e-a505-01a2c83b0ed7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:31.601078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6252c92b-b1f0-470e-a505-01a2c83b0ed7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:31.601891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6252c92b-b1f0-470e-a505-01a2c83b0ed7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:31.602333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6252c92b-b1f0-470e-a505-01a2c83b0ed7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:31.868030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6252c92b-b1f0-470e-a505-01a2c83b0ed7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:31.882817 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6252c92b-b1f0-470e-a505-01a2c83b0ed7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1313 microversion: 2.1 time: 0.292953 Jul 28 03:50:31.882817 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1716/3109] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:31 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:31.882817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb8f9ea8-9549-4361-8dff-a6072d9443be tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:31.882817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eb8f9ea8-9549-4361-8dff-a6072d9443be tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:31.894651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb8f9ea8-9549-4361-8dff-a6072d9443be tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:31.895355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb8f9ea8-9549-4361-8dff-a6072d9443be tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:31.896085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb8f9ea8-9549-4361-8dff-a6072d9443be tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:31.896690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb8f9ea8-9549-4361-8dff-a6072d9443be tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:31.994369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7ceba939-991e-4728-82ab-3508635a41c5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:32.014913 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7ceba939-991e-4728-82ab-3508635a41c5 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1675 microversion: 2.1 time: 1.378756 Jul 28 03:50:32.020425 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1394/3110] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:30 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1675 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:32.059279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-063bfae8-8ca8-4111-9c44-957015027f9f req-a2d76d54-a90b-4648-8872-d32957e30a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42d51e5-d212-4768-bcef-1990cc448e06", "name": "network-vif-unplugged", "status": "completed", "tag": "4612f5a9-e8fb-4fac-8539-f4d3f8624a31"}, {"server_uuid": "4b9af60f-ae9a-44b4-ab96-f43afbc198d5", "name": "network-vif-plugged", "status": "completed", "tag": "429f22a0-45cf-4946-8f46-5b7f631d5396"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:32.075896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-063bfae8-8ca8-4111-9c44-957015027f9f req-a2d76d54-a90b-4648-8872-d32957e30a8c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:32.076796 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-063bfae8-8ca8-4111-9c44-957015027f9f req-a2d76d54-a90b-4648-8872-d32957e30a8c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:32.094131 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-063bfae8-8ca8-4111-9c44-957015027f9f req-a2d76d54-a90b-4648-8872-d32957e30a8c service nova] Creating event network-vif-unplugged:4612f5a9-e8fb-4fac-8539-f4d3f8624a31 for instance e42d51e5-d212-4768-bcef-1990cc448e06 on n-h2-826756-3 Jul 28 03:50:32.095095 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-063bfae8-8ca8-4111-9c44-957015027f9f req-a2d76d54-a90b-4648-8872-d32957e30a8c service nova] Creating event network-vif-plugged:429f22a0-45cf-4946-8f46-5b7f631d5396 for instance 4b9af60f-ae9a-44b4-ab96-f43afbc198d5 on n-h1-826756-3 Jul 28 03:50:32.115469 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-063bfae8-8ca8-4111-9c44-957015027f9f req-a2d76d54-a90b-4648-8872-d32957e30a8c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.085056 Jul 28 03:50:32.116203 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1395/3111] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:32.133213 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-2434327a-ec87-4121-a538-576221410ec0 req-97a44bb6-4afa-4a57-a8a4-338e52da1bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e42d51e5-d212-4768-bcef-1990cc448e06", "name": "network-vif-deleted", "tag": "db626bfd-ae49-44f5-aa50-749c509840c2"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:32.150872 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-2434327a-ec87-4121-a538-576221410ec0 req-97a44bb6-4afa-4a57-a8a4-338e52da1bd4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:32.151829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-2434327a-ec87-4121-a538-576221410ec0 req-97a44bb6-4afa-4a57-a8a4-338e52da1bd4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:32.172518 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-2434327a-ec87-4121-a538-576221410ec0 req-97a44bb6-4afa-4a57-a8a4-338e52da1bd4 service nova] Creating event network-vif-deleted:db626bfd-ae49-44f5-aa50-749c509840c2 for instance e42d51e5-d212-4768-bcef-1990cc448e06 on n-h2-826756-3 Jul 28 03:50:32.182215 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-2434327a-ec87-4121-a538-576221410ec0 req-97a44bb6-4afa-4a57-a8a4-338e52da1bd4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063949 Jul 28 03:50:32.183781 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1396/3112] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:32.191982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-215256806", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "693f524d-65ea-4c5a-b83d-05789d71bfe6"}], "security_groups": [{"name": "tempest-securitygroup--1734340006"}], "key_name": "tempest-keypair-1210621033", "user_data": "}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:32.269341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eb8f9ea8-9549-4361-8dff-a6072d9443be tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:32.281187 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb8f9ea8-9549-4361-8dff-a6072d9443be tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 200 len: 1314 microversion: 2.1 time: 0.402958 Jul 28 03:50:32.292482 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1717/3113] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:31 2022] GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:32.292482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-904b74da-09a5-4215-94e0-024dd58e7a01 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:32.292482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-904b74da-09a5-4215-94e0-024dd58e7a01 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:32.298817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-904b74da-09a5-4215-94e0-024dd58e7a01 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:32.299282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-904b74da-09a5-4215-94e0-024dd58e7a01 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:32.300192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-904b74da-09a5-4215-94e0-024dd58e7a01 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:32.300661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-904b74da-09a5-4215-94e0-024dd58e7a01 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:32.537184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-904b74da-09a5-4215-94e0-024dd58e7a01 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:32.545870 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-904b74da-09a5-4215-94e0-024dd58e7a01 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1313 microversion: 2.1 time: 0.260236 Jul 28 03:50:32.547100 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1718/3114] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:32 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:32.611437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2afc547c-9aa8-47f1-84ff-450c9ae25dc4 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:32.612374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2afc547c-9aa8-47f1-84ff-450c9ae25dc4 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:32.620780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2afc547c-9aa8-47f1-84ff-450c9ae25dc4 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:32.621863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2afc547c-9aa8-47f1-84ff-450c9ae25dc4 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:32.623679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2afc547c-9aa8-47f1-84ff-450c9ae25dc4 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:32.625026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2afc547c-9aa8-47f1-84ff-450c9ae25dc4 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:32.866536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2afc547c-9aa8-47f1-84ff-450c9ae25dc4 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:32.875921 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2afc547c-9aa8-47f1-84ff-450c9ae25dc4 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1323 microversion: 2.1 time: 0.275238 Jul 28 03:50:32.876756 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1719/3115] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:32 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1323 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:32.897705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-16a32c97-43d4-475f-b651-4606d2e14888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:32.898411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-16a32c97-43d4-475f-b651-4606d2e14888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:32.906246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16a32c97-43d4-475f-b651-4606d2e14888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:32.906706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16a32c97-43d4-475f-b651-4606d2e14888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:32.907738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16a32c97-43d4-475f-b651-4606d2e14888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:32.908191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16a32c97-43d4-475f-b651-4606d2e14888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:33.044286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] validate_networks() for [('693f524d-65ea-4c5a-b83d-05789d71bfe6', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:50:33.098407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-16a32c97-43d4-475f-b651-4606d2e14888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:33.109590 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-16a32c97-43d4-475f-b651-4606d2e14888 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1313 microversion: 2.1 time: 0.215240 Jul 28 03:50:33.111381 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1720/3116] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:32 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:33.117023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d759d8a9-d7b3-444f-b6c7-a77d6a5fef42 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:33.118300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d759d8a9-d7b3-444f-b6c7-a77d6a5fef42 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:33.134755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d759d8a9-d7b3-444f-b6c7-a77d6a5fef42 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:33.135270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d759d8a9-d7b3-444f-b6c7-a77d6a5fef42 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:33.136043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d759d8a9-d7b3-444f-b6c7-a77d6a5fef42 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:33.136503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d759d8a9-d7b3-444f-b6c7-a77d6a5fef42 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:33.344026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d759d8a9-d7b3-444f-b6c7-a77d6a5fef42 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:33.353652 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d759d8a9-d7b3-444f-b6c7-a77d6a5fef42 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1495 microversion: 2.1 time: 0.240959 Jul 28 03:50:33.354791 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1721/3117] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:33 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1495 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:33.359907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0630bc00-57b3-478d-b53a-7348a15ac489 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:33.362608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0630bc00-57b3-478d-b53a-7348a15ac489 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:33.372394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0630bc00-57b3-478d-b53a-7348a15ac489 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:33.373391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0630bc00-57b3-478d-b53a-7348a15ac489 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:33.375014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0630bc00-57b3-478d-b53a-7348a15ac489 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:33.375730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0630bc00-57b3-478d-b53a-7348a15ac489 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:33.582703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0630bc00-57b3-478d-b53a-7348a15ac489 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:33.591863 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0630bc00-57b3-478d-b53a-7348a15ac489 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 200 len: 1502 microversion: 2.1 time: 0.235832 Jul 28 03:50:33.594041 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1722/3118] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:33 2022] GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 1502 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:33.600670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0605508-511f-4555-a391-49ab034e3206 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:33.602485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e0605508-511f-4555-a391-49ab034e3206 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:33.611817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0605508-511f-4555-a391-49ab034e3206 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:33.612663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0605508-511f-4555-a391-49ab034e3206 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:33.613683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0605508-511f-4555-a391-49ab034e3206 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:33.615114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0605508-511f-4555-a391-49ab034e3206 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:33.804003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e0605508-511f-4555-a391-49ab034e3206 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:33.812833 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e0605508-511f-4555-a391-49ab034e3206 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1484 microversion: 2.1 time: 0.216405 Jul 28 03:50:33.814707 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1723/3119] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:33 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1484 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:33.820195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-715a183e-3b2a-4528-a6a1-1d24e0e55369 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:33.821292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-715a183e-3b2a-4528-a6a1-1d24e0e55369 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:33.828959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-715a183e-3b2a-4528-a6a1-1d24e0e55369 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:33.829689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-715a183e-3b2a-4528-a6a1-1d24e0e55369 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:33.830630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-715a183e-3b2a-4528-a6a1-1d24e0e55369 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:33.831359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-715a183e-3b2a-4528-a6a1-1d24e0e55369 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:34.000071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-715a183e-3b2a-4528-a6a1-1d24e0e55369 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:34.027508 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-715a183e-3b2a-4528-a6a1-1d24e0e55369 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1313 microversion: 2.1 time: 0.208881 Jul 28 03:50:34.028862 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1724/3120] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:33 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:34.051815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-48249786-688d-46ea-9a59-a5db751290fb tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:34.051815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-48249786-688d-46ea-9a59-a5db751290fb tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:34.063229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48249786-688d-46ea-9a59-a5db751290fb tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:34.063854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48249786-688d-46ea-9a59-a5db751290fb tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:34.064813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48249786-688d-46ea-9a59-a5db751290fb tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:34.065357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48249786-688d-46ea-9a59-a5db751290fb tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:34.262314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-48249786-688d-46ea-9a59-a5db751290fb tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:34.271236 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-48249786-688d-46ea-9a59-a5db751290fb tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1323 microversion: 2.1 time: 0.226189 Jul 28 03:50:34.282970 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1725/3121] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:34 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1323 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:34.282970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c17c375e-6001-4c87-b8a2-5309a2c63320 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:34.282970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c17c375e-6001-4c87-b8a2-5309a2c63320 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:34.291459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c17c375e-6001-4c87-b8a2-5309a2c63320 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:34.292105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c17c375e-6001-4c87-b8a2-5309a2c63320 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:34.295946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c17c375e-6001-4c87-b8a2-5309a2c63320 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:34.295946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c17c375e-6001-4c87-b8a2-5309a2c63320 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:34.493056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c17c375e-6001-4c87-b8a2-5309a2c63320 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:34.503872 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c17c375e-6001-4c87-b8a2-5309a2c63320 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1313 microversion: 2.1 time: 0.228355 Jul 28 03:50:34.514931 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1726/3122] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:34 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:34.514931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b13bfc40-f29b-4031-a1da-252b1c6b1a09 req-cd8ee03d-aee1-4a09-9ca4-55accf1976b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dca550f-8f08-4f26-a922-b8b222db43a1", "tag": "4dce8ccd-5f8a-4b35-a9d0-946725622ad1"}, {"name": "network-changed", "server_uuid": "f57a0500-5de5-48e7-bc4e-c25234ca8fa6", "tag": "f50067a7-443a-48a2-a22b-703b731470d5"}, {"server_uuid": "e42d51e5-d212-4768-bcef-1990cc448e06", "name": "network-vif-deleted", "tag": "4612f5a9-e8fb-4fac-8539-f4d3f8624a31"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:34.522051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b13bfc40-f29b-4031-a1da-252b1c6b1a09 req-cd8ee03d-aee1-4a09-9ca4-55accf1976b8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:34.522503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b13bfc40-f29b-4031-a1da-252b1c6b1a09 req-cd8ee03d-aee1-4a09-9ca4-55accf1976b8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:34.539914 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b13bfc40-f29b-4031-a1da-252b1c6b1a09 req-cd8ee03d-aee1-4a09-9ca4-55accf1976b8 service nova] Creating event network-changed:4dce8ccd-5f8a-4b35-a9d0-946725622ad1 for instance 1dca550f-8f08-4f26-a922-b8b222db43a1 on n-h2-826756-3 Jul 28 03:50:34.540517 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b13bfc40-f29b-4031-a1da-252b1c6b1a09 req-cd8ee03d-aee1-4a09-9ca4-55accf1976b8 service nova] Creating event network-changed:f50067a7-443a-48a2-a22b-703b731470d5 for instance f57a0500-5de5-48e7-bc4e-c25234ca8fa6 on n-h2-826756-3 Jul 28 03:50:34.541956 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b13bfc40-f29b-4031-a1da-252b1c6b1a09 req-cd8ee03d-aee1-4a09-9ca4-55accf1976b8 service nova] Creating event network-vif-deleted:4612f5a9-e8fb-4fac-8539-f4d3f8624a31 for instance e42d51e5-d212-4768-bcef-1990cc448e06 on n-h2-826756-3 Jul 28 03:50:34.549858 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b13bfc40-f29b-4031-a1da-252b1c6b1a09 req-cd8ee03d-aee1-4a09-9ca4-55accf1976b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.043442 Jul 28 03:50:34.550721 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1727/3123] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:34.555783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e5f2a12-5299-43f5-9e21-623c164dd583 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:34.556839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e5f2a12-5299-43f5-9e21-623c164dd583 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:34.564011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e5f2a12-5299-43f5-9e21-623c164dd583 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:34.564663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e5f2a12-5299-43f5-9e21-623c164dd583 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:34.565474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e5f2a12-5299-43f5-9e21-623c164dd583 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:34.565923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e5f2a12-5299-43f5-9e21-623c164dd583 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:34.569882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:34.585680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:50:34.585680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:50:34.586551 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:50:34.586786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:50:34.587243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:50:34.598539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:34.599092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:34.600026 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:34.600602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:34.610652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e5f2a12-5299-43f5-9e21-623c164dd583 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:34.611391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e5f2a12-5299-43f5-9e21-623c164dd583 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:34.612408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-3e5f2a12-5299-43f5-9e21-623c164dd583 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lazy-loading 'fault' on Instance uuid e42d51e5-d212-4768-bcef-1990cc448e06 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:50:34.644522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for project 781ab005138547038def64d108937e3e. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:50:34.667518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for user d20381abd9784627887af3cb97cd68a8 and project 781ab005138547038def64d108937e3e. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:50:34.673033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e5f2a12-5299-43f5-9e21-623c164dd583 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:34.687741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:50:34.688000 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e5f2a12-5299-43f5-9e21-623c164dd583 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1302 microversion: 2.1 time: 0.136107 Jul 28 03:50:34.690963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:50:34.702543 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1728/3124] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:34 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1302 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:34.711220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-07cb5173-2aa6-4f74-bb67-7e2ba7fa83c4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:34.716873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-07cb5173-2aa6-4f74-bb67-7e2ba7fa83c4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:34.727288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07cb5173-2aa6-4f74-bb67-7e2ba7fa83c4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:34.727884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07cb5173-2aa6-4f74-bb67-7e2ba7fa83c4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:34.729254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07cb5173-2aa6-4f74-bb67-7e2ba7fa83c4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:34.729854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07cb5173-2aa6-4f74-bb67-7e2ba7fa83c4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:34.793035 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fc33475d-85a8-4adb-8a52-a06886ea5a31 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.594965 Jul 28 03:50:34.801951 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1397/3125] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:50:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 2617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:50:34.811865 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1feb771e-68bf-43c5-bed3-ac87a68d29e2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:34.813120 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1feb771e-68bf-43c5-bed3-ac87a68d29e2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:34.927310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-07cb5173-2aa6-4f74-bb67-7e2ba7fa83c4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:34.936492 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-07cb5173-2aa6-4f74-bb67-7e2ba7fa83c4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 200 len: 1502 microversion: 2.1 time: 0.232457 Jul 28 03:50:34.937118 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1729/3126] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:34 2022] GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 1502 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:35.023435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1feb771e-68bf-43c5-bed3-ac87a68d29e2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:35.051288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-68d0ae8a-affc-4f65-b026-bfe30e171b1d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:35.051831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-68d0ae8a-affc-4f65-b026-bfe30e171b1d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:35.062132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68d0ae8a-affc-4f65-b026-bfe30e171b1d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:35.062604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68d0ae8a-affc-4f65-b026-bfe30e171b1d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:35.063411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68d0ae8a-affc-4f65-b026-bfe30e171b1d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:35.063846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68d0ae8a-affc-4f65-b026-bfe30e171b1d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:35.080768 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1feb771e-68bf-43c5-bed3-ac87a68d29e2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1241 microversion: 2.1 time: 0.275614 Jul 28 03:50:35.084225 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1398/3127] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:34 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1241 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:35.254666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-0415ad4b-666e-4c0b-94ec-50d1a4463f7c req-14024768-0d17-42fc-a405-b8b57efedcef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d8efe8-31af-4052-80af-189387e88134", "name": "network-vif-plugged", "status": "completed", "tag": "4501bc0b-758b-4585-8209-f282991da4d7"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:35.309894 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-0415ad4b-666e-4c0b-94ec-50d1a4463f7c req-14024768-0d17-42fc-a405-b8b57efedcef service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:35.311152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-0415ad4b-666e-4c0b-94ec-50d1a4463f7c req-14024768-0d17-42fc-a405-b8b57efedcef service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:35.329317 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-0415ad4b-666e-4c0b-94ec-50d1a4463f7c req-14024768-0d17-42fc-a405-b8b57efedcef service nova] Creating event network-vif-plugged:4501bc0b-758b-4585-8209-f282991da4d7 for instance c5d8efe8-31af-4052-80af-189387e88134 on n-h1-826756-3 Jul 28 03:50:35.337068 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-0415ad4b-666e-4c0b-94ec-50d1a4463f7c req-14024768-0d17-42fc-a405-b8b57efedcef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088854 Jul 28 03:50:35.338844 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1399/3128] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:50:35.357943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fb5128c8-af9a-4236-b0f0-f5a59ea8230e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:35.360013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fb5128c8-af9a-4236-b0f0-f5a59ea8230e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:35.369313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb5128c8-af9a-4236-b0f0-f5a59ea8230e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:35.370223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb5128c8-af9a-4236-b0f0-f5a59ea8230e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:35.371323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb5128c8-af9a-4236-b0f0-f5a59ea8230e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:35.373321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb5128c8-af9a-4236-b0f0-f5a59ea8230e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:35.413614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-68d0ae8a-affc-4f65-b026-bfe30e171b1d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:35.426104 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-68d0ae8a-affc-4f65-b026-bfe30e171b1d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1313 microversion: 2.1 time: 0.378681 Jul 28 03:50:35.427255 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1730/3129] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:35 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:35.533750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c7db8b92-68fc-4482-a255-ad82755115bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:35.535732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c7db8b92-68fc-4482-a255-ad82755115bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:35.562708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7db8b92-68fc-4482-a255-ad82755115bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:35.563182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7db8b92-68fc-4482-a255-ad82755115bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:35.564026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7db8b92-68fc-4482-a255-ad82755115bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:35.567485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7db8b92-68fc-4482-a255-ad82755115bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:35.847591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fb5128c8-af9a-4236-b0f0-f5a59ea8230e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:35.860475 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fb5128c8-af9a-4236-b0f0-f5a59ea8230e tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1323 microversion: 2.1 time: 0.520007 Jul 28 03:50:35.861744 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1400/3130] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:35 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1323 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:35.866903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c95cd0b6-2595-47d3-b199-a61f052c8584 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:35.868142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c95cd0b6-2595-47d3-b199-a61f052c8584 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:35.881614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c95cd0b6-2595-47d3-b199-a61f052c8584 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:35.882178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c95cd0b6-2595-47d3-b199-a61f052c8584 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:35.884017 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c95cd0b6-2595-47d3-b199-a61f052c8584 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:35.885070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c95cd0b6-2595-47d3-b199-a61f052c8584 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:35.947569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c95cd0b6-2595-47d3-b199-a61f052c8584 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:35.948009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c95cd0b6-2595-47d3-b199-a61f052c8584 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:35.948705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-c95cd0b6-2595-47d3-b199-a61f052c8584 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lazy-loading 'fault' on Instance uuid e42d51e5-d212-4768-bcef-1990cc448e06 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:50:36.058758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c95cd0b6-2595-47d3-b199-a61f052c8584 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9290ff8a6a524900894b16523e9a2fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6bba8696d304edbb658461d3f313beb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:36.071977 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c95cd0b6-2595-47d3-b199-a61f052c8584 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 200 len: 1302 microversion: 2.1 time: 0.208703 Jul 28 03:50:36.073161 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1401/3131] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:35 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 1302 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:36.078382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0f568892-e41d-47de-af13-31d2acf55dc3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:36.079166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0f568892-e41d-47de-af13-31d2acf55dc3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:36.086654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0f568892-e41d-47de-af13-31d2acf55dc3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:36.087648 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0f568892-e41d-47de-af13-31d2acf55dc3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:36.088707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0f568892-e41d-47de-af13-31d2acf55dc3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:36.089384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0f568892-e41d-47de-af13-31d2acf55dc3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:36.197552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c7db8b92-68fc-4482-a255-ad82755115bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:36.208824 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c7db8b92-68fc-4482-a255-ad82755115bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1499 microversion: 2.1 time: 0.684368 Jul 28 03:50:36.209736 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1731/3132] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:35 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1499 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:36.239467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-81c07ae6-2379-4467-b472-5fd740ac823e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:36.240776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-81c07ae6-2379-4467-b472-5fd740ac823e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:36.247046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:36.249162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81c07ae6-2379-4467-b472-5fd740ac823e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:36.249759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81c07ae6-2379-4467-b472-5fd740ac823e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:36.250772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81c07ae6-2379-4467-b472-5fd740ac823e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:36.251221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81c07ae6-2379-4467-b472-5fd740ac823e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:36.323187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-81c07ae6-2379-4467-b472-5fd740ac823e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:36.336069 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-81c07ae6-2379-4467-b472-5fd740ac823e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1245 microversion: 2.1 time: 0.106873 Jul 28 03:50:36.344811 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1732/3133] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:36 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:36.344811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0b5afc63-9f5f-4648-9dac-b1bbe32406c5 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:36.346345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0b5afc63-9f5f-4648-9dac-b1bbe32406c5 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:36.358046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b5afc63-9f5f-4648-9dac-b1bbe32406c5 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:36.358507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b5afc63-9f5f-4648-9dac-b1bbe32406c5 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:36.359481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b5afc63-9f5f-4648-9dac-b1bbe32406c5 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:36.359930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b5afc63-9f5f-4648-9dac-b1bbe32406c5 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:36.394793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-0b5afc63-9f5f-4648-9dac-b1bbe32406c5 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lazy-loading 'flavor' on Instance uuid 4b9af60f-ae9a-44b4-ab96-f43afbc198d5 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:50:36.486008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0f568892-e41d-47de-af13-31d2acf55dc3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:36.502285 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0f568892-e41d-47de-af13-31d2acf55dc3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 200 len: 1502 microversion: 2.1 time: 0.427810 Jul 28 03:50:36.505038 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1402/3134] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:36 2022] GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 1502 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:36.512805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dae5fbfc-470b-47b4-9d53-2e262f30baf5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:36.513680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dae5fbfc-470b-47b4-9d53-2e262f30baf5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:36.526768 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0b5afc63-9f5f-4648-9dac-b1bbe32406c5 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "POST /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5/action" status: 200 len: 32 microversion: 2.1 time: 0.188454 Jul 28 03:50:36.527512 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1733/3135] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:50:36 2022] POST /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:50:36.534340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dae5fbfc-470b-47b4-9d53-2e262f30baf5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:36.535020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dae5fbfc-470b-47b4-9d53-2e262f30baf5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:36.535755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dae5fbfc-470b-47b4-9d53-2e262f30baf5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:36.536522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dae5fbfc-470b-47b4-9d53-2e262f30baf5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:36.539345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e39359c0-dd39-4d6d-b616-f993c310adac tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:36.540255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e39359c0-dd39-4d6d-b616-f993c310adac tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:36.556307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e39359c0-dd39-4d6d-b616-f993c310adac tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:36.557114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e39359c0-dd39-4d6d-b616-f993c310adac tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:36.557990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e39359c0-dd39-4d6d-b616-f993c310adac tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:36.558670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e39359c0-dd39-4d6d-b616-f993c310adac tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:36.791823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=22 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:36.860826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e39359c0-dd39-4d6d-b616-f993c310adac tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:36.892475 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e39359c0-dd39-4d6d-b616-f993c310adac tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.357372 Jul 28 03:50:36.894878 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1734/3136] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:36 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:36.914770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-339e7068-c956-42ef-a304-8b3aa97929a3 req-ecb4e145-8d1e-46c0-a78c-f318a436408e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852ef6b3-2db0-4d01-9af9-b8bcda4937e4", "name": "network-vif-deleted", "tag": "05bc4f93-611a-42fa-b8c2-db24a22c3131"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:36.933415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-339e7068-c956-42ef-a304-8b3aa97929a3 req-ecb4e145-8d1e-46c0-a78c-f318a436408e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:36.935421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-339e7068-c956-42ef-a304-8b3aa97929a3 req-ecb4e145-8d1e-46c0-a78c-f318a436408e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:36.960218 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-339e7068-c956-42ef-a304-8b3aa97929a3 req-ecb4e145-8d1e-46c0-a78c-f318a436408e service nova] Creating event network-vif-deleted:05bc4f93-611a-42fa-b8c2-db24a22c3131 for instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 on n-h1-826756-3 Jul 28 03:50:36.971419 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-339e7068-c956-42ef-a304-8b3aa97929a3 req-ecb4e145-8d1e-46c0-a78c-f318a436408e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074370 Jul 28 03:50:36.973205 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1735/3137] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:36.982522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-586fecc1-3d67-42cb-a181-d4faac5af69d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:36.986156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-586fecc1-3d67-42cb-a181-d4faac5af69d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:37.014843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-586fecc1-3d67-42cb-a181-d4faac5af69d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:37.016771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-586fecc1-3d67-42cb-a181-d4faac5af69d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:37.022295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-586fecc1-3d67-42cb-a181-d4faac5af69d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:37.026770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-586fecc1-3d67-42cb-a181-d4faac5af69d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:37.063108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dae5fbfc-470b-47b4-9d53-2e262f30baf5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:37.075587 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dae5fbfc-470b-47b4-9d53-2e262f30baf5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1313 microversion: 2.1 time: 0.568610 Jul 28 03:50:37.076731 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1403/3138] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:36 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1313 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:37.122956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-601d5534-156d-475f-803a-75a60ba64696 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:37.124702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-601d5534-156d-475f-803a-75a60ba64696 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:37.140199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-601d5534-156d-475f-803a-75a60ba64696 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:37.141413 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-601d5534-156d-475f-803a-75a60ba64696 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:37.142902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-601d5534-156d-475f-803a-75a60ba64696 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:37.143432 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-601d5534-156d-475f-803a-75a60ba64696 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:37.165736 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-601d5534-156d-475f-803a-75a60ba64696 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] HTTP exception thrown: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-601d5534-156d-475f-803a-75a60ba64696 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Request method failure captured: Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 HTTP/1.1 Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gbzast_Oajy2o3oVjsoD8MDbWSFl4PqFZGSQpsKNTVljzKZyP2UJX4BAxzxg3EsGRB2XT5e3x-qUGwamy-ARdlY8sfsrY521TPXpeV_ldCG8ULveXBZhf0u1_buTMn7D47ZmSu58ltI8i9b48HujdQhlDaP4tEIoJaU35Xpg1nbRGQ Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: a6bba8696d304edbb658461d3f313beb Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a6bba8696d304edbb658461d3f313beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6bba8696d304edbb658461d3f313beb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a6bba8696d304edbb658461d3f313beb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6bba8696d304edbb658461d3f313beb"}]}] Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: a6bba8696d304edbb658461d3f313beb Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersTestMultiNic-915001081-project Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 9290ff8a6a524900894b16523e9a2fb8 Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersTestMultiNic-915001081-project Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'e42d51e5-d212-4768-bcef-1990cc448e06'} Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:37.169141 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.174037 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.174037 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:37.174037 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:37.174037 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:50:37.174037 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:50:37.174037 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:37.174037 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.174037 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-601d5534-156d-475f-803a-75a60ba64696 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Returning 404 to user: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:37.174037 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-601d5534-156d-475f-803a-75a60ba64696 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 404 len: 111 microversion: 2.1 time: 0.060077 Jul 28 03:50:37.174037 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1404/3139] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:37 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:50:37.362833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d8335edc-be47-422d-8289-afcb492c33e5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:37.366750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d8335edc-be47-422d-8289-afcb492c33e5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:37.392087 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8335edc-be47-422d-8289-afcb492c33e5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:37.392591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8335edc-be47-422d-8289-afcb492c33e5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:37.413792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8335edc-be47-422d-8289-afcb492c33e5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:37.414267 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8335edc-be47-422d-8289-afcb492c33e5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:37.497388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-586fecc1-3d67-42cb-a181-d4faac5af69d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:37.522249 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-586fecc1-3d67-42cb-a181-d4faac5af69d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1519 microversion: 2.1 time: 0.545195 Jul 28 03:50:37.526250 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1736/3140] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:36 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1519 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:37.540383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c5e44755-92cb-4585-8b54-6c6d2bdd4454 req-40e5b35f-ad65-4e38-9f81-616c49d89e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852ef6b3-2db0-4d01-9af9-b8bcda4937e4", "name": "network-vif-unplugged", "status": "completed", "tag": "05bc4f93-611a-42fa-b8c2-db24a22c3131"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:37.575993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c5e44755-92cb-4585-8b54-6c6d2bdd4454 req-40e5b35f-ad65-4e38-9f81-616c49d89e07 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:37.577915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c5e44755-92cb-4585-8b54-6c6d2bdd4454 req-40e5b35f-ad65-4e38-9f81-616c49d89e07 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:37.627869 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d8335edc-be47-422d-8289-afcb492c33e5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:37.634630 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c5e44755-92cb-4585-8b54-6c6d2bdd4454 req-40e5b35f-ad65-4e38-9f81-616c49d89e07 service nova] Creating event network-vif-unplugged:05bc4f93-611a-42fa-b8c2-db24a22c3131 for instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 on n-h1-826756-3 Jul 28 03:50:37.641057 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d8335edc-be47-422d-8289-afcb492c33e5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1311 microversion: 2.1 time: 0.283853 Jul 28 03:50:37.644455 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1405/3141] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:37 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1311 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:37.655745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d286a020-3bae-4360-925a-550ed2937f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:37.656639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d286a020-3bae-4360-925a-550ed2937f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:37.669252 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c5e44755-92cb-4585-8b54-6c6d2bdd4454 req-40e5b35f-ad65-4e38-9f81-616c49d89e07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140151 Jul 28 03:50:37.672674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d286a020-3bae-4360-925a-550ed2937f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:37.675044 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1737/3142] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:37.675733 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d286a020-3bae-4360-925a-550ed2937f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:37.676926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d286a020-3bae-4360-925a-550ed2937f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:37.678402 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d286a020-3bae-4360-925a-550ed2937f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:37.708179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a05d58f-3ab9-4105-966f-0e19eb609a17 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-704837402", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3180c803-d610-4370-bdd1-6fffd42aed30"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:37.713426 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-d286a020-3bae-4360-925a-550ed2937f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d286a020-3bae-4360-925a-550ed2937f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 HTTP/1.1 Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '852ef6b3-2db0-4d01-9af9-b8bcda4937e4'} Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:37.720073 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.729051 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.729051 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:37.729051 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:37.729051 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:50:37.729051 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:50:37.729051 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:50:37.729051 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a05d58f-3ab9-4105-966f-0e19eb609a17 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Request method failure captured: Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 242 Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gd30M_Oa6KzzPT3fTqGaTgi39NfBWpghUp5j1tjD_HVW0Qs7IJhSGA6BRZs64T68__4mPZA_m0XMZmaXZGlIhO_-SwQd0Wng7tcT6iCTeiTLR39EN6G2ZGBQgcytBtNLMbfkV5pozQZNHPhAylESgCTeoHXt6bJzISqrl-OPXcp63k Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}] Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 468992e0518a48e290cbf3cdd8ac6af7 Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-704837402", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "3180c803-d610-4370-bdd1-6fffd42aed30"}]}} Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-704837402', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '3180c803-d610-4370-bdd1-6fffd42aed30'}]}}} Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:50:37.730899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a05d58f-3ab9-4105-966f-0e19eb609a17 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a05d58f-3ab9-4105-966f-0e19eb609a17 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.022272 Jul 28 03:50:37.745137 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1738/3143] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:50:37 2022] POST /compute/v2.1/servers => generated 175 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:50:37.750051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d286a020-3bae-4360-925a-550ed2937f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:37.750051 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d286a020-3bae-4360-925a-550ed2937f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 404 len: 111 microversion: 2.1 time: 0.078889 Jul 28 03:50:37.750051 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1406/3144] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:37 2022] GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:50:37.760004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-18edd30f-924a-4582-aa13-f673929f06e2 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:37.760842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-18edd30f-924a-4582-aa13-f673929f06e2 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: 86a6577e-066c-41d2-be40-3fb75cb94ea6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:37.773052 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-18edd30f-924a-4582-aa13-f673929f06e2 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] HTTP exception thrown: Instance 86a6577e-066c-41d2-be40-3fb75cb94ea6 could not be found. Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-18edd30f-924a-4582-aa13-f673929f06e2 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Request method failure captured: Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/86a6577e-066c-41d2-be40-3fb75cb94ea6/metadata HTTP/1.1 Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gd30M_Oa6KzzPT3fTqGaTgi39NfBWpghUp5j1tjD_HVW0Qs7IJhSGA6BRZs64T68__4mPZA_m0XMZmaXZGlIhO_-SwQd0Wng7tcT6iCTeiTLR39EN6G2ZGBQgcytBtNLMbfkV5pozQZNHPhAylESgCTeoHXt6bJzISqrl-OPXcp63k Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}] Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 468992e0518a48e290cbf3cdd8ac6af7 Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 86a6577e-066c-41d2-be40-3fb75cb94ea6 could not be found. Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': '86a6577e-066c-41d2-be40-3fb75cb94ea6'} Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a6577e-066c-41d2-be40-3fb75cb94ea6 could not be found. Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a6577e-066c-41d2-be40-3fb75cb94ea6 could not be found. Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:37.782340 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:37.788913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:50:37.788913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:50:37.788913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a6577e-066c-41d2-be40-3fb75cb94ea6 could not be found. Jul 28 03:50:37.788913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.788913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-18edd30f-924a-4582-aa13-f673929f06e2 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Returning 404 to user: Instance 86a6577e-066c-41d2-be40-3fb75cb94ea6 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:37.788913 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-18edd30f-924a-4582-aa13-f673929f06e2 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/86a6577e-066c-41d2-be40-3fb75cb94ea6/metadata" status: 404 len: 111 microversion: 2.1 time: 0.031685 Jul 28 03:50:37.788913 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1739/3145] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:50:37 2022] GET /compute/v2.1/servers/86a6577e-066c-41d2-be40-3fb75cb94ea6/metadata => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:50:37.868210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2d33cd06-f3ef-491f-9888-fd5b357c5dbd tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-386180006", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3180c803-d610-4370-bdd1-6fffd42aed30"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2d33cd06-f3ef-491f-9888-fd5b357c5dbd tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Request method failure captured: Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 498 Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gd30M_Oa6KzzPT3fTqGaTgi39NfBWpghUp5j1tjD_HVW0Qs7IJhSGA6BRZs64T68__4mPZA_m0XMZmaXZGlIhO_-SwQd0Wng7tcT6iCTeiTLR39EN6G2ZGBQgcytBtNLMbfkV5pozQZNHPhAylESgCTeoHXt6bJzISqrl-OPXcp63k Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}] Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 468992e0518a48e290cbf3cdd8ac6af7 Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-386180006", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3180c803-d610-4370-bdd1-6fffd42aed30"}]}} Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-386180006', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3180c803-d610-4370-bdd1-6fffd42aed30'}]}}} Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 28 03:50:37.875211 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:37.879348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:37.882085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2d33cd06-f3ef-491f-9888-fd5b357c5dbd tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:37.885211 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2d33cd06-f3ef-491f-9888-fd5b357c5dbd tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.021287 Jul 28 03:50:37.886309 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1407/3146] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:50:37 2022] POST /compute/v2.1/servers => generated 687 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:50:37.920825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-806df5bc-ff3c-4024-a091-021c1ad59d70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:37.921409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-806df5bc-ff3c-4024-a091-021c1ad59d70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:37.940212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-806df5bc-ff3c-4024-a091-021c1ad59d70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:37.940709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-806df5bc-ff3c-4024-a091-021c1ad59d70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:37.941583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-806df5bc-ff3c-4024-a091-021c1ad59d70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:37.942141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-806df5bc-ff3c-4024-a091-021c1ad59d70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:37.953954 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-654179107", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "c540e59d-0550-4ece-8b64-1987a84fa206"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:38.049101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] validate_networks() for [('c540e59d-0550-4ece-8b64-1987a84fa206', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:50:38.398465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-806df5bc-ff3c-4024-a091-021c1ad59d70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:38.418935 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-806df5bc-ff3c-4024-a091-021c1ad59d70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.503906 Jul 28 03:50:38.420284 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1740/3147] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:37 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:38.428693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-75aedc68-8e46-4b42-b0ae-9bd7e7595a56 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-759935478", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3180c803-d610-4370-bdd1-6fffd42aed30"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-75aedc68-8e46-4b42-b0ae-9bd7e7595a56 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Request method failure captured: Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 499 Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gd30M_Oa6KzzPT3fTqGaTgi39NfBWpghUp5j1tjD_HVW0Qs7IJhSGA6BRZs64T68__4mPZA_m0XMZmaXZGlIhO_-SwQd0Wng7tcT6iCTeiTLR39EN6G2ZGBQgcytBtNLMbfkV5pozQZNHPhAylESgCTeoHXt6bJzISqrl-OPXcp63k Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}] Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 468992e0518a48e290cbf3cdd8ac6af7 Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-759935478", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3180c803-d610-4370-bdd1-6fffd42aed30"}]}} Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-759935478', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3180c803-d610-4370-bdd1-6fffd42aed30'}]}}} Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 03:50:38.434134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:38.437694 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:38.443177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-75aedc68-8e46-4b42-b0ae-9bd7e7595a56 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:38.444493 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-75aedc68-8e46-4b42-b0ae-9bd7e7595a56 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.022751 Jul 28 03:50:38.445666 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1741/3148] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:50:38 2022] POST /compute/v2.1/servers => generated 689 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:50:38.455039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2eddfd7c-6728-4b66-85c5-d510c172b1bf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:38.456188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2eddfd7c-6728-4b66-85c5-d510c172b1bf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:38.471381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2eddfd7c-6728-4b66-85c5-d510c172b1bf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:38.472733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2eddfd7c-6728-4b66-85c5-d510c172b1bf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:38.473974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2eddfd7c-6728-4b66-85c5-d510c172b1bf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:38.475044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2eddfd7c-6728-4b66-85c5-d510c172b1bf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:38.881481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2eddfd7c-6728-4b66-85c5-d510c172b1bf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:38.895392 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2eddfd7c-6728-4b66-85c5-d510c172b1bf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1313 microversion: 2.1 time: 0.445293 Jul 28 03:50:38.896064 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1742/3149] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:38 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:38.911220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ea15d6c-b0a5-4e7f-95d7-bb5111a9b2ca tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1132046690", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3180c803-d610-4370-bdd1-6fffd42aed30"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ea15d6c-b0a5-4e7f-95d7-bb5111a9b2ca tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Request method failure captured: Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 754 Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gd30M_Oa6KzzPT3fTqGaTgi39NfBWpghUp5j1tjD_HVW0Qs7IJhSGA6BRZs64T68__4mPZA_m0XMZmaXZGlIhO_-SwQd0Wng7tcT6iCTeiTLR39EN6G2ZGBQgcytBtNLMbfkV5pozQZNHPhAylESgCTeoHXt6bJzISqrl-OPXcp63k Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}] Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 468992e0518a48e290cbf3cdd8ac6af7 Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1132046690", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3180c803-d610-4370-bdd1-6fffd42aed30"}]}} Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1132046690', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3180c803-d610-4370-bdd1-6fffd42aed30'}]}}} Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:50:38.922864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:50:38.926768 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:50:38.929643 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:38.929643 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:38.929643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ea15d6c-b0a5-4e7f-95d7-bb5111a9b2ca tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:38.929643 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ea15d6c-b0a5-4e7f-95d7-bb5111a9b2ca tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.027397 Jul 28 03:50:38.932737 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1743/3150] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:50:38 2022] POST /compute/v2.1/servers => generated 1197 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 28 03:50:38.948565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a61ca1b7-ad06-4951-9270-4db11c5c2d4a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:38.950025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a61ca1b7-ad06-4951-9270-4db11c5c2d4a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:38.967996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a61ca1b7-ad06-4951-9270-4db11c5c2d4a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:38.967996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a61ca1b7-ad06-4951-9270-4db11c5c2d4a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:38.970629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a61ca1b7-ad06-4951-9270-4db11c5c2d4a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:38.972805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a61ca1b7-ad06-4951-9270-4db11c5c2d4a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:39.192333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a61ca1b7-ad06-4951-9270-4db11c5c2d4a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:39.203483 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a61ca1b7-ad06-4951-9270-4db11c5c2d4a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1299 microversion: 2.1 time: 0.269019 Jul 28 03:50:39.204406 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1744/3151] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:38 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1299 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:39.217199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5bf6d3fd-0b1f-494b-86b4-e82386d911c8 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1157482173", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3180c803-d610-4370-bdd1-6fffd42aed30"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5bf6d3fd-0b1f-494b-86b4-e82386d911c8 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Request method failure captured: Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 1266 Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gd30M_Oa6KzzPT3fTqGaTgi39NfBWpghUp5j1tjD_HVW0Qs7IJhSGA6BRZs64T68__4mPZA_m0XMZmaXZGlIhO_-SwQd0Wng7tcT6iCTeiTLR39EN6G2ZGBQgcytBtNLMbfkV5pozQZNHPhAylESgCTeoHXt6bJzISqrl-OPXcp63k Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}] Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 468992e0518a48e290cbf3cdd8ac6af7 Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1157482173", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "3180c803-d610-4370-bdd1-6fffd42aed30"}]}} Jul 28 03:50:39.229394 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1157482173', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '3180c803-d610-4370-bdd1-6fffd42aed30'}]}}} Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:39.231658 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:50:39.232784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:50:39.234541 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:50:39.234541 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:39.234541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5bf6d3fd-0b1f-494b-86b4-e82386d911c8 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:39.235495 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5bf6d3fd-0b1f-494b-86b4-e82386d911c8 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.029636 Jul 28 03:50:39.236729 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1745/3152] 10.222.0.48 () {60 vars in 1148 bytes} [Thu Jul 28 03:50:39 2022] POST /compute/v2.1/servers => generated 2221 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 28 03:50:39.251887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b151fb25-c747-4f32-b19a-e7d250087218 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:39.253982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b151fb25-c747-4f32-b19a-e7d250087218 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: e72fce7f-6f05-419c-ad9f-95fb0842743d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:39.270965 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-b151fb25-c747-4f32-b19a-e7d250087218 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] HTTP exception thrown: Instance e72fce7f-6f05-419c-ad9f-95fb0842743d could not be found. Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b151fb25-c747-4f32-b19a-e7d250087218 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Request method failure captured: Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/e72fce7f-6f05-419c-ad9f-95fb0842743d/metadata/test2 HTTP/1.1 Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gd30M_Oa6KzzPT3fTqGaTgi39NfBWpghUp5j1tjD_HVW0Qs7IJhSGA6BRZs64T68__4mPZA_m0XMZmaXZGlIhO_-SwQd0Wng7tcT6iCTeiTLR39EN6G2ZGBQgcytBtNLMbfkV5pozQZNHPhAylESgCTeoHXt6bJzISqrl-OPXcp63k Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}] Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 468992e0518a48e290cbf3cdd8ac6af7 Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance e72fce7f-6f05-419c-ad9f-95fb0842743d could not be found. Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': 'e72fce7f-6f05-419c-ad9f-95fb0842743d', 'id': 'test2'} Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e72fce7f-6f05-419c-ad9f-95fb0842743d could not be found. Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e72fce7f-6f05-419c-ad9f-95fb0842743d could not be found. Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:39.274281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:39.279089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:50:39.279089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:50:39.279089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e72fce7f-6f05-419c-ad9f-95fb0842743d could not be found. Jul 28 03:50:39.279089 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:39.281513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b151fb25-c747-4f32-b19a-e7d250087218 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Returning 404 to user: Instance e72fce7f-6f05-419c-ad9f-95fb0842743d could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:39.285375 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b151fb25-c747-4f32-b19a-e7d250087218 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/e72fce7f-6f05-419c-ad9f-95fb0842743d/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.041806 Jul 28 03:50:39.287660 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1746/3153] 10.222.0.48 () {58 vars in 1281 bytes} [Thu Jul 28 03:50:39 2022] GET /compute/v2.1/servers/e72fce7f-6f05-419c-ad9f-95fb0842743d/metadata/test2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:50:39.307491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2915b70-5b1d-498d-b2b7-0edcb7f00159 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:39.308323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2915b70-5b1d-498d-b2b7-0edcb7f00159 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:39.319811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2915b70-5b1d-498d-b2b7-0edcb7f00159 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:39.320615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2915b70-5b1d-498d-b2b7-0edcb7f00159 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:39.322194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2915b70-5b1d-498d-b2b7-0edcb7f00159 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:39.323924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2915b70-5b1d-498d-b2b7-0edcb7f00159 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:39.375605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2915b70-5b1d-498d-b2b7-0edcb7f00159 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:50:39.529060 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b2915b70-5b1d-498d-b2b7-0edcb7f00159 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 204 len: 0 microversion: 2.1 time: 0.226480 Jul 28 03:50:39.530377 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1747/3154] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:50:39 2022] DELETE /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:50:39.537964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0dda6c6d-35cd-425c-91d2-e24b7c0c8ce8 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:39.538690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0dda6c6d-35cd-425c-91d2-e24b7c0c8ce8 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:39.546136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dda6c6d-35cd-425c-91d2-e24b7c0c8ce8 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:39.546598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dda6c6d-35cd-425c-91d2-e24b7c0c8ce8 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:39.547626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dda6c6d-35cd-425c-91d2-e24b7c0c8ce8 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:39.548072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dda6c6d-35cd-425c-91d2-e24b7c0c8ce8 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:39.593582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:40.003176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0dda6c6d-35cd-425c-91d2-e24b7c0c8ce8 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:40.014138 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0dda6c6d-35cd-425c-91d2-e24b7c0c8ce8 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.482288 Jul 28 03:50:40.023595 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1748/3155] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:39 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:40.023595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e9030a29-a195-41e4-b416-28de445d0213 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:40.023595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e9030a29-a195-41e4-b416-28de445d0213 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:40.028100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9030a29-a195-41e4-b416-28de445d0213 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:40.028762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9030a29-a195-41e4-b416-28de445d0213 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:40.029550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9030a29-a195-41e4-b416-28de445d0213 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:40.029981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9030a29-a195-41e4-b416-28de445d0213 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:40.332563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:50:40.337539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:50:40.338303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:50:40.338718 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:50:40.338959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e9030a29-a195-41e4-b416-28de445d0213 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:40.339138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:50:40.347918 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e9030a29-a195-41e4-b416-28de445d0213 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1525 microversion: 2.1 time: 0.331680 Jul 28 03:50:40.348554 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1749/3156] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:40 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1525 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:40.359086 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:40.359548 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:40.360324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:40.360482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c543d7a5-6c59-4d30-984c-79687641504a req-ffa04c0c-6a36-434d-93a1-82c6284131bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dca550f-8f08-4f26-a922-b8b222db43a1", "name": "network-vif-plugged", "status": "completed", "tag": "4dce8ccd-5f8a-4b35-a9d0-946725622ad1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:40.360862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:40.382267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c543d7a5-6c59-4d30-984c-79687641504a req-ffa04c0c-6a36-434d-93a1-82c6284131bd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:40.382721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c543d7a5-6c59-4d30-984c-79687641504a req-ffa04c0c-6a36-434d-93a1-82c6284131bd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:40.416803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Getting quotas for project 34ed8cbcca694b8794992388d95bf072. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:50:40.423480 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c543d7a5-6c59-4d30-984c-79687641504a req-ffa04c0c-6a36-434d-93a1-82c6284131bd service nova] Creating event network-vif-plugged:4dce8ccd-5f8a-4b35-a9d0-946725622ad1 for instance 1dca550f-8f08-4f26-a922-b8b222db43a1 on n-h2-826756-3 Jul 28 03:50:40.429354 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c543d7a5-6c59-4d30-984c-79687641504a req-ffa04c0c-6a36-434d-93a1-82c6284131bd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078984 Jul 28 03:50:40.429986 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1750/3157] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:40.435728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70bd51e7-9359-478d-8352-9ff02e30b1fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:40.436467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-70bd51e7-9359-478d-8352-9ff02e30b1fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:40.440270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Getting quotas for user 67fcd8c3ec5441e582a4852f0f1184b6 and project 34ed8cbcca694b8794992388d95bf072. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:50:40.453131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70bd51e7-9359-478d-8352-9ff02e30b1fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:40.453874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70bd51e7-9359-478d-8352-9ff02e30b1fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:40.455189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70bd51e7-9359-478d-8352-9ff02e30b1fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:40.455897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70bd51e7-9359-478d-8352-9ff02e30b1fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:40.464544 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:50:40.470061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:50:40.600636 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a089c1c9-25f0-45d3-bf86-391ee29f99e5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.653013 Jul 28 03:50:40.606758 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1408/3158] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:50:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:50:40.618508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-226d71b7-3b95-427a-b98b-980822fa9b2a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:40.624328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-226d71b7-3b95-427a-b98b-980822fa9b2a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:40.647068 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-226d71b7-3b95-427a-b98b-980822fa9b2a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:40.647856 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-226d71b7-3b95-427a-b98b-980822fa9b2a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:40.649441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-226d71b7-3b95-427a-b98b-980822fa9b2a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:40.651373 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-226d71b7-3b95-427a-b98b-980822fa9b2a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:40.870024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-70bd51e7-9359-478d-8352-9ff02e30b1fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:40.881820 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-70bd51e7-9359-478d-8352-9ff02e30b1fd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1313 microversion: 2.1 time: 0.450262 Jul 28 03:50:40.882827 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1751/3159] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:40 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:40.890618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7caf213b-8c5c-4a7a-9a83-faa724ce89ad tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:40.891876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7caf213b-8c5c-4a7a-9a83-faa724ce89ad tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:41.058796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7caf213b-8c5c-4a7a-9a83-faa724ce89ad tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:41.066785 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7caf213b-8c5c-4a7a-9a83-faa724ce89ad tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1214 microversion: 2.1 time: 0.182416 Jul 28 03:50:41.068250 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1752/3160] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:40 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:41.074070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-481114e1-c6f6-4d6e-b304-d6ff16610b34 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:41.074846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-481114e1-c6f6-4d6e-b304-d6ff16610b34 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:41.083519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-481114e1-c6f6-4d6e-b304-d6ff16610b34 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:41.084135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-481114e1-c6f6-4d6e-b304-d6ff16610b34 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:41.085202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-481114e1-c6f6-4d6e-b304-d6ff16610b34 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:41.085748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-481114e1-c6f6-4d6e-b304-d6ff16610b34 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:41.370258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-481114e1-c6f6-4d6e-b304-d6ff16610b34 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:41.383418 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-481114e1-c6f6-4d6e-b304-d6ff16610b34 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.312043 Jul 28 03:50:41.384394 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1753/3161] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:41 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:41.404524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f7defa3a-cf88-4ffb-9f23-4e5dacc9ff03 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:41.405151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f7defa3a-cf88-4ffb-9f23-4e5dacc9ff03 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:41.437013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7defa3a-cf88-4ffb-9f23-4e5dacc9ff03 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:41.437663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7defa3a-cf88-4ffb-9f23-4e5dacc9ff03 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:41.439982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7defa3a-cf88-4ffb-9f23-4e5dacc9ff03 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:41.440515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7defa3a-cf88-4ffb-9f23-4e5dacc9ff03 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:41.729346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f7defa3a-cf88-4ffb-9f23-4e5dacc9ff03 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:41.743299 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f7defa3a-cf88-4ffb-9f23-4e5dacc9ff03 tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1525 microversion: 2.1 time: 0.357589 Jul 28 03:50:41.743940 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1754/3162] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:41 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1525 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:41.792800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-226d71b7-3b95-427a-b98b-980822fa9b2a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:41.808722 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-226d71b7-3b95-427a-b98b-980822fa9b2a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1367 microversion: 2.1 time: 1.200275 Jul 28 03:50:41.810007 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1409/3163] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:40 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1367 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:41.904093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2a9bd47b-90db-4388-989d-633aa004a2e1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:41.904882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2a9bd47b-90db-4388-989d-633aa004a2e1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:41.911921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a9bd47b-90db-4388-989d-633aa004a2e1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:41.912401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a9bd47b-90db-4388-989d-633aa004a2e1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:41.913396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a9bd47b-90db-4388-989d-633aa004a2e1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:41.913815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a9bd47b-90db-4388-989d-633aa004a2e1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.116262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-56fe9f71-775d-4a7d-9347-d2a1af09b787 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:42.117223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-56fe9f71-775d-4a7d-9347-d2a1af09b787 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:42.148326 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-56fe9f71-775d-4a7d-9347-d2a1af09b787 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.149185 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-56fe9f71-775d-4a7d-9347-d2a1af09b787 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.152975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-56fe9f71-775d-4a7d-9347-d2a1af09b787 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.154503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-56fe9f71-775d-4a7d-9347-d2a1af09b787 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.297874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2a9bd47b-90db-4388-989d-633aa004a2e1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:42.312344 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2a9bd47b-90db-4388-989d-633aa004a2e1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1313 microversion: 2.1 time: 0.412824 Jul 28 03:50:42.322723 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1755/3164] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:41 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:42.336253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c5b3d269-9db8-4fdf-b2ec-1da995dfaf66 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:42.337946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c5b3d269-9db8-4fdf-b2ec-1da995dfaf66 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:42.350332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5b3d269-9db8-4fdf-b2ec-1da995dfaf66 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.350970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5b3d269-9db8-4fdf-b2ec-1da995dfaf66 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.352238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5b3d269-9db8-4fdf-b2ec-1da995dfaf66 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.352989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5b3d269-9db8-4fdf-b2ec-1da995dfaf66 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.406165 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-c5b3d269-9db8-4fdf-b2ec-1da995dfaf66 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] HTTP exception thrown: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c5b3d269-9db8-4fdf-b2ec-1da995dfaf66 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Request method failure captured: Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 HTTP/1.1 Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gbzast_Oajy2o3oVjsoD8MDbWSFl4PqFZGSQpsKNTVljzKZyP2UJX4BAxzxg3EsGRB2XT5e3x-qUGwamy-ARdlY8sfsrY521TPXpeV_ldCG8ULveXBZhf0u1_buTMn7D47ZmSu58ltI8i9b48HujdQhlDaP4tEIoJaU35Xpg1nbRGQ Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a6bba8696d304edbb658461d3f313beb Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a6bba8696d304edbb658461d3f313beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6bba8696d304edbb658461d3f313beb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a6bba8696d304edbb658461d3f313beb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6bba8696d304edbb658461d3f313beb"}]}] Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a6bba8696d304edbb658461d3f313beb Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestMultiNic-915001081-project Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 9290ff8a6a524900894b16523e9a2fb8 Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestMultiNic-915001081-project Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'e42d51e5-d212-4768-bcef-1990cc448e06'} Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:50:42.413968 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:42.420882 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.420882 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:42.420882 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.420882 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:42.420882 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:42.420882 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:42.420882 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:50:42.420882 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:50:42.420882 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:42.420882 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.420882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c5b3d269-9db8-4fdf-b2ec-1da995dfaf66 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Returning 404 to user: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:42.422838 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c5b3d269-9db8-4fdf-b2ec-1da995dfaf66 tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 404 len: 111 microversion: 2.1 time: 0.091981 Jul 28 03:50:42.424510 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1756/3165] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:50:42 2022] DELETE /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:50:42.438528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5e229d6f-5207-404b-9f78-b4b5f51b4197 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:42.439615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5e229d6f-5207-404b-9f78-b4b5f51b4197 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:42.455964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e229d6f-5207-404b-9f78-b4b5f51b4197 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.457615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e229d6f-5207-404b-9f78-b4b5f51b4197 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.458758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e229d6f-5207-404b-9f78-b4b5f51b4197 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.461220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e229d6f-5207-404b-9f78-b4b5f51b4197 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.469685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-56fe9f71-775d-4a7d-9347-d2a1af09b787 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:42.483780 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-56fe9f71-775d-4a7d-9347-d2a1af09b787 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1274 microversion: 2.1 time: 0.395620 Jul 28 03:50:42.493514 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1410/3166] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:42 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1274 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:42.513126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4337ad52-b0bd-4f1d-ad34-14a58257fead tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:42.514598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4337ad52-b0bd-4f1d-ad34-14a58257fead tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: e42d51e5-d212-4768-bcef-1990cc448e06] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:42.524491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4337ad52-b0bd-4f1d-ad34-14a58257fead tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.525721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4337ad52-b0bd-4f1d-ad34-14a58257fead tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.527224 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4337ad52-b0bd-4f1d-ad34-14a58257fead tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.528266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4337ad52-b0bd-4f1d-ad34-14a58257fead tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.564391 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-4337ad52-b0bd-4f1d-ad34-14a58257fead tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] HTTP exception thrown: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4337ad52-b0bd-4f1d-ad34-14a58257fead tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Request method failure captured: Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 HTTP/1.1 Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gbzast_Oajy2o3oVjsoD8MDbWSFl4PqFZGSQpsKNTVljzKZyP2UJX4BAxzxg3EsGRB2XT5e3x-qUGwamy-ARdlY8sfsrY521TPXpeV_ldCG8ULveXBZhf0u1_buTMn7D47ZmSu58ltI8i9b48HujdQhlDaP4tEIoJaU35Xpg1nbRGQ Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: a6bba8696d304edbb658461d3f313beb Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a6bba8696d304edbb658461d3f313beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6bba8696d304edbb658461d3f313beb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a6bba8696d304edbb658461d3f313beb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6bba8696d304edbb658461d3f313beb"}]}] Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: a6bba8696d304edbb658461d3f313beb Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersTestMultiNic-915001081-project Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 9290ff8a6a524900894b16523e9a2fb8 Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersTestMultiNic-915001081-project Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'e42d51e5-d212-4768-bcef-1990cc448e06'} Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:42.566594 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.572434 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:42.572434 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:42.572434 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:42.572434 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:50:42.572434 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:50:42.572434 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. Jul 28 03:50:42.572434 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.574380 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4337ad52-b0bd-4f1d-ad34-14a58257fead tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Returning 404 to user: Instance e42d51e5-d212-4768-bcef-1990cc448e06 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:42.575843 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4337ad52-b0bd-4f1d-ad34-14a58257fead tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06" status: 404 len: 111 microversion: 2.1 time: 0.080514 Jul 28 03:50:42.577504 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1411/3167] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:42 2022] GET /compute/v2.1/servers/e42d51e5-d212-4768-bcef-1990cc448e06 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:50:42.586623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b7540d6-071d-4b0d-b115-bcdd5d59046a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:42.587499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2b7540d6-071d-4b0d-b115-bcdd5d59046a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:42.595468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b7540d6-071d-4b0d-b115-bcdd5d59046a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.596275 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b7540d6-071d-4b0d-b115-bcdd5d59046a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.597316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b7540d6-071d-4b0d-b115-bcdd5d59046a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.597990 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b7540d6-071d-4b0d-b115-bcdd5d59046a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.613404 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-2b7540d6-071d-4b0d-b115-bcdd5d59046a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] HTTP exception thrown: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b7540d6-071d-4b0d-b115-bcdd5d59046a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Request method failure captured: Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a HTTP/1.1 Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gbzast_Oajy2o3oVjsoD8MDbWSFl4PqFZGSQpsKNTVljzKZyP2UJX4BAxzxg3EsGRB2XT5e3x-qUGwamy-ARdlY8sfsrY521TPXpeV_ldCG8ULveXBZhf0u1_buTMn7D47ZmSu58ltI8i9b48HujdQhlDaP4tEIoJaU35Xpg1nbRGQ Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: a6bba8696d304edbb658461d3f313beb Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a6bba8696d304edbb658461d3f313beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6bba8696d304edbb658461d3f313beb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a6bba8696d304edbb658461d3f313beb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6bba8696d304edbb658461d3f313beb"}]}] Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: a6bba8696d304edbb658461d3f313beb Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersTestMultiNic-915001081-project Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 9290ff8a6a524900894b16523e9a2fb8 Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersTestMultiNic-915001081-project Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'a708e336-67ea-42c9-9d6d-8f77b8b67e7a'} Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:50:42.615366 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:50:42.619579 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.619579 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:42.619579 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.619579 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:42.619579 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:42.619579 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:42.619579 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:50:42.619579 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:50:42.619579 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:50:42.619579 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.622163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b7540d6-071d-4b0d-b115-bcdd5d59046a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Returning 404 to user: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:42.623300 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2b7540d6-071d-4b0d-b115-bcdd5d59046a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 404 len: 111 microversion: 2.1 time: 0.041666 Jul 28 03:50:42.624132 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1412/3168] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:50:42 2022] DELETE /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:50:42.633417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-055d71fe-c44f-4723-bd04-514daa70cd9a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:42.636282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-055d71fe-c44f-4723-bd04-514daa70cd9a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] [instance: a708e336-67ea-42c9-9d6d-8f77b8b67e7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:42.648518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-055d71fe-c44f-4723-bd04-514daa70cd9a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.649779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-055d71fe-c44f-4723-bd04-514daa70cd9a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.653673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-055d71fe-c44f-4723-bd04-514daa70cd9a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.655210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-055d71fe-c44f-4723-bd04-514daa70cd9a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.674062 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-055d71fe-c44f-4723-bd04-514daa70cd9a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] HTTP exception thrown: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-055d71fe-c44f-4723-bd04-514daa70cd9a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Request method failure captured: Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a HTTP/1.1 Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gbzast_Oajy2o3oVjsoD8MDbWSFl4PqFZGSQpsKNTVljzKZyP2UJX4BAxzxg3EsGRB2XT5e3x-qUGwamy-ARdlY8sfsrY521TPXpeV_ldCG8ULveXBZhf0u1_buTMn7D47ZmSu58ltI8i9b48HujdQhlDaP4tEIoJaU35Xpg1nbRGQ Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: a6bba8696d304edbb658461d3f313beb Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a6bba8696d304edbb658461d3f313beb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6bba8696d304edbb658461d3f313beb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a6bba8696d304edbb658461d3f313beb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a6bba8696d304edbb658461d3f313beb"}]}] Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: a6bba8696d304edbb658461d3f313beb Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersTestMultiNic-915001081 Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersTestMultiNic-915001081-project Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 9290ff8a6a524900894b16523e9a2fb8 Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersTestMultiNic-915001081-project Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'a708e336-67ea-42c9-9d6d-8f77b8b67e7a'} Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:42.677318 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.685932 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:42.685932 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:42.685932 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:42.685932 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:50:42.685932 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:50:42.685932 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. Jul 28 03:50:42.685932 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:50:42.689669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-055d71fe-c44f-4723-bd04-514daa70cd9a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] Returning 404 to user: Instance a708e336-67ea-42c9-9d6d-8f77b8b67e7a could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:42.691895 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-055d71fe-c44f-4723-bd04-514daa70cd9a tempest-ServersTestMultiNic-915001081 tempest-ServersTestMultiNic-915001081-project] 10.222.0.48 "GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a" status: 404 len: 111 microversion: 2.1 time: 0.062898 Jul 28 03:50:42.693905 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1413/3169] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:42 2022] GET /compute/v2.1/servers/a708e336-67ea-42c9-9d6d-8f77b8b67e7a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:50:42.731249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5e229d6f-5207-404b-9f78-b4b5f51b4197 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:42.741297 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5e229d6f-5207-404b-9f78-b4b5f51b4197 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.314814 Jul 28 03:50:42.741938 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1757/3170] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:42 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:42.765784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bcf0218e-2034-4a2c-9ba2-b248e0fb227a tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:42.766409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bcf0218e-2034-4a2c-9ba2-b248e0fb227a tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:42.772817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcf0218e-2034-4a2c-9ba2-b248e0fb227a tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.773299 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcf0218e-2034-4a2c-9ba2-b248e0fb227a tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.774047 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcf0218e-2034-4a2c-9ba2-b248e0fb227a tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.774480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcf0218e-2034-4a2c-9ba2-b248e0fb227a tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.834259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-342ed60b-5dfa-4a7d-ba92-d43b497020bc tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:42.835077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-342ed60b-5dfa-4a7d-ba92-d43b497020bc tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:42.844588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-342ed60b-5dfa-4a7d-ba92-d43b497020bc tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.845431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-342ed60b-5dfa-4a7d-ba92-d43b497020bc tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:42.846528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-342ed60b-5dfa-4a7d-ba92-d43b497020bc tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:42.847177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-342ed60b-5dfa-4a7d-ba92-d43b497020bc tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:43.017867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-342ed60b-5dfa-4a7d-ba92-d43b497020bc tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:43.033433 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-342ed60b-5dfa-4a7d-ba92-d43b497020bc tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1367 microversion: 2.1 time: 0.205199 Jul 28 03:50:43.035511 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1758/3171] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:42 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:43.333899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a3b71f29-0f63-4b4c-a57a-08a161aaf16d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:43.334596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a3b71f29-0f63-4b4c-a57a-08a161aaf16d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:43.341460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3b71f29-0f63-4b4c-a57a-08a161aaf16d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:43.341871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3b71f29-0f63-4b4c-a57a-08a161aaf16d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:43.342653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3b71f29-0f63-4b4c-a57a-08a161aaf16d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:43.343082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3b71f29-0f63-4b4c-a57a-08a161aaf16d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:43.480732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bcf0218e-2034-4a2c-9ba2-b248e0fb227a tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '468992e0518a48e290cbf3cdd8ac6af7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76cc5b82a9a440b9be30a49d71e0ec5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:43.492013 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bcf0218e-2034-4a2c-9ba2-b248e0fb227a tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 200 len: 1525 microversion: 2.1 time: 0.730053 Jul 28 03:50:43.492792 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1414/3172] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:42 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 1525 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:43.530889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-adb5a10d-5e16-4ee5-a8d3-86bd1d3f301d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:43.531526 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-adb5a10d-5e16-4ee5-a8d3-86bd1d3f301d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:43.541154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-adb5a10d-5e16-4ee5-a8d3-86bd1d3f301d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:43.541968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-adb5a10d-5e16-4ee5-a8d3-86bd1d3f301d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:43.544206 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-adb5a10d-5e16-4ee5-a8d3-86bd1d3f301d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:43.545701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-adb5a10d-5e16-4ee5-a8d3-86bd1d3f301d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:43.661792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a3b71f29-0f63-4b4c-a57a-08a161aaf16d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:43.673919 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a3b71f29-0f63-4b4c-a57a-08a161aaf16d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1463 microversion: 2.1 time: 0.343977 Jul 28 03:50:43.680542 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1759/3173] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:43 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1463 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:43.821263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-adb5a10d-5e16-4ee5-a8d3-86bd1d3f301d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:43.843200 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-adb5a10d-5e16-4ee5-a8d3-86bd1d3f301d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1272 microversion: 2.1 time: 0.332290 Jul 28 03:50:43.856592 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1415/3174] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:43 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:43.862931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-443ec54a-51ed-4ec6-b04a-1d16c80f4f74 req-5b03cc9a-c39e-47fd-8784-a18774d4735b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d8efe8-31af-4052-80af-189387e88134", "name": "network-vif-deleted", "tag": "4501bc0b-758b-4585-8209-f282991da4d7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:43.871559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fb01d1d7-9675-443c-ba39-833a6f5174ec tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:43.879873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-443ec54a-51ed-4ec6-b04a-1d16c80f4f74 req-5b03cc9a-c39e-47fd-8784-a18774d4735b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:43.880556 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fb01d1d7-9675-443c-ba39-833a6f5174ec tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:43.883990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-443ec54a-51ed-4ec6-b04a-1d16c80f4f74 req-5b03cc9a-c39e-47fd-8784-a18774d4735b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:43.893301 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb01d1d7-9675-443c-ba39-833a6f5174ec tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:43.897009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb01d1d7-9675-443c-ba39-833a6f5174ec tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:43.898158 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb01d1d7-9675-443c-ba39-833a6f5174ec tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:43.898626 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb01d1d7-9675-443c-ba39-833a6f5174ec tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:43.908727 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-443ec54a-51ed-4ec6-b04a-1d16c80f4f74 req-5b03cc9a-c39e-47fd-8784-a18774d4735b service nova] Creating event network-vif-deleted:4501bc0b-758b-4585-8209-f282991da4d7 for instance c5d8efe8-31af-4052-80af-189387e88134 on n-h1-826756-3 Jul 28 03:50:43.911440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:43.925602 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-443ec54a-51ed-4ec6-b04a-1d16c80f4f74 req-5b03cc9a-c39e-47fd-8784-a18774d4735b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247802 Jul 28 03:50:43.926532 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1760/3175] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:43.931752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ae679b0-9512-481d-ad9b-4bcdae11cf59 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:43.932504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ae679b0-9512-481d-ad9b-4bcdae11cf59 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:43.943022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ae679b0-9512-481d-ad9b-4bcdae11cf59 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:43.943672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ae679b0-9512-481d-ad9b-4bcdae11cf59 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:43.944682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ae679b0-9512-481d-ad9b-4bcdae11cf59 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:43.945277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ae679b0-9512-481d-ad9b-4bcdae11cf59 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:44.210170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ae679b0-9512-481d-ad9b-4bcdae11cf59 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:44.220783 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ae679b0-9512-481d-ad9b-4bcdae11cf59 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.293080 Jul 28 03:50:44.225893 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1761/3176] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:43 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:44.237531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5fc5fa0e-61c1-476d-8223-832412763b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:44.238174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5fc5fa0e-61c1-476d-8223-832412763b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:44.258806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fc5fa0e-61c1-476d-8223-832412763b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:44.259276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fc5fa0e-61c1-476d-8223-832412763b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:44.260132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fc5fa0e-61c1-476d-8223-832412763b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:44.260614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fc5fa0e-61c1-476d-8223-832412763b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:44.487138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5fc5fa0e-61c1-476d-8223-832412763b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:44.495331 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5fc5fa0e-61c1-476d-8223-832412763b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1367 microversion: 2.1 time: 0.266392 Jul 28 03:50:44.504925 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1762/3177] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:44 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:44.518025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6169496a-afee-4258-badf-e8d4f77a2d3d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:44.518639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6169496a-afee-4258-badf-e8d4f77a2d3d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] [instance: c5d8efe8-31af-4052-80af-189387e88134] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:44.528469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6169496a-afee-4258-badf-e8d4f77a2d3d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:44.528922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6169496a-afee-4258-badf-e8d4f77a2d3d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:44.529694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6169496a-afee-4258-badf-e8d4f77a2d3d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:44.530129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6169496a-afee-4258-badf-e8d4f77a2d3d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:44.548955 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-6169496a-afee-4258-badf-e8d4f77a2d3d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] HTTP exception thrown: Instance c5d8efe8-31af-4052-80af-189387e88134 could not be found. Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6169496a-afee-4258-badf-e8d4f77a2d3d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Request method failure captured: Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 HTTP/1.1 Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gd30M_Oa6KzzPT3fTqGaTgi39NfBWpghUp5j1tjD_HVW0Qs7IJhSGA6BRZs64T68__4mPZA_m0XMZmaXZGlIhO_-SwQd0Wng7tcT6iCTeiTLR39EN6G2ZGBQgcytBtNLMbfkV5pozQZNHPhAylESgCTeoHXt6bJzISqrl-OPXcp63k Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76cc5b82a9a440b9be30a49d71e0ec5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76cc5b82a9a440b9be30a49d71e0ec5c"}]}] Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 76cc5b82a9a440b9be30a49d71e0ec5c Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-999349709 Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 468992e0518a48e290cbf3cdd8ac6af7 Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-999349709-project Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c5d8efe8-31af-4052-80af-189387e88134 could not be found. Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c5d8efe8-31af-4052-80af-189387e88134'} Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5d8efe8-31af-4052-80af-189387e88134 could not be found. Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5d8efe8-31af-4052-80af-189387e88134 could not be found. Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:44.550773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:50:44.555139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:44.555139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:50:44.555139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:50:44.555139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:50:44.555139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:50:44.555139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:50:44.555139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5d8efe8-31af-4052-80af-189387e88134 could not be found. Jul 28 03:50:44.555139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:50:44.555139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6169496a-afee-4258-badf-e8d4f77a2d3d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] Returning 404 to user: Instance c5d8efe8-31af-4052-80af-189387e88134 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:50:44.555139 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6169496a-afee-4258-badf-e8d4f77a2d3d tempest-ServerMetadataNegativeTestJSON-999349709 tempest-ServerMetadataNegativeTestJSON-999349709-project] 10.222.0.48 "GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134" status: 404 len: 111 microversion: 2.1 time: 0.039072 Jul 28 03:50:44.555139 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1763/3178] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:44 2022] GET /compute/v2.1/servers/c5d8efe8-31af-4052-80af-189387e88134 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:50:44.725965 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fb01d1d7-9675-443c-ba39-833a6f5174ec tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1614 microversion: 2.1 time: 0.857992 Jul 28 03:50:44.727898 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1416/3179] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:43 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1614 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:44.747948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e7a78b42-5e70-4ed5-9fd4-753275c94ded tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:44.748580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e7a78b42-5e70-4ed5-9fd4-753275c94ded tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:44.756530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7a78b42-5e70-4ed5-9fd4-753275c94ded tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:44.757270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7a78b42-5e70-4ed5-9fd4-753275c94ded tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:44.758227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7a78b42-5e70-4ed5-9fd4-753275c94ded tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:44.758906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7a78b42-5e70-4ed5-9fd4-753275c94ded tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:44.819266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e7a78b42-5e70-4ed5-9fd4-753275c94ded tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '91b68f66bd734611a37932f904d14539', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c60fef00bbe244e6b4f34710d8c49b38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:44.820171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e7a78b42-5e70-4ed5-9fd4-753275c94ded tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] flavor_id is None. Assuming migration. {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4188}} Jul 28 03:50:44.820647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e7a78b42-5e70-4ed5-9fd4-753275c94ded tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 03:50:44.865179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9466225f-1f02-420b-92d8-ce61ee18e9f2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:44.866038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9466225f-1f02-420b-92d8-ce61ee18e9f2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:44.879443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9466225f-1f02-420b-92d8-ce61ee18e9f2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:44.880299 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9466225f-1f02-420b-92d8-ce61ee18e9f2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:44.881305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9466225f-1f02-420b-92d8-ce61ee18e9f2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:44.881727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9466225f-1f02-420b-92d8-ce61ee18e9f2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:45.009398 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e7a78b42-5e70-4ed5-9fd4-753275c94ded tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1/action" status: 202 len: 0 microversion: 2.1 time: 0.265742 Jul 28 03:50:45.018221 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1764/3180] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:50:44 2022] POST /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:50:45.030848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-596af57e-15fd-4b86-9932-6a51175f81a8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:45.034444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-596af57e-15fd-4b86-9932-6a51175f81a8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:45.052087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-596af57e-15fd-4b86-9932-6a51175f81a8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:45.054998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-596af57e-15fd-4b86-9932-6a51175f81a8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:45.058893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-596af57e-15fd-4b86-9932-6a51175f81a8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:45.059558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-596af57e-15fd-4b86-9932-6a51175f81a8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:45.072914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9466225f-1f02-420b-92d8-ce61ee18e9f2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:45.106478 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9466225f-1f02-420b-92d8-ce61ee18e9f2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1272 microversion: 2.1 time: 0.244727 Jul 28 03:50:45.107332 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1417/3181] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:44 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:45.246755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-65af24c7-fc5d-47aa-8aa3-0a500c17e5e1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:45.249169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-65af24c7-fc5d-47aa-8aa3-0a500c17e5e1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:45.258041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-65af24c7-fc5d-47aa-8aa3-0a500c17e5e1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:45.258805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-65af24c7-fc5d-47aa-8aa3-0a500c17e5e1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:45.260692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-65af24c7-fc5d-47aa-8aa3-0a500c17e5e1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:45.260982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-65af24c7-fc5d-47aa-8aa3-0a500c17e5e1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:45.702577 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-65af24c7-fc5d-47aa-8aa3-0a500c17e5e1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:45.713522 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-65af24c7-fc5d-47aa-8aa3-0a500c17e5e1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.471490 Jul 28 03:50:45.713708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-596af57e-15fd-4b86-9932-6a51175f81a8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:45.716294 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1418/3182] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:45 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:45.739730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-524a7e95-ab0a-473b-bf14-2fad6b122eb9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:45.740435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-524a7e95-ab0a-473b-bf14-2fad6b122eb9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:45.740527 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-596af57e-15fd-4b86-9932-6a51175f81a8 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1472 microversion: 2.1 time: 0.720859 Jul 28 03:50:45.752913 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1765/3183] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:45 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1472 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:45.755427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-524a7e95-ab0a-473b-bf14-2fad6b122eb9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:45.757534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-524a7e95-ab0a-473b-bf14-2fad6b122eb9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:45.760563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-524a7e95-ab0a-473b-bf14-2fad6b122eb9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:45.761410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-524a7e95-ab0a-473b-bf14-2fad6b122eb9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:45.995388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-13ef6d38-7328-4be5-b963-e2f129660829 req-566d4bec-68e5-4754-b8b8-edbe93028721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdf6d03-2454-457b-9c80-106379a5194d", "tag": "db43bb38-3ef8-41b9-9df6-ae22a0c2289a"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:46.021481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-13ef6d38-7328-4be5-b963-e2f129660829 req-566d4bec-68e5-4754-b8b8-edbe93028721 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:46.022527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-13ef6d38-7328-4be5-b963-e2f129660829 req-566d4bec-68e5-4754-b8b8-edbe93028721 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:46.045514 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-13ef6d38-7328-4be5-b963-e2f129660829 req-566d4bec-68e5-4754-b8b8-edbe93028721 service nova] Creating event network-changed:db43bb38-3ef8-41b9-9df6-ae22a0c2289a for instance dfdf6d03-2454-457b-9c80-106379a5194d on n-h2-826756-3 Jul 28 03:50:46.055449 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-13ef6d38-7328-4be5-b963-e2f129660829 req-566d4bec-68e5-4754-b8b8-edbe93028721 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070728 Jul 28 03:50:46.056810 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1766/3184] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:46.131977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f0ce5ab5-fba4-415c-b045-da853391b008 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:46.135245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f0ce5ab5-fba4-415c-b045-da853391b008 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:46.150555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0ce5ab5-fba4-415c-b045-da853391b008 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:46.151863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0ce5ab5-fba4-415c-b045-da853391b008 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:46.153635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0ce5ab5-fba4-415c-b045-da853391b008 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:46.154322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0ce5ab5-fba4-415c-b045-da853391b008 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:46.180273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:46.235240 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-524a7e95-ab0a-473b-bf14-2fad6b122eb9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:46.247612 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-524a7e95-ab0a-473b-bf14-2fad6b122eb9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1367 microversion: 2.1 time: 0.529558 Jul 28 03:50:46.249132 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1419/3185] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:45 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1367 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:46.556013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f0ce5ab5-fba4-415c-b045-da853391b008 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:46.570555 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f0ce5ab5-fba4-415c-b045-da853391b008 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1314 microversion: 2.1 time: 0.444721 Jul 28 03:50:46.585371 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1767/3186] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:46 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:46.740488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4f65b616-4088-4447-bcfb-0517a54d05f3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:46.741846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4f65b616-4088-4447-bcfb-0517a54d05f3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:46.764797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90b1c42b-4250-41fd-9a86-59816f6909c9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:46.766224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-90b1c42b-4250-41fd-9a86-59816f6909c9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:46.774111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f65b616-4088-4447-bcfb-0517a54d05f3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:46.775834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f65b616-4088-4447-bcfb-0517a54d05f3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:46.778321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f65b616-4088-4447-bcfb-0517a54d05f3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:46.779952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f65b616-4088-4447-bcfb-0517a54d05f3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:46.789168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90b1c42b-4250-41fd-9a86-59816f6909c9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:46.790425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90b1c42b-4250-41fd-9a86-59816f6909c9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:46.792280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90b1c42b-4250-41fd-9a86-59816f6909c9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:46.806955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90b1c42b-4250-41fd-9a86-59816f6909c9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:47.313031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4f65b616-4088-4447-bcfb-0517a54d05f3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:47.326208 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4f65b616-4088-4447-bcfb-0517a54d05f3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.588938 Jul 28 03:50:47.328155 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1420/3187] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:46 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:47.336338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-84fa8814-2e44-444a-a74b-6d1cdfd95214 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:47.337900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-84fa8814-2e44-444a-a74b-6d1cdfd95214 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:47.347499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-84fa8814-2e44-444a-a74b-6d1cdfd95214 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:47.347956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-84fa8814-2e44-444a-a74b-6d1cdfd95214 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:47.348791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-84fa8814-2e44-444a-a74b-6d1cdfd95214 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:47.349234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-84fa8814-2e44-444a-a74b-6d1cdfd95214 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:47.360861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-90b1c42b-4250-41fd-9a86-59816f6909c9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:47.373279 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90b1c42b-4250-41fd-9a86-59816f6909c9 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1472 microversion: 2.1 time: 0.612976 Jul 28 03:50:47.396222 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1768/3188] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:46 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1472 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:47.598402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0b83cc05-7c75-413a-a3ba-c5d296d0d39d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:47.602872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0b83cc05-7c75-413a-a3ba-c5d296d0d39d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:47.627941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b83cc05-7c75-413a-a3ba-c5d296d0d39d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:47.629928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b83cc05-7c75-413a-a3ba-c5d296d0d39d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:47.631535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b83cc05-7c75-413a-a3ba-c5d296d0d39d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:47.633346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b83cc05-7c75-413a-a3ba-c5d296d0d39d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:48.079651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0b83cc05-7c75-413a-a3ba-c5d296d0d39d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:48.097779 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0b83cc05-7c75-413a-a3ba-c5d296d0d39d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1314 microversion: 2.1 time: 0.507251 Jul 28 03:50:48.098381 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1769/3189] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:47 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:48.236805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-84fa8814-2e44-444a-a74b-6d1cdfd95214 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:48.250390 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-84fa8814-2e44-444a-a74b-6d1cdfd95214 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1367 microversion: 2.1 time: 0.920237 Jul 28 03:50:48.252562 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1421/3190] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:47 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1367 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:48.323164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f36420e7-b092-4762-9ca3-7ac4527a0694 req-05f2431e-7c1e-4229-9c76-8673d0354cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c219f2e3-05d9-43c5-9b8d-611c925c32ca", "tag": "be3e2f0f-e9ba-4b41-8c85-a9b3f3b0095c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:48.349443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4953815b-5b15-4a08-b533-65d75de298fc tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:48.350492 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4953815b-5b15-4a08-b533-65d75de298fc tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:48.355108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f36420e7-b092-4762-9ca3-7ac4527a0694 req-05f2431e-7c1e-4229-9c76-8673d0354cb4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:48.359940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4953815b-5b15-4a08-b533-65d75de298fc tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:48.360315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f36420e7-b092-4762-9ca3-7ac4527a0694 req-05f2431e-7c1e-4229-9c76-8673d0354cb4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:48.365093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4953815b-5b15-4a08-b533-65d75de298fc tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:48.366294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4953815b-5b15-4a08-b533-65d75de298fc tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:48.366952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4953815b-5b15-4a08-b533-65d75de298fc tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:48.381604 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f36420e7-b092-4762-9ca3-7ac4527a0694 req-05f2431e-7c1e-4229-9c76-8673d0354cb4 service nova] Creating event network-changed:be3e2f0f-e9ba-4b41-8c85-a9b3f3b0095c for instance c219f2e3-05d9-43c5-9b8d-611c925c32ca on n-h1-826756-3 Jul 28 03:50:48.399300 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f36420e7-b092-4762-9ca3-7ac4527a0694 req-05f2431e-7c1e-4229-9c76-8673d0354cb4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080379 Jul 28 03:50:48.400764 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1770/3191] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:48.415315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-233ac4d8-9abe-4195-9abc-504c1a019ff4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:48.416842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-233ac4d8-9abe-4195-9abc-504c1a019ff4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:48.433966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-233ac4d8-9abe-4195-9abc-504c1a019ff4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:48.434834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-233ac4d8-9abe-4195-9abc-504c1a019ff4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:48.435867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-233ac4d8-9abe-4195-9abc-504c1a019ff4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:48.439014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-233ac4d8-9abe-4195-9abc-504c1a019ff4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:48.954884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-233ac4d8-9abe-4195-9abc-504c1a019ff4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:48.966202 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-233ac4d8-9abe-4195-9abc-504c1a019ff4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1472 microversion: 2.1 time: 0.563937 Jul 28 03:50:48.967386 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1771/3192] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:48 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1472 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:49.099406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4953815b-5b15-4a08-b533-65d75de298fc tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:49.122328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59fe8dd1-a5c9-4b25-865d-8fa4ebb1d175 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:49.123058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59fe8dd1-a5c9-4b25-865d-8fa4ebb1d175 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:49.136525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59fe8dd1-a5c9-4b25-865d-8fa4ebb1d175 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:49.140872 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4953815b-5b15-4a08-b533-65d75de298fc tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.791166 Jul 28 03:50:49.142609 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1422/3193] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:48 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:49.144832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59fe8dd1-a5c9-4b25-865d-8fa4ebb1d175 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:49.146721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59fe8dd1-a5c9-4b25-865d-8fa4ebb1d175 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:49.147530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59fe8dd1-a5c9-4b25-865d-8fa4ebb1d175 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:49.273247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8c724ea8-ab31-4779-a20d-b743837c2665 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:49.274757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8c724ea8-ab31-4779-a20d-b743837c2665 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:49.281151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:49.283690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c724ea8-ab31-4779-a20d-b743837c2665 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:49.284509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c724ea8-ab31-4779-a20d-b743837c2665 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:49.285708 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c724ea8-ab31-4779-a20d-b743837c2665 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:49.286304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8c724ea8-ab31-4779-a20d-b743837c2665 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:49.573249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-59fe8dd1-a5c9-4b25-865d-8fa4ebb1d175 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:49.584637 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59fe8dd1-a5c9-4b25-865d-8fa4ebb1d175 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1314 microversion: 2.1 time: 0.466260 Jul 28 03:50:49.586104 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1772/3194] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:49 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:50.004525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-73bbe43b-3d9a-447f-b315-8c0b80188ccc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:50.005511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-73bbe43b-3d9a-447f-b315-8c0b80188ccc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:50.019149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73bbe43b-3d9a-447f-b315-8c0b80188ccc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:50.019989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73bbe43b-3d9a-447f-b315-8c0b80188ccc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:50.020995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73bbe43b-3d9a-447f-b315-8c0b80188ccc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:50.021588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73bbe43b-3d9a-447f-b315-8c0b80188ccc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:50.300155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8c724ea8-ab31-4779-a20d-b743837c2665 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:50.313597 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8c724ea8-ab31-4779-a20d-b743837c2665 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1367 microversion: 2.1 time: 1.044163 Jul 28 03:50:50.315304 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1423/3195] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:49 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1367 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:50.336177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2ec7f218-c2a2-4733-8adc-0a65bdef1303 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:50.337969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2ec7f218-c2a2-4733-8adc-0a65bdef1303 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:50.349461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ec7f218-c2a2-4733-8adc-0a65bdef1303 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:50.350721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ec7f218-c2a2-4733-8adc-0a65bdef1303 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:50.352440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ec7f218-c2a2-4733-8adc-0a65bdef1303 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:50.353592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ec7f218-c2a2-4733-8adc-0a65bdef1303 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:50.399056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:50.457640 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=14 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:50.649690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-73bbe43b-3d9a-447f-b315-8c0b80188ccc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:50.663963 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-73bbe43b-3d9a-447f-b315-8c0b80188ccc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1472 microversion: 2.1 time: 0.672433 Jul 28 03:50:50.678974 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1773/3196] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:49 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1472 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:50.686221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7672651a-4367-48c7-bf6b-2dfcdd6249e9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:50.687386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7672651a-4367-48c7-bf6b-2dfcdd6249e9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:50.699854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7672651a-4367-48c7-bf6b-2dfcdd6249e9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:50.700682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7672651a-4367-48c7-bf6b-2dfcdd6249e9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:50.702411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7672651a-4367-48c7-bf6b-2dfcdd6249e9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:50.703529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7672651a-4367-48c7-bf6b-2dfcdd6249e9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:50.893862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2ec7f218-c2a2-4733-8adc-0a65bdef1303 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:50.911283 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2ec7f218-c2a2-4733-8adc-0a65bdef1303 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.594678 Jul 28 03:50:50.912309 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1424/3197] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:50 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:51.026208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7672651a-4367-48c7-bf6b-2dfcdd6249e9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:51.044170 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7672651a-4367-48c7-bf6b-2dfcdd6249e9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1314 microversion: 2.1 time: 0.365997 Jul 28 03:50:51.044858 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1774/3198] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:50 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:51.337903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f99b1e70-14d8-4b47-b4cb-99b31d4fc093 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:51.338491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f99b1e70-14d8-4b47-b4cb-99b31d4fc093 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:51.346650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f99b1e70-14d8-4b47-b4cb-99b31d4fc093 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:51.347612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f99b1e70-14d8-4b47-b4cb-99b31d4fc093 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:51.348609 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f99b1e70-14d8-4b47-b4cb-99b31d4fc093 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:51.349228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f99b1e70-14d8-4b47-b4cb-99b31d4fc093 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:51.364690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:51.619281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a6cffc83-dac5-4708-8fdf-dcb750a00770 req-010d24e9-e5b3-4cb5-90b6-601091a4960a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfdf6d03-2454-457b-9c80-106379a5194d", "name": "network-vif-plugged", "status": "completed", "tag": "db43bb38-3ef8-41b9-9df6-ae22a0c2289a"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:51.635559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a6cffc83-dac5-4708-8fdf-dcb750a00770 req-010d24e9-e5b3-4cb5-90b6-601091a4960a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:51.636414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a6cffc83-dac5-4708-8fdf-dcb750a00770 req-010d24e9-e5b3-4cb5-90b6-601091a4960a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:51.681628 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a6cffc83-dac5-4708-8fdf-dcb750a00770 req-010d24e9-e5b3-4cb5-90b6-601091a4960a service nova] Creating event network-vif-plugged:db43bb38-3ef8-41b9-9df6-ae22a0c2289a for instance dfdf6d03-2454-457b-9c80-106379a5194d on n-h2-826756-3 Jul 28 03:50:51.689736 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a6cffc83-dac5-4708-8fdf-dcb750a00770 req-010d24e9-e5b3-4cb5-90b6-601091a4960a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.329433 Jul 28 03:50:51.690720 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1775/3199] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:51.698935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0111e821-bd91-4499-9d45-b3ea77dd22d5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:51.703489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0111e821-bd91-4499-9d45-b3ea77dd22d5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:51.711807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0111e821-bd91-4499-9d45-b3ea77dd22d5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:51.712835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0111e821-bd91-4499-9d45-b3ea77dd22d5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:51.713685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0111e821-bd91-4499-9d45-b3ea77dd22d5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:51.714321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0111e821-bd91-4499-9d45-b3ea77dd22d5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:51.899388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f99b1e70-14d8-4b47-b4cb-99b31d4fc093 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:51.919457 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f99b1e70-14d8-4b47-b4cb-99b31d4fc093 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1367 microversion: 2.1 time: 0.585706 Jul 28 03:50:51.921581 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1425/3200] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:51 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1367 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:51.947184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9decf7db-51f0-43a9-97ee-f9506afc8d30 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:51.949110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9decf7db-51f0-43a9-97ee-f9506afc8d30 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:51.962273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0111e821-bd91-4499-9d45-b3ea77dd22d5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:51.963755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9decf7db-51f0-43a9-97ee-f9506afc8d30 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:51.964928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9decf7db-51f0-43a9-97ee-f9506afc8d30 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:51.966962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9decf7db-51f0-43a9-97ee-f9506afc8d30 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:51.968024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9decf7db-51f0-43a9-97ee-f9506afc8d30 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:51.973836 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0111e821-bd91-4499-9d45-b3ea77dd22d5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 0.281220 Jul 28 03:50:51.984670 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1776/3201] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:51 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:52.071762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74e7cf43-4c1d-4959-822d-5c5379f167a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:52.073156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74e7cf43-4c1d-4959-822d-5c5379f167a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:52.082840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74e7cf43-4c1d-4959-822d-5c5379f167a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:52.083296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74e7cf43-4c1d-4959-822d-5c5379f167a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:52.084232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74e7cf43-4c1d-4959-822d-5c5379f167a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:52.084900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74e7cf43-4c1d-4959-822d-5c5379f167a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:52.382487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-74e7cf43-4c1d-4959-822d-5c5379f167a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:52.394955 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74e7cf43-4c1d-4959-822d-5c5379f167a4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1314 microversion: 2.1 time: 0.328003 Jul 28 03:50:52.396926 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1777/3202] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:52 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:52.595475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9decf7db-51f0-43a9-97ee-f9506afc8d30 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:52.616546 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9decf7db-51f0-43a9-97ee-f9506afc8d30 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.676832 Jul 28 03:50:52.632135 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1426/3203] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:51 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:50:52.954804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-03e47248-e807-454b-ac4c-2d982305c259 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:52.956057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-03e47248-e807-454b-ac4c-2d982305c259 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:52.963947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03e47248-e807-454b-ac4c-2d982305c259 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:52.964765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03e47248-e807-454b-ac4c-2d982305c259 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:52.965827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03e47248-e807-454b-ac4c-2d982305c259 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:52.966537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03e47248-e807-454b-ac4c-2d982305c259 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:52.998542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a39c881d-709f-4765-a82e-a2b6c4a46eaa tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:52.999325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a39c881d-709f-4765-a82e-a2b6c4a46eaa tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:53.012792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a39c881d-709f-4765-a82e-a2b6c4a46eaa tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:53.014953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a39c881d-709f-4765-a82e-a2b6c4a46eaa tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:53.017659 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a39c881d-709f-4765-a82e-a2b6c4a46eaa tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:53.019033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a39c881d-709f-4765-a82e-a2b6c4a46eaa tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:53.891463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-03e47248-e807-454b-ac4c-2d982305c259 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:53.899782 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-03e47248-e807-454b-ac4c-2d982305c259 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1367 microversion: 2.1 time: 0.949805 Jul 28 03:50:53.903041 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1778/3204] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:52 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1367 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:53.910512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-35dc5526-fc48-46c8-903a-d286d07aa455 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:53.920310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-35dc5526-fc48-46c8-903a-d286d07aa455 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:53.936595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35dc5526-fc48-46c8-903a-d286d07aa455 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:53.937145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35dc5526-fc48-46c8-903a-d286d07aa455 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:53.937943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35dc5526-fc48-46c8-903a-d286d07aa455 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:53.938451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35dc5526-fc48-46c8-903a-d286d07aa455 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:54.240405 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a39c881d-709f-4765-a82e-a2b6c4a46eaa tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:54.256468 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a39c881d-709f-4765-a82e-a2b6c4a46eaa tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 1.263236 Jul 28 03:50:54.257998 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1427/3205] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:52 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:54.298500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d8ca23eb-d135-4e63-a4aa-7b01e36a3d1a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:54.301295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d8ca23eb-d135-4e63-a4aa-7b01e36a3d1a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:54.318843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8ca23eb-d135-4e63-a4aa-7b01e36a3d1a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:54.319572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8ca23eb-d135-4e63-a4aa-7b01e36a3d1a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:54.320938 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8ca23eb-d135-4e63-a4aa-7b01e36a3d1a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:54.321623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d8ca23eb-d135-4e63-a4aa-7b01e36a3d1a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:54.338576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-35dc5526-fc48-46c8-903a-d286d07aa455 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:54.362048 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-35dc5526-fc48-46c8-903a-d286d07aa455 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1314 microversion: 2.1 time: 0.455942 Jul 28 03:50:54.363251 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1779/3206] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:53 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:54.708265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d8ca23eb-d135-4e63-a4aa-7b01e36a3d1a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:54.729888 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d8ca23eb-d135-4e63-a4aa-7b01e36a3d1a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.470488 Jul 28 03:50:54.730845 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1428/3207] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:54 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:54.931432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05680588-02e8-4e8c-8725-074216194377 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:54.932365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-05680588-02e8-4e8c-8725-074216194377 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:54.940110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05680588-02e8-4e8c-8725-074216194377 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:54.941026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05680588-02e8-4e8c-8725-074216194377 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:54.942178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05680588-02e8-4e8c-8725-074216194377 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:54.942821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05680588-02e8-4e8c-8725-074216194377 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:55.287684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8f7ed2ea-8d9b-4ea4-abe7-d9058c575aec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:55.289345 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8f7ed2ea-8d9b-4ea4-abe7-d9058c575aec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:55.315607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8f7ed2ea-8d9b-4ea4-abe7-d9058c575aec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:55.317418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8f7ed2ea-8d9b-4ea4-abe7-d9058c575aec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:55.319191 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8f7ed2ea-8d9b-4ea4-abe7-d9058c575aec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:55.321214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8f7ed2ea-8d9b-4ea4-abe7-d9058c575aec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:55.603814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-05680588-02e8-4e8c-8725-074216194377 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:55.626749 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-05680588-02e8-4e8c-8725-074216194377 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1556 microversion: 2.1 time: 0.698475 Jul 28 03:50:55.629033 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1780/3208] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:54 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1556 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:55.644028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4da6850-efe0-4b3e-a3e0-8e052e92f8de tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:55.646691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e4da6850-efe0-4b3e-a3e0-8e052e92f8de tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:55.664868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:55.669769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4da6850-efe0-4b3e-a3e0-8e052e92f8de tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:55.670817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4da6850-efe0-4b3e-a3e0-8e052e92f8de tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:55.672123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4da6850-efe0-4b3e-a3e0-8e052e92f8de tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:55.672944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4da6850-efe0-4b3e-a3e0-8e052e92f8de tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:55.979804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8f7ed2ea-8d9b-4ea4-abe7-d9058c575aec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:55.989030 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8f7ed2ea-8d9b-4ea4-abe7-d9058c575aec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 0.707985 Jul 28 03:50:55.992753 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1429/3209] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:55 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:55.997961 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2889d0a3-49ea-407a-a069-278cd9cc66ca tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:55.998706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2889d0a3-49ea-407a-a069-278cd9cc66ca tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:56.005691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2889d0a3-49ea-407a-a069-278cd9cc66ca tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:56.009531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2889d0a3-49ea-407a-a069-278cd9cc66ca tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:56.012201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2889d0a3-49ea-407a-a069-278cd9cc66ca tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:56.012935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2889d0a3-49ea-407a-a069-278cd9cc66ca tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:56.126091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e4da6850-efe0-4b3e-a3e0-8e052e92f8de tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:56.136115 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e4da6850-efe0-4b3e-a3e0-8e052e92f8de tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1314 microversion: 2.1 time: 0.505128 Jul 28 03:50:56.137072 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1781/3210] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:55 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:56.142772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-84aaba70-f1e4-43e3-a01b-31acf0ef58c0 req-c2b9bad5-d556-4455-b7ab-cfee52eb2c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c219f2e3-05d9-43c5-9b8d-611c925c32ca", "name": "network-vif-plugged", "status": "completed", "tag": "be3e2f0f-e9ba-4b41-8c85-a9b3f3b0095c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:56.153663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-84aaba70-f1e4-43e3-a01b-31acf0ef58c0 req-c2b9bad5-d556-4455-b7ab-cfee52eb2c3c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:56.154401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-84aaba70-f1e4-43e3-a01b-31acf0ef58c0 req-c2b9bad5-d556-4455-b7ab-cfee52eb2c3c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:56.166032 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2889d0a3-49ea-407a-a069-278cd9cc66ca tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.171904 Jul 28 03:50:56.167694 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-84aaba70-f1e4-43e3-a01b-31acf0ef58c0 req-c2b9bad5-d556-4455-b7ab-cfee52eb2c3c service nova] Creating event network-vif-plugged:be3e2f0f-e9ba-4b41-8c85-a9b3f3b0095c for instance c219f2e3-05d9-43c5-9b8d-611c925c32ca on n-h1-826756-3 Jul 28 03:50:56.167856 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1430/3211] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:50:55 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:56.173355 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-84aaba70-f1e4-43e3-a01b-31acf0ef58c0 req-c2b9bad5-d556-4455-b7ab-cfee52eb2c3c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034603 Jul 28 03:50:56.173673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-41272335-9a85-4e61-a7ac-ba0b3e2c679e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:56.174294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-41272335-9a85-4e61-a7ac-ba0b3e2c679e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:56.178087 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1782/3212] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:56.185386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41272335-9a85-4e61-a7ac-ba0b3e2c679e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:56.185930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41272335-9a85-4e61-a7ac-ba0b3e2c679e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:56.188327 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41272335-9a85-4e61-a7ac-ba0b3e2c679e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:56.190729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41272335-9a85-4e61-a7ac-ba0b3e2c679e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:56.869531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-41272335-9a85-4e61-a7ac-ba0b3e2c679e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:56.884438 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-41272335-9a85-4e61-a7ac-ba0b3e2c679e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.715368 Jul 28 03:50:56.886948 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1431/3213] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:56 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:57.018248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-29f6504a-b07f-48c9-a79a-4f354fafb5c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:57.020031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-29f6504a-b07f-48c9-a79a-4f354fafb5c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:57.039743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29f6504a-b07f-48c9-a79a-4f354fafb5c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:57.043593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29f6504a-b07f-48c9-a79a-4f354fafb5c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:57.047784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29f6504a-b07f-48c9-a79a-4f354fafb5c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:57.048799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29f6504a-b07f-48c9-a79a-4f354fafb5c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:57.184557 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2c301eb9-defd-4ed8-9b0c-b7bc13511edb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:57.185755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2c301eb9-defd-4ed8-9b0c-b7bc13511edb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:57.198077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c301eb9-defd-4ed8-9b0c-b7bc13511edb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:57.199190 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c301eb9-defd-4ed8-9b0c-b7bc13511edb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:57.201242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c301eb9-defd-4ed8-9b0c-b7bc13511edb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:57.206059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c301eb9-defd-4ed8-9b0c-b7bc13511edb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:57.606866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-29f6504a-b07f-48c9-a79a-4f354fafb5c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:57.625662 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-29f6504a-b07f-48c9-a79a-4f354fafb5c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 0.613082 Jul 28 03:50:57.626532 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1783/3214] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:57 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:57.733730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2c301eb9-defd-4ed8-9b0c-b7bc13511edb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:57.750596 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2c301eb9-defd-4ed8-9b0c-b7bc13511edb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1314 microversion: 2.1 time: 0.571205 Jul 28 03:50:57.767244 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1432/3215] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:57 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:57.911856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9081c80e-ae3c-4290-a525-de0107032b0e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:57.913093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9081c80e-ae3c-4290-a525-de0107032b0e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:57.935816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9081c80e-ae3c-4290-a525-de0107032b0e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:57.936664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9081c80e-ae3c-4290-a525-de0107032b0e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:57.943256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9081c80e-ae3c-4290-a525-de0107032b0e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:57.945104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9081c80e-ae3c-4290-a525-de0107032b0e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:58.433498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9081c80e-ae3c-4290-a525-de0107032b0e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:58.449673 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9081c80e-ae3c-4290-a525-de0107032b0e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.541019 Jul 28 03:50:58.452920 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1784/3216] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:57 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:58.657475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e7fed34d-6eb4-4114-8967-12193cb466c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:58.658430 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e7fed34d-6eb4-4114-8967-12193cb466c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:58.667125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e7fed34d-6eb4-4114-8967-12193cb466c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:58.668154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e7fed34d-6eb4-4114-8967-12193cb466c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:58.669423 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e7fed34d-6eb4-4114-8967-12193cb466c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:58.670099 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e7fed34d-6eb4-4114-8967-12193cb466c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:58.706321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:58.792977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3aeb4348-b81e-4376-8224-c1f315a377cf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:58.796073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3aeb4348-b81e-4376-8224-c1f315a377cf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:58.822453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3aeb4348-b81e-4376-8224-c1f315a377cf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:58.824104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3aeb4348-b81e-4376-8224-c1f315a377cf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:58.834612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3aeb4348-b81e-4376-8224-c1f315a377cf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:58.835479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3aeb4348-b81e-4376-8224-c1f315a377cf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:59.265090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e7fed34d-6eb4-4114-8967-12193cb466c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:59.282094 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e7fed34d-6eb4-4114-8967-12193cb466c0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 0.628822 Jul 28 03:50:59.286563 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1433/3217] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:58 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:59.298547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-c55b0df1-84c3-41f3-9bed-b8897240cdb8 req-c192e29e-e889-4713-8e9d-2443135c18c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfdf6d03-2454-457b-9c80-106379a5194d", "tag": "db43bb38-3ef8-41b9-9df6-ae22a0c2289a"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:59.305572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3aeb4348-b81e-4376-8224-c1f315a377cf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:50:59.320526 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c55b0df1-84c3-41f3-9bed-b8897240cdb8 req-c192e29e-e889-4713-8e9d-2443135c18c8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:59.321297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c55b0df1-84c3-41f3-9bed-b8897240cdb8 req-c192e29e-e889-4713-8e9d-2443135c18c8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:59.322288 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3aeb4348-b81e-4376-8224-c1f315a377cf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1501 microversion: 2.1 time: 0.550448 Jul 28 03:50:59.335600 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1785/3218] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:58 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1501 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:50:59.349055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-400b21d5-3a03-4ef6-aa45-1cbebdfd0b15 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:50:59.349505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-400b21d5-3a03-4ef6-aa45-1cbebdfd0b15 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:59.354098 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-c55b0df1-84c3-41f3-9bed-b8897240cdb8 req-c192e29e-e889-4713-8e9d-2443135c18c8 service nova] Creating event network-changed:db43bb38-3ef8-41b9-9df6-ae22a0c2289a for instance dfdf6d03-2454-457b-9c80-106379a5194d on n-h2-826756-3 Jul 28 03:50:59.362663 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-c55b0df1-84c3-41f3-9bed-b8897240cdb8 req-c192e29e-e889-4713-8e9d-2443135c18c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073631 Jul 28 03:50:59.363834 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1434/3219] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:50:59.364591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-400b21d5-3a03-4ef6-aa45-1cbebdfd0b15 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:59.365050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-400b21d5-3a03-4ef6-aa45-1cbebdfd0b15 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:59.366796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-400b21d5-3a03-4ef6-aa45-1cbebdfd0b15 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:59.367319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-400b21d5-3a03-4ef6-aa45-1cbebdfd0b15 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:59.374929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:50:59.481926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-70c5b076-232c-4776-bb39-85dbfadcbe1c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:59.483343 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-70c5b076-232c-4776-bb39-85dbfadcbe1c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:59.502375 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70c5b076-232c-4776-bb39-85dbfadcbe1c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:59.505693 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-400b21d5-3a03-4ef6-aa45-1cbebdfd0b15 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "POST /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca/action" status: 202 len: 0 microversion: 2.1 time: 0.161501 Jul 28 03:50:59.507493 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1786/3220] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:50:59 2022] POST /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:50:59.510923 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70c5b076-232c-4776-bb39-85dbfadcbe1c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:59.511801 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70c5b076-232c-4776-bb39-85dbfadcbe1c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:59.512251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70c5b076-232c-4776-bb39-85dbfadcbe1c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:59.547766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1d64d2aa-cf0b-4cfb-9ab2-54082e634cdf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:59.549122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1d64d2aa-cf0b-4cfb-9ab2-54082e634cdf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:50:59.563996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d64d2aa-cf0b-4cfb-9ab2-54082e634cdf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:59.565162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d64d2aa-cf0b-4cfb-9ab2-54082e634cdf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:59.569958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d64d2aa-cf0b-4cfb-9ab2-54082e634cdf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:59.570972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d64d2aa-cf0b-4cfb-9ab2-54082e634cdf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:00.080810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1d64d2aa-cf0b-4cfb-9ab2-54082e634cdf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:00.107388 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1d64d2aa-cf0b-4cfb-9ab2-54082e634cdf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1506 microversion: 2.1 time: 0.573705 Jul 28 03:51:00.109334 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1787/3221] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:59 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1506 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:00.219101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-70c5b076-232c-4776-bb39-85dbfadcbe1c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:00.229359 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-70c5b076-232c-4776-bb39-85dbfadcbe1c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.752169 Jul 28 03:51:00.233076 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1435/3222] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:50:59 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:00.314913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-db44988f-621b-4c48-ba5a-da1b7f1cb613 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:00.319180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-db44988f-621b-4c48-ba5a-da1b7f1cb613 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:00.347517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db44988f-621b-4c48-ba5a-da1b7f1cb613 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:00.355595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db44988f-621b-4c48-ba5a-da1b7f1cb613 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:00.360150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db44988f-621b-4c48-ba5a-da1b7f1cb613 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:00.361795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db44988f-621b-4c48-ba5a-da1b7f1cb613 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:01.134452 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-877d7d8c-6f7f-4a8b-aac2-bb0fc0dc7ae6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:01.135382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-877d7d8c-6f7f-4a8b-aac2-bb0fc0dc7ae6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:01.157614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-877d7d8c-6f7f-4a8b-aac2-bb0fc0dc7ae6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:01.158370 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-877d7d8c-6f7f-4a8b-aac2-bb0fc0dc7ae6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:01.159395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-877d7d8c-6f7f-4a8b-aac2-bb0fc0dc7ae6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:01.160043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-877d7d8c-6f7f-4a8b-aac2-bb0fc0dc7ae6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:01.406385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-db44988f-621b-4c48-ba5a-da1b7f1cb613 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:01.423257 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-db44988f-621b-4c48-ba5a-da1b7f1cb613 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 1.117346 Jul 28 03:51:01.425097 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1788/3223] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:00 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:01.430050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bcb1fab5-3a3d-4bff-8b89-9c7bdca69401 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:01.441376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bcb1fab5-3a3d-4bff-8b89-9c7bdca69401 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:01.449859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcb1fab5-3a3d-4bff-8b89-9c7bdca69401 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:01.450719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcb1fab5-3a3d-4bff-8b89-9c7bdca69401 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:01.451976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcb1fab5-3a3d-4bff-8b89-9c7bdca69401 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:01.453510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcb1fab5-3a3d-4bff-8b89-9c7bdca69401 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:01.550258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-877d7d8c-6f7f-4a8b-aac2-bb0fc0dc7ae6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:01.568410 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-877d7d8c-6f7f-4a8b-aac2-bb0fc0dc7ae6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1486 microversion: 2.1 time: 0.438883 Jul 28 03:51:01.576945 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1436/3224] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:01 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1486 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:01.604189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-744e3e56-bef6-4da1-ac53-12ac3ac0fb73 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:01.605019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-744e3e56-bef6-4da1-ac53-12ac3ac0fb73 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:01.618006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-744e3e56-bef6-4da1-ac53-12ac3ac0fb73 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:01.619070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-744e3e56-bef6-4da1-ac53-12ac3ac0fb73 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:01.621537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-744e3e56-bef6-4da1-ac53-12ac3ac0fb73 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:01.627148 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-744e3e56-bef6-4da1-ac53-12ac3ac0fb73 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:01.688307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-744e3e56-bef6-4da1-ac53-12ac3ac0fb73 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:51:01.853426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bcb1fab5-3a3d-4bff-8b89-9c7bdca69401 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:01.864231 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bcb1fab5-3a3d-4bff-8b89-9c7bdca69401 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.437717 Jul 28 03:51:01.865110 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1789/3225] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:01 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:01.895417 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-744e3e56-bef6-4da1-ac53-12ac3ac0fb73 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 204 len: 0 microversion: 2.1 time: 0.296734 Jul 28 03:51:01.896551 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1437/3226] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:51:01 2022] DELETE /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:51:01.922736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-412086f3-5b0b-494c-ade0-a07d04efc69c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:01.924546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-412086f3-5b0b-494c-ade0-a07d04efc69c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:01.932912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-412086f3-5b0b-494c-ade0-a07d04efc69c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:01.933763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-412086f3-5b0b-494c-ade0-a07d04efc69c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:01.935398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-412086f3-5b0b-494c-ade0-a07d04efc69c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:01.936215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-412086f3-5b0b-494c-ade0-a07d04efc69c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:02.177289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-412086f3-5b0b-494c-ade0-a07d04efc69c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:02.189238 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-412086f3-5b0b-494c-ade0-a07d04efc69c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1492 microversion: 2.1 time: 0.285192 Jul 28 03:51:02.190158 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1790/3227] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:01 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1492 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:02.252738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1651517927", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "3af84c31-98f2-463c-b601-b956984ff33d"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:02.336913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] validate_networks() for [('3af84c31-98f2-463c-b601-b956984ff33d', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:51:02.450307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b79cbc5c-b8d9-4338-b5aa-aaf6bece1515 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:02.452415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b79cbc5c-b8d9-4338-b5aa-aaf6bece1515 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:02.475799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b79cbc5c-b8d9-4338-b5aa-aaf6bece1515 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:02.475799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b79cbc5c-b8d9-4338-b5aa-aaf6bece1515 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:02.475799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b79cbc5c-b8d9-4338-b5aa-aaf6bece1515 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:02.476626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b79cbc5c-b8d9-4338-b5aa-aaf6bece1515 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:02.712529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b79cbc5c-b8d9-4338-b5aa-aaf6bece1515 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:02.725248 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b79cbc5c-b8d9-4338-b5aa-aaf6bece1515 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 0.282725 Jul 28 03:51:02.726157 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1791/3228] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:02 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:02.896862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93c62b0b-ad3b-46f8-bc03-9b705358dc3a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:02.898817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93c62b0b-ad3b-46f8-bc03-9b705358dc3a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:02.912130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93c62b0b-ad3b-46f8-bc03-9b705358dc3a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:02.913555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93c62b0b-ad3b-46f8-bc03-9b705358dc3a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:02.916014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93c62b0b-ad3b-46f8-bc03-9b705358dc3a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:02.917122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93c62b0b-ad3b-46f8-bc03-9b705358dc3a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:03.154146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93c62b0b-ad3b-46f8-bc03-9b705358dc3a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:03.167817 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93c62b0b-ad3b-46f8-bc03-9b705358dc3a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.283321 Jul 28 03:51:03.181558 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1792/3229] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:02 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:03.216289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b68e3fa0-88cd-4fcd-8187-e504e3beb159 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:03.217799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b68e3fa0-88cd-4fcd-8187-e504e3beb159 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:03.226478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b68e3fa0-88cd-4fcd-8187-e504e3beb159 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:03.227100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b68e3fa0-88cd-4fcd-8187-e504e3beb159 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:03.228100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b68e3fa0-88cd-4fcd-8187-e504e3beb159 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:03.229024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b68e3fa0-88cd-4fcd-8187-e504e3beb159 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:03.497964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b68e3fa0-88cd-4fcd-8187-e504e3beb159 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:03.511480 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b68e3fa0-88cd-4fcd-8187-e504e3beb159 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1492 microversion: 2.1 time: 0.300507 Jul 28 03:51:03.512288 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1793/3230] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:03 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1492 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:03.757901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-52ee4b0c-ca20-486e-9efb-74c0a8837d0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:03.758881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-52ee4b0c-ca20-486e-9efb-74c0a8837d0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:03.767132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52ee4b0c-ca20-486e-9efb-74c0a8837d0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:03.767807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52ee4b0c-ca20-486e-9efb-74c0a8837d0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:03.771743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52ee4b0c-ca20-486e-9efb-74c0a8837d0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:03.772491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52ee4b0c-ca20-486e-9efb-74c0a8837d0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:03.870087 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:51:03.870579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:51:03.871012 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:51:03.871616 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:51:03.872094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:51:03.901291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:03.902283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:03.903404 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:03.903850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:03.935026 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Getting quotas for project 4986ce186af44fea81f404b2b28c111d. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:51:03.941637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Getting quotas for user 45d31becde7f4984932272266a7e1867 and project 4986ce186af44fea81f404b2b28c111d. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:51:03.960081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:51:03.964115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:51:04.006089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-52ee4b0c-ca20-486e-9efb-74c0a8837d0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:04.016719 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-52ee4b0c-ca20-486e-9efb-74c0a8837d0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 0.270910 Jul 28 03:51:04.018104 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1794/3231] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:03 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:04.043390 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-01d1d278-3c09-44f7-87c5-9b92bb9a25dd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.070434 Jul 28 03:51:04.048389 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1438/3232] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:51:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:51:04.133168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-158533723", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "3af84c31-98f2-463c-b601-b956984ff33d"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:04.193856 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8e8e339a-b406-43b0-b102-b2fbb9229c61 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:04.194524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8e8e339a-b406-43b0-b102-b2fbb9229c61 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:04.202694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e8e339a-b406-43b0-b102-b2fbb9229c61 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:04.203146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e8e339a-b406-43b0-b102-b2fbb9229c61 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:04.203922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e8e339a-b406-43b0-b102-b2fbb9229c61 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:04.204378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e8e339a-b406-43b0-b102-b2fbb9229c61 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:04.213487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] validate_networks() for [('3af84c31-98f2-463c-b601-b956984ff33d', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:51:04.596836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8e8e339a-b406-43b0-b102-b2fbb9229c61 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:04.643658 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8e8e339a-b406-43b0-b102-b2fbb9229c61 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.454392 Jul 28 03:51:04.651035 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1439/3233] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:04 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:04.672487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3632490b-9064-43a3-bff4-c7a9bbcf5fc8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:04.673409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3632490b-9064-43a3-bff4-c7a9bbcf5fc8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:04.695053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3632490b-9064-43a3-bff4-c7a9bbcf5fc8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:04.695530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3632490b-9064-43a3-bff4-c7a9bbcf5fc8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:04.697305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3632490b-9064-43a3-bff4-c7a9bbcf5fc8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:04.698095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3632490b-9064-43a3-bff4-c7a9bbcf5fc8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:05.412187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:51:05.413009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:51:05.414100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:51:05.414605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:51:05.415130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:51:05.458094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:05.459260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:05.461080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:05.461829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:05.526311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Getting quotas for project 4986ce186af44fea81f404b2b28c111d. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:51:05.549296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Getting quotas for user 45d31becde7f4984932272266a7e1867 and project 4986ce186af44fea81f404b2b28c111d. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:51:05.570114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:51:05.573446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: f7a4251e-80ef-4e70-aa87-29d50b7e5c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:51:05.641696 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2dec3390-c60a-48a5-b8df-bbb8cdf71d90 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.514985 Jul 28 03:51:05.642466 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1795/3234] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:51:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:51:05.651017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-702c3139-dee6-4c93-a572-352e208a95d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:05.652149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-702c3139-dee6-4c93-a572-352e208a95d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:05.661721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-702c3139-dee6-4c93-a572-352e208a95d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:05.662340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-702c3139-dee6-4c93-a572-352e208a95d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:05.663444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-702c3139-dee6-4c93-a572-352e208a95d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:05.665509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-702c3139-dee6-4c93-a572-352e208a95d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:06.329923 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3632490b-9064-43a3-bff4-c7a9bbcf5fc8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:06.346490 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3632490b-9064-43a3-bff4-c7a9bbcf5fc8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1492 microversion: 2.1 time: 1.693389 Jul 28 03:51:06.354831 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1440/3235] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:04 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1492 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:06.368819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cd7eafcc-846b-41e0-9e7a-bfe9eb8749a3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:06.369852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cd7eafcc-846b-41e0-9e7a-bfe9eb8749a3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:06.407334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd7eafcc-846b-41e0-9e7a-bfe9eb8749a3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:06.411107 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd7eafcc-846b-41e0-9e7a-bfe9eb8749a3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:06.414690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd7eafcc-846b-41e0-9e7a-bfe9eb8749a3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:06.427894 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd7eafcc-846b-41e0-9e7a-bfe9eb8749a3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:06.876956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-702c3139-dee6-4c93-a572-352e208a95d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:06.889746 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-702c3139-dee6-4c93-a572-352e208a95d0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 1.245985 Jul 28 03:51:06.890723 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1796/3236] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:05 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:06.905552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-64775014", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "451", "networks": [{"uuid": "3af84c31-98f2-463c-b601-b956984ff33d"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:07.031612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] validate_networks() for [('3af84c31-98f2-463c-b601-b956984ff33d', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:51:07.105192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd7eafcc-846b-41e0-9e7a-bfe9eb8749a3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:07.130225 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cd7eafcc-846b-41e0-9e7a-bfe9eb8749a3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1505 microversion: 2.1 time: 0.773943 Jul 28 03:51:07.131004 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1441/3237] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:06 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1505 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:07.142314 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-cbdecebf-3678-43ba-b7ae-a76e593ad047 req-c2b49828-c59d-4462-bbc0-ee468e8fe8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c219f2e3-05d9-43c5-9b8d-611c925c32ca", "name": "network-vif-deleted", "tag": "be3e2f0f-e9ba-4b41-8c85-a9b3f3b0095c"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:07.176519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-cbdecebf-3678-43ba-b7ae-a76e593ad047 req-c2b49828-c59d-4462-bbc0-ee468e8fe8c6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:07.177631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-cbdecebf-3678-43ba-b7ae-a76e593ad047 req-c2b49828-c59d-4462-bbc0-ee468e8fe8c6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:07.198328 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-cbdecebf-3678-43ba-b7ae-a76e593ad047 req-c2b49828-c59d-4462-bbc0-ee468e8fe8c6 service nova] Creating event network-vif-deleted:be3e2f0f-e9ba-4b41-8c85-a9b3f3b0095c for instance c219f2e3-05d9-43c5-9b8d-611c925c32ca on n-h1-826756-3 Jul 28 03:51:07.223742 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-cbdecebf-3678-43ba-b7ae-a76e593ad047 req-c2b49828-c59d-4462-bbc0-ee468e8fe8c6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077499 Jul 28 03:51:07.225135 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1442/3238] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:07.383502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6009bdab-a506-4616-ac89-57963fa18416 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:07.386399 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6009bdab-a506-4616-ac89-57963fa18416 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:07.406429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6009bdab-a506-4616-ac89-57963fa18416 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:07.407070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6009bdab-a506-4616-ac89-57963fa18416 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:07.408661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6009bdab-a506-4616-ac89-57963fa18416 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:07.410690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6009bdab-a506-4616-ac89-57963fa18416 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:07.491319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6009bdab-a506-4616-ac89-57963fa18416 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:07.491974 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6009bdab-a506-4616-ac89-57963fa18416 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:07.492702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-6009bdab-a506-4616-ac89-57963fa18416 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lazy-loading 'fault' on Instance uuid c219f2e3-05d9-43c5-9b8d-611c925c32ca {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:51:07.567961 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6009bdab-a506-4616-ac89-57963fa18416 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:07.602045 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6009bdab-a506-4616-ac89-57963fa18416 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 200 len: 1304 microversion: 2.1 time: 0.226500 Jul 28 03:51:07.605658 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1443/3239] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:07 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 1304 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:07.923481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bca6b20e-1d98-4468-9300-4e8142e03b6f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:07.924569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bca6b20e-1d98-4468-9300-4e8142e03b6f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:07.937461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bca6b20e-1d98-4468-9300-4e8142e03b6f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:07.939980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bca6b20e-1d98-4468-9300-4e8142e03b6f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:07.944614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bca6b20e-1d98-4468-9300-4e8142e03b6f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:07.945072 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bca6b20e-1d98-4468-9300-4e8142e03b6f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:08.605847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bca6b20e-1d98-4468-9300-4e8142e03b6f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:08.627188 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bca6b20e-1d98-4468-9300-4e8142e03b6f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 0.709062 Jul 28 03:51:08.637562 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1444/3240] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:07 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:08.656933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-be2b7be7-fa7f-4881-a36e-cf5a16adeb5c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:08.657948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-be2b7be7-fa7f-4881-a36e-cf5a16adeb5c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:08.666922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be2b7be7-fa7f-4881-a36e-cf5a16adeb5c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:08.670339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be2b7be7-fa7f-4881-a36e-cf5a16adeb5c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:08.671731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be2b7be7-fa7f-4881-a36e-cf5a16adeb5c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:08.673561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be2b7be7-fa7f-4881-a36e-cf5a16adeb5c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:09.314980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-be2b7be7-fa7f-4881-a36e-cf5a16adeb5c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:09.339308 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-be2b7be7-fa7f-4881-a36e-cf5a16adeb5c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1485 microversion: 2.1 time: 0.699438 Jul 28 03:51:09.361211 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1445/3241] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:08 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1485 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:09.372188 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e763640f-e0c0-4907-ad55-954b11bec07b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:09.374025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e763640f-e0c0-4907-ad55-954b11bec07b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:09.381721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e763640f-e0c0-4907-ad55-954b11bec07b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:09.382667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e763640f-e0c0-4907-ad55-954b11bec07b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:09.383710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e763640f-e0c0-4907-ad55-954b11bec07b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:09.384486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e763640f-e0c0-4907-ad55-954b11bec07b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:09.401856 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-e763640f-e0c0-4907-ad55-954b11bec07b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e763640f-e0c0-4907-ad55-954b11bec07b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca HTTP/1.1 Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'c219f2e3-05d9-43c5-9b8d-611c925c32ca'} Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:09.403992 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:51:09.415916 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:09.415916 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:09.415916 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:09.415916 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:51:09.415916 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:51:09.415916 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:51:09.415916 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:51:09.415916 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e763640f-e0c0-4907-ad55-954b11bec07b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:51:09.415916 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e763640f-e0c0-4907-ad55-954b11bec07b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 404 len: 111 microversion: 2.1 time: 0.051186 Jul 28 03:51:09.417204 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1446/3242] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:09 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:51:09.494172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:51:09.495401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:51:09.496556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:51:09.497521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:51:09.499145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:51:09.534241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:09.535751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:09.539484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:09.540614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:09.591807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1465064283", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:09.598091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Getting quotas for project 4986ce186af44fea81f404b2b28c111d. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:51:09.639515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Getting quotas for user 45d31becde7f4984932272266a7e1867 and project 4986ce186af44fea81f404b2b28c111d. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:51:09.693625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:51:09.698354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:51:09.743651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] validate_networks() for [('89e6a438-5ad0-4d83-8f71-3f4222c4b6a4', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:51:09.790252 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2faf8cd4-0161-4a6b-a83a-0b5defca1052 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.888618 Jul 28 03:51:09.791996 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1797/3243] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:51:09.800184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c25ef2b4-8f5a-40c2-86a9-d25e311b7341 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:09.802269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c25ef2b4-8f5a-40c2-86a9-d25e311b7341 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:09.811727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c25ef2b4-8f5a-40c2-86a9-d25e311b7341 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:09.812695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c25ef2b4-8f5a-40c2-86a9-d25e311b7341 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:09.813900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c25ef2b4-8f5a-40c2-86a9-d25e311b7341 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:09.814743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c25ef2b4-8f5a-40c2-86a9-d25e311b7341 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:10.225125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c25ef2b4-8f5a-40c2-86a9-d25e311b7341 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:10.238036 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c25ef2b4-8f5a-40c2-86a9-d25e311b7341 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 0.444465 Jul 28 03:51:10.252619 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1798/3244] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:09 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:10.267281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1763680650", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "c540e59d-0550-4ece-8b64-1987a84fa206"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:10.385148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] validate_networks() for [('c540e59d-0550-4ece-8b64-1987a84fa206', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:51:11.554635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:51:11.555605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:51:11.555605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:51:11.555980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:51:11.556390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:51:11.578068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:11.579653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:11.587381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:11.592708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:11.634452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Getting quotas for project 34ed8cbcca694b8794992388d95bf072. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:51:11.647270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Getting quotas for user 67fcd8c3ec5441e582a4852f0f1184b6 and project 34ed8cbcca694b8794992388d95bf072. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:51:11.677506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:51:11.685392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:51:11.801604 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e7e62a44-ce94-4043-9207-6f9ec2693208 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545344 Jul 28 03:51:11.803817 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1799/3245] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:51:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:51:11.828598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-71bc3534-4c37-4b3d-9c3f-8e5705daf119 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:11.830832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-71bc3534-4c37-4b3d-9c3f-8e5705daf119 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:11.875449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71bc3534-4c37-4b3d-9c3f-8e5705daf119 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:11.876335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71bc3534-4c37-4b3d-9c3f-8e5705daf119 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:11.879644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71bc3534-4c37-4b3d-9c3f-8e5705daf119 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:11.880716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71bc3534-4c37-4b3d-9c3f-8e5705daf119 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:11.995306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:51:11.996805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:51:11.997404 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:51:11.998128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:51:12.004442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:51:12.028082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:12.062882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:12.066011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:12.067077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:12.099590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Getting quotas for project 14a740ef28ff4ceaa9879883f86d0da5. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:51:12.110198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Getting quotas for user 0b9f8f65f4724b7899491e805177cf1d and project 14a740ef28ff4ceaa9879883f86d0da5. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:51:12.141252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:51:12.146000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:51:12.235941 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-442983ee-3c2e-4067-8912-0f1828674940 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.649502 Jul 28 03:51:12.237104 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1447/3246] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:51:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:51:12.244864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-985741a7-0a3c-4db6-ae29-aaa65777f641 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:12.246372 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-985741a7-0a3c-4db6-ae29-aaa65777f641 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:12.258668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-985741a7-0a3c-4db6-ae29-aaa65777f641 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:12.259775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-985741a7-0a3c-4db6-ae29-aaa65777f641 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:12.260790 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-985741a7-0a3c-4db6-ae29-aaa65777f641 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:12.261462 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-985741a7-0a3c-4db6-ae29-aaa65777f641 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:12.526523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-71bc3534-4c37-4b3d-9c3f-8e5705daf119 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:12.562565 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-71bc3534-4c37-4b3d-9c3f-8e5705daf119 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1277 microversion: 2.1 time: 0.741096 Jul 28 03:51:12.569209 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1800/3247] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:11 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1277 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:12.604803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a5711b98-bd56-4803-9edf-816ff75f8390 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:12.606096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a5711b98-bd56-4803-9edf-816ff75f8390 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:12.901408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a5711b98-bd56-4803-9edf-816ff75f8390 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:12.925335 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a5711b98-bd56-4803-9edf-816ff75f8390 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1215 microversion: 2.1 time: 0.349966 Jul 28 03:51:12.928248 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1801/3248] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:12 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1215 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:12.947178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ea72e2e-3435-47e2-83de-6a164783e43a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:12.951071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ea72e2e-3435-47e2-83de-6a164783e43a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:13.168553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2ea72e2e-3435-47e2-83de-6a164783e43a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:13.189767 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ea72e2e-3435-47e2-83de-6a164783e43a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1214 microversion: 2.1 time: 0.259097 Jul 28 03:51:13.209129 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1802/3249] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:12 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1214 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:13.307409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-985741a7-0a3c-4db6-ae29-aaa65777f641 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:13.329503 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-985741a7-0a3c-4db6-ae29-aaa65777f641 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 1.090610 Jul 28 03:51:13.345067 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1448/3250] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:12 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:13.603027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1ef3baf6-3bf1-4921-8b9f-31559d7b268e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:13.603946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1ef3baf6-3bf1-4921-8b9f-31559d7b268e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:13.630553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ef3baf6-3bf1-4921-8b9f-31559d7b268e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:13.631860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ef3baf6-3bf1-4921-8b9f-31559d7b268e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:13.635204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ef3baf6-3bf1-4921-8b9f-31559d7b268e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:13.637618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ef3baf6-3bf1-4921-8b9f-31559d7b268e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:13.893269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1ef3baf6-3bf1-4921-8b9f-31559d7b268e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:13.905493 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1ef3baf6-3bf1-4921-8b9f-31559d7b268e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1277 microversion: 2.1 time: 0.306819 Jul 28 03:51:13.920896 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1803/3251] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:13 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:13.961348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5f373ef4-fbf1-4afd-b875-952c672e3f1d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:13.962831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5f373ef4-fbf1-4afd-b875-952c672e3f1d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:14.011067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5f373ef4-fbf1-4afd-b875-952c672e3f1d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:14.011545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5f373ef4-fbf1-4afd-b875-952c672e3f1d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:14.012385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5f373ef4-fbf1-4afd-b875-952c672e3f1d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:14.012834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5f373ef4-fbf1-4afd-b875-952c672e3f1d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:14.202625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5f373ef4-fbf1-4afd-b875-952c672e3f1d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:14.223381 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5f373ef4-fbf1-4afd-b875-952c672e3f1d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1285 microversion: 2.1 time: 0.266716 Jul 28 03:51:14.225591 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1449/3252] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:13 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1285 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:14.227222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-986273d3-22a0-4532-a0d3-b46f11dba145 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:14.227966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-986273d3-22a0-4532-a0d3-b46f11dba145 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:14.241863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-986273d3-22a0-4532-a0d3-b46f11dba145 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:14.242745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-986273d3-22a0-4532-a0d3-b46f11dba145 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:14.244231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-986273d3-22a0-4532-a0d3-b46f11dba145 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:14.247465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-986273d3-22a0-4532-a0d3-b46f11dba145 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:14.363856 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1b691dbd-d9f9-42bf-ac16-188ea584b926 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:14.365830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1b691dbd-d9f9-42bf-ac16-188ea584b926 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:14.378856 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b691dbd-d9f9-42bf-ac16-188ea584b926 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:14.380219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b691dbd-d9f9-42bf-ac16-188ea584b926 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:14.382105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b691dbd-d9f9-42bf-ac16-188ea584b926 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:14.382727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b691dbd-d9f9-42bf-ac16-188ea584b926 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:15.013429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-986273d3-22a0-4532-a0d3-b46f11dba145 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:15.029760 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-986273d3-22a0-4532-a0d3-b46f11dba145 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1266 microversion: 2.1 time: 0.806921 Jul 28 03:51:15.030863 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1804/3253] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:14 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1266 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:15.055408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-79f3f5eb-c007-4bfb-8d40-a167f0bf34cb req-d87ae014-162f-45d3-a392-13f02d267ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc6b0f9-3b19-45a8-86b7-27753d96eea4", "tag": "3ed3b7b7-c555-4215-b589-2eda58828d91"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:15.074460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-79f3f5eb-c007-4bfb-8d40-a167f0bf34cb req-d87ae014-162f-45d3-a392-13f02d267ca5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:15.082881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-79f3f5eb-c007-4bfb-8d40-a167f0bf34cb req-d87ae014-162f-45d3-a392-13f02d267ca5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:15.105923 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-79f3f5eb-c007-4bfb-8d40-a167f0bf34cb req-d87ae014-162f-45d3-a392-13f02d267ca5 service nova] Creating event network-changed:3ed3b7b7-c555-4215-b589-2eda58828d91 for instance 7cc6b0f9-3b19-45a8-86b7-27753d96eea4 on n-h1-826756-3 Jul 28 03:51:15.113467 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-79f3f5eb-c007-4bfb-8d40-a167f0bf34cb req-d87ae014-162f-45d3-a392-13f02d267ca5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066446 Jul 28 03:51:15.115336 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1805/3254] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:15.123326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fc45d7dc-f502-45f0-a7a5-ab5779a89f5e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:15.124528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fc45d7dc-f502-45f0-a7a5-ab5779a89f5e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:15.134497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc45d7dc-f502-45f0-a7a5-ab5779a89f5e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:15.135730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc45d7dc-f502-45f0-a7a5-ab5779a89f5e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:15.136898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc45d7dc-f502-45f0-a7a5-ab5779a89f5e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:15.137407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc45d7dc-f502-45f0-a7a5-ab5779a89f5e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:15.155529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:15.332737 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1b691dbd-d9f9-42bf-ac16-188ea584b926 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:15.350853 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1b691dbd-d9f9-42bf-ac16-188ea584b926 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 0.994719 Jul 28 03:51:15.364385 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1450/3255] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:14 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:15.364385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a38261fa-c309-4da2-8827-e661aef345cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:15.364385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a38261fa-c309-4da2-8827-e661aef345cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:15.372274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a38261fa-c309-4da2-8827-e661aef345cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:15.373271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a38261fa-c309-4da2-8827-e661aef345cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:15.374699 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a38261fa-c309-4da2-8827-e661aef345cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:15.375153 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a38261fa-c309-4da2-8827-e661aef345cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:15.424641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:15.617201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a38261fa-c309-4da2-8827-e661aef345cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:15.629360 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a38261fa-c309-4da2-8827-e661aef345cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1273 microversion: 2.1 time: 0.274678 Jul 28 03:51:15.630887 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1451/3256] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:15 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:15.674883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc45d7dc-f502-45f0-a7a5-ab5779a89f5e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:15.683433 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fc45d7dc-f502-45f0-a7a5-ab5779a89f5e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1319 microversion: 2.1 time: 0.566159 Jul 28 03:51:15.684072 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1806/3257] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:15 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1319 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:16.067366 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ece85718-3ffb-411f-b310-79d15a715f33 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:16.068279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ece85718-3ffb-411f-b310-79d15a715f33 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:16.083525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ece85718-3ffb-411f-b310-79d15a715f33 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:16.084293 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ece85718-3ffb-411f-b310-79d15a715f33 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:16.085415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ece85718-3ffb-411f-b310-79d15a715f33 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:16.085892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ece85718-3ffb-411f-b310-79d15a715f33 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:16.280294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ece85718-3ffb-411f-b310-79d15a715f33 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:16.293192 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ece85718-3ffb-411f-b310-79d15a715f33 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1272 microversion: 2.1 time: 0.237165 Jul 28 03:51:16.294823 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1452/3258] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:16 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:16.378518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3dfd8ef9-76c0-4c9f-9070-a1e0abb58c16 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:16.380532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3dfd8ef9-76c0-4c9f-9070-a1e0abb58c16 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:16.403796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3dfd8ef9-76c0-4c9f-9070-a1e0abb58c16 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:16.404497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3dfd8ef9-76c0-4c9f-9070-a1e0abb58c16 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:16.405731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3dfd8ef9-76c0-4c9f-9070-a1e0abb58c16 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:16.407813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3dfd8ef9-76c0-4c9f-9070-a1e0abb58c16 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:16.654306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d69ab7ef-edac-4bcf-817d-9b45343b4c7e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:16.657367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d69ab7ef-edac-4bcf-817d-9b45343b4c7e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:16.678806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d69ab7ef-edac-4bcf-817d-9b45343b4c7e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:16.679541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d69ab7ef-edac-4bcf-817d-9b45343b4c7e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:16.680814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d69ab7ef-edac-4bcf-817d-9b45343b4c7e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:16.681654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d69ab7ef-edac-4bcf-817d-9b45343b4c7e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:16.767557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3dfd8ef9-76c0-4c9f-9070-a1e0abb58c16 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:16.779359 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3dfd8ef9-76c0-4c9f-9070-a1e0abb58c16 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 0.408079 Jul 28 03:51:16.781375 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1807/3259] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:16 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:16.791606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9be36360-b554-4559-abfa-61f5ca468398 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:16.792453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9be36360-b554-4559-abfa-61f5ca468398 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:16.796481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:16.801617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9be36360-b554-4559-abfa-61f5ca468398 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:16.802631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9be36360-b554-4559-abfa-61f5ca468398 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:16.803465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9be36360-b554-4559-abfa-61f5ca468398 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:16.804647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9be36360-b554-4559-abfa-61f5ca468398 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:16.841193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d69ab7ef-edac-4bcf-817d-9b45343b4c7e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:16.857517 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d69ab7ef-edac-4bcf-817d-9b45343b4c7e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1273 microversion: 2.1 time: 0.206777 Jul 28 03:51:16.859989 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1453/3260] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:16 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:16.965976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fc2cac07-c122-443a-b313-e594064f65dc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Action: 'create', calling method: .version_select at 0x7ffa745028b0>, body: {"keypair": {"name": "tempest-keypair-1504483950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK+muAVY9zTFk1T15uEfppaL9BdjhYNW26Dfv9Q+gye58ATHLFOOc4+Y8eP38TSQf6mRpTr6SAE1GEiI/4xDVS/d+KybuQ1zsSwoWJ4Xe1NIcTGiL/j42XXzhayT8zNng=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:16.989216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:17.007393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-fc2cac07-c122-443a-b313-e594064f65dc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Getting quotas for project 98f0f82bb0014564bff4c739314d25a4. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:51:17.021548 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-fc2cac07-c122-443a-b313-e594064f65dc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Getting quotas for user ea947ad72ea74f439474ac4703fb0ebb and project 98f0f82bb0014564bff4c739314d25a4. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:51:17.057946 n-d-826756-3 devstack@n-api.service[126072]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc2cac07-c122-443a-b313-e594064f65dc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [0f432de9-6a0d-4702-8da9-6ef9180eb774] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 03:51:17.245317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9be36360-b554-4559-abfa-61f5ca468398 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:17.254388 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9be36360-b554-4559-abfa-61f5ca468398 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1319 microversion: 2.1 time: 0.471583 Jul 28 03:51:17.255275 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1808/3261] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:16 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:17.329516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb0bb488-c331-4e08-85c9-33ea7bc7e696 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:17.330423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb0bb488-c331-4e08-85c9-33ea7bc7e696 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:17.343512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb0bb488-c331-4e08-85c9-33ea7bc7e696 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:17.344682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb0bb488-c331-4e08-85c9-33ea7bc7e696 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:17.346064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb0bb488-c331-4e08-85c9-33ea7bc7e696 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:17.346773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb0bb488-c331-4e08-85c9-33ea7bc7e696 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:17.547863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb0bb488-c331-4e08-85c9-33ea7bc7e696 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:17.579231 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb0bb488-c331-4e08-85c9-33ea7bc7e696 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1272 microversion: 2.1 time: 0.261563 Jul 28 03:51:17.581891 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1809/3262] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:17 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:17.625426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c9d86e18-b5a4-4d3e-be6d-948d9f33b23e req-e150b72a-0b76-477e-8002-bb4ed09415be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a4251e-80ef-4e70-aa87-29d50b7e5c26", "tag": "016cb180-7a18-405e-a328-f841540f4743"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:17.669017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c9d86e18-b5a4-4d3e-be6d-948d9f33b23e req-e150b72a-0b76-477e-8002-bb4ed09415be service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:17.670062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c9d86e18-b5a4-4d3e-be6d-948d9f33b23e req-e150b72a-0b76-477e-8002-bb4ed09415be service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:17.711412 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c9d86e18-b5a4-4d3e-be6d-948d9f33b23e req-e150b72a-0b76-477e-8002-bb4ed09415be service nova] Creating event network-changed:016cb180-7a18-405e-a328-f841540f4743 for instance f7a4251e-80ef-4e70-aa87-29d50b7e5c26 on n-h2-826756-3 Jul 28 03:51:17.722570 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c9d86e18-b5a4-4d3e-be6d-948d9f33b23e req-e150b72a-0b76-477e-8002-bb4ed09415be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110779 Jul 28 03:51:17.724059 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1810/3263] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:17.812784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b19a5920-8dea-4c31-8109-63db7efa23c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:17.814209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b19a5920-8dea-4c31-8109-63db7efa23c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:17.849372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b19a5920-8dea-4c31-8109-63db7efa23c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:17.850689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b19a5920-8dea-4c31-8109-63db7efa23c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:17.852232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b19a5920-8dea-4c31-8109-63db7efa23c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:17.853468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b19a5920-8dea-4c31-8109-63db7efa23c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:18.073283 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc2cac07-c122-443a-b313-e594064f65dc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [0f432de9-6a0d-4702-8da9-6ef9180eb774] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 48406. Jul 28 03:51:18.108712 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fc2cac07-c122-443a-b313-e594064f65dc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.229320 Jul 28 03:51:18.110583 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1454/3264] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Jul 28 03:51:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1250 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 03:51:18.123394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-382b29e3-dfdd-4816-994c-3eada6fd46bc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:18.125726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-382b29e3-dfdd-4816-994c-3eada6fd46bc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:18.157230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-382b29e3-dfdd-4816-994c-3eada6fd46bc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:18.158342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-382b29e3-dfdd-4816-994c-3eada6fd46bc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:18.161009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-382b29e3-dfdd-4816-994c-3eada6fd46bc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:18.166078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-382b29e3-dfdd-4816-994c-3eada6fd46bc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:18.335308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b19a5920-8dea-4c31-8109-63db7efa23c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:18.349006 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b19a5920-8dea-4c31-8109-63db7efa23c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 0.539995 Jul 28 03:51:18.350127 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1811/3265] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:17 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:18.371516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-734de02e-858c-4ba5-8278-c210c895ab2f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:18.382042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-734de02e-858c-4ba5-8278-c210c895ab2f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:18.401089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-734de02e-858c-4ba5-8278-c210c895ab2f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:18.401529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-734de02e-858c-4ba5-8278-c210c895ab2f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:18.411413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-734de02e-858c-4ba5-8278-c210c895ab2f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:18.412161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-734de02e-858c-4ba5-8278-c210c895ab2f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:18.832301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-734de02e-858c-4ba5-8278-c210c895ab2f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:18.848894 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-734de02e-858c-4ba5-8278-c210c895ab2f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1319 microversion: 2.1 time: 0.491415 Jul 28 03:51:18.849836 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1812/3266] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:18 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1319 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:18.858771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-575b609f-29e6-4b0c-9943-0c6c5f5ce92c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:18.867632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-575b609f-29e6-4b0c-9943-0c6c5f5ce92c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:18.869383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-575b609f-29e6-4b0c-9943-0c6c5f5ce92c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Searching by: {'deleted': False, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:51:18.885006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-575b609f-29e6-4b0c-9943-0c6c5f5ce92c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:18.885778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-575b609f-29e6-4b0c-9943-0c6c5f5ce92c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:18.886743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-575b609f-29e6-4b0c-9943-0c6c5f5ce92c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:18.887361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-575b609f-29e6-4b0c-9943-0c6c5f5ce92c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:18.918144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-575b609f-29e6-4b0c-9943-0c6c5f5ce92c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:51:18.957788 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-575b609f-29e6-4b0c-9943-0c6c5f5ce92c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.106632 Jul 28 03:51:18.968574 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1813/3267] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 03:51:18 2022] GET /compute/v2.1/servers => generated 344 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:18.975152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-275cc020-0706-40b1-a325-561fd1730656 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:18.976768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-275cc020-0706-40b1-a325-561fd1730656 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:18.987719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-275cc020-0706-40b1-a325-561fd1730656 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:18.988269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-275cc020-0706-40b1-a325-561fd1730656 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:18.989508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-275cc020-0706-40b1-a325-561fd1730656 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:18.989948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-275cc020-0706-40b1-a325-561fd1730656 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:19.223801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-275cc020-0706-40b1-a325-561fd1730656 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:19.236170 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-275cc020-0706-40b1-a325-561fd1730656 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1314 microversion: 2.1 time: 0.264974 Jul 28 03:51:19.246397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-382b29e3-dfdd-4816-994c-3eada6fd46bc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:19.249245 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1814/3268] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:18 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:19.263432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-219aa9dd-40cb-4887-bd9a-4514ff35bca3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:19.273534 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-382b29e3-dfdd-4816-994c-3eada6fd46bc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1315 microversion: 2.1 time: 1.159060 Jul 28 03:51:19.274118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-219aa9dd-40cb-4887-bd9a-4514ff35bca3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:19.275081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-219aa9dd-40cb-4887-bd9a-4514ff35bca3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Searching by: {'deleted': False, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:51:19.276299 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1455/3269] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:18 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1315 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:19.288959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-219aa9dd-40cb-4887-bd9a-4514ff35bca3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:19.289980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-219aa9dd-40cb-4887-bd9a-4514ff35bca3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:19.290553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-219aa9dd-40cb-4887-bd9a-4514ff35bca3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:19.290999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-219aa9dd-40cb-4887-bd9a-4514ff35bca3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:19.324929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-219aa9dd-40cb-4887-bd9a-4514ff35bca3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:51:19.364832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-219aa9dd-40cb-4887-bd9a-4514ff35bca3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:19.379994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6b71d79c-6c6c-422a-aa30-42fa706372e3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:19.380664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-219aa9dd-40cb-4887-bd9a-4514ff35bca3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:19.381476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6b71d79c-6c6c-422a-aa30-42fa706372e3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:19.383306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-219aa9dd-40cb-4887-bd9a-4514ff35bca3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:19.397160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6b71d79c-6c6c-422a-aa30-42fa706372e3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:19.398501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6b71d79c-6c6c-422a-aa30-42fa706372e3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:19.400703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6b71d79c-6c6c-422a-aa30-42fa706372e3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:19.401426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6b71d79c-6c6c-422a-aa30-42fa706372e3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:20.279081 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-219aa9dd-40cb-4887-bd9a-4514ff35bca3 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 1.025902 Jul 28 03:51:20.279751 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1815/3270] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:51:19 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:20.306350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d17cdda3-b209-4f4f-8b67-391834033fc4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:20.309817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d17cdda3-b209-4f4f-8b67-391834033fc4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:20.332158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d17cdda3-b209-4f4f-8b67-391834033fc4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:20.334986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d17cdda3-b209-4f4f-8b67-391834033fc4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:20.340303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d17cdda3-b209-4f4f-8b67-391834033fc4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:20.342413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d17cdda3-b209-4f4f-8b67-391834033fc4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:20.721486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6b71d79c-6c6c-422a-aa30-42fa706372e3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:20.730579 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6b71d79c-6c6c-422a-aa30-42fa706372e3 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 1.357150 Jul 28 03:51:20.746560 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1456/3271] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:19 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:20.761981 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-f3737345-99e0-4122-96d7-89da4ad5aca5 req-b6738fa1-de81-44e4-9034-4fb87a05598d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3639d857-7077-4ba1-a880-8d0c9822845d", "tag": "887fcfc4-1119-4e02-a17f-5125c132b986"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:20.772732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f3737345-99e0-4122-96d7-89da4ad5aca5 req-b6738fa1-de81-44e4-9034-4fb87a05598d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:20.773475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f3737345-99e0-4122-96d7-89da4ad5aca5 req-b6738fa1-de81-44e4-9034-4fb87a05598d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:20.795872 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-f3737345-99e0-4122-96d7-89da4ad5aca5 req-b6738fa1-de81-44e4-9034-4fb87a05598d service nova] Creating event network-changed:887fcfc4-1119-4e02-a17f-5125c132b986 for instance 3639d857-7077-4ba1-a880-8d0c9822845d on n-h1-826756-3 Jul 28 03:51:20.803258 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-f3737345-99e0-4122-96d7-89da4ad5aca5 req-b6738fa1-de81-44e4-9034-4fb87a05598d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054591 Jul 28 03:51:20.804108 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1457/3272] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:20.810877 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bc7b84e5-ca88-445e-98b0-1204891123c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:20.811805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bc7b84e5-ca88-445e-98b0-1204891123c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:20.821323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc7b84e5-ca88-445e-98b0-1204891123c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:20.822157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc7b84e5-ca88-445e-98b0-1204891123c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:20.823181 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc7b84e5-ca88-445e-98b0-1204891123c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:20.824249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc7b84e5-ca88-445e-98b0-1204891123c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:20.894458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d17cdda3-b209-4f4f-8b67-391834033fc4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:20.904044 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d17cdda3-b209-4f4f-8b67-391834033fc4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1319 microversion: 2.1 time: 0.613968 Jul 28 03:51:20.917099 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1816/3273] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:20 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1319 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:20.926792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15754e53-ebef-45ec-9bb0-9a20bc094bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:20.927640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15754e53-ebef-45ec-9bb0-9a20bc094bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:20.935032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15754e53-ebef-45ec-9bb0-9a20bc094bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:20.935761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15754e53-ebef-45ec-9bb0-9a20bc094bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:20.936815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15754e53-ebef-45ec-9bb0-9a20bc094bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:20.937425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15754e53-ebef-45ec-9bb0-9a20bc094bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:21.221253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-15754e53-ebef-45ec-9bb0-9a20bc094bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:21.233578 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15754e53-ebef-45ec-9bb0-9a20bc094bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1315 microversion: 2.1 time: 0.314924 Jul 28 03:51:21.250730 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1817/3274] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:20 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:21.258218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce63e775-afab-41a8-917c-90544968a376 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:21.274432 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce63e775-afab-41a8-917c-90544968a376 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021889 Jul 28 03:51:21.291560 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1818/3275] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:51:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:21.446518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-71f736c1-8799-4f36-afcc-fb7fb67b4e6b req-c77104ad-dcde-4f64-af4c-54ecf74396d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc6b0f9-3b19-45a8-86b7-27753d96eea4", "name": "network-vif-plugged", "status": "completed", "tag": "3ed3b7b7-c555-4215-b589-2eda58828d91"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:21.472780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-71f736c1-8799-4f36-afcc-fb7fb67b4e6b req-c77104ad-dcde-4f64-af4c-54ecf74396d2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:21.474917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-71f736c1-8799-4f36-afcc-fb7fb67b4e6b req-c77104ad-dcde-4f64-af4c-54ecf74396d2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:21.513232 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-71f736c1-8799-4f36-afcc-fb7fb67b4e6b req-c77104ad-dcde-4f64-af4c-54ecf74396d2 service nova] Creating event network-vif-plugged:3ed3b7b7-c555-4215-b589-2eda58828d91 for instance 7cc6b0f9-3b19-45a8-86b7-27753d96eea4 on n-h1-826756-3 Jul 28 03:51:21.528047 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-71f736c1-8799-4f36-afcc-fb7fb67b4e6b req-c77104ad-dcde-4f64-af4c-54ecf74396d2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086117 Jul 28 03:51:21.528810 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1819/3276] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:51:21.659794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-686094e8-104b-4d5b-9527-c97412a7d208 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:21.660490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-686094e8-104b-4d5b-9527-c97412a7d208 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:21.679432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-686094e8-104b-4d5b-9527-c97412a7d208 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:21.680161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-686094e8-104b-4d5b-9527-c97412a7d208 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:21.681621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-686094e8-104b-4d5b-9527-c97412a7d208 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:21.682255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-686094e8-104b-4d5b-9527-c97412a7d208 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:21.722998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-686094e8-104b-4d5b-9527-c97412a7d208 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:51:21.844604 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-686094e8-104b-4d5b-9527-c97412a7d208 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 204 len: 0 microversion: 2.1 time: 0.185815 Jul 28 03:51:21.847092 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1820/3277] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:51:21 2022] DELETE /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:51:21.855916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-65abd29d-6ab9-4dcd-9234-79d7ae5030fc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:21.856821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-65abd29d-6ab9-4dcd-9234-79d7ae5030fc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:21.864943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65abd29d-6ab9-4dcd-9234-79d7ae5030fc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:21.865836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65abd29d-6ab9-4dcd-9234-79d7ae5030fc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:21.866815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65abd29d-6ab9-4dcd-9234-79d7ae5030fc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:21.867555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65abd29d-6ab9-4dcd-9234-79d7ae5030fc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:21.897272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bc7b84e5-ca88-445e-98b0-1204891123c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:21.915144 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bc7b84e5-ca88-445e-98b0-1204891123c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1314 microversion: 2.1 time: 1.108975 Jul 28 03:51:21.916707 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1458/3278] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:20 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1314 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:21.932417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-138edbb7-64e8-468d-a879-510126e4432c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:21.933777 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-138edbb7-64e8-468d-a879-510126e4432c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:21.944483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-138edbb7-64e8-468d-a879-510126e4432c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:21.951920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-138edbb7-64e8-468d-a879-510126e4432c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:21.953205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-138edbb7-64e8-468d-a879-510126e4432c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:21.953989 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-138edbb7-64e8-468d-a879-510126e4432c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:22.086379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:22.220963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-65abd29d-6ab9-4dcd-9234-79d7ae5030fc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:22.236286 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-65abd29d-6ab9-4dcd-9234-79d7ae5030fc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 0.387223 Jul 28 03:51:22.236744 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1821/3279] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:21 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:22.255051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-525fdf66-2707-4175-acdc-13bc7b8b93d4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:22.255390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-525fdf66-2707-4175-acdc-13bc7b8b93d4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:22.280827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-525fdf66-2707-4175-acdc-13bc7b8b93d4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:22.281692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-525fdf66-2707-4175-acdc-13bc7b8b93d4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:22.282670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-525fdf66-2707-4175-acdc-13bc7b8b93d4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:22.283263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-525fdf66-2707-4175-acdc-13bc7b8b93d4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:22.545703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-138edbb7-64e8-468d-a879-510126e4432c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:22.565627 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-138edbb7-64e8-468d-a879-510126e4432c tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1608 microversion: 2.1 time: 0.647092 Jul 28 03:51:22.566286 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1459/3280] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:21 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1608 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:22.571614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a6fc83d4-08d4-4d4e-a8d9-275ba65bfece tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:22.572555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a6fc83d4-08d4-4d4e-a8d9-275ba65bfece tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:22.583205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a6fc83d4-08d4-4d4e-a8d9-275ba65bfece tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:22.583896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a6fc83d4-08d4-4d4e-a8d9-275ba65bfece tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:22.585093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a6fc83d4-08d4-4d4e-a8d9-275ba65bfece tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:22.585696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a6fc83d4-08d4-4d4e-a8d9-275ba65bfece tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:22.661605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-525fdf66-2707-4175-acdc-13bc7b8b93d4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:22.664564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:22.673330 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-525fdf66-2707-4175-acdc-13bc7b8b93d4 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1319 microversion: 2.1 time: 0.435355 Jul 28 03:51:22.674271 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1822/3281] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:22 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:22.812406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a6fc83d4-08d4-4d4e-a8d9-275ba65bfece tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:22.822318 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a6fc83d4-08d4-4d4e-a8d9-275ba65bfece tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1315 microversion: 2.1 time: 0.254895 Jul 28 03:51:22.823014 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1460/3282] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:22 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:22.841657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-88ebf8cb-a417-48c2-a6bf-68f881581d85 req-ff92313a-4836-497f-9d83-f3b275b199d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8", "tag": "ddebd4c4-d703-4220-b742-f9fb50b2c194"}, {"name": "network-changed", "server_uuid": "1779e378-a42a-40cb-9037-1ee317601146", "tag": "a7d6effa-8de5-424a-9d5c-d66436bc0ad1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:22.855360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-88ebf8cb-a417-48c2-a6bf-68f881581d85 req-ff92313a-4836-497f-9d83-f3b275b199d1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:22.855996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-88ebf8cb-a417-48c2-a6bf-68f881581d85 req-ff92313a-4836-497f-9d83-f3b275b199d1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:22.871560 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-88ebf8cb-a417-48c2-a6bf-68f881581d85 req-ff92313a-4836-497f-9d83-f3b275b199d1 service nova] Creating event network-changed:ddebd4c4-d703-4220-b742-f9fb50b2c194 for instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 on n-h1-826756-3 Jul 28 03:51:22.872082 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-88ebf8cb-a417-48c2-a6bf-68f881581d85 req-ff92313a-4836-497f-9d83-f3b275b199d1 service nova] Creating event network-changed:a7d6effa-8de5-424a-9d5c-d66436bc0ad1 for instance 1779e378-a42a-40cb-9037-1ee317601146 on n-h1-826756-3 Jul 28 03:51:22.880665 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-88ebf8cb-a417-48c2-a6bf-68f881581d85 req-ff92313a-4836-497f-9d83-f3b275b199d1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045373 Jul 28 03:51:22.882870 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1823/3283] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:22.940085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-215c4a2f-fc3f-4a89-86d6-978901564d3e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:22.941703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-215c4a2f-fc3f-4a89-86d6-978901564d3e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:22.948797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-215c4a2f-fc3f-4a89-86d6-978901564d3e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:22.949243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-215c4a2f-fc3f-4a89-86d6-978901564d3e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:22.950225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-215c4a2f-fc3f-4a89-86d6-978901564d3e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:22.950599 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-215c4a2f-fc3f-4a89-86d6-978901564d3e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:23.117895 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-215c4a2f-fc3f-4a89-86d6-978901564d3e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:23.126019 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-215c4a2f-fc3f-4a89-86d6-978901564d3e tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1314 microversion: 2.1 time: 0.190073 Jul 28 03:51:23.126618 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1461/3284] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:22 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:23.262910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a945ea20-e193-4a31-a8b2-319f866407a0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:23.263684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a945ea20-e193-4a31-a8b2-319f866407a0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:23.278426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a945ea20-e193-4a31-a8b2-319f866407a0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:23.278903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a945ea20-e193-4a31-a8b2-319f866407a0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:23.279703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a945ea20-e193-4a31-a8b2-319f866407a0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:23.280157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a945ea20-e193-4a31-a8b2-319f866407a0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:23.577572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a945ea20-e193-4a31-a8b2-319f866407a0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:23.587433 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a945ea20-e193-4a31-a8b2-319f866407a0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 0.329145 Jul 28 03:51:23.588022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-86192fd6-98b6-48b1-a7b4-499a66360604 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:23.588703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-86192fd6-98b6-48b1-a7b4-499a66360604 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:23.599297 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1824/3285] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:23 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:23.606766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86192fd6-98b6-48b1-a7b4-499a66360604 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:23.607687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86192fd6-98b6-48b1-a7b4-499a66360604 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:23.609145 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86192fd6-98b6-48b1-a7b4-499a66360604 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:23.610234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86192fd6-98b6-48b1-a7b4-499a66360604 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:23.698048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51387559-b8ed-482e-a81e-52ee89f355af tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:23.698673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-51387559-b8ed-482e-a81e-52ee89f355af tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:23.714762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51387559-b8ed-482e-a81e-52ee89f355af tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:23.715634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51387559-b8ed-482e-a81e-52ee89f355af tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:23.716935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51387559-b8ed-482e-a81e-52ee89f355af tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:23.717703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51387559-b8ed-482e-a81e-52ee89f355af tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:24.370540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-86192fd6-98b6-48b1-a7b4-499a66360604 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:24.388212 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-86192fd6-98b6-48b1-a7b4-499a66360604 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1608 microversion: 2.1 time: 0.803512 Jul 28 03:51:24.390581 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1462/3286] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:23 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1608 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:24.398453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-018c789a-a1a0-4290-9e69-51dd0a41688b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:24.399382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-018c789a-a1a0-4290-9e69-51dd0a41688b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:24.408786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-018c789a-a1a0-4290-9e69-51dd0a41688b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:24.409547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-018c789a-a1a0-4290-9e69-51dd0a41688b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:24.411113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-018c789a-a1a0-4290-9e69-51dd0a41688b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:24.411738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-018c789a-a1a0-4290-9e69-51dd0a41688b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:24.544848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-51387559-b8ed-482e-a81e-52ee89f355af tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:24.554772 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51387559-b8ed-482e-a81e-52ee89f355af tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1319 microversion: 2.1 time: 0.860006 Jul 28 03:51:24.560859 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1825/3287] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:23 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1319 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:24.564133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c7f949e-4560-4f90-9212-df530b474624 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:24.565154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c7f949e-4560-4f90-9212-df530b474624 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:24.581403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c7f949e-4560-4f90-9212-df530b474624 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:24.581974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c7f949e-4560-4f90-9212-df530b474624 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:24.583067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c7f949e-4560-4f90-9212-df530b474624 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:24.583584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c7f949e-4560-4f90-9212-df530b474624 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:24.938350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-018c789a-a1a0-4290-9e69-51dd0a41688b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:24.955401 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-018c789a-a1a0-4290-9e69-51dd0a41688b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1315 microversion: 2.1 time: 0.562669 Jul 28 03:51:24.956309 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1463/3288] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:24 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:24.964884 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d939fd50-c142-4c68-b18d-af490dff5f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:24.967054 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d939fd50-c142-4c68-b18d-af490dff5f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:24.975470 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d939fd50-c142-4c68-b18d-af490dff5f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:24.976961 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d939fd50-c142-4c68-b18d-af490dff5f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:24.978527 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d939fd50-c142-4c68-b18d-af490dff5f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:24.979357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c7f949e-4560-4f90-9212-df530b474624 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:24.980160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d939fd50-c142-4c68-b18d-af490dff5f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:24.999198 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c7f949e-4560-4f90-9212-df530b474624 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1314 microversion: 2.1 time: 0.442283 Jul 28 03:51:25.011749 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1826/3289] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:24 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:25.073049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1254848879", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e174d1f-d406-4bbf-bcb8-442696da4c2d"}], "security_groups": [{"name": "tempest-securitygroup--803029955"}], "key_name": "tempest-keypair-1504483950", "user_data": "}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:25.285390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] validate_networks() for [('4e174d1f-d406-4bbf-bcb8-442696da4c2d', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:51:25.294654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d939fd50-c142-4c68-b18d-af490dff5f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:25.304525 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d939fd50-c142-4c68-b18d-af490dff5f18 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1477 microversion: 2.1 time: 0.346164 Jul 28 03:51:25.318870 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1464/3290] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:24 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1477 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:25.420101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-210509af-0f0a-4ce5-9272-e20a4355addd tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:25.422074 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-210509af-0f0a-4ce5-9272-e20a4355addd tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:25.428941 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-210509af-0f0a-4ce5-9272-e20a4355addd tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:25.429515 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-210509af-0f0a-4ce5-9272-e20a4355addd tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:25.430607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-210509af-0f0a-4ce5-9272-e20a4355addd tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:25.431154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-210509af-0f0a-4ce5-9272-e20a4355addd tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:25.628847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-210509af-0f0a-4ce5-9272-e20a4355addd tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:25.645047 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-210509af-0f0a-4ce5-9272-e20a4355addd tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1608 microversion: 2.1 time: 0.228964 Jul 28 03:51:25.646414 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1465/3291] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:25 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1608 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:25.661403 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-41276387-e31b-4154-b57b-a6c355958279 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:25.661403 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-41276387-e31b-4154-b57b-a6c355958279 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:25.661403 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41276387-e31b-4154-b57b-a6c355958279 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:25.661403 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41276387-e31b-4154-b57b-a6c355958279 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:25.663734 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41276387-e31b-4154-b57b-a6c355958279 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:25.664215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41276387-e31b-4154-b57b-a6c355958279 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:25.905124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-41276387-e31b-4154-b57b-a6c355958279 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:25.914718 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-41276387-e31b-4154-b57b-a6c355958279 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1319 microversion: 2.1 time: 0.266438 Jul 28 03:51:25.915850 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1466/3292] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:25 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:25.937003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-555c71c7-10a8-4f4b-b320-c046bfaf96ce req-2b8c1cf6-446a-475a-8839-50834c90d4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a4251e-80ef-4e70-aa87-29d50b7e5c26", "name": "network-vif-plugged", "status": "completed", "tag": "016cb180-7a18-405e-a328-f841540f4743"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:25.947848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-555c71c7-10a8-4f4b-b320-c046bfaf96ce req-2b8c1cf6-446a-475a-8839-50834c90d4cf service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:25.949089 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-555c71c7-10a8-4f4b-b320-c046bfaf96ce req-2b8c1cf6-446a-475a-8839-50834c90d4cf service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:25.960462 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-555c71c7-10a8-4f4b-b320-c046bfaf96ce req-2b8c1cf6-446a-475a-8839-50834c90d4cf service nova] Creating event network-vif-plugged:016cb180-7a18-405e-a328-f841540f4743 for instance f7a4251e-80ef-4e70-aa87-29d50b7e5c26 on n-h2-826756-3 Jul 28 03:51:25.966196 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-555c71c7-10a8-4f4b-b320-c046bfaf96ce req-2b8c1cf6-446a-475a-8839-50834c90d4cf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048615 Jul 28 03:51:25.967081 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1467/3293] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:25.984747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-26bfe9ac-e61f-4d4b-8fb2-e6617441d536 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:25.985552 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-26bfe9ac-e61f-4d4b-8fb2-e6617441d536 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:25.992873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26bfe9ac-e61f-4d4b-8fb2-e6617441d536 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:25.993628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26bfe9ac-e61f-4d4b-8fb2-e6617441d536 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:25.994496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26bfe9ac-e61f-4d4b-8fb2-e6617441d536 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:25.995028 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26bfe9ac-e61f-4d4b-8fb2-e6617441d536 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:26.096380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:51:26.098240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:51:26.099258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:51:26.100126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:51:26.100806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:51:26.134321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:26.136085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:26.139499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:26.140340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:26.167386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Getting quotas for project 98f0f82bb0014564bff4c739314d25a4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:51:26.174657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Getting quotas for user ea947ad72ea74f439474ac4703fb0ebb and project 98f0f82bb0014564bff4c739314d25a4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:51:26.193522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:51:26.196434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:51:26.263512 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ec2439e8-04e8-4a77-a476-864093dd13cd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.194688 Jul 28 03:51:26.265508 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1827/3294] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:51:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 03:51:26.276157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8c51590a-04dc-4fcc-81ce-1163485c4277 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:26.288214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8c51590a-04dc-4fcc-81ce-1163485c4277 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:26.301022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c51590a-04dc-4fcc-81ce-1163485c4277 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:26.302148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c51590a-04dc-4fcc-81ce-1163485c4277 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:26.302983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c51590a-04dc-4fcc-81ce-1163485c4277 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:26.304448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c51590a-04dc-4fcc-81ce-1163485c4277 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:26.592570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8c51590a-04dc-4fcc-81ce-1163485c4277 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:26.604820 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8c51590a-04dc-4fcc-81ce-1163485c4277 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1314 microversion: 2.1 time: 0.339245 Jul 28 03:51:26.610184 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1828/3295] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:26 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:26.617488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd40c4de-0905-437c-a9bc-831fa503d9a8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:26.618730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd40c4de-0905-437c-a9bc-831fa503d9a8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:26.726224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dd40c4de-0905-437c-a9bc-831fa503d9a8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:26.741810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dd40c4de-0905-437c-a9bc-831fa503d9a8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:26.745500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dd40c4de-0905-437c-a9bc-831fa503d9a8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:26.747232 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd40c4de-0905-437c-a9bc-831fa503d9a8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1282 microversion: 2.20 time: 0.135029 Jul 28 03:51:26.748234 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1829/3296] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:51:26 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1282 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:26.754794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a0468dab-a46c-41a9-859c-ce8bc15c312c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:26.755857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a0468dab-a46c-41a9-859c-ce8bc15c312c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:26.765082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0468dab-a46c-41a9-859c-ce8bc15c312c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:26.765990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0468dab-a46c-41a9-859c-ce8bc15c312c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:26.767136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0468dab-a46c-41a9-859c-ce8bc15c312c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:26.768063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0468dab-a46c-41a9-859c-ce8bc15c312c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:27.042657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=16 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:27.102878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a0468dab-a46c-41a9-859c-ce8bc15c312c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:27.105454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-26bfe9ac-e61f-4d4b-8fb2-e6617441d536 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:27.133395 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-26bfe9ac-e61f-4d4b-8fb2-e6617441d536 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1315 microversion: 2.1 time: 1.151753 Jul 28 03:51:27.135267 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a0468dab-a46c-41a9-859c-ce8bc15c312c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1476 microversion: 2.1 time: 0.382133 Jul 28 03:51:27.137576 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1468/3297] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:25 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1315 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:27.138499 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1830/3298] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:26 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1476 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:27.147769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3871021d-81a2-411d-b41c-3bbb8bd57618 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:27.148784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3871021d-81a2-411d-b41c-3bbb8bd57618 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:27.153599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e41ae3aa-d1f0-4f28-8e6f-d02f37c070df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:27.154544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e41ae3aa-d1f0-4f28-8e6f-d02f37c070df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:27.162118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3871021d-81a2-411d-b41c-3bbb8bd57618 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:27.179844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e41ae3aa-d1f0-4f28-8e6f-d02f37c070df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:27.180324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e41ae3aa-d1f0-4f28-8e6f-d02f37c070df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:27.181172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e41ae3aa-d1f0-4f28-8e6f-d02f37c070df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:27.181781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e41ae3aa-d1f0-4f28-8e6f-d02f37c070df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:27.182816 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3871021d-81a2-411d-b41c-3bbb8bd57618 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:27.184039 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3871021d-81a2-411d-b41c-3bbb8bd57618 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:27.189511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3871021d-81a2-411d-b41c-3bbb8bd57618 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:27.623484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e41ae3aa-d1f0-4f28-8e6f-d02f37c070df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:27.643654 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e41ae3aa-d1f0-4f28-8e6f-d02f37c070df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1319 microversion: 2.1 time: 0.501713 Jul 28 03:51:27.644288 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1831/3299] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:27 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:27.650862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-32a35560-e201-437e-b4bc-6c8350b89eaa tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:27.651499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-32a35560-e201-437e-b4bc-6c8350b89eaa tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:27.672581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32a35560-e201-437e-b4bc-6c8350b89eaa tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:27.673409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32a35560-e201-437e-b4bc-6c8350b89eaa tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:27.679677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32a35560-e201-437e-b4bc-6c8350b89eaa tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:27.680752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32a35560-e201-437e-b4bc-6c8350b89eaa tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:28.110168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-32a35560-e201-437e-b4bc-6c8350b89eaa tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:28.118815 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-32a35560-e201-437e-b4bc-6c8350b89eaa tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1314 microversion: 2.1 time: 0.473366 Jul 28 03:51:28.119726 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1832/3300] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:27 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:28.145399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1ba412c5-5102-4886-990b-2ee7f6609256 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:28.146469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1ba412c5-5102-4886-990b-2ee7f6609256 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:28.168670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ba412c5-5102-4886-990b-2ee7f6609256 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:28.171000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ba412c5-5102-4886-990b-2ee7f6609256 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:28.172843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ba412c5-5102-4886-990b-2ee7f6609256 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:28.173573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ba412c5-5102-4886-990b-2ee7f6609256 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:28.371096 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3871021d-81a2-411d-b41c-3bbb8bd57618 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:28.382185 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3871021d-81a2-411d-b41c-3bbb8bd57618 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1608 microversion: 2.1 time: 1.241052 Jul 28 03:51:28.404078 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1469/3301] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:27 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1608 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:28.409434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-696b9aec-89db-4d8e-b39a-627bd21aa0af req-fee73f66-88f4-4b22-9ffd-0e6f2906493e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3639d857-7077-4ba1-a880-8d0c9822845d", "name": "network-vif-plugged", "status": "completed", "tag": "887fcfc4-1119-4e02-a17f-5125c132b986"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:28.436658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-696b9aec-89db-4d8e-b39a-627bd21aa0af req-fee73f66-88f4-4b22-9ffd-0e6f2906493e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:28.441671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-696b9aec-89db-4d8e-b39a-627bd21aa0af req-fee73f66-88f4-4b22-9ffd-0e6f2906493e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:28.454751 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:28.485920 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-696b9aec-89db-4d8e-b39a-627bd21aa0af req-fee73f66-88f4-4b22-9ffd-0e6f2906493e service nova] Creating event network-vif-plugged:887fcfc4-1119-4e02-a17f-5125c132b986 for instance 3639d857-7077-4ba1-a880-8d0c9822845d on n-h1-826756-3 Jul 28 03:51:28.492076 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-696b9aec-89db-4d8e-b39a-627bd21aa0af req-fee73f66-88f4-4b22-9ffd-0e6f2906493e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086372 Jul 28 03:51:28.493480 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1470/3302] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:28.502655 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b9081267-3232-4d76-8b3d-b6f406402961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:28.504258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b9081267-3232-4d76-8b3d-b6f406402961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:28.515577 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9081267-3232-4d76-8b3d-b6f406402961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:28.516203 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9081267-3232-4d76-8b3d-b6f406402961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:28.517387 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9081267-3232-4d76-8b3d-b6f406402961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:28.518071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b9081267-3232-4d76-8b3d-b6f406402961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:28.729340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1ba412c5-5102-4886-990b-2ee7f6609256 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:28.745679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1ba412c5-5102-4886-990b-2ee7f6609256 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:28.747817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1ba412c5-5102-4886-990b-2ee7f6609256 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:28.749127 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1ba412c5-5102-4886-990b-2ee7f6609256 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1334 microversion: 2.20 time: 0.611556 Jul 28 03:51:28.749780 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1833/3303] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:51:28 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1334 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:28.771407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ae427c64-0175-4ace-b23b-0b6b8e337e6d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:28.772555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ae427c64-0175-4ace-b23b-0b6b8e337e6d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:28.779730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae427c64-0175-4ace-b23b-0b6b8e337e6d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:28.780610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae427c64-0175-4ace-b23b-0b6b8e337e6d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:28.781741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae427c64-0175-4ace-b23b-0b6b8e337e6d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:28.783146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae427c64-0175-4ace-b23b-0b6b8e337e6d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:28.988608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ae427c64-0175-4ace-b23b-0b6b8e337e6d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:29.004103 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ae427c64-0175-4ace-b23b-0b6b8e337e6d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1315 microversion: 2.1 time: 0.252809 Jul 28 03:51:29.004956 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1834/3304] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:28 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:29.011402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-341330eb-4580-41ba-802c-2c0259d4c459 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:29.012272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-341330eb-4580-41ba-802c-2c0259d4c459 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:29.024389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-341330eb-4580-41ba-802c-2c0259d4c459 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:29.025842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-341330eb-4580-41ba-802c-2c0259d4c459 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:29.027182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-341330eb-4580-41ba-802c-2c0259d4c459 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:29.028126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-341330eb-4580-41ba-802c-2c0259d4c459 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:29.226836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-341330eb-4580-41ba-802c-2c0259d4c459 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:29.237180 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-341330eb-4580-41ba-802c-2c0259d4c459 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1319 microversion: 2.1 time: 0.230829 Jul 28 03:51:29.240241 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1835/3305] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:29 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:29.246219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2a1f8ea6-8ed6-46dc-b271-401f19de2d3d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:29.247206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2a1f8ea6-8ed6-46dc-b271-401f19de2d3d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:29.255391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a1f8ea6-8ed6-46dc-b271-401f19de2d3d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:29.256247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a1f8ea6-8ed6-46dc-b271-401f19de2d3d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:29.257272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a1f8ea6-8ed6-46dc-b271-401f19de2d3d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:29.258043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a1f8ea6-8ed6-46dc-b271-401f19de2d3d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:29.453034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2a1f8ea6-8ed6-46dc-b271-401f19de2d3d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:29.464135 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2a1f8ea6-8ed6-46dc-b271-401f19de2d3d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1314 microversion: 2.1 time: 0.221927 Jul 28 03:51:29.480200 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1836/3306] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:29 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:29.480200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-18c1d66f-1bf4-417a-a0af-6836451070a1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:29.480200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-18c1d66f-1bf4-417a-a0af-6836451070a1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:29.483397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18c1d66f-1bf4-417a-a0af-6836451070a1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:29.483845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18c1d66f-1bf4-417a-a0af-6836451070a1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:29.484813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18c1d66f-1bf4-417a-a0af-6836451070a1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:29.486191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18c1d66f-1bf4-417a-a0af-6836451070a1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:29.584845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-18c1d66f-1bf4-417a-a0af-6836451070a1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:29.593621 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-18c1d66f-1bf4-417a-a0af-6836451070a1 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1541 microversion: 2.1 time: 0.126772 Jul 28 03:51:29.602997 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1837/3307] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:29 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1541 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:29.775558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63cac897-71b9-435e-bab8-8c4be4cc8cc9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:29.776174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63cac897-71b9-435e-bab8-8c4be4cc8cc9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:29.780466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b9081267-3232-4d76-8b3d-b6f406402961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:29.783271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63cac897-71b9-435e-bab8-8c4be4cc8cc9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:29.784333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63cac897-71b9-435e-bab8-8c4be4cc8cc9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:29.785228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63cac897-71b9-435e-bab8-8c4be4cc8cc9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:29.785664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63cac897-71b9-435e-bab8-8c4be4cc8cc9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:29.789260 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b9081267-3232-4d76-8b3d-b6f406402961 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1476 microversion: 2.1 time: 1.294266 Jul 28 03:51:29.790075 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1471/3308] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:28 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1476 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:29.874786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63cac897-71b9-435e-bab8-8c4be4cc8cc9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:29.884525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63cac897-71b9-435e-bab8-8c4be4cc8cc9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:29.886467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63cac897-71b9-435e-bab8-8c4be4cc8cc9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:29.887715 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63cac897-71b9-435e-bab8-8c4be4cc8cc9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1340 microversion: 2.20 time: 0.116338 Jul 28 03:51:29.897496 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1838/3309] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:51:29 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1340 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:30.031689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4f60e887-9fba-4822-896f-279431deabb5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:30.032804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4f60e887-9fba-4822-896f-279431deabb5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:30.044423 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f60e887-9fba-4822-896f-279431deabb5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:30.050643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f60e887-9fba-4822-896f-279431deabb5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:30.051846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f60e887-9fba-4822-896f-279431deabb5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:30.052522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f60e887-9fba-4822-896f-279431deabb5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:30.215877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3c47e6f3-48fb-43e2-9078-db7dd6f17ec2 req-18110ec5-f7b5-46e3-85a9-a308d64d2b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f57a0500-5de5-48e7-bc4e-c25234ca8fa6", "name": "network-vif-deleted", "tag": "f50067a7-443a-48a2-a22b-703b731470d5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:30.247828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3c47e6f3-48fb-43e2-9078-db7dd6f17ec2 req-18110ec5-f7b5-46e3-85a9-a308d64d2b12 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:30.251913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3c47e6f3-48fb-43e2-9078-db7dd6f17ec2 req-18110ec5-f7b5-46e3-85a9-a308d64d2b12 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:30.280917 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3c47e6f3-48fb-43e2-9078-db7dd6f17ec2 req-18110ec5-f7b5-46e3-85a9-a308d64d2b12 service nova] Creating event network-vif-deleted:f50067a7-443a-48a2-a22b-703b731470d5 for instance f57a0500-5de5-48e7-bc4e-c25234ca8fa6 on n-h2-826756-3 Jul 28 03:51:30.293200 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3c47e6f3-48fb-43e2-9078-db7dd6f17ec2 req-18110ec5-f7b5-46e3-85a9-a308d64d2b12 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081034 Jul 28 03:51:30.295890 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1839/3310] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:30.306209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-12944501-add7-4f5e-aefe-60752b720bed tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:30.306209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-12944501-add7-4f5e-aefe-60752b720bed tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:30.315596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12944501-add7-4f5e-aefe-60752b720bed tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:30.316107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12944501-add7-4f5e-aefe-60752b720bed tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:30.316964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12944501-add7-4f5e-aefe-60752b720bed tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:30.317407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12944501-add7-4f5e-aefe-60752b720bed tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:30.626623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-12944501-add7-4f5e-aefe-60752b720bed tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:30.629595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4f60e887-9fba-4822-896f-279431deabb5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:30.638446 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-12944501-add7-4f5e-aefe-60752b720bed tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1319 microversion: 2.1 time: 0.337891 Jul 28 03:51:30.647790 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4f60e887-9fba-4822-896f-279431deabb5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1315 microversion: 2.1 time: 0.620245 Jul 28 03:51:30.657318 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1840/3311] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:30 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:30.657438 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1472/3312] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:30 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:30.665377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ab6e750-fb63-4a43-bf7a-ecb82d734f3b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:30.672503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ab6e750-fb63-4a43-bf7a-ecb82d734f3b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:30.672770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-e3699724-e51e-4224-b833-79d27d297981 req-815b1172-f1a0-404f-9227-8d42795cd910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8", "name": "network-vif-plugged", "status": "completed", "tag": "ddebd4c4-d703-4220-b742-f9fb50b2c194"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:30.684875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ab6e750-fb63-4a43-bf7a-ecb82d734f3b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:30.691478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ab6e750-fb63-4a43-bf7a-ecb82d734f3b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:30.694757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ab6e750-fb63-4a43-bf7a-ecb82d734f3b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:30.697489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ab6e750-fb63-4a43-bf7a-ecb82d734f3b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:30.701165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e3699724-e51e-4224-b833-79d27d297981 req-815b1172-f1a0-404f-9227-8d42795cd910 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:30.701713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e3699724-e51e-4224-b833-79d27d297981 req-815b1172-f1a0-404f-9227-8d42795cd910 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:30.735138 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-e3699724-e51e-4224-b833-79d27d297981 req-815b1172-f1a0-404f-9227-8d42795cd910 service nova] Creating event network-vif-plugged:ddebd4c4-d703-4220-b742-f9fb50b2c194 for instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 on n-h1-826756-3 Jul 28 03:51:30.740760 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-e3699724-e51e-4224-b833-79d27d297981 req-815b1172-f1a0-404f-9227-8d42795cd910 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082675 Jul 28 03:51:30.741717 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1473/3313] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:30.756760 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0109cb33-8fe6-40d7-a770-fb6ea452ce1e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:30.757473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0109cb33-8fe6-40d7-a770-fb6ea452ce1e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:30.775734 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0109cb33-8fe6-40d7-a770-fb6ea452ce1e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:30.776614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0109cb33-8fe6-40d7-a770-fb6ea452ce1e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:30.777603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0109cb33-8fe6-40d7-a770-fb6ea452ce1e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:30.778266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0109cb33-8fe6-40d7-a770-fb6ea452ce1e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:30.980096 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0109cb33-8fe6-40d7-a770-fb6ea452ce1e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:30.990305 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0109cb33-8fe6-40d7-a770-fb6ea452ce1e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1253 microversion: 2.1 time: 0.247235 Jul 28 03:51:30.995624 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1474/3314] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:30 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1253 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:31.001374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-00604690-1742-4b18-b638-423dd4e0a5cb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:31.014858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-00604690-1742-4b18-b638-423dd4e0a5cb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:31.032046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00604690-1742-4b18-b638-423dd4e0a5cb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:31.036819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00604690-1742-4b18-b638-423dd4e0a5cb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:31.037890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00604690-1742-4b18-b638-423dd4e0a5cb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:31.041016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00604690-1742-4b18-b638-423dd4e0a5cb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:31.574885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2ab6e750-fb63-4a43-bf7a-ecb82d734f3b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:31.584636 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ab6e750-fb63-4a43-bf7a-ecb82d734f3b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1314 microversion: 2.1 time: 0.927916 Jul 28 03:51:31.596382 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1841/3315] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:30 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1314 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:31.601673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7f83e9d2-a8dd-4fd3-8d55-b1a9ebaf8e6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:31.606563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7f83e9d2-a8dd-4fd3-8d55-b1a9ebaf8e6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:31.624026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f83e9d2-a8dd-4fd3-8d55-b1a9ebaf8e6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:31.624563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f83e9d2-a8dd-4fd3-8d55-b1a9ebaf8e6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:31.625376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f83e9d2-a8dd-4fd3-8d55-b1a9ebaf8e6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:31.625820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f83e9d2-a8dd-4fd3-8d55-b1a9ebaf8e6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:31.649791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:31.751418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7f83e9d2-a8dd-4fd3-8d55-b1a9ebaf8e6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:31.761130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7f83e9d2-a8dd-4fd3-8d55-b1a9ebaf8e6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:31.763267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7f83e9d2-a8dd-4fd3-8d55-b1a9ebaf8e6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:31.767403 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7f83e9d2-a8dd-4fd3-8d55-b1a9ebaf8e6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1340 microversion: 2.20 time: 0.175009 Jul 28 03:51:31.780477 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1842/3316] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:51:31 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1340 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:31.780477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4045571-0c58-4abf-8503-352b0a372e04 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:31.780477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d4045571-0c58-4abf-8503-352b0a372e04 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:31.781326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4045571-0c58-4abf-8503-352b0a372e04 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:31.781598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4045571-0c58-4abf-8503-352b0a372e04 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:31.782362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4045571-0c58-4abf-8503-352b0a372e04 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:31.783060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4045571-0c58-4abf-8503-352b0a372e04 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:31.987926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-00604690-1742-4b18-b638-423dd4e0a5cb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:32.003381 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-00604690-1742-4b18-b638-423dd4e0a5cb tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1476 microversion: 2.1 time: 1.006313 Jul 28 03:51:32.004325 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1475/3317] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:30 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1476 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:32.009120 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-12ab4458-204d-4d84-978b-9490025af358 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:32.009739 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-12ab4458-204d-4d84-978b-9490025af358 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:32.027253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-12ab4458-204d-4d84-978b-9490025af358 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:32.028563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-12ab4458-204d-4d84-978b-9490025af358 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:32.030720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-12ab4458-204d-4d84-978b-9490025af358 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:32.032125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-12ab4458-204d-4d84-978b-9490025af358 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:32.086662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d4045571-0c58-4abf-8503-352b0a372e04 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:32.118258 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d4045571-0c58-4abf-8503-352b0a372e04 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1511 microversion: 2.1 time: 0.348486 Jul 28 03:51:32.142231 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1843/3318] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:31 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:32.151574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3562887-2f5f-489a-b721-b555356ca351 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:32.153468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d3562887-2f5f-489a-b721-b555356ca351 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:32.166406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3562887-2f5f-489a-b721-b555356ca351 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:32.167305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3562887-2f5f-489a-b721-b555356ca351 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:32.168628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3562887-2f5f-489a-b721-b555356ca351 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:32.169384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3562887-2f5f-489a-b721-b555356ca351 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:32.311929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d3562887-2f5f-489a-b721-b555356ca351 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:32.321401 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d3562887-2f5f-489a-b721-b555356ca351 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1253 microversion: 2.1 time: 0.177553 Jul 28 03:51:32.322238 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1844/3319] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:32 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1253 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:32.346699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17eb87c8-5f35-4a0e-916a-cf02d474ca3d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:32.347454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-17eb87c8-5f35-4a0e-916a-cf02d474ca3d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:32.355156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:32.357794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17eb87c8-5f35-4a0e-916a-cf02d474ca3d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:32.358263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17eb87c8-5f35-4a0e-916a-cf02d474ca3d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:32.359221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17eb87c8-5f35-4a0e-916a-cf02d474ca3d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:32.359527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17eb87c8-5f35-4a0e-916a-cf02d474ca3d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:32.602939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-12ab4458-204d-4d84-978b-9490025af358 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:32.619181 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-12ab4458-204d-4d84-978b-9490025af358 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1315 microversion: 2.1 time: 0.613169 Jul 28 03:51:32.619998 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1476/3320] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:32 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:32.626766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-e49b4f04-c129-498a-a723-537cbdb327e8 req-ad260cbc-e71d-4e2d-8097-d7bf8562fa8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dca550f-8f08-4f26-a922-b8b222db43a1", "name": "network-vif-unplugged", "status": "completed", "tag": "4dce8ccd-5f8a-4b35-a9d0-946725622ad1"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:32.640996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e49b4f04-c129-498a-a723-537cbdb327e8 req-ad260cbc-e71d-4e2d-8097-d7bf8562fa8f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:32.641885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e49b4f04-c129-498a-a723-537cbdb327e8 req-ad260cbc-e71d-4e2d-8097-d7bf8562fa8f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:32.661130 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-e49b4f04-c129-498a-a723-537cbdb327e8 req-ad260cbc-e71d-4e2d-8097-d7bf8562fa8f service nova] Creating event network-vif-unplugged:4dce8ccd-5f8a-4b35-a9d0-946725622ad1 for instance 1dca550f-8f08-4f26-a922-b8b222db43a1 on n-h1-826756-3 Jul 28 03:51:32.669236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [req-e49b4f04-c129-498a-a723-537cbdb327e8 req-ad260cbc-e71d-4e2d-8097-d7bf8562fa8f service nova] Instance 1dca550f-8f08-4f26-a922-b8b222db43a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:51:32.706441 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-e49b4f04-c129-498a-a723-537cbdb327e8 req-ad260cbc-e71d-4e2d-8097-d7bf8562fa8f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083463 Jul 28 03:51:32.707419 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1477/3321] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:32.720078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-998f3754-0c85-42be-a10c-86d59cef97ee tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:32.722165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-998f3754-0c85-42be-a10c-86d59cef97ee tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:32.730670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-998f3754-0c85-42be-a10c-86d59cef97ee tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:32.731526 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-998f3754-0c85-42be-a10c-86d59cef97ee tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:32.732586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-998f3754-0c85-42be-a10c-86d59cef97ee tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:32.733238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-998f3754-0c85-42be-a10c-86d59cef97ee tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:32.777010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-17eb87c8-5f35-4a0e-916a-cf02d474ca3d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:32.789193 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-17eb87c8-5f35-4a0e-916a-cf02d474ca3d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1512 microversion: 2.1 time: 0.448632 Jul 28 03:51:32.804487 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1845/3322] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:32 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1512 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:32.819254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-110c4225-01a4-4b04-8183-905b614fd4d2 req-57e6276f-9278-48c2-97fa-83a0954819c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1779e378-a42a-40cb-9037-1ee317601146", "name": "network-vif-plugged", "status": "completed", "tag": "a7d6effa-8de5-424a-9d5c-d66436bc0ad1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:32.833793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-110c4225-01a4-4b04-8183-905b614fd4d2 req-57e6276f-9278-48c2-97fa-83a0954819c6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:32.834791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-110c4225-01a4-4b04-8183-905b614fd4d2 req-57e6276f-9278-48c2-97fa-83a0954819c6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:32.853065 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-110c4225-01a4-4b04-8183-905b614fd4d2 req-57e6276f-9278-48c2-97fa-83a0954819c6 service nova] Creating event network-vif-plugged:a7d6effa-8de5-424a-9d5c-d66436bc0ad1 for instance 1779e378-a42a-40cb-9037-1ee317601146 on n-h1-826756-3 Jul 28 03:51:32.864930 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-110c4225-01a4-4b04-8183-905b614fd4d2 req-57e6276f-9278-48c2-97fa-83a0954819c6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056020 Jul 28 03:51:32.866378 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1846/3323] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:32.875257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e34f6810-ffad-410f-bf76-c8f4a0f0d0e2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:32.876423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e34f6810-ffad-410f-bf76-c8f4a0f0d0e2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:32.899948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e34f6810-ffad-410f-bf76-c8f4a0f0d0e2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:32.901258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e34f6810-ffad-410f-bf76-c8f4a0f0d0e2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:32.902378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e34f6810-ffad-410f-bf76-c8f4a0f0d0e2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:32.903002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e34f6810-ffad-410f-bf76-c8f4a0f0d0e2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:33.140175 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-998f3754-0c85-42be-a10c-86d59cef97ee tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:33.155916 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-998f3754-0c85-42be-a10c-86d59cef97ee tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1314 microversion: 2.1 time: 0.446828 Jul 28 03:51:33.158819 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1478/3324] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:32 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:33.196200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-deba657a-2c62-4dbe-b9a8-0111026797ef tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:33.199267 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-deba657a-2c62-4dbe-b9a8-0111026797ef tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: f7a4251e-80ef-4e70-aa87-29d50b7e5c26] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:33.228226 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-deba657a-2c62-4dbe-b9a8-0111026797ef tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:33.229672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-deba657a-2c62-4dbe-b9a8-0111026797ef tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:33.231203 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-deba657a-2c62-4dbe-b9a8-0111026797ef tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:33.233982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-deba657a-2c62-4dbe-b9a8-0111026797ef tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:33.548958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e34f6810-ffad-410f-bf76-c8f4a0f0d0e2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:33.567844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e34f6810-ffad-410f-bf76-c8f4a0f0d0e2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:33.569562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e34f6810-ffad-410f-bf76-c8f4a0f0d0e2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:33.571086 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e34f6810-ffad-410f-bf76-c8f4a0f0d0e2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1407 microversion: 2.20 time: 0.703213 Jul 28 03:51:33.572279 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1847/3325] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:51:32 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1407 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:33.577242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-69996b78-2841-47b6-9db7-8112885fabb4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:33.578177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-69996b78-2841-47b6-9db7-8112885fabb4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:33.585121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69996b78-2841-47b6-9db7-8112885fabb4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:33.585921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69996b78-2841-47b6-9db7-8112885fabb4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:33.587016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69996b78-2841-47b6-9db7-8112885fabb4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:33.587671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69996b78-2841-47b6-9db7-8112885fabb4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:33.946350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-69996b78-2841-47b6-9db7-8112885fabb4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:33.962598 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-69996b78-2841-47b6-9db7-8112885fabb4 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1476 microversion: 2.1 time: 0.388678 Jul 28 03:51:33.964286 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1848/3326] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:33 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1476 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:33.971676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd134855-3d63-4c94-8f7a-74905ea35089 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:33.972638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd134855-3d63-4c94-8f7a-74905ea35089 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:33.979402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd134855-3d63-4c94-8f7a-74905ea35089 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:33.980133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd134855-3d63-4c94-8f7a-74905ea35089 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:33.981130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd134855-3d63-4c94-8f7a-74905ea35089 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:33.982403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd134855-3d63-4c94-8f7a-74905ea35089 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:34.088623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dd134855-3d63-4c94-8f7a-74905ea35089 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:34.105508 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd134855-3d63-4c94-8f7a-74905ea35089 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1253 microversion: 2.1 time: 0.139419 Jul 28 03:51:34.109650 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1849/3327] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:33 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1253 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:34.127979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51fd6f38-8b1b-467c-af5a-a59c557e44c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:34.128712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-51fd6f38-8b1b-467c-af5a-a59c557e44c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:34.136635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51fd6f38-8b1b-467c-af5a-a59c557e44c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:34.137339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51fd6f38-8b1b-467c-af5a-a59c557e44c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:34.137773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-deba657a-2c62-4dbe-b9a8-0111026797ef tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:34.138515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51fd6f38-8b1b-467c-af5a-a59c557e44c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:34.139178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51fd6f38-8b1b-467c-af5a-a59c557e44c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:34.156183 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-deba657a-2c62-4dbe-b9a8-0111026797ef tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26" status: 200 len: 1511 microversion: 2.1 time: 0.995602 Jul 28 03:51:34.161904 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1479/3328] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:33 2022] GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26 => generated 1511 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:34.181445 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-98f1d71d-5a3d-4679-ad06-7ccd78836542 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:34.182249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-98f1d71d-5a3d-4679-ad06-7ccd78836542 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:34.203746 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98f1d71d-5a3d-4679-ad06-7ccd78836542 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:34.204249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98f1d71d-5a3d-4679-ad06-7ccd78836542 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:34.205953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98f1d71d-5a3d-4679-ad06-7ccd78836542 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:34.206842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98f1d71d-5a3d-4679-ad06-7ccd78836542 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:34.507861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-98f1d71d-5a3d-4679-ad06-7ccd78836542 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:34.517459 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-98f1d71d-5a3d-4679-ad06-7ccd78836542 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1314 microversion: 2.1 time: 0.341329 Jul 28 03:51:34.537834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-51fd6f38-8b1b-467c-af5a-a59c557e44c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:34.546181 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1480/3329] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:34 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:34.549102 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51fd6f38-8b1b-467c-af5a-a59c557e44c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1502 microversion: 2.1 time: 0.434072 Jul 28 03:51:34.553277 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1850/3330] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:34 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1502 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:34.569465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-428fa2a9-f86c-45c3-8a68-8f113e3ffe1e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:34.579502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df26ec2f-5b1a-49f9-b861-b2cad7148000 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:34.580043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-df26ec2f-5b1a-49f9-b861-b2cad7148000 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:34.587176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-428fa2a9-f86c-45c3-8a68-8f113e3ffe1e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:34.588582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-428fa2a9-f86c-45c3-8a68-8f113e3ffe1e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:51:34.589720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df26ec2f-5b1a-49f9-b861-b2cad7148000 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:34.590161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df26ec2f-5b1a-49f9-b861-b2cad7148000 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:34.590958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df26ec2f-5b1a-49f9-b861-b2cad7148000 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:34.591404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df26ec2f-5b1a-49f9-b861-b2cad7148000 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:34.631082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-428fa2a9-f86c-45c3-8a68-8f113e3ffe1e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:34.633950 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-428fa2a9-f86c-45c3-8a68-8f113e3ffe1e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:34.635137 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-428fa2a9-f86c-45c3-8a68-8f113e3ffe1e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:34.636080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-428fa2a9-f86c-45c3-8a68-8f113e3ffe1e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:34.667282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-df26ec2f-5b1a-49f9-b861-b2cad7148000 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lazy-loading 'flavor' on Instance uuid 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:51:34.852773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-428fa2a9-f86c-45c3-8a68-8f113e3ffe1e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:51:35.034106 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-df26ec2f-5b1a-49f9-b861-b2cad7148000 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "POST /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8/action" status: 202 len: 0 microversion: 2.1 time: 0.459866 Jul 28 03:51:35.037339 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1851/3331] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:51:34 2022] POST /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:51:35.047354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4bbae454-1de6-48b6-ba45-92edda8765e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:35.048585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4bbae454-1de6-48b6-ba45-92edda8765e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:35.064085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4bbae454-1de6-48b6-ba45-92edda8765e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:35.065502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4bbae454-1de6-48b6-ba45-92edda8765e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:35.066987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4bbae454-1de6-48b6-ba45-92edda8765e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:35.068397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4bbae454-1de6-48b6-ba45-92edda8765e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:35.087064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-428fa2a9-f86c-45c3-8a68-8f113e3ffe1e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:35.105763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-428fa2a9-f86c-45c3-8a68-8f113e3ffe1e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:35.106597 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-428fa2a9-f86c-45c3-8a68-8f113e3ffe1e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:35.462082 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-428fa2a9-f86c-45c3-8a68-8f113e3ffe1e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.913804 Jul 28 03:51:35.463079 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1481/3332] 10.222.0.48 () {58 vars in 1167 bytes} [Thu Jul 28 03:51:34 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:35.468803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-3f67e243-30c6-4d3c-891f-c416bb4f7b6f req-aa75c0d6-4e19-4af9-84e7-84a6df3413f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dca550f-8f08-4f26-a922-b8b222db43a1", "tag": "4dce8ccd-5f8a-4b35-a9d0-946725622ad1"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:35.499998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3f67e243-30c6-4d3c-891f-c416bb4f7b6f req-aa75c0d6-4e19-4af9-84e7-84a6df3413f8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:35.500775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3f67e243-30c6-4d3c-891f-c416bb4f7b6f req-aa75c0d6-4e19-4af9-84e7-84a6df3413f8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:35.515535 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-3f67e243-30c6-4d3c-891f-c416bb4f7b6f req-aa75c0d6-4e19-4af9-84e7-84a6df3413f8 service nova] Creating event network-changed:4dce8ccd-5f8a-4b35-a9d0-946725622ad1 for instance 1dca550f-8f08-4f26-a922-b8b222db43a1 on n-h1-826756-3 Jul 28 03:51:35.525316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [req-3f67e243-30c6-4d3c-891f-c416bb4f7b6f req-aa75c0d6-4e19-4af9-84e7-84a6df3413f8 service nova] Instance 1dca550f-8f08-4f26-a922-b8b222db43a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:51:35.527601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4bbae454-1de6-48b6-ba45-92edda8765e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:35.542398 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-3f67e243-30c6-4d3c-891f-c416bb4f7b6f req-aa75c0d6-4e19-4af9-84e7-84a6df3413f8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078007 Jul 28 03:51:35.543668 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1482/3333] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:35.545490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4bbae454-1de6-48b6-ba45-92edda8765e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:35.550632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-10a70639-edfa-4489-909e-aa36ceef0fe2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:35.551840 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-10a70639-edfa-4489-909e-aa36ceef0fe2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:35.553796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4bbae454-1de6-48b6-ba45-92edda8765e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:35.557658 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4bbae454-1de6-48b6-ba45-92edda8765e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1407 microversion: 2.20 time: 0.515978 Jul 28 03:51:35.558975 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1852/3334] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:51:35 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1407 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:35.566067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-10a70639-edfa-4489-909e-aa36ceef0fe2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:35.566757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-10a70639-edfa-4489-909e-aa36ceef0fe2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:35.567714 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-10a70639-edfa-4489-909e-aa36ceef0fe2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:35.568302 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-10a70639-edfa-4489-909e-aa36ceef0fe2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:35.569952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d9a58786-6430-4983-8bb4-a672bc01763f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:35.573226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d9a58786-6430-4983-8bb4-a672bc01763f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:35.586564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9a58786-6430-4983-8bb4-a672bc01763f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:35.587141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9a58786-6430-4983-8bb4-a672bc01763f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:35.588050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9a58786-6430-4983-8bb4-a672bc01763f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:35.588544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9a58786-6430-4983-8bb4-a672bc01763f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:35.932344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-10a70639-edfa-4489-909e-aa36ceef0fe2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:35.953828 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-10a70639-edfa-4489-909e-aa36ceef0fe2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1474 microversion: 2.1 time: 0.408124 Jul 28 03:51:35.954923 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1483/3335] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:35 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1474 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:35.965900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e69103cd-b5f4-47ab-97f8-7e8ec2b529ea tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:35.967163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e69103cd-b5f4-47ab-97f8-7e8ec2b529ea tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:35.975820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e69103cd-b5f4-47ab-97f8-7e8ec2b529ea tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:35.977568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e69103cd-b5f4-47ab-97f8-7e8ec2b529ea tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:35.979020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e69103cd-b5f4-47ab-97f8-7e8ec2b529ea tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:35.979769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e69103cd-b5f4-47ab-97f8-7e8ec2b529ea tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:36.153423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:36.166603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e69103cd-b5f4-47ab-97f8-7e8ec2b529ea tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:36.174924 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e69103cd-b5f4-47ab-97f8-7e8ec2b529ea tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1253 microversion: 2.1 time: 0.218561 Jul 28 03:51:36.188958 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1484/3336] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:35 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1253 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:36.201712 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c57c885b-5034-483f-b6cf-be5722b24b82 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:36.207490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c57c885b-5034-483f-b6cf-be5722b24b82 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:36.208443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c57c885b-5034-483f-b6cf-be5722b24b82 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1651517927', 'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:51:36.214516 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c57c885b-5034-483f-b6cf-be5722b24b82 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:36.215130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c57c885b-5034-483f-b6cf-be5722b24b82 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:36.216475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c57c885b-5034-483f-b6cf-be5722b24b82 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:36.216706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c57c885b-5034-483f-b6cf-be5722b24b82 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:36.259691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d9a58786-6430-4983-8bb4-a672bc01763f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:36.270126 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d9a58786-6430-4983-8bb4-a672bc01763f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.709618 Jul 28 03:51:36.273659 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1853/3337] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:35 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:36.282334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19728fc2-f73e-4e5e-bee0-0173f4d21900 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:36.284752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-19728fc2-f73e-4e5e-bee0-0173f4d21900 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:36.296840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19728fc2-f73e-4e5e-bee0-0173f4d21900 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:36.298928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19728fc2-f73e-4e5e-bee0-0173f4d21900 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:36.299902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19728fc2-f73e-4e5e-bee0-0173f4d21900 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:36.300561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19728fc2-f73e-4e5e-bee0-0173f4d21900 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:36.321957 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-c57c885b-5034-483f-b6cf-be5722b24b82 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:51:36.409961 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c57c885b-5034-483f-b6cf-be5722b24b82 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:36.417751 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c57c885b-5034-483f-b6cf-be5722b24b82 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:36.418198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c57c885b-5034-483f-b6cf-be5722b24b82 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:36.586951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19728fc2-f73e-4e5e-bee0-0173f4d21900 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:36.596393 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-19728fc2-f73e-4e5e-bee0-0173f4d21900 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1501 microversion: 2.1 time: 0.319413 Jul 28 03:51:36.596984 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1854/3338] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:36 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1501 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:36.618674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5848e1fb-f703-47ba-86f6-7ea5356999e6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:36.619567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5848e1fb-f703-47ba-86f6-7ea5356999e6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:36.626894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5848e1fb-f703-47ba-86f6-7ea5356999e6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:36.627622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5848e1fb-f703-47ba-86f6-7ea5356999e6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:36.628632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5848e1fb-f703-47ba-86f6-7ea5356999e6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:36.629076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5848e1fb-f703-47ba-86f6-7ea5356999e6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:36.652982 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c57c885b-5034-483f-b6cf-be5722b24b82 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1651517927" status: 200 len: 1515 microversion: 2.1 time: 0.462244 Jul 28 03:51:36.659388 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1485/3339] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:51:36 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1651517927 => generated 1515 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:36.659388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9db05599-b325-4cc6-855e-0c5bf58c3b2c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:36.661549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9db05599-b325-4cc6-855e-0c5bf58c3b2c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:36.667806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9db05599-b325-4cc6-855e-0c5bf58c3b2c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:36.668261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9db05599-b325-4cc6-855e-0c5bf58c3b2c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:36.669094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9db05599-b325-4cc6-855e-0c5bf58c3b2c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:36.669534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9db05599-b325-4cc6-855e-0c5bf58c3b2c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:36.696727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-9db05599-b325-4cc6-855e-0c5bf58c3b2c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lazy-loading 'flavor' on Instance uuid 1779e378-a42a-40cb-9037-1ee317601146 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:51:36.730918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:36.732952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=32 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:36.806554 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9db05599-b325-4cc6-855e-0c5bf58c3b2c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "POST /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146/action" status: 200 len: 32 microversion: 2.1 time: 0.150730 Jul 28 03:51:36.808026 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1486/3340] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:51:36 2022] POST /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:51:36.817125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e5280ed5-db7e-41b5-a7b4-c7b8f10c7b9f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:36.823217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e5280ed5-db7e-41b5-a7b4-c7b8f10c7b9f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:36.824147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e5280ed5-db7e-41b5-a7b4-c7b8f10c7b9f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:51:36.835021 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5280ed5-db7e-41b5-a7b4-c7b8f10c7b9f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:36.835762 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5280ed5-db7e-41b5-a7b4-c7b8f10c7b9f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:36.838706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5280ed5-db7e-41b5-a7b4-c7b8f10c7b9f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:36.838706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5280ed5-db7e-41b5-a7b4-c7b8f10c7b9f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:36.886272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5848e1fb-f703-47ba-86f6-7ea5356999e6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:36.902037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5848e1fb-f703-47ba-86f6-7ea5356999e6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:36.903600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5848e1fb-f703-47ba-86f6-7ea5356999e6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:36.907827 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5848e1fb-f703-47ba-86f6-7ea5356999e6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1407 microversion: 2.20 time: 0.293110 Jul 28 03:51:36.909672 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1855/3341] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:51:36 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:36.915618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b76d52fa-64ca-41af-9470-ed2a00771f35 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:36.916583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b76d52fa-64ca-41af-9470-ed2a00771f35 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:36.926254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b76d52fa-64ca-41af-9470-ed2a00771f35 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:36.927429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b76d52fa-64ca-41af-9470-ed2a00771f35 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:36.928805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b76d52fa-64ca-41af-9470-ed2a00771f35 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:36.929842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b76d52fa-64ca-41af-9470-ed2a00771f35 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:36.966362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-e5280ed5-db7e-41b5-a7b4-c7b8f10c7b9f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:51:37.052440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e5280ed5-db7e-41b5-a7b4-c7b8f10c7b9f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:37.064074 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5280ed5-db7e-41b5-a7b4-c7b8f10c7b9f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:37.064566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5280ed5-db7e-41b5-a7b4-c7b8f10c7b9f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:37.213077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b76d52fa-64ca-41af-9470-ed2a00771f35 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:37.242321 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b76d52fa-64ca-41af-9470-ed2a00771f35 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.330180 Jul 28 03:51:37.244128 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1856/3342] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:36 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:37.251291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2a389847-72a4-405a-8088-522ea068e5c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:37.252897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2a389847-72a4-405a-8088-522ea068e5c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:37.260684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a389847-72a4-405a-8088-522ea068e5c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:37.261655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a389847-72a4-405a-8088-522ea068e5c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:37.262717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a389847-72a4-405a-8088-522ea068e5c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:37.263849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a389847-72a4-405a-8088-522ea068e5c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:37.545611 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e5280ed5-db7e-41b5-a7b4-c7b8f10c7b9f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.735193 Jul 28 03:51:37.547188 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1487/3343] 10.222.0.48 () {58 vars in 1173 bytes} [Thu Jul 28 03:51:36 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:37.556392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d1218973-f7e1-49b2-88f8-31f634e3293e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:37.558083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d1218973-f7e1-49b2-88f8-31f634e3293e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:37.572427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d1218973-f7e1-49b2-88f8-31f634e3293e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:37.574064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d1218973-f7e1-49b2-88f8-31f634e3293e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:37.576508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d1218973-f7e1-49b2-88f8-31f634e3293e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:37.577637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d1218973-f7e1-49b2-88f8-31f634e3293e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:37.726923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2a389847-72a4-405a-8088-522ea068e5c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:37.731469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:37.742698 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2a389847-72a4-405a-8088-522ea068e5c2 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1474 microversion: 2.1 time: 0.496279 Jul 28 03:51:37.745100 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1857/3344] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:37 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1474 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:37.754838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-293e407d-f2e6-4ab0-82a9-507d7a55ad40 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:37.756297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-293e407d-f2e6-4ab0-82a9-507d7a55ad40 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:37.765115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-293e407d-f2e6-4ab0-82a9-507d7a55ad40 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:37.765768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-293e407d-f2e6-4ab0-82a9-507d7a55ad40 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:37.766734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-293e407d-f2e6-4ab0-82a9-507d7a55ad40 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:37.766982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-293e407d-f2e6-4ab0-82a9-507d7a55ad40 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:37.789843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d1218973-f7e1-49b2-88f8-31f634e3293e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95da7dd0ca314d3fa4b630ff50fadf61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4337b4b2c44fa99ab41728c08e3954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:37.819548 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d1218973-f7e1-49b2-88f8-31f634e3293e tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 200 len: 1253 microversion: 2.1 time: 0.270628 Jul 28 03:51:37.820689 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1488/3345] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:37 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 1253 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:37.827482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7f1c93de-790d-414a-8dea-052b9d5e7dfd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:37.834182 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7f1c93de-790d-414a-8dea-052b9d5e7dfd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:37.835223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.compute.servers [None req-7f1c93de-790d-414a-8dea-052b9d5e7dfd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Removing options 'limit' from query {{(pid=126072) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 28 03:51:37.836081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7f1c93de-790d-414a-8dea-052b9d5e7dfd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:51:37.845861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f1c93de-790d-414a-8dea-052b9d5e7dfd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:37.846571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f1c93de-790d-414a-8dea-052b9d5e7dfd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:37.849606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f1c93de-790d-414a-8dea-052b9d5e7dfd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:37.850071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f1c93de-790d-414a-8dea-052b9d5e7dfd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:37.944963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7f1c93de-790d-414a-8dea-052b9d5e7dfd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:37.964878 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f1c93de-790d-414a-8dea-052b9d5e7dfd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:37.966951 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f1c93de-790d-414a-8dea-052b9d5e7dfd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:38.140670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-293e407d-f2e6-4ab0-82a9-507d7a55ad40 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:38.161325 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-293e407d-f2e6-4ab0-82a9-507d7a55ad40 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.413848 Jul 28 03:51:38.163093 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1858/3346] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:37 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:38.172279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-cb2e451e-aff3-42b9-9cc6-7a6ebb4d8c93 req-3a807ef2-679e-4f18-b4f8-ee2bed3d105e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d0126e-11bf-4048-9e35-7309c228b534", "tag": "f15c48dd-54c1-4291-88c3-ac0923fa48e7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:38.189963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cb2e451e-aff3-42b9-9cc6-7a6ebb4d8c93 req-3a807ef2-679e-4f18-b4f8-ee2bed3d105e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:38.191064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cb2e451e-aff3-42b9-9cc6-7a6ebb4d8c93 req-3a807ef2-679e-4f18-b4f8-ee2bed3d105e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:38.213743 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-cb2e451e-aff3-42b9-9cc6-7a6ebb4d8c93 req-3a807ef2-679e-4f18-b4f8-ee2bed3d105e service nova] Creating event network-changed:f15c48dd-54c1-4291-88c3-ac0923fa48e7 for instance 99d0126e-11bf-4048-9e35-7309c228b534 on n-h2-826756-3 Jul 28 03:51:38.225668 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-cb2e451e-aff3-42b9-9cc6-7a6ebb4d8c93 req-3a807ef2-679e-4f18-b4f8-ee2bed3d105e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060048 Jul 28 03:51:38.227653 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1859/3347] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:38.238882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a7d7aff-6334-411a-8fe6-2fb578458a44 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:38.240584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9a7d7aff-6334-411a-8fe6-2fb578458a44 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:38.253727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a7d7aff-6334-411a-8fe6-2fb578458a44 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:38.254915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a7d7aff-6334-411a-8fe6-2fb578458a44 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:38.256848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a7d7aff-6334-411a-8fe6-2fb578458a44 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:38.258362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a7d7aff-6334-411a-8fe6-2fb578458a44 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:38.512639 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7f1c93de-790d-414a-8dea-052b9d5e7dfd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.690086 Jul 28 03:51:38.530380 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1489/3348] 10.222.0.48 () {58 vars in 1161 bytes} [Thu Jul 28 03:51:37 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:38.546060 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7cf6831a-ad9f-4555-8364-7523ea7daa93 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:38.549536 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7cf6831a-ad9f-4555-8364-7523ea7daa93 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:38.570296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cf6831a-ad9f-4555-8364-7523ea7daa93 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:38.573344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cf6831a-ad9f-4555-8364-7523ea7daa93 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:38.578642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cf6831a-ad9f-4555-8364-7523ea7daa93 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:38.578642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cf6831a-ad9f-4555-8364-7523ea7daa93 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:38.630015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9a7d7aff-6334-411a-8fe6-2fb578458a44 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:38.645392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9a7d7aff-6334-411a-8fe6-2fb578458a44 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:38.646778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9a7d7aff-6334-411a-8fe6-2fb578458a44 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:38.652810 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9a7d7aff-6334-411a-8fe6-2fb578458a44 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1407 microversion: 2.20 time: 0.423025 Jul 28 03:51:38.655522 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1860/3349] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:51:38 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1407 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:38.670642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-96607c1a-d151-4b71-b70d-21638fd49d4a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:38.678921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-96607c1a-d151-4b71-b70d-21638fd49d4a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:38.679757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-96607c1a-d151-4b71-b70d-21638fd49d4a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:51:38.696231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96607c1a-d151-4b71-b70d-21638fd49d4a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:38.697038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96607c1a-d151-4b71-b70d-21638fd49d4a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:38.698379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96607c1a-d151-4b71-b70d-21638fd49d4a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:38.699163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96607c1a-d151-4b71-b70d-21638fd49d4a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:38.865825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-96607c1a-d151-4b71-b70d-21638fd49d4a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:51:39.011563 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-96607c1a-d151-4b71-b70d-21638fd49d4a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.354871 Jul 28 03:51:39.024761 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1861/3350] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:51:38 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:39.024761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-39db8049-8476-4730-b99b-ba0cc8140649 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:39.024761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-39db8049-8476-4730-b99b-ba0cc8140649 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:39.031634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39db8049-8476-4730-b99b-ba0cc8140649 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:39.032126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39db8049-8476-4730-b99b-ba0cc8140649 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:39.034006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39db8049-8476-4730-b99b-ba0cc8140649 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:39.034468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39db8049-8476-4730-b99b-ba0cc8140649 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:39.328840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-39db8049-8476-4730-b99b-ba0cc8140649 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:39.345410 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-39db8049-8476-4730-b99b-ba0cc8140649 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1471 microversion: 2.1 time: 0.329163 Jul 28 03:51:39.346018 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1862/3351] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:39 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1471 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:39.358480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-beb976d6-8d39-45dc-bc8f-246fc1cd5369 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:39.359119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-beb976d6-8d39-45dc-bc8f-246fc1cd5369 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] [instance: f57a0500-5de5-48e7-bc4e-c25234ca8fa6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:39.373769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-beb976d6-8d39-45dc-bc8f-246fc1cd5369 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:39.376737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-beb976d6-8d39-45dc-bc8f-246fc1cd5369 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:39.379204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-beb976d6-8d39-45dc-bc8f-246fc1cd5369 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:39.379720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-beb976d6-8d39-45dc-bc8f-246fc1cd5369 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:39.413753 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-beb976d6-8d39-45dc-bc8f-246fc1cd5369 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] HTTP exception thrown: Instance f57a0500-5de5-48e7-bc4e-c25234ca8fa6 could not be found. Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-beb976d6-8d39-45dc-bc8f-246fc1cd5369 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Request method failure captured: Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 HTTP/1.1 Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gcstLPxKE27gFnXK1Sma7PzuiNTc3KujtD9WOaEq77XId0Jh5oU_NnM3uXK7onmJHkcBk7bOoYaXlMYSk6x-Imc5h3GGC0Vvtfloyz4lTxj8rK1JuUrdztUgvpqqHwFxlre4G5qXqjsaA84zUThOzzT_WaOq4B7FO_1pV2HN24WA_4 Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 2d4337b4b2c44fa99ab41728c08e3954 Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestBootFromVolume-1768485068 Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2d4337b4b2c44fa99ab41728c08e3954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2d4337b4b2c44fa99ab41728c08e3954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2d4337b4b2c44fa99ab41728c08e3954"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2d4337b4b2c44fa99ab41728c08e3954"}]}] Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestBootFromVolume-1768485068 Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 2d4337b4b2c44fa99ab41728c08e3954 Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1768485068 Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestBootFromVolume-1768485068-project Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 95da7dd0ca314d3fa4b630ff50fadf61 Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestBootFromVolume-1768485068-project Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance f57a0500-5de5-48e7-bc4e-c25234ca8fa6 could not be found. Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'f57a0500-5de5-48e7-bc4e-c25234ca8fa6'} Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f57a0500-5de5-48e7-bc4e-c25234ca8fa6 could not be found. Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f57a0500-5de5-48e7-bc4e-c25234ca8fa6 could not be found. Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:39.415574 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:51:39.419918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:39.419918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:39.419918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:39.419918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:51:39.419918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:51:39.419918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f57a0500-5de5-48e7-bc4e-c25234ca8fa6 could not be found. Jul 28 03:51:39.419918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:51:39.419918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-beb976d6-8d39-45dc-bc8f-246fc1cd5369 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Returning 404 to user: Instance f57a0500-5de5-48e7-bc4e-c25234ca8fa6 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:51:39.419918 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-beb976d6-8d39-45dc-bc8f-246fc1cd5369 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6" status: 404 len: 111 microversion: 2.1 time: 0.069312 Jul 28 03:51:39.419918 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1863/3352] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:39 2022] GET /compute/v2.1/servers/f57a0500-5de5-48e7-bc4e-c25234ca8fa6 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:51:39.441146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1726dfdd-5d3b-4be5-a41a-7409d6df61ff tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:39.447028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1726dfdd-5d3b-4be5-a41a-7409d6df61ff tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:39.448319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.compute.servers [None req-1726dfdd-5d3b-4be5-a41a-7409d6df61ff tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Removing options 'limit' from query {{(pid=126071) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 28 03:51:39.448677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1726dfdd-5d3b-4be5-a41a-7409d6df61ff tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:51:39.463887 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7cf6831a-ad9f-4555-8364-7523ea7daa93 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:39.472082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1726dfdd-5d3b-4be5-a41a-7409d6df61ff tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:39.473280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1726dfdd-5d3b-4be5-a41a-7409d6df61ff tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:39.476585 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7cf6831a-ad9f-4555-8364-7523ea7daa93 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.949891 Jul 28 03:51:39.483120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1726dfdd-5d3b-4be5-a41a-7409d6df61ff tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:39.483687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1726dfdd-5d3b-4be5-a41a-7409d6df61ff tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:39.495510 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1490/3353] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:38 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:39.511654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4ed57b03-9946-493e-8b28-96843e183a50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:39.512280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4ed57b03-9946-493e-8b28-96843e183a50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:39.522636 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ed57b03-9946-493e-8b28-96843e183a50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:39.527793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ed57b03-9946-493e-8b28-96843e183a50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:39.529092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ed57b03-9946-493e-8b28-96843e183a50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:39.529670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ed57b03-9946-493e-8b28-96843e183a50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:39.537454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-1726dfdd-5d3b-4be5-a41a-7409d6df61ff tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:51:39.608551 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1726dfdd-5d3b-4be5-a41a-7409d6df61ff tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.179202 Jul 28 03:51:39.615948 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1864/3354] 10.222.0.48 () {58 vars in 1150 bytes} [Thu Jul 28 03:51:39 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:39.615948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c1689da9-54fe-4402-8109-e6f661c5a6c6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:39.615948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c1689da9-54fe-4402-8109-e6f661c5a6c6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:39.635287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1689da9-54fe-4402-8109-e6f661c5a6c6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:39.635844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1689da9-54fe-4402-8109-e6f661c5a6c6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:39.641812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1689da9-54fe-4402-8109-e6f661c5a6c6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:39.642634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1689da9-54fe-4402-8109-e6f661c5a6c6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:39.895568 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c1689da9-54fe-4402-8109-e6f661c5a6c6 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "POST /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1/action" status: 202 len: 0 microversion: 2.1 time: 0.284281 Jul 28 03:51:39.897027 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1865/3355] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:51:39 2022] POST /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:51:39.909509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-50e85228-02c1-40a3-ba83-9ca757bee6d2 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] Calling method '.version_select at 0x7ffa67aa4430>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:39.956681 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-50e85228-02c1-40a3-ba83-9ca757bee6d2 tempest-ServersTestBootFromVolume-1768485068 tempest-ServersTestBootFromVolume-1768485068-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1573393649" status: 202 len: 0 microversion: 2.1 time: 0.056900 Jul 28 03:51:39.957202 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1866/3356] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 03:51:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1573393649 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:51:39.964878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ad0705d-6133-49f4-b170-93573b3fa779 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:39.974167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2ad0705d-6133-49f4-b170-93573b3fa779 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:39.975577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ad0705d-6133-49f4-b170-93573b3fa779 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:51:39.988266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ad0705d-6133-49f4-b170-93573b3fa779 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:39.989262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ad0705d-6133-49f4-b170-93573b3fa779 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:39.990902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ad0705d-6133-49f4-b170-93573b3fa779 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:39.991644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ad0705d-6133-49f4-b170-93573b3fa779 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:40.060289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-2ad0705d-6133-49f4-b170-93573b3fa779 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:51:40.074540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4ed57b03-9946-493e-8b28-96843e183a50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:40.085836 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4ed57b03-9946-493e-8b28-96843e183a50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.589087 Jul 28 03:51:40.089752 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1491/3357] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:39 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:40.105976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f47b70d9-5b36-4170-8c8e-e60f457921c6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:40.106975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f47b70d9-5b36-4170-8c8e-e60f457921c6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:40.115101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f47b70d9-5b36-4170-8c8e-e60f457921c6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:40.119370 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ad0705d-6133-49f4-b170-93573b3fa779 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.160933 Jul 28 03:51:40.120311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f47b70d9-5b36-4170-8c8e-e60f457921c6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:40.121409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f47b70d9-5b36-4170-8c8e-e60f457921c6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:40.122077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f47b70d9-5b36-4170-8c8e-e60f457921c6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:40.134314 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1867/3358] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 03:51:39 2022] GET /compute/v2.1/servers => generated 1009 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:40.150162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f9204230-b724-4d81-acf4-8ff2bd3fabb0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:40.151308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f9204230-b724-4d81-acf4-8ff2bd3fabb0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:40.167074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9204230-b724-4d81-acf4-8ff2bd3fabb0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:40.167798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9204230-b724-4d81-acf4-8ff2bd3fabb0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:40.172555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9204230-b724-4d81-acf4-8ff2bd3fabb0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:40.173359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9204230-b724-4d81-acf4-8ff2bd3fabb0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:40.436622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f9204230-b724-4d81-acf4-8ff2bd3fabb0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:40.449524 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f9204230-b724-4d81-acf4-8ff2bd3fabb0 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1470 microversion: 2.1 time: 0.313492 Jul 28 03:51:40.450125 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1868/3359] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:40 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1470 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:40.471992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0d3d6758-aaeb-469e-9332-46ed7cb346b4 req-3b89ca8e-d199-41bd-a466-cac4ec2922bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dca550f-8f08-4f26-a922-b8b222db43a1", "name": "network-vif-plugged", "status": "completed", "tag": "4dce8ccd-5f8a-4b35-a9d0-946725622ad1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:40.486576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0d3d6758-aaeb-469e-9332-46ed7cb346b4 req-3b89ca8e-d199-41bd-a466-cac4ec2922bb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:40.487059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0d3d6758-aaeb-469e-9332-46ed7cb346b4 req-3b89ca8e-d199-41bd-a466-cac4ec2922bb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:40.509873 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0d3d6758-aaeb-469e-9332-46ed7cb346b4 req-3b89ca8e-d199-41bd-a466-cac4ec2922bb service nova] Creating event network-vif-plugged:4dce8ccd-5f8a-4b35-a9d0-946725622ad1 for instance 1dca550f-8f08-4f26-a922-b8b222db43a1 on n-h1-826756-3 Jul 28 03:51:40.531542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-0d3d6758-aaeb-469e-9332-46ed7cb346b4 req-3b89ca8e-d199-41bd-a466-cac4ec2922bb service nova] Instance 1dca550f-8f08-4f26-a922-b8b222db43a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:51:40.549245 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0d3d6758-aaeb-469e-9332-46ed7cb346b4 req-3b89ca8e-d199-41bd-a466-cac4ec2922bb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087157 Jul 28 03:51:40.550314 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1869/3360] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:40.557581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-be4a1582-dc0c-4445-88c4-6711618509b6 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:40.565157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be4a1582-dc0c-4445-88c4-6711618509b6 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:40.567329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-be4a1582-dc0c-4445-88c4-6711618509b6 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:51:40.586194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be4a1582-dc0c-4445-88c4-6711618509b6 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:40.586633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be4a1582-dc0c-4445-88c4-6711618509b6 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:40.587459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be4a1582-dc0c-4445-88c4-6711618509b6 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:40.587895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be4a1582-dc0c-4445-88c4-6711618509b6 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:40.591673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f47b70d9-5b36-4170-8c8e-e60f457921c6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:40.619092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f47b70d9-5b36-4170-8c8e-e60f457921c6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:40.621334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f47b70d9-5b36-4170-8c8e-e60f457921c6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:40.622780 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f47b70d9-5b36-4170-8c8e-e60f457921c6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1407 microversion: 2.20 time: 0.531672 Jul 28 03:51:40.623369 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1492/3361] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:51:40 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1407 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:40.628215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d1fde414-f809-4935-9614-13b7cf4dbb70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:40.637711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d1fde414-f809-4935-9614-13b7cf4dbb70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:40.650414 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d1fde414-f809-4935-9614-13b7cf4dbb70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:40.650878 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d1fde414-f809-4935-9614-13b7cf4dbb70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:40.651737 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d1fde414-f809-4935-9614-13b7cf4dbb70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:40.652238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d1fde414-f809-4935-9614-13b7cf4dbb70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:40.757313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-be4a1582-dc0c-4445-88c4-6711618509b6 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:51:40.840606 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-be4a1582-dc0c-4445-88c4-6711618509b6 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 344 microversion: 2.1 time: 0.288918 Jul 28 03:51:40.850753 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1870/3362] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:51:40 2022] GET /compute/v2.1/servers?flavor=451 => generated 344 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:40.856197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6028a801-cbbf-4ed2-8fac-2e8445a6955f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:40.862623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6028a801-cbbf-4ed2-8fac-2e8445a6955f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:40.864035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.compute.servers [None req-6028a801-cbbf-4ed2-8fac-2e8445a6955f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Removing options 'limit' from query {{(pid=126071) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 28 03:51:40.864035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6028a801-cbbf-4ed2-8fac-2e8445a6955f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:51:40.872814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6028a801-cbbf-4ed2-8fac-2e8445a6955f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:40.872814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6028a801-cbbf-4ed2-8fac-2e8445a6955f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:40.873906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6028a801-cbbf-4ed2-8fac-2e8445a6955f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:40.874408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6028a801-cbbf-4ed2-8fac-2e8445a6955f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:40.913555 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6028a801-cbbf-4ed2-8fac-2e8445a6955f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=1" status: 200 len: 483 microversion: 2.1 time: 0.061249 Jul 28 03:51:40.923248 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1871/3363] 10.222.0.48 () {58 vars in 1140 bytes} [Thu Jul 28 03:51:40 2022] GET /compute/v2.1/servers?limit=1 => generated 483 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:40.928743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-babab563-dbcd-46c9-84a2-b5ba74bef0e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:40.934726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-babab563-dbcd-46c9-84a2-b5ba74bef0e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:40.935307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-babab563-dbcd-46c9-84a2-b5ba74bef0e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1651517927', 'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:51:40.941489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-babab563-dbcd-46c9-84a2-b5ba74bef0e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:40.941931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-babab563-dbcd-46c9-84a2-b5ba74bef0e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:40.942710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-babab563-dbcd-46c9-84a2-b5ba74bef0e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:40.943748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-babab563-dbcd-46c9-84a2-b5ba74bef0e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:41.049106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-babab563-dbcd-46c9-84a2-b5ba74bef0e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:51:41.060537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d1fde414-f809-4935-9614-13b7cf4dbb70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:41.071307 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d1fde414-f809-4935-9614-13b7cf4dbb70 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.446290 Jul 28 03:51:41.085169 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1493/3364] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:40 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:41.115080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-89a9f6a2-54a8-4bba-a236-790dc93b9f5a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:41.116494 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-89a9f6a2-54a8-4bba-a236-790dc93b9f5a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:41.125599 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-89a9f6a2-54a8-4bba-a236-790dc93b9f5a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:41.126350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-89a9f6a2-54a8-4bba-a236-790dc93b9f5a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:41.127304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-89a9f6a2-54a8-4bba-a236-790dc93b9f5a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:41.128160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-89a9f6a2-54a8-4bba-a236-790dc93b9f5a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:41.162749 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-babab563-dbcd-46c9-84a2-b5ba74bef0e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1651517927" status: 200 len: 346 microversion: 2.1 time: 0.238042 Jul 28 03:51:41.177215 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1872/3365] 10.222.0.48 () {58 vars in 1242 bytes} [Thu Jul 28 03:51:40 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1651517927 => generated 346 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:41.185162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c27a226-680e-41cf-9ecb-607fcb06a672 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:41.192442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c27a226-680e-41cf-9ecb-607fcb06a672 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:41.192907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c27a226-680e-41cf-9ecb-607fcb06a672 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:41.235653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c27a226-680e-41cf-9ecb-607fcb06a672 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Going to try to stop instance {{(pid=126071) force_stop /opt/stack/nova/nova/compute/api.py:2753}} Jul 28 03:51:41.261457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:41.313562 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c27a226-680e-41cf-9ecb-607fcb06a672 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "POST /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4/action" status: 202 len: 0 microversion: 2.1 time: 0.133436 Jul 28 03:51:41.315401 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1873/3366] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:51:41 2022] POST /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:51:41.351304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4cf31975-326c-4e27-8475-16961dc101f5 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:41.360777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4cf31975-326c-4e27-8475-16961dc101f5 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:41.374187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cf31975-326c-4e27-8475-16961dc101f5 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:41.374819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cf31975-326c-4e27-8475-16961dc101f5 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:41.377255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cf31975-326c-4e27-8475-16961dc101f5 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:41.377848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cf31975-326c-4e27-8475-16961dc101f5 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:41.482408 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-89a9f6a2-54a8-4bba-a236-790dc93b9f5a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:41.504580 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-89a9f6a2-54a8-4bba-a236-790dc93b9f5a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.395371 Jul 28 03:51:41.513166 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1494/3367] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:41 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:41.520264 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-86f5d277-6daf-4014-88c6-420409661216 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:41.521179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-86f5d277-6daf-4014-88c6-420409661216 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:41.539192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:41.555688 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86f5d277-6daf-4014-88c6-420409661216 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:41.556137 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86f5d277-6daf-4014-88c6-420409661216 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:41.557579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86f5d277-6daf-4014-88c6-420409661216 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:41.558020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86f5d277-6daf-4014-88c6-420409661216 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:41.768081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-86f5d277-6daf-4014-88c6-420409661216 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:41.785117 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-86f5d277-6daf-4014-88c6-420409661216 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1470 microversion: 2.1 time: 0.276539 Jul 28 03:51:41.786449 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1495/3368] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:41 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1470 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:41.793193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1e5bd6f0-6d79-4ab0-bb61-57503c20939b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:41.794071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1e5bd6f0-6d79-4ab0-bb61-57503c20939b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:41.803338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e5bd6f0-6d79-4ab0-bb61-57503c20939b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:41.804098 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e5bd6f0-6d79-4ab0-bb61-57503c20939b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:41.806205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e5bd6f0-6d79-4ab0-bb61-57503c20939b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:41.806998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e5bd6f0-6d79-4ab0-bb61-57503c20939b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:41.835561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4cf31975-326c-4e27-8475-16961dc101f5 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:41.856928 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4cf31975-326c-4e27-8475-16961dc101f5 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1522 microversion: 2.1 time: 0.536505 Jul 28 03:51:41.872464 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1874/3369] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:41 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1522 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:42.008211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1e5bd6f0-6d79-4ab0-bb61-57503c20939b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:42.017380 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1e5bd6f0-6d79-4ab0-bb61-57503c20939b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:42.019058 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1e5bd6f0-6d79-4ab0-bb61-57503c20939b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:42.020662 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1e5bd6f0-6d79-4ab0-bb61-57503c20939b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1407 microversion: 2.20 time: 0.233019 Jul 28 03:51:42.034301 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1496/3370] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:51:41 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:42.119822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ebb84eaf-2279-4925-80cf-9c56a370463c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:42.121068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ebb84eaf-2279-4925-80cf-9c56a370463c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:42.129501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebb84eaf-2279-4925-80cf-9c56a370463c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:42.129963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebb84eaf-2279-4925-80cf-9c56a370463c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:42.131153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebb84eaf-2279-4925-80cf-9c56a370463c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:42.132575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebb84eaf-2279-4925-80cf-9c56a370463c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:42.427270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ebb84eaf-2279-4925-80cf-9c56a370463c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:42.436698 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ebb84eaf-2279-4925-80cf-9c56a370463c tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.324343 Jul 28 03:51:42.437748 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1875/3371] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:42 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:42.528546 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-54095258-1cfe-4ef6-a839-29ed794e78eb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:42.529385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-54095258-1cfe-4ef6-a839-29ed794e78eb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:42.544821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-54095258-1cfe-4ef6-a839-29ed794e78eb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:42.547077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-54095258-1cfe-4ef6-a839-29ed794e78eb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:42.549632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-54095258-1cfe-4ef6-a839-29ed794e78eb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:42.550578 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-54095258-1cfe-4ef6-a839-29ed794e78eb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:42.575285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0a4635b7-ec7c-4eda-b969-518ea6e7fa55 req-9a7414a9-8977-4139-866d-c447f9bcbf8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d0126e-11bf-4048-9e35-7309c228b534", "name": "network-vif-plugged", "status": "completed", "tag": "f15c48dd-54c1-4291-88c3-ac0923fa48e7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:42.607525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0a4635b7-ec7c-4eda-b969-518ea6e7fa55 req-9a7414a9-8977-4139-866d-c447f9bcbf8a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:42.608273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0a4635b7-ec7c-4eda-b969-518ea6e7fa55 req-9a7414a9-8977-4139-866d-c447f9bcbf8a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:42.648953 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0a4635b7-ec7c-4eda-b969-518ea6e7fa55 req-9a7414a9-8977-4139-866d-c447f9bcbf8a service nova] Creating event network-vif-plugged:f15c48dd-54c1-4291-88c3-ac0923fa48e7 for instance 99d0126e-11bf-4048-9e35-7309c228b534 on n-h2-826756-3 Jul 28 03:51:42.659845 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0a4635b7-ec7c-4eda-b969-518ea6e7fa55 req-9a7414a9-8977-4139-866d-c447f9bcbf8a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089760 Jul 28 03:51:42.662078 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1876/3372] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:51:42.811234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-751ea080-2c9b-4fae-962c-2c6ff42df2ec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:42.812227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-751ea080-2c9b-4fae-962c-2c6ff42df2ec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:42.822400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-751ea080-2c9b-4fae-962c-2c6ff42df2ec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:42.823231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-751ea080-2c9b-4fae-962c-2c6ff42df2ec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:42.823989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-751ea080-2c9b-4fae-962c-2c6ff42df2ec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:42.824837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-751ea080-2c9b-4fae-962c-2c6ff42df2ec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:42.976919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-54095258-1cfe-4ef6-a839-29ed794e78eb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:42.997279 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-54095258-1cfe-4ef6-a839-29ed794e78eb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.474072 Jul 28 03:51:43.014023 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1497/3373] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:42 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:43.019467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b5c93cbf-da3b-489c-80f2-9a8d317df337 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:43.020408 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b5c93cbf-da3b-489c-80f2-9a8d317df337 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:43.028424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5c93cbf-da3b-489c-80f2-9a8d317df337 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:43.029208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5c93cbf-da3b-489c-80f2-9a8d317df337 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:43.030220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5c93cbf-da3b-489c-80f2-9a8d317df337 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:43.031359 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5c93cbf-da3b-489c-80f2-9a8d317df337 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:43.201875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-751ea080-2c9b-4fae-962c-2c6ff42df2ec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:43.214440 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-751ea080-2c9b-4fae-962c-2c6ff42df2ec tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1470 microversion: 2.1 time: 0.410535 Jul 28 03:51:43.228864 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1877/3374] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:42 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1470 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:43.240732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-16e4b171-b9ad-46dc-b116-fd6a8b2e098c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:43.241685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-16e4b171-b9ad-46dc-b116-fd6a8b2e098c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:43.250458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16e4b171-b9ad-46dc-b116-fd6a8b2e098c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:43.250921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16e4b171-b9ad-46dc-b116-fd6a8b2e098c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:43.251845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16e4b171-b9ad-46dc-b116-fd6a8b2e098c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:43.252222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16e4b171-b9ad-46dc-b116-fd6a8b2e098c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:43.369413 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b5c93cbf-da3b-489c-80f2-9a8d317df337 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:43.379931 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b5c93cbf-da3b-489c-80f2-9a8d317df337 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1522 microversion: 2.1 time: 0.364092 Jul 28 03:51:43.381586 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1498/3375] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:43 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:43.459538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e6bccb98-e7e9-41e0-bb41-9fa11fcfdc05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:43.460073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e6bccb98-e7e9-41e0-bb41-9fa11fcfdc05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:43.466969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6bccb98-e7e9-41e0-bb41-9fa11fcfdc05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:43.467442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6bccb98-e7e9-41e0-bb41-9fa11fcfdc05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:43.468214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6bccb98-e7e9-41e0-bb41-9fa11fcfdc05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:43.469365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6bccb98-e7e9-41e0-bb41-9fa11fcfdc05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:43.524040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-16e4b171-b9ad-46dc-b116-fd6a8b2e098c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:43.534072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-16e4b171-b9ad-46dc-b116-fd6a8b2e098c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:43.536168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-16e4b171-b9ad-46dc-b116-fd6a8b2e098c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:43.537525 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-16e4b171-b9ad-46dc-b116-fd6a8b2e098c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1407 microversion: 2.20 time: 0.307539 Jul 28 03:51:43.538748 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1878/3376] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:51:43 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:43.836515 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e6bccb98-e7e9-41e0-bb41-9fa11fcfdc05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:43.845267 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e6bccb98-e7e9-41e0-bb41-9fa11fcfdc05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.389704 Jul 28 03:51:43.846329 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1499/3377] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:43 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:44.022709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0585306b-8b79-4d7f-9e24-12e08a9effc9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:44.030029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0585306b-8b79-4d7f-9e24-12e08a9effc9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:44.045350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0585306b-8b79-4d7f-9e24-12e08a9effc9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:44.049590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0585306b-8b79-4d7f-9e24-12e08a9effc9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:44.051340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0585306b-8b79-4d7f-9e24-12e08a9effc9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:44.051989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0585306b-8b79-4d7f-9e24-12e08a9effc9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:44.246205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-abd34ab7-a0ca-4632-9af7-d17ab26170c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:44.247627 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-abd34ab7-a0ca-4632-9af7-d17ab26170c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:44.255774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abd34ab7-a0ca-4632-9af7-d17ab26170c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:44.256575 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abd34ab7-a0ca-4632-9af7-d17ab26170c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:44.257773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abd34ab7-a0ca-4632-9af7-d17ab26170c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:44.258377 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abd34ab7-a0ca-4632-9af7-d17ab26170c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:44.430970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0585306b-8b79-4d7f-9e24-12e08a9effc9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:44.442142 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0585306b-8b79-4d7f-9e24-12e08a9effc9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.425961 Jul 28 03:51:44.442766 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1879/3378] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:44 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:44.454604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3a1d74a-f390-4d35-9da4-cfd4d3c81dd8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:44.455233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d3a1d74a-f390-4d35-9da4-cfd4d3c81dd8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:44.463446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3a1d74a-f390-4d35-9da4-cfd4d3c81dd8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:44.464425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3a1d74a-f390-4d35-9da4-cfd4d3c81dd8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:44.465698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3a1d74a-f390-4d35-9da4-cfd4d3c81dd8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:44.466251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3a1d74a-f390-4d35-9da4-cfd4d3c81dd8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:44.666284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-abd34ab7-a0ca-4632-9af7-d17ab26170c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:44.678082 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-abd34ab7-a0ca-4632-9af7-d17ab26170c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1470 microversion: 2.1 time: 0.437084 Jul 28 03:51:44.690843 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1500/3379] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:44 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1470 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:44.690843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3d2f1307-f150-4296-b83f-c942d9e9d63c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:44.690843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3d2f1307-f150-4296-b83f-c942d9e9d63c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:44.693094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3d2f1307-f150-4296-b83f-c942d9e9d63c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:44.693774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3d2f1307-f150-4296-b83f-c942d9e9d63c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:44.694754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3d2f1307-f150-4296-b83f-c942d9e9d63c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:44.695421 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3d2f1307-f150-4296-b83f-c942d9e9d63c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:44.791904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d3a1d74a-f390-4d35-9da4-cfd4d3c81dd8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:44.801994 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d3a1d74a-f390-4d35-9da4-cfd4d3c81dd8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1522 microversion: 2.1 time: 0.358141 Jul 28 03:51:44.802905 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1880/3380] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:44 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:44.868938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-db1c76e4-9f10-41b4-9c14-b32d9a3cc860 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:44.869539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-db1c76e4-9f10-41b4-9c14-b32d9a3cc860 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:44.876589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db1c76e4-9f10-41b4-9c14-b32d9a3cc860 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:44.877727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db1c76e4-9f10-41b4-9c14-b32d9a3cc860 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:44.878557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db1c76e4-9f10-41b4-9c14-b32d9a3cc860 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:44.879010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db1c76e4-9f10-41b4-9c14-b32d9a3cc860 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:45.070109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-db1c76e4-9f10-41b4-9c14-b32d9a3cc860 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:45.083312 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-db1c76e4-9f10-41b4-9c14-b32d9a3cc860 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.219139 Jul 28 03:51:45.096911 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1881/3381] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:44 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:45.107989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-032c9773-61d1-406d-ba28-818029e518b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:45.108537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-032c9773-61d1-406d-ba28-818029e518b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:45.115370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-032c9773-61d1-406d-ba28-818029e518b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:45.115834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-032c9773-61d1-406d-ba28-818029e518b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:45.116678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-032c9773-61d1-406d-ba28-818029e518b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:45.117116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-032c9773-61d1-406d-ba28-818029e518b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:45.148022 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-032c9773-61d1-406d-ba28-818029e518b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d/ips" status: 200 len: 149 microversion: 2.1 time: 0.049865 Jul 28 03:51:45.149125 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1882/3382] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:51:45 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:45.160692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-91c7b974-2562-4f73-be22-056f9da49f53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4553306-07a9-43fd-9c5b-33fe1c8547ac"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:45.164285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-91c7b974-2562-4f73-be22-056f9da49f53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:45.171595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91c7b974-2562-4f73-be22-056f9da49f53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:45.172047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91c7b974-2562-4f73-be22-056f9da49f53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:45.172953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91c7b974-2562-4f73-be22-056f9da49f53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:45.173289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91c7b974-2562-4f73-be22-056f9da49f53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:45.318285 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-91c7b974-2562-4f73-be22-056f9da49f53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] HTTP exception thrown: Invalid volume: volume b4553306-07a9-43fd-9c5b-33fe1c8547ac is already attached to instances: a314625b-adb1-45fa-9483-b084005a11b6 Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-91c7b974-2562-4f73-be22-056f9da49f53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Request method failure captured: Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d/os-volume_attachments HTTP/1.1 Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 74 Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gca3wwj6vf3mcE1k3p04a-IB_aHJ4q2aQgyaMGEamuHOXYtT8sTCQ39msigigoKDkTgI0q27esncQkdsISfIdor8uYi2ofpy2xxPUYcBX6T1jxeXp0Wz1yCRt_oOue5jQOpZsPCIWzJpvRA8Ld9LSF337wCVS7VtPTruWEjBErR8iQ Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 781ab005138547038def64d108937e3e Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781ab005138547038def64d108937e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781ab005138547038def64d108937e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}] Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 781ab005138547038def64d108937e3e Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d20381abd9784627887af3cb97cd68a8 Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: {"volumeAttachment": {"volumeId": "b4553306-07a9-43fd-9c5b-33fe1c8547ac"}} Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid volume: volume b4553306-07a9-43fd-9c5b-33fe1c8547ac is already attached to instances: a314625b-adb1-45fa-9483-b084005a11b6 Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': 'dfdf6d03-2454-457b-9c80-106379a5194d', 'body': {'volumeAttachment': {'volumeId': 'b4553306-07a9-43fd-9c5b-33fe1c8547ac'}}} Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5110, in attach_volume Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4950, in _check_volume_already_attached Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b4553306-07a9-43fd-9c5b-33fe1c8547ac is already attached to instances: a314625b-adb1-45fa-9483-b084005a11b6 Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:51:45.320913 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b4553306-07a9-43fd-9c5b-33fe1c8547ac is already attached to instances: a314625b-adb1-45fa-9483-b084005a11b6 Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b4553306-07a9-43fd-9c5b-33fe1c8547ac is already attached to instances: a314625b-adb1-45fa-9483-b084005a11b6 Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-91c7b974-2562-4f73-be22-056f9da49f53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Returning 400 to user: Invalid volume: volume b4553306-07a9-43fd-9c5b-33fe1c8547ac is already attached to instances: a314625b-adb1-45fa-9483-b084005a11b6 {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:51:45.326284 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-91c7b974-2562-4f73-be22-056f9da49f53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "POST /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.166718 Jul 28 03:51:45.328618 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1883/3383] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 03:51:45 2022] POST /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d/os-volume_attachments => generated 174 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:51:45.333430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7e7d9f3d-1250-48b8-afc6-e0a84d58b46f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:45.334225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7e7d9f3d-1250-48b8-afc6-e0a84d58b46f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:45.341071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e7d9f3d-1250-48b8-afc6-e0a84d58b46f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:45.341521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e7d9f3d-1250-48b8-afc6-e0a84d58b46f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:45.343497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e7d9f3d-1250-48b8-afc6-e0a84d58b46f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:45.344588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e7d9f3d-1250-48b8-afc6-e0a84d58b46f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:45.373606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7e7d9f3d-1250-48b8-afc6-e0a84d58b46f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:51:45.438758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3d2f1307-f150-4296-b83f-c942d9e9d63c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:45.441984 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:45.455436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3d2f1307-f150-4296-b83f-c942d9e9d63c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:45.457518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3d2f1307-f150-4296-b83f-c942d9e9d63c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:45.458986 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3d2f1307-f150-4296-b83f-c942d9e9d63c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1407 microversion: 2.20 time: 0.778041 Jul 28 03:51:45.459778 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1501/3384] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:51:44 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1407 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:51:45.480823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-50c1cc40-09a0-4ee4-822f-70b9bd9ec911 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:45.482016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-50c1cc40-09a0-4ee4-822f-70b9bd9ec911 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:45.490655 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50c1cc40-09a0-4ee4-822f-70b9bd9ec911 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:45.491437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50c1cc40-09a0-4ee4-822f-70b9bd9ec911 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:45.492523 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50c1cc40-09a0-4ee4-822f-70b9bd9ec911 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:45.493116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50c1cc40-09a0-4ee4-822f-70b9bd9ec911 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:45.510388 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7e7d9f3d-1250-48b8-afc6-e0a84d58b46f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 204 len: 0 microversion: 2.1 time: 0.180344 Jul 28 03:51:45.518122 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1884/3385] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:51:45 2022] DELETE /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:51:45.527664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e704716d-a266-46a7-8155-9a281ff506c1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:45.528822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e704716d-a266-46a7-8155-9a281ff506c1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:45.536617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e704716d-a266-46a7-8155-9a281ff506c1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:45.537151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e704716d-a266-46a7-8155-9a281ff506c1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:45.537998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e704716d-a266-46a7-8155-9a281ff506c1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:45.538441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e704716d-a266-46a7-8155-9a281ff506c1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:45.782830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e704716d-a266-46a7-8155-9a281ff506c1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:45.800954 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e704716d-a266-46a7-8155-9a281ff506c1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1681 microversion: 2.1 time: 0.280715 Jul 28 03:51:45.802534 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1885/3386] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:45 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1681 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:45.811198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c350c2b1-bfdc-4823-806f-47737bfbfadc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:45.811198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c350c2b1-bfdc-4823-806f-47737bfbfadc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:45.818661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c350c2b1-bfdc-4823-806f-47737bfbfadc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:45.819103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c350c2b1-bfdc-4823-806f-47737bfbfadc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:45.820833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c350c2b1-bfdc-4823-806f-47737bfbfadc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:45.821311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c350c2b1-bfdc-4823-806f-47737bfbfadc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:45.913859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-50c1cc40-09a0-4ee4-822f-70b9bd9ec911 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:45.930005 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-50c1cc40-09a0-4ee4-822f-70b9bd9ec911 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.453860 Jul 28 03:51:45.943734 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1502/3387] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:45 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:45.948915 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f1fd2482-49fa-4541-be12-8080c3b8d311 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:45.949544 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f1fd2482-49fa-4541-be12-8080c3b8d311 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:45.964786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1fd2482-49fa-4541-be12-8080c3b8d311 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:45.965236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1fd2482-49fa-4541-be12-8080c3b8d311 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:45.969859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1fd2482-49fa-4541-be12-8080c3b8d311 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:45.970566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1fd2482-49fa-4541-be12-8080c3b8d311 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:46.050829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c350c2b1-bfdc-4823-806f-47737bfbfadc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:46.062606 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c350c2b1-bfdc-4823-806f-47737bfbfadc tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1470 microversion: 2.1 time: 0.258324 Jul 28 03:51:46.076437 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1886/3388] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:45 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1470 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:46.116965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4edbc3a-07bd-40a0-8d1d-ddce5c6fa5db tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:46.117669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e4edbc3a-07bd-40a0-8d1d-ddce5c6fa5db tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:46.134624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4edbc3a-07bd-40a0-8d1d-ddce5c6fa5db tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:46.135488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4edbc3a-07bd-40a0-8d1d-ddce5c6fa5db tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:46.138329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4edbc3a-07bd-40a0-8d1d-ddce5c6fa5db tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:46.140904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4edbc3a-07bd-40a0-8d1d-ddce5c6fa5db tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:46.344392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f1fd2482-49fa-4541-be12-8080c3b8d311 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:46.367119 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f1fd2482-49fa-4541-be12-8080c3b8d311 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1522 microversion: 2.1 time: 0.420973 Jul 28 03:51:46.369961 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1503/3389] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:45 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:46.403177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-bc1ae138-248a-4652-8a93-c1a90959735c req-5ffc71ea-ab82-4b49-9759-4fb07e13833c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dca550f-8f08-4f26-a922-b8b222db43a1", "name": "network-vif-unplugged", "status": "completed", "tag": "4dce8ccd-5f8a-4b35-a9d0-946725622ad1"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:46.420646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-bc1ae138-248a-4652-8a93-c1a90959735c req-5ffc71ea-ab82-4b49-9759-4fb07e13833c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:46.421555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-bc1ae138-248a-4652-8a93-c1a90959735c req-5ffc71ea-ab82-4b49-9759-4fb07e13833c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:46.432607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e4edbc3a-07bd-40a0-8d1d-ddce5c6fa5db tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:46.451483 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-bc1ae138-248a-4652-8a93-c1a90959735c req-5ffc71ea-ab82-4b49-9759-4fb07e13833c service nova] Creating event network-vif-unplugged:4dce8ccd-5f8a-4b35-a9d0-946725622ad1 for instance 1dca550f-8f08-4f26-a922-b8b222db43a1 on n-h2-826756-3 Jul 28 03:51:46.454262 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e4edbc3a-07bd-40a0-8d1d-ddce5c6fa5db tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.340721 Jul 28 03:51:46.461457 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1887/3390] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:46 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:46.462774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [req-bc1ae138-248a-4652-8a93-c1a90959735c req-5ffc71ea-ab82-4b49-9759-4fb07e13833c service nova] Instance 1dca550f-8f08-4f26-a922-b8b222db43a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126072) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:51:46.483344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-71fb9cb2-d67f-4511-939f-cda3c05269f1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:46.484461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-71fb9cb2-d67f-4511-939f-cda3c05269f1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:46.485842 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-bc1ae138-248a-4652-8a93-c1a90959735c req-5ffc71ea-ab82-4b49-9759-4fb07e13833c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089648 Jul 28 03:51:46.486469 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1504/3391] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:46.487418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:46.497369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71fb9cb2-d67f-4511-939f-cda3c05269f1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:46.497829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71fb9cb2-d67f-4511-939f-cda3c05269f1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:46.498624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71fb9cb2-d67f-4511-939f-cda3c05269f1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:46.499047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71fb9cb2-d67f-4511-939f-cda3c05269f1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:46.831224 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-31a6afb9-04a0-4aa2-aa74-684085d7f55e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:46.833099 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-31a6afb9-04a0-4aa2-aa74-684085d7f55e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:46.846486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-31a6afb9-04a0-4aa2-aa74-684085d7f55e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:46.847840 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-31a6afb9-04a0-4aa2-aa74-684085d7f55e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:46.849750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-31a6afb9-04a0-4aa2-aa74-684085d7f55e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:46.852390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-31a6afb9-04a0-4aa2-aa74-684085d7f55e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:47.210455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-71fb9cb2-d67f-4511-939f-cda3c05269f1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:47.219671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-31a6afb9-04a0-4aa2-aa74-684085d7f55e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:47.243232 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-31a6afb9-04a0-4aa2-aa74-684085d7f55e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1681 microversion: 2.1 time: 0.422350 Jul 28 03:51:47.250604 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1505/3392] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:46 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1681 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:47.258724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-71fb9cb2-d67f-4511-939f-cda3c05269f1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:47.261682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-71fb9cb2-d67f-4511-939f-cda3c05269f1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:47.279789 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-daeceff9-699a-4934-95ef-5c8cb6ed0847 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:47.281102 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-daeceff9-699a-4934-95ef-5c8cb6ed0847 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:47.282813 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-71fb9cb2-d67f-4511-939f-cda3c05269f1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1600 microversion: 2.20 time: 0.804139 Jul 28 03:51:47.287769 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1888/3393] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:51:46 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1600 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:51:47.312161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-daeceff9-699a-4934-95ef-5c8cb6ed0847 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:47.314017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cb4cd98a-c0ce-42d2-a560-4a259d4a1b50 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:47.315007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cb4cd98a-c0ce-42d2-a560-4a259d4a1b50 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:47.318818 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-daeceff9-699a-4934-95ef-5c8cb6ed0847 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:47.320310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-daeceff9-699a-4934-95ef-5c8cb6ed0847 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:47.323904 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-daeceff9-699a-4934-95ef-5c8cb6ed0847 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:47.340162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb4cd98a-c0ce-42d2-a560-4a259d4a1b50 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:47.340916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb4cd98a-c0ce-42d2-a560-4a259d4a1b50 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:47.341917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb4cd98a-c0ce-42d2-a560-4a259d4a1b50 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:47.342485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb4cd98a-c0ce-42d2-a560-4a259d4a1b50 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:47.416131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:47.691996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cb4cd98a-c0ce-42d2-a560-4a259d4a1b50 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:47.700186 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cb4cd98a-c0ce-42d2-a560-4a259d4a1b50 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1470 microversion: 2.1 time: 0.410594 Jul 28 03:51:47.700808 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1889/3394] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:47 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1470 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:47.709736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-145db11d-dfaf-41cd-a448-e37cbf720386 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:47.710234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-145db11d-dfaf-41cd-a448-e37cbf720386 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:47.735213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-145db11d-dfaf-41cd-a448-e37cbf720386 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:47.736149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-145db11d-dfaf-41cd-a448-e37cbf720386 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:47.737673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-145db11d-dfaf-41cd-a448-e37cbf720386 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:47.738413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-145db11d-dfaf-41cd-a448-e37cbf720386 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:47.793183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-daeceff9-699a-4934-95ef-5c8cb6ed0847 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:47.806433 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-daeceff9-699a-4934-95ef-5c8cb6ed0847 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.554640 Jul 28 03:51:47.807063 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1506/3395] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:47 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:47.828238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-618e4849-a4d4-41b7-9e3e-82464ceb665d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:47.829286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-618e4849-a4d4-41b7-9e3e-82464ceb665d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:47.838942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-618e4849-a4d4-41b7-9e3e-82464ceb665d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:47.839534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-618e4849-a4d4-41b7-9e3e-82464ceb665d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:47.841505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-618e4849-a4d4-41b7-9e3e-82464ceb665d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:47.843134 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-618e4849-a4d4-41b7-9e3e-82464ceb665d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:47.867703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=8 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:47.894920 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-145db11d-dfaf-41cd-a448-e37cbf720386 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.189013 Jul 28 03:51:47.895736 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1890/3396] 10.222.0.48 () {60 vars in 1316 bytes} [Thu Jul 28 03:51:47 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:51:47.914402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e3517c4-58a0-463d-a553-4742b72df871 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:47.915224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4e3517c4-58a0-463d-a553-4742b72df871 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:47.923787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e3517c4-58a0-463d-a553-4742b72df871 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:47.924516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e3517c4-58a0-463d-a553-4742b72df871 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:47.925733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e3517c4-58a0-463d-a553-4742b72df871 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:47.926550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e3517c4-58a0-463d-a553-4742b72df871 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:47.940627 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=8 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:48.270815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e3517c4-58a0-463d-a553-4742b72df871 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:48.279532 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e3517c4-58a0-463d-a553-4742b72df871 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.382528 Jul 28 03:51:48.280272 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1891/3397] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:47 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:48.287602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7308dab9-422e-4bf8-9a41-46b5b5e8777e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:48.288524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7308dab9-422e-4bf8-9a41-46b5b5e8777e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:48.296584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7308dab9-422e-4bf8-9a41-46b5b5e8777e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:48.297170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7308dab9-422e-4bf8-9a41-46b5b5e8777e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:48.298060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7308dab9-422e-4bf8-9a41-46b5b5e8777e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:48.298593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7308dab9-422e-4bf8-9a41-46b5b5e8777e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:48.380398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-618e4849-a4d4-41b7-9e3e-82464ceb665d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:48.409958 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-618e4849-a4d4-41b7-9e3e-82464ceb665d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1522 microversion: 2.1 time: 0.588634 Jul 28 03:51:48.412307 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1507/3398] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:47 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1522 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:48.571752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7308dab9-422e-4bf8-9a41-46b5b5e8777e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:48.581771 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7308dab9-422e-4bf8-9a41-46b5b5e8777e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1681 microversion: 2.1 time: 0.299953 Jul 28 03:51:48.582423 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1892/3399] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:48 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1681 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:48.722508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-40f71a8b-b9ca-4ced-b299-381265e281c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:48.723331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-40f71a8b-b9ca-4ced-b299-381265e281c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:48.731179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40f71a8b-b9ca-4ced-b299-381265e281c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:48.731752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40f71a8b-b9ca-4ced-b299-381265e281c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:48.732648 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40f71a8b-b9ca-4ced-b299-381265e281c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:48.733115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40f71a8b-b9ca-4ced-b299-381265e281c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:48.827767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-459624c6-607d-4b08-8379-a7549e300bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:48.828711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-459624c6-607d-4b08-8379-a7549e300bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:48.840061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-459624c6-607d-4b08-8379-a7549e300bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:48.840785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-459624c6-607d-4b08-8379-a7549e300bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:48.841804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-459624c6-607d-4b08-8379-a7549e300bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:48.842389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-459624c6-607d-4b08-8379-a7549e300bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:49.091867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-459624c6-607d-4b08-8379-a7549e300bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:49.107013 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-459624c6-607d-4b08-8379-a7549e300bd9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.282339 Jul 28 03:51:49.123979 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1893/3400] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:48 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:49.133961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-74fa2762-22f1-462c-a02b-66b7a859178e req-bc9d2af7-22ff-4ee6-b311-ec319cb3e0c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dca550f-8f08-4f26-a922-b8b222db43a1", "tag": "4dce8ccd-5f8a-4b35-a9d0-946725622ad1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:49.147533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-74fa2762-22f1-462c-a02b-66b7a859178e req-bc9d2af7-22ff-4ee6-b311-ec319cb3e0c4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:49.148135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-74fa2762-22f1-462c-a02b-66b7a859178e req-bc9d2af7-22ff-4ee6-b311-ec319cb3e0c4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:49.162801 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-74fa2762-22f1-462c-a02b-66b7a859178e req-bc9d2af7-22ff-4ee6-b311-ec319cb3e0c4 service nova] Creating event network-changed:4dce8ccd-5f8a-4b35-a9d0-946725622ad1 for instance 1dca550f-8f08-4f26-a922-b8b222db43a1 on n-h2-826756-3 Jul 28 03:51:49.169878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-74fa2762-22f1-462c-a02b-66b7a859178e req-bc9d2af7-22ff-4ee6-b311-ec319cb3e0c4 service nova] Instance 1dca550f-8f08-4f26-a922-b8b222db43a1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 03:51:49.194827 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-74fa2762-22f1-462c-a02b-66b7a859178e req-bc9d2af7-22ff-4ee6-b311-ec319cb3e0c4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066780 Jul 28 03:51:49.196312 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1894/3401] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:49.305396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f3c994ae-155e-4c22-97e6-fc2b6f40fba2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:49.306729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f3c994ae-155e-4c22-97e6-fc2b6f40fba2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:49.320376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3c994ae-155e-4c22-97e6-fc2b6f40fba2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:49.321153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3c994ae-155e-4c22-97e6-fc2b6f40fba2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:49.322125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3c994ae-155e-4c22-97e6-fc2b6f40fba2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:49.322981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3c994ae-155e-4c22-97e6-fc2b6f40fba2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:49.363138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-40f71a8b-b9ca-4ced-b299-381265e281c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:49.387371 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-40f71a8b-b9ca-4ced-b299-381265e281c1 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1470 microversion: 2.1 time: 0.668061 Jul 28 03:51:49.389204 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1508/3402] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:48 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1470 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:49.435628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dc087ae2-4f49-4140-8e20-8b6239a67911 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:49.436268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dc087ae2-4f49-4140-8e20-8b6239a67911 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:49.459509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc087ae2-4f49-4140-8e20-8b6239a67911 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:49.460046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc087ae2-4f49-4140-8e20-8b6239a67911 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:49.461638 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc087ae2-4f49-4140-8e20-8b6239a67911 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:49.462195 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc087ae2-4f49-4140-8e20-8b6239a67911 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:49.696285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f3c994ae-155e-4c22-97e6-fc2b6f40fba2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:49.705132 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f3c994ae-155e-4c22-97e6-fc2b6f40fba2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.405610 Jul 28 03:51:49.729036 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1895/3403] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:49 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:49.732959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-edfb1825-f37f-4e19-b550-c12ae670d6cf req-0543e523-9321-40ce-aff6-b448a3880855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d0126e-11bf-4048-9e35-7309c228b534", "tag": "f15c48dd-54c1-4291-88c3-ac0923fa48e7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:49.754287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-edfb1825-f37f-4e19-b550-c12ae670d6cf req-0543e523-9321-40ce-aff6-b448a3880855 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:49.755453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-edfb1825-f37f-4e19-b550-c12ae670d6cf req-0543e523-9321-40ce-aff6-b448a3880855 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:49.783534 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-edfb1825-f37f-4e19-b550-c12ae670d6cf req-0543e523-9321-40ce-aff6-b448a3880855 service nova] Creating event network-changed:f15c48dd-54c1-4291-88c3-ac0923fa48e7 for instance 99d0126e-11bf-4048-9e35-7309c228b534 on n-h2-826756-3 Jul 28 03:51:49.794068 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-edfb1825-f37f-4e19-b550-c12ae670d6cf req-0543e523-9321-40ce-aff6-b448a3880855 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067431 Jul 28 03:51:49.794956 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1896/3404] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:49.804578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-662d7ccf-3ff4-43fa-bd71-5e3afe5e639d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:49.810608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-662d7ccf-3ff4-43fa-bd71-5e3afe5e639d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:49.822527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-662d7ccf-3ff4-43fa-bd71-5e3afe5e639d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:49.826582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-662d7ccf-3ff4-43fa-bd71-5e3afe5e639d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:49.827678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-662d7ccf-3ff4-43fa-bd71-5e3afe5e639d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:49.828315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-662d7ccf-3ff4-43fa-bd71-5e3afe5e639d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:50.124424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-662d7ccf-3ff4-43fa-bd71-5e3afe5e639d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:50.137298 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-662d7ccf-3ff4-43fa-bd71-5e3afe5e639d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1681 microversion: 2.1 time: 0.340614 Jul 28 03:51:50.138599 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1897/3405] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:49 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1681 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:50.151101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d7fb008-bb3c-41b6-9b07-85d31d6f9bce tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:50.154046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d7fb008-bb3c-41b6-9b07-85d31d6f9bce tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:50.165492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d7fb008-bb3c-41b6-9b07-85d31d6f9bce tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:50.170668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d7fb008-bb3c-41b6-9b07-85d31d6f9bce tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:50.171773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d7fb008-bb3c-41b6-9b07-85d31d6f9bce tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:50.172460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d7fb008-bb3c-41b6-9b07-85d31d6f9bce tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:50.405072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7d7fb008-bb3c-41b6-9b07-85d31d6f9bce tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:50.409834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dc087ae2-4f49-4140-8e20-8b6239a67911 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:50.416180 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d7fb008-bb3c-41b6-9b07-85d31d6f9bce tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.275111 Jul 28 03:51:50.417332 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1898/3406] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:50 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:50.424654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a288e8e8-a056-45f1-8bc9-37bfcea6fa0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:50.425445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a288e8e8-a056-45f1-8bc9-37bfcea6fa0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:50.431851 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dc087ae2-4f49-4140-8e20-8b6239a67911 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1522 microversion: 2.1 time: 1.002617 Jul 28 03:51:50.432472 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1509/3407] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:49 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1522 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:50.446884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a288e8e8-a056-45f1-8bc9-37bfcea6fa0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:50.447679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a288e8e8-a056-45f1-8bc9-37bfcea6fa0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:50.448810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a288e8e8-a056-45f1-8bc9-37bfcea6fa0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:50.449486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a288e8e8-a056-45f1-8bc9-37bfcea6fa0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:50.702781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a288e8e8-a056-45f1-8bc9-37bfcea6fa0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:50.724943 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a288e8e8-a056-45f1-8bc9-37bfcea6fa0d tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1470 microversion: 2.1 time: 0.305457 Jul 28 03:51:50.726818 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1899/3408] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:50 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:50.738556 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b8771233-091f-4034-bd39-6433b4382315 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:50.740446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b8771233-091f-4034-bd39-6433b4382315 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:50.766259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b8771233-091f-4034-bd39-6433b4382315 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:50.767284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b8771233-091f-4034-bd39-6433b4382315 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:50.772824 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b8771233-091f-4034-bd39-6433b4382315 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:50.773933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b8771233-091f-4034-bd39-6433b4382315 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:51.195860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-56283526-7a9a-405c-9c4a-3c02a0550a67 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:51.197570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b8771233-091f-4034-bd39-6433b4382315 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:51.200794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-56283526-7a9a-405c-9c4a-3c02a0550a67 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:51.214442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:51.220531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56283526-7a9a-405c-9c4a-3c02a0550a67 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:51.220664 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b8771233-091f-4034-bd39-6433b4382315 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.487848 Jul 28 03:51:51.222498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56283526-7a9a-405c-9c4a-3c02a0550a67 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:51.223219 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1510/3409] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:50 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:51.236543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56283526-7a9a-405c-9c4a-3c02a0550a67 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:51.237008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56283526-7a9a-405c-9c4a-3c02a0550a67 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:51.360683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-56283526-7a9a-405c-9c4a-3c02a0550a67 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:51.375195 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-56283526-7a9a-405c-9c4a-3c02a0550a67 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1613 microversion: 2.1 time: 0.206444 Jul 28 03:51:51.375932 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1900/3410] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:51 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1613 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:51.448528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1bca01ed-21c7-4ece-854c-56d3740f9265 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:51.449807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1bca01ed-21c7-4ece-854c-56d3740f9265 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:51.459541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6da17664-a461-439e-a870-bfc04114a094 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:51.460317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6da17664-a461-439e-a870-bfc04114a094 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:51.466372 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1bca01ed-21c7-4ece-854c-56d3740f9265 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:51.466822 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1bca01ed-21c7-4ece-854c-56d3740f9265 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:51.467501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da17664-a461-439e-a870-bfc04114a094 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:51.468233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da17664-a461-439e-a870-bfc04114a094 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:51.469687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da17664-a461-439e-a870-bfc04114a094 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:51.469888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1bca01ed-21c7-4ece-854c-56d3740f9265 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:51.470297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1bca01ed-21c7-4ece-854c-56d3740f9265 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:51.470779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da17664-a461-439e-a870-bfc04114a094 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:51.795722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6da17664-a461-439e-a870-bfc04114a094 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:51.813444 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6da17664-a461-439e-a870-bfc04114a094 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1522 microversion: 2.1 time: 0.357505 Jul 28 03:51:51.818690 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1901/3411] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:51 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:51.842092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97309d0b-459f-41d6-9901-6156cce7e9dd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:51.843081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-97309d0b-459f-41d6-9901-6156cce7e9dd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:51.861248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97309d0b-459f-41d6-9901-6156cce7e9dd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:51.863472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97309d0b-459f-41d6-9901-6156cce7e9dd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:51.863965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97309d0b-459f-41d6-9901-6156cce7e9dd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:51.864451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97309d0b-459f-41d6-9901-6156cce7e9dd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:52.005692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1bca01ed-21c7-4ece-854c-56d3740f9265 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:52.033009 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1bca01ed-21c7-4ece-854c-56d3740f9265 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.589213 Jul 28 03:51:52.060559 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1511/3412] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:51 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:52.071146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-e6efdc45-7f89-4211-b2ab-33ff14aa6417 req-c1f42db6-df5b-4df3-8e4d-4ae12e4e33d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfdf6d03-2454-457b-9c80-106379a5194d", "name": "network-vif-deleted", "tag": "db43bb38-3ef8-41b9-9df6-ae22a0c2289a"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:52.094691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e6efdc45-7f89-4211-b2ab-33ff14aa6417 req-c1f42db6-df5b-4df3-8e4d-4ae12e4e33d2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:52.095137 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e6efdc45-7f89-4211-b2ab-33ff14aa6417 req-c1f42db6-df5b-4df3-8e4d-4ae12e4e33d2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:52.111393 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-e6efdc45-7f89-4211-b2ab-33ff14aa6417 req-c1f42db6-df5b-4df3-8e4d-4ae12e4e33d2 service nova] Creating event network-vif-deleted:db43bb38-3ef8-41b9-9df6-ae22a0c2289a for instance dfdf6d03-2454-457b-9c80-106379a5194d on n-h2-826756-3 Jul 28 03:51:52.120712 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-e6efdc45-7f89-4211-b2ab-33ff14aa6417 req-c1f42db6-df5b-4df3-8e4d-4ae12e4e33d2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058436 Jul 28 03:51:52.121799 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1512/3413] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:52.210135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-97309d0b-459f-41d6-9901-6156cce7e9dd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:52.235220 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-97309d0b-459f-41d6-9901-6156cce7e9dd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1470 microversion: 2.1 time: 0.413566 Jul 28 03:51:52.236147 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1902/3414] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:51 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1470 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:52.272029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7077b7e6-53bd-4f69-b43b-0495e70bde79 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:52.274207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7077b7e6-53bd-4f69-b43b-0495e70bde79 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:52.288071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7077b7e6-53bd-4f69-b43b-0495e70bde79 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:52.289231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7077b7e6-53bd-4f69-b43b-0495e70bde79 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:52.291238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7077b7e6-53bd-4f69-b43b-0495e70bde79 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:52.292495 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7077b7e6-53bd-4f69-b43b-0495e70bde79 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:52.408812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce1d5b94-f84c-4596-8ef2-6400a038f166 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:52.413759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ce1d5b94-f84c-4596-8ef2-6400a038f166 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:52.441033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce1d5b94-f84c-4596-8ef2-6400a038f166 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:52.444312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce1d5b94-f84c-4596-8ef2-6400a038f166 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:52.447271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce1d5b94-f84c-4596-8ef2-6400a038f166 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:52.448052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce1d5b94-f84c-4596-8ef2-6400a038f166 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:52.550567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7077b7e6-53bd-4f69-b43b-0495e70bde79 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:52.564199 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7077b7e6-53bd-4f69-b43b-0495e70bde79 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.313143 Jul 28 03:51:52.565194 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1513/3415] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:52 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:52.607416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ce1d5b94-f84c-4596-8ef2-6400a038f166 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:52.624509 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce1d5b94-f84c-4596-8ef2-6400a038f166 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1613 microversion: 2.1 time: 0.223499 Jul 28 03:51:52.640383 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1903/3416] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:52 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1613 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:52.845308 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-90d1ce90-f986-40a4-a59c-90e94a1aef14 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:52.846228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-90d1ce90-f986-40a4-a59c-90e94a1aef14 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:52.857459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90d1ce90-f986-40a4-a59c-90e94a1aef14 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:52.858273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90d1ce90-f986-40a4-a59c-90e94a1aef14 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:52.859267 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90d1ce90-f986-40a4-a59c-90e94a1aef14 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:52.859853 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90d1ce90-f986-40a4-a59c-90e94a1aef14 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:53.068808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-07c37b81-e193-41c4-92be-d19fbddbe901 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:53.069840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-07c37b81-e193-41c4-92be-d19fbddbe901 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:53.083109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07c37b81-e193-41c4-92be-d19fbddbe901 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:53.084808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07c37b81-e193-41c4-92be-d19fbddbe901 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:53.086956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07c37b81-e193-41c4-92be-d19fbddbe901 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:53.089588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07c37b81-e193-41c4-92be-d19fbddbe901 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:53.332860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-07c37b81-e193-41c4-92be-d19fbddbe901 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:53.348464 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-07c37b81-e193-41c4-92be-d19fbddbe901 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.293844 Jul 28 03:51:53.368206 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1904/3417] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:53 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:53.381901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-185f4e87-8390-4a5b-bf5b-42a5dd5d03cf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:53.386722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-185f4e87-8390-4a5b-bf5b-42a5dd5d03cf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:53.397941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-185f4e87-8390-4a5b-bf5b-42a5dd5d03cf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:53.398775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-185f4e87-8390-4a5b-bf5b-42a5dd5d03cf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:53.399869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-185f4e87-8390-4a5b-bf5b-42a5dd5d03cf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:53.400953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-185f4e87-8390-4a5b-bf5b-42a5dd5d03cf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:53.459808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-90d1ce90-f986-40a4-a59c-90e94a1aef14 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:53.473719 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-90d1ce90-f986-40a4-a59c-90e94a1aef14 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1522 microversion: 2.1 time: 0.635251 Jul 28 03:51:53.475716 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1514/3418] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:52 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1522 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:53.600944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e2924bd6-7bb0-4b53-a6bc-5f9e29e93a69 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:53.601815 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e2924bd6-7bb0-4b53-a6bc-5f9e29e93a69 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:53.610303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e2924bd6-7bb0-4b53-a6bc-5f9e29e93a69 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:53.618459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e2924bd6-7bb0-4b53-a6bc-5f9e29e93a69 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:53.622958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e2924bd6-7bb0-4b53-a6bc-5f9e29e93a69 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:53.624204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e2924bd6-7bb0-4b53-a6bc-5f9e29e93a69 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:53.637946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-185f4e87-8390-4a5b-bf5b-42a5dd5d03cf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:53.676510 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-185f4e87-8390-4a5b-bf5b-42a5dd5d03cf tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1470 microversion: 2.1 time: 0.285995 Jul 28 03:51:53.676510 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1905/3419] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:53 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1470 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:53.693647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ff11d479-00b6-408f-85be-95de9f32925b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:53.694388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ff11d479-00b6-408f-85be-95de9f32925b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:53.709053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff11d479-00b6-408f-85be-95de9f32925b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:53.709925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff11d479-00b6-408f-85be-95de9f32925b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:53.710973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff11d479-00b6-408f-85be-95de9f32925b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:53.711420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff11d479-00b6-408f-85be-95de9f32925b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:53.751817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff11d479-00b6-408f-85be-95de9f32925b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:53.752691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff11d479-00b6-408f-85be-95de9f32925b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:53.753268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-ff11d479-00b6-408f-85be-95de9f32925b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lazy-loading 'fault' on Instance uuid dfdf6d03-2454-457b-9c80-106379a5194d {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:51:53.817214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ff11d479-00b6-408f-85be-95de9f32925b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:53.820007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:53.834918 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ff11d479-00b6-408f-85be-95de9f32925b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 200 len: 1331 microversion: 2.1 time: 0.170212 Jul 28 03:51:53.836408 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1906/3420] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:53 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 1331 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:54.376412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5cd7a3b2-c92f-44fa-af9e-1cd482731409 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:54.378571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5cd7a3b2-c92f-44fa-af9e-1cd482731409 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:54.390307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5cd7a3b2-c92f-44fa-af9e-1cd482731409 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:54.391006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5cd7a3b2-c92f-44fa-af9e-1cd482731409 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:54.392010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5cd7a3b2-c92f-44fa-af9e-1cd482731409 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:54.392652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5cd7a3b2-c92f-44fa-af9e-1cd482731409 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:54.535345 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e2924bd6-7bb0-4b53-a6bc-5f9e29e93a69 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:54.563307 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e2924bd6-7bb0-4b53-a6bc-5f9e29e93a69 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.966982 Jul 28 03:51:54.565010 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1515/3421] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:53 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:54.574988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-afb2ee7c-bcf4-46fa-af13-a0fa7d01815e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:54.577446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-afb2ee7c-bcf4-46fa-af13-a0fa7d01815e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:54.604768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afb2ee7c-bcf4-46fa-af13-a0fa7d01815e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:54.604768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afb2ee7c-bcf4-46fa-af13-a0fa7d01815e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:54.604768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afb2ee7c-bcf4-46fa-af13-a0fa7d01815e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:54.604768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afb2ee7c-bcf4-46fa-af13-a0fa7d01815e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:54.783669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5cd7a3b2-c92f-44fa-af9e-1cd482731409 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:54.794437 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5cd7a3b2-c92f-44fa-af9e-1cd482731409 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.422700 Jul 28 03:51:54.795111 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1907/3422] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:54 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:54.809059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59cd8ec7-ef22-439a-80e5-48f79e140325 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:54.809059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59cd8ec7-ef22-439a-80e5-48f79e140325 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:54.821664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59cd8ec7-ef22-439a-80e5-48f79e140325 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:54.822457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59cd8ec7-ef22-439a-80e5-48f79e140325 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:54.829008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59cd8ec7-ef22-439a-80e5-48f79e140325 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:54.831478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59cd8ec7-ef22-439a-80e5-48f79e140325 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:55.037455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-afb2ee7c-bcf4-46fa-af13-a0fa7d01815e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:55.068517 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-afb2ee7c-bcf4-46fa-af13-a0fa7d01815e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1522 microversion: 2.1 time: 0.501026 Jul 28 03:51:55.070098 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1516/3423] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:54 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:55.086687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e9402789-9112-4181-9504-e2b9132693c7 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:55.089315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e9402789-9112-4181-9504-e2b9132693c7 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:55.107746 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e9402789-9112-4181-9504-e2b9132693c7 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:55.108969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e9402789-9112-4181-9504-e2b9132693c7 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:55.113950 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e9402789-9112-4181-9504-e2b9132693c7 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:55.115996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e9402789-9112-4181-9504-e2b9132693c7 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:55.165773 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-e9402789-9112-4181-9504-e2b9132693c7 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] HTTP exception thrown: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e9402789-9112-4181-9504-e2b9132693c7 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Request method failure captured: Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d HTTP/1.1 Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gca3wwj6vf3mcE1k3p04a-IB_aHJ4q2aQgyaMGEamuHOXYtT8sTCQ39msigigoKDkTgI0q27esncQkdsISfIdor8uYi2ofpy2xxPUYcBX6T1jxeXp0Wz1yCRt_oOue5jQOpZsPCIWzJpvRA8Ld9LSF337wCVS7VtPTruWEjBErR8iQ Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 781ab005138547038def64d108937e3e Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781ab005138547038def64d108937e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781ab005138547038def64d108937e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}] Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 781ab005138547038def64d108937e3e Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: d20381abd9784627887af3cb97cd68a8 Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'dfdf6d03-2454-457b-9c80-106379a5194d'} Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:51:55.170365 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:51:55.180025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:51:55.180025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:51:55.180025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:51:55.180025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:51:55.180025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:51:55.180025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:51:55.180025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:51:55.186327 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e9402789-9112-4181-9504-e2b9132693c7 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Returning 404 to user: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:51:55.188369 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e9402789-9112-4181-9504-e2b9132693c7 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 404 len: 111 microversion: 2.1 time: 0.116209 Jul 28 03:51:55.194467 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1517/3424] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:55 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:51:55.214230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1c3b9523-fd06-49c9-a0c9-7365d269fc54 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '.version_select at 0x7ffa742c0e50>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:55.259530 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1c3b9523-fd06-49c9-a0c9-7365d269fc54 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210621033" status: 202 len: 0 microversion: 2.1 time: 0.057250 Jul 28 03:51:55.262209 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1518/3425] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 03:51:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210621033 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:51:55.338639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-59cd8ec7-ef22-439a-80e5-48f79e140325 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:55.352939 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59cd8ec7-ef22-439a-80e5-48f79e140325 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1463 microversion: 2.1 time: 0.556648 Jul 28 03:51:55.353895 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1908/3426] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:54 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1463 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:55.603804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af162186-106b-4f2e-82e0-58cdde44e6bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:55.604748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-af162186-106b-4f2e-82e0-58cdde44e6bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:55.614427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af162186-106b-4f2e-82e0-58cdde44e6bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:55.614911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af162186-106b-4f2e-82e0-58cdde44e6bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:55.616434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af162186-106b-4f2e-82e0-58cdde44e6bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:55.616879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af162186-106b-4f2e-82e0-58cdde44e6bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:55.834538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c8bd72b7-1fbc-485d-bbe2-12ec7e481dff tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:55.837155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c8bd72b7-1fbc-485d-bbe2-12ec7e481dff tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:55.872142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8bd72b7-1fbc-485d-bbe2-12ec7e481dff tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:55.874363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8bd72b7-1fbc-485d-bbe2-12ec7e481dff tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:55.880626 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8bd72b7-1fbc-485d-bbe2-12ec7e481dff tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:55.881707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8bd72b7-1fbc-485d-bbe2-12ec7e481dff tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:56.272985 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c8bd72b7-1fbc-485d-bbe2-12ec7e481dff tempest-MigrationsAdminTest-2045450230 tempest-MigrationsAdminTest-2045450230-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1614 microversion: 2.1 time: 0.901861 Jul 28 03:51:56.290564 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1519/3427] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:55 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1614 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:56.308202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b7554073-9e1f-47c8-9071-9c0b77995ed3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:56.313116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b7554073-9e1f-47c8-9071-9c0b77995ed3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:56.326402 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7554073-9e1f-47c8-9071-9c0b77995ed3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:56.327400 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7554073-9e1f-47c8-9071-9c0b77995ed3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:56.328530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7554073-9e1f-47c8-9071-9c0b77995ed3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:56.329328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7554073-9e1f-47c8-9071-9c0b77995ed3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:56.401321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-af162186-106b-4f2e-82e0-58cdde44e6bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:56.417440 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-af162186-106b-4f2e-82e0-58cdde44e6bd tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.833586 Jul 28 03:51:56.418133 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1909/3428] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:55 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:56.423015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-335b03f5-87ab-4594-b291-08f237da4ac3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:56.423642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-335b03f5-87ab-4594-b291-08f237da4ac3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:56.444252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-335b03f5-87ab-4594-b291-08f237da4ac3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:56.444833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-335b03f5-87ab-4594-b291-08f237da4ac3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:56.445727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-335b03f5-87ab-4594-b291-08f237da4ac3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:56.446166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-335b03f5-87ab-4594-b291-08f237da4ac3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:56.920530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b7554073-9e1f-47c8-9071-9c0b77995ed3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:56.929891 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b7554073-9e1f-47c8-9071-9c0b77995ed3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.637783 Jul 28 03:51:56.944254 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1520/3429] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:56 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:56.950424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3afb7811-bca8-44c4-b469-261bb6da6c75 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:56.952098 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3afb7811-bca8-44c4-b469-261bb6da6c75 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:56.963873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3afb7811-bca8-44c4-b469-261bb6da6c75 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:56.965084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3afb7811-bca8-44c4-b469-261bb6da6c75 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:56.966711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3afb7811-bca8-44c4-b469-261bb6da6c75 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:56.967775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3afb7811-bca8-44c4-b469-261bb6da6c75 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:57.015774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:51:57.022090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3afb7811-bca8-44c4-b469-261bb6da6c75 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:51:57.163167 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3afb7811-bca8-44c4-b469-261bb6da6c75 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 204 len: 0 microversion: 2.1 time: 0.215044 Jul 28 03:51:57.165609 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1521/3430] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:51:56 2022] DELETE /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:51:57.179065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4e3bb009-0fbd-4ac9-8d4c-1a949e258ae7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:57.189804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4e3bb009-0fbd-4ac9-8d4c-1a949e258ae7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:57.208862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e3bb009-0fbd-4ac9-8d4c-1a949e258ae7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:57.209496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e3bb009-0fbd-4ac9-8d4c-1a949e258ae7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:57.210828 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e3bb009-0fbd-4ac9-8d4c-1a949e258ae7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:57.211889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e3bb009-0fbd-4ac9-8d4c-1a949e258ae7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:57.396771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-335b03f5-87ab-4594-b291-08f237da4ac3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:57.416294 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-335b03f5-87ab-4594-b291-08f237da4ac3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1522 microversion: 2.1 time: 0.997132 Jul 28 03:51:57.421727 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1910/3431] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:56 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1522 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:57.448637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cb28923e-744e-4d62-8832-56ed64ed42b0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:57.449473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cb28923e-744e-4d62-8832-56ed64ed42b0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:57.469273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb28923e-744e-4d62-8832-56ed64ed42b0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:57.469716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb28923e-744e-4d62-8832-56ed64ed42b0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:57.473827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb28923e-744e-4d62-8832-56ed64ed42b0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:57.474521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb28923e-744e-4d62-8832-56ed64ed42b0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:57.647976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4e3bb009-0fbd-4ac9-8d4c-1a949e258ae7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:57.651140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-cb28923e-744e-4d62-8832-56ed64ed42b0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lazy-loading 'services' on Instance uuid a314625b-adb1-45fa-9483-b084005a11b6 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:51:57.663364 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4e3bb009-0fbd-4ac9-8d4c-1a949e258ae7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1469 microversion: 2.1 time: 0.491530 Jul 28 03:51:57.664217 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1522/3432] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:57 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1469 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:57.674097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a135bf44-af7c-42d2-862b-64814b52764a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:57.675111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a135bf44-af7c-42d2-862b-64814b52764a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:57.723429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a135bf44-af7c-42d2-862b-64814b52764a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:57.723429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a135bf44-af7c-42d2-862b-64814b52764a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:57.724216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a135bf44-af7c-42d2-862b-64814b52764a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:57.725092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a135bf44-af7c-42d2-862b-64814b52764a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:57.838258 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cb28923e-744e-4d62-8832-56ed64ed42b0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments/b4553306-07a9-43fd-9c5b-33fe1c8547ac" status: 202 len: 0 microversion: 2.1 time: 0.411877 Jul 28 03:51:57.846926 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1911/3433] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 03:51:57 2022] DELETE /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments/b4553306-07a9-43fd-9c5b-33fe1c8547ac => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:51:57.855711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4bf83b14-2b6f-4db8-b46e-b569338dd2ba req-365ad8a8-eead-4c16-8328-5ed57973601f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dca550f-8f08-4f26-a922-b8b222db43a1", "name": "network-vif-plugged", "status": "completed", "tag": "4dce8ccd-5f8a-4b35-a9d0-946725622ad1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:51:57.875958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4bf83b14-2b6f-4db8-b46e-b569338dd2ba req-365ad8a8-eead-4c16-8328-5ed57973601f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:57.877098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4bf83b14-2b6f-4db8-b46e-b569338dd2ba req-365ad8a8-eead-4c16-8328-5ed57973601f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:57.920997 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4bf83b14-2b6f-4db8-b46e-b569338dd2ba req-365ad8a8-eead-4c16-8328-5ed57973601f service nova] Creating event network-vif-plugged:4dce8ccd-5f8a-4b35-a9d0-946725622ad1 for instance 1dca550f-8f08-4f26-a922-b8b222db43a1 on n-h2-826756-3 Jul 28 03:51:57.934467 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4bf83b14-2b6f-4db8-b46e-b569338dd2ba req-365ad8a8-eead-4c16-8328-5ed57973601f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084987 Jul 28 03:51:57.935499 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1912/3434] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:57.954115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ff9c55c5-03c2-4343-96e5-73c21de51088 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:57.957858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ff9c55c5-03c2-4343-96e5-73c21de51088 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:57.971677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff9c55c5-03c2-4343-96e5-73c21de51088 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:57.972559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff9c55c5-03c2-4343-96e5-73c21de51088 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:57.974002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff9c55c5-03c2-4343-96e5-73c21de51088 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:57.974820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff9c55c5-03c2-4343-96e5-73c21de51088 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:58.060511 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ff9c55c5-03c2-4343-96e5-73c21de51088 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109067 Jul 28 03:51:58.062086 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1913/3435] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:51:57 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:58.068217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4955aff-4f39-4e4f-ab81-ccf257806950 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:58.068879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d4955aff-4f39-4e4f-ab81-ccf257806950 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:58.076414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4955aff-4f39-4e4f-ab81-ccf257806950 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:58.080173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4955aff-4f39-4e4f-ab81-ccf257806950 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:58.080173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4955aff-4f39-4e4f-ab81-ccf257806950 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:58.080579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4955aff-4f39-4e4f-ab81-ccf257806950 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:58.141829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a135bf44-af7c-42d2-862b-64814b52764a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:58.152281 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a135bf44-af7c-42d2-862b-64814b52764a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.487149 Jul 28 03:51:58.153459 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1523/3436] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:57 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:58.460826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-43a846c7-bdd5-43c0-ada9-2eeb60183168 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:58.469921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d4955aff-4f39-4e4f-ab81-ccf257806950 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:58.477381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-43a846c7-bdd5-43c0-ada9-2eeb60183168 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:58.496060 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-43a846c7-bdd5-43c0-ada9-2eeb60183168 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:58.496815 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-43a846c7-bdd5-43c0-ada9-2eeb60183168 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:58.499326 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d4955aff-4f39-4e4f-ab81-ccf257806950 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.434687 Jul 28 03:51:58.500072 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1914/3437] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:58 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:51:58.514967 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-43a846c7-bdd5-43c0-ada9-2eeb60183168 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:58.515827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-43a846c7-bdd5-43c0-ada9-2eeb60183168 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:58.689613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1ebcc472-968e-4cf2-abb8-b21e19e56187 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:58.691934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1ebcc472-968e-4cf2-abb8-b21e19e56187 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:58.706318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ebcc472-968e-4cf2-abb8-b21e19e56187 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:58.707153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ebcc472-968e-4cf2-abb8-b21e19e56187 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:58.708967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ebcc472-968e-4cf2-abb8-b21e19e56187 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:58.720165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ebcc472-968e-4cf2-abb8-b21e19e56187 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:59.044890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-43a846c7-bdd5-43c0-ada9-2eeb60183168 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:59.087611 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-43a846c7-bdd5-43c0-ada9-2eeb60183168 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1522 microversion: 2.1 time: 0.643915 Jul 28 03:51:59.090327 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1524/3438] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:58 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1522 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:59.099768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ea9fdf94-7c91-4022-bf0d-2c6252ba0c13 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:59.102627 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ea9fdf94-7c91-4022-bf0d-2c6252ba0c13 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:59.119746 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea9fdf94-7c91-4022-bf0d-2c6252ba0c13 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:59.124764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea9fdf94-7c91-4022-bf0d-2c6252ba0c13 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:59.126601 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea9fdf94-7c91-4022-bf0d-2c6252ba0c13 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:59.127657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea9fdf94-7c91-4022-bf0d-2c6252ba0c13 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:59.132419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1ebcc472-968e-4cf2-abb8-b21e19e56187 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:59.149786 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1ebcc472-968e-4cf2-abb8-b21e19e56187 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1469 microversion: 2.1 time: 0.466497 Jul 28 03:51:59.153860 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1915/3439] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:58 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1469 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:51:59.184432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-325d9ceb-e965-4dbc-801b-15d7d701b5c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:59.189635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-325d9ceb-e965-4dbc-801b-15d7d701b5c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:59.206010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-325d9ceb-e965-4dbc-801b-15d7d701b5c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:59.206573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-325d9ceb-e965-4dbc-801b-15d7d701b5c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:59.208168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-325d9ceb-e965-4dbc-801b-15d7d701b5c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:59.209573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-325d9ceb-e965-4dbc-801b-15d7d701b5c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:59.217048 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ea9fdf94-7c91-4022-bf0d-2c6252ba0c13 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125418 Jul 28 03:51:59.217765 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1525/3440] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:51:59 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:51:59.528116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-14f6ddf8-b277-4610-9be3-92a5aecd4e50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:51:59.529349 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-14f6ddf8-b277-4610-9be3-92a5aecd4e50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:51:59.544255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-14f6ddf8-b277-4610-9be3-92a5aecd4e50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:59.550641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-14f6ddf8-b277-4610-9be3-92a5aecd4e50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:59.551954 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-14f6ddf8-b277-4610-9be3-92a5aecd4e50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:51:59.552658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-14f6ddf8-b277-4610-9be3-92a5aecd4e50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:51:59.827959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-325d9ceb-e965-4dbc-801b-15d7d701b5c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:51:59.841970 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-325d9ceb-e965-4dbc-801b-15d7d701b5c2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.662397 Jul 28 03:51:59.858658 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1916/3441] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:59 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:00.113494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-37aada49-6ad7-4079-8798-7e8ff1fa996a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:00.113983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-37aada49-6ad7-4079-8798-7e8ff1fa996a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:00.132061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37aada49-6ad7-4079-8798-7e8ff1fa996a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:00.141349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37aada49-6ad7-4079-8798-7e8ff1fa996a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:00.142805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37aada49-6ad7-4079-8798-7e8ff1fa996a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:00.143638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37aada49-6ad7-4079-8798-7e8ff1fa996a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:00.526209 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-14f6ddf8-b277-4610-9be3-92a5aecd4e50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:00.556097 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-14f6ddf8-b277-4610-9be3-92a5aecd4e50 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 1.031940 Jul 28 03:52:00.560182 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1526/3442] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:51:59 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:00.582671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-22e58369-42c4-4101-9b5c-55e330b381ce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:00.583988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-22e58369-42c4-4101-9b5c-55e330b381ce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:00.594186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22e58369-42c4-4101-9b5c-55e330b381ce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:00.594646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22e58369-42c4-4101-9b5c-55e330b381ce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:00.597015 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22e58369-42c4-4101-9b5c-55e330b381ce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:00.597489 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22e58369-42c4-4101-9b5c-55e330b381ce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:00.851783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-37aada49-6ad7-4079-8798-7e8ff1fa996a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:00.873600 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-37aada49-6ad7-4079-8798-7e8ff1fa996a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1522 microversion: 2.1 time: 0.762425 Jul 28 03:52:00.874535 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1917/3443] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:00 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1522 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:00.898830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b620e9a3-f241-4bb0-9634-df78189bf705 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:00.902653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b620e9a3-f241-4bb0-9634-df78189bf705 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:00.938894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b620e9a3-f241-4bb0-9634-df78189bf705 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:00.939740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b620e9a3-f241-4bb0-9634-df78189bf705 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:00.940759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b620e9a3-f241-4bb0-9634-df78189bf705 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:00.941418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b620e9a3-f241-4bb0-9634-df78189bf705 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:01.030868 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b620e9a3-f241-4bb0-9634-df78189bf705 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154035 Jul 28 03:52:01.042975 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1918/3444] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:52:00 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:01.056929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ded0e707-0cbf-4c79-b54c-1e76486c5364 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:01.057846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ded0e707-0cbf-4c79-b54c-1e76486c5364 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:01.072344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ded0e707-0cbf-4c79-b54c-1e76486c5364 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:01.073208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ded0e707-0cbf-4c79-b54c-1e76486c5364 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:01.074211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ded0e707-0cbf-4c79-b54c-1e76486c5364 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:01.074854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ded0e707-0cbf-4c79-b54c-1e76486c5364 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:01.540479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ded0e707-0cbf-4c79-b54c-1e76486c5364 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:01.554451 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-22e58369-42c4-4101-9b5c-55e330b381ce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:01.566806 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ded0e707-0cbf-4c79-b54c-1e76486c5364 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.521919 Jul 28 03:52:01.575263 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-22e58369-42c4-4101-9b5c-55e330b381ce tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 200 len: 1469 microversion: 2.1 time: 1.002541 Jul 28 03:52:01.578537 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1527/3445] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:00 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 1469 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:01.592631 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1919/3446] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:01 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:01.597794 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0a53ad30-84be-40ef-b8d5-e78a707c8068 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:01.608101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0a53ad30-84be-40ef-b8d5-e78a707c8068 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:01.619642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a53ad30-84be-40ef-b8d5-e78a707c8068 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:01.620516 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a53ad30-84be-40ef-b8d5-e78a707c8068 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:01.621599 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a53ad30-84be-40ef-b8d5-e78a707c8068 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:01.623381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a53ad30-84be-40ef-b8d5-e78a707c8068 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:01.916978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-48b14749-e353-4d67-90ee-114ea695c51d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:01.918948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-48b14749-e353-4d67-90ee-114ea695c51d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:01.962307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48b14749-e353-4d67-90ee-114ea695c51d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:01.964011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48b14749-e353-4d67-90ee-114ea695c51d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:01.973241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48b14749-e353-4d67-90ee-114ea695c51d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:01.977343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48b14749-e353-4d67-90ee-114ea695c51d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:02.369332 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0a53ad30-84be-40ef-b8d5-e78a707c8068 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:02.387152 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0a53ad30-84be-40ef-b8d5-e78a707c8068 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.791923 Jul 28 03:52:02.392053 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1528/3447] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:01 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:02.419892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-c0a42aa0-b9b0-40cb-9a92-8b2a3054545c req-b970b7f5-4b04-4e10-bceb-1fb900a208f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dca550f-8f08-4f26-a922-b8b222db43a1", "name": "network-vif-deleted", "tag": "4dce8ccd-5f8a-4b35-a9d0-946725622ad1"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:02.470652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c0a42aa0-b9b0-40cb-9a92-8b2a3054545c req-b970b7f5-4b04-4e10-bceb-1fb900a208f2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:02.472701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c0a42aa0-b9b0-40cb-9a92-8b2a3054545c req-b970b7f5-4b04-4e10-bceb-1fb900a208f2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:02.475581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-48b14749-e353-4d67-90ee-114ea695c51d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:02.493160 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-48b14749-e353-4d67-90ee-114ea695c51d tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1499 microversion: 2.1 time: 0.584391 Jul 28 03:52:02.494574 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1920/3448] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:01 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1499 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:02.501246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f8d777e2-7f65-4828-bc04-670e24538ca3 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:02.503849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f8d777e2-7f65-4828-bc04-670e24538ca3 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:02.516451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8d777e2-7f65-4828-bc04-670e24538ca3 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:02.517302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8d777e2-7f65-4828-bc04-670e24538ca3 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:02.523294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8d777e2-7f65-4828-bc04-670e24538ca3 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:02.523823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8d777e2-7f65-4828-bc04-670e24538ca3 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:02.539272 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-c0a42aa0-b9b0-40cb-9a92-8b2a3054545c req-b970b7f5-4b04-4e10-bceb-1fb900a208f2 service nova] Creating event network-vif-deleted:4dce8ccd-5f8a-4b35-a9d0-946725622ad1 for instance 1dca550f-8f08-4f26-a922-b8b222db43a1 on n-h2-826756-3 Jul 28 03:52:02.559517 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-c0a42aa0-b9b0-40cb-9a92-8b2a3054545c req-b970b7f5-4b04-4e10-bceb-1fb900a208f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165296 Jul 28 03:52:02.565546 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1529/3449] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:02.595693 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f8d777e2-7f65-4828-bc04-670e24538ca3 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099172 Jul 28 03:52:02.597213 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1921/3450] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:52:02 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:02.598449 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b1da369c-4ceb-42f9-86b4-ff7c382510e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:02.610590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b1da369c-4ceb-42f9-86b4-ff7c382510e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:02.612257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-33c352d4-4e57-4883-9b0a-125bb9ea1b50 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:02.613188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-33c352d4-4e57-4883-9b0a-125bb9ea1b50 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:02.622171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33c352d4-4e57-4883-9b0a-125bb9ea1b50 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:02.625632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33c352d4-4e57-4883-9b0a-125bb9ea1b50 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:02.626415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b1da369c-4ceb-42f9-86b4-ff7c382510e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:52:02.627688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33c352d4-4e57-4883-9b0a-125bb9ea1b50 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:02.628276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33c352d4-4e57-4883-9b0a-125bb9ea1b50 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:02.659780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b1da369c-4ceb-42f9-86b4-ff7c382510e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:02.659780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b1da369c-4ceb-42f9-86b4-ff7c382510e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:02.663416 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b1da369c-4ceb-42f9-86b4-ff7c382510e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:02.664280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b1da369c-4ceb-42f9-86b4-ff7c382510e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:02.758801 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-b1da369c-4ceb-42f9-86b4-ff7c382510e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:52:02.803230 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b1da369c-4ceb-42f9-86b4-ff7c382510e8 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.230683 Jul 28 03:52:02.810895 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1530/3451] 10.222.0.48 () {58 vars in 1154 bytes} [Thu Jul 28 03:52:02 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:02.816909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7f9e4620-ae01-457f-9546-41e4a76f33d7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:02.818317 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7f9e4620-ae01-457f-9546-41e4a76f33d7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 1dca550f-8f08-4f26-a922-b8b222db43a1] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:02.829583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f9e4620-ae01-457f-9546-41e4a76f33d7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:02.830624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f9e4620-ae01-457f-9546-41e4a76f33d7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:02.832450 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f9e4620-ae01-457f-9546-41e4a76f33d7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:02.833635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f9e4620-ae01-457f-9546-41e4a76f33d7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:02.853685 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-7f9e4620-ae01-457f-9546-41e4a76f33d7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] HTTP exception thrown: Instance 1dca550f-8f08-4f26-a922-b8b222db43a1 could not be found. Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7f9e4620-ae01-457f-9546-41e4a76f33d7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Request method failure captured: Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 HTTP/1.1 Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gaKcX578nbjGiUiXaydMbgAOBWSPKDXeu38gaIcAqwRpIc6837eYzymj4L8IE_F12C4XVPwuRTuWQTy7Qb3deFMwfikgaBlUpk_DTRqqXqN480FOh6GvyyIqd880qBogQS5MgLrvQXb27r29WhQYiSQz2zc93UTCvSsyhl162V7L9s Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: da4a22e4560a4210bb58942cec62c091 Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-MigrationsAdminTest-1644568816 Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da4a22e4560a4210bb58942cec62c091"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da4a22e4560a4210bb58942cec62c091"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da4a22e4560a4210bb58942cec62c091"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da4a22e4560a4210bb58942cec62c091"}]}] Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-MigrationsAdminTest-1644568816 Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: da4a22e4560a4210bb58942cec62c091 Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-MigrationsAdminTest-1644568816 Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-MigrationsAdminTest-1644568816-project Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ac9d734be6ee4b549f9ed389c276f54a Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-MigrationsAdminTest-1644568816-project Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 1dca550f-8f08-4f26-a922-b8b222db43a1 could not be found. Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '1dca550f-8f08-4f26-a922-b8b222db43a1'} Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dca550f-8f08-4f26-a922-b8b222db43a1 could not be found. Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dca550f-8f08-4f26-a922-b8b222db43a1 could not be found. Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:02.856250 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:02.861629 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:02.861629 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:02.861629 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:02.861629 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:52:02.861629 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:52:02.861629 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dca550f-8f08-4f26-a922-b8b222db43a1 could not be found. Jul 28 03:52:02.861629 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:02.864109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7f9e4620-ae01-457f-9546-41e4a76f33d7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Returning 404 to user: Instance 1dca550f-8f08-4f26-a922-b8b222db43a1 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:52:02.865340 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7f9e4620-ae01-457f-9546-41e4a76f33d7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1" status: 404 len: 111 microversion: 2.1 time: 0.053009 Jul 28 03:52:02.866281 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1531/3452] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:02 2022] GET /compute/v2.1/servers/1dca550f-8f08-4f26-a922-b8b222db43a1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:52:02.878045 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-507e7ba5-b794-4d9d-96eb-23062fe38ce7 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:02.888127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-507e7ba5-b794-4d9d-96eb-23062fe38ce7 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:02.889033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-507e7ba5-b794-4d9d-96eb-23062fe38ce7 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:02.928642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-507e7ba5-b794-4d9d-96eb-23062fe38ce7 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Going to try to start instance {{(pid=126072) start /opt/stack/nova/nova/compute/api.py:2776}} Jul 28 03:52:03.018735 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-507e7ba5-b794-4d9d-96eb-23062fe38ce7 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "POST /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4/action" status: 202 len: 0 microversion: 2.1 time: 0.143919 Jul 28 03:52:03.026285 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1532/3453] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:52:02 2022] POST /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:52:03.039544 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8f73b17e-0087-4e40-b8cd-4d967bceddca tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:03.041289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8f73b17e-0087-4e40-b8cd-4d967bceddca tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:03.054603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8f73b17e-0087-4e40-b8cd-4d967bceddca tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:03.058117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8f73b17e-0087-4e40-b8cd-4d967bceddca tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:03.060171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8f73b17e-0087-4e40-b8cd-4d967bceddca tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:03.061378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8f73b17e-0087-4e40-b8cd-4d967bceddca tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:03.128488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8f73b17e-0087-4e40-b8cd-4d967bceddca tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:52:03.143630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-33c352d4-4e57-4883-9b0a-125bb9ea1b50 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:03.154015 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-33c352d4-4e57-4883-9b0a-125bb9ea1b50 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.555567 Jul 28 03:52:03.160504 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1922/3454] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:02 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:03.182033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f527e1a2-d291-423a-b0c8-a24faa5e484b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:03.189377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f527e1a2-d291-423a-b0c8-a24faa5e484b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:03.210206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f527e1a2-d291-423a-b0c8-a24faa5e484b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:03.215836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f527e1a2-d291-423a-b0c8-a24faa5e484b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:03.222656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f527e1a2-d291-423a-b0c8-a24faa5e484b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:03.223479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f527e1a2-d291-423a-b0c8-a24faa5e484b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:03.246283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:03.419662 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8f73b17e-0087-4e40-b8cd-4d967bceddca tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 204 len: 0 microversion: 2.1 time: 0.390485 Jul 28 03:52:03.423533 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1533/3455] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:52:03 2022] DELETE /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:52:03.426115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0d989c5d-5304-49e3-9946-f3f115298a3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:03.426825 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0d989c5d-5304-49e3-9946-f3f115298a3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:03.437696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d989c5d-5304-49e3-9946-f3f115298a3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:03.438146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d989c5d-5304-49e3-9946-f3f115298a3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:03.438968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d989c5d-5304-49e3-9946-f3f115298a3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:03.439474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d989c5d-5304-49e3-9946-f3f115298a3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:03.470971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:03.785479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0d989c5d-5304-49e3-9946-f3f115298a3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:03.801028 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0d989c5d-5304-49e3-9946-f3f115298a3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.379131 Jul 28 03:52:03.801962 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1534/3456] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:03 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:03.806966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9e0ef37c-1e23-453d-9615-1b7ee7d7abcd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:03.807578 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9e0ef37c-1e23-453d-9615-1b7ee7d7abcd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:03.826812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e0ef37c-1e23-453d-9615-1b7ee7d7abcd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:03.827253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e0ef37c-1e23-453d-9615-1b7ee7d7abcd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:03.828039 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e0ef37c-1e23-453d-9615-1b7ee7d7abcd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:03.828505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e0ef37c-1e23-453d-9615-1b7ee7d7abcd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:04.171531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f527e1a2-d291-423a-b0c8-a24faa5e484b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:04.172671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9e0ef37c-1e23-453d-9615-1b7ee7d7abcd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:04.192559 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9e0ef37c-1e23-453d-9615-1b7ee7d7abcd tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1534 microversion: 2.1 time: 0.389429 Jul 28 03:52:04.207616 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f527e1a2-d291-423a-b0c8-a24faa5e484b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1508 microversion: 2.1 time: 1.030655 Jul 28 03:52:04.214418 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1923/3458] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:03 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1508 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:04.247033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b79cc81d-87f0-4911-bbed-7cade2065184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:04.249565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b79cc81d-87f0-4911-bbed-7cade2065184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:04.253728 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1535/3457] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:03 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1534 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:04.257587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b79cc81d-87f0-4911-bbed-7cade2065184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:04.258273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b79cc81d-87f0-4911-bbed-7cade2065184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:04.260470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b79cc81d-87f0-4911-bbed-7cade2065184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:04.261470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b79cc81d-87f0-4911-bbed-7cade2065184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:04.266095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6ff097b9-11fe-41a1-b09f-c6977c120bd2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:04.266877 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6ff097b9-11fe-41a1-b09f-c6977c120bd2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:04.280179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ff097b9-11fe-41a1-b09f-c6977c120bd2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:04.284372 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ff097b9-11fe-41a1-b09f-c6977c120bd2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:04.285389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ff097b9-11fe-41a1-b09f-c6977c120bd2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:04.285950 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ff097b9-11fe-41a1-b09f-c6977c120bd2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:04.308887 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b79cc81d-87f0-4911-bbed-7cade2065184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074084 Jul 28 03:52:04.314600 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1924/3459] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:52:04 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:04.683718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1437090346", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "e52fca37-53fa-462b-b8ba-2d25974c2e06"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:04.794755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6ff097b9-11fe-41a1-b09f-c6977c120bd2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:04.798101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] validate_networks() for [('e52fca37-53fa-462b-b8ba-2d25974c2e06', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:52:04.810718 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6ff097b9-11fe-41a1-b09f-c6977c120bd2 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.555543 Jul 28 03:52:04.811425 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1536/3460] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:04 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:04.822683 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4ca0adfe-9800-4b9b-aa2d-b4cb8d9d3b1e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:04.824637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4ca0adfe-9800-4b9b-aa2d-b4cb8d9d3b1e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:04.833545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ca0adfe-9800-4b9b-aa2d-b4cb8d9d3b1e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:04.834428 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ca0adfe-9800-4b9b-aa2d-b4cb8d9d3b1e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:04.835583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ca0adfe-9800-4b9b-aa2d-b4cb8d9d3b1e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:04.836179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ca0adfe-9800-4b9b-aa2d-b4cb8d9d3b1e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:05.419274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4ca0adfe-9800-4b9b-aa2d-b4cb8d9d3b1e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:05.439111 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4ca0adfe-9800-4b9b-aa2d-b4cb8d9d3b1e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1508 microversion: 2.1 time: 0.620255 Jul 28 03:52:05.453934 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1537/3461] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:04 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1508 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:05.459799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-45414323-6271-4027-b2dd-055ec243f8ac tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:05.460778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-45414323-6271-4027-b2dd-055ec243f8ac tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:05.464839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:05.469247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-45414323-6271-4027-b2dd-055ec243f8ac tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:05.469985 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-45414323-6271-4027-b2dd-055ec243f8ac tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:05.470966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-45414323-6271-4027-b2dd-055ec243f8ac tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:05.471560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-45414323-6271-4027-b2dd-055ec243f8ac tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:05.682515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:52:05.683217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:52:05.683900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:52:05.684328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:52:05.684913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:52:05.732865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:05.733613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:05.734700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:05.735151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:05.798106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Getting quotas for project 321f83387b874d5e8a7081438d656f0b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:52:05.801010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-45414323-6271-4027-b2dd-055ec243f8ac tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:05.812289 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-45414323-6271-4027-b2dd-055ec243f8ac tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 200 len: 1492 microversion: 2.1 time: 0.356807 Jul 28 03:52:05.816042 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1538/3462] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:05 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 1492 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:05.826244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Getting quotas for user d7122dcc470240558ca95e293e1c29e4 and project 321f83387b874d5e8a7081438d656f0b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:52:05.829429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-07ccb271-0303-4a85-a02e-59f97925ad1a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:05.834450 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-07ccb271-0303-4a85-a02e-59f97925ad1a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:05.853288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-07ccb271-0303-4a85-a02e-59f97925ad1a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:05.853964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-07ccb271-0303-4a85-a02e-59f97925ad1a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:05.855310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-07ccb271-0303-4a85-a02e-59f97925ad1a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:05.856155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:52:05.857619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-07ccb271-0303-4a85-a02e-59f97925ad1a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:05.868579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:52:06.488024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-07ccb271-0303-4a85-a02e-59f97925ad1a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:06.503389 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-07ccb271-0303-4a85-a02e-59f97925ad1a tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1508 microversion: 2.1 time: 0.685886 Jul 28 03:52:06.507212 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1539/3463] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:05 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1508 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:06.535684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-db8636a6-46d3-48ab-b091-2c6dd38e0732 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:06.560227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-db8636a6-46d3-48ab-b091-2c6dd38e0732 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:06.625689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db8636a6-46d3-48ab-b091-2c6dd38e0732 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:06.629430 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db8636a6-46d3-48ab-b091-2c6dd38e0732 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:06.636864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db8636a6-46d3-48ab-b091-2c6dd38e0732 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:06.637468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db8636a6-46d3-48ab-b091-2c6dd38e0732 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:06.822570 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-db8636a6-46d3-48ab-b091-2c6dd38e0732 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.313789 Jul 28 03:52:06.829374 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1540/3464] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:52:06 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments => generated 197 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:06.865499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2f497dc4-6abe-41ed-a420-aac43ae24b17 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:06.866501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2f497dc4-6abe-41ed-a420-aac43ae24b17 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:06.893431 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-92c13a84-9035-4f7b-983c-e0657bbf8bcc tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.328549 Jul 28 03:52:06.895684 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1925/3465] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:52:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:52:06.902654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f497dc4-6abe-41ed-a420-aac43ae24b17 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:06.903582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f497dc4-6abe-41ed-a420-aac43ae24b17 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:06.917253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a29500ce-db90-487a-91b1-181b18370a30 req-d53c3832-b3b5-4117-81f2-73c6dd176c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed99415-e36a-431c-a33c-c609912af752", "name": "network-vif-deleted", "tag": "fe3c986d-7298-4555-ba29-5e1b4c7e6981"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:06.917863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f497dc4-6abe-41ed-a420-aac43ae24b17 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:06.924595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f497dc4-6abe-41ed-a420-aac43ae24b17 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:06.960057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a29500ce-db90-487a-91b1-181b18370a30 req-d53c3832-b3b5-4117-81f2-73c6dd176c02 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:06.961711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a29500ce-db90-487a-91b1-181b18370a30 req-d53c3832-b3b5-4117-81f2-73c6dd176c02 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:07.007680 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a29500ce-db90-487a-91b1-181b18370a30 req-d53c3832-b3b5-4117-81f2-73c6dd176c02 service nova] Creating event network-vif-deleted:fe3c986d-7298-4555-ba29-5e1b4c7e6981 for instance bed99415-e36a-431c-a33c-c609912af752 on n-h1-826756-3 Jul 28 03:52:07.025064 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a29500ce-db90-487a-91b1-181b18370a30 req-d53c3832-b3b5-4117-81f2-73c6dd176c02 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125757 Jul 28 03:52:07.027114 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1926/3466] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:07.048529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4ae797a-9a71-4486-a148-246dbf8169b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:07.053689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e4ae797a-9a71-4486-a148-246dbf8169b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:07.080456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4ae797a-9a71-4486-a148-246dbf8169b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:07.082781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4ae797a-9a71-4486-a148-246dbf8169b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:07.085207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4ae797a-9a71-4486-a148-246dbf8169b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:07.087785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4ae797a-9a71-4486-a148-246dbf8169b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:07.320698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2f497dc4-6abe-41ed-a420-aac43ae24b17 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:07.339132 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2f497dc4-6abe-41ed-a420-aac43ae24b17 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.505183 Jul 28 03:52:07.340277 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1541/3467] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:06 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:07.346406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f1da202a-faa6-45bb-b09e-73696a82dd51 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:07.352680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f1da202a-faa6-45bb-b09e-73696a82dd51 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: bed99415-e36a-431c-a33c-c609912af752] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:07.366674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1da202a-faa6-45bb-b09e-73696a82dd51 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:07.370663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1da202a-faa6-45bb-b09e-73696a82dd51 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:07.377249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1da202a-faa6-45bb-b09e-73696a82dd51 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:07.377716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1da202a-faa6-45bb-b09e-73696a82dd51 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:07.409708 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-f1da202a-faa6-45bb-b09e-73696a82dd51 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] HTTP exception thrown: Instance bed99415-e36a-431c-a33c-c609912af752 could not be found. Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f1da202a-faa6-45bb-b09e-73696a82dd51 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Request method failure captured: Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 HTTP/1.1 Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gaKcX578nbjGiUiXaydMbgAOBWSPKDXeu38gaIcAqwRpIc6837eYzymj4L8IE_F12C4XVPwuRTuWQTy7Qb3deFMwfikgaBlUpk_DTRqqXqN480FOh6GvyyIqd880qBogQS5MgLrvQXb27r29WhQYiSQz2zc93UTCvSsyhl162V7L9s Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: da4a22e4560a4210bb58942cec62c091 Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-MigrationsAdminTest-1644568816 Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da4a22e4560a4210bb58942cec62c091"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da4a22e4560a4210bb58942cec62c091"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da4a22e4560a4210bb58942cec62c091"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da4a22e4560a4210bb58942cec62c091"}]}] Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-MigrationsAdminTest-1644568816 Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: da4a22e4560a4210bb58942cec62c091 Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-MigrationsAdminTest-1644568816 Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-MigrationsAdminTest-1644568816-project Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ac9d734be6ee4b549f9ed389c276f54a Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-MigrationsAdminTest-1644568816-project Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance bed99415-e36a-431c-a33c-c609912af752 could not be found. Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'bed99415-e36a-431c-a33c-c609912af752'} Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed99415-e36a-431c-a33c-c609912af752 could not be found. Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed99415-e36a-431c-a33c-c609912af752 could not be found. Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:07.412943 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:07.419690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:07.419690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:07.419690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:07.419690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:52:07.419690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:52:07.419690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed99415-e36a-431c-a33c-c609912af752 could not be found. Jul 28 03:52:07.419690 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:07.424197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f1da202a-faa6-45bb-b09e-73696a82dd51 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Returning 404 to user: Instance bed99415-e36a-431c-a33c-c609912af752 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:52:07.426191 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f1da202a-faa6-45bb-b09e-73696a82dd51 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752" status: 404 len: 111 microversion: 2.1 time: 0.084460 Jul 28 03:52:07.428078 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1542/3468] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:07 2022] GET /compute/v2.1/servers/bed99415-e36a-431c-a33c-c609912af752 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:52:07.436707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-774228bb-bd5a-44d5-8acd-1209d6edc065 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:07.438369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-774228bb-bd5a-44d5-8acd-1209d6edc065 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:07.449303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-774228bb-bd5a-44d5-8acd-1209d6edc065 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:07.450261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-774228bb-bd5a-44d5-8acd-1209d6edc065 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:07.451379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-774228bb-bd5a-44d5-8acd-1209d6edc065 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:07.452091 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-774228bb-bd5a-44d5-8acd-1209d6edc065 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:07.572288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-774228bb-bd5a-44d5-8acd-1209d6edc065 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:07.582966 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-774228bb-bd5a-44d5-8acd-1209d6edc065 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1221 microversion: 2.1 time: 0.152728 Jul 28 03:52:07.584402 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1543/3469] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:07 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1221 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:07.593723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-800849b5-6de3-45d8-9003-0cc123034503 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '.version_select at 0x7ffa7488dee0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:07.641721 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-800849b5-6de3-45d8-9003-0cc123034503 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493708872" status: 202 len: 0 microversion: 2.1 time: 0.055521 Jul 28 03:52:07.643480 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1544/3470] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 03:52:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493708872 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:52:07.658410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e4ae797a-9a71-4486-a148-246dbf8169b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:07.672005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e3e84c72-7bcc-44d6-a78f-e3807d68376f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:07.672786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e3e84c72-7bcc-44d6-a78f-e3807d68376f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:07.674670 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e4ae797a-9a71-4486-a148-246dbf8169b4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1529 microversion: 2.1 time: 0.640596 Jul 28 03:52:07.675899 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1927/3471] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:07 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1529 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:07.727817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3e84c72-7bcc-44d6-a78f-e3807d68376f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:07.730415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3e84c72-7bcc-44d6-a78f-e3807d68376f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:07.732097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3e84c72-7bcc-44d6-a78f-e3807d68376f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:07.735178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3e84c72-7bcc-44d6-a78f-e3807d68376f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:07.839440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-11f5f1a3-c52c-4c03-8460-908bcf6e4803 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:07.847388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-11f5f1a3-c52c-4c03-8460-908bcf6e4803 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:07.891591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11f5f1a3-c52c-4c03-8460-908bcf6e4803 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:07.898672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11f5f1a3-c52c-4c03-8460-908bcf6e4803 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:07.903407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11f5f1a3-c52c-4c03-8460-908bcf6e4803 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:07.910596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11f5f1a3-c52c-4c03-8460-908bcf6e4803 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:08.017135 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-11f5f1a3-c52c-4c03-8460-908bcf6e4803 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183986 Jul 28 03:52:08.017724 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1928/3472] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:52:07 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:52:08.207394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e3e84c72-7bcc-44d6-a78f-e3807d68376f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:08.222096 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e3e84c72-7bcc-44d6-a78f-e3807d68376f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1512 microversion: 2.1 time: 0.576651 Jul 28 03:52:08.223066 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1545/3473] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:07 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1512 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:08.274022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8dea28e2-bb87-4ec4-b447-2f499753e626 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:08.284230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8dea28e2-bb87-4ec4-b447-2f499753e626 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:08.284760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.compute.servers [None req-8dea28e2-bb87-4ec4-b447-2f499753e626 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Removing options 'limit' from query {{(pid=126071) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 28 03:52:08.287030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8dea28e2-bb87-4ec4-b447-2f499753e626 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:52:08.294581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dea28e2-bb87-4ec4-b447-2f499753e626 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:08.296056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dea28e2-bb87-4ec4-b447-2f499753e626 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:08.297790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dea28e2-bb87-4ec4-b447-2f499753e626 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:08.298501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dea28e2-bb87-4ec4-b447-2f499753e626 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:08.300717 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8dea28e2-bb87-4ec4-b447-2f499753e626 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.039963 Jul 28 03:52:08.319560 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1929/3474] 10.222.0.48 () {58 vars in 1140 bytes} [Thu Jul 28 03:52:08 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:52:08.319863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2139e7ce-992c-452f-aaf4-147809ab3a66 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:08.320897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2139e7ce-992c-452f-aaf4-147809ab3a66 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:08.345043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2139e7ce-992c-452f-aaf4-147809ab3a66 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:08.345525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2139e7ce-992c-452f-aaf4-147809ab3a66 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:08.346381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2139e7ce-992c-452f-aaf4-147809ab3a66 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:08.346826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2139e7ce-992c-452f-aaf4-147809ab3a66 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:08.366147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6e48bbfa-fd41-4d26-88cc-6881ba6da146 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:08.367384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6e48bbfa-fd41-4d26-88cc-6881ba6da146 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:08.390947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e48bbfa-fd41-4d26-88cc-6881ba6da146 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:08.392488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e48bbfa-fd41-4d26-88cc-6881ba6da146 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:08.399498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e48bbfa-fd41-4d26-88cc-6881ba6da146 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:08.412123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e48bbfa-fd41-4d26-88cc-6881ba6da146 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:09.015723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6e48bbfa-fd41-4d26-88cc-6881ba6da146 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:09.036775 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6e48bbfa-fd41-4d26-88cc-6881ba6da146 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.674397 Jul 28 03:52:09.051538 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1930/3475] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:08 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:09.066263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-78d844a9-8660-4930-aeb9-8baa25232e82 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:09.068698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-78d844a9-8660-4930-aeb9-8baa25232e82 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:09.089231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:09.095106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78d844a9-8660-4930-aeb9-8baa25232e82 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:09.096754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78d844a9-8660-4930-aeb9-8baa25232e82 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:09.098749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78d844a9-8660-4930-aeb9-8baa25232e82 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:09.100295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78d844a9-8660-4930-aeb9-8baa25232e82 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:09.292328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-78d844a9-8660-4930-aeb9-8baa25232e82 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:09.319494 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-78d844a9-8660-4930-aeb9-8baa25232e82 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1275 microversion: 2.1 time: 0.265920 Jul 28 03:52:09.342072 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1931/3476] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:09 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1275 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:09.354527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-96559675-c4c9-4064-8d2f-a003020e614f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:09.355156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-96559675-c4c9-4064-8d2f-a003020e614f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:09.378304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96559675-c4c9-4064-8d2f-a003020e614f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:09.381854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96559675-c4c9-4064-8d2f-a003020e614f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:09.386551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96559675-c4c9-4064-8d2f-a003020e614f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:09.387880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96559675-c4c9-4064-8d2f-a003020e614f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:10.054823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2139e7ce-992c-452f-aaf4-147809ab3a66 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:10.064698 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2139e7ce-992c-452f-aaf4-147809ab3a66 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1512 microversion: 2.1 time: 1.749427 Jul 28 03:52:10.065313 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1546/3477] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:08 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1512 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:10.075721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3c49a326-e4e6-47d6-8591-c97af05ec292 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:10.083176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3c49a326-e4e6-47d6-8591-c97af05ec292 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:10.110223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c49a326-e4e6-47d6-8591-c97af05ec292 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:10.111106 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c49a326-e4e6-47d6-8591-c97af05ec292 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:10.112505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c49a326-e4e6-47d6-8591-c97af05ec292 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:10.120145 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c49a326-e4e6-47d6-8591-c97af05ec292 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:10.216700 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3c49a326-e4e6-47d6-8591-c97af05ec292 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.147008 Jul 28 03:52:10.217301 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1547/3478] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:52:10 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6/os-volume_attachments => generated 25 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:52:10.251772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8aa374ee-d6cc-481d-af62-2e829fd40b81 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:10.253475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8aa374ee-d6cc-481d-af62-2e829fd40b81 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:10.299005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8aa374ee-d6cc-481d-af62-2e829fd40b81 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:10.299669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8aa374ee-d6cc-481d-af62-2e829fd40b81 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:10.302100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8aa374ee-d6cc-481d-af62-2e829fd40b81 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:10.304212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8aa374ee-d6cc-481d-af62-2e829fd40b81 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:10.506358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-96559675-c4c9-4064-8d2f-a003020e614f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:10.517055 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-96559675-c4c9-4064-8d2f-a003020e614f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1524 microversion: 2.1 time: 1.173533 Jul 28 03:52:10.520935 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1932/3479] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:09 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1524 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:10.551067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d237a07-1532-4d98-b7e1-a82ac3c17b32 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:10.552136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d237a07-1532-4d98-b7e1-a82ac3c17b32 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: f7a4251e-80ef-4e70-aa87-29d50b7e5c26] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:10.565690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d237a07-1532-4d98-b7e1-a82ac3c17b32 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:10.566532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d237a07-1532-4d98-b7e1-a82ac3c17b32 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:10.567598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d237a07-1532-4d98-b7e1-a82ac3c17b32 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:10.568288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d237a07-1532-4d98-b7e1-a82ac3c17b32 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:10.958839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7d237a07-1532-4d98-b7e1-a82ac3c17b32 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:10.970301 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d237a07-1532-4d98-b7e1-a82ac3c17b32 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26" status: 200 len: 1511 microversion: 2.1 time: 0.434922 Jul 28 03:52:10.971508 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1933/3480] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:10 2022] GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26 => generated 1511 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:10.979306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8165b84e-a656-4a5a-81b2-2138dbf4819e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:10.980320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8165b84e-a656-4a5a-81b2-2138dbf4819e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:10.989976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8165b84e-a656-4a5a-81b2-2138dbf4819e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:10.991008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8165b84e-a656-4a5a-81b2-2138dbf4819e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:10.992338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8165b84e-a656-4a5a-81b2-2138dbf4819e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:10.993143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8165b84e-a656-4a5a-81b2-2138dbf4819e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:11.072064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8165b84e-a656-4a5a-81b2-2138dbf4819e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:52:11.296140 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8165b84e-a656-4a5a-81b2-2138dbf4819e tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "DELETE /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 204 len: 0 microversion: 2.1 time: 0.321992 Jul 28 03:52:11.299699 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1934/3481] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:52:10 2022] DELETE /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:52:11.309985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-862678db-68a4-4e08-a5fb-da1dc482485c tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:11.311532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-862678db-68a4-4e08-a5fb-da1dc482485c tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:11.330361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-862678db-68a4-4e08-a5fb-da1dc482485c tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:11.330815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-862678db-68a4-4e08-a5fb-da1dc482485c tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:11.331819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-862678db-68a4-4e08-a5fb-da1dc482485c tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:11.332460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-862678db-68a4-4e08-a5fb-da1dc482485c tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:11.400407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8aa374ee-d6cc-481d-af62-2e829fd40b81 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:11.441115 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8aa374ee-d6cc-481d-af62-2e829fd40b81 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 1.221155 Jul 28 03:52:11.442282 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1548/3482] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:10 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:11.463962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bba3777e-b03c-4939-81b9-e5bce648f52f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:11.465421 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bba3777e-b03c-4939-81b9-e5bce648f52f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:11.475339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bba3777e-b03c-4939-81b9-e5bce648f52f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:11.476256 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bba3777e-b03c-4939-81b9-e5bce648f52f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:11.477409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bba3777e-b03c-4939-81b9-e5bce648f52f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:11.478093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bba3777e-b03c-4939-81b9-e5bce648f52f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:11.541592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bba3777e-b03c-4939-81b9-e5bce648f52f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:52:11.656546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-862678db-68a4-4e08-a5fb-da1dc482485c tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:11.674941 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-862678db-68a4-4e08-a5fb-da1dc482485c tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1275 microversion: 2.1 time: 0.373261 Jul 28 03:52:11.675725 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1935/3483] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:11 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1275 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:11.719493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-851dea5e-612b-4da8-b524-bbd3f2fe8824 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:11.720461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-851dea5e-612b-4da8-b524-bbd3f2fe8824 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:11.758000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-851dea5e-612b-4da8-b524-bbd3f2fe8824 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:11.758477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-851dea5e-612b-4da8-b524-bbd3f2fe8824 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:11.760773 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bba3777e-b03c-4939-81b9-e5bce648f52f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 204 len: 0 microversion: 2.1 time: 0.306605 Jul 28 03:52:11.764183 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1549/3484] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:52:11 2022] DELETE /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:52:11.769477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-851dea5e-612b-4da8-b524-bbd3f2fe8824 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:11.770405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-851dea5e-612b-4da8-b524-bbd3f2fe8824 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:11.794389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f2c311da-9c9e-4b70-a6ce-a662c64fe136 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:11.795537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f2c311da-9c9e-4b70-a6ce-a662c64fe136 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:11.807765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2c311da-9c9e-4b70-a6ce-a662c64fe136 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:11.808254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2c311da-9c9e-4b70-a6ce-a662c64fe136 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:11.810478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2c311da-9c9e-4b70-a6ce-a662c64fe136 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:11.812778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2c311da-9c9e-4b70-a6ce-a662c64fe136 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:12.208857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-851dea5e-612b-4da8-b524-bbd3f2fe8824 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:12.225406 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-851dea5e-612b-4da8-b524-bbd3f2fe8824 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1511 microversion: 2.1 time: 0.542230 Jul 28 03:52:12.227295 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1936/3485] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:11 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1511 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:12.236322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-77238169-ce29-40cf-a692-e81f546f0fb9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:12.239397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-77238169-ce29-40cf-a692-e81f546f0fb9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:12.263131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77238169-ce29-40cf-a692-e81f546f0fb9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:12.267124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77238169-ce29-40cf-a692-e81f546f0fb9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:12.269354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77238169-ce29-40cf-a692-e81f546f0fb9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:12.273435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77238169-ce29-40cf-a692-e81f546f0fb9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:12.695521 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:12.821879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-77238169-ce29-40cf-a692-e81f546f0fb9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:12.837419 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-77238169-ce29-40cf-a692-e81f546f0fb9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1524 microversion: 2.1 time: 0.602650 Jul 28 03:52:12.842495 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1937/3486] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:12 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1524 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:12.870491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0608c35d-f22c-41f6-b900-5bfdf0b4631e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:12.871258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0608c35d-f22c-41f6-b900-5bfdf0b4631e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:12.902101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0608c35d-f22c-41f6-b900-5bfdf0b4631e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:12.903263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0608c35d-f22c-41f6-b900-5bfdf0b4631e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:12.904914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0608c35d-f22c-41f6-b900-5bfdf0b4631e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:12.906852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0608c35d-f22c-41f6-b900-5bfdf0b4631e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:12.990149 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f2c311da-9c9e-4b70-a6ce-a662c64fe136 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:13.009620 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f2c311da-9c9e-4b70-a6ce-a662c64fe136 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1465 microversion: 2.1 time: 1.242200 Jul 28 03:52:13.019357 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1550/3487] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:11 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1465 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:13.024318 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-e96f2b37-301c-4cd2-9c56-4db7faa624b8 req-d50a2690-d58f-46a4-abdc-643de55393ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8", "name": "network-vif-plugged", "status": "completed", "tag": "ddebd4c4-d703-4220-b742-f9fb50b2c194"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:13.077089 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e96f2b37-301c-4cd2-9c56-4db7faa624b8 req-d50a2690-d58f-46a4-abdc-643de55393ae service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:13.083200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e96f2b37-301c-4cd2-9c56-4db7faa624b8 req-d50a2690-d58f-46a4-abdc-643de55393ae service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:13.132263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:13.158780 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-e96f2b37-301c-4cd2-9c56-4db7faa624b8 req-d50a2690-d58f-46a4-abdc-643de55393ae service nova] Creating event network-vif-plugged:ddebd4c4-d703-4220-b742-f9fb50b2c194 for instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 on n-h1-826756-3 Jul 28 03:52:13.173864 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-e96f2b37-301c-4cd2-9c56-4db7faa624b8 req-d50a2690-d58f-46a4-abdc-643de55393ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159273 Jul 28 03:52:13.174539 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1551/3488] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:13.188947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-40085dcb-79b7-40bb-a536-ead978e07cf3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:13.200799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-40085dcb-79b7-40bb-a536-ead978e07cf3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:13.203845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-40085dcb-79b7-40bb-a536-ead978e07cf3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:52:13.268174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0608c35d-f22c-41f6-b900-5bfdf0b4631e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:13.282953 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0608c35d-f22c-41f6-b900-5bfdf0b4631e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1679 microversion: 2.1 time: 0.438762 Jul 28 03:52:13.297067 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1938/3489] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:12 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1679 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:13.297067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3327d74-0585-4cbe-a21a-3d223fbde54b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:13.297067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3327d74-0585-4cbe-a21a-3d223fbde54b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:13.310780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3327d74-0585-4cbe-a21a-3d223fbde54b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:13.310780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3327d74-0585-4cbe-a21a-3d223fbde54b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:13.311585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3327d74-0585-4cbe-a21a-3d223fbde54b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:13.317475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3327d74-0585-4cbe-a21a-3d223fbde54b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:13.502821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40085dcb-79b7-40bb-a536-ead978e07cf3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:13.504607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40085dcb-79b7-40bb-a536-ead978e07cf3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:13.506130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40085dcb-79b7-40bb-a536-ead978e07cf3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:13.506798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40085dcb-79b7-40bb-a536-ead978e07cf3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:13.639046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3327d74-0585-4cbe-a21a-3d223fbde54b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:13.659145 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-40085dcb-79b7-40bb-a536-ead978e07cf3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:52:13.678201 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3327d74-0585-4cbe-a21a-3d223fbde54b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1487 microversion: 2.1 time: 0.392883 Jul 28 03:52:13.679236 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1939/3490] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:13 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1487 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:13.698285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5622e8d4-acf6-4781-a95e-cfba971f3dc7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:13.699452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5622e8d4-acf6-4781-a95e-cfba971f3dc7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:13.716690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5622e8d4-acf6-4781-a95e-cfba971f3dc7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:13.717454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5622e8d4-acf6-4781-a95e-cfba971f3dc7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:13.718566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5622e8d4-acf6-4781-a95e-cfba971f3dc7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:13.719621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5622e8d4-acf6-4781-a95e-cfba971f3dc7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:13.806632 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-40085dcb-79b7-40bb-a536-ead978e07cf3 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 344 microversion: 2.1 time: 0.629142 Jul 28 03:52:13.808831 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1552/3491] 10.222.0.48 () {58 vars in 1154 bytes} [Thu Jul 28 03:52:13 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 344 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:13.820647 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-72d2d1ce-5acf-4dc7-b33a-0a81839652fb tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:13.821908 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-72d2d1ce-5acf-4dc7-b33a-0a81839652fb tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:13.830817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72d2d1ce-5acf-4dc7-b33a-0a81839652fb tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:13.831702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72d2d1ce-5acf-4dc7-b33a-0a81839652fb tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:13.832998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72d2d1ce-5acf-4dc7-b33a-0a81839652fb tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:13.833667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72d2d1ce-5acf-4dc7-b33a-0a81839652fb tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:13.942908 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-72d2d1ce-5acf-4dc7-b33a-0a81839652fb tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "POST /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146/action" status: 202 len: 0 microversion: 2.1 time: 0.131522 Jul 28 03:52:13.949396 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1553/3492] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:52:13 2022] POST /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:52:13.957429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fe105bc2-3f14-4cd6-8a4e-658b392f8550 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:13.959398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fe105bc2-3f14-4cd6-8a4e-658b392f8550 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:13.973980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe105bc2-3f14-4cd6-8a4e-658b392f8550 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:13.974772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe105bc2-3f14-4cd6-8a4e-658b392f8550 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:13.975687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe105bc2-3f14-4cd6-8a4e-658b392f8550 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:13.976342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe105bc2-3f14-4cd6-8a4e-658b392f8550 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:14.021736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5622e8d4-acf6-4781-a95e-cfba971f3dc7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:14.025771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:14.035692 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5622e8d4-acf6-4781-a95e-cfba971f3dc7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1317 microversion: 2.1 time: 0.354015 Jul 28 03:52:14.036592 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1940/3493] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:13 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:14.042983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05d86a2f-3ddf-4ddc-acf6-054b59042b78 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:14.043858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-05d86a2f-3ddf-4ddc-acf6-054b59042b78 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:14.065761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05d86a2f-3ddf-4ddc-acf6-054b59042b78 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:14.070624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05d86a2f-3ddf-4ddc-acf6-054b59042b78 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:14.071790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05d86a2f-3ddf-4ddc-acf6-054b59042b78 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:14.072430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05d86a2f-3ddf-4ddc-acf6-054b59042b78 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:14.347619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fe105bc2-3f14-4cd6-8a4e-658b392f8550 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:14.364191 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fe105bc2-3f14-4cd6-8a4e-658b392f8550 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1512 microversion: 2.1 time: 0.412533 Jul 28 03:52:14.381364 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1554/3494] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:13 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1512 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:14.389841 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fd30983c-da80-4d8c-b567-dc7825fec265 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:14.390630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fd30983c-da80-4d8c-b567-dc7825fec265 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:14.403667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd30983c-da80-4d8c-b567-dc7825fec265 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:14.404079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd30983c-da80-4d8c-b567-dc7825fec265 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:14.406841 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd30983c-da80-4d8c-b567-dc7825fec265 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:14.407340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd30983c-da80-4d8c-b567-dc7825fec265 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:14.469687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-05d86a2f-3ddf-4ddc-acf6-054b59042b78 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:14.487267 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-05d86a2f-3ddf-4ddc-acf6-054b59042b78 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1524 microversion: 2.1 time: 0.448931 Jul 28 03:52:14.500376 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1941/3495] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:14 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1524 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:14.500376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7201f69c-1e05-426e-a389-844792122bc7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:14.500376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7201f69c-1e05-426e-a389-844792122bc7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:14.507511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7201f69c-1e05-426e-a389-844792122bc7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:14.507766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7201f69c-1e05-426e-a389-844792122bc7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:14.508479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7201f69c-1e05-426e-a389-844792122bc7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:14.509265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7201f69c-1e05-426e-a389-844792122bc7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:14.703152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fd30983c-da80-4d8c-b567-dc7825fec265 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:14.716823 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fd30983c-da80-4d8c-b567-dc7825fec265 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1495 microversion: 2.1 time: 0.333409 Jul 28 03:52:14.719202 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1555/3496] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:14 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1495 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:14.729090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4c7c1235-43df-4a1d-9435-fae9f8c88774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:14.731901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4c7c1235-43df-4a1d-9435-fae9f8c88774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:14.750216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c7c1235-43df-4a1d-9435-fae9f8c88774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:14.750993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c7c1235-43df-4a1d-9435-fae9f8c88774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:14.751791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c7c1235-43df-4a1d-9435-fae9f8c88774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:14.752214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c7c1235-43df-4a1d-9435-fae9f8c88774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:14.896620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7201f69c-1e05-426e-a389-844792122bc7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:14.917343 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7201f69c-1e05-426e-a389-844792122bc7 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1465 microversion: 2.1 time: 0.426920 Jul 28 03:52:14.920471 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1942/3497] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:14 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1465 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:14.944379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7f47e252-271e-429e-bce4-3357328e8f25 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:14.946254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7f47e252-271e-429e-bce4-3357328e8f25 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: f7a4251e-80ef-4e70-aa87-29d50b7e5c26] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:14.964952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f47e252-271e-429e-bce4-3357328e8f25 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:14.965864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f47e252-271e-429e-bce4-3357328e8f25 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:14.966930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f47e252-271e-429e-bce4-3357328e8f25 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:14.967620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f47e252-271e-429e-bce4-3357328e8f25 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:15.138862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4c7c1235-43df-4a1d-9435-fae9f8c88774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:15.150909 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4c7c1235-43df-4a1d-9435-fae9f8c88774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1679 microversion: 2.1 time: 0.430309 Jul 28 03:52:15.151528 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1556/3498] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:14 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1679 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:15.171177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6ad7c629-ed82-4910-a6f9-6c5d906a38cf tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:15.171811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6ad7c629-ed82-4910-a6f9-6c5d906a38cf tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:15.182189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ad7c629-ed82-4910-a6f9-6c5d906a38cf tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:15.182639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ad7c629-ed82-4910-a6f9-6c5d906a38cf tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:15.184072 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ad7c629-ed82-4910-a6f9-6c5d906a38cf tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:15.184548 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ad7c629-ed82-4910-a6f9-6c5d906a38cf tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:15.531855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6ad7c629-ed82-4910-a6f9-6c5d906a38cf tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:15.543025 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6ad7c629-ed82-4910-a6f9-6c5d906a38cf tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1317 microversion: 2.1 time: 0.390378 Jul 28 03:52:15.550901 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1557/3499] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:15 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:15.555537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-945b929e-64d8-48e5-a8f0-dfb5b9960b3e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:15.556143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-945b929e-64d8-48e5-a8f0-dfb5b9960b3e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:15.570568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-945b929e-64d8-48e5-a8f0-dfb5b9960b3e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:15.571090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-945b929e-64d8-48e5-a8f0-dfb5b9960b3e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:15.571783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-945b929e-64d8-48e5-a8f0-dfb5b9960b3e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:15.572217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-945b929e-64d8-48e5-a8f0-dfb5b9960b3e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:15.667718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7f47e252-271e-429e-bce4-3357328e8f25 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:15.683575 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7f47e252-271e-429e-bce4-3357328e8f25 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26" status: 200 len: 1511 microversion: 2.1 time: 0.759321 Jul 28 03:52:15.684947 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1943/3500] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:14 2022] GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26 => generated 1511 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:15.721186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a66e230e-8d3a-4032-bae1-69b570d5ffb9 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:15.722235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a66e230e-8d3a-4032-bae1-69b570d5ffb9 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:15.731368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a66e230e-8d3a-4032-bae1-69b570d5ffb9 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:15.732290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a66e230e-8d3a-4032-bae1-69b570d5ffb9 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:15.733409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a66e230e-8d3a-4032-bae1-69b570d5ffb9 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:15.734218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a66e230e-8d3a-4032-bae1-69b570d5ffb9 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:15.763592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:15.836186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:16.038361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a66e230e-8d3a-4032-bae1-69b570d5ffb9 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:16.089697 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a66e230e-8d3a-4032-bae1-69b570d5ffb9 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1511 microversion: 2.1 time: 0.385291 Jul 28 03:52:16.091448 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1944/3501] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:15 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1511 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:16.143903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-08537679-5954-4630-801f-e52e030b50bf tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:16.144614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-08537679-5954-4630-801f-e52e030b50bf tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:16.154611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08537679-5954-4630-801f-e52e030b50bf tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:16.155133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08537679-5954-4630-801f-e52e030b50bf tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:16.156030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08537679-5954-4630-801f-e52e030b50bf tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:16.156690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08537679-5954-4630-801f-e52e030b50bf tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:16.229101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-945b929e-64d8-48e5-a8f0-dfb5b9960b3e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:16.245375 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-945b929e-64d8-48e5-a8f0-dfb5b9960b3e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1524 microversion: 2.1 time: 0.693672 Jul 28 03:52:16.247678 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1558/3502] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:15 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1524 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:16.256244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-722cc163-73db-4e93-952a-e0158e5a2a10 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:16.257954 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-722cc163-73db-4e93-952a-e0158e5a2a10 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:16.265112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-722cc163-73db-4e93-952a-e0158e5a2a10 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:16.265808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-722cc163-73db-4e93-952a-e0158e5a2a10 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:16.267916 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-722cc163-73db-4e93-952a-e0158e5a2a10 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:16.269140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-722cc163-73db-4e93-952a-e0158e5a2a10 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:16.486572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-08537679-5954-4630-801f-e52e030b50bf tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:16.501681 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-08537679-5954-4630-801f-e52e030b50bf tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1495 microversion: 2.1 time: 0.364573 Jul 28 03:52:16.503140 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1945/3503] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:16 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1495 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:16.518762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-29f98a9f-1008-452e-938f-90afbe3886ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:16.529286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-29f98a9f-1008-452e-938f-90afbe3886ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:16.530188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-29f98a9f-1008-452e-938f-90afbe3886ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:52:16.549223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29f98a9f-1008-452e-938f-90afbe3886ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:16.549223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29f98a9f-1008-452e-938f-90afbe3886ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:16.550525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29f98a9f-1008-452e-938f-90afbe3886ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:16.550877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29f98a9f-1008-452e-938f-90afbe3886ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:16.614110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-29f98a9f-1008-452e-938f-90afbe3886ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:52:16.678890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-29f98a9f-1008-452e-938f-90afbe3886ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:16.688914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29f98a9f-1008-452e-938f-90afbe3886ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:16.689464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29f98a9f-1008-452e-938f-90afbe3886ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:17.035915 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-29f98a9f-1008-452e-938f-90afbe3886ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.531120 Jul 28 03:52:17.059730 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1946/3504] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:52:16 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:17.065846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2d97a9a7-7de3-4d61-9cf9-a3631606d673 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:17.066911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2d97a9a7-7de3-4d61-9cf9-a3631606d673 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:17.078854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d97a9a7-7de3-4d61-9cf9-a3631606d673 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:17.080954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d97a9a7-7de3-4d61-9cf9-a3631606d673 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:17.082575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d97a9a7-7de3-4d61-9cf9-a3631606d673 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:17.083745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d97a9a7-7de3-4d61-9cf9-a3631606d673 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:17.354600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2d97a9a7-7de3-4d61-9cf9-a3631606d673 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:17.378158 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2d97a9a7-7de3-4d61-9cf9-a3631606d673 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1679 microversion: 2.1 time: 0.316848 Jul 28 03:52:17.398880 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1947/3505] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:17 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1679 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:17.436876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a3f9277a-a48f-4f4a-8ba0-7f2f0caa5ae9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:17.438327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a3f9277a-a48f-4f4a-8ba0-7f2f0caa5ae9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:17.455970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3f9277a-a48f-4f4a-8ba0-7f2f0caa5ae9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:17.459490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3f9277a-a48f-4f4a-8ba0-7f2f0caa5ae9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:17.461460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3f9277a-a48f-4f4a-8ba0-7f2f0caa5ae9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:17.462571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3f9277a-a48f-4f4a-8ba0-7f2f0caa5ae9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:17.677560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-722cc163-73db-4e93-952a-e0158e5a2a10 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:17.693419 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-722cc163-73db-4e93-952a-e0158e5a2a10 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1465 microversion: 2.1 time: 1.443401 Jul 28 03:52:17.694311 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1559/3506] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:16 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1465 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:17.701851 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bcf395ad-b695-4bae-8b02-f82670107904 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:17.728821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bcf395ad-b695-4bae-8b02-f82670107904 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:17.733036 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bcf395ad-b695-4bae-8b02-f82670107904 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:52:17.903983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a3f9277a-a48f-4f4a-8ba0-7f2f0caa5ae9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:17.920764 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a3f9277a-a48f-4f4a-8ba0-7f2f0caa5ae9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1317 microversion: 2.1 time: 0.520249 Jul 28 03:52:17.921375 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1948/3507] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:17 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:17.931267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f640f470-c905-49c5-a022-5107f302f062 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:17.935424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f640f470-c905-49c5-a022-5107f302f062 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:17.953713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f640f470-c905-49c5-a022-5107f302f062 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:17.954555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f640f470-c905-49c5-a022-5107f302f062 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:17.955970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f640f470-c905-49c5-a022-5107f302f062 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:17.956848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f640f470-c905-49c5-a022-5107f302f062 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:18.077580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcf395ad-b695-4bae-8b02-f82670107904 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:18.078051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcf395ad-b695-4bae-8b02-f82670107904 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:18.078937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcf395ad-b695-4bae-8b02-f82670107904 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:18.088616 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bcf395ad-b695-4bae-8b02-f82670107904 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:18.156677 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-bcf395ad-b695-4bae-8b02-f82670107904 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:52:18.204257 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bcf395ad-b695-4bae-8b02-f82670107904 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.507872 Jul 28 03:52:18.205473 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1560/3508] 10.222.0.48 () {58 vars in 1150 bytes} [Thu Jul 28 03:52:17 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:18.211054 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-649d7aac-47a8-4ecc-b018-396de8c0c23a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:18.211938 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-649d7aac-47a8-4ecc-b018-396de8c0c23a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:18.227179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-649d7aac-47a8-4ecc-b018-396de8c0c23a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:18.227914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-649d7aac-47a8-4ecc-b018-396de8c0c23a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:18.228923 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-649d7aac-47a8-4ecc-b018-396de8c0c23a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:18.229522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-649d7aac-47a8-4ecc-b018-396de8c0c23a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:18.271479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f640f470-c905-49c5-a022-5107f302f062 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:18.282998 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f640f470-c905-49c5-a022-5107f302f062 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1524 microversion: 2.1 time: 0.360318 Jul 28 03:52:18.284259 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1949/3509] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:17 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1524 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:18.291709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6841d795-1786-42fc-b1f0-ec5870e62997 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:18.297748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6841d795-1786-42fc-b1f0-ec5870e62997 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:18.298721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6841d795-1786-42fc-b1f0-ec5870e62997 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:52:18.308838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6841d795-1786-42fc-b1f0-ec5870e62997 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:18.309611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6841d795-1786-42fc-b1f0-ec5870e62997 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:18.310758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6841d795-1786-42fc-b1f0-ec5870e62997 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:18.311208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6841d795-1786-42fc-b1f0-ec5870e62997 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:18.481282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-6841d795-1786-42fc-b1f0-ec5870e62997 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:52:18.563633 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6841d795-1786-42fc-b1f0-ec5870e62997 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.278037 Jul 28 03:52:18.575847 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1950/3510] 10.222.0.48 () {58 vars in 1212 bytes} [Thu Jul 28 03:52:18 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:18.575847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7388d613-7821-4525-80d5-cf915a350774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:18.575847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7388d613-7821-4525-80d5-cf915a350774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:18.577989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7388d613-7821-4525-80d5-cf915a350774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:18.578538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7388d613-7821-4525-80d5-cf915a350774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:18.579413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7388d613-7821-4525-80d5-cf915a350774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:18.579965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7388d613-7821-4525-80d5-cf915a350774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:18.664387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7388d613-7821-4525-80d5-cf915a350774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:18.680740 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7388d613-7821-4525-80d5-cf915a350774 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1611 microversion: 2.1 time: 0.114824 Jul 28 03:52:18.681959 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1951/3511] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:18 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1611 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:18.690396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66e68b85-6ab8-4945-b159-ef889f1f277b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:18.696315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-66e68b85-6ab8-4945-b159-ef889f1f277b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:18.697328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-66e68b85-6ab8-4945-b159-ef889f1f277b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:52:18.711944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66e68b85-6ab8-4945-b159-ef889f1f277b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:18.712905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66e68b85-6ab8-4945-b159-ef889f1f277b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:18.714056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66e68b85-6ab8-4945-b159-ef889f1f277b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:18.714731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66e68b85-6ab8-4945-b159-ef889f1f277b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:18.837052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-66e68b85-6ab8-4945-b159-ef889f1f277b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:52:18.942700 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-66e68b85-6ab8-4945-b159-ef889f1f277b tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.259005 Jul 28 03:52:18.944260 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1952/3512] 10.222.0.48 () {58 vars in 1196 bytes} [Thu Jul 28 03:52:18 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:18.955728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7cb93994-b19f-4cd9-860c-59d89a299442 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:18.957357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7cb93994-b19f-4cd9-860c-59d89a299442 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:18.970339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cb93994-b19f-4cd9-860c-59d89a299442 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:18.970947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cb93994-b19f-4cd9-860c-59d89a299442 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:18.971921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cb93994-b19f-4cd9-860c-59d89a299442 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:18.972542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cb93994-b19f-4cd9-860c-59d89a299442 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:19.002000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-649d7aac-47a8-4ecc-b018-396de8c0c23a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:19.044478 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-649d7aac-47a8-4ecc-b018-396de8c0c23a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1501 microversion: 2.1 time: 0.833684 Jul 28 03:52:19.071478 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1561/3513] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:18 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1501 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:19.094859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f7c6c7ea-1339-4941-afd1-2a6054e5eb5f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:19.095924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f7c6c7ea-1339-4941-afd1-2a6054e5eb5f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:19.124436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7c6c7ea-1339-4941-afd1-2a6054e5eb5f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:19.125322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7c6c7ea-1339-4941-afd1-2a6054e5eb5f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:19.126478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7c6c7ea-1339-4941-afd1-2a6054e5eb5f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:19.132541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7cb93994-b19f-4cd9-860c-59d89a299442 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:19.133467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7c6c7ea-1339-4941-afd1-2a6054e5eb5f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:19.147801 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7cb93994-b19f-4cd9-860c-59d89a299442 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1423 microversion: 2.1 time: 0.201728 Jul 28 03:52:19.176478 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1953/3514] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:18 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1423 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:19.176478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-95f6600a-4c8e-4b18-b999-a286528d1d3c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:19.186004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-95f6600a-4c8e-4b18-b999-a286528d1d3c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:19.186570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-95f6600a-4c8e-4b18-b999-a286528d1d3c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'name': '1651517927', 'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:52:19.223543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95f6600a-4c8e-4b18-b999-a286528d1d3c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:19.223997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95f6600a-4c8e-4b18-b999-a286528d1d3c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:19.224830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95f6600a-4c8e-4b18-b999-a286528d1d3c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:19.225272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95f6600a-4c8e-4b18-b999-a286528d1d3c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:19.351102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-95f6600a-4c8e-4b18-b999-a286528d1d3c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:52:19.473632 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-95f6600a-4c8e-4b18-b999-a286528d1d3c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers?name=1651517927" status: 200 len: 346 microversion: 2.1 time: 0.305652 Jul 28 03:52:19.479266 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1954/3515] 10.222.0.48 () {58 vars in 1156 bytes} [Thu Jul 28 03:52:19 2022] GET /compute/v2.1/servers?name=1651517927 => generated 346 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:19.501761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c2424bd8-2f9a-41ac-810f-b2f88d24c306 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:19.505403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c2424bd8-2f9a-41ac-810f-b2f88d24c306 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:19.546262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c2424bd8-2f9a-41ac-810f-b2f88d24c306 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:19.549624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c2424bd8-2f9a-41ac-810f-b2f88d24c306 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:19.553128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c2424bd8-2f9a-41ac-810f-b2f88d24c306 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:19.556165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c2424bd8-2f9a-41ac-810f-b2f88d24c306 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:19.629863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c2424bd8-2f9a-41ac-810f-b2f88d24c306 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:52:19.640668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:19.901141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f7c6c7ea-1339-4941-afd1-2a6054e5eb5f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:19.920103 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c2424bd8-2f9a-41ac-810f-b2f88d24c306 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 204 len: 0 microversion: 2.1 time: 0.438892 Jul 28 03:52:19.926074 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1955/3516] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:52:19 2022] DELETE /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:52:19.926320 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f7c6c7ea-1339-4941-afd1-2a6054e5eb5f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1317 microversion: 2.1 time: 0.850518 Jul 28 03:52:19.926839 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1562/3517] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:19 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1317 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:19.940049 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e98cbd63-ea66-478d-99d4-32191254c367 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:19.957478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e98cbd63-ea66-478d-99d4-32191254c367 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:19.957985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f3e0bc00-7671-4b12-bc3b-13c1060bab34 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:19.958806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e98cbd63-ea66-478d-99d4-32191254c367 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:52:19.961764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f3e0bc00-7671-4b12-bc3b-13c1060bab34 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:19.979329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3e0bc00-7671-4b12-bc3b-13c1060bab34 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:19.979779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3e0bc00-7671-4b12-bc3b-13c1060bab34 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:19.986348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3e0bc00-7671-4b12-bc3b-13c1060bab34 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:19.986936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3e0bc00-7671-4b12-bc3b-13c1060bab34 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:19.988674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e98cbd63-ea66-478d-99d4-32191254c367 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:19.989440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e98cbd63-ea66-478d-99d4-32191254c367 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:19.990832 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e98cbd63-ea66-478d-99d4-32191254c367 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:20.008827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e98cbd63-ea66-478d-99d4-32191254c367 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:20.146621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-e98cbd63-ea66-478d-99d4-32191254c367 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:52:20.333686 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e98cbd63-ea66-478d-99d4-32191254c367 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.405623 Jul 28 03:52:20.344397 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1563/3518] 10.222.0.48 () {58 vars in 1154 bytes} [Thu Jul 28 03:52:19 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:20.349866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-fc4c7925-355a-4e29-8de1-cba5795567eb req-0fb36c54-2d40-4337-b6f3-4a4239184dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "022dc911-465a-4044-8ac3-52bf6cdf8612", "name": "network-vif-deleted", "tag": "70fad463-b5e0-490a-be92-a6a1e4248f1c"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:20.382631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-fc4c7925-355a-4e29-8de1-cba5795567eb req-0fb36c54-2d40-4337-b6f3-4a4239184dd4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:20.383426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-fc4c7925-355a-4e29-8de1-cba5795567eb req-0fb36c54-2d40-4337-b6f3-4a4239184dd4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:20.408731 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-fc4c7925-355a-4e29-8de1-cba5795567eb req-0fb36c54-2d40-4337-b6f3-4a4239184dd4 service nova] Creating event network-vif-deleted:70fad463-b5e0-490a-be92-a6a1e4248f1c for instance 022dc911-465a-4044-8ac3-52bf6cdf8612 on n-h2-826756-3 Jul 28 03:52:20.422314 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-fc4c7925-355a-4e29-8de1-cba5795567eb req-0fb36c54-2d40-4337-b6f3-4a4239184dd4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076092 Jul 28 03:52:20.424591 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1564/3519] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:20.439493 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5db87656-9de3-45ce-976b-890cf8af0409 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:20.444163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5db87656-9de3-45ce-976b-890cf8af0409 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:20.461276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5db87656-9de3-45ce-976b-890cf8af0409 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:20.461999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5db87656-9de3-45ce-976b-890cf8af0409 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:20.467417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5db87656-9de3-45ce-976b-890cf8af0409 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:20.468082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5db87656-9de3-45ce-976b-890cf8af0409 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:20.540413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f3e0bc00-7671-4b12-bc3b-13c1060bab34 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:20.549104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5db87656-9de3-45ce-976b-890cf8af0409 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:20.549964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5db87656-9de3-45ce-976b-890cf8af0409 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:20.550678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-5db87656-9de3-45ce-976b-890cf8af0409 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lazy-loading 'fault' on Instance uuid a314625b-adb1-45fa-9483-b084005a11b6 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:52:20.571758 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f3e0bc00-7671-4b12-bc3b-13c1060bab34 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1524 microversion: 2.1 time: 0.641752 Jul 28 03:52:20.575134 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1956/3520] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:19 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1524 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:20.607972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9ecca15a-d7ef-45ff-8d05-9f75de70529b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:20.608665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9ecca15a-d7ef-45ff-8d05-9f75de70529b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:20.624619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ecca15a-d7ef-45ff-8d05-9f75de70529b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:20.631903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ecca15a-d7ef-45ff-8d05-9f75de70529b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:20.635113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ecca15a-d7ef-45ff-8d05-9f75de70529b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:20.636012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ecca15a-d7ef-45ff-8d05-9f75de70529b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:20.695215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5db87656-9de3-45ce-976b-890cf8af0409 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:20.711447 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5db87656-9de3-45ce-976b-890cf8af0409 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 200 len: 1330 microversion: 2.1 time: 0.285190 Jul 28 03:52:20.714950 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1565/3521] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:20 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 1330 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:20.740889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1d8544d0-9913-48fa-8684-35efc4664b83 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:20.741861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1d8544d0-9913-48fa-8684-35efc4664b83 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:20.751059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1d8544d0-9913-48fa-8684-35efc4664b83 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:20.751911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1d8544d0-9913-48fa-8684-35efc4664b83 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:20.755312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1d8544d0-9913-48fa-8684-35efc4664b83 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:20.756317 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1d8544d0-9913-48fa-8684-35efc4664b83 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:20.797450 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1d8544d0-9913-48fa-8684-35efc4664b83 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:20.798319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1d8544d0-9913-48fa-8684-35efc4664b83 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:20.799124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-1d8544d0-9913-48fa-8684-35efc4664b83 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lazy-loading 'fault' on Instance uuid 022dc911-465a-4044-8ac3-52bf6cdf8612 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:52:20.803519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:20.866891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1d8544d0-9913-48fa-8684-35efc4664b83 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:20.880174 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1d8544d0-9913-48fa-8684-35efc4664b83 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 200 len: 1300 microversion: 2.1 time: 0.159672 Jul 28 03:52:20.897298 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1566/3522] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:20 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 1300 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:20.902835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7cc267c0-cf95-4842-b6a7-5d5919fe52ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:20.914010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7cc267c0-cf95-4842-b6a7-5d5919fe52ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:20.927820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7cc267c0-cf95-4842-b6a7-5d5919fe52ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-165151792', 'deleted': False, 'project_id': '4986ce186af44fea81f404b2b28c111d'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:52:20.950783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cc267c0-cf95-4842-b6a7-5d5919fe52ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:20.951388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cc267c0-cf95-4842-b6a7-5d5919fe52ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:20.952321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cc267c0-cf95-4842-b6a7-5d5919fe52ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:20.956968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cc267c0-cf95-4842-b6a7-5d5919fe52ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:21.116701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-7cc267c0-cf95-4842-b6a7-5d5919fe52ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:52:21.241576 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7cc267c0-cf95-4842-b6a7-5d5919fe52ae tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-165151792" status: 200 len: 346 microversion: 2.1 time: 0.341708 Jul 28 03:52:21.252656 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1567/3523] 10.222.0.48 () {58 vars in 1228 bytes} [Thu Jul 28 03:52:20 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-165151792 => generated 346 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:21.259879 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5cac4048-d55a-4084-baf5-a93d2a806b33 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:21.261556 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5cac4048-d55a-4084-baf5-a93d2a806b33 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:21.269805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5cac4048-d55a-4084-baf5-a93d2a806b33 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:21.270361 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5cac4048-d55a-4084-baf5-a93d2a806b33 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:21.271455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5cac4048-d55a-4084-baf5-a93d2a806b33 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:21.272371 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5cac4048-d55a-4084-baf5-a93d2a806b33 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:21.388380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9ecca15a-d7ef-45ff-8d05-9f75de70529b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:21.400606 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9ecca15a-d7ef-45ff-8d05-9f75de70529b tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.809752 Jul 28 03:52:21.412441 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1957/3524] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:20 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:21.412441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a850e53e-9c51-4541-bea4-5f5d54c38541 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:21.412441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a850e53e-9c51-4541-bea4-5f5d54c38541 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:21.421177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a850e53e-9c51-4541-bea4-5f5d54c38541 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:21.421177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a850e53e-9c51-4541-bea4-5f5d54c38541 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:21.421177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a850e53e-9c51-4541-bea4-5f5d54c38541 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:21.421177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a850e53e-9c51-4541-bea4-5f5d54c38541 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:21.476831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a850e53e-9c51-4541-bea4-5f5d54c38541 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:52:21.648074 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a850e53e-9c51-4541-bea4-5f5d54c38541 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 204 len: 0 microversion: 2.1 time: 0.245130 Jul 28 03:52:21.650780 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1958/3525] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:52:21 2022] DELETE /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:52:21.660041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5cac4048-d55a-4084-baf5-a93d2a806b33 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:21.664536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d1357d1d-56c5-4953-9f3f-4525e7f186b6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:21.666079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d1357d1d-56c5-4953-9f3f-4525e7f186b6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:21.678377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1357d1d-56c5-4953-9f3f-4525e7f186b6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:21.679223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1357d1d-56c5-4953-9f3f-4525e7f186b6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:21.680155 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5cac4048-d55a-4084-baf5-a93d2a806b33 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1317 microversion: 2.1 time: 0.418900 Jul 28 03:52:21.680463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1357d1d-56c5-4953-9f3f-4525e7f186b6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:21.683431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1357d1d-56c5-4953-9f3f-4525e7f186b6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:21.685211 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1568/3526] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:21 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:21.710656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-226d1fbc-f9e8-4e53-8ec3-13902ac490fa tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:21.711002 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-226d1fbc-f9e8-4e53-8ec3-13902ac490fa tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:21.718452 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-226d1fbc-f9e8-4e53-8ec3-13902ac490fa tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:21.720059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-226d1fbc-f9e8-4e53-8ec3-13902ac490fa tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:21.731685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-226d1fbc-f9e8-4e53-8ec3-13902ac490fa tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:21.731685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-226d1fbc-f9e8-4e53-8ec3-13902ac490fa tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:21.987010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d1357d1d-56c5-4953-9f3f-4525e7f186b6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:21.996609 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d1357d1d-56c5-4953-9f3f-4525e7f186b6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1524 microversion: 2.1 time: 0.339895 Jul 28 03:52:21.997229 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1959/3527] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:21 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1524 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:22.008692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-65148cab-115c-4d19-a13b-543328aedfad tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:22.008692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-65148cab-115c-4d19-a13b-543328aedfad tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:22.015030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65148cab-115c-4d19-a13b-543328aedfad tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:22.015030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65148cab-115c-4d19-a13b-543328aedfad tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:22.015842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65148cab-115c-4d19-a13b-543328aedfad tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:22.016394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65148cab-115c-4d19-a13b-543328aedfad tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:22.038768 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-65148cab-115c-4d19-a13b-543328aedfad tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] HTTP exception thrown: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-65148cab-115c-4d19-a13b-543328aedfad tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Request method failure captured: Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 HTTP/1.1 Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gca3wwj6vf3mcE1k3p04a-IB_aHJ4q2aQgyaMGEamuHOXYtT8sTCQ39msigigoKDkTgI0q27esncQkdsISfIdor8uYi2ofpy2xxPUYcBX6T1jxeXp0Wz1yCRt_oOue5jQOpZsPCIWzJpvRA8Ld9LSF337wCVS7VtPTruWEjBErR8iQ Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 781ab005138547038def64d108937e3e Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781ab005138547038def64d108937e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781ab005138547038def64d108937e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}] Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 781ab005138547038def64d108937e3e Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d20381abd9784627887af3cb97cd68a8 Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a314625b-adb1-45fa-9483-b084005a11b6'} Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:22.041438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:22.054144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:22.054144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:22.054144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:22.054144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:52:22.054144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:52:22.054144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:52:22.054144 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:22.054144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-65148cab-115c-4d19-a13b-543328aedfad tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Returning 404 to user: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:52:22.054144 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-65148cab-115c-4d19-a13b-543328aedfad tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 404 len: 111 microversion: 2.1 time: 0.045020 Jul 28 03:52:22.054144 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1960/3528] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:21 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:52:22.054144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-629bc4c2-9bb3-4074-8703-029b2adfba1f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:22.060377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-629bc4c2-9bb3-4074-8703-029b2adfba1f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 022dc911-465a-4044-8ac3-52bf6cdf8612] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:22.066925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-629bc4c2-9bb3-4074-8703-029b2adfba1f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:22.067887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-629bc4c2-9bb3-4074-8703-029b2adfba1f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:22.069534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-629bc4c2-9bb3-4074-8703-029b2adfba1f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:22.070314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-629bc4c2-9bb3-4074-8703-029b2adfba1f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:22.083394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-226d1fbc-f9e8-4e53-8ec3-13902ac490fa tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:22.095435 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-226d1fbc-f9e8-4e53-8ec3-13902ac490fa tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1517 microversion: 2.1 time: 0.408709 Jul 28 03:52:22.101672 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1569/3529] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:21 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1517 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:22.120952 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-629bc4c2-9bb3-4074-8703-029b2adfba1f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] HTTP exception thrown: Instance 022dc911-465a-4044-8ac3-52bf6cdf8612 could not be found. Jul 28 03:52:22.123073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3de4cfc1-740d-4554-b82b-4524e239db4a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '.version_select at 0x7ffa749db5e0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-629bc4c2-9bb3-4074-8703-029b2adfba1f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Request method failure captured: Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 HTTP/1.1 Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gaKcX578nbjGiUiXaydMbgAOBWSPKDXeu38gaIcAqwRpIc6837eYzymj4L8IE_F12C4XVPwuRTuWQTy7Qb3deFMwfikgaBlUpk_DTRqqXqN480FOh6GvyyIqd880qBogQS5MgLrvQXb27r29WhQYiSQz2zc93UTCvSsyhl162V7L9s Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: da4a22e4560a4210bb58942cec62c091 Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-MigrationsAdminTest-1644568816 Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da4a22e4560a4210bb58942cec62c091"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da4a22e4560a4210bb58942cec62c091"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da4a22e4560a4210bb58942cec62c091"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da4a22e4560a4210bb58942cec62c091"}]}] Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-MigrationsAdminTest-1644568816 Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: da4a22e4560a4210bb58942cec62c091 Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-MigrationsAdminTest-1644568816 Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-MigrationsAdminTest-1644568816-project Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ac9d734be6ee4b549f9ed389c276f54a Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-MigrationsAdminTest-1644568816-project Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 022dc911-465a-4044-8ac3-52bf6cdf8612 could not be found. Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '022dc911-465a-4044-8ac3-52bf6cdf8612'} Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022dc911-465a-4044-8ac3-52bf6cdf8612 could not be found. Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022dc911-465a-4044-8ac3-52bf6cdf8612 could not be found. Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:22.136434 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:22.141660 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:22.141660 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:22.141660 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:22.141660 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:52:22.141660 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:52:22.141660 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022dc911-465a-4044-8ac3-52bf6cdf8612 could not be found. Jul 28 03:52:22.141660 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:22.141660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-629bc4c2-9bb3-4074-8703-029b2adfba1f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Returning 404 to user: Instance 022dc911-465a-4044-8ac3-52bf6cdf8612 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:52:22.141660 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-629bc4c2-9bb3-4074-8703-029b2adfba1f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612" status: 404 len: 111 microversion: 2.1 time: 0.093185 Jul 28 03:52:22.144774 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1961/3530] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:22 2022] GET /compute/v2.1/servers/022dc911-465a-4044-8ac3-52bf6cdf8612 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:52:22.154507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d5f22b7-9f00-48ea-8417-e0073c434e43 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:22.155308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4d5f22b7-9f00-48ea-8417-e0073c434e43 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:22.160049 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3de4cfc1-740d-4554-b82b-4524e239db4a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-814177108" status: 202 len: 0 microversion: 2.1 time: 0.056409 Jul 28 03:52:22.170747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d5f22b7-9f00-48ea-8417-e0073c434e43 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:22.171496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d5f22b7-9f00-48ea-8417-e0073c434e43 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:22.172887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d5f22b7-9f00-48ea-8417-e0073c434e43 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:22.173640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d5f22b7-9f00-48ea-8417-e0073c434e43 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:22.184102 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1570/3531] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 03:52:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-814177108 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:52:22.268481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4d5f22b7-9f00-48ea-8417-e0073c434e43 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:52:22.434156 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1dc1c949-9e23-40c7-94a2-92f44cfb9bc7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:22.444529 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1dc1c949-9e23-40c7-94a2-92f44cfb9bc7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:22.459847 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d5f22b7-9f00-48ea-8417-e0073c434e43 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 204 len: 0 microversion: 2.1 time: 0.312522 Jul 28 03:52:22.463079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1dc1c949-9e23-40c7-94a2-92f44cfb9bc7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:22.469426 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1962/3532] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:52:22 2022] DELETE /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:52:22.470009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1dc1c949-9e23-40c7-94a2-92f44cfb9bc7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:22.472001 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1dc1c949-9e23-40c7-94a2-92f44cfb9bc7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:22.485200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1dc1c949-9e23-40c7-94a2-92f44cfb9bc7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:22.488161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0c08e968-fedb-45b9-85f0-6fed15808b8f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:22.489409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0c08e968-fedb-45b9-85f0-6fed15808b8f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:22.500841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c08e968-fedb-45b9-85f0-6fed15808b8f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:22.501649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c08e968-fedb-45b9-85f0-6fed15808b8f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:22.503038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c08e968-fedb-45b9-85f0-6fed15808b8f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:22.504538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c08e968-fedb-45b9-85f0-6fed15808b8f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:22.795319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0c08e968-fedb-45b9-85f0-6fed15808b8f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:22.820381 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0c08e968-fedb-45b9-85f0-6fed15808b8f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1469 microversion: 2.1 time: 0.349047 Jul 28 03:52:22.822663 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1963/3533] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:22 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1469 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:22.830549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0748292f-0241-4aa5-b87f-3d0bbbf08942 req-f6c2cdac-dc08-4fba-847d-fefeca3070b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a314625b-adb1-45fa-9483-b084005a11b6", "name": "network-vif-deleted", "tag": "64ff1826-6714-4cbc-a27d-442eaec6ddd7"}, {"name": "network-changed", "server_uuid": "92736c04-fa08-430a-8ca3-03e849df899b", "tag": "73e19a03-28e6-4a71-a676-4f947ab1f597"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:22.868892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0748292f-0241-4aa5-b87f-3d0bbbf08942 req-f6c2cdac-dc08-4fba-847d-fefeca3070b5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:22.870064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0748292f-0241-4aa5-b87f-3d0bbbf08942 req-f6c2cdac-dc08-4fba-847d-fefeca3070b5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:22.895698 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0748292f-0241-4aa5-b87f-3d0bbbf08942 req-f6c2cdac-dc08-4fba-847d-fefeca3070b5 service nova] Creating event network-vif-deleted:64ff1826-6714-4cbc-a27d-442eaec6ddd7 for instance a314625b-adb1-45fa-9483-b084005a11b6 on n-h2-826756-3 Jul 28 03:52:22.896780 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0748292f-0241-4aa5-b87f-3d0bbbf08942 req-f6c2cdac-dc08-4fba-847d-fefeca3070b5 service nova] Creating event network-changed:73e19a03-28e6-4a71-a676-4f947ab1f597 for instance 92736c04-fa08-430a-8ca3-03e849df899b on n-h2-826756-3 Jul 28 03:52:22.911159 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0748292f-0241-4aa5-b87f-3d0bbbf08942 req-f6c2cdac-dc08-4fba-847d-fefeca3070b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.086692 Jul 28 03:52:22.915853 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1964/3534] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:22.951018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-162805c3-a963-487f-8e9e-6c614605cf2a tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:22.952849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-162805c3-a963-487f-8e9e-6c614605cf2a tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:22.975041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-162805c3-a963-487f-8e9e-6c614605cf2a tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:22.976051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-162805c3-a963-487f-8e9e-6c614605cf2a tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:22.977127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-162805c3-a963-487f-8e9e-6c614605cf2a tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:22.977838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-162805c3-a963-487f-8e9e-6c614605cf2a tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:22.980746 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1dc1c949-9e23-40c7-94a2-92f44cfb9bc7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:22.995150 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1dc1c949-9e23-40c7-94a2-92f44cfb9bc7 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.566924 Jul 28 03:52:22.996063 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1571/3535] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:22 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:23.058059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7a550550-a8a7-4ec3-ac0d-d1925a5de653 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:23.058059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7a550550-a8a7-4ec3-ac0d-d1925a5de653 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:23.066417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a550550-a8a7-4ec3-ac0d-d1925a5de653 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:23.067189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a550550-a8a7-4ec3-ac0d-d1925a5de653 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:23.068506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a550550-a8a7-4ec3-ac0d-d1925a5de653 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:23.069362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a550550-a8a7-4ec3-ac0d-d1925a5de653 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:23.333774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7a550550-a8a7-4ec3-ac0d-d1925a5de653 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:23.345968 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7a550550-a8a7-4ec3-ac0d-d1925a5de653 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1524 microversion: 2.1 time: 0.318588 Jul 28 03:52:23.346578 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1572/3536] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:23 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1524 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:23.360124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-162805c3-a963-487f-8e9e-6c614605cf2a tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:23.361862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1e2a0a60-90d5-4200-b1d8-ddc2c2f6feab tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:23.363275 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1e2a0a60-90d5-4200-b1d8-ddc2c2f6feab tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:23.383520 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-162805c3-a963-487f-8e9e-6c614605cf2a tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1317 microversion: 2.1 time: 0.449919 Jul 28 03:52:23.383882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e2a0a60-90d5-4200-b1d8-ddc2c2f6feab tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:23.384902 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1965/3537] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:22 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:23.387937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e2a0a60-90d5-4200-b1d8-ddc2c2f6feab tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:23.390125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e2a0a60-90d5-4200-b1d8-ddc2c2f6feab tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:23.390678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e2a0a60-90d5-4200-b1d8-ddc2c2f6feab tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:23.727283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1e2a0a60-90d5-4200-b1d8-ddc2c2f6feab tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:23.737417 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1e2a0a60-90d5-4200-b1d8-ddc2c2f6feab tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1517 microversion: 2.1 time: 0.384081 Jul 28 03:52:23.739155 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1573/3538] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:23 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1517 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:23.850305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-562607f9-2bc7-4e9e-a5b2-fb673d3f582f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:23.851306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-562607f9-2bc7-4e9e-a5b2-fb673d3f582f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:23.867575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-562607f9-2bc7-4e9e-a5b2-fb673d3f582f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:23.868040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-562607f9-2bc7-4e9e-a5b2-fb673d3f582f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:23.878606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-562607f9-2bc7-4e9e-a5b2-fb673d3f582f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:23.879319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-562607f9-2bc7-4e9e-a5b2-fb673d3f582f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:23.919921 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39b0c87f-3331-4731-a83d-cda5ce95ddc8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Action: 'create', calling method: .version_select at 0x7ffa741caee0>, body: {"keypair": {"name": "tempest-keypair-631985019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF404XijwxnTPgvEYKOKK0/p01lpgMqcu6uZoZrsVF6XQ55zv92+xPmU53mzUqxYwVO/jKYp958nDWPLtfOGnGvgVeCQVkZS2+op8TW1t1drZ5JWIg8yNceIBOZ0ZCefDw=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:23.940254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-39b0c87f-3331-4731-a83d-cda5ce95ddc8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for project 781ab005138547038def64d108937e3e. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:52:23.947871 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-39b0c87f-3331-4731-a83d-cda5ce95ddc8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for user d20381abd9784627887af3cb97cd68a8 and project 781ab005138547038def64d108937e3e. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:52:23.995089 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-39b0c87f-3331-4731-a83d-cda5ce95ddc8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.083672 Jul 28 03:52:23.996511 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1574/3539] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:52:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:52:24.019800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-29e319aa-a552-4685-9bc8-7fe3c43cea05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:24.020606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-29e319aa-a552-4685-9bc8-7fe3c43cea05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:24.029185 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-29e319aa-a552-4685-9bc8-7fe3c43cea05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:24.029819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-29e319aa-a552-4685-9bc8-7fe3c43cea05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:24.030820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-29e319aa-a552-4685-9bc8-7fe3c43cea05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:24.031356 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-29e319aa-a552-4685-9bc8-7fe3c43cea05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:24.184589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-562607f9-2bc7-4e9e-a5b2-fb673d3f582f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:24.196956 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-562607f9-2bc7-4e9e-a5b2-fb673d3f582f tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1469 microversion: 2.1 time: 0.353682 Jul 28 03:52:24.197943 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1966/3540] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:23 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1469 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:24.369703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0fea4e8a-1f9b-466f-b06a-67aa56b86de0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:24.370626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0fea4e8a-1f9b-466f-b06a-67aa56b86de0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:24.380690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fea4e8a-1f9b-466f-b06a-67aa56b86de0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:24.381649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fea4e8a-1f9b-466f-b06a-67aa56b86de0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:24.391713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fea4e8a-1f9b-466f-b06a-67aa56b86de0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:24.391827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fea4e8a-1f9b-466f-b06a-67aa56b86de0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:24.832962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0fea4e8a-1f9b-466f-b06a-67aa56b86de0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:24.848137 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0fea4e8a-1f9b-466f-b06a-67aa56b86de0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1524 microversion: 2.1 time: 0.482800 Jul 28 03:52:24.849072 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1967/3541] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:24 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1524 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:24.861317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-21d26394-6cf8-464c-a976-be6c5e766908 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:24.862719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-21d26394-6cf8-464c-a976-be6c5e766908 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:24.867251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:24.876811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21d26394-6cf8-464c-a976-be6c5e766908 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:24.877443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21d26394-6cf8-464c-a976-be6c5e766908 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:24.879309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21d26394-6cf8-464c-a976-be6c5e766908 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:24.879780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21d26394-6cf8-464c-a976-be6c5e766908 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:25.176058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-21d26394-6cf8-464c-a976-be6c5e766908 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:25.181818 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-29e319aa-a552-4685-9bc8-7fe3c43cea05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:25.190596 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-21d26394-6cf8-464c-a976-be6c5e766908 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1317 microversion: 2.1 time: 0.338631 Jul 28 03:52:25.191283 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-29e319aa-a552-4685-9bc8-7fe3c43cea05 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 1.175739 Jul 28 03:52:25.196927 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1575/3542] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:24 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:25.202177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5e1f3899-f48a-4e92-8424-5c486e44fe2c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:25.205144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5e1f3899-f48a-4e92-8424-5c486e44fe2c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:25.205668 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1968/3543] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:24 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:25.220874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8b8c13ed-ada3-4168-989e-acbfdc4ff2e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:25.221813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8b8c13ed-ada3-4168-989e-acbfdc4ff2e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:25.222270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e1f3899-f48a-4e92-8424-5c486e44fe2c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:25.222955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e1f3899-f48a-4e92-8424-5c486e44fe2c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:25.225921 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e1f3899-f48a-4e92-8424-5c486e44fe2c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:25.226669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e1f3899-f48a-4e92-8424-5c486e44fe2c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:25.238739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b8c13ed-ada3-4168-989e-acbfdc4ff2e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:25.239938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b8c13ed-ada3-4168-989e-acbfdc4ff2e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:25.242609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b8c13ed-ada3-4168-989e-acbfdc4ff2e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:25.244465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b8c13ed-ada3-4168-989e-acbfdc4ff2e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:25.274102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:25.659658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8b8c13ed-ada3-4168-989e-acbfdc4ff2e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:25.671914 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8b8c13ed-ada3-4168-989e-acbfdc4ff2e5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1469 microversion: 2.1 time: 0.456134 Jul 28 03:52:25.694815 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1969/3544] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:25 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1469 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:25.875856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-60f85c11-250f-495a-8468-4e80b2d40f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:25.877938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-60f85c11-250f-495a-8468-4e80b2d40f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:25.903883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60f85c11-250f-495a-8468-4e80b2d40f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:25.904727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60f85c11-250f-495a-8468-4e80b2d40f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:25.906374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60f85c11-250f-495a-8468-4e80b2d40f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:25.907481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60f85c11-250f-495a-8468-4e80b2d40f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:25.938294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5e1f3899-f48a-4e92-8424-5c486e44fe2c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:25.948075 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5e1f3899-f48a-4e92-8424-5c486e44fe2c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1517 microversion: 2.1 time: 0.749687 Jul 28 03:52:25.960788 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1576/3545] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:25 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1517 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:26.161242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-60f85c11-250f-495a-8468-4e80b2d40f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:26.174452 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-60f85c11-250f-495a-8468-4e80b2d40f36 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1524 microversion: 2.1 time: 0.303602 Jul 28 03:52:26.175050 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1970/3546] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:25 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1524 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:26.215488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3c7ade2b-7d36-460d-ae18-0080c8f0c928 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:26.216514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e56a0570-0515-47ae-bbdd-e0bb2864a440 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:26.217037 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3c7ade2b-7d36-460d-ae18-0080c8f0c928 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:26.217594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e56a0570-0515-47ae-bbdd-e0bb2864a440 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:26.228183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c7ade2b-7d36-460d-ae18-0080c8f0c928 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:26.230785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e56a0570-0515-47ae-bbdd-e0bb2864a440 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:26.231851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e56a0570-0515-47ae-bbdd-e0bb2864a440 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:26.233556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e56a0570-0515-47ae-bbdd-e0bb2864a440 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:26.234253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e56a0570-0515-47ae-bbdd-e0bb2864a440 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:26.241261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c7ade2b-7d36-460d-ae18-0080c8f0c928 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:26.242444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c7ade2b-7d36-460d-ae18-0080c8f0c928 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:26.242898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3c7ade2b-7d36-460d-ae18-0080c8f0c928 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:26.487331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e56a0570-0515-47ae-bbdd-e0bb2864a440 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:26.499104 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e56a0570-0515-47ae-bbdd-e0bb2864a440 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1507 microversion: 2.1 time: 0.286591 Jul 28 03:52:26.500060 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1971/3547] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:26 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1507 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:26.695685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40427577-f48f-4c70-981e-015ba9b39fd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:26.704688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40427577-f48f-4c70-981e-015ba9b39fd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:26.715403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:26.718554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40427577-f48f-4c70-981e-015ba9b39fd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:26.719633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40427577-f48f-4c70-981e-015ba9b39fd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:26.720957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40427577-f48f-4c70-981e-015ba9b39fd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:26.721571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40427577-f48f-4c70-981e-015ba9b39fd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:26.821422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40427577-f48f-4c70-981e-015ba9b39fd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:26.835408 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40427577-f48f-4c70-981e-015ba9b39fd5 tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1427 microversion: 2.1 time: 0.144725 Jul 28 03:52:26.836832 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1972/3548] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:26 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1427 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:26.976992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-99fee68d-73cc-4606-af79-35f217ee36f0 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:26.977684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-99fee68d-73cc-4606-af79-35f217ee36f0 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:26.993591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-99fee68d-73cc-4606-af79-35f217ee36f0 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:26.996581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-99fee68d-73cc-4606-af79-35f217ee36f0 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:26.997804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-99fee68d-73cc-4606-af79-35f217ee36f0 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:27.000235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-99fee68d-73cc-4606-af79-35f217ee36f0 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:27.227303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3c7ade2b-7d36-460d-ae18-0080c8f0c928 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:27.236742 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3c7ade2b-7d36-460d-ae18-0080c8f0c928 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1317 microversion: 2.1 time: 1.025157 Jul 28 03:52:27.248379 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1577/3549] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:26 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1317 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:27.254122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-546094612", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "693f524d-65ea-4c5a-b83d-05789d71bfe6"}], "security_groups": [{"name": "tempest-securitygroup--1799498810"}], "key_name": "tempest-keypair-631985019", "user_data": "}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:27.283004 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:27.306711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-99fee68d-73cc-4606-af79-35f217ee36f0 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:27.319576 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-99fee68d-73cc-4606-af79-35f217ee36f0 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1517 microversion: 2.1 time: 0.348700 Jul 28 03:52:27.320938 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1973/3550] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:26 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1517 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:27.327522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fd4bad39-a6ca-4276-879d-740bf0f5fe4d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:27.328598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fd4bad39-a6ca-4276-879d-740bf0f5fe4d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:27.374344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd4bad39-a6ca-4276-879d-740bf0f5fe4d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:27.375172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd4bad39-a6ca-4276-879d-740bf0f5fe4d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:27.376316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd4bad39-a6ca-4276-879d-740bf0f5fe4d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:27.376932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd4bad39-a6ca-4276-879d-740bf0f5fe4d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:27.726094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fd4bad39-a6ca-4276-879d-740bf0f5fe4d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:27.737060 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fd4bad39-a6ca-4276-879d-740bf0f5fe4d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1524 microversion: 2.1 time: 0.414011 Jul 28 03:52:27.743372 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1974/3551] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:27 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1524 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:27.756695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-efe7cb05-b5e2-4cc1-9c25-4ef87d96b8b0 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:27.758494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-efe7cb05-b5e2-4cc1-9c25-4ef87d96b8b0 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:27.792778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efe7cb05-b5e2-4cc1-9c25-4ef87d96b8b0 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:27.793392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efe7cb05-b5e2-4cc1-9c25-4ef87d96b8b0 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:27.794258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efe7cb05-b5e2-4cc1-9c25-4ef87d96b8b0 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:27.794707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efe7cb05-b5e2-4cc1-9c25-4ef87d96b8b0 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:27.820393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] validate_networks() for [('693f524d-65ea-4c5a-b83d-05789d71bfe6', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:52:28.012677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-efe7cb05-b5e2-4cc1-9c25-4ef87d96b8b0 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:28.024781 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-efe7cb05-b5e2-4cc1-9c25-4ef87d96b8b0 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 200 len: 1465 microversion: 2.1 time: 0.279789 Jul 28 03:52:28.041466 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1975/3552] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:27 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 1465 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:28.056004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-143a318e-6f8f-4e77-acbf-03c51eed9b6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:28.056946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-143a318e-6f8f-4e77-acbf-03c51eed9b6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:28.066276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-143a318e-6f8f-4e77-acbf-03c51eed9b6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:28.068141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-143a318e-6f8f-4e77-acbf-03c51eed9b6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:28.070104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-143a318e-6f8f-4e77-acbf-03c51eed9b6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:28.070873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-143a318e-6f8f-4e77-acbf-03c51eed9b6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:28.306787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-143a318e-6f8f-4e77-acbf-03c51eed9b6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9d734be6ee4b549f9ed389c276f54a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da4a22e4560a4210bb58942cec62c091', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:28.319856 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-143a318e-6f8f-4e77-acbf-03c51eed9b6b tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 200 len: 1427 microversion: 2.1 time: 0.276795 Jul 28 03:52:28.324014 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1976/3553] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:28 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 1427 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:28.336984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d087a262-f5a8-49f3-99e2-8bcbf0513a37 req-a78c4fa0-8712-4434-b26c-260791e5c81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1779e378-a42a-40cb-9037-1ee317601146", "name": "network-vif-deleted", "tag": "a7d6effa-8de5-424a-9d5c-d66436bc0ad1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:28.386400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d087a262-f5a8-49f3-99e2-8bcbf0513a37 req-a78c4fa0-8712-4434-b26c-260791e5c81c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:28.387717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d087a262-f5a8-49f3-99e2-8bcbf0513a37 req-a78c4fa0-8712-4434-b26c-260791e5c81c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:28.436150 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-d087a262-f5a8-49f3-99e2-8bcbf0513a37 req-a78c4fa0-8712-4434-b26c-260791e5c81c service nova] Creating event network-vif-deleted:a7d6effa-8de5-424a-9d5c-d66436bc0ad1 for instance 1779e378-a42a-40cb-9037-1ee317601146 on n-h1-826756-3 Jul 28 03:52:28.470947 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d087a262-f5a8-49f3-99e2-8bcbf0513a37 req-a78c4fa0-8712-4434-b26c-260791e5c81c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133921 Jul 28 03:52:28.474218 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1977/3554] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:28.489012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8917214f-209d-484d-aaeb-ff0b4a5cdcd0 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:28.490357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8917214f-209d-484d-aaeb-ff0b4a5cdcd0 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:28.500289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8917214f-209d-484d-aaeb-ff0b4a5cdcd0 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:28.500955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8917214f-209d-484d-aaeb-ff0b4a5cdcd0 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:28.501970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8917214f-209d-484d-aaeb-ff0b4a5cdcd0 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:28.503658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8917214f-209d-484d-aaeb-ff0b4a5cdcd0 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:28.813790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8917214f-209d-484d-aaeb-ff0b4a5cdcd0 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:28.838396 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8917214f-209d-484d-aaeb-ff0b4a5cdcd0 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1317 microversion: 2.1 time: 0.348645 Jul 28 03:52:28.840181 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1978/3555] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:28 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:28.855821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9366d15-450a-4aa5-a8f1-fa04f86e081e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:28.862984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9366d15-450a-4aa5-a8f1-fa04f86e081e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:28.875656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9366d15-450a-4aa5-a8f1-fa04f86e081e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:28.876223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9366d15-450a-4aa5-a8f1-fa04f86e081e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:28.877096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9366d15-450a-4aa5-a8f1-fa04f86e081e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:28.877593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9366d15-450a-4aa5-a8f1-fa04f86e081e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:28.975157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9366d15-450a-4aa5-a8f1-fa04f86e081e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:28.976307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9366d15-450a-4aa5-a8f1-fa04f86e081e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:28.976963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-b9366d15-450a-4aa5-a8f1-fa04f86e081e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lazy-loading 'fault' on Instance uuid 3639d857-7077-4ba1-a880-8d0c9822845d {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:52:29.177869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b9366d15-450a-4aa5-a8f1-fa04f86e081e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:29.189736 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9366d15-450a-4aa5-a8f1-fa04f86e081e tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 200 len: 1309 microversion: 2.1 time: 0.346403 Jul 28 03:52:29.192739 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1979/3556] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:28 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 1309 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:29.207326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-90af284d-ae2c-4203-aead-b566827e1947 req-0b87828d-ed15-4386-bdce-3e4585620aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92736c04-fa08-430a-8ca3-03e849df899b", "name": "network-vif-plugged", "status": "completed", "tag": "73e19a03-28e6-4a71-a676-4f947ab1f597"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:29.211808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:52:29.212685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:52:29.212804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:52:29.213139 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:52:29.213612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:52:29.234656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:29.242848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:29.244246 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:29.244736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:29.254193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-90af284d-ae2c-4203-aead-b566827e1947 req-0b87828d-ed15-4386-bdce-3e4585620aa8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:29.256212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-90af284d-ae2c-4203-aead-b566827e1947 req-0b87828d-ed15-4386-bdce-3e4585620aa8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:29.268709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:29.289685 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-90af284d-ae2c-4203-aead-b566827e1947 req-0b87828d-ed15-4386-bdce-3e4585620aa8 service nova] Creating event network-vif-plugged:73e19a03-28e6-4a71-a676-4f947ab1f597 for instance 92736c04-fa08-430a-8ca3-03e849df899b on n-h2-826756-3 Jul 28 03:52:29.290937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for project 781ab005138547038def64d108937e3e. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:52:29.304032 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-90af284d-ae2c-4203-aead-b566827e1947 req-0b87828d-ed15-4386-bdce-3e4585620aa8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109722 Jul 28 03:52:29.306013 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1980/3557] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:29.316950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a8ad72fc-0a99-4b61-99c2-4fdb06089d3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:29.318289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a8ad72fc-0a99-4b61-99c2-4fdb06089d3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:29.321095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for user d20381abd9784627887af3cb97cd68a8 and project 781ab005138547038def64d108937e3e. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:52:29.332243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8ad72fc-0a99-4b61-99c2-4fdb06089d3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:29.333584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8ad72fc-0a99-4b61-99c2-4fdb06089d3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:29.335372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8ad72fc-0a99-4b61-99c2-4fdb06089d3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:29.336338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8ad72fc-0a99-4b61-99c2-4fdb06089d3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:29.381637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:52:29.391334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:52:29.532435 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cef05d2b-a00d-4441-8976-ce2e7d25da04 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.287003 Jul 28 03:52:29.533185 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1578/3558] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:52:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 2289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:52:29.546146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-90f2b310-d16d-46e0-826f-a8e3c72a8fc3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:29.547798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-90f2b310-d16d-46e0-826f-a8e3c72a8fc3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 1779e378-a42a-40cb-9037-1ee317601146] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:29.606507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a8ad72fc-0a99-4b61-99c2-4fdb06089d3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:29.618476 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a8ad72fc-0a99-4b61-99c2-4fdb06089d3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1524 microversion: 2.1 time: 0.310643 Jul 28 03:52:29.619084 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1981/3559] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:29 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1524 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:29.620528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90f2b310-d16d-46e0-826f-a8e3c72a8fc3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:29.622590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90f2b310-d16d-46e0-826f-a8e3c72a8fc3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:29.624073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90f2b310-d16d-46e0-826f-a8e3c72a8fc3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:29.624874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-90f2b310-d16d-46e0-826f-a8e3c72a8fc3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:29.628159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f464c49-915d-4a60-ad63-cb503c80ef3c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:29.629417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8f464c49-915d-4a60-ad63-cb503c80ef3c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] [instance: 6ce84a29-c300-4be9-934b-93e5af74e3eb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:29.656084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f464c49-915d-4a60-ad63-cb503c80ef3c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:29.656917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f464c49-915d-4a60-ad63-cb503c80ef3c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:29.659968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f464c49-915d-4a60-ad63-cb503c80ef3c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:29.660641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f464c49-915d-4a60-ad63-cb503c80ef3c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:29.663741 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-90f2b310-d16d-46e0-826f-a8e3c72a8fc3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] HTTP exception thrown: Instance 1779e378-a42a-40cb-9037-1ee317601146 could not be found. Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-90f2b310-d16d-46e0-826f-a8e3c72a8fc3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Request method failure captured: Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 HTTP/1.1 Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gdyqq3ExEutxtLorBUrSmeRX9e97Dm7EO5_tTl-t26JI1a1kzaUUeaJiARxe0GeLFQTGJOxNKIge83EohiNirBC1HaJXrkxPxOnVG7tVfYuM_7aHVn8JYEgkQjnZBPU-hFitR1sWaVkKMQcgEOxE9XJOWutLhBG9isu20VVSfed-tk Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 14a740ef28ff4ceaa9879883f86d0da5 Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerRescueTestJSON-217792854 Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/14a740ef28ff4ceaa9879883f86d0da5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14a740ef28ff4ceaa9879883f86d0da5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_14a740ef28ff4ceaa9879883f86d0da5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14a740ef28ff4ceaa9879883f86d0da5"}]}] Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerRescueTestJSON-217792854 Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 14a740ef28ff4ceaa9879883f86d0da5 Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerRescueTestJSON-217792854 Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerRescueTestJSON-217792854-project Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 0b9f8f65f4724b7899491e805177cf1d Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerRescueTestJSON-217792854-project Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 1779e378-a42a-40cb-9037-1ee317601146 could not be found. Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '1779e378-a42a-40cb-9037-1ee317601146'} Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1779e378-a42a-40cb-9037-1ee317601146 could not be found. Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1779e378-a42a-40cb-9037-1ee317601146 could not be found. Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:29.665819 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:29.671093 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:29.671093 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:29.671093 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:29.671093 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:52:29.671093 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:52:29.671093 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1779e378-a42a-40cb-9037-1ee317601146 could not be found. Jul 28 03:52:29.671093 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:29.672688 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-90f2b310-d16d-46e0-826f-a8e3c72a8fc3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Returning 404 to user: Instance 1779e378-a42a-40cb-9037-1ee317601146 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:52:29.675032 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-90f2b310-d16d-46e0-826f-a8e3c72a8fc3 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146" status: 404 len: 111 microversion: 2.1 time: 0.139407 Jul 28 03:52:29.675809 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1579/3560] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:29 2022] GET /compute/v2.1/servers/1779e378-a42a-40cb-9037-1ee317601146 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:52:29.685315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b045f29-b5e7-4895-a342-83f2217a72e1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:29.686101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2b045f29-b5e7-4895-a342-83f2217a72e1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:29.700949 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-8f464c49-915d-4a60-ad63-cb503c80ef3c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] HTTP exception thrown: Instance 6ce84a29-c300-4be9-934b-93e5af74e3eb could not be found. Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f464c49-915d-4a60-ad63-cb503c80ef3c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Request method failure captured: Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb HTTP/1.1 Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gaKcX578nbjGiUiXaydMbgAOBWSPKDXeu38gaIcAqwRpIc6837eYzymj4L8IE_F12C4XVPwuRTuWQTy7Qb3deFMwfikgaBlUpk_DTRqqXqN480FOh6GvyyIqd880qBogQS5MgLrvQXb27r29WhQYiSQz2zc93UTCvSsyhl162V7L9s Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: da4a22e4560a4210bb58942cec62c091 Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-MigrationsAdminTest-1644568816 Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/da4a22e4560a4210bb58942cec62c091"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da4a22e4560a4210bb58942cec62c091"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_da4a22e4560a4210bb58942cec62c091"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/da4a22e4560a4210bb58942cec62c091"}]}] Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-MigrationsAdminTest-1644568816 Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: da4a22e4560a4210bb58942cec62c091 Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-MigrationsAdminTest-1644568816 Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-MigrationsAdminTest-1644568816-project Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ac9d734be6ee4b549f9ed389c276f54a Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-MigrationsAdminTest-1644568816-project Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 6ce84a29-c300-4be9-934b-93e5af74e3eb could not be found. Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '6ce84a29-c300-4be9-934b-93e5af74e3eb'} Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ce84a29-c300-4be9-934b-93e5af74e3eb could not be found. Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ce84a29-c300-4be9-934b-93e5af74e3eb could not be found. Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:29.706141 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:29.711228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:29.711228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:29.711228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:29.711228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:52:29.711228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:52:29.711228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ce84a29-c300-4be9-934b-93e5af74e3eb could not be found. Jul 28 03:52:29.711228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:29.711228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f464c49-915d-4a60-ad63-cb503c80ef3c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] Returning 404 to user: Instance 6ce84a29-c300-4be9-934b-93e5af74e3eb could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:52:29.711228 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8f464c49-915d-4a60-ad63-cb503c80ef3c tempest-MigrationsAdminTest-1644568816 tempest-MigrationsAdminTest-1644568816-project] 10.222.0.48 "GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb" status: 404 len: 111 microversion: 2.1 time: 0.088049 Jul 28 03:52:29.717572 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1982/3561] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:29 2022] GET /compute/v2.1/servers/6ce84a29-c300-4be9-934b-93e5af74e3eb => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:52:29.735852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f691d0d-7e48-46e0-88f6-60fa9ec92ec4 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:29.738124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6f691d0d-7e48-46e0-88f6-60fa9ec92ec4 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:29.752147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f691d0d-7e48-46e0-88f6-60fa9ec92ec4 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:29.752557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f691d0d-7e48-46e0-88f6-60fa9ec92ec4 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:29.753354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f691d0d-7e48-46e0-88f6-60fa9ec92ec4 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:29.753790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f691d0d-7e48-46e0-88f6-60fa9ec92ec4 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:29.814136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6f691d0d-7e48-46e0-88f6-60fa9ec92ec4 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:52:29.834702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2b045f29-b5e7-4895-a342-83f2217a72e1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:29.850473 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2b045f29-b5e7-4895-a342-83f2217a72e1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1240 microversion: 2.1 time: 0.169921 Jul 28 03:52:29.864384 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1580/3562] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:29 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1240 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:29.866657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-63b26500-e893-4a26-973d-8858ba2108c8 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:29.870761 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-63b26500-e893-4a26-973d-8858ba2108c8 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:29.881151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-63b26500-e893-4a26-973d-8858ba2108c8 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:29.881946 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-63b26500-e893-4a26-973d-8858ba2108c8 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:29.883371 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-63b26500-e893-4a26-973d-8858ba2108c8 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:29.884015 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-63b26500-e893-4a26-973d-8858ba2108c8 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:30.064678 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6f691d0d-7e48-46e0-88f6-60fa9ec92ec4 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 204 len: 0 microversion: 2.1 time: 0.345112 Jul 28 03:52:30.065783 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1983/3563] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:52:29 2022] DELETE /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:52:30.098072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb649207-c211-499c-8631-25b3dfa6a80f tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:30.098795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb649207-c211-499c-8631-25b3dfa6a80f tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:30.116540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb649207-c211-499c-8631-25b3dfa6a80f tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:30.126930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb649207-c211-499c-8631-25b3dfa6a80f tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:30.127853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb649207-c211-499c-8631-25b3dfa6a80f tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:30.128317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb649207-c211-499c-8631-25b3dfa6a80f tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:30.289970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-63b26500-e893-4a26-973d-8858ba2108c8 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:30.298533 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-63b26500-e893-4a26-973d-8858ba2108c8 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1317 microversion: 2.1 time: 0.437513 Jul 28 03:52:30.300399 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1581/3564] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:29 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1317 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:30.305475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c9483375-120a-488d-9f0b-9f25caa8dacd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:30.306584 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c9483375-120a-488d-9f0b-9f25caa8dacd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 3639d857-7077-4ba1-a880-8d0c9822845d] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:30.332288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9483375-120a-488d-9f0b-9f25caa8dacd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:30.333091 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9483375-120a-488d-9f0b-9f25caa8dacd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:30.342225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9483375-120a-488d-9f0b-9f25caa8dacd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:30.343146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9483375-120a-488d-9f0b-9f25caa8dacd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:30.372561 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-c9483375-120a-488d-9f0b-9f25caa8dacd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] HTTP exception thrown: Instance 3639d857-7077-4ba1-a880-8d0c9822845d could not be found. Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c9483375-120a-488d-9f0b-9f25caa8dacd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Request method failure captured: Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d HTTP/1.1 Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gelcjeT-ds6SK4re9dbIZOnYJjgNXok09uMkeVQMAjioMq22yJclt6vVoyXzavVV1h-rZp02jIdhFTWSCWqLsegQUhgweIVtIyhyw5wgDl6aqWSQ-YIO9cT22vhR_53pba28LYvBSH6FSAyoG4M8-T35bXrWFj02weobDUmt7okoR4 Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 4986ce186af44fea81f404b2b28c111d Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ListServerFiltersTestJSON-188963721 Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4986ce186af44fea81f404b2b28c111d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4986ce186af44fea81f404b2b28c111d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4986ce186af44fea81f404b2b28c111d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4986ce186af44fea81f404b2b28c111d"}]}] Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ListServerFiltersTestJSON-188963721 Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 4986ce186af44fea81f404b2b28c111d Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-188963721 Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ListServerFiltersTestJSON-188963721-project Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 45d31becde7f4984932272266a7e1867 Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ListServerFiltersTestJSON-188963721-project Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 3639d857-7077-4ba1-a880-8d0c9822845d could not be found. Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '3639d857-7077-4ba1-a880-8d0c9822845d'} Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3639d857-7077-4ba1-a880-8d0c9822845d could not be found. Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3639d857-7077-4ba1-a880-8d0c9822845d could not be found. Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:30.376626 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:30.385613 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:30.385613 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:30.385613 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:30.385613 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:52:30.385613 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:52:30.385613 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3639d857-7077-4ba1-a880-8d0c9822845d could not be found. Jul 28 03:52:30.385613 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:30.385613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c9483375-120a-488d-9f0b-9f25caa8dacd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Returning 404 to user: Instance 3639d857-7077-4ba1-a880-8d0c9822845d could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:52:30.385613 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c9483375-120a-488d-9f0b-9f25caa8dacd tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d" status: 404 len: 111 microversion: 2.1 time: 0.077207 Jul 28 03:52:30.385613 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1582/3565] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:30 2022] GET /compute/v2.1/servers/3639d857-7077-4ba1-a880-8d0c9822845d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:52:30.396502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4a1a59a6-13cf-429b-9e55-dabb2937927f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:30.397504 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4a1a59a6-13cf-429b-9e55-dabb2937927f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: f7a4251e-80ef-4e70-aa87-29d50b7e5c26] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:30.408947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a1a59a6-13cf-429b-9e55-dabb2937927f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:30.409689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a1a59a6-13cf-429b-9e55-dabb2937927f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:30.411289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a1a59a6-13cf-429b-9e55-dabb2937927f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:30.412008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a1a59a6-13cf-429b-9e55-dabb2937927f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:30.480804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4a1a59a6-13cf-429b-9e55-dabb2937927f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: f7a4251e-80ef-4e70-aa87-29d50b7e5c26] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:52:30.509767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fb649207-c211-499c-8631-25b3dfa6a80f tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:30.521517 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fb649207-c211-499c-8631-25b3dfa6a80f tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1491 microversion: 2.1 time: 0.439167 Jul 28 03:52:30.522136 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1984/3566] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:30 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1491 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:30.549651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6bbf68be-47d0-414e-950c-c958dba4ee0e req-5a3d7d8a-7066-4007-a42c-2368c2d0e678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ce84a29-c300-4be9-934b-93e5af74e3eb", "name": "network-vif-deleted", "tag": "e6b88eec-69c4-4857-90b1-4a08af8688ff"}, {"server_uuid": "3639d857-7077-4ba1-a880-8d0c9822845d", "name": "network-vif-deleted", "tag": "887fcfc4-1119-4e02-a17f-5125c132b986"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:30.573046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6bbf68be-47d0-414e-950c-c958dba4ee0e req-5a3d7d8a-7066-4007-a42c-2368c2d0e678 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:30.573568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6bbf68be-47d0-414e-950c-c958dba4ee0e req-5a3d7d8a-7066-4007-a42c-2368c2d0e678 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:30.600638 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6bbf68be-47d0-414e-950c-c958dba4ee0e req-5a3d7d8a-7066-4007-a42c-2368c2d0e678 service nova] Creating event network-vif-deleted:e6b88eec-69c4-4857-90b1-4a08af8688ff for instance 6ce84a29-c300-4be9-934b-93e5af74e3eb on n-h2-826756-3 Jul 28 03:52:30.601287 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6bbf68be-47d0-414e-950c-c958dba4ee0e req-5a3d7d8a-7066-4007-a42c-2368c2d0e678 service nova] Creating event network-vif-deleted:887fcfc4-1119-4e02-a17f-5125c132b986 for instance 3639d857-7077-4ba1-a880-8d0c9822845d on n-h1-826756-3 Jul 28 03:52:30.611754 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6bbf68be-47d0-414e-950c-c958dba4ee0e req-5a3d7d8a-7066-4007-a42c-2368c2d0e678 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070873 Jul 28 03:52:30.618306 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1985/3567] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:52:30.644460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-812e3a0b-31a1-44a9-b066-0d997a6298b7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:30.645486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-812e3a0b-31a1-44a9-b066-0d997a6298b7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:30.650572 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4a1a59a6-13cf-429b-9e55-dabb2937927f tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26" status: 204 len: 0 microversion: 2.1 time: 0.260447 Jul 28 03:52:30.652456 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1583/3568] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:52:30 2022] DELETE /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:52:30.662527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-812e3a0b-31a1-44a9-b066-0d997a6298b7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:30.664083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-812e3a0b-31a1-44a9-b066-0d997a6298b7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:30.665083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-812e3a0b-31a1-44a9-b066-0d997a6298b7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:30.665631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-812e3a0b-31a1-44a9-b066-0d997a6298b7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:30.671328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-663d2ea8-d906-4489-9198-5c136388699c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:30.672686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-663d2ea8-d906-4489-9198-5c136388699c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: f7a4251e-80ef-4e70-aa87-29d50b7e5c26] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:30.687385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-663d2ea8-d906-4489-9198-5c136388699c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:30.688886 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-663d2ea8-d906-4489-9198-5c136388699c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:30.691165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-663d2ea8-d906-4489-9198-5c136388699c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:30.692165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-663d2ea8-d906-4489-9198-5c136388699c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:30.929764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-812e3a0b-31a1-44a9-b066-0d997a6298b7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:30.932392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:30.941386 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-812e3a0b-31a1-44a9-b066-0d997a6298b7 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1524 microversion: 2.1 time: 0.304495 Jul 28 03:52:30.942320 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1986/3569] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:30 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1524 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:30.950050 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-663d2ea8-d906-4489-9198-5c136388699c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:30.962818 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-663d2ea8-d906-4489-9198-5c136388699c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26" status: 200 len: 1517 microversion: 2.1 time: 0.301487 Jul 28 03:52:30.964650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1e8f63ab-4e89-44ab-8b51-01c2b0456349 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:30.966517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1e8f63ab-4e89-44ab-8b51-01c2b0456349 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:30.967180 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1584/3570] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:30 2022] GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26 => generated 1517 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:30.979595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e8f63ab-4e89-44ab-8b51-01c2b0456349 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:30.979869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e8f63ab-4e89-44ab-8b51-01c2b0456349 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:30.980479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e8f63ab-4e89-44ab-8b51-01c2b0456349 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:30.981162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e8f63ab-4e89-44ab-8b51-01c2b0456349 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:31.108755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1e8f63ab-4e89-44ab-8b51-01c2b0456349 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:31.118218 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1e8f63ab-4e89-44ab-8b51-01c2b0456349 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1244 microversion: 2.1 time: 0.173696 Jul 28 03:52:31.119203 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1987/3571] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:30 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1244 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:31.335090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-75c0adba-58c7-4580-9cd8-2fb73a503b7e tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:31.336479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-75c0adba-58c7-4580-9cd8-2fb73a503b7e tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:31.351147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75c0adba-58c7-4580-9cd8-2fb73a503b7e tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:31.352039 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75c0adba-58c7-4580-9cd8-2fb73a503b7e tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:31.353658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75c0adba-58c7-4580-9cd8-2fb73a503b7e tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:31.354799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75c0adba-58c7-4580-9cd8-2fb73a503b7e tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:31.545136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e56d164-0a49-4464-a9f3-1d6daf65f87d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:31.546104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e56d164-0a49-4464-a9f3-1d6daf65f87d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:31.553808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e56d164-0a49-4464-a9f3-1d6daf65f87d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:31.554627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e56d164-0a49-4464-a9f3-1d6daf65f87d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:31.555555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e56d164-0a49-4464-a9f3-1d6daf65f87d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:31.556059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e56d164-0a49-4464-a9f3-1d6daf65f87d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:31.771554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e56d164-0a49-4464-a9f3-1d6daf65f87d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:31.780101 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e56d164-0a49-4464-a9f3-1d6daf65f87d tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1491 microversion: 2.1 time: 0.239636 Jul 28 03:52:31.799726 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1988/3572] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:31 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1491 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:31.981819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-441f80ea-b9e8-4bd6-bc2f-662e38d92819 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:31.982965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-441f80ea-b9e8-4bd6-bc2f-662e38d92819 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:31.998264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-441f80ea-b9e8-4bd6-bc2f-662e38d92819 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:32.000277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-441f80ea-b9e8-4bd6-bc2f-662e38d92819 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:32.004626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-441f80ea-b9e8-4bd6-bc2f-662e38d92819 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:32.006718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-441f80ea-b9e8-4bd6-bc2f-662e38d92819 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:32.011537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-75c0adba-58c7-4580-9cd8-2fb73a503b7e tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:32.033851 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-75c0adba-58c7-4580-9cd8-2fb73a503b7e tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1317 microversion: 2.1 time: 0.708014 Jul 28 03:52:32.045062 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1585/3573] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:31 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:32.079831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-86726e7d-3464-45b1-b5c0-71cd49053457 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:32.081210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-86726e7d-3464-45b1-b5c0-71cd49053457 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: f7a4251e-80ef-4e70-aa87-29d50b7e5c26] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:32.103071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86726e7d-3464-45b1-b5c0-71cd49053457 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:32.103809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86726e7d-3464-45b1-b5c0-71cd49053457 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:32.105128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86726e7d-3464-45b1-b5c0-71cd49053457 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:32.105874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86726e7d-3464-45b1-b5c0-71cd49053457 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:32.131280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:32.252969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-441f80ea-b9e8-4bd6-bc2f-662e38d92819 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:32.276851 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-441f80ea-b9e8-4bd6-bc2f-662e38d92819 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1524 microversion: 2.1 time: 0.314693 Jul 28 03:52:32.277475 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1989/3574] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:31 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1524 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:32.313213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66277a98-741d-4d17-9818-d24dd7aa405b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:32.313977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-66277a98-741d-4d17-9818-d24dd7aa405b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:32.328283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66277a98-741d-4d17-9818-d24dd7aa405b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:32.328814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66277a98-741d-4d17-9818-d24dd7aa405b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:32.329642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66277a98-741d-4d17-9818-d24dd7aa405b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:32.330093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66277a98-741d-4d17-9818-d24dd7aa405b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:32.466570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-66277a98-741d-4d17-9818-d24dd7aa405b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:32.488517 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-66277a98-741d-4d17-9818-d24dd7aa405b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1236 microversion: 2.1 time: 0.181027 Jul 28 03:52:32.525771 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1990/3575] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:32 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1236 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:32.753081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-86726e7d-3464-45b1-b5c0-71cd49053457 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:32.784086 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-86726e7d-3464-45b1-b5c0-71cd49053457 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26" status: 200 len: 1517 microversion: 2.1 time: 0.725677 Jul 28 03:52:32.786634 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1586/3576] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:32 2022] GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26 => generated 1517 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:32.813169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6746f8a5-9026-42cd-9cc6-34da4c0c5780 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:32.814525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6746f8a5-9026-42cd-9cc6-34da4c0c5780 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:32.824429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6746f8a5-9026-42cd-9cc6-34da4c0c5780 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:32.825223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6746f8a5-9026-42cd-9cc6-34da4c0c5780 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:32.826384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6746f8a5-9026-42cd-9cc6-34da4c0c5780 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:32.826995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6746f8a5-9026-42cd-9cc6-34da4c0c5780 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:33.086174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ffa857bf-6c57-496d-826c-14907fe753f5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:33.087867 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ffa857bf-6c57-496d-826c-14907fe753f5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:33.102896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ffa857bf-6c57-496d-826c-14907fe753f5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:33.106206 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ffa857bf-6c57-496d-826c-14907fe753f5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:33.109919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ffa857bf-6c57-496d-826c-14907fe753f5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:33.115049 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ffa857bf-6c57-496d-826c-14907fe753f5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:33.192928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6746f8a5-9026-42cd-9cc6-34da4c0c5780 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:33.202030 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6746f8a5-9026-42cd-9cc6-34da4c0c5780 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1491 microversion: 2.1 time: 0.399713 Jul 28 03:52:33.203344 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1991/3577] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:32 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1491 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:33.301262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc077620-965c-4267-b80e-c0ae4e39fc3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:33.302016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dc077620-965c-4267-b80e-c0ae4e39fc3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:33.308755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc077620-965c-4267-b80e-c0ae4e39fc3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:33.309588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc077620-965c-4267-b80e-c0ae4e39fc3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:33.310603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc077620-965c-4267-b80e-c0ae4e39fc3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:33.311267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc077620-965c-4267-b80e-c0ae4e39fc3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:33.716427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ffa857bf-6c57-496d-826c-14907fe753f5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:33.742930 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ffa857bf-6c57-496d-826c-14907fe753f5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1506 microversion: 2.1 time: 0.659434 Jul 28 03:52:33.744370 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1587/3578] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:33 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1506 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:33.750722 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-570a1cb9-f931-44b7-ab83-3a67aebc93a8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:33.751959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-570a1cb9-f931-44b7-ab83-3a67aebc93a8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:33.761722 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-570a1cb9-f931-44b7-ab83-3a67aebc93a8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:33.764384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-570a1cb9-f931-44b7-ab83-3a67aebc93a8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:33.765930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-570a1cb9-f931-44b7-ab83-3a67aebc93a8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:33.767880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-570a1cb9-f931-44b7-ab83-3a67aebc93a8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:33.942554 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-570a1cb9-f931-44b7-ab83-3a67aebc93a8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:33.955423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dc077620-965c-4267-b80e-c0ae4e39fc3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:33.966106 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc077620-965c-4267-b80e-c0ae4e39fc3c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1506 microversion: 2.1 time: 0.669010 Jul 28 03:52:33.966813 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-570a1cb9-f931-44b7-ab83-3a67aebc93a8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1298 microversion: 2.1 time: 0.218056 Jul 28 03:52:33.967499 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1588/3579] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:33 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1298 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:33.968043 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1992/3580] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:33 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1506 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:33.981765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b51b3d11-9e2f-41eb-a04b-fcf0f3e276fb tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:33.985927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e6c1af34-e9d6-4547-a90f-aa613c036922 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:33.986966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b51b3d11-9e2f-41eb-a04b-fcf0f3e276fb tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: f7a4251e-80ef-4e70-aa87-29d50b7e5c26] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:33.987733 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e6c1af34-e9d6-4547-a90f-aa613c036922 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:34.001136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b51b3d11-9e2f-41eb-a04b-fcf0f3e276fb tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.001555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b51b3d11-9e2f-41eb-a04b-fcf0f3e276fb tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.003363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6c1af34-e9d6-4547-a90f-aa613c036922 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.003809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6c1af34-e9d6-4547-a90f-aa613c036922 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.004599 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6c1af34-e9d6-4547-a90f-aa613c036922 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.005029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6c1af34-e9d6-4547-a90f-aa613c036922 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.010204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b51b3d11-9e2f-41eb-a04b-fcf0f3e276fb tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.010657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b51b3d11-9e2f-41eb-a04b-fcf0f3e276fb tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.073232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e6c1af34-e9d6-4547-a90f-aa613c036922 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:34.074795 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e6c1af34-e9d6-4547-a90f-aa613c036922 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b/os-instance-actions/req-92c13a84-9035-4f7b-983c-e0657bbf8bcc" status: 200 len: 313 microversion: 2.1 time: 0.105176 Jul 28 03:52:34.075599 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1589/3581] 10.222.0.48 () {58 vars in 1419 bytes} [Thu Jul 28 03:52:33 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b/os-instance-actions/req-92c13a84-9035-4f7b-983c-e0657bbf8bcc => generated 313 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:34.089014 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c274c0e8-b56b-4798-84a6-b33ab37c18a5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:34.091543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c274c0e8-b56b-4798-84a6-b33ab37c18a5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:34.098606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c274c0e8-b56b-4798-84a6-b33ab37c18a5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.099156 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c274c0e8-b56b-4798-84a6-b33ab37c18a5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.100019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c274c0e8-b56b-4798-84a6-b33ab37c18a5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.100625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c274c0e8-b56b-4798-84a6-b33ab37c18a5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.183268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b51b3d11-9e2f-41eb-a04b-fcf0f3e276fb tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:34.193191 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b51b3d11-9e2f-41eb-a04b-fcf0f3e276fb tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26" status: 200 len: 1517 microversion: 2.1 time: 0.222469 Jul 28 03:52:34.194404 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1993/3582] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:33 2022] GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26 => generated 1517 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:34.198281 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c274c0e8-b56b-4798-84a6-b33ab37c18a5 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "POST /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b/action" status: 202 len: 0 microversion: 2.1 time: 0.111255 Jul 28 03:52:34.199743 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1590/3583] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:52:34 2022] POST /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:52:34.223649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f490b45-fc5d-4414-859d-7bed700c46de tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:34.224753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2f490b45-fc5d-4414-859d-7bed700c46de tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:34.233501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f490b45-fc5d-4414-859d-7bed700c46de tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.234236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f490b45-fc5d-4414-859d-7bed700c46de tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.235564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f490b45-fc5d-4414-859d-7bed700c46de tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.237596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f490b45-fc5d-4414-859d-7bed700c46de tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.395116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3ec7be63-80f4-4062-b634-ba2f6ecffada tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Action: 'update', calling method: .version_select at 0x7ffa67af4280>, body: {"quota_set": {"ram": "5120"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:34.422639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2f490b45-fc5d-4414-859d-7bed700c46de tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:34.431341 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2f490b45-fc5d-4414-859d-7bed700c46de tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1508 microversion: 2.1 time: 0.226524 Jul 28 03:52:34.431937 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1994/3584] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:34 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1508 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:34.437018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f2074886-3e20-4d72-ab0e-15086d66eb27 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:34.437920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f2074886-3e20-4d72-ab0e-15086d66eb27 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:34.444564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2074886-3e20-4d72-ab0e-15086d66eb27 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.445259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2074886-3e20-4d72-ab0e-15086d66eb27 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.446283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2074886-3e20-4d72-ab0e-15086d66eb27 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.446951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2074886-3e20-4d72-ab0e-15086d66eb27 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.523509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ec7be63-80f4-4062-b634-ba2f6ecffada tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.526405 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ec7be63-80f4-4062-b634-ba2f6ecffada tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.527680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ec7be63-80f4-4062-b634-ba2f6ecffada tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.528423 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ec7be63-80f4-4062-b634-ba2f6ecffada tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.535322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f2074886-3e20-4d72-ab0e-15086d66eb27 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:34.553372 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f2074886-3e20-4d72-ab0e-15086d66eb27 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1449 microversion: 2.1 time: 0.119601 Jul 28 03:52:34.554446 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1995/3585] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:34 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1449 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:34.595685 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3ec7be63-80f4-4062-b634-ba2f6ecffada tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/60031e095a6d42fea5d8a38966df6ae1" status: 200 len: 148 microversion: 2.57 time: 0.380680 Jul 28 03:52:34.596939 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1591/3586] 10.222.0.48 () {62 vars in 1303 bytes} [Thu Jul 28 03:52:34 2022] PUT /compute/v2.1/os-quota-sets/60031e095a6d42fea5d8a38966df6ae1 => generated 148 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:52:34.602884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-72347e77-5a91-4d2d-acc8-e746597e5913 req-02208e5b-82ad-4d54-9ea7-86721cb735a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b9af60f-ae9a-44b4-ab96-f43afbc198d5", "name": "network-vif-deleted", "tag": "429f22a0-45cf-4946-8f46-5b7f631d5396"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:34.611621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-291a323e-2cde-471a-ba4e-d768cc9a0918 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Calling method '.version_select at 0x7ffa67ae4a60>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:34.613587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-72347e77-5a91-4d2d-acc8-e746597e5913 req-02208e5b-82ad-4d54-9ea7-86721cb735a0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.614264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-72347e77-5a91-4d2d-acc8-e746597e5913 req-02208e5b-82ad-4d54-9ea7-86721cb735a0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.631739 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-72347e77-5a91-4d2d-acc8-e746597e5913 req-02208e5b-82ad-4d54-9ea7-86721cb735a0 service nova] Creating event network-vif-deleted:429f22a0-45cf-4946-8f46-5b7f631d5396 for instance 4b9af60f-ae9a-44b4-ab96-f43afbc198d5 on n-h1-826756-3 Jul 28 03:52:34.637000 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-72347e77-5a91-4d2d-acc8-e746597e5913 req-02208e5b-82ad-4d54-9ea7-86721cb735a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038043 Jul 28 03:52:34.637693 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1996/3587] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:34.688631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-291a323e-2cde-471a-ba4e-d768cc9a0918 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.689345 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-291a323e-2cde-471a-ba4e-d768cc9a0918 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.690160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-291a323e-2cde-471a-ba4e-d768cc9a0918 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.690591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-291a323e-2cde-471a-ba4e-d768cc9a0918 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.711153 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-291a323e-2cde-471a-ba4e-d768cc9a0918 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/60031e095a6d42fea5d8a38966df6ae1/detail" status: 200 len: 463 microversion: 2.57 time: 0.105278 Jul 28 03:52:34.711693 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1592/3588] 10.222.0.48 () {60 vars in 1304 bytes} [Thu Jul 28 03:52:34 2022] GET /compute/v2.1/os-quota-sets/60031e095a6d42fea5d8a38966df6ae1/detail => generated 463 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:52:34.874459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce76a005-5f5f-49c8-8d8e-3c7eee29bf9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:34.875377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ce76a005-5f5f-49c8-8d8e-3c7eee29bf9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:34.875852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e45283c6-99e2-4e05-8380-ed30e1627c68 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Action: 'update', calling method: .version_select at 0x7ffa741cf0d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:34.883666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce76a005-5f5f-49c8-8d8e-3c7eee29bf9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.885635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce76a005-5f5f-49c8-8d8e-3c7eee29bf9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.886653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce76a005-5f5f-49c8-8d8e-3c7eee29bf9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.887272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce76a005-5f5f-49c8-8d8e-3c7eee29bf9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.919769 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce76a005-5f5f-49c8-8d8e-3c7eee29bf9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/ips" status: 200 len: 153 microversion: 2.20 time: 0.050376 Jul 28 03:52:34.920719 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1997/3589] 10.222.0.48 () {60 vars in 1289 bytes} [Thu Jul 28 03:52:34 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/ips => generated 153 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:52:34.969433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e45283c6-99e2-4e05-8380-ed30e1627c68 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.970621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e45283c6-99e2-4e05-8380-ed30e1627c68 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.972529 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e45283c6-99e2-4e05-8380-ed30e1627c68 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:34.973829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e45283c6-99e2-4e05-8380-ed30e1627c68 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:34.991816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-65654183-ffa5-431c-886c-477b3835bb0d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:34.992801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-65654183-ffa5-431c-886c-477b3835bb0d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:35.000444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65654183-ffa5-431c-886c-477b3835bb0d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:35.000908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65654183-ffa5-431c-886c-477b3835bb0d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:35.003447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65654183-ffa5-431c-886c-477b3835bb0d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:35.003985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65654183-ffa5-431c-886c-477b3835bb0d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:35.030344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e45283c6-99e2-4e05-8380-ed30e1627c68 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:35.031310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e45283c6-99e2-4e05-8380-ed30e1627c68 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:35.032741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e45283c6-99e2-4e05-8380-ed30e1627c68 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:35.033401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e45283c6-99e2-4e05-8380-ed30e1627c68 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:35.092491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-65654183-ffa5-431c-886c-477b3835bb0d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:35.103988 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-65654183-ffa5-431c-886c-477b3835bb0d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1298 microversion: 2.1 time: 0.116858 Jul 28 03:52:35.105386 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1998/3590] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:34 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1298 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:35.111605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-588634dc-ca91-4fe5-b941-3ee46445bb80 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:35.113067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-588634dc-ca91-4fe5-b941-3ee46445bb80 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:35.125380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-588634dc-ca91-4fe5-b941-3ee46445bb80 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:35.126572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-588634dc-ca91-4fe5-b941-3ee46445bb80 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:35.127930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-588634dc-ca91-4fe5-b941-3ee46445bb80 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:35.129116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-588634dc-ca91-4fe5-b941-3ee46445bb80 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:35.143434 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e45283c6-99e2-4e05-8380-ed30e1627c68 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-quota-sets/60031e095a6d42fea5d8a38966df6ae1?user_id=384a8ac1be084d46ae26f1cdd2557f51" status: 200 len: 148 microversion: 2.57 time: 0.271292 Jul 28 03:52:35.152747 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1593/3591] 10.222.0.48 () {62 vars in 1384 bytes} [Thu Jul 28 03:52:34 2022] PUT /compute/v2.1/os-quota-sets/60031e095a6d42fea5d8a38966df6ae1?user_id=384a8ac1be084d46ae26f1cdd2557f51 => generated 148 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:52:35.162773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c6c78c68-d0c4-42c2-9c0c-871fdba0f171 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] Calling method '.version_select at 0x7ffa67ae4820>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:35.313774 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c6c78c68-d0c4-42c2-9c0c-871fdba0f171 tempest-QuotasAdminTestV257-598054514 tempest-QuotasAdminTestV257-598054514-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/60031e095a6d42fea5d8a38966df6ae1?user_id=384a8ac1be084d46ae26f1cdd2557f51" status: 200 len: 190 microversion: 2.57 time: 0.158581 Jul 28 03:52:35.314694 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1594/3592] 10.222.0.48 () {60 vars in 1364 bytes} [Thu Jul 28 03:52:35 2022] GET /compute/v2.1/os-quota-sets/60031e095a6d42fea5d8a38966df6ae1?user_id=384a8ac1be084d46ae26f1cdd2557f51 => generated 190 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:52:35.322764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-764b59e3-b12f-44f0-a959-72d515c538df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:35.323962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-764b59e3-b12f-44f0-a959-72d515c538df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: f7a4251e-80ef-4e70-aa87-29d50b7e5c26] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:35.327711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:35.333342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-764b59e3-b12f-44f0-a959-72d515c538df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:35.334126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-764b59e3-b12f-44f0-a959-72d515c538df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:35.335442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-764b59e3-b12f-44f0-a959-72d515c538df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:35.335756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-764b59e3-b12f-44f0-a959-72d515c538df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:35.348061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-588634dc-ca91-4fe5-b941-3ee46445bb80 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:35.362818 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-588634dc-ca91-4fe5-b941-3ee46445bb80 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1506 microversion: 2.1 time: 0.255946 Jul 28 03:52:35.363813 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 1999/3593] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:35 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:35.457552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aaa4c06a-e79f-4fd4-a034-15add2af98e9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:35.458234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aaa4c06a-e79f-4fd4-a034-15add2af98e9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:35.475758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaa4c06a-e79f-4fd4-a034-15add2af98e9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:35.476691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaa4c06a-e79f-4fd4-a034-15add2af98e9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:35.483071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaa4c06a-e79f-4fd4-a034-15add2af98e9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:35.483984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaa4c06a-e79f-4fd4-a034-15add2af98e9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:35.723347 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-764b59e3-b12f-44f0-a959-72d515c538df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:35.743812 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-764b59e3-b12f-44f0-a959-72d515c538df tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26" status: 200 len: 1475 microversion: 2.1 time: 0.427561 Jul 28 03:52:35.748845 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1595/3594] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:35 2022] GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26 => generated 1475 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:35.761204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-56fbc5a7-1967-45d3-9f09-fc017e3a34f1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:35.761839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-56fbc5a7-1967-45d3-9f09-fc017e3a34f1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:35.779163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-56fbc5a7-1967-45d3-9f09-fc017e3a34f1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:35.779614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-56fbc5a7-1967-45d3-9f09-fc017e3a34f1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:35.791960 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-56fbc5a7-1967-45d3-9f09-fc017e3a34f1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:35.792434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-56fbc5a7-1967-45d3-9f09-fc017e3a34f1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:35.844636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aaa4c06a-e79f-4fd4-a034-15add2af98e9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:35.854956 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aaa4c06a-e79f-4fd4-a034-15add2af98e9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1508 microversion: 2.1 time: 0.404141 Jul 28 03:52:35.856543 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2000/3595] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:35 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1508 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:35.893244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-416906d8-60b7-47c0-9f6e-7c5e8a463818 req-6c5ec659-3fe0-4a9a-b705-7ce694a786ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8", "name": "network-vif-unplugged", "status": "completed", "tag": "ddebd4c4-d703-4220-b742-f9fb50b2c194"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:35.922695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-416906d8-60b7-47c0-9f6e-7c5e8a463818 req-6c5ec659-3fe0-4a9a-b705-7ce694a786ee service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:35.924439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-416906d8-60b7-47c0-9f6e-7c5e8a463818 req-6c5ec659-3fe0-4a9a-b705-7ce694a786ee service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:35.968170 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-416906d8-60b7-47c0-9f6e-7c5e8a463818 req-6c5ec659-3fe0-4a9a-b705-7ce694a786ee service nova] Creating event network-vif-unplugged:ddebd4c4-d703-4220-b742-f9fb50b2c194 for instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 on n-h1-826756-3 Jul 28 03:52:35.996242 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-416906d8-60b7-47c0-9f6e-7c5e8a463818 req-6c5ec659-3fe0-4a9a-b705-7ce694a786ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110263 Jul 28 03:52:35.999026 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2001/3596] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:52:36.051659 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-56fbc5a7-1967-45d3-9f09-fc017e3a34f1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b9f8f65f4724b7899491e805177cf1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14a740ef28ff4ceaa9879883f86d0da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:36.066396 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-56fbc5a7-1967-45d3-9f09-fc017e3a34f1 tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 200 len: 1449 microversion: 2.1 time: 0.314924 Jul 28 03:52:36.073113 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1596/3597] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:35 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 1449 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:36.139561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ae72f283-c5ca-4b48-8c94-4a33085fe2b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:36.140363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ae72f283-c5ca-4b48-8c94-4a33085fe2b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:36.157269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae72f283-c5ca-4b48-8c94-4a33085fe2b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:36.158350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae72f283-c5ca-4b48-8c94-4a33085fe2b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:36.160481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae72f283-c5ca-4b48-8c94-4a33085fe2b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:36.162908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae72f283-c5ca-4b48-8c94-4a33085fe2b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:36.391460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-67576c75-6fcd-4b47-b3f6-8182fe533d38 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:36.392704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-67576c75-6fcd-4b47-b3f6-8182fe533d38 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:36.413884 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67576c75-6fcd-4b47-b3f6-8182fe533d38 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:36.414575 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67576c75-6fcd-4b47-b3f6-8182fe533d38 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:36.416460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67576c75-6fcd-4b47-b3f6-8182fe533d38 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:36.416905 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67576c75-6fcd-4b47-b3f6-8182fe533d38 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:36.432436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ae72f283-c5ca-4b48-8c94-4a33085fe2b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:36.447219 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ae72f283-c5ca-4b48-8c94-4a33085fe2b9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1298 microversion: 2.1 time: 0.314458 Jul 28 03:52:36.471383 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2002/3598] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:36 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1298 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:36.724710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f0217e22-0c63-4a32-b896-8afac5e0aeeb req-bef83b3b-b6fb-4cba-9855-3a3769eb5c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a4251e-80ef-4e70-aa87-29d50b7e5c26", "name": "network-vif-deleted", "tag": "016cb180-7a18-405e-a328-f841540f4743"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:36.784204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f0217e22-0c63-4a32-b896-8afac5e0aeeb req-bef83b3b-b6fb-4cba-9855-3a3769eb5c09 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:36.785726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f0217e22-0c63-4a32-b896-8afac5e0aeeb req-bef83b3b-b6fb-4cba-9855-3a3769eb5c09 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:36.812690 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f0217e22-0c63-4a32-b896-8afac5e0aeeb req-bef83b3b-b6fb-4cba-9855-3a3769eb5c09 service nova] Creating event network-vif-deleted:016cb180-7a18-405e-a328-f841540f4743 for instance f7a4251e-80ef-4e70-aa87-29d50b7e5c26 on n-h2-826756-3 Jul 28 03:52:36.829335 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f0217e22-0c63-4a32-b896-8afac5e0aeeb req-bef83b3b-b6fb-4cba-9855-3a3769eb5c09 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113978 Jul 28 03:52:36.830837 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2003/3599] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:36.841676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b1ef12e-7060-4a42-99bd-d920fb74bdec tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:36.847371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b1ef12e-7060-4a42-99bd-d920fb74bdec tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: f7a4251e-80ef-4e70-aa87-29d50b7e5c26] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:36.873854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b1ef12e-7060-4a42-99bd-d920fb74bdec tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:36.885835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b1ef12e-7060-4a42-99bd-d920fb74bdec tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:36.886712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b1ef12e-7060-4a42-99bd-d920fb74bdec tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:36.887266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b1ef12e-7060-4a42-99bd-d920fb74bdec tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:36.973441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b1ef12e-7060-4a42-99bd-d920fb74bdec tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:36.980828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b1ef12e-7060-4a42-99bd-d920fb74bdec tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:36.981456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-4b1ef12e-7060-4a42-99bd-d920fb74bdec tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lazy-loading 'fault' on Instance uuid f7a4251e-80ef-4e70-aa87-29d50b7e5c26 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:52:37.180689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b1ef12e-7060-4a42-99bd-d920fb74bdec tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:37.209205 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b1ef12e-7060-4a42-99bd-d920fb74bdec tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26" status: 200 len: 1310 microversion: 2.1 time: 0.370809 Jul 28 03:52:37.213199 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2004/3600] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:36 2022] GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26 => generated 1310 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:37.239601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fd4ba864-6860-48b2-9752-c3db72909b74 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:37.246056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fd4ba864-6860-48b2-9752-c3db72909b74 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:37.256128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-67576c75-6fcd-4b47-b3f6-8182fe533d38 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:37.283118 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-67576c75-6fcd-4b47-b3f6-8182fe533d38 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 200 len: 1509 microversion: 2.1 time: 0.895550 Jul 28 03:52:37.285172 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1597/3601] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:36 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 1509 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:37.304761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd4ba864-6860-48b2-9752-c3db72909b74 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:37.305280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7b20e3bb-ae3e-4b60-bbc6-7a305496229a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:37.306135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7b20e3bb-ae3e-4b60-bbc6-7a305496229a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] [instance: 4b9af60f-ae9a-44b4-ab96-f43afbc198d5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:37.306743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd4ba864-6860-48b2-9752-c3db72909b74 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:37.308424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd4ba864-6860-48b2-9752-c3db72909b74 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:37.309118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd4ba864-6860-48b2-9752-c3db72909b74 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:37.332852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7b20e3bb-ae3e-4b60-bbc6-7a305496229a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:37.339055 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7b20e3bb-ae3e-4b60-bbc6-7a305496229a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:37.341338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7b20e3bb-ae3e-4b60-bbc6-7a305496229a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:37.346384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7b20e3bb-ae3e-4b60-bbc6-7a305496229a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:37.377769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:37.395716 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-7b20e3bb-ae3e-4b60-bbc6-7a305496229a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] HTTP exception thrown: Instance 4b9af60f-ae9a-44b4-ab96-f43afbc198d5 could not be found. Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7b20e3bb-ae3e-4b60-bbc6-7a305496229a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Request method failure captured: Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 HTTP/1.1 Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gdyqq3ExEutxtLorBUrSmeRX9e97Dm7EO5_tTl-t26JI1a1kzaUUeaJiARxe0GeLFQTGJOxNKIge83EohiNirBC1HaJXrkxPxOnVG7tVfYuM_7aHVn8JYEgkQjnZBPU-hFitR1sWaVkKMQcgEOxE9XJOWutLhBG9isu20VVSfed-tk Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 14a740ef28ff4ceaa9879883f86d0da5 Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerRescueTestJSON-217792854 Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/14a740ef28ff4ceaa9879883f86d0da5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14a740ef28ff4ceaa9879883f86d0da5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_14a740ef28ff4ceaa9879883f86d0da5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/14a740ef28ff4ceaa9879883f86d0da5"}]}] Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerRescueTestJSON-217792854 Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 14a740ef28ff4ceaa9879883f86d0da5 Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerRescueTestJSON-217792854 Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerRescueTestJSON-217792854-project Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 0b9f8f65f4724b7899491e805177cf1d Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerRescueTestJSON-217792854-project Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 4b9af60f-ae9a-44b4-ab96-f43afbc198d5 could not be found. Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '4b9af60f-ae9a-44b4-ab96-f43afbc198d5'} Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b9af60f-ae9a-44b4-ab96-f43afbc198d5 could not be found. Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b9af60f-ae9a-44b4-ab96-f43afbc198d5 could not be found. Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:37.397897 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:37.403761 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:37.403761 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:37.403761 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:37.403761 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:52:37.403761 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:52:37.403761 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b9af60f-ae9a-44b4-ab96-f43afbc198d5 could not be found. Jul 28 03:52:37.403761 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:37.406388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7b20e3bb-ae3e-4b60-bbc6-7a305496229a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] Returning 404 to user: Instance 4b9af60f-ae9a-44b4-ab96-f43afbc198d5 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:52:37.416447 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7b20e3bb-ae3e-4b60-bbc6-7a305496229a tempest-ServerRescueTestJSON-217792854 tempest-ServerRescueTestJSON-217792854-project] 10.222.0.48 "GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5" status: 404 len: 111 microversion: 2.1 time: 0.129779 Jul 28 03:52:37.417352 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1598/3602] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:37 2022] GET /compute/v2.1/servers/4b9af60f-ae9a-44b4-ab96-f43afbc198d5 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:52:37.436986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:37.437793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:37.453430 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:37.454146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:37.456769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:37.457550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:37.535631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:52:37.547958 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.compute.api [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Working on deleting snapshot 8216ba24-7498-4644-a035-798f237e0d6e from shelved instance... Jul 28 03:52:38.042840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fd4ba864-6860-48b2-9752-c3db72909b74 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:38.056917 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fd4ba864-6860-48b2-9752-c3db72909b74 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1508 microversion: 2.1 time: 0.839444 Jul 28 03:52:38.060742 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2005/3603] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:37 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1508 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:38.066101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9aa0876-c4d4-4bb9-88f2-c00811dfca6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:38.069263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9aa0876-c4d4-4bb9-88f2-c00811dfca6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:38.081483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9aa0876-c4d4-4bb9-88f2-c00811dfca6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:38.082455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9aa0876-c4d4-4bb9-88f2-c00811dfca6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:38.085654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9aa0876-c4d4-4bb9-88f2-c00811dfca6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:38.086628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9aa0876-c4d4-4bb9-88f2-c00811dfca6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:38.721561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b9aa0876-c4d4-4bb9-88f2-c00811dfca6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:38.733911 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9aa0876-c4d4-4bb9-88f2-c00811dfca6a tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1366 microversion: 2.1 time: 0.671852 Jul 28 03:52:38.737150 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2006/3604] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:38 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1366 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:38.750513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bed1f245-dd23-42c9-ab40-dd646fc4948c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:38.752099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bed1f245-dd23-42c9-ab40-dd646fc4948c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: f7a4251e-80ef-4e70-aa87-29d50b7e5c26] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:38.771493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bed1f245-dd23-42c9-ab40-dd646fc4948c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:38.772695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bed1f245-dd23-42c9-ab40-dd646fc4948c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:38.773715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bed1f245-dd23-42c9-ab40-dd646fc4948c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:38.776954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bed1f245-dd23-42c9-ab40-dd646fc4948c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:38.810814 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-bed1f245-dd23-42c9-ab40-dd646fc4948c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] HTTP exception thrown: Instance f7a4251e-80ef-4e70-aa87-29d50b7e5c26 could not be found. Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bed1f245-dd23-42c9-ab40-dd646fc4948c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Request method failure captured: Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26 HTTP/1.1 Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gelcjeT-ds6SK4re9dbIZOnYJjgNXok09uMkeVQMAjioMq22yJclt6vVoyXzavVV1h-rZp02jIdhFTWSCWqLsegQUhgweIVtIyhyw5wgDl6aqWSQ-YIO9cT22vhR_53pba28LYvBSH6FSAyoG4M8-T35bXrWFj02weobDUmt7okoR4 Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 4986ce186af44fea81f404b2b28c111d Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ListServerFiltersTestJSON-188963721 Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4986ce186af44fea81f404b2b28c111d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4986ce186af44fea81f404b2b28c111d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4986ce186af44fea81f404b2b28c111d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4986ce186af44fea81f404b2b28c111d"}]}] Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ListServerFiltersTestJSON-188963721 Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 4986ce186af44fea81f404b2b28c111d Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-188963721 Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ListServerFiltersTestJSON-188963721-project Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 45d31becde7f4984932272266a7e1867 Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ListServerFiltersTestJSON-188963721-project Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance f7a4251e-80ef-4e70-aa87-29d50b7e5c26 could not be found. Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'f7a4251e-80ef-4e70-aa87-29d50b7e5c26'} Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a4251e-80ef-4e70-aa87-29d50b7e5c26 could not be found. Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a4251e-80ef-4e70-aa87-29d50b7e5c26 could not be found. Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:38.818659 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:38.823100 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:38.823100 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:38.823100 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:38.823100 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:52:38.823100 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:52:38.823100 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a4251e-80ef-4e70-aa87-29d50b7e5c26 could not be found. Jul 28 03:52:38.823100 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:38.825059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bed1f245-dd23-42c9-ab40-dd646fc4948c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Returning 404 to user: Instance f7a4251e-80ef-4e70-aa87-29d50b7e5c26 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:52:38.826137 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bed1f245-dd23-42c9-ab40-dd646fc4948c tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26" status: 404 len: 111 microversion: 2.1 time: 0.085075 Jul 28 03:52:38.827554 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2007/3605] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:38 2022] GET /compute/v2.1/servers/f7a4251e-80ef-4e70-aa87-29d50b7e5c26 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:52:38.834797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Doing local delete in cell a8b3e198-f422-4bf1-ae6c-bd38905d4b84(cell1) {{(pid=126072) _delete /opt/stack/nova/nova/compute/api.py:2535}} Jul 28 03:52:38.835661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:38.837674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:38.838653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4f3802e1-2294-4707-91ca-3ed1d0535263 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:38.839011 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.compute.api [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 28 03:52:38.839447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4f3802e1-2294-4707-91ca-3ed1d0535263 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:38.846335 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] deallocate_for_instance() {{(pid=126072) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 28 03:52:38.856656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f3802e1-2294-4707-91ca-3ed1d0535263 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:38.857831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f3802e1-2294-4707-91ca-3ed1d0535263 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:38.859069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f3802e1-2294-4707-91ca-3ed1d0535263 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:38.859529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f3802e1-2294-4707-91ca-3ed1d0535263 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:38.944328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4f3802e1-2294-4707-91ca-3ed1d0535263 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:52:39.101608 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4f3802e1-2294-4707-91ca-3ed1d0535263 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 204 len: 0 microversion: 2.1 time: 0.269683 Jul 28 03:52:39.102324 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2008/3606] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:52:38 2022] DELETE /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:52:39.109674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9eb190c7-f802-4252-b3bc-8e4b44ccdef1 req-631dfa7a-5e03-437d-93cd-13c5d59a031d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5aac5b7-2161-4673-ba81-5a05fd98352f", "tag": "f7ad17ec-309b-462d-af2d-0f006c3127e1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:39.124936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9eb190c7-f802-4252-b3bc-8e4b44ccdef1 req-631dfa7a-5e03-437d-93cd-13c5d59a031d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:39.125739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9eb190c7-f802-4252-b3bc-8e4b44ccdef1 req-631dfa7a-5e03-437d-93cd-13c5d59a031d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:39.138994 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9eb190c7-f802-4252-b3bc-8e4b44ccdef1 req-631dfa7a-5e03-437d-93cd-13c5d59a031d service nova] Creating event network-changed:f7ad17ec-309b-462d-af2d-0f006c3127e1 for instance b5aac5b7-2161-4673-ba81-5a05fd98352f on n-h1-826756-3 Jul 28 03:52:39.144958 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9eb190c7-f802-4252-b3bc-8e4b44ccdef1 req-631dfa7a-5e03-437d-93cd-13c5d59a031d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040867 Jul 28 03:52:39.145915 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2009/3607] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:39.154407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d9000a6c-295a-48f4-a2da-9d5cadc90a18 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:39.155588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d9000a6c-295a-48f4-a2da-9d5cadc90a18 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:39.165783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:39.168618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9000a6c-295a-48f4-a2da-9d5cadc90a18 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:39.169409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9000a6c-295a-48f4-a2da-9d5cadc90a18 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:39.170767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9000a6c-295a-48f4-a2da-9d5cadc90a18 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:39.171695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9000a6c-295a-48f4-a2da-9d5cadc90a18 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:39.210454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-d9000a6c-295a-48f4-a2da-9d5cadc90a18 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lazy-loading 'flavor' on Instance uuid 99d0126e-11bf-4048-9e35-7309c228b534 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:52:39.458388 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d9000a6c-295a-48f4-a2da-9d5cadc90a18 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "POST /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/action" status: 202 len: 0 microversion: 2.20 time: 0.310613 Jul 28 03:52:39.464008 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2010/3608] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 03:52:39 2022] POST /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:52:39.473385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c1d7ed23-e745-4b66-a75c-d23781a3a111 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:39.474374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c1d7ed23-e745-4b66-a75c-d23781a3a111 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:39.482082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1d7ed23-e745-4b66-a75c-d23781a3a111 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:39.482829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1d7ed23-e745-4b66-a75c-d23781a3a111 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:39.483864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1d7ed23-e745-4b66-a75c-d23781a3a111 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:39.484570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1d7ed23-e745-4b66-a75c-d23781a3a111 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:39.799437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Updating instance_info_cache with network_info: [] {{(pid=126072) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 03:52:39.895734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c1d7ed23-e745-4b66-a75c-d23781a3a111 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:39.904845 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c1d7ed23-e745-4b66-a75c-d23781a3a111 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1506 microversion: 2.1 time: 0.438900 Jul 28 03:52:39.910648 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2011/3609] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:39 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:39.921010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed32c233-b0e5-4a38-b373-e1fb7cf32f79 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:39.923127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed32c233-b0e5-4a38-b373-e1fb7cf32f79 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:39.938580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed32c233-b0e5-4a38-b373-e1fb7cf32f79 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:39.941785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed32c233-b0e5-4a38-b373-e1fb7cf32f79 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:39.942914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed32c233-b0e5-4a38-b373-e1fb7cf32f79 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:39.945506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed32c233-b0e5-4a38-b373-e1fb7cf32f79 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:40.329513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed32c233-b0e5-4a38-b373-e1fb7cf32f79 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:40.340557 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed32c233-b0e5-4a38-b373-e1fb7cf32f79 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1518 microversion: 2.1 time: 0.428282 Jul 28 03:52:40.355437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=11,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:40.357284 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2012/3610] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:39 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1518 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:40.363378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fafb6286-ba0c-4942-b320-619c6f4a80e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:40.364430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fafb6286-ba0c-4942-b320-619c6f4a80e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:40.378176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fafb6286-ba0c-4942-b320-619c6f4a80e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:40.379865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fafb6286-ba0c-4942-b320-619c6f4a80e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:40.380993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fafb6286-ba0c-4942-b320-619c6f4a80e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:40.381666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fafb6286-ba0c-4942-b320-619c6f4a80e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:40.444672 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-02345703-53e2-41eb-9336-835015a15b5e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 204 len: 0 microversion: 2.1 time: 3.024847 Jul 28 03:52:40.446157 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1599/3611] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:52:37 2022] DELETE /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 0 bytes in 3027 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:52:40.465743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-44a18c1b-0a92-4b74-9c1d-905f6d964f8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:40.467244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-44a18c1b-0a92-4b74-9c1d-905f6d964f8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:40.475933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44a18c1b-0a92-4b74-9c1d-905f6d964f8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:40.476664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44a18c1b-0a92-4b74-9c1d-905f6d964f8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:40.477639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44a18c1b-0a92-4b74-9c1d-905f6d964f8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:40.478188 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44a18c1b-0a92-4b74-9c1d-905f6d964f8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:40.790166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-44a18c1b-0a92-4b74-9c1d-905f6d964f8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:40.799436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fafb6286-ba0c-4942-b320-619c6f4a80e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:40.810365 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-44a18c1b-0a92-4b74-9c1d-905f6d964f8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1366 microversion: 2.1 time: 0.362587 Jul 28 03:52:40.811537 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1600/3612] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:40 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:40.813342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fafb6286-ba0c-4942-b320-619c6f4a80e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:40.814884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fafb6286-ba0c-4942-b320-619c6f4a80e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:40.816112 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fafb6286-ba0c-4942-b320-619c6f4a80e9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1725 microversion: 2.20 time: 0.457527 Jul 28 03:52:40.816703 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2013/3613] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:40 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1725 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:40.819177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-01710114-e850-4212-aca2-025c468520b6 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '.version_select at 0x7ffa741ca9d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:40.820274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-01710114-e850-4212-aca2-025c468520b6 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:40.828840 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01710114-e850-4212-aca2-025c468520b6 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:40.830151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01710114-e850-4212-aca2-025c468520b6 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:40.831804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01710114-e850-4212-aca2-025c468520b6 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:40.832800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01710114-e850-4212-aca2-025c468520b6 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:40.833176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9780989d-de30-499b-9aeb-1a056347a726 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:40.833810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9780989d-de30-499b-9aeb-1a056347a726 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:40.849254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9780989d-de30-499b-9aeb-1a056347a726 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:40.849910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9780989d-de30-499b-9aeb-1a056347a726 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:40.850962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9780989d-de30-499b-9aeb-1a056347a726 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:40.851407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9780989d-de30-499b-9aeb-1a056347a726 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:40.882504 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-9780989d-de30-499b-9aeb-1a056347a726 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:52:40.882946 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-01710114-e850-4212-aca2-025c468520b6 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.067940 Jul 28 03:52:40.883754 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1601/3614] 10.222.0.48 () {58 vars in 1296 bytes} [Thu Jul 28 03:52:40 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b/os-instance-actions => generated 611 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9780989d-de30-499b-9aeb-1a056347a726 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 HTTP/1.1 Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8'} Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:40.884610 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:40.890341 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:40.890341 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:40.890341 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:40.890341 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:52:40.890341 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:52:40.890341 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:52:40.890341 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:40.892101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9780989d-de30-499b-9aeb-1a056347a726 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:52:40.893242 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9780989d-de30-499b-9aeb-1a056347a726 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 404 len: 111 microversion: 2.1 time: 0.065208 Jul 28 03:52:40.894247 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2014/3615] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:40 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:52:40.904832 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6f629a41-06d1-48e2-a7f3-c8b5e07ef3d9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:40.904832 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6f629a41-06d1-48e2-a7f3-c8b5e07ef3d9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:40.915345 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f629a41-06d1-48e2-a7f3-c8b5e07ef3d9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:40.916043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f629a41-06d1-48e2-a7f3-c8b5e07ef3d9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:40.917070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f629a41-06d1-48e2-a7f3-c8b5e07ef3d9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:40.917836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f629a41-06d1-48e2-a7f3-c8b5e07ef3d9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:40.987275 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6f629a41-06d1-48e2-a7f3-c8b5e07ef3d9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:52:41.088471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-384993840", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "c540e59d-0550-4ece-8b64-1987a84fa206"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:41.179277 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6f629a41-06d1-48e2-a7f3-c8b5e07ef3d9 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "DELETE /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 204 len: 0 microversion: 2.1 time: 0.279665 Jul 28 03:52:41.181698 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1602/3616] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:52:40 2022] DELETE /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:52:41.204028 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-afe99626-4640-4eaf-bcf1-26668817209b req-5ac55995-c6cf-4541-bcd6-9e00a332774e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8", "name": "network-vif-deleted", "tag": "ddebd4c4-d703-4220-b742-f9fb50b2c194"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:41.205620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] validate_networks() for [('c540e59d-0550-4ece-8b64-1987a84fa206', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:52:41.218458 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-afe99626-4640-4eaf-bcf1-26668817209b req-5ac55995-c6cf-4541-bcd6-9e00a332774e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:41.219244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-afe99626-4640-4eaf-bcf1-26668817209b req-5ac55995-c6cf-4541-bcd6-9e00a332774e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:41.234834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.compute.server_external_events [req-afe99626-4640-4eaf-bcf1-26668817209b req-5ac55995-c6cf-4541-bcd6-9e00a332774e service nova] Unable to find a host for instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8. Dropping event network-vif-deleted {{(pid=126072) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 03:52:41.235796 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-afe99626-4640-4eaf-bcf1-26668817209b req-5ac55995-c6cf-4541-bcd6-9e00a332774e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.045907 Jul 28 03:52:41.236389 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1603/3617] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 03:52:41.258830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f2a98997-85f1-4ada-a4a5-ef843d6d657f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:41.259862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f2a98997-85f1-4ada-a4a5-ef843d6d657f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:41.272181 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2a98997-85f1-4ada-a4a5-ef843d6d657f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:41.276702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2a98997-85f1-4ada-a4a5-ef843d6d657f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:41.285172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2a98997-85f1-4ada-a4a5-ef843d6d657f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:41.285932 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2a98997-85f1-4ada-a4a5-ef843d6d657f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:41.623831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f2a98997-85f1-4ada-a4a5-ef843d6d657f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:41.637510 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f2a98997-85f1-4ada-a4a5-ef843d6d657f tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1512 microversion: 2.1 time: 0.400013 Jul 28 03:52:41.638536 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1604/3618] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:41 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1512 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:41.644553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c8624664-33e3-469c-b999-6772001884ca tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:41.645467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c8624664-33e3-469c-b999-6772001884ca tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:41.653236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8624664-33e3-469c-b999-6772001884ca tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:41.653779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8624664-33e3-469c-b999-6772001884ca tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:41.654586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8624664-33e3-469c-b999-6772001884ca tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:41.655024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8624664-33e3-469c-b999-6772001884ca tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:41.762164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c8624664-33e3-469c-b999-6772001884ca tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d31becde7f4984932272266a7e1867', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4986ce186af44fea81f404b2b28c111d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:41.776197 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c8624664-33e3-469c-b999-6772001884ca tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 200 len: 1476 microversion: 2.1 time: 0.136395 Jul 28 03:52:41.788396 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1605/3619] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:41 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 1476 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:41.847488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-803f97ee-0997-4e99-94f0-2c3348e438fe tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:41.848465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-803f97ee-0997-4e99-94f0-2c3348e438fe tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:41.856863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-803f97ee-0997-4e99-94f0-2c3348e438fe tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:41.857922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-803f97ee-0997-4e99-94f0-2c3348e438fe tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:41.859219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-803f97ee-0997-4e99-94f0-2c3348e438fe tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:41.859836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-803f97ee-0997-4e99-94f0-2c3348e438fe tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:42.053284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-803f97ee-0997-4e99-94f0-2c3348e438fe tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:42.073817 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-803f97ee-0997-4e99-94f0-2c3348e438fe tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1366 microversion: 2.1 time: 0.232738 Jul 28 03:52:42.074585 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1606/3620] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:41 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:42.079844 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2d9440e6-bd16-4248-9ffe-257d1789fb83 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:42.080920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2d9440e6-bd16-4248-9ffe-257d1789fb83 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:42.088038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d9440e6-bd16-4248-9ffe-257d1789fb83 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:42.088535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d9440e6-bd16-4248-9ffe-257d1789fb83 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:42.089833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d9440e6-bd16-4248-9ffe-257d1789fb83 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:42.090892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d9440e6-bd16-4248-9ffe-257d1789fb83 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:42.435066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2d9440e6-bd16-4248-9ffe-257d1789fb83 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:42.460657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2d9440e6-bd16-4248-9ffe-257d1789fb83 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:42.464136 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2d9440e6-bd16-4248-9ffe-257d1789fb83 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:42.466348 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2d9440e6-bd16-4248-9ffe-257d1789fb83 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1725 microversion: 2.20 time: 0.390089 Jul 28 03:52:42.468129 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1607/3621] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:42 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1725 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:42.709273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a305351f-ba0a-4806-851e-3f257d27cdfc tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:42.713662 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:52:42.713662 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:52:42.715072 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a305351f-ba0a-4806-851e-3f257d27cdfc tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:42.715520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a305351f-ba0a-4806-851e-3f257d27cdfc tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:42.717148 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a305351f-ba0a-4806-851e-3f257d27cdfc tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:42.717799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a305351f-ba0a-4806-851e-3f257d27cdfc tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:42.724969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=20 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:42.780788 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a305351f-ba0a-4806-851e-3f257d27cdfc tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.311046 Jul 28 03:52:42.790030 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1608/3622] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:52:42 2022] GET /compute/v2.1/os-services => generated 944 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:42.803698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f652d43c-6677-4df8-906e-214dcdcc62c7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:42.804763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f652d43c-6677-4df8-906e-214dcdcc62c7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:42.814059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f652d43c-6677-4df8-906e-214dcdcc62c7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:42.822391 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f652d43c-6677-4df8-906e-214dcdcc62c7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:42.823616 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f652d43c-6677-4df8-906e-214dcdcc62c7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:42.824054 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f652d43c-6677-4df8-906e-214dcdcc62c7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:43.151081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f652d43c-6677-4df8-906e-214dcdcc62c7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:43.173442 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f652d43c-6677-4df8-906e-214dcdcc62c7 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1512 microversion: 2.1 time: 0.381535 Jul 28 03:52:43.189727 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1609/3623] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:42 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1512 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:43.208401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-04d61151-69ee-439c-a2c9-32c17c606712 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:43.210811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-04d61151-69ee-439c-a2c9-32c17c606712 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] [instance: 7cc6b0f9-3b19-45a8-86b7-27753d96eea4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:43.229340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04d61151-69ee-439c-a2c9-32c17c606712 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:43.233986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04d61151-69ee-439c-a2c9-32c17c606712 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:43.237073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04d61151-69ee-439c-a2c9-32c17c606712 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:43.239279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-04d61151-69ee-439c-a2c9-32c17c606712 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:43.266531 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-04d61151-69ee-439c-a2c9-32c17c606712 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] HTTP exception thrown: Instance 7cc6b0f9-3b19-45a8-86b7-27753d96eea4 could not be found. Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-04d61151-69ee-439c-a2c9-32c17c606712 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Request method failure captured: Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 HTTP/1.1 Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gelcjeT-ds6SK4re9dbIZOnYJjgNXok09uMkeVQMAjioMq22yJclt6vVoyXzavVV1h-rZp02jIdhFTWSCWqLsegQUhgweIVtIyhyw5wgDl6aqWSQ-YIO9cT22vhR_53pba28LYvBSH6FSAyoG4M8-T35bXrWFj02weobDUmt7okoR4 Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 4986ce186af44fea81f404b2b28c111d Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ListServerFiltersTestJSON-188963721 Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4986ce186af44fea81f404b2b28c111d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4986ce186af44fea81f404b2b28c111d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4986ce186af44fea81f404b2b28c111d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4986ce186af44fea81f404b2b28c111d"}]}] Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ListServerFiltersTestJSON-188963721 Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 4986ce186af44fea81f404b2b28c111d Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-188963721 Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ListServerFiltersTestJSON-188963721-project Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 45d31becde7f4984932272266a7e1867 Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ListServerFiltersTestJSON-188963721-project Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 7cc6b0f9-3b19-45a8-86b7-27753d96eea4 could not be found. Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '7cc6b0f9-3b19-45a8-86b7-27753d96eea4'} Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc6b0f9-3b19-45a8-86b7-27753d96eea4 could not be found. Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc6b0f9-3b19-45a8-86b7-27753d96eea4 could not be found. Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:43.269352 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:43.277404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:43.277404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:43.277404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:43.277404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:52:43.277404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:52:43.277404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc6b0f9-3b19-45a8-86b7-27753d96eea4 could not be found. Jul 28 03:52:43.277404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:43.280609 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-04d61151-69ee-439c-a2c9-32c17c606712 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] Returning 404 to user: Instance 7cc6b0f9-3b19-45a8-86b7-27753d96eea4 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:52:43.282341 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-04d61151-69ee-439c-a2c9-32c17c606712 tempest-ListServerFiltersTestJSON-188963721 tempest-ListServerFiltersTestJSON-188963721-project] 10.222.0.48 "GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4" status: 404 len: 111 microversion: 2.1 time: 0.090708 Jul 28 03:52:43.283501 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1610/3624] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:43 2022] GET /compute/v2.1/servers/7cc6b0f9-3b19-45a8-86b7-27753d96eea4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:52:43.289278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-026815c0-339f-4ce8-94fd-1f468a3065db tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:43.293513 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:52:43.293513 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:52:43.295698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-026815c0-339f-4ce8-94fd-1f468a3065db tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:43.296499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-026815c0-339f-4ce8-94fd-1f468a3065db tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:43.297566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-026815c0-339f-4ce8-94fd-1f468a3065db tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:43.298255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-026815c0-339f-4ce8-94fd-1f468a3065db tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:43.337384 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-026815c0-339f-4ce8-94fd-1f468a3065db tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.052410 Jul 28 03:52:43.338856 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1611/3625] 10.222.0.48 () {58 vars in 1170 bytes} [Thu Jul 28 03:52:43 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:43.352846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fed9a150-726e-41ed-9b40-ca360fb67f87 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:43.353467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fed9a150-726e-41ed-9b40-ca360fb67f87 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:43.367571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fed9a150-726e-41ed-9b40-ca360fb67f87 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:43.368753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fed9a150-726e-41ed-9b40-ca360fb67f87 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:43.369838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fed9a150-726e-41ed-9b40-ca360fb67f87 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:43.370500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fed9a150-726e-41ed-9b40-ca360fb67f87 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:43.409741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:52:43.410804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:52:43.411628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:52:43.412309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:52:43.413416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:52:43.432706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:43.433567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:43.434617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:43.435293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:43.468273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Getting quotas for project 34ed8cbcca694b8794992388d95bf072. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:52:43.475200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Getting quotas for user 67fcd8c3ec5441e582a4852f0f1184b6 and project 34ed8cbcca694b8794992388d95bf072. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:52:43.493185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:52:43.495716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:52:43.570833 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce7bd5ae-51d4-4676-bec0-cee7a930a38c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.493701 Jul 28 03:52:43.575097 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2015/3626] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:52:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:52:43.599370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-05db17a9-27a1-4996-9ed2-62509eec091e req-380a0768-5f25-4e11-8206-88bfe123898b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc6b0f9-3b19-45a8-86b7-27753d96eea4", "name": "network-vif-deleted", "tag": "3ed3b7b7-c555-4215-b589-2eda58828d91"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:43.620689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-05db17a9-27a1-4996-9ed2-62509eec091e req-380a0768-5f25-4e11-8206-88bfe123898b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:43.621140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-05db17a9-27a1-4996-9ed2-62509eec091e req-380a0768-5f25-4e11-8206-88bfe123898b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:43.635265 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-05db17a9-27a1-4996-9ed2-62509eec091e req-380a0768-5f25-4e11-8206-88bfe123898b service nova] Creating event network-vif-deleted:3ed3b7b7-c555-4215-b589-2eda58828d91 for instance 7cc6b0f9-3b19-45a8-86b7-27753d96eea4 on n-h1-826756-3 Jul 28 03:52:43.643346 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-05db17a9-27a1-4996-9ed2-62509eec091e req-380a0768-5f25-4e11-8206-88bfe123898b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066685 Jul 28 03:52:43.645541 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2016/3627] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:43.652466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-015ad2ef-f8fc-4739-bebe-aad015edc13b tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:43.656014 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:52:43.656014 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 03:52:43.658882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-015ad2ef-f8fc-4739-bebe-aad015edc13b tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:43.659650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-015ad2ef-f8fc-4739-bebe-aad015edc13b tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:43.660711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-015ad2ef-f8fc-4739-bebe-aad015edc13b tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:43.661329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-015ad2ef-f8fc-4739-bebe-aad015edc13b tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:43.703452 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-015ad2ef-f8fc-4739-bebe-aad015edc13b tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.055285 Jul 28 03:52:43.714663 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2017/3628] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:52:43 2022] GET /compute/v2.1/os-services => generated 944 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:43.720279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-46d7698f-f0ba-4714-9af6-e8f156ca78ac tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:43.722424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-46d7698f-f0ba-4714-9af6-e8f156ca78ac tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:43.730791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46d7698f-f0ba-4714-9af6-e8f156ca78ac tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:43.731239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46d7698f-f0ba-4714-9af6-e8f156ca78ac tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:43.732027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46d7698f-f0ba-4714-9af6-e8f156ca78ac tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:43.732507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46d7698f-f0ba-4714-9af6-e8f156ca78ac tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:44.206964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-46d7698f-f0ba-4714-9af6-e8f156ca78ac tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:44.218043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-46d7698f-f0ba-4714-9af6-e8f156ca78ac tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:44.227430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-46d7698f-f0ba-4714-9af6-e8f156ca78ac tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:44.229132 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-46d7698f-f0ba-4714-9af6-e8f156ca78ac tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1725 microversion: 2.20 time: 0.513259 Jul 28 03:52:44.244557 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2018/3629] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:43 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1725 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:44.264445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d98b2df5-bf36-4997-9de3-8a490f27d872 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:44.265087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d98b2df5-bf36-4997-9de3-8a490f27d872 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:44.283409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d98b2df5-bf36-4997-9de3-8a490f27d872 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:44.283409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d98b2df5-bf36-4997-9de3-8a490f27d872 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:44.285054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d98b2df5-bf36-4997-9de3-8a490f27d872 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:44.285665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d98b2df5-bf36-4997-9de3-8a490f27d872 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:44.338222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fed9a150-726e-41ed-9b40-ca360fb67f87 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:44.351383 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fed9a150-726e-41ed-9b40-ca360fb67f87 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1366 microversion: 2.1 time: 1.011150 Jul 28 03:52:44.352587 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1612/3630] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:43 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1366 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:44.361000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a5064ee8-c0b2-412f-8b5f-cdbdc22bd1ee tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:44.375013 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:52:44.375013 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:52:44.376895 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a5064ee8-c0b2-412f-8b5f-cdbdc22bd1ee tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:44.379454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a5064ee8-c0b2-412f-8b5f-cdbdc22bd1ee tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:44.380271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a5064ee8-c0b2-412f-8b5f-cdbdc22bd1ee tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:44.380898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a5064ee8-c0b2-412f-8b5f-cdbdc22bd1ee tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:44.394897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d98b2df5-bf36-4997-9de3-8a490f27d872 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:44.404330 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d98b2df5-bf36-4997-9de3-8a490f27d872 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1218 microversion: 2.1 time: 0.170460 Jul 28 03:52:44.409473 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2019/3631] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:44 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1218 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:44.419459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-303c410c-1e4a-4393-88fc-324158719954 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:44.425317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-303c410c-1e4a-4393-88fc-324158719954 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:44.437474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-303c410c-1e4a-4393-88fc-324158719954 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:44.438048 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a5064ee8-c0b2-412f-8b5f-cdbdc22bd1ee tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=n-d-826756-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.084182 Jul 28 03:52:44.442769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-303c410c-1e4a-4393-88fc-324158719954 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:44.445515 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1613/3632] 10.222.0.48 () {58 vars in 1194 bytes} [Thu Jul 28 03:52:44 2022] GET /compute/v2.1/os-services?host=n-d-826756-3&binary=xxx => generated 16 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:52:44.447070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-303c410c-1e4a-4393-88fc-324158719954 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:44.447794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-303c410c-1e4a-4393-88fc-324158719954 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:44.456991 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-094e8d27-b735-455f-bf2e-dca42a2afdb7 tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:44.459538 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:52:44.459538 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:52:44.469458 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-094e8d27-b735-455f-bf2e-dca42a2afdb7 tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:44.470138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-094e8d27-b735-455f-bf2e-dca42a2afdb7 tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:44.473768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-094e8d27-b735-455f-bf2e-dca42a2afdb7 tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:44.474475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-094e8d27-b735-455f-bf2e-dca42a2afdb7 tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:44.572118 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-094e8d27-b735-455f-bf2e-dca42a2afdb7 tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.118555 Jul 28 03:52:44.573739 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1614/3633] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:52:44 2022] GET /compute/v2.1/os-services => generated 944 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:52:44.585903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3e0ac63e-6acf-4219-b267-33fc96aecab7 tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:44.589982 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:52:44.589982 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:52:44.592492 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e0ac63e-6acf-4219-b267-33fc96aecab7 tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:44.593259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e0ac63e-6acf-4219-b267-33fc96aecab7 tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:44.595291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e0ac63e-6acf-4219-b267-33fc96aecab7 tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:44.595987 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e0ac63e-6acf-4219-b267-33fc96aecab7 tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:44.634186 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3e0ac63e-6acf-4219-b267-33fc96aecab7 tempest-ServicesAdminNegativeTestJSON-1894966632 tempest-ServicesAdminNegativeTestJSON-1894966632-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.053086 Jul 28 03:52:44.635480 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1615/3634] 10.222.0.48 () {58 vars in 1198 bytes} [Thu Jul 28 03:52:44 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:52:44.875542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39d7bb99-6558-48d3-a0ba-7b996b3d507b tempest-ServicesAdminNegativeTestJSON-1947832497 tempest-ServicesAdminNegativeTestJSON-1947832497-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:44.879027 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:52:44.879027 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 03:52:44.882557 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-39d7bb99-6558-48d3-a0ba-7b996b3d507b tempest-ServicesAdminNegativeTestJSON-1947832497 tempest-ServicesAdminNegativeTestJSON-1947832497-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '5560c44c5c66408a893a3db75ff5f52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f492aa271a8e42deab6840a8efb070f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39d7bb99-6558-48d3-a0ba-7b996b3d507b tempest-ServicesAdminNegativeTestJSON-1947832497 tempest-ServicesAdminNegativeTestJSON-1947832497-project] Request method failure captured: Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4ggJZmXocLXqBAsy2NOjsWWR2_T-7AYylOMGoUpMUzPI51KO1ERMajWL2Yw6dplSiAB9Ipr38MsliyzbGZS4J74K65I0EfuGhfolaa-lVMJ4ji5GJqSxCWeIFnEDDyvFpJ_QhfGFHuBNjcyWGCqvVu7I022_sG1NOFTp9vu8ipnMLm4 Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: f492aa271a8e42deab6840a8efb070f5 Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1947832497 Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f492aa271a8e42deab6840a8efb070f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f492aa271a8e42deab6840a8efb070f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f492aa271a8e42deab6840a8efb070f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f492aa271a8e42deab6840a8efb070f5"}]}] Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1947832497 Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: f492aa271a8e42deab6840a8efb070f5 Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1947832497 Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServicesAdminNegativeTestJSON-1947832497-project Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 5560c44c5c66408a893a3db75ff5f52f Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1947832497-project Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: action_args: {} Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise self.value Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 03:52:44.892539 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:44.901812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:44.901812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:44.901812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:44.901812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:44.901812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:44.901812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 28 03:52:44.901812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 28 03:52:44.901812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 28 03:52:44.901812 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:52:44.901812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39d7bb99-6558-48d3-a0ba-7b996b3d507b tempest-ServicesAdminNegativeTestJSON-1947832497 tempest-ServicesAdminNegativeTestJSON-1947832497-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:52:44.901812 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-39d7bb99-6558-48d3-a0ba-7b996b3d507b tempest-ServicesAdminNegativeTestJSON-1947832497 tempest-ServicesAdminNegativeTestJSON-1947832497-project] 10.222.0.48 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.249038 Jul 28 03:52:44.901812 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1616/3635] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:52:44 2022] GET /compute/v2.1/os-services => generated 112 bytes in 251 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:52:45.001285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-303c410c-1e4a-4393-88fc-324158719954 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:45.058907 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-303c410c-1e4a-4393-88fc-324158719954 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1512 microversion: 2.1 time: 0.619582 Jul 28 03:52:45.060320 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2020/3636] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:44 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1512 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:45.269679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9b70ce8f-c765-4ad4-938f-a734c9988abd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:45.279774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9b70ce8f-c765-4ad4-938f-a734c9988abd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:45.308763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=38 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:45.319149 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9b70ce8f-c765-4ad4-938f-a734c9988abd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:45.324124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9b70ce8f-c765-4ad4-938f-a734c9988abd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:45.325902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9b70ce8f-c765-4ad4-938f-a734c9988abd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:45.328999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9b70ce8f-c765-4ad4-938f-a734c9988abd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:45.375226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8e51e543-45ca-4432-9173-b7d8ff9fa8ab tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:45.376114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8e51e543-45ca-4432-9173-b7d8ff9fa8ab tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:45.391274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e51e543-45ca-4432-9173-b7d8ff9fa8ab tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:45.391739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e51e543-45ca-4432-9173-b7d8ff9fa8ab tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:45.392590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e51e543-45ca-4432-9173-b7d8ff9fa8ab tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:45.395630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e51e543-45ca-4432-9173-b7d8ff9fa8ab tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:45.858761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8e51e543-45ca-4432-9173-b7d8ff9fa8ab tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:45.879308 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8e51e543-45ca-4432-9173-b7d8ff9fa8ab tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1366 microversion: 2.1 time: 0.504881 Jul 28 03:52:45.897715 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2021/3637] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:45 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1366 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:45.914146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-69a7ba78-39a3-485c-a047-b6df9374f7ef tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:45.916955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-69a7ba78-39a3-485c-a047-b6df9374f7ef tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:45.946904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69a7ba78-39a3-485c-a047-b6df9374f7ef tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:45.948819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69a7ba78-39a3-485c-a047-b6df9374f7ef tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:45.951049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69a7ba78-39a3-485c-a047-b6df9374f7ef tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:45.953395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69a7ba78-39a3-485c-a047-b6df9374f7ef tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:45.997416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:46.176906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-69a7ba78-39a3-485c-a047-b6df9374f7ef tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:46.200130 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-69a7ba78-39a3-485c-a047-b6df9374f7ef tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1272 microversion: 2.1 time: 0.294260 Jul 28 03:52:46.216250 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2022/3638] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:45 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1272 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:46.237221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e7425711-b7d2-45c4-aea9-ba50ce7d6d52 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:46.237851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e7425711-b7d2-45c4-aea9-ba50ce7d6d52 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:46.244045 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9b70ce8f-c765-4ad4-938f-a734c9988abd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:46.258725 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9b70ce8f-c765-4ad4-938f-a734c9988abd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:46.258986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7425711-b7d2-45c4-aea9-ba50ce7d6d52 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:46.259280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7425711-b7d2-45c4-aea9-ba50ce7d6d52 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:46.260111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7425711-b7d2-45c4-aea9-ba50ce7d6d52 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:46.261643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9b70ce8f-c765-4ad4-938f-a734c9988abd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:46.263106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7425711-b7d2-45c4-aea9-ba50ce7d6d52 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:46.266025 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9b70ce8f-c765-4ad4-938f-a734c9988abd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1725 microversion: 2.20 time: 1.001153 Jul 28 03:52:46.267014 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1617/3639] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:45 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1725 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:46.273854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-49d15bc0-cec2-4d00-b031-1e9faa340da1 req-ef0774ad-2d07-4fb0-8312-bf3921d13a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92736c04-fa08-430a-8ca3-03e849df899b", "name": "network-vif-deleted", "tag": "73e19a03-28e6-4a71-a676-4f947ab1f597"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:46.300767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-49d15bc0-cec2-4d00-b031-1e9faa340da1 req-ef0774ad-2d07-4fb0-8312-bf3921d13a53 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:46.301529 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-49d15bc0-cec2-4d00-b031-1e9faa340da1 req-ef0774ad-2d07-4fb0-8312-bf3921d13a53 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:46.322731 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-49d15bc0-cec2-4d00-b031-1e9faa340da1 req-ef0774ad-2d07-4fb0-8312-bf3921d13a53 service nova] Creating event network-vif-deleted:73e19a03-28e6-4a71-a676-4f947ab1f597 for instance 92736c04-fa08-430a-8ca3-03e849df899b on n-h2-826756-3 Jul 28 03:52:46.339016 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-49d15bc0-cec2-4d00-b031-1e9faa340da1 req-ef0774ad-2d07-4fb0-8312-bf3921d13a53 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070086 Jul 28 03:52:46.340001 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1618/3640] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:46.346250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-04270db9-85fb-49d8-97da-210ef1edae2e req-9046b1e0-0b30-44e3-9262-00bb595354f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5aac5b7-2161-4673-ba81-5a05fd98352f", "name": "network-vif-plugged", "status": "completed", "tag": "f7ad17ec-309b-462d-af2d-0f006c3127e1"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:46.383299 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-04270db9-85fb-49d8-97da-210ef1edae2e req-9046b1e0-0b30-44e3-9262-00bb595354f3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:46.383857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-04270db9-85fb-49d8-97da-210ef1edae2e req-9046b1e0-0b30-44e3-9262-00bb595354f3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:46.407220 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-04270db9-85fb-49d8-97da-210ef1edae2e req-9046b1e0-0b30-44e3-9262-00bb595354f3 service nova] Creating event network-vif-plugged:f7ad17ec-309b-462d-af2d-0f006c3127e1 for instance b5aac5b7-2161-4673-ba81-5a05fd98352f on n-h1-826756-3 Jul 28 03:52:46.422566 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-04270db9-85fb-49d8-97da-210ef1edae2e req-9046b1e0-0b30-44e3-9262-00bb595354f3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080750 Jul 28 03:52:46.423478 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1619/3641] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:46.450064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e7425711-b7d2-45c4-aea9-ba50ce7d6d52 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7122dcc470240558ca95e293e1c29e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '321f83387b874d5e8a7081438d656f0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:46.460086 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e7425711-b7d2-45c4-aea9-ba50ce7d6d52 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 200 len: 1302 microversion: 2.1 time: 0.242510 Jul 28 03:52:46.465787 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2023/3642] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:46 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 1302 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:46.920241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-43950ef5-7cd8-463e-a431-592dd4f9fcfb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:46.921367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-43950ef5-7cd8-463e-a431-592dd4f9fcfb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:46.942814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-43950ef5-7cd8-463e-a431-592dd4f9fcfb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:46.943383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-43950ef5-7cd8-463e-a431-592dd4f9fcfb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:46.947226 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-43950ef5-7cd8-463e-a431-592dd4f9fcfb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:46.947945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-43950ef5-7cd8-463e-a431-592dd4f9fcfb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:47.040052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:DELETE=2,nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:47.249985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0a524746-7f24-4b66-89e8-ea4d9c4e7752 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:47.251334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0a524746-7f24-4b66-89e8-ea4d9c4e7752 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:47.274368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a524746-7f24-4b66-89e8-ea4d9c4e7752 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:47.275484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a524746-7f24-4b66-89e8-ea4d9c4e7752 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:47.279629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a524746-7f24-4b66-89e8-ea4d9c4e7752 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:47.280800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a524746-7f24-4b66-89e8-ea4d9c4e7752 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:47.355996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-43950ef5-7cd8-463e-a431-592dd4f9fcfb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:47.365367 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-43950ef5-7cd8-463e-a431-592dd4f9fcfb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1366 microversion: 2.1 time: 0.452931 Jul 28 03:52:47.369286 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1620/3643] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:46 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1366 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:47.395298 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0d26b07e-a57d-4321-8a8f-99a4d025475e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:47.396391 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0d26b07e-a57d-4321-8a8f-99a4d025475e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:47.427495 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d26b07e-a57d-4321-8a8f-99a4d025475e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:47.429289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d26b07e-a57d-4321-8a8f-99a4d025475e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:47.431192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d26b07e-a57d-4321-8a8f-99a4d025475e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:47.434151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d26b07e-a57d-4321-8a8f-99a4d025475e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:47.530749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0a524746-7f24-4b66-89e8-ea4d9c4e7752 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:47.545151 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0a524746-7f24-4b66-89e8-ea4d9c4e7752 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1272 microversion: 2.1 time: 0.301030 Jul 28 03:52:47.556702 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2024/3644] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:47 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1272 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:47.568425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94f8b20d-2c12-408b-a00d-d2d3e59a2782 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:47.570929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-94f8b20d-2c12-408b-a00d-d2d3e59a2782 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] [instance: 92736c04-fa08-430a-8ca3-03e849df899b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:47.587302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94f8b20d-2c12-408b-a00d-d2d3e59a2782 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:47.588120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94f8b20d-2c12-408b-a00d-d2d3e59a2782 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:47.591126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94f8b20d-2c12-408b-a00d-d2d3e59a2782 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:47.591743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94f8b20d-2c12-408b-a00d-d2d3e59a2782 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:47.640284 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-94f8b20d-2c12-408b-a00d-d2d3e59a2782 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] HTTP exception thrown: Instance 92736c04-fa08-430a-8ca3-03e849df899b could not be found. Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94f8b20d-2c12-408b-a00d-d2d3e59a2782 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Request method failure captured: Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b HTTP/1.1 Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gfkbdlv-dsl7iG16UvhAjJrfAWFk-kTyawgCeeF4ZZW0ZLP68UoHU2RQHB1S9AvGDitpfRXfyKf-uvHn4bi6VtAvr0HYGyKaFHUMVWW9fCIPLXVFQycccuLNBkzDbRgdt-I0BI0SRt4y2VEuQxDkJsGXAuLm8Vua-QuoLXEtYmm9W8 Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 321f83387b874d5e8a7081438d656f0b Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-InstanceActionsTestJSON-1808712327 Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/321f83387b874d5e8a7081438d656f0b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/321f83387b874d5e8a7081438d656f0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_321f83387b874d5e8a7081438d656f0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/321f83387b874d5e8a7081438d656f0b"}]}] Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-InstanceActionsTestJSON-1808712327 Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 321f83387b874d5e8a7081438d656f0b Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1808712327 Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-InstanceActionsTestJSON-1808712327-project Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d7122dcc470240558ca95e293e1c29e4 Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-InstanceActionsTestJSON-1808712327-project Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 92736c04-fa08-430a-8ca3-03e849df899b could not be found. Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '92736c04-fa08-430a-8ca3-03e849df899b'} Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92736c04-fa08-430a-8ca3-03e849df899b could not be found. Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92736c04-fa08-430a-8ca3-03e849df899b could not be found. Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:52:47.653503 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:47.658564 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:52:47.658564 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:52:47.658564 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:52:47.658564 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:52:47.658564 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:52:47.658564 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92736c04-fa08-430a-8ca3-03e849df899b could not be found. Jul 28 03:52:47.658564 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:52:47.660747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94f8b20d-2c12-408b-a00d-d2d3e59a2782 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] Returning 404 to user: Instance 92736c04-fa08-430a-8ca3-03e849df899b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:52:47.665385 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-94f8b20d-2c12-408b-a00d-d2d3e59a2782 tempest-InstanceActionsTestJSON-1808712327 tempest-InstanceActionsTestJSON-1808712327-project] 10.222.0.48 "GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b" status: 404 len: 111 microversion: 2.1 time: 0.105607 Jul 28 03:52:47.667863 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2025/3645] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:47 2022] GET /compute/v2.1/servers/92736c04-fa08-430a-8ca3-03e849df899b => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:52:47.753273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0d26b07e-a57d-4321-8a8f-99a4d025475e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:47.773065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0d26b07e-a57d-4321-8a8f-99a4d025475e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:47.774965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0d26b07e-a57d-4321-8a8f-99a4d025475e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:47.777601 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0d26b07e-a57d-4321-8a8f-99a4d025475e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1725 microversion: 2.20 time: 0.406908 Jul 28 03:52:47.779486 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1621/3646] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:47 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1725 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:48.394863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa858826-cb24-4003-a4fd-3234b8cc3184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:48.397375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fa858826-cb24-4003-a4fd-3234b8cc3184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:48.420619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa858826-cb24-4003-a4fd-3234b8cc3184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:48.422000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa858826-cb24-4003-a4fd-3234b8cc3184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:48.424992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa858826-cb24-4003-a4fd-3234b8cc3184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:48.426900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa858826-cb24-4003-a4fd-3234b8cc3184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:48.811034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa858826-cb24-4003-a4fd-3234b8cc3184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:48.824370 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fa858826-cb24-4003-a4fd-3234b8cc3184 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1555 microversion: 2.1 time: 0.431529 Jul 28 03:52:48.825316 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2026/3647] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:48 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1555 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:48.837623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-044bbfa5-95d2-4056-ae95-ec4654f5830a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:48.839043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-044bbfa5-95d2-4056-ae95-ec4654f5830a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:48.852875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-044bbfa5-95d2-4056-ae95-ec4654f5830a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:48.855015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-044bbfa5-95d2-4056-ae95-ec4654f5830a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:48.860840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-044bbfa5-95d2-4056-ae95-ec4654f5830a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:48.861378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-044bbfa5-95d2-4056-ae95-ec4654f5830a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:48.900174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1048356616", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": "none"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:48.966836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:52:48.968104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:52:48.969166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:52:48.969767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:52:48.970334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:52:48.980841 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:48.981459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:48.982593 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:48.983023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:49.003216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Getting quotas for project 0f7708baae334a6690987771003f26c1. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:52:49.010140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Getting quotas for user 7d06eada4fd84fb493d81e3e66623809 and project 0f7708baae334a6690987771003f26c1. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:52:49.034378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:52:49.037219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 5e460e72-5983-4de4-8331-277067642ac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:52:49.103738 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4e4ff78a-3a2e-4297-951f-b32c1d0d2bff tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.636619 Jul 28 03:52:49.104725 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1622/3648] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:52:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:52:49.109487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1c233892-492e-4a06-849d-5637acad1641 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:49.110299 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1c233892-492e-4a06-849d-5637acad1641 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:49.119089 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1c233892-492e-4a06-849d-5637acad1641 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:49.120247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1c233892-492e-4a06-849d-5637acad1641 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:49.134196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1c233892-492e-4a06-849d-5637acad1641 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:49.134787 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1c233892-492e-4a06-849d-5637acad1641 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:49.171259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-044bbfa5-95d2-4056-ae95-ec4654f5830a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:49.183945 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-044bbfa5-95d2-4056-ae95-ec4654f5830a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1314 microversion: 2.1 time: 0.355886 Jul 28 03:52:49.202853 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2027/3649] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:48 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:49.210703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ff4a4b6c-eb9a-410b-92cf-360b2306fd62 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:49.220250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ff4a4b6c-eb9a-410b-92cf-360b2306fd62 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:49.232826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff4a4b6c-eb9a-410b-92cf-360b2306fd62 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:49.237491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff4a4b6c-eb9a-410b-92cf-360b2306fd62 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:49.239900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff4a4b6c-eb9a-410b-92cf-360b2306fd62 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:49.243117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff4a4b6c-eb9a-410b-92cf-360b2306fd62 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:49.377506 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ff4a4b6c-eb9a-410b-92cf-360b2306fd62 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.171203 Jul 28 03:52:49.379737 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2028/3650] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:52:49 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-interface => generated 285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:49.393825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a2e6c43-a888-4e34-bedc-81dcb6595fce tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:49.395286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7a2e6c43-a888-4e34-bedc-81dcb6595fce tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 5e460e72-5983-4de4-8331-277067642ac9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:49.492796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a2e6c43-a888-4e34-bedc-81dcb6595fce tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:49.507956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a2e6c43-a888-4e34-bedc-81dcb6595fce tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:49.510045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a2e6c43-a888-4e34-bedc-81dcb6595fce tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:49.513535 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7a2e6c43-a888-4e34-bedc-81dcb6595fce tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9" status: 200 len: 1278 microversion: 2.47 time: 0.131390 Jul 28 03:52:49.535731 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2029/3651] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:49 2022] GET /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:49.703077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-428601423", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": "none"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:49.795402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:52:49.796139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:52:49.797404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:52:49.799440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:52:49.802169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:52:49.827508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:49.829962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:49.832509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:49.837305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:49.879349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Getting quotas for project 0f7708baae334a6690987771003f26c1. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:52:49.886863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Getting quotas for user 7d06eada4fd84fb493d81e3e66623809 and project 0f7708baae334a6690987771003f26c1. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:52:49.910154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:52:49.918116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:52:49.985176 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93dcfafe-0fa5-4059-9be0-96c71e5196df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.294430 Jul 28 03:52:49.986861 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2030/3652] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:52:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 297 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:52:50.004864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-586ba916-6df5-4d24-b5fa-a33d1f37f660 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:50.008203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-586ba916-6df5-4d24-b5fa-a33d1f37f660 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:50.082879 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-586ba916-6df5-4d24-b5fa-a33d1f37f660 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "PUT /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 991 microversion: 2.47 time: 0.085520 Jul 28 03:52:50.085209 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2031/3653] 10.222.0.48 () {62 vars in 1297 bytes} [Thu Jul 28 03:52:49 2022] PUT /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:52:50.108204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fdd03185-9e05-4263-8f69-a29285c4dc30 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:50.109195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fdd03185-9e05-4263-8f69-a29285c4dc30 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:50.210938 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1c233892-492e-4a06-849d-5637acad1641 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:50.245947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1c233892-492e-4a06-849d-5637acad1641 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:50.247474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1c233892-492e-4a06-849d-5637acad1641 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:50.261826 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1c233892-492e-4a06-849d-5637acad1641 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1725 microversion: 2.20 time: 1.155725 Jul 28 03:52:50.263378 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1623/3654] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:49 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1725 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:50.272283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-daaab6a2-5f74-43f6-a764-c71e76239e66 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:50.283488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fdd03185-9e05-4263-8f69-a29285c4dc30 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:50.321544 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-daaab6a2-5f74-43f6-a764-c71e76239e66 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:50.347465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fdd03185-9e05-4263-8f69-a29285c4dc30 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:50.349482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fdd03185-9e05-4263-8f69-a29285c4dc30 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:50.360641 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fdd03185-9e05-4263-8f69-a29285c4dc30 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1277 microversion: 2.47 time: 0.256447 Jul 28 03:52:50.361263 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2032/3655] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:50 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:52:50.365714 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-daaab6a2-5f74-43f6-a764-c71e76239e66 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:50.368108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-daaab6a2-5f74-43f6-a764-c71e76239e66 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:50.369143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-daaab6a2-5f74-43f6-a764-c71e76239e66 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:50.369731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-daaab6a2-5f74-43f6-a764-c71e76239e66 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:51.180958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-daaab6a2-5f74-43f6-a764-c71e76239e66 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:51.190847 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-daaab6a2-5f74-43f6-a764-c71e76239e66 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1314 microversion: 2.1 time: 0.926284 Jul 28 03:52:51.196246 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1624/3656] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:50 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1314 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:51.294541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-de49fd1e-1187-4bc2-9d04-aa8e77bb797d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:51.295225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-de49fd1e-1187-4bc2-9d04-aa8e77bb797d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:51.313119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de49fd1e-1187-4bc2-9d04-aa8e77bb797d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:51.315790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de49fd1e-1187-4bc2-9d04-aa8e77bb797d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:51.318681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de49fd1e-1187-4bc2-9d04-aa8e77bb797d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:51.321611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de49fd1e-1187-4bc2-9d04-aa8e77bb797d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:51.383634 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2c215eda-ee81-475c-9bea-0eb95432e235 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:51.384392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2c215eda-ee81-475c-9bea-0eb95432e235 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:51.396747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c215eda-ee81-475c-9bea-0eb95432e235 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:51.397315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c215eda-ee81-475c-9bea-0eb95432e235 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:51.400298 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c215eda-ee81-475c-9bea-0eb95432e235 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:51.400942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c215eda-ee81-475c-9bea-0eb95432e235 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:51.608280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2c215eda-ee81-475c-9bea-0eb95432e235 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:51.624702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2c215eda-ee81-475c-9bea-0eb95432e235 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:51.630149 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2c215eda-ee81-475c-9bea-0eb95432e235 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:51.634046 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2c215eda-ee81-475c-9bea-0eb95432e235 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1329 microversion: 2.47 time: 0.253441 Jul 28 03:52:51.638518 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1625/3657] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:51 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1329 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:51.984647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-de49fd1e-1187-4bc2-9d04-aa8e77bb797d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:51.995976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-de49fd1e-1187-4bc2-9d04-aa8e77bb797d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:52.008107 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-f35fffc2-15a0-4f27-a9a8-c7d9893c64ff req-b75a8443-13a6-4974-8eef-cd53fd7be168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13579693-5082-4742-9c29-a1e16f62308b", "tag": "d8173c3d-706d-485a-8434-4f868aa9fe50"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:52.008995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-de49fd1e-1187-4bc2-9d04-aa8e77bb797d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:52.010406 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-de49fd1e-1187-4bc2-9d04-aa8e77bb797d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1725 microversion: 2.20 time: 0.728061 Jul 28 03:52:52.022186 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2033/3658] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:51 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1725 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:52.030088 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f35fffc2-15a0-4f27-a9a8-c7d9893c64ff req-b75a8443-13a6-4974-8eef-cd53fd7be168 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:52.030719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f35fffc2-15a0-4f27-a9a8-c7d9893c64ff req-b75a8443-13a6-4974-8eef-cd53fd7be168 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:52.073623 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-f35fffc2-15a0-4f27-a9a8-c7d9893c64ff req-b75a8443-13a6-4974-8eef-cd53fd7be168 service nova] Creating event network-changed:d8173c3d-706d-485a-8434-4f868aa9fe50 for instance 13579693-5082-4742-9c29-a1e16f62308b on n-h2-826756-3 Jul 28 03:52:52.086399 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-f35fffc2-15a0-4f27-a9a8-c7d9893c64ff req-b75a8443-13a6-4974-8eef-cd53fd7be168 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085001 Jul 28 03:52:52.091023 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1626/3659] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:52.216414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b2a7634-dc91-47eb-be5e-9740e70437f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:52.217344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b2a7634-dc91-47eb-be5e-9740e70437f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:52.232458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2a7634-dc91-47eb-be5e-9740e70437f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:52.232978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2a7634-dc91-47eb-be5e-9740e70437f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:52.234506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2a7634-dc91-47eb-be5e-9740e70437f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:52.234832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2a7634-dc91-47eb-be5e-9740e70437f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:52.567928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7b2a7634-dc91-47eb-be5e-9740e70437f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:52.587131 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b2a7634-dc91-47eb-be5e-9740e70437f1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1314 microversion: 2.1 time: 0.374577 Jul 28 03:52:52.588329 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2034/3660] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:52 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:52.661859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9d17acc1-0576-4226-8322-7a75fe5702d0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:52.662696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9d17acc1-0576-4226-8322-7a75fe5702d0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:52.666745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:52.670562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d17acc1-0576-4226-8322-7a75fe5702d0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:52.671214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d17acc1-0576-4226-8322-7a75fe5702d0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:52.672319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d17acc1-0576-4226-8322-7a75fe5702d0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:52.673020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d17acc1-0576-4226-8322-7a75fe5702d0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:52.821717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9d17acc1-0576-4226-8322-7a75fe5702d0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:52.832046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9d17acc1-0576-4226-8322-7a75fe5702d0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:52.834017 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9d17acc1-0576-4226-8322-7a75fe5702d0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:52.835470 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9d17acc1-0576-4226-8322-7a75fe5702d0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1335 microversion: 2.47 time: 0.178475 Jul 28 03:52:52.837084 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1627/3661] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:52 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1335 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:53.035506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4fa3842-981e-490b-8849-9f7bc5b15c03 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:53.036718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d4fa3842-981e-490b-8849-9f7bc5b15c03 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:53.045912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4fa3842-981e-490b-8849-9f7bc5b15c03 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:53.050465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4fa3842-981e-490b-8849-9f7bc5b15c03 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:53.051471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4fa3842-981e-490b-8849-9f7bc5b15c03 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:53.054882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4fa3842-981e-490b-8849-9f7bc5b15c03 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:53.611154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5a489a1f-3e48-4f1d-b3d2-ad792e6b69cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:53.611785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5a489a1f-3e48-4f1d-b3d2-ad792e6b69cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:53.628451 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a489a1f-3e48-4f1d-b3d2-ad792e6b69cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:53.642181 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a489a1f-3e48-4f1d-b3d2-ad792e6b69cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:53.643080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a489a1f-3e48-4f1d-b3d2-ad792e6b69cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:53.643613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a489a1f-3e48-4f1d-b3d2-ad792e6b69cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:53.661201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d4fa3842-981e-490b-8849-9f7bc5b15c03 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:53.692494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d4fa3842-981e-490b-8849-9f7bc5b15c03 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:53.698995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d4fa3842-981e-490b-8849-9f7bc5b15c03 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:53.703917 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d4fa3842-981e-490b-8849-9f7bc5b15c03 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1725 microversion: 2.20 time: 0.669851 Jul 28 03:52:53.707259 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2035/3662] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:53 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1725 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:53.865558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d700c70a-1813-4b9f-bc70-7e98a56a928d tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:53.866244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d700c70a-1813-4b9f-bc70-7e98a56a928d tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:53.885223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d700c70a-1813-4b9f-bc70-7e98a56a928d tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:53.888217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d700c70a-1813-4b9f-bc70-7e98a56a928d tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:53.893582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d700c70a-1813-4b9f-bc70-7e98a56a928d tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:53.894068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d700c70a-1813-4b9f-bc70-7e98a56a928d tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:54.178823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d700c70a-1813-4b9f-bc70-7e98a56a928d tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:54.182342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5a489a1f-3e48-4f1d-b3d2-ad792e6b69cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:54.195747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d700c70a-1813-4b9f-bc70-7e98a56a928d tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:54.198106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d700c70a-1813-4b9f-bc70-7e98a56a928d tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:54.199727 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d700c70a-1813-4b9f-bc70-7e98a56a928d tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1335 microversion: 2.47 time: 0.341882 Jul 28 03:52:54.206679 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2036/3663] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:53 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1335 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:54.212198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4f8ef83f-9fc5-4dc7-8547-71a4e6c86252 req-9c363dca-5480-4923-8860-22c9937aa822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5aac5b7-2161-4673-ba81-5a05fd98352f", "tag": "f7ad17ec-309b-462d-af2d-0f006c3127e1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:54.221167 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5a489a1f-3e48-4f1d-b3d2-ad792e6b69cd tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1314 microversion: 2.1 time: 0.614130 Jul 28 03:52:54.222915 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1628/3664] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:53 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:54.232291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4f8ef83f-9fc5-4dc7-8547-71a4e6c86252 req-9c363dca-5480-4923-8860-22c9937aa822 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:54.237814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4f8ef83f-9fc5-4dc7-8547-71a4e6c86252 req-9c363dca-5480-4923-8860-22c9937aa822 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:54.256150 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4f8ef83f-9fc5-4dc7-8547-71a4e6c86252 req-9c363dca-5480-4923-8860-22c9937aa822 service nova] Creating event network-changed:f7ad17ec-309b-462d-af2d-0f006c3127e1 for instance b5aac5b7-2161-4673-ba81-5a05fd98352f on n-h1-826756-3 Jul 28 03:52:54.274832 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4f8ef83f-9fc5-4dc7-8547-71a4e6c86252 req-9c363dca-5480-4923-8860-22c9937aa822 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066557 Jul 28 03:52:54.275868 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2037/3665] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:54.736724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-03dde371-9db7-44f7-baf3-6dff9a26bfe0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:54.737500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-03dde371-9db7-44f7-baf3-6dff9a26bfe0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:54.755219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03dde371-9db7-44f7-baf3-6dff9a26bfe0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:54.756476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03dde371-9db7-44f7-baf3-6dff9a26bfe0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:54.758267 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03dde371-9db7-44f7-baf3-6dff9a26bfe0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:54.758994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03dde371-9db7-44f7-baf3-6dff9a26bfe0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:55.228892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90037d8f-ebc0-4ede-bd22-9dda8a3e373b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:55.230393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-90037d8f-ebc0-4ede-bd22-9dda8a3e373b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:55.245331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90037d8f-ebc0-4ede-bd22-9dda8a3e373b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:55.247664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90037d8f-ebc0-4ede-bd22-9dda8a3e373b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:55.250311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90037d8f-ebc0-4ede-bd22-9dda8a3e373b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:55.252174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90037d8f-ebc0-4ede-bd22-9dda8a3e373b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:55.395200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-90037d8f-ebc0-4ede-bd22-9dda8a3e373b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:55.413582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-90037d8f-ebc0-4ede-bd22-9dda8a3e373b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:55.421299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-90037d8f-ebc0-4ede-bd22-9dda8a3e373b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:55.422825 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90037d8f-ebc0-4ede-bd22-9dda8a3e373b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1356 microversion: 2.47 time: 0.201625 Jul 28 03:52:55.425072 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2038/3666] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:55 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1356 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:55.453320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6bbac532-5c53-4a31-91c0-7d5c0e5515c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:55.454192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6bbac532-5c53-4a31-91c0-7d5c0e5515c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:55.462465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6bbac532-5c53-4a31-91c0-7d5c0e5515c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:55.463187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6bbac532-5c53-4a31-91c0-7d5c0e5515c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:55.464140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6bbac532-5c53-4a31-91c0-7d5c0e5515c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:55.464821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6bbac532-5c53-4a31-91c0-7d5c0e5515c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:55.906069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6bbac532-5c53-4a31-91c0-7d5c0e5515c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:55.917261 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6bbac532-5c53-4a31-91c0-7d5c0e5515c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1314 microversion: 2.1 time: 0.468661 Jul 28 03:52:55.918776 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2039/3667] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:55 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:55.933637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:55.941428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:55.944807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:55.956274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:55.956956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:55.957996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:55.961073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:56.134945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:52:56.135762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:52:56.136272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:52:56.136824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:52:56.137246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:52:56.164236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-03dde371-9db7-44f7-baf3-6dff9a26bfe0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:56.178172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-03dde371-9db7-44f7-baf3-6dff9a26bfe0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:56.184324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-03dde371-9db7-44f7-baf3-6dff9a26bfe0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:56.185543 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-03dde371-9db7-44f7-baf3-6dff9a26bfe0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1725 microversion: 2.20 time: 1.455108 Jul 28 03:52:56.200807 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1629/3668] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:54 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1725 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:56.277509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:56.292045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:56.295220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:56.296180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:56.296901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:56.359133 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5d489396-466d-41a5-8d31-a1def454fce3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "POST /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526/action" status: 202 len: 1078 microversion: 2.47 time: 0.437709 Jul 28 03:52:56.360532 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2040/3669] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 03:52:55 2022] POST /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526/action => generated 1078 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 28 03:52:56.383787 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-487075e4-1889-43dc-8b45-ab13ee2b80e5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:56.384452 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-487075e4-1889-43dc-8b45-ab13ee2b80e5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:56.392071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-487075e4-1889-43dc-8b45-ab13ee2b80e5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:56.393044 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-487075e4-1889-43dc-8b45-ab13ee2b80e5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:56.393807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-487075e4-1889-43dc-8b45-ab13ee2b80e5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:56.394244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-487075e4-1889-43dc-8b45-ab13ee2b80e5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:56.947118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4c7b8654-87ee-429d-8f8a-a58b31a3ef37 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:56.948169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4c7b8654-87ee-429d-8f8a-a58b31a3ef37 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:56.967053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c7b8654-87ee-429d-8f8a-a58b31a3ef37 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:56.967521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c7b8654-87ee-429d-8f8a-a58b31a3ef37 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:56.967747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-487075e4-1889-43dc-8b45-ab13ee2b80e5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:56.968319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c7b8654-87ee-429d-8f8a-a58b31a3ef37 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:56.969159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c7b8654-87ee-429d-8f8a-a58b31a3ef37 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:56.982407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-487075e4-1889-43dc-8b45-ab13ee2b80e5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:56.985950 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-487075e4-1889-43dc-8b45-ab13ee2b80e5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:56.991371 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-487075e4-1889-43dc-8b45-ab13ee2b80e5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.612780 Jul 28 03:52:57.009540 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1630/3670] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:56 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:57.217112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ecaf91f9-7b45-4e86-9a3f-c9353250b7b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:57.217112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ecaf91f9-7b45-4e86-9a3f-c9353250b7b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:57.221421 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ecaf91f9-7b45-4e86-9a3f-c9353250b7b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:57.226479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ecaf91f9-7b45-4e86-9a3f-c9353250b7b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:57.227613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ecaf91f9-7b45-4e86-9a3f-c9353250b7b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:57.229010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ecaf91f9-7b45-4e86-9a3f-c9353250b7b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:57.387537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4c7b8654-87ee-429d-8f8a-a58b31a3ef37 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:57.397313 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4c7b8654-87ee-429d-8f8a-a58b31a3ef37 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1314 microversion: 2.1 time: 0.458894 Jul 28 03:52:57.398537 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2041/3671] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:56 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:57.939202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ecaf91f9-7b45-4e86-9a3f-c9353250b7b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:57.951196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ecaf91f9-7b45-4e86-9a3f-c9353250b7b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:57.952727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ecaf91f9-7b45-4e86-9a3f-c9353250b7b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:57.969699 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ecaf91f9-7b45-4e86-9a3f-c9353250b7b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1725 microversion: 2.20 time: 0.763731 Jul 28 03:52:58.014304 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1631/3672] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:57 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1725 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:58.018949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59911942-1599-4cba-8bb0-933826ef220a tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:58.019571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59911942-1599-4cba-8bb0-933826ef220a tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:58.047374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59911942-1599-4cba-8bb0-933826ef220a tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:58.048103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59911942-1599-4cba-8bb0-933826ef220a tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:58.049152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59911942-1599-4cba-8bb0-933826ef220a tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:58.049790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59911942-1599-4cba-8bb0-933826ef220a tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:58.074708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:58.190514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-59911942-1599-4cba-8bb0-933826ef220a tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:58.210052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-59911942-1599-4cba-8bb0-933826ef220a tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:58.212334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-59911942-1599-4cba-8bb0-933826ef220a tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:58.213883 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59911942-1599-4cba-8bb0-933826ef220a tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.198957 Jul 28 03:52:58.236949 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2042/3673] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:58 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:58.422170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-df8c7d03-aea7-4236-9291-2d5837e48dbf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:58.423503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-df8c7d03-aea7-4236-9291-2d5837e48dbf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:58.455105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df8c7d03-aea7-4236-9291-2d5837e48dbf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:58.456061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df8c7d03-aea7-4236-9291-2d5837e48dbf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:58.457477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df8c7d03-aea7-4236-9291-2d5837e48dbf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:58.458132 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df8c7d03-aea7-4236-9291-2d5837e48dbf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:58.992817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=11 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:59.014992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-60a371c9-472b-402e-9f01-3e6a22fec5e0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:59.016268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-60a371c9-472b-402e-9f01-3e6a22fec5e0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:59.030119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:59.042664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60a371c9-472b-402e-9f01-3e6a22fec5e0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:59.045065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60a371c9-472b-402e-9f01-3e6a22fec5e0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:59.047720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60a371c9-472b-402e-9f01-3e6a22fec5e0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:59.049953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60a371c9-472b-402e-9f01-3e6a22fec5e0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:59.351720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-df8c7d03-aea7-4236-9291-2d5837e48dbf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:59.365493 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-df8c7d03-aea7-4236-9291-2d5837e48dbf tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1314 microversion: 2.1 time: 0.949922 Jul 28 03:52:59.373011 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1632/3674] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:52:58 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1314 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:59.378507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-30bdadd5-e570-440e-a9c7-b608215f07e3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:59.385603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-30bdadd5-e570-440e-a9c7-b608215f07e3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:52:59.401856 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-30bdadd5-e570-440e-a9c7-b608215f07e3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:59.402552 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-30bdadd5-e570-440e-a9c7-b608215f07e3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:59.403563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-30bdadd5-e570-440e-a9c7-b608215f07e3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:52:59.412323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-30bdadd5-e570-440e-a9c7-b608215f07e3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:52:59.506821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-60a371c9-472b-402e-9f01-3e6a22fec5e0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:59.536855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-60a371c9-472b-402e-9f01-3e6a22fec5e0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:59.550002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-60a371c9-472b-402e-9f01-3e6a22fec5e0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:59.551830 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-60a371c9-472b-402e-9f01-3e6a22fec5e0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1725 microversion: 2.20 time: 0.547478 Jul 28 03:52:59.556873 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2043/3675] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:59 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1725 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:59.594738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-30bdadd5-e570-440e-a9c7-b608215f07e3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:59.605574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-30bdadd5-e570-440e-a9c7-b608215f07e3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:59.614370 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-30bdadd5-e570-440e-a9c7-b608215f07e3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:52:59.615708 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-30bdadd5-e570-440e-a9c7-b608215f07e3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.241242 Jul 28 03:52:59.616343 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1633/3676] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:52:59 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:00.391886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:00.394933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=16 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:00.402337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d67282f-566b-48a0-8025-b1db19e6cb3a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:00.403236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6d67282f-566b-48a0-8025-b1db19e6cb3a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:00.417032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d67282f-566b-48a0-8025-b1db19e6cb3a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:00.421447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d67282f-566b-48a0-8025-b1db19e6cb3a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:00.424969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d67282f-566b-48a0-8025-b1db19e6cb3a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:00.425646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d67282f-566b-48a0-8025-b1db19e6cb3a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:00.460761 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-7d821984-f2a8-4ed1-92d2-136fa2d0f273 req-73fbb6e8-6ec0-4dcf-8479-a379b4ea71a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13579693-5082-4742-9c29-a1e16f62308b", "name": "network-vif-plugged", "status": "completed", "tag": "d8173c3d-706d-485a-8434-4f868aa9fe50"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:00.490482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-7d821984-f2a8-4ed1-92d2-136fa2d0f273 req-73fbb6e8-6ec0-4dcf-8479-a379b4ea71a3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:00.490982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-7d821984-f2a8-4ed1-92d2-136fa2d0f273 req-73fbb6e8-6ec0-4dcf-8479-a379b4ea71a3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:00.520021 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-7d821984-f2a8-4ed1-92d2-136fa2d0f273 req-73fbb6e8-6ec0-4dcf-8479-a379b4ea71a3 service nova] Creating event network-vif-plugged:d8173c3d-706d-485a-8434-4f868aa9fe50 for instance 13579693-5082-4742-9c29-a1e16f62308b on n-h2-826756-3 Jul 28 03:53:00.526518 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-7d821984-f2a8-4ed1-92d2-136fa2d0f273 req-73fbb6e8-6ec0-4dcf-8479-a379b4ea71a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069192 Jul 28 03:53:00.529141 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1634/3677] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:53:00.583105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-98c2307f-b2b5-45c0-b9bf-8cb65b75ed13 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:00.583964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-98c2307f-b2b5-45c0-b9bf-8cb65b75ed13 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:00.611451 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98c2307f-b2b5-45c0-b9bf-8cb65b75ed13 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:00.612214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98c2307f-b2b5-45c0-b9bf-8cb65b75ed13 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:00.618242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98c2307f-b2b5-45c0-b9bf-8cb65b75ed13 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:00.619814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98c2307f-b2b5-45c0-b9bf-8cb65b75ed13 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:00.788886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6d67282f-566b-48a0-8025-b1db19e6cb3a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:00.803780 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d67282f-566b-48a0-8025-b1db19e6cb3a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1314 microversion: 2.1 time: 0.409986 Jul 28 03:53:00.808464 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2044/3678] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:00 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:00.818912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf92e94b-b287-4f4f-86c3-ecbe39e48c4e tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:00.822683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cf92e94b-b287-4f4f-86c3-ecbe39e48c4e tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:00.840442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf92e94b-b287-4f4f-86c3-ecbe39e48c4e tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:00.845342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf92e94b-b287-4f4f-86c3-ecbe39e48c4e tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:00.846441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf92e94b-b287-4f4f-86c3-ecbe39e48c4e tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:00.850427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf92e94b-b287-4f4f-86c3-ecbe39e48c4e tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:01.001084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf92e94b-b287-4f4f-86c3-ecbe39e48c4e tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:01.022574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf92e94b-b287-4f4f-86c3-ecbe39e48c4e tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:01.029883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf92e94b-b287-4f4f-86c3-ecbe39e48c4e tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:01.033621 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf92e94b-b287-4f4f-86c3-ecbe39e48c4e tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.218041 Jul 28 03:53:01.049028 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2045/3679] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:00 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:01.440734 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-98c2307f-b2b5-45c0-b9bf-8cb65b75ed13 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:01.455688 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-98c2307f-b2b5-45c0-b9bf-8cb65b75ed13 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:01.457378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-98c2307f-b2b5-45c0-b9bf-8cb65b75ed13 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:01.458647 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-98c2307f-b2b5-45c0-b9bf-8cb65b75ed13 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1746 microversion: 2.20 time: 0.882423 Jul 28 03:53:01.474951 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1635/3680] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:00 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1746 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:01.831100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-876ad82a-804c-487a-bd5d-527f96a0ac44 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:01.832686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-876ad82a-804c-487a-bd5d-527f96a0ac44 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:01.845345 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-876ad82a-804c-487a-bd5d-527f96a0ac44 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:01.850600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-876ad82a-804c-487a-bd5d-527f96a0ac44 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:01.851786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-876ad82a-804c-487a-bd5d-527f96a0ac44 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:01.852944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-876ad82a-804c-487a-bd5d-527f96a0ac44 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:02.013921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8df46410-d2eb-4d0b-8eec-d8c3f7d0385f tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-213786283", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:02.020905 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-8df46410-d2eb-4d0b-8eec-d8c3f7d0385f tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] HTTP exception thrown: min_count must be <= max_count Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8df46410-d2eb-4d0b-8eec-d8c3f7d0385f tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Request method failure captured: Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 183 Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ggdMIMJ44PT0SN-DErZQZUBYZppSWmh18Viy7jFGplewwM1XDCjv181yDdlss7VjtQSDMMXTC1lVOsYkHEF3OzjeLz6Rho4h9LK91nM581MiNGBEMmW66gJo4AFZXhPQ-1KdDSucUPhcMiXFVwmWrYohFeBwfuteryjPzhHRMWo5bU Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f2bafb45d9aa4c6eb0cfda704f6b2cff Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}] Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f2bafb45d9aa4c6eb0cfda704f6b2cff Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-MultipleCreateNegativeTestJSON-1940874047-project Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 6f3c0ce79cf044a9ab2be304b2c41b80 Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1940874047-project Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-213786283", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: exception: min_count must be <= max_count Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-213786283', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 28 03:53:02.023003 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.029065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8df46410-d2eb-4d0b-8eec-d8c3f7d0385f tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Returning 400 to user: min_count must be <= max_count {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:02.030410 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8df46410-d2eb-4d0b-8eec-d8c3f7d0385f tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.593043 Jul 28 03:53:02.031854 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2046/3681] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:53:01 2022] POST /compute/v2.1/servers => generated 74 bytes in 595 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:02.062741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f56d795-da8b-4380-9347-8b4f8742cd7c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:02.063433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f56d795-da8b-4380-9347-8b4f8742cd7c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:02.075906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f56d795-da8b-4380-9347-8b4f8742cd7c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:02.076378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f56d795-da8b-4380-9347-8b4f8742cd7c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:02.088119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f56d795-da8b-4380-9347-8b4f8742cd7c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:02.088968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f56d795-da8b-4380-9347-8b4f8742cd7c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:02.228055 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-876ad82a-804c-487a-bd5d-527f96a0ac44 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:02.238667 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-876ad82a-804c-487a-bd5d-527f96a0ac44 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1314 microversion: 2.1 time: 0.411432 Jul 28 03:53:02.253326 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1636/3682] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:01 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:02.262539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c3b80598-2d34-43ce-8988-875ab04a0657 tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-563107796", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "max_count": 0}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c3b80598-2d34-43ce-8988-875ab04a0657 tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Request method failure captured: Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 167 Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4ggdMIMJ44PT0SN-DErZQZUBYZppSWmh18Viy7jFGplewwM1XDCjv181yDdlss7VjtQSDMMXTC1lVOsYkHEF3OzjeLz6Rho4h9LK91nM581MiNGBEMmW66gJo4AFZXhPQ-1KdDSucUPhcMiXFVwmWrYohFeBwfuteryjPzhHRMWo5bU Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: f2bafb45d9aa4c6eb0cfda704f6b2cff Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}] Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: f2bafb45d9aa4c6eb0cfda704f6b2cff Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-MultipleCreateNegativeTestJSON-1940874047-project Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 6f3c0ce79cf044a9ab2be304b2c41b80 Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1940874047-project Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-563107796", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "max_count": 0}} Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-563107796', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'max_count': 0}}} Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 0 Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:53:02.267654 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 28 03:53:02.272633 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.275040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c3b80598-2d34-43ce-8988-875ab04a0657 tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:02.276113 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c3b80598-2d34-43ce-8988-875ab04a0657 tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021547 Jul 28 03:53:02.276942 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1637/3683] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:53:02 2022] POST /compute/v2.1/servers => generated 130 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:53:02.354056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2613cac7-8484-46de-8a8a-978a99bfa16e tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-336069731", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "max_count": 2.5}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2613cac7-8484-46de-8a8a-978a99bfa16e tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Request method failure captured: Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 169 Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4ggdMIMJ44PT0SN-DErZQZUBYZppSWmh18Viy7jFGplewwM1XDCjv181yDdlss7VjtQSDMMXTC1lVOsYkHEF3OzjeLz6Rho4h9LK91nM581MiNGBEMmW66gJo4AFZXhPQ-1KdDSucUPhcMiXFVwmWrYohFeBwfuteryjPzhHRMWo5bU Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: f2bafb45d9aa4c6eb0cfda704f6b2cff Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}] Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: f2bafb45d9aa4c6eb0cfda704f6b2cff Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-MultipleCreateNegativeTestJSON-1940874047-project Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 6f3c0ce79cf044a9ab2be304b2c41b80 Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1940874047-project Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-336069731", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "max_count": 2.5}} Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-336069731', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'max_count': 2.5}}} Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 2.5 Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:53:02.361262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2613cac7-8484-46de-8a8a-978a99bfa16e tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2613cac7-8484-46de-8a8a-978a99bfa16e tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.013401 Jul 28 03:53:02.369854 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1638/3684] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:53:02 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:53:02.451185 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-15ebbb65-d05e-4c17-9c36-52da493a1b0c tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1449878999", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "min_count": 0}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-15ebbb65-d05e-4c17-9c36-52da493a1b0c tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Request method failure captured: Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 168 Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4ggdMIMJ44PT0SN-DErZQZUBYZppSWmh18Viy7jFGplewwM1XDCjv181yDdlss7VjtQSDMMXTC1lVOsYkHEF3OzjeLz6Rho4h9LK91nM581MiNGBEMmW66gJo4AFZXhPQ-1KdDSucUPhcMiXFVwmWrYohFeBwfuteryjPzhHRMWo5bU Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: f2bafb45d9aa4c6eb0cfda704f6b2cff Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}] Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: f2bafb45d9aa4c6eb0cfda704f6b2cff Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-MultipleCreateNegativeTestJSON-1940874047-project Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 6f3c0ce79cf044a9ab2be304b2c41b80 Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1940874047-project Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1449878999", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "min_count": 0}} Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1449878999', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'min_count': 0}}} Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 0 Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:53:02.457630 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 28 03:53:02.462789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.465925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-15ebbb65-d05e-4c17-9c36-52da493a1b0c tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:02.470072 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-15ebbb65-d05e-4c17-9c36-52da493a1b0c tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.023267 Jul 28 03:53:02.474712 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1639/3685] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:53:02 2022] POST /compute/v2.1/servers => generated 130 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:53:02.489581 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5e70e786-72f8-4afd-8b41-3022734cb694 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:02.493537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5e70e786-72f8-4afd-8b41-3022734cb694 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:02.495151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f56d795-da8b-4380-9347-8b4f8742cd7c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:02.514821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f56d795-da8b-4380-9347-8b4f8742cd7c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:02.516427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f56d795-da8b-4380-9347-8b4f8742cd7c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:02.523401 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f56d795-da8b-4380-9347-8b4f8742cd7c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.464720 Jul 28 03:53:02.524760 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e70e786-72f8-4afd-8b41-3022734cb694 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:02.525683 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e70e786-72f8-4afd-8b41-3022734cb694 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:02.530103 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e70e786-72f8-4afd-8b41-3022734cb694 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:02.531201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e70e786-72f8-4afd-8b41-3022734cb694 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:02.538016 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2047/3686] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:02 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:02.638122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7dbccfab-2ad8-4b57-82d8-5e4549e7cb49 tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-631931535", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "min_count": 2.5}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7dbccfab-2ad8-4b57-82d8-5e4549e7cb49 tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Request method failure captured: Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 169 Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ggdMIMJ44PT0SN-DErZQZUBYZppSWmh18Viy7jFGplewwM1XDCjv181yDdlss7VjtQSDMMXTC1lVOsYkHEF3OzjeLz6Rho4h9LK91nM581MiNGBEMmW66gJo4AFZXhPQ-1KdDSucUPhcMiXFVwmWrYohFeBwfuteryjPzhHRMWo5bU Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f2bafb45d9aa4c6eb0cfda704f6b2cff Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f2bafb45d9aa4c6eb0cfda704f6b2cff"}]}] Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f2bafb45d9aa4c6eb0cfda704f6b2cff Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1940874047 Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-MultipleCreateNegativeTestJSON-1940874047-project Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 6f3c0ce79cf044a9ab2be304b2c41b80 Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1940874047-project Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-631931535", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "min_count": 2.5}} Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-631931535', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'min_count': 2.5}}} Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 2.5 Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:53:02.642977 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:02.647359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7dbccfab-2ad8-4b57-82d8-5e4549e7cb49 tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:02.653035 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7dbccfab-2ad8-4b57-82d8-5e4549e7cb49 tempest-MultipleCreateNegativeTestJSON-1940874047 tempest-MultipleCreateNegativeTestJSON-1940874047-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.013815 Jul 28 03:53:02.653035 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2048/3687] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:53:02 2022] POST /compute/v2.1/servers => generated 139 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:53:03.267258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c2395225-62c8-47ac-bf8b-ee3c040a5fea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:03.267954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c2395225-62c8-47ac-bf8b-ee3c040a5fea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:03.282733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c2395225-62c8-47ac-bf8b-ee3c040a5fea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:03.283188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c2395225-62c8-47ac-bf8b-ee3c040a5fea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:03.283966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c2395225-62c8-47ac-bf8b-ee3c040a5fea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:03.295423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c2395225-62c8-47ac-bf8b-ee3c040a5fea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:03.529384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5e70e786-72f8-4afd-8b41-3022734cb694 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:03.544339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5e70e786-72f8-4afd-8b41-3022734cb694 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:03.555623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5e70e786-72f8-4afd-8b41-3022734cb694 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:03.557899 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5e70e786-72f8-4afd-8b41-3022734cb694 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1746 microversion: 2.20 time: 1.075118 Jul 28 03:53:03.560750 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1640/3688] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:02 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1746 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:03.582788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-27c0a19b-0ac5-41d1-880c-37b4047b9634 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:03.583615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-27c0a19b-0ac5-41d1-880c-37b4047b9634 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:03.606069 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27c0a19b-0ac5-41d1-880c-37b4047b9634 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:03.612175 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27c0a19b-0ac5-41d1-880c-37b4047b9634 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:03.613002 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27c0a19b-0ac5-41d1-880c-37b4047b9634 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:03.619161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27c0a19b-0ac5-41d1-880c-37b4047b9634 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:03.793566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-27c0a19b-0ac5-41d1-880c-37b4047b9634 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:03.806670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-27c0a19b-0ac5-41d1-880c-37b4047b9634 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:03.808168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-27c0a19b-0ac5-41d1-880c-37b4047b9634 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:03.811722 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-27c0a19b-0ac5-41d1-880c-37b4047b9634 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.249939 Jul 28 03:53:03.812578 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1641/3689] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:03 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:04.055462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c2395225-62c8-47ac-bf8b-ee3c040a5fea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:04.084171 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c2395225-62c8-47ac-bf8b-ee3c040a5fea tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1502 microversion: 2.1 time: 0.820597 Jul 28 03:53:04.095298 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2049/3690] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:03 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1502 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:04.121962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-143bb757-5c86-4346-bb27-b8b0a350b4aa tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:04.138070 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-143bb757-5c86-4346-bb27-b8b0a350b4aa tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:04.138710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-143bb757-5c86-4346-bb27-b8b0a350b4aa tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:04.155369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:04.212791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-143bb757-5c86-4346-bb27-b8b0a350b4aa tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Going to try to stop instance {{(pid=126072) force_stop /opt/stack/nova/nova/compute/api.py:2753}} Jul 28 03:53:04.314419 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-143bb757-5c86-4346-bb27-b8b0a350b4aa tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "POST /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b/action" status: 202 len: 0 microversion: 2.1 time: 0.195521 Jul 28 03:53:04.315356 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1642/3691] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:53:04 2022] POST /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:53:04.336337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e3293b94-ae50-4aa6-85d5-f187e1cb8bf9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:04.337078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e3293b94-ae50-4aa6-85d5-f187e1cb8bf9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:04.354471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3293b94-ae50-4aa6-85d5-f187e1cb8bf9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:04.367212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3293b94-ae50-4aa6-85d5-f187e1cb8bf9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:04.370888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3293b94-ae50-4aa6-85d5-f187e1cb8bf9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:04.372124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3293b94-ae50-4aa6-85d5-f187e1cb8bf9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:04.584417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6a353d71-a577-40cf-80cc-a589b85d3f5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:04.585920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6a353d71-a577-40cf-80cc-a589b85d3f5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:04.596244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a353d71-a577-40cf-80cc-a589b85d3f5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:04.599572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a353d71-a577-40cf-80cc-a589b85d3f5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:04.606589 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a353d71-a577-40cf-80cc-a589b85d3f5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:04.607145 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a353d71-a577-40cf-80cc-a589b85d3f5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:04.901954 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6a353d71-a577-40cf-80cc-a589b85d3f5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:04.917653 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6a353d71-a577-40cf-80cc-a589b85d3f5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:04.922401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6a353d71-a577-40cf-80cc-a589b85d3f5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:04.926601 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6a353d71-a577-40cf-80cc-a589b85d3f5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1741 microversion: 2.20 time: 0.345665 Jul 28 03:53:04.932055 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1643/3692] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:04 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1741 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:04.954342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dd529e23-9637-465b-9b0f-5c6940216832 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:04.956645 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dd529e23-9637-465b-9b0f-5c6940216832 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:04.988504 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd529e23-9637-465b-9b0f-5c6940216832 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:04.989205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd529e23-9637-465b-9b0f-5c6940216832 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:04.990398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd529e23-9637-465b-9b0f-5c6940216832 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:04.990972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd529e23-9637-465b-9b0f-5c6940216832 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:05.221287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dd529e23-9637-465b-9b0f-5c6940216832 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:05.264544 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dd529e23-9637-465b-9b0f-5c6940216832 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:05.269183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dd529e23-9637-465b-9b0f-5c6940216832 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:05.273946 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dd529e23-9637-465b-9b0f-5c6940216832 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.340467 Jul 28 03:53:05.274923 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1644/3693] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:04 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:05.873932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e3293b94-ae50-4aa6-85d5-f187e1cb8bf9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:05.893789 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e3293b94-ae50-4aa6-85d5-f187e1cb8bf9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 1.573559 Jul 28 03:53:05.895538 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2050/3694] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:04 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:05.958779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-af11d8f7-87b5-410b-a568-8e7c50ce1ec5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:05.960239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-af11d8f7-87b5-410b-a568-8e7c50ce1ec5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:05.972222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-af11d8f7-87b5-410b-a568-8e7c50ce1ec5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:05.973047 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-af11d8f7-87b5-410b-a568-8e7c50ce1ec5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:05.974668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-af11d8f7-87b5-410b-a568-8e7c50ce1ec5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:05.976670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-af11d8f7-87b5-410b-a568-8e7c50ce1ec5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:06.305570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a1138f66-03a0-4930-87a2-f692e33b0fc8 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:06.306365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a1138f66-03a0-4930-87a2-f692e33b0fc8 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:06.317170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1138f66-03a0-4930-87a2-f692e33b0fc8 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:06.318343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1138f66-03a0-4930-87a2-f692e33b0fc8 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:06.322855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1138f66-03a0-4930-87a2-f692e33b0fc8 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:06.323509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1138f66-03a0-4930-87a2-f692e33b0fc8 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:06.865523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a1138f66-03a0-4930-87a2-f692e33b0fc8 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:06.904188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a1138f66-03a0-4930-87a2-f692e33b0fc8 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:06.905862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a1138f66-03a0-4930-87a2-f692e33b0fc8 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:06.918058 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a1138f66-03a0-4930-87a2-f692e33b0fc8 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.618019 Jul 28 03:53:06.924574 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2051/3695] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:06 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:06.951945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-52b3ba36-a2c6-49e5-ba48-0216e56ddd8f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:06.952725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-52b3ba36-a2c6-49e5-ba48-0216e56ddd8f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:06.984758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52b3ba36-a2c6-49e5-ba48-0216e56ddd8f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:06.985229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52b3ba36-a2c6-49e5-ba48-0216e56ddd8f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:06.986027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52b3ba36-a2c6-49e5-ba48-0216e56ddd8f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:06.986467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52b3ba36-a2c6-49e5-ba48-0216e56ddd8f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:07.160455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-af11d8f7-87b5-410b-a568-8e7c50ce1ec5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:07.182606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-af11d8f7-87b5-410b-a568-8e7c50ce1ec5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:07.184565 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-af11d8f7-87b5-410b-a568-8e7c50ce1ec5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:07.187686 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-af11d8f7-87b5-410b-a568-8e7c50ce1ec5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1741 microversion: 2.20 time: 1.233862 Jul 28 03:53:07.190748 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1645/3696] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:05 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1741 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:07.391093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-5a7d77fa-180b-4f1f-b991-684db559442e req-388d5b40-27da-4363-870f-5298f8c890e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d0126e-11bf-4048-9e35-7309c228b534", "name": "network-vif-plugged", "status": "completed", "tag": "f15c48dd-54c1-4291-88c3-ac0923fa48e7"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:07.438777 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5a7d77fa-180b-4f1f-b991-684db559442e req-388d5b40-27da-4363-870f-5298f8c890e2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:07.443180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5a7d77fa-180b-4f1f-b991-684db559442e req-388d5b40-27da-4363-870f-5298f8c890e2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:07.513699 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-5a7d77fa-180b-4f1f-b991-684db559442e req-388d5b40-27da-4363-870f-5298f8c890e2 service nova] Creating event network-vif-plugged:f15c48dd-54c1-4291-88c3-ac0923fa48e7 for instance 99d0126e-11bf-4048-9e35-7309c228b534 on n-h2-826756-3 Jul 28 03:53:07.537835 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-5a7d77fa-180b-4f1f-b991-684db559442e req-388d5b40-27da-4363-870f-5298f8c890e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153777 Jul 28 03:53:07.547421 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1646/3697] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:53:07.944708 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-74de4772-12c0-4a0b-a7d5-aec09e696f38 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:07.947319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-74de4772-12c0-4a0b-a7d5-aec09e696f38 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:07.959171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-74de4772-12c0-4a0b-a7d5-aec09e696f38 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:07.959742 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-74de4772-12c0-4a0b-a7d5-aec09e696f38 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:07.960499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-74de4772-12c0-4a0b-a7d5-aec09e696f38 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:07.960936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-74de4772-12c0-4a0b-a7d5-aec09e696f38 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:08.328614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-74de4772-12c0-4a0b-a7d5-aec09e696f38 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:08.343849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-74de4772-12c0-4a0b-a7d5-aec09e696f38 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:08.346261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-74de4772-12c0-4a0b-a7d5-aec09e696f38 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:08.347490 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-74de4772-12c0-4a0b-a7d5-aec09e696f38 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.407845 Jul 28 03:53:08.348055 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1647/3698] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:07 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:08.363057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-465b7eb5-d163-4a2d-967c-ae86ea56c917 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:08.363672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-465b7eb5-d163-4a2d-967c-ae86ea56c917 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:08.377630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-465b7eb5-d163-4a2d-967c-ae86ea56c917 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:08.378074 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-465b7eb5-d163-4a2d-967c-ae86ea56c917 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:08.379061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-465b7eb5-d163-4a2d-967c-ae86ea56c917 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:08.379259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-465b7eb5-d163-4a2d-967c-ae86ea56c917 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:08.534299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-52b3ba36-a2c6-49e5-ba48-0216e56ddd8f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:08.586380 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-52b3ba36-a2c6-49e5-ba48-0216e56ddd8f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 1.652620 Jul 28 03:53:08.601213 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2052/3699] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:06 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:08.947215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-683182054", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": "none"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:09.105500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:53:09.105924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:53:09.106399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:53:09.106807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:53:09.107227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:53:09.131124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:09.131621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:09.133634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:09.134339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:09.192813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Getting quotas for project 3046242ec6a64ff3950749a6ceff2248. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:53:09.203749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Getting quotas for user edd7eb775c5b4f63aac616f9c60bc2f2 and project 3046242ec6a64ff3950749a6ceff2248. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:53:09.219999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:53:09.222722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:53:09.281304 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c46c4f16-404c-40e8-85f6-ec4536015687 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.677971 Jul 28 03:53:09.282595 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2053/3700] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:53:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:53:09.381382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-2130353712", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "fe0c643a-f50e-419f-b19c-97dc71790979"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:09.445773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] validate_networks() for [('fe0c643a-f50e-419f-b19c-97dc71790979', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:53:09.543132 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-465b7eb5-d163-4a2d-967c-ae86ea56c917 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:09.552003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-465b7eb5-d163-4a2d-967c-ae86ea56c917 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:09.553681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-465b7eb5-d163-4a2d-967c-ae86ea56c917 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:09.568462 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-465b7eb5-d163-4a2d-967c-ae86ea56c917 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1741 microversion: 2.20 time: 1.205828 Jul 28 03:53:09.581560 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1648/3701] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:08 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1741 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:09.603517 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c8cc3205-a7e9-41c0-aede-7fd30182cf16 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:09.603794 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c8cc3205-a7e9-41c0-aede-7fd30182cf16 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:09.967371 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c8cc3205-a7e9-41c0-aede-7fd30182cf16 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:09.977420 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c8cc3205-a7e9-41c0-aede-7fd30182cf16 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:09.978919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c8cc3205-a7e9-41c0-aede-7fd30182cf16 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:09.980069 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c8cc3205-a7e9-41c0-aede-7fd30182cf16 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1277 microversion: 2.54 time: 0.394340 Jul 28 03:53:09.999060 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1649/3702] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:09 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1277 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:10.018890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7ded46d5-2803-4c8e-9c64-70f86d74f2de tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:10.028184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7ded46d5-2803-4c8e-9c64-70f86d74f2de tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:10.078395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ded46d5-2803-4c8e-9c64-70f86d74f2de tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:10.081144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ded46d5-2803-4c8e-9c64-70f86d74f2de tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:10.090412 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ded46d5-2803-4c8e-9c64-70f86d74f2de tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:10.096023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ded46d5-2803-4c8e-9c64-70f86d74f2de tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:10.362090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:53:10.363229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:53:10.363931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:53:10.364612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:53:10.365510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:53:10.381107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:10.382136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:10.383769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:10.384428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:10.407777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Getting quotas for project f46636803c54485f8a0d956306f9b033. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:53:10.415031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Getting quotas for user 4854da16472a4dbca31edde269c13bd5 and project f46636803c54485f8a0d956306f9b033. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:53:10.430909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7ded46d5-2803-4c8e-9c64-70f86d74f2de tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:10.443535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7ded46d5-2803-4c8e-9c64-70f86d74f2de tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:10.448159 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7ded46d5-2803-4c8e-9c64-70f86d74f2de tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:10.454455 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7ded46d5-2803-4c8e-9c64-70f86d74f2de tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.450978 Jul 28 03:53:10.457914 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1650/3703] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:10 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:10.463357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Going to run 3 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:53:10.469659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 057d7888-f34a-422c-853e-31e349089c1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:53:10.472966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-592e03fe-53ed-46d4-8b5a-3ecd72bb3a59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:10.485179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-592e03fe-53ed-46d4-8b5a-3ecd72bb3a59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:10.500767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-592e03fe-53ed-46d4-8b5a-3ecd72bb3a59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:10.501558 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-592e03fe-53ed-46d4-8b5a-3ecd72bb3a59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:10.502576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-592e03fe-53ed-46d4-8b5a-3ecd72bb3a59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:10.503228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-592e03fe-53ed-46d4-8b5a-3ecd72bb3a59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:10.552022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 6518bd32-8cbe-4ef4-8813-1923f796b586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=057d7888-f34a-422c-853e-31e349089c1c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:53:10.637112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=6518bd32-8cbe-4ef4-8813-1923f796b586,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:53:10.831040 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-61e533d6-51d1-4562-ab57-53bd9e94998e tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.547023 Jul 28 03:53:10.832099 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2054/3704] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:53:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:53:11.043095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4fdfe1fa-eb05-44b7-a457-fabb1a8d7a62 tempest-FloatingIPsNegativeTestJSON-234485597 tempest-FloatingIPsNegativeTestJSON-234485597-project] Calling method '.version_select at 0x7ffa67aa4820>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:11.196322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-592e03fe-53ed-46d4-8b5a-3ecd72bb3a59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:11.212559 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-592e03fe-53ed-46d4-8b5a-3ecd72bb3a59 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 0.750505 Jul 28 03:53:11.213417 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1651/3705] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:10 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:11.236875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f5ac3ce0-3c84-4bcf-a273-de3085456d7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:11.237499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f5ac3ce0-3c84-4bcf-a273-de3085456d7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:11.283565 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f5ac3ce0-3c84-4bcf-a273-de3085456d7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:11.295462 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f5ac3ce0-3c84-4bcf-a273-de3085456d7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:11.296763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f5ac3ce0-3c84-4bcf-a273-de3085456d7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:11.300171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f5ac3ce0-3c84-4bcf-a273-de3085456d7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:11.353427 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4fdfe1fa-eb05-44b7-a457-fabb1a8d7a62 tempest-FloatingIPsNegativeTestJSON-234485597 tempest-FloatingIPsNegativeTestJSON-234485597-project] 10.222.0.48 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.516338 Jul 28 03:53:11.354636 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2055/3706] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Jul 28 03:53:10 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:53:11.359858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17a63e7d-18d5-4351-b660-8a37e25e5387 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:11.372887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-17a63e7d-18d5-4351-b660-8a37e25e5387 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:11.383318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-17a63e7d-18d5-4351-b660-8a37e25e5387 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Searching by: {'deleted': False, 'project_id': 'f46636803c54485f8a0d956306f9b033'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:53:11.458001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17a63e7d-18d5-4351-b660-8a37e25e5387 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:11.458487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17a63e7d-18d5-4351-b660-8a37e25e5387 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:11.459295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17a63e7d-18d5-4351-b660-8a37e25e5387 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:11.459730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17a63e7d-18d5-4351-b660-8a37e25e5387 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:11.572789 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-17a63e7d-18d5-4351-b660-8a37e25e5387 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.216773 Jul 28 03:53:11.588456 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2056/3707] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 03:53:11 2022] GET /compute/v2.1/servers => generated 1018 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:11.594081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a459d2d1-84a0-4696-aac2-c2eb5ec77cfd tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:11.594697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a459d2d1-84a0-4696-aac2-c2eb5ec77cfd tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:11.618618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a459d2d1-84a0-4696-aac2-c2eb5ec77cfd tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:11.619374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a459d2d1-84a0-4696-aac2-c2eb5ec77cfd tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:11.620416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a459d2d1-84a0-4696-aac2-c2eb5ec77cfd tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:11.621083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a459d2d1-84a0-4696-aac2-c2eb5ec77cfd tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:11.821177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a459d2d1-84a0-4696-aac2-c2eb5ec77cfd tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:11.832837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a459d2d1-84a0-4696-aac2-c2eb5ec77cfd tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:11.835312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a459d2d1-84a0-4696-aac2-c2eb5ec77cfd tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:11.837787 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a459d2d1-84a0-4696-aac2-c2eb5ec77cfd tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1337 microversion: 2.54 time: 0.247879 Jul 28 03:53:11.839330 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2057/3708] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:11 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1337 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:11.861854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-64f00d63-f824-429b-9cf6-2712c78e7dfd tempest-FloatingIPsNegativeTestJSON-234485597 tempest-FloatingIPsNegativeTestJSON-234485597-project] Action: 'create', calling method: .version_select at 0x7ffa799f0d30>, body: {"pool": "non_exist_pool"} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:11.947940 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-64f00d63-f824-429b-9cf6-2712c78e7dfd tempest-FloatingIPsNegativeTestJSON-234485597 tempest-FloatingIPsNegativeTestJSON-234485597-project] HTTP exception thrown: Floating IP pool not found. Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-64f00d63-f824-429b-9cf6-2712c78e7dfd tempest-FloatingIPsNegativeTestJSON-234485597 tempest-FloatingIPsNegativeTestJSON-234485597-project] Request method failure captured: Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 26 Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ggl0DSGA5YO5SCmV4056cb7UpOPQc9OZGOywX3s8ecex4krec5_uLNGJ231Dx0xqzWFoz7tDhST40gYWasrz1zB7Y3b5LkhjMj4RCis79027JDcXCkkb-Cjc5BLr7Mufe5kNnR4mUpo4JUj2eJT_Qpy3kZxGlc5a8YB8gTsoOQE7GE Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 98f6be4a8266490da9fd57aaba92900d Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-234485597 Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/98f6be4a8266490da9fd57aaba92900d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f6be4a8266490da9fd57aaba92900d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_98f6be4a8266490da9fd57aaba92900d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f6be4a8266490da9fd57aaba92900d"}]}] Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-234485597 Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 98f6be4a8266490da9fd57aaba92900d Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-234485597 Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-FloatingIPsNegativeTestJSON-234485597-project Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 9d291212ed854b418e2d8b451c8b7982 Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-234485597-project Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: {"pool": "non_exist_pool"} Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: exception: Floating IP pool not found. Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:53:11.949568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:53:11.958615 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 28 03:53:11.958615 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:11.958615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-64f00d63-f824-429b-9cf6-2712c78e7dfd tempest-FloatingIPsNegativeTestJSON-234485597 tempest-FloatingIPsNegativeTestJSON-234485597-project] Returning 404 to user: Floating IP pool not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:11.958615 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-64f00d63-f824-429b-9cf6-2712c78e7dfd tempest-FloatingIPsNegativeTestJSON-234485597 tempest-FloatingIPsNegativeTestJSON-234485597-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.110776 Jul 28 03:53:11.958615 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2058/3709] 10.222.0.48 () {60 vars in 1170 bytes} [Thu Jul 28 03:53:11 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:53:11.967062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-00ab13e2-64de-4520-918e-03e6de38c459 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:11.969349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-00ab13e2-64de-4520-918e-03e6de38c459 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:11.990513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00ab13e2-64de-4520-918e-03e6de38c459 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:11.993076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00ab13e2-64de-4520-918e-03e6de38c459 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:11.994357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00ab13e2-64de-4520-918e-03e6de38c459 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:11.997015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00ab13e2-64de-4520-918e-03e6de38c459 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:12.175411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-00ab13e2-64de-4520-918e-03e6de38c459 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:12.192698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-00ab13e2-64de-4520-918e-03e6de38c459 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:12.201993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-00ab13e2-64de-4520-918e-03e6de38c459 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:12.203972 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-00ab13e2-64de-4520-918e-03e6de38c459 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.246130 Jul 28 03:53:12.207931 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2059/3710] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:11 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:12.225274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a18f9a52-425c-471a-9f6e-11c64a290e8a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:12.226273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a18f9a52-425c-471a-9f6e-11c64a290e8a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:12.472869 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f5ac3ce0-3c84-4bcf-a273-de3085456d7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:12.491255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f5ac3ce0-3c84-4bcf-a273-de3085456d7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:12.500027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f5ac3ce0-3c84-4bcf-a273-de3085456d7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:12.506584 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f5ac3ce0-3c84-4bcf-a273-de3085456d7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1741 microversion: 2.20 time: 1.290132 Jul 28 03:53:12.507533 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1652/3711] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:11 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1741 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:12.516192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-26771191-48e6-4481-bba3-681166686c60 tempest-FloatingIPsNegativeTestJSON-234485597 tempest-FloatingIPsNegativeTestJSON-234485597-project] Calling method '.version_select at 0x7ffa677505e0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:12.554162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a18f9a52-425c-471a-9f6e-11c64a290e8a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:12.565673 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a18f9a52-425c-471a-9f6e-11c64a290e8a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1223 microversion: 2.1 time: 0.352718 Jul 28 03:53:12.570209 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2060/3712] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:12 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1223 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:12.588745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bf8fe7e8-5890-470a-b293-b4f463154477 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:12.592605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bf8fe7e8-5890-470a-b293-b4f463154477 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:12.623054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf8fe7e8-5890-470a-b293-b4f463154477 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:12.623235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf8fe7e8-5890-470a-b293-b4f463154477 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:12.624056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf8fe7e8-5890-470a-b293-b4f463154477 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:12.624533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf8fe7e8-5890-470a-b293-b4f463154477 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:12.776796 n-d-826756-3 devstack@n-api.service[126072]: DEBUG neutronclient.v2_0.client [None req-26771191-48e6-4481-bba3-681166686c60 tempest-FloatingIPsNegativeTestJSON-234485597 tempest-FloatingIPsNegativeTestJSON-234485597-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 71cf9c0c-c05f-4776-a66b-7025f60a94df could not be found", "detail": ""}} {{(pid=126072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:53:12.778042 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-26771191-48e6-4481-bba3-681166686c60 tempest-FloatingIPsNegativeTestJSON-234485597 tempest-FloatingIPsNegativeTestJSON-234485597-project] HTTP exception thrown: Floating IP not found for ID 71cf9c0c-c05f-4776-a66b-7025f60a94df Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-26771191-48e6-4481-bba3-681166686c60 tempest-FloatingIPsNegativeTestJSON-234485597 tempest-FloatingIPsNegativeTestJSON-234485597-project] Request method failure captured: Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/os-floating-ips/71cf9c0c-c05f-4776-a66b-7025f60a94df HTTP/1.1 Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4ggl0DSGA5YO5SCmV4056cb7UpOPQc9OZGOywX3s8ecex4krec5_uLNGJ231Dx0xqzWFoz7tDhST40gYWasrz1zB7Y3b5LkhjMj4RCis79027JDcXCkkb-Cjc5BLr7Mufe5kNnR4mUpo4JUj2eJT_Qpy3kZxGlc5a8YB8gTsoOQE7GE Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 98f6be4a8266490da9fd57aaba92900d Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-234485597 Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/98f6be4a8266490da9fd57aaba92900d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f6be4a8266490da9fd57aaba92900d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_98f6be4a8266490da9fd57aaba92900d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f6be4a8266490da9fd57aaba92900d"}]}] Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-234485597 Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 98f6be4a8266490da9fd57aaba92900d Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-234485597 Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-FloatingIPsNegativeTestJSON-234485597-project Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 9d291212ed854b418e2d8b451c8b7982 Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-234485597-project Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: exception: Floating IP not found for ID 71cf9c0c-c05f-4776-a66b-7025f60a94df Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '71cf9c0c-c05f-4776-a66b-7025f60a94df'} Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 71cf9c0c-c05f-4776-a66b-7025f60a94df could not be found Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bbece389-c97c-477f-8ee8-f62aa1f2135a'] Jul 28 03:53:12.788925 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 71cf9c0c-c05f-4776-a66b-7025f60a94df. Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 71cf9c0c-c05f-4776-a66b-7025f60a94df Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 71cf9c0c-c05f-4776-a66b-7025f60a94df Jul 28 03:53:12.795640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:12.802783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-26771191-48e6-4481-bba3-681166686c60 tempest-FloatingIPsNegativeTestJSON-234485597 tempest-FloatingIPsNegativeTestJSON-234485597-project] Returning 404 to user: Floating IP not found for ID 71cf9c0c-c05f-4776-a66b-7025f60a94df {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:12.804524 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-26771191-48e6-4481-bba3-681166686c60 tempest-FloatingIPsNegativeTestJSON-234485597 tempest-FloatingIPsNegativeTestJSON-234485597-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/71cf9c0c-c05f-4776-a66b-7025f60a94df" status: 404 len: 111 microversion: 2.1 time: 0.291888 Jul 28 03:53:12.805664 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1653/3713] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:53:12 2022] DELETE /compute/v2.1/os-floating-ips/71cf9c0c-c05f-4776-a66b-7025f60a94df => generated 111 bytes in 297 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:53:12.866169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bb55ad72-e88b-413c-8bad-6c8ab3090f0e tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:12.866784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bb55ad72-e88b-413c-8bad-6c8ab3090f0e tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:12.883967 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb55ad72-e88b-413c-8bad-6c8ab3090f0e tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:12.884423 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb55ad72-e88b-413c-8bad-6c8ab3090f0e tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:12.894557 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb55ad72-e88b-413c-8bad-6c8ab3090f0e tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:12.895945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb55ad72-e88b-413c-8bad-6c8ab3090f0e tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:13.234616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bf8fe7e8-5890-470a-b293-b4f463154477 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:13.244764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bb55ad72-e88b-413c-8bad-6c8ab3090f0e tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:13.251447 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bf8fe7e8-5890-470a-b293-b4f463154477 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 0.677899 Jul 28 03:53:13.255857 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2061/3714] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:12 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:13.258109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bb55ad72-e88b-413c-8bad-6c8ab3090f0e tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:13.288308 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bb55ad72-e88b-413c-8bad-6c8ab3090f0e tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:13.290507 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bb55ad72-e88b-413c-8bad-6c8ab3090f0e tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1335 microversion: 2.54 time: 0.428071 Jul 28 03:53:13.295030 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1654/3715] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:12 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1335 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:13.329640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c1f9ea1-8b7b-45fd-992b-5caa2f011ac7 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:13.338650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5c1f9ea1-8b7b-45fd-992b-5caa2f011ac7 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:13.358918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c1f9ea1-8b7b-45fd-992b-5caa2f011ac7 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:13.360921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c1f9ea1-8b7b-45fd-992b-5caa2f011ac7 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:13.370499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c1f9ea1-8b7b-45fd-992b-5caa2f011ac7 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:13.381889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c1f9ea1-8b7b-45fd-992b-5caa2f011ac7 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:13.533808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-81e00b7b-4541-4df9-881a-6b5c6d2e6ab8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:13.534519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-81e00b7b-4541-4df9-881a-6b5c6d2e6ab8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:13.573975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81e00b7b-4541-4df9-881a-6b5c6d2e6ab8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:13.585757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81e00b7b-4541-4df9-881a-6b5c6d2e6ab8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:13.586668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81e00b7b-4541-4df9-881a-6b5c6d2e6ab8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:13.596809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81e00b7b-4541-4df9-881a-6b5c6d2e6ab8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:13.644311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5c1f9ea1-8b7b-45fd-992b-5caa2f011ac7 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:13.678155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5c1f9ea1-8b7b-45fd-992b-5caa2f011ac7 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:13.684235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5c1f9ea1-8b7b-45fd-992b-5caa2f011ac7 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:13.686068 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5c1f9ea1-8b7b-45fd-992b-5caa2f011ac7 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.428931 Jul 28 03:53:13.692493 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2062/3716] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:13 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:13.711158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f09c2f69-c477-46fb-95c7-e2380cc7d101 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:13.712376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f09c2f69-c477-46fb-95c7-e2380cc7d101 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:13.725708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f09c2f69-c477-46fb-95c7-e2380cc7d101 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:13.726569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f09c2f69-c477-46fb-95c7-e2380cc7d101 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:13.727585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f09c2f69-c477-46fb-95c7-e2380cc7d101 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:13.728671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f09c2f69-c477-46fb-95c7-e2380cc7d101 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:14.203771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f09c2f69-c477-46fb-95c7-e2380cc7d101 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:14.235129 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f09c2f69-c477-46fb-95c7-e2380cc7d101 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1227 microversion: 2.1 time: 0.524636 Jul 28 03:53:14.236106 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2063/3717] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:13 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1227 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:14.289978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9da23a9-3ff4-4a71-8d2f-0991673db1da tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:14.290885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9da23a9-3ff4-4a71-8d2f-0991673db1da tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:14.302962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9da23a9-3ff4-4a71-8d2f-0991673db1da tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:14.307127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9da23a9-3ff4-4a71-8d2f-0991673db1da tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:14.308406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9da23a9-3ff4-4a71-8d2f-0991673db1da tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:14.312499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9da23a9-3ff4-4a71-8d2f-0991673db1da tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:14.682018 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-81e00b7b-4541-4df9-881a-6b5c6d2e6ab8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:14.700547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-81e00b7b-4541-4df9-881a-6b5c6d2e6ab8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:14.702051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-81e00b7b-4541-4df9-881a-6b5c6d2e6ab8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:14.711409 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-81e00b7b-4541-4df9-881a-6b5c6d2e6ab8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1741 microversion: 2.20 time: 1.173919 Jul 28 03:53:14.713956 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1655/3718] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:13 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1741 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:14.735892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ff74dcc4-cfef-4271-b0d8-95de8e3b0f33 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:14.738541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ff74dcc4-cfef-4271-b0d8-95de8e3b0f33 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:14.800784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff74dcc4-cfef-4271-b0d8-95de8e3b0f33 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:14.801973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff74dcc4-cfef-4271-b0d8-95de8e3b0f33 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:14.803484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff74dcc4-cfef-4271-b0d8-95de8e3b0f33 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:14.806013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff74dcc4-cfef-4271-b0d8-95de8e3b0f33 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:15.279850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b9da23a9-3ff4-4a71-8d2f-0991673db1da tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:15.297454 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9da23a9-3ff4-4a71-8d2f-0991673db1da tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 1.009063 Jul 28 03:53:15.299807 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2064/3719] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:14 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:15.323151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-710385b9-f3d0-48a7-9067-4887b33b2ffd tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:15.323948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-710385b9-f3d0-48a7-9067-4887b33b2ffd tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:15.371922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-710385b9-f3d0-48a7-9067-4887b33b2ffd tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:15.372171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-710385b9-f3d0-48a7-9067-4887b33b2ffd tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:15.378299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-710385b9-f3d0-48a7-9067-4887b33b2ffd tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:15.382147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-710385b9-f3d0-48a7-9067-4887b33b2ffd tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:15.549952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ff74dcc4-cfef-4271-b0d8-95de8e3b0f33 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:15.577886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-710385b9-f3d0-48a7-9067-4887b33b2ffd tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:15.581170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ff74dcc4-cfef-4271-b0d8-95de8e3b0f33 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:15.589104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ff74dcc4-cfef-4271-b0d8-95de8e3b0f33 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:15.592882 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ff74dcc4-cfef-4271-b0d8-95de8e3b0f33 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1335 microversion: 2.54 time: 0.876439 Jul 28 03:53:15.594464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-710385b9-f3d0-48a7-9067-4887b33b2ffd tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:15.599536 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1656/3720] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:14 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1335 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:15.621631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fbb57144-b535-4247-9ba2-bc8bee3a842b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:15.622846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fbb57144-b535-4247-9ba2-bc8bee3a842b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:15.623653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-710385b9-f3d0-48a7-9067-4887b33b2ffd tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:15.629759 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-710385b9-f3d0-48a7-9067-4887b33b2ffd tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.323346 Jul 28 03:53:15.630746 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2065/3721] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:15 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:15.635160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fbb57144-b535-4247-9ba2-bc8bee3a842b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:15.636777 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fbb57144-b535-4247-9ba2-bc8bee3a842b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:15.639757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fbb57144-b535-4247-9ba2-bc8bee3a842b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:15.641895 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fbb57144-b535-4247-9ba2-bc8bee3a842b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:15.736071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ce76af5-71a9-4524-bbf7-2a6463de0ad5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:15.737160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ce76af5-71a9-4524-bbf7-2a6463de0ad5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:15.763367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ce76af5-71a9-4524-bbf7-2a6463de0ad5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:15.765038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ce76af5-71a9-4524-bbf7-2a6463de0ad5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:15.766511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ce76af5-71a9-4524-bbf7-2a6463de0ad5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:15.773004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ce76af5-71a9-4524-bbf7-2a6463de0ad5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:15.790102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:16.133592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fbb57144-b535-4247-9ba2-bc8bee3a842b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:16.177632 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fbb57144-b535-4247-9ba2-bc8bee3a842b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1275 microversion: 2.1 time: 0.574195 Jul 28 03:53:16.185721 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1657/3722] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:15 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1275 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:16.326325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-78b92476-b64f-40f2-bd9e-0e9ff22b2aff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:16.327709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-78b92476-b64f-40f2-bd9e-0e9ff22b2aff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:16.351349 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78b92476-b64f-40f2-bd9e-0e9ff22b2aff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:16.352556 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78b92476-b64f-40f2-bd9e-0e9ff22b2aff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:16.356859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78b92476-b64f-40f2-bd9e-0e9ff22b2aff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:16.358157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78b92476-b64f-40f2-bd9e-0e9ff22b2aff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:16.598691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ce76af5-71a9-4524-bbf7-2a6463de0ad5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:16.627033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ce76af5-71a9-4524-bbf7-2a6463de0ad5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:16.631803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ce76af5-71a9-4524-bbf7-2a6463de0ad5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:16.650722 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ce76af5-71a9-4524-bbf7-2a6463de0ad5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1741 microversion: 2.20 time: 0.907775 Jul 28 03:53:16.657346 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2066/3723] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:15 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1741 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:16.682883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1fb5e9d9-8f9e-47bd-b2e2-27be2921be26 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:16.686860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1fb5e9d9-8f9e-47bd-b2e2-27be2921be26 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:16.717930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fb5e9d9-8f9e-47bd-b2e2-27be2921be26 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:16.720027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fb5e9d9-8f9e-47bd-b2e2-27be2921be26 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:16.724328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fb5e9d9-8f9e-47bd-b2e2-27be2921be26 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:16.728163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fb5e9d9-8f9e-47bd-b2e2-27be2921be26 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:16.964111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1fb5e9d9-8f9e-47bd-b2e2-27be2921be26 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:16.980863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1fb5e9d9-8f9e-47bd-b2e2-27be2921be26 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:16.984802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1fb5e9d9-8f9e-47bd-b2e2-27be2921be26 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:16.986579 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1fb5e9d9-8f9e-47bd-b2e2-27be2921be26 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1356 microversion: 2.54 time: 0.326221 Jul 28 03:53:16.987782 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2067/3724] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:16 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1356 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:16.994508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-673de106-dd46-4bbc-aba1-64690469d693 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:16.997004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-673de106-dd46-4bbc-aba1-64690469d693 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:17.037918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-673de106-dd46-4bbc-aba1-64690469d693 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:17.038496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-673de106-dd46-4bbc-aba1-64690469d693 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:17.039290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-673de106-dd46-4bbc-aba1-64690469d693 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:17.053089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-673de106-dd46-4bbc-aba1-64690469d693 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:17.268124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-673de106-dd46-4bbc-aba1-64690469d693 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:17.338332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-673de106-dd46-4bbc-aba1-64690469d693 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:17.350766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-673de106-dd46-4bbc-aba1-64690469d693 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:17.361901 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-673de106-dd46-4bbc-aba1-64690469d693 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.367890 Jul 28 03:53:17.363773 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2068/3725] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:16 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:17.384411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9aa41e8a-5758-4efb-9877-167f5ab679ea tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Action: 'create', calling method: .version_select at 0x7ffa79997280>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-2086151354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqyj/iGvuVzJMhLbepAF5o3OYyxNk+Mdq4OpdPlI3wCxJCNboAD6dO56ViqNBpmbct/DrYCDt5iM0UeRAtQ+qcMs4M06olQwF10fSLFH/8s1BC7EfmEo5N8/89Y7Suw0A=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:17.448053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-9aa41e8a-5758-4efb-9877-167f5ab679ea tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Getting quotas for project 3046242ec6a64ff3950749a6ceff2248. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:53:17.470046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-9aa41e8a-5758-4efb-9877-167f5ab679ea tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Getting quotas for user edd7eb775c5b4f63aac616f9c60bc2f2 and project 3046242ec6a64ff3950749a6ceff2248. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:53:17.535864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:17.606470 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9aa41e8a-5758-4efb-9877-167f5ab679ea tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.240330 Jul 28 03:53:17.621040 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2069/3726] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Jul 28 03:53:17 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 256 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 03:53:17.637589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f91156fe-1ee7-4e21-aed9-e0a3cc547bba tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:17.638213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f91156fe-1ee7-4e21-aed9-e0a3cc547bba tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:17.674743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f91156fe-1ee7-4e21-aed9-e0a3cc547bba tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:17.675222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f91156fe-1ee7-4e21-aed9-e0a3cc547bba tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:17.676025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f91156fe-1ee7-4e21-aed9-e0a3cc547bba tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:17.676522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f91156fe-1ee7-4e21-aed9-e0a3cc547bba tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:17.922135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-78b92476-b64f-40f2-bd9e-0e9ff22b2aff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:17.940676 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-78b92476-b64f-40f2-bd9e-0e9ff22b2aff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 1.622802 Jul 28 03:53:17.942716 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1658/3727] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:16 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:17.964997 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-2086151354", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:17.979783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:17.988029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:17.988781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:17.989802 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:17.999820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:18.162640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f91156fe-1ee7-4e21-aed9-e0a3cc547bba tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:18.174009 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f91156fe-1ee7-4e21-aed9-e0a3cc547bba tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1281 microversion: 2.1 time: 0.551714 Jul 28 03:53:18.176062 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2070/3728] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:17 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1281 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:18.184870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:53:18.185592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:53:18.186863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:53:18.187465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:53:18.187606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fc3ca0b6-f194-405c-adbc-a2ba5fe6c94d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:18.188157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:53:18.188286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fc3ca0b6-f194-405c-adbc-a2ba5fe6c94d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:18.209300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc3ca0b6-f194-405c-adbc-a2ba5fe6c94d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:18.209821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc3ca0b6-f194-405c-adbc-a2ba5fe6c94d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:18.210606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc3ca0b6-f194-405c-adbc-a2ba5fe6c94d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:18.211098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc3ca0b6-f194-405c-adbc-a2ba5fe6c94d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:18.250854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:18.294602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:18.304294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:18.305059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:18.306310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:18.310483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:18.367786 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-47ba494b-7897-4440-8e02-01ff509689a8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "POST /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8/action" status: 202 len: 1139 microversion: 2.54 time: 0.418321 Jul 28 03:53:18.368813 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1659/3729] 10.222.0.48 () {62 vars in 1320 bytes} [Thu Jul 28 03:53:17 2022] POST /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8/action => generated 1139 bytes in 422 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 28 03:53:18.404711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c7e25d62-c4f8-4417-8238-f8c1efea2baa tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:18.405636 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c7e25d62-c4f8-4417-8238-f8c1efea2baa tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:18.415178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c7e25d62-c4f8-4417-8238-f8c1efea2baa tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:18.416033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c7e25d62-c4f8-4417-8238-f8c1efea2baa tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:18.417360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c7e25d62-c4f8-4417-8238-f8c1efea2baa tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:18.417978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c7e25d62-c4f8-4417-8238-f8c1efea2baa tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:18.628452 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c7e25d62-c4f8-4417-8238-f8c1efea2baa tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:18.649027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c7e25d62-c4f8-4417-8238-f8c1efea2baa tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:18.649377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc3ca0b6-f194-405c-adbc-a2ba5fe6c94d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:18.661830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc3ca0b6-f194-405c-adbc-a2ba5fe6c94d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:18.662508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c7e25d62-c4f8-4417-8238-f8c1efea2baa tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:18.667299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc3ca0b6-f194-405c-adbc-a2ba5fe6c94d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:18.672522 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c7e25d62-c4f8-4417-8238-f8c1efea2baa tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.280033 Jul 28 03:53:18.672972 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fc3ca0b6-f194-405c-adbc-a2ba5fe6c94d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1741 microversion: 2.20 time: 0.495094 Jul 28 03:53:18.689143 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1660/3730] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:18 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:18.693870 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2071/3731] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:18 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1741 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:18.695772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-acc62bb6-65a9-42a4-b955-512c71e37575 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:18.702773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-acc62bb6-65a9-42a4-b955-512c71e37575 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:18.719065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acc62bb6-65a9-42a4-b955-512c71e37575 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:18.719614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acc62bb6-65a9-42a4-b955-512c71e37575 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:18.720513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acc62bb6-65a9-42a4-b955-512c71e37575 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:18.721071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acc62bb6-65a9-42a4-b955-512c71e37575 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:18.972976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ffe8d0fb-a5fb-4972-89db-dff90753146d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:18.973598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ffe8d0fb-a5fb-4972-89db-dff90753146d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:18.985974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffe8d0fb-a5fb-4972-89db-dff90753146d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:18.989912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffe8d0fb-a5fb-4972-89db-dff90753146d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:18.991001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffe8d0fb-a5fb-4972-89db-dff90753146d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:18.991656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffe8d0fb-a5fb-4972-89db-dff90753146d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:19.007265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-acc62bb6-65a9-42a4-b955-512c71e37575 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:19.062884 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-acc62bb6-65a9-42a4-b955-512c71e37575 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:19.067041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-acc62bb6-65a9-42a4-b955-512c71e37575 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:19.068699 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-acc62bb6-65a9-42a4-b955-512c71e37575 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.391045 Jul 28 03:53:19.084397 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1661/3732] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:18 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:19.199817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3b9e27c5-2a6d-469b-9107-447b0705a08a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:19.200470 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3b9e27c5-2a6d-469b-9107-447b0705a08a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:19.226165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b9e27c5-2a6d-469b-9107-447b0705a08a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:19.228663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b9e27c5-2a6d-469b-9107-447b0705a08a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:19.234425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b9e27c5-2a6d-469b-9107-447b0705a08a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:19.235047 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3b9e27c5-2a6d-469b-9107-447b0705a08a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:19.453972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3b9e27c5-2a6d-469b-9107-447b0705a08a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:19.472825 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3b9e27c5-2a6d-469b-9107-447b0705a08a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1281 microversion: 2.1 time: 0.277781 Jul 28 03:53:19.488272 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1662/3733] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:19 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1281 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:19.703759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b4f916c0-91a5-4b03-998d-3a590cd53d26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:19.705244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b4f916c0-91a5-4b03-998d-3a590cd53d26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:19.722740 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b4f916c0-91a5-4b03-998d-3a590cd53d26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:19.728106 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b4f916c0-91a5-4b03-998d-3a590cd53d26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:19.735692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b4f916c0-91a5-4b03-998d-3a590cd53d26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:19.736679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b4f916c0-91a5-4b03-998d-3a590cd53d26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:19.930857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ffe8d0fb-a5fb-4972-89db-dff90753146d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:19.943122 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ffe8d0fb-a5fb-4972-89db-dff90753146d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 0.975251 Jul 28 03:53:19.944569 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2072/3734] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:18 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:19.976060 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:19.982051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-819b068f-e9ef-444c-b4be-c620200add53 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:19.983058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-819b068f-e9ef-444c-b4be-c620200add53 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:20.007125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-819b068f-e9ef-444c-b4be-c620200add53 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:20.007960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-819b068f-e9ef-444c-b4be-c620200add53 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:20.017671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-819b068f-e9ef-444c-b4be-c620200add53 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:20.018474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-819b068f-e9ef-444c-b4be-c620200add53 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:20.209183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-819b068f-e9ef-444c-b4be-c620200add53 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:20.242607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-819b068f-e9ef-444c-b4be-c620200add53 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:20.248772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-819b068f-e9ef-444c-b4be-c620200add53 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:20.254581 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-819b068f-e9ef-444c-b4be-c620200add53 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.307537 Jul 28 03:53:20.256135 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2073/3735] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:19 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:20.274008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fc6cc044-0803-4a27-9ddc-ac02dac1d3ef tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:20.274830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fc6cc044-0803-4a27-9ddc-ac02dac1d3ef tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:20.288449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc6cc044-0803-4a27-9ddc-ac02dac1d3ef tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:20.289343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc6cc044-0803-4a27-9ddc-ac02dac1d3ef tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:20.290604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc6cc044-0803-4a27-9ddc-ac02dac1d3ef tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:20.292027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc6cc044-0803-4a27-9ddc-ac02dac1d3ef tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:20.542614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b4f916c0-91a5-4b03-998d-3a590cd53d26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:20.560074 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b4f916c0-91a5-4b03-998d-3a590cd53d26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:20.561955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b4f916c0-91a5-4b03-998d-3a590cd53d26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:20.563189 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b4f916c0-91a5-4b03-998d-3a590cd53d26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1741 microversion: 2.20 time: 0.865547 Jul 28 03:53:20.563770 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1663/3736] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:19 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1741 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:20.574822 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1c244b6d-0f5f-45df-82d9-85b7aaac4078 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:20.585676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1c244b6d-0f5f-45df-82d9-85b7aaac4078 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:20.596612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc6cc044-0803-4a27-9ddc-ac02dac1d3ef tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:20.603996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1c244b6d-0f5f-45df-82d9-85b7aaac4078 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:20.604503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1c244b6d-0f5f-45df-82d9-85b7aaac4078 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:20.605305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1c244b6d-0f5f-45df-82d9-85b7aaac4078 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:20.605745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1c244b6d-0f5f-45df-82d9-85b7aaac4078 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:20.613322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc6cc044-0803-4a27-9ddc-ac02dac1d3ef tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:20.614884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc6cc044-0803-4a27-9ddc-ac02dac1d3ef tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:20.621629 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fc6cc044-0803-4a27-9ddc-ac02dac1d3ef tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.360849 Jul 28 03:53:20.622406 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2074/3737] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:20 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:20.974606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf5fd2ef-3011-4378-b922-8b990ab0a0b5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:20.975389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cf5fd2ef-3011-4378-b922-8b990ab0a0b5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:20.986973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf5fd2ef-3011-4378-b922-8b990ab0a0b5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:20.987541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf5fd2ef-3011-4378-b922-8b990ab0a0b5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:20.991278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf5fd2ef-3011-4378-b922-8b990ab0a0b5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:20.991832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf5fd2ef-3011-4378-b922-8b990ab0a0b5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:21.054848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1c244b6d-0f5f-45df-82d9-85b7aaac4078 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:21.064049 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1c244b6d-0f5f-45df-82d9-85b7aaac4078 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1281 microversion: 2.1 time: 0.493201 Jul 28 03:53:21.088389 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1664/3738] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:20 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1281 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:21.279731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6521e823-9985-4799-90e3-141f502a0385 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:21.280733 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6521e823-9985-4799-90e3-141f502a0385 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:21.297882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6521e823-9985-4799-90e3-141f502a0385 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:21.298338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6521e823-9985-4799-90e3-141f502a0385 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:21.299130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6521e823-9985-4799-90e3-141f502a0385 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:21.299570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6521e823-9985-4799-90e3-141f502a0385 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:21.501375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:21.585570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6521e823-9985-4799-90e3-141f502a0385 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:21.603901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6521e823-9985-4799-90e3-141f502a0385 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:21.612393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6521e823-9985-4799-90e3-141f502a0385 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:21.621948 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6521e823-9985-4799-90e3-141f502a0385 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.346781 Jul 28 03:53:21.626347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf5fd2ef-3011-4378-b922-8b990ab0a0b5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:21.627412 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1665/3739] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:21 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:21.633114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3142e589-b89e-4bfb-955e-fe60aafbc5e4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:21.634097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3142e589-b89e-4bfb-955e-fe60aafbc5e4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:21.643733 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3142e589-b89e-4bfb-955e-fe60aafbc5e4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:21.645116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3142e589-b89e-4bfb-955e-fe60aafbc5e4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:21.646233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3142e589-b89e-4bfb-955e-fe60aafbc5e4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:21.646942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3142e589-b89e-4bfb-955e-fe60aafbc5e4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:21.651269 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf5fd2ef-3011-4378-b922-8b990ab0a0b5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 0.681145 Jul 28 03:53:21.667790 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2075/3740] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:20 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:21.674184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e139963d-02f3-427e-b637-8dfa1c27a6df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:21.685020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e139963d-02f3-427e-b637-8dfa1c27a6df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:21.699337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e139963d-02f3-427e-b637-8dfa1c27a6df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:21.700879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e139963d-02f3-427e-b637-8dfa1c27a6df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:21.705340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e139963d-02f3-427e-b637-8dfa1c27a6df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:21.706627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e139963d-02f3-427e-b637-8dfa1c27a6df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:21.906469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e139963d-02f3-427e-b637-8dfa1c27a6df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:21.917276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e139963d-02f3-427e-b637-8dfa1c27a6df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:21.918823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e139963d-02f3-427e-b637-8dfa1c27a6df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:21.920031 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e139963d-02f3-427e-b637-8dfa1c27a6df tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.251066 Jul 28 03:53:21.940088 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2076/3741] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:21 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:22.101619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d11f3801-f9d0-4462-8fe3-d920a09d3346 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:22.102361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d11f3801-f9d0-4462-8fe3-d920a09d3346 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:22.134247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d11f3801-f9d0-4462-8fe3-d920a09d3346 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:22.137215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d11f3801-f9d0-4462-8fe3-d920a09d3346 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:22.139927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d11f3801-f9d0-4462-8fe3-d920a09d3346 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:22.141154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d11f3801-f9d0-4462-8fe3-d920a09d3346 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:22.291530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d11f3801-f9d0-4462-8fe3-d920a09d3346 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:22.305260 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d11f3801-f9d0-4462-8fe3-d920a09d3346 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1281 microversion: 2.1 time: 0.208658 Jul 28 03:53:22.308453 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2077/3742] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:22 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1281 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:22.337528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3142e589-b89e-4bfb-955e-fe60aafbc5e4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:22.349092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3142e589-b89e-4bfb-955e-fe60aafbc5e4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:22.358337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3142e589-b89e-4bfb-955e-fe60aafbc5e4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:22.360742 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3142e589-b89e-4bfb-955e-fe60aafbc5e4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1741 microversion: 2.20 time: 0.730795 Jul 28 03:53:22.378784 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1666/3743] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:21 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1741 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:22.652258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-283bcc35-e061-49ce-b114-9207c41be494 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:22.653018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-283bcc35-e061-49ce-b114-9207c41be494 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:22.685189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f49dc3ff-2e92-40bf-a429-e8d846c67093 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:22.690455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f49dc3ff-2e92-40bf-a429-e8d846c67093 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:22.704619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-283bcc35-e061-49ce-b114-9207c41be494 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:22.705513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-283bcc35-e061-49ce-b114-9207c41be494 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:22.706560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-283bcc35-e061-49ce-b114-9207c41be494 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:22.714038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=79 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:22.714588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-283bcc35-e061-49ce-b114-9207c41be494 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:22.737180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f49dc3ff-2e92-40bf-a429-e8d846c67093 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:22.744771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f49dc3ff-2e92-40bf-a429-e8d846c67093 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:22.746331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f49dc3ff-2e92-40bf-a429-e8d846c67093 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:22.747113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f49dc3ff-2e92-40bf-a429-e8d846c67093 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:22.948894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-283bcc35-e061-49ce-b114-9207c41be494 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:22.985477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-283bcc35-e061-49ce-b114-9207c41be494 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:22.987310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-283bcc35-e061-49ce-b114-9207c41be494 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:22.995481 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-283bcc35-e061-49ce-b114-9207c41be494 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.347754 Jul 28 03:53:22.996798 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2078/3744] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:22 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:23.002222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb96262c-c4c7-4dc6-9d50-e769cac431db tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:23.003660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eb96262c-c4c7-4dc6-9d50-e769cac431db tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:23.011122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb96262c-c4c7-4dc6-9d50-e769cac431db tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:23.020237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb96262c-c4c7-4dc6-9d50-e769cac431db tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:23.021382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb96262c-c4c7-4dc6-9d50-e769cac431db tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:23.022397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb96262c-c4c7-4dc6-9d50-e769cac431db tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:23.334467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eb96262c-c4c7-4dc6-9d50-e769cac431db tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:23.352390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eb96262c-c4c7-4dc6-9d50-e769cac431db tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:23.359848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eb96262c-c4c7-4dc6-9d50-e769cac431db tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:23.364682 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb96262c-c4c7-4dc6-9d50-e769cac431db tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.365255 Jul 28 03:53:23.370785 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2079/3745] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:22 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:23.390482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-01173696-5977-4abe-9566-73228c137dfd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:23.395230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-01173696-5977-4abe-9566-73228c137dfd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:23.410583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01173696-5977-4abe-9566-73228c137dfd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:23.412760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01173696-5977-4abe-9566-73228c137dfd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:23.415232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01173696-5977-4abe-9566-73228c137dfd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:23.419698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01173696-5977-4abe-9566-73228c137dfd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:23.522366 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f49dc3ff-2e92-40bf-a429-e8d846c67093 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:23.537017 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f49dc3ff-2e92-40bf-a429-e8d846c67093 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 0.865732 Jul 28 03:53:23.540193 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1667/3746] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:22 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:23.551330 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4ef8816c-3153-4daf-88f0-ae7200f34213 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:23.552963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4ef8816c-3153-4daf-88f0-ae7200f34213 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:23.570053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ef8816c-3153-4daf-88f0-ae7200f34213 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:23.570892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ef8816c-3153-4daf-88f0-ae7200f34213 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:23.571968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ef8816c-3153-4daf-88f0-ae7200f34213 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:23.575214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ef8816c-3153-4daf-88f0-ae7200f34213 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:23.641610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-01173696-5977-4abe-9566-73228c137dfd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:23.652915 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-01173696-5977-4abe-9566-73228c137dfd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 0.279075 Jul 28 03:53:23.653647 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2080/3747] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:23 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:24.026490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-22aa255c-f0e6-4adc-9b58-685c394b404f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:24.028278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-22aa255c-f0e6-4adc-9b58-685c394b404f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:24.053947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22aa255c-f0e6-4adc-9b58-685c394b404f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:24.054909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22aa255c-f0e6-4adc-9b58-685c394b404f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:24.055840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22aa255c-f0e6-4adc-9b58-685c394b404f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:24.056426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22aa255c-f0e6-4adc-9b58-685c394b404f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:24.079333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4ef8816c-3153-4daf-88f0-ae7200f34213 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:24.090919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4ef8816c-3153-4daf-88f0-ae7200f34213 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:24.094409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4ef8816c-3153-4daf-88f0-ae7200f34213 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:24.101956 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4ef8816c-3153-4daf-88f0-ae7200f34213 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1741 microversion: 2.20 time: 0.560357 Jul 28 03:53:24.102951 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1668/3748] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:23 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1741 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:24.298463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-22aa255c-f0e6-4adc-9b58-685c394b404f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:24.309518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-22aa255c-f0e6-4adc-9b58-685c394b404f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:24.319385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-22aa255c-f0e6-4adc-9b58-685c394b404f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:24.321010 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-22aa255c-f0e6-4adc-9b58-685c394b404f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.301750 Jul 28 03:53:24.322143 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2081/3749] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:24 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:24.396447 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8e8920c3-5c75-41ca-a868-55110a25b705 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:24.397253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8e8920c3-5c75-41ca-a868-55110a25b705 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:24.411454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e8920c3-5c75-41ca-a868-55110a25b705 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:24.412142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e8920c3-5c75-41ca-a868-55110a25b705 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:24.413341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e8920c3-5c75-41ca-a868-55110a25b705 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:24.425125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e8920c3-5c75-41ca-a868-55110a25b705 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:24.565965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-de4633cb-f776-4547-bd67-19e9adf1cbf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:24.577218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-de4633cb-f776-4547-bd67-19e9adf1cbf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:24.591892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de4633cb-f776-4547-bd67-19e9adf1cbf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:24.595687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de4633cb-f776-4547-bd67-19e9adf1cbf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:24.596910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de4633cb-f776-4547-bd67-19e9adf1cbf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:24.601434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de4633cb-f776-4547-bd67-19e9adf1cbf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:24.923173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8e8920c3-5c75-41ca-a868-55110a25b705 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:24.943600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8e8920c3-5c75-41ca-a868-55110a25b705 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:24.943600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8e8920c3-5c75-41ca-a868-55110a25b705 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:24.950814 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8e8920c3-5c75-41ca-a868-55110a25b705 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.557709 Jul 28 03:53:24.954531 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1669/3750] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:24 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:24.982142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-771b6542-b081-42ec-9f9b-1730a0cd162a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:24.983019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-771b6542-b081-42ec-9f9b-1730a0cd162a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:24.995304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-771b6542-b081-42ec-9f9b-1730a0cd162a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:24.995843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-771b6542-b081-42ec-9f9b-1730a0cd162a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:25.001650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-771b6542-b081-42ec-9f9b-1730a0cd162a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:25.002496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-771b6542-b081-42ec-9f9b-1730a0cd162a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:25.099342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-de4633cb-f776-4547-bd67-19e9adf1cbf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:25.115419 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-de4633cb-f776-4547-bd67-19e9adf1cbf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 0.557543 Jul 28 03:53:25.116476 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2082/3751] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:24 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:25.134618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd87284d-751d-4005-b82c-a88806cbdc5a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:25.135243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd87284d-751d-4005-b82c-a88806cbdc5a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:25.167331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd87284d-751d-4005-b82c-a88806cbdc5a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:25.170269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd87284d-751d-4005-b82c-a88806cbdc5a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:25.171099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd87284d-751d-4005-b82c-a88806cbdc5a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:25.176404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd87284d-751d-4005-b82c-a88806cbdc5a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:25.575024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dd87284d-751d-4005-b82c-a88806cbdc5a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:25.578292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:25.599278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dd87284d-751d-4005-b82c-a88806cbdc5a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:25.603589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dd87284d-751d-4005-b82c-a88806cbdc5a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:25.606441 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd87284d-751d-4005-b82c-a88806cbdc5a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1741 microversion: 2.20 time: 0.479632 Jul 28 03:53:25.611668 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2083/3752] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:25 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1741 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:25.622493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d9f0c19-0d3a-44cc-9e47-6f75ba846fa2 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:25.626614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4d9f0c19-0d3a-44cc-9e47-6f75ba846fa2 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:25.653885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d9f0c19-0d3a-44cc-9e47-6f75ba846fa2 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:25.654314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d9f0c19-0d3a-44cc-9e47-6f75ba846fa2 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:25.654897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d9f0c19-0d3a-44cc-9e47-6f75ba846fa2 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:25.657431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-771b6542-b081-42ec-9f9b-1730a0cd162a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:25.661465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d9f0c19-0d3a-44cc-9e47-6f75ba846fa2 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:25.675571 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-771b6542-b081-42ec-9f9b-1730a0cd162a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 0.709412 Jul 28 03:53:25.678734 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1670/3753] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:24 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:25.811730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d9f0c19-0d3a-44cc-9e47-6f75ba846fa2 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:25.821204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d9f0c19-0d3a-44cc-9e47-6f75ba846fa2 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:25.823442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d9f0c19-0d3a-44cc-9e47-6f75ba846fa2 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:25.834319 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d9f0c19-0d3a-44cc-9e47-6f75ba846fa2 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.220949 Jul 28 03:53:25.835498 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2084/3754] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:25 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:25.981593 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d728b3d7-88fd-4eb5-bdac-91eb7283ae43 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:25.982205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d728b3d7-88fd-4eb5-bdac-91eb7283ae43 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:25.996642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d728b3d7-88fd-4eb5-bdac-91eb7283ae43 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:25.997094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d728b3d7-88fd-4eb5-bdac-91eb7283ae43 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:25.997866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d728b3d7-88fd-4eb5-bdac-91eb7283ae43 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:25.998360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d728b3d7-88fd-4eb5-bdac-91eb7283ae43 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:26.139129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-95fe997a-a5bc-4782-912d-a0557bb2a768 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:26.141247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-95fe997a-a5bc-4782-912d-a0557bb2a768 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:26.156262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95fe997a-a5bc-4782-912d-a0557bb2a768 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:26.157133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95fe997a-a5bc-4782-912d-a0557bb2a768 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:26.158319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95fe997a-a5bc-4782-912d-a0557bb2a768 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:26.159705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95fe997a-a5bc-4782-912d-a0557bb2a768 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:26.553305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-95fe997a-a5bc-4782-912d-a0557bb2a768 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:26.563571 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-95fe997a-a5bc-4782-912d-a0557bb2a768 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 0.429523 Jul 28 03:53:26.564943 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2085/3755] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:26 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:26.638993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a004e1e6-067e-447d-bfe5-d42673c679b5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:26.641509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a004e1e6-067e-447d-bfe5-d42673c679b5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:26.649407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d728b3d7-88fd-4eb5-bdac-91eb7283ae43 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:26.656007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a004e1e6-067e-447d-bfe5-d42673c679b5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:26.658311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a004e1e6-067e-447d-bfe5-d42673c679b5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:26.660035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a004e1e6-067e-447d-bfe5-d42673c679b5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:26.661542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a004e1e6-067e-447d-bfe5-d42673c679b5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:26.665141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d728b3d7-88fd-4eb5-bdac-91eb7283ae43 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:26.676434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d728b3d7-88fd-4eb5-bdac-91eb7283ae43 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:26.679153 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d728b3d7-88fd-4eb5-bdac-91eb7283ae43 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.700947 Jul 28 03:53:26.690479 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1671/3756] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:25 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:26.717992 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b01d9cf9-5097-4ca6-b43e-419a9afa718c tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:26.719172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b01d9cf9-5097-4ca6-b43e-419a9afa718c tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:26.761093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b01d9cf9-5097-4ca6-b43e-419a9afa718c tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:26.777240 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b01d9cf9-5097-4ca6-b43e-419a9afa718c tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:26.778243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b01d9cf9-5097-4ca6-b43e-419a9afa718c tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:26.778706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b01d9cf9-5097-4ca6-b43e-419a9afa718c tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:27.321186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a004e1e6-067e-447d-bfe5-d42673c679b5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:27.347177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a004e1e6-067e-447d-bfe5-d42673c679b5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:27.361431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a004e1e6-067e-447d-bfe5-d42673c679b5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:27.363481 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a004e1e6-067e-447d-bfe5-d42673c679b5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1741 microversion: 2.20 time: 0.729289 Jul 28 03:53:27.370019 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2086/3757] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:26 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1741 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:27.378873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62aed776-a122-4b99-b758-d0233648d8cc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:27.389185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-62aed776-a122-4b99-b758-d0233648d8cc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:27.409860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62aed776-a122-4b99-b758-d0233648d8cc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:27.417684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62aed776-a122-4b99-b758-d0233648d8cc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:27.422414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62aed776-a122-4b99-b758-d0233648d8cc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:27.422874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62aed776-a122-4b99-b758-d0233648d8cc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:27.547514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=18 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:27.600815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62aed776-a122-4b99-b758-d0233648d8cc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:27.624875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62aed776-a122-4b99-b758-d0233648d8cc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:27.629494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62aed776-a122-4b99-b758-d0233648d8cc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:27.640873 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-62aed776-a122-4b99-b758-d0233648d8cc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.269336 Jul 28 03:53:27.646028 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2087/3758] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:27 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:27.652970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1fcd8f24-d26b-46d7-b264-d080f09e970b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:27.655914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1fcd8f24-d26b-46d7-b264-d080f09e970b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:27.670258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fcd8f24-d26b-46d7-b264-d080f09e970b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:27.671651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fcd8f24-d26b-46d7-b264-d080f09e970b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:27.673207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fcd8f24-d26b-46d7-b264-d080f09e970b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:27.673883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fcd8f24-d26b-46d7-b264-d080f09e970b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:28.160431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1fcd8f24-d26b-46d7-b264-d080f09e970b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:28.176947 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1fcd8f24-d26b-46d7-b264-d080f09e970b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 0.524884 Jul 28 03:53:28.177982 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2088/3759] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:27 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:28.209635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-833c044e-796c-46dd-8ca0-b43dd6bfbc26 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:28.212005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-833c044e-796c-46dd-8ca0-b43dd6bfbc26 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:28.219919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-833c044e-796c-46dd-8ca0-b43dd6bfbc26 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:28.220428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-833c044e-796c-46dd-8ca0-b43dd6bfbc26 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:28.221882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-833c044e-796c-46dd-8ca0-b43dd6bfbc26 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:28.222944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-833c044e-796c-46dd-8ca0-b43dd6bfbc26 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:28.406975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b01d9cf9-5097-4ca6-b43e-419a9afa718c tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:28.444398 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b01d9cf9-5097-4ca6-b43e-419a9afa718c tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 1.743124 Jul 28 03:53:28.446851 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1672/3760] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:26 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:28.458572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c571ef3e-5b78-4e3c-b70f-a80bfe5eb0e8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:28.464733 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c571ef3e-5b78-4e3c-b70f-a80bfe5eb0e8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:28.479016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c571ef3e-5b78-4e3c-b70f-a80bfe5eb0e8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:28.481859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c571ef3e-5b78-4e3c-b70f-a80bfe5eb0e8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:28.483675 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c571ef3e-5b78-4e3c-b70f-a80bfe5eb0e8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:28.486923 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c571ef3e-5b78-4e3c-b70f-a80bfe5eb0e8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:28.528182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-833c044e-796c-46dd-8ca0-b43dd6bfbc26 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:28.566031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-833c044e-796c-46dd-8ca0-b43dd6bfbc26 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:28.576533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-833c044e-796c-46dd-8ca0-b43dd6bfbc26 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:28.602162 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-833c044e-796c-46dd-8ca0-b43dd6bfbc26 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1365 microversion: 2.47 time: 0.422551 Jul 28 03:53:28.603787 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2089/3761] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:28 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1365 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:28.623518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-275b0249-8bf1-41da-a700-0fb7a2c27def tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:28.629204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-275b0249-8bf1-41da-a700-0fb7a2c27def tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:28.656768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-275b0249-8bf1-41da-a700-0fb7a2c27def tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:28.657867 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c571ef3e-5b78-4e3c-b70f-a80bfe5eb0e8 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/ips" status: 200 len: 149 microversion: 2.1 time: 0.204450 Jul 28 03:53:28.659422 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1673/3762] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:53:28 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/ips => generated 149 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:28.661589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-275b0249-8bf1-41da-a700-0fb7a2c27def tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:28.666143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-275b0249-8bf1-41da-a700-0fb7a2c27def tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:28.666838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-275b0249-8bf1-41da-a700-0fb7a2c27def tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:28.677286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-cb328c1f-8962-4b68-b2ff-0ee31f902b24 req-b24bf77e-1f7f-43cf-b190-72038e0bf14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "057d7888-f34a-422c-853e-31e349089c1c", "tag": "eca48282-6121-4c71-a667-9b08a44281c4"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:28.709648 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-cb328c1f-8962-4b68-b2ff-0ee31f902b24 req-b24bf77e-1f7f-43cf-b190-72038e0bf14f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:28.710476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-cb328c1f-8962-4b68-b2ff-0ee31f902b24 req-b24bf77e-1f7f-43cf-b190-72038e0bf14f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:28.760856 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-cb328c1f-8962-4b68-b2ff-0ee31f902b24 req-b24bf77e-1f7f-43cf-b190-72038e0bf14f service nova] Creating event network-changed:eca48282-6121-4c71-a667-9b08a44281c4 for instance 057d7888-f34a-422c-853e-31e349089c1c on n-h2-826756-3 Jul 28 03:53:28.794760 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-cb328c1f-8962-4b68-b2ff-0ee31f902b24 req-b24bf77e-1f7f-43cf-b190-72038e0bf14f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131505 Jul 28 03:53:28.798998 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1674/3763] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:53:28.811509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6144cf28-f4c7-46f8-b43d-bea4bd0df9e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:28.813112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6144cf28-f4c7-46f8-b43d-bea4bd0df9e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:28.824024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6144cf28-f4c7-46f8-b43d-bea4bd0df9e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:28.825083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6144cf28-f4c7-46f8-b43d-bea4bd0df9e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:28.826186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6144cf28-f4c7-46f8-b43d-bea4bd0df9e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:28.826914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6144cf28-f4c7-46f8-b43d-bea4bd0df9e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:29.131890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6144cf28-f4c7-46f8-b43d-bea4bd0df9e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:29.137619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:29.162909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6144cf28-f4c7-46f8-b43d-bea4bd0df9e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:29.175711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6144cf28-f4c7-46f8-b43d-bea4bd0df9e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:29.177121 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6144cf28-f4c7-46f8-b43d-bea4bd0df9e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.375514 Jul 28 03:53:29.180847 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1675/3764] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:28 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:29.217296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0d4c0a21-bf99-488d-afd4-454f4d4290d2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:29.218144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0d4c0a21-bf99-488d-afd4-454f4d4290d2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:29.265898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d4c0a21-bf99-488d-afd4-454f4d4290d2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:29.266572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d4c0a21-bf99-488d-afd4-454f4d4290d2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:29.282482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d4c0a21-bf99-488d-afd4-454f4d4290d2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:29.287475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d4c0a21-bf99-488d-afd4-454f4d4290d2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:29.786873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-275b0249-8bf1-41da-a700-0fb7a2c27def tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:29.821133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-275b0249-8bf1-41da-a700-0fb7a2c27def tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:29.827087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-275b0249-8bf1-41da-a700-0fb7a2c27def tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:29.836210 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-275b0249-8bf1-41da-a700-0fb7a2c27def tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1741 microversion: 2.20 time: 1.230085 Jul 28 03:53:29.836978 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2090/3765] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:28 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1741 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:29.878868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a3ff82b-d4ee-4847-a05f-3eb04e113b25 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:29.883909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1a3ff82b-d4ee-4847-a05f-3eb04e113b25 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:29.917631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a3ff82b-d4ee-4847-a05f-3eb04e113b25 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:29.919471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a3ff82b-d4ee-4847-a05f-3eb04e113b25 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:29.922936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a3ff82b-d4ee-4847-a05f-3eb04e113b25 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:29.926373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a3ff82b-d4ee-4847-a05f-3eb04e113b25 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:30.433354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1a3ff82b-d4ee-4847-a05f-3eb04e113b25 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:30.451861 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1a3ff82b-d4ee-4847-a05f-3eb04e113b25 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 0.600297 Jul 28 03:53:30.461182 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2091/3766] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:29 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:30.481013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3fdea4c-cf55-4579-9a87-c2c6eab2ee13 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:30.493444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3fdea4c-cf55-4579-9a87-c2c6eab2ee13 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:30.558685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3fdea4c-cf55-4579-9a87-c2c6eab2ee13 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:30.559470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3fdea4c-cf55-4579-9a87-c2c6eab2ee13 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:30.560851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3fdea4c-cf55-4579-9a87-c2c6eab2ee13 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:30.574645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3fdea4c-cf55-4579-9a87-c2c6eab2ee13 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:30.831653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3fdea4c-cf55-4579-9a87-c2c6eab2ee13 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:30.866402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3fdea4c-cf55-4579-9a87-c2c6eab2ee13 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:30.884105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3fdea4c-cf55-4579-9a87-c2c6eab2ee13 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:30.885690 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3fdea4c-cf55-4579-9a87-c2c6eab2ee13 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1371 microversion: 2.47 time: 0.423114 Jul 28 03:53:30.900665 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2092/3767] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:30 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1371 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:30.937793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ee40329-7b1c-4104-9559-2eb3b4a44c84 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:30.941978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5ee40329-7b1c-4104-9559-2eb3b4a44c84 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:30.968830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ee40329-7b1c-4104-9559-2eb3b4a44c84 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:30.981941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ee40329-7b1c-4104-9559-2eb3b4a44c84 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:30.983903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ee40329-7b1c-4104-9559-2eb3b4a44c84 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:30.987021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ee40329-7b1c-4104-9559-2eb3b4a44c84 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:31.115411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ee40329-7b1c-4104-9559-2eb3b4a44c84 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:31.144168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ee40329-7b1c-4104-9559-2eb3b4a44c84 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:31.152732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ee40329-7b1c-4104-9559-2eb3b4a44c84 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:31.158794 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ee40329-7b1c-4104-9559-2eb3b4a44c84 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.258946 Jul 28 03:53:31.178909 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2093/3768] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:30 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:31.191315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f2be6e00-d2fd-477d-8b35-fa4bd9a23793 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:31.192386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f2be6e00-d2fd-477d-8b35-fa4bd9a23793 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:31.200552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2be6e00-d2fd-477d-8b35-fa4bd9a23793 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:31.201384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2be6e00-d2fd-477d-8b35-fa4bd9a23793 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:31.202807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2be6e00-d2fd-477d-8b35-fa4bd9a23793 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:31.203442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2be6e00-d2fd-477d-8b35-fa4bd9a23793 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:31.247617 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0d4c0a21-bf99-488d-afd4-454f4d4290d2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:31.259858 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0d4c0a21-bf99-488d-afd4-454f4d4290d2 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 2.063174 Jul 28 03:53:31.268817 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1676/3769] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:29 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 2074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:31.284989 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-1524bc9b-44ed-47c7-bae8-fce74adf2fc7 req-0a85203e-5f35-42bf-b4df-36c8a05a8a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b176a775-44c8-4373-8e8e-62d58afd3072", "tag": "f63d6385-37de-4e04-a4fa-5dc00f6f6f0e"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:31.326249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1524bc9b-44ed-47c7-bae8-fce74adf2fc7 req-0a85203e-5f35-42bf-b4df-36c8a05a8a88 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:31.326698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1524bc9b-44ed-47c7-bae8-fce74adf2fc7 req-0a85203e-5f35-42bf-b4df-36c8a05a8a88 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:31.360143 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-1524bc9b-44ed-47c7-bae8-fce74adf2fc7 req-0a85203e-5f35-42bf-b4df-36c8a05a8a88 service nova] Creating event network-changed:f63d6385-37de-4e04-a4fa-5dc00f6f6f0e for instance b176a775-44c8-4373-8e8e-62d58afd3072 on n-h2-826756-3 Jul 28 03:53:31.386174 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-1524bc9b-44ed-47c7-bae8-fce74adf2fc7 req-0a85203e-5f35-42bf-b4df-36c8a05a8a88 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115932 Jul 28 03:53:31.392981 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1677/3770] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:31.490360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-96c3cd91-d4c2-457b-8d41-e9fee2ff3b2b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:31.491432 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-96c3cd91-d4c2-457b-8d41-e9fee2ff3b2b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:31.509169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96c3cd91-d4c2-457b-8d41-e9fee2ff3b2b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:31.520489 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96c3cd91-d4c2-457b-8d41-e9fee2ff3b2b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:31.521706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96c3cd91-d4c2-457b-8d41-e9fee2ff3b2b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:31.524586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-96c3cd91-d4c2-457b-8d41-e9fee2ff3b2b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:32.340426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f2be6e00-d2fd-477d-8b35-fa4bd9a23793 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:32.355588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f2be6e00-d2fd-477d-8b35-fa4bd9a23793 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:32.357167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f2be6e00-d2fd-477d-8b35-fa4bd9a23793 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:32.358398 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f2be6e00-d2fd-477d-8b35-fa4bd9a23793 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1741 microversion: 2.20 time: 1.178203 Jul 28 03:53:32.358971 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2094/3771] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:31 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1741 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:32.373678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3abec7d4-15cb-4ef7-b3c4-46bda62b44d3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:32.374291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3abec7d4-15cb-4ef7-b3c4-46bda62b44d3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:32.404435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3abec7d4-15cb-4ef7-b3c4-46bda62b44d3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:32.405394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3abec7d4-15cb-4ef7-b3c4-46bda62b44d3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:32.406262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3abec7d4-15cb-4ef7-b3c4-46bda62b44d3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:32.406713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3abec7d4-15cb-4ef7-b3c4-46bda62b44d3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:32.478105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-96c3cd91-d4c2-457b-8d41-e9fee2ff3b2b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:32.487328 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-96c3cd91-d4c2-457b-8d41-e9fee2ff3b2b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 1.001299 Jul 28 03:53:32.492010 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1678/3772] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:31 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:32.654917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3abec7d4-15cb-4ef7-b3c4-46bda62b44d3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:32.669635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3abec7d4-15cb-4ef7-b3c4-46bda62b44d3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:32.673198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3abec7d4-15cb-4ef7-b3c4-46bda62b44d3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:32.679091 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3abec7d4-15cb-4ef7-b3c4-46bda62b44d3 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1356 microversion: 2.47 time: 0.319026 Jul 28 03:53:32.681363 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2095/3773] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:32 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1356 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:32.691585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-20ad9deb-e836-4fd8-9b1a-f62d555765c0 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:32.697566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-20ad9deb-e836-4fd8-9b1a-f62d555765c0 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:32.709724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20ad9deb-e836-4fd8-9b1a-f62d555765c0 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:32.710579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20ad9deb-e836-4fd8-9b1a-f62d555765c0 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:32.711666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20ad9deb-e836-4fd8-9b1a-f62d555765c0 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:32.712287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20ad9deb-e836-4fd8-9b1a-f62d555765c0 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:32.868237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-20ad9deb-e836-4fd8-9b1a-f62d555765c0 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:32.886422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-20ad9deb-e836-4fd8-9b1a-f62d555765c0 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:32.891431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-20ad9deb-e836-4fd8-9b1a-f62d555765c0 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:32.896538 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-20ad9deb-e836-4fd8-9b1a-f62d555765c0 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.208195 Jul 28 03:53:32.896538 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2096/3774] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:32 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:32.899138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-458546295", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:32.925213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ce2b34b-c9e5-4d15-ab5e-655a5a557057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:32.930717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ce2b34b-c9e5-4d15-ab5e-655a5a557057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:32.963740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ce2b34b-c9e5-4d15-ab5e-655a5a557057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:32.963740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ce2b34b-c9e5-4d15-ab5e-655a5a557057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:32.969512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ce2b34b-c9e5-4d15-ab5e-655a5a557057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:32.970033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ce2b34b-c9e5-4d15-ab5e-655a5a557057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:33.032655 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:53:33.390339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ce2b34b-c9e5-4d15-ab5e-655a5a557057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:33.402989 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ce2b34b-c9e5-4d15-ab5e-655a5a557057 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 0.485314 Jul 28 03:53:33.413645 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2097/3775] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:32 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:33.423482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a0334d7-a79e-4d41-b5a3-5706049f7883 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:33.434878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a0334d7-a79e-4d41-b5a3-5706049f7883 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:33.437256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4a0334d7-a79e-4d41-b5a3-5706049f7883 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Searching by: {'deleted': False, 'project_id': '0f7708baae334a6690987771003f26c1'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:53:33.446892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a0334d7-a79e-4d41-b5a3-5706049f7883 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:33.447995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a0334d7-a79e-4d41-b5a3-5706049f7883 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:33.449090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a0334d7-a79e-4d41-b5a3-5706049f7883 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:33.449944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a0334d7-a79e-4d41-b5a3-5706049f7883 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:33.623138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-4a0334d7-a79e-4d41-b5a3-5706049f7883 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:53:33.711696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a0334d7-a79e-4d41-b5a3-5706049f7883 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:33.719665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a0334d7-a79e-4d41-b5a3-5706049f7883 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:33.720118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a0334d7-a79e-4d41-b5a3-5706049f7883 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:33.731498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a0334d7-a79e-4d41-b5a3-5706049f7883 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:33.733197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a0334d7-a79e-4d41-b5a3-5706049f7883 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:33.771957 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4a0334d7-a79e-4d41-b5a3-5706049f7883 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.356162 Jul 28 03:53:33.773568 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2098/3776] 10.222.0.48 () {60 vars in 1187 bytes} [Thu Jul 28 03:53:33 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:33.783197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-64e0f9ee-9f71-4b0f-bf95-cd66ebeb7ba1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e018e5a-9d2b-4a49-a618-83bcd13abd42"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:33.787183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-64e0f9ee-9f71-4b0f-bf95-cd66ebeb7ba1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:33.800106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64e0f9ee-9f71-4b0f-bf95-cd66ebeb7ba1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:33.800930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64e0f9ee-9f71-4b0f-bf95-cd66ebeb7ba1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:33.802234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64e0f9ee-9f71-4b0f-bf95-cd66ebeb7ba1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:33.802973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64e0f9ee-9f71-4b0f-bf95-cd66ebeb7ba1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:33.889643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:33.937388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:53:33.938205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:53:33.938388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:53:33.938641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:53:33.939278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:53:33.950244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:33.950687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:33.951702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:33.952139 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:33.984743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Getting quotas for project 565b5ba6a4c4496b913bbb8c95b6cd18. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:53:33.991665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Getting quotas for user 6af5e8135e15471f92108c2774212cc3 and project 565b5ba6a4c4496b913bbb8c95b6cd18. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:53:34.012899 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:53:34.015772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:53:34.080320 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6f222149-879c-4dd1-9dca-2af0753a5081 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.586037 Jul 28 03:53:34.088550 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1679/3777] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:53:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:53:34.095774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-08f25bd0-b5af-464b-997b-13e165dcefea tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:34.097225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-08f25bd0-b5af-464b-997b-13e165dcefea tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:34.110490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-08f25bd0-b5af-464b-997b-13e165dcefea tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.111035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-08f25bd0-b5af-464b-997b-13e165dcefea tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.111960 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-08f25bd0-b5af-464b-997b-13e165dcefea tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.114341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-08f25bd0-b5af-464b-997b-13e165dcefea tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.154338 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-64e0f9ee-9f71-4b0f-bf95-cd66ebeb7ba1 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "POST /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379077 Jul 28 03:53:34.155079 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2099/3778] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 03:53:33 2022] POST /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:34.176238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9c65f40a-1b2e-417d-a93e-5541df05e151 req-03c12f33-c83b-4f77-bf88-ef15a897d153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6518bd32-8cbe-4ef4-8813-1923f796b586", "tag": "7b27a036-9343-483f-ab94-976b6b861c67"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:34.207932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9c65f40a-1b2e-417d-a93e-5541df05e151 req-03c12f33-c83b-4f77-bf88-ef15a897d153 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.208614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9c65f40a-1b2e-417d-a93e-5541df05e151 req-03c12f33-c83b-4f77-bf88-ef15a897d153 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.223923 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9c65f40a-1b2e-417d-a93e-5541df05e151 req-03c12f33-c83b-4f77-bf88-ef15a897d153 service nova] Creating event network-changed:7b27a036-9343-483f-ab94-976b6b861c67 for instance 6518bd32-8cbe-4ef4-8813-1923f796b586 on n-h1-826756-3 Jul 28 03:53:34.229994 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9c65f40a-1b2e-417d-a93e-5541df05e151 req-03c12f33-c83b-4f77-bf88-ef15a897d153 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072335 Jul 28 03:53:34.231140 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2100/3779] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:34.238595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c37627b-b980-443b-8300-0a4b6c261938 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:34.239376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5c37627b-b980-443b-8300-0a4b6c261938 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:34.247185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c37627b-b980-443b-8300-0a4b6c261938 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.247640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c37627b-b980-443b-8300-0a4b6c261938 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.248599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c37627b-b980-443b-8300-0a4b6c261938 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.249033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c37627b-b980-443b-8300-0a4b6c261938 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.413032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5c37627b-b980-443b-8300-0a4b6c261938 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:34.439470 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5c37627b-b980-443b-8300-0a4b6c261938 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 0.206771 Jul 28 03:53:34.440089 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2101/3780] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:34 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:34.446869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-65e83fd8-7ba7-4e0e-bb6b-a0854b994d71 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:34.447290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-65e83fd8-7ba7-4e0e-bb6b-a0854b994d71 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:34.454908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65e83fd8-7ba7-4e0e-bb6b-a0854b994d71 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.455375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65e83fd8-7ba7-4e0e-bb6b-a0854b994d71 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.456170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65e83fd8-7ba7-4e0e-bb6b-a0854b994d71 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.456641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65e83fd8-7ba7-4e0e-bb6b-a0854b994d71 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.485097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-65e83fd8-7ba7-4e0e-bb6b-a0854b994d71 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:53:34.597983 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-65e83fd8-7ba7-4e0e-bb6b-a0854b994d71 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "DELETE /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 204 len: 0 microversion: 2.47 time: 0.154813 Jul 28 03:53:34.602712 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2102/3781] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:53:34 2022] DELETE /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:53:34.610507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e6baf666-6c03-4e29-b8b6-c76e071af4b6 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:34.612056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e6baf666-6c03-4e29-b8b6-c76e071af4b6 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:34.623371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6baf666-6c03-4e29-b8b6-c76e071af4b6 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.624926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6baf666-6c03-4e29-b8b6-c76e071af4b6 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.626169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6baf666-6c03-4e29-b8b6-c76e071af4b6 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.626876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6baf666-6c03-4e29-b8b6-c76e071af4b6 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.718478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e6baf666-6c03-4e29-b8b6-c76e071af4b6 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:34.731193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e6baf666-6c03-4e29-b8b6-c76e071af4b6 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:34.732757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e6baf666-6c03-4e29-b8b6-c76e071af4b6 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:34.734221 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e6baf666-6c03-4e29-b8b6-c76e071af4b6 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.133449 Jul 28 03:53:34.735053 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2103/3782] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:34 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:34.741637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-622c27c3-44ce-4f71-adfb-80c8c1b6ca9c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:34.749072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-622c27c3-44ce-4f71-adfb-80c8c1b6ca9c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:34.752381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-08f25bd0-b5af-464b-997b-13e165dcefea tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:34.761717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-08f25bd0-b5af-464b-997b-13e165dcefea tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:34.763430 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-08f25bd0-b5af-464b-997b-13e165dcefea tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:34.765411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-622c27c3-44ce-4f71-adfb-80c8c1b6ca9c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.765411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-622c27c3-44ce-4f71-adfb-80c8c1b6ca9c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.765411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-622c27c3-44ce-4f71-adfb-80c8c1b6ca9c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.765411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-622c27c3-44ce-4f71-adfb-80c8c1b6ca9c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.767273 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-08f25bd0-b5af-464b-997b-13e165dcefea tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1723 microversion: 2.20 time: 0.676975 Jul 28 03:53:34.785075 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1680/3783] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:34 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1723 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:34.785075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e3cc8baf-9fe0-4271-8509-3e08d9f783fe tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:34.785075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e3cc8baf-9fe0-4271-8509-3e08d9f783fe tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:34.791143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3cc8baf-9fe0-4271-8509-3e08d9f783fe tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.791143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3cc8baf-9fe0-4271-8509-3e08d9f783fe tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.792009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3cc8baf-9fe0-4271-8509-3e08d9f783fe tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.792420 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3cc8baf-9fe0-4271-8509-3e08d9f783fe tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.869631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-622c27c3-44ce-4f71-adfb-80c8c1b6ca9c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:34.879236 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-622c27c3-44ce-4f71-adfb-80c8c1b6ca9c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1220 microversion: 2.1 time: 0.143139 Jul 28 03:53:34.879891 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2104/3784] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:34 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1220 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:34.884809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c4bf69d4-f16b-4adf-94ba-93f6de8f917b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:34.885717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c4bf69d4-f16b-4adf-94ba-93f6de8f917b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:34.893649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4bf69d4-f16b-4adf-94ba-93f6de8f917b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.894098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4bf69d4-f16b-4adf-94ba-93f6de8f917b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.894931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4bf69d4-f16b-4adf-94ba-93f6de8f917b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:34.895833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4bf69d4-f16b-4adf-94ba-93f6de8f917b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:34.996890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c4bf69d4-f16b-4adf-94ba-93f6de8f917b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:35.006828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c4bf69d4-f16b-4adf-94ba-93f6de8f917b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:35.009089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c4bf69d4-f16b-4adf-94ba-93f6de8f917b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:35.009658 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c4bf69d4-f16b-4adf-94ba-93f6de8f917b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1362 microversion: 2.47 time: 0.128792 Jul 28 03:53:35.010456 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2105/3785] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:34 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1362 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:35.059257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e3cc8baf-9fe0-4271-8509-3e08d9f783fe tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:35.074009 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e3cc8baf-9fe0-4271-8509-3e08d9f783fe tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 0.296061 Jul 28 03:53:35.075047 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1681/3786] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:34 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:35.466461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66eb68f3-f07a-48c7-8210-707518a300f6 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:35.468723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-66eb68f3-f07a-48c7-8210-707518a300f6 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:35.479158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66eb68f3-f07a-48c7-8210-707518a300f6 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:35.480336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66eb68f3-f07a-48c7-8210-707518a300f6 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:35.481646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66eb68f3-f07a-48c7-8210-707518a300f6 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:35.482714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66eb68f3-f07a-48c7-8210-707518a300f6 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:35.684115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-66eb68f3-f07a-48c7-8210-707518a300f6 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:35.711622 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-66eb68f3-f07a-48c7-8210-707518a300f6 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 0.252975 Jul 28 03:53:35.712568 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2106/3787] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:35 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:35.763511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-82544512-e3e4-450a-9110-895e973cb45f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:35.764122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-82544512-e3e4-450a-9110-895e973cb45f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:35.779042 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-82544512-e3e4-450a-9110-895e973cb45f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:35.779845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-82544512-e3e4-450a-9110-895e973cb45f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:35.780331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-82544512-e3e4-450a-9110-895e973cb45f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:35.780801 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-82544512-e3e4-450a-9110-895e973cb45f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:35.812981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3d526a46-1fd5-4dda-8272-0f9d1803671c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:35.814766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3d526a46-1fd5-4dda-8272-0f9d1803671c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:35.828862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d526a46-1fd5-4dda-8272-0f9d1803671c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:35.830720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d526a46-1fd5-4dda-8272-0f9d1803671c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:35.834397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d526a46-1fd5-4dda-8272-0f9d1803671c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:35.835919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d526a46-1fd5-4dda-8272-0f9d1803671c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:35.915917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-82544512-e3e4-450a-9110-895e973cb45f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:35.928281 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-82544512-e3e4-450a-9110-895e973cb45f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:35.929890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-82544512-e3e4-450a-9110-895e973cb45f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:35.931127 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-82544512-e3e4-450a-9110-895e973cb45f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.171652 Jul 28 03:53:35.946642 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1682/3788] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:35 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:35.953510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1087772c-84df-4de8-b1f1-95ac4ce7a023 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:35.954386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1087772c-84df-4de8-b1f1-95ac4ce7a023 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:35.972905 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1087772c-84df-4de8-b1f1-95ac4ce7a023 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:35.975668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1087772c-84df-4de8-b1f1-95ac4ce7a023 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:35.976614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1087772c-84df-4de8-b1f1-95ac4ce7a023 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:35.978372 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1087772c-84df-4de8-b1f1-95ac4ce7a023 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:36.120145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3d526a46-1fd5-4dda-8272-0f9d1803671c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:36.135926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3d526a46-1fd5-4dda-8272-0f9d1803671c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:36.151180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3d526a46-1fd5-4dda-8272-0f9d1803671c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:36.155862 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3d526a46-1fd5-4dda-8272-0f9d1803671c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1723 microversion: 2.20 time: 0.358371 Jul 28 03:53:36.160438 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1087772c-84df-4de8-b1f1-95ac4ce7a023 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:36.169213 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2107/3789] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:35 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:36.183161 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1087772c-84df-4de8-b1f1-95ac4ce7a023 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1276 microversion: 2.1 time: 0.234839 Jul 28 03:53:36.183515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-261bbbb1-0967-4746-bc26-b883420d613b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:36.184332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-261bbbb1-0967-4746-bc26-b883420d613b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:36.197638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-261bbbb1-0967-4746-bc26-b883420d613b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:36.201671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-261bbbb1-0967-4746-bc26-b883420d613b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:36.202728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-261bbbb1-0967-4746-bc26-b883420d613b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:36.203289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-261bbbb1-0967-4746-bc26-b883420d613b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:36.220121 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1683/3790] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:35 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1276 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:36.230984 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-48edb79e-9075-445b-9ad4-3f139b674ff5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:36.231911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-48edb79e-9075-445b-9ad4-3f139b674ff5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:36.250870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-48edb79e-9075-445b-9ad4-3f139b674ff5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:36.254239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-48edb79e-9075-445b-9ad4-3f139b674ff5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:36.257095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-48edb79e-9075-445b-9ad4-3f139b674ff5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:36.257925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-48edb79e-9075-445b-9ad4-3f139b674ff5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:36.352194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-261bbbb1-0967-4746-bc26-b883420d613b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:36.363315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-261bbbb1-0967-4746-bc26-b883420d613b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:36.366582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-261bbbb1-0967-4746-bc26-b883420d613b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:36.368917 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-261bbbb1-0967-4746-bc26-b883420d613b tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1362 microversion: 2.47 time: 0.198399 Jul 28 03:53:36.370170 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2108/3791] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:36 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:36.739680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-49678d8d-498a-44e0-b86f-70aa905b8cda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:36.741129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-49678d8d-498a-44e0-b86f-70aa905b8cda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:36.759419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49678d8d-498a-44e0-b86f-70aa905b8cda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:36.759944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49678d8d-498a-44e0-b86f-70aa905b8cda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:36.760794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49678d8d-498a-44e0-b86f-70aa905b8cda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:36.761469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49678d8d-498a-44e0-b86f-70aa905b8cda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:37.010349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-49678d8d-498a-44e0-b86f-70aa905b8cda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:37.019412 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-49678d8d-498a-44e0-b86f-70aa905b8cda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 0.284056 Jul 28 03:53:37.020628 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2109/3792] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:36 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:37.026052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-446c2fe0-c494-4cbb-97ae-bb1e5724cced tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:37.027133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-446c2fe0-c494-4cbb-97ae-bb1e5724cced tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:37.034298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-446c2fe0-c494-4cbb-97ae-bb1e5724cced tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:37.035150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-446c2fe0-c494-4cbb-97ae-bb1e5724cced tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:37.036699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-446c2fe0-c494-4cbb-97ae-bb1e5724cced tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:37.037408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-446c2fe0-c494-4cbb-97ae-bb1e5724cced tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:37.122954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-446c2fe0-c494-4cbb-97ae-bb1e5724cced tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:37.132667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-446c2fe0-c494-4cbb-97ae-bb1e5724cced tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:37.134261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-446c2fe0-c494-4cbb-97ae-bb1e5724cced tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:37.135451 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-446c2fe0-c494-4cbb-97ae-bb1e5724cced tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.113398 Jul 28 03:53:37.136010 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2110/3793] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:37 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:37.194559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-69d85d88-164f-4353-8766-9a9dedef819e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:37.195719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-69d85d88-164f-4353-8766-9a9dedef819e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:37.205157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69d85d88-164f-4353-8766-9a9dedef819e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:37.205595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69d85d88-164f-4353-8766-9a9dedef819e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:37.206448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69d85d88-164f-4353-8766-9a9dedef819e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:37.206820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69d85d88-164f-4353-8766-9a9dedef819e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:37.419561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-69d85d88-164f-4353-8766-9a9dedef819e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:37.450455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-69d85d88-164f-4353-8766-9a9dedef819e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:37.454792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-69d85d88-164f-4353-8766-9a9dedef819e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:37.457334 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-69d85d88-164f-4353-8766-9a9dedef819e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1723 microversion: 2.20 time: 0.277216 Jul 28 03:53:37.475200 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2111/3794] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:37 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:37.482575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c92684b-5f57-40ee-9550-dcd08ea5d119 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:37.484057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c92684b-5f57-40ee-9550-dcd08ea5d119 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:37.494631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c92684b-5f57-40ee-9550-dcd08ea5d119 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:37.495140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c92684b-5f57-40ee-9550-dcd08ea5d119 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:37.495982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c92684b-5f57-40ee-9550-dcd08ea5d119 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:37.496481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c92684b-5f57-40ee-9550-dcd08ea5d119 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:37.608107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7c92684b-5f57-40ee-9550-dcd08ea5d119 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:37.637867 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7c92684b-5f57-40ee-9550-dcd08ea5d119 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1274 microversion: 2.1 time: 0.158334 Jul 28 03:53:37.653408 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2112/3795] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:37 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1274 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:37.673301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bbfe483e-d25c-41e7-8978-93d7483b98f0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:37.674251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bbfe483e-d25c-41e7-8978-93d7483b98f0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:37.688394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbfe483e-d25c-41e7-8978-93d7483b98f0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:37.688712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbfe483e-d25c-41e7-8978-93d7483b98f0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:37.690667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbfe483e-d25c-41e7-8978-93d7483b98f0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:37.691301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbfe483e-d25c-41e7-8978-93d7483b98f0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:37.736434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:37.739444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbfe483e-d25c-41e7-8978-93d7483b98f0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:37.740292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbfe483e-d25c-41e7-8978-93d7483b98f0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:37.741694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-bbfe483e-d25c-41e7-8978-93d7483b98f0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lazy-loading 'fault' on Instance uuid 17ea907f-7e1b-451a-87ec-b3ba6eee8526 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:53:38.366276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bbfe483e-d25c-41e7-8978-93d7483b98f0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:38.369976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:38.391598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bbfe483e-d25c-41e7-8978-93d7483b98f0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:38.402006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bbfe483e-d25c-41e7-8978-93d7483b98f0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:38.403809 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bbfe483e-d25c-41e7-8978-93d7483b98f0 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 200 len: 1367 microversion: 2.47 time: 0.749008 Jul 28 03:53:38.406396 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2113/3796] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:37 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 1367 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:38.412779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9da5b30e-8b33-4ea3-9b22-ddc658692441 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:38.413905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9da5b30e-8b33-4ea3-9b22-ddc658692441 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:38.424639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9da5b30e-8b33-4ea3-9b22-ddc658692441 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:38.425476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9da5b30e-8b33-4ea3-9b22-ddc658692441 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:38.426657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9da5b30e-8b33-4ea3-9b22-ddc658692441 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:38.427259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9da5b30e-8b33-4ea3-9b22-ddc658692441 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:38.468580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-48edb79e-9075-445b-9ad4-3f139b674ff5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:38.483123 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-48edb79e-9075-445b-9ad4-3f139b674ff5 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1512 microversion: 2.1 time: 2.261330 Jul 28 03:53:38.502528 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1684/3797] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:36 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1512 bytes in 2282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:38.508779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4186a590-9b1b-4f76-939f-6449414343dc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:38.509867 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4186a590-9b1b-4f76-939f-6449414343dc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:38.532641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4186a590-9b1b-4f76-939f-6449414343dc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:38.533086 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4186a590-9b1b-4f76-939f-6449414343dc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:38.540450 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4186a590-9b1b-4f76-939f-6449414343dc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:38.540913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4186a590-9b1b-4f76-939f-6449414343dc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:38.750045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9da5b30e-8b33-4ea3-9b22-ddc658692441 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:38.760418 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9da5b30e-8b33-4ea3-9b22-ddc658692441 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 0.352191 Jul 28 03:53:38.761769 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2114/3798] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:38 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:38.778172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4918d366-0275-44cf-b62f-c269cbe08087 req-6daf7762-6ee7-47c9-b745-bcee61d1e318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057d7888-f34a-422c-853e-31e349089c1c", "name": "network-vif-plugged", "status": "completed", "tag": "eca48282-6121-4c71-a667-9b08a44281c4"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:38.789238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4918d366-0275-44cf-b62f-c269cbe08087 req-6daf7762-6ee7-47c9-b745-bcee61d1e318 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:38.789687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4918d366-0275-44cf-b62f-c269cbe08087 req-6daf7762-6ee7-47c9-b745-bcee61d1e318 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:38.805489 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4918d366-0275-44cf-b62f-c269cbe08087 req-6daf7762-6ee7-47c9-b745-bcee61d1e318 service nova] Creating event network-vif-plugged:eca48282-6121-4c71-a667-9b08a44281c4 for instance 057d7888-f34a-422c-853e-31e349089c1c on n-h2-826756-3 Jul 28 03:53:38.812266 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4918d366-0275-44cf-b62f-c269cbe08087 req-6daf7762-6ee7-47c9-b745-bcee61d1e318 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048002 Jul 28 03:53:38.813650 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2115/3799] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:38.821152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a2d9483-5cc3-45cd-928c-0c9dbea9e583 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:38.821972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1a2d9483-5cc3-45cd-928c-0c9dbea9e583 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:38.829970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4186a590-9b1b-4f76-939f-6449414343dc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:38.833394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a2d9483-5cc3-45cd-928c-0c9dbea9e583 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:38.834324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a2d9483-5cc3-45cd-928c-0c9dbea9e583 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:38.835926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a2d9483-5cc3-45cd-928c-0c9dbea9e583 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:38.836599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a2d9483-5cc3-45cd-928c-0c9dbea9e583 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:38.843773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4186a590-9b1b-4f76-939f-6449414343dc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:38.848412 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4186a590-9b1b-4f76-939f-6449414343dc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:38.853050 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4186a590-9b1b-4f76-939f-6449414343dc tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.349096 Jul 28 03:53:38.855676 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1685/3800] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:38 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:38.865461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3e8e77f9-d9d0-4b55-9cf6-a4e0929b529c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:38.867864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3e8e77f9-d9d0-4b55-9cf6-a4e0929b529c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:38.888715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e8e77f9-d9d0-4b55-9cf6-a4e0929b529c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:38.889504 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e8e77f9-d9d0-4b55-9cf6-a4e0929b529c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:38.890558 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e8e77f9-d9d0-4b55-9cf6-a4e0929b529c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:38.891208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e8e77f9-d9d0-4b55-9cf6-a4e0929b529c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:39.133355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1a2d9483-5cc3-45cd-928c-0c9dbea9e583 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:39.138816 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3e8e77f9-d9d0-4b55-9cf6-a4e0929b529c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:39.146958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1a2d9483-5cc3-45cd-928c-0c9dbea9e583 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:39.148545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1a2d9483-5cc3-45cd-928c-0c9dbea9e583 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:39.149962 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1a2d9483-5cc3-45cd-928c-0c9dbea9e583 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1723 microversion: 2.20 time: 0.334282 Jul 28 03:53:39.150887 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2116/3801] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:38 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:39.166210 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3e8e77f9-d9d0-4b55-9cf6-a4e0929b529c tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1274 microversion: 2.1 time: 0.308356 Jul 28 03:53:39.169652 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1686/3802] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:38 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1274 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:39.434540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-657418ec-a5a3-451f-bf48-623ea8534d76 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:39.435164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-657418ec-a5a3-451f-bf48-623ea8534d76 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 17ea907f-7e1b-451a-87ec-b3ba6eee8526] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:39.450037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-657418ec-a5a3-451f-bf48-623ea8534d76 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:39.450618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-657418ec-a5a3-451f-bf48-623ea8534d76 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:39.451536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-657418ec-a5a3-451f-bf48-623ea8534d76 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:39.452482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-657418ec-a5a3-451f-bf48-623ea8534d76 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:39.475551 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-657418ec-a5a3-451f-bf48-623ea8534d76 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] HTTP exception thrown: Instance 17ea907f-7e1b-451a-87ec-b3ba6eee8526 could not be found. Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-657418ec-a5a3-451f-bf48-623ea8534d76 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Request method failure captured: Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 HTTP/1.1 Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ggQBLa5O71gU53rkGfoPP7gOzF1bp9Nv24i0t01SH2c3HV6ACFP12GcM5u8Hv8i578eggOBTZ1GUCRuvO8FDiLFAeae0u8iQ2Uv17duTZZP2XhF3o4Olz2cVlO47_RkUOtmLTkEbBKiGD65373VTDqRL4n4ypJE_3kF3VLlvfSjKZA Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.47 Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 0f7708baae334a6690987771003f26c1 Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerShowV247Test-276053072 Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0f7708baae334a6690987771003f26c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f7708baae334a6690987771003f26c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0f7708baae334a6690987771003f26c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f7708baae334a6690987771003f26c1"}]}] Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerShowV247Test-276053072 Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 0f7708baae334a6690987771003f26c1 Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerShowV247Test-276053072 Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerShowV247Test-276053072-project Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 7d06eada4fd84fb493d81e3e66623809 Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerShowV247Test-276053072-project Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 17ea907f-7e1b-451a-87ec-b3ba6eee8526 could not be found. Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '17ea907f-7e1b-451a-87ec-b3ba6eee8526'} Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17ea907f-7e1b-451a-87ec-b3ba6eee8526 could not be found. Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17ea907f-7e1b-451a-87ec-b3ba6eee8526 could not be found. Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:39.477928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:39.483493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:39.483493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:39.483493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:39.483493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:53:39.483493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:53:39.483493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17ea907f-7e1b-451a-87ec-b3ba6eee8526 could not be found. Jul 28 03:53:39.483493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:39.485808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-657418ec-a5a3-451f-bf48-623ea8534d76 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Returning 404 to user: Instance 17ea907f-7e1b-451a-87ec-b3ba6eee8526 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:39.486910 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-657418ec-a5a3-451f-bf48-623ea8534d76 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526" status: 404 len: 111 microversion: 2.47 time: 0.059395 Jul 28 03:53:39.487662 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2117/3803] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:39 2022] GET /compute/v2.1/servers/17ea907f-7e1b-451a-87ec-b3ba6eee8526 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:53:39.500418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-01aee1f6-9d1c-4383-b507-424eb81a041f tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:39.502570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-01aee1f6-9d1c-4383-b507-424eb81a041f tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 5e460e72-5983-4de4-8331-277067642ac9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:39.512225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01aee1f6-9d1c-4383-b507-424eb81a041f tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:39.514214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01aee1f6-9d1c-4383-b507-424eb81a041f tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:39.518950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9fddaf03-7a9b-4187-8b4b-23ed2fcf006c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:39.519701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9fddaf03-7a9b-4187-8b4b-23ed2fcf006c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:39.528177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01aee1f6-9d1c-4383-b507-424eb81a041f tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:39.529374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fddaf03-7a9b-4187-8b4b-23ed2fcf006c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:39.530104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fddaf03-7a9b-4187-8b4b-23ed2fcf006c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:39.531288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01aee1f6-9d1c-4383-b507-424eb81a041f tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:39.531477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fddaf03-7a9b-4187-8b4b-23ed2fcf006c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:39.533185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fddaf03-7a9b-4187-8b4b-23ed2fcf006c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:39.576638 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-01aee1f6-9d1c-4383-b507-424eb81a041f tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 5e460e72-5983-4de4-8331-277067642ac9] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:53:39.759712 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-01aee1f6-9d1c-4383-b507-424eb81a041f tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9" status: 204 len: 0 microversion: 2.47 time: 0.266896 Jul 28 03:53:39.760230 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1687/3804] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:53:39 2022] DELETE /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:53:39.772273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-47777d4f-7e77-4dc0-8e68-332008f9d168 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:39.773478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-47777d4f-7e77-4dc0-8e68-332008f9d168 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 5e460e72-5983-4de4-8331-277067642ac9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:39.783514 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47777d4f-7e77-4dc0-8e68-332008f9d168 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:39.784713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47777d4f-7e77-4dc0-8e68-332008f9d168 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:39.786459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47777d4f-7e77-4dc0-8e68-332008f9d168 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:39.787134 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47777d4f-7e77-4dc0-8e68-332008f9d168 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:39.850945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9fddaf03-7a9b-4187-8b4b-23ed2fcf006c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:39.859330 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9fddaf03-7a9b-4187-8b4b-23ed2fcf006c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1489 microversion: 2.1 time: 0.346445 Jul 28 03:53:39.863112 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2118/3805] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:39 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1489 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:39.890990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1d8e4437-f268-4a80-9271-af25d28f6196 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:39.891864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1d8e4437-f268-4a80-9271-af25d28f6196 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:39.901259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d8e4437-f268-4a80-9271-af25d28f6196 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:39.901726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d8e4437-f268-4a80-9271-af25d28f6196 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:39.902534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d8e4437-f268-4a80-9271-af25d28f6196 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:39.902975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d8e4437-f268-4a80-9271-af25d28f6196 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:40.077015 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-47777d4f-7e77-4dc0-8e68-332008f9d168 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:40.098723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-47777d4f-7e77-4dc0-8e68-332008f9d168 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:40.100646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-47777d4f-7e77-4dc0-8e68-332008f9d168 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:40.102066 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-47777d4f-7e77-4dc0-8e68-332008f9d168 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9" status: 200 len: 1363 microversion: 2.47 time: 0.337156 Jul 28 03:53:40.103102 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1688/3806] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:39 2022] GET /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:40.109104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-901ef1ae-5ddf-4fc3-a320-fd2bdbc5dfd5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:40.109863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-901ef1ae-5ddf-4fc3-a320-fd2bdbc5dfd5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:40.117219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-901ef1ae-5ddf-4fc3-a320-fd2bdbc5dfd5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:40.117812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-901ef1ae-5ddf-4fc3-a320-fd2bdbc5dfd5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:40.118902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-901ef1ae-5ddf-4fc3-a320-fd2bdbc5dfd5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:40.119442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-901ef1ae-5ddf-4fc3-a320-fd2bdbc5dfd5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:40.364672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-901ef1ae-5ddf-4fc3-a320-fd2bdbc5dfd5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:40.373485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-901ef1ae-5ddf-4fc3-a320-fd2bdbc5dfd5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:40.380673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-901ef1ae-5ddf-4fc3-a320-fd2bdbc5dfd5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:40.382061 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-901ef1ae-5ddf-4fc3-a320-fd2bdbc5dfd5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.277907 Jul 28 03:53:40.396385 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1689/3807] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:40 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:40.400983 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-93b258a2-6194-4843-84c4-aa258f4e8c42 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:40.402194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-93b258a2-6194-4843-84c4-aa258f4e8c42 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:40.422250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-93b258a2-6194-4843-84c4-aa258f4e8c42 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:40.423434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-93b258a2-6194-4843-84c4-aa258f4e8c42 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:40.425715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-93b258a2-6194-4843-84c4-aa258f4e8c42 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:40.426418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-93b258a2-6194-4843-84c4-aa258f4e8c42 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:40.465588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-93b258a2-6194-4843-84c4-aa258f4e8c42 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:53:40.465867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1d8e4437-f268-4a80-9271-af25d28f6196 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:40.479052 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1d8e4437-f268-4a80-9271-af25d28f6196 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 0.605168 Jul 28 03:53:40.479880 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2119/3808] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:39 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:40.496407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59f67ecd-c148-43a1-bc3d-e999b049a45e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:40.496995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59f67ecd-c148-43a1-bc3d-e999b049a45e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:40.511744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59f67ecd-c148-43a1-bc3d-e999b049a45e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:40.515244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59f67ecd-c148-43a1-bc3d-e999b049a45e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:40.516113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59f67ecd-c148-43a1-bc3d-e999b049a45e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:40.516586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59f67ecd-c148-43a1-bc3d-e999b049a45e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:40.576420 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:40.629174 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-93b258a2-6194-4843-84c4-aa258f4e8c42 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "DELETE /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 204 len: 0 microversion: 2.1 time: 0.242017 Jul 28 03:53:40.635563 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1690/3809] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:53:40 2022] DELETE /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:53:40.646855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a8326f68-f075-4249-8369-6ff7af162d33 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:40.648049 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a8326f68-f075-4249-8369-6ff7af162d33 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:40.656818 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8326f68-f075-4249-8369-6ff7af162d33 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:40.657724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8326f68-f075-4249-8369-6ff7af162d33 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:40.659494 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8326f68-f075-4249-8369-6ff7af162d33 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:40.661025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8326f68-f075-4249-8369-6ff7af162d33 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:40.703233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-59f67ecd-c148-43a1-bc3d-e999b049a45e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:40.713626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-59f67ecd-c148-43a1-bc3d-e999b049a45e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:40.715514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-59f67ecd-c148-43a1-bc3d-e999b049a45e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:40.716997 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59f67ecd-c148-43a1-bc3d-e999b049a45e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1723 microversion: 2.20 time: 0.236302 Jul 28 03:53:40.718504 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2120/3810] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:40 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:40.724078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-229691db-e156-46ef-9879-28d8287928c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:40.726864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-229691db-e156-46ef-9879-28d8287928c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:40.735044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-229691db-e156-46ef-9879-28d8287928c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:40.735878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-229691db-e156-46ef-9879-28d8287928c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:40.745328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-229691db-e156-46ef-9879-28d8287928c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:40.749498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-229691db-e156-46ef-9879-28d8287928c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:41.034840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-229691db-e156-46ef-9879-28d8287928c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:41.053786 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-229691db-e156-46ef-9879-28d8287928c0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1495 microversion: 2.1 time: 0.333491 Jul 28 03:53:41.064226 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2121/3811] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:40 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1495 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:41.071325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4ceef2cb-f5a4-4636-aa27-addfa62c8edc req-e5bf1895-006f-42f2-9ab8-c183a6303c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6518bd32-8cbe-4ef4-8813-1923f796b586", "name": "network-vif-plugged", "status": "completed", "tag": "7b27a036-9343-483f-ab94-976b6b861c67"}, {"server_uuid": "99d0126e-11bf-4048-9e35-7309c228b534", "name": "network-vif-unplugged", "status": "completed", "tag": "f15c48dd-54c1-4291-88c3-ac0923fa48e7"}, {"server_uuid": "b176a775-44c8-4373-8e8e-62d58afd3072", "name": "network-vif-plugged", "status": "completed", "tag": "f63d6385-37de-4e04-a4fa-5dc00f6f6f0e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:41.084042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4ceef2cb-f5a4-4636-aa27-addfa62c8edc req-e5bf1895-006f-42f2-9ab8-c183a6303c7e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:41.084883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4ceef2cb-f5a4-4636-aa27-addfa62c8edc req-e5bf1895-006f-42f2-9ab8-c183a6303c7e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:41.108386 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4ceef2cb-f5a4-4636-aa27-addfa62c8edc req-e5bf1895-006f-42f2-9ab8-c183a6303c7e service nova] Creating event network-vif-plugged:7b27a036-9343-483f-ab94-976b6b861c67 for instance 6518bd32-8cbe-4ef4-8813-1923f796b586 on n-h1-826756-3 Jul 28 03:53:41.109333 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4ceef2cb-f5a4-4636-aa27-addfa62c8edc req-e5bf1895-006f-42f2-9ab8-c183a6303c7e service nova] Creating event network-vif-unplugged:f15c48dd-54c1-4291-88c3-ac0923fa48e7 for instance 99d0126e-11bf-4048-9e35-7309c228b534 on n-h2-826756-3 Jul 28 03:53:41.110118 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4ceef2cb-f5a4-4636-aa27-addfa62c8edc req-e5bf1895-006f-42f2-9ab8-c183a6303c7e service nova] Creating event network-vif-plugged:f63d6385-37de-4e04-a4fa-5dc00f6f6f0e for instance b176a775-44c8-4373-8e8e-62d58afd3072 on n-h2-826756-3 Jul 28 03:53:41.140222 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4ceef2cb-f5a4-4636-aa27-addfa62c8edc req-e5bf1895-006f-42f2-9ab8-c183a6303c7e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.073344 Jul 28 03:53:41.141369 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2122/3812] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:41.179195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6065c450-01e1-48e2-a45d-9b3d390317a5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:41.180825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6065c450-01e1-48e2-a45d-9b3d390317a5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 5e460e72-5983-4de4-8331-277067642ac9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:41.201255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6065c450-01e1-48e2-a45d-9b3d390317a5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:41.205200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6065c450-01e1-48e2-a45d-9b3d390317a5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:41.206880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6065c450-01e1-48e2-a45d-9b3d390317a5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:41.207634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6065c450-01e1-48e2-a45d-9b3d390317a5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:41.305112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6065c450-01e1-48e2-a45d-9b3d390317a5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:41.337982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6065c450-01e1-48e2-a45d-9b3d390317a5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:41.351116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6065c450-01e1-48e2-a45d-9b3d390317a5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:41.353256 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6065c450-01e1-48e2-a45d-9b3d390317a5 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9" status: 200 len: 1363 microversion: 2.47 time: 0.210275 Jul 28 03:53:41.355083 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2123/3813] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:41 2022] GET /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:41.422125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f835a54-7e24-49b1-b53a-4814f7e0589f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:41.423875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8f835a54-7e24-49b1-b53a-4814f7e0589f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:41.432287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f835a54-7e24-49b1-b53a-4814f7e0589f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:41.433049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f835a54-7e24-49b1-b53a-4814f7e0589f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:41.434093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f835a54-7e24-49b1-b53a-4814f7e0589f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:41.434977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f835a54-7e24-49b1-b53a-4814f7e0589f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:41.641678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8f835a54-7e24-49b1-b53a-4814f7e0589f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:41.676643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8f835a54-7e24-49b1-b53a-4814f7e0589f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:41.680734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8f835a54-7e24-49b1-b53a-4814f7e0589f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:41.683669 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8f835a54-7e24-49b1-b53a-4814f7e0589f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.274546 Jul 28 03:53:41.685410 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2124/3814] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:41 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:41.700110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-49ff6a57-6fec-4599-bd6a-d8c872f1d8e0 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:41.700919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-49ff6a57-6fec-4599-bd6a-d8c872f1d8e0 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:41.711114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49ff6a57-6fec-4599-bd6a-d8c872f1d8e0 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:41.715721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49ff6a57-6fec-4599-bd6a-d8c872f1d8e0 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:41.721207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49ff6a57-6fec-4599-bd6a-d8c872f1d8e0 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:41.721660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49ff6a57-6fec-4599-bd6a-d8c872f1d8e0 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:41.746006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a8326f68-f075-4249-8369-6ff7af162d33 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:41.755364 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a8326f68-f075-4249-8369-6ff7af162d33 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1316 microversion: 2.1 time: 1.117384 Jul 28 03:53:41.756881 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1691/3815] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:40 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1316 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:41.762483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f89bcdc6-de44-4cbd-b8ef-6ebdeb07ce82 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:41.763075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f89bcdc6-de44-4cbd-b8ef-6ebdeb07ce82 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:41.775350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f89bcdc6-de44-4cbd-b8ef-6ebdeb07ce82 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:41.776139 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f89bcdc6-de44-4cbd-b8ef-6ebdeb07ce82 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:41.777308 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f89bcdc6-de44-4cbd-b8ef-6ebdeb07ce82 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:41.777748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f89bcdc6-de44-4cbd-b8ef-6ebdeb07ce82 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:41.949512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f89bcdc6-de44-4cbd-b8ef-6ebdeb07ce82 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:41.966433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f89bcdc6-de44-4cbd-b8ef-6ebdeb07ce82 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:41.969758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f89bcdc6-de44-4cbd-b8ef-6ebdeb07ce82 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:41.971967 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f89bcdc6-de44-4cbd-b8ef-6ebdeb07ce82 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1723 microversion: 2.20 time: 0.213586 Jul 28 03:53:41.984967 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1692/3816] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:41 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:42.048720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-49ff6a57-6fec-4599-bd6a-d8c872f1d8e0 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:42.074585 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-49ff6a57-6fec-4599-bd6a-d8c872f1d8e0 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 0.387437 Jul 28 03:53:42.075217 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2125/3817] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:41 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:42.086756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4ef79d83-3839-4505-83cb-75fc8b41a8a3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:42.087374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4ef79d83-3839-4505-83cb-75fc8b41a8a3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:42.097928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ef79d83-3839-4505-83cb-75fc8b41a8a3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:42.098571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ef79d83-3839-4505-83cb-75fc8b41a8a3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:42.099661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ef79d83-3839-4505-83cb-75fc8b41a8a3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:42.100457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4ef79d83-3839-4505-83cb-75fc8b41a8a3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:42.398271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bcfb5412-a43f-448e-9f83-8d5e2b2777fc tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:42.399491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bcfb5412-a43f-448e-9f83-8d5e2b2777fc tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 5e460e72-5983-4de4-8331-277067642ac9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:42.413322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcfb5412-a43f-448e-9f83-8d5e2b2777fc tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:42.414272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcfb5412-a43f-448e-9f83-8d5e2b2777fc tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:42.416291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcfb5412-a43f-448e-9f83-8d5e2b2777fc tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:42.417300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcfb5412-a43f-448e-9f83-8d5e2b2777fc tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:42.457964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4ef79d83-3839-4505-83cb-75fc8b41a8a3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:42.478838 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4ef79d83-3839-4505-83cb-75fc8b41a8a3 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1495 microversion: 2.1 time: 0.398556 Jul 28 03:53:42.479742 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1693/3818] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:42 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1495 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:42.548853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bcfb5412-a43f-448e-9f83-8d5e2b2777fc tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:42.561156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bcfb5412-a43f-448e-9f83-8d5e2b2777fc tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:42.563005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bcfb5412-a43f-448e-9f83-8d5e2b2777fc tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:42.564451 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bcfb5412-a43f-448e-9f83-8d5e2b2777fc tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9" status: 200 len: 1363 microversion: 2.47 time: 0.176021 Jul 28 03:53:42.565198 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2126/3819] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:42 2022] GET /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:42.718725 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7c9ebb81-5113-4a4e-a7fd-ee30e5ee9c1b tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:42.720483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7c9ebb81-5113-4a4e-a7fd-ee30e5ee9c1b tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:42.729594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c9ebb81-5113-4a4e-a7fd-ee30e5ee9c1b tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:42.730565 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c9ebb81-5113-4a4e-a7fd-ee30e5ee9c1b tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:42.732384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c9ebb81-5113-4a4e-a7fd-ee30e5ee9c1b tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:42.733284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c9ebb81-5113-4a4e-a7fd-ee30e5ee9c1b tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:42.778413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-25417610-ad75-4ec3-ac13-b29d6256fed7 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:42.779556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-25417610-ad75-4ec3-ac13-b29d6256fed7 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:42.789921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25417610-ad75-4ec3-ac13-b29d6256fed7 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:42.793655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25417610-ad75-4ec3-ac13-b29d6256fed7 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:42.798360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25417610-ad75-4ec3-ac13-b29d6256fed7 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:42.799232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25417610-ad75-4ec3-ac13-b29d6256fed7 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:42.945275 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7c9ebb81-5113-4a4e-a7fd-ee30e5ee9c1b tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:42.964273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7c9ebb81-5113-4a4e-a7fd-ee30e5ee9c1b tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:42.966144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7c9ebb81-5113-4a4e-a7fd-ee30e5ee9c1b tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:42.967485 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7c9ebb81-5113-4a4e-a7fd-ee30e5ee9c1b tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.253234 Jul 28 03:53:42.981192 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1694/3820] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:42 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:43.008750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0fb95f44-e818-4eac-8220-37ae65171365 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:43.010509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0fb95f44-e818-4eac-8220-37ae65171365 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:43.026728 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fb95f44-e818-4eac-8220-37ae65171365 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:43.027945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fb95f44-e818-4eac-8220-37ae65171365 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:43.029365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fb95f44-e818-4eac-8220-37ae65171365 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:43.030235 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fb95f44-e818-4eac-8220-37ae65171365 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:43.183717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-25417610-ad75-4ec3-ac13-b29d6256fed7 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:43.198711 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-25417610-ad75-4ec3-ac13-b29d6256fed7 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1316 microversion: 2.1 time: 0.424207 Jul 28 03:53:43.199341 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2127/3821] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:42 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1316 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:43.204001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f93ba83d-0268-411c-82f2-c52542d44fc8 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:43.213529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f93ba83d-0268-411c-82f2-c52542d44fc8 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:43.243404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f93ba83d-0268-411c-82f2-c52542d44fc8 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:43.244400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f93ba83d-0268-411c-82f2-c52542d44fc8 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:43.245515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f93ba83d-0268-411c-82f2-c52542d44fc8 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:43.247043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f93ba83d-0268-411c-82f2-c52542d44fc8 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:43.395351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0fb95f44-e818-4eac-8220-37ae65171365 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:43.407337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0fb95f44-e818-4eac-8220-37ae65171365 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:43.411540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0fb95f44-e818-4eac-8220-37ae65171365 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:43.412844 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0fb95f44-e818-4eac-8220-37ae65171365 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1723 microversion: 2.20 time: 0.412804 Jul 28 03:53:43.416319 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1695/3822] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:42 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:43.494119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:43.510631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-186c8754-6e01-44fd-bef2-8c90a7c9fe4a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:43.511265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-186c8754-6e01-44fd-bef2-8c90a7c9fe4a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:43.526679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-186c8754-6e01-44fd-bef2-8c90a7c9fe4a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:43.528538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-186c8754-6e01-44fd-bef2-8c90a7c9fe4a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:43.528538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-186c8754-6e01-44fd-bef2-8c90a7c9fe4a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:43.528538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-186c8754-6e01-44fd-bef2-8c90a7c9fe4a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:43.538970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f93ba83d-0268-411c-82f2-c52542d44fc8 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:43.563667 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f93ba83d-0268-411c-82f2-c52542d44fc8 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 0.363221 Jul 28 03:53:43.564782 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2128/3823] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:43 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:43.603610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e9973097-b288-4618-95d6-d79cf768a32c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:43.605321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e9973097-b288-4618-95d6-d79cf768a32c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 5e460e72-5983-4de4-8331-277067642ac9] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:43.618142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9973097-b288-4618-95d6-d79cf768a32c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:43.618716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9973097-b288-4618-95d6-d79cf768a32c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:43.621604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9973097-b288-4618-95d6-d79cf768a32c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:43.626832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9973097-b288-4618-95d6-d79cf768a32c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:43.705222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9973097-b288-4618-95d6-d79cf768a32c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:43.706083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9973097-b288-4618-95d6-d79cf768a32c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:43.706922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-e9973097-b288-4618-95d6-d79cf768a32c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lazy-loading 'fault' on Instance uuid 5e460e72-5983-4de4-8331-277067642ac9 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:53:43.715036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:43.786822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e9973097-b288-4618-95d6-d79cf768a32c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:43.800462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e9973097-b288-4618-95d6-d79cf768a32c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:43.803804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e9973097-b288-4618-95d6-d79cf768a32c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d06eada4fd84fb493d81e3e66623809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f7708baae334a6690987771003f26c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:43.805703 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e9973097-b288-4618-95d6-d79cf768a32c tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9" status: 200 len: 1368 microversion: 2.47 time: 0.206236 Jul 28 03:53:43.821333 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2129/3824] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:43 2022] GET /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:43.946047 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-186c8754-6e01-44fd-bef2-8c90a7c9fe4a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:43.966738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:43.979438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-ea30e6e9-4bb1-446b-b7b0-9ec9efba3b99 req-7b107255-130f-4766-8445-168e2582e585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "091c0997-537d-4124-9945-1ef1dd079d63", "tag": "c5b8c623-1fc8-4425-b1c1-c5da71e14c34"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:43.991771 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-186c8754-6e01-44fd-bef2-8c90a7c9fe4a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1495 microversion: 2.1 time: 0.483117 Jul 28 03:53:43.994867 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1696/3825] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:43 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1495 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:44.002251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4d31fe51-47c8-4434-b36f-d137816d5cb7 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:44.003271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4d31fe51-47c8-4434-b36f-d137816d5cb7 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:44.009042 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:44.017923 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4d31fe51-47c8-4434-b36f-d137816d5cb7 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:44.018373 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4d31fe51-47c8-4434-b36f-d137816d5cb7 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:44.019594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4d31fe51-47c8-4434-b36f-d137816d5cb7 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:44.020301 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4d31fe51-47c8-4434-b36f-d137816d5cb7 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:44.029700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ea30e6e9-4bb1-446b-b7b0-9ec9efba3b99 req-7b107255-130f-4766-8445-168e2582e585 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:44.031764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ea30e6e9-4bb1-446b-b7b0-9ec9efba3b99 req-7b107255-130f-4766-8445-168e2582e585 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:44.063138 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-ea30e6e9-4bb1-446b-b7b0-9ec9efba3b99 req-7b107255-130f-4766-8445-168e2582e585 service nova] Creating event network-changed:c5b8c623-1fc8-4425-b1c1-c5da71e14c34 for instance 091c0997-537d-4124-9945-1ef1dd079d63 on n-h1-826756-3 Jul 28 03:53:44.077953 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-ea30e6e9-4bb1-446b-b7b0-9ec9efba3b99 req-7b107255-130f-4766-8445-168e2582e585 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105362 Jul 28 03:53:44.081538 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2130/3826] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:44.204520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4d31fe51-47c8-4434-b36f-d137816d5cb7 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:44.231167 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4d31fe51-47c8-4434-b36f-d137816d5cb7 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:44.232909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4d31fe51-47c8-4434-b36f-d137816d5cb7 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:44.238156 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4d31fe51-47c8-4434-b36f-d137816d5cb7 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.240487 Jul 28 03:53:44.245402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b0fe336-c468-4460-84ba-34e78e08bc34 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:44.247503 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1697/3827] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:43 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:44.259633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b0fe336-c468-4460-84ba-34e78e08bc34 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:44.286875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b0fe336-c468-4460-84ba-34e78e08bc34 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:44.293475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b0fe336-c468-4460-84ba-34e78e08bc34 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:44.295012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b0fe336-c468-4460-84ba-34e78e08bc34 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:44.295579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b0fe336-c468-4460-84ba-34e78e08bc34 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:44.435708 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7a88dd9d-4bf1-4d24-8bc3-8798855085ce tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:44.436847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7a88dd9d-4bf1-4d24-8bc3-8798855085ce tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:44.448229 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a88dd9d-4bf1-4d24-8bc3-8798855085ce tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:44.450977 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a88dd9d-4bf1-4d24-8bc3-8798855085ce tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:44.454715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a88dd9d-4bf1-4d24-8bc3-8798855085ce tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:44.455494 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7a88dd9d-4bf1-4d24-8bc3-8798855085ce tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:44.682886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b0fe336-c468-4460-84ba-34e78e08bc34 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:44.696961 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b0fe336-c468-4460-84ba-34e78e08bc34 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1316 microversion: 2.1 time: 0.468746 Jul 28 03:53:44.697993 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2131/3828] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:44 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:44.720395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-172a60bc-e197-47a0-8d77-4ac068b0a4ed tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:44.721511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-172a60bc-e197-47a0-8d77-4ac068b0a4ed tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:44.732488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-172a60bc-e197-47a0-8d77-4ac068b0a4ed tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:44.733136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-172a60bc-e197-47a0-8d77-4ac068b0a4ed tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:44.734798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-172a60bc-e197-47a0-8d77-4ac068b0a4ed tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:44.735800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-172a60bc-e197-47a0-8d77-4ac068b0a4ed tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:44.809501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7a88dd9d-4bf1-4d24-8bc3-8798855085ce tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:44.821065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7a88dd9d-4bf1-4d24-8bc3-8798855085ce tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:44.822659 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7a88dd9d-4bf1-4d24-8bc3-8798855085ce tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:44.824370 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7a88dd9d-4bf1-4d24-8bc3-8798855085ce tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1723 microversion: 2.20 time: 0.392956 Jul 28 03:53:44.825561 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1698/3829] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:44 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1723 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:44.846978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39fa79ef-3291-455c-a27d-7b133b7548b9 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:44.848023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-39fa79ef-3291-455c-a27d-7b133b7548b9 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] [instance: 5e460e72-5983-4de4-8331-277067642ac9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:44.854912 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39fa79ef-3291-455c-a27d-7b133b7548b9 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:44.855639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39fa79ef-3291-455c-a27d-7b133b7548b9 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:44.856669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39fa79ef-3291-455c-a27d-7b133b7548b9 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:44.857278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39fa79ef-3291-455c-a27d-7b133b7548b9 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:44.882099 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-39fa79ef-3291-455c-a27d-7b133b7548b9 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] HTTP exception thrown: Instance 5e460e72-5983-4de4-8331-277067642ac9 could not be found. Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39fa79ef-3291-455c-a27d-7b133b7548b9 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Request method failure captured: Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9 HTTP/1.1 Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4ggQBLa5O71gU53rkGfoPP7gOzF1bp9Nv24i0t01SH2c3HV6ACFP12GcM5u8Hv8i578eggOBTZ1GUCRuvO8FDiLFAeae0u8iQ2Uv17duTZZP2XhF3o4Olz2cVlO47_RkUOtmLTkEbBKiGD65373VTDqRL4n4ypJE_3kF3VLlvfSjKZA Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Openstack-Nova-Api-Version: 2.47 Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 0f7708baae334a6690987771003f26c1 Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerShowV247Test-276053072 Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0f7708baae334a6690987771003f26c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f7708baae334a6690987771003f26c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0f7708baae334a6690987771003f26c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0f7708baae334a6690987771003f26c1"}]}] Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerShowV247Test-276053072 Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 0f7708baae334a6690987771003f26c1 Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerShowV247Test-276053072 Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerShowV247Test-276053072-project Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 7d06eada4fd84fb493d81e3e66623809 Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerShowV247Test-276053072-project Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 5e460e72-5983-4de4-8331-277067642ac9 could not be found. Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '5e460e72-5983-4de4-8331-277067642ac9'} Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e460e72-5983-4de4-8331-277067642ac9 could not be found. Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e460e72-5983-4de4-8331-277067642ac9 could not be found. Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:44.899717 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:44.906387 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:44.906387 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:44.906387 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:44.906387 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:53:44.906387 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:53:44.906387 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e460e72-5983-4de4-8331-277067642ac9 could not be found. Jul 28 03:53:44.906387 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:53:44.906387 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39fa79ef-3291-455c-a27d-7b133b7548b9 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] Returning 404 to user: Instance 5e460e72-5983-4de4-8331-277067642ac9 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:44.906387 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-39fa79ef-3291-455c-a27d-7b133b7548b9 tempest-ServerShowV247Test-276053072 tempest-ServerShowV247Test-276053072-project] 10.222.0.48 "GET /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9" status: 404 len: 111 microversion: 2.47 time: 0.061256 Jul 28 03:53:44.906387 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1699/3830] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:44 2022] GET /compute/v2.1/servers/5e460e72-5983-4de4-8331-277067642ac9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:53:45.020514 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0672a7fc-528f-4bfa-a6ee-ec6550f006cb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:45.021855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0672a7fc-528f-4bfa-a6ee-ec6550f006cb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:45.034441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0672a7fc-528f-4bfa-a6ee-ec6550f006cb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:45.035176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0672a7fc-528f-4bfa-a6ee-ec6550f006cb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:45.037178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0672a7fc-528f-4bfa-a6ee-ec6550f006cb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:45.038320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0672a7fc-528f-4bfa-a6ee-ec6550f006cb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:45.094087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-172a60bc-e197-47a0-8d77-4ac068b0a4ed tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:45.096516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:45.107953 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-172a60bc-e197-47a0-8d77-4ac068b0a4ed tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 0.399869 Jul 28 03:53:45.108613 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2132/3831] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:44 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:45.254258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0672a7fc-528f-4bfa-a6ee-ec6550f006cb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:45.267117 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0672a7fc-528f-4bfa-a6ee-ec6550f006cb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1495 microversion: 2.1 time: 0.252793 Jul 28 03:53:45.268967 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1700/3832] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:45 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1495 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:45.296672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e452dec5-4d42-4d6f-8b82-4ecd2ab401a3 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:45.298090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e452dec5-4d42-4d6f-8b82-4ecd2ab401a3 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:45.310883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e452dec5-4d42-4d6f-8b82-4ecd2ab401a3 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:45.312468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e452dec5-4d42-4d6f-8b82-4ecd2ab401a3 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:45.313683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e452dec5-4d42-4d6f-8b82-4ecd2ab401a3 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:45.315868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e452dec5-4d42-4d6f-8b82-4ecd2ab401a3 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:45.409730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e452dec5-4d42-4d6f-8b82-4ecd2ab401a3 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:45.426863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e452dec5-4d42-4d6f-8b82-4ecd2ab401a3 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:45.429711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e452dec5-4d42-4d6f-8b82-4ecd2ab401a3 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:45.431506 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e452dec5-4d42-4d6f-8b82-4ecd2ab401a3 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.148042 Jul 28 03:53:45.432984 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2133/3833] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:45 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:45.738489 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7e6419ee-8d33-4c7d-b8dc-8a4ca54bfd6f tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:45.740056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7e6419ee-8d33-4c7d-b8dc-8a4ca54bfd6f tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:45.764035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7e6419ee-8d33-4c7d-b8dc-8a4ca54bfd6f tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:45.765224 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7e6419ee-8d33-4c7d-b8dc-8a4ca54bfd6f tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:45.766877 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7e6419ee-8d33-4c7d-b8dc-8a4ca54bfd6f tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:45.767891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7e6419ee-8d33-4c7d-b8dc-8a4ca54bfd6f tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:45.857813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b168c4ab-b016-4c06-8536-b2121bd3c6b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:45.861507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b168c4ab-b016-4c06-8536-b2121bd3c6b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:45.883558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b168c4ab-b016-4c06-8536-b2121bd3c6b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:45.884622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b168c4ab-b016-4c06-8536-b2121bd3c6b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:45.886087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b168c4ab-b016-4c06-8536-b2121bd3c6b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:45.886948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b168c4ab-b016-4c06-8536-b2121bd3c6b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:46.145811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b168c4ab-b016-4c06-8536-b2121bd3c6b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:46.161696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b168c4ab-b016-4c06-8536-b2121bd3c6b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:46.166061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b168c4ab-b016-4c06-8536-b2121bd3c6b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:46.169007 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b168c4ab-b016-4c06-8536-b2121bd3c6b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1726 microversion: 2.20 time: 0.317827 Jul 28 03:53:46.181385 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2134/3834] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:45 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1726 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:46.196435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d003add5-f9c3-4b29-ba2f-592ab58639dc tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:46.197498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d003add5-f9c3-4b29-ba2f-592ab58639dc tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:46.205534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d003add5-f9c3-4b29-ba2f-592ab58639dc tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:46.206360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d003add5-f9c3-4b29-ba2f-592ab58639dc tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:46.207344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d003add5-f9c3-4b29-ba2f-592ab58639dc tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:46.208014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d003add5-f9c3-4b29-ba2f-592ab58639dc tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:46.408234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d003add5-f9c3-4b29-ba2f-592ab58639dc tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:46.420645 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d003add5-f9c3-4b29-ba2f-592ab58639dc tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 0.237837 Jul 28 03:53:46.421360 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2135/3835] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:46 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:46.465177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bbaae730-8a4d-41a3-a606-ee2596b599d2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc343077-0b34-4b31-9628-6d79124f591b"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:46.467888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bbaae730-8a4d-41a3-a606-ee2596b599d2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:46.478204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbaae730-8a4d-41a3-a606-ee2596b599d2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:46.478648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbaae730-8a4d-41a3-a606-ee2596b599d2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:46.479435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbaae730-8a4d-41a3-a606-ee2596b599d2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:46.479866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbaae730-8a4d-41a3-a606-ee2596b599d2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:46.754127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7e6419ee-8d33-4c7d-b8dc-8a4ca54bfd6f tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:46.765538 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7e6419ee-8d33-4c7d-b8dc-8a4ca54bfd6f tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1316 microversion: 2.1 time: 1.049762 Jul 28 03:53:46.777625 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1701/3836] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:45 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1316 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:46.783000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ea14b2e8-cb5d-43f9-8f79-8a14713464a1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:46.784092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ea14b2e8-cb5d-43f9-8f79-8a14713464a1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:46.800850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea14b2e8-cb5d-43f9-8f79-8a14713464a1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:46.801345 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea14b2e8-cb5d-43f9-8f79-8a14713464a1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:46.802222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea14b2e8-cb5d-43f9-8f79-8a14713464a1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:46.809776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea14b2e8-cb5d-43f9-8f79-8a14713464a1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:46.997464 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bbaae730-8a4d-41a3-a606-ee2596b599d2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "POST /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.574248 Jul 28 03:53:46.998366 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2136/3837] 10.222.0.48 () {62 vars in 1364 bytes} [Thu Jul 28 03:53:46 2022] POST /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments => generated 188 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:53:47.014268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bf4be81a-2412-4f8f-8f4d-cffdecba9748 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:47.015549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bf4be81a-2412-4f8f-8f4d-cffdecba9748 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:47.024992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf4be81a-2412-4f8f-8f4d-cffdecba9748 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:47.025737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf4be81a-2412-4f8f-8f4d-cffdecba9748 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:47.027043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf4be81a-2412-4f8f-8f4d-cffdecba9748 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:47.028124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf4be81a-2412-4f8f-8f4d-cffdecba9748 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:47.190530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bf4be81a-2412-4f8f-8f4d-cffdecba9748 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:47.200969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bf4be81a-2412-4f8f-8f4d-cffdecba9748 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:47.203774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bf4be81a-2412-4f8f-8f4d-cffdecba9748 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:47.205645 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bf4be81a-2412-4f8f-8f4d-cffdecba9748 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.205927 Jul 28 03:53:47.206838 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2137/3838] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:46 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:47.297926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ef45591-5359-4226-bd92-7ac3b7eff52f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:47.298756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ef45591-5359-4226-bd92-7ac3b7eff52f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:47.312115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ef45591-5359-4226-bd92-7ac3b7eff52f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:47.312599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ef45591-5359-4226-bd92-7ac3b7eff52f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:47.313579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ef45591-5359-4226-bd92-7ac3b7eff52f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:47.314720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ef45591-5359-4226-bd92-7ac3b7eff52f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:47.392455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ef45591-5359-4226-bd92-7ac3b7eff52f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126071) unshelve /opt/stack/nova/nova/compute/api.py:4575}} Jul 28 03:53:47.427083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ea14b2e8-cb5d-43f9-8f79-8a14713464a1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:47.442453 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ea14b2e8-cb5d-43f9-8f79-8a14713464a1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1495 microversion: 2.1 time: 0.663269 Jul 28 03:53:47.445096 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1702/3839] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:46 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1495 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:47.454911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-52100678-b02a-4c09-924f-37bccabef1bf tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:47.457390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-52100678-b02a-4c09-924f-37bccabef1bf tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:47.474620 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52100678-b02a-4c09-924f-37bccabef1bf tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:47.477785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52100678-b02a-4c09-924f-37bccabef1bf tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:47.478965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52100678-b02a-4c09-924f-37bccabef1bf tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:47.479702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52100678-b02a-4c09-924f-37bccabef1bf tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:47.526393 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ef45591-5359-4226-bd92-7ac3b7eff52f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "POST /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/action" status: 202 len: 0 microversion: 2.20 time: 0.233279 Jul 28 03:53:47.528329 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2138/3840] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 03:53:47 2022] POST /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:53:47.536891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0d7d6728-f231-4dca-b58d-7bb477c1b078 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:47.543593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0d7d6728-f231-4dca-b58d-7bb477c1b078 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:47.559110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d7d6728-f231-4dca-b58d-7bb477c1b078 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:47.560813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d7d6728-f231-4dca-b58d-7bb477c1b078 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:47.562456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d7d6728-f231-4dca-b58d-7bb477c1b078 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:47.563060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d7d6728-f231-4dca-b58d-7bb477c1b078 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:47.775333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0d7d6728-f231-4dca-b58d-7bb477c1b078 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:47.800094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0d7d6728-f231-4dca-b58d-7bb477c1b078 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:47.802883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0d7d6728-f231-4dca-b58d-7bb477c1b078 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:47.804768 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0d7d6728-f231-4dca-b58d-7bb477c1b078 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1752 microversion: 2.20 time: 0.271888 Jul 28 03:53:47.805713 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2139/3841] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:47 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1752 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:47.811458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5e655246-da55-49b3-bd0b-d07780f6cf4e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:47.813357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5e655246-da55-49b3-bd0b-d07780f6cf4e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:47.824093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e655246-da55-49b3-bd0b-d07780f6cf4e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:47.825215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e655246-da55-49b3-bd0b-d07780f6cf4e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:47.826912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e655246-da55-49b3-bd0b-d07780f6cf4e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:47.827664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e655246-da55-49b3-bd0b-d07780f6cf4e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:48.334286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5e655246-da55-49b3-bd0b-d07780f6cf4e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:48.354437 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5e655246-da55-49b3-bd0b-d07780f6cf4e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1316 microversion: 2.1 time: 0.546945 Jul 28 03:53:48.356914 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2140/3842] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:47 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1316 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:48.367158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb9bda13-7a53-49ed-ac9c-7e6121545ecf tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:48.369115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eb9bda13-7a53-49ed-ac9c-7e6121545ecf tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:48.382294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb9bda13-7a53-49ed-ac9c-7e6121545ecf tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:48.383755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb9bda13-7a53-49ed-ac9c-7e6121545ecf tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:48.385726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb9bda13-7a53-49ed-ac9c-7e6121545ecf tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:48.386859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb9bda13-7a53-49ed-ac9c-7e6121545ecf tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:48.466245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eb9bda13-7a53-49ed-ac9c-7e6121545ecf tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:48.476010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eb9bda13-7a53-49ed-ac9c-7e6121545ecf tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:48.477581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eb9bda13-7a53-49ed-ac9c-7e6121545ecf tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:48.478809 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb9bda13-7a53-49ed-ac9c-7e6121545ecf tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.119889 Jul 28 03:53:48.479394 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2141/3843] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:48 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:48.514846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a8054329-5165-4b2d-91c6-1d5e36959aac req-4fe77bb5-1ebe-4fdb-a18a-aff9fb206e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091c0997-537d-4124-9945-1ef1dd079d63", "name": "network-vif-plugged", "status": "completed", "tag": "c5b8c623-1fc8-4425-b1c1-c5da71e14c34"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:48.527354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a8054329-5165-4b2d-91c6-1d5e36959aac req-4fe77bb5-1ebe-4fdb-a18a-aff9fb206e5f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:48.528052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-52100678-b02a-4c09-924f-37bccabef1bf tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:48.529050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a8054329-5165-4b2d-91c6-1d5e36959aac req-4fe77bb5-1ebe-4fdb-a18a-aff9fb206e5f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:48.538856 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-52100678-b02a-4c09-924f-37bccabef1bf tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1323 microversion: 2.1 time: 1.092335 Jul 28 03:53:48.539469 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1703/3844] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:47 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1323 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:48.549103 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9604bb04-43d6-42ab-a5ad-b15e12156181 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:48.549103 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9604bb04-43d6-42ab-a5ad-b15e12156181 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:48.552126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:48.563211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9604bb04-43d6-42ab-a5ad-b15e12156181 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:48.564017 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a8054329-5165-4b2d-91c6-1d5e36959aac req-4fe77bb5-1ebe-4fdb-a18a-aff9fb206e5f service nova] Creating event network-vif-plugged:c5b8c623-1fc8-4425-b1c1-c5da71e14c34 for instance 091c0997-537d-4124-9945-1ef1dd079d63 on n-h1-826756-3 Jul 28 03:53:48.564478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9604bb04-43d6-42ab-a5ad-b15e12156181 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:48.565492 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9604bb04-43d6-42ab-a5ad-b15e12156181 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:48.565940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9604bb04-43d6-42ab-a5ad-b15e12156181 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:48.571427 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a8054329-5165-4b2d-91c6-1d5e36959aac req-4fe77bb5-1ebe-4fdb-a18a-aff9fb206e5f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062559 Jul 28 03:53:48.572664 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2142/3845] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:48.828395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a8eb304-171e-41e8-b52a-d5417c691447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:48.829957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8a8eb304-171e-41e8-b52a-d5417c691447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:48.838807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a8eb304-171e-41e8-b52a-d5417c691447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:48.839344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a8eb304-171e-41e8-b52a-d5417c691447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:48.840391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a8eb304-171e-41e8-b52a-d5417c691447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:48.840994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a8eb304-171e-41e8-b52a-d5417c691447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:49.190005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a8eb304-171e-41e8-b52a-d5417c691447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:49.213977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a8eb304-171e-41e8-b52a-d5417c691447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:49.217560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a8eb304-171e-41e8-b52a-d5417c691447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:49.222017 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a8eb304-171e-41e8-b52a-d5417c691447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1752 microversion: 2.20 time: 0.398044 Jul 28 03:53:49.240915 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2143/3846] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:48 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1752 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:49.267543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d11d9b28-fbc8-4588-9cab-1070d89409d9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e018e5a-9d2b-4a49-a618-83bcd13abd42"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:49.270448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d11d9b28-fbc8-4588-9cab-1070d89409d9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:49.290257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d11d9b28-fbc8-4588-9cab-1070d89409d9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:49.290709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d11d9b28-fbc8-4588-9cab-1070d89409d9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:49.291713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d11d9b28-fbc8-4588-9cab-1070d89409d9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:49.294691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d11d9b28-fbc8-4588-9cab-1070d89409d9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:49.396977 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9604bb04-43d6-42ab-a5ad-b15e12156181 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:49.415472 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9604bb04-43d6-42ab-a5ad-b15e12156181 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1495 microversion: 2.1 time: 0.874725 Jul 28 03:53:49.417452 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1704/3847] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:48 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1495 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:49.443443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-1b78bc04-c82c-4f96-8feb-b0b5f3308487 req-249a9ebb-2593-4ea5-91bc-4564b9ba3c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13579693-5082-4742-9c29-a1e16f62308b", "name": "network-vif-deleted", "tag": "d8173c3d-706d-485a-8434-4f868aa9fe50"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:49.500452 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1b78bc04-c82c-4f96-8feb-b0b5f3308487 req-249a9ebb-2593-4ea5-91bc-4564b9ba3c4a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:49.500933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1b78bc04-c82c-4f96-8feb-b0b5f3308487 req-249a9ebb-2593-4ea5-91bc-4564b9ba3c4a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:49.530580 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-d11d9b28-fbc8-4588-9cab-1070d89409d9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] HTTP exception thrown: Invalid volume: volume 1e018e5a-9d2b-4a49-a618-83bcd13abd42 is already attached to instances: b5aac5b7-2161-4673-ba81-5a05fd98352f Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d11d9b28-fbc8-4588-9cab-1070d89409d9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Request method failure captured: Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments HTTP/1.1 Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 74 Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gca3wwj6vf3mcE1k3p04a-IB_aHJ4q2aQgyaMGEamuHOXYtT8sTCQ39msigigoKDkTgI0q27esncQkdsISfIdor8uYi2ofpy2xxPUYcBX6T1jxeXp0Wz1yCRt_oOue5jQOpZsPCIWzJpvRA8Ld9LSF337wCVS7VtPTruWEjBErR8iQ Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 781ab005138547038def64d108937e3e Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781ab005138547038def64d108937e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781ab005138547038def64d108937e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}] Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 781ab005138547038def64d108937e3e Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d20381abd9784627887af3cb97cd68a8 Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: {"volumeAttachment": {"volumeId": "1e018e5a-9d2b-4a49-a618-83bcd13abd42"}} Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid volume: volume 1e018e5a-9d2b-4a49-a618-83bcd13abd42 is already attached to instances: b5aac5b7-2161-4673-ba81-5a05fd98352f Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': 'b5aac5b7-2161-4673-ba81-5a05fd98352f', 'body': {'volumeAttachment': {'volumeId': '1e018e5a-9d2b-4a49-a618-83bcd13abd42'}}} Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5110, in attach_volume Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4950, in _check_volume_already_attached Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1e018e5a-9d2b-4a49-a618-83bcd13abd42 is already attached to instances: b5aac5b7-2161-4673-ba81-5a05fd98352f Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:53:49.532373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1e018e5a-9d2b-4a49-a618-83bcd13abd42 is already attached to instances: b5aac5b7-2161-4673-ba81-5a05fd98352f Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1e018e5a-9d2b-4a49-a618-83bcd13abd42 is already attached to instances: b5aac5b7-2161-4673-ba81-5a05fd98352f Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d11d9b28-fbc8-4588-9cab-1070d89409d9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Returning 400 to user: Invalid volume: volume 1e018e5a-9d2b-4a49-a618-83bcd13abd42 is already attached to instances: b5aac5b7-2161-4673-ba81-5a05fd98352f {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:49.543413 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d11d9b28-fbc8-4588-9cab-1070d89409d9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "POST /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.282557 Jul 28 03:53:49.549030 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-1b78bc04-c82c-4f96-8feb-b0b5f3308487 req-249a9ebb-2593-4ea5-91bc-4564b9ba3c4a service nova] Creating event network-vif-deleted:d8173c3d-706d-485a-8434-4f868aa9fe50 for instance 13579693-5082-4742-9c29-a1e16f62308b on n-h2-826756-3 Jul 28 03:53:49.549825 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2144/3848] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 03:53:49 2022] POST /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments => generated 174 bytes in 295 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:53:49.552540 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-1b78bc04-c82c-4f96-8feb-b0b5f3308487 req-249a9ebb-2593-4ea5-91bc-4564b9ba3c4a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112827 Jul 28 03:53:49.553181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-512d5a7d-0752-4455-9ede-b55d562ae599 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:49.553355 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1705/3849] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:49.553544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-512d5a7d-0752-4455-9ede-b55d562ae599 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:49.570745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c8d973a0-838d-4d58-8354-5b183da18ba5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:49.571465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c8d973a0-838d-4d58-8354-5b183da18ba5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:49.584986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8d973a0-838d-4d58-8354-5b183da18ba5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:49.585674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8d973a0-838d-4d58-8354-5b183da18ba5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:49.586128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8d973a0-838d-4d58-8354-5b183da18ba5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:49.586634 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8d973a0-838d-4d58-8354-5b183da18ba5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:49.594423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-512d5a7d-0752-4455-9ede-b55d562ae599 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:49.595289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-512d5a7d-0752-4455-9ede-b55d562ae599 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:49.596161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-512d5a7d-0752-4455-9ede-b55d562ae599 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:49.598361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-512d5a7d-0752-4455-9ede-b55d562ae599 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:49.847978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c8d973a0-838d-4d58-8354-5b183da18ba5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:49.879705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c8d973a0-838d-4d58-8354-5b183da18ba5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:49.888390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c8d973a0-838d-4d58-8354-5b183da18ba5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:49.890910 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c8d973a0-838d-4d58-8354-5b183da18ba5 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1408 microversion: 2.54 time: 0.337076 Jul 28 03:53:49.892569 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1706/3850] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:49 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1408 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:49.913703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9f94b7a8-7dba-4be1-992b-6a181a23f648 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:49.914832 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9f94b7a8-7dba-4be1-992b-6a181a23f648 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:49.942269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f94b7a8-7dba-4be1-992b-6a181a23f648 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:49.943232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f94b7a8-7dba-4be1-992b-6a181a23f648 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:49.947652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f94b7a8-7dba-4be1-992b-6a181a23f648 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:49.949103 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f94b7a8-7dba-4be1-992b-6a181a23f648 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:50.102869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-512d5a7d-0752-4455-9ede-b55d562ae599 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:50.140397 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-512d5a7d-0752-4455-9ede-b55d562ae599 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1316 microversion: 2.1 time: 0.591932 Jul 28 03:53:50.141191 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2145/3851] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:49 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1316 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:50.155358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3069de35-64bd-49ce-851c-312b37532dd0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:50.155970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3069de35-64bd-49ce-851c-312b37532dd0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:50.176439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3069de35-64bd-49ce-851c-312b37532dd0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:50.188509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3069de35-64bd-49ce-851c-312b37532dd0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:50.191371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3069de35-64bd-49ce-851c-312b37532dd0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:50.192701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3069de35-64bd-49ce-851c-312b37532dd0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:50.236524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:50.358656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9f94b7a8-7dba-4be1-992b-6a181a23f648 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:50.368253 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9f94b7a8-7dba-4be1-992b-6a181a23f648 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 200 len: 1516 microversion: 2.1 time: 0.472337 Jul 28 03:53:50.377186 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1707/3852] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:49 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 1516 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:50.387383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-453e0204-3b1c-4db4-b8a5-0db70dcdab62 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:50.388019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-453e0204-3b1c-4db4-b8a5-0db70dcdab62 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:50.395038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-453e0204-3b1c-4db4-b8a5-0db70dcdab62 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:50.395485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-453e0204-3b1c-4db4-b8a5-0db70dcdab62 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:50.396542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-453e0204-3b1c-4db4-b8a5-0db70dcdab62 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:50.397154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-453e0204-3b1c-4db4-b8a5-0db70dcdab62 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:50.418989 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:50.448382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-3069de35-64bd-49ce-851c-312b37532dd0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lazy-loading 'services' on Instance uuid b5aac5b7-2161-4673-ba81-5a05fd98352f {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:53:50.597235 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3069de35-64bd-49ce-851c-312b37532dd0 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments/1e018e5a-9d2b-4a49-a618-83bcd13abd42" status: 202 len: 0 microversion: 2.1 time: 0.454070 Jul 28 03:53:50.613065 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2146/3853] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 03:53:50 2022] DELETE /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments/1e018e5a-9d2b-4a49-a618-83bcd13abd42 => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:53:50.641751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ffb4814b-1334-44d2-bb79-de3a83b5b6eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:50.642914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ffb4814b-1334-44d2-bb79-de3a83b5b6eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 6518bd32-8cbe-4ef4-8813-1923f796b586] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:50.654194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffb4814b-1334-44d2-bb79-de3a83b5b6eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:50.654946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffb4814b-1334-44d2-bb79-de3a83b5b6eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:50.657803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffb4814b-1334-44d2-bb79-de3a83b5b6eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:50.658523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffb4814b-1334-44d2-bb79-de3a83b5b6eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:50.907770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-453e0204-3b1c-4db4-b8a5-0db70dcdab62 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:50.924892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-453e0204-3b1c-4db4-b8a5-0db70dcdab62 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:50.926835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-453e0204-3b1c-4db4-b8a5-0db70dcdab62 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:50.931002 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-453e0204-3b1c-4db4-b8a5-0db70dcdab62 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1754 microversion: 2.20 time: 0.551842 Jul 28 03:53:50.932018 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1708/3854] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:50 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1754 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:50.954410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-00d2d521-91ea-4060-971f-d3f6c32c9472 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:50.955035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-00d2d521-91ea-4060-971f-d3f6c32c9472 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:50.969702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00d2d521-91ea-4060-971f-d3f6c32c9472 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:50.970660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00d2d521-91ea-4060-971f-d3f6c32c9472 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:50.971947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00d2d521-91ea-4060-971f-d3f6c32c9472 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:50.972647 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00d2d521-91ea-4060-971f-d3f6c32c9472 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:51.014172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00d2d521-91ea-4060-971f-d3f6c32c9472 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:51.014911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00d2d521-91ea-4060-971f-d3f6c32c9472 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:51.015549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-00d2d521-91ea-4060-971f-d3f6c32c9472 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lazy-loading 'fault' on Instance uuid 13579693-5082-4742-9c29-a1e16f62308b {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:53:51.169619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ffb4814b-1334-44d2-bb79-de3a83b5b6eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:51.178657 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ffb4814b-1334-44d2-bb79-de3a83b5b6eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586" status: 200 len: 1516 microversion: 2.1 time: 0.560928 Jul 28 03:53:51.179275 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2147/3855] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:50 2022] GET /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586 => generated 1516 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:51.211500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-57f80ccd-197b-46c6-9d43-4a6af2813b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:51.233015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-57f80ccd-197b-46c6-9d43-4a6af2813b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:51.267994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57f80ccd-197b-46c6-9d43-4a6af2813b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:51.268709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57f80ccd-197b-46c6-9d43-4a6af2813b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:51.276819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57f80ccd-197b-46c6-9d43-4a6af2813b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:51.277595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57f80ccd-197b-46c6-9d43-4a6af2813b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:51.318840 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-00d2d521-91ea-4060-971f-d3f6c32c9472 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:51.359560 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-00d2d521-91ea-4060-971f-d3f6c32c9472 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 200 len: 1304 microversion: 2.1 time: 0.417032 Jul 28 03:53:51.360839 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1709/3856] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:50 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 1304 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:51.389864 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-57f80ccd-197b-46c6-9d43-4a6af2813b0b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187791 Jul 28 03:53:51.403088 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2148/3857] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:53:51 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:51.410463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74ec6680-6341-493b-bb2c-d197057fba53 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:51.411726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74ec6680-6341-493b-bb2c-d197057fba53 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:51.414713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ba9029bb-260d-45d5-a760-05441033cc83 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:51.420642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ba9029bb-260d-45d5-a760-05441033cc83 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:51.436314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74ec6680-6341-493b-bb2c-d197057fba53 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:51.437273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74ec6680-6341-493b-bb2c-d197057fba53 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:51.438243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74ec6680-6341-493b-bb2c-d197057fba53 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:51.438852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74ec6680-6341-493b-bb2c-d197057fba53 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:51.440033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba9029bb-260d-45d5-a760-05441033cc83 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:51.445115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba9029bb-260d-45d5-a760-05441033cc83 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:51.446939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba9029bb-260d-45d5-a760-05441033cc83 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:51.447845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ba9029bb-260d-45d5-a760-05441033cc83 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:51.686717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ba9029bb-260d-45d5-a760-05441033cc83 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:51.702296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ba9029bb-260d-45d5-a760-05441033cc83 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:51.703842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ba9029bb-260d-45d5-a760-05441033cc83 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:51.705095 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ba9029bb-260d-45d5-a760-05441033cc83 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1426 microversion: 2.54 time: 0.332104 Jul 28 03:53:51.705674 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1710/3858] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:51 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1426 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:51.738709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-abad412a-1474-4d11-9aca-1069c8b3333a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:51.739350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-abad412a-1474-4d11-9aca-1069c8b3333a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 057d7888-f34a-422c-853e-31e349089c1c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:51.776401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abad412a-1474-4d11-9aca-1069c8b3333a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:51.776856 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abad412a-1474-4d11-9aca-1069c8b3333a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:51.787446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abad412a-1474-4d11-9aca-1069c8b3333a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:51.787997 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-abad412a-1474-4d11-9aca-1069c8b3333a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:51.952229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-74ec6680-6341-493b-bb2c-d197057fba53 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:51.961592 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74ec6680-6341-493b-bb2c-d197057fba53 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1465 microversion: 2.1 time: 0.555919 Jul 28 03:53:51.974872 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2149/3859] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:51 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1465 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:51.980344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6947fb4b-ee42-4ab3-9080-1bb7a60ec875 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:51.984471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6947fb4b-ee42-4ab3-9080-1bb7a60ec875 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:52.003681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6947fb4b-ee42-4ab3-9080-1bb7a60ec875 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:52.004545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6947fb4b-ee42-4ab3-9080-1bb7a60ec875 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:52.006816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6947fb4b-ee42-4ab3-9080-1bb7a60ec875 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:52.007346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6947fb4b-ee42-4ab3-9080-1bb7a60ec875 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:52.226873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-abad412a-1474-4d11-9aca-1069c8b3333a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:52.237949 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-abad412a-1474-4d11-9aca-1069c8b3333a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c" status: 200 len: 1517 microversion: 2.1 time: 0.521510 Jul 28 03:53:52.240132 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1711/3860] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:51 2022] GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c => generated 1517 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:52.248407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a4deece8-5463-480b-b4a3-c9c3e574e263 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1914457770", "metadata": {"image_type": "test"}}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:52.251859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a4deece8-5463-480b-b4a3-c9c3e574e263 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:52.267191 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a4deece8-5463-480b-b4a3-c9c3e574e263 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:52.268144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a4deece8-5463-480b-b4a3-c9c3e574e263 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:52.269567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a4deece8-5463-480b-b4a3-c9c3e574e263 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:52.270348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a4deece8-5463-480b-b4a3-c9c3e574e263 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:52.316443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6947fb4b-ee42-4ab3-9080-1bb7a60ec875 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:52.335448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6947fb4b-ee42-4ab3-9080-1bb7a60ec875 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:52.338066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6947fb4b-ee42-4ab3-9080-1bb7a60ec875 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:52.341937 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6947fb4b-ee42-4ab3-9080-1bb7a60ec875 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1754 microversion: 2.20 time: 0.365030 Jul 28 03:53:52.356388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-a4deece8-5463-480b-b4a3-c9c3e574e263 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Getting quotas for project 565b5ba6a4c4496b913bbb8c95b6cd18. Resources: dict_keys(['metadata_items']) {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:53:52.363062 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-a4deece8-5463-480b-b4a3-c9c3e574e263 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Getting quotas for user 6af5e8135e15471f92108c2774212cc3 and project 565b5ba6a4c4496b913bbb8c95b6cd18. Resources: dict_keys(['metadata_items']) {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:53:52.371048 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2150/3861] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:51 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1754 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:52.378629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-58129b04-2c12-45b7-be0b-b4cce2975fc9 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:52.384268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-58129b04-2c12-45b7-be0b-b4cce2975fc9 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 057d7888-f34a-422c-853e-31e349089c1c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:52.402985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58129b04-2c12-45b7-be0b-b4cce2975fc9 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:52.403763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58129b04-2c12-45b7-be0b-b4cce2975fc9 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:52.404773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58129b04-2c12-45b7-be0b-b4cce2975fc9 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:52.406473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58129b04-2c12-45b7-be0b-b4cce2975fc9 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:52.482442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-58129b04-2c12-45b7-be0b-b4cce2975fc9 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 057d7888-f34a-422c-853e-31e349089c1c] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:53:52.667501 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-58129b04-2c12-45b7-be0b-b4cce2975fc9 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "DELETE /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c" status: 204 len: 0 microversion: 2.1 time: 0.294549 Jul 28 03:53:52.674076 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2151/3862] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:53:52 2022] DELETE /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:53:52.681900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4c0b2f8a-3ce6-4713-a856-82f3e2d7c33b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:52.685381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4c0b2f8a-3ce6-4713-a856-82f3e2d7c33b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:52.692715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c0b2f8a-3ce6-4713-a856-82f3e2d7c33b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:52.693583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c0b2f8a-3ce6-4713-a856-82f3e2d7c33b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:52.695897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c0b2f8a-3ce6-4713-a856-82f3e2d7c33b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:52.696583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c0b2f8a-3ce6-4713-a856-82f3e2d7c33b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:52.714318 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-4c0b2f8a-3ce6-4713-a856-82f3e2d7c33b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4c0b2f8a-3ce6-4713-a856-82f3e2d7c33b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b HTTP/1.1 Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '13579693-5082-4742-9c29-a1e16f62308b'} Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:52.717752 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:52.726583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:52.726583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:52.726583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:52.726583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:53:52.726583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:53:52.726583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:53:52.726583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:53:52.728381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4c0b2f8a-3ce6-4713-a856-82f3e2d7c33b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:52.729454 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4c0b2f8a-3ce6-4713-a856-82f3e2d7c33b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 404 len: 111 microversion: 2.1 time: 0.053679 Jul 28 03:53:52.730642 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2152/3863] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:52 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:53:52.739894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-24dc09e3-9d44-4f83-adf9-03702c7547ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:52.742532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-24dc09e3-9d44-4f83-adf9-03702c7547ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:52.751144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24dc09e3-9d44-4f83-adf9-03702c7547ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:52.751845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24dc09e3-9d44-4f83-adf9-03702c7547ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:52.752822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24dc09e3-9d44-4f83-adf9-03702c7547ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:52.753550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24dc09e3-9d44-4f83-adf9-03702c7547ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:52.793708 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-24dc09e3-9d44-4f83-adf9-03702c7547ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061660 Jul 28 03:53:52.794739 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2153/3864] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:53:52 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:52.815545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a1dfdd80-25e2-428e-96f1-5e67fe24fa6b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:52.816143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a1dfdd80-25e2-428e-96f1-5e67fe24fa6b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 057d7888-f34a-422c-853e-31e349089c1c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:52.844721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1dfdd80-25e2-428e-96f1-5e67fe24fa6b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:52.846260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1dfdd80-25e2-428e-96f1-5e67fe24fa6b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:52.848829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1dfdd80-25e2-428e-96f1-5e67fe24fa6b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:52.851261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1dfdd80-25e2-428e-96f1-5e67fe24fa6b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:52.885709 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a4deece8-5463-480b-b4a3-c9c3e574e263 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "POST /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63/action" status: 202 len: 0 microversion: 2.1 time: 0.642670 Jul 28 03:53:52.893829 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1712/3865] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:53:52 2022] POST /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 03:53:52.900225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1970d255-27ee-4b3b-a038-674647666c4f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:52.902388 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1970d255-27ee-4b3b-a038-674647666c4f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:52.919652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1970d255-27ee-4b3b-a038-674647666c4f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:52.920429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1970d255-27ee-4b3b-a038-674647666c4f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:52.923402 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1970d255-27ee-4b3b-a038-674647666c4f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:52.924064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1970d255-27ee-4b3b-a038-674647666c4f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:53.151639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1970d255-27ee-4b3b-a038-674647666c4f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:53.184838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1970d255-27ee-4b3b-a038-674647666c4f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:53.194290 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1970d255-27ee-4b3b-a038-674647666c4f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:53.196849 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1970d255-27ee-4b3b-a038-674647666c4f tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1414 microversion: 2.54 time: 0.300689 Jul 28 03:53:53.222353 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1713/3866] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:52 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1414 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:53.238078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6195717f-c09e-4162-940a-01ea782a66ca tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa6777ad30>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:53.358127 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6195717f-c09e-4162-940a-01ea782a66ca tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.134402 Jul 28 03:53:53.358727 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1714/3867] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:53:53 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:53.394098 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-595772841", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "c540e59d-0550-4ece-8b64-1987a84fa206"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:53.605433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] validate_networks() for [('c540e59d-0550-4ece-8b64-1987a84fa206', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:53:54.186922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a1dfdd80-25e2-428e-96f1-5e67fe24fa6b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:54.237870 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a1dfdd80-25e2-428e-96f1-5e67fe24fa6b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c" status: 200 len: 1523 microversion: 2.1 time: 1.437099 Jul 28 03:53:54.238752 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2154/3868] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:52 2022] GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c => generated 1523 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:54.262203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc843434-3509-4de0-8f10-d5cdbda2153d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:54.267685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cc843434-3509-4de0-8f10-d5cdbda2153d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:54.288646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc843434-3509-4de0-8f10-d5cdbda2153d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:54.293804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc843434-3509-4de0-8f10-d5cdbda2153d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:54.295236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc843434-3509-4de0-8f10-d5cdbda2153d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:54.295875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc843434-3509-4de0-8f10-d5cdbda2153d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:54.687347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cc843434-3509-4de0-8f10-d5cdbda2153d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:54.697207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cc843434-3509-4de0-8f10-d5cdbda2153d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:54.699901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cc843434-3509-4de0-8f10-d5cdbda2153d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:54.701818 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cc843434-3509-4de0-8f10-d5cdbda2153d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1754 microversion: 2.20 time: 0.446578 Jul 28 03:53:54.702398 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2155/3869] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:54 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1754 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:54.729581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-faff7f49-2907-4e4e-8ca5-ccad086b4840 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:54.735092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-faff7f49-2907-4e4e-8ca5-ccad086b4840 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:54.742631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faff7f49-2907-4e4e-8ca5-ccad086b4840 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:54.743351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faff7f49-2907-4e4e-8ca5-ccad086b4840 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:54.745264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faff7f49-2907-4e4e-8ca5-ccad086b4840 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:54.745913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faff7f49-2907-4e4e-8ca5-ccad086b4840 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:54.788298 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-faff7f49-2907-4e4e-8ca5-ccad086b4840 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062575 Jul 28 03:53:54.790494 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2156/3870] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:53:54 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:54.796485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-be456e3b-2125-4c2e-8174-5e6054bd55e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:54.797404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-be456e3b-2125-4c2e-8174-5e6054bd55e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:54.803391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:54.805981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be456e3b-2125-4c2e-8174-5e6054bd55e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:54.807104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be456e3b-2125-4c2e-8174-5e6054bd55e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:54.808422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be456e3b-2125-4c2e-8174-5e6054bd55e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:54.809071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be456e3b-2125-4c2e-8174-5e6054bd55e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:54.966238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be456e3b-2125-4c2e-8174-5e6054bd55e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:54.977582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be456e3b-2125-4c2e-8174-5e6054bd55e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:54.979168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be456e3b-2125-4c2e-8174-5e6054bd55e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:54.984903 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-be456e3b-2125-4c2e-8174-5e6054bd55e8 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1414 microversion: 2.54 time: 0.188818 Jul 28 03:53:54.988412 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2157/3871] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:54 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1414 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:55.007737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f3870f54-d8fb-4da6-9528-50b33478c30e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa678dd4c0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:55.100224 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f3870f54-d8fb-4da6-9528-50b33478c30e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.110556 Jul 28 03:53:55.106992 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2158/3872] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:53:54 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:55.240514 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:53:55.241333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:53:55.241816 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:53:55.242223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:53:55.242635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:53:55.262219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af6ed84c-5956-4a8d-91f9-8c54aac8a839 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:55.262965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-af6ed84c-5956-4a8d-91f9-8c54aac8a839 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 057d7888-f34a-422c-853e-31e349089c1c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:55.279177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af6ed84c-5956-4a8d-91f9-8c54aac8a839 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:55.279617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af6ed84c-5956-4a8d-91f9-8c54aac8a839 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:55.286562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:55.287373 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:55.288719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:55.289558 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:55.294425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af6ed84c-5956-4a8d-91f9-8c54aac8a839 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:55.295480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af6ed84c-5956-4a8d-91f9-8c54aac8a839 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:55.364023 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Getting quotas for project 34ed8cbcca694b8794992388d95bf072. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:53:55.380783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Getting quotas for user 67fcd8c3ec5441e582a4852f0f1184b6 and project 34ed8cbcca694b8794992388d95bf072. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:53:55.413297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:53:55.415658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:53:55.584275 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7ae290dd-8463-41a4-a31c-95e12029099b tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.222053 Jul 28 03:53:55.586271 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1715/3873] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:53:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:53:55.602761 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f0532d0f-dd03-4c4b-ae04-9f587ffab594 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:55.603820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f0532d0f-dd03-4c4b-ae04-9f587ffab594 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:55.648932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-af6ed84c-5956-4a8d-91f9-8c54aac8a839 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:55.661530 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-af6ed84c-5956-4a8d-91f9-8c54aac8a839 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c" status: 200 len: 1523 microversion: 2.1 time: 0.406067 Jul 28 03:53:55.664283 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2159/3874] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:55 2022] GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c => generated 1523 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:55.731513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-87824607-93b2-43c8-8d5f-2b07b5da7f74 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:55.732438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-87824607-93b2-43c8-8d5f-2b07b5da7f74 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:55.743497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87824607-93b2-43c8-8d5f-2b07b5da7f74 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:55.745346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87824607-93b2-43c8-8d5f-2b07b5da7f74 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:55.748660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87824607-93b2-43c8-8d5f-2b07b5da7f74 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:55.749309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87824607-93b2-43c8-8d5f-2b07b5da7f74 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:55.873759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f0532d0f-dd03-4c4b-ae04-9f587ffab594 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:55.887577 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f0532d0f-dd03-4c4b-ae04-9f587ffab594 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1214 microversion: 2.1 time: 0.290659 Jul 28 03:53:55.890859 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1716/3875] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:55 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1214 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:53:55.902790 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5d5ac149-8c2e-4050-be43-ec5e1e127b9b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:55.914134 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5d5ac149-8c2e-4050-be43-ec5e1e127b9b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:55.938455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d5ac149-8c2e-4050-be43-ec5e1e127b9b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:55.940371 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d5ac149-8c2e-4050-be43-ec5e1e127b9b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:55.945436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d5ac149-8c2e-4050-be43-ec5e1e127b9b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:55.948515 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5d5ac149-8c2e-4050-be43-ec5e1e127b9b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:56.025489 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5d5ac149-8c2e-4050-be43-ec5e1e127b9b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133187 Jul 28 03:53:56.028679 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1717/3876] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:53:55 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:56.043966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7475ac64-e99b-4714-9864-7ad331064990 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:56.056072 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7475ac64-e99b-4714-9864-7ad331064990 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:56.106180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7475ac64-e99b-4714-9864-7ad331064990 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:56.106939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7475ac64-e99b-4714-9864-7ad331064990 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:56.108297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7475ac64-e99b-4714-9864-7ad331064990 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:56.108899 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7475ac64-e99b-4714-9864-7ad331064990 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:56.151335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-87824607-93b2-43c8-8d5f-2b07b5da7f74 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:56.173316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-87824607-93b2-43c8-8d5f-2b07b5da7f74 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:56.176528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-87824607-93b2-43c8-8d5f-2b07b5da7f74 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:56.180970 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-87824607-93b2-43c8-8d5f-2b07b5da7f74 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1754 microversion: 2.20 time: 0.453563 Jul 28 03:53:56.200676 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2160/3877] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:55 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1754 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:56.219460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-38779b66-7f71-4668-b385-33ac06e3901b tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa6793c670>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:56.353507 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-38779b66-7f71-4668-b385-33ac06e3901b tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.149600 Jul 28 03:53:56.358407 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2161/3878] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:53:56 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:56.438991 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7475ac64-e99b-4714-9864-7ad331064990 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:56.471597 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7475ac64-e99b-4714-9864-7ad331064990 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:56.478251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7475ac64-e99b-4714-9864-7ad331064990 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:56.479733 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7475ac64-e99b-4714-9864-7ad331064990 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1414 microversion: 2.54 time: 0.450020 Jul 28 03:53:56.483533 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1718/3879] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:56 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1414 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:56.684295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dfd6f4a3-572d-4298-9476-26a57d914a6a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:56.685459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dfd6f4a3-572d-4298-9476-26a57d914a6a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 057d7888-f34a-422c-853e-31e349089c1c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:56.712153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfd6f4a3-572d-4298-9476-26a57d914a6a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:56.715688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfd6f4a3-572d-4298-9476-26a57d914a6a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:56.716756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfd6f4a3-572d-4298-9476-26a57d914a6a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:56.719694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfd6f4a3-572d-4298-9476-26a57d914a6a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:56.912186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3afc3d5b-d927-440d-a560-e4ab2e9870fb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:56.912952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3afc3d5b-d927-440d-a560-e4ab2e9870fb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:56.924291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3afc3d5b-d927-440d-a560-e4ab2e9870fb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:56.926197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3afc3d5b-d927-440d-a560-e4ab2e9870fb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:56.927560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3afc3d5b-d927-440d-a560-e4ab2e9870fb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:56.929665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3afc3d5b-d927-440d-a560-e4ab2e9870fb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:57.226057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3afc3d5b-d927-440d-a560-e4ab2e9870fb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:57.278237 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3afc3d5b-d927-440d-a560-e4ab2e9870fb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1218 microversion: 2.1 time: 0.371280 Jul 28 03:53:57.301545 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1719/3880] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:56 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1218 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:57.349222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c145de55-ce77-436e-bb2a-268f49414380 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:57.357726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c145de55-ce77-436e-bb2a-268f49414380 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:57.395007 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c145de55-ce77-436e-bb2a-268f49414380 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:57.395782 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c145de55-ce77-436e-bb2a-268f49414380 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:57.401469 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c145de55-ce77-436e-bb2a-268f49414380 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:57.402228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c145de55-ce77-436e-bb2a-268f49414380 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:57.541586 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c145de55-ce77-436e-bb2a-268f49414380 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.238957 Jul 28 03:53:57.542281 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1720/3881] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:53:57 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments => generated 197 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:57.558899 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fd8c2d3c-1961-43cb-80ac-0adbfb99d11f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:57.559488 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fd8c2d3c-1961-43cb-80ac-0adbfb99d11f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:57.578507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd8c2d3c-1961-43cb-80ac-0adbfb99d11f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:57.578966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd8c2d3c-1961-43cb-80ac-0adbfb99d11f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:57.584722 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd8c2d3c-1961-43cb-80ac-0adbfb99d11f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:57.585445 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd8c2d3c-1961-43cb-80ac-0adbfb99d11f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:57.957164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fd8c2d3c-1961-43cb-80ac-0adbfb99d11f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:57.978116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fd8c2d3c-1961-43cb-80ac-0adbfb99d11f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:57.982211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fd8c2d3c-1961-43cb-80ac-0adbfb99d11f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:57.993635 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fd8c2d3c-1961-43cb-80ac-0adbfb99d11f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1754 microversion: 2.20 time: 0.438728 Jul 28 03:53:57.999482 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1721/3882] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:57 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1754 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:58.016087 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-af67f0c0-eec3-4351-a3cd-2706c7f0adb2 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa67690700>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:58.118562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dfd6f4a3-572d-4298-9476-26a57d914a6a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:58.131078 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dfd6f4a3-572d-4298-9476-26a57d914a6a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c" status: 200 len: 1523 microversion: 2.1 time: 1.451240 Jul 28 03:53:58.135114 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2162/3883] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:56 2022] GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c => generated 1523 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:58.143312 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-af67f0c0-eec3-4351-a3cd-2706c7f0adb2 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.142445 Jul 28 03:53:58.144070 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1722/3884] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:53:57 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:58.144884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7e4a2cd8-867a-4675-afb7-5a14a882db95 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:58.145807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7e4a2cd8-867a-4675-afb7-5a14a882db95 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:58.182515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e4a2cd8-867a-4675-afb7-5a14a882db95 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:58.186135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e4a2cd8-867a-4675-afb7-5a14a882db95 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:58.187189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e4a2cd8-867a-4675-afb7-5a14a882db95 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:58.188807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e4a2cd8-867a-4675-afb7-5a14a882db95 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:58.251008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:58.329970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c319717e-4423-4b0d-a07e-8e13aaccc225 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:58.330612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c319717e-4423-4b0d-a07e-8e13aaccc225 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:58.352665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c319717e-4423-4b0d-a07e-8e13aaccc225 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:58.353127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c319717e-4423-4b0d-a07e-8e13aaccc225 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:58.353940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c319717e-4423-4b0d-a07e-8e13aaccc225 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:58.354382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c319717e-4423-4b0d-a07e-8e13aaccc225 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:58.503126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7e4a2cd8-867a-4675-afb7-5a14a882db95 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:58.524990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7e4a2cd8-867a-4675-afb7-5a14a882db95 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:58.535899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7e4a2cd8-867a-4675-afb7-5a14a882db95 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:58.541849 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7e4a2cd8-867a-4675-afb7-5a14a882db95 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1399 microversion: 2.54 time: 0.405331 Jul 28 03:53:58.569876 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2163/3885] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:58 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1399 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:58.580605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4c0fe9a8-649f-4be5-80c5-440ff469b1af tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:58.584000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4c0fe9a8-649f-4be5-80c5-440ff469b1af tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:58.620404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c0fe9a8-649f-4be5-80c5-440ff469b1af tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:58.625025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c0fe9a8-649f-4be5-80c5-440ff469b1af tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:58.629441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c0fe9a8-649f-4be5-80c5-440ff469b1af tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:58.631959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c0fe9a8-649f-4be5-80c5-440ff469b1af tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:58.751769 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4c0fe9a8-649f-4be5-80c5-440ff469b1af tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180255 Jul 28 03:53:58.758677 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2164/3886] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:53:58 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:58.760924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c319717e-4423-4b0d-a07e-8e13aaccc225 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:58.773181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dea8ba95-9e5b-49e1-bcb1-e8a92dc5de09 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '.version_select at 0x7ffa679149d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:58.804081 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c319717e-4423-4b0d-a07e-8e13aaccc225 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1272 microversion: 2.1 time: 0.478610 Jul 28 03:53:58.816417 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1723/3887] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:58 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1272 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:58.820017 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-76a2e250-117c-4701-a1f9-241879e47d03 req-b28f0ed0-8ce4-4d0a-9246-79a5e881b1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "057d7888-f34a-422c-853e-31e349089c1c", "name": "network-vif-deleted", "tag": "eca48282-6121-4c71-a667-9b08a44281c4"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:58.845330 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dea8ba95-9e5b-49e1-bcb1-e8a92dc5de09 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2086151354" status: 204 len: 0 microversion: 2.54 time: 0.082590 Jul 28 03:53:58.852908 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2165/3888] 10.222.0.48 () {60 vars in 1319 bytes} [Thu Jul 28 03:53:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-2086151354 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:53:58.867796 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-76a2e250-117c-4701-a1f9-241879e47d03 req-b28f0ed0-8ce4-4d0a-9246-79a5e881b1f1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:58.870861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-76a2e250-117c-4701-a1f9-241879e47d03 req-b28f0ed0-8ce4-4d0a-9246-79a5e881b1f1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:58.877092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ffb24b8c-6e70-4c4f-ba13-a424c1428bee tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:58.879312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ffb24b8c-6e70-4c4f-ba13-a424c1428bee tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:58.906098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffb24b8c-6e70-4c4f-ba13-a424c1428bee tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:58.910843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffb24b8c-6e70-4c4f-ba13-a424c1428bee tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:58.912045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffb24b8c-6e70-4c4f-ba13-a424c1428bee tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:58.914765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffb24b8c-6e70-4c4f-ba13-a424c1428bee tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:58.941526 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-76a2e250-117c-4701-a1f9-241879e47d03 req-b28f0ed0-8ce4-4d0a-9246-79a5e881b1f1 service nova] Creating event network-vif-deleted:eca48282-6121-4c71-a667-9b08a44281c4 for instance 057d7888-f34a-422c-853e-31e349089c1c on n-h2-826756-3 Jul 28 03:53:58.974779 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-76a2e250-117c-4701-a1f9-241879e47d03 req-b28f0ed0-8ce4-4d0a-9246-79a5e881b1f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166392 Jul 28 03:53:58.975461 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1724/3889] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:59.031551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ffb24b8c-6e70-4c4f-ba13-a424c1428bee tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:53:59.051757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-398a0b44-3d9a-4310-96d8-721f1d907abf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:59.052986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-398a0b44-3d9a-4310-96d8-721f1d907abf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:59.071636 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-398a0b44-3d9a-4310-96d8-721f1d907abf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:59.073132 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-398a0b44-3d9a-4310-96d8-721f1d907abf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:59.075803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-398a0b44-3d9a-4310-96d8-721f1d907abf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:59.077351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-398a0b44-3d9a-4310-96d8-721f1d907abf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:59.345907 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ffb24b8c-6e70-4c4f-ba13-a424c1428bee tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 204 len: 0 microversion: 2.54 time: 0.485524 Jul 28 03:53:59.351063 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2166/3890] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:53:58 2022] DELETE /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:53:59.369313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-36daa574-80e0-40b2-98b4-623135a84159 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa67800d30>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:59.489480 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-36daa574-80e0-40b2-98b4-623135a84159 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.132722 Jul 28 03:53:59.490468 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2167/3891] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:53:59 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:59.509914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d63befb1-4235-4968-b36c-fb84d8b0fe0b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:59.512231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d63befb1-4235-4968-b36c-fb84d8b0fe0b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 057d7888-f34a-422c-853e-31e349089c1c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:59.530034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d63befb1-4235-4968-b36c-fb84d8b0fe0b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:59.533172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d63befb1-4235-4968-b36c-fb84d8b0fe0b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:59.536116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d63befb1-4235-4968-b36c-fb84d8b0fe0b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:59.538053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d63befb1-4235-4968-b36c-fb84d8b0fe0b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:59.644933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d63befb1-4235-4968-b36c-fb84d8b0fe0b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:59.647170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d63befb1-4235-4968-b36c-fb84d8b0fe0b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:59.648325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-d63befb1-4235-4968-b36c-fb84d8b0fe0b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lazy-loading 'fault' on Instance uuid 057d7888-f34a-422c-853e-31e349089c1c {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:53:59.849150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d63befb1-4235-4968-b36c-fb84d8b0fe0b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:53:59.862794 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d63befb1-4235-4968-b36c-fb84d8b0fe0b tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c" status: 200 len: 1313 microversion: 2.1 time: 0.359668 Jul 28 03:53:59.864125 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2168/3892] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:53:59 2022] GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:59.874821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90345718-63b9-4ad9-9ee7-5bc4878a5015 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:59.877358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-90345718-63b9-4ad9-9ee7-5bc4878a5015 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:53:59.893279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90345718-63b9-4ad9-9ee7-5bc4878a5015 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:59.894439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90345718-63b9-4ad9-9ee7-5bc4878a5015 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:53:59.895654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90345718-63b9-4ad9-9ee7-5bc4878a5015 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:53:59.896322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90345718-63b9-4ad9-9ee7-5bc4878a5015 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:00.137686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-90345718-63b9-4ad9-9ee7-5bc4878a5015 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:00.154819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-90345718-63b9-4ad9-9ee7-5bc4878a5015 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:00.156712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-90345718-63b9-4ad9-9ee7-5bc4878a5015 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:00.157965 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90345718-63b9-4ad9-9ee7-5bc4878a5015 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1405 microversion: 2.54 time: 0.292587 Jul 28 03:54:00.173868 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2169/3893] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:59 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:00.178380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-52344206-5267-4b32-a1cb-72b37422110c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:00.183072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-52344206-5267-4b32-a1cb-72b37422110c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:00.203635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52344206-5267-4b32-a1cb-72b37422110c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:00.204437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52344206-5267-4b32-a1cb-72b37422110c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:00.205478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52344206-5267-4b32-a1cb-72b37422110c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:00.207111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52344206-5267-4b32-a1cb-72b37422110c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:00.274129 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-52344206-5267-4b32-a1cb-72b37422110c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104099 Jul 28 03:54:00.289187 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2170/3894] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:54:00 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:00.295410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2e68bb20-991d-43f2-bea9-d625bec4c71a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:00.296343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2e68bb20-991d-43f2-bea9-d625bec4c71a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:00.309787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e68bb20-991d-43f2-bea9-d625bec4c71a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:00.310514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e68bb20-991d-43f2-bea9-d625bec4c71a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:00.311571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e68bb20-991d-43f2-bea9-d625bec4c71a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:00.312176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e68bb20-991d-43f2-bea9-d625bec4c71a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:00.689907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2e68bb20-991d-43f2-bea9-d625bec4c71a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:00.708100 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2e68bb20-991d-43f2-bea9-d625bec4c71a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1272 microversion: 2.1 time: 0.415516 Jul 28 03:54:00.728164 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2171/3895] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:00 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1272 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:00.733879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c04d198-334a-48c9-a182-f5956657b104 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa6798d940>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:00.767456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-398a0b44-3d9a-4310-96d8-721f1d907abf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:00.782925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-398a0b44-3d9a-4310-96d8-721f1d907abf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:00.784861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-398a0b44-3d9a-4310-96d8-721f1d907abf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:00.789665 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-398a0b44-3d9a-4310-96d8-721f1d907abf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1754 microversion: 2.20 time: 1.753914 Jul 28 03:54:00.807322 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1725/3896] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:53:59 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1754 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:00.872067 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c04d198-334a-48c9-a182-f5956657b104 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.141881 Jul 28 03:54:00.872900 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2172/3897] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:00 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:00.888852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ca8cf799-299c-4c33-ac4d-31c6b4a9b3de tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:00.889810 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ca8cf799-299c-4c33-ac4d-31c6b4a9b3de tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 057d7888-f34a-422c-853e-31e349089c1c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:00.906998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ca8cf799-299c-4c33-ac4d-31c6b4a9b3de tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:00.907783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ca8cf799-299c-4c33-ac4d-31c6b4a9b3de tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:00.909236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ca8cf799-299c-4c33-ac4d-31c6b4a9b3de tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:00.919809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ca8cf799-299c-4c33-ac4d-31c6b4a9b3de tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:00.979200 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-ca8cf799-299c-4c33-ac4d-31c6b4a9b3de tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] HTTP exception thrown: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ca8cf799-299c-4c33-ac4d-31c6b4a9b3de tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Request method failure captured: Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c HTTP/1.1 Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4ggkaYbXSI5r-ln4lNB2zTdFukrJD1-LMeG_N8QQd6xJYDl0W74RpePstn1MpyujU7z58memlGS4ifE7_dNe4k_xlcgICj441seWrpP9g845z1mH7qvmJzejVivLKurqX1PFEYeuaRWOfrt9kYqxFOx7OOKxRMvY22jLFb_kBQ6-Syg Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f46636803c54485f8a0d956306f9b033"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f46636803c54485f8a0d956306f9b033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}] Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 4854da16472a4dbca31edde269c13bd5 Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '057d7888-f34a-422c-853e-31e349089c1c'} Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:00.984302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:00.991207 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:00.991207 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:00.991207 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:00.991207 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:00.991207 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:00.991207 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:00.991207 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:00.993776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ca8cf799-299c-4c33-ac4d-31c6b4a9b3de tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Returning 404 to user: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:00.997293 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ca8cf799-299c-4c33-ac4d-31c6b4a9b3de tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c" status: 404 len: 111 microversion: 2.1 time: 0.112000 Jul 28 03:54:00.998612 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1726/3898] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:00 2022] GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:01.008167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f1129ab8-12ad-4850-a522-7113e6165116 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:01.016252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f1129ab8-12ad-4850-a522-7113e6165116 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:01.018190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f1129ab8-12ad-4850-a522-7113e6165116 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'f46636803c54485f8a0d956306f9b033'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:54:01.044264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1129ab8-12ad-4850-a522-7113e6165116 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:01.055609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1129ab8-12ad-4850-a522-7113e6165116 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:01.059311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1129ab8-12ad-4850-a522-7113e6165116 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:01.063657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1129ab8-12ad-4850-a522-7113e6165116 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:01.186968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c91574ed-6e79-409f-bf94-57485d927d94 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:01.188332 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c91574ed-6e79-409f-bf94-57485d927d94 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:01.208114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c91574ed-6e79-409f-bf94-57485d927d94 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:01.211532 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c91574ed-6e79-409f-bf94-57485d927d94 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:01.212465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c91574ed-6e79-409f-bf94-57485d927d94 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:01.212924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c91574ed-6e79-409f-bf94-57485d927d94 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:01.273380 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f1129ab8-12ad-4850-a522-7113e6165116 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.269394 Jul 28 03:54:01.277477 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2173/3899] 10.222.0.48 () {58 vars in 1230 bytes} [Thu Jul 28 03:54:01 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 03:54:01.300045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e3951a9-da6d-4e42-882a-3dbdf54ab697 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e3951a9-da6d-4e42-882a-3dbdf54ab697 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Request method failure captured: Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ggkaYbXSI5r-ln4lNB2zTdFukrJD1-LMeG_N8QQd6xJYDl0W74RpePstn1MpyujU7z58memlGS4ifE7_dNe4k_xlcgICj441seWrpP9g845z1mH7qvmJzejVivLKurqX1PFEYeuaRWOfrt9kYqxFOx7OOKxRMvY22jLFb_kBQ6-Syg Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f46636803c54485f8a0d956306f9b033"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f46636803c54485f8a0d956306f9b033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}] Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 4854da16472a4dbca31edde269c13bd5 Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: action_args: {} Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 28 03:54:01.307499 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:54:01.312547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:54:01.312547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:54:01.312547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:54:01.312547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 28 03:54:01.312547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:01.312547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:01.312547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:01.312547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:01.312547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:01.312547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:01.312547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:54:01.312547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:54:01.312547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 28 03:54:01.312547 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:01.314689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e3951a9-da6d-4e42-882a-3dbdf54ab697 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:01.315177 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e3951a9-da6d-4e42-882a-3dbdf54ab697 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.024019 Jul 28 03:54:01.328027 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2174/3900] 10.222.0.48 () {58 vars in 1182 bytes} [Thu Jul 28 03:54:01 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:54:01.341002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-96e3473d-df4b-4c95-9727-a3176a6672e4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:01.347089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-96e3473d-df4b-4c95-9727-a3176a6672e4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:01.364426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96e3473d-df4b-4c95-9727-a3176a6672e4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:01.369052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96e3473d-df4b-4c95-9727-a3176a6672e4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:01.374499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96e3473d-df4b-4c95-9727-a3176a6672e4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:01.383012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96e3473d-df4b-4c95-9727-a3176a6672e4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:01.424607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c91574ed-6e79-409f-bf94-57485d927d94 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:01.428810 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:01.452558 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c91574ed-6e79-409f-bf94-57485d927d94 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:01.471055 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c91574ed-6e79-409f-bf94-57485d927d94 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:01.479154 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c91574ed-6e79-409f-bf94-57485d927d94 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1405 microversion: 2.54 time: 0.290808 Jul 28 03:54:01.479866 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1727/3901] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:01 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1405 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:54:01.495256 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-96e3473d-df4b-4c95-9727-a3176a6672e4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.165263 Jul 28 03:54:01.500931 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2175/3902] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:54:01 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f/os-volume_attachments => generated 25 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:54:01.530651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8bb709f7-5a64-4131-8999-73e035483b44 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:01.554532 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8bb709f7-5a64-4131-8999-73e035483b44 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:01.560135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8bb709f7-5a64-4131-8999-73e035483b44 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Searching by: {'deleted': False, 'project_id': 'f46636803c54485f8a0d956306f9b033'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:54:01.578757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bb709f7-5a64-4131-8999-73e035483b44 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:01.579537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bb709f7-5a64-4131-8999-73e035483b44 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:01.580604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bb709f7-5a64-4131-8999-73e035483b44 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:01.597456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bb709f7-5a64-4131-8999-73e035483b44 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:01.729504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3298c4d6-6369-4f95-a401-f80cde736a03 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:01.732585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3298c4d6-6369-4f95-a401-f80cde736a03 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:01.769691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3298c4d6-6369-4f95-a401-f80cde736a03 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:01.777286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3298c4d6-6369-4f95-a401-f80cde736a03 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:01.780423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3298c4d6-6369-4f95-a401-f80cde736a03 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:01.790232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3298c4d6-6369-4f95-a401-f80cde736a03 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:01.858839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-8bb709f7-5a64-4131-8999-73e035483b44 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:54:01.878626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3298c4d6-6369-4f95-a401-f80cde736a03 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:54:02.079988 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8bb709f7-5a64-4131-8999-73e035483b44 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.598421 Jul 28 03:54:02.081092 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1728/3903] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 03:54:01 2022] GET /compute/v2.1/servers => generated 683 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:02.107837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-42a285e8-e705-4b16-89d3-32207ce095d6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:02.108590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-42a285e8-e705-4b16-89d3-32207ce095d6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:02.148088 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42a285e8-e705-4b16-89d3-32207ce095d6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:02.148593 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42a285e8-e705-4b16-89d3-32207ce095d6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:02.151910 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42a285e8-e705-4b16-89d3-32207ce095d6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:02.155170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42a285e8-e705-4b16-89d3-32207ce095d6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:02.165200 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3298c4d6-6369-4f95-a401-f80cde736a03 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 204 len: 0 microversion: 2.1 time: 0.442857 Jul 28 03:54:02.172071 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2176/3904] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:54:01 2022] DELETE /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:54:02.189205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9319fce1-5378-430c-9e2f-40bd8a9787b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:02.189957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9319fce1-5378-430c-9e2f-40bd8a9787b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:02.216721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9319fce1-5378-430c-9e2f-40bd8a9787b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:02.217259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9319fce1-5378-430c-9e2f-40bd8a9787b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:02.222053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9319fce1-5378-430c-9e2f-40bd8a9787b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:02.222570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9319fce1-5378-430c-9e2f-40bd8a9787b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:03.232720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9319fce1-5378-430c-9e2f-40bd8a9787b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:03.258461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9319fce1-5378-430c-9e2f-40bd8a9787b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:03.272143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9319fce1-5378-430c-9e2f-40bd8a9787b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:03.277917 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9319fce1-5378-430c-9e2f-40bd8a9787b1 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1754 microversion: 2.20 time: 1.108505 Jul 28 03:54:03.285855 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2177/3905] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:02 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1754 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:03.299386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-db9187ee-4ceb-497b-974c-d7d8248e488b tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa678f1550>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:03.413138 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-db9187ee-4ceb-497b-974c-d7d8248e488b tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.125794 Jul 28 03:54:03.414024 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2178/3906] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:03 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:03.425919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4720061f-098f-4fa6-a33b-c8bb0023dee5 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:03.438837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4720061f-098f-4fa6-a33b-c8bb0023dee5 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:03.445635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.compute.servers [None req-4720061f-098f-4fa6-a33b-c8bb0023dee5 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Removing options 'limit' from query {{(pid=126071) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 28 03:54:03.446942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4720061f-098f-4fa6-a33b-c8bb0023dee5 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Searching by: {'deleted': False, 'project_id': 'f46636803c54485f8a0d956306f9b033'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:54:03.459387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4720061f-098f-4fa6-a33b-c8bb0023dee5 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:03.466166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4720061f-098f-4fa6-a33b-c8bb0023dee5 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:03.469377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4720061f-098f-4fa6-a33b-c8bb0023dee5 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:03.475279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4720061f-098f-4fa6-a33b-c8bb0023dee5 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:03.565692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-4720061f-098f-4fa6-a33b-c8bb0023dee5 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:54:03.631101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-42a285e8-e705-4b16-89d3-32207ce095d6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:03.640173 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-42a285e8-e705-4b16-89d3-32207ce095d6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1314 microversion: 2.1 time: 1.553361 Jul 28 03:54:03.651074 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1729/3907] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:02 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1314 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:03.658304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1f6f9451-27a4-428a-9a59-0cd87f43e4f6 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:03.663667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1f6f9451-27a4-428a-9a59-0cd87f43e4f6 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:03.681690 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4720061f-098f-4fa6-a33b-c8bb0023dee5 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.257384 Jul 28 03:54:03.682697 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2179/3908] 10.222.0.48 () {58 vars in 1144 bytes} [Thu Jul 28 03:54:03 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:03.705725 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f6f9451-27a4-428a-9a59-0cd87f43e4f6 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:03.713270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-521edb42-443d-4844-a036-7e5bb38194ac tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:03.714380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-521edb42-443d-4844-a036-7e5bb38194ac tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:03.715084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f6f9451-27a4-428a-9a59-0cd87f43e4f6 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:03.718348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f6f9451-27a4-428a-9a59-0cd87f43e4f6 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:03.723190 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f6f9451-27a4-428a-9a59-0cd87f43e4f6 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:03.738270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-521edb42-443d-4844-a036-7e5bb38194ac tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:03.743494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-521edb42-443d-4844-a036-7e5bb38194ac tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:03.752086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-521edb42-443d-4844-a036-7e5bb38194ac tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:03.757033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-521edb42-443d-4844-a036-7e5bb38194ac tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:03.938869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-521edb42-443d-4844-a036-7e5bb38194ac tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:03.939605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-521edb42-443d-4844-a036-7e5bb38194ac tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:03.940396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-521edb42-443d-4844-a036-7e5bb38194ac tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lazy-loading 'fault' on Instance uuid d7ae8c15-c39e-4017-b92d-5532069466a8 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:54:04.515126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-521edb42-443d-4844-a036-7e5bb38194ac tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:04.527754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-521edb42-443d-4844-a036-7e5bb38194ac tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:04.533417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-521edb42-443d-4844-a036-7e5bb38194ac tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'edd7eb775c5b4f63aac616f9c60bc2f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3046242ec6a64ff3950749a6ceff2248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:04.537287 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-521edb42-443d-4844-a036-7e5bb38194ac tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 200 len: 1410 microversion: 2.54 time: 0.843858 Jul 28 03:54:04.537898 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2180/3909] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:03 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 1410 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:04.552492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-eadc0b31-8229-4ce9-971e-647dfa0e1797 req-4723261b-0848-4fcd-92bf-763a04693a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091c0997-537d-4124-9945-1ef1dd079d63", "name": "network-vif-plugged", "status": "completed", "tag": "c5b8c623-1fc8-4425-b1c1-c5da71e14c34"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:04.573640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-eadc0b31-8229-4ce9-971e-647dfa0e1797 req-4723261b-0848-4fcd-92bf-763a04693a1e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:04.575712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-eadc0b31-8229-4ce9-971e-647dfa0e1797 req-4723261b-0848-4fcd-92bf-763a04693a1e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:04.602523 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-eadc0b31-8229-4ce9-971e-647dfa0e1797 req-4723261b-0848-4fcd-92bf-763a04693a1e service nova] Creating event network-vif-plugged:c5b8c623-1fc8-4425-b1c1-c5da71e14c34 for instance 091c0997-537d-4124-9945-1ef1dd079d63 on n-h1-826756-3 Jul 28 03:54:04.623442 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-eadc0b31-8229-4ce9-971e-647dfa0e1797 req-4723261b-0848-4fcd-92bf-763a04693a1e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080456 Jul 28 03:54:04.629084 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2181/3910] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:04.640638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d281c68-800d-45cb-9f26-c9f3c3457ffc tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d281c68-800d-45cb-9f26-c9f3c3457ffc tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Request method failure captured: Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ggkaYbXSI5r-ln4lNB2zTdFukrJD1-LMeG_N8QQd6xJYDl0W74RpePstn1MpyujU7z58memlGS4ifE7_dNe4k_xlcgICj441seWrpP9g845z1mH7qvmJzejVivLKurqX1PFEYeuaRWOfrt9kYqxFOx7OOKxRMvY22jLFb_kBQ6-Syg Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f46636803c54485f8a0d956306f9b033"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f46636803c54485f8a0d956306f9b033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}] Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 4854da16472a4dbca31edde269c13bd5 Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: action_args: {} Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi '-1' Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 28 03:54:04.645447 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 28 03:54:04.654392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:04.656636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d281c68-800d-45cb-9f26-c9f3c3457ffc tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:04.657753 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d281c68-800d-45cb-9f26-c9f3c3457ffc tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.025065 Jul 28 03:54:04.658896 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2182/3911] 10.222.0.48 () {58 vars in 1142 bytes} [Thu Jul 28 03:54:04 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:54:04.669519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-620b2cbb-5c3d-4545-8dd6-f0ef50aa37f7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:04.679192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-620b2cbb-5c3d-4545-8dd6-f0ef50aa37f7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:04.688842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-620b2cbb-5c3d-4545-8dd6-f0ef50aa37f7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:04.689648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-620b2cbb-5c3d-4545-8dd6-f0ef50aa37f7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:04.691629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-620b2cbb-5c3d-4545-8dd6-f0ef50aa37f7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:04.692277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-620b2cbb-5c3d-4545-8dd6-f0ef50aa37f7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:04.730158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:05.013633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-620b2cbb-5c3d-4545-8dd6-f0ef50aa37f7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:05.027413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-620b2cbb-5c3d-4545-8dd6-f0ef50aa37f7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:05.029494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-620b2cbb-5c3d-4545-8dd6-f0ef50aa37f7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:05.030920 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-620b2cbb-5c3d-4545-8dd6-f0ef50aa37f7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1754 microversion: 2.20 time: 0.370682 Jul 28 03:54:05.064896 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2183/3912] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:04 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1754 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:05.083970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1f6f9451-27a4-428a-9a59-0cd87f43e4f6 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:05.084525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-899fe76a-c4d7-4f8c-af7e-a4616b057bc1 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa679143a0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:05.097348 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1f6f9451-27a4-428a-9a59-0cd87f43e4f6 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1680 microversion: 2.1 time: 1.444809 Jul 28 03:54:05.104511 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1730/3913] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:03 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1680 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:05.110208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f38df163-14b0-4b6c-b225-d037a8c1b85a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f38df163-14b0-4b6c-b225-d037a8c1b85a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Request method failure captured: Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4ggkaYbXSI5r-ln4lNB2zTdFukrJD1-LMeG_N8QQd6xJYDl0W74RpePstn1MpyujU7z58memlGS4ifE7_dNe4k_xlcgICj441seWrpP9g845z1mH7qvmJzejVivLKurqX1PFEYeuaRWOfrt9kYqxFOx7OOKxRMvY22jLFb_kBQ6-Syg Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f46636803c54485f8a0d956306f9b033"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f46636803c54485f8a0d956306f9b033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}] Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 4854da16472a4dbca31edde269c13bd5 Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: action_args: {} Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'testing' Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 28 03:54:05.127164 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 28 03:54:05.133114 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:05.135579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f38df163-14b0-4b6c-b225-d037a8c1b85a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:05.140295 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f38df163-14b0-4b6c-b225-d037a8c1b85a tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.034177 Jul 28 03:54:05.142068 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1731/3914] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:54:05 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:54:05.158029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a64f306b-6f14-4794-babc-cb08ffe65266 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:05.158805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a64f306b-6f14-4794-babc-cb08ffe65266 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:05.174743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a64f306b-6f14-4794-babc-cb08ffe65266 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:05.177191 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a64f306b-6f14-4794-babc-cb08ffe65266 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:05.178663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a64f306b-6f14-4794-babc-cb08ffe65266 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:05.178860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a64f306b-6f14-4794-babc-cb08ffe65266 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:05.245458 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-899fe76a-c4d7-4f8c-af7e-a4616b057bc1 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.179277 Jul 28 03:54:05.247778 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2184/3915] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:05 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:05.257029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-79f89aea-adf7-43f5-873f-de616d4c026d tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:05.284571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-79f89aea-adf7-43f5-873f-de616d4c026d tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:05.285703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-79f89aea-adf7-43f5-873f-de616d4c026d tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'f46636803c54485f8a0d956306f9b033'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:54:05.315410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.compute.servers [None req-79f89aea-adf7-43f5-873f-de616d4c026d tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Flavor 'non_existing_flavor' could not be found {{(pid=126071) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 28 03:54:05.316603 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-79f89aea-adf7-43f5-873f-de616d4c026d tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.067751 Jul 28 03:54:05.342455 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2185/3916] 10.222.0.48 () {58 vars in 1178 bytes} [Thu Jul 28 03:54:05 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:54:05.350229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-915785c2-4d2c-4dd7-a281-4fc356457f8f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:05.359907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-915785c2-4d2c-4dd7-a281-4fc356457f8f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:05.360633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-915785c2-4d2c-4dd7-a281-4fc356457f8f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'f46636803c54485f8a0d956306f9b033'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:54:05.401426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-915785c2-4d2c-4dd7-a281-4fc356457f8f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:05.401892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-915785c2-4d2c-4dd7-a281-4fc356457f8f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:05.409982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-915785c2-4d2c-4dd7-a281-4fc356457f8f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:05.410910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-915785c2-4d2c-4dd7-a281-4fc356457f8f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:05.663008 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-915785c2-4d2c-4dd7-a281-4fc356457f8f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.318906 Jul 28 03:54:05.680584 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2186/3917] 10.222.0.48 () {58 vars in 1174 bytes} [Thu Jul 28 03:54:05 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:54:05.709395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e45137c4-33bd-4283-bc25-b3a0b29d52f4 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:05.710636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e45137c4-33bd-4283-bc25-b3a0b29d52f4 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] [instance: d7ae8c15-c39e-4017-b92d-5532069466a8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:05.724416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e45137c4-33bd-4283-bc25-b3a0b29d52f4 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:05.727139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e45137c4-33bd-4283-bc25-b3a0b29d52f4 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:05.729587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e45137c4-33bd-4283-bc25-b3a0b29d52f4 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:05.732577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e45137c4-33bd-4283-bc25-b3a0b29d52f4 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:05.795821 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e45137c4-33bd-4283-bc25-b3a0b29d52f4 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] HTTP exception thrown: Instance d7ae8c15-c39e-4017-b92d-5532069466a8 could not be found. Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e45137c4-33bd-4283-bc25-b3a0b29d52f4 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Request method failure captured: Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 HTTP/1.1 Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ggkYGKUna4mY2aNaHBMsKRU9LTe24FmrJk6htjAxIaGUlY-STXqTDTYZpc8OHke_lLLRrlujdXO4JxkNWWTlVP6wUagtMIRbVPOYg8FwV46bDhOzt86L60XsN1XcwzPTOoEx9tWni_GWinuIsxgFj-f-wyOIV0_bDUh7XrsLFmUdSw Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.54 Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 3046242ec6a64ff3950749a6ceff2248 Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerShowV254Test-216131717 Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/3046242ec6a64ff3950749a6ceff2248"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3046242ec6a64ff3950749a6ceff2248"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_3046242ec6a64ff3950749a6ceff2248"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/3046242ec6a64ff3950749a6ceff2248"}]}] Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerShowV254Test-216131717 Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 3046242ec6a64ff3950749a6ceff2248 Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerShowV254Test-216131717 Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerShowV254Test-216131717-project Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: edd7eb775c5b4f63aac616f9c60bc2f2 Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerShowV254Test-216131717-project Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d7ae8c15-c39e-4017-b92d-5532069466a8 could not be found. Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd7ae8c15-c39e-4017-b92d-5532069466a8'} Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7ae8c15-c39e-4017-b92d-5532069466a8 could not be found. Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7ae8c15-c39e-4017-b92d-5532069466a8 could not be found. Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:05.809083 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:05.815520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:05.815520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:05.815520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:05.815520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:05.815520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:05.815520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7ae8c15-c39e-4017-b92d-5532069466a8 could not be found. Jul 28 03:54:05.815520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:05.815520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e45137c4-33bd-4283-bc25-b3a0b29d52f4 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] Returning 404 to user: Instance d7ae8c15-c39e-4017-b92d-5532069466a8 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:05.815520 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e45137c4-33bd-4283-bc25-b3a0b29d52f4 tempest-ServerShowV254Test-216131717 tempest-ServerShowV254Test-216131717-project] 10.222.0.48 "GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8" status: 404 len: 111 microversion: 2.54 time: 0.131659 Jul 28 03:54:05.815520 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2187/3918] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:05 2022] GET /compute/v2.1/servers/d7ae8c15-c39e-4017-b92d-5532069466a8 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:54:05.824254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb84d61c-0d9e-417d-b5e9-ebeea5402eca tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:05.837020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb84d61c-0d9e-417d-b5e9-ebeea5402eca tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:05.840255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb84d61c-0d9e-417d-b5e9-ebeea5402eca tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'f46636803c54485f8a0d956306f9b033'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:54:05.863949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb84d61c-0d9e-417d-b5e9-ebeea5402eca tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:05.865360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb84d61c-0d9e-417d-b5e9-ebeea5402eca tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:05.869210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb84d61c-0d9e-417d-b5e9-ebeea5402eca tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:05.869670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb84d61c-0d9e-417d-b5e9-ebeea5402eca tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:05.879461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=8 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:06.090630 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb84d61c-0d9e-417d-b5e9-ebeea5402eca tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.274612 Jul 28 03:54:06.091231 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2188/3919] 10.222.0.48 () {58 vars in 1184 bytes} [Thu Jul 28 03:54:05 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:54:06.111269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-94d791ba-dba6-4887-a115-32e76ee55873 req-1c0d4310-62b3-4946-982a-0d1985c829c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b960b866-f837-4e4a-8aab-be20f36f67fb", "tag": "1c00c82a-3d7c-4b3e-b531-d5739f820522"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:06.128444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-94d791ba-dba6-4887-a115-32e76ee55873 req-1c0d4310-62b3-4946-982a-0d1985c829c7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:06.128972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-94d791ba-dba6-4887-a115-32e76ee55873 req-1c0d4310-62b3-4946-982a-0d1985c829c7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:06.160446 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-94d791ba-dba6-4887-a115-32e76ee55873 req-1c0d4310-62b3-4946-982a-0d1985c829c7 service nova] Creating event network-changed:1c00c82a-3d7c-4b3e-b531-d5739f820522 for instance b960b866-f837-4e4a-8aab-be20f36f67fb on n-h1-826756-3 Jul 28 03:54:06.175851 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-94d791ba-dba6-4887-a115-32e76ee55873 req-1c0d4310-62b3-4946-982a-0d1985c829c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083298 Jul 28 03:54:06.180232 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2189/3920] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:06.197067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f21b819c-edf9-4499-b9d9-3b345604319b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:06.199080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f21b819c-edf9-4499-b9d9-3b345604319b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:06.217677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f21b819c-edf9-4499-b9d9-3b345604319b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:06.230683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f21b819c-edf9-4499-b9d9-3b345604319b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:06.231636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f21b819c-edf9-4499-b9d9-3b345604319b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:06.232086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f21b819c-edf9-4499-b9d9-3b345604319b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:06.422680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a64f306b-6f14-4794-babc-cb08ffe65266 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:06.441709 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a64f306b-6f14-4794-babc-cb08ffe65266 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1314 microversion: 2.1 time: 1.298393 Jul 28 03:54:06.451844 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1732/3921] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:05 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1314 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:06.461631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-26a761ab-268a-459e-9e7f-8735c0686478 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:06.477630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-26a761ab-268a-459e-9e7f-8735c0686478 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:06.485590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-26a761ab-268a-459e-9e7f-8735c0686478 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Searching by: {'deleted': False, 'project_id': 'f46636803c54485f8a0d956306f9b033'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:54:06.510513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26a761ab-268a-459e-9e7f-8735c0686478 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:06.511394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26a761ab-268a-459e-9e7f-8735c0686478 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:06.512474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26a761ab-268a-459e-9e7f-8735c0686478 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:06.513167 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26a761ab-268a-459e-9e7f-8735c0686478 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:06.598178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-26a761ab-268a-459e-9e7f-8735c0686478 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:54:06.696502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-26a761ab-268a-459e-9e7f-8735c0686478 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:06.715183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26a761ab-268a-459e-9e7f-8735c0686478 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:06.715820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26a761ab-268a-459e-9e7f-8735c0686478 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:06.748506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f21b819c-edf9-4499-b9d9-3b345604319b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:06.770417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f21b819c-edf9-4499-b9d9-3b345604319b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:06.772873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f21b819c-edf9-4499-b9d9-3b345604319b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:06.774087 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f21b819c-edf9-4499-b9d9-3b345604319b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1754 microversion: 2.20 time: 0.592139 Jul 28 03:54:06.781976 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2190/3922] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:06 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1754 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:06.790103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-57624888-abc0-46df-9875-5524db557b27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:06.804883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-57624888-abc0-46df-9875-5524db557b27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:06.823828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57624888-abc0-46df-9875-5524db557b27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:06.824609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57624888-abc0-46df-9875-5524db557b27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:06.825593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57624888-abc0-46df-9875-5524db557b27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:06.826195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57624888-abc0-46df-9875-5524db557b27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:07.410993 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-26a761ab-268a-459e-9e7f-8735c0686478 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.953250 Jul 28 03:54:07.412595 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1733/3923] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 03:54:06 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:07.417785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c6588273-1b2f-4d73-9250-5f1e15b61f97 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa74b453a0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:07.510149 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c6588273-1b2f-4d73-9250-5f1e15b61f97 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.096052 Jul 28 03:54:07.511560 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1734/3924] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:07 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:07.526773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f351a85d-0095-4b9a-975c-4defbd333f65 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:07.537545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f351a85d-0095-4b9a-975c-4defbd333f65 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:07.540208 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f351a85d-0095-4b9a-975c-4defbd333f65 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.026731 Jul 28 03:54:07.544902 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1735/3925] 10.222.0.48 () {58 vars in 1178 bytes} [Thu Jul 28 03:54:07 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:54:07.558273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-57624888-abc0-46df-9875-5524db557b27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:07.558934 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-70730073-a2ed-496e-b35e-7493267ddb86 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:07.559903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-70730073-a2ed-496e-b35e-7493267ddb86 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:07.570681 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-57624888-abc0-46df-9875-5524db557b27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1680 microversion: 2.1 time: 0.785482 Jul 28 03:54:07.573393 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2191/3926] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:06 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1680 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:07.576271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70730073-a2ed-496e-b35e-7493267ddb86 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:07.579394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70730073-a2ed-496e-b35e-7493267ddb86 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:07.585747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70730073-a2ed-496e-b35e-7493267ddb86 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:07.586535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70730073-a2ed-496e-b35e-7493267ddb86 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:07.591011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d43c6923-9267-4a3d-9907-c05338d3bcda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:07.599075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d43c6923-9267-4a3d-9907-c05338d3bcda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:07.599921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d43c6923-9267-4a3d-9907-c05338d3bcda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Searching by: {'deleted': False, 'project_id': 'f46636803c54485f8a0d956306f9b033'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 03:54:07.618317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d43c6923-9267-4a3d-9907-c05338d3bcda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:07.619085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d43c6923-9267-4a3d-9907-c05338d3bcda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:07.622459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d43c6923-9267-4a3d-9907-c05338d3bcda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:07.629774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d43c6923-9267-4a3d-9907-c05338d3bcda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:07.712544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-d43c6923-9267-4a3d-9907-c05338d3bcda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 03:54:07.822919 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d43c6923-9267-4a3d-9907-c05338d3bcda tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.243476 Jul 28 03:54:07.835437 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2192/3927] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 03:54:07 2022] GET /compute/v2.1/servers => generated 683 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:07.850091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-64a28e53-7be2-4bc4-b135-a72daed6efff tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:07.855870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-64a28e53-7be2-4bc4-b135-a72daed6efff tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:07.870391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64a28e53-7be2-4bc4-b135-a72daed6efff tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:07.874103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64a28e53-7be2-4bc4-b135-a72daed6efff tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:07.875221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64a28e53-7be2-4bc4-b135-a72daed6efff tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:07.878395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64a28e53-7be2-4bc4-b135-a72daed6efff tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:08.246839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-70730073-a2ed-496e-b35e-7493267ddb86 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:08.292079 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-70730073-a2ed-496e-b35e-7493267ddb86 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1314 microversion: 2.1 time: 0.745023 Jul 28 03:54:08.327063 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1736/3928] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:07 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1314 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:08.364660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-262c1964-37f2-4d50-b034-50e282ffb058 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:08.371528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-262c1964-37f2-4d50-b034-50e282ffb058 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 057d7888-f34a-422c-853e-31e349089c1c] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:08.395257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-262c1964-37f2-4d50-b034-50e282ffb058 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:08.397468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-262c1964-37f2-4d50-b034-50e282ffb058 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:08.399281 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-262c1964-37f2-4d50-b034-50e282ffb058 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:08.400034 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-262c1964-37f2-4d50-b034-50e282ffb058 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:08.495665 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-262c1964-37f2-4d50-b034-50e282ffb058 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] HTTP exception thrown: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-262c1964-37f2-4d50-b034-50e282ffb058 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Request method failure captured: Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c HTTP/1.1 Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4ggkaYbXSI5r-ln4lNB2zTdFukrJD1-LMeG_N8QQd6xJYDl0W74RpePstn1MpyujU7z58memlGS4ifE7_dNe4k_xlcgICj441seWrpP9g845z1mH7qvmJzejVivLKurqX1PFEYeuaRWOfrt9kYqxFOx7OOKxRMvY22jLFb_kBQ6-Syg Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f46636803c54485f8a0d956306f9b033"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f46636803c54485f8a0d956306f9b033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}] Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 4854da16472a4dbca31edde269c13bd5 Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '057d7888-f34a-422c-853e-31e349089c1c'} Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:08.505331 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:08.511473 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:08.511473 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:08.511473 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:08.511473 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:08.511473 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:08.511473 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:08.511473 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:08.511473 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:08.511473 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:08.511473 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:08.511473 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:08.515578 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-262c1964-37f2-4d50-b034-50e282ffb058 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Returning 404 to user: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:08.516928 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-262c1964-37f2-4d50-b034-50e282ffb058 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "DELETE /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c" status: 404 len: 111 microversion: 2.1 time: 0.186405 Jul 28 03:54:08.522671 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1737/3929] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:54:08 2022] DELETE /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:08.529385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2ef7086e-fadd-4a85-b367-b4e0f1fdef42 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa74269310>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:08.625147 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2ef7086e-fadd-4a85-b367-b4e0f1fdef42 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.099966 Jul 28 03:54:08.659372 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1738/3930] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:08 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:08.685796 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b902fa1e-f1b3-44fc-bcfe-5e776eda4aec tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:08.688258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b902fa1e-f1b3-44fc-bcfe-5e776eda4aec tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 6518bd32-8cbe-4ef4-8813-1923f796b586] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:08.714124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b902fa1e-f1b3-44fc-bcfe-5e776eda4aec tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:08.714913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b902fa1e-f1b3-44fc-bcfe-5e776eda4aec tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:08.717175 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b902fa1e-f1b3-44fc-bcfe-5e776eda4aec tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:08.717832 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b902fa1e-f1b3-44fc-bcfe-5e776eda4aec tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:08.768935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b902fa1e-f1b3-44fc-bcfe-5e776eda4aec tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 6518bd32-8cbe-4ef4-8813-1923f796b586] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:54:08.938148 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b902fa1e-f1b3-44fc-bcfe-5e776eda4aec tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586" status: 204 len: 0 microversion: 2.1 time: 0.270851 Jul 28 03:54:08.945568 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1739/3931] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:54:08 2022] DELETE /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:54:08.955541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-70d3e074-e8ac-4922-aed9-405f27803420 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:08.956403 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-70d3e074-e8ac-4922-aed9-405f27803420 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:08.976922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70d3e074-e8ac-4922-aed9-405f27803420 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:08.978287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70d3e074-e8ac-4922-aed9-405f27803420 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:08.978287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70d3e074-e8ac-4922-aed9-405f27803420 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:08.979131 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-70d3e074-e8ac-4922-aed9-405f27803420 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:09.146289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-70d3e074-e8ac-4922-aed9-405f27803420 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:09.161350 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-70d3e074-e8ac-4922-aed9-405f27803420 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1612 microversion: 2.1 time: 0.212693 Jul 28 03:54:09.205762 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1740/3932] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:08 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1612 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:09.229165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1f7928b7-4ff5-44ae-a4f6-48ee7264a5eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:09.237778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1f7928b7-4ff5-44ae-a4f6-48ee7264a5eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:09.259491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f7928b7-4ff5-44ae-a4f6-48ee7264a5eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:09.260836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f7928b7-4ff5-44ae-a4f6-48ee7264a5eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:09.263781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f7928b7-4ff5-44ae-a4f6-48ee7264a5eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:09.264304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f7928b7-4ff5-44ae-a4f6-48ee7264a5eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:09.357479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1f7928b7-4ff5-44ae-a4f6-48ee7264a5eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:54:09.629497 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:09.643164 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1f7928b7-4ff5-44ae-a4f6-48ee7264a5eb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 204 len: 0 microversion: 2.1 time: 0.432533 Jul 28 03:54:09.650544 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1741/3933] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:54:09 2022] DELETE /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:54:09.665397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3aa77cd7-2fd5-4cca-adc1-c374c0776c4c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:09.666418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3aa77cd7-2fd5-4cca-adc1-c374c0776c4c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:09.676778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3aa77cd7-2fd5-4cca-adc1-c374c0776c4c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:09.677629 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3aa77cd7-2fd5-4cca-adc1-c374c0776c4c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:09.679092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3aa77cd7-2fd5-4cca-adc1-c374c0776c4c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:09.679393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3aa77cd7-2fd5-4cca-adc1-c374c0776c4c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:09.774310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-64a28e53-7be2-4bc4-b135-a72daed6efff tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:09.793465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-64a28e53-7be2-4bc4-b135-a72daed6efff tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:09.798513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-64a28e53-7be2-4bc4-b135-a72daed6efff tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:09.803860 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-64a28e53-7be2-4bc4-b135-a72daed6efff tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1754 microversion: 2.20 time: 1.963602 Jul 28 03:54:09.809197 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2193/3934] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:07 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1754 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:09.826406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a0a56d81-365b-4167-914a-112c9a44ba74 req-06ed0def-d33e-4c86-b534-bdc4e1697c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5aac5b7-2161-4673-ba81-5a05fd98352f", "name": "network-vif-deleted", "tag": "f7ad17ec-309b-462d-af2d-0f006c3127e1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:09.863840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a0a56d81-365b-4167-914a-112c9a44ba74 req-06ed0def-d33e-4c86-b534-bdc4e1697c3a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:09.870032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a0a56d81-365b-4167-914a-112c9a44ba74 req-06ed0def-d33e-4c86-b534-bdc4e1697c3a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:09.904130 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a0a56d81-365b-4167-914a-112c9a44ba74 req-06ed0def-d33e-4c86-b534-bdc4e1697c3a service nova] Creating event network-vif-deleted:f7ad17ec-309b-462d-af2d-0f006c3127e1 for instance b5aac5b7-2161-4673-ba81-5a05fd98352f on n-h1-826756-3 Jul 28 03:54:09.920574 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a0a56d81-365b-4167-914a-112c9a44ba74 req-06ed0def-d33e-4c86-b534-bdc4e1697c3a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107793 Jul 28 03:54:09.927373 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2194/3935] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:09.943673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c1d61e76-b013-42f9-805c-dae58a155f2a tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa67751700>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:10.076184 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c1d61e76-b013-42f9-805c-dae58a155f2a tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.147252 Jul 28 03:54:10.084942 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2195/3936] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:09 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:10.098719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2414861c-59fe-4efb-aba5-aca58dba58dd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:10.109522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2414861c-59fe-4efb-aba5-aca58dba58dd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 057d7888-f34a-422c-853e-31e349089c1c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:10.123044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2414861c-59fe-4efb-aba5-aca58dba58dd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:10.129380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2414861c-59fe-4efb-aba5-aca58dba58dd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:10.133619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2414861c-59fe-4efb-aba5-aca58dba58dd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:10.135630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2414861c-59fe-4efb-aba5-aca58dba58dd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:10.180408 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3aa77cd7-2fd5-4cca-adc1-c374c0776c4c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:10.186546 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-2414861c-59fe-4efb-aba5-aca58dba58dd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] HTTP exception thrown: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2414861c-59fe-4efb-aba5-aca58dba58dd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Request method failure captured: Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c HTTP/1.1 Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ggkaYbXSI5r-ln4lNB2zTdFukrJD1-LMeG_N8QQd6xJYDl0W74RpePstn1MpyujU7z58memlGS4ifE7_dNe4k_xlcgICj441seWrpP9g845z1mH7qvmJzejVivLKurqX1PFEYeuaRWOfrt9kYqxFOx7OOKxRMvY22jLFb_kBQ6-Syg Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f46636803c54485f8a0d956306f9b033"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f46636803c54485f8a0d956306f9b033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}] Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 4854da16472a4dbca31edde269c13bd5 Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '057d7888-f34a-422c-853e-31e349089c1c'} Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:10.192938 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:10.211260 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:10.211260 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:10.211260 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:10.211260 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:10.211260 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:10.211260 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. Jul 28 03:54:10.211260 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:10.211260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2414861c-59fe-4efb-aba5-aca58dba58dd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Returning 404 to user: Instance 057d7888-f34a-422c-853e-31e349089c1c could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:10.211260 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2414861c-59fe-4efb-aba5-aca58dba58dd tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c" status: 404 len: 111 microversion: 2.1 time: 0.111298 Jul 28 03:54:10.211911 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3aa77cd7-2fd5-4cca-adc1-c374c0776c4c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1314 microversion: 2.1 time: 0.542352 Jul 28 03:54:10.211911 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1742/3937] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:09 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:10.211911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c3acf8ab-f06b-41f9-8923-75b97fd44bc2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:10.211911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c3acf8ab-f06b-41f9-8923-75b97fd44bc2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:10.217231 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2196/3938] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:10 2022] GET /compute/v2.1/servers/057d7888-f34a-422c-853e-31e349089c1c => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:10.231150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9765773a-79f1-48e5-9f9d-1da2ea70ba54 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:10.232672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3acf8ab-f06b-41f9-8923-75b97fd44bc2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:10.236785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3acf8ab-f06b-41f9-8923-75b97fd44bc2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:10.237960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9765773a-79f1-48e5-9f9d-1da2ea70ba54 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 6518bd32-8cbe-4ef4-8813-1923f796b586] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:10.239513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3acf8ab-f06b-41f9-8923-75b97fd44bc2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:10.243162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3acf8ab-f06b-41f9-8923-75b97fd44bc2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:10.266691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9765773a-79f1-48e5-9f9d-1da2ea70ba54 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:10.273354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9765773a-79f1-48e5-9f9d-1da2ea70ba54 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:10.274468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9765773a-79f1-48e5-9f9d-1da2ea70ba54 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:10.275438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9765773a-79f1-48e5-9f9d-1da2ea70ba54 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:10.469350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c3acf8ab-f06b-41f9-8923-75b97fd44bc2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:10.484483 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c3acf8ab-f06b-41f9-8923-75b97fd44bc2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 200 len: 1612 microversion: 2.1 time: 0.280134 Jul 28 03:54:10.485545 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1743/3939] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:10 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 1612 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:10.839664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-46e3b017-eda7-4ec1-aee6-e0105bfe85d8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:10.840405 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-46e3b017-eda7-4ec1-aee6-e0105bfe85d8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:10.882111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46e3b017-eda7-4ec1-aee6-e0105bfe85d8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:10.885958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46e3b017-eda7-4ec1-aee6-e0105bfe85d8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:10.889776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46e3b017-eda7-4ec1-aee6-e0105bfe85d8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:10.892716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-46e3b017-eda7-4ec1-aee6-e0105bfe85d8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:11.846823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9765773a-79f1-48e5-9f9d-1da2ea70ba54 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:11.858777 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9765773a-79f1-48e5-9f9d-1da2ea70ba54 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586" status: 200 len: 1522 microversion: 2.1 time: 1.634528 Jul 28 03:54:11.872428 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2197/3940] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:10 2022] GET /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586 => generated 1522 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:11.880881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-11365f14-ce52-4660-bd97-82c3f3f4f9dd tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa67914ca0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:11.976487 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-11365f14-ce52-4660-bd97-82c3f3f4f9dd tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.109160 Jul 28 03:54:11.978722 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2198/3941] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:11 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:11.996839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f57b103-0f9e-4c8d-82ad-fab7f2a54862 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:12.000239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-46e3b017-eda7-4ec1-aee6-e0105bfe85d8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:12.005913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6f57b103-0f9e-4c8d-82ad-fab7f2a54862 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:12.007533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:12.028465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-46e3b017-eda7-4ec1-aee6-e0105bfe85d8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:12.030150 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-46e3b017-eda7-4ec1-aee6-e0105bfe85d8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:12.040708 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-46e3b017-eda7-4ec1-aee6-e0105bfe85d8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1754 microversion: 2.20 time: 1.203076 Jul 28 03:54:12.041967 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1744/3942] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:10 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1754 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:12.049794 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4f0b26cc-4721-4c2e-b4c9-b6c334e29b14 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:12.065192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4f0b26cc-4721-4c2e-b4c9-b6c334e29b14 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:12.070933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f57b103-0f9e-4c8d-82ad-fab7f2a54862 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:12.075748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f57b103-0f9e-4c8d-82ad-fab7f2a54862 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:12.078686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f0b26cc-4721-4c2e-b4c9-b6c334e29b14 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:12.080986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f57b103-0f9e-4c8d-82ad-fab7f2a54862 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:12.085128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f0b26cc-4721-4c2e-b4c9-b6c334e29b14 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:12.086220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f0b26cc-4721-4c2e-b4c9-b6c334e29b14 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:12.086833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f0b26cc-4721-4c2e-b4c9-b6c334e29b14 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:12.098543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f57b103-0f9e-4c8d-82ad-fab7f2a54862 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:12.135293 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-4f0b26cc-4721-4c2e-b4c9-b6c334e29b14 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] HTTP exception thrown: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4f0b26cc-4721-4c2e-b4c9-b6c334e29b14 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Request method failure captured: Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f HTTP/1.1 Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gca3wwj6vf3mcE1k3p04a-IB_aHJ4q2aQgyaMGEamuHOXYtT8sTCQ39msigigoKDkTgI0q27esncQkdsISfIdor8uYi2ofpy2xxPUYcBX6T1jxeXp0Wz1yCRt_oOue5jQOpZsPCIWzJpvRA8Ld9LSF337wCVS7VtPTruWEjBErR8iQ Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 781ab005138547038def64d108937e3e Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781ab005138547038def64d108937e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781ab005138547038def64d108937e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}] Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 781ab005138547038def64d108937e3e Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: d20381abd9784627887af3cb97cd68a8 Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'b5aac5b7-2161-4673-ba81-5a05fd98352f'} Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:12.138466 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:12.143739 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:12.143739 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:12.143739 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:12.143739 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:12.143739 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:12.143739 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:54:12.143739 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:12.147790 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4f0b26cc-4721-4c2e-b4c9-b6c334e29b14 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Returning 404 to user: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:12.153165 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4f0b26cc-4721-4c2e-b4c9-b6c334e29b14 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 404 len: 111 microversion: 2.1 time: 0.109971 Jul 28 03:54:12.155463 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1745/3943] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:12 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:12.171795 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d574cbee-4f55-4b08-a3dc-73201c0c2685 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '.version_select at 0x7ffa742df8b0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:12.239197 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d574cbee-4f55-4b08-a3dc-73201c0c2685 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-631985019" status: 202 len: 0 microversion: 2.1 time: 0.074338 Jul 28 03:54:12.243971 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1746/3944] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 03:54:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-631985019 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:54:12.888208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-69550a6b-d926-413a-b6a0-eb9757f5d347 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:12.889565 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-69550a6b-d926-413a-b6a0-eb9757f5d347 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 6518bd32-8cbe-4ef4-8813-1923f796b586] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:12.912952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-69550a6b-d926-413a-b6a0-eb9757f5d347 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:12.919287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-69550a6b-d926-413a-b6a0-eb9757f5d347 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:12.921695 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-69550a6b-d926-413a-b6a0-eb9757f5d347 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:12.928783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-69550a6b-d926-413a-b6a0-eb9757f5d347 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:13.402582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6f57b103-0f9e-4c8d-82ad-fab7f2a54862 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:13.411347 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6f57b103-0f9e-4c8d-82ad-fab7f2a54862 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1314 microversion: 2.1 time: 1.431436 Jul 28 03:54:13.416384 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2199/3945] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:11 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1314 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:13.435396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cafcd6bf-e25b-441f-a3f4-f4f48c899220 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa67761e50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:13.509337 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cafcd6bf-e25b-441f-a3f4-f4f48c899220 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.089232 Jul 28 03:54:13.510673 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2200/3946] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:13 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:13.529735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-087591d7-d956-424c-8f81-97efb6f91629 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:13.531037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-087591d7-d956-424c-8f81-97efb6f91629 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:13.554531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-087591d7-d956-424c-8f81-97efb6f91629 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:13.555000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-087591d7-d956-424c-8f81-97efb6f91629 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:13.555795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-087591d7-d956-424c-8f81-97efb6f91629 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:13.556236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-087591d7-d956-424c-8f81-97efb6f91629 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:14.076098 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-69550a6b-d926-413a-b6a0-eb9757f5d347 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:14.087250 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-69550a6b-d926-413a-b6a0-eb9757f5d347 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586" status: 200 len: 1522 microversion: 2.1 time: 1.203505 Jul 28 03:54:14.088545 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1747/3947] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:12 2022] GET /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586 => generated 1522 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:14.437702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7c9f987e-5997-4905-97bc-1b1508c0995f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:14.443324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7c9f987e-5997-4905-97bc-1b1508c0995f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:14.454950 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c9f987e-5997-4905-97bc-1b1508c0995f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:14.461573 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c9f987e-5997-4905-97bc-1b1508c0995f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:14.465976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c9f987e-5997-4905-97bc-1b1508c0995f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:14.473192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c9f987e-5997-4905-97bc-1b1508c0995f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:14.605938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-087591d7-d956-424c-8f81-97efb6f91629 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:14.616955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-087591d7-d956-424c-8f81-97efb6f91629 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:14.618468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-087591d7-d956-424c-8f81-97efb6f91629 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:14.619722 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-087591d7-d956-424c-8f81-97efb6f91629 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 1.107958 Jul 28 03:54:14.620231 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2201/3948] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:13 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:14.683535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d0cce8c-9d6e-4e06-a840-b0e3f45c7186 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa6789d0d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:14.810648 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d0cce8c-9d6e-4e06-a840-b0e3f45c7186 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.139167 Jul 28 03:54:14.811629 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2202/3949] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:14 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:15.116681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-631daeca-0752-4752-988c-2177b767d99f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:15.117504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-631daeca-0752-4752-988c-2177b767d99f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 6518bd32-8cbe-4ef4-8813-1923f796b586] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:15.140723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-631daeca-0752-4752-988c-2177b767d99f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:15.140868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-631daeca-0752-4752-988c-2177b767d99f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:15.141665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-631daeca-0752-4752-988c-2177b767d99f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:15.142101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-631daeca-0752-4752-988c-2177b767d99f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:16.366026 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7c9f987e-5997-4905-97bc-1b1508c0995f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:16.375316 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7c9f987e-5997-4905-97bc-1b1508c0995f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1314 microversion: 2.1 time: 1.941561 Jul 28 03:54:16.381984 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1748/3950] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:14 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1314 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:16.401225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6bcc934c-9cc5-40c8-8f7c-8dc68b1dce26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:16.406257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6bcc934c-9cc5-40c8-8f7c-8dc68b1dce26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:16.425428 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6bcc934c-9cc5-40c8-8f7c-8dc68b1dce26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:16.426060 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6bcc934c-9cc5-40c8-8f7c-8dc68b1dce26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:16.426980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6bcc934c-9cc5-40c8-8f7c-8dc68b1dce26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:16.427514 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6bcc934c-9cc5-40c8-8f7c-8dc68b1dce26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:16.527439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:16.565346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-631daeca-0752-4752-988c-2177b767d99f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:16.577878 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-631daeca-0752-4752-988c-2177b767d99f tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586" status: 200 len: 1522 microversion: 2.1 time: 1.467904 Jul 28 03:54:16.582439 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2203/3951] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:15 2022] GET /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586 => generated 1522 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:16.589241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-24c046d7-e24f-427c-8246-2bd4fda74784 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa67751670>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:16.665068 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-24c046d7-e24f-427c-8246-2bd4fda74784 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.081440 Jul 28 03:54:16.670027 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2204/3952] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:16 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:16.680765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:17.325601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-8a75179c-320b-42ee-8d83-3350148bf51a req-79325ea3-ea5f-464c-a018-5415fe39b333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b960b866-f837-4e4a-8aab-be20f36f67fb", "name": "network-vif-plugged", "status": "completed", "tag": "1c00c82a-3d7c-4b3e-b531-d5739f820522"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:17.342500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8a75179c-320b-42ee-8d83-3350148bf51a req-79325ea3-ea5f-464c-a018-5415fe39b333 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:17.353478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8a75179c-320b-42ee-8d83-3350148bf51a req-79325ea3-ea5f-464c-a018-5415fe39b333 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:17.399032 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-8a75179c-320b-42ee-8d83-3350148bf51a req-79325ea3-ea5f-464c-a018-5415fe39b333 service nova] Creating event network-vif-plugged:1c00c82a-3d7c-4b3e-b531-d5739f820522 for instance b960b866-f837-4e4a-8aab-be20f36f67fb on n-h1-826756-3 Jul 28 03:54:17.404736 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-8a75179c-320b-42ee-8d83-3350148bf51a req-79325ea3-ea5f-464c-a018-5415fe39b333 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085048 Jul 28 03:54:17.406205 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2205/3953] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:54:17.411931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-88a7c578-050d-47c8-8306-61338dbaad51 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:17.423090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-88a7c578-050d-47c8-8306-61338dbaad51 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:17.454718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88a7c578-050d-47c8-8306-61338dbaad51 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:17.455679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88a7c578-050d-47c8-8306-61338dbaad51 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:17.456698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88a7c578-050d-47c8-8306-61338dbaad51 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:17.457149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88a7c578-050d-47c8-8306-61338dbaad51 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:17.664923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=10 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:18.073383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-88a7c578-050d-47c8-8306-61338dbaad51 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:18.083364 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-88a7c578-050d-47c8-8306-61338dbaad51 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1314 microversion: 2.1 time: 0.675479 Jul 28 03:54:18.083990 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2206/3954] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:17 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1314 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:18.118242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c85c4be-723f-42e1-82f5-a8858565c0b4 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:18.132729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c85c4be-723f-42e1-82f5-a8858565c0b4 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 6518bd32-8cbe-4ef4-8813-1923f796b586] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:18.153771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c85c4be-723f-42e1-82f5-a8858565c0b4 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:18.164188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c85c4be-723f-42e1-82f5-a8858565c0b4 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:18.167230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c85c4be-723f-42e1-82f5-a8858565c0b4 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:18.170214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c85c4be-723f-42e1-82f5-a8858565c0b4 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:18.309860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6bcc934c-9cc5-40c8-8f7c-8dc68b1dce26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:18.324798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6bcc934c-9cc5-40c8-8f7c-8dc68b1dce26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:18.330705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6bcc934c-9cc5-40c8-8f7c-8dc68b1dce26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:18.333466 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6bcc934c-9cc5-40c8-8f7c-8dc68b1dce26 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 1.947717 Jul 28 03:54:18.335211 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1749/3955] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:16 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:18.340692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a85489e6-75f9-4375-a6fa-66f965032e09 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa749cec10>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:18.461345 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a85489e6-75f9-4375-a6fa-66f965032e09 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.122429 Jul 28 03:54:18.462090 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1750/3956] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:18 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:18.479028 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-3ad916b8-e3a1-4286-ad94-c30b2be0d3ee req-c7ff2ef5-21ae-4304-8055-e27bebe78c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6518bd32-8cbe-4ef4-8813-1923f796b586", "name": "network-vif-deleted", "tag": "7b27a036-9343-483f-ab94-976b6b861c67"}, {"server_uuid": "b176a775-44c8-4373-8e8e-62d58afd3072", "name": "network-vif-deleted", "tag": "f63d6385-37de-4e04-a4fa-5dc00f6f6f0e"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:18.514945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3ad916b8-e3a1-4286-ad94-c30b2be0d3ee req-c7ff2ef5-21ae-4304-8055-e27bebe78c02 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:18.515848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3ad916b8-e3a1-4286-ad94-c30b2be0d3ee req-c7ff2ef5-21ae-4304-8055-e27bebe78c02 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:18.540986 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-3ad916b8-e3a1-4286-ad94-c30b2be0d3ee req-c7ff2ef5-21ae-4304-8055-e27bebe78c02 service nova] Creating event network-vif-deleted:7b27a036-9343-483f-ab94-976b6b861c67 for instance 6518bd32-8cbe-4ef4-8813-1923f796b586 on n-h1-826756-3 Jul 28 03:54:18.546354 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-3ad916b8-e3a1-4286-ad94-c30b2be0d3ee req-c7ff2ef5-21ae-4304-8055-e27bebe78c02 service nova] Creating event network-vif-deleted:f63d6385-37de-4e04-a4fa-5dc00f6f6f0e for instance b176a775-44c8-4373-8e8e-62d58afd3072 on n-h2-826756-3 Jul 28 03:54:18.571833 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-3ad916b8-e3a1-4286-ad94-c30b2be0d3ee req-c7ff2ef5-21ae-4304-8055-e27bebe78c02 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.106385 Jul 28 03:54:18.580471 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1751/3957] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:18.590345 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8f6a781d-b49d-4b45-b8ec-157e2d205d25 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Action: 'create', calling method: .version_select at 0x7ffa749cee50>, body: {"keypair": {"name": "tempest-keypair-2105898308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGc+fqyticcUl7+m1xadFG1KLqxCqtMnCnVXZKVvjYJZ2T1/fHmHlUMNorJvmALbHTK5iqCkNY3Cfb75aoJ4a2bOqk+pAPp6FWE8Qyv1v3kwgAaNbDOSjLcbzO9UookG/A=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:18.635055 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-8f6a781d-b49d-4b45-b8ec-157e2d205d25 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for project 781ab005138547038def64d108937e3e. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:54:18.655581 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-8f6a781d-b49d-4b45-b8ec-157e2d205d25 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for user d20381abd9784627887af3cb97cd68a8 and project 781ab005138547038def64d108937e3e. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:54:18.695899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7c85c4be-723f-42e1-82f5-a8858565c0b4 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4854da16472a4dbca31edde269c13bd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46636803c54485f8a0d956306f9b033', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:18.716433 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7c85c4be-723f-42e1-82f5-a8858565c0b4 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586" status: 200 len: 1308 microversion: 2.1 time: 0.631128 Jul 28 03:54:18.718826 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2207/3958] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:18 2022] GET /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586 => generated 1308 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:18.757470 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8f6a781d-b49d-4b45-b8ec-157e2d205d25 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.173131 Jul 28 03:54:18.759660 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1752/3959] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:54:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:19.110587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cab20d98-789c-4c7f-9f71-f5d0af6e0f77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:19.111672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cab20d98-789c-4c7f-9f71-f5d0af6e0f77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:19.128553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cab20d98-789c-4c7f-9f71-f5d0af6e0f77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:19.132088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cab20d98-789c-4c7f-9f71-f5d0af6e0f77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:19.133110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cab20d98-789c-4c7f-9f71-f5d0af6e0f77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:19.133676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cab20d98-789c-4c7f-9f71-f5d0af6e0f77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:19.367948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1fa1ef59-d21c-4b8c-bf60-1bf50e2387a4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:19.370216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1fa1ef59-d21c-4b8c-bf60-1bf50e2387a4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:19.403658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1fa1ef59-d21c-4b8c-bf60-1bf50e2387a4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:19.404771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1fa1ef59-d21c-4b8c-bf60-1bf50e2387a4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:19.405449 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1fa1ef59-d21c-4b8c-bf60-1bf50e2387a4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:19.406097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1fa1ef59-d21c-4b8c-bf60-1bf50e2387a4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:19.897214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cab20d98-789c-4c7f-9f71-f5d0af6e0f77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:19.916638 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cab20d98-789c-4c7f-9f71-f5d0af6e0f77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1314 microversion: 2.1 time: 0.810063 Jul 28 03:54:19.917577 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2208/3960] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:19 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:19.935362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f04f801-2414-4bcc-aa73-45e103eb42e2 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa67751670>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:20.045673 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2f04f801-2414-4bcc-aa73-45e103eb42e2 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.126239 Jul 28 03:54:20.046957 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2209/3961] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:19 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:20.058912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-014de664-4eb9-4fe3-b20d-3b3bcf3939cb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:20.060013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-014de664-4eb9-4fe3-b20d-3b3bcf3939cb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: 6518bd32-8cbe-4ef4-8813-1923f796b586] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:20.089126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-014de664-4eb9-4fe3-b20d-3b3bcf3939cb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:20.091143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-014de664-4eb9-4fe3-b20d-3b3bcf3939cb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:20.093945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-014de664-4eb9-4fe3-b20d-3b3bcf3939cb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:20.095845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-014de664-4eb9-4fe3-b20d-3b3bcf3939cb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:20.124213 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-014de664-4eb9-4fe3-b20d-3b3bcf3939cb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] HTTP exception thrown: Instance 6518bd32-8cbe-4ef4-8813-1923f796b586 could not be found. Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-014de664-4eb9-4fe3-b20d-3b3bcf3939cb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Request method failure captured: Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586 HTTP/1.1 Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ggkaYbXSI5r-ln4lNB2zTdFukrJD1-LMeG_N8QQd6xJYDl0W74RpePstn1MpyujU7z58memlGS4ifE7_dNe4k_xlcgICj441seWrpP9g845z1mH7qvmJzejVivLKurqX1PFEYeuaRWOfrt9kYqxFOx7OOKxRMvY22jLFb_kBQ6-Syg Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f46636803c54485f8a0d956306f9b033"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f46636803c54485f8a0d956306f9b033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}] Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 4854da16472a4dbca31edde269c13bd5 Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 6518bd32-8cbe-4ef4-8813-1923f796b586 could not be found. Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '6518bd32-8cbe-4ef4-8813-1923f796b586'} Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6518bd32-8cbe-4ef4-8813-1923f796b586 could not be found. Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6518bd32-8cbe-4ef4-8813-1923f796b586 could not be found. Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:20.126583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:20.131748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:20.131748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:20.131748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:20.131748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:20.131748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:20.131748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6518bd32-8cbe-4ef4-8813-1923f796b586 could not be found. Jul 28 03:54:20.131748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:20.134644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-014de664-4eb9-4fe3-b20d-3b3bcf3939cb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Returning 404 to user: Instance 6518bd32-8cbe-4ef4-8813-1923f796b586 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:20.135772 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-014de664-4eb9-4fe3-b20d-3b3bcf3939cb tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586" status: 404 len: 111 microversion: 2.1 time: 0.087642 Jul 28 03:54:20.137078 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2210/3962] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:20 2022] GET /compute/v2.1/servers/6518bd32-8cbe-4ef4-8813-1923f796b586 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:20.155874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e46da230-8642-49c9-b434-6874c6a25f03 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:20.157162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e46da230-8642-49c9-b434-6874c6a25f03 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] [instance: b176a775-44c8-4373-8e8e-62d58afd3072] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:20.165521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e46da230-8642-49c9-b434-6874c6a25f03 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:20.166441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e46da230-8642-49c9-b434-6874c6a25f03 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:20.167631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e46da230-8642-49c9-b434-6874c6a25f03 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:20.168332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e46da230-8642-49c9-b434-6874c6a25f03 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:20.199032 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e46da230-8642-49c9-b434-6874c6a25f03 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] HTTP exception thrown: Instance b176a775-44c8-4373-8e8e-62d58afd3072 could not be found. Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e46da230-8642-49c9-b434-6874c6a25f03 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Request method failure captured: Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 HTTP/1.1 Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ggkaYbXSI5r-ln4lNB2zTdFukrJD1-LMeG_N8QQd6xJYDl0W74RpePstn1MpyujU7z58memlGS4ifE7_dNe4k_xlcgICj441seWrpP9g845z1mH7qvmJzejVivLKurqX1PFEYeuaRWOfrt9kYqxFOx7OOKxRMvY22jLFb_kBQ6-Syg Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f46636803c54485f8a0d956306f9b033"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f46636803c54485f8a0d956306f9b033"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f46636803c54485f8a0d956306f9b033"}]}] Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f46636803c54485f8a0d956306f9b033 Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1466415749 Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 4854da16472a4dbca31edde269c13bd5 Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ListServersNegativeTestJSON-1466415749-project Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance b176a775-44c8-4373-8e8e-62d58afd3072 could not be found. Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'b176a775-44c8-4373-8e8e-62d58afd3072'} Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b176a775-44c8-4373-8e8e-62d58afd3072 could not be found. Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b176a775-44c8-4373-8e8e-62d58afd3072 could not be found. Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:20.201114 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:20.206424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:20.206424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:20.206424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:20.206424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:20.206424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:20.206424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b176a775-44c8-4373-8e8e-62d58afd3072 could not be found. Jul 28 03:54:20.206424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:20.208765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e46da230-8642-49c9-b434-6874c6a25f03 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] Returning 404 to user: Instance b176a775-44c8-4373-8e8e-62d58afd3072 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:20.209982 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e46da230-8642-49c9-b434-6874c6a25f03 tempest-ListServersNegativeTestJSON-1466415749 tempest-ListServersNegativeTestJSON-1466415749-project] 10.222.0.48 "GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072" status: 404 len: 111 microversion: 2.1 time: 0.061665 Jul 28 03:54:20.211215 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2211/3963] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:20 2022] GET /compute/v2.1/servers/b176a775-44c8-4373-8e8e-62d58afd3072 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:20.285730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1fa1ef59-d21c-4b8c-bf60-1bf50e2387a4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:20.305378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1fa1ef59-d21c-4b8c-bf60-1bf50e2387a4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:20.308096 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1fa1ef59-d21c-4b8c-bf60-1bf50e2387a4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:20.315204 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1fa1ef59-d21c-4b8c-bf60-1bf50e2387a4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 0.950448 Jul 28 03:54:20.316198 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1753/3964] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:19 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:54:20.621253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-8f7c9714-71df-4db8-a2a8-6c55b4c57516 req-7619b17e-815f-4c18-93e7-fc5f6aa6582a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d0126e-11bf-4048-9e35-7309c228b534", "tag": "f15c48dd-54c1-4291-88c3-ac0923fa48e7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:20.640634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:20.643016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8f7c9714-71df-4db8-a2a8-6c55b4c57516 req-7619b17e-815f-4c18-93e7-fc5f6aa6582a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:20.643848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8f7c9714-71df-4db8-a2a8-6c55b4c57516 req-7619b17e-815f-4c18-93e7-fc5f6aa6582a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:20.674420 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-8f7c9714-71df-4db8-a2a8-6c55b4c57516 req-7619b17e-815f-4c18-93e7-fc5f6aa6582a service nova] Creating event network-changed:f15c48dd-54c1-4291-88c3-ac0923fa48e7 for instance 99d0126e-11bf-4048-9e35-7309c228b534 on n-h1-826756-3 Jul 28 03:54:20.695666 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-8f7c9714-71df-4db8-a2a8-6c55b4c57516 req-7619b17e-815f-4c18-93e7-fc5f6aa6582a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077406 Jul 28 03:54:20.698371 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2212/3965] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:20.939729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-845a3159-274a-4188-9520-c6213505e2e0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:20.941263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-845a3159-274a-4188-9520-c6213505e2e0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:20.973211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-845a3159-274a-4188-9520-c6213505e2e0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:20.974159 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-845a3159-274a-4188-9520-c6213505e2e0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:20.976212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-845a3159-274a-4188-9520-c6213505e2e0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:20.980606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-845a3159-274a-4188-9520-c6213505e2e0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:21.064745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf9f3f7b-b52a-4c92-a5ea-964232619257 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa677519d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:21.230802 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf9f3f7b-b52a-4c92-a5ea-964232619257 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1424 microversion: 2.1 time: 0.172298 Jul 28 03:54:21.232860 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2213/3966] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:21 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1424 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:21.342602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d5a39b82-6047-40ae-9370-a53df473cbf9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:21.344312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d5a39b82-6047-40ae-9370-a53df473cbf9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:21.368622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5a39b82-6047-40ae-9370-a53df473cbf9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:21.368622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5a39b82-6047-40ae-9370-a53df473cbf9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:21.378072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5a39b82-6047-40ae-9370-a53df473cbf9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:21.380196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5a39b82-6047-40ae-9370-a53df473cbf9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:21.519107 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-845a3159-274a-4188-9520-c6213505e2e0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:21.528816 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-845a3159-274a-4188-9520-c6213505e2e0 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1501 microversion: 2.1 time: 0.595459 Jul 28 03:54:21.540215 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1754/3967] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:20 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1501 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:21.563054 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0c38f1ea-b51e-4901-b6de-616a7ba72d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:21.564556 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0c38f1ea-b51e-4901-b6de-616a7ba72d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:21.571561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0c38f1ea-b51e-4901-b6de-616a7ba72d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:21.572219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0c38f1ea-b51e-4901-b6de-616a7ba72d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:21.573821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0c38f1ea-b51e-4901-b6de-616a7ba72d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:21.574430 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0c38f1ea-b51e-4901-b6de-616a7ba72d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:21.615486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-0c38f1ea-b51e-4901-b6de-616a7ba72d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lazy-loading 'flavor' on Instance uuid b960b866-f837-4e4a-8aab-be20f36f67fb {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:54:21.727837 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0c38f1ea-b51e-4901-b6de-616a7ba72d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "POST /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb/action" status: 202 len: 0 microversion: 2.1 time: 0.169429 Jul 28 03:54:21.747558 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1755/3968] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:54:21 2022] POST /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:54:21.771115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cdf28466-0591-4be8-bd79-8b46120bcde9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:21.772220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cdf28466-0591-4be8-bd79-8b46120bcde9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:21.815330 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cdf28466-0591-4be8-bd79-8b46120bcde9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:21.816569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cdf28466-0591-4be8-bd79-8b46120bcde9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:21.821065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cdf28466-0591-4be8-bd79-8b46120bcde9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:21.821838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cdf28466-0591-4be8-bd79-8b46120bcde9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:22.229977 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cdf28466-0591-4be8-bd79-8b46120bcde9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:22.244249 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cdf28466-0591-4be8-bd79-8b46120bcde9 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1509 microversion: 2.1 time: 0.492733 Jul 28 03:54:22.245461 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1756/3969] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:21 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1509 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:22.264705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-806ff7c0-7f05-41e8-9a41-c522c22cd467 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa6777ad30>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:22.983748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d5a39b82-6047-40ae-9370-a53df473cbf9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:23.000397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d5a39b82-6047-40ae-9370-a53df473cbf9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:23.002403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d5a39b82-6047-40ae-9370-a53df473cbf9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:23.004263 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d5a39b82-6047-40ae-9370-a53df473cbf9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 1.666142 Jul 28 03:54:23.008526 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2214/3970] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:21 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:54:23.274566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0675edab-fa45-4bbb-b0f8-068d4abb8a0c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:23.275357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0675edab-fa45-4bbb-b0f8-068d4abb8a0c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:23.286569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0675edab-fa45-4bbb-b0f8-068d4abb8a0c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:23.289863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0675edab-fa45-4bbb-b0f8-068d4abb8a0c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:23.294610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0675edab-fa45-4bbb-b0f8-068d4abb8a0c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:23.295364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0675edab-fa45-4bbb-b0f8-068d4abb8a0c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:23.340318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:25.577115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0675edab-fa45-4bbb-b0f8-068d4abb8a0c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:25.587568 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0675edab-fa45-4bbb-b0f8-068d4abb8a0c tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1492 microversion: 2.1 time: 2.319829 Jul 28 03:54:25.588183 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2215/3971] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:23 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1492 bytes in 2321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:25.606889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-52d6c5a0-0dd1-4251-a1de-7756130bb4c7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:25.618982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-52d6c5a0-0dd1-4251-a1de-7756130bb4c7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:25.635940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52d6c5a0-0dd1-4251-a1de-7756130bb4c7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:25.636422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52d6c5a0-0dd1-4251-a1de-7756130bb4c7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:25.637962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52d6c5a0-0dd1-4251-a1de-7756130bb4c7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:25.644882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52d6c5a0-0dd1-4251-a1de-7756130bb4c7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:27.278150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-52d6c5a0-0dd1-4251-a1de-7756130bb4c7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:27.294509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-52d6c5a0-0dd1-4251-a1de-7756130bb4c7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:27.298905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-52d6c5a0-0dd1-4251-a1de-7756130bb4c7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:27.302955 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-52d6c5a0-0dd1-4251-a1de-7756130bb4c7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 1.704571 Jul 28 03:54:27.304754 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2216/3972] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:25 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:27.315596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-afac75c2-a56a-4120-905c-03cacbd79fd4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:27.316520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-afac75c2-a56a-4120-905c-03cacbd79fd4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:27.331449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afac75c2-a56a-4120-905c-03cacbd79fd4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:27.332375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afac75c2-a56a-4120-905c-03cacbd79fd4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:27.333747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afac75c2-a56a-4120-905c-03cacbd79fd4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:27.334828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afac75c2-a56a-4120-905c-03cacbd79fd4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:27.370362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-afac75c2-a56a-4120-905c-03cacbd79fd4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:54:27.554901 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-afac75c2-a56a-4120-905c-03cacbd79fd4 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 204 len: 0 microversion: 2.1 time: 0.248465 Jul 28 03:54:27.556217 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2217/3973] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:54:27 2022] DELETE /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:54:27.565906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d7489075-8b4d-4230-8c58-c7478d4c5cf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:27.568313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d7489075-8b4d-4230-8c58-c7478d4c5cf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:27.583498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7489075-8b4d-4230-8c58-c7478d4c5cf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:27.584051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7489075-8b4d-4230-8c58-c7478d4c5cf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:27.586904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7489075-8b4d-4230-8c58-c7478d4c5cf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:27.587735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7489075-8b4d-4230-8c58-c7478d4c5cf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:27.640074 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-806ff7c0-7f05-41e8-9a41-c522c22cd467 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1433 microversion: 2.1 time: 5.391501 Jul 28 03:54:27.641424 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1757/3974] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:22 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1433 bytes in 5395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:27.655863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-04ca7aff-104f-4ded-9499-aad8aeba559e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa74b5dca0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:27.762517 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-04ca7aff-104f-4ded-9499-aad8aeba559e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 200 len: 1433 microversion: 2.1 time: 0.111690 Jul 28 03:54:27.767237 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1758/3975] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:27 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 1433 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:27.781745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fe97af5c-927b-42bf-81c2-7c701ab58b97 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:27.784835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fe97af5c-927b-42bf-81c2-7c701ab58b97 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:27.810995 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe97af5c-927b-42bf-81c2-7c701ab58b97 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:27.813076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe97af5c-927b-42bf-81c2-7c701ab58b97 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:27.818748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe97af5c-927b-42bf-81c2-7c701ab58b97 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:27.819200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe97af5c-927b-42bf-81c2-7c701ab58b97 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:28.155832 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fe97af5c-927b-42bf-81c2-7c701ab58b97 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:28.170930 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fe97af5c-927b-42bf-81c2-7c701ab58b97 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1478 microversion: 2.1 time: 0.393031 Jul 28 03:54:28.176414 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1759/3976] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:27 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1478 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:28.328074 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dda7d544-6a22-4c1b-89fc-d6a45d999408 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:28.328749 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dda7d544-6a22-4c1b-89fc-d6a45d999408 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:28.341784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dda7d544-6a22-4c1b-89fc-d6a45d999408 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:28.342593 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dda7d544-6a22-4c1b-89fc-d6a45d999408 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:28.344491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dda7d544-6a22-4c1b-89fc-d6a45d999408 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:28.353978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dda7d544-6a22-4c1b-89fc-d6a45d999408 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:28.673950 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:28.705449 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dda7d544-6a22-4c1b-89fc-d6a45d999408 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:28.717313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dda7d544-6a22-4c1b-89fc-d6a45d999408 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:28.719921 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dda7d544-6a22-4c1b-89fc-d6a45d999408 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:28.721227 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dda7d544-6a22-4c1b-89fc-d6a45d999408 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 0.398018 Jul 28 03:54:28.722177 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1760/3977] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:28 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:54:28.963259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d7489075-8b4d-4230-8c58-c7478d4c5cf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:28.985104 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d7489075-8b4d-4230-8c58-c7478d4c5cf1 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1498 microversion: 2.1 time: 1.416713 Jul 28 03:54:28.986307 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2218/3978] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:27 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1498 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:29.202624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b20d8a38-646a-4b20-84b4-466419be0429 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:29.203452 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b20d8a38-646a-4b20-84b4-466419be0429 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:29.233465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b20d8a38-646a-4b20-84b4-466419be0429 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:29.234304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b20d8a38-646a-4b20-84b4-466419be0429 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:29.235361 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b20d8a38-646a-4b20-84b4-466419be0429 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:29.238393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b20d8a38-646a-4b20-84b4-466419be0429 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:29.752135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f7889ae7-422a-4526-a5b7-9a8782f7e720 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:29.753163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f7889ae7-422a-4526-a5b7-9a8782f7e720 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:29.778740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7889ae7-422a-4526-a5b7-9a8782f7e720 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:29.780508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7889ae7-422a-4526-a5b7-9a8782f7e720 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:29.782222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7889ae7-422a-4526-a5b7-9a8782f7e720 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:29.782917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7889ae7-422a-4526-a5b7-9a8782f7e720 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:29.787588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b20d8a38-646a-4b20-84b4-466419be0429 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:29.838172 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b20d8a38-646a-4b20-84b4-466419be0429 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1478 microversion: 2.1 time: 0.636996 Jul 28 03:54:29.841509 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1761/3979] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:29 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1478 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:30.008476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9cd418b0-d0e1-4aa0-b694-04f970158dfc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:30.009522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9cd418b0-d0e1-4aa0-b694-04f970158dfc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:30.025366 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9cd418b0-d0e1-4aa0-b694-04f970158dfc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:30.025944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9cd418b0-d0e1-4aa0-b694-04f970158dfc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:30.026758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9cd418b0-d0e1-4aa0-b694-04f970158dfc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:30.029926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9cd418b0-d0e1-4aa0-b694-04f970158dfc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:30.910145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f7889ae7-422a-4526-a5b7-9a8782f7e720 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:30.945365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f7889ae7-422a-4526-a5b7-9a8782f7e720 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:30.949051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f7889ae7-422a-4526-a5b7-9a8782f7e720 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:30.955088 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f7889ae7-422a-4526-a5b7-9a8782f7e720 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 1.206742 Jul 28 03:54:30.969704 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2219/3980] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:29 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:30.980316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e7f6d70-ff1d-4165-9de4-932e8fec7ee0 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:30.981428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4e7f6d70-ff1d-4165-9de4-932e8fec7ee0 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:30.988246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e7f6d70-ff1d-4165-9de4-932e8fec7ee0 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:30.990621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e7f6d70-ff1d-4165-9de4-932e8fec7ee0 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:30.993319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e7f6d70-ff1d-4165-9de4-932e8fec7ee0 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:30.994082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e7f6d70-ff1d-4165-9de4-932e8fec7ee0 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:31.506896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9cd418b0-d0e1-4aa0-b694-04f970158dfc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:31.526121 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9cd418b0-d0e1-4aa0-b694-04f970158dfc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1498 microversion: 2.1 time: 1.519160 Jul 28 03:54:31.529655 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1762/3981] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:30 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1498 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:31.922538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1962201702", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "432fe8a4-44a9-4825-926e-bdd171a59a09"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:32.092305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] validate_networks() for [('432fe8a4-44a9-4825-926e-bdd171a59a09', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:54:32.342020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e7f6d70-ff1d-4165-9de4-932e8fec7ee0 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:32.367308 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e7f6d70-ff1d-4165-9de4-932e8fec7ee0 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1465 microversion: 2.1 time: 1.391187 Jul 28 03:54:32.368459 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2220/3982] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:30 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1465 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:32.375495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-159448030", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "693f524d-65ea-4c5a-b83d-05789d71bfe6"}], "security_groups": [{"name": "tempest-securitygroup--1975853108"}], "key_name": "tempest-keypair-2105898308", "user_data": "}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:32.612937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] validate_networks() for [('693f524d-65ea-4c5a-b83d-05789d71bfe6', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:54:34.051567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:54:34.059012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:54:34.059739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:54:34.060327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:54:34.061068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:54:34.087339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:34.092111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:34.092111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:34.092111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:34.153822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for project 781ab005138547038def64d108937e3e. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:54:34.173790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Getting quotas for user d20381abd9784627887af3cb97cd68a8 and project 781ab005138547038def64d108937e3e. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:54:34.245431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:54:34.252686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:54:34.397711 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0704f54f-1d16-422b-b8f4-7ff1c781608c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.027474 Jul 28 03:54:34.399116 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2221/3983] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:54:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 2030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:54:34.407498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c1c0197-9d57-4959-90ec-211c642ccc4b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:34.425121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c1c0197-9d57-4959-90ec-211c642ccc4b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:34.425121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c1c0197-9d57-4959-90ec-211c642ccc4b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:34.425121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c1c0197-9d57-4959-90ec-211c642ccc4b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:34.425121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c1c0197-9d57-4959-90ec-211c642ccc4b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:34.425121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c1c0197-9d57-4959-90ec-211c642ccc4b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:34.756102 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:54:34.757287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:54:34.758368 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:54:34.759205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:54:34.760067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:54:34.776685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:34.777117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:34.780770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:34.783082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:34.843713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Getting quotas for project 04165cf1ca0d45b79d70317e5ae26763. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:54:34.852157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Getting quotas for user 87846236df9b4df183d4ba72c91f07b2 and project 04165cf1ca0d45b79d70317e5ae26763. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:54:34.911415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:54:34.916664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:54:35.096272 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f4fa80b6-e4f1-41a4-bab1-03dc74794201 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.564311 Jul 28 03:54:35.106104 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1763/3984] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:54:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:54:35.120504 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ef84242a-8a71-4cd9-8e8b-a09cfe9205bb tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa742c0700>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:35.243445 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ef84242a-8a71-4cd9-8e8b-a09cfe9205bb tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/5d43adf9-af92-4117-9ed9-35547daa1220" status: 200 len: 784 microversion: 2.1 time: 0.135970 Jul 28 03:54:35.257748 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1764/3985] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:35 2022] GET /compute/v2.1/images/5d43adf9-af92-4117-9ed9-35547daa1220 => generated 784 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:35.273953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e5b8903e-ceb7-40b7-86ef-277958a9d5df tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:35.280961 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e5b8903e-ceb7-40b7-86ef-277958a9d5df tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:35.285166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1c1c0197-9d57-4959-90ec-211c642ccc4b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:35.311288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1c1c0197-9d57-4959-90ec-211c642ccc4b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:35.323684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5b8903e-ceb7-40b7-86ef-277958a9d5df tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:35.325185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1c1c0197-9d57-4959-90ec-211c642ccc4b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:35.327881 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c1c0197-9d57-4959-90ec-211c642ccc4b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 0.927396 Jul 28 03:54:35.328207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5b8903e-ceb7-40b7-86ef-277958a9d5df tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:35.330671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5b8903e-ceb7-40b7-86ef-277958a9d5df tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:35.332198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5b8903e-ceb7-40b7-86ef-277958a9d5df tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:35.332708 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2222/3986] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:34 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:35.359931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-71b29baa-af07-4ab6-9bae-1ff0c23e5041 req-b3254a7d-1a85-4ade-be9e-249a9037b094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091c0997-537d-4124-9945-1ef1dd079d63", "name": "network-vif-unplugged", "status": "completed", "tag": "c5b8c623-1fc8-4425-b1c1-c5da71e14c34"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:35.388780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-71b29baa-af07-4ab6-9bae-1ff0c23e5041 req-b3254a7d-1a85-4ade-be9e-249a9037b094 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:35.391539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-71b29baa-af07-4ab6-9bae-1ff0c23e5041 req-b3254a7d-1a85-4ade-be9e-249a9037b094 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:35.451312 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-71b29baa-af07-4ab6-9bae-1ff0c23e5041 req-b3254a7d-1a85-4ade-be9e-249a9037b094 service nova] Creating event network-vif-unplugged:c5b8c623-1fc8-4425-b1c1-c5da71e14c34 for instance 091c0997-537d-4124-9945-1ef1dd079d63 on n-h1-826756-3 Jul 28 03:54:35.474766 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-71b29baa-af07-4ab6-9bae-1ff0c23e5041 req-b3254a7d-1a85-4ade-be9e-249a9037b094 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132297 Jul 28 03:54:35.477644 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5b8903e-ceb7-40b7-86ef-277958a9d5df tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:35.478155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5b8903e-ceb7-40b7-86ef-277958a9d5df tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:35.478828 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-e5b8903e-ceb7-40b7-86ef-277958a9d5df tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lazy-loading 'fault' on Instance uuid b960b866-f837-4e4a-8aab-be20f36f67fb {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:54:35.481388 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2223/3987] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:35.608430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-474753835", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:35.741210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] validate_networks() for [('3fcf143f-a069-44e5-9902-e5b7dddd3dfa', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:54:35.783457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e5b8903e-ceb7-40b7-86ef-277958a9d5df tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67fcd8c3ec5441e582a4852f0f1184b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed8cbcca694b8794992388d95bf072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:35.794732 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e5b8903e-ceb7-40b7-86ef-277958a9d5df tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 200 len: 1304 microversion: 2.1 time: 0.534663 Jul 28 03:54:35.800335 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1765/3988] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:35 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 1304 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:35.824901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-05fd3ac9-94f7-4dfb-940b-4f8c1f533bda req-a0a5d6f7-9b7a-43fb-bd54-107aba2c6bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b960b866-f837-4e4a-8aab-be20f36f67fb", "name": "network-vif-deleted", "tag": "1c00c82a-3d7c-4b3e-b531-d5739f820522"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:35.875549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-05fd3ac9-94f7-4dfb-940b-4f8c1f533bda req-a0a5d6f7-9b7a-43fb-bd54-107aba2c6bc5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:35.876000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-05fd3ac9-94f7-4dfb-940b-4f8c1f533bda req-a0a5d6f7-9b7a-43fb-bd54-107aba2c6bc5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:35.999215 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-05fd3ac9-94f7-4dfb-940b-4f8c1f533bda req-a0a5d6f7-9b7a-43fb-bd54-107aba2c6bc5 service nova] Creating event network-vif-deleted:1c00c82a-3d7c-4b3e-b531-d5739f820522 for instance b960b866-f837-4e4a-8aab-be20f36f67fb on n-h1-826756-3 Jul 28 03:54:36.016457 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-05fd3ac9-94f7-4dfb-940b-4f8c1f533bda req-a0a5d6f7-9b7a-43fb-bd54-107aba2c6bc5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207978 Jul 28 03:54:36.019117 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1766/3989] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:36.054024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eb496bcf-32e6-436d-8d7d-8f5c135a5d20 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:36.057930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-eb496bcf-32e6-436d-8d7d-8f5c135a5d20 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:36.084435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb496bcf-32e6-436d-8d7d-8f5c135a5d20 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:36.087067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb496bcf-32e6-436d-8d7d-8f5c135a5d20 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:36.088994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb496bcf-32e6-436d-8d7d-8f5c135a5d20 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:36.090939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb496bcf-32e6-436d-8d7d-8f5c135a5d20 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:36.568896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-eb496bcf-32e6-436d-8d7d-8f5c135a5d20 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:36.584127 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-eb496bcf-32e6-436d-8d7d-8f5c135a5d20 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1293 microversion: 2.1 time: 0.561632 Jul 28 03:54:36.596422 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1767/3990] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:36 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1293 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:36.602868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-12b52915-a721-4200-bd5e-74a83d6e5b3d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:36.613231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-12b52915-a721-4200-bd5e-74a83d6e5b3d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:36.626117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-12b52915-a721-4200-bd5e-74a83d6e5b3d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:36.626538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-12b52915-a721-4200-bd5e-74a83d6e5b3d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:36.627436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-12b52915-a721-4200-bd5e-74a83d6e5b3d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:36.627929 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-12b52915-a721-4200-bd5e-74a83d6e5b3d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:36.634723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:36.765174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-12b52915-a721-4200-bd5e-74a83d6e5b3d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:36.781238 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-12b52915-a721-4200-bd5e-74a83d6e5b3d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1232 microversion: 2.1 time: 0.190739 Jul 28 03:54:36.797322 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1768/3991] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:36 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1232 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:36.812158 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a3f58315-1814-4818-be64-7e486045c6d7 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:36.843629 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a3f58315-1814-4818-be64-7e486045c6d7 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042752 Jul 28 03:54:36.844552 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1769/3992] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:54:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:36.867440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-75b719a4-71d5-4d1e-ab37-66b432fdcaad tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:36.868231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-75b719a4-71d5-4d1e-ab37-66b432fdcaad tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:36.900792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75b719a4-71d5-4d1e-ab37-66b432fdcaad tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:36.901256 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75b719a4-71d5-4d1e-ab37-66b432fdcaad tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:36.902083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75b719a4-71d5-4d1e-ab37-66b432fdcaad tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:36.902524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-75b719a4-71d5-4d1e-ab37-66b432fdcaad tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:38.124982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-75b719a4-71d5-4d1e-ab37-66b432fdcaad tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:38.145656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-75b719a4-71d5-4d1e-ab37-66b432fdcaad tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:38.152897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-75b719a4-71d5-4d1e-ab37-66b432fdcaad tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:38.155622 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-75b719a4-71d5-4d1e-ab37-66b432fdcaad tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 1.299732 Jul 28 03:54:38.224226 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1770/3993] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:36 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:38.241973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d962a455-8aa4-4c4b-9c53-c4c2179f70c6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:38.245896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d962a455-8aa4-4c4b-9c53-c4c2179f70c6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:38.273251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d962a455-8aa4-4c4b-9c53-c4c2179f70c6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:38.274426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d962a455-8aa4-4c4b-9c53-c4c2179f70c6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:38.275739 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d962a455-8aa4-4c4b-9c53-c4c2179f70c6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:38.277061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d962a455-8aa4-4c4b-9c53-c4c2179f70c6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:38.326948 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-d962a455-8aa4-4c4b-9c53-c4c2179f70c6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d962a455-8aa4-4c4b-9c53-c4c2179f70c6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb HTTP/1.1 Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'b960b866-f837-4e4a-8aab-be20f36f67fb'} Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:38.329791 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:38.334887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:38.334887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:38.334887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:38.334887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:38.334887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:38.334887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:38.334887 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:38.337321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d962a455-8aa4-4c4b-9c53-c4c2179f70c6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:38.339799 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d962a455-8aa4-4c4b-9c53-c4c2179f70c6 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 404 len: 111 microversion: 2.1 time: 0.113308 Jul 28 03:54:38.345821 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1771/3994] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:38 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:38.351896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-80489a81-3e2e-4c54-84dd-4d52115f3a4f tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa746328b0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:38.782506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:54:38.783018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:54:38.783651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:54:38.784208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:54:38.784826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:54:38.810071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:38.812239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:38.813612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:38.814245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:38.897576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Getting quotas for project ea989471cdf641f389e0f61166fdb28a. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:54:38.912207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Getting quotas for user a36bace2510942d4bb94ec23a6b3a053 and project ea989471cdf641f389e0f61166fdb28a. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:54:38.949713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:54:38.958903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:54:39.079847 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e579e089-cd92-449d-98f9-6ab29ca270d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.590113 Jul 28 03:54:39.086308 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2224/3995] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:54:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 3599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:54:39.086308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e85de480-e2a4-4092-b1b0-6ac010970c00 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:39.103868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e85de480-e2a4-4092-b1b0-6ac010970c00 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:39.136046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e85de480-e2a4-4092-b1b0-6ac010970c00 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:39.136543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e85de480-e2a4-4092-b1b0-6ac010970c00 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:39.137403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e85de480-e2a4-4092-b1b0-6ac010970c00 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:39.141328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e85de480-e2a4-4092-b1b0-6ac010970c00 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:39.329336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e85de480-e2a4-4092-b1b0-6ac010970c00 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:39.346000 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e85de480-e2a4-4092-b1b0-6ac010970c00 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1299 microversion: 2.1 time: 0.263782 Jul 28 03:54:39.352329 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2225/3996] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:39 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1299 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:39.363950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-975c55fb-0597-4aa7-bcd1-7fcf8cb2b3c4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:39.364636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-975c55fb-0597-4aa7-bcd1-7fcf8cb2b3c4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:39.411692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-975c55fb-0597-4aa7-bcd1-7fcf8cb2b3c4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:39.412926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-975c55fb-0597-4aa7-bcd1-7fcf8cb2b3c4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:39.416589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-975c55fb-0597-4aa7-bcd1-7fcf8cb2b3c4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:39.417215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-975c55fb-0597-4aa7-bcd1-7fcf8cb2b3c4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:39.428179 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-80489a81-3e2e-4c54-84dd-4d52115f3a4f tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "DELETE /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 204 len: 0 microversion: 2.1 time: 1.080463 Jul 28 03:54:39.438396 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1772/3997] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:38 2022] DELETE /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 0 bytes in 1091 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:54:39.446816 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f7cae9b1-53cd-4bb5-973a-70e7c4ae0812 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:39.447656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f7cae9b1-53cd-4bb5-973a-70e7c4ae0812 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:39.480234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7cae9b1-53cd-4bb5-973a-70e7c4ae0812 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:39.480952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7cae9b1-53cd-4bb5-973a-70e7c4ae0812 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:39.483095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7cae9b1-53cd-4bb5-973a-70e7c4ae0812 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:39.483752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7cae9b1-53cd-4bb5-973a-70e7c4ae0812 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:39.502578 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-f7cae9b1-53cd-4bb5-973a-70e7c4ae0812 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f7cae9b1-53cd-4bb5-973a-70e7c4ae0812 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb HTTP/1.1 Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'b960b866-f837-4e4a-8aab-be20f36f67fb'} Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:39.505159 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:39.513939 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:39.513939 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:39.513939 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:39.513939 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:39.513939 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:39.513939 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:39.513939 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:39.513939 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:39.513939 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:39.513939 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:39.513939 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:39.527489 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f7cae9b1-53cd-4bb5-973a-70e7c4ae0812 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:39.529393 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f7cae9b1-53cd-4bb5-973a-70e7c4ae0812 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 404 len: 111 microversion: 2.1 time: 0.088058 Jul 28 03:54:39.530188 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1773/3998] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:54:39 2022] DELETE /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:39.548392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-41a91603-47ab-4df2-860c-78e6525fc56a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:39.551118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-41a91603-47ab-4df2-860c-78e6525fc56a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:39.727856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-975c55fb-0597-4aa7-bcd1-7fcf8cb2b3c4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:39.742665 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-975c55fb-0597-4aa7-bcd1-7fcf8cb2b3c4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1286 microversion: 2.1 time: 0.388514 Jul 28 03:54:39.755922 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2226/3999] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:39 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1286 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:39.771873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ccc4032-2426-4ec1-8a34-57d8038ae940 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:39.778255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ccc4032-2426-4ec1-8a34-57d8038ae940 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:39.803028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ccc4032-2426-4ec1-8a34-57d8038ae940 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:39.803709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ccc4032-2426-4ec1-8a34-57d8038ae940 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:39.805286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ccc4032-2426-4ec1-8a34-57d8038ae940 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:39.810164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ccc4032-2426-4ec1-8a34-57d8038ae940 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.078322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-41a91603-47ab-4df2-860c-78e6525fc56a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:40.087702 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-41a91603-47ab-4df2-860c-78e6525fc56a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1216 microversion: 2.1 time: 0.550371 Jul 28 03:54:40.105698 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1774/4000] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:39 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1216 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:40.112164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-34fda342-66ca-4baf-819d-b04a5d00bef6 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa74632ca0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:40.151062 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-34fda342-66ca-4baf-819d-b04a5d00bef6 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] HTTP exception thrown: Image not found. Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-34fda342-66ca-4baf-819d-b04a5d00bef6 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Request method failure captured: Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 HTTP/1.1 Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gg7G2DrOKI_Bj5hWsmZ1pP6ndynMfF5gYh6na_ZnI5FzQQ_-siOnWWZ2EjvtESiHROq-Rcrz9VBljQyjwxE3LpJAsKa7oF9yTxgNY4fYF81QFzFvX7XgYcxVU5KfgUTxOWCN7HzvARGRM_4aLDl43kKESC-APFJgb281w8d815_Epc Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 565b5ba6a4c4496b913bbb8c95b6cd18 Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesOneServerTestJSON-1180323520 Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/565b5ba6a4c4496b913bbb8c95b6cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/565b5ba6a4c4496b913bbb8c95b6cd18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_565b5ba6a4c4496b913bbb8c95b6cd18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/565b5ba6a4c4496b913bbb8c95b6cd18"}]}] Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesOneServerTestJSON-1180323520 Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 565b5ba6a4c4496b913bbb8c95b6cd18 Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1180323520 Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesOneServerTestJSON-1180323520-project Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 6af5e8135e15471f92108c2774212cc3 Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesOneServerTestJSON-1180323520-project Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: exception: Image not found. Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472'} Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 03:54:40.155262 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 could not be found. Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:54:40.163031 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.171548 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-34fda342-66ca-4baf-819d-b04a5d00bef6 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Returning 404 to user: Image not found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:40.172840 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-34fda342-66ca-4baf-819d-b04a5d00bef6 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 404 len: 62 microversion: 2.1 time: 0.065750 Jul 28 03:54:40.174248 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1775/4001] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:40 2022] GET /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:54:40.185280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2fdb18af-43f3-4760-97da-5432cffdb1af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:40.186259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2fdb18af-43f3-4760-97da-5432cffdb1af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: b960b866-f837-4e4a-8aab-be20f36f67fb] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:40.189189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:40.195461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2fdb18af-43f3-4760-97da-5432cffdb1af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.196296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2fdb18af-43f3-4760-97da-5432cffdb1af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.197866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2fdb18af-43f3-4760-97da-5432cffdb1af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.199021 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2fdb18af-43f3-4760-97da-5432cffdb1af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.223039 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-2fdb18af-43f3-4760-97da-5432cffdb1af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2fdb18af-43f3-4760-97da-5432cffdb1af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb HTTP/1.1 Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'b960b866-f837-4e4a-8aab-be20f36f67fb'} Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:40.225904 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.230596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.230596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:40.230596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:40.230596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:40.230596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:40.230596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. Jul 28 03:54:40.230596 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.230596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2fdb18af-43f3-4760-97da-5432cffdb1af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance b960b866-f837-4e4a-8aab-be20f36f67fb could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:40.233930 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2fdb18af-43f3-4760-97da-5432cffdb1af tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb" status: 404 len: 111 microversion: 2.1 time: 0.052534 Jul 28 03:54:40.237597 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1776/4002] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:40 2022] GET /compute/v2.1/servers/b960b866-f837-4e4a-8aab-be20f36f67fb => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:40.239057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ccc4032-2426-4ec1-8a34-57d8038ae940 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:40.251080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ccc4032-2426-4ec1-8a34-57d8038ae940 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:40.251353 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c67b42c1-09aa-4fc8-b538-22bbea27ae93 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-480190572"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:40.253721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ccc4032-2426-4ec1-8a34-57d8038ae940 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:40.255819 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ccc4032-2426-4ec1-8a34-57d8038ae940 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 0.488287 Jul 28 03:54:40.256911 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2227/4003] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:39 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:40.258903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c67b42c1-09aa-4fc8-b538-22bbea27ae93 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:40.277747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c67b42c1-09aa-4fc8-b538-22bbea27ae93 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.278663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c67b42c1-09aa-4fc8-b538-22bbea27ae93 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.279729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c67b42c1-09aa-4fc8-b538-22bbea27ae93 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.280658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c67b42c1-09aa-4fc8-b538-22bbea27ae93 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.290218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-553f543c-cafa-4882-83fb-2535db76108e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:40.291368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-553f543c-cafa-4882-83fb-2535db76108e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:40.316688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-553f543c-cafa-4882-83fb-2535db76108e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.317885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-553f543c-cafa-4882-83fb-2535db76108e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.319064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-553f543c-cafa-4882-83fb-2535db76108e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.320178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-553f543c-cafa-4882-83fb-2535db76108e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.407987 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-553f543c-cafa-4882-83fb-2535db76108e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-553f543c-cafa-4882-83fb-2535db76108e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b HTTP/1.1 Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '13579693-5082-4742-9c29-a1e16f62308b'} Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:40.411582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:40.416108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:54:40.416108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.416108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:40.416108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.416108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.416108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:40.416108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:40.416108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:40.416108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:40.416108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:54:40.416108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.416108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-553f543c-cafa-4882-83fb-2535db76108e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:40.416108 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-553f543c-cafa-4882-83fb-2535db76108e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "DELETE /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 404 len: 111 microversion: 2.1 time: 0.154788 Jul 28 03:54:40.420300 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2228/4004] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:54:40 2022] DELETE /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:40.434104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e874ac7d-741f-43ba-b3fb-7c2ed961709c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:40.435090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e874ac7d-741f-43ba-b3fb-7c2ed961709c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:40.451486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e874ac7d-741f-43ba-b3fb-7c2ed961709c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.452391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e874ac7d-741f-43ba-b3fb-7c2ed961709c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.455026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e874ac7d-741f-43ba-b3fb-7c2ed961709c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.455547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e874ac7d-741f-43ba-b3fb-7c2ed961709c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.645338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e874ac7d-741f-43ba-b3fb-7c2ed961709c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:40.662877 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e874ac7d-741f-43ba-b3fb-7c2ed961709c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1299 microversion: 2.1 time: 0.240726 Jul 28 03:54:40.664850 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2229/4005] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:40 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1299 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:40.672061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb987011-7bcd-474b-bfdc-d20da084c2c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:40.678299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb987011-7bcd-474b-bfdc-d20da084c2c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 13579693-5082-4742-9c29-a1e16f62308b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:40.695304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb987011-7bcd-474b-bfdc-d20da084c2c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.696732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb987011-7bcd-474b-bfdc-d20da084c2c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.700111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb987011-7bcd-474b-bfdc-d20da084c2c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.701233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb987011-7bcd-474b-bfdc-d20da084c2c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.733653 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c67b42c1-09aa-4fc8-b538-22bbea27ae93 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "POST /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63/action" status: 202 len: 0 microversion: 2.1 time: 0.493068 Jul 28 03:54:40.737284 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-fb987011-7bcd-474b-bfdc-d20da084c2c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb987011-7bcd-474b-bfdc-d20da084c2c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b HTTP/1.1 Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '13579693-5082-4742-9c29-a1e16f62308b'} Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:40.739194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.743718 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.743718 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:40.743718 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:40.743718 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:40.743718 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:40.743718 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. Jul 28 03:54:40.743718 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.744207 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1777/4006] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:54:40 2022] POST /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 03:54:40.751098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb987011-7bcd-474b-bfdc-d20da084c2c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance 13579693-5082-4742-9c29-a1e16f62308b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:40.752485 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fb987011-7bcd-474b-bfdc-d20da084c2c8 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b" status: 404 len: 111 microversion: 2.1 time: 0.086275 Jul 28 03:54:40.753447 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2230/4007] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:40 2022] GET /compute/v2.1/servers/13579693-5082-4742-9c29-a1e16f62308b => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:40.755969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0e6d511e-4ab2-43dc-9c69-3ec2a6f64d7d tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa74632c10>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:40.774411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c6a0204-4a51-4c59-89e9-18a97c96e3ff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:40.777383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c6a0204-4a51-4c59-89e9-18a97c96e3ff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:40.794715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c6a0204-4a51-4c59-89e9-18a97c96e3ff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.795571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c6a0204-4a51-4c59-89e9-18a97c96e3ff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.799313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c6a0204-4a51-4c59-89e9-18a97c96e3ff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.800254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c6a0204-4a51-4c59-89e9-18a97c96e3ff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.840178 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-9c6a0204-4a51-4c59-89e9-18a97c96e3ff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c6a0204-4a51-4c59-89e9-18a97c96e3ff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 HTTP/1.1 Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8'} Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:40.843112 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:40.847740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:54:40.847740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.847740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:40.847740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.847740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.847740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:40.847740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:40.847740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:40.847740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:40.847740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:54:40.847740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.851001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c6a0204-4a51-4c59-89e9-18a97c96e3ff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:40.852107 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c6a0204-4a51-4c59-89e9-18a97c96e3ff tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 404 len: 111 microversion: 2.1 time: 0.093677 Jul 28 03:54:40.853310 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2231/4008] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:54:40 2022] DELETE /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:40.858519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4ed50756-9065-4d5e-89cf-bb1c53f4eabb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:40.859422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4ed50756-9065-4d5e-89cf-bb1c53f4eabb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:40.866695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ed50756-9065-4d5e-89cf-bb1c53f4eabb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.867549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ed50756-9065-4d5e-89cf-bb1c53f4eabb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.868608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ed50756-9065-4d5e-89cf-bb1c53f4eabb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.869281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ed50756-9065-4d5e-89cf-bb1c53f4eabb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.892272 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0e6d511e-4ab2-43dc-9c69-3ec2a6f64d7d tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.146744 Jul 28 03:54:40.892901 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1778/4009] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:40 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:40.907344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eb97b52c-405a-45b4-9271-b558f71c7d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:40.908085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-eb97b52c-405a-45b4-9271-b558f71c7d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:40.930715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb97b52c-405a-45b4-9271-b558f71c7d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.934988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb97b52c-405a-45b4-9271-b558f71c7d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.936828 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb97b52c-405a-45b4-9271-b558f71c7d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:40.941324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eb97b52c-405a-45b4-9271-b558f71c7d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:40.971129 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-eb97b52c-405a-45b4-9271-b558f71c7d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eb97b52c-405a-45b4-9271-b558f71c7d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 HTTP/1.1 Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8'} Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:40.989273 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.997113 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:40.997113 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:40.997113 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:40.997113 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:40.997113 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:40.997113 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. Jul 28 03:54:40.997113 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:40.999042 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eb97b52c-405a-45b4-9271-b558f71c7d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance 2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:41.000148 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-eb97b52c-405a-45b4-9271-b558f71c7d1f tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8" status: 404 len: 111 microversion: 2.1 time: 0.098219 Jul 28 03:54:41.005676 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1779/4010] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:40 2022] GET /compute/v2.1/servers/2feea9f6-d2b9-40c9-8efb-cfb5d2922eb8 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:41.014249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e581f25a-3d8a-46ec-82f7-3911451a2492 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:41.017704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e581f25a-3d8a-46ec-82f7-3911451a2492 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:41.036784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e581f25a-3d8a-46ec-82f7-3911451a2492 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:41.049364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4ed50756-9065-4d5e-89cf-bb1c53f4eabb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:41.050565 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e581f25a-3d8a-46ec-82f7-3911451a2492 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:41.054954 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e581f25a-3d8a-46ec-82f7-3911451a2492 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:41.055692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e581f25a-3d8a-46ec-82f7-3911451a2492 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:41.060173 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4ed50756-9065-4d5e-89cf-bb1c53f4eabb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1286 microversion: 2.1 time: 0.205217 Jul 28 03:54:41.074340 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2232/4011] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:40 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1286 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:41.088333 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-e581f25a-3d8a-46ec-82f7-3911451a2492 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e581f25a-3d8a-46ec-82f7-3911451a2492 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca HTTP/1.1 Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'c219f2e3-05d9-43c5-9b8d-611c925c32ca'} Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:41.090158 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:41.095025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:54:41.095025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.095025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:41.095025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.095025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:41.095025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:41.095025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:41.095025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:41.095025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:41.095025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:54:41.095025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.095025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e581f25a-3d8a-46ec-82f7-3911451a2492 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:41.095025 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e581f25a-3d8a-46ec-82f7-3911451a2492 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 404 len: 111 microversion: 2.1 time: 0.081910 Jul 28 03:54:41.095025 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1780/4012] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:54:41 2022] DELETE /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:54:41.101311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f9f4acb-db65-4acd-9206-8c07bcb7c95e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:41.101921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f9f4acb-db65-4acd-9206-8c07bcb7c95e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c219f2e3-05d9-43c5-9b8d-611c925c32ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:41.117470 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9d0831da-f105-4406-9db3-d963c65ae1ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:41.118169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9d0831da-f105-4406-9db3-d963c65ae1ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:41.119638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f9f4acb-db65-4acd-9206-8c07bcb7c95e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:41.120203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f9f4acb-db65-4acd-9206-8c07bcb7c95e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:41.121050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f9f4acb-db65-4acd-9206-8c07bcb7c95e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:41.121482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f9f4acb-db65-4acd-9206-8c07bcb7c95e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:41.159282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d0831da-f105-4406-9db3-d963c65ae1ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:41.159732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d0831da-f105-4406-9db3-d963c65ae1ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:41.164673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d0831da-f105-4406-9db3-d963c65ae1ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:41.165133 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d0831da-f105-4406-9db3-d963c65ae1ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:41.179571 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-5f9f4acb-db65-4acd-9206-8c07bcb7c95e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f9f4acb-db65-4acd-9206-8c07bcb7c95e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca HTTP/1.1 Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c219f2e3-05d9-43c5-9b8d-611c925c32ca'} Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:41.188583 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.195369 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:41.195369 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:41.195369 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:41.195369 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:41.195369 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:41.195369 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. Jul 28 03:54:41.195369 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.195369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f9f4acb-db65-4acd-9206-8c07bcb7c95e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance c219f2e3-05d9-43c5-9b8d-611c925c32ca could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:41.196502 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f9f4acb-db65-4acd-9206-8c07bcb7c95e tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca" status: 404 len: 111 microversion: 2.1 time: 0.098361 Jul 28 03:54:41.196502 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2233/4013] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:41 2022] GET /compute/v2.1/servers/c219f2e3-05d9-43c5-9b8d-611c925c32ca => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:41.223102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c06f2b14-261c-4b94-b9f6-6acf652d7b77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:41.224909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c06f2b14-261c-4b94-b9f6-6acf652d7b77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:41.241109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c06f2b14-261c-4b94-b9f6-6acf652d7b77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:41.245104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c06f2b14-261c-4b94-b9f6-6acf652d7b77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:41.246216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c06f2b14-261c-4b94-b9f6-6acf652d7b77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:41.247043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c06f2b14-261c-4b94-b9f6-6acf652d7b77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:41.283232 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-c06f2b14-261c-4b94-b9f6-6acf652d7b77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c06f2b14-261c-4b94-b9f6-6acf652d7b77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 HTTP/1.1 Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '852ef6b3-2db0-4d01-9af9-b8bcda4937e4'} Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:41.286111 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:41.290965 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:54:41.290965 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.290965 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:41.290965 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.290965 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:41.290965 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:41.290965 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:41.290965 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:41.290965 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:41.290965 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:54:41.290965 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.294468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c06f2b14-261c-4b94-b9f6-6acf652d7b77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:41.295650 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c06f2b14-261c-4b94-b9f6-6acf652d7b77 tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "DELETE /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 404 len: 111 microversion: 2.1 time: 0.094922 Jul 28 03:54:41.298393 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2234/4014] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:54:41 2022] DELETE /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:41.306953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d1b069b1-8595-41b5-9feb-f9740db0971e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:41.307635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d1b069b1-8595-41b5-9feb-f9740db0971e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:41.317828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1b069b1-8595-41b5-9feb-f9740db0971e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:41.318677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1b069b1-8595-41b5-9feb-f9740db0971e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:41.319667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1b069b1-8595-41b5-9feb-f9740db0971e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:41.325821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1b069b1-8595-41b5-9feb-f9740db0971e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:41.379991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:41.508611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9d0831da-f105-4406-9db3-d963c65ae1ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:41.528045 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9d0831da-f105-4406-9db3-d963c65ae1ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1276 microversion: 2.1 time: 0.422237 Jul 28 03:54:41.554518 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1781/4015] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:41 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1276 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:41.565783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e27bb92a-ce51-49c7-a89e-8cd1cd378d8a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:41.566851 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e27bb92a-ce51-49c7-a89e-8cd1cd378d8a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: 852ef6b3-2db0-4d01-9af9-b8bcda4937e4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:41.575926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e27bb92a-ce51-49c7-a89e-8cd1cd378d8a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:41.576442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e27bb92a-ce51-49c7-a89e-8cd1cd378d8a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:41.577642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e27bb92a-ce51-49c7-a89e-8cd1cd378d8a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:41.578369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e27bb92a-ce51-49c7-a89e-8cd1cd378d8a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:41.601244 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-e27bb92a-ce51-49c7-a89e-8cd1cd378d8a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e27bb92a-ce51-49c7-a89e-8cd1cd378d8a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 HTTP/1.1 Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '852ef6b3-2db0-4d01-9af9-b8bcda4937e4'} Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:41.603851 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.609305 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:41.609305 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:41.609305 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:41.609305 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:41.609305 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:41.609305 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. Jul 28 03:54:41.609305 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:41.609305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e27bb92a-ce51-49c7-a89e-8cd1cd378d8a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance 852ef6b3-2db0-4d01-9af9-b8bcda4937e4 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:41.609305 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e27bb92a-ce51-49c7-a89e-8cd1cd378d8a tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4" status: 404 len: 111 microversion: 2.1 time: 0.050101 Jul 28 03:54:41.613208 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1782/4016] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:41 2022] GET /compute/v2.1/servers/852ef6b3-2db0-4d01-9af9-b8bcda4937e4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:41.690464 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-01a87aa2-4e70-4f19-a887-83cc815b064f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:41.691306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-01a87aa2-4e70-4f19-a887-83cc815b064f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:41.705242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01a87aa2-4e70-4f19-a887-83cc815b064f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:41.712473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01a87aa2-4e70-4f19-a887-83cc815b064f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:41.713735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01a87aa2-4e70-4f19-a887-83cc815b064f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:41.714419 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-01a87aa2-4e70-4f19-a887-83cc815b064f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:41.832373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d1b069b1-8595-41b5-9feb-f9740db0971e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:41.859055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d1b069b1-8595-41b5-9feb-f9740db0971e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:41.866379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d1b069b1-8595-41b5-9feb-f9740db0971e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:41.875875 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d1b069b1-8595-41b5-9feb-f9740db0971e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 0.571922 Jul 28 03:54:41.888379 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2235/4017] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:41 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:41.907638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0bfed541-77dc-4585-8016-a4df81daa764 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa67761700>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:42.037355 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0bfed541-77dc-4585-8016-a4df81daa764 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.134108 Jul 28 03:54:42.038518 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2236/4018] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:41 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:42.083062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-27e25d93-0338-4ba3-89cc-e10d3b38580c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:42.084834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-27e25d93-0338-4ba3-89cc-e10d3b38580c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:42.099575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27e25d93-0338-4ba3-89cc-e10d3b38580c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:42.100307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27e25d93-0338-4ba3-89cc-e10d3b38580c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:42.101317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27e25d93-0338-4ba3-89cc-e10d3b38580c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:42.101985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27e25d93-0338-4ba3-89cc-e10d3b38580c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:42.341161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-01a87aa2-4e70-4f19-a887-83cc815b064f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:42.353816 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-01a87aa2-4e70-4f19-a887-83cc815b064f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1367 microversion: 2.1 time: 0.667365 Jul 28 03:54:42.367806 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1783/4019] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:41 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1367 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:42.458964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-27e25d93-0338-4ba3-89cc-e10d3b38580c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:42.482283 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-27e25d93-0338-4ba3-89cc-e10d3b38580c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1328 microversion: 2.1 time: 0.402463 Jul 28 03:54:42.482914 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2237/4020] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:42 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1328 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:42.579826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-947a8f27-8be7-4a0c-a6c7-09853522f248 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:42.584694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-947a8f27-8be7-4a0c-a6c7-09853522f248 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:42.621716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-947a8f27-8be7-4a0c-a6c7-09853522f248 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:42.622202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-947a8f27-8be7-4a0c-a6c7-09853522f248 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:42.623303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-947a8f27-8be7-4a0c-a6c7-09853522f248 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:42.625306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-947a8f27-8be7-4a0c-a6c7-09853522f248 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:42.909959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e2b40965-0183-4c1b-b0ba-596ebe96867a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:42.913106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e2b40965-0183-4c1b-b0ba-596ebe96867a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:42.948468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2b40965-0183-4c1b-b0ba-596ebe96867a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:42.949297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2b40965-0183-4c1b-b0ba-596ebe96867a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:42.952967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2b40965-0183-4c1b-b0ba-596ebe96867a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:42.954066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2b40965-0183-4c1b-b0ba-596ebe96867a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:43.284024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-947a8f27-8be7-4a0c-a6c7-09853522f248 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:43.301838 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-947a8f27-8be7-4a0c-a6c7-09853522f248 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1274 microversion: 2.1 time: 0.742502 Jul 28 03:54:43.303122 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1784/4021] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:42 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1274 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:43.321166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5f72f46a-57d3-4826-8d3c-3cbc07f9d1fc tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa74b5d5e0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:43.414342 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5f72f46a-57d3-4826-8d3c-3cbc07f9d1fc tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.109790 Jul 28 03:54:43.427110 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1785/4022] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:43 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:43.596619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e2b40965-0183-4c1b-b0ba-596ebe96867a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:43.608605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e2b40965-0183-4c1b-b0ba-596ebe96867a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:43.610687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e2b40965-0183-4c1b-b0ba-596ebe96867a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:43.612249 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e2b40965-0183-4c1b-b0ba-596ebe96867a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 0.712280 Jul 28 03:54:43.613438 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2238/4023] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:42 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:43.619313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06d8f5cb-4fd7-4e45-99a1-950350353fed tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:43.620179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-06d8f5cb-4fd7-4e45-99a1-950350353fed tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:43.627961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06d8f5cb-4fd7-4e45-99a1-950350353fed tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:43.628835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06d8f5cb-4fd7-4e45-99a1-950350353fed tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:43.630155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06d8f5cb-4fd7-4e45-99a1-950350353fed tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:43.631500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06d8f5cb-4fd7-4e45-99a1-950350353fed tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:43.699620 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1065447108", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": "none"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:43.813407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:54:43.813906 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:54:43.814503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:54:43.815702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:54:43.816207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:54:43.843073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:43.843590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:43.845199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:43.845697 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:43.885765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-06d8f5cb-4fd7-4e45-99a1-950350353fed tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:43.896447 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-06d8f5cb-4fd7-4e45-99a1-950350353fed tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1367 microversion: 2.1 time: 0.280479 Jul 28 03:54:43.897406 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2239/4024] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:43 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:43.905228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c904906f-c098-4234-8353-c687df855d93 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:43.906118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c904906f-c098-4234-8353-c687df855d93 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:43.913934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c904906f-c098-4234-8353-c687df855d93 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:43.915393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c904906f-c098-4234-8353-c687df855d93 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:43.916500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c904906f-c098-4234-8353-c687df855d93 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:43.917134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c904906f-c098-4234-8353-c687df855d93 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:43.917794 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Getting quotas for project abc63a5432844a94ace433430d2ad697. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:54:43.930156 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Getting quotas for user b14967aa01c64eef9ef842a89b919e26 and project abc63a5432844a94ace433430d2ad697. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:54:43.952765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:54:43.960839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] [instance: f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:54:44.029426 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-647384d9-5736-42f6-bfdd-006962b9838f tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.600873 Jul 28 03:54:44.037270 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1786/4025] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:54:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:54:44.064752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-903baaab-ac1e-47eb-bc28-1533406092f3 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:44.065468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-903baaab-ac1e-47eb-bc28-1533406092f3 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] [instance: f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:44.175897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c904906f-c098-4234-8353-c687df855d93 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:44.185641 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c904906f-c098-4234-8353-c687df855d93 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1328 microversion: 2.1 time: 0.284601 Jul 28 03:54:44.199338 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2240/4026] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:43 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1328 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:44.336864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15b3c0b1-d2b3-40da-9a61-bacbb7520928 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:44.337599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15b3c0b1-d2b3-40da-9a61-bacbb7520928 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:44.351479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15b3c0b1-d2b3-40da-9a61-bacbb7520928 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:44.351941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15b3c0b1-d2b3-40da-9a61-bacbb7520928 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:44.352783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15b3c0b1-d2b3-40da-9a61-bacbb7520928 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:44.353222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15b3c0b1-d2b3-40da-9a61-bacbb7520928 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:44.503821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-15b3c0b1-d2b3-40da-9a61-bacbb7520928 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:44.514058 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15b3c0b1-d2b3-40da-9a61-bacbb7520928 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1274 microversion: 2.1 time: 0.181334 Jul 28 03:54:44.515384 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2241/4027] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:44 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:44.525762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8531ae7f-cb32-4d62-8607-eea511d64d89 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa6789d310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:44.615622 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8531ae7f-cb32-4d62-8607-eea511d64d89 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.099049 Jul 28 03:54:44.616702 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2242/4028] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:44 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:44.636444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dee7afee-e8ab-42db-bbbc-cda1716ef447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:44.637436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dee7afee-e8ab-42db-bbbc-cda1716ef447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:44.651114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dee7afee-e8ab-42db-bbbc-cda1716ef447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:44.654246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dee7afee-e8ab-42db-bbbc-cda1716ef447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:44.655878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dee7afee-e8ab-42db-bbbc-cda1716ef447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:44.656570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dee7afee-e8ab-42db-bbbc-cda1716ef447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:44.805687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-903baaab-ac1e-47eb-bc28-1533406092f3 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:44.816588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-903baaab-ac1e-47eb-bc28-1533406092f3 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:44.822766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-903baaab-ac1e-47eb-bc28-1533406092f3 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:44.824163 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-903baaab-ac1e-47eb-bc28-1533406092f3 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2" status: 200 len: 1281 microversion: 2.47 time: 0.785422 Jul 28 03:54:44.826431 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1787/4029] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:44 2022] GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 => generated 1281 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:44.890127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dee7afee-e8ab-42db-bbbc-cda1716ef447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:44.904363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dee7afee-e8ab-42db-bbbc-cda1716ef447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:44.906567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dee7afee-e8ab-42db-bbbc-cda1716ef447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:44.908747 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dee7afee-e8ab-42db-bbbc-cda1716ef447 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 0.276811 Jul 28 03:54:44.917688 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2243/4030] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:44 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:44.931792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0d1d468c-16f4-4064-9962-b7e5c8e84e0f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:44.932847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0d1d468c-16f4-4064-9962-b7e5c8e84e0f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:44.942401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d1d468c-16f4-4064-9962-b7e5c8e84e0f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:44.943118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d1d468c-16f4-4064-9962-b7e5c8e84e0f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:44.944676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d1d468c-16f4-4064-9962-b7e5c8e84e0f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:44.946325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d1d468c-16f4-4064-9962-b7e5c8e84e0f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:45.212266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-85260356-b1be-4876-8225-395b212868a0 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:45.215658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-85260356-b1be-4876-8225-395b212868a0 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:45.234244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85260356-b1be-4876-8225-395b212868a0 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:45.239611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85260356-b1be-4876-8225-395b212868a0 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:45.244390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85260356-b1be-4876-8225-395b212868a0 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:45.244851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85260356-b1be-4876-8225-395b212868a0 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:45.377384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0d1d468c-16f4-4064-9962-b7e5c8e84e0f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:45.389967 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0d1d468c-16f4-4064-9962-b7e5c8e84e0f tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1367 microversion: 2.1 time: 0.463889 Jul 28 03:54:45.393510 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1788/4031] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:44 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1367 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:45.482854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-85260356-b1be-4876-8225-395b212868a0 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:45.491493 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-85260356-b1be-4876-8225-395b212868a0 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1328 microversion: 2.1 time: 0.287990 Jul 28 03:54:45.494294 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2244/4032] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:45 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1328 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:45.535922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8df148d4-b9ac-4f32-b82d-9b9d1dad1e3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:45.536888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8df148d4-b9ac-4f32-b82d-9b9d1dad1e3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:45.548520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8df148d4-b9ac-4f32-b82d-9b9d1dad1e3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:45.549027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8df148d4-b9ac-4f32-b82d-9b9d1dad1e3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:45.550013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8df148d4-b9ac-4f32-b82d-9b9d1dad1e3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:45.550458 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8df148d4-b9ac-4f32-b82d-9b9d1dad1e3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:45.630811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4899f39d-a3fd-4cb1-bf35-f00e01e72809 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa678b90d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:45.681745 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4899f39d-a3fd-4cb1-bf35-f00e01e72809 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.054891 Jul 28 03:54:45.682865 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2245/4033] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:45 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:45.850153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4fc87b6a-b682-4753-b295-ce8fb4c8bb24 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:45.850593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4fc87b6a-b682-4753-b295-ce8fb4c8bb24 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] [instance: f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:45.868682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4fc87b6a-b682-4753-b295-ce8fb4c8bb24 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:45.869462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4fc87b6a-b682-4753-b295-ce8fb4c8bb24 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:45.870447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4fc87b6a-b682-4753-b295-ce8fb4c8bb24 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:45.871057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4fc87b6a-b682-4753-b295-ce8fb4c8bb24 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:45.991855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4fc87b6a-b682-4753-b295-ce8fb4c8bb24 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:46.003720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4fc87b6a-b682-4753-b295-ce8fb4c8bb24 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:46.015843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4fc87b6a-b682-4753-b295-ce8fb4c8bb24 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:46.022820 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4fc87b6a-b682-4753-b295-ce8fb4c8bb24 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2" status: 200 len: 1277 microversion: 2.47 time: 0.176933 Jul 28 03:54:46.030987 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2246/4034] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:45 2022] GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:54:46.060704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9b111beb-e796-42d1-8d0c-27c33bc46c52 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:46.061540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9b111beb-e796-42d1-8d0c-27c33bc46c52 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:46.079484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b111beb-e796-42d1-8d0c-27c33bc46c52 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:46.080148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b111beb-e796-42d1-8d0c-27c33bc46c52 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:46.081161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b111beb-e796-42d1-8d0c-27c33bc46c52 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:46.081611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b111beb-e796-42d1-8d0c-27c33bc46c52 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:46.289278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8df148d4-b9ac-4f32-b82d-9b9d1dad1e3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:46.305636 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8df148d4-b9ac-4f32-b82d-9b9d1dad1e3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1316 microversion: 2.1 time: 0.774085 Jul 28 03:54:46.318955 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1789/4035] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:45 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1316 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:46.411658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f4db3295-84ef-4ccf-8be7-8882835b54a4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:46.412303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f4db3295-84ef-4ccf-8be7-8882835b54a4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:46.422685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f4db3295-84ef-4ccf-8be7-8882835b54a4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:46.423146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f4db3295-84ef-4ccf-8be7-8882835b54a4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:46.435446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f4db3295-84ef-4ccf-8be7-8882835b54a4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:46.440106 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f4db3295-84ef-4ccf-8be7-8882835b54a4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:46.572943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9b111beb-e796-42d1-8d0c-27c33bc46c52 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:46.594393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9b111beb-e796-42d1-8d0c-27c33bc46c52 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:46.598137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9b111beb-e796-42d1-8d0c-27c33bc46c52 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:46.603020 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9b111beb-e796-42d1-8d0c-27c33bc46c52 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 0.567575 Jul 28 03:54:46.603908 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2247/4036] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:46 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:46.618375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43965e6f-8ae9-4342-96aa-ff4224fd1230 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:46.620155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-43965e6f-8ae9-4342-96aa-ff4224fd1230 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:46.647850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:46.654980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43965e6f-8ae9-4342-96aa-ff4224fd1230 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:46.657134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43965e6f-8ae9-4342-96aa-ff4224fd1230 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:46.658072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43965e6f-8ae9-4342-96aa-ff4224fd1230 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:46.658561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43965e6f-8ae9-4342-96aa-ff4224fd1230 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:47.262983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-43965e6f-8ae9-4342-96aa-ff4224fd1230 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:47.277381 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43965e6f-8ae9-4342-96aa-ff4224fd1230 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1328 microversion: 2.1 time: 0.668873 Jul 28 03:54:47.279208 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2248/4037] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:46 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1328 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:47.297047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-342df339-ca6b-4621-a510-6999de61702f tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa67482af0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:47.362969 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-342df339-ca6b-4621-a510-6999de61702f tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.081405 Jul 28 03:54:47.363568 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2249/4038] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:47 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:47.383539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fceffe19-6faa-4601-a38a-50ee0a51915b tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:47.385075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fceffe19-6faa-4601-a38a-50ee0a51915b tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] [instance: f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:47.404873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fceffe19-6faa-4601-a38a-50ee0a51915b tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:47.406590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fceffe19-6faa-4601-a38a-50ee0a51915b tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:47.406832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fceffe19-6faa-4601-a38a-50ee0a51915b tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:47.407512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fceffe19-6faa-4601-a38a-50ee0a51915b tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:47.667627 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f4db3295-84ef-4ccf-8be7-8882835b54a4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:47.678087 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f4db3295-84ef-4ccf-8be7-8882835b54a4 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1367 microversion: 2.1 time: 1.270539 Jul 28 03:54:47.684256 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1790/4039] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:46 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1367 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:47.698098 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-85aa6b2a-1391-461b-b8d5-69c81e956134 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:47.699009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-85aa6b2a-1391-461b-b8d5-69c81e956134 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:47.706487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-85aa6b2a-1391-461b-b8d5-69c81e956134 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:47.707367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-85aa6b2a-1391-461b-b8d5-69c81e956134 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:47.708501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-85aa6b2a-1391-461b-b8d5-69c81e956134 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:47.709226 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-85aa6b2a-1391-461b-b8d5-69c81e956134 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:48.089883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fceffe19-6faa-4601-a38a-50ee0a51915b tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:48.126087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fceffe19-6faa-4601-a38a-50ee0a51915b tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:48.130916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fceffe19-6faa-4601-a38a-50ee0a51915b tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:48.133585 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fceffe19-6faa-4601-a38a-50ee0a51915b tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2" status: 200 len: 1339 microversion: 2.47 time: 0.761421 Jul 28 03:54:48.151938 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2250/4040] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:47 2022] GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 => generated 1339 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:48.157084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b18f6841-0218-4dd3-8d19-8fb9e0ee7ea5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:48.157829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b18f6841-0218-4dd3-8d19-8fb9e0ee7ea5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:48.175058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b18f6841-0218-4dd3-8d19-8fb9e0ee7ea5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:48.175710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b18f6841-0218-4dd3-8d19-8fb9e0ee7ea5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:48.176690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b18f6841-0218-4dd3-8d19-8fb9e0ee7ea5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:48.178641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b18f6841-0218-4dd3-8d19-8fb9e0ee7ea5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:48.262557 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-85aa6b2a-1391-461b-b8d5-69c81e956134 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:48.312324 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-85aa6b2a-1391-461b-b8d5-69c81e956134 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1316 microversion: 2.1 time: 0.613262 Jul 28 03:54:48.317967 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1791/4041] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:47 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1316 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:48.332828 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-6fbe33d2-a75a-4ced-a119-2f30244cefab req-2547faf8-ac22-45b3-b473-2cea757d7a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091c0997-537d-4124-9945-1ef1dd079d63", "name": "network-vif-plugged", "status": "completed", "tag": "c5b8c623-1fc8-4425-b1c1-c5da71e14c34"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:48.363765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-6fbe33d2-a75a-4ced-a119-2f30244cefab req-2547faf8-ac22-45b3-b473-2cea757d7a15 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:48.364448 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-6fbe33d2-a75a-4ced-a119-2f30244cefab req-2547faf8-ac22-45b3-b473-2cea757d7a15 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:48.418783 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-6fbe33d2-a75a-4ced-a119-2f30244cefab req-2547faf8-ac22-45b3-b473-2cea757d7a15 service nova] Creating event network-vif-plugged:c5b8c623-1fc8-4425-b1c1-c5da71e14c34 for instance 091c0997-537d-4124-9945-1ef1dd079d63 on n-h1-826756-3 Jul 28 03:54:48.439696 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-6fbe33d2-a75a-4ced-a119-2f30244cefab req-2547faf8-ac22-45b3-b473-2cea757d7a15 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118996 Jul 28 03:54:48.444635 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1792/4042] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:48.462350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-4062ef84-b382-426a-b6c8-2540eb63ab7d req-a9e0e9fd-4f75-41bd-8a92-1c9bee5dee87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a04170d-7c69-4efa-8141-d243feb5c41b", "tag": "86249602-9c2e-448f-acf5-aca733cedbd0"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:48.508907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4062ef84-b382-426a-b6c8-2540eb63ab7d req-a9e0e9fd-4f75-41bd-8a92-1c9bee5dee87 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:48.511193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4062ef84-b382-426a-b6c8-2540eb63ab7d req-a9e0e9fd-4f75-41bd-8a92-1c9bee5dee87 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:48.559343 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-4062ef84-b382-426a-b6c8-2540eb63ab7d req-a9e0e9fd-4f75-41bd-8a92-1c9bee5dee87 service nova] Creating event network-changed:86249602-9c2e-448f-acf5-aca733cedbd0 for instance 0a04170d-7c69-4efa-8141-d243feb5c41b on n-h2-826756-3 Jul 28 03:54:48.605280 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-4062ef84-b382-426a-b6c8-2540eb63ab7d req-a9e0e9fd-4f75-41bd-8a92-1c9bee5dee87 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158749 Jul 28 03:54:48.612052 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1793/4043] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:48.649926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-38447363-703d-4636-9ce4-abd0674c4852 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:48.652660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-38447363-703d-4636-9ce4-abd0674c4852 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:48.678689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38447363-703d-4636-9ce4-abd0674c4852 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:48.679310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38447363-703d-4636-9ce4-abd0674c4852 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:48.686230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38447363-703d-4636-9ce4-abd0674c4852 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:48.686868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38447363-703d-4636-9ce4-abd0674c4852 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:48.850153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:48.944062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:49.347681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b18f6841-0218-4dd3-8d19-8fb9e0ee7ea5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:49.360439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b18f6841-0218-4dd3-8d19-8fb9e0ee7ea5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:49.363720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b18f6841-0218-4dd3-8d19-8fb9e0ee7ea5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:49.365870 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b18f6841-0218-4dd3-8d19-8fb9e0ee7ea5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 1.220418 Jul 28 03:54:49.369892 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2251/4044] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:48 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:49.394193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-264f5229-ef93-4017-bf6f-1316522632d7 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa677758b0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:49.460171 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-264f5229-ef93-4017-bf6f-1316522632d7 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.087718 Jul 28 03:54:49.460762 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2252/4045] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:49 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:49.473757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abdd5f45-71ad-4fa0-af55-823578ac1cdc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:49.474555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-abdd5f45-71ad-4fa0-af55-823578ac1cdc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:49.482260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abdd5f45-71ad-4fa0-af55-823578ac1cdc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:49.483329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abdd5f45-71ad-4fa0-af55-823578ac1cdc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:49.484448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abdd5f45-71ad-4fa0-af55-823578ac1cdc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:49.485008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abdd5f45-71ad-4fa0-af55-823578ac1cdc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:49.527501 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-abdd5f45-71ad-4fa0-af55-823578ac1cdc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abdd5f45-71ad-4fa0-af55-823578ac1cdc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 HTTP/1.1 Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c47b71f0-424f-4b3b-ae6c-9f38a83a43e0'} Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:49.529620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:49.536789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:54:49.536789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:49.536789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:49.536789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:49.536789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:49.536789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:49.536789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:49.536789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:49.536789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:49.536789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:54:49.536789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:49.536789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abdd5f45-71ad-4fa0-af55-823578ac1cdc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:49.539472 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-abdd5f45-71ad-4fa0-af55-823578ac1cdc tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 404 len: 111 microversion: 2.1 time: 0.076551 Jul 28 03:54:49.543341 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2253/4046] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:54:49 2022] DELETE /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:49.546749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a546ccc-0c69-4b57-b2d4-26f5537773cb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:49.547571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7a546ccc-0c69-4b57-b2d4-26f5537773cb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:49.557199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a546ccc-0c69-4b57-b2d4-26f5537773cb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:49.557805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a546ccc-0c69-4b57-b2d4-26f5537773cb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:49.558708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a546ccc-0c69-4b57-b2d4-26f5537773cb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:49.559521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a546ccc-0c69-4b57-b2d4-26f5537773cb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:49.763034 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-38447363-703d-4636-9ce4-abd0674c4852 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:49.776094 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-38447363-703d-4636-9ce4-abd0674c4852 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1328 microversion: 2.1 time: 1.158480 Jul 28 03:54:49.785148 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1794/4047] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:48 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1328 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:49.803274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5272f43e-ba0c-475d-be65-24352f37acdb tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:49.803908 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5272f43e-ba0c-475d-be65-24352f37acdb tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] [instance: f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:49.827513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5272f43e-ba0c-475d-be65-24352f37acdb tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:49.829729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5272f43e-ba0c-475d-be65-24352f37acdb tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:49.830652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5272f43e-ba0c-475d-be65-24352f37acdb tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:49.831097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5272f43e-ba0c-475d-be65-24352f37acdb tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:49.908957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a546ccc-0c69-4b57-b2d4-26f5537773cb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:49.919125 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7a546ccc-0c69-4b57-b2d4-26f5537773cb tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1367 microversion: 2.1 time: 0.377180 Jul 28 03:54:49.925626 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2254/4048] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:49 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:49.955243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eee0c04a-1ef4-4a89-b2f8-4e390e1ada29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:49.956691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eee0c04a-1ef4-4a89-b2f8-4e390e1ada29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:49.972057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eee0c04a-1ef4-4a89-b2f8-4e390e1ada29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:49.973146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eee0c04a-1ef4-4a89-b2f8-4e390e1ada29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:49.994958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eee0c04a-1ef4-4a89-b2f8-4e390e1ada29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:49.995561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eee0c04a-1ef4-4a89-b2f8-4e390e1ada29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:50.160390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5272f43e-ba0c-475d-be65-24352f37acdb tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:50.180252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5272f43e-ba0c-475d-be65-24352f37acdb tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:50.182257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5272f43e-ba0c-475d-be65-24352f37acdb tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:50.191254 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5272f43e-ba0c-475d-be65-24352f37acdb tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2" status: 200 len: 1360 microversion: 2.47 time: 0.402632 Jul 28 03:54:50.197081 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1795/4049] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:49 2022] GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 => generated 1360 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:50.215845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-92747248-a4b3-458f-9d91-0589a7cb736d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:50.221148 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-92747248-a4b3-458f-9d91-0589a7cb736d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: c47b71f0-424f-4b3b-ae6c-9f38a83a43e0] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:50.248671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92747248-a4b3-458f-9d91-0589a7cb736d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:50.256511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92747248-a4b3-458f-9d91-0589a7cb736d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:50.261725 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92747248-a4b3-458f-9d91-0589a7cb736d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:50.262464 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92747248-a4b3-458f-9d91-0589a7cb736d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:50.309416 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-92747248-a4b3-458f-9d91-0589a7cb736d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-92747248-a4b3-458f-9d91-0589a7cb736d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 HTTP/1.1 Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'c47b71f0-424f-4b3b-ae6c-9f38a83a43e0'} Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:50.311508 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:50.316708 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:50.316708 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:50.316708 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:50.316708 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:50.316708 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:50.316708 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. Jul 28 03:54:50.316708 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:50.321530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-92747248-a4b3-458f-9d91-0589a7cb736d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:50.322667 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-92747248-a4b3-458f-9d91-0589a7cb736d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0" status: 404 len: 111 microversion: 2.1 time: 0.122795 Jul 28 03:54:50.324758 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1796/4050] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:50 2022] GET /compute/v2.1/servers/c47b71f0-424f-4b3b-ae6c-9f38a83a43e0 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:50.336770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2ef962e7-c241-48d7-aacc-541affec84ab tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2028121552"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:50.346218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2ef962e7-c241-48d7-aacc-541affec84ab tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] [instance: f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:50.365942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ef962e7-c241-48d7-aacc-541affec84ab tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:50.375257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ef962e7-c241-48d7-aacc-541affec84ab tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:50.376482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ef962e7-c241-48d7-aacc-541affec84ab tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:50.377094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ef962e7-c241-48d7-aacc-541affec84ab tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:50.435736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:50.971945 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2ef962e7-c241-48d7-aacc-541affec84ab tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] 10.222.0.48 "POST /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2/action" status: 202 len: 52 microversion: 2.47 time: 0.644155 Jul 28 03:54:50.981378 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1797/4051] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 03:54:50 2022] POST /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2/action => generated 52 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 28 03:54:50.999705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1b3cd91d-4d2c-47b7-8a0e-69feb1adef9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:51.000322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1b3cd91d-4d2c-47b7-8a0e-69feb1adef9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:51.022748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b3cd91d-4d2c-47b7-8a0e-69feb1adef9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:51.023261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b3cd91d-4d2c-47b7-8a0e-69feb1adef9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:51.024034 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b3cd91d-4d2c-47b7-8a0e-69feb1adef9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:51.024509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b3cd91d-4d2c-47b7-8a0e-69feb1adef9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:51.078549 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-1b3cd91d-4d2c-47b7-8a0e-69feb1adef9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1b3cd91d-4d2c-47b7-8a0e-69feb1adef9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 HTTP/1.1 Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'df82d7cd-a14e-41f7-8d5b-59e62a9a4352'} Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:51.080303 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:51.086302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:54:51.086302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:51.086302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:51.086302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:51.086302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:51.086302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:51.086302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:51.086302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:51.086302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:51.086302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:54:51.086302 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:51.086302 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1b3cd91d-4d2c-47b7-8a0e-69feb1adef9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:51.086302 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1b3cd91d-4d2c-47b7-8a0e-69feb1adef9d tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "DELETE /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 404 len: 111 microversion: 2.1 time: 0.091532 Jul 28 03:54:51.090903 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1798/4052] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:54:50 2022] DELETE /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:51.101774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4c502c38-8258-4cf8-bdee-a83e43755d5c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:51.102591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4c502c38-8258-4cf8-bdee-a83e43755d5c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:51.119482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c502c38-8258-4cf8-bdee-a83e43755d5c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:51.119937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c502c38-8258-4cf8-bdee-a83e43755d5c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:51.126588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c502c38-8258-4cf8-bdee-a83e43755d5c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:51.127103 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c502c38-8258-4cf8-bdee-a83e43755d5c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:51.728576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4c502c38-8258-4cf8-bdee-a83e43755d5c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:51.739457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4c502c38-8258-4cf8-bdee-a83e43755d5c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:51.741738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4c502c38-8258-4cf8-bdee-a83e43755d5c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:51.743266 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4c502c38-8258-4cf8-bdee-a83e43755d5c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 0.651266 Jul 28 03:54:51.759174 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1799/4053] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:51 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:51.766356 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-83aaa0f7-fbad-468c-90b6-83ab5c2d2627 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa749cbd30>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:51.826235 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-83aaa0f7-fbad-468c-90b6-83ab5c2d2627 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.064595 Jul 28 03:54:51.834567 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1800/4054] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:51 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:51.840418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-54dbe5d6-68d3-4d9e-b4e2-7db147668ee8 req-5399313b-9479-4270-94ea-462f2d97758a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ca573b-83e4-413b-817d-e8379dd57e68", "tag": "3cb9b533-8415-43e1-aa30-e19706ae27ec"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:51.856372 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-54dbe5d6-68d3-4d9e-b4e2-7db147668ee8 req-5399313b-9479-4270-94ea-462f2d97758a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:51.857562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-54dbe5d6-68d3-4d9e-b4e2-7db147668ee8 req-5399313b-9479-4270-94ea-462f2d97758a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:51.873630 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-54dbe5d6-68d3-4d9e-b4e2-7db147668ee8 req-5399313b-9479-4270-94ea-462f2d97758a service nova] Creating event network-changed:3cb9b533-8415-43e1-aa30-e19706ae27ec for instance b3ca573b-83e4-413b-817d-e8379dd57e68 on n-h2-826756-3 Jul 28 03:54:51.892019 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-54dbe5d6-68d3-4d9e-b4e2-7db147668ee8 req-5399313b-9479-4270-94ea-462f2d97758a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045015 Jul 28 03:54:51.897112 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1801/4055] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:51.916861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0b9b1a6f-9872-4519-bcde-5b14eaf53377 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:51.918658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0b9b1a6f-9872-4519-bcde-5b14eaf53377 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:51.936863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b9b1a6f-9872-4519-bcde-5b14eaf53377 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:51.938846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b9b1a6f-9872-4519-bcde-5b14eaf53377 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:51.939988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b9b1a6f-9872-4519-bcde-5b14eaf53377 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:51.940737 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b9b1a6f-9872-4519-bcde-5b14eaf53377 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:52.010366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eee0c04a-1ef4-4a89-b2f8-4e390e1ada29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:52.026115 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eee0c04a-1ef4-4a89-b2f8-4e390e1ada29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1316 microversion: 2.1 time: 2.098932 Jul 28 03:54:52.029912 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2255/4056] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:49 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1316 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:52.036566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a1e2d55-3da7-4e8f-9aa0-1ccb11d62d6c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:52.037519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9a1e2d55-3da7-4e8f-9aa0-1ccb11d62d6c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:52.088139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a1e2d55-3da7-4e8f-9aa0-1ccb11d62d6c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:52.089011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a1e2d55-3da7-4e8f-9aa0-1ccb11d62d6c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:52.090262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a1e2d55-3da7-4e8f-9aa0-1ccb11d62d6c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:52.090854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a1e2d55-3da7-4e8f-9aa0-1ccb11d62d6c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:52.263367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0b9b1a6f-9872-4519-bcde-5b14eaf53377 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:52.275477 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0b9b1a6f-9872-4519-bcde-5b14eaf53377 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1328 microversion: 2.1 time: 0.374029 Jul 28 03:54:52.276824 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1802/4057] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:51 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1328 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:52.281877 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-294a3f7c-1d96-4102-8945-bc7c51703aef tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:52.282809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-294a3f7c-1d96-4102-8945-bc7c51703aef tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] [instance: f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:52.289975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-294a3f7c-1d96-4102-8945-bc7c51703aef tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:52.290750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-294a3f7c-1d96-4102-8945-bc7c51703aef tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:52.291773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-294a3f7c-1d96-4102-8945-bc7c51703aef tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:52.292611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-294a3f7c-1d96-4102-8945-bc7c51703aef tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:52.338586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-294a3f7c-1d96-4102-8945-bc7c51703aef tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] [instance: f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:54:52.506844 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-294a3f7c-1d96-4102-8945-bc7c51703aef tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2" status: 204 len: 0 microversion: 2.47 time: 0.228389 Jul 28 03:54:52.510735 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1803/4058] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:54:52 2022] DELETE /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:54:52.516444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-de8444b5-23fd-4376-b36b-ea7e9ee465bb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:52.517082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-de8444b5-23fd-4376-b36b-ea7e9ee465bb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] [instance: df82d7cd-a14e-41f7-8d5b-59e62a9a4352] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:52.551250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de8444b5-23fd-4376-b36b-ea7e9ee465bb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:52.551706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de8444b5-23fd-4376-b36b-ea7e9ee465bb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:52.553621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de8444b5-23fd-4376-b36b-ea7e9ee465bb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:52.554095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de8444b5-23fd-4376-b36b-ea7e9ee465bb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:52.585966 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-de8444b5-23fd-4376-b36b-ea7e9ee465bb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] HTTP exception thrown: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-de8444b5-23fd-4376-b36b-ea7e9ee465bb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Request method failure captured: Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 HTTP/1.1 Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gcUnidVD-kT9ScwKSFr1zBTLZOlaHfYJcQ6c4HJ6VzAHf6EsydHA54Tlto1uttPyfNNAjtJu5rQEG1V8WXyGzHCXQYYzrZs3-1VJuCxKTwfP7ZFLomZhJvlnwciOWGgcL9EbQItt8XaSIHm3995m7i08mBl0-sTgZowen6IY6MFI88 Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_34ed8cbcca694b8794992388d95bf072"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/34ed8cbcca694b8794992388d95bf072"}]}] Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 34ed8cbcca694b8794992388d95bf072 Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-DeleteServersTestJSON-2011165869 Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 67fcd8c3ec5441e582a4852f0f1184b6 Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-DeleteServersTestJSON-2011165869-project Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'df82d7cd-a14e-41f7-8d5b-59e62a9a4352'} Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:52.593441 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:52.598389 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:52.598389 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:52.598389 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:52.598389 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:52.598389 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:52.598389 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. Jul 28 03:54:52.598389 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:54:52.598389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-de8444b5-23fd-4376-b36b-ea7e9ee465bb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] Returning 404 to user: Instance df82d7cd-a14e-41f7-8d5b-59e62a9a4352 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:52.598389 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-de8444b5-23fd-4376-b36b-ea7e9ee465bb tempest-DeleteServersTestJSON-2011165869 tempest-DeleteServersTestJSON-2011165869-project] 10.222.0.48 "GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352" status: 404 len: 111 microversion: 2.1 time: 0.083066 Jul 28 03:54:52.605551 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1804/4059] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:52 2022] GET /compute/v2.1/servers/df82d7cd-a14e-41f7-8d5b-59e62a9a4352 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:54:52.627549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-f24f5295-e5fc-41a6-9949-b86baaf82af4 req-a83fdcdc-a5c2-4d7f-a207-f0022cf789c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d0126e-11bf-4048-9e35-7309c228b534", "name": "network-vif-plugged", "status": "completed", "tag": "f15c48dd-54c1-4291-88c3-ac0923fa48e7"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:52.650441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f24f5295-e5fc-41a6-9949-b86baaf82af4 req-a83fdcdc-a5c2-4d7f-a207-f0022cf789c0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:52.650880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f24f5295-e5fc-41a6-9949-b86baaf82af4 req-a83fdcdc-a5c2-4d7f-a207-f0022cf789c0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:52.687638 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-f24f5295-e5fc-41a6-9949-b86baaf82af4 req-a83fdcdc-a5c2-4d7f-a207-f0022cf789c0 service nova] Creating event network-vif-plugged:f15c48dd-54c1-4291-88c3-ac0923fa48e7 for instance 99d0126e-11bf-4048-9e35-7309c228b534 on n-h1-826756-3 Jul 28 03:54:52.698302 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-f24f5295-e5fc-41a6-9949-b86baaf82af4 req-a83fdcdc-a5c2-4d7f-a207-f0022cf789c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084357 Jul 28 03:54:52.704025 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1805/4060] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:52.710965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bc0d6202-f6e7-439d-8c3b-bfb21955efcc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:52.711979 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bc0d6202-f6e7-439d-8c3b-bfb21955efcc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] [instance: f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:52.725745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc0d6202-f6e7-439d-8c3b-bfb21955efcc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:52.727219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc0d6202-f6e7-439d-8c3b-bfb21955efcc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:52.728460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc0d6202-f6e7-439d-8c3b-bfb21955efcc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:52.729134 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bc0d6202-f6e7-439d-8c3b-bfb21955efcc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:52.884045 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bc0d6202-f6e7-439d-8c3b-bfb21955efcc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:52.897646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bc0d6202-f6e7-439d-8c3b-bfb21955efcc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:52.898689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9a1e2d55-3da7-4e8f-9aa0-1ccb11d62d6c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:52.905206 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bc0d6202-f6e7-439d-8c3b-bfb21955efcc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:52.908308 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9a1e2d55-3da7-4e8f-9aa0-1ccb11d62d6c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1367 microversion: 2.1 time: 0.876731 Jul 28 03:54:52.911066 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bc0d6202-f6e7-439d-8c3b-bfb21955efcc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2" status: 200 len: 1366 microversion: 2.47 time: 0.203956 Jul 28 03:54:52.915276 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2256/4061] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:52 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1367 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:52.920588 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1806/4062] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:52 2022] GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:52.932313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ada1ce1-e43e-4351-8411-d1af5e27dae3 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:52.935011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ada1ce1-e43e-4351-8411-d1af5e27dae3 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:52.944185 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ff002a73-4a92-4410-9ce3-06f9711144f7 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa676e3ee0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:52.960866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ada1ce1-e43e-4351-8411-d1af5e27dae3 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:52.961633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ada1ce1-e43e-4351-8411-d1af5e27dae3 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:52.966135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ada1ce1-e43e-4351-8411-d1af5e27dae3 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:52.967816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ada1ce1-e43e-4351-8411-d1af5e27dae3 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:53.037650 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ff002a73-4a92-4410-9ce3-06f9711144f7 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.115577 Jul 28 03:54:53.045827 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1807/4063] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:52 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:53.060332 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f78f9003-c34b-41c5-8055-c58d7d23c35b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:53.060975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f78f9003-c34b-41c5-8055-c58d7d23c35b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:53.087639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f78f9003-c34b-41c5-8055-c58d7d23c35b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:53.088426 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f78f9003-c34b-41c5-8055-c58d7d23c35b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:53.089405 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f78f9003-c34b-41c5-8055-c58d7d23c35b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:53.090017 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f78f9003-c34b-41c5-8055-c58d7d23c35b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:53.301754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ada1ce1-e43e-4351-8411-d1af5e27dae3 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:53.305258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:53.337092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ada1ce1-e43e-4351-8411-d1af5e27dae3 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:53.337092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ada1ce1-e43e-4351-8411-d1af5e27dae3 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:53.356771 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ada1ce1-e43e-4351-8411-d1af5e27dae3 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 0.424266 Jul 28 03:54:53.387692 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2257/4064] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:52 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:53.402195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d7e70c31-7cfe-4fc9-a163-4ce73bc8cd9c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:53.406683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d7e70c31-7cfe-4fc9-a163-4ce73bc8cd9c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:53.423028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7e70c31-7cfe-4fc9-a163-4ce73bc8cd9c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:53.423908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7e70c31-7cfe-4fc9-a163-4ce73bc8cd9c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:53.425212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7e70c31-7cfe-4fc9-a163-4ce73bc8cd9c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:53.426267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7e70c31-7cfe-4fc9-a163-4ce73bc8cd9c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:53.870543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:53.873515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d7e70c31-7cfe-4fc9-a163-4ce73bc8cd9c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:53.883370 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d7e70c31-7cfe-4fc9-a163-4ce73bc8cd9c tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1328 microversion: 2.1 time: 0.493464 Jul 28 03:54:53.888445 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2258/4065] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:53 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1328 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:53.935881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f24c60bd-d931-4621-86f6-157ae8c08825 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:53.936996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f24c60bd-d931-4621-86f6-157ae8c08825 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:53.957182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f24c60bd-d931-4621-86f6-157ae8c08825 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:53.964263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f24c60bd-d931-4621-86f6-157ae8c08825 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:53.965281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f24c60bd-d931-4621-86f6-157ae8c08825 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:53.965740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f24c60bd-d931-4621-86f6-157ae8c08825 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:54.248826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f78f9003-c34b-41c5-8055-c58d7d23c35b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:54.258434 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f78f9003-c34b-41c5-8055-c58d7d23c35b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1316 microversion: 2.1 time: 1.211148 Jul 28 03:54:54.262164 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1808/4066] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:53 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1316 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:54.268779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-59e463b0-1c7f-4c01-bc13-92db09af2841 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:54.276620 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-59e463b0-1c7f-4c01-bc13-92db09af2841 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] [instance: f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:54.284648 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59e463b0-1c7f-4c01-bc13-92db09af2841 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:54.288894 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59e463b0-1c7f-4c01-bc13-92db09af2841 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:54.289970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59e463b0-1c7f-4c01-bc13-92db09af2841 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:54.292698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-59e463b0-1c7f-4c01-bc13-92db09af2841 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:54.343717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f24c60bd-d931-4621-86f6-157ae8c08825 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:54.362881 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f24c60bd-d931-4621-86f6-157ae8c08825 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1367 microversion: 2.1 time: 0.430930 Jul 28 03:54:54.369145 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2259/4067] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:53 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:54.386234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-71eed8ed-6acd-4f63-bcf0-dff22472c1d4 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa6789daf0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:54.466070 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-71eed8ed-6acd-4f63-bcf0-dff22472c1d4 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.095227 Jul 28 03:54:54.475728 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2260/4068] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:54 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:54.482018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-624916a5-0271-4090-96e9-27392308f099 req-a22ec280-8e9b-4784-b518-e56b7d47152a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d97b518-6a6e-44f8-9be3-940b6fa8c853", "tag": "9ce2e89e-838e-4b08-b1df-2e933c36e5d1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:54.484238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-59e463b0-1c7f-4c01-bc13-92db09af2841 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:54.499540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-59e463b0-1c7f-4c01-bc13-92db09af2841 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:54.500882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-624916a5-0271-4090-96e9-27392308f099 req-a22ec280-8e9b-4784-b518-e56b7d47152a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:54.501189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-59e463b0-1c7f-4c01-bc13-92db09af2841 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:54.502347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-624916a5-0271-4090-96e9-27392308f099 req-a22ec280-8e9b-4784-b518-e56b7d47152a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:54.502481 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-59e463b0-1c7f-4c01-bc13-92db09af2841 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2" status: 200 len: 1366 microversion: 2.47 time: 0.239046 Jul 28 03:54:54.503044 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1809/4069] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:54 2022] GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:54.512828 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7dc71a2d-fe17-47f1-8576-c6fdb536000b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:54.516232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7dc71a2d-fe17-47f1-8576-c6fdb536000b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:54.520981 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-624916a5-0271-4090-96e9-27392308f099 req-a22ec280-8e9b-4784-b518-e56b7d47152a service nova] Creating event network-changed:9ce2e89e-838e-4b08-b1df-2e933c36e5d1 for instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 on n-h1-826756-3 Jul 28 03:54:54.529165 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-624916a5-0271-4090-96e9-27392308f099 req-a22ec280-8e9b-4784-b518-e56b7d47152a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049265 Jul 28 03:54:54.530453 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2261/4070] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:54.532095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7dc71a2d-fe17-47f1-8576-c6fdb536000b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:54.532710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7dc71a2d-fe17-47f1-8576-c6fdb536000b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:54.533821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7dc71a2d-fe17-47f1-8576-c6fdb536000b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:54.534467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7dc71a2d-fe17-47f1-8576-c6fdb536000b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:54.815044 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=16 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:54.913945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a9ea9aa-f2ea-4d39-b168-cd22d5c82904 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:54.914721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8a9ea9aa-f2ea-4d39-b168-cd22d5c82904 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:54.926977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a9ea9aa-f2ea-4d39-b168-cd22d5c82904 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:54.932477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a9ea9aa-f2ea-4d39-b168-cd22d5c82904 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:54.934385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a9ea9aa-f2ea-4d39-b168-cd22d5c82904 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:54.939869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a9ea9aa-f2ea-4d39-b168-cd22d5c82904 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:55.187444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7dc71a2d-fe17-47f1-8576-c6fdb536000b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:55.200210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7dc71a2d-fe17-47f1-8576-c6fdb536000b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:55.201505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7dc71a2d-fe17-47f1-8576-c6fdb536000b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:55.202711 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7dc71a2d-fe17-47f1-8576-c6fdb536000b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 0.698732 Jul 28 03:54:55.203286 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1810/4071] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:54 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:55.282764 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-434a8f3f-10a7-4d33-a65d-9d32ec2f6c45 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:55.283918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-434a8f3f-10a7-4d33-a65d-9d32ec2f6c45 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:55.297716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-434a8f3f-10a7-4d33-a65d-9d32ec2f6c45 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:55.298676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-434a8f3f-10a7-4d33-a65d-9d32ec2f6c45 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:55.299819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-434a8f3f-10a7-4d33-a65d-9d32ec2f6c45 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:55.300508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-434a8f3f-10a7-4d33-a65d-9d32ec2f6c45 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:55.311086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a9ea9aa-f2ea-4d39-b168-cd22d5c82904 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:55.319686 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a9ea9aa-f2ea-4d39-b168-cd22d5c82904 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1328 microversion: 2.1 time: 0.410338 Jul 28 03:54:55.336911 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2262/4072] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:54 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1328 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:55.393094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-198a8ca7-7d12-4677-b520-5386b602e447 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:55.393811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-198a8ca7-7d12-4677-b520-5386b602e447 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:55.403745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-198a8ca7-7d12-4677-b520-5386b602e447 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:55.406941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-198a8ca7-7d12-4677-b520-5386b602e447 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:55.408483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-198a8ca7-7d12-4677-b520-5386b602e447 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:55.411703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-198a8ca7-7d12-4677-b520-5386b602e447 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:55.689477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-434a8f3f-10a7-4d33-a65d-9d32ec2f6c45 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:55.699039 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-434a8f3f-10a7-4d33-a65d-9d32ec2f6c45 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1316 microversion: 2.1 time: 0.420648 Jul 28 03:54:55.699560 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1811/4073] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:55 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:55.709083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8a8be2f7-c60c-44a0-8b4b-4cddd90c651e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa74653ee0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:55.793414 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8a8be2f7-c60c-44a0-8b4b-4cddd90c651e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.088283 Jul 28 03:54:55.794644 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1812/4074] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:55 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:55.800613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ac9f6e08-7b06-4d46-a92a-d0010422f7a9 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:55.802303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ac9f6e08-7b06-4d46-a92a-d0010422f7a9 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] [instance: f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:55.814110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac9f6e08-7b06-4d46-a92a-d0010422f7a9 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:55.814945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac9f6e08-7b06-4d46-a92a-d0010422f7a9 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:55.816688 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac9f6e08-7b06-4d46-a92a-d0010422f7a9 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:55.817679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac9f6e08-7b06-4d46-a92a-d0010422f7a9 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:55.843436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-198a8ca7-7d12-4677-b520-5386b602e447 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:55.857669 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-198a8ca7-7d12-4677-b520-5386b602e447 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1367 microversion: 2.1 time: 0.468085 Jul 28 03:54:55.866502 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2263/4075] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:55 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:55.953394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ac9f6e08-7b06-4d46-a92a-d0010422f7a9 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:55.980630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ac9f6e08-7b06-4d46-a92a-d0010422f7a9 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:55.982584 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ac9f6e08-7b06-4d46-a92a-d0010422f7a9 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b14967aa01c64eef9ef842a89b919e26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abc63a5432844a94ace433430d2ad697', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:55.984211 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ac9f6e08-7b06-4d46-a92a-d0010422f7a9 tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2" status: 200 len: 1366 microversion: 2.47 time: 0.188055 Jul 28 03:54:55.985374 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1813/4076] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:55 2022] GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:56.228391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0920b215-5a0d-4804-9149-cafbc1ab3113 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:56.229123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0920b215-5a0d-4804-9149-cafbc1ab3113 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:56.251923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0920b215-5a0d-4804-9149-cafbc1ab3113 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:56.260751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0920b215-5a0d-4804-9149-cafbc1ab3113 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:56.262570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0920b215-5a0d-4804-9149-cafbc1ab3113 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:56.269706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0920b215-5a0d-4804-9149-cafbc1ab3113 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:56.348201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ce7721c3-129e-488a-97b7-66ca6f28931a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:56.349720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ce7721c3-129e-488a-97b7-66ca6f28931a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:56.363015 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce7721c3-129e-488a-97b7-66ca6f28931a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:56.370096 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce7721c3-129e-488a-97b7-66ca6f28931a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:56.376016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce7721c3-129e-488a-97b7-66ca6f28931a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:56.380081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce7721c3-129e-488a-97b7-66ca6f28931a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:56.786374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ce7721c3-129e-488a-97b7-66ca6f28931a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:56.801992 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ce7721c3-129e-488a-97b7-66ca6f28931a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1328 microversion: 2.1 time: 0.457972 Jul 28 03:54:56.824969 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1814/4077] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:56 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1328 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:56.843491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0857b37c-c562-4ea8-b8ee-92b00fbc223c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:56.844109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0857b37c-c562-4ea8-b8ee-92b00fbc223c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:56.858527 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0857b37c-c562-4ea8-b8ee-92b00fbc223c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:56.858981 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0857b37c-c562-4ea8-b8ee-92b00fbc223c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:56.859767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0857b37c-c562-4ea8-b8ee-92b00fbc223c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:56.860199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0857b37c-c562-4ea8-b8ee-92b00fbc223c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:56.901636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0920b215-5a0d-4804-9149-cafbc1ab3113 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:56.913467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0920b215-5a0d-4804-9149-cafbc1ab3113 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:56.923153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0920b215-5a0d-4804-9149-cafbc1ab3113 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:56.927510 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0920b215-5a0d-4804-9149-cafbc1ab3113 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1810 microversion: 2.20 time: 0.702009 Jul 28 03:54:56.930134 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2264/4078] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:56 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1810 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:56.942614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca2af8f8-8a0f-4772-9ba5-0f6fa4fefe71 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa674829d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:57.491482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0857b37c-c562-4ea8-b8ee-92b00fbc223c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:57.517871 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0857b37c-c562-4ea8-b8ee-92b00fbc223c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1316 microversion: 2.1 time: 0.686894 Jul 28 03:54:57.531830 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1815/4079] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:56 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1316 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:57.537258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-172ffd5e-e38f-4b87-8a89-bd409fe24a32 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:57.550912 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-172ffd5e-e38f-4b87-8a89-bd409fe24a32 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:57.559833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-172ffd5e-e38f-4b87-8a89-bd409fe24a32 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:57.560664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-172ffd5e-e38f-4b87-8a89-bd409fe24a32 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:57.561880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-172ffd5e-e38f-4b87-8a89-bd409fe24a32 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:57.562661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-172ffd5e-e38f-4b87-8a89-bd409fe24a32 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:57.605607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:57.746652 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca2af8f8-8a0f-4772-9ba5-0f6fa4fefe71 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.815028 Jul 28 03:54:57.749772 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2265/4080] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:56 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:57.767792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e6fdc22c-54f1-4f03-87a2-2b500f8ce4cc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:57.770079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e6fdc22c-54f1-4f03-87a2-2b500f8ce4cc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] [instance: f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:57.819314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6fdc22c-54f1-4f03-87a2-2b500f8ce4cc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:57.822436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6fdc22c-54f1-4f03-87a2-2b500f8ce4cc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:57.825655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6fdc22c-54f1-4f03-87a2-2b500f8ce4cc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:57.831414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6fdc22c-54f1-4f03-87a2-2b500f8ce4cc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:57.886460 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e6fdc22c-54f1-4f03-87a2-2b500f8ce4cc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] HTTP exception thrown: Instance f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 could not be found. Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e6fdc22c-54f1-4f03-87a2-2b500f8ce4cc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Request method failure captured: Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 HTTP/1.1 Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4giCq0vpmjy1iS6fV0OCZ_vBBMaalrUhqxF-7BI7cNWiab0yu-1V4sJHSn0Q7Z1S_U9i5FrDR-ToIcd_rFC-qZM8XekNCyGhv8uzWV-ZL6kAMYHNklG1JtFV11xyCYCkzs3pGZJM66YGiE6fubum5nPZK0veyRPX0PvIP74bpY2MJVc Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.47 Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: abc63a5432844a94ace433430d2ad697 Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersAaction247Test-1134668604 Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/abc63a5432844a94ace433430d2ad697"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abc63a5432844a94ace433430d2ad697"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_abc63a5432844a94ace433430d2ad697"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/abc63a5432844a94ace433430d2ad697"}]}] Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersAaction247Test-1134668604 Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: abc63a5432844a94ace433430d2ad697 Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersAaction247Test-1134668604 Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersAaction247Test-1134668604-project Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: b14967aa01c64eef9ef842a89b919e26 Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersAaction247Test-1134668604-project Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 could not be found. Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2'} Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 could not be found. Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 could not be found. Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:54:57.891934 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:57.898058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:54:57.898058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:54:57.898058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:54:57.898058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:54:57.898058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:54:57.898058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 could not be found. Jul 28 03:54:57.898058 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:54:57.902963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e6fdc22c-54f1-4f03-87a2-2b500f8ce4cc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] Returning 404 to user: Instance f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:54:57.908317 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e6fdc22c-54f1-4f03-87a2-2b500f8ce4cc tempest-ServersAaction247Test-1134668604 tempest-ServersAaction247Test-1134668604-project] 10.222.0.48 "GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2" status: 404 len: 111 microversion: 2.47 time: 0.154457 Jul 28 03:54:57.911131 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2266/4081] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:57 2022] GET /compute/v2.1/servers/f7a3e74e-caf8-4d6b-9fb5-ebf51287a9a2 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:54:57.945258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d12b8e4-eade-4008-8771-1cc7e98f627a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:57.947370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8d12b8e4-eade-4008-8771-1cc7e98f627a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:57.975062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d12b8e4-eade-4008-8771-1cc7e98f627a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:57.978622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d12b8e4-eade-4008-8771-1cc7e98f627a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:57.984465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d12b8e4-eade-4008-8771-1cc7e98f627a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:57.986436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d12b8e4-eade-4008-8771-1cc7e98f627a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:58.361505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8d12b8e4-eade-4008-8771-1cc7e98f627a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:58.377172 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8d12b8e4-eade-4008-8771-1cc7e98f627a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1328 microversion: 2.1 time: 0.463256 Jul 28 03:54:58.392929 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2267/4082] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:57 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1328 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:58.400245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6b1276de-1024-43e2-a1fe-c4c28c44944a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:58.403343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6b1276de-1024-43e2-a1fe-c4c28c44944a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:58.420225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b1276de-1024-43e2-a1fe-c4c28c44944a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:58.421264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b1276de-1024-43e2-a1fe-c4c28c44944a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:58.422476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b1276de-1024-43e2-a1fe-c4c28c44944a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:58.424935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b1276de-1024-43e2-a1fe-c4c28c44944a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:58.645696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-172ffd5e-e38f-4b87-8a89-bd409fe24a32 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:58.662597 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-172ffd5e-e38f-4b87-8a89-bd409fe24a32 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1367 microversion: 2.1 time: 1.129143 Jul 28 03:54:58.663546 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1816/4083] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:57 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1367 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:58.672221 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-7372e8be-7fbf-41d9-a405-057ae33ddb6d req-448aea4b-f610-4ebc-80b3-a916ff13eb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d97b518-6a6e-44f8-9be3-940b6fa8c853", "name": "network-vif-plugged", "status": "completed", "tag": "9ce2e89e-838e-4b08-b1df-2e933c36e5d1"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:54:58.695479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-7372e8be-7fbf-41d9-a405-057ae33ddb6d req-448aea4b-f610-4ebc-80b3-a916ff13eb35 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:58.695921 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-7372e8be-7fbf-41d9-a405-057ae33ddb6d req-448aea4b-f610-4ebc-80b3-a916ff13eb35 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:58.717984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6b1276de-1024-43e2-a1fe-c4c28c44944a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:58.725029 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-7372e8be-7fbf-41d9-a405-057ae33ddb6d req-448aea4b-f610-4ebc-80b3-a916ff13eb35 service nova] Creating event network-vif-plugged:9ce2e89e-838e-4b08-b1df-2e933c36e5d1 for instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 on n-h1-826756-3 Jul 28 03:54:58.730126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6b1276de-1024-43e2-a1fe-c4c28c44944a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:58.739090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6b1276de-1024-43e2-a1fe-c4c28c44944a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:58.740487 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6b1276de-1024-43e2-a1fe-c4c28c44944a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1797 microversion: 2.20 time: 0.345973 Jul 28 03:54:58.741418 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2268/4084] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:54:58 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1797 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:58.745579 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-7372e8be-7fbf-41d9-a405-057ae33ddb6d req-448aea4b-f610-4ebc-80b3-a916ff13eb35 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080347 Jul 28 03:54:58.746519 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1817/4085] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:58.761668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-865aaa17-9b45-4cf9-b4e5-616497f7ce51 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:58.762262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-865aaa17-9b45-4cf9-b4e5-616497f7ce51 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:58.771678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-07504b2e-5c33-42a2-b1ff-eb13457347c6 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa74653040>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:58.788005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-865aaa17-9b45-4cf9-b4e5-616497f7ce51 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:58.796765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-865aaa17-9b45-4cf9-b4e5-616497f7ce51 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:58.797543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-865aaa17-9b45-4cf9-b4e5-616497f7ce51 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:58.797994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-865aaa17-9b45-4cf9-b4e5-616497f7ce51 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:58.878553 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-07504b2e-5c33-42a2-b1ff-eb13457347c6 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.113875 Jul 28 03:54:58.880475 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1818/4086] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:58 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:59.225149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-865aaa17-9b45-4cf9-b4e5-616497f7ce51 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:59.255222 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-865aaa17-9b45-4cf9-b4e5-616497f7ce51 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1316 microversion: 2.1 time: 0.512642 Jul 28 03:54:59.261946 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2269/4087] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:58 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:59.406804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b023771f-45ee-4fd6-8bd7-5623fe671e74 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:59.408932 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b023771f-45ee-4fd6-8bd7-5623fe671e74 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:59.420547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b023771f-45ee-4fd6-8bd7-5623fe671e74 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:59.420923 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b023771f-45ee-4fd6-8bd7-5623fe671e74 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:59.421706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b023771f-45ee-4fd6-8bd7-5623fe671e74 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:59.430415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b023771f-45ee-4fd6-8bd7-5623fe671e74 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:59.684212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-825d0c55-8352-4440-8b01-f2a2aeed8f44 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:59.684895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-825d0c55-8352-4440-8b01-f2a2aeed8f44 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:54:59.692001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-825d0c55-8352-4440-8b01-f2a2aeed8f44 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:59.692562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-825d0c55-8352-4440-8b01-f2a2aeed8f44 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:59.693426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-825d0c55-8352-4440-8b01-f2a2aeed8f44 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:54:59.694104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-825d0c55-8352-4440-8b01-f2a2aeed8f44 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:54:59.779918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b023771f-45ee-4fd6-8bd7-5623fe671e74 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:54:59.797038 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b023771f-45ee-4fd6-8bd7-5623fe671e74 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1328 microversion: 2.1 time: 0.399961 Jul 28 03:54:59.799201 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1819/4088] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:59 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1328 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:59.897510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7d13d7dd-52bb-4c05-a179-b7f1f4baf098 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa746533a0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:59.990007 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7d13d7dd-52bb-4c05-a179-b7f1f4baf098 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.098233 Jul 28 03:54:59.991043 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1820/4089] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:54:59 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:55:00.018527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-825d0c55-8352-4440-8b01-f2a2aeed8f44 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:00.033830 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-825d0c55-8352-4440-8b01-f2a2aeed8f44 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1367 microversion: 2.1 time: 0.354120 Jul 28 03:55:00.035938 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2270/4090] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:54:59 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:00.287422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8691564d-eab3-4fc9-886d-aad5314e5b69 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:00.288123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8691564d-eab3-4fc9-886d-aad5314e5b69 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:00.303077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8691564d-eab3-4fc9-886d-aad5314e5b69 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:00.304494 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8691564d-eab3-4fc9-886d-aad5314e5b69 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:00.307590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8691564d-eab3-4fc9-886d-aad5314e5b69 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:00.311564 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8691564d-eab3-4fc9-886d-aad5314e5b69 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:00.819161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f8c04f2-4f94-4c30-8103-9db27743784b tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:00.820702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8f8c04f2-4f94-4c30-8103-9db27743784b tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:00.834206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f8c04f2-4f94-4c30-8103-9db27743784b tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:00.840033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f8c04f2-4f94-4c30-8103-9db27743784b tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:00.841283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f8c04f2-4f94-4c30-8103-9db27743784b tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:00.841885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f8c04f2-4f94-4c30-8103-9db27743784b tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:00.957267 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8691564d-eab3-4fc9-886d-aad5314e5b69 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:00.965765 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8691564d-eab3-4fc9-886d-aad5314e5b69 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1316 microversion: 2.1 time: 0.683414 Jul 28 03:55:00.970355 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1821/4091] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:00 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1316 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:00.988730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-cf7b3f08-a2a1-48b1-9f7c-93212f5a279d req-d72d693c-f31d-4085-b91c-95b6d3376a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a04170d-7c69-4efa-8141-d243feb5c41b", "name": "network-vif-plugged", "status": "completed", "tag": "86249602-9c2e-448f-acf5-aca733cedbd0"}, {"server_uuid": "b3ca573b-83e4-413b-817d-e8379dd57e68", "name": "network-vif-plugged", "status": "completed", "tag": "3cb9b533-8415-43e1-aa30-e19706ae27ec"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:00.994820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:01.011151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-cf7b3f08-a2a1-48b1-9f7c-93212f5a279d req-d72d693c-f31d-4085-b91c-95b6d3376a2b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:01.015819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-cf7b3f08-a2a1-48b1-9f7c-93212f5a279d req-d72d693c-f31d-4085-b91c-95b6d3376a2b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:01.054718 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-cf7b3f08-a2a1-48b1-9f7c-93212f5a279d req-d72d693c-f31d-4085-b91c-95b6d3376a2b service nova] Creating event network-vif-plugged:86249602-9c2e-448f-acf5-aca733cedbd0 for instance 0a04170d-7c69-4efa-8141-d243feb5c41b on n-h2-826756-3 Jul 28 03:55:01.056894 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-cf7b3f08-a2a1-48b1-9f7c-93212f5a279d req-d72d693c-f31d-4085-b91c-95b6d3376a2b service nova] Creating event network-vif-plugged:3cb9b533-8415-43e1-aa30-e19706ae27ec for instance b3ca573b-83e4-413b-817d-e8379dd57e68 on n-h2-826756-3 Jul 28 03:55:01.075285 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-cf7b3f08-a2a1-48b1-9f7c-93212f5a279d req-d72d693c-f31d-4085-b91c-95b6d3376a2b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103223 Jul 28 03:55:01.078184 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1822/4092] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:01.093433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c5be7b25-9da1-405e-821d-691bc34dd9bc tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa74832a60>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:01.221872 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c5be7b25-9da1-405e-821d-691bc34dd9bc tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.140908 Jul 28 03:55:01.224475 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1823/4093] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:55:01 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:01.237303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d2432c89-8e96-4378-a991-9c732e89831d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:01.238807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d2432c89-8e96-4378-a991-9c732e89831d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:01.258148 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2432c89-8e96-4378-a991-9c732e89831d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:01.260324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2432c89-8e96-4378-a991-9c732e89831d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:01.264980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2432c89-8e96-4378-a991-9c732e89831d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:01.267314 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2432c89-8e96-4378-a991-9c732e89831d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:01.302318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8f8c04f2-4f94-4c30-8103-9db27743784b tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:01.315975 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8f8c04f2-4f94-4c30-8103-9db27743784b tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1328 microversion: 2.1 time: 0.500529 Jul 28 03:55:01.318086 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2271/4094] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:00 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1328 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:01.991432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1cf3701d-cca9-4105-aeb2-11412a6cc679 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:01.992122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1cf3701d-cca9-4105-aeb2-11412a6cc679 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:02.008859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cf3701d-cca9-4105-aeb2-11412a6cc679 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:02.015559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cf3701d-cca9-4105-aeb2-11412a6cc679 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:02.020827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cf3701d-cca9-4105-aeb2-11412a6cc679 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:02.021734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cf3701d-cca9-4105-aeb2-11412a6cc679 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:02.091596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d2432c89-8e96-4378-a991-9c732e89831d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:02.121424 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d2432c89-8e96-4378-a991-9c732e89831d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1367 microversion: 2.1 time: 0.895630 Jul 28 03:55:02.125711 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1824/4095] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:01 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1367 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:02.240415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d10cc0b8-686e-488e-b2ad-5b95cc84e95e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa745c89d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:02.354273 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d10cc0b8-686e-488e-b2ad-5b95cc84e95e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.119300 Jul 28 03:55:02.356034 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1825/4096] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:55:02 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:02.362321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d86d67d5-945d-4fe9-8b09-a3533d1f80e4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:02.363367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d86d67d5-945d-4fe9-8b09-a3533d1f80e4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:02.372193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d86d67d5-945d-4fe9-8b09-a3533d1f80e4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:02.373548 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d86d67d5-945d-4fe9-8b09-a3533d1f80e4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:02.375146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d86d67d5-945d-4fe9-8b09-a3533d1f80e4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:02.376205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d86d67d5-945d-4fe9-8b09-a3533d1f80e4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:02.590091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1cf3701d-cca9-4105-aeb2-11412a6cc679 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:02.604036 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1cf3701d-cca9-4105-aeb2-11412a6cc679 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.617105 Jul 28 03:55:02.614223 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2272/4097] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:01 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:02.909859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1546320246", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:02.924561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d86d67d5-945d-4fe9-8b09-a3533d1f80e4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:02.938700 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d86d67d5-945d-4fe9-8b09-a3533d1f80e4 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1328 microversion: 2.1 time: 0.577513 Jul 28 03:55:02.938819 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1826/4098] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:02 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1328 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:03.074608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] validate_networks() for [('3fcf143f-a069-44e5-9902-e5b7dddd3dfa', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:55:03.150216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cb5a66b5-4317-4eb2-be5b-38ac8a01937e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:03.153670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cb5a66b5-4317-4eb2-be5b-38ac8a01937e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:03.172132 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cb5a66b5-4317-4eb2-be5b-38ac8a01937e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:03.197985 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cb5a66b5-4317-4eb2-be5b-38ac8a01937e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:03.199338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cb5a66b5-4317-4eb2-be5b-38ac8a01937e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:03.200060 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cb5a66b5-4317-4eb2-be5b-38ac8a01937e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:04.155582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cb5a66b5-4317-4eb2-be5b-38ac8a01937e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:04.186916 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cb5a66b5-4317-4eb2-be5b-38ac8a01937e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1367 microversion: 2.1 time: 1.043419 Jul 28 03:55:04.203267 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1827/4099] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:03 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1367 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:04.225780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7702a69b-e9c1-4613-8d4c-4a38af393543 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa74653040>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:04.319193 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7702a69b-e9c1-4613-8d4c-4a38af393543 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.113142 Jul 28 03:55:04.324228 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1828/4100] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:55:04 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:04.338166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-25b4d1d1-dbe4-4332-9957-77d1d774d501 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:04.339397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-25b4d1d1-dbe4-4332-9957-77d1d774d501 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:04.358258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25b4d1d1-dbe4-4332-9957-77d1d774d501 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:04.364200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25b4d1d1-dbe4-4332-9957-77d1d774d501 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:04.365468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25b4d1d1-dbe4-4332-9957-77d1d774d501 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:04.376427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25b4d1d1-dbe4-4332-9957-77d1d774d501 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:05.483277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-25b4d1d1-dbe4-4332-9957-77d1d774d501 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:05.498165 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-25b4d1d1-dbe4-4332-9957-77d1d774d501 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1528 microversion: 2.1 time: 1.171676 Jul 28 03:55:05.502593 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1829/4101] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:04 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1528 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:05.521943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fc15698b-d9c3-4a0f-b67f-8535d481139d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:05.524031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fc15698b-d9c3-4a0f-b67f-8535d481139d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:05.552858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc15698b-d9c3-4a0f-b67f-8535d481139d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:05.553379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc15698b-d9c3-4a0f-b67f-8535d481139d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:05.554237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc15698b-d9c3-4a0f-b67f-8535d481139d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:05.554753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fc15698b-d9c3-4a0f-b67f-8535d481139d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:05.769989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:55:05.771062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:55:05.772279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:55:05.772967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:55:05.773596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:55:05.788908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:05.792569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:05.794483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:05.796308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:05.844324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Getting quotas for project ea989471cdf641f389e0f61166fdb28a. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:55:05.859828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Getting quotas for user a36bace2510942d4bb94ec23a6b3a053 and project ea989471cdf641f389e0f61166fdb28a. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:55:05.896950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:55:05.903680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:55:05.922284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fc15698b-d9c3-4a0f-b67f-8535d481139d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:05.930944 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fc15698b-d9c3-4a0f-b67f-8535d481139d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1556 microversion: 2.1 time: 0.423260 Jul 28 03:55:05.943953 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1830/4102] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:05 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1556 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:05.949469 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-50258a56-08eb-4f9a-9b84-29c247a40df5 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa743f60d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:06.030727 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-98743d42-db48-4978-af03-508008fd8306 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.124879 Jul 28 03:55:06.034366 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2273/4103] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:55:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:55:06.051147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17e82163-484b-4a3b-ad0a-195517ad5ed5 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:06.061529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-17e82163-484b-4a3b-ad0a-195517ad5ed5 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:06.064042 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-50258a56-08eb-4f9a-9b84-29c247a40df5 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.118624 Jul 28 03:55:06.074877 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1831/4104] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:55:05 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:06.093251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17e82163-484b-4a3b-ad0a-195517ad5ed5 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:06.093728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17e82163-484b-4a3b-ad0a-195517ad5ed5 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:06.094577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17e82163-484b-4a3b-ad0a-195517ad5ed5 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:06.094999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17e82163-484b-4a3b-ad0a-195517ad5ed5 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:06.103254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-67a2fda4-f8e0-4f66-a6e4-571cc42ccf56 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:06.103761 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-67a2fda4-f8e0-4f66-a6e4-571cc42ccf56 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:06.132710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67a2fda4-f8e0-4f66-a6e4-571cc42ccf56 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:06.133168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67a2fda4-f8e0-4f66-a6e4-571cc42ccf56 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:06.133957 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67a2fda4-f8e0-4f66-a6e4-571cc42ccf56 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:06.134392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67a2fda4-f8e0-4f66-a6e4-571cc42ccf56 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:06.430505 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-67a2fda4-f8e0-4f66-a6e4-571cc42ccf56 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.353632 Jul 28 03:55:06.431146 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1832/4105] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 03:55:06 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-interface => generated 285 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:06.458519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c2555efd-2d55-47d4-adba-19c47719b40d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:06.462254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c2555efd-2d55-47d4-adba-19c47719b40d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:06.713844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-17e82163-484b-4a3b-ad0a-195517ad5ed5 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:06.723309 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-17e82163-484b-4a3b-ad0a-195517ad5ed5 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1528 microversion: 2.1 time: 0.687418 Jul 28 03:55:06.741704 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2274/4106] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:06 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1528 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:07.207790 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c2555efd-2d55-47d4-adba-19c47719b40d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:07.215628 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c2555efd-2d55-47d4-adba-19c47719b40d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1217 microversion: 2.1 time: 0.783411 Jul 28 03:55:07.224105 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1833/4107] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:06 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1217 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:07.233639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4e0aa385-7b01-43d1-b2a2-be7b6367efab tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa741abd30>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:07.286897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b12be1a8-2922-4a9f-b05d-9eed50b963b4 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:07.288012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b12be1a8-2922-4a9f-b05d-9eed50b963b4 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:07.300575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b12be1a8-2922-4a9f-b05d-9eed50b963b4 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:07.301402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b12be1a8-2922-4a9f-b05d-9eed50b963b4 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:07.302478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b12be1a8-2922-4a9f-b05d-9eed50b963b4 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:07.303199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b12be1a8-2922-4a9f-b05d-9eed50b963b4 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:07.353663 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-b12be1a8-2922-4a9f-b05d-9eed50b963b4 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] HTTP exception thrown: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:07.363155 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4e0aa385-7b01-43d1-b2a2-be7b6367efab tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.137664 Jul 28 03:55:07.370941 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1834/4108] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:55:07 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b12be1a8-2922-4a9f-b05d-9eed50b963b4 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] Request method failure captured: Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 HTTP/1.1 Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh2IBmyV5MIa2LOusBWlDzMVq_aV_H6Mw6kCl8hAGN1OrpYfA3N7o_AMIwhG-yUhe6k8trYNr0KRCkgw0pIia9ua5GXzXrp4OSIi_l8F-i9P7cvQT9E97UNtA_Skqq4orxPdVtXh0roqJrWTbjPV8A2wpfLCPkVL8Il7-ZE96VjVzQ Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f188800df9674a689f727bf0494c60da Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1898539146 Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f188800df9674a689f727bf0494c60da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f188800df9674a689f727bf0494c60da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f188800df9674a689f727bf0494c60da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f188800df9674a689f727bf0494c60da"}]}] Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1898539146 Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f188800df9674a689f727bf0494c60da Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1898539146 Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1898539146-project Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0dc17ec5c99342c590f5f2ba3577c8f8 Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1898539146-project Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'b3ca573b-83e4-413b-817d-e8379dd57e68'} Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:55:07.377983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:55:07.382589 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:07.382589 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:07.382589 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:07.382589 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:07.382589 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:07.382589 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:07.382589 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:07.382589 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:55:07.382589 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:55:07.382589 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:07.382589 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:07.385117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b12be1a8-2922-4a9f-b05d-9eed50b963b4 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] Returning 404 to user: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:55:07.386237 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b12be1a8-2922-4a9f-b05d-9eed50b963b4 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 404 len: 111 microversion: 2.1 time: 0.639076 Jul 28 03:55:07.387323 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2275/4109] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:55:06 2022] DELETE /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 111 bytes in 641 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:55:07.397218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cf38ffc2-12f1-47b2-8ad6-edca3033684a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:07.398214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cf38ffc2-12f1-47b2-8ad6-edca3033684a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:07.412196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cf38ffc2-12f1-47b2-8ad6-edca3033684a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:07.414677 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cf38ffc2-12f1-47b2-8ad6-edca3033684a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:07.416057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cf38ffc2-12f1-47b2-8ad6-edca3033684a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:07.417842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cf38ffc2-12f1-47b2-8ad6-edca3033684a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:07.658716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cf38ffc2-12f1-47b2-8ad6-edca3033684a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:07.672187 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cf38ffc2-12f1-47b2-8ad6-edca3033684a tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1528 microversion: 2.1 time: 0.279367 Jul 28 03:55:07.673356 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1835/4110] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:07 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1528 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:07.692545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b76c091e-9bac-400e-a9fe-9684b16a1741 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] Action: 'update', calling method: >, body: {"server": {"name": "b3ca573b-83e4-413b-817d-e8379dd57e68_new"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:07.695487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b76c091e-9bac-400e-a9fe-9684b16a1741 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:07.724863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b76c091e-9bac-400e-a9fe-9684b16a1741 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:07.730151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b76c091e-9bac-400e-a9fe-9684b16a1741 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:07.734523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b76c091e-9bac-400e-a9fe-9684b16a1741 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:07.738367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b76c091e-9bac-400e-a9fe-9684b16a1741 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:07.801188 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-b76c091e-9bac-400e-a9fe-9684b16a1741 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] HTTP exception thrown: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b76c091e-9bac-400e-a9fe-9684b16a1741 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] Request method failure captured: Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: request: PUT /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 HTTP/1.1 Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 64 Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh2IBmyV5MIa2LOusBWlDzMVq_aV_H6Mw6kCl8hAGN1OrpYfA3N7o_AMIwhG-yUhe6k8trYNr0KRCkgw0pIia9ua5GXzXrp4OSIi_l8F-i9P7cvQT9E97UNtA_Skqq4orxPdVtXh0roqJrWTbjPV8A2wpfLCPkVL8Il7-ZE96VjVzQ Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f188800df9674a689f727bf0494c60da Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1898539146 Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f188800df9674a689f727bf0494c60da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f188800df9674a689f727bf0494c60da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f188800df9674a689f727bf0494c60da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f188800df9674a689f727bf0494c60da"}]}] Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1898539146 Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f188800df9674a689f727bf0494c60da Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1898539146 Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1898539146-project Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0dc17ec5c99342c590f5f2ba3577c8f8 Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1898539146-project Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "b3ca573b-83e4-413b-817d-e8379dd57e68_new"}} Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'b3ca573b-83e4-413b-817d-e8379dd57e68', 'body': {'server': {'name': 'b3ca573b-83e4-413b-817d-e8379dd57e68_new'}}} Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 28 03:55:07.806864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:07.812092 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:07.815692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b76c091e-9bac-400e-a9fe-9684b16a1741 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] Returning 404 to user: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:55:07.819134 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b76c091e-9bac-400e-a9fe-9684b16a1741 tempest-ServersNegativeTestMultiTenantJSON-1898539146 tempest-ServersNegativeTestMultiTenantJSON-1898539146-project] 10.222.0.48 "PUT /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 404 len: 111 microversion: 2.1 time: 0.130700 Jul 28 03:55:07.824744 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2276/4111] 10.222.0.48 () {60 vars in 1256 bytes} [Thu Jul 28 03:55:07 2022] PUT /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:55:07.850400 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2dc46547-0a64-4b7d-ae48-a1a395a61745 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:07.851189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2dc46547-0a64-4b7d-ae48-a1a395a61745 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:07.866759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2dc46547-0a64-4b7d-ae48-a1a395a61745 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:07.867216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2dc46547-0a64-4b7d-ae48-a1a395a61745 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:07.870419 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2dc46547-0a64-4b7d-ae48-a1a395a61745 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:07.871248 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2dc46547-0a64-4b7d-ae48-a1a395a61745 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:07.909189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2dc46547-0a64-4b7d-ae48-a1a395a61745 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:55:08.115327 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2dc46547-0a64-4b7d-ae48-a1a395a61745 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 204 len: 0 microversion: 2.1 time: 0.285880 Jul 28 03:55:08.125687 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1836/4112] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:55:07 2022] DELETE /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:55:08.129230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d530fc7-c306-4f0f-9723-ec1ea63414d3 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:08.129850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8d530fc7-c306-4f0f-9723-ec1ea63414d3 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:08.166428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d530fc7-c306-4f0f-9723-ec1ea63414d3 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:08.166881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d530fc7-c306-4f0f-9723-ec1ea63414d3 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:08.167672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d530fc7-c306-4f0f-9723-ec1ea63414d3 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:08.168107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d530fc7-c306-4f0f-9723-ec1ea63414d3 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:08.246049 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-64221827-e4dc-4c96-a084-cbf46cc4c01d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:08.247526 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-64221827-e4dc-4c96-a084-cbf46cc4c01d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:08.265033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64221827-e4dc-4c96-a084-cbf46cc4c01d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:08.266081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64221827-e4dc-4c96-a084-cbf46cc4c01d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:08.274259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64221827-e4dc-4c96-a084-cbf46cc4c01d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:08.274998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64221827-e4dc-4c96-a084-cbf46cc4c01d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:08.424980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-64221827-e4dc-4c96-a084-cbf46cc4c01d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:08.437818 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-64221827-e4dc-4c96-a084-cbf46cc4c01d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1269 microversion: 2.1 time: 0.195304 Jul 28 03:55:08.444508 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1837/4113] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:08 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1269 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:08.450376 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b170aeda-b064-4e28-8d16-a1822e276424 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa749e9e50>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:08.615875 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b170aeda-b064-4e28-8d16-a1822e276424 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.169362 Jul 28 03:55:08.616716 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1838/4114] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:55:08 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:09.475560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f50f142f-13c5-466f-8a33-8d217d804d1e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:09.477924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f50f142f-13c5-466f-8a33-8d217d804d1e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:09.502527 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f50f142f-13c5-466f-8a33-8d217d804d1e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:09.504006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f50f142f-13c5-466f-8a33-8d217d804d1e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:09.507779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f50f142f-13c5-466f-8a33-8d217d804d1e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:09.511535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f50f142f-13c5-466f-8a33-8d217d804d1e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:09.646509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f50f142f-13c5-466f-8a33-8d217d804d1e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:09.653029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8d530fc7-c306-4f0f-9723-ec1ea63414d3 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:09.666974 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f50f142f-13c5-466f-8a33-8d217d804d1e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1275 microversion: 2.1 time: 0.200536 Jul 28 03:55:09.669461 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1839/4115] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:09 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1275 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:55:09.675823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-13de789b-055b-4525-8f58-06fc3ce8efea tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa7451ee50>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:09.689199 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8d530fc7-c306-4f0f-9723-ec1ea63414d3 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1534 microversion: 2.1 time: 1.562056 Jul 28 03:55:09.689992 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2277/4116] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:08 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1534 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:55:09.743373 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-13de789b-055b-4525-8f58-06fc3ce8efea tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1428 microversion: 2.1 time: 0.072038 Jul 28 03:55:09.752691 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1840/4117] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:55:09 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1428 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:10.701950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-52162f29-efdb-460f-b2a4-56dbd230c4e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:10.704422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-52162f29-efdb-460f-b2a4-56dbd230c4e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:10.710925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-60b04221-8003-414a-a9ab-813b4d1b72c7 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:10.712878 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-60b04221-8003-414a-a9ab-813b4d1b72c7 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:10.722319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-60b04221-8003-414a-a9ab-813b4d1b72c7 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:10.723329 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-60b04221-8003-414a-a9ab-813b4d1b72c7 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:10.724291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-60b04221-8003-414a-a9ab-813b4d1b72c7 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:10.724778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52162f29-efdb-460f-b2a4-56dbd230c4e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:10.725235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52162f29-efdb-460f-b2a4-56dbd230c4e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:10.725870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-60b04221-8003-414a-a9ab-813b4d1b72c7 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:10.726001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52162f29-efdb-460f-b2a4-56dbd230c4e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:10.726439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52162f29-efdb-460f-b2a4-56dbd230c4e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:11.453632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-52162f29-efdb-460f-b2a4-56dbd230c4e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:11.477057 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-52162f29-efdb-460f-b2a4-56dbd230c4e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1317 microversion: 2.1 time: 0.776446 Jul 28 03:55:11.478272 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2278/4118] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:10 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1317 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:11.486096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f53b42f6-c021-437c-8478-ef395cdb7705 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa67761dc0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:11.570123 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f53b42f6-c021-437c-8478-ef395cdb7705 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1437 microversion: 2.1 time: 0.089505 Jul 28 03:55:11.570914 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2279/4119] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:55:11 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:11.584413 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-60b04221-8003-414a-a9ab-813b4d1b72c7 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:11.592826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-92581c95-a433-4be7-895e-a8f34bc4cb58 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa67471670>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:11.602409 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-60b04221-8003-414a-a9ab-813b4d1b72c7 tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1534 microversion: 2.1 time: 0.895969 Jul 28 03:55:11.612116 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1841/4120] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:10 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1534 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:11.663416 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-92581c95-a433-4be7-895e-a8f34bc4cb58 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 200 len: 1437 microversion: 2.1 time: 0.082777 Jul 28 03:55:11.665304 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2280/4121] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:55:11 2022] GET /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 1437 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:11.682410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8250e960-3938-4d36-89e7-01089eb4ddcb tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:11.683434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8250e960-3938-4d36-89e7-01089eb4ddcb tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:11.746787 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8250e960-3938-4d36-89e7-01089eb4ddcb tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:11.747489 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8250e960-3938-4d36-89e7-01089eb4ddcb tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:11.748026 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8250e960-3938-4d36-89e7-01089eb4ddcb tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:11.748490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8250e960-3938-4d36-89e7-01089eb4ddcb tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:12.046930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a71856ab-da60-41c6-b1c3-3665e67fd0fb req-9ffa7c5c-1134-4b7c-a8fe-fdaf60ae55d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a04170d-7c69-4efa-8141-d243feb5c41b", "tag": "86249602-9c2e-448f-acf5-aca733cedbd0"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:12.073676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a71856ab-da60-41c6-b1c3-3665e67fd0fb req-9ffa7c5c-1134-4b7c-a8fe-fdaf60ae55d8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:12.074378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a71856ab-da60-41c6-b1c3-3665e67fd0fb req-9ffa7c5c-1134-4b7c-a8fe-fdaf60ae55d8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:12.100270 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a71856ab-da60-41c6-b1c3-3665e67fd0fb req-9ffa7c5c-1134-4b7c-a8fe-fdaf60ae55d8 service nova] Creating event network-changed:86249602-9c2e-448f-acf5-aca733cedbd0 for instance 0a04170d-7c69-4efa-8141-d243feb5c41b on n-h2-826756-3 Jul 28 03:55:12.114911 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a71856ab-da60-41c6-b1c3-3665e67fd0fb req-9ffa7c5c-1134-4b7c-a8fe-fdaf60ae55d8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.335116 Jul 28 03:55:12.117267 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2281/4122] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:12.500273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-39f0f223-2fa0-44db-863e-ccaf66e368ba tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:12.501351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-39f0f223-2fa0-44db-863e-ccaf66e368ba tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:12.508615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39f0f223-2fa0-44db-863e-ccaf66e368ba tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:12.509280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39f0f223-2fa0-44db-863e-ccaf66e368ba tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:12.510247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39f0f223-2fa0-44db-863e-ccaf66e368ba tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:12.511155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39f0f223-2fa0-44db-863e-ccaf66e368ba tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:12.538934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:12.886233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-39f0f223-2fa0-44db-863e-ccaf66e368ba tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:12.903403 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-39f0f223-2fa0-44db-863e-ccaf66e368ba tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1317 microversion: 2.1 time: 0.401422 Jul 28 03:55:12.904490 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2282/4123] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:12 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:55:12.922199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9b177385-0859-4f8a-bafe-f8ec5d8c3da5 req-78a8e717-dd12-4f04-8bd0-daff348161b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ca573b-83e4-413b-817d-e8379dd57e68", "name": "network-vif-deleted", "tag": "3cb9b533-8415-43e1-aa30-e19706ae27ec"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:12.943108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9b177385-0859-4f8a-bafe-f8ec5d8c3da5 req-78a8e717-dd12-4f04-8bd0-daff348161b4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:12.945969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9b177385-0859-4f8a-bafe-f8ec5d8c3da5 req-78a8e717-dd12-4f04-8bd0-daff348161b4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:12.970107 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9b177385-0859-4f8a-bafe-f8ec5d8c3da5 req-78a8e717-dd12-4f04-8bd0-daff348161b4 service nova] Creating event network-vif-deleted:3cb9b533-8415-43e1-aa30-e19706ae27ec for instance b3ca573b-83e4-413b-817d-e8379dd57e68 on n-h2-826756-3 Jul 28 03:55:12.976790 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9b177385-0859-4f8a-bafe-f8ec5d8c3da5 req-78a8e717-dd12-4f04-8bd0-daff348161b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070796 Jul 28 03:55:12.983705 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2283/4124] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:12.989774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-08835ad7-890b-4977-8a61-bf4a645a312d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:12.992051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-08835ad7-890b-4977-8a61-bf4a645a312d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:13.007649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08835ad7-890b-4977-8a61-bf4a645a312d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:13.013506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08835ad7-890b-4977-8a61-bf4a645a312d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:13.018676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08835ad7-890b-4977-8a61-bf4a645a312d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:13.019227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08835ad7-890b-4977-8a61-bf4a645a312d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:13.101099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08835ad7-890b-4977-8a61-bf4a645a312d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:13.102036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08835ad7-890b-4977-8a61-bf4a645a312d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:13.102036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-08835ad7-890b-4977-8a61-bf4a645a312d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lazy-loading 'fault' on Instance uuid b3ca573b-83e4-413b-817d-e8379dd57e68 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:55:13.235729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-08835ad7-890b-4977-8a61-bf4a645a312d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87846236df9b4df183d4ba72c91f07b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04165cf1ca0d45b79d70317e5ae26763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:13.251199 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-08835ad7-890b-4977-8a61-bf4a645a312d tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 200 len: 1318 microversion: 2.1 time: 0.265688 Jul 28 03:55:13.262217 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2284/4125] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:12 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:13.677011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8250e960-3938-4d36-89e7-01089eb4ddcb tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:13.690199 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8250e960-3938-4d36-89e7-01089eb4ddcb tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1465 microversion: 2.1 time: 2.013834 Jul 28 03:55:13.691257 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1842/4126] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:11 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1465 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:13.723298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d661a70f-4763-49e7-9c82-ea79d728b076 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa674be310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:13.931122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f830aa00-64dd-49fc-b8ce-b50375a454d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:13.932008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f830aa00-64dd-49fc-b8ce-b50375a454d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:13.950031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f830aa00-64dd-49fc-b8ce-b50375a454d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:13.951506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f830aa00-64dd-49fc-b8ce-b50375a454d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:13.954009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f830aa00-64dd-49fc-b8ce-b50375a454d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:13.955422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f830aa00-64dd-49fc-b8ce-b50375a454d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:13.989987 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:14.761020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f830aa00-64dd-49fc-b8ce-b50375a454d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:14.772276 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f830aa00-64dd-49fc-b8ce-b50375a454d8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1317 microversion: 2.1 time: 0.846709 Jul 28 03:55:14.778816 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1843/4127] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:13 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1317 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:14.784664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e47cd129-c7d8-4a63-a297-b2207d0381fb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:14.790655 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e47cd129-c7d8-4a63-a297-b2207d0381fb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] [instance: b3ca573b-83e4-413b-817d-e8379dd57e68] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:14.808052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e47cd129-c7d8-4a63-a297-b2207d0381fb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:14.808833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e47cd129-c7d8-4a63-a297-b2207d0381fb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:14.814699 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e47cd129-c7d8-4a63-a297-b2207d0381fb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:14.815607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e47cd129-c7d8-4a63-a297-b2207d0381fb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:14.851688 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-e47cd129-c7d8-4a63-a297-b2207d0381fb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] HTTP exception thrown: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e47cd129-c7d8-4a63-a297-b2207d0381fb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Request method failure captured: Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 HTTP/1.1 Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gha_YnavYilva5rDaAAFRGrJJAEbgwoLjSf0dde-7dZRF3MMo7-0BG0PpFlmziH3b7TFl2jh_mijB4uf7_ATNiMlauOsGZAq0AzgO3HNqHPzBchx2oMm3CwgOdOzdSeTwRRb_cb46PrC9KM1Tj1zo3eWWUXoUupqR9tCIEplViGd-A Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 04165cf1ca0d45b79d70317e5ae26763 Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1272641849 Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/04165cf1ca0d45b79d70317e5ae26763"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04165cf1ca0d45b79d70317e5ae26763"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_04165cf1ca0d45b79d70317e5ae26763"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/04165cf1ca0d45b79d70317e5ae26763"}]}] Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1272641849 Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 04165cf1ca0d45b79d70317e5ae26763 Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1272641849 Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1272641849-project Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 87846236df9b4df183d4ba72c91f07b2 Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1272641849-project Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'b3ca573b-83e4-413b-817d-e8379dd57e68'} Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:14.859514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:14.864404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:14.864404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:14.864404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:14.864404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:14.864404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:14.864404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:55:14.864404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:55:14.864404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. Jul 28 03:55:14.864404 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:14.865617 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d661a70f-4763-49e7-9c82-ea79d728b076 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "DELETE /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765" status: 204 len: 0 microversion: 2.1 time: 1.149259 Jul 28 03:55:14.865617 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2285/4128] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:13 2022] DELETE /compute/v2.1/images/fa07e008-6dba-4333-b3e9-deab6a738765 => generated 0 bytes in 1152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:55:14.867587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e47cd129-c7d8-4a63-a297-b2207d0381fb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] Returning 404 to user: Instance b3ca573b-83e4-413b-817d-e8379dd57e68 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:55:14.868751 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e47cd129-c7d8-4a63-a297-b2207d0381fb tempest-ServersNegativeTestMultiTenantJSON-1272641849 tempest-ServersNegativeTestMultiTenantJSON-1272641849-project] 10.222.0.48 "GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68" status: 404 len: 111 microversion: 2.1 time: 0.088516 Jul 28 03:55:14.870856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-dbb221c6-929d-49b7-a3f8-94213b896847 req-04db30e0-9d9a-4466-a015-f9f14184c73c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091c0997-537d-4124-9945-1ef1dd079d63", "name": "network-vif-unplugged", "status": "completed", "tag": "c5b8c623-1fc8-4425-b1c1-c5da71e14c34"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:14.872179 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1844/4129] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:14 2022] GET /compute/v2.1/servers/b3ca573b-83e4-413b-817d-e8379dd57e68 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:55:14.880821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-941561c6-79e7-43de-9290-d932b6d89ea9 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '.version_select at 0x7ffa7451c280>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:14.901934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-dbb221c6-929d-49b7-a3f8-94213b896847 req-04db30e0-9d9a-4466-a015-f9f14184c73c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:14.902476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-dbb221c6-929d-49b7-a3f8-94213b896847 req-04db30e0-9d9a-4466-a015-f9f14184c73c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:14.933586 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-dbb221c6-929d-49b7-a3f8-94213b896847 req-04db30e0-9d9a-4466-a015-f9f14184c73c service nova] Creating event network-vif-unplugged:c5b8c623-1fc8-4425-b1c1-c5da71e14c34 for instance 091c0997-537d-4124-9945-1ef1dd079d63 on n-h1-826756-3 Jul 28 03:55:14.946507 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-dbb221c6-929d-49b7-a3f8-94213b896847 req-04db30e0-9d9a-4466-a015-f9f14184c73c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081117 Jul 28 03:55:14.951670 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2286/4130] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:14.962638 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-941561c6-79e7-43de-9290-d932b6d89ea9 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] HTTP exception thrown: Image not found. Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-941561c6-79e7-43de-9290-d932b6d89ea9 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Request method failure captured: Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 HTTP/1.1 Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gg7G2DrOKI_Bj5hWsmZ1pP6ndynMfF5gYh6na_ZnI5FzQQ_-siOnWWZ2EjvtESiHROq-Rcrz9VBljQyjwxE3LpJAsKa7oF9yTxgNY4fYF81QFzFvX7XgYcxVU5KfgUTxOWCN7HzvARGRM_4aLDl43kKESC-APFJgb281w8d815_Epc Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 565b5ba6a4c4496b913bbb8c95b6cd18 Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesOneServerTestJSON-1180323520 Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/565b5ba6a4c4496b913bbb8c95b6cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/565b5ba6a4c4496b913bbb8c95b6cd18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_565b5ba6a4c4496b913bbb8c95b6cd18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/565b5ba6a4c4496b913bbb8c95b6cd18"}]}] Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesOneServerTestJSON-1180323520 Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 565b5ba6a4c4496b913bbb8c95b6cd18 Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1180323520 Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesOneServerTestJSON-1180323520-project Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 6af5e8135e15471f92108c2774212cc3 Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesOneServerTestJSON-1180323520-project Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: exception: Image not found. Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472'} Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 to delete Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 could not be found. Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:14.965978 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:55:14.972713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:14.977982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-941561c6-79e7-43de-9290-d932b6d89ea9 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Returning 404 to user: Image not found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:55:14.977982 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-941561c6-79e7-43de-9290-d932b6d89ea9 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "DELETE /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472" status: 404 len: 62 microversion: 2.1 time: 0.102392 Jul 28 03:55:14.977982 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1845/4131] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:14 2022] DELETE /compute/v2.1/images/2f2ffadc-eedb-4fcd-8d1e-09ed95f3a472 => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:55:14.985770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c1a60c40-453e-4a80-ba11-f71dc169a32e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:14.986898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c1a60c40-453e-4a80-ba11-f71dc169a32e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:14.998135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1a60c40-453e-4a80-ba11-f71dc169a32e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:15.001065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1a60c40-453e-4a80-ba11-f71dc169a32e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:15.004527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1a60c40-453e-4a80-ba11-f71dc169a32e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:15.005211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1a60c40-453e-4a80-ba11-f71dc169a32e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:15.053668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c1a60c40-453e-4a80-ba11-f71dc169a32e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:55:15.231559 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c1a60c40-453e-4a80-ba11-f71dc169a32e tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "DELETE /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 204 len: 0 microversion: 2.1 time: 0.250308 Jul 28 03:55:15.248700 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39a711b2-f9f6-460a-a2df-96856c00e3a8 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:15.249317 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-39a711b2-f9f6-460a-a2df-96856c00e3a8 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:15.252765 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2287/4132] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:55:14 2022] DELETE /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:55:15.258517 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39a711b2-f9f6-460a-a2df-96856c00e3a8 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:15.258968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39a711b2-f9f6-460a-a2df-96856c00e3a8 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:15.259758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39a711b2-f9f6-460a-a2df-96856c00e3a8 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:15.260190 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39a711b2-f9f6-460a-a2df-96856c00e3a8 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:15.674515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1832251665", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "97b731ac-6aed-4353-af0c-8334fe578fd5"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:15.827794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:15.880250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-39a711b2-f9f6-460a-a2df-96856c00e3a8 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:15.881199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:15.895329 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-39a711b2-f9f6-460a-a2df-96856c00e3a8 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1471 microversion: 2.1 time: 0.651743 Jul 28 03:55:15.901207 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1846/4133] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:15 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1471 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:55:15.927834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9475c2d4-258e-4c66-9bf2-55fcd06d975e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:15.947963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9475c2d4-258e-4c66-9bf2-55fcd06d975e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:15.980341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9475c2d4-258e-4c66-9bf2-55fcd06d975e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:15.981215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9475c2d4-258e-4c66-9bf2-55fcd06d975e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:15.982265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9475c2d4-258e-4c66-9bf2-55fcd06d975e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:15.982976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9475c2d4-258e-4c66-9bf2-55fcd06d975e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:16.000429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] validate_networks() for [('97b731ac-6aed-4353-af0c-8334fe578fd5', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:55:16.476260 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9475c2d4-258e-4c66-9bf2-55fcd06d975e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:16.499382 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9475c2d4-258e-4c66-9bf2-55fcd06d975e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1317 microversion: 2.1 time: 0.575642 Jul 28 03:55:16.510831 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1847/4134] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:15 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1317 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:16.527709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-94e67a79-3cb2-4209-bf43-478ec55903d0 req-6344f5dd-10b6-407c-9cfc-66b15e6e8e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b66483-933e-4f43-ae0a-51f310b354bd", "tag": "c7389941-74c7-4501-90bf-188fb0ba1398"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:16.538193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-94e67a79-3cb2-4209-bf43-478ec55903d0 req-6344f5dd-10b6-407c-9cfc-66b15e6e8e4c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:16.538634 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-94e67a79-3cb2-4209-bf43-478ec55903d0 req-6344f5dd-10b6-407c-9cfc-66b15e6e8e4c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:16.555760 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-94e67a79-3cb2-4209-bf43-478ec55903d0 req-6344f5dd-10b6-407c-9cfc-66b15e6e8e4c service nova] Creating event network-changed:c7389941-74c7-4501-90bf-188fb0ba1398 for instance d4b66483-933e-4f43-ae0a-51f310b354bd on n-h1-826756-3 Jul 28 03:55:16.584218 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-94e67a79-3cb2-4209-bf43-478ec55903d0 req-6344f5dd-10b6-407c-9cfc-66b15e6e8e4c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071749 Jul 28 03:55:16.585627 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1848/4135] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:16.923575 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0f129bce-4ca3-4f2e-bb76-19adb82ea257 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:16.925119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0f129bce-4ca3-4f2e-bb76-19adb82ea257 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:16.946643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0f129bce-4ca3-4f2e-bb76-19adb82ea257 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:16.947364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0f129bce-4ca3-4f2e-bb76-19adb82ea257 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:16.950011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0f129bce-4ca3-4f2e-bb76-19adb82ea257 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:16.956226 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0f129bce-4ca3-4f2e-bb76-19adb82ea257 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:17.215557 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:17.455257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:55:17.455817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:55:17.456136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:55:17.456601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:55:17.457301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:55:17.463499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:17.477334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:17.478933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:17.485200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:17.486250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:17.526992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Getting quotas for project 80fab9081e5b462fbb075214772b3e2c. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:55:17.538024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Getting quotas for user b03a4efae0c04654b541e86b86ad22c4 and project 80fab9081e5b462fbb075214772b3e2c. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:55:17.568055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:55:17.571663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:55:17.679675 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-232928e6-5c8e-4b4a-b664-760ebc015926 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.089637 Jul 28 03:55:17.681120 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2288/4136] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:55:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 03:55:17.686545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9acf2490-5c43-46c4-9db1-d41ccb2ca962 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:17.687391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9acf2490-5c43-46c4-9db1-d41ccb2ca962 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:17.697394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9acf2490-5c43-46c4-9db1-d41ccb2ca962 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:17.698718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9acf2490-5c43-46c4-9db1-d41ccb2ca962 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:17.700013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9acf2490-5c43-46c4-9db1-d41ccb2ca962 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:17.700674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9acf2490-5c43-46c4-9db1-d41ccb2ca962 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:18.093759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9acf2490-5c43-46c4-9db1-d41ccb2ca962 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:18.107817 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9acf2490-5c43-46c4-9db1-d41ccb2ca962 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1317 microversion: 2.1 time: 0.424081 Jul 28 03:55:18.131299 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2289/4137] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:17 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:18.137203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-88efa22d-ad5f-435e-bd1a-df94a85b81f0 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:18.139321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-88efa22d-ad5f-435e-bd1a-df94a85b81f0 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:18.241205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-88efa22d-ad5f-435e-bd1a-df94a85b81f0 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:18.249781 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-88efa22d-ad5f-435e-bd1a-df94a85b81f0 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1217 microversion: 2.1 time: 0.117071 Jul 28 03:55:18.265291 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2290/4138] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:18 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:18.419931 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0f129bce-4ca3-4f2e-bb76-19adb82ea257 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:18.438491 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0f129bce-4ca3-4f2e-bb76-19adb82ea257 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1471 microversion: 2.1 time: 1.519120 Jul 28 03:55:18.442997 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1849/4139] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:16 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1471 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:19.144603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a530dcb0-b4cb-451b-a102-ecfc609ab4b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:19.146029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a530dcb0-b4cb-451b-a102-ecfc609ab4b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:19.176770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a530dcb0-b4cb-451b-a102-ecfc609ab4b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:19.185421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a530dcb0-b4cb-451b-a102-ecfc609ab4b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:19.187156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a530dcb0-b4cb-451b-a102-ecfc609ab4b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:19.188287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a530dcb0-b4cb-451b-a102-ecfc609ab4b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:19.272780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b48ae39f-84ea-49ff-a525-f17870880cfd tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:19.273226 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b48ae39f-84ea-49ff-a525-f17870880cfd tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:19.287119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b48ae39f-84ea-49ff-a525-f17870880cfd tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:19.297579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b48ae39f-84ea-49ff-a525-f17870880cfd tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:19.298672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b48ae39f-84ea-49ff-a525-f17870880cfd tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:19.299134 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b48ae39f-84ea-49ff-a525-f17870880cfd tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:19.544920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b48ae39f-84ea-49ff-a525-f17870880cfd tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:19.562718 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b48ae39f-84ea-49ff-a525-f17870880cfd tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1269 microversion: 2.1 time: 0.295227 Jul 28 03:55:19.563620 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1850/4140] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:19 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1269 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:19.580839 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8fa3bb1c-0fdd-494e-b1ab-561f27680afe tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:19.582010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8fa3bb1c-0fdd-494e-b1ab-561f27680afe tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:19.607752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8fa3bb1c-0fdd-494e-b1ab-561f27680afe tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:19.615693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8fa3bb1c-0fdd-494e-b1ab-561f27680afe tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:19.617817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8fa3bb1c-0fdd-494e-b1ab-561f27680afe tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:19.618930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8fa3bb1c-0fdd-494e-b1ab-561f27680afe tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:19.798819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a530dcb0-b4cb-451b-a102-ecfc609ab4b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:19.814065 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a530dcb0-b4cb-451b-a102-ecfc609ab4b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1317 microversion: 2.1 time: 0.679204 Jul 28 03:55:19.825436 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2291/4141] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:19 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1317 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:20.584087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1e3f1714-ca50-464e-b039-98766fc96914 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:20.588039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1e3f1714-ca50-464e-b039-98766fc96914 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:20.602656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e3f1714-ca50-464e-b039-98766fc96914 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:20.603111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e3f1714-ca50-464e-b039-98766fc96914 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:20.603912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e3f1714-ca50-464e-b039-98766fc96914 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:20.604359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e3f1714-ca50-464e-b039-98766fc96914 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:20.927838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8fa3bb1c-0fdd-494e-b1ab-561f27680afe tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:20.946834 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8fa3bb1c-0fdd-494e-b1ab-561f27680afe tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1471 microversion: 2.1 time: 1.377282 Jul 28 03:55:20.947457 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1851/4142] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:19 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1471 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:20.977187 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fa7f55b9-420e-46ee-80c1-fdf98a1c9e91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:20.979753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fa7f55b9-420e-46ee-80c1-fdf98a1c9e91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:21.000315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa7f55b9-420e-46ee-80c1-fdf98a1c9e91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:21.001088 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa7f55b9-420e-46ee-80c1-fdf98a1c9e91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:21.002122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa7f55b9-420e-46ee-80c1-fdf98a1c9e91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:21.002669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa7f55b9-420e-46ee-80c1-fdf98a1c9e91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:21.478453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1e3f1714-ca50-464e-b039-98766fc96914 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:21.487870 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1e3f1714-ca50-464e-b039-98766fc96914 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1275 microversion: 2.1 time: 0.907690 Jul 28 03:55:21.507828 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2292/4143] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:20 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1275 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:21.511428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3d6cbca7-e066-411f-9ce7-f3bb8d368a95 req-3d102f16-1da1-461d-813c-bda9bba83fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "091c0997-537d-4124-9945-1ef1dd079d63", "name": "network-vif-deleted", "tag": "c5b8c623-1fc8-4425-b1c1-c5da71e14c34"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:21.537558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3d6cbca7-e066-411f-9ce7-f3bb8d368a95 req-3d102f16-1da1-461d-813c-bda9bba83fbd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:21.539509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3d6cbca7-e066-411f-9ce7-f3bb8d368a95 req-3d102f16-1da1-461d-813c-bda9bba83fbd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:22.003884 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3d6cbca7-e066-411f-9ce7-f3bb8d368a95 req-3d102f16-1da1-461d-813c-bda9bba83fbd service nova] Creating event network-vif-deleted:c5b8c623-1fc8-4425-b1c1-c5da71e14c34 for instance 091c0997-537d-4124-9945-1ef1dd079d63 on n-h1-826756-3 Jul 28 03:55:22.013366 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3d6cbca7-e066-411f-9ce7-f3bb8d368a95 req-3d102f16-1da1-461d-813c-bda9bba83fbd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.514636 Jul 28 03:55:22.016074 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2293/4144] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:22.034251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ee0bd9b3-7e18-4bbd-9623-996f1a514372 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:22.036600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ee0bd9b3-7e18-4bbd-9623-996f1a514372 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:22.056706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee0bd9b3-7e18-4bbd-9623-996f1a514372 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:22.057556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee0bd9b3-7e18-4bbd-9623-996f1a514372 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:22.058580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee0bd9b3-7e18-4bbd-9623-996f1a514372 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:22.059241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee0bd9b3-7e18-4bbd-9623-996f1a514372 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:22.100285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee0bd9b3-7e18-4bbd-9623-996f1a514372 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:22.101279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee0bd9b3-7e18-4bbd-9623-996f1a514372 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:22.102014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-ee0bd9b3-7e18-4bbd-9623-996f1a514372 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lazy-loading 'fault' on Instance uuid 091c0997-537d-4124-9945-1ef1dd079d63 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:55:22.174152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ee0bd9b3-7e18-4bbd-9623-996f1a514372 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af5e8135e15471f92108c2774212cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565b5ba6a4c4496b913bbb8c95b6cd18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:22.196398 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ee0bd9b3-7e18-4bbd-9623-996f1a514372 tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 200 len: 1306 microversion: 2.1 time: 0.169001 Jul 28 03:55:22.213517 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2294/4145] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:22 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 1306 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:22.516118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fa7f55b9-420e-46ee-80c1-fdf98a1c9e91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:22.521360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-20f07e45-dd1d-4abe-9f08-579af3e68252 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:22.522260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-20f07e45-dd1d-4abe-9f08-579af3e68252 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:22.527108 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fa7f55b9-420e-46ee-80c1-fdf98a1c9e91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1317 microversion: 2.1 time: 1.570604 Jul 28 03:55:22.527873 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1852/4146] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:20 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1317 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:22.534175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20f07e45-dd1d-4abe-9f08-579af3e68252 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:22.535302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20f07e45-dd1d-4abe-9f08-579af3e68252 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:22.536373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20f07e45-dd1d-4abe-9f08-579af3e68252 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:22.536965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20f07e45-dd1d-4abe-9f08-579af3e68252 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:22.700999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-20f07e45-dd1d-4abe-9f08-579af3e68252 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:22.714264 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-20f07e45-dd1d-4abe-9f08-579af3e68252 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1275 microversion: 2.1 time: 0.199448 Jul 28 03:55:22.716131 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2295/4147] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:22 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1275 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:23.223101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-afb4ff72-0e1a-4dff-af84-5ed539de899b tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:23.223768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-afb4ff72-0e1a-4dff-af84-5ed539de899b tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] [instance: 091c0997-537d-4124-9945-1ef1dd079d63] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:23.235410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afb4ff72-0e1a-4dff-af84-5ed539de899b tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:23.237123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afb4ff72-0e1a-4dff-af84-5ed539de899b tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:23.240079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afb4ff72-0e1a-4dff-af84-5ed539de899b tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:23.240775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afb4ff72-0e1a-4dff-af84-5ed539de899b tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:23.278588 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-afb4ff72-0e1a-4dff-af84-5ed539de899b tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] HTTP exception thrown: Instance 091c0997-537d-4124-9945-1ef1dd079d63 could not be found. Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-afb4ff72-0e1a-4dff-af84-5ed539de899b tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Request method failure captured: Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 HTTP/1.1 Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gg7G2DrOKI_Bj5hWsmZ1pP6ndynMfF5gYh6na_ZnI5FzQQ_-siOnWWZ2EjvtESiHROq-Rcrz9VBljQyjwxE3LpJAsKa7oF9yTxgNY4fYF81QFzFvX7XgYcxVU5KfgUTxOWCN7HzvARGRM_4aLDl43kKESC-APFJgb281w8d815_Epc Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 565b5ba6a4c4496b913bbb8c95b6cd18 Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesOneServerTestJSON-1180323520 Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/565b5ba6a4c4496b913bbb8c95b6cd18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/565b5ba6a4c4496b913bbb8c95b6cd18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_565b5ba6a4c4496b913bbb8c95b6cd18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/565b5ba6a4c4496b913bbb8c95b6cd18"}]}] Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesOneServerTestJSON-1180323520 Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 565b5ba6a4c4496b913bbb8c95b6cd18 Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1180323520 Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesOneServerTestJSON-1180323520-project Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 6af5e8135e15471f92108c2774212cc3 Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesOneServerTestJSON-1180323520-project Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 091c0997-537d-4124-9945-1ef1dd079d63 could not be found. Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '091c0997-537d-4124-9945-1ef1dd079d63'} Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 091c0997-537d-4124-9945-1ef1dd079d63 could not be found. Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 091c0997-537d-4124-9945-1ef1dd079d63 could not be found. Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:23.281507 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:23.287295 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:23.287295 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:23.287295 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:23.287295 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:55:23.287295 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:55:23.287295 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 091c0997-537d-4124-9945-1ef1dd079d63 could not be found. Jul 28 03:55:23.287295 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:23.289057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-afb4ff72-0e1a-4dff-af84-5ed539de899b tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] Returning 404 to user: Instance 091c0997-537d-4124-9945-1ef1dd079d63 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:55:23.291612 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-afb4ff72-0e1a-4dff-af84-5ed539de899b tempest-ImagesOneServerTestJSON-1180323520 tempest-ImagesOneServerTestJSON-1180323520-project] 10.222.0.48 "GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63" status: 404 len: 111 microversion: 2.1 time: 0.073046 Jul 28 03:55:23.294575 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1853/4148] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:23 2022] GET /compute/v2.1/servers/091c0997-537d-4124-9945-1ef1dd079d63 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:55:23.551112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-22ace947-1b70-47fd-9406-7644cab3c70d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:23.552503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-22ace947-1b70-47fd-9406-7644cab3c70d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:23.566581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22ace947-1b70-47fd-9406-7644cab3c70d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:23.571721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22ace947-1b70-47fd-9406-7644cab3c70d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:23.573036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22ace947-1b70-47fd-9406-7644cab3c70d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:23.580899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22ace947-1b70-47fd-9406-7644cab3c70d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:23.736660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39bf94ef-0ac0-429a-9b16-5aeb1218e7d5 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:23.737311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-39bf94ef-0ac0-429a-9b16-5aeb1218e7d5 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:23.748209 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39bf94ef-0ac0-429a-9b16-5aeb1218e7d5 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:23.748686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39bf94ef-0ac0-429a-9b16-5aeb1218e7d5 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:23.752242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39bf94ef-0ac0-429a-9b16-5aeb1218e7d5 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:23.753681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39bf94ef-0ac0-429a-9b16-5aeb1218e7d5 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:23.937589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-22ace947-1b70-47fd-9406-7644cab3c70d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:23.952581 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-22ace947-1b70-47fd-9406-7644cab3c70d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1317 microversion: 2.1 time: 0.406298 Jul 28 03:55:23.968579 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2296/4149] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:23 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:24.627403 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-39bf94ef-0ac0-429a-9b16-5aeb1218e7d5 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:24.672686 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-39bf94ef-0ac0-429a-9b16-5aeb1218e7d5 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1317 microversion: 2.1 time: 0.910039 Jul 28 03:55:24.676294 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1854/4150] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:23 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1317 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:55:24.978623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e22d0361-9de1-40b7-95a8-a1b7ab23d617 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:24.980215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e22d0361-9de1-40b7-95a8-a1b7ab23d617 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:25.025206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e22d0361-9de1-40b7-95a8-a1b7ab23d617 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:25.028308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e22d0361-9de1-40b7-95a8-a1b7ab23d617 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:25.029512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e22d0361-9de1-40b7-95a8-a1b7ab23d617 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:25.033535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e22d0361-9de1-40b7-95a8-a1b7ab23d617 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:25.509218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e22d0361-9de1-40b7-95a8-a1b7ab23d617 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:25.532481 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e22d0361-9de1-40b7-95a8-a1b7ab23d617 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1317 microversion: 2.1 time: 0.561070 Jul 28 03:55:25.533095 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2297/4151] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:24 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1317 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:25.713031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4b184c28-9455-4122-a68f-e586de5c2024 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:25.716013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4b184c28-9455-4122-a68f-e586de5c2024 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:25.747266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b184c28-9455-4122-a68f-e586de5c2024 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:25.750226 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b184c28-9455-4122-a68f-e586de5c2024 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:25.756909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b184c28-9455-4122-a68f-e586de5c2024 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:25.759099 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b184c28-9455-4122-a68f-e586de5c2024 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:26.560708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f8e31f2-bf72-49dd-8f44-1b905c0a5e36 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:26.561404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2f8e31f2-bf72-49dd-8f44-1b905c0a5e36 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:26.585388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f8e31f2-bf72-49dd-8f44-1b905c0a5e36 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:26.594608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f8e31f2-bf72-49dd-8f44-1b905c0a5e36 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:26.597081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f8e31f2-bf72-49dd-8f44-1b905c0a5e36 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:26.600921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f8e31f2-bf72-49dd-8f44-1b905c0a5e36 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:27.201098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2f8e31f2-bf72-49dd-8f44-1b905c0a5e36 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:27.222405 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2f8e31f2-bf72-49dd-8f44-1b905c0a5e36 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1317 microversion: 2.1 time: 0.660904 Jul 28 03:55:27.223515 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2298/4152] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:26 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:27.372228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-ae3a928d-bef9-4e6f-8ea2-5c0bc5866547 req-0d3054c8-9dd2-4ebc-bef7-66c9090287a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b66483-933e-4f43-ae0a-51f310b354bd", "name": "network-vif-plugged", "status": "completed", "tag": "c7389941-74c7-4501-90bf-188fb0ba1398"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:27.396025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ae3a928d-bef9-4e6f-8ea2-5c0bc5866547 req-0d3054c8-9dd2-4ebc-bef7-66c9090287a5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:27.396923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ae3a928d-bef9-4e6f-8ea2-5c0bc5866547 req-0d3054c8-9dd2-4ebc-bef7-66c9090287a5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:27.412976 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-ae3a928d-bef9-4e6f-8ea2-5c0bc5866547 req-0d3054c8-9dd2-4ebc-bef7-66c9090287a5 service nova] Creating event network-vif-plugged:c7389941-74c7-4501-90bf-188fb0ba1398 for instance d4b66483-933e-4f43-ae0a-51f310b354bd on n-h1-826756-3 Jul 28 03:55:27.420103 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-ae3a928d-bef9-4e6f-8ea2-5c0bc5866547 req-0d3054c8-9dd2-4ebc-bef7-66c9090287a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052661 Jul 28 03:55:27.422910 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2299/4153] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:55:27.582280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4b184c28-9455-4122-a68f-e586de5c2024 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:27.591834 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4b184c28-9455-4122-a68f-e586de5c2024 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1317 microversion: 2.1 time: 1.890322 Jul 28 03:55:27.594572 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1855/4154] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:25 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1317 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:28.250682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-925aa5b7-69b8-4e12-b4ee-ef192f37f302 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:28.252682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-925aa5b7-69b8-4e12-b4ee-ef192f37f302 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:28.256734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:28.266420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:28.285392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-925aa5b7-69b8-4e12-b4ee-ef192f37f302 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:28.291404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-925aa5b7-69b8-4e12-b4ee-ef192f37f302 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:28.294562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-925aa5b7-69b8-4e12-b4ee-ef192f37f302 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:28.295930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-925aa5b7-69b8-4e12-b4ee-ef192f37f302 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:28.396166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-5c469269-c2a5-44ba-9202-3e52d5026c0d req-a1f3c14f-7bc2-4290-82ba-2e0ba44ffef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "878cce4d-84e4-4b06-ba18-1233d9baa8c5", "tag": "aee1e06b-9023-45fd-8be4-e0ad799ef062"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:28.420961 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5c469269-c2a5-44ba-9202-3e52d5026c0d req-a1f3c14f-7bc2-4290-82ba-2e0ba44ffef7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:28.421416 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5c469269-c2a5-44ba-9202-3e52d5026c0d req-a1f3c14f-7bc2-4290-82ba-2e0ba44ffef7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:28.476825 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-5c469269-c2a5-44ba-9202-3e52d5026c0d req-a1f3c14f-7bc2-4290-82ba-2e0ba44ffef7 service nova] Creating event network-changed:aee1e06b-9023-45fd-8be4-e0ad799ef062 for instance 878cce4d-84e4-4b06-ba18-1233d9baa8c5 on n-h2-826756-3 Jul 28 03:55:28.486271 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-5c469269-c2a5-44ba-9202-3e52d5026c0d req-a1f3c14f-7bc2-4290-82ba-2e0ba44ffef7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095732 Jul 28 03:55:28.487505 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1856/4155] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:55:28.623510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bd861d03-4685-494d-bbc9-b9abd913d542 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:28.625328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bd861d03-4685-494d-bbc9-b9abd913d542 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:28.650018 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd861d03-4685-494d-bbc9-b9abd913d542 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:28.650461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd861d03-4685-494d-bbc9-b9abd913d542 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:28.651481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd861d03-4685-494d-bbc9-b9abd913d542 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:28.655270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd861d03-4685-494d-bbc9-b9abd913d542 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:28.974689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-925aa5b7-69b8-4e12-b4ee-ef192f37f302 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:28.984291 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-925aa5b7-69b8-4e12-b4ee-ef192f37f302 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1317 microversion: 2.1 time: 0.739377 Jul 28 03:55:28.989858 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2300/4156] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:28 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1317 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:29.332393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bd861d03-4685-494d-bbc9-b9abd913d542 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:29.346685 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bd861d03-4685-494d-bbc9-b9abd913d542 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1317 microversion: 2.1 time: 0.734956 Jul 28 03:55:29.349005 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1857/4157] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:28 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1317 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:55:30.018040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19bbd468-bafa-4642-a208-68ec19256ec1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:30.021415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-19bbd468-bafa-4642-a208-68ec19256ec1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:30.051429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19bbd468-bafa-4642-a208-68ec19256ec1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:30.051896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19bbd468-bafa-4642-a208-68ec19256ec1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:30.052854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19bbd468-bafa-4642-a208-68ec19256ec1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:30.054372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19bbd468-bafa-4642-a208-68ec19256ec1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:30.371424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f9390060-3da3-4a20-afc6-d0fb07c10b5a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:30.372333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f9390060-3da3-4a20-afc6-d0fb07c10b5a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:30.395078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9390060-3da3-4a20-afc6-d0fb07c10b5a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:30.395078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9390060-3da3-4a20-afc6-d0fb07c10b5a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:30.395078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9390060-3da3-4a20-afc6-d0fb07c10b5a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:30.395078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9390060-3da3-4a20-afc6-d0fb07c10b5a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:30.460618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19bbd468-bafa-4642-a208-68ec19256ec1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:30.474673 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-19bbd468-bafa-4642-a208-68ec19256ec1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1507 microversion: 2.1 time: 0.467528 Jul 28 03:55:30.499866 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2301/4158] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:30 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1507 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:30.514194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-004179e6-3d41-49d1-9291-98b615828f4c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:30.514725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-004179e6-3d41-49d1-9291-98b615828f4c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:30.523332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-004179e6-3d41-49d1-9291-98b615828f4c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:30.524043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-004179e6-3d41-49d1-9291-98b615828f4c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:30.525097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-004179e6-3d41-49d1-9291-98b615828f4c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:30.525587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-004179e6-3d41-49d1-9291-98b615828f4c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:30.533766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:30.586646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-004179e6-3d41-49d1-9291-98b615828f4c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:55:30.757245 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-004179e6-3d41-49d1-9291-98b615828f4c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 204 len: 0 microversion: 2.1 time: 0.258824 Jul 28 03:55:30.762520 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2302/4159] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:55:30 2022] DELETE /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:55:30.782075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-78bf52b3-0b5a-4b1e-bf45-8d36b4382050 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:30.782952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-78bf52b3-0b5a-4b1e-bf45-8d36b4382050 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:30.796558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78bf52b3-0b5a-4b1e-bf45-8d36b4382050 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:30.797302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78bf52b3-0b5a-4b1e-bf45-8d36b4382050 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:30.798391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78bf52b3-0b5a-4b1e-bf45-8d36b4382050 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:30.799006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78bf52b3-0b5a-4b1e-bf45-8d36b4382050 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:31.098474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f9390060-3da3-4a20-afc6-d0fb07c10b5a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:31.117115 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f9390060-3da3-4a20-afc6-d0fb07c10b5a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1317 microversion: 2.1 time: 0.749904 Jul 28 03:55:31.118563 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1858/4160] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:30 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1317 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:31.217849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-78bf52b3-0b5a-4b1e-bf45-8d36b4382050 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:31.232681 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-78bf52b3-0b5a-4b1e-bf45-8d36b4382050 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1513 microversion: 2.1 time: 0.467404 Jul 28 03:55:31.233704 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2303/4161] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:30 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1513 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:55:32.141257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0cbc6268-8639-4dce-b4ba-05f00393949b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:32.142124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0cbc6268-8639-4dce-b4ba-05f00393949b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:32.150668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:32.161671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0cbc6268-8639-4dce-b4ba-05f00393949b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:32.162145 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0cbc6268-8639-4dce-b4ba-05f00393949b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:32.164687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0cbc6268-8639-4dce-b4ba-05f00393949b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:32.165162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0cbc6268-8639-4dce-b4ba-05f00393949b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:32.261428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-18978e61-413f-49f3-820d-fa13830b6e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:32.262102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-18978e61-413f-49f3-820d-fa13830b6e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:32.277623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18978e61-413f-49f3-820d-fa13830b6e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:32.278756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18978e61-413f-49f3-820d-fa13830b6e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:32.280417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18978e61-413f-49f3-820d-fa13830b6e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:32.281084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18978e61-413f-49f3-820d-fa13830b6e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:32.541597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-18978e61-413f-49f3-820d-fa13830b6e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:32.558692 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-18978e61-413f-49f3-820d-fa13830b6e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1513 microversion: 2.1 time: 0.300589 Jul 28 03:55:32.561772 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2304/4162] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:32 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1513 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:33.586052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-46aeddc8-42c2-4c83-97ff-bf9effd341fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:33.586813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-46aeddc8-42c2-4c83-97ff-bf9effd341fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:33.608536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46aeddc8-42c2-4c83-97ff-bf9effd341fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:33.609343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46aeddc8-42c2-4c83-97ff-bf9effd341fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:33.610098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46aeddc8-42c2-4c83-97ff-bf9effd341fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:33.611105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46aeddc8-42c2-4c83-97ff-bf9effd341fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:33.703170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0cbc6268-8639-4dce-b4ba-05f00393949b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:33.728928 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0cbc6268-8639-4dce-b4ba-05f00393949b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1317 microversion: 2.1 time: 1.588235 Jul 28 03:55:33.730130 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1859/4163] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:32 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1317 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:33.900817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-46aeddc8-42c2-4c83-97ff-bf9effd341fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:33.915877 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-46aeddc8-42c2-4c83-97ff-bf9effd341fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1513 microversion: 2.1 time: 0.337524 Jul 28 03:55:33.937273 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2305/4164] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:33 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1513 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:34.752685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3f7e5c04-0c6d-4527-82f6-c630cdcfdef9 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:34.753361 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3f7e5c04-0c6d-4527-82f6-c630cdcfdef9 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:34.780482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f7e5c04-0c6d-4527-82f6-c630cdcfdef9 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:34.781096 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f7e5c04-0c6d-4527-82f6-c630cdcfdef9 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:34.781965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f7e5c04-0c6d-4527-82f6-c630cdcfdef9 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:34.782472 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f7e5c04-0c6d-4527-82f6-c630cdcfdef9 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:34.939659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ff27324-2fe6-43c8-bb7e-c7448d2fb514 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:34.940300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ff27324-2fe6-43c8-bb7e-c7448d2fb514 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:34.950689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ff27324-2fe6-43c8-bb7e-c7448d2fb514 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:34.951149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ff27324-2fe6-43c8-bb7e-c7448d2fb514 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:34.951940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ff27324-2fe6-43c8-bb7e-c7448d2fb514 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:34.952395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ff27324-2fe6-43c8-bb7e-c7448d2fb514 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:35.277214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ff27324-2fe6-43c8-bb7e-c7448d2fb514 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:35.297230 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ff27324-2fe6-43c8-bb7e-c7448d2fb514 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1513 microversion: 2.1 time: 0.361849 Jul 28 03:55:35.298637 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2306/4165] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:34 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1513 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:55:36.286710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3f7e5c04-0c6d-4527-82f6-c630cdcfdef9 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:36.300959 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3f7e5c04-0c6d-4527-82f6-c630cdcfdef9 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1317 microversion: 2.1 time: 1.548407 Jul 28 03:55:36.301816 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1860/4166] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:34 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1317 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:36.319868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-995947d4-e5d9-4eca-8816-e3898bb075f6 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:36.320653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-995947d4-e5d9-4eca-8816-e3898bb075f6 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:36.343182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-995947d4-e5d9-4eca-8816-e3898bb075f6 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:36.343419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-995947d4-e5d9-4eca-8816-e3898bb075f6 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:36.344147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-995947d4-e5d9-4eca-8816-e3898bb075f6 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:36.350339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-995947d4-e5d9-4eca-8816-e3898bb075f6 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:36.431767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-dfd2a905-92f0-4894-be93-fbc1be1908c4 req-eb46a034-d820-4240-9891-4642f556f28d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b66483-933e-4f43-ae0a-51f310b354bd", "name": "network-vif-deleted", "tag": "c7389941-74c7-4501-90bf-188fb0ba1398"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:36.463913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-dfd2a905-92f0-4894-be93-fbc1be1908c4 req-eb46a034-d820-4240-9891-4642f556f28d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:36.464379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-dfd2a905-92f0-4894-be93-fbc1be1908c4 req-eb46a034-d820-4240-9891-4642f556f28d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:36.515586 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-dfd2a905-92f0-4894-be93-fbc1be1908c4 req-eb46a034-d820-4240-9891-4642f556f28d service nova] Creating event network-vif-deleted:c7389941-74c7-4501-90bf-188fb0ba1398 for instance d4b66483-933e-4f43-ae0a-51f310b354bd on n-h1-826756-3 Jul 28 03:55:36.536237 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-dfd2a905-92f0-4894-be93-fbc1be1908c4 req-eb46a034-d820-4240-9891-4642f556f28d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100025 Jul 28 03:55:36.537822 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1861/4167] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:55:36.638039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-995947d4-e5d9-4eca-8816-e3898bb075f6 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:36.650252 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-995947d4-e5d9-4eca-8816-e3898bb075f6 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 200 len: 1471 microversion: 2.1 time: 0.334330 Jul 28 03:55:36.653710 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2307/4168] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:36 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 1471 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:37.326461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-efcbcd85-c44b-4a96-8fc8-8028a3faa732 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:37.332065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f2cf55fc-2296-4366-a157-e254f260a3c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:37.333589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-efcbcd85-c44b-4a96-8fc8-8028a3faa732 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:37.336508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f2cf55fc-2296-4366-a157-e254f260a3c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:37.350886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efcbcd85-c44b-4a96-8fc8-8028a3faa732 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:37.351844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efcbcd85-c44b-4a96-8fc8-8028a3faa732 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:37.412871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efcbcd85-c44b-4a96-8fc8-8028a3faa732 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:37.412871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efcbcd85-c44b-4a96-8fc8-8028a3faa732 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:37.421278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2cf55fc-2296-4366-a157-e254f260a3c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:37.421278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2cf55fc-2296-4366-a157-e254f260a3c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:37.421278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2cf55fc-2296-4366-a157-e254f260a3c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:37.421278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f2cf55fc-2296-4366-a157-e254f260a3c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:37.539054 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f2cf55fc-2296-4366-a157-e254f260a3c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments/cc343077-0b34-4b31-9628-6d79124f591b" status: 200 len: 194 microversion: 2.20 time: 0.218116 Jul 28 03:55:37.540177 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1862/4169] 10.222.0.48 () {60 vars in 1454 bytes} [Thu Jul 28 03:55:37 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments/cc343077-0b34-4b31-9628-6d79124f591b => generated 194 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:55:37.677105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-609b8034-43fa-474e-8b02-d97f62d63605 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:37.678563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-609b8034-43fa-474e-8b02-d97f62d63605 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:37.688622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-609b8034-43fa-474e-8b02-d97f62d63605 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:37.689255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-609b8034-43fa-474e-8b02-d97f62d63605 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:37.691035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-609b8034-43fa-474e-8b02-d97f62d63605 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:37.691743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-609b8034-43fa-474e-8b02-d97f62d63605 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:37.859356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-efcbcd85-c44b-4a96-8fc8-8028a3faa732 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:37.871609 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-efcbcd85-c44b-4a96-8fc8-8028a3faa732 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1317 microversion: 2.1 time: 0.547489 Jul 28 03:55:37.875058 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2308/4170] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:37 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1317 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:37.888719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c53b5440-446d-477a-9c14-c5dd7f6e7eed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:37.889884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c53b5440-446d-477a-9c14-c5dd7f6e7eed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:37.903894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c53b5440-446d-477a-9c14-c5dd7f6e7eed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:37.905026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c53b5440-446d-477a-9c14-c5dd7f6e7eed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:37.907500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c53b5440-446d-477a-9c14-c5dd7f6e7eed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:37.908125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c53b5440-446d-477a-9c14-c5dd7f6e7eed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:37.931151 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-c53b5440-446d-477a-9c14-c5dd7f6e7eed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c53b5440-446d-477a-9c14-c5dd7f6e7eed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd HTTP/1.1 Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd4b66483-933e-4f43-ae0a-51f310b354bd'} Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:37.938493 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:37.942747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:37.942747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:37.942747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:37.942747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:55:37.942747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:55:37.942747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:55:37.942747 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:37.943336 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-609b8034-43fa-474e-8b02-d97f62d63605 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lazy-loading 'services' on Instance uuid 99d0126e-11bf-4048-9e35-7309c228b534 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:55:37.964599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c53b5440-446d-477a-9c14-c5dd7f6e7eed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:55:37.971367 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c53b5440-446d-477a-9c14-c5dd7f6e7eed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 404 len: 111 microversion: 2.1 time: 0.088024 Jul 28 03:55:37.975494 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2309/4171] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:37 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:55:37.988737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b5b1a3c-e0e2-455a-aa4b-c8f68b469db2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:37.989820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3b5b1a3c-e0e2-455a-aa4b-c8f68b469db2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:37.993223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:38.001337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b5b1a3c-e0e2-455a-aa4b-c8f68b469db2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:38.001805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b5b1a3c-e0e2-455a-aa4b-c8f68b469db2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:38.002624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b5b1a3c-e0e2-455a-aa4b-c8f68b469db2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:38.003171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b5b1a3c-e0e2-455a-aa4b-c8f68b469db2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:38.184243 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-609b8034-43fa-474e-8b02-d97f62d63605 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "DELETE /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments/cc343077-0b34-4b31-9628-6d79124f591b" status: 202 len: 0 microversion: 2.20 time: 0.514883 Jul 28 03:55:38.185508 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1863/4172] 10.222.0.48 () {60 vars in 1457 bytes} [Thu Jul 28 03:55:37 2022] DELETE /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments/cc343077-0b34-4b31-9628-6d79124f591b => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:55:38.198635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c0443841-2306-4677-927b-6b5ae5952ccf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:38.210211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c0443841-2306-4677-927b-6b5ae5952ccf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:38.227032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0443841-2306-4677-927b-6b5ae5952ccf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:38.239804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0443841-2306-4677-927b-6b5ae5952ccf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:38.241493 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0443841-2306-4677-927b-6b5ae5952ccf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:38.242551 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c0443841-2306-4677-927b-6b5ae5952ccf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:38.382425 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c0443841-2306-4677-927b-6b5ae5952ccf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.190107 Jul 28 03:55:38.390258 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1864/4173] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:55:38 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:55:38.895885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6b30634c-bc61-4c7a-914f-1c7189de6578 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:38.897181 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6b30634c-bc61-4c7a-914f-1c7189de6578 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:38.920817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6b30634c-bc61-4c7a-914f-1c7189de6578 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:38.924838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6b30634c-bc61-4c7a-914f-1c7189de6578 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:38.928944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6b30634c-bc61-4c7a-914f-1c7189de6578 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:38.929885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6b30634c-bc61-4c7a-914f-1c7189de6578 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:39.429489 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6b30634c-bc61-4c7a-914f-1c7189de6578 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:39.446041 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6b30634c-bc61-4c7a-914f-1c7189de6578 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1317 microversion: 2.1 time: 0.556324 Jul 28 03:55:39.464857 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1865/4174] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:38 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:39.472490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-3a899466-660e-4765-a7ad-63c9f693f698 req-68b38f3c-96a5-4617-8b95-b8e4e72c84cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878cce4d-84e4-4b06-ba18-1233d9baa8c5", "name": "network-vif-plugged", "status": "completed", "tag": "aee1e06b-9023-45fd-8be4-e0ad799ef062"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:39.489066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3a899466-660e-4765-a7ad-63c9f693f698 req-68b38f3c-96a5-4617-8b95-b8e4e72c84cb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:39.489949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3a899466-660e-4765-a7ad-63c9f693f698 req-68b38f3c-96a5-4617-8b95-b8e4e72c84cb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:39.520380 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-3a899466-660e-4765-a7ad-63c9f693f698 req-68b38f3c-96a5-4617-8b95-b8e4e72c84cb service nova] Creating event network-vif-plugged:aee1e06b-9023-45fd-8be4-e0ad799ef062 for instance 878cce4d-84e4-4b06-ba18-1233d9baa8c5 on n-h2-826756-3 Jul 28 03:55:39.550135 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-3a899466-660e-4765-a7ad-63c9f693f698 req-68b38f3c-96a5-4617-8b95-b8e4e72c84cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083614 Jul 28 03:55:39.551130 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1866/4175] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:39.570177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-81c7f1ee-cd1e-41e8-857d-9afdb7a0ee66 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:39.573893 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-81c7f1ee-cd1e-41e8-857d-9afdb7a0ee66 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:39.585570 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81c7f1ee-cd1e-41e8-857d-9afdb7a0ee66 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:39.608806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81c7f1ee-cd1e-41e8-857d-9afdb7a0ee66 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:39.610675 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81c7f1ee-cd1e-41e8-857d-9afdb7a0ee66 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:39.623187 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-81c7f1ee-cd1e-41e8-857d-9afdb7a0ee66 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:39.753949 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-81c7f1ee-cd1e-41e8-857d-9afdb7a0ee66 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.198581 Jul 28 03:55:39.760955 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1867/4176] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:55:39 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments => generated 197 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:55:39.782263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3b5b1a3c-e0e2-455a-aa4b-c8f68b469db2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:39.801845 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3b5b1a3c-e0e2-455a-aa4b-c8f68b469db2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 1.819762 Jul 28 03:55:39.806943 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2310/4177] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:37 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:40.148633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a8ee3c81-d963-411c-86cc-1f6b17715c03 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a8ee3c81-d963-411c-86cc-1f6b17715c03 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 163 Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": 12345, "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'networks': [{'uuid': '3fcf143f-a069-44e5-9902-e5b7dddd3dfa'}]}}} Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 12345 Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:55:40.155713 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:55:40.159514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:55:40.159514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 28 03:55:40.159514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:40.159514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:40.159514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:40.159514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:40.159514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:40.159514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:40.159514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:55:40.159514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:55:40.159514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 28 03:55:40.159514 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:40.163509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a8ee3c81-d963-411c-86cc-1f6b17715c03 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:55:40.165346 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a8ee3c81-d963-411c-86cc-1f6b17715c03 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.022507 Jul 28 03:55:40.167172 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1868/4178] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:55:40 2022] POST /compute/v2.1/servers => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:55:40.180050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-00fec482-c841-4295-b6c7-e05d92be865b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:40.180851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-00fec482-c841-4295-b6c7-e05d92be865b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:40.191069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00fec482-c841-4295-b6c7-e05d92be865b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:40.192092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00fec482-c841-4295-b6c7-e05d92be865b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:40.193724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00fec482-c841-4295-b6c7-e05d92be865b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:40.194326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00fec482-c841-4295-b6c7-e05d92be865b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:40.482562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3fe362ba-57f9-43b9-a5c3-15ab6d2b16e6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:40.484455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3fe362ba-57f9-43b9-a5c3-15ab6d2b16e6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:40.495104 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3fe362ba-57f9-43b9-a5c3-15ab6d2b16e6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:40.496631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3fe362ba-57f9-43b9-a5c3-15ab6d2b16e6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:40.504894 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3fe362ba-57f9-43b9-a5c3-15ab6d2b16e6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:40.505594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3fe362ba-57f9-43b9-a5c3-15ab6d2b16e6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:41.186393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3fe362ba-57f9-43b9-a5c3-15ab6d2b16e6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:41.222276 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3fe362ba-57f9-43b9-a5c3-15ab6d2b16e6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1317 microversion: 2.1 time: 0.742326 Jul 28 03:55:41.224646 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1869/4179] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:40 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1317 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:41.247890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2455771c-c3cc-4b49-b95c-aef027cf2e7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:41.253004 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2455771c-c3cc-4b49-b95c-aef027cf2e7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:41.264956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2455771c-c3cc-4b49-b95c-aef027cf2e7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:41.265708 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2455771c-c3cc-4b49-b95c-aef027cf2e7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:41.266704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2455771c-c3cc-4b49-b95c-aef027cf2e7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:41.267284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2455771c-c3cc-4b49-b95c-aef027cf2e7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:41.345243 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2455771c-c3cc-4b49-b95c-aef027cf2e7a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.118194 Jul 28 03:55:41.345837 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1870/4180] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:55:41 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:55:41.975797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-00fec482-c841-4295-b6c7-e05d92be865b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:42.046723 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-00fec482-c841-4295-b6c7-e05d92be865b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 1.872962 Jul 28 03:55:42.047901 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2311/4181] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:40 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:42.086382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-78517ac1-2d8e-4cbd-925e-c49807dfcc9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:42.087004 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-78517ac1-2d8e-4cbd-925e-c49807dfcc9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:42.141542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78517ac1-2d8e-4cbd-925e-c49807dfcc9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:42.142088 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78517ac1-2d8e-4cbd-925e-c49807dfcc9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:42.142791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78517ac1-2d8e-4cbd-925e-c49807dfcc9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:42.143228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78517ac1-2d8e-4cbd-925e-c49807dfcc9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:42.270156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9e9ab369-46e2-46a7-888c-d035b477d7f6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:42.271643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9e9ab369-46e2-46a7-888c-d035b477d7f6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:42.340285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e9ab369-46e2-46a7-888c-d035b477d7f6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:42.340873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e9ab369-46e2-46a7-888c-d035b477d7f6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:42.341719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e9ab369-46e2-46a7-888c-d035b477d7f6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:42.342499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e9ab369-46e2-46a7-888c-d035b477d7f6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:43.367766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-78517ac1-2d8e-4cbd-925e-c49807dfcc9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:43.427779 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-78517ac1-2d8e-4cbd-925e-c49807dfcc9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 1.345851 Jul 28 03:55:43.428396 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1871/4182] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:42 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:43.470115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e5effbde-80ae-4c3e-b695-d0c44270d449 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:43.482575 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e5effbde-80ae-4c3e-b695-d0c44270d449 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:43.504092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9e9ab369-46e2-46a7-888c-d035b477d7f6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:43.506930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5effbde-80ae-4c3e-b695-d0c44270d449 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:43.507382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5effbde-80ae-4c3e-b695-d0c44270d449 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:43.508168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5effbde-80ae-4c3e-b695-d0c44270d449 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:43.508688 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e5effbde-80ae-4c3e-b695-d0c44270d449 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:43.514674 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9e9ab369-46e2-46a7-888c-d035b477d7f6 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1317 microversion: 2.1 time: 1.263640 Jul 28 03:55:43.515966 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2312/4183] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:42 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1317 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:55:43.637822 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e5effbde-80ae-4c3e-b695-d0c44270d449 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.196351 Jul 28 03:55:43.651914 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1872/4184] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:55:43 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:55:43.835927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-75eec7d1-7716-49a4-ba64-45f409a66ce7 tempest-QuotasTestJSON-345803225 tempest-QuotasTestJSON-345803225-project] Calling method '.version_select at 0x7ffa6792fc10>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:43.962107 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-75eec7d1-7716-49a4-ba64-45f409a66ce7 tempest-QuotasTestJSON-345803225 tempest-QuotasTestJSON-345803225-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/7f05145947ed47e39cca7b26b78677de/defaults" status: 200 len: 371 microversion: 2.1 time: 0.444525 Jul 28 03:55:43.963010 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2313/4185] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 03:55:43 2022] GET /compute/v2.1/os-quota-sets/7f05145947ed47e39cca7b26b78677de/defaults => generated 371 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:43.975942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-16b89237-4bf0-4ce4-858c-aa9ec3681e5a tempest-QuotasTestJSON-345803225 tempest-QuotasTestJSON-345803225-project] Calling method '.version_select at 0x7ffa74584c10>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:44.139545 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-16b89237-4bf0-4ce4-858c-aa9ec3681e5a tempest-QuotasTestJSON-345803225 tempest-QuotasTestJSON-345803225-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/7f05145947ed47e39cca7b26b78677de" status: 200 len: 371 microversion: 2.1 time: 0.167823 Jul 28 03:55:44.141837 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1873/4186] 10.222.0.48 () {58 vars in 1242 bytes} [Thu Jul 28 03:55:43 2022] GET /compute/v2.1/os-quota-sets/7f05145947ed47e39cca7b26b78677de => generated 371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:44.160087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-683e1907-b66f-4693-9ab9-2606dc5a84f4 tempest-QuotasTestJSON-345803225 tempest-QuotasTestJSON-345803225-project] Calling method '.version_select at 0x7ffa6792f1f0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:44.333588 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-683e1907-b66f-4693-9ab9-2606dc5a84f4 tempest-QuotasTestJSON-345803225 tempest-QuotasTestJSON-345803225-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/7f05145947ed47e39cca7b26b78677de/defaults" status: 200 len: 371 microversion: 2.1 time: 0.178877 Jul 28 03:55:44.334196 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2314/4187] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 03:55:44 2022] GET /compute/v2.1/os-quota-sets/7f05145947ed47e39cca7b26b78677de/defaults => generated 371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:44.351294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-94b0b35e-ccc7-4bdc-88bb-4ec4eee6b020 tempest-QuotasTestJSON-345803225 tempest-QuotasTestJSON-345803225-project] Calling method '.version_select at 0x7ffa74584430>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:44.536944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-22b3baf7-0e49-4804-95e7-64c443778f35 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:44.537569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-22b3baf7-0e49-4804-95e7-64c443778f35 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:44.573011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22b3baf7-0e49-4804-95e7-64c443778f35 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:44.573483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22b3baf7-0e49-4804-95e7-64c443778f35 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:44.582358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22b3baf7-0e49-4804-95e7-64c443778f35 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:44.585531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22b3baf7-0e49-4804-95e7-64c443778f35 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:44.638411 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-94b0b35e-ccc7-4bdc-88bb-4ec4eee6b020 tempest-QuotasTestJSON-345803225 tempest-QuotasTestJSON-345803225-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/7f05145947ed47e39cca7b26b78677de" status: 200 len: 371 microversion: 2.1 time: 0.291666 Jul 28 03:55:44.640644 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1874/4188] 10.222.0.48 () {58 vars in 1242 bytes} [Thu Jul 28 03:55:44 2022] GET /compute/v2.1/os-quota-sets/7f05145947ed47e39cca7b26b78677de => generated 371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:44.662216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b0903703-aa78-477d-8cea-c8914dde93a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:44.669644 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b0903703-aa78-477d-8cea-c8914dde93a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:44.697314 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0903703-aa78-477d-8cea-c8914dde93a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:44.697906 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0903703-aa78-477d-8cea-c8914dde93a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:44.702534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0903703-aa78-477d-8cea-c8914dde93a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:44.706063 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0903703-aa78-477d-8cea-c8914dde93a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:44.831199 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b0903703-aa78-477d-8cea-c8914dde93a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.181956 Jul 28 03:55:44.831731 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1875/4189] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:55:44 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:55:44.862922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7b09ad4a-4d91-4200-9783-990e9f762849 tempest-QuotasTestJSON-345803225 tempest-QuotasTestJSON-345803225-project] Calling method '.version_select at 0x7ffa7408fd30>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:45.105724 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7b09ad4a-4d91-4200-9783-990e9f762849 tempest-QuotasTestJSON-345803225 tempest-QuotasTestJSON-345803225-project] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/7f05145947ed47e39cca7b26b78677de?user_id=1df89c91b9d946bf9f85caa5ae8ebb16" status: 200 len: 371 microversion: 2.1 time: 0.254617 Jul 28 03:55:45.106806 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1876/4190] 10.222.0.48 () {58 vars in 1323 bytes} [Thu Jul 28 03:55:44 2022] GET /compute/v2.1/os-quota-sets/7f05145947ed47e39cca7b26b78677de?user_id=1df89c91b9d946bf9f85caa5ae8ebb16 => generated 371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:45.522618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-22b3baf7-0e49-4804-95e7-64c443778f35 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:45.542314 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-22b3baf7-0e49-4804-95e7-64c443778f35 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1506 microversion: 2.1 time: 1.010298 Jul 28 03:55:45.548705 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2315/4191] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:44 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1506 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:55:45.574865 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f482e079-dfb4-4e79-bd93-150bb58f6bdc tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:45.575365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f482e079-dfb4-4e79-bd93-150bb58f6bdc tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:45.602362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f482e079-dfb4-4e79-bd93-150bb58f6bdc tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:45.602885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f482e079-dfb4-4e79-bd93-150bb58f6bdc tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:45.603941 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f482e079-dfb4-4e79-bd93-150bb58f6bdc tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:45.604331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f482e079-dfb4-4e79-bd93-150bb58f6bdc tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:45.696219 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f482e079-dfb4-4e79-bd93-150bb58f6bdc tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5/ips" status: 200 len: 109 microversion: 2.1 time: 0.125891 Jul 28 03:55:45.705963 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1877/4192] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:55:45 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5/ips => generated 109 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:45.723327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4e588f8-af40-49c6-8111-03fb0fda1288 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:45.724000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4e588f8-af40-49c6-8111-03fb0fda1288 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:45.746538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4e588f8-af40-49c6-8111-03fb0fda1288 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:45.748647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4e588f8-af40-49c6-8111-03fb0fda1288 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:45.750885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4e588f8-af40-49c6-8111-03fb0fda1288 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:45.756490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4e588f8-af40-49c6-8111-03fb0fda1288 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:45.844697 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0c342315-878f-4020-b43c-a9d08c60b53e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:45.846686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0c342315-878f-4020-b43c-a9d08c60b53e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:45.870053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0c342315-878f-4020-b43c-a9d08c60b53e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:45.870629 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0c342315-878f-4020-b43c-a9d08c60b53e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:45.871575 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0c342315-878f-4020-b43c-a9d08c60b53e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:45.872420 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0c342315-878f-4020-b43c-a9d08c60b53e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:45.880334 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4e588f8-af40-49c6-8111-03fb0fda1288 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5/ips" status: 200 len: 109 microversion: 2.1 time: 0.172788 Jul 28 03:55:45.881633 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2316/4193] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:55:45 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5/ips => generated 109 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:45.905218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eed824b8-69c9-4c1b-8ed1-3723e1e5df48 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:45.907887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eed824b8-69c9-4c1b-8ed1-3723e1e5df48 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:45.920210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eed824b8-69c9-4c1b-8ed1-3723e1e5df48 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:45.921074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eed824b8-69c9-4c1b-8ed1-3723e1e5df48 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:45.922074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eed824b8-69c9-4c1b-8ed1-3723e1e5df48 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:45.922755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eed824b8-69c9-4c1b-8ed1-3723e1e5df48 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:45.999315 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0c342315-878f-4020-b43c-a9d08c60b53e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.159648 Jul 28 03:55:46.000286 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1878/4194] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:55:45 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:55:46.044921 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eed824b8-69c9-4c1b-8ed1-3723e1e5df48 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5/ips/tempest-ServerAddressesTestJSON-1572952055-network" status: 200 len: 94 microversion: 2.1 time: 0.149611 Jul 28 03:55:46.053319 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2317/4195] 10.222.0.48 () {58 vars in 1401 bytes} [Thu Jul 28 03:55:45 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5/ips/tempest-ServerAddressesTestJSON-1572952055-network => generated 94 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:55:46.059156 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-471e609d-a3bc-45d6-8991-3c07883cd070 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:46.059655 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-471e609d-a3bc-45d6-8991-3c07883cd070 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:46.071676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-471e609d-a3bc-45d6-8991-3c07883cd070 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:46.076769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-471e609d-a3bc-45d6-8991-3c07883cd070 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:46.077676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-471e609d-a3bc-45d6-8991-3c07883cd070 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:46.078121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-471e609d-a3bc-45d6-8991-3c07883cd070 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:46.188377 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-471e609d-a3bc-45d6-8991-3c07883cd070 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:55:46.509138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-321178529", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "2af3b349-fc32-4cc8-84a4-341a88489282"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:46.527445 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-471e609d-a3bc-45d6-8991-3c07883cd070 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "DELETE /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 204 len: 0 microversion: 2.1 time: 0.471910 Jul 28 03:55:46.532914 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1879/4196] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:55:46 2022] DELETE /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:55:46.561530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d0d9f5ac-c464-4655-bd16-b8613342f34a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:46.562785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d0d9f5ac-c464-4655-bd16-b8613342f34a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:46.582313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d0d9f5ac-c464-4655-bd16-b8613342f34a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:46.583431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d0d9f5ac-c464-4655-bd16-b8613342f34a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:46.583965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d0d9f5ac-c464-4655-bd16-b8613342f34a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:46.584341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d0d9f5ac-c464-4655-bd16-b8613342f34a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:46.793859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] validate_networks() for [('2af3b349-fc32-4cc8-84a4-341a88489282', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:55:47.109249 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d0d9f5ac-c464-4655-bd16-b8613342f34a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:47.127027 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d0d9f5ac-c464-4655-bd16-b8613342f34a tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1512 microversion: 2.1 time: 0.585212 Jul 28 03:55:47.131756 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1880/4197] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:46 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1512 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:47.150958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3ff3474c-f811-493a-9f55-6610c8d6c8de tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:47.159292 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3ff3474c-f811-493a-9f55-6610c8d6c8de tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:47.175604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ff3474c-f811-493a-9f55-6610c8d6c8de tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:47.176053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ff3474c-f811-493a-9f55-6610c8d6c8de tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:47.176873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ff3474c-f811-493a-9f55-6610c8d6c8de tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:47.177312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ff3474c-f811-493a-9f55-6610c8d6c8de tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:47.245640 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3ff3474c-f811-493a-9f55-6610c8d6c8de tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.111009 Jul 28 03:55:47.246661 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1881/4198] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:55:47 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:55:47.656525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aebf064e-e2e3-47ce-bcb0-9f300245057d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:47.657604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-aebf064e-e2e3-47ce-bcb0-9f300245057d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:47.669419 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aebf064e-e2e3-47ce-bcb0-9f300245057d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:47.670403 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aebf064e-e2e3-47ce-bcb0-9f300245057d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:47.683071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aebf064e-e2e3-47ce-bcb0-9f300245057d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:47.683845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aebf064e-e2e3-47ce-bcb0-9f300245057d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:47.758649 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aebf064e-e2e3-47ce-bcb0-9f300245057d tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/ips" status: 200 len: 147 microversion: 2.1 time: 0.105697 Jul 28 03:55:47.778447 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1882/4199] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:55:47 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/ips => generated 147 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:48.156584 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-99bb25af-35f7-4374-a779-6186609ffe2b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:48.157501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-99bb25af-35f7-4374-a779-6186609ffe2b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:48.168345 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-99bb25af-35f7-4374-a779-6186609ffe2b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:48.173353 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-99bb25af-35f7-4374-a779-6186609ffe2b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:48.183551 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-99bb25af-35f7-4374-a779-6186609ffe2b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:48.184675 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-99bb25af-35f7-4374-a779-6186609ffe2b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:48.421327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:55:48.421327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:55:48.421327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:55:48.421327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:55:48.421327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:55:48.423322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:48.479426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:48.479894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:48.489107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:48.492400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:48.555272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Getting quotas for project 48efc7f6c8c94d428bc418846baeab4f. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:55:48.577682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Getting quotas for user 5265a6963e6e46c8bc7657bcf081362a and project 48efc7f6c8c94d428bc418846baeab4f. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:55:48.651463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:55:48.652906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:55:48.816904 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bd1ef727-4fca-4625-9247-d9d0be5200d9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.759931 Jul 28 03:55:48.821121 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2318/4200] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:55:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:55:48.876998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c61eba60-c5f8-4f3f-8776-6017d05c6292 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:48.883831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c61eba60-c5f8-4f3f-8776-6017d05c6292 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:48.924143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c61eba60-c5f8-4f3f-8776-6017d05c6292 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:48.926468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c61eba60-c5f8-4f3f-8776-6017d05c6292 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:48.930083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c61eba60-c5f8-4f3f-8776-6017d05c6292 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:48.932766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c61eba60-c5f8-4f3f-8776-6017d05c6292 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:49.104519 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c61eba60-c5f8-4f3f-8776-6017d05c6292 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.276254 Jul 28 03:55:49.108805 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2319/4201] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:55:48 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments => generated 197 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:55:49.110080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-99bb25af-35f7-4374-a779-6186609ffe2b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:49.118556 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:49.132443 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-99bb25af-35f7-4374-a779-6186609ffe2b tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1512 microversion: 2.1 time: 0.983254 Jul 28 03:55:49.136344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-904b9909-69c8-4ff7-a920-5f3c7bc72327 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:49.137194 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1883/4202] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:48 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1512 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:49.137622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-904b9909-69c8-4ff7-a920-5f3c7bc72327 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:49.165283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-603686d3-6419-4c36-92f1-5a681d49a05f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-69302978", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a8ff52e2-7879-401b-8d5c-4de054fbb7f2", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:49.346167 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-603686d3-6419-4c36-92f1-5a681d49a05f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Block Device a8ff52e2-7879-401b-8d5c-4de054fbb7f2 is not bootable. Jul 28 03:55:49.350216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-904b9909-69c8-4ff7-a920-5f3c7bc72327 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-603686d3-6419-4c36-92f1-5a681d49a05f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 356 Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-69302978", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a8ff52e2-7879-401b-8d5c-4de054fbb7f2", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: exception: Block Device a8ff52e2-7879-401b-8d5c-4de054fbb7f2 is not bootable. Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-69302978', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'a8ff52e2-7879-401b-8d5c-4de054fbb7f2'}], 'networks': [{'uuid': '3fcf143f-a069-44e5-9902-e5b7dddd3dfa'}]}}} Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2195, in create Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1661, in _create_instance Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device a8ff52e2-7879-401b-8d5c-4de054fbb7f2 is not bootable. Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:55:49.356828 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device a8ff52e2-7879-401b-8d5c-4de054fbb7f2 is not bootable. Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device a8ff52e2-7879-401b-8d5c-4de054fbb7f2 is not bootable. Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-603686d3-6419-4c36-92f1-5a681d49a05f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Block Device a8ff52e2-7879-401b-8d5c-4de054fbb7f2 is not bootable. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-603686d3-6419-4c36-92f1-5a681d49a05f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.220189 Jul 28 03:55:49.361816 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1884/4203] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:55:49 2022] POST /compute/v2.1/servers => generated 110 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:55:49.366300 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-904b9909-69c8-4ff7-a920-5f3c7bc72327 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1224 microversion: 2.1 time: 0.256000 Jul 28 03:55:49.388611 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2320/4204] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:49 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1224 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:49.404137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-48db6797-8def-4427-a6dc-8924180bbb99 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:49.410658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-48db6797-8def-4427-a6dc-8924180bbb99 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:49.440830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48db6797-8def-4427-a6dc-8924180bbb99 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:49.444185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48db6797-8def-4427-a6dc-8924180bbb99 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:49.447948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48db6797-8def-4427-a6dc-8924180bbb99 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:49.448810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48db6797-8def-4427-a6dc-8924180bbb99 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:49.816053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ba1ce229-16c7-46ba-9ee4-15d50e5d65b7 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Action: 'create', calling method: .version_select at 0x7ffa745228b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-549228979"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:50.363840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-48db6797-8def-4427-a6dc-8924180bbb99 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:50.394287 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-48db6797-8def-4427-a6dc-8924180bbb99 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 1.004437 Jul 28 03:55:50.397737 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2321/4205] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:49 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:50.448130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3d6174b2-5592-4fe0-84c8-e6958ff7afca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:50.456442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3d6174b2-5592-4fe0-84c8-e6958ff7afca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:50.477575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d6174b2-5592-4fe0-84c8-e6958ff7afca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:50.481722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d6174b2-5592-4fe0-84c8-e6958ff7afca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:50.483065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d6174b2-5592-4fe0-84c8-e6958ff7afca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:50.489516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d6174b2-5592-4fe0-84c8-e6958ff7afca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:50.609027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:50.715417 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3d6174b2-5592-4fe0-84c8-e6958ff7afca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.290356 Jul 28 03:55:50.741686 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2322/4206] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:55:50 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments => generated 197 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:55:50.770832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aa5c354c-2d74-4191-a48c-3651ea5f28bf tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:50.771954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aa5c354c-2d74-4191-a48c-3651ea5f28bf tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:50.809145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa5c354c-2d74-4191-a48c-3651ea5f28bf tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:50.809720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa5c354c-2d74-4191-a48c-3651ea5f28bf tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:50.812746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa5c354c-2d74-4191-a48c-3651ea5f28bf tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:50.814701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa5c354c-2d74-4191-a48c-3651ea5f28bf tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:51.070470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa5c354c-2d74-4191-a48c-3651ea5f28bf tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:51.074689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa5c354c-2d74-4191-a48c-3651ea5f28bf tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:51.075201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-aa5c354c-2d74-4191-a48c-3651ea5f28bf tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lazy-loading 'fault' on Instance uuid 878cce4d-84e4-4b06-ba18-1233d9baa8c5 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:55:51.340021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aa5c354c-2d74-4191-a48c-3651ea5f28bf tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03a4efae0c04654b541e86b86ad22c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fab9081e5b462fbb075214772b3e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:51.358996 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aa5c354c-2d74-4191-a48c-3651ea5f28bf tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 200 len: 1307 microversion: 2.1 time: 0.607506 Jul 28 03:55:51.363301 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2323/4207] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:50 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 1307 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:51.514753 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ba1ce229-16c7-46ba-9ee4-15d50e5d65b7 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.151775 Jul 28 03:55:51.518054 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1885/4208] 10.222.0.48 () {60 vars in 1155 bytes} [Thu Jul 28 03:55:49 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2158 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 03:55:51.524959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-95ec5011-c5d1-4774-b4f8-e1607e5e7670 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:51.526090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-95ec5011-c5d1-4774-b4f8-e1607e5e7670 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:51.547781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-95ec5011-c5d1-4774-b4f8-e1607e5e7670 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:51.550503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-95ec5011-c5d1-4774-b4f8-e1607e5e7670 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:51.553125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-95ec5011-c5d1-4774-b4f8-e1607e5e7670 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:51.554588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-95ec5011-c5d1-4774-b4f8-e1607e5e7670 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:51.608675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-db1199cf-e070-4daa-9240-0a8a080ac166 req-fb4f7be4-92ed-459a-9004-5f77220d3853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "878cce4d-84e4-4b06-ba18-1233d9baa8c5", "name": "network-vif-deleted", "tag": "aee1e06b-9023-45fd-8be4-e0ad799ef062"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:51.638647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-db1199cf-e070-4daa-9240-0a8a080ac166 req-fb4f7be4-92ed-459a-9004-5f77220d3853 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:51.639087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-db1199cf-e070-4daa-9240-0a8a080ac166 req-fb4f7be4-92ed-459a-9004-5f77220d3853 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:51.680390 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-db1199cf-e070-4daa-9240-0a8a080ac166 req-fb4f7be4-92ed-459a-9004-5f77220d3853 service nova] Creating event network-vif-deleted:aee1e06b-9023-45fd-8be4-e0ad799ef062 for instance 878cce4d-84e4-4b06-ba18-1233d9baa8c5 on n-h2-826756-3 Jul 28 03:55:51.710568 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-db1199cf-e070-4daa-9240-0a8a080ac166 req-fb4f7be4-92ed-459a-9004-5f77220d3853 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.345520 Jul 28 03:55:51.713846 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2324/4209] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:51.733972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d1ed0ad4-036e-4d8d-b2f4-1ffeed2c8c07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:51.744201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d1ed0ad4-036e-4d8d-b2f4-1ffeed2c8c07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:51.762521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1ed0ad4-036e-4d8d-b2f4-1ffeed2c8c07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:51.765070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1ed0ad4-036e-4d8d-b2f4-1ffeed2c8c07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:51.768677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1ed0ad4-036e-4d8d-b2f4-1ffeed2c8c07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:51.769273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1ed0ad4-036e-4d8d-b2f4-1ffeed2c8c07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:51.820430 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-95ec5011-c5d1-4774-b4f8-e1607e5e7670 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:51.833529 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-95ec5011-c5d1-4774-b4f8-e1607e5e7670 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1276 microversion: 2.1 time: 0.312242 Jul 28 03:55:51.834125 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1886/4210] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:51 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1276 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:51.867054 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3cdf188b-25f2-4de4-b64f-a3dc54e53182 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa74522310>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:52.007890 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3cdf188b-25f2-4de4-b64f-a3dc54e53182 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa" status: 200 len: 344 microversion: 2.1 time: 0.163315 Jul 28 03:55:52.008961 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1887/4211] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:55:51 2022] GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa => generated 344 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:52.013986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a47ac494-2771-4371-aebb-357e3902d00a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:52.020144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a47ac494-2771-4371-aebb-357e3902d00a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:52.044219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a47ac494-2771-4371-aebb-357e3902d00a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:52.076814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a47ac494-2771-4371-aebb-357e3902d00a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:52.082602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a47ac494-2771-4371-aebb-357e3902d00a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:52.084091 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a47ac494-2771-4371-aebb-357e3902d00a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:52.215897 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a47ac494-2771-4371-aebb-357e3902d00a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.205670 Jul 28 03:55:52.216524 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1888/4212] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:55:52 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:55:52.298581 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d13e0e3d-7fda-44e7-9186-ce141d4bde53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7bca87c-e01d-4dc7-9273-341463060866"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:52.310581 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d13e0e3d-7fda-44e7-9186-ce141d4bde53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:52.333975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d13e0e3d-7fda-44e7-9186-ce141d4bde53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:52.338223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d13e0e3d-7fda-44e7-9186-ce141d4bde53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:52.343557 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d13e0e3d-7fda-44e7-9186-ce141d4bde53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:52.344385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d13e0e3d-7fda-44e7-9186-ce141d4bde53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:52.711141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d1ed0ad4-036e-4d8d-b2f4-1ffeed2c8c07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:52.724127 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d1ed0ad4-036e-4d8d-b2f4-1ffeed2c8c07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 1.006662 Jul 28 03:55:52.725377 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2325/4213] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:51 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:52.731192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0d0a0c95-2d67-498a-a209-5814f703c997 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:52.731998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0d0a0c95-2d67-498a-a209-5814f703c997 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] [instance: 878cce4d-84e4-4b06-ba18-1233d9baa8c5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:52.762892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d0a0c95-2d67-498a-a209-5814f703c997 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:52.763100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d0a0c95-2d67-498a-a209-5814f703c997 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:52.763894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d0a0c95-2d67-498a-a209-5814f703c997 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:52.764452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d0a0c95-2d67-498a-a209-5814f703c997 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:52.830787 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-0d0a0c95-2d67-498a-a209-5814f703c997 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] HTTP exception thrown: Instance 878cce4d-84e4-4b06-ba18-1233d9baa8c5 could not be found. Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0d0a0c95-2d67-498a-a209-5814f703c997 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Request method failure captured: Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 HTTP/1.1 Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gijW7uUbmw_FRcmbGRMa-9930K9UBAyUlnSrzwgLEh6ZHXtTWS-Uj7Z8VrdrQxhY-afPB9EipQkj9iZcP4z2acSq_mHIvxZhTJPy1HxLDXX4KJUX5dqYPHM81CWRkQ7hYO755ntOxKdO8niw5EKJknr5sbVw7-qZHLN3y5_Hpk7b0s Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80fab9081e5b462fbb075214772b3e2c Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerAddressesTestJSON-1697550904 Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80fab9081e5b462fbb075214772b3e2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80fab9081e5b462fbb075214772b3e2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80fab9081e5b462fbb075214772b3e2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80fab9081e5b462fbb075214772b3e2c"}]}] Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerAddressesTestJSON-1697550904 Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80fab9081e5b462fbb075214772b3e2c Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1697550904 Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerAddressesTestJSON-1697550904-project Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: b03a4efae0c04654b541e86b86ad22c4 Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerAddressesTestJSON-1697550904-project Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 878cce4d-84e4-4b06-ba18-1233d9baa8c5 could not be found. Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '878cce4d-84e4-4b06-ba18-1233d9baa8c5'} Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 878cce4d-84e4-4b06-ba18-1233d9baa8c5 could not be found. Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 878cce4d-84e4-4b06-ba18-1233d9baa8c5 could not be found. Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:52.832611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:52.835874 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:52.835874 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:52.835874 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:52.835874 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:55:52.835874 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:55:52.835874 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 878cce4d-84e4-4b06-ba18-1233d9baa8c5 could not be found. Jul 28 03:55:52.835874 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:52.835874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0d0a0c95-2d67-498a-a209-5814f703c997 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] Returning 404 to user: Instance 878cce4d-84e4-4b06-ba18-1233d9baa8c5 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:55:52.835874 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0d0a0c95-2d67-498a-a209-5814f703c997 tempest-ServerAddressesTestJSON-1697550904 tempest-ServerAddressesTestJSON-1697550904-project] 10.222.0.48 "GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5" status: 404 len: 111 microversion: 2.1 time: 0.107759 Jul 28 03:55:52.835874 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2326/4214] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:52 2022] GET /compute/v2.1/servers/878cce4d-84e4-4b06-ba18-1233d9baa8c5 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:55:52.862181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dbd1f645-b068-4620-a3e9-b999fee2d662 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:52.862808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dbd1f645-b068-4620-a3e9-b999fee2d662 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:52.881733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dbd1f645-b068-4620-a3e9-b999fee2d662 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:52.882548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dbd1f645-b068-4620-a3e9-b999fee2d662 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:52.883530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dbd1f645-b068-4620-a3e9-b999fee2d662 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:52.886818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dbd1f645-b068-4620-a3e9-b999fee2d662 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:52.926156 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d13e0e3d-7fda-44e7-9186-ce141d4bde53 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "POST /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.634185 Jul 28 03:55:52.929243 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1889/4215] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 03:55:52 2022] POST /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments => generated 194 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:53.025393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-75d461b5-6eb9-4d62-8bf4-714da9e15841 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa7469e310>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:53.101225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dbd1f645-b068-4620-a3e9-b999fee2d662 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:53.124240 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dbd1f645-b068-4620-a3e9-b999fee2d662 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1282 microversion: 2.1 time: 0.268400 Jul 28 03:55:53.128056 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2327/4216] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:52 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1282 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:53.230544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fcb5b5a7-2125-489f-baaf-acf23fe60eaf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:53.233408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fcb5b5a7-2125-489f-baaf-acf23fe60eaf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:53.267122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcb5b5a7-2125-489f-baaf-acf23fe60eaf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:53.273506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcb5b5a7-2125-489f-baaf-acf23fe60eaf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:53.277507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcb5b5a7-2125-489f-baaf-acf23fe60eaf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:53.279725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcb5b5a7-2125-489f-baaf-acf23fe60eaf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:53.283265 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-75d461b5-6eb9-4d62-8bf4-714da9e15841 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa" status: 200 len: 344 microversion: 2.1 time: 0.264738 Jul 28 03:55:53.284188 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1890/4217] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:55:53 2022] GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa => generated 344 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:53.367771 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fcb5b5a7-2125-489f-baaf-acf23fe60eaf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.142062 Jul 28 03:55:53.371282 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2328/4218] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:55:53 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534/os-volume_attachments => generated 25 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:53.561952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-be89d9cc-15ae-467f-a3df-5cc5927e3051 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:53.562633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-be89d9cc-15ae-467f-a3df-5cc5927e3051 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:53.575089 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be89d9cc-15ae-467f-a3df-5cc5927e3051 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:53.575550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be89d9cc-15ae-467f-a3df-5cc5927e3051 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:53.576380 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be89d9cc-15ae-467f-a3df-5cc5927e3051 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:53.576808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-be89d9cc-15ae-467f-a3df-5cc5927e3051 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:53.730622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-be89d9cc-15ae-467f-a3df-5cc5927e3051 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:55:53.969821 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-be89d9cc-15ae-467f-a3df-5cc5927e3051 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "DELETE /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 204 len: 0 microversion: 2.20 time: 0.411808 Jul 28 03:55:53.974063 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1891/4219] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:55:53 2022] DELETE /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:55:53.980015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-faddc733-54c9-4431-bd6b-f042f6ef6891 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:53.980976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-faddc733-54c9-4431-bd6b-f042f6ef6891 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:54.012785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faddc733-54c9-4431-bd6b-f042f6ef6891 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:54.013590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faddc733-54c9-4431-bd6b-f042f6ef6891 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:54.018082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faddc733-54c9-4431-bd6b-f042f6ef6891 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:54.021366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faddc733-54c9-4431-bd6b-f042f6ef6891 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:54.147136 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fb038360-ec65-4ed9-986f-d2f88b97b4b3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:54.148215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fb038360-ec65-4ed9-986f-d2f88b97b4b3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:54.158756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb038360-ec65-4ed9-986f-d2f88b97b4b3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:54.169051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb038360-ec65-4ed9-986f-d2f88b97b4b3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:54.170486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb038360-ec65-4ed9-986f-d2f88b97b4b3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:54.171437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb038360-ec65-4ed9-986f-d2f88b97b4b3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:54.575775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fb038360-ec65-4ed9-986f-d2f88b97b4b3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:54.588544 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fb038360-ec65-4ed9-986f-d2f88b97b4b3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1324 microversion: 2.1 time: 0.444682 Jul 28 03:55:54.589155 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1892/4220] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:54 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1324 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:55:54.601259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-443f9774-4c43-49c6-9f05-0f53d68caae0 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa741ab9d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:54.729465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-faddc733-54c9-4431-bd6b-f042f6ef6891 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:54.740539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-faddc733-54c9-4431-bd6b-f042f6ef6891 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:54.742111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-faddc733-54c9-4431-bd6b-f042f6ef6891 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:54.748048 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-faddc733-54c9-4431-bd6b-f042f6ef6891 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1725 microversion: 2.20 time: 0.772245 Jul 28 03:55:54.748663 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2329/4221] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:55:53 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1725 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:55:54.773886 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-443f9774-4c43-49c6-9f05-0f53d68caae0 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa" status: 200 len: 345 microversion: 2.1 time: 0.183068 Jul 28 03:55:54.774480 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1893/4222] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:55:54 2022] GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa => generated 345 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:54.790190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0c03659b-eef0-46c1-886c-138e67310875 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Action: 'create', calling method: .version_select at 0x7ffa67925940>, body: {"snapshot": {"volume_id": "bf0b2779-81e9-4c8d-a172-b6fa94d614fa", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1825785464"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:55.524905 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0c03659b-eef0-46c1-886c-138e67310875 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.740220 Jul 28 03:55:55.525907 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2330/4223] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jul 28 03:55:54 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:55.533573 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=8 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:55.539375 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f7e5671b-e92f-4ae1-ac96-83f852eb320d tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa67aef5e0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:55.610687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-55521075-2ba6-4b73-8a90-6224bbb9fbe8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:55.611520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-55521075-2ba6-4b73-8a90-6224bbb9fbe8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:55.635518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55521075-2ba6-4b73-8a90-6224bbb9fbe8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:55.639115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55521075-2ba6-4b73-8a90-6224bbb9fbe8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:55.642822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55521075-2ba6-4b73-8a90-6224bbb9fbe8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:55.643578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55521075-2ba6-4b73-8a90-6224bbb9fbe8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:55.801473 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f7e5671b-e92f-4ae1-ac96-83f852eb320d tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff" status: 200 len: 287 microversion: 2.1 time: 0.268687 Jul 28 03:55:55.808042 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1894/4224] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 03:55:55 2022] GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff => generated 287 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:55.812231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2d31df67-f99a-4af6-b7a5-8ecffa30563d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:55.814434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2d31df67-f99a-4af6-b7a5-8ecffa30563d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:55.832080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d31df67-f99a-4af6-b7a5-8ecffa30563d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:55.838806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d31df67-f99a-4af6-b7a5-8ecffa30563d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:55.847446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d31df67-f99a-4af6-b7a5-8ecffa30563d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:55.853120 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2d31df67-f99a-4af6-b7a5-8ecffa30563d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:56.151222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-55521075-2ba6-4b73-8a90-6224bbb9fbe8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:56.169141 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-55521075-2ba6-4b73-8a90-6224bbb9fbe8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1324 microversion: 2.1 time: 0.563027 Jul 28 03:55:56.171359 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2331/4225] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:55 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1324 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:55:56.182873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fdb0ca51-628c-4f9c-a4ba-4f6fd55f4f7d tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa67957430>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:56.318602 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fdb0ca51-628c-4f9c-a4ba-4f6fd55f4f7d tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.144992 Jul 28 03:55:56.319486 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2332/4226] 10.222.0.48 () {58 vars in 1140 bytes} [Thu Jul 28 03:55:56 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:56.329362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-46908a7e-f93e-4343-b504-d0533a6991c2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-616074338", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5d43adf9-af92-4117-9ed9-35547daa1220", "destination_type": "local"}, {"source_type": "volume", "uuid": "c376c364-02ef-46b0-bc62-4963bcac761c", "destination_type": "invalid"}], "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-46908a7e-f93e-4343-b504-d0533a6991c2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 494 Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-616074338", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5d43adf9-af92-4117-9ed9-35547daa1220", "destination_type": "local"}, {"source_type": "volume", "uuid": "c376c364-02ef-46b0-bc62-4963bcac761c", "destination_type": "invalid"}], "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-616074338', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '5d43adf9-af92-4117-9ed9-35547daa1220', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c376c364-02ef-46b0-bc62-4963bcac761c', 'destination_type': 'invalid'}], 'networks': [{'uuid': '3fcf143f-a069-44e5-9902-e5b7dddd3dfa'}]}}} Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'invalid' Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:55:56.335739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 28 03:55:56.339290 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:56.346636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-46908a7e-f93e-4343-b504-d0533a6991c2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:55:56.347778 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-46908a7e-f93e-4343-b504-d0533a6991c2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.026960 Jul 28 03:55:56.348940 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2333/4227] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:55:56 2022] POST /compute/v2.1/servers => generated 155 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:55:56.360508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51750368-af80-4a44-ab16-1ab7ce4056b2 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa74669ca0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:56.432583 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51750368-af80-4a44-ab16-1ab7ce4056b2 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff" status: 200 len: 287 microversion: 2.1 time: 0.082027 Jul 28 03:55:56.433347 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2334/4228] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 03:55:56 2022] GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:56.442104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d4552af-e0b7-4747-b653-a67fd17e9e39 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:56.449680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6d4552af-e0b7-4747-b653-a67fd17e9e39 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:56.472151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d4552af-e0b7-4747-b653-a67fd17e9e39 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:56.472678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d4552af-e0b7-4747-b653-a67fd17e9e39 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:56.477651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d4552af-e0b7-4747-b653-a67fd17e9e39 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:56.480063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d4552af-e0b7-4747-b653-a67fd17e9e39 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:57.416109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6d4552af-e0b7-4747-b653-a67fd17e9e39 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:57.427075 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d4552af-e0b7-4747-b653-a67fd17e9e39 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.992149 Jul 28 03:55:57.431705 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2335/4229] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:56 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:57.464767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a08f147c-2b7d-4825-b7d8-f2980c92f914 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:57.466065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a08f147c-2b7d-4825-b7d8-f2980c92f914 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:57.474294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a08f147c-2b7d-4825-b7d8-f2980c92f914 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:57.474872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a08f147c-2b7d-4825-b7d8-f2980c92f914 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:57.475928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a08f147c-2b7d-4825-b7d8-f2980c92f914 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:57.476512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a08f147c-2b7d-4825-b7d8-f2980c92f914 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:57.929810 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2d31df67-f99a-4af6-b7a5-8ecffa30563d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:57.939186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2d31df67-f99a-4af6-b7a5-8ecffa30563d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:57.940732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2d31df67-f99a-4af6-b7a5-8ecffa30563d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:57.942974 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2d31df67-f99a-4af6-b7a5-8ecffa30563d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1725 microversion: 2.20 time: 2.138349 Jul 28 03:55:57.942974 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1895/4230] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:55:55 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1725 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:55:57.964906 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-076e19e3-384e-425b-83dc-2f6c57673109 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa7412dca0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:58.123510 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-076e19e3-384e-425b-83dc-2f6c57673109 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff" status: 200 len: 287 microversion: 2.1 time: 0.179953 Jul 28 03:55:58.124099 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1896/4231] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 03:55:57 2022] GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff => generated 287 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:58.129085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2614cb49-6742-4356-8ba2-7da09c1f8b37 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:58.129695 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2614cb49-6742-4356-8ba2-7da09c1f8b37 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:58.160443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2614cb49-6742-4356-8ba2-7da09c1f8b37 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:58.161094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2614cb49-6742-4356-8ba2-7da09c1f8b37 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:58.162051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2614cb49-6742-4356-8ba2-7da09c1f8b37 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:58.162893 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2614cb49-6742-4356-8ba2-7da09c1f8b37 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:58.245597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a08f147c-2b7d-4825-b7d8-f2980c92f914 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:58.254592 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a08f147c-2b7d-4825-b7d8-f2980c92f914 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1324 microversion: 2.1 time: 0.804855 Jul 28 03:55:58.261118 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2336/4232] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:57 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1324 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:58.698033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2614cb49-6742-4356-8ba2-7da09c1f8b37 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:58.719869 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2614cb49-6742-4356-8ba2-7da09c1f8b37 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.594619 Jul 28 03:55:58.727214 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1897/4233] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:58 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:58.837672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-211a9873-252d-4423-a677-b03c9f9621ef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1707312611", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-211a9873-252d-4423-a677-b03c9f9621ef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 492 Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1707312611", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1707312611', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '3fcf143f-a069-44e5-9902-e5b7dddd3dfa'}]}}} Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:58.854859 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 28 03:55:58.858073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:55:58.861747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-211a9873-252d-4423-a677-b03c9f9621ef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:55:58.870166 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-211a9873-252d-4423-a677-b03c9f9621ef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.036228 Jul 28 03:55:58.887177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-309cbfcd-57fa-497e-8c7b-66bf311b4e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:58.889393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-309cbfcd-57fa-497e-8c7b-66bf311b4e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:58.892832 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2337/4234] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:55:58 2022] POST /compute/v2.1/servers => generated 624 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:55:58.895506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:58.913291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-309cbfcd-57fa-497e-8c7b-66bf311b4e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:58.913994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-309cbfcd-57fa-497e-8c7b-66bf311b4e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:58.921355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0e7907f4-3d08-48a6-945c-e0e3b7f274ee req-a8e9e5cd-874c-4a32-8af8-1ea00b0ec05a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f", "tag": "c8793abb-3b60-44eb-92c4-080c797cc8a3"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:55:58.922698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-309cbfcd-57fa-497e-8c7b-66bf311b4e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:58.923664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-309cbfcd-57fa-497e-8c7b-66bf311b4e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:58.968070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0e7907f4-3d08-48a6-945c-e0e3b7f274ee req-a8e9e5cd-874c-4a32-8af8-1ea00b0ec05a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:58.973681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0e7907f4-3d08-48a6-945c-e0e3b7f274ee req-a8e9e5cd-874c-4a32-8af8-1ea00b0ec05a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:58.996680 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0e7907f4-3d08-48a6-945c-e0e3b7f274ee req-a8e9e5cd-874c-4a32-8af8-1ea00b0ec05a service nova] Creating event network-changed:c8793abb-3b60-44eb-92c4-080c797cc8a3 for instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f on n-h1-826756-3 Jul 28 03:55:59.026414 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0e7907f4-3d08-48a6-945c-e0e3b7f274ee req-a8e9e5cd-874c-4a32-8af8-1ea00b0ec05a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131437 Jul 28 03:55:59.032334 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2338/4235] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:59.038295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15ad5628-8d9f-408c-bc64-a00cb7b77634 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:59.039221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15ad5628-8d9f-408c-bc64-a00cb7b77634 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:59.053293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15ad5628-8d9f-408c-bc64-a00cb7b77634 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:59.053917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15ad5628-8d9f-408c-bc64-a00cb7b77634 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:59.055016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15ad5628-8d9f-408c-bc64-a00cb7b77634 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:59.055612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15ad5628-8d9f-408c-bc64-a00cb7b77634 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:59.259155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-15ad5628-8d9f-408c-bc64-a00cb7b77634 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:59.274262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-15ad5628-8d9f-408c-bc64-a00cb7b77634 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:59.275798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-15ad5628-8d9f-408c-bc64-a00cb7b77634 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:59.277047 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15ad5628-8d9f-408c-bc64-a00cb7b77634 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1658 microversion: 2.20 time: 0.243182 Jul 28 03:55:59.301697 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2339/4236] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:55:59 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1658 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:55:59.311444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9ac6b6a4-5641-4f99-bfd9-989a6abb4ae5 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa67015e50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:59.360428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:55:59.387761 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9ac6b6a4-5641-4f99-bfd9-989a6abb4ae5 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff" status: 200 len: 288 microversion: 2.1 time: 0.084600 Jul 28 03:55:59.392290 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2340/4237] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 03:55:59 2022] GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff => generated 288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:55:59.398326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cd6450fe-0bba-4c92-9c27-7b9bb3c59f36 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:55:59.399604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cd6450fe-0bba-4c92-9c27-7b9bb3c59f36 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:55:59.408664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd6450fe-0bba-4c92-9c27-7b9bb3c59f36 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:59.409483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd6450fe-0bba-4c92-9c27-7b9bb3c59f36 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:59.410610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd6450fe-0bba-4c92-9c27-7b9bb3c59f36 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:55:59.411295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd6450fe-0bba-4c92-9c27-7b9bb3c59f36 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:55:59.821033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-309cbfcd-57fa-497e-8c7b-66bf311b4e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:55:59.829351 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-309cbfcd-57fa-497e-8c7b-66bf311b4e9c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.952916 Jul 28 03:55:59.833661 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1898/4238] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:58 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:55:59.845047 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7cf598c8-73e7-44fd-94a5-6aeef146748d tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa67aef3a0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:00.017275 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7cf598c8-73e7-44fd-94a5-6aeef146748d tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff" status: 202 len: 0 microversion: 2.1 time: 0.181812 Jul 28 03:56:00.018040 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1899/4239] 10.222.0.48 () {58 vars in 1254 bytes} [Thu Jul 28 03:55:59 2022] DELETE /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:56:00.026599 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7834300c-5b62-4dc2-9f8d-28f443bf2ff1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:00.028991 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7834300c-5b62-4dc2-9f8d-28f443bf2ff1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:00.049247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7834300c-5b62-4dc2-9f8d-28f443bf2ff1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:00.050056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7834300c-5b62-4dc2-9f8d-28f443bf2ff1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:00.051876 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7834300c-5b62-4dc2-9f8d-28f443bf2ff1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:00.052890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7834300c-5b62-4dc2-9f8d-28f443bf2ff1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:00.130978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cd6450fe-0bba-4c92-9c27-7b9bb3c59f36 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:00.147695 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cd6450fe-0bba-4c92-9c27-7b9bb3c59f36 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1324 microversion: 2.1 time: 0.753461 Jul 28 03:56:00.153839 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2341/4240] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:55:59 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1324 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:00.183778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-650c338c-37d1-4767-8287-452975e2fd60 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa74bc6280>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:00.266809 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-650c338c-37d1-4767-8287-452975e2fd60 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff" status: 200 len: 287 microversion: 2.1 time: 0.111581 Jul 28 03:56:00.268143 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2342/4241] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 03:56:00 2022] GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff => generated 287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:00.317092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a1851af-daef-4c6f-b004-e073340f0b96 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:00.318141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4a1851af-daef-4c6f-b004-e073340f0b96 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:00.330848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a1851af-daef-4c6f-b004-e073340f0b96 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:00.331659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a1851af-daef-4c6f-b004-e073340f0b96 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:00.333348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a1851af-daef-4c6f-b004-e073340f0b96 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:00.336470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a1851af-daef-4c6f-b004-e073340f0b96 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:00.427075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a1851af-daef-4c6f-b004-e073340f0b96 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:00.427795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a1851af-daef-4c6f-b004-e073340f0b96 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:00.429513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-4a1851af-daef-4c6f-b004-e073340f0b96 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lazy-loading 'fault' on Instance uuid 99d0126e-11bf-4048-9e35-7309c228b534 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:56:00.821301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a1851af-daef-4c6f-b004-e073340f0b96 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:00.830555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a1851af-daef-4c6f-b004-e073340f0b96 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:00.837408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a1851af-daef-4c6f-b004-e073340f0b96 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:00.839643 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4a1851af-daef-4c6f-b004-e073340f0b96 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 200 len: 1372 microversion: 2.20 time: 0.526826 Jul 28 03:56:00.857715 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2343/4242] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:00 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 1372 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:56:01.177375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b4d7026a-e713-4dc5-b542-b73b2962333b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:01.179028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4d7026a-e713-4dc5-b542-b73b2962333b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:01.192847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4d7026a-e713-4dc5-b542-b73b2962333b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:01.198065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4d7026a-e713-4dc5-b542-b73b2962333b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:01.201592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4d7026a-e713-4dc5-b542-b73b2962333b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:01.203251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4d7026a-e713-4dc5-b542-b73b2962333b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:01.752017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b4d7026a-e713-4dc5-b542-b73b2962333b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:01.760521 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b4d7026a-e713-4dc5-b542-b73b2962333b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1324 microversion: 2.1 time: 0.589862 Jul 28 03:56:01.764923 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2344/4243] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:01 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1324 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:01.775169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8cdef4cf-5393-43ea-89ab-7c81c0eaf6aa tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa67914700>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:01.882258 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8cdef4cf-5393-43ea-89ab-7c81c0eaf6aa tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff" status: 200 len: 287 microversion: 2.1 time: 0.115666 Jul 28 03:56:01.883175 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2345/4244] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 03:56:01 2022] GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:01.888047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-461b5352-17e9-4a2b-b5c5-0af207148f79 req-a8616614-b33c-41ef-9c4e-79f37ad3c7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d0126e-11bf-4048-9e35-7309c228b534", "name": "network-vif-deleted", "tag": "f15c48dd-54c1-4291-88c3-ac0923fa48e7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:01.907188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-461b5352-17e9-4a2b-b5c5-0af207148f79 req-a8616614-b33c-41ef-9c4e-79f37ad3c7c6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:01.909401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-461b5352-17e9-4a2b-b5c5-0af207148f79 req-a8616614-b33c-41ef-9c4e-79f37ad3c7c6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:01.939123 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-461b5352-17e9-4a2b-b5c5-0af207148f79 req-a8616614-b33c-41ef-9c4e-79f37ad3c7c6 service nova] Creating event network-vif-deleted:f15c48dd-54c1-4291-88c3-ac0923fa48e7 for instance 99d0126e-11bf-4048-9e35-7309c228b534 on n-h1-826756-3 Jul 28 03:56:01.949965 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-461b5352-17e9-4a2b-b5c5-0af207148f79 req-a8616614-b33c-41ef-9c4e-79f37ad3c7c6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064260 Jul 28 03:56:01.951650 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2346/4245] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:01.970250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d07f837-566f-47a3-a3c2-84d0483fa106 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:01.971571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8d07f837-566f-47a3-a3c2-84d0483fa106 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:01.987208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d07f837-566f-47a3-a3c2-84d0483fa106 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:01.987966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d07f837-566f-47a3-a3c2-84d0483fa106 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:01.990077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d07f837-566f-47a3-a3c2-84d0483fa106 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:01.990720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d07f837-566f-47a3-a3c2-84d0483fa106 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:02.014735 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-8d07f837-566f-47a3-a3c2-84d0483fa106 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] HTTP exception thrown: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d07f837-566f-47a3-a3c2-84d0483fa106 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Request method failure captured: Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 HTTP/1.1 Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ge0nTQTH4Nnkv87cBSSTP3AKpCz3wDCSgcz7a6Avf43CRxluuwes7dUSpAOw0bfyuhbm-Ooorxp6zBwWAliV_zY_19Da40Q-zXhAZ5o4Aysg6CTx68R3ahhmMht8Nkg5bJacHNsHPKx1ufUKpvBjLBThH5BfdoBkGSqH9Zrs3kIXTc Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 98f0f82bb0014564bff4c739314d25a4 Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f0f82bb0014564bff4c739314d25a4"}]}] Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 98f0f82bb0014564bff4c739314d25a4 Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeShelveTestJSON-958508241-project Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ea947ad72ea74f439474ac4703fb0ebb Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeShelveTestJSON-958508241-project Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '99d0126e-11bf-4048-9e35-7309c228b534'} Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:02.017070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:02.020520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:02.020520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:02.020520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:02.020520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:02.020520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:02.020520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:02.020520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:56:02.020520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:02.022452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d07f837-566f-47a3-a3c2-84d0483fa106 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Returning 404 to user: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:02.023512 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8d07f837-566f-47a3-a3c2-84d0483fa106 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 404 len: 111 microversion: 2.20 time: 0.068845 Jul 28 03:56:02.031737 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2347/4246] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:01 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:56:02.044494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-558c88bf-d4a9-4b20-bbeb-20e7db4e20ce tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '.version_select at 0x7ffa67007670>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:02.087964 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-558c88bf-d4a9-4b20-bbeb-20e7db4e20ce tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504483950" status: 204 len: 0 microversion: 2.20 time: 0.051457 Jul 28 03:56:02.089857 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2348/4247] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Jul 28 03:56:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504483950 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:56:02.344962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7834300c-5b62-4dc2-9f8d-28f443bf2ff1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:02.353488 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7834300c-5b62-4dc2-9f8d-28f443bf2ff1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 2.334086 Jul 28 03:56:02.354151 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1900/4248] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:00 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 2335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:02.448332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66ce898f-b727-4a61-9b5c-23696e7edd3b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66ce898f-b727-4a61-9b5c-23696e7edd3b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 416 Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'networks': [{'uuid': '3fcf143f-a069-44e5-9902-e5b7dddd3dfa'}]}}} Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:02.452661 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:56:02.455233 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:02.460492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66ce898f-b727-4a61-9b5c-23696e7edd3b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:02.464448 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-66ce898f-b727-4a61-9b5c-23696e7edd3b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.019831 Jul 28 03:56:02.466229 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2349/4249] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:56:02 2022] POST /compute/v2.1/servers => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:56:02.474230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c180591f-00e8-4711-a330-9c2200406316 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:02.475014 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c180591f-00e8-4711-a330-9c2200406316 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:02.485213 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:02.487587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c180591f-00e8-4711-a330-9c2200406316 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:02.488041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c180591f-00e8-4711-a330-9c2200406316 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:02.488873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c180591f-00e8-4711-a330-9c2200406316 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:02.491835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c180591f-00e8-4711-a330-9c2200406316 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:02.790062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-510389d3-845f-402b-a803-b00d12a09e69 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:02.791574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-510389d3-845f-402b-a803-b00d12a09e69 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:02.836334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-510389d3-845f-402b-a803-b00d12a09e69 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:02.838177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-510389d3-845f-402b-a803-b00d12a09e69 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:02.842730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-510389d3-845f-402b-a803-b00d12a09e69 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:02.843293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-510389d3-845f-402b-a803-b00d12a09e69 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:03.156729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c180591f-00e8-4711-a330-9c2200406316 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:03.185965 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c180591f-00e8-4711-a330-9c2200406316 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.710034 Jul 28 03:56:03.189790 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1901/4250] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:02 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:03.225603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-910ed415-8f9c-425f-bf39-24b3a76c8c13 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa74522310>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:03.307189 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-910ed415-8f9c-425f-bf39-24b3a76c8c13 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff" status: 200 len: 287 microversion: 2.1 time: 0.109721 Jul 28 03:56:03.307794 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1902/4251] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 03:56:03 2022] GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:03.320481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-370340cb-b5b6-4a87-88dd-91b44486c931 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:03.321491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-370340cb-b5b6-4a87-88dd-91b44486c931 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:03.335511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-370340cb-b5b6-4a87-88dd-91b44486c931 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:03.338130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-370340cb-b5b6-4a87-88dd-91b44486c931 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:03.339618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-370340cb-b5b6-4a87-88dd-91b44486c931 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:03.347262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-370340cb-b5b6-4a87-88dd-91b44486c931 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:03.499311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-510389d3-845f-402b-a803-b00d12a09e69 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:03.525642 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-510389d3-845f-402b-a803-b00d12a09e69 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1324 microversion: 2.1 time: 0.742394 Jul 28 03:56:03.526505 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2350/4252] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:02 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1324 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:03.656820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-370340cb-b5b6-4a87-88dd-91b44486c931 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:03.674737 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-370340cb-b5b6-4a87-88dd-91b44486c931 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.357073 Jul 28 03:56:03.675541 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1903/4253] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:03 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:03.821927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86a629a3-489f-46da-bbe9-7e27cf40469b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1201496966", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": -1, "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:03.857883 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-86a629a3-489f-46da-bbe9-7e27cf40469b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Flavor -1 could not be found. Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86a629a3-489f-46da-bbe9-7e27cf40469b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 206 Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1201496966", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": -1, "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: exception: Flavor -1 could not be found. Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1201496966', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': -1, 'networks': [{'uuid': '3fcf143f-a069-44e5-9902-e5b7dddd3dfa'}]}}} Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:03.859835 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 28 03:56:03.863739 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:03.866103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86a629a3-489f-46da-bbe9-7e27cf40469b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:03.867387 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-86a629a3-489f-46da-bbe9-7e27cf40469b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.049998 Jul 28 03:56:03.871377 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2351/4254] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:56:03 2022] POST /compute/v2.1/servers => generated 73 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:56:03.876455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-07dfd464-fc04-46ad-9f12-44ab2233098e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:03.877078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-07dfd464-fc04-46ad-9f12-44ab2233098e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:03.895088 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-07dfd464-fc04-46ad-9f12-44ab2233098e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:03.895542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-07dfd464-fc04-46ad-9f12-44ab2233098e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:03.896341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-07dfd464-fc04-46ad-9f12-44ab2233098e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:03.896807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-07dfd464-fc04-46ad-9f12-44ab2233098e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:04.320603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-73d9c301-f449-4fbd-88d7-f7aee06c80b5 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa745b1a60>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:04.368248 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-73d9c301-f449-4fbd-88d7-f7aee06c80b5 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] HTTP exception thrown: Snapshot 27ad96df-e1c2-4050-a84e-8ba29b5c82ff could not be found. Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-73d9c301-f449-4fbd-88d7-f7aee06c80b5 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Request method failure captured: Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff HTTP/1.1 Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjE9zLwyh9pwWTwcB7e-fPzFlsR5fmFinztowOkXtc5DMtNIKQEoWtrL6wCtgPSPfSkZWjYxcTBASCJj4Jedf3Smyg4wfWjdM8GKVl9RJYGrHe7eaEpSoc88V4aeEAt8dE9soqANsXB2buAe_haJdVHzbGTBXTMEFhA4uKr-5e1nWA Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 441be6932bc445888c073d62c09869ac Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1254902501 Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/441be6932bc445888c073d62c09869ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/441be6932bc445888c073d62c09869ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_441be6932bc445888c073d62c09869ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/441be6932bc445888c073d62c09869ac"}]}] Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1254902501 Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 441be6932bc445888c073d62c09869ac Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1254902501 Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-VolumesSnapshotsTestJSON-1254902501-project Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a294b5ea4870425f86a968f4a09ce241 Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1254902501-project Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: exception: Snapshot 27ad96df-e1c2-4050-a84e-8ba29b5c82ff could not be found. Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '27ad96df-e1c2-4050-a84e-8ba29b5c82ff'} Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 27ad96df-e1c2-4050-a84e-8ba29b5c82ff could not be found. (HTTP 404) (Request-ID: req-9d810e70-59d7-458e-9b95-cfb981b156c0) Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:56:04.378287 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 27ad96df-e1c2-4050-a84e-8ba29b5c82ff could not be found. Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 27ad96df-e1c2-4050-a84e-8ba29b5c82ff could not be found. Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 27ad96df-e1c2-4050-a84e-8ba29b5c82ff could not be found. Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:04.382070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-73d9c301-f449-4fbd-88d7-f7aee06c80b5 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Returning 404 to user: Snapshot 27ad96df-e1c2-4050-a84e-8ba29b5c82ff could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:04.385585 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-07dfd464-fc04-46ad-9f12-44ab2233098e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:04.386017 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-73d9c301-f449-4fbd-88d7-f7aee06c80b5 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff" status: 404 len: 111 microversion: 2.1 time: 0.065796 Jul 28 03:56:04.390290 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2352/4255] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Jul 28 03:56:04 2022] GET /compute/v2.1/os-snapshots/27ad96df-e1c2-4050-a84e-8ba29b5c82ff => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:56:04.391026 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-07dfd464-fc04-46ad-9f12-44ab2233098e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.518291 Jul 28 03:56:04.395454 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1904/4256] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:03 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:04.398301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63784c31-9df3-4c87-b853-e1160b2071f4 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa67007160>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:04.416177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-34ede9c1-0db5-47de-8f6d-76f0e9dbe95f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:04.416660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-34ede9c1-0db5-47de-8f6d-76f0e9dbe95f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:04.431513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-34ede9c1-0db5-47de-8f6d-76f0e9dbe95f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:04.432207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-34ede9c1-0db5-47de-8f6d-76f0e9dbe95f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:04.441958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-34ede9c1-0db5-47de-8f6d-76f0e9dbe95f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:04.443296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-34ede9c1-0db5-47de-8f6d-76f0e9dbe95f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:04.512405 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63784c31-9df3-4c87-b853-e1160b2071f4 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa" status: 202 len: 0 microversion: 2.1 time: 0.120828 Jul 28 03:56:04.513345 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2353/4257] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:56:04 2022] DELETE /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:56:04.523255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c65b3580-33c3-461a-8d79-f589db7f885c tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa6798de50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:04.622467 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c65b3580-33c3-461a-8d79-f589db7f885c tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa" status: 200 len: 344 microversion: 2.1 time: 0.104976 Jul 28 03:56:04.623331 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2354/4258] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:56:04 2022] GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa => generated 344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:04.637280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19be734e-8c32-4794-8407-093b406556f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:04.640076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-19be734e-8c32-4794-8407-093b406556f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:04.668016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19be734e-8c32-4794-8407-093b406556f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:04.670293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19be734e-8c32-4794-8407-093b406556f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:04.671811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19be734e-8c32-4794-8407-093b406556f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:04.677451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19be734e-8c32-4794-8407-093b406556f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:04.714923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:05.024765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-34ede9c1-0db5-47de-8f6d-76f0e9dbe95f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:05.042522 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-34ede9c1-0db5-47de-8f6d-76f0e9dbe95f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.630660 Jul 28 03:56:05.044074 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1905/4259] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:04 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:05.052154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-13f75e32-929f-4efb-b481-08aa00adc167 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Action: 'create', calling method: .version_select at 0x7ffa741ca160>, body: {"keypair": {"name": "tempest-keypair-1022284047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3UGuXg5EHnPceWxJZKR2TLFaVXcnyD+WHh55f4p+rmwZsvzV1CXF/zCjIeItVJR57Nc0xiqOATLkXa4DV/Zkt4XxfxDuRGO19y+M5o9aqrJEU+trnwkZqCy8IrfxdbrQ=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:05.101716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-13f75e32-929f-4efb-b481-08aa00adc167 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Getting quotas for project 98f0f82bb0014564bff4c739314d25a4. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:05.118323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-13f75e32-929f-4efb-b481-08aa00adc167 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Getting quotas for user ea947ad72ea74f439474ac4703fb0ebb and project 98f0f82bb0014564bff4c739314d25a4. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:05.164605 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-13f75e32-929f-4efb-b481-08aa00adc167 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.117751 Jul 28 03:56:05.165983 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1906/4260] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Jul 28 03:56:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 121 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 03:56:05.215925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d8517d98-7103-4384-81fb-0fb889cb3a3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-627757005", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d8517d98-7103-4384-81fb-0fb889cb3a3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 172 Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-627757005", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-627757005', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '3fcf143f-a069-44e5-9902-e5b7dddd3dfa'}]}}} Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi -1 Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:56:05.239474 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:56:05.243730 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:56:05.243730 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:56:05.243730 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 28 03:56:05.243730 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:05.243730 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:05.243730 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:05.243730 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:05.243730 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:05.243730 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:05.243730 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:56:05.243730 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:56:05.243730 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 28 03:56:05.243730 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:05.248054 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d8517d98-7103-4384-81fb-0fb889cb3a3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:05.250830 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d8517d98-7103-4384-81fb-0fb889cb3a3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.042688 Jul 28 03:56:05.251288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19be734e-8c32-4794-8407-093b406556f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:05.254230 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1907/4261] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:56:05 2022] POST /compute/v2.1/servers => generated 145 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:56:05.272953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7c98e741-bc28-4da0-92dc-71b2ff0e7330 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:05.277346 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-19be734e-8c32-4794-8407-093b406556f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1324 microversion: 2.1 time: 0.644017 Jul 28 03:56:05.277970 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2355/4262] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:04 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1324 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:05.279660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7c98e741-bc28-4da0-92dc-71b2ff0e7330 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:05.301204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c98e741-bc28-4da0-92dc-71b2ff0e7330 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:05.302993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c98e741-bc28-4da0-92dc-71b2ff0e7330 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:05.303940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c98e741-bc28-4da0-92dc-71b2ff0e7330 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:05.305301 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7c98e741-bc28-4da0-92dc-71b2ff0e7330 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:05.366936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:05.571472 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7c98e741-bc28-4da0-92dc-71b2ff0e7330 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:05.583605 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7c98e741-bc28-4da0-92dc-71b2ff0e7330 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.325132 Jul 28 03:56:05.598137 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1908/4263] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:05 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:05.606479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f195177-e6b4-433f-bdda-a224e835930a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:05.607814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0f195177-e6b4-433f-bdda-a224e835930a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:05.616152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f195177-e6b4-433f-bdda-a224e835930a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:05.616999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f195177-e6b4-433f-bdda-a224e835930a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:05.618072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f195177-e6b4-433f-bdda-a224e835930a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:05.618873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f195177-e6b4-433f-bdda-a224e835930a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:05.637320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b9a20228-e65d-45c8-bb8e-d748cee01d95 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa6777ab80>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:05.703442 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b9a20228-e65d-45c8-bb8e-d748cee01d95 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa" status: 200 len: 344 microversion: 2.1 time: 0.069930 Jul 28 03:56:05.704550 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1909/4264] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:56:05 2022] GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa => generated 344 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:56:06.045333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0f195177-e6b4-433f-bdda-a224e835930a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:06.066735 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0f195177-e6b4-433f-bdda-a224e835930a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.464126 Jul 28 03:56:06.069184 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2356/4265] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:05 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:06.290896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5e75b30e-d8cf-43b3-a636-1e05a6765547 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-530068925", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:06.296617 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-5e75b30e-d8cf-43b3-a636-1e05a6765547 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5e75b30e-d8cf-43b3-a636-1e05a6765547 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 215 Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-530068925", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-530068925', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:06.298666 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:06.303011 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:06.303011 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:06.303011 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:06.303011 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:06.303011 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:06.303011 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 28 03:56:06.303011 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:06.305176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5e75b30e-d8cf-43b3-a636-1e05a6765547 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:06.306115 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5e75b30e-d8cf-43b3-a636-1e05a6765547 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.021183 Jul 28 03:56:06.306887 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1910/4266] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:56:06 2022] POST /compute/v2.1/servers => generated 123 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:56:06.316056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-68e501b8-3e74-4840-aa98-2ec2124f9258 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:06.317462 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f9d152c3-ff58-4c7b-baf5-dbb42396fb2f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:06.318170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f9d152c3-ff58-4c7b-baf5-dbb42396fb2f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:06.318972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-68e501b8-3e74-4840-aa98-2ec2124f9258 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:06.326918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9d152c3-ff58-4c7b-baf5-dbb42396fb2f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:06.327440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9d152c3-ff58-4c7b-baf5-dbb42396fb2f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:06.328539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9d152c3-ff58-4c7b-baf5-dbb42396fb2f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:06.329125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9d152c3-ff58-4c7b-baf5-dbb42396fb2f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:06.333635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68e501b8-3e74-4840-aa98-2ec2124f9258 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:06.334099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68e501b8-3e74-4840-aa98-2ec2124f9258 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:06.334901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68e501b8-3e74-4840-aa98-2ec2124f9258 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:06.335349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68e501b8-3e74-4840-aa98-2ec2124f9258 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:06.603893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-68e501b8-3e74-4840-aa98-2ec2124f9258 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:06.614891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f9d152c3-ff58-4c7b-baf5-dbb42396fb2f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:06.615976 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-68e501b8-3e74-4840-aa98-2ec2124f9258 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1324 microversion: 2.1 time: 0.317479 Jul 28 03:56:06.620757 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2357/4267] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:06 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1324 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:06.631580 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f9d152c3-ff58-4c7b-baf5-dbb42396fb2f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.320554 Jul 28 03:56:06.634772 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1911/4268] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:06 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:06.660522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b6744ed4-5502-42f9-b3c0-a84db101c324 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:06.661223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b6744ed4-5502-42f9-b3c0-a84db101c324 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:06.677001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6744ed4-5502-42f9-b3c0-a84db101c324 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:06.677999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6744ed4-5502-42f9-b3c0-a84db101c324 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:06.680532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6744ed4-5502-42f9-b3c0-a84db101c324 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:06.682009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6744ed4-5502-42f9-b3c0-a84db101c324 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:06.718688 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-620fd417-b12c-45d8-aa63-9f65ea5076ab tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa7451c160>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:06.841293 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-620fd417-b12c-45d8-aa63-9f65ea5076ab tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa" status: 200 len: 344 microversion: 2.1 time: 0.127631 Jul 28 03:56:06.842522 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1912/4269] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:56:06 2022] GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa => generated 344 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:56:07.060257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b6744ed4-5502-42f9-b3c0-a84db101c324 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:07.072596 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b6744ed4-5502-42f9-b3c0-a84db101c324 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.418164 Jul 28 03:56:07.074000 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2358/4270] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:06 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:07.215527 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cb506d5f-a46e-42dc-b9a8-859d46e935a4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-676036719", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "key_name": "tempest-key-52554061", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:07.314354 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-cb506d5f-a46e-42dc-b9a8-859d46e935a4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] validate_networks() for [('3fcf143f-a069-44e5-9902-e5b7dddd3dfa', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:56:07.643906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed18206e-aeb5-4fbb-9235-ce8df2d1f33a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:07.645401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed18206e-aeb5-4fbb-9235-ce8df2d1f33a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:07.654302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed18206e-aeb5-4fbb-9235-ce8df2d1f33a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:07.655093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed18206e-aeb5-4fbb-9235-ce8df2d1f33a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:07.656103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed18206e-aeb5-4fbb-9235-ce8df2d1f33a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:07.657179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed18206e-aeb5-4fbb-9235-ce8df2d1f33a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:07.825134 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-cb506d5f-a46e-42dc-b9a8-859d46e935a4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Invalid key_name provided. Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cb506d5f-a46e-42dc-b9a8-859d46e935a4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 244 Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-676036719", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "key_name": "tempest-key-52554061", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid key_name provided. Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-676036719', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'key_name': 'tempest-key-52554061', 'networks': [{'uuid': '3fcf143f-a069-44e5-9902-e5b7dddd3dfa'}]}}} Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2195, in create Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1671, in _create_instance Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1078, in _validate_and_build_base_options Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-52554061 not found for user a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:07.827066 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cb506d5f-a46e-42dc-b9a8-859d46e935a4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Invalid key_name provided. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cb506d5f-a46e-42dc-b9a8-859d46e935a4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.621510 Jul 28 03:56:07.834417 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1913/4271] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:56:07 2022] POST /compute/v2.1/servers => generated 70 bytes in 626 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:56:07.849815 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-700328d9-8b0b-4414-895a-3c296338b770 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:07.850850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-700328d9-8b0b-4414-895a-3c296338b770 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:07.857913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-700328d9-8b0b-4414-895a-3c296338b770 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:07.858362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-700328d9-8b0b-4414-895a-3c296338b770 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:07.859170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-700328d9-8b0b-4414-895a-3c296338b770 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:07.866766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-700328d9-8b0b-4414-895a-3c296338b770 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:07.904619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed18206e-aeb5-4fbb-9235-ce8df2d1f33a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:07.914400 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed18206e-aeb5-4fbb-9235-ce8df2d1f33a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1324 microversion: 2.1 time: 0.275620 Jul 28 03:56:07.915571 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2359/4272] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:07 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:07.921423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc0ae587-4a26-423c-b3b7-13ef5b35ad75 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa67959670>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:07.967932 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-cc0ae587-4a26-423c-b3b7-13ef5b35ad75 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] HTTP exception thrown: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc0ae587-4a26-423c-b3b7-13ef5b35ad75 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Request method failure captured: Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa HTTP/1.1 Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjE9zLwyh9pwWTwcB7e-fPzFlsR5fmFinztowOkXtc5DMtNIKQEoWtrL6wCtgPSPfSkZWjYxcTBASCJj4Jedf3Smyg4wfWjdM8GKVl9RJYGrHe7eaEpSoc88V4aeEAt8dE9soqANsXB2buAe_haJdVHzbGTBXTMEFhA4uKr-5e1nWA Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 441be6932bc445888c073d62c09869ac Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1254902501 Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/441be6932bc445888c073d62c09869ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/441be6932bc445888c073d62c09869ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_441be6932bc445888c073d62c09869ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/441be6932bc445888c073d62c09869ac"}]}] Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1254902501 Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 441be6932bc445888c073d62c09869ac Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1254902501 Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-VolumesSnapshotsTestJSON-1254902501-project Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a294b5ea4870425f86a968f4a09ce241 Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1254902501-project Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: exception: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'bf0b2779-81e9-4c8d-a172-b6fa94d614fa'} Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. (HTTP 404) (Request-ID: req-a6d069e1-1db9-4187-8225-fe27596dc8ad) Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:56:07.971115 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:07.975634 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:07.979702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc0ae587-4a26-423c-b3b7-13ef5b35ad75 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Returning 404 to user: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:07.987676 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cc0ae587-4a26-423c-b3b7-13ef5b35ad75 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa" status: 404 len: 109 microversion: 2.1 time: 0.064151 Jul 28 03:56:07.993705 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2360/4273] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:56:07 2022] GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:08.002419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7458951f-89b2-4505-95db-2b205e1f1ac2 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa67925dc0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:08.053926 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-7458951f-89b2-4505-95db-2b205e1f1ac2 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] HTTP exception thrown: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7458951f-89b2-4505-95db-2b205e1f1ac2 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Request method failure captured: Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa HTTP/1.1 Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjE9zLwyh9pwWTwcB7e-fPzFlsR5fmFinztowOkXtc5DMtNIKQEoWtrL6wCtgPSPfSkZWjYxcTBASCJj4Jedf3Smyg4wfWjdM8GKVl9RJYGrHe7eaEpSoc88V4aeEAt8dE9soqANsXB2buAe_haJdVHzbGTBXTMEFhA4uKr-5e1nWA Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 441be6932bc445888c073d62c09869ac Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1254902501 Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/441be6932bc445888c073d62c09869ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/441be6932bc445888c073d62c09869ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_441be6932bc445888c073d62c09869ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/441be6932bc445888c073d62c09869ac"}]}] Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1254902501 Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 441be6932bc445888c073d62c09869ac Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1254902501 Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-VolumesSnapshotsTestJSON-1254902501-project Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a294b5ea4870425f86a968f4a09ce241 Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1254902501-project Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: exception: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'bf0b2779-81e9-4c8d-a172-b6fa94d614fa'} Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. (HTTP 404) (Request-ID: req-e8ca6788-47a3-4aa0-835c-a60ada255bd4) Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:56:08.056760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:08.060740 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:08.064871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7458951f-89b2-4505-95db-2b205e1f1ac2 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Returning 404 to user: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:08.065935 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7458951f-89b2-4505-95db-2b205e1f1ac2 tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa" status: 404 len: 109 microversion: 2.1 time: 0.070343 Jul 28 03:56:08.067616 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2361/4274] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:56:07 2022] DELETE /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:08.075597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44bc9f87-2a68-43e4-bd30-235207f678be tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Calling method '.version_select at 0x7ffa67925d30>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:08.138411 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-44bc9f87-2a68-43e4-bd30-235207f678be tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] HTTP exception thrown: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44bc9f87-2a68-43e4-bd30-235207f678be tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Request method failure captured: Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa HTTP/1.1 Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjE9zLwyh9pwWTwcB7e-fPzFlsR5fmFinztowOkXtc5DMtNIKQEoWtrL6wCtgPSPfSkZWjYxcTBASCJj4Jedf3Smyg4wfWjdM8GKVl9RJYGrHe7eaEpSoc88V4aeEAt8dE9soqANsXB2buAe_haJdVHzbGTBXTMEFhA4uKr-5e1nWA Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 441be6932bc445888c073d62c09869ac Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1254902501 Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/441be6932bc445888c073d62c09869ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/441be6932bc445888c073d62c09869ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_441be6932bc445888c073d62c09869ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/441be6932bc445888c073d62c09869ac"}]}] Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1254902501 Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 441be6932bc445888c073d62c09869ac Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1254902501 Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-VolumesSnapshotsTestJSON-1254902501-project Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a294b5ea4870425f86a968f4a09ce241 Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1254902501-project Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: exception: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'bf0b2779-81e9-4c8d-a172-b6fa94d614fa'} Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. (HTTP 404) (Request-ID: req-a13d8f43-f117-48f6-ade1-7aa5341bcf39) Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:56:08.140864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44bc9f87-2a68-43e4-bd30-235207f678be tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] Returning 404 to user: Volume bf0b2779-81e9-4c8d-a172-b6fa94d614fa could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-44bc9f87-2a68-43e4-bd30-235207f678be tempest-VolumesSnapshotsTestJSON-1254902501 tempest-VolumesSnapshotsTestJSON-1254902501-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa" status: 404 len: 109 microversion: 2.1 time: 0.070860 Jul 28 03:56:08.148244 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2362/4275] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:56:08 2022] GET /compute/v2.1/os-volumes/bf0b2779-81e9-4c8d-a172-b6fa94d614fa => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:56:08.283691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-700328d9-8b0b-4414-895a-3c296338b770 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:08.307103 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-700328d9-8b0b-4414-895a-3c296338b770 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.465096 Jul 28 03:56:08.308511 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1914/4276] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:07 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:08.331933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f985d472-3f4d-4536-bb00-7c49eebaea75 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:08.332810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f985d472-3f4d-4536-bb00-7c49eebaea75 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:08.339647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f985d472-3f4d-4536-bb00-7c49eebaea75 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:08.340299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f985d472-3f4d-4536-bb00-7c49eebaea75 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:08.342408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f985d472-3f4d-4536-bb00-7c49eebaea75 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:08.343001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f985d472-3f4d-4536-bb00-7c49eebaea75 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:08.794591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f985d472-3f4d-4536-bb00-7c49eebaea75 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:08.808605 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f985d472-3f4d-4536-bb00-7c49eebaea75 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.482218 Jul 28 03:56:08.825100 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2363/4277] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:08 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:08.941606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1202358d-b2ae-4ca8-a0f1-33d33d65a0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:08.942248 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1202358d-b2ae-4ca8-a0f1-33d33d65a0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:08.958550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1202358d-b2ae-4ca8-a0f1-33d33d65a0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:08.959089 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1202358d-b2ae-4ca8-a0f1-33d33d65a0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:08.959898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1202358d-b2ae-4ca8-a0f1-33d33d65a0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:08.960337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1202358d-b2ae-4ca8-a0f1-33d33d65a0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:09.399174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-289be396-850b-417f-a18a-bb1a57b4523c req-ad22cbd5-970e-4588-bbc6-777d7f8da2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f", "name": "network-vif-plugged", "status": "completed", "tag": "c8793abb-3b60-44eb-92c4-080c797cc8a3"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:09.421148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-289be396-850b-417f-a18a-bb1a57b4523c req-ad22cbd5-970e-4588-bbc6-777d7f8da2a7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:09.421670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-289be396-850b-417f-a18a-bb1a57b4523c req-ad22cbd5-970e-4588-bbc6-777d7f8da2a7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:09.485350 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-289be396-850b-417f-a18a-bb1a57b4523c req-ad22cbd5-970e-4588-bbc6-777d7f8da2a7 service nova] Creating event network-vif-plugged:c8793abb-3b60-44eb-92c4-080c797cc8a3 for instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f on n-h1-826756-3 Jul 28 03:56:09.515537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1202358d-b2ae-4ca8-a0f1-33d33d65a0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:09.516257 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-289be396-850b-417f-a18a-bb1a57b4523c req-ad22cbd5-970e-4588-bbc6-777d7f8da2a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.549256 Jul 28 03:56:09.524412 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2364/4278] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:09.526389 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1202358d-b2ae-4ca8-a0f1-33d33d65a0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1324 microversion: 2.1 time: 0.588712 Jul 28 03:56:09.540800 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1915/4279] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:08 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1324 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:09.545150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-23b343bd-6113-4d34-ac96-562f8c6be636 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-434062057", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:09.613543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1206427596", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e174d1f-d406-4bbf-bcb8-442696da4c2d"}], "security_groups": [{"name": "tempest-securitygroup--1506068575"}], "key_name": "tempest-keypair-1022284047", "user_data": "}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:09.923648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.security_group_api [None req-23b343bd-6113-4d34-ac96-562f8c6be636 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Neutron security group does_not_exist not found {{(pid=126071) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 28 03:56:09.924573 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-23b343bd-6113-4d34-ac96-562f8c6be636 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-23b343bd-6113-4d34-ac96-562f8c6be636 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 257 Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-434062057", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-434062057', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '3fcf143f-a069-44e5-9902-e5b7dddd3dfa'}]}}} Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 28 03:56:09.939215 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2195, in create Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1671, in _create_instance Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1063, in _validate_and_build_base_options Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 510, in _check_requested_secgroups Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:09.942648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-23b343bd-6113-4d34-ac96-562f8c6be636 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:09.945607 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-23b343bd-6113-4d34-ac96-562f8c6be636 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.413913 Jul 28 03:56:09.945607 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2365/4280] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:56:09 2022] POST /compute/v2.1/servers => generated 106 bytes in 417 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:56:09.954630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66074d91-5df3-46df-a538-5a5890943221 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:09.955432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-66074d91-5df3-46df-a538-5a5890943221 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:09.971597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66074d91-5df3-46df-a538-5a5890943221 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:09.983455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66074d91-5df3-46df-a538-5a5890943221 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:09.984901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66074d91-5df3-46df-a538-5a5890943221 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:09.985564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66074d91-5df3-46df-a538-5a5890943221 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:10.130045 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] validate_networks() for [('4e174d1f-d406-4bbf-bcb8-442696da4c2d', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:56:10.364574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-66074d91-5df3-46df-a538-5a5890943221 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:10.374729 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-66074d91-5df3-46df-a538-5a5890943221 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.425158 Jul 28 03:56:10.375326 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2366/4281] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:09 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:10.398698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ef803e8-ac18-4331-9758-11c127ed341a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:10.410624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ef803e8-ac18-4331-9758-11c127ed341a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:10.422046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ef803e8-ac18-4331-9758-11c127ed341a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:10.422740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ef803e8-ac18-4331-9758-11c127ed341a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:10.423705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ef803e8-ac18-4331-9758-11c127ed341a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:10.424292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ef803e8-ac18-4331-9758-11c127ed341a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:10.758782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ef803e8-ac18-4331-9758-11c127ed341a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:10.770455 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ef803e8-ac18-4331-9758-11c127ed341a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.376010 Jul 28 03:56:10.773660 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2367/4282] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:10 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:10.781296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ba2a66d1-dab7-479f-adef-0df2ddab5f1f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:10.782493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ba2a66d1-dab7-479f-adef-0df2ddab5f1f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:10.796797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba2a66d1-dab7-479f-adef-0df2ddab5f1f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:10.799303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba2a66d1-dab7-479f-adef-0df2ddab5f1f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:10.803139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba2a66d1-dab7-479f-adef-0df2ddab5f1f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:10.804194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba2a66d1-dab7-479f-adef-0df2ddab5f1f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:11.057615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ba2a66d1-dab7-479f-adef-0df2ddab5f1f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:11.083510 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ba2a66d1-dab7-479f-adef-0df2ddab5f1f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1324 microversion: 2.1 time: 0.307921 Jul 28 03:56:11.084996 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2368/4283] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:10 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:11.090924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3447d781-6315-48f5-934d-084ed33d4840 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:11.091416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3447d781-6315-48f5-934d-084ed33d4840 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 5a684b3c-d619-40db-bbe4-4c2a4f74de9c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:11.097999 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-3447d781-6315-48f5-934d-084ed33d4840 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance 5a684b3c-d619-40db-bbe4-4c2a4f74de9c could not be found. Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3447d781-6315-48f5-934d-084ed33d4840 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/5a684b3c-d619-40db-bbe4-4c2a4f74de9c HTTP/1.1 Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 5a684b3c-d619-40db-bbe4-4c2a4f74de9c could not be found. Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '5a684b3c-d619-40db-bbe4-4c2a4f74de9c'} Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a684b3c-d619-40db-bbe4-4c2a4f74de9c could not be found. Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a684b3c-d619-40db-bbe4-4c2a4f74de9c could not be found. Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:11.099569 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:11.103760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:11.103760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:11.103760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:11.103760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:11.103760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:11.103760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:11.103760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a684b3c-d619-40db-bbe4-4c2a4f74de9c could not be found. Jul 28 03:56:11.103760 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:11.103760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3447d781-6315-48f5-934d-084ed33d4840 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance 5a684b3c-d619-40db-bbe4-4c2a4f74de9c could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:11.103760 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3447d781-6315-48f5-934d-084ed33d4840 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5a684b3c-d619-40db-bbe4-4c2a4f74de9c" status: 404 len: 111 microversion: 2.1 time: 0.015094 Jul 28 03:56:11.103760 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2369/4284] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:56:11 2022] DELETE /compute/v2.1/servers/5a684b3c-d619-40db-bbe4-4c2a4f74de9c => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:11.114757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-71c27bb1-05fe-4ff1-8f8f-a9a1d33445ad tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:11.115746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-71c27bb1-05fe-4ff1-8f8f-a9a1d33445ad tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:11.125795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71c27bb1-05fe-4ff1-8f8f-a9a1d33445ad tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:11.126391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71c27bb1-05fe-4ff1-8f8f-a9a1d33445ad tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:11.127259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71c27bb1-05fe-4ff1-8f8f-a9a1d33445ad tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:11.127765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71c27bb1-05fe-4ff1-8f8f-a9a1d33445ad tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:11.316641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-71c27bb1-05fe-4ff1-8f8f-a9a1d33445ad tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:11.332794 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-71c27bb1-05fe-4ff1-8f8f-a9a1d33445ad tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.221630 Jul 28 03:56:11.337804 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2370/4285] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:11 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:11.363781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15e0e6b2-7dff-462d-be77-9e29d5f1b75d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:11.364537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15e0e6b2-7dff-462d-be77-9e29d5f1b75d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:11.383175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e0e6b2-7dff-462d-be77-9e29d5f1b75d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:11.390240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e0e6b2-7dff-462d-be77-9e29d5f1b75d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:11.393199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e0e6b2-7dff-462d-be77-9e29d5f1b75d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:11.396424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e0e6b2-7dff-462d-be77-9e29d5f1b75d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:11.787146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-15e0e6b2-7dff-462d-be77-9e29d5f1b75d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:11.799498 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15e0e6b2-7dff-462d-be77-9e29d5f1b75d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.441623 Jul 28 03:56:11.807042 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2371/4286] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:11 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:11.829382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1302781-71ec-4e7d-b611-c25a643f08aa tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:11.842393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1302781-71ec-4e7d-b611-c25a643f08aa tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Failed to fetch instance by id 9223372036854775808 {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2972}} Jul 28 03:56:11.843079 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-b1302781-71ec-4e7d-b611-c25a643f08aa tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1302781-71ec-4e7d-b611-c25a643f08aa tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 9223372036854775808 could not be found. Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9223372036854775808'} Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2973, in get Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:11.844771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:11.848670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:11.848670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:11.848670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:11.848670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 28 03:56:11.848670 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:11.848670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1302781-71ec-4e7d-b611-c25a643f08aa tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:11.848670 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1302781-71ec-4e7d-b611-c25a643f08aa tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.020927 Jul 28 03:56:11.848670 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2372/4287] 10.222.0.48 () {58 vars in 1188 bytes} [Thu Jul 28 03:56:11 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 03:56:11.895096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1e9beafe-0168-4702-ae74-8520a9cc1b8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:11.895842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1e9beafe-0168-4702-ae74-8520a9cc1b8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:11.936799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e9beafe-0168-4702-ae74-8520a9cc1b8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:11.937938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e9beafe-0168-4702-ae74-8520a9cc1b8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:11.937938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e9beafe-0168-4702-ae74-8520a9cc1b8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:11.937938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e9beafe-0168-4702-ae74-8520a9cc1b8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:12.210883 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:56:12.211405 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:56:12.212700 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:56:12.214138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:56:12.214138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:56:12.233735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:12.235687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:12.238786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:12.239575 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:12.286605 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Getting quotas for project 98f0f82bb0014564bff4c739314d25a4. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:12.300314 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Getting quotas for user ea947ad72ea74f439474ac4703fb0ebb and project 98f0f82bb0014564bff4c739314d25a4. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:12.334693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:56:12.337185 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:56:12.337839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1e9beafe-0168-4702-ae74-8520a9cc1b8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:12.350754 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1e9beafe-0168-4702-ae74-8520a9cc1b8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.492292 Jul 28 03:56:12.352317 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2373/4288] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:11 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:12.384016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fbf46914-5f3d-4075-8ae8-004be9c08491 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:12.388216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fbf46914-5f3d-4075-8ae8-004be9c08491 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:12.410535 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2c0adfd2-23e9-45ae-b16e-a09a1a4afbdd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.801651 Jul 28 03:56:12.411936 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1916/4289] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:56:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 2804 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:56:12.412970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:12.419400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbf46914-5f3d-4075-8ae8-004be9c08491 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:12.419944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbf46914-5f3d-4075-8ae8-004be9c08491 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:12.426259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4543b463-b36b-4a73-b6e0-f59cef5bc4ca tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:12.427183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4543b463-b36b-4a73-b6e0-f59cef5bc4ca tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:12.434577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbf46914-5f3d-4075-8ae8-004be9c08491 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:12.435071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbf46914-5f3d-4075-8ae8-004be9c08491 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:12.435512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4543b463-b36b-4a73-b6e0-f59cef5bc4ca tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:12.436484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4543b463-b36b-4a73-b6e0-f59cef5bc4ca tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:12.437542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4543b463-b36b-4a73-b6e0-f59cef5bc4ca tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:12.438622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4543b463-b36b-4a73-b6e0-f59cef5bc4ca tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:12.652710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-fbf46914-5f3d-4075-8ae8-004be9c08491 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lazy-loading 'services' on Instance uuid 0a04170d-7c69-4efa-8141-d243feb5c41b {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:56:12.822326 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fbf46914-5f3d-4075-8ae8-004be9c08491 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments/e7bca87c-e01d-4dc7-9273-341463060866" status: 202 len: 0 microversion: 2.1 time: 0.466218 Jul 28 03:56:12.824597 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2374/4290] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 03:56:12 2022] DELETE /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments/e7bca87c-e01d-4dc7-9273-341463060866 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:56:12.847558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a397b276-5a32-4213-989b-b5968239e9b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:12.852602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a397b276-5a32-4213-989b-b5968239e9b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:12.863832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a397b276-5a32-4213-989b-b5968239e9b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:12.864642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a397b276-5a32-4213-989b-b5968239e9b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:12.866708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a397b276-5a32-4213-989b-b5968239e9b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:12.867629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a397b276-5a32-4213-989b-b5968239e9b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:12.986901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4543b463-b36b-4a73-b6e0-f59cef5bc4ca tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:12.999610 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4543b463-b36b-4a73-b6e0-f59cef5bc4ca tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1521 microversion: 2.1 time: 0.583096 Jul 28 03:56:13.000281 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1917/4291] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:12 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1521 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:13.039950 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-27dcf241-5f4a-483d-98c7-3c1376b00073 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:13.040633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-27dcf241-5f4a-483d-98c7-3c1376b00073 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:13.111288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-27dcf241-5f4a-483d-98c7-3c1376b00073 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:13.123593 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-27dcf241-5f4a-483d-98c7-3c1376b00073 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:13.126269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-27dcf241-5f4a-483d-98c7-3c1376b00073 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:13.127683 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-27dcf241-5f4a-483d-98c7-3c1376b00073 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1282 microversion: 2.20 time: 0.126423 Jul 28 03:56:13.128927 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1918/4292] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:13 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1282 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:13.145901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f3acf7a8-02aa-40bd-b0c8-479e2d27e1df tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:13.151255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f3acf7a8-02aa-40bd-b0c8-479e2d27e1df tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:13.172909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f3acf7a8-02aa-40bd-b0c8-479e2d27e1df tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:13.173363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f3acf7a8-02aa-40bd-b0c8-479e2d27e1df tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:13.176929 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f3acf7a8-02aa-40bd-b0c8-479e2d27e1df tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:13.178813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f3acf7a8-02aa-40bd-b0c8-479e2d27e1df tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:13.252490 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f3acf7a8-02aa-40bd-b0c8-479e2d27e1df tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122092 Jul 28 03:56:13.257655 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1919/4293] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:56:13 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:13.264809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a8aefabc-6fd2-4663-899c-1600aa1fd103 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:13.265829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a8aefabc-6fd2-4663-899c-1600aa1fd103 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:13.274263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8aefabc-6fd2-4663-899c-1600aa1fd103 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:13.275060 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8aefabc-6fd2-4663-899c-1600aa1fd103 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:13.275984 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8aefabc-6fd2-4663-899c-1600aa1fd103 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:13.276632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8aefabc-6fd2-4663-899c-1600aa1fd103 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:13.483540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a8aefabc-6fd2-4663-899c-1600aa1fd103 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:13.496508 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a8aefabc-6fd2-4663-899c-1600aa1fd103 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1521 microversion: 2.1 time: 0.236335 Jul 28 03:56:13.497305 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1920/4294] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:13 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:13.532973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9fa7ab60-1cc2-4b07-b4e8-add24e69bfc9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1395121919", "metadata": {"": ""}}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9fa7ab60-1cc2-4b07-b4e8-add24e69bfc9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Request method failure captured: Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f/action HTTP/1.1 Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 107 Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gjBY0mYKCXtj0_d2uaizZHT_bTm8g67l0hNznQ_KVINZT1siV-lKxZREHB__mQh0Osf7Cog-lCJIGpJJ_mIo_1i4LQ-Uw87qYT7Q9LIdNSOqrDCo-x87gq81TQtloPebhhpc4TesbUzk376RJomPlfVbclxoCv7QtBWHpejAHdY1so Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}] Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 5265a6963e6e46c8bc7657bcf081362a Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1395121919", "metadata": {"": ""}}} Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1395121919', 'metadata': {'': ''}}}} Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'': ''} Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:13.546258 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:56:13.550379 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:13.552787 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9fa7ab60-1cc2-4b07-b4e8-add24e69bfc9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:13.554072 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9fa7ab60-1cc2-4b07-b4e8-add24e69bfc9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "POST /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f/action" status: 400 len: 170 microversion: 2.1 time: 0.032904 Jul 28 03:56:13.554998 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1921/4295] 10.222.0.48 () {60 vars in 1279 bytes} [Thu Jul 28 03:56:13 2022] POST /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f/action => generated 170 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:56:13.571210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0b9f2617-338b-440c-ac28-a973e4094d4a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:13.574815 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0b9f2617-338b-440c-ac28-a973e4094d4a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:13.601241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b9f2617-338b-440c-ac28-a973e4094d4a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:13.613748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a397b276-5a32-4213-989b-b5968239e9b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:13.621588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b9f2617-338b-440c-ac28-a973e4094d4a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:13.622521 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b9f2617-338b-440c-ac28-a973e4094d4a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:13.632891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b9f2617-338b-440c-ac28-a973e4094d4a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:13.636144 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a397b276-5a32-4213-989b-b5968239e9b7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.802634 Jul 28 03:56:13.637108 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2375/4296] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:12 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:13.669410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a6de784-3d53-458a-8450-4278912532a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:13.670999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7a6de784-3d53-458a-8450-4278912532a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Failed to fetch instance by id -1 {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2972}} Jul 28 03:56:13.672391 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-7a6de784-3d53-458a-8450-4278912532a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance -1 could not be found. Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a6de784-3d53-458a-8450-4278912532a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance -1 could not be found. Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '-1'} Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2973, in get Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:13.676425 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:13.679763 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:13.679763 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:13.679763 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 28 03:56:13.679763 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:13.682001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a6de784-3d53-458a-8450-4278912532a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance -1 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:13.683101 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7a6de784-3d53-458a-8450-4278912532a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.017739 Jul 28 03:56:13.685020 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2376/4297] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 03:56:13 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:56:13.693993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc993687-ffb5-4961-a131-29ac16306c9a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:13.694939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cc993687-ffb5-4961-a131-29ac16306c9a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:13.713676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc993687-ffb5-4961-a131-29ac16306c9a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:13.714401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc993687-ffb5-4961-a131-29ac16306c9a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:13.715406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc993687-ffb5-4961-a131-29ac16306c9a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:13.716180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc993687-ffb5-4961-a131-29ac16306c9a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:14.003569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0b9f2617-338b-440c-ac28-a973e4094d4a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:14.013637 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0b9f2617-338b-440c-ac28-a973e4094d4a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1521 microversion: 2.1 time: 0.453275 Jul 28 03:56:14.017332 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1922/4298] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:13 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:14.045969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b18880a-43dd-4083-b0db-f07a1a2cb4a9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:14.047079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2b18880a-43dd-4083-b0db-f07a1a2cb4a9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:14.059641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b18880a-43dd-4083-b0db-f07a1a2cb4a9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:14.060909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b18880a-43dd-4083-b0db-f07a1a2cb4a9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:14.062630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b18880a-43dd-4083-b0db-f07a1a2cb4a9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:14.068245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2b18880a-43dd-4083-b0db-f07a1a2cb4a9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:14.344103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cc993687-ffb5-4961-a131-29ac16306c9a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:14.395908 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cc993687-ffb5-4961-a131-29ac16306c9a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.706152 Jul 28 03:56:14.425858 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2377/4299] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:13 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:14.446598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-db82b1af-6906-49c1-b5c8-c6910deb2374 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:14.448368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-db82b1af-6906-49c1-b5c8-c6910deb2374 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:14.468125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db82b1af-6906-49c1-b5c8-c6910deb2374 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:14.470798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db82b1af-6906-49c1-b5c8-c6910deb2374 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:14.471648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db82b1af-6906-49c1-b5c8-c6910deb2374 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:14.472095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db82b1af-6906-49c1-b5c8-c6910deb2374 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:14.498270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2b18880a-43dd-4083-b0db-f07a1a2cb4a9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:14.511642 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2b18880a-43dd-4083-b0db-f07a1a2cb4a9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1521 microversion: 2.1 time: 0.474951 Jul 28 03:56:14.512268 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1923/4300] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:14 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:14.543557 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-72686cae-0cf1-4d67-a14b-73f32b4f0e27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:14.545885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-72686cae-0cf1-4d67-a14b-73f32b4f0e27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:14.562162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72686cae-0cf1-4d67-a14b-73f32b4f0e27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:14.570377 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72686cae-0cf1-4d67-a14b-73f32b4f0e27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:14.571341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72686cae-0cf1-4d67-a14b-73f32b4f0e27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:14.571794 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-72686cae-0cf1-4d67-a14b-73f32b4f0e27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:14.642136 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-72686cae-0cf1-4d67-a14b-73f32b4f0e27 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111680 Jul 28 03:56:14.642914 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1924/4301] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:56:14 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:14.653850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bb1a0a0d-fb23-47a7-8808-a9c1aa05a762 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:14.654489 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bb1a0a0d-fb23-47a7-8808-a9c1aa05a762 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:14.683707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb1a0a0d-fb23-47a7-8808-a9c1aa05a762 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:14.689159 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb1a0a0d-fb23-47a7-8808-a9c1aa05a762 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:14.691272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb1a0a0d-fb23-47a7-8808-a9c1aa05a762 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:14.692255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bb1a0a0d-fb23-47a7-8808-a9c1aa05a762 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:14.747483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-db82b1af-6906-49c1-b5c8-c6910deb2374 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:14.761075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-db82b1af-6906-49c1-b5c8-c6910deb2374 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:14.763346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-db82b1af-6906-49c1-b5c8-c6910deb2374 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:14.765375 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-db82b1af-6906-49c1-b5c8-c6910deb2374 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1334 microversion: 2.20 time: 0.337986 Jul 28 03:56:14.790512 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2378/4302] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:14 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1334 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:14.797900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4ac9aa2d-54a0-4a33-99e8-2459b6c4941e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-6978963", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4ac9aa2d-54a0-4a33-99e8-2459b6c4941e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Request method failure captured: Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f/action HTTP/1.1 Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 616 Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjBY0mYKCXtj0_d2uaizZHT_bTm8g67l0hNznQ_KVINZT1siV-lKxZREHB__mQh0Osf7Cog-lCJIGpJJ_mIo_1i4LQ-Uw87qYT7Q9LIdNSOqrDCo-x87gq81TQtloPebhhpc4TesbUzk376RJomPlfVbclxoCv7QtBWHpejAHdY1so Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}] Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 5265a6963e6e46c8bc7657bcf081362a Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-6978963", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-6978963', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:56:14.804012 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 28 03:56:14.806309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:14.808340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4ac9aa2d-54a0-4a33-99e8-2459b6c4941e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:14.808340 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4ac9aa2d-54a0-4a33-99e8-2459b6c4941e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "POST /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f/action" status: 400 len: 938 microversion: 2.1 time: 0.013934 Jul 28 03:56:14.808340 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2379/4303] 10.222.0.48 () {60 vars in 1279 bytes} [Thu Jul 28 03:56:14 2022] POST /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f/action => generated 938 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:56:14.829582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cac615a8-8a84-4817-95a8-3bc3dfc95e06 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:14.833973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cac615a8-8a84-4817-95a8-3bc3dfc95e06 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:14.870532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cac615a8-8a84-4817-95a8-3bc3dfc95e06 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:14.870995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cac615a8-8a84-4817-95a8-3bc3dfc95e06 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:14.874854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cac615a8-8a84-4817-95a8-3bc3dfc95e06 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:14.876435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cac615a8-8a84-4817-95a8-3bc3dfc95e06 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:14.939118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:15.110620 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bb1a0a0d-fb23-47a7-8808-a9c1aa05a762 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:15.125501 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bb1a0a0d-fb23-47a7-8808-a9c1aa05a762 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.481157 Jul 28 03:56:15.128398 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1925/4304] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:14 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:15.165051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b646091-95df-45f5-8cff-0ffca4f41827 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:15.165653 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2b646091-95df-45f5-8cff-0ffca4f41827 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 896ad757-11b3-4348-8fa1-7291446efce9] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:15.181538 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-2b646091-95df-45f5-8cff-0ffca4f41827 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance 896ad757-11b3-4348-8fa1-7291446efce9 could not be found. Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b646091-95df-45f5-8cff-0ffca4f41827 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/896ad757-11b3-4348-8fa1-7291446efce9/action HTTP/1.1 Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 19 Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: {"forceDelete": {}} Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 896ad757-11b3-4348-8fa1-7291446efce9 could not be found. Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '896ad757-11b3-4348-8fa1-7291446efce9', 'body': {'forceDelete': {}}} Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 896ad757-11b3-4348-8fa1-7291446efce9 could not be found. Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 896ad757-11b3-4348-8fa1-7291446efce9 could not be found. Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:15.190831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:15.195240 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:15.195240 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:15.195240 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 896ad757-11b3-4348-8fa1-7291446efce9 could not be found. Jul 28 03:56:15.195240 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:15.195240 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2b646091-95df-45f5-8cff-0ffca4f41827 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance 896ad757-11b3-4348-8fa1-7291446efce9 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:15.195240 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2b646091-95df-45f5-8cff-0ffca4f41827 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/896ad757-11b3-4348-8fa1-7291446efce9/action" status: 404 len: 111 microversion: 2.1 time: 0.045105 Jul 28 03:56:15.199509 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1926/4305] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:15 2022] POST /compute/v2.1/servers/896ad757-11b3-4348-8fa1-7291446efce9/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:15.225130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-168a2cdf-b027-4dc4-8944-aae7c19c7f8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:15.231120 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-168a2cdf-b027-4dc4-8944-aae7c19c7f8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:15.274187 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-168a2cdf-b027-4dc4-8944-aae7c19c7f8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:15.274669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-168a2cdf-b027-4dc4-8944-aae7c19c7f8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:15.275476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-168a2cdf-b027-4dc4-8944-aae7c19c7f8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:15.275944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-168a2cdf-b027-4dc4-8944-aae7c19c7f8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:15.654565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cac615a8-8a84-4817-95a8-3bc3dfc95e06 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:15.665902 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cac615a8-8a84-4817-95a8-3bc3dfc95e06 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1521 microversion: 2.1 time: 0.850816 Jul 28 03:56:15.670991 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2380/4306] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:14 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1521 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:15.692304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5a437833-2c8f-40c5-a06b-a4360611e64c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:15.709987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5a437833-2c8f-40c5-a06b-a4360611e64c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:15.728820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a437833-2c8f-40c5-a06b-a4360611e64c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:15.729497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a437833-2c8f-40c5-a06b-a4360611e64c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:15.730783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a437833-2c8f-40c5-a06b-a4360611e64c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:15.731436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a437833-2c8f-40c5-a06b-a4360611e64c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:15.826091 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5a437833-2c8f-40c5-a06b-a4360611e64c tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144192 Jul 28 03:56:15.827483 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2381/4307] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:56:15 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:15.832681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-732f68fe-a303-4811-ab99-508d93e8d0b5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:15.847637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-732f68fe-a303-4811-ab99-508d93e8d0b5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:15.863372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-732f68fe-a303-4811-ab99-508d93e8d0b5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:15.864039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-732f68fe-a303-4811-ab99-508d93e8d0b5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:15.866917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-732f68fe-a303-4811-ab99-508d93e8d0b5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:15.870930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-732f68fe-a303-4811-ab99-508d93e8d0b5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:15.883676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-168a2cdf-b027-4dc4-8944-aae7c19c7f8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:15.892895 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-168a2cdf-b027-4dc4-8944-aae7c19c7f8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.692172 Jul 28 03:56:15.904755 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1927/4308] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:15 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:15.930631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-faa4ad41-c528-410b-904f-b51a45ab513b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:15.931224 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-faa4ad41-c528-410b-904f-b51a45ab513b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:15.953765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-faa4ad41-c528-410b-904f-b51a45ab513b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:15.957381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-faa4ad41-c528-410b-904f-b51a45ab513b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:15.965625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-faa4ad41-c528-410b-904f-b51a45ab513b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:15.966092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-faa4ad41-c528-410b-904f-b51a45ab513b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:16.320884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-732f68fe-a303-4811-ab99-508d93e8d0b5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:16.329630 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-732f68fe-a303-4811-ab99-508d93e8d0b5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1521 microversion: 2.1 time: 0.500805 Jul 28 03:56:16.336450 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2382/4309] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:15 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:16.342245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-508a786f-1ecd-438f-9cbe-3086df11c88d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:16.357281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-508a786f-1ecd-438f-9cbe-3086df11c88d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:16.366739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-508a786f-1ecd-438f-9cbe-3086df11c88d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:16.374551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-508a786f-1ecd-438f-9cbe-3086df11c88d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:16.375605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-508a786f-1ecd-438f-9cbe-3086df11c88d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:16.377135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-508a786f-1ecd-438f-9cbe-3086df11c88d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:16.664616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-508a786f-1ecd-438f-9cbe-3086df11c88d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:16.679861 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-508a786f-1ecd-438f-9cbe-3086df11c88d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.337804 Jul 28 03:56:16.680912 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2383/4310] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:16 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:16.697693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1afaa320-ca9d-46d7-b21e-b5d5ddf02660 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1afaa320-ca9d-46d7-b21e-b5d5ddf02660 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Request method failure captured: Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f/action HTTP/1.1 Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 285 Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjBY0mYKCXtj0_d2uaizZHT_bTm8g67l0hNznQ_KVINZT1siV-lKxZREHB__mQh0Osf7Cog-lCJIGpJJ_mIo_1i4LQ-Uw87qYT7Q9LIdNSOqrDCo-x87gq81TQtloPebhhpc4TesbUzk376RJomPlfVbclxoCv7QtBWHpejAHdY1so Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}] Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 5265a6963e6e46c8bc7657bcf081362a Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:16.701815 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:56:16.705367 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:16.716318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1afaa320-ca9d-46d7-b21e-b5d5ddf02660 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:16.718023 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1afaa320-ca9d-46d7-b21e-b5d5ddf02660 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "POST /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f/action" status: 400 len: 619 microversion: 2.1 time: 0.030400 Jul 28 03:56:16.718982 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2384/4311] 10.222.0.48 () {60 vars in 1279 bytes} [Thu Jul 28 03:56:16 2022] POST /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f/action => generated 619 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:56:16.732529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-767ead1a-9d74-4246-babb-ae0291662e4f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:16.735008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-767ead1a-9d74-4246-babb-ae0291662e4f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d9bc7e97-83e6-4b1d-af96-432ea27b821d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:16.743341 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-767ead1a-9d74-4246-babb-ae0291662e4f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance d9bc7e97-83e6-4b1d-af96-432ea27b821d could not be found. Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-767ead1a-9d74-4246-babb-ae0291662e4f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/d9bc7e97-83e6-4b1d-af96-432ea27b821d/action HTTP/1.1 Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 39 Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: {"os-getConsoleOutput": {"length": 10}} Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d9bc7e97-83e6-4b1d-af96-432ea27b821d could not be found. Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd9bc7e97-83e6-4b1d-af96-432ea27b821d', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9bc7e97-83e6-4b1d-af96-432ea27b821d could not be found. Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9bc7e97-83e6-4b1d-af96-432ea27b821d could not be found. Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:16.749946 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:16.754342 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:16.754342 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:16.754342 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:16.754342 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:16.754342 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9bc7e97-83e6-4b1d-af96-432ea27b821d could not be found. Jul 28 03:56:16.754342 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:16.756552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-767ead1a-9d74-4246-babb-ae0291662e4f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance d9bc7e97-83e6-4b1d-af96-432ea27b821d could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:16.758863 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-767ead1a-9d74-4246-babb-ae0291662e4f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/d9bc7e97-83e6-4b1d-af96-432ea27b821d/action" status: 404 len: 111 microversion: 2.1 time: 0.031271 Jul 28 03:56:16.762076 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2385/4312] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:16 2022] POST /compute/v2.1/servers/d9bc7e97-83e6-4b1d-af96-432ea27b821d/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:16.772327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-30ae6ba6-2d45-49c8-85dc-0123ff60164b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:16.776248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-30ae6ba6-2d45-49c8-85dc-0123ff60164b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:16.791015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30ae6ba6-2d45-49c8-85dc-0123ff60164b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:16.793532 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-faa4ad41-c528-410b-904f-b51a45ab513b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:16.797733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30ae6ba6-2d45-49c8-85dc-0123ff60164b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:16.801116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30ae6ba6-2d45-49c8-85dc-0123ff60164b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:16.803098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30ae6ba6-2d45-49c8-85dc-0123ff60164b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:16.821377 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-faa4ad41-c528-410b-904f-b51a45ab513b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:16.826552 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-faa4ad41-c528-410b-904f-b51a45ab513b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:16.834995 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-faa4ad41-c528-410b-904f-b51a45ab513b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1340 microversion: 2.20 time: 0.928829 Jul 28 03:56:16.839549 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1928/4313] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:15 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1340 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:16.865150 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5a3052e7-db4a-4bec-9c03-7b88754a042c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:16.866554 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5a3052e7-db4a-4bec-9c03-7b88754a042c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:16.921826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a3052e7-db4a-4bec-9c03-7b88754a042c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:16.925771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a3052e7-db4a-4bec-9c03-7b88754a042c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:16.929020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a3052e7-db4a-4bec-9c03-7b88754a042c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:16.929517 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a3052e7-db4a-4bec-9c03-7b88754a042c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:17.566184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5a3052e7-db4a-4bec-9c03-7b88754a042c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:17.577335 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5a3052e7-db4a-4bec-9c03-7b88754a042c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.736149 Jul 28 03:56:17.578006 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1929/4314] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:16 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:17.584720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-15eb49ee-6831-4a13-b743-1556e8b15897 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:17.587047 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-15eb49ee-6831-4a13-b743-1556e8b15897 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:17.612853 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-15eb49ee-6831-4a13-b743-1556e8b15897 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:17.613311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-15eb49ee-6831-4a13-b743-1556e8b15897 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:17.614289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-15eb49ee-6831-4a13-b743-1556e8b15897 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:17.616959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-15eb49ee-6831-4a13-b743-1556e8b15897 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:17.687592 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-15eb49ee-6831-4a13-b743-1556e8b15897 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108472 Jul 28 03:56:17.693341 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1930/4315] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:56:17 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:17.712291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a1ff0ad2-1fcb-4593-b0da-8b44e821b55d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:17.713531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a1ff0ad2-1fcb-4593-b0da-8b44e821b55d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:17.733328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a1ff0ad2-1fcb-4593-b0da-8b44e821b55d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:17.733791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a1ff0ad2-1fcb-4593-b0da-8b44e821b55d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:17.734719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a1ff0ad2-1fcb-4593-b0da-8b44e821b55d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:17.741591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a1ff0ad2-1fcb-4593-b0da-8b44e821b55d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:18.162042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-30ae6ba6-2d45-49c8-85dc-0123ff60164b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:18.173521 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-30ae6ba6-2d45-49c8-85dc-0123ff60164b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1521 microversion: 2.1 time: 1.409969 Jul 28 03:56:18.177241 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2386/4316] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:16 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1521 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:18.192670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e8af12b8-0eb1-4e4c-8693-866c419343cf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:18.193645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e8af12b8-0eb1-4e4c-8693-866c419343cf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:18.207915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8af12b8-0eb1-4e4c-8693-866c419343cf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:18.209031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8af12b8-0eb1-4e4c-8693-866c419343cf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:18.211770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8af12b8-0eb1-4e4c-8693-866c419343cf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:18.217396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8af12b8-0eb1-4e4c-8693-866c419343cf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:18.298530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a1ff0ad2-1fcb-4593-b0da-8b44e821b55d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:18.313137 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a1ff0ad2-1fcb-4593-b0da-8b44e821b55d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.618457 Jul 28 03:56:18.313740 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1931/4317] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:17 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:18.324076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dffd8207-0129-4007-8adf-d8f9d91a5bf3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:18.324730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dffd8207-0129-4007-8adf-d8f9d91a5bf3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:18.335843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dffd8207-0129-4007-8adf-d8f9d91a5bf3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:18.336301 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dffd8207-0129-4007-8adf-d8f9d91a5bf3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:18.337119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dffd8207-0129-4007-8adf-d8f9d91a5bf3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:18.337554 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dffd8207-0129-4007-8adf-d8f9d91a5bf3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:18.742772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dffd8207-0129-4007-8adf-d8f9d91a5bf3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:18.754392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:18.767940 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dffd8207-0129-4007-8adf-d8f9d91a5bf3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1521 microversion: 2.1 time: 0.451315 Jul 28 03:56:18.785892 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1932/4318] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:18 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:18.792113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5f4a65a2-adf6-40bf-bc94-ffea99da2fe2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:18.793040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5f4a65a2-adf6-40bf-bc94-ffea99da2fe2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 92f3482b-9ba2-4e9b-a38f-2165dcf42bae] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:18.808059 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-5f4a65a2-adf6-40bf-bc94-ffea99da2fe2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance 92f3482b-9ba2-4e9b-a38f-2165dcf42bae could not be found. Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5f4a65a2-adf6-40bf-bc94-ffea99da2fe2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/92f3482b-9ba2-4e9b-a38f-2165dcf42bae HTTP/1.1 Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 92f3482b-9ba2-4e9b-a38f-2165dcf42bae could not be found. Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '92f3482b-9ba2-4e9b-a38f-2165dcf42bae'} Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92f3482b-9ba2-4e9b-a38f-2165dcf42bae could not be found. Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92f3482b-9ba2-4e9b-a38f-2165dcf42bae could not be found. Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:18.814410 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:18.818753 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:18.818753 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:18.818753 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:18.818753 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92f3482b-9ba2-4e9b-a38f-2165dcf42bae could not be found. Jul 28 03:56:18.818753 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:18.820748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5f4a65a2-adf6-40bf-bc94-ffea99da2fe2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance 92f3482b-9ba2-4e9b-a38f-2165dcf42bae could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:18.824752 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5f4a65a2-adf6-40bf-bc94-ffea99da2fe2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/92f3482b-9ba2-4e9b-a38f-2165dcf42bae" status: 404 len: 111 microversion: 2.1 time: 0.036374 Jul 28 03:56:18.826311 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1933/4319] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:18 2022] GET /compute/v2.1/servers/92f3482b-9ba2-4e9b-a38f-2165dcf42bae => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:18.843315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ed29392d-f1c7-4e1e-a809-f6ebf974065e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:18.847550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ed29392d-f1c7-4e1e-a809-f6ebf974065e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:18.875788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed29392d-f1c7-4e1e-a809-f6ebf974065e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:18.876474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed29392d-f1c7-4e1e-a809-f6ebf974065e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:18.877433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed29392d-f1c7-4e1e-a809-f6ebf974065e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:18.884176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed29392d-f1c7-4e1e-a809-f6ebf974065e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:18.963424 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ed29392d-f1c7-4e1e-a809-f6ebf974065e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135561 Jul 28 03:56:18.964368 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1934/4320] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:56:18 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:18.984867 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bf7b28fd-d254-4672-b59c-03872197fb30 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-61718982"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:18.992592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bf7b28fd-d254-4672-b59c-03872197fb30 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:19.008002 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf7b28fd-d254-4672-b59c-03872197fb30 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:19.015396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf7b28fd-d254-4672-b59c-03872197fb30 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:19.016851 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf7b28fd-d254-4672-b59c-03872197fb30 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:19.017530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf7b28fd-d254-4672-b59c-03872197fb30 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:19.457706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e8af12b8-0eb1-4e4c-8693-866c419343cf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:19.481771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e8af12b8-0eb1-4e4c-8693-866c419343cf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:19.483121 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bf7b28fd-d254-4672-b59c-03872197fb30 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "POST /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f/action" status: 202 len: 0 microversion: 2.1 time: 0.517112 Jul 28 03:56:19.483946 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1935/4321] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:18 2022] POST /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 03:56:19.501425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b10cfbd3-ad16-4113-b90d-06e3ede5aa77 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:19.502247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b10cfbd3-ad16-4113-b90d-06e3ede5aa77 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:19.510312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e8af12b8-0eb1-4e4c-8693-866c419343cf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:19.510538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b10cfbd3-ad16-4113-b90d-06e3ede5aa77 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:19.510854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b10cfbd3-ad16-4113-b90d-06e3ede5aa77 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:19.511678 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e8af12b8-0eb1-4e4c-8693-866c419343cf tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1408 microversion: 2.20 time: 1.332865 Jul 28 03:56:19.511973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b10cfbd3-ad16-4113-b90d-06e3ede5aa77 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:19.512628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b10cfbd3-ad16-4113-b90d-06e3ede5aa77 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:19.531724 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2387/4322] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:18 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1408 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:19.554508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e317e9dc-2ae7-4331-a059-6ec7d6859d6e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1764221599"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:19.562255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e317e9dc-2ae7-4331-a059-6ec7d6859d6e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:19.580583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e317e9dc-2ae7-4331-a059-6ec7d6859d6e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:19.581308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e317e9dc-2ae7-4331-a059-6ec7d6859d6e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:19.582320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e317e9dc-2ae7-4331-a059-6ec7d6859d6e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:19.582934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e317e9dc-2ae7-4331-a059-6ec7d6859d6e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:19.701452 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e317e9dc-2ae7-4331-a059-6ec7d6859d6e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] HTTP exception thrown: Cannot 'createImage' instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f while it is in task_state image_snapshot Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e317e9dc-2ae7-4331-a059-6ec7d6859d6e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Request method failure captured: Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f/action HTTP/1.1 Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 85 Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjBY0mYKCXtj0_d2uaizZHT_bTm8g67l0hNznQ_KVINZT1siV-lKxZREHB__mQh0Osf7Cog-lCJIGpJJ_mIo_1i4LQ-Uw87qYT7Q9LIdNSOqrDCo-x87gq81TQtloPebhhpc4TesbUzk376RJomPlfVbclxoCv7QtBWHpejAHdY1so Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}] Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 5265a6963e6e46c8bc7657bcf081362a Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1764221599"}} Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: exception: Cannot 'createImage' instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f while it is in task_state image_snapshot Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1764221599'}}} Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 153, in inner Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f in task_state image_snapshot. Cannot snapshot while the instance is in this state. Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 03:56:19.719994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f while it is in task_state image_snapshot Jul 28 03:56:19.728429 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:19.728429 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:19.728429 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:19.728429 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:19.728429 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:19.728429 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:19.728429 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:19.728429 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:19.728429 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f while it is in task_state image_snapshot Jul 28 03:56:19.728429 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:19.728429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e317e9dc-2ae7-4331-a059-6ec7d6859d6e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Returning 409 to user: Cannot 'createImage' instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f while it is in task_state image_snapshot {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:19.728429 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e317e9dc-2ae7-4331-a059-6ec7d6859d6e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "POST /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f/action" status: 409 len: 159 microversion: 2.1 time: 0.188792 Jul 28 03:56:19.728429 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2388/4323] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:19 2022] POST /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f/action => generated 159 bytes in 190 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:56:19.732098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7aa195dc-4885-4dd9-ac27-12a5e423a314 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '.version_select at 0x7ffa6798de50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:19.952555 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7aa195dc-4885-4dd9-ac27-12a5e423a314 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "DELETE /compute/v2.1/images/311b9a8f-bbc1-4808-8e18-648e6e388a5d" status: 204 len: 0 microversion: 2.1 time: 0.224129 Jul 28 03:56:19.953378 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2389/4324] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:19 2022] DELETE /compute/v2.1/images/311b9a8f-bbc1-4808-8e18-648e6e388a5d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:56:19.963113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e5613b5-af35-4420-aeba-2de018fe2442 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:19.963965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0e5613b5-af35-4420-aeba-2de018fe2442 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:19.975118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e5613b5-af35-4420-aeba-2de018fe2442 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:19.977972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e5613b5-af35-4420-aeba-2de018fe2442 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:19.978939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e5613b5-af35-4420-aeba-2de018fe2442 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:19.980018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e5613b5-af35-4420-aeba-2de018fe2442 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:20.503552 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b10cfbd3-ad16-4113-b90d-06e3ede5aa77 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:20.514664 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b10cfbd3-ad16-4113-b90d-06e3ede5aa77 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 1.020290 Jul 28 03:56:20.519893 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1936/4325] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:19 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:20.521932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0e5613b5-af35-4420-aeba-2de018fe2442 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:20.536163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7cbfc88b-dbdd-44fb-bd85-5f15e33387cd tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:20.538675 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0e5613b5-af35-4420-aeba-2de018fe2442 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1533 microversion: 2.1 time: 0.580415 Jul 28 03:56:20.540463 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2390/4326] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:19 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1533 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:20.543149 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7cbfc88b-dbdd-44fb-bd85-5f15e33387cd tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:20.549099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e6ab4697-75b0-4354-b617-56b457b278cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:20.549965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e6ab4697-75b0-4354-b617-56b457b278cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:20.568935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cbfc88b-dbdd-44fb-bd85-5f15e33387cd tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:20.569446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cbfc88b-dbdd-44fb-bd85-5f15e33387cd tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:20.570265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cbfc88b-dbdd-44fb-bd85-5f15e33387cd tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:20.574245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7cbfc88b-dbdd-44fb-bd85-5f15e33387cd tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:20.590950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6ab4697-75b0-4354-b617-56b457b278cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:20.595292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6ab4697-75b0-4354-b617-56b457b278cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:20.596334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6ab4697-75b0-4354-b617-56b457b278cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:20.598754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6ab4697-75b0-4354-b617-56b457b278cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:20.681077 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7cbfc88b-dbdd-44fb-bd85-5f15e33387cd tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158929 Jul 28 03:56:20.682070 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1937/4327] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:56:20 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:20.689942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aacdb757-b43b-47f6-a56f-250cc5f2ce3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:20.693193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-aacdb757-b43b-47f6-a56f-250cc5f2ce3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:20.711724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aacdb757-b43b-47f6-a56f-250cc5f2ce3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:20.714305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aacdb757-b43b-47f6-a56f-250cc5f2ce3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:20.721280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aacdb757-b43b-47f6-a56f-250cc5f2ce3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:20.722061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-aacdb757-b43b-47f6-a56f-250cc5f2ce3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:21.502749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e6ab4697-75b0-4354-b617-56b457b278cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:21.522275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e6ab4697-75b0-4354-b617-56b457b278cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:21.528123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e6ab4697-75b0-4354-b617-56b457b278cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:21.542300 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e6ab4697-75b0-4354-b617-56b457b278cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1408 microversion: 2.20 time: 1.000442 Jul 28 03:56:21.558753 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2391/4328] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:20 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1408 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:21.564572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-2bbdfe20-71ec-45a5-890a-b2f67f2e0bbc req-83c0fe06-9745-4b80-be4e-ca8736cfd5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8", "tag": "565bb390-f25a-4510-b22a-3975e600ba96"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:21.597889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2bbdfe20-71ec-45a5-890a-b2f67f2e0bbc req-83c0fe06-9745-4b80-be4e-ca8736cfd5f3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:21.600043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2bbdfe20-71ec-45a5-890a-b2f67f2e0bbc req-83c0fe06-9745-4b80-be4e-ca8736cfd5f3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:21.601925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-aacdb757-b43b-47f6-a56f-250cc5f2ce3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:21.614269 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aacdb757-b43b-47f6-a56f-250cc5f2ce3a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.930822 Jul 28 03:56:21.623427 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-2bbdfe20-71ec-45a5-890a-b2f67f2e0bbc req-83c0fe06-9745-4b80-be4e-ca8736cfd5f3 service nova] Creating event network-changed:565bb390-f25a-4510-b22a-3975e600ba96 for instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 on n-h2-826756-3 Jul 28 03:56:21.629343 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-2bbdfe20-71ec-45a5-890a-b2f67f2e0bbc req-83c0fe06-9745-4b80-be4e-ca8736cfd5f3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068897 Jul 28 03:56:21.632438 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2392/4329] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:21.642290 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1938/4330] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:20 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:21.648041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f8cba71b-dc3e-4d0d-a956-82e7f72ec644 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:21.649390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f8cba71b-dc3e-4d0d-a956-82e7f72ec644 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:21.666361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8cba71b-dc3e-4d0d-a956-82e7f72ec644 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:21.667286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8cba71b-dc3e-4d0d-a956-82e7f72ec644 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:21.669519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8cba71b-dc3e-4d0d-a956-82e7f72ec644 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:21.670344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8cba71b-dc3e-4d0d-a956-82e7f72ec644 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:21.694301 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-57afc885-bf2a-4feb-8b90-3849fe76fe19 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:21.696671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-57afc885-bf2a-4feb-8b90-3849fe76fe19 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:21.711848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-57afc885-bf2a-4feb-8b90-3849fe76fe19 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:21.712361 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-57afc885-bf2a-4feb-8b90-3849fe76fe19 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:21.714239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-57afc885-bf2a-4feb-8b90-3849fe76fe19 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:21.714940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-57afc885-bf2a-4feb-8b90-3849fe76fe19 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:21.797507 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-57afc885-bf2a-4feb-8b90-3849fe76fe19 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108611 Jul 28 03:56:21.805282 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1939/4331] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:56:21 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:56:21.935646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6e3dd39f-1248-43a9-bf50-12bfcf2376aa tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-731313148", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6e3dd39f-1248-43a9-bf50-12bfcf2376aa tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 237 Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-731313148", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-731313148', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '3fcf143f-a069-44e5-9902-e5b7dddd3dfa'}]}}} Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:21.953962 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 28 03:56:21.957877 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:21.961327 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6e3dd39f-1248-43a9-bf50-12bfcf2376aa tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:21.962361 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6e3dd39f-1248-43a9-bf50-12bfcf2376aa tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.030826 Jul 28 03:56:21.963096 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1940/4332] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:56:21 2022] POST /compute/v2.1/servers => generated 139 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:56:21.977775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9e19606a-d5f4-40c4-916e-f491990b3e52 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:21.978986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9e19606a-d5f4-40c4-916e-f491990b3e52 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:22.005733 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e19606a-d5f4-40c4-916e-f491990b3e52 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:22.006325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e19606a-d5f4-40c4-916e-f491990b3e52 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:22.007414 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e19606a-d5f4-40c4-916e-f491990b3e52 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:22.007964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e19606a-d5f4-40c4-916e-f491990b3e52 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:22.259339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:22.615039 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9e19606a-d5f4-40c4-916e-f491990b3e52 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:22.625218 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9e19606a-d5f4-40c4-916e-f491990b3e52 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.657184 Jul 28 03:56:22.630403 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1941/4333] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:21 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:22.647503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b57b0848-b554-4610-b3de-e7cb7b92e814 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:22.648386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b57b0848-b554-4610-b3de-e7cb7b92e814 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:22.667579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b57b0848-b554-4610-b3de-e7cb7b92e814 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:22.668308 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b57b0848-b554-4610-b3de-e7cb7b92e814 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:22.669936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b57b0848-b554-4610-b3de-e7cb7b92e814 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:22.671010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b57b0848-b554-4610-b3de-e7cb7b92e814 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:23.086973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f8cba71b-dc3e-4d0d-a956-82e7f72ec644 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:23.118083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=12 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:23.149096 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f8cba71b-dc3e-4d0d-a956-82e7f72ec644 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1539 microversion: 2.1 time: 1.514000 Jul 28 03:56:23.153839 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2393/4334] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:21 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1539 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:23.185606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a7dd01c9-0564-42c4-af46-96b22aaef3f3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:23.189388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a7dd01c9-0564-42c4-af46-96b22aaef3f3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:23.231514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a7dd01c9-0564-42c4-af46-96b22aaef3f3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:23.232004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a7dd01c9-0564-42c4-af46-96b22aaef3f3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:23.232938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a7dd01c9-0564-42c4-af46-96b22aaef3f3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:23.241689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a7dd01c9-0564-42c4-af46-96b22aaef3f3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:23.303066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b57b0848-b554-4610-b3de-e7cb7b92e814 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:23.324632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b57b0848-b554-4610-b3de-e7cb7b92e814 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:23.334840 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b57b0848-b554-4610-b3de-e7cb7b92e814 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:23.342361 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b57b0848-b554-4610-b3de-e7cb7b92e814 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1408 microversion: 2.20 time: 0.704336 Jul 28 03:56:23.347115 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1942/4335] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:22 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1408 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:23.388841 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-33a4baed-5ca2-4aeb-908f-302783275486 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:23.394718 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-33a4baed-5ca2-4aeb-908f-302783275486 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:23.434463 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:23.438170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33a4baed-5ca2-4aeb-908f-302783275486 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:23.438829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33a4baed-5ca2-4aeb-908f-302783275486 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:23.440236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33a4baed-5ca2-4aeb-908f-302783275486 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:23.442316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-33a4baed-5ca2-4aeb-908f-302783275486 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:23.548981 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-33a4baed-5ca2-4aeb-908f-302783275486 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196400 Jul 28 03:56:23.556557 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1943/4336] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:56:23 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments => generated 197 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:23.841470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a7dd01c9-0564-42c4-af46-96b22aaef3f3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:23.850626 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a7dd01c9-0564-42c4-af46-96b22aaef3f3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.695522 Jul 28 03:56:23.869843 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2394/4337] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:23 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:24.041980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9a5e1f62-3171-4400-b7e6-60e6e3cc14ae tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1306306806", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9a5e1f62-3171-4400-b7e6-60e6e3cc14ae tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 235 Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1306306806", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1306306806', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '3fcf143f-a069-44e5-9902-e5b7dddd3dfa'}]}}} Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:24.046673 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9a5e1f62-3171-4400-b7e6-60e6e3cc14ae tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:24.054316 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9a5e1f62-3171-4400-b7e6-60e6e3cc14ae tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.010434 Jul 28 03:56:24.059684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-78170963-030b-4b96-8e5c-d43b9dbeee01 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:24.060545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-78170963-030b-4b96-8e5c-d43b9dbeee01 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:24.070353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78170963-030b-4b96-8e5c-d43b9dbeee01 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:24.070725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78170963-030b-4b96-8e5c-d43b9dbeee01 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:24.071517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78170963-030b-4b96-8e5c-d43b9dbeee01 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:24.071952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78170963-030b-4b96-8e5c-d43b9dbeee01 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:24.073156 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1944/4338] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:56:24 2022] POST /compute/v2.1/servers => generated 133 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:56:24.179558 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c7943630-1fb6-48ea-b618-a736bf58a18b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:24.180171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c7943630-1fb6-48ea-b618-a736bf58a18b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:24.191835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c7943630-1fb6-48ea-b618-a736bf58a18b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:24.192288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c7943630-1fb6-48ea-b618-a736bf58a18b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:24.193105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c7943630-1fb6-48ea-b618-a736bf58a18b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:24.193537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c7943630-1fb6-48ea-b618-a736bf58a18b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:24.621717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-78170963-030b-4b96-8e5c-d43b9dbeee01 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:24.640057 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-78170963-030b-4b96-8e5c-d43b9dbeee01 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.584268 Jul 28 03:56:24.655015 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2395/4339] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:24 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:24.668700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-725c6d1d-5624-405e-b499-19879cc3de05 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:24.669478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-725c6d1d-5624-405e-b499-19879cc3de05 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:24.670830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c7943630-1fb6-48ea-b618-a736bf58a18b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:24.681760 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c7943630-1fb6-48ea-b618-a736bf58a18b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1521 microversion: 2.1 time: 0.506183 Jul 28 03:56:24.686497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-725c6d1d-5624-405e-b499-19879cc3de05 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:24.687000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-725c6d1d-5624-405e-b499-19879cc3de05 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:24.687795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-725c6d1d-5624-405e-b499-19879cc3de05 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:24.688258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-725c6d1d-5624-405e-b499-19879cc3de05 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:24.696968 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1945/4340] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:24 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:24.704915 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-03e62ef2-6036-422c-afa3-dc423cb7baa5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:24.707487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-03e62ef2-6036-422c-afa3-dc423cb7baa5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:24.715672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03e62ef2-6036-422c-afa3-dc423cb7baa5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:24.716377 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03e62ef2-6036-422c-afa3-dc423cb7baa5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:24.717741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03e62ef2-6036-422c-afa3-dc423cb7baa5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:24.718355 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03e62ef2-6036-422c-afa3-dc423cb7baa5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:24.774997 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-03e62ef2-6036-422c-afa3-dc423cb7baa5 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076793 Jul 28 03:56:24.775990 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1946/4341] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 03:56:24 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 03:56:24.785118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-19027f69-2f74-4591-a2af-095bb95fa478 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:24.785731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-19027f69-2f74-4591-a2af-095bb95fa478 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:24.795009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-19027f69-2f74-4591-a2af-095bb95fa478 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:24.795736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-19027f69-2f74-4591-a2af-095bb95fa478 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:24.797940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-19027f69-2f74-4591-a2af-095bb95fa478 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:24.798410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-19027f69-2f74-4591-a2af-095bb95fa478 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:25.087143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-725c6d1d-5624-405e-b499-19879cc3de05 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:25.099198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-725c6d1d-5624-405e-b499-19879cc3de05 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:25.100656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-725c6d1d-5624-405e-b499-19879cc3de05 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:25.102050 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-725c6d1d-5624-405e-b499-19879cc3de05 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1408 microversion: 2.20 time: 0.444468 Jul 28 03:56:25.120381 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2396/4342] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:24 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1408 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:25.135034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c0f27f4-a58f-4b69-841c-ad5ee9a0819d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:25.136633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c0f27f4-a58f-4b69-841c-ad5ee9a0819d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:25.147856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c0f27f4-a58f-4b69-841c-ad5ee9a0819d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:25.148796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c0f27f4-a58f-4b69-841c-ad5ee9a0819d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:25.149800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c0f27f4-a58f-4b69-841c-ad5ee9a0819d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:25.150449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c0f27f4-a58f-4b69-841c-ad5ee9a0819d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:25.259139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c0f27f4-a58f-4b69-841c-ad5ee9a0819d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:56:25.578527 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c0f27f4-a58f-4b69-841c-ad5ee9a0819d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 204 len: 0 microversion: 2.1 time: 0.455312 Jul 28 03:56:25.579254 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2397/4343] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:56:25 2022] DELETE /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:56:25.599236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb94cfcd-5a8b-4750-9b97-2a3551165256 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:25.605196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb94cfcd-5a8b-4750-9b97-2a3551165256 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:25.614224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb94cfcd-5a8b-4750-9b97-2a3551165256 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:25.615155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb94cfcd-5a8b-4750-9b97-2a3551165256 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:25.616343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb94cfcd-5a8b-4750-9b97-2a3551165256 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:25.616975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb94cfcd-5a8b-4750-9b97-2a3551165256 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:25.671712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb94cfcd-5a8b-4750-9b97-2a3551165256 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:56:25.696169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:25.736484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-19027f69-2f74-4591-a2af-095bb95fa478 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:25.745584 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-19027f69-2f74-4591-a2af-095bb95fa478 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.968223 Jul 28 03:56:25.746186 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1947/4344] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:24 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:25.776546 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6aab23c1-572e-46c4-8ff3-92780f96dcfd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:25.777353 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6aab23c1-572e-46c4-8ff3-92780f96dcfd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:25.795876 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6aab23c1-572e-46c4-8ff3-92780f96dcfd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:25.796376 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6aab23c1-572e-46c4-8ff3-92780f96dcfd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:25.797205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6aab23c1-572e-46c4-8ff3-92780f96dcfd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:25.797636 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6aab23c1-572e-46c4-8ff3-92780f96dcfd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:25.874225 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fb94cfcd-5a8b-4750-9b97-2a3551165256 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 204 len: 0 microversion: 2.1 time: 0.285297 Jul 28 03:56:25.876599 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2398/4345] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:56:25 2022] DELETE /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:56:25.884854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-19b94e13-2ebc-458c-b108-2358d01ffc0a req-31b830fb-9236-45c8-98c4-922fc27617b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f", "name": "network-vif-plugged", "status": "completed", "tag": "c8793abb-3b60-44eb-92c4-080c797cc8a3"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:25.905964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-19b94e13-2ebc-458c-b108-2358d01ffc0a req-31b830fb-9236-45c8-98c4-922fc27617b3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:25.909332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-19b94e13-2ebc-458c-b108-2358d01ffc0a req-31b830fb-9236-45c8-98c4-922fc27617b3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:25.939017 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-19b94e13-2ebc-458c-b108-2358d01ffc0a req-31b830fb-9236-45c8-98c4-922fc27617b3 service nova] Creating event network-vif-plugged:c8793abb-3b60-44eb-92c4-080c797cc8a3 for instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f on n-h1-826756-3 Jul 28 03:56:25.952214 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-19b94e13-2ebc-458c-b108-2358d01ffc0a req-31b830fb-9236-45c8-98c4-922fc27617b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072361 Jul 28 03:56:25.952549 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2399/4346] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:25.959940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-757eb0c7-368b-4536-ac63-ab2619818643 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:25.960618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-757eb0c7-368b-4536-ac63-ab2619818643 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 63334852-6f1c-4427-8a04-517e2e036348] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:25.972700 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-757eb0c7-368b-4536-ac63-ab2619818643 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance 63334852-6f1c-4427-8a04-517e2e036348 could not be found. Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-757eb0c7-368b-4536-ac63-ab2619818643 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/63334852-6f1c-4427-8a04-517e2e036348/action HTTP/1.1 Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 13 Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: {"pause": {}} Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 63334852-6f1c-4427-8a04-517e2e036348 could not be found. Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '63334852-6f1c-4427-8a04-517e2e036348', 'body': {'pause': {}}} Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63334852-6f1c-4427-8a04-517e2e036348 could not be found. Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63334852-6f1c-4427-8a04-517e2e036348 could not be found. Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:25.982229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:25.985958 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:25.985958 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:25.985958 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63334852-6f1c-4427-8a04-517e2e036348 could not be found. Jul 28 03:56:25.985958 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:25.985958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-757eb0c7-368b-4536-ac63-ab2619818643 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance 63334852-6f1c-4427-8a04-517e2e036348 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:25.985958 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-757eb0c7-368b-4536-ac63-ab2619818643 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/63334852-6f1c-4427-8a04-517e2e036348/action" status: 404 len: 111 microversion: 2.1 time: 0.030498 Jul 28 03:56:25.985958 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2400/4347] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:25 2022] POST /compute/v2.1/servers/63334852-6f1c-4427-8a04-517e2e036348/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:26.000725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d82069ce-f1bc-4e61-9a03-d90d94b88853 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:26.003440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d82069ce-f1bc-4e61-9a03-d90d94b88853 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:26.044923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d82069ce-f1bc-4e61-9a03-d90d94b88853 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:26.045502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d82069ce-f1bc-4e61-9a03-d90d94b88853 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:26.046444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d82069ce-f1bc-4e61-9a03-d90d94b88853 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:26.049326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d82069ce-f1bc-4e61-9a03-d90d94b88853 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:26.251855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6aab23c1-572e-46c4-8ff3-92780f96dcfd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:26.273078 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6aab23c1-572e-46c4-8ff3-92780f96dcfd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1527 microversion: 2.1 time: 0.503574 Jul 28 03:56:26.276318 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1948/4348] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:25 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1527 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:26.285836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1891f315-cf1a-4803-8d6c-a17f1c69e032 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:26.287572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1891f315-cf1a-4803-8d6c-a17f1c69e032 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:26.299040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1891f315-cf1a-4803-8d6c-a17f1c69e032 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:26.299922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1891f315-cf1a-4803-8d6c-a17f1c69e032 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:26.300166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d82069ce-f1bc-4e61-9a03-d90d94b88853 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:26.305910 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1891f315-cf1a-4803-8d6c-a17f1c69e032 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:26.309441 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d82069ce-f1bc-4e61-9a03-d90d94b88853 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1679 microversion: 2.1 time: 0.322442 Jul 28 03:56:26.310030 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1891f315-cf1a-4803-8d6c-a17f1c69e032 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:26.310808 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2401/4349] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:25 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1679 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:26.653370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf323c28-0dcf-4af6-8b63-c805760a61ef tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Action: 'create', calling method: .version_select at 0x7ffa74229160>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-815715296", "policies": ["affinity"]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:26.710554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-cf323c28-0dcf-4af6-8b63-c805760a61ef tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:26.728126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-cf323c28-0dcf-4af6-8b63-c805760a61ef tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for user dcd7c1f106fe47bab0c75bd81a3689ee and project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:26.851288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-cf323c28-0dcf-4af6-8b63-c805760a61ef tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:26.857132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-cf323c28-0dcf-4af6-8b63-c805760a61ef tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for user dcd7c1f106fe47bab0c75bd81a3689ee and project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:26.974214 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf323c28-0dcf-4af6-8b63-c805760a61ef tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.661914 Jul 28 03:56:26.975257 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2402/4350] 10.222.0.48 () {60 vars in 1174 bytes} [Thu Jul 28 03:56:26 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:26.988030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa826e86-0c35-4724-b26a-16ce39364d76 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:26.988907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fa826e86-0c35-4724-b26a-16ce39364d76 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:27.009435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa826e86-0c35-4724-b26a-16ce39364d76 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:27.010531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa826e86-0c35-4724-b26a-16ce39364d76 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:27.011381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa826e86-0c35-4724-b26a-16ce39364d76 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:27.011840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa826e86-0c35-4724-b26a-16ce39364d76 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:27.184545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1891f315-cf1a-4803-8d6c-a17f1c69e032 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:27.206774 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1891f315-cf1a-4803-8d6c-a17f1c69e032 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.921043 Jul 28 03:56:27.220376 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1949/4351] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:26 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:27.242656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-168834ef-671c-4bd3-be16-4b22eedb7c2a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Action: 'create', calling method: .version_select at 0x7ffa67750310>, body: {"server_group": {"name": "tempest-server-group-1207061705", "policies": ["affinity"]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:27.292266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-168834ef-671c-4bd3-be16-4b22eedb7c2a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:27.300634 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-168834ef-671c-4bd3-be16-4b22eedb7c2a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for user dcd7c1f106fe47bab0c75bd81a3689ee and project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:27.426874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa826e86-0c35-4724-b26a-16ce39364d76 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:27.447876 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-168834ef-671c-4bd3-be16-4b22eedb7c2a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:27.449878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa826e86-0c35-4724-b26a-16ce39364d76 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:27.452559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa826e86-0c35-4724-b26a-16ce39364d76 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:27.454160 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fa826e86-0c35-4724-b26a-16ce39364d76 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1408 microversion: 2.20 time: 0.477874 Jul 28 03:56:27.479005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-168834ef-671c-4bd3-be16-4b22eedb7c2a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for user dcd7c1f106fe47bab0c75bd81a3689ee and project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:27.481656 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2403/4352] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:26 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1408 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:27.501733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5e53eabf-ec4b-4606-9d6c-a37b5f64e7e4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:27.502809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5e53eabf-ec4b-4606-9d6c-a37b5f64e7e4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:27.521895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e53eabf-ec4b-4606-9d6c-a37b5f64e7e4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:27.523582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e53eabf-ec4b-4606-9d6c-a37b5f64e7e4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:27.527123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e53eabf-ec4b-4606-9d6c-a37b5f64e7e4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:27.530035 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-168834ef-671c-4bd3-be16-4b22eedb7c2a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.319031 Jul 28 03:56:27.530909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e53eabf-ec4b-4606-9d6c-a37b5f64e7e4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:27.546906 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1950/4353] 10.222.0.48 () {60 vars in 1173 bytes} [Thu Jul 28 03:56:27 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:27.556002 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-085c409f-4040-489d-9cfc-b3bf8c34391d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:27.565326 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-085c409f-4040-489d-9cfc-b3bf8c34391d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:27.587273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-085c409f-4040-489d-9cfc-b3bf8c34391d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:27.588177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-085c409f-4040-489d-9cfc-b3bf8c34391d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:27.589667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-085c409f-4040-489d-9cfc-b3bf8c34391d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:27.593416 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-085c409f-4040-489d-9cfc-b3bf8c34391d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:27.989298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5e53eabf-ec4b-4606-9d6c-a37b5f64e7e4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:28.020155 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5e53eabf-ec4b-4606-9d6c-a37b5f64e7e4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.515528 Jul 28 03:56:28.042040 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2404/4354] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:27 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:28.042040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f181653e-b711-4809-bd1a-1fadf92a2374 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:28.042040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f181653e-b711-4809-bd1a-1fadf92a2374 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:28.066995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f181653e-b711-4809-bd1a-1fadf92a2374 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:28.078889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f181653e-b711-4809-bd1a-1fadf92a2374 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:28.081461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f181653e-b711-4809-bd1a-1fadf92a2374 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:28.083692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f181653e-b711-4809-bd1a-1fadf92a2374 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:28.224173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-085c409f-4040-489d-9cfc-b3bf8c34391d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:28.236903 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-085c409f-4040-489d-9cfc-b3bf8c34391d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1485 microversion: 2.1 time: 0.688199 Jul 28 03:56:28.237859 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1951/4355] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:27 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1485 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:28.244530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8b1d5aa2-f893-4a4b-97d0-18d718f63184 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Action: 'create', calling method: .version_select at 0x7ffa7408fee0>, body: {"server_group": {"name": "tempest-server-group-1207061705", "policies": ["affinity"]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:28.266985 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-8b1d5aa2-f893-4a4b-97d0-18d718f63184 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:28.285693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-8b1d5aa2-f893-4a4b-97d0-18d718f63184 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for user dcd7c1f106fe47bab0c75bd81a3689ee and project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:28.355066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-8b1d5aa2-f893-4a4b-97d0-18d718f63184 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:28.364323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-8b1d5aa2-f893-4a4b-97d0-18d718f63184 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for user dcd7c1f106fe47bab0c75bd81a3689ee and project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:28.401961 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8b1d5aa2-f893-4a4b-97d0-18d718f63184 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.162739 Jul 28 03:56:28.402822 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1952/4356] 10.222.0.48 () {60 vars in 1173 bytes} [Thu Jul 28 03:56:28 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:28.410073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a36c5ce5-96af-4161-bfc2-5d0379c219e1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:28.411710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a36c5ce5-96af-4161-bfc2-5d0379c219e1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:28.420775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a36c5ce5-96af-4161-bfc2-5d0379c219e1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:28.421548 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a36c5ce5-96af-4161-bfc2-5d0379c219e1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:28.422558 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a36c5ce5-96af-4161-bfc2-5d0379c219e1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:28.423170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a36c5ce5-96af-4161-bfc2-5d0379c219e1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:28.429632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:28.559310 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a36c5ce5-96af-4161-bfc2-5d0379c219e1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action" status: 202 len: 0 microversion: 2.1 time: 0.154684 Jul 28 03:56:28.561606 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1953/4357] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:28 2022] POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:56:28.571881 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d301d0e2-220b-491f-a0a4-cb4587e06ade tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:28.620196 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d301d0e2-220b-491f-a0a4-cb4587e06ade tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/1d33ee28-784c-41e8-b806-be23a20d3a7e" status: 204 len: 0 microversion: 2.1 time: 0.055916 Jul 28 03:56:28.621473 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1954/4358] 10.222.0.48 () {58 vars in 1266 bytes} [Thu Jul 28 03:56:28 2022] DELETE /compute/v2.1/os-server-groups/1d33ee28-784c-41e8-b806-be23a20d3a7e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:56:28.637681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d5b4a9ba-89e6-4621-9e79-e65d3da2c775 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:28.638453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d5b4a9ba-89e6-4621-9e79-e65d3da2c775 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:28.650341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d5b4a9ba-89e6-4621-9e79-e65d3da2c775 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:28.650341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d5b4a9ba-89e6-4621-9e79-e65d3da2c775 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:28.650718 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d5b4a9ba-89e6-4621-9e79-e65d3da2c775 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:28.651174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d5b4a9ba-89e6-4621-9e79-e65d3da2c775 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:28.823581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f181653e-b711-4809-bd1a-1fadf92a2374 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:28.842775 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f181653e-b711-4809-bd1a-1fadf92a2374 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1679 microversion: 2.1 time: 0.813719 Jul 28 03:56:28.844090 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2405/4359] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:28 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1679 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:28.851692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2b909da1-80a9-4fc2-ab3c-2ad539339f84 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:28.854896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2b909da1-80a9-4fc2-ab3c-2ad539339f84 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:28.866272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b909da1-80a9-4fc2-ab3c-2ad539339f84 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:28.868886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b909da1-80a9-4fc2-ab3c-2ad539339f84 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:28.871346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b909da1-80a9-4fc2-ab3c-2ad539339f84 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:28.878532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b909da1-80a9-4fc2-ab3c-2ad539339f84 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:29.161498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d5b4a9ba-89e6-4621-9e79-e65d3da2c775 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:29.173798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d5b4a9ba-89e6-4621-9e79-e65d3da2c775 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:29.183200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d5b4a9ba-89e6-4621-9e79-e65d3da2c775 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:29.187952 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d5b4a9ba-89e6-4621-9e79-e65d3da2c775 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1408 microversion: 2.20 time: 0.565150 Jul 28 03:56:29.189072 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1955/4360] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:28 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1408 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:29.206586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-757992b4-40ac-4a96-82a5-e4099e359c9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:29.265436 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-757992b4-40ac-4a96-82a5-e4099e359c9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.067293 Jul 28 03:56:29.272277 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1956/4361] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:56:29 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:29.280653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2b909da1-80a9-4fc2-ab3c-2ad539339f84 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:29.289777 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2b909da1-80a9-4fc2-ab3c-2ad539339f84 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1510 microversion: 2.1 time: 0.442557 Jul 28 03:56:29.294578 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-d8f7126a-69a0-458d-b0c2-5311d0e9cf22 req-7ea297ce-23e4-426e-b641-acc046368745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f", "name": "network-vif-deleted", "tag": "c8793abb-3b60-44eb-92c4-080c797cc8a3"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:29.304111 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2406/4362] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:28 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1510 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:29.309861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-175771cb-01f2-4276-98aa-ed9b503d532c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:29.310490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-175771cb-01f2-4276-98aa-ed9b503d532c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:29.322767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-175771cb-01f2-4276-98aa-ed9b503d532c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:29.323073 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-d8f7126a-69a0-458d-b0c2-5311d0e9cf22 req-7ea297ce-23e4-426e-b641-acc046368745 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:29.323628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-d8f7126a-69a0-458d-b0c2-5311d0e9cf22 req-7ea297ce-23e4-426e-b641-acc046368745 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:29.327654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-175771cb-01f2-4276-98aa-ed9b503d532c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:29.335703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-175771cb-01f2-4276-98aa-ed9b503d532c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:29.336638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-175771cb-01f2-4276-98aa-ed9b503d532c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:29.344049 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-d8f7126a-69a0-458d-b0c2-5311d0e9cf22 req-7ea297ce-23e4-426e-b641-acc046368745 service nova] Creating event network-vif-deleted:c8793abb-3b60-44eb-92c4-080c797cc8a3 for instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f on n-h1-826756-3 Jul 28 03:56:29.356814 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-d8f7126a-69a0-458d-b0c2-5311d0e9cf22 req-7ea297ce-23e4-426e-b641-acc046368745 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065952 Jul 28 03:56:29.357615 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1957/4363] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:29.367486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d4c7b6cf-44f8-4ea6-9a9b-9e821fb57dce tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:29.412743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-175771cb-01f2-4276-98aa-ed9b503d532c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:29.413471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-175771cb-01f2-4276-98aa-ed9b503d532c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:29.414091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-175771cb-01f2-4276-98aa-ed9b503d532c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lazy-loading 'fault' on Instance uuid 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:56:29.432794 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d4c7b6cf-44f8-4ea6-9a9b-9e821fb57dce tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/c7d44285-3077-410d-88a3-d6734a2f827b" status: 204 len: 0 microversion: 2.1 time: 0.070133 Jul 28 03:56:29.433913 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1958/4364] 10.222.0.48 () {58 vars in 1266 bytes} [Thu Jul 28 03:56:29 2022] DELETE /compute/v2.1/os-server-groups/c7d44285-3077-410d-88a3-d6734a2f827b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:56:29.442417 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8f2bac02-32c8-4d88-9230-b0bb496bb896 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:29.460637 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8f2bac02-32c8-4d88-9230-b0bb496bb896 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.022101 Jul 28 03:56:29.474725 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1959/4365] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:56:29 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:56:29.493539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8fbec73a-f98c-4b14-a07a-a208672acc48 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Action: 'create', calling method: .version_select at 0x7ffa741ab550>, body: {"server_group": {"name": "tempest-server-group-646549220", "policies": ["affinity"]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:29.542730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-8fbec73a-f98c-4b14-a07a-a208672acc48 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:29.546027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:29.562518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-8fbec73a-f98c-4b14-a07a-a208672acc48 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for user dcd7c1f106fe47bab0c75bd81a3689ee and project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:29.571090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-175771cb-01f2-4276-98aa-ed9b503d532c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:29.591925 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-175771cb-01f2-4276-98aa-ed9b503d532c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 200 len: 1314 microversion: 2.1 time: 0.286136 Jul 28 03:56:29.593624 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2407/4366] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:29 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:29.645596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-8fbec73a-f98c-4b14-a07a-a208672acc48 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:29.652595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-8fbec73a-f98c-4b14-a07a-a208672acc48 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for user dcd7c1f106fe47bab0c75bd81a3689ee and project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:29.670127 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8fbec73a-f98c-4b14-a07a-a208672acc48 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.185844 Jul 28 03:56:29.676447 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1960/4367] 10.222.0.48 () {60 vars in 1173 bytes} [Thu Jul 28 03:56:29 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:29.684734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-995e4475-024b-43b1-b731-762d4e13b9f6 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:29.689637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:29.733690 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-995e4475-024b-43b1-b731-762d4e13b9f6 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/bd3a9dae-91a9-4688-943c-2c2c31764d3d" status: 204 len: 0 microversion: 2.1 time: 0.055241 Jul 28 03:56:29.736529 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2408/4368] 10.222.0.48 () {58 vars in 1266 bytes} [Thu Jul 28 03:56:29 2022] DELETE /compute/v2.1/os-server-groups/bd3a9dae-91a9-4688-943c-2c2c31764d3d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:56:29.747959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-653df948-e904-4f35-b685-d6f4e1773459 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:29.777120 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-653df948-e904-4f35-b685-d6f4e1773459 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.037314 Jul 28 03:56:29.778150 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1961/4369] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:56:29 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:29.795048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca3395fe-7c54-4fd7-b474-b0c95eb20b97 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Action: 'create', calling method: .version_select at 0x7ffa6798d670>, body: {"server_group": {"name": "tempest-server-group-1991853983", "policies": ["anti-affinity"]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:29.865693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ca3395fe-7c54-4fd7-b474-b0c95eb20b97 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:29.868657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-30a78167-06fa-42b6-8a8b-afd81ac1654e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:29.869786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-30a78167-06fa-42b6-8a8b-afd81ac1654e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:29.878425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-30a78167-06fa-42b6-8a8b-afd81ac1654e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:29.878989 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-30a78167-06fa-42b6-8a8b-afd81ac1654e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:29.880072 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-30a78167-06fa-42b6-8a8b-afd81ac1654e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:29.880976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-30a78167-06fa-42b6-8a8b-afd81ac1654e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:29.882762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ca3395fe-7c54-4fd7-b474-b0c95eb20b97 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for user dcd7c1f106fe47bab0c75bd81a3689ee and project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:29.988602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ca3395fe-7c54-4fd7-b474-b0c95eb20b97 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:29.993080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-30a78167-06fa-42b6-8a8b-afd81ac1654e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:30.007023 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-30a78167-06fa-42b6-8a8b-afd81ac1654e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1611 microversion: 2.1 time: 0.143945 Jul 28 03:56:30.021757 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1962/4370] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:29 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1611 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:30.023732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ca3395fe-7c54-4fd7-b474-b0c95eb20b97 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for user dcd7c1f106fe47bab0c75bd81a3689ee and project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_groups'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:30.066177 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca3395fe-7c54-4fd7-b474-b0c95eb20b97 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.268174 Jul 28 03:56:30.066884 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2409/4371] 10.222.0.48 () {60 vars in 1173 bytes} [Thu Jul 28 03:56:29 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:30.077650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5716d99f-f0b1-4dcd-86cb-e5a285f34502 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:30.125263 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5716d99f-f0b1-4dcd-86cb-e5a285f34502 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/a392ba2e-6f96-47ac-9e79-5a08090e5252" status: 204 len: 0 microversion: 2.1 time: 0.051020 Jul 28 03:56:30.127246 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1963/4372] 10.222.0.48 () {58 vars in 1266 bytes} [Thu Jul 28 03:56:30 2022] DELETE /compute/v2.1/os-server-groups/a392ba2e-6f96-47ac-9e79-5a08090e5252 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:56:30.135384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74e734d9-1fca-43b5-ac55-d7fefc42c5a0 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:30.162194 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74e734d9-1fca-43b5-ac55-d7fefc42c5a0 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.030501 Jul 28 03:56:30.166395 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2410/4373] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:56:30 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:30.213852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-acaabed2-734e-4aad-b4d2-b6488886f0ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:30.214732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-acaabed2-734e-4aad-b4d2-b6488886f0ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:30.227520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acaabed2-734e-4aad-b4d2-b6488886f0ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:30.229105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acaabed2-734e-4aad-b4d2-b6488886f0ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:30.230191 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acaabed2-734e-4aad-b4d2-b6488886f0ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:30.231058 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acaabed2-734e-4aad-b4d2-b6488886f0ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:30.321296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bed0d0d7-7c00-428c-963c-16ba3e1acea0 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:30.321907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bed0d0d7-7c00-428c-963c-16ba3e1acea0 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:30.344001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bed0d0d7-7c00-428c-963c-16ba3e1acea0 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:30.345023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bed0d0d7-7c00-428c-963c-16ba3e1acea0 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:30.345845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bed0d0d7-7c00-428c-963c-16ba3e1acea0 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:30.346286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bed0d0d7-7c00-428c-963c-16ba3e1acea0 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:30.581795 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-acaabed2-734e-4aad-b4d2-b6488886f0ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:30.599466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-acaabed2-734e-4aad-b4d2-b6488886f0ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:30.609894 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-acaabed2-734e-4aad-b4d2-b6488886f0ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:30.618155 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-acaabed2-734e-4aad-b4d2-b6488886f0ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1408 microversion: 2.20 time: 0.410251 Jul 28 03:56:30.632381 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1964/4374] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:30 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1408 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:30.633540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1011556223", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "ef9b1f4b-5024-423d-981c-8d5e466ac486"}]}, "os:scheduler_hints": {"group": "cce60740-8ec7-40ca-952f-2e87457f2118"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:30.741314 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] validate_networks() for [('ef9b1f4b-5024-423d-981c-8d5e466ac486', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:56:31.254534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bed0d0d7-7c00-428c-963c-16ba3e1acea0 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:31.284539 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bed0d0d7-7c00-428c-963c-16ba3e1acea0 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1490 microversion: 2.1 time: 0.971435 Jul 28 03:56:31.290750 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2411/4375] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:30 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1490 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:31.307644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-633a5978-70c6-4c83-b505-eb852fd7585a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:31.309091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-633a5978-70c6-4c83-b505-eb852fd7585a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:31.329871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-633a5978-70c6-4c83-b505-eb852fd7585a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:31.335366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-633a5978-70c6-4c83-b505-eb852fd7585a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:31.337263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-633a5978-70c6-4c83-b505-eb852fd7585a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:31.337993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-633a5978-70c6-4c83-b505-eb852fd7585a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:31.379379 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-633a5978-70c6-4c83-b505-eb852fd7585a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] HTTP exception thrown: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-633a5978-70c6-4c83-b505-eb852fd7585a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Request method failure captured: Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f HTTP/1.1 Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjBY0mYKCXtj0_d2uaizZHT_bTm8g67l0hNznQ_KVINZT1siV-lKxZREHB__mQh0Osf7Cog-lCJIGpJJ_mIo_1i4LQ-Uw87qYT7Q9LIdNSOqrDCo-x87gq81TQtloPebhhpc4TesbUzk376RJomPlfVbclxoCv7QtBWHpejAHdY1so Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}] Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 5265a6963e6e46c8bc7657bcf081362a Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f'} Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:31.381036 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:31.385312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:31.385312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:31.385312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:31.385312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:31.385312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:31.385312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:31.385312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:56:31.385312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:31.385312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-633a5978-70c6-4c83-b505-eb852fd7585a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Returning 404 to user: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:31.385312 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-633a5978-70c6-4c83-b505-eb852fd7585a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 404 len: 111 microversion: 2.1 time: 0.090030 Jul 28 03:56:31.391035 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2412/4376] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:31 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:31.403916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-64877102-c8fb-416c-9ca6-d7be3f6139d2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:31.404587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-64877102-c8fb-416c-9ca6-d7be3f6139d2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:31.423837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64877102-c8fb-416c-9ca6-d7be3f6139d2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:31.424295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64877102-c8fb-416c-9ca6-d7be3f6139d2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:31.428275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64877102-c8fb-416c-9ca6-d7be3f6139d2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:31.429419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64877102-c8fb-416c-9ca6-d7be3f6139d2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:31.549356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64877102-c8fb-416c-9ca6-d7be3f6139d2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:31.553306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64877102-c8fb-416c-9ca6-d7be3f6139d2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:31.555759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-64877102-c8fb-416c-9ca6-d7be3f6139d2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lazy-loading 'fault' on Instance uuid 0a04170d-7c69-4efa-8141-d243feb5c41b {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:56:31.572907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:56:31.573002 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:56:31.573472 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:56:31.573882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:56:31.574293 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:56:31.613914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:31.615140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:31.616100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:31.616809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:31.662873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:31.675230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for user dcd7c1f106fe47bab0c75bd81a3689ee and project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:31.695295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-64877102-c8fb-416c-9ca6-d7be3f6139d2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20381abd9784627887af3cb97cd68a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '781ab005138547038def64d108937e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:31.706291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:56:31.708512 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-64877102-c8fb-416c-9ca6-d7be3f6139d2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 200 len: 1331 microversion: 2.1 time: 0.315919 Jul 28 03:56:31.708728 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:56:31.709132 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2413/4377] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:31 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 1331 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:31.725973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f9de93ca-722b-40e2-86cd-94a3d30d83db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:31.728452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f9de93ca-722b-40e2-86cd-94a3d30d83db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:31.755917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9de93ca-722b-40e2-86cd-94a3d30d83db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:31.757116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9de93ca-722b-40e2-86cd-94a3d30d83db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:31.758675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9de93ca-722b-40e2-86cd-94a3d30d83db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:31.759640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9de93ca-722b-40e2-86cd-94a3d30d83db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:31.838375 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-f9de93ca-722b-40e2-86cd-94a3d30d83db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Cannot 'pause' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state paused Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f9de93ca-722b-40e2-86cd-94a3d30d83db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action HTTP/1.1 Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 13 Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: {"pause": {}} Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: exception: Cannot 'pause' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state paused Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1d97b518-6a6e-44f8-9be3-940b6fa8c853', 'body': {'pause': {}}} Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 in vm_state paused. Cannot pause while the instance is in this state. Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state paused Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:31.843323 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:31.848541 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:31.848541 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:31.848541 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:31.848541 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state paused Jul 28 03:56:31.848541 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:31.855407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f9de93ca-722b-40e2-86cd-94a3d30d83db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 409 to user: Cannot 'pause' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state paused {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:31.859075 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f9de93ca-722b-40e2-86cd-94a3d30d83db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action" status: 409 len: 143 microversion: 2.1 time: 0.147281 Jul 28 03:56:31.861342 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2414/4378] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:31 2022] POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action => generated 143 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:56:31.868302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1330d2cc-546d-488f-acae-ad607aca966e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Action: 'create', calling method: .version_select at 0x7ffa799f01f0>, body: {"keypair": {"name": "tempest-keypair-1899350001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsGlVyXft9vo9M40WHZZUck3jCDFo1h5VH1ScQsYLjiAtVyYW51o9zXkHgy0bHFcryqDL/XWdojJlVTs+86WLRTUhetlnogpnlmf5AOmQOuNlQO581Fp9Scomi8EqEioQ=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:31.871027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=126072) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 28 03:56:31.921495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1330d2cc-546d-488f-acae-ad607aca966e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Getting quotas for project 48efc7f6c8c94d428bc418846baeab4f. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:31.923725 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_group_members'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:31.934569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for user dcd7c1f106fe47bab0c75bd81a3689ee and project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_group_members'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:31.936787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1330d2cc-546d-488f-acae-ad607aca966e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Getting quotas for user 5265a6963e6e46c8bc7657bcf081362a and project 48efc7f6c8c94d428bc418846baeab4f. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:31.996336 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1330d2cc-546d-488f-acae-ad607aca966e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133573 Jul 28 03:56:31.997407 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2415/4379] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 03:56:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:32.007986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d5fe8202-5203-474c-b8d6-8c2bf225313d req-34695c21-a315-47e8-bd0c-49a5abdcecd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a04170d-7c69-4efa-8141-d243feb5c41b", "name": "network-vif-deleted", "tag": "86249602-9c2e-448f-acf5-aca733cedbd0"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:32.039562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d5fe8202-5203-474c-b8d6-8c2bf225313d req-34695c21-a315-47e8-bd0c-49a5abdcecd9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:32.041341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d5fe8202-5203-474c-b8d6-8c2bf225313d req-34695c21-a315-47e8-bd0c-49a5abdcecd9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:32.050547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_group_members'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:32.096538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Getting quotas for user dcd7c1f106fe47bab0c75bd81a3689ee and project 51fdacaa518c4e69a3af11d7e92dec1e. Resources: {'server_group_members'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:32.101542 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-d5fe8202-5203-474c-b8d6-8c2bf225313d req-34695c21-a315-47e8-bd0c-49a5abdcecd9 service nova] Creating event network-vif-deleted:86249602-9c2e-448f-acf5-aca733cedbd0 for instance 0a04170d-7c69-4efa-8141-d243feb5c41b on n-h2-826756-3 Jul 28 03:56:32.113004 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d5fe8202-5203-474c-b8d6-8c2bf225313d req-34695c21-a315-47e8-bd0c-49a5abdcecd9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113996 Jul 28 03:56:32.116401 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2416/4380] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:32.131383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-be87cdff-8532-4fca-af04-05cb3c25f681 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:32.137316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-be87cdff-8532-4fca-af04-05cb3c25f681 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:32.153675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be87cdff-8532-4fca-af04-05cb3c25f681 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:32.154235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be87cdff-8532-4fca-af04-05cb3c25f681 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:32.155136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be87cdff-8532-4fca-af04-05cb3c25f681 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:32.156837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be87cdff-8532-4fca-af04-05cb3c25f681 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:32.161078 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c8a168eb-5637-4a4e-871d-8e25d5293a9f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.538930 Jul 28 03:56:32.168606 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1965/4381] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:56:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:56:32.177310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ff5a5b4d-00a2-403e-9fb0-3127207e0d91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:32.178406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ff5a5b4d-00a2-403e-9fb0-3127207e0d91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:32.186253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff5a5b4d-00a2-403e-9fb0-3127207e0d91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:32.188115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff5a5b4d-00a2-403e-9fb0-3127207e0d91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:32.190025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff5a5b4d-00a2-403e-9fb0-3127207e0d91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:32.190629 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ff5a5b4d-00a2-403e-9fb0-3127207e0d91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:32.318107 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ff5a5b4d-00a2-403e-9fb0-3127207e0d91 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action" status: 202 len: 0 microversion: 2.1 time: 0.145691 Jul 28 03:56:32.319671 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1966/4382] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:32 2022] POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:56:32.326220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d7a976fe-fb57-4ad1-9cf5-c14f36d871b1 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:32.327494 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d7a976fe-fb57-4ad1-9cf5-c14f36d871b1 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:32.565227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d7a976fe-fb57-4ad1-9cf5-c14f36d871b1 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:32.585474 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d7a976fe-fb57-4ad1-9cf5-c14f36d871b1 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1213 microversion: 2.1 time: 0.264154 Jul 28 03:56:32.586290 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1967/4383] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:32 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1213 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:32.621363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-16878083-0bf1-4871-a557-e0cf9e9fd6be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:32.622178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-16878083-0bf1-4871-a557-e0cf9e9fd6be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:32.637784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16878083-0bf1-4871-a557-e0cf9e9fd6be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:32.638635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16878083-0bf1-4871-a557-e0cf9e9fd6be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:32.639013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16878083-0bf1-4871-a557-e0cf9e9fd6be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:32.639449 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-16878083-0bf1-4871-a557-e0cf9e9fd6be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:33.098208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be87cdff-8532-4fca-af04-05cb3c25f681 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:33.117075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be87cdff-8532-4fca-af04-05cb3c25f681 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:33.126208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be87cdff-8532-4fca-af04-05cb3c25f681 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:33.128959 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-be87cdff-8532-4fca-af04-05cb3c25f681 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1408 microversion: 2.20 time: 1.009963 Jul 28 03:56:33.134081 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2417/4384] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:32 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1408 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:33.151876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-961db8b6-c2bf-45e2-8a02-c049f7851262 req-b35564a8-2139-4be1-903b-e55226bf8f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8", "name": "network-vif-plugged", "status": "completed", "tag": "565bb390-f25a-4510-b22a-3975e600ba96"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:33.182334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-16878083-0bf1-4871-a557-e0cf9e9fd6be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:33.196829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-961db8b6-c2bf-45e2-8a02-c049f7851262 req-b35564a8-2139-4be1-903b-e55226bf8f9c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:33.197128 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-16878083-0bf1-4871-a557-e0cf9e9fd6be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1497 microversion: 2.1 time: 0.609964 Jul 28 03:56:33.197734 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1968/4385] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:32 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1497 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:33.198113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-961db8b6-c2bf-45e2-8a02-c049f7851262 req-b35564a8-2139-4be1-903b-e55226bf8f9c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:33.228222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-569813e3-7067-419c-8b4d-ec127b06cf2b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:33.232758 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-961db8b6-c2bf-45e2-8a02-c049f7851262 req-b35564a8-2139-4be1-903b-e55226bf8f9c service nova] Creating event network-vif-plugged:565bb390-f25a-4510-b22a-3975e600ba96 for instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 on n-h2-826756-3 Jul 28 03:56:33.247330 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-569813e3-7067-419c-8b4d-ec127b06cf2b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:33.252443 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-961db8b6-c2bf-45e2-8a02-c049f7851262 req-b35564a8-2139-4be1-903b-e55226bf8f9c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111245 Jul 28 03:56:33.255208 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2418/4386] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:33.258928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-569813e3-7067-419c-8b4d-ec127b06cf2b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:33.259390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-569813e3-7067-419c-8b4d-ec127b06cf2b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:33.260193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-569813e3-7067-419c-8b4d-ec127b06cf2b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:33.260667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-569813e3-7067-419c-8b4d-ec127b06cf2b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:33.339747 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-569813e3-7067-419c-8b4d-ec127b06cf2b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] HTTP exception thrown: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-569813e3-7067-419c-8b4d-ec127b06cf2b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Request method failure captured: Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b HTTP/1.1 Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gca3wwj6vf3mcE1k3p04a-IB_aHJ4q2aQgyaMGEamuHOXYtT8sTCQ39msigigoKDkTgI0q27esncQkdsISfIdor8uYi2ofpy2xxPUYcBX6T1jxeXp0Wz1yCRt_oOue5jQOpZsPCIWzJpvRA8Ld9LSF337wCVS7VtPTruWEjBErR8iQ Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781ab005138547038def64d108937e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781ab005138547038def64d108937e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}] Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: d20381abd9784627887af3cb97cd68a8 Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '0a04170d-7c69-4efa-8141-d243feb5c41b'} Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:33.354235 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:33.358491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:33.358491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:33.358491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:33.358491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:33.358491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:33.358491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:33.358491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:33.358491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-569813e3-7067-419c-8b4d-ec127b06cf2b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Returning 404 to user: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:33.358491 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-569813e3-7067-419c-8b4d-ec127b06cf2b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 404 len: 111 microversion: 2.1 time: 0.146197 Jul 28 03:56:33.363524 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1969/4387] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:33 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:33.371439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-349e4a53-d5eb-41ef-8075-fea82ae049d9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '.version_select at 0x7ffa74110ca0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:33.434295 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-349e4a53-d5eb-41ef-8075-fea82ae049d9 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105898308" status: 202 len: 0 microversion: 2.1 time: 0.069668 Jul 28 03:56:33.434946 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2419/4388] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 03:56:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2105898308 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:56:33.606842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8b958382-dbcd-4bf2-9339-fa047120520c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:33.607466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8b958382-dbcd-4bf2-9339-fa047120520c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:33.637112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b958382-dbcd-4bf2-9339-fa047120520c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:33.638556 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b958382-dbcd-4bf2-9339-fa047120520c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:33.639578 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b958382-dbcd-4bf2-9339-fa047120520c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:33.640204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b958382-dbcd-4bf2-9339-fa047120520c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:33.859444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8b958382-dbcd-4bf2-9339-fa047120520c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:33.886628 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8b958382-dbcd-4bf2-9339-fa047120520c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1217 microversion: 2.1 time: 0.280933 Jul 28 03:56:33.887763 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1970/4389] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:33 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1217 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:34.159114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b0b9cd4f-17f0-4758-b28d-2b49b98148c4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:34.160250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b0b9cd4f-17f0-4758-b28d-2b49b98148c4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:34.177139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0b9cd4f-17f0-4758-b28d-2b49b98148c4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:34.178090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0b9cd4f-17f0-4758-b28d-2b49b98148c4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:34.178909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0b9cd4f-17f0-4758-b28d-2b49b98148c4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:34.179353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0b9cd4f-17f0-4758-b28d-2b49b98148c4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:34.224916 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-83eaea99-595d-4ace-8bd8-5076612d999b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:34.225692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-83eaea99-595d-4ace-8bd8-5076612d999b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:34.240215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83eaea99-595d-4ace-8bd8-5076612d999b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:34.243003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83eaea99-595d-4ace-8bd8-5076612d999b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:34.245795 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83eaea99-595d-4ace-8bd8-5076612d999b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:34.248440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83eaea99-595d-4ace-8bd8-5076612d999b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:35.071657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b0b9cd4f-17f0-4758-b28d-2b49b98148c4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:35.083738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b0b9cd4f-17f0-4758-b28d-2b49b98148c4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:35.085612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b0b9cd4f-17f0-4758-b28d-2b49b98148c4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:35.087037 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b0b9cd4f-17f0-4758-b28d-2b49b98148c4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1408 microversion: 2.20 time: 0.935183 Jul 28 03:56:35.088154 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2420/4390] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:34 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1408 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:35.095958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a91ed0dc-c7c3-4adb-9e9d-bc1144c9652c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:35.096907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a91ed0dc-c7c3-4adb-9e9d-bc1144c9652c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:35.103439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a91ed0dc-c7c3-4adb-9e9d-bc1144c9652c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:35.104227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a91ed0dc-c7c3-4adb-9e9d-bc1144c9652c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:35.105224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a91ed0dc-c7c3-4adb-9e9d-bc1144c9652c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:35.105830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a91ed0dc-c7c3-4adb-9e9d-bc1144c9652c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:35.225432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a91ed0dc-c7c3-4adb-9e9d-bc1144c9652c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:35.234488 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a91ed0dc-c7c3-4adb-9e9d-bc1144c9652c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1271 microversion: 2.1 time: 0.144068 Jul 28 03:56:35.235206 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2421/4391] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:35 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:35.419891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-83eaea99-595d-4ace-8bd8-5076612d999b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:35.430426 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-83eaea99-595d-4ace-8bd8-5076612d999b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 1.213494 Jul 28 03:56:35.447082 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1971/4392] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:34 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:35.459261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3c41574-9a19-4a02-a683-ef7d67e091e2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:35.459875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d3c41574-9a19-4a02-a683-ef7d67e091e2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:35.467525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3c41574-9a19-4a02-a683-ef7d67e091e2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:35.469710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3c41574-9a19-4a02-a683-ef7d67e091e2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:35.469710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3c41574-9a19-4a02-a683-ef7d67e091e2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:35.469710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3c41574-9a19-4a02-a683-ef7d67e091e2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:35.689798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d3c41574-9a19-4a02-a683-ef7d67e091e2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:35.702186 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d3c41574-9a19-4a02-a683-ef7d67e091e2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.247866 Jul 28 03:56:35.703424 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2422/4393] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:35 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:35.737447 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-23218556-1e5b-4016-8e00-27865fee79fd tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:35.739941 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-23218556-1e5b-4016-8e00-27865fee79fd tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:35.760919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23218556-1e5b-4016-8e00-27865fee79fd tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:35.762757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23218556-1e5b-4016-8e00-27865fee79fd tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:35.764964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23218556-1e5b-4016-8e00-27865fee79fd tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:35.765875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-23218556-1e5b-4016-8e00-27865fee79fd tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:35.790399 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-23218556-1e5b-4016-8e00-27865fee79fd tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-23218556-1e5b-4016-8e00-27865fee79fd tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd/action HTTP/1.1 Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 28 Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: {"reboot": {"type": "SOFT"}} Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'd4b66483-933e-4f43-ae0a-51f310b354bd', 'body': {'reboot': {'type': 'SOFT'}}} Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:35.792019 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:35.796439 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:56:35.796439 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:35.796439 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:35.796439 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:35.796439 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:35.796439 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:35.796439 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:35.796439 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:35.796439 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:35.796439 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:56:35.796439 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:35.808889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-23218556-1e5b-4016-8e00-27865fee79fd tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:35.809894 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-23218556-1e5b-4016-8e00-27865fee79fd tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd/action" status: 404 len: 111 microversion: 2.1 time: 0.079791 Jul 28 03:56:35.811724 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1972/4394] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:35 2022] POST /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:35.822354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d7c7cd95-9ea2-44fe-8ce0-22a807dd6b11 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:35.823670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d7c7cd95-9ea2-44fe-8ce0-22a807dd6b11 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:35.832448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7c7cd95-9ea2-44fe-8ce0-22a807dd6b11 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:35.833082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7c7cd95-9ea2-44fe-8ce0-22a807dd6b11 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:35.834042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7c7cd95-9ea2-44fe-8ce0-22a807dd6b11 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:35.835177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7c7cd95-9ea2-44fe-8ce0-22a807dd6b11 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:35.865398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:36.117545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1cf07728-862e-4c19-a474-cd1dc47435ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:36.118501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1cf07728-862e-4c19-a474-cd1dc47435ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:36.128513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1cf07728-862e-4c19-a474-cd1dc47435ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:36.128957 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1cf07728-862e-4c19-a474-cd1dc47435ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:36.131114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1cf07728-862e-4c19-a474-cd1dc47435ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:36.134170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1cf07728-862e-4c19-a474-cd1dc47435ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:36.158008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d7c7cd95-9ea2-44fe-8ce0-22a807dd6b11 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:36.175317 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d7c7cd95-9ea2-44fe-8ce0-22a807dd6b11 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.359667 Jul 28 03:56:36.183230 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2423/4395] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:35 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:36.209458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-10ea68ae-8b6f-4b4f-8cda-6dfc4488685d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:36.210717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-10ea68ae-8b6f-4b4f-8cda-6dfc4488685d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:36.228931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10ea68ae-8b6f-4b4f-8cda-6dfc4488685d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:36.238514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10ea68ae-8b6f-4b4f-8cda-6dfc4488685d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:36.239624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10ea68ae-8b6f-4b4f-8cda-6dfc4488685d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:36.240254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10ea68ae-8b6f-4b4f-8cda-6dfc4488685d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:36.645703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-10ea68ae-8b6f-4b4f-8cda-6dfc4488685d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:36.654621 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-10ea68ae-8b6f-4b4f-8cda-6dfc4488685d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.451847 Jul 28 03:56:36.655746 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2424/4396] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:36 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:36.660842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59c4966c-af35-46b7-b71c-333b3f192e0a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:36.661611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59c4966c-af35-46b7-b71c-333b3f192e0a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:36.667836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59c4966c-af35-46b7-b71c-333b3f192e0a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:36.668575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59c4966c-af35-46b7-b71c-333b3f192e0a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:36.669562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59c4966c-af35-46b7-b71c-333b3f192e0a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:36.670159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59c4966c-af35-46b7-b71c-333b3f192e0a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:36.710821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1cf07728-862e-4c19-a474-cd1dc47435ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:36.726504 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1cf07728-862e-4c19-a474-cd1dc47435ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:36.731184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1cf07728-862e-4c19-a474-cd1dc47435ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:36.733078 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1cf07728-862e-4c19-a474-cd1dc47435ef tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1601 microversion: 2.20 time: 0.624367 Jul 28 03:56:36.734032 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1973/4397] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:36 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1601 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:56:36.753793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fab851e1-2bd3-42d2-9d0b-963db1f21fc8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:36.761273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fab851e1-2bd3-42d2-9d0b-963db1f21fc8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 08af31ec-2a40-49bc-b9a2-652e29399b1f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:36.792670 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-fab851e1-2bd3-42d2-9d0b-963db1f21fc8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance 08af31ec-2a40-49bc-b9a2-652e29399b1f could not be found. Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fab851e1-2bd3-42d2-9d0b-963db1f21fc8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/08af31ec-2a40-49bc-b9a2-652e29399b1f/action HTTP/1.1 Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 28 Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: {"reboot": {"type": "SOFT"}} Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 08af31ec-2a40-49bc-b9a2-652e29399b1f could not be found. Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '08af31ec-2a40-49bc-b9a2-652e29399b1f', 'body': {'reboot': {'type': 'SOFT'}}} Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08af31ec-2a40-49bc-b9a2-652e29399b1f could not be found. Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08af31ec-2a40-49bc-b9a2-652e29399b1f could not be found. Jul 28 03:56:36.798597 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:36.802231 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:36.802231 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:36.802231 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:36.802231 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:36.802231 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:36.802231 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:36.802231 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:36.802231 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08af31ec-2a40-49bc-b9a2-652e29399b1f could not be found. Jul 28 03:56:36.802231 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:36.802728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-59c4966c-af35-46b7-b71c-333b3f192e0a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:36.806704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fab851e1-2bd3-42d2-9d0b-963db1f21fc8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance 08af31ec-2a40-49bc-b9a2-652e29399b1f could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:36.806704 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fab851e1-2bd3-42d2-9d0b-963db1f21fc8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/08af31ec-2a40-49bc-b9a2-652e29399b1f/action" status: 404 len: 111 microversion: 2.1 time: 0.063843 Jul 28 03:56:36.806704 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1974/4398] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:36 2022] POST /compute/v2.1/servers/08af31ec-2a40-49bc-b9a2-652e29399b1f/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:36.810816 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59c4966c-af35-46b7-b71c-333b3f192e0a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1271 microversion: 2.1 time: 0.153780 Jul 28 03:56:36.811636 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2425/4399] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:36 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:36.819131 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3397cb39-2e9c-491d-aa94-bea3af1fc4b2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:36.819627 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3397cb39-2e9c-491d-aa94-bea3af1fc4b2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:36.822598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3bf5ff5-ee8c-4522-85e5-d39278a97294 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:36.830346 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:36.832893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3bf5ff5-ee8c-4522-85e5-d39278a97294 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:36.854741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3397cb39-2e9c-491d-aa94-bea3af1fc4b2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:36.856361 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3397cb39-2e9c-491d-aa94-bea3af1fc4b2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:36.859020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3397cb39-2e9c-491d-aa94-bea3af1fc4b2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:36.861809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3397cb39-2e9c-491d-aa94-bea3af1fc4b2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:36.865561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3bf5ff5-ee8c-4522-85e5-d39278a97294 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:36.868049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3bf5ff5-ee8c-4522-85e5-d39278a97294 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:36.873247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3bf5ff5-ee8c-4522-85e5-d39278a97294 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:36.875574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3bf5ff5-ee8c-4522-85e5-d39278a97294 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:37.172324 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3397cb39-2e9c-491d-aa94-bea3af1fc4b2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.364193 Jul 28 03:56:37.173065 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1975/4400] 10.222.0.48 () {60 vars in 1316 bytes} [Thu Jul 28 03:56:36 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8/os-interface => generated 285 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:56:37.488372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3bf5ff5-ee8c-4522-85e5-d39278a97294 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:37.512756 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3bf5ff5-ee8c-4522-85e5-d39278a97294 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.698402 Jul 28 03:56:37.514747 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2426/4401] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:36 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:37.544903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-42849238-f28f-4713-9fd3-3ba431ce5369 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:37.547976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-42849238-f28f-4713-9fd3-3ba431ce5369 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:37.558461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42849238-f28f-4713-9fd3-3ba431ce5369 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:37.558917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42849238-f28f-4713-9fd3-3ba431ce5369 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:37.559703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42849238-f28f-4713-9fd3-3ba431ce5369 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:37.560281 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-42849238-f28f-4713-9fd3-3ba431ce5369 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:37.832317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3a0f198-7999-4bfd-bf21-b05787753b85 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:37.833614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3a0f198-7999-4bfd-bf21-b05787753b85 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:37.848150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a0f198-7999-4bfd-bf21-b05787753b85 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:37.853741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a0f198-7999-4bfd-bf21-b05787753b85 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:37.855273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a0f198-7999-4bfd-bf21-b05787753b85 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:37.856319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a0f198-7999-4bfd-bf21-b05787753b85 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:38.232534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3a0f198-7999-4bfd-bf21-b05787753b85 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:38.247729 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3a0f198-7999-4bfd-bf21-b05787753b85 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1313 microversion: 2.1 time: 0.419665 Jul 28 03:56:38.250914 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2427/4402] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:37 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:38.395604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-42849238-f28f-4713-9fd3-3ba431ce5369 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:38.407440 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-42849238-f28f-4713-9fd3-3ba431ce5369 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.870288 Jul 28 03:56:38.409021 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1976/4403] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:37 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:38.436040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7f242387-0484-4b8d-92e2-83eb49bd0e4b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:38.440081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7f242387-0484-4b8d-92e2-83eb49bd0e4b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:38.457842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f242387-0484-4b8d-92e2-83eb49bd0e4b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:38.458301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f242387-0484-4b8d-92e2-83eb49bd0e4b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:38.459108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f242387-0484-4b8d-92e2-83eb49bd0e4b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:38.461165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f242387-0484-4b8d-92e2-83eb49bd0e4b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:38.492916 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-7f242387-0484-4b8d-92e2-83eb49bd0e4b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7f242387-0484-4b8d-92e2-83eb49bd0e4b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd/action HTTP/1.1 Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 65 Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: {"rebuild": {"imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220"}} Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd4b66483-933e-4f43-ae0a-51f310b354bd', 'body': {'rebuild': {'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220'}}} Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 28 03:56:38.495557 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:56:38.499296 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:38.510907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7f242387-0484-4b8d-92e2-83eb49bd0e4b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:38.511829 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7f242387-0484-4b8d-92e2-83eb49bd0e4b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd/action" status: 404 len: 111 microversion: 2.1 time: 0.081044 Jul 28 03:56:38.512459 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2428/4404] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:38 2022] POST /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd/action => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:38.526123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f9e5e0cb-8d4a-4d4d-923f-1316359aa538 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:38.528270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f9e5e0cb-8d4a-4d4d-923f-1316359aa538 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:38.538911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9e5e0cb-8d4a-4d4d-923f-1316359aa538 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:38.540435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9e5e0cb-8d4a-4d4d-923f-1316359aa538 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:38.542021 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9e5e0cb-8d4a-4d4d-923f-1316359aa538 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:38.543624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9e5e0cb-8d4a-4d4d-923f-1316359aa538 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:38.740961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-403569593", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:38.845493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] validate_networks() for [('2af3b349-fc32-4cc8-84a4-341a88489282', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:56:39.710282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f9e5e0cb-8d4a-4d4d-923f-1316359aa538 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:39.721171 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f9e5e0cb-8d4a-4d4d-923f-1316359aa538 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 1.203166 Jul 28 03:56:39.731356 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1977/4405] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:38 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:39.760121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f548852c-b8a4-4a29-a955-5494c300b7eb tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:39.764642 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f548852c-b8a4-4a29-a955-5494c300b7eb tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:39.793163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f548852c-b8a4-4a29-a955-5494c300b7eb tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:39.798246 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f548852c-b8a4-4a29-a955-5494c300b7eb tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:39.799450 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f548852c-b8a4-4a29-a955-5494c300b7eb tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:39.804921 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f548852c-b8a4-4a29-a955-5494c300b7eb tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:40.660758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f548852c-b8a4-4a29-a955-5494c300b7eb tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:40.691959 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f548852c-b8a4-4a29-a955-5494c300b7eb tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1313 microversion: 2.1 time: 0.959796 Jul 28 03:56:40.704970 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1978/4406] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:39 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1313 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:40.711586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c2514ef9-3d8e-4ace-b91a-c4f2f6eb7fb5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:40.712458 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c2514ef9-3d8e-4ace-b91a-c4f2f6eb7fb5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:40.732791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2514ef9-3d8e-4ace-b91a-c4f2f6eb7fb5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:40.734211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2514ef9-3d8e-4ace-b91a-c4f2f6eb7fb5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:40.736888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2514ef9-3d8e-4ace-b91a-c4f2f6eb7fb5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:40.737341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2514ef9-3d8e-4ace-b91a-c4f2f6eb7fb5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:41.084431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c2514ef9-3d8e-4ace-b91a-c4f2f6eb7fb5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:41.088703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:41.114061 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c2514ef9-3d8e-4ace-b91a-c4f2f6eb7fb5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.414112 Jul 28 03:56:41.115116 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1979/4407] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:40 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:41.137845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4774288c-738a-4c73-a10a-63aac6fe66a2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:41.138693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4774288c-738a-4c73-a10a-63aac6fe66a2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:41.152313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4774288c-738a-4c73-a10a-63aac6fe66a2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:41.153207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4774288c-738a-4c73-a10a-63aac6fe66a2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:41.154270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4774288c-738a-4c73-a10a-63aac6fe66a2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:41.154998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4774288c-738a-4c73-a10a-63aac6fe66a2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:41.174417 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-4774288c-738a-4c73-a10a-63aac6fe66a2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] HTTP exception thrown: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4774288c-738a-4c73-a10a-63aac6fe66a2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Request method failure captured: Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b HTTP/1.1 Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gca3wwj6vf3mcE1k3p04a-IB_aHJ4q2aQgyaMGEamuHOXYtT8sTCQ39msigigoKDkTgI0q27esncQkdsISfIdor8uYi2ofpy2xxPUYcBX6T1jxeXp0Wz1yCRt_oOue5jQOpZsPCIWzJpvRA8Ld9LSF337wCVS7VtPTruWEjBErR8iQ Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781ab005138547038def64d108937e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781ab005138547038def64d108937e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}] Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: d20381abd9784627887af3cb97cd68a8 Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '0a04170d-7c69-4efa-8141-d243feb5c41b'} Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:41.176393 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:41.182309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:41.182309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.182309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:41.182309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.182309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:41.182309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:41.182309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:41.182309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:41.182309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:41.182309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:41.182309 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.186368 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4774288c-738a-4c73-a10a-63aac6fe66a2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Returning 404 to user: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:41.187621 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4774288c-738a-4c73-a10a-63aac6fe66a2 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 404 len: 111 microversion: 2.1 time: 0.056249 Jul 28 03:56:41.189016 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1980/4408] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:56:41 2022] DELETE /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:41.195228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5d7b8445-e08e-4c7c-ab38-5ba81099de21 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:41.199813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5d7b8445-e08e-4c7c-ab38-5ba81099de21 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: b8c56be1-e269-44cd-a14a-d66348d102fd] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:41.209017 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-5d7b8445-e08e-4c7c-ab38-5ba81099de21 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance b8c56be1-e269-44cd-a14a-d66348d102fd could not be found. Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5d7b8445-e08e-4c7c-ab38-5ba81099de21 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/b8c56be1-e269-44cd-a14a-d66348d102fd/action HTTP/1.1 Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 65 Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: {"rebuild": {"imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220"}} Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance b8c56be1-e269-44cd-a14a-d66348d102fd could not be found. Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'b8c56be1-e269-44cd-a14a-d66348d102fd', 'body': {'rebuild': {'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220'}}} Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8c56be1-e269-44cd-a14a-d66348d102fd could not be found. Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 28 03:56:41.214768 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:41.220831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:41.220831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:41.220831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:41.220831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8c56be1-e269-44cd-a14a-d66348d102fd could not be found. Jul 28 03:56:41.220831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.220831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:41.220831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.220831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:41.220831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:41.220831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:41.220831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:41.220831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:41.220831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8c56be1-e269-44cd-a14a-d66348d102fd could not be found. Jul 28 03:56:41.220831 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.227288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5d7b8445-e08e-4c7c-ab38-5ba81099de21 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance b8c56be1-e269-44cd-a14a-d66348d102fd could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:41.228428 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5d7b8445-e08e-4c7c-ab38-5ba81099de21 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/b8c56be1-e269-44cd-a14a-d66348d102fd/action" status: 404 len: 111 microversion: 2.1 time: 0.037955 Jul 28 03:56:41.234207 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1981/4409] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:41 2022] POST /compute/v2.1/servers/b8c56be1-e269-44cd-a14a-d66348d102fd/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:41.241154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-26634826-2eda-441c-bc19-66a185dd0069 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:41.243155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-26634826-2eda-441c-bc19-66a185dd0069 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: 0a04170d-7c69-4efa-8141-d243feb5c41b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:41.263567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26634826-2eda-441c-bc19-66a185dd0069 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:41.265796 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26634826-2eda-441c-bc19-66a185dd0069 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:41.268993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26634826-2eda-441c-bc19-66a185dd0069 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:41.269610 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26634826-2eda-441c-bc19-66a185dd0069 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:41.304267 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-26634826-2eda-441c-bc19-66a185dd0069 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] HTTP exception thrown: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-26634826-2eda-441c-bc19-66a185dd0069 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Request method failure captured: Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b HTTP/1.1 Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gca3wwj6vf3mcE1k3p04a-IB_aHJ4q2aQgyaMGEamuHOXYtT8sTCQ39msigigoKDkTgI0q27esncQkdsISfIdor8uYi2ofpy2xxPUYcBX6T1jxeXp0Wz1yCRt_oOue5jQOpZsPCIWzJpvRA8Ld9LSF337wCVS7VtPTruWEjBErR8iQ Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781ab005138547038def64d108937e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781ab005138547038def64d108937e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}] Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: d20381abd9784627887af3cb97cd68a8 Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '0a04170d-7c69-4efa-8141-d243feb5c41b'} Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:41.310316 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.314806 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:41.314806 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:41.314806 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:41.314806 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:41.314806 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:41.314806 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. Jul 28 03:56:41.314806 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:41.316068 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-26634826-2eda-441c-bc19-66a185dd0069 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Returning 404 to user: Instance 0a04170d-7c69-4efa-8141-d243feb5c41b could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:41.319935 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-26634826-2eda-441c-bc19-66a185dd0069 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b" status: 404 len: 111 microversion: 2.1 time: 0.084237 Jul 28 03:56:41.323417 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1982/4410] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:41 2022] GET /compute/v2.1/servers/0a04170d-7c69-4efa-8141-d243feb5c41b => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:41.333834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8a326e69-18bf-41b5-9b52-843156355267 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:41.335625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8a326e69-18bf-41b5-9b52-843156355267 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:41.353297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a326e69-18bf-41b5-9b52-843156355267 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:41.354027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a326e69-18bf-41b5-9b52-843156355267 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:41.354988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a326e69-18bf-41b5-9b52-843156355267 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:41.360459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a326e69-18bf-41b5-9b52-843156355267 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:41.640541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:41.960154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=20 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:42.134032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8a326e69-18bf-41b5-9b52-843156355267 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:42.146122 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8a326e69-18bf-41b5-9b52-843156355267 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.820863 Jul 28 03:56:42.162436 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1983/4411] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:41 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:42.174619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5008a288-ddf2-47d4-8f89-9bcb75acec6a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:42.176679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5008a288-ddf2-47d4-8f89-9bcb75acec6a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:42.189067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5008a288-ddf2-47d4-8f89-9bcb75acec6a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:42.192276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5008a288-ddf2-47d4-8f89-9bcb75acec6a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:42.194995 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5008a288-ddf2-47d4-8f89-9bcb75acec6a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:42.195677 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5008a288-ddf2-47d4-8f89-9bcb75acec6a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:42.356789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:56:42.357214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:56:42.357905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:56:42.358553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:56:42.359128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:56:42.375593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:42.380809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:42.381930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:42.382979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:42.424345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Getting quotas for project 48efc7f6c8c94d428bc418846baeab4f. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:42.442151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Getting quotas for user 5265a6963e6e46c8bc7657bcf081362a and project 48efc7f6c8c94d428bc418846baeab4f. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:42.474033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:56:42.479625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:56:42.528122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=5 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:42.576367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=40 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:42.589769 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aa7c367b-208a-454f-9229-d69c29252d38 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.853036 Jul 28 03:56:42.597115 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2429/4412] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:56:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 3861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:56:42.603225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-201946ac-d342-49a1-8ba6-ae524427fe4c req-d280e6c7-9ec4-490c-b90c-f419ff61cc20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0880950-7d28-4b67-b1da-2c0a2837a94b", "tag": "b62f3751-6f21-4235-a655-134ef0a4f4fb"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:42.621212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-201946ac-d342-49a1-8ba6-ae524427fe4c req-d280e6c7-9ec4-490c-b90c-f419ff61cc20 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:42.621758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-201946ac-d342-49a1-8ba6-ae524427fe4c req-d280e6c7-9ec4-490c-b90c-f419ff61cc20 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:42.638932 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-201946ac-d342-49a1-8ba6-ae524427fe4c req-d280e6c7-9ec4-490c-b90c-f419ff61cc20 service nova] Creating event network-changed:b62f3751-6f21-4235-a655-134ef0a4f4fb for instance c0880950-7d28-4b67-b1da-2c0a2837a94b on n-h1-826756-3 Jul 28 03:56:42.650280 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-201946ac-d342-49a1-8ba6-ae524427fe4c req-d280e6c7-9ec4-490c-b90c-f419ff61cc20 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051405 Jul 28 03:56:42.652995 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2430/4413] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:42.677367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e91e78f9-d124-42ac-bddf-4ea88bfaef15 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:42.678369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e91e78f9-d124-42ac-bddf-4ea88bfaef15 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:42.685831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e91e78f9-d124-42ac-bddf-4ea88bfaef15 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:42.686510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e91e78f9-d124-42ac-bddf-4ea88bfaef15 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:42.687462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e91e78f9-d124-42ac-bddf-4ea88bfaef15 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:42.688054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e91e78f9-d124-42ac-bddf-4ea88bfaef15 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:43.067311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e91e78f9-d124-42ac-bddf-4ea88bfaef15 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:43.077572 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e91e78f9-d124-42ac-bddf-4ea88bfaef15 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.415035 Jul 28 03:56:43.092680 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2431/4414] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:42 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:43.102679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d4cb12e-9d6d-4939-bde0-876c039f1f7f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:43.112082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6d4cb12e-9d6d-4939-bde0-876c039f1f7f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:43.239322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6d4cb12e-9d6d-4939-bde0-876c039f1f7f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:43.247124 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d4cb12e-9d6d-4939-bde0-876c039f1f7f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1224 microversion: 2.1 time: 0.156824 Jul 28 03:56:43.247914 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2432/4415] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:43 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1224 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:43.260312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-deb9b185-a0bd-47c9-8216-d995cefcd1e6 req-69feb96a-6a24-43e6-bd74-c818e6190c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8", "tag": "565bb390-f25a-4510-b22a-3975e600ba96"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:43.300306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-deb9b185-a0bd-47c9-8216-d995cefcd1e6 req-69feb96a-6a24-43e6-bd74-c818e6190c2e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:43.300831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-deb9b185-a0bd-47c9-8216-d995cefcd1e6 req-69feb96a-6a24-43e6-bd74-c818e6190c2e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:43.334662 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-deb9b185-a0bd-47c9-8216-d995cefcd1e6 req-69feb96a-6a24-43e6-bd74-c818e6190c2e service nova] Creating event network-changed:565bb390-f25a-4510-b22a-3975e600ba96 for instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 on n-h2-826756-3 Jul 28 03:56:43.355214 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-deb9b185-a0bd-47c9-8216-d995cefcd1e6 req-69feb96a-6a24-43e6-bd74-c818e6190c2e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105623 Jul 28 03:56:43.356583 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2433/4416] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:43.370160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3587ee9-2f69-4dec-ac9b-bef93839f98a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:43.380047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d3587ee9-2f69-4dec-ac9b-bef93839f98a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 2babe69c-70e7-4dbc-b0ff-2433428a2a67] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:43.393051 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-d3587ee9-2f69-4dec-ac9b-bef93839f98a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance 2babe69c-70e7-4dbc-b0ff-2433428a2a67 could not be found. Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3587ee9-2f69-4dec-ac9b-bef93839f98a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/2babe69c-70e7-4dbc-b0ff-2433428a2a67/action HTTP/1.1 Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 15 Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: {"restore": {}} Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2babe69c-70e7-4dbc-b0ff-2433428a2a67 could not be found. Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2babe69c-70e7-4dbc-b0ff-2433428a2a67', 'body': {'restore': {}}} Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2babe69c-70e7-4dbc-b0ff-2433428a2a67 could not be found. Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2babe69c-70e7-4dbc-b0ff-2433428a2a67 could not be found. Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:43.402517 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:43.407695 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:43.407695 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:43.407695 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2babe69c-70e7-4dbc-b0ff-2433428a2a67 could not be found. Jul 28 03:56:43.407695 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:43.411481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3587ee9-2f69-4dec-ac9b-bef93839f98a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance 2babe69c-70e7-4dbc-b0ff-2433428a2a67 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:43.412666 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d3587ee9-2f69-4dec-ac9b-bef93839f98a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/2babe69c-70e7-4dbc-b0ff-2433428a2a67/action" status: 404 len: 111 microversion: 2.1 time: 0.054098 Jul 28 03:56:43.414715 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2434/4417] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:43 2022] POST /compute/v2.1/servers/2babe69c-70e7-4dbc-b0ff-2433428a2a67/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:43.424553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8cd7ff14-4d1b-44a1-b82b-8d4b24ae713a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:43.438980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8cd7ff14-4d1b-44a1-b82b-8d4b24ae713a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:43.471377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cd7ff14-4d1b-44a1-b82b-8d4b24ae713a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:43.471826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cd7ff14-4d1b-44a1-b82b-8d4b24ae713a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:43.472651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cd7ff14-4d1b-44a1-b82b-8d4b24ae713a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:43.473140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cd7ff14-4d1b-44a1-b82b-8d4b24ae713a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:44.014054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8cd7ff14-4d1b-44a1-b82b-8d4b24ae713a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:44.027053 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8cd7ff14-4d1b-44a1-b82b-8d4b24ae713a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.607357 Jul 28 03:56:44.045354 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2435/4418] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:43 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:44.061493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c9b24bd-17a4-4cc9-9ac3-fda5df7cd9ca tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:44.062140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c9b24bd-17a4-4cc9-9ac3-fda5df7cd9ca tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:44.079687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c9b24bd-17a4-4cc9-9ac3-fda5df7cd9ca tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:44.080517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c9b24bd-17a4-4cc9-9ac3-fda5df7cd9ca tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:44.084303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c9b24bd-17a4-4cc9-9ac3-fda5df7cd9ca tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:44.084857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c9b24bd-17a4-4cc9-9ac3-fda5df7cd9ca tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:44.229316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5008a288-ddf2-47d4-8f89-9bcb75acec6a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:44.241130 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5008a288-ddf2-47d4-8f89-9bcb75acec6a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1313 microversion: 2.1 time: 2.083864 Jul 28 03:56:44.247806 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1984/4419] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:42 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1313 bytes in 2092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:44.273628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1f52a07f-2855-4260-9537-f5b6861c9949 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:44.274796 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1f52a07f-2855-4260-9537-f5b6861c9949 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:44.317916 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f52a07f-2855-4260-9537-f5b6861c9949 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:44.322553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f52a07f-2855-4260-9537-f5b6861c9949 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:44.323653 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f52a07f-2855-4260-9537-f5b6861c9949 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:44.328315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f52a07f-2855-4260-9537-f5b6861c9949 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:44.514457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c9b24bd-17a4-4cc9-9ac3-fda5df7cd9ca tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:44.531415 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c9b24bd-17a4-4cc9-9ac3-fda5df7cd9ca tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.477737 Jul 28 03:56:44.532044 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2436/4420] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:44 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:44.571769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-39c489fc-4f96-48db-85e4-ef18f70b61a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:44.574250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-39c489fc-4f96-48db-85e4-ef18f70b61a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:44.587698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39c489fc-4f96-48db-85e4-ef18f70b61a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:44.587698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39c489fc-4f96-48db-85e4-ef18f70b61a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:44.588279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39c489fc-4f96-48db-85e4-ef18f70b61a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:44.589602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39c489fc-4f96-48db-85e4-ef18f70b61a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:44.652342 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-39c489fc-4f96-48db-85e4-ef18f70b61a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Cannot 'restore' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-39c489fc-4f96-48db-85e4-ef18f70b61a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action HTTP/1.1 Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 15 Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: {"restore": {}} Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: exception: Cannot 'restore' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1d97b518-6a6e-44f8-9be3-940b6fa8c853', 'body': {'restore': {}}} Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 in vm_state active. Cannot restore while the instance is in this state. Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:44.660814 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:44.665325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:44.665325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:44.665325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:44.665325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:56:44.665325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:44.666789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-39c489fc-4f96-48db-85e4-ef18f70b61a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 409 to user: Cannot 'restore' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:44.672921 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-39c489fc-4f96-48db-85e4-ef18f70b61a3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action" status: 409 len: 145 microversion: 2.1 time: 0.118241 Jul 28 03:56:44.679667 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2437/4421] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:44 2022] POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action => generated 145 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 28 03:56:44.689053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5e4eee65-55b0-4797-aa20-e4555221f371 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:44.690336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5e4eee65-55b0-4797-aa20-e4555221f371 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:44.713745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e4eee65-55b0-4797-aa20-e4555221f371 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:44.714757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e4eee65-55b0-4797-aa20-e4555221f371 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:44.716320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e4eee65-55b0-4797-aa20-e4555221f371 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:44.717367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e4eee65-55b0-4797-aa20-e4555221f371 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:44.787508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1f52a07f-2855-4260-9537-f5b6861c9949 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:44.800257 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1f52a07f-2855-4260-9537-f5b6861c9949 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1276 microversion: 2.1 time: 0.529219 Jul 28 03:56:44.806511 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1985/4422] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:44 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1276 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:45.263664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-38304817-c9af-4fe8-97a1-3fc0333f2649 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:45.264376 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-38304817-c9af-4fe8-97a1-3fc0333f2649 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:45.278592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38304817-c9af-4fe8-97a1-3fc0333f2649 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:45.279054 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38304817-c9af-4fe8-97a1-3fc0333f2649 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:45.279906 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38304817-c9af-4fe8-97a1-3fc0333f2649 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:45.280382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38304817-c9af-4fe8-97a1-3fc0333f2649 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:45.343601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5e4eee65-55b0-4797-aa20-e4555221f371 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:45.356455 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5e4eee65-55b0-4797-aa20-e4555221f371 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.674774 Jul 28 03:56:45.357361 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2438/4423] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:44 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:45.402454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-33eb6a4e-d0d8-49a2-9bff-06debf9b4881 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:45.403378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-33eb6a4e-d0d8-49a2-9bff-06debf9b4881 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:45.418647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33eb6a4e-d0d8-49a2-9bff-06debf9b4881 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:45.422757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33eb6a4e-d0d8-49a2-9bff-06debf9b4881 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:45.435379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33eb6a4e-d0d8-49a2-9bff-06debf9b4881 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:45.436188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33eb6a4e-d0d8-49a2-9bff-06debf9b4881 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:45.657560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-33eb6a4e-d0d8-49a2-9bff-06debf9b4881 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:45.667760 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-33eb6a4e-d0d8-49a2-9bff-06debf9b4881 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.270230 Jul 28 03:56:45.683711 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2439/4424] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:45 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:45.691396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fe15a05e-267d-449b-85ee-466f31549888 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Action: 'create', calling method: .version_select at 0x7ffa74110280>, body: {"keypair": {"name": "tempest-keypair-1444746979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBse/Ae0fOWUEFKXmZWOJGoM/SBhV9hUvKJWV7ZirrzaRCYrH87+AwLyc8baxNYkgnlWHDVu8TNdGu/MiiKPT6CKFo78XjlBVrdktwDipNXiGraHOGcA/W8thVAzzwEohQ=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:45.714838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-fe15a05e-267d-449b-85ee-466f31549888 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Getting quotas for project fbc3cf9680194c01945e8764c0aa2985. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:45.722423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-fe15a05e-267d-449b-85ee-466f31549888 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Getting quotas for user 4acaa84bd52e40d9ad5809a5acf0e5a9 and project fbc3cf9680194c01945e8764c0aa2985. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:45.755172 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fe15a05e-267d-449b-85ee-466f31549888 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.069367 Jul 28 03:56:45.755796 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2440/4425] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Jul 28 03:56:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 72 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 03:56:45.761989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86c2b8e7-22b8-48ca-a02e-7deade07bbfb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:45.762750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-86c2b8e7-22b8-48ca-a02e-7deade07bbfb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 15d3de1e-1dcc-434c-b26c-31a8ce6b9d7b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:45.769221 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-86c2b8e7-22b8-48ca-a02e-7deade07bbfb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance 15d3de1e-1dcc-434c-b26c-31a8ce6b9d7b could not be found. Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86c2b8e7-22b8-48ca-a02e-7deade07bbfb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/15d3de1e-1dcc-434c-b26c-31a8ce6b9d7b/action HTTP/1.1 Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 14 Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: {"resume": {}} Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 15d3de1e-1dcc-434c-b26c-31a8ce6b9d7b could not be found. Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '15d3de1e-1dcc-434c-b26c-31a8ce6b9d7b', 'body': {'resume': {}}} Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d3de1e-1dcc-434c-b26c-31a8ce6b9d7b could not be found. Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d3de1e-1dcc-434c-b26c-31a8ce6b9d7b could not be found. Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:45.776758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:45.781469 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:45.781469 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:45.781469 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d3de1e-1dcc-434c-b26c-31a8ce6b9d7b could not be found. Jul 28 03:56:45.781469 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:45.781469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86c2b8e7-22b8-48ca-a02e-7deade07bbfb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance 15d3de1e-1dcc-434c-b26c-31a8ce6b9d7b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:45.781469 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-86c2b8e7-22b8-48ca-a02e-7deade07bbfb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/15d3de1e-1dcc-434c-b26c-31a8ce6b9d7b/action" status: 404 len: 111 microversion: 2.1 time: 0.021923 Jul 28 03:56:45.781469 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2441/4426] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:45 2022] POST /compute/v2.1/servers/15d3de1e-1dcc-434c-b26c-31a8ce6b9d7b/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:45.790344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-903b9b2d-e4f4-4e2b-8bda-41b32f94b188 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:45.791744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-903b9b2d-e4f4-4e2b-8bda-41b32f94b188 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:45.802500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-903b9b2d-e4f4-4e2b-8bda-41b32f94b188 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:45.804321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-903b9b2d-e4f4-4e2b-8bda-41b32f94b188 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:45.805936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-903b9b2d-e4f4-4e2b-8bda-41b32f94b188 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:45.806618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-903b9b2d-e4f4-4e2b-8bda-41b32f94b188 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:46.006293 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-38304817-c9af-4fe8-97a1-3fc0333f2649 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:46.028853 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-38304817-c9af-4fe8-97a1-3fc0333f2649 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1313 microversion: 2.1 time: 0.768898 Jul 28 03:56:46.031031 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1986/4427] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:45 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1313 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:46.041174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7944c28e-3677-4c6d-88ae-eee3cd490b6a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:46.042666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7944c28e-3677-4c6d-88ae-eee3cd490b6a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:46.065340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-903b9b2d-e4f4-4e2b-8bda-41b32f94b188 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:46.077041 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-903b9b2d-e4f4-4e2b-8bda-41b32f94b188 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.290869 Jul 28 03:56:46.077375 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7944c28e-3677-4c6d-88ae-eee3cd490b6a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:46.079461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7944c28e-3677-4c6d-88ae-eee3cd490b6a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:46.081955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7944c28e-3677-4c6d-88ae-eee3cd490b6a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:46.083038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7944c28e-3677-4c6d-88ae-eee3cd490b6a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:46.089560 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2442/4428] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:45 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:46.105349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d41cc0c-8f4d-4e7b-81e6-e88d2afad0db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:46.105979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8d41cc0c-8f4d-4e7b-81e6-e88d2afad0db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:46.115536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d41cc0c-8f4d-4e7b-81e6-e88d2afad0db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:46.115992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d41cc0c-8f4d-4e7b-81e6-e88d2afad0db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:46.118290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d41cc0c-8f4d-4e7b-81e6-e88d2afad0db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:46.118942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d41cc0c-8f4d-4e7b-81e6-e88d2afad0db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:46.368187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8d41cc0c-8f4d-4e7b-81e6-e88d2afad0db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:46.369058 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7944c28e-3677-4c6d-88ae-eee3cd490b6a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:46.380117 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8d41cc0c-8f4d-4e7b-81e6-e88d2afad0db tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.281252 Jul 28 03:56:46.382543 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2443/4429] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:46 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:46.400818 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7944c28e-3677-4c6d-88ae-eee3cd490b6a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1282 microversion: 2.1 time: 0.367348 Jul 28 03:56:46.401940 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1987/4430] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:46 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1282 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:46.418539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f77a50d-a55a-4213-a452-d4246e9837cc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:46.423797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0f77a50d-a55a-4213-a452-d4246e9837cc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:46.431459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f77a50d-a55a-4213-a452-d4246e9837cc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:46.433174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f77a50d-a55a-4213-a452-d4246e9837cc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:46.434168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f77a50d-a55a-4213-a452-d4246e9837cc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:46.434742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f77a50d-a55a-4213-a452-d4246e9837cc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:46.484267 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-0f77a50d-a55a-4213-a452-d4246e9837cc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Cannot 'resume' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f77a50d-a55a-4213-a452-d4246e9837cc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action HTTP/1.1 Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 14 Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: {"resume": {}} Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: exception: Cannot 'resume' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1d97b518-6a6e-44f8-9be3-940b6fa8c853', 'body': {'resume': {}}} Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 in vm_state active. Cannot resume while the instance is in this state. Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:46.487755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:46.493957 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:46.493957 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:46.493957 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:46.493957 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:56:46.493957 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:46.496651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f77a50d-a55a-4213-a452-d4246e9837cc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 409 to user: Cannot 'resume' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:46.497998 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0f77a50d-a55a-4213-a452-d4246e9837cc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action" status: 409 len: 144 microversion: 2.1 time: 0.097983 Jul 28 03:56:46.499411 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2444/4431] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:46 2022] POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action => generated 144 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:56:46.509550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-11826fd3-58c3-4dae-b281-9b227cce6503 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:46.510830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-11826fd3-58c3-4dae-b281-9b227cce6503 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:46.521183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-11826fd3-58c3-4dae-b281-9b227cce6503 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:46.522623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-11826fd3-58c3-4dae-b281-9b227cce6503 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:46.523897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-11826fd3-58c3-4dae-b281-9b227cce6503 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:46.524797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-11826fd3-58c3-4dae-b281-9b227cce6503 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.053125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5a0c4377-b479-4376-be7b-a9e628febb02 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:47.054377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5a0c4377-b479-4376-be7b-a9e628febb02 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:47.067576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a0c4377-b479-4376-be7b-a9e628febb02 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:47.069277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a0c4377-b479-4376-be7b-a9e628febb02 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.071000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a0c4377-b479-4376-be7b-a9e628febb02 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:47.071615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a0c4377-b479-4376-be7b-a9e628febb02 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.195626 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-11826fd3-58c3-4dae-b281-9b227cce6503 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:47.208319 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-11826fd3-58c3-4dae-b281-9b227cce6503 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.704388 Jul 28 03:56:47.209420 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1988/4432] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:46 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:47.222833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ec50e7d5-2093-4832-b00c-7c636e206018 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:47.225986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ec50e7d5-2093-4832-b00c-7c636e206018 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:47.241466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ec50e7d5-2093-4832-b00c-7c636e206018 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:47.241931 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ec50e7d5-2093-4832-b00c-7c636e206018 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.242712 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ec50e7d5-2093-4832-b00c-7c636e206018 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:47.243144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ec50e7d5-2093-4832-b00c-7c636e206018 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.271565 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-ec50e7d5-2093-4832-b00c-7c636e206018 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] HTTP exception thrown: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ec50e7d5-2093-4832-b00c-7c636e206018 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Request method failure captured: Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f HTTP/1.1 Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gca3wwj6vf3mcE1k3p04a-IB_aHJ4q2aQgyaMGEamuHOXYtT8sTCQ39msigigoKDkTgI0q27esncQkdsISfIdor8uYi2ofpy2xxPUYcBX6T1jxeXp0Wz1yCRt_oOue5jQOpZsPCIWzJpvRA8Ld9LSF337wCVS7VtPTruWEjBErR8iQ Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781ab005138547038def64d108937e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781ab005138547038def64d108937e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}] Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: d20381abd9784627887af3cb97cd68a8 Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'b5aac5b7-2161-4673-ba81-5a05fd98352f'} Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:47.273310 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:47.278147 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:56:47.278147 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.278147 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:47.278147 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.278147 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:47.278147 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:47.278147 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:47.278147 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:47.278147 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:47.278147 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:56:47.278147 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.278147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ec50e7d5-2093-4832-b00c-7c636e206018 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Returning 404 to user: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:47.278147 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ec50e7d5-2093-4832-b00c-7c636e206018 tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 404 len: 111 microversion: 2.1 time: 0.064199 Jul 28 03:56:47.278147 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1989/4433] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:56:47 2022] DELETE /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:47.288233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ccc5b84e-d7b3-4a60-9113-317be16479b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:47.288908 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ccc5b84e-d7b3-4a60-9113-317be16479b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:47.310800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ccc5b84e-d7b3-4a60-9113-317be16479b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:47.311218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ccc5b84e-d7b3-4a60-9113-317be16479b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.312054 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ccc5b84e-d7b3-4a60-9113-317be16479b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:47.312492 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ccc5b84e-d7b3-4a60-9113-317be16479b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.464996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5a0c4377-b479-4376-be7b-a9e628febb02 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:47.487162 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5a0c4377-b479-4376-be7b-a9e628febb02 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1313 microversion: 2.1 time: 0.439218 Jul 28 03:56:47.487773 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2445/4434] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:47 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:47.496660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f00b99cc-fe52-4ec0-99eb-394a6c0808ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:47.498185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f00b99cc-fe52-4ec0-99eb-394a6c0808ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: b5aac5b7-2161-4673-ba81-5a05fd98352f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:47.516424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f00b99cc-fe52-4ec0-99eb-394a6c0808ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:47.516889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f00b99cc-fe52-4ec0-99eb-394a6c0808ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.517709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f00b99cc-fe52-4ec0-99eb-394a6c0808ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:47.518148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f00b99cc-fe52-4ec0-99eb-394a6c0808ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.550226 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-f00b99cc-fe52-4ec0-99eb-394a6c0808ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] HTTP exception thrown: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f00b99cc-fe52-4ec0-99eb-394a6c0808ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Request method failure captured: Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f HTTP/1.1 Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gca3wwj6vf3mcE1k3p04a-IB_aHJ4q2aQgyaMGEamuHOXYtT8sTCQ39msigigoKDkTgI0q27esncQkdsISfIdor8uYi2ofpy2xxPUYcBX6T1jxeXp0Wz1yCRt_oOue5jQOpZsPCIWzJpvRA8Ld9LSF337wCVS7VtPTruWEjBErR8iQ Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781ab005138547038def64d108937e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781ab005138547038def64d108937e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}] Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d20381abd9784627887af3cb97cd68a8 Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'b5aac5b7-2161-4673-ba81-5a05fd98352f'} Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:47.553203 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.559457 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:47.559457 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:47.559457 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:47.559457 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:47.559457 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:47.559457 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. Jul 28 03:56:47.559457 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.559457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f00b99cc-fe52-4ec0-99eb-394a6c0808ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Returning 404 to user: Instance b5aac5b7-2161-4673-ba81-5a05fd98352f could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:47.559457 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f00b99cc-fe52-4ec0-99eb-394a6c0808ef tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f" status: 404 len: 111 microversion: 2.1 time: 0.065745 Jul 28 03:56:47.560585 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2446/4435] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:47 2022] GET /compute/v2.1/servers/b5aac5b7-2161-4673-ba81-5a05fd98352f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:47.570070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-82e81001-e7cb-4ff8-bb2b-d967ffa61865 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:47.570714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-82e81001-e7cb-4ff8-bb2b-d967ffa61865 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:47.583426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82e81001-e7cb-4ff8-bb2b-d967ffa61865 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:47.583906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82e81001-e7cb-4ff8-bb2b-d967ffa61865 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.584761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82e81001-e7cb-4ff8-bb2b-d967ffa61865 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:47.588170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82e81001-e7cb-4ff8-bb2b-d967ffa61865 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.743605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82e81001-e7cb-4ff8-bb2b-d967ffa61865 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:47.748502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:47.764565 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-82e81001-e7cb-4ff8-bb2b-d967ffa61865 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1282 microversion: 2.1 time: 0.203314 Jul 28 03:56:47.782076 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2447/4436] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:47 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:47.787441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b092f419-cdb8-49ca-b6ad-79a7f046374e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:47.788208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b092f419-cdb8-49ca-b6ad-79a7f046374e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:47.795766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b092f419-cdb8-49ca-b6ad-79a7f046374e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:47.796585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b092f419-cdb8-49ca-b6ad-79a7f046374e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.797542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b092f419-cdb8-49ca-b6ad-79a7f046374e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:47.798142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b092f419-cdb8-49ca-b6ad-79a7f046374e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.819226 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-b092f419-cdb8-49ca-b6ad-79a7f046374e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] HTTP exception thrown: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b092f419-cdb8-49ca-b6ad-79a7f046374e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Request method failure captured: Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d HTTP/1.1 Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gca3wwj6vf3mcE1k3p04a-IB_aHJ4q2aQgyaMGEamuHOXYtT8sTCQ39msigigoKDkTgI0q27esncQkdsISfIdor8uYi2ofpy2xxPUYcBX6T1jxeXp0Wz1yCRt_oOue5jQOpZsPCIWzJpvRA8Ld9LSF337wCVS7VtPTruWEjBErR8iQ Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781ab005138547038def64d108937e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781ab005138547038def64d108937e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}] Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d20381abd9784627887af3cb97cd68a8 Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'dfdf6d03-2454-457b-9c80-106379a5194d'} Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:47.821258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:47.825555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:56:47.825555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.825555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:47.825555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.825555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:47.825555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:47.825555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:47.825555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:47.825555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:47.825555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:56:47.825555 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.827297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b092f419-cdb8-49ca-b6ad-79a7f046374e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Returning 404 to user: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:47.828369 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b092f419-cdb8-49ca-b6ad-79a7f046374e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 404 len: 111 microversion: 2.1 time: 0.044946 Jul 28 03:56:47.829439 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2448/4437] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:56:47 2022] DELETE /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:47.845757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f0e6a374-488c-4235-88f8-c604fee4ff7e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:47.846860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f0e6a374-488c-4235-88f8-c604fee4ff7e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: dfdf6d03-2454-457b-9c80-106379a5194d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:47.853894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0e6a374-488c-4235-88f8-c604fee4ff7e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:47.854640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0e6a374-488c-4235-88f8-c604fee4ff7e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.855624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0e6a374-488c-4235-88f8-c604fee4ff7e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:47.856224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0e6a374-488c-4235-88f8-c604fee4ff7e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:47.882394 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-f0e6a374-488c-4235-88f8-c604fee4ff7e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] HTTP exception thrown: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f0e6a374-488c-4235-88f8-c604fee4ff7e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Request method failure captured: Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d HTTP/1.1 Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gca3wwj6vf3mcE1k3p04a-IB_aHJ4q2aQgyaMGEamuHOXYtT8sTCQ39msigigoKDkTgI0q27esncQkdsISfIdor8uYi2ofpy2xxPUYcBX6T1jxeXp0Wz1yCRt_oOue5jQOpZsPCIWzJpvRA8Ld9LSF337wCVS7VtPTruWEjBErR8iQ Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781ab005138547038def64d108937e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781ab005138547038def64d108937e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}] Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d20381abd9784627887af3cb97cd68a8 Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'dfdf6d03-2454-457b-9c80-106379a5194d'} Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:47.884594 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.888995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:47.888995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:47.888995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:47.888995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:47.888995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:47.888995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. Jul 28 03:56:47.888995 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:47.890440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f0e6a374-488c-4235-88f8-c604fee4ff7e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Returning 404 to user: Instance dfdf6d03-2454-457b-9c80-106379a5194d could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:47.891777 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f0e6a374-488c-4235-88f8-c604fee4ff7e tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d" status: 404 len: 111 microversion: 2.1 time: 0.054019 Jul 28 03:56:47.893031 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2449/4438] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:47 2022] GET /compute/v2.1/servers/dfdf6d03-2454-457b-9c80-106379a5194d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:48.510381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-87e29f16-010a-476f-b498-2fcf86a61c9a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:48.512734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-87e29f16-010a-476f-b498-2fcf86a61c9a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:48.524586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87e29f16-010a-476f-b498-2fcf86a61c9a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:48.533796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87e29f16-010a-476f-b498-2fcf86a61c9a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:48.535031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87e29f16-010a-476f-b498-2fcf86a61c9a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:48.535684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87e29f16-010a-476f-b498-2fcf86a61c9a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:48.636749 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ccc5b84e-d7b3-4a60-9113-317be16479b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:48.646124 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ccc5b84e-d7b3-4a60-9113-317be16479b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 1.369837 Jul 28 03:56:48.658960 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1990/4439] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:47 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:48.664633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-495513785", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "336ce4fc-34cd-461d-9479-a7e9334b53be"}, {"port": "64c0dac1-8c71-4869-8d21-34d221428489", "tag": "port-1"}, {"port": "8d43bc33-8f3a-406e-99fa-b66c536b9ca4", "tag": "port-2"}, {"uuid": "247f38fc-fc41-4464-a38e-6c3764453d96", "tag": "net-1"}, {"uuid": "247f38fc-fc41-4464-a38e-6c3764453d96"}, {"uuid": "586dd88c-ead1-4176-834b-867a90a89297", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "586dd88c-ead1-4176-834b-867a90a89297", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "8753bed5-0a3c-4314-a0d1-3e7e1ab7dd2a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a27c72ee-23a6-4a7a-9e20-ad7ddac1ce27", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "33fd44b0-667a-4f26-b401-1a95682077ea", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1569175274"}], "key_name": "tempest-keypair-1444746979", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:48.790518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-87e29f16-010a-476f-b498-2fcf86a61c9a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:48.805974 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-87e29f16-010a-476f-b498-2fcf86a61c9a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1313 microversion: 2.1 time: 0.299551 Jul 28 03:56:48.807280 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2450/4440] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:48 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:48.820995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-72f507c4-e9bf-4e08-af5e-5918b6c4ed6f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:48.822249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-72f507c4-e9bf-4e08-af5e-5918b6c4ed6f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:48.835662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72f507c4-e9bf-4e08-af5e-5918b6c4ed6f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:48.836470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72f507c4-e9bf-4e08-af5e-5918b6c4ed6f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:48.837456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72f507c4-e9bf-4e08-af5e-5918b6c4ed6f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:48.838086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72f507c4-e9bf-4e08-af5e-5918b6c4ed6f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:48.946836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-72f507c4-e9bf-4e08-af5e-5918b6c4ed6f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:48.968583 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-72f507c4-e9bf-4e08-af5e-5918b6c4ed6f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1282 microversion: 2.1 time: 0.159915 Jul 28 03:56:48.973774 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2451/4441] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:48 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:48.979248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-35f7f787-02aa-4759-8d8a-5b9320e09411 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-35f7f787-02aa-4759-8d8a-5b9320e09411 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 160 Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "3fcf143f-a069-44e5-9902-e5b7dddd3dfa"}]}} Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'body': {'server': {'name': '', 'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220', 'flavorRef': '452', 'networks': [{'uuid': '3fcf143f-a069-44e5-9902-e5b7dddd3dfa'}]}}} Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi '' Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:56:48.990611 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:56:48.995598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:56:48.995598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 28 03:56:48.995598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:48.995598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:48.995598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:48.995598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:48.995598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:48.995598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:48.995598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:56:48.995598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:56:48.995598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 28 03:56:48.995598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:48.999616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-35f7f787-02aa-4759-8d8a-5b9320e09411 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:49.000742 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-35f7f787-02aa-4759-8d8a-5b9320e09411 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.025494 Jul 28 03:56:49.011443 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2452/4442] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:56:48 2022] POST /compute/v2.1/servers => generated 108 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:56:49.017064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-22f03216-58d7-4a30-9ba2-0b1ecca60108 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:49.019451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-22f03216-58d7-4a30-9ba2-0b1ecca60108 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:49.030980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] validate_networks() for [('336ce4fc-34cd-461d-9479-a7e9334b53be', None, None, None, None, None), (None, None, '64c0dac1-8c71-4869-8d21-34d221428489', None, None, None), (None, None, '8d43bc33-8f3a-406e-99fa-b66c536b9ca4', None, None, None), ('247f38fc-fc41-4464-a38e-6c3764453d96', None, None, None, None, None), ('247f38fc-fc41-4464-a38e-6c3764453d96', None, None, None, None, None), ('586dd88c-ead1-4176-834b-867a90a89297', '10.2.2.100', None, None, None, None), ('586dd88c-ead1-4176-834b-867a90a89297', '10.2.2.200', None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:56:49.049328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22f03216-58d7-4a30-9ba2-0b1ecca60108 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:49.049798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22f03216-58d7-4a30-9ba2-0b1ecca60108 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:49.050622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22f03216-58d7-4a30-9ba2-0b1ecca60108 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:49.051070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22f03216-58d7-4a30-9ba2-0b1ecca60108 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:49.584872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-22f03216-58d7-4a30-9ba2-0b1ecca60108 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:49.599084 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-22f03216-58d7-4a30-9ba2-0b1ecca60108 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.586123 Jul 28 03:56:49.600710 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2453/4443] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:49 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:49.627252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3aef27e7-ad47-42b8-b1d0-d4948d43ef1d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:49.628221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3aef27e7-ad47-42b8-b1d0-d4948d43ef1d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:49.656260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3aef27e7-ad47-42b8-b1d0-d4948d43ef1d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:49.659459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3aef27e7-ad47-42b8-b1d0-d4948d43ef1d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:49.666086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3aef27e7-ad47-42b8-b1d0-d4948d43ef1d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:49.666709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3aef27e7-ad47-42b8-b1d0-d4948d43ef1d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:49.937494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3aef27e7-ad47-42b8-b1d0-d4948d43ef1d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:49.949846 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3aef27e7-ad47-42b8-b1d0-d4948d43ef1d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.328860 Jul 28 03:56:49.950454 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2454/4444] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:49 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:49.965809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4f31c8d2-3600-44c1-bfd3-0bc997c951e4 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:49.967226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4f31c8d2-3600-44c1-bfd3-0bc997c951e4 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:49.979973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f31c8d2-3600-44c1-bfd3-0bc997c951e4 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:49.980733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f31c8d2-3600-44c1-bfd3-0bc997c951e4 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:49.981719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f31c8d2-3600-44c1-bfd3-0bc997c951e4 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:49.984668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f31c8d2-3600-44c1-bfd3-0bc997c951e4 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:50.775714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4f31c8d2-3600-44c1-bfd3-0bc997c951e4 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:50.786276 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4f31c8d2-3600-44c1-bfd3-0bc997c951e4 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1313 microversion: 2.1 time: 0.832916 Jul 28 03:56:50.802833 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2455/4445] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:49 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1313 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:50.814833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d4bab31-ba4e-44f7-8adc-2b2d4d37fe2a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:50.815387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5d4bab31-ba4e-44f7-8adc-2b2d4d37fe2a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: aff5565b-a5bb-4b35-ac63-b827e8b1a674] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:50.831400 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-5d4bab31-ba4e-44f7-8adc-2b2d4d37fe2a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance aff5565b-a5bb-4b35-ac63-b827e8b1a674 could not be found. Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d4bab31-ba4e-44f7-8adc-2b2d4d37fe2a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/aff5565b-a5bb-4b35-ac63-b827e8b1a674/action HTTP/1.1 Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 14 Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: {"shelve": {}} Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance aff5565b-a5bb-4b35-ac63-b827e8b1a674 could not be found. Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'aff5565b-a5bb-4b35-ac63-b827e8b1a674', 'body': {'shelve': {}}} Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff5565b-a5bb-4b35-ac63-b827e8b1a674 could not be found. Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff5565b-a5bb-4b35-ac63-b827e8b1a674 could not be found. Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:50.839970 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:50.845863 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:50.845863 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:50.845863 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff5565b-a5bb-4b35-ac63-b827e8b1a674 could not be found. Jul 28 03:56:50.845863 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:50.845863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d4bab31-ba4e-44f7-8adc-2b2d4d37fe2a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance aff5565b-a5bb-4b35-ac63-b827e8b1a674 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:50.845863 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5d4bab31-ba4e-44f7-8adc-2b2d4d37fe2a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/aff5565b-a5bb-4b35-ac63-b827e8b1a674/action" status: 404 len: 111 microversion: 2.1 time: 0.036798 Jul 28 03:56:50.845863 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2456/4446] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:50 2022] POST /compute/v2.1/servers/aff5565b-a5bb-4b35-ac63-b827e8b1a674/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:50.851572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c21ccd9d-829c-4d65-bcee-0c4d1742103c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:50.858407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c21ccd9d-829c-4d65-bcee-0c4d1742103c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:50.869138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c21ccd9d-829c-4d65-bcee-0c4d1742103c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:50.869587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c21ccd9d-829c-4d65-bcee-0c4d1742103c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:50.870372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c21ccd9d-829c-4d65-bcee-0c4d1742103c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:50.870806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c21ccd9d-829c-4d65-bcee-0c4d1742103c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:51.193423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c21ccd9d-829c-4d65-bcee-0c4d1742103c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:51.204056 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c21ccd9d-829c-4d65-bcee-0c4d1742103c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1324 microversion: 2.1 time: 0.360270 Jul 28 03:56:51.204698 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2457/4447] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:50 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1324 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:51.216227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6fad7a99-0e67-4052-9105-657059c1c5fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:51.217892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6fad7a99-0e67-4052-9105-657059c1c5fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:51.238238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fad7a99-0e67-4052-9105-657059c1c5fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:51.239548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fad7a99-0e67-4052-9105-657059c1c5fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:51.240915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fad7a99-0e67-4052-9105-657059c1c5fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:51.241506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fad7a99-0e67-4052-9105-657059c1c5fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:51.682087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6fad7a99-0e67-4052-9105-657059c1c5fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:51.693411 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6fad7a99-0e67-4052-9105-657059c1c5fb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.487614 Jul 28 03:56:51.694042 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2458/4448] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:51 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:51.702967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a6612a3a-9c4a-4917-8f4d-7bf97f9cbd42 req-723c4de1-49a5-4dab-931f-16f136765ef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0880950-7d28-4b67-b1da-2c0a2837a94b", "name": "network-vif-plugged", "status": "completed", "tag": "b62f3751-6f21-4235-a655-134ef0a4f4fb"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:51.726448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a6612a3a-9c4a-4917-8f4d-7bf97f9cbd42 req-723c4de1-49a5-4dab-931f-16f136765ef4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:51.728038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a6612a3a-9c4a-4917-8f4d-7bf97f9cbd42 req-723c4de1-49a5-4dab-931f-16f136765ef4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:51.754109 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a6612a3a-9c4a-4917-8f4d-7bf97f9cbd42 req-723c4de1-49a5-4dab-931f-16f136765ef4 service nova] Creating event network-vif-plugged:b62f3751-6f21-4235-a655-134ef0a4f4fb for instance c0880950-7d28-4b67-b1da-2c0a2837a94b on n-h1-826756-3 Jul 28 03:56:51.763728 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a6612a3a-9c4a-4917-8f4d-7bf97f9cbd42 req-723c4de1-49a5-4dab-931f-16f136765ef4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068321 Jul 28 03:56:51.764815 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2459/4449] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:51.777133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a109d847-ee71-45ce-84d2-935e1d3b1208 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:51.783203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a109d847-ee71-45ce-84d2-935e1d3b1208 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:51.809946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a109d847-ee71-45ce-84d2-935e1d3b1208 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:51.810352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a109d847-ee71-45ce-84d2-935e1d3b1208 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:51.811226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a109d847-ee71-45ce-84d2-935e1d3b1208 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:51.811664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a109d847-ee71-45ce-84d2-935e1d3b1208 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:52.138623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a109d847-ee71-45ce-84d2-935e1d3b1208 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:52.150136 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a109d847-ee71-45ce-84d2-935e1d3b1208 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.384200 Jul 28 03:56:52.150757 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2460/4450] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:51 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:52.160437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b709f8a4-1598-4284-9625-550114c33181 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:52.176570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b709f8a4-1598-4284-9625-550114c33181 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:52.189654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b709f8a4-1598-4284-9625-550114c33181 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:52.190043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b709f8a4-1598-4284-9625-550114c33181 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:52.190829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b709f8a4-1598-4284-9625-550114c33181 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:52.197179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b709f8a4-1598-4284-9625-550114c33181 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:52.405875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:52.533304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b709f8a4-1598-4284-9625-550114c33181 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:52.544209 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b709f8a4-1598-4284-9625-550114c33181 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1313 microversion: 2.1 time: 0.387723 Jul 28 03:56:52.549301 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2461/4451] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:52 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1313 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:52.556144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e4d0ee9-cbf5-41a5-805e-fa6417f08aef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:52.558667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4e4d0ee9-cbf5-41a5-805e-fa6417f08aef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:52.582941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e4d0ee9-cbf5-41a5-805e-fa6417f08aef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:52.583922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e4d0ee9-cbf5-41a5-805e-fa6417f08aef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:52.585037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e4d0ee9-cbf5-41a5-805e-fa6417f08aef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:52.585705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e4d0ee9-cbf5-41a5-805e-fa6417f08aef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:52.641974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-4e4d0ee9-cbf5-41a5-805e-fa6417f08aef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lazy-loading 'flavor' on Instance uuid 1d97b518-6a6e-44f8-9be3-940b6fa8c853 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:56:52.994232 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e4d0ee9-cbf5-41a5-805e-fa6417f08aef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action" status: 202 len: 0 microversion: 2.1 time: 0.443083 Jul 28 03:56:52.995939 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2462/4452] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:56:52 2022] POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:56:53.023888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b25616de-eea6-40e7-bde8-5c25e9fc71be tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:53.025757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b25616de-eea6-40e7-bde8-5c25e9fc71be tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:53.045600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b25616de-eea6-40e7-bde8-5c25e9fc71be tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:53.055576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b25616de-eea6-40e7-bde8-5c25e9fc71be tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:53.056741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b25616de-eea6-40e7-bde8-5c25e9fc71be tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:53.058387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b25616de-eea6-40e7-bde8-5c25e9fc71be tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:53.462741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b25616de-eea6-40e7-bde8-5c25e9fc71be tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:53.474101 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b25616de-eea6-40e7-bde8-5c25e9fc71be tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1324 microversion: 2.1 time: 0.468212 Jul 28 03:56:53.474702 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2463/4453] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:52 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:53.488462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f2d21a5-3fe1-4725-a4f3-8c6f0f31daba tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:53.488905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2f2d21a5-3fe1-4725-a4f3-8c6f0f31daba tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:53.502745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f2d21a5-3fe1-4725-a4f3-8c6f0f31daba tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:53.503200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f2d21a5-3fe1-4725-a4f3-8c6f0f31daba tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:53.503996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f2d21a5-3fe1-4725-a4f3-8c6f0f31daba tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:53.504456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f2d21a5-3fe1-4725-a4f3-8c6f0f31daba tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:53.541307 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-2f2d21a5-3fe1-4725-a4f3-8c6f0f31daba tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] HTTP exception thrown: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f2d21a5-3fe1-4725-a4f3-8c6f0f31daba tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Request method failure captured: Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 HTTP/1.1 Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gca3wwj6vf3mcE1k3p04a-IB_aHJ4q2aQgyaMGEamuHOXYtT8sTCQ39msigigoKDkTgI0q27esncQkdsISfIdor8uYi2ofpy2xxPUYcBX6T1jxeXp0Wz1yCRt_oOue5jQOpZsPCIWzJpvRA8Ld9LSF337wCVS7VtPTruWEjBErR8iQ Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781ab005138547038def64d108937e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781ab005138547038def64d108937e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}] Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d20381abd9784627887af3cb97cd68a8 Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a314625b-adb1-45fa-9483-b084005a11b6'} Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:53.543486 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:53.547380 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:56:53.547380 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:53.547380 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:53.547380 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:53.547380 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:53.547380 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:53.547380 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:53.547380 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:53.547380 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:53.547380 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:56:53.547380 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:53.555445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f2d21a5-3fe1-4725-a4f3-8c6f0f31daba tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Returning 404 to user: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:53.556786 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2f2d21a5-3fe1-4725-a4f3-8c6f0f31daba tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 404 len: 111 microversion: 2.1 time: 0.076336 Jul 28 03:56:53.557647 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2464/4454] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:56:53 2022] DELETE /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:53.564631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-db2a1246-ed03-465f-961b-5453a8886758 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:53.565688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-db2a1246-ed03-465f-961b-5453a8886758 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:53.572879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db2a1246-ed03-465f-961b-5453a8886758 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:53.573693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db2a1246-ed03-465f-961b-5453a8886758 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:53.574751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db2a1246-ed03-465f-961b-5453a8886758 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:53.575456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db2a1246-ed03-465f-961b-5453a8886758 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:53.867760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-db2a1246-ed03-465f-961b-5453a8886758 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:53.877411 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-db2a1246-ed03-465f-961b-5453a8886758 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1511 microversion: 2.1 time: 0.318247 Jul 28 03:56:53.878399 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2465/4455] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:53 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1511 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:53.899690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3da15edf-9c78-41f7-9a59-402a793845ef req-6b2583c7-3e83-4b6e-a5ca-fb393a30f129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acb45614-0607-46f1-90bc-e064c206adea", "tag": "72d248d2-7689-4773-96a2-0a68ee2aa720"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:56:53.911370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3da15edf-9c78-41f7-9a59-402a793845ef req-6b2583c7-3e83-4b6e-a5ca-fb393a30f129 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:53.912099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3da15edf-9c78-41f7-9a59-402a793845ef req-6b2583c7-3e83-4b6e-a5ca-fb393a30f129 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:53.926019 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3da15edf-9c78-41f7-9a59-402a793845ef req-6b2583c7-3e83-4b6e-a5ca-fb393a30f129 service nova] Creating event network-changed:72d248d2-7689-4773-96a2-0a68ee2aa720 for instance acb45614-0607-46f1-90bc-e064c206adea on n-h2-826756-3 Jul 28 03:56:53.931730 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3da15edf-9c78-41f7-9a59-402a793845ef req-6b2583c7-3e83-4b6e-a5ca-fb393a30f129 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041509 Jul 28 03:56:53.933197 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2466/4456] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:53.940543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ef10cac5-36f2-49ef-8125-b43371aceb8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:53.941621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ef10cac5-36f2-49ef-8125-b43371aceb8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] [instance: a314625b-adb1-45fa-9483-b084005a11b6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:53.950351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef10cac5-36f2-49ef-8125-b43371aceb8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:53.951749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef10cac5-36f2-49ef-8125-b43371aceb8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:53.953029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef10cac5-36f2-49ef-8125-b43371aceb8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:53.953710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef10cac5-36f2-49ef-8125-b43371aceb8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:53.972141 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-ef10cac5-36f2-49ef-8125-b43371aceb8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] HTTP exception thrown: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ef10cac5-36f2-49ef-8125-b43371aceb8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Request method failure captured: Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 HTTP/1.1 Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gca3wwj6vf3mcE1k3p04a-IB_aHJ4q2aQgyaMGEamuHOXYtT8sTCQ39msigigoKDkTgI0q27esncQkdsISfIdor8uYi2ofpy2xxPUYcBX6T1jxeXp0Wz1yCRt_oOue5jQOpZsPCIWzJpvRA8Ld9LSF337wCVS7VtPTruWEjBErR8iQ Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/781ab005138547038def64d108937e3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_781ab005138547038def64d108937e3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/781ab005138547038def64d108937e3e"}]}] Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 781ab005138547038def64d108937e3e Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1432668179 Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: d20381abd9784627887af3cb97cd68a8 Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeNegativeTest-1432668179-project Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a314625b-adb1-45fa-9483-b084005a11b6'} Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:56:53.974243 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:53.979426 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:56:53.979426 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:56:53.979426 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:56:53.979426 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:56:53.979426 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:56:53.979426 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. Jul 28 03:56:53.979426 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:56:53.983349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ef10cac5-36f2-49ef-8125-b43371aceb8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] Returning 404 to user: Instance a314625b-adb1-45fa-9483-b084005a11b6 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:56:53.984604 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ef10cac5-36f2-49ef-8125-b43371aceb8b tempest-AttachVolumeNegativeTest-1432668179 tempest-AttachVolumeNegativeTest-1432668179-project] 10.222.0.48 "GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6" status: 404 len: 111 microversion: 2.1 time: 0.049985 Jul 28 03:56:53.985965 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2467/4457] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:53 2022] GET /compute/v2.1/servers/a314625b-adb1-45fa-9483-b084005a11b6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:56:53.992326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fafe2667-8257-47f5-829c-291f1b822aad tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:53.992989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fafe2667-8257-47f5-829c-291f1b822aad tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:54.000050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fafe2667-8257-47f5-829c-291f1b822aad tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:54.000720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fafe2667-8257-47f5-829c-291f1b822aad tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:54.001374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fafe2667-8257-47f5-829c-291f1b822aad tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:54.001823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fafe2667-8257-47f5-829c-291f1b822aad tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:54.054405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:54.450157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fafe2667-8257-47f5-829c-291f1b822aad tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:54.463935 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fafe2667-8257-47f5-829c-291f1b822aad tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1313 microversion: 2.1 time: 0.476223 Jul 28 03:56:54.467289 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2468/4458] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:53 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:54.500233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c29ea359-0956-4df5-be04-1549ab89daed tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:54.501171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c29ea359-0956-4df5-be04-1549ab89daed tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:54.518459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c29ea359-0956-4df5-be04-1549ab89daed tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:54.518799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c29ea359-0956-4df5-be04-1549ab89daed tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:54.519668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c29ea359-0956-4df5-be04-1549ab89daed tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:54.520110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c29ea359-0956-4df5-be04-1549ab89daed tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:55.230848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:56:55.231858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:56:55.232666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:56:55.233178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:56:55.233670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:56:55.246858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:55.247282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:55.248287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:55.249353 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:55.276892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Getting quotas for project fbc3cf9680194c01945e8764c0aa2985. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:56:55.283161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Getting quotas for user 4acaa84bd52e40d9ad5809a5acf0e5a9 and project fbc3cf9680194c01945e8764c0aa2985. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:56:55.323022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c29ea359-0956-4df5-be04-1549ab89daed tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:55.339872 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c29ea359-0956-4df5-be04-1549ab89daed tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1324 microversion: 2.1 time: 0.844031 Jul 28 03:56:55.340517 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2469/4459] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:54 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1324 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:55.345741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5459942f-0dc7-4852-996c-26489fa22d20 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:55.346365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5459942f-0dc7-4852-996c-26489fa22d20 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:55.353193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5459942f-0dc7-4852-996c-26489fa22d20 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:55.354439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5459942f-0dc7-4852-996c-26489fa22d20 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:55.355420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5459942f-0dc7-4852-996c-26489fa22d20 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:55.356048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5459942f-0dc7-4852-996c-26489fa22d20 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:55.520561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:56:55.524775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='8753bed5-0a3c-4314-a0d1-3e7e1ab7dd2a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a27c72ee-23a6-4a7a-9e20-ad7ddac1ce27',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='33fd44b0-667a-4f26-b401-1a95682077ea',volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:56:55.737685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:55.903544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5459942f-0dc7-4852-996c-26489fa22d20 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:55.916866 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5459942f-0dc7-4852-996c-26489fa22d20 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1511 microversion: 2.1 time: 0.575120 Jul 28 03:56:55.917906 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2470/4460] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:55 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1511 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:55.941721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f38eed64-edbc-43e1-a18b-4da1c92ad531 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:55.942850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f38eed64-edbc-43e1-a18b-4da1c92ad531 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:55.951438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f38eed64-edbc-43e1-a18b-4da1c92ad531 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:55.952294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f38eed64-edbc-43e1-a18b-4da1c92ad531 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:55.954474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f38eed64-edbc-43e1-a18b-4da1c92ad531 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:55.955156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f38eed64-edbc-43e1-a18b-4da1c92ad531 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:56.053499 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a55775ed-e30b-4e10-9f7d-07c52412aaa7 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 7.392999 Jul 28 03:56:56.054772 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1991/4461] 10.222.0.48 () {62 vars in 1189 bytes} [Thu Jul 28 03:56:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 7395 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:56:56.069020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5f592e13-1f10-448c-8000-407b562cf36e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:56.069909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5f592e13-1f10-448c-8000-407b562cf36e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:56.165179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5f592e13-1f10-448c-8000-407b562cf36e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:56.178699 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5f592e13-1f10-448c-8000-407b562cf36e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:56.186595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5f592e13-1f10-448c-8000-407b562cf36e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:56.187974 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5f592e13-1f10-448c-8000-407b562cf36e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1285 microversion: 2.32 time: 0.125867 Jul 28 03:56:56.188461 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1992/4462] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:56 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:56.373687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1d0c6997-43ab-4985-bff8-c09d3226286a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:56.374967 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1d0c6997-43ab-4985-bff8-c09d3226286a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:56.383619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1d0c6997-43ab-4985-bff8-c09d3226286a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:56.384074 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1d0c6997-43ab-4985-bff8-c09d3226286a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:56.385543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1d0c6997-43ab-4985-bff8-c09d3226286a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:56.385988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1d0c6997-43ab-4985-bff8-c09d3226286a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:56.418533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f38eed64-edbc-43e1-a18b-4da1c92ad531 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:56.426891 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f38eed64-edbc-43e1-a18b-4da1c92ad531 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1499 microversion: 2.1 time: 0.507645 Jul 28 03:56:56.428102 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2471/4463] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:55 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1499 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:56.453696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0af86aad-90f9-4476-81a2-5513cf3ecd32 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:56.478348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.compute.server_groups [None req-0af86aad-90f9-4476-81a2-5513cf3ecd32 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Querying cell a8b3e198-f422-4bf1-ae6c-bd38905d4b84(cell1) for 1 instances {{(pid=126071) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 28 03:56:56.479171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0af86aad-90f9-4476-81a2-5513cf3ecd32 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:56.479624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0af86aad-90f9-4476-81a2-5513cf3ecd32 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:56.500819 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0af86aad-90f9-4476-81a2-5513cf3ecd32 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/cce60740-8ec7-40ca-952f-2e87457f2118" status: 200 len: 221 microversion: 2.1 time: 0.053392 Jul 28 03:56:56.501734 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2472/4464] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:56:56 2022] GET /compute/v2.1/os-server-groups/cce60740-8ec7-40ca-952f-2e87457f2118 => generated 221 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:56:56.513009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2b2ee1a-d032-40a2-94d7-da804da4e5f3 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:56.513519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2b2ee1a-d032-40a2-94d7-da804da4e5f3 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:56.515729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:56:56.522666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2b2ee1a-d032-40a2-94d7-da804da4e5f3 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:56.523179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2b2ee1a-d032-40a2-94d7-da804da4e5f3 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:56.524037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2b2ee1a-d032-40a2-94d7-da804da4e5f3 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:56.524580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2b2ee1a-d032-40a2-94d7-da804da4e5f3 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:56.555413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2b2ee1a-d032-40a2-94d7-da804da4e5f3 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:56:56.672198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1d0c6997-43ab-4985-bff8-c09d3226286a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:56.712767 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b2b2ee1a-d032-40a2-94d7-da804da4e5f3 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 204 len: 0 microversion: 2.1 time: 0.202810 Jul 28 03:56:56.713108 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1d0c6997-43ab-4985-bff8-c09d3226286a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1324 microversion: 2.1 time: 0.343810 Jul 28 03:56:56.713612 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2473/4465] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:56:56 2022] DELETE /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:56:56.725903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e52048d8-89c2-4aaf-bf69-6934b5f73baf tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:56.726628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e52048d8-89c2-4aaf-bf69-6934b5f73baf tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:56.731692 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1993/4466] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:56 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1324 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:56.748334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e52048d8-89c2-4aaf-bf69-6934b5f73baf tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:56.773219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e52048d8-89c2-4aaf-bf69-6934b5f73baf tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:56.774118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e52048d8-89c2-4aaf-bf69-6934b5f73baf tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:56.774574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e52048d8-89c2-4aaf-bf69-6934b5f73baf tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:56.956466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cd3221ab-4e6e-4118-8ed0-c44698dbdbbb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:56.957177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cd3221ab-4e6e-4118-8ed0-c44698dbdbbb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:56.968502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd3221ab-4e6e-4118-8ed0-c44698dbdbbb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:56.969215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd3221ab-4e6e-4118-8ed0-c44698dbdbbb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:56.970415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd3221ab-4e6e-4118-8ed0-c44698dbdbbb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:56.971065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd3221ab-4e6e-4118-8ed0-c44698dbdbbb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:57.180332 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd3221ab-4e6e-4118-8ed0-c44698dbdbbb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:57.193516 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cd3221ab-4e6e-4118-8ed0-c44698dbdbbb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1511 microversion: 2.1 time: 0.242320 Jul 28 03:56:57.207326 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1994/4467] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:56 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1511 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:57.220893 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-60ad641e-7190-4c2e-b619-370dc3c5a74e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:57.221863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-60ad641e-7190-4c2e-b619-370dc3c5a74e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:57.295260 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-60ad641e-7190-4c2e-b619-370dc3c5a74e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:57.307128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-60ad641e-7190-4c2e-b619-370dc3c5a74e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:57.309953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-60ad641e-7190-4c2e-b619-370dc3c5a74e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:57.313616 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-60ad641e-7190-4c2e-b619-370dc3c5a74e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1285 microversion: 2.32 time: 0.103067 Jul 28 03:56:57.315195 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1995/4468] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:57 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:57.662812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e52048d8-89c2-4aaf-bf69-6934b5f73baf tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:57.674159 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e52048d8-89c2-4aaf-bf69-6934b5f73baf tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1505 microversion: 2.1 time: 0.953222 Jul 28 03:56:57.674159 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2474/4469] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:56 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1505 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:57.848082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-08f0d59a-11da-4d76-aa2b-bde41c7d7d98 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:57.851702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-08f0d59a-11da-4d76-aa2b-bde41c7d7d98 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:57.864439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-08f0d59a-11da-4d76-aa2b-bde41c7d7d98 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:57.865192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-08f0d59a-11da-4d76-aa2b-bde41c7d7d98 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:57.866276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-08f0d59a-11da-4d76-aa2b-bde41c7d7d98 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:57.867362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-08f0d59a-11da-4d76-aa2b-bde41c7d7d98 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:58.223606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b51a7d60-984f-4ed6-8cdf-c23125672a0f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:58.224951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b51a7d60-984f-4ed6-8cdf-c23125672a0f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:58.239692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b51a7d60-984f-4ed6-8cdf-c23125672a0f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:58.241231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b51a7d60-984f-4ed6-8cdf-c23125672a0f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:58.245370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b51a7d60-984f-4ed6-8cdf-c23125672a0f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:58.245885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b51a7d60-984f-4ed6-8cdf-c23125672a0f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:58.530577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b51a7d60-984f-4ed6-8cdf-c23125672a0f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:58.540433 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b51a7d60-984f-4ed6-8cdf-c23125672a0f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1511 microversion: 2.1 time: 0.324173 Jul 28 03:56:58.541439 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2475/4470] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:58 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1511 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:56:58.546376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ffec0694-1fe9-437c-8d7c-0590341b1c3e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:58.547002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ffec0694-1fe9-437c-8d7c-0590341b1c3e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:58.554931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffec0694-1fe9-437c-8d7c-0590341b1c3e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:58.556157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffec0694-1fe9-437c-8d7c-0590341b1c3e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:58.557301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffec0694-1fe9-437c-8d7c-0590341b1c3e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:58.557881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffec0694-1fe9-437c-8d7c-0590341b1c3e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:58.657036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ffec0694-1fe9-437c-8d7c-0590341b1c3e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:58.670039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ffec0694-1fe9-437c-8d7c-0590341b1c3e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:58.672588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ffec0694-1fe9-437c-8d7c-0590341b1c3e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:58.673362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-08f0d59a-11da-4d76-aa2b-bde41c7d7d98 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:58.674547 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ffec0694-1fe9-437c-8d7c-0590341b1c3e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1593 microversion: 2.32 time: 0.131996 Jul 28 03:56:58.675591 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2476/4471] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:58 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1593 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:56:58.683054 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-08f0d59a-11da-4d76-aa2b-bde41c7d7d98 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1324 microversion: 2.1 time: 0.842595 Jul 28 03:56:58.700748 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1996/4472] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:57 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1324 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:58.704188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5bc1ce0b-db4d-408f-bfb0-f90fe0a37c7a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:58.704905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5bc1ce0b-db4d-408f-bfb0-f90fe0a37c7a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:58.718520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5bc1ce0b-db4d-408f-bfb0-f90fe0a37c7a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:58.719100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5bc1ce0b-db4d-408f-bfb0-f90fe0a37c7a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:58.720133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5bc1ce0b-db4d-408f-bfb0-f90fe0a37c7a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:58.720727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5bc1ce0b-db4d-408f-bfb0-f90fe0a37c7a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:59.013491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5bc1ce0b-db4d-408f-bfb0-f90fe0a37c7a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:59.027665 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5bc1ce0b-db4d-408f-bfb0-f90fe0a37c7a tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1505 microversion: 2.1 time: 0.326837 Jul 28 03:56:59.029193 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2477/4473] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:58 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:56:59.568114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b5df1963-340b-426d-8dee-bc5687fe34e3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:59.568700 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b5df1963-340b-426d-8dee-bc5687fe34e3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:59.585586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5df1963-340b-426d-8dee-bc5687fe34e3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:59.588903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5df1963-340b-426d-8dee-bc5687fe34e3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:59.596198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5df1963-340b-426d-8dee-bc5687fe34e3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:59.597676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b5df1963-340b-426d-8dee-bc5687fe34e3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:59.706316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d10d0be1-370a-4f4f-bc05-7b30febdda3f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:59.707556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d10d0be1-370a-4f4f-bc05-7b30febdda3f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:59.724826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d10d0be1-370a-4f4f-bc05-7b30febdda3f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:59.725651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d10d0be1-370a-4f4f-bc05-7b30febdda3f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:59.726674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d10d0be1-370a-4f4f-bc05-7b30febdda3f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:59.734300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d10d0be1-370a-4f4f-bc05-7b30febdda3f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:59.890754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d10d0be1-370a-4f4f-bc05-7b30febdda3f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:59.910088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d10d0be1-370a-4f4f-bc05-7b30febdda3f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:59.912959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d10d0be1-370a-4f4f-bc05-7b30febdda3f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:56:59.915369 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d10d0be1-370a-4f4f-bc05-7b30febdda3f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1593 microversion: 2.32 time: 0.219652 Jul 28 03:56:59.917080 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2478/4474] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:56:59 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1593 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:56:59.923076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6923ba16-dbd4-4a2f-8100-b9bb6f4cb2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:56:59.924842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6923ba16-dbd4-4a2f-8100-b9bb6f4cb2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:56:59.962255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6923ba16-dbd4-4a2f-8100-b9bb6f4cb2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:59.963530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6923ba16-dbd4-4a2f-8100-b9bb6f4cb2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:56:59.964772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6923ba16-dbd4-4a2f-8100-b9bb6f4cb2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:56:59.967253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6923ba16-dbd4-4a2f-8100-b9bb6f4cb2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:00.286640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6923ba16-dbd4-4a2f-8100-b9bb6f4cb2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:00.296866 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6923ba16-dbd4-4a2f-8100-b9bb6f4cb2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1324 microversion: 2.1 time: 0.378330 Jul 28 03:57:00.312143 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2479/4475] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:59 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1324 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:00.317672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-dfd5731a-869c-452d-909d-bb371697e265 req-9e84e5db-a9ba-40cb-a15d-b0fe01d07bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb45614-0607-46f1-90bc-e064c206adea", "name": "network-vif-plugged", "status": "completed", "tag": "72d248d2-7689-4773-96a2-0a68ee2aa720"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:00.324038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b5df1963-340b-426d-8dee-bc5687fe34e3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:00.353473 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b5df1963-340b-426d-8dee-bc5687fe34e3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1511 microversion: 2.1 time: 0.794042 Jul 28 03:57:00.369688 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1997/4476] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:56:59 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1511 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:00.374674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8bb9803c-fcb7-4170-be1a-2f84f22f0a8e tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:00.375320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8bb9803c-fcb7-4170-be1a-2f84f22f0a8e tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:00.382906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-dfd5731a-869c-452d-909d-bb371697e265 req-9e84e5db-a9ba-40cb-a15d-b0fe01d07bbf service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:00.383370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-dfd5731a-869c-452d-909d-bb371697e265 req-9e84e5db-a9ba-40cb-a15d-b0fe01d07bbf service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:00.398443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bb9803c-fcb7-4170-be1a-2f84f22f0a8e tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:00.399183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bb9803c-fcb7-4170-be1a-2f84f22f0a8e tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:00.400153 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bb9803c-fcb7-4170-be1a-2f84f22f0a8e tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:00.400779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bb9803c-fcb7-4170-be1a-2f84f22f0a8e tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:00.408771 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-dfd5731a-869c-452d-909d-bb371697e265 req-9e84e5db-a9ba-40cb-a15d-b0fe01d07bbf service nova] Creating event network-vif-plugged:72d248d2-7689-4773-96a2-0a68ee2aa720 for instance acb45614-0607-46f1-90bc-e064c206adea on n-h2-826756-3 Jul 28 03:57:00.420145 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-dfd5731a-869c-452d-909d-bb371697e265 req-9e84e5db-a9ba-40cb-a15d-b0fe01d07bbf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106172 Jul 28 03:57:00.429787 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2480/4477] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:00.642360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8bb9803c-fcb7-4170-be1a-2f84f22f0a8e tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcd7c1f106fe47bab0c75bd81a3689ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51fdacaa518c4e69a3af11d7e92dec1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:00.663096 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8bb9803c-fcb7-4170-be1a-2f84f22f0a8e tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 200 len: 1463 microversion: 2.1 time: 0.291234 Jul 28 03:57:00.666649 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1998/4478] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:00 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 1463 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:00.943951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0cbcc453-71a2-4c57-a0fa-50482a6e0f21 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:00.946933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0cbcc453-71a2-4c57-a0fa-50482a6e0f21 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:00.978393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cbcc453-71a2-4c57-a0fa-50482a6e0f21 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:00.979226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cbcc453-71a2-4c57-a0fa-50482a6e0f21 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:00.980281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cbcc453-71a2-4c57-a0fa-50482a6e0f21 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:00.980908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cbcc453-71a2-4c57-a0fa-50482a6e0f21 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:01.020965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-60567c46-3666-40b2-b01e-1ba7bb2018ee req-9682b28c-bcc7-4682-b70d-8c16957dcb52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0880950-7d28-4b67-b1da-2c0a2837a94b", "name": "network-vif-deleted", "tag": "b62f3751-6f21-4235-a655-134ef0a4f4fb"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:01.065400 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-60567c46-3666-40b2-b01e-1ba7bb2018ee req-9682b28c-bcc7-4682-b70d-8c16957dcb52 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:01.066153 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-60567c46-3666-40b2-b01e-1ba7bb2018ee req-9682b28c-bcc7-4682-b70d-8c16957dcb52 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:01.117794 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-60567c46-3666-40b2-b01e-1ba7bb2018ee req-9682b28c-bcc7-4682-b70d-8c16957dcb52 service nova] Creating event network-vif-deleted:b62f3751-6f21-4235-a655-134ef0a4f4fb for instance c0880950-7d28-4b67-b1da-2c0a2837a94b on n-h1-826756-3 Jul 28 03:57:01.150006 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-60567c46-3666-40b2-b01e-1ba7bb2018ee req-9682b28c-bcc7-4682-b70d-8c16957dcb52 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118657 Jul 28 03:57:01.151665 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 1999/4479] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:01.232283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0cbcc453-71a2-4c57-a0fa-50482a6e0f21 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:01.245641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0cbcc453-71a2-4c57-a0fa-50482a6e0f21 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:01.247750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0cbcc453-71a2-4c57-a0fa-50482a6e0f21 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:01.249717 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0cbcc453-71a2-4c57-a0fa-50482a6e0f21 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1593 microversion: 2.32 time: 0.312928 Jul 28 03:57:01.276756 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2481/4480] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:00 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1593 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:01.320672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-980b97af-d121-492f-a445-503a57224b14 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:01.321528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-980b97af-d121-492f-a445-503a57224b14 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:01.332838 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-980b97af-d121-492f-a445-503a57224b14 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:01.333317 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-980b97af-d121-492f-a445-503a57224b14 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:01.334127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-980b97af-d121-492f-a445-503a57224b14 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:01.334568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-980b97af-d121-492f-a445-503a57224b14 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:01.377986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cfadff8e-faf6-4cac-975f-812c0d94c7c2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:01.377986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cfadff8e-faf6-4cac-975f-812c0d94c7c2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:01.390751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfadff8e-faf6-4cac-975f-812c0d94c7c2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:01.391203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfadff8e-faf6-4cac-975f-812c0d94c7c2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:01.392016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfadff8e-faf6-4cac-975f-812c0d94c7c2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:01.395794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfadff8e-faf6-4cac-975f-812c0d94c7c2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:02.021436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cfadff8e-faf6-4cac-975f-812c0d94c7c2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:02.048513 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cfadff8e-faf6-4cac-975f-812c0d94c7c2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1511 microversion: 2.1 time: 0.666531 Jul 28 03:57:02.075966 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2482/4481] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:01 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1511 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:57:02.087490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4a2faae-6f5d-4a08-b117-ffc173a7a5f9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:02.088130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4a2faae-6f5d-4a08-b117-ffc173a7a5f9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:02.103698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4a2faae-6f5d-4a08-b117-ffc173a7a5f9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:02.116760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4a2faae-6f5d-4a08-b117-ffc173a7a5f9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:02.121801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4a2faae-6f5d-4a08-b117-ffc173a7a5f9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:02.122761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4a2faae-6f5d-4a08-b117-ffc173a7a5f9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:02.174057 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-a4a2faae-6f5d-4a08-b117-ffc173a7a5f9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] HTTP exception thrown: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4a2faae-6f5d-4a08-b117-ffc173a7a5f9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Request method failure captured: Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b HTTP/1.1 Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjpm4zmFhqP9-Ax9nPRVlcqgNe23z_1PtRfrSKLgKiZ0XEfjteQmBPsBX2SitpSJgJRr_ehkO1UaDuR3hygdhi-Vb8MCYf6TWxdeiXStPBL8nAoZBvisu_eC8EBbe6cPVewNNL8lA5oahmvlLatTnRUx2BfysCb7NqifXwb0Uy_83k Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 51fdacaa518c4e69a3af11d7e92dec1e Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "tempest-type-58461595", "name": "tempest-service-1229007773", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51fdacaa518c4e69a3af11d7e92dec1e"}]}] Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 51fdacaa518c4e69a3af11d7e92dec1e Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerGroupTestJSON-306423488-project Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: dcd7c1f106fe47bab0c75bd81a3689ee Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerGroupTestJSON-306423488-project Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c0880950-7d28-4b67-b1da-2c0a2837a94b'} Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.181475 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:02.186424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.186424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.186424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:02.186424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:02.186424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:57:02.186424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:57:02.186424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.186424 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.198539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4a2faae-6f5d-4a08-b117-ffc173a7a5f9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Returning 404 to user: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:57:02.199768 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4a2faae-6f5d-4a08-b117-ffc173a7a5f9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 404 len: 111 microversion: 2.1 time: 0.122540 Jul 28 03:57:02.201627 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2483/4482] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:02 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:57:02.218518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a6f73690-2c34-4ac9-9c88-4aec1fc31995 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:02.241440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.compute.server_groups [None req-a6f73690-2c34-4ac9-9c88-4aec1fc31995 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Querying cell a8b3e198-f422-4bf1-ae6c-bd38905d4b84(cell1) for 1 instances {{(pid=126071) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 28 03:57:02.249449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6f73690-2c34-4ac9-9c88-4aec1fc31995 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:02.250254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6f73690-2c34-4ac9-9c88-4aec1fc31995 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:02.266670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-980b97af-d121-492f-a445-503a57224b14 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:02.277546 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a6f73690-2c34-4ac9-9c88-4aec1fc31995 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.066311 Jul 28 03:57:02.280669 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-980b97af-d121-492f-a445-503a57224b14 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1324 microversion: 2.1 time: 0.965279 Jul 28 03:57:02.288731 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2484/4483] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 03:57:02 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:02.298597 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2000/4484] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:01 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1324 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:02.309455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ed49243d-8bd1-444a-8c98-70d1e9b8b64c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:02.319755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e082ef1b-e758-463b-91e0-ac34963243a5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:02.320558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e082ef1b-e758-463b-91e0-ac34963243a5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:02.335244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e082ef1b-e758-463b-91e0-ac34963243a5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:02.335691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e082ef1b-e758-463b-91e0-ac34963243a5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:02.336805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e082ef1b-e758-463b-91e0-ac34963243a5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:02.337293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e082ef1b-e758-463b-91e0-ac34963243a5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:02.352581 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.compute.server_groups [None req-ed49243d-8bd1-444a-8c98-70d1e9b8b64c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Querying cell a8b3e198-f422-4bf1-ae6c-bd38905d4b84(cell1) for 1 instances {{(pid=126072) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 28 03:57:02.353489 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed49243d-8bd1-444a-8c98-70d1e9b8b64c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:02.353961 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed49243d-8bd1-444a-8c98-70d1e9b8b64c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:02.384473 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ed49243d-8bd1-444a-8c98-70d1e9b8b64c tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/os-server-groups/cce60740-8ec7-40ca-952f-2e87457f2118" status: 200 len: 183 microversion: 2.1 time: 0.082730 Jul 28 03:57:02.385224 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2001/4485] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 03:57:02 2022] GET /compute/v2.1/os-server-groups/cce60740-8ec7-40ca-952f-2e87457f2118 => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:02.447139 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-40481049-779d-4b82-b5a6-8e0177560ed7 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:02.448263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-40481049-779d-4b82-b5a6-8e0177560ed7 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:02.484984 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40481049-779d-4b82-b5a6-8e0177560ed7 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:02.485882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40481049-779d-4b82-b5a6-8e0177560ed7 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:02.491934 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40481049-779d-4b82-b5a6-8e0177560ed7 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:02.493649 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-40481049-779d-4b82-b5a6-8e0177560ed7 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:02.526510 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-40481049-779d-4b82-b5a6-8e0177560ed7 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] HTTP exception thrown: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-40481049-779d-4b82-b5a6-8e0177560ed7 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Request method failure captured: Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b HTTP/1.1 Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gjpm4zmFhqP9-Ax9nPRVlcqgNe23z_1PtRfrSKLgKiZ0XEfjteQmBPsBX2SitpSJgJRr_ehkO1UaDuR3hygdhi-Vb8MCYf6TWxdeiXStPBL8nAoZBvisu_eC8EBbe6cPVewNNL8lA5oahmvlLatTnRUx2BfysCb7NqifXwb0Uy_83k Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 51fdacaa518c4e69a3af11d7e92dec1e Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "tempest-type-58461595", "name": "tempest-service-1229007773", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51fdacaa518c4e69a3af11d7e92dec1e"}]}] Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 51fdacaa518c4e69a3af11d7e92dec1e Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerGroupTestJSON-306423488-project Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: dcd7c1f106fe47bab0c75bd81a3689ee Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerGroupTestJSON-306423488-project Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'c0880950-7d28-4b67-b1da-2c0a2837a94b'} Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:57:02.528547 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:57:02.532799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.532799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.532799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:02.532799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.532799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.532799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:02.532799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:02.532799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:57:02.532799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:57:02.532799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.532799 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.532799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-40481049-779d-4b82-b5a6-8e0177560ed7 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Returning 404 to user: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:57:02.532799 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-40481049-779d-4b82-b5a6-8e0177560ed7 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 404 len: 111 microversion: 2.1 time: 0.112838 Jul 28 03:57:02.534881 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2002/4486] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:57:02 2022] DELETE /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:57:02.540726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2311272d-6859-4998-8348-d265aa7641d9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:02.541347 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2311272d-6859-4998-8348-d265aa7641d9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] [instance: c0880950-7d28-4b67-b1da-2c0a2837a94b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:02.550671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2311272d-6859-4998-8348-d265aa7641d9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:02.551477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2311272d-6859-4998-8348-d265aa7641d9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:02.552612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2311272d-6859-4998-8348-d265aa7641d9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:02.553216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2311272d-6859-4998-8348-d265aa7641d9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:02.572978 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-2311272d-6859-4998-8348-d265aa7641d9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] HTTP exception thrown: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2311272d-6859-4998-8348-d265aa7641d9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Request method failure captured: Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b HTTP/1.1 Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gjpm4zmFhqP9-Ax9nPRVlcqgNe23z_1PtRfrSKLgKiZ0XEfjteQmBPsBX2SitpSJgJRr_ehkO1UaDuR3hygdhi-Vb8MCYf6TWxdeiXStPBL8nAoZBvisu_eC8EBbe6cPVewNNL8lA5oahmvlLatTnRUx2BfysCb7NqifXwb0Uy_83k Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 51fdacaa518c4e69a3af11d7e92dec1e Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "tempest-type-58461595", "name": "tempest-service-1229007773", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51fdacaa518c4e69a3af11d7e92dec1e"}]}] Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 51fdacaa518c4e69a3af11d7e92dec1e Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerGroupTestJSON-306423488-project Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: dcd7c1f106fe47bab0c75bd81a3689ee Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerGroupTestJSON-306423488-project Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'c0880950-7d28-4b67-b1da-2c0a2837a94b'} Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.574809 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:02.579269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.579269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.579269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:02.579269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:02.579269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:57:02.579269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:57:02.579269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. Jul 28 03:57:02.579269 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.581015 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2311272d-6859-4998-8348-d265aa7641d9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Returning 404 to user: Instance c0880950-7d28-4b67-b1da-2c0a2837a94b could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:57:02.582062 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2311272d-6859-4998-8348-d265aa7641d9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b" status: 404 len: 111 microversion: 2.1 time: 0.046009 Jul 28 03:57:02.582825 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2003/4487] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:02 2022] GET /compute/v2.1/servers/c0880950-7d28-4b67-b1da-2c0a2837a94b => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:57:02.592858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aa8d2110-bf3f-4cde-a88f-513d70d5b19f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:02.601729 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-aa8d2110-bf3f-4cde-a88f-513d70d5b19f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] HTTP exception thrown: Instance group a392ba2e-6f96-47ac-9e79-5a08090e5252 could not be found. Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aa8d2110-bf3f-4cde-a88f-513d70d5b19f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Request method failure captured: Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/os-server-groups/a392ba2e-6f96-47ac-9e79-5a08090e5252 HTTP/1.1 Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gjpm4zmFhqP9-Ax9nPRVlcqgNe23z_1PtRfrSKLgKiZ0XEfjteQmBPsBX2SitpSJgJRr_ehkO1UaDuR3hygdhi-Vb8MCYf6TWxdeiXStPBL8nAoZBvisu_eC8EBbe6cPVewNNL8lA5oahmvlLatTnRUx2BfysCb7NqifXwb0Uy_83k Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 51fdacaa518c4e69a3af11d7e92dec1e Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "tempest-type-58461595", "name": "tempest-service-1229007773", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51fdacaa518c4e69a3af11d7e92dec1e"}]}] Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 51fdacaa518c4e69a3af11d7e92dec1e Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerGroupTestJSON-306423488-project Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: dcd7c1f106fe47bab0c75bd81a3689ee Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerGroupTestJSON-306423488-project Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance group a392ba2e-6f96-47ac-9e79-5a08090e5252 could not be found. Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'a392ba2e-6f96-47ac-9e79-5a08090e5252'} Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a392ba2e-6f96-47ac-9e79-5a08090e5252 could not be found. Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a392ba2e-6f96-47ac-9e79-5a08090e5252 could not be found. Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:02.613927 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.617400 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.617400 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:02.617400 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:02.617400 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:57:02.617400 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:57:02.617400 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a392ba2e-6f96-47ac-9e79-5a08090e5252 could not be found. Jul 28 03:57:02.617400 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.619870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aa8d2110-bf3f-4cde-a88f-513d70d5b19f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Returning 404 to user: Instance group a392ba2e-6f96-47ac-9e79-5a08090e5252 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:57:02.621451 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aa8d2110-bf3f-4cde-a88f-513d70d5b19f tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/a392ba2e-6f96-47ac-9e79-5a08090e5252" status: 404 len: 117 microversion: 2.1 time: 0.033710 Jul 28 03:57:02.626695 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2004/4488] 10.222.0.48 () {58 vars in 1266 bytes} [Thu Jul 28 03:57:02 2022] DELETE /compute/v2.1/os-server-groups/a392ba2e-6f96-47ac-9e79-5a08090e5252 => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:57:02.635542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-adb234b9-b7ee-4141-9473-d48a9ae73ef8 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:02.648547 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-adb234b9-b7ee-4141-9473-d48a9ae73ef8 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] HTTP exception thrown: Instance group bd3a9dae-91a9-4688-943c-2c2c31764d3d could not be found. Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-adb234b9-b7ee-4141-9473-d48a9ae73ef8 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Request method failure captured: Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/os-server-groups/bd3a9dae-91a9-4688-943c-2c2c31764d3d HTTP/1.1 Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gjpm4zmFhqP9-Ax9nPRVlcqgNe23z_1PtRfrSKLgKiZ0XEfjteQmBPsBX2SitpSJgJRr_ehkO1UaDuR3hygdhi-Vb8MCYf6TWxdeiXStPBL8nAoZBvisu_eC8EBbe6cPVewNNL8lA5oahmvlLatTnRUx2BfysCb7NqifXwb0Uy_83k Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 51fdacaa518c4e69a3af11d7e92dec1e Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "tempest-type-58461595", "name": "tempest-service-1229007773", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51fdacaa518c4e69a3af11d7e92dec1e"}]}] Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 51fdacaa518c4e69a3af11d7e92dec1e Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerGroupTestJSON-306423488-project Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: dcd7c1f106fe47bab0c75bd81a3689ee Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerGroupTestJSON-306423488-project Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance group bd3a9dae-91a9-4688-943c-2c2c31764d3d could not be found. Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'bd3a9dae-91a9-4688-943c-2c2c31764d3d'} Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group bd3a9dae-91a9-4688-943c-2c2c31764d3d could not be found. Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group bd3a9dae-91a9-4688-943c-2c2c31764d3d could not be found. Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:02.653800 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.667981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.667981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:02.667981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:02.667981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:57:02.667981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:57:02.667981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group bd3a9dae-91a9-4688-943c-2c2c31764d3d could not be found. Jul 28 03:57:02.667981 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.674542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-adb234b9-b7ee-4141-9473-d48a9ae73ef8 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Returning 404 to user: Instance group bd3a9dae-91a9-4688-943c-2c2c31764d3d could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:57:02.676560 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-adb234b9-b7ee-4141-9473-d48a9ae73ef8 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/bd3a9dae-91a9-4688-943c-2c2c31764d3d" status: 404 len: 117 microversion: 2.1 time: 0.047662 Jul 28 03:57:02.677402 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2005/4489] 10.222.0.48 () {58 vars in 1266 bytes} [Thu Jul 28 03:57:02 2022] DELETE /compute/v2.1/os-server-groups/bd3a9dae-91a9-4688-943c-2c2c31764d3d => generated 117 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:57:02.698959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d8be72ec-e6d9-4ba2-8715-958271af3ef9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:02.710876 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-d8be72ec-e6d9-4ba2-8715-958271af3ef9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] HTTP exception thrown: Instance group c7d44285-3077-410d-88a3-d6734a2f827b could not be found. Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d8be72ec-e6d9-4ba2-8715-958271af3ef9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Request method failure captured: Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/os-server-groups/c7d44285-3077-410d-88a3-d6734a2f827b HTTP/1.1 Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gjpm4zmFhqP9-Ax9nPRVlcqgNe23z_1PtRfrSKLgKiZ0XEfjteQmBPsBX2SitpSJgJRr_ehkO1UaDuR3hygdhi-Vb8MCYf6TWxdeiXStPBL8nAoZBvisu_eC8EBbe6cPVewNNL8lA5oahmvlLatTnRUx2BfysCb7NqifXwb0Uy_83k Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 51fdacaa518c4e69a3af11d7e92dec1e Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "tempest-type-58461595", "name": "tempest-service-1229007773", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51fdacaa518c4e69a3af11d7e92dec1e"}]}] Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 51fdacaa518c4e69a3af11d7e92dec1e Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerGroupTestJSON-306423488-project Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: dcd7c1f106fe47bab0c75bd81a3689ee Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerGroupTestJSON-306423488-project Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance group c7d44285-3077-410d-88a3-d6734a2f827b could not be found. Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'c7d44285-3077-410d-88a3-d6734a2f827b'} Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c7d44285-3077-410d-88a3-d6734a2f827b could not be found. Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c7d44285-3077-410d-88a3-d6734a2f827b could not be found. Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:02.713229 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.720208 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.720208 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:02.720208 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:02.720208 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:57:02.720208 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:57:02.720208 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c7d44285-3077-410d-88a3-d6734a2f827b could not be found. Jul 28 03:57:02.720208 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.722586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d8be72ec-e6d9-4ba2-8715-958271af3ef9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Returning 404 to user: Instance group c7d44285-3077-410d-88a3-d6734a2f827b could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:57:02.725281 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d8be72ec-e6d9-4ba2-8715-958271af3ef9 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/c7d44285-3077-410d-88a3-d6734a2f827b" status: 404 len: 117 microversion: 2.1 time: 0.039573 Jul 28 03:57:02.726200 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2006/4490] 10.222.0.48 () {58 vars in 1266 bytes} [Thu Jul 28 03:57:02 2022] DELETE /compute/v2.1/os-server-groups/c7d44285-3077-410d-88a3-d6734a2f827b => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:57:02.746723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-deef3712-7328-41d4-99c2-76bceb0a49d8 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:02.777643 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-deef3712-7328-41d4-99c2-76bceb0a49d8 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] HTTP exception thrown: Instance group 1d33ee28-784c-41e8-b806-be23a20d3a7e could not be found. Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-deef3712-7328-41d4-99c2-76bceb0a49d8 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Request method failure captured: Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/os-server-groups/1d33ee28-784c-41e8-b806-be23a20d3a7e HTTP/1.1 Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gjpm4zmFhqP9-Ax9nPRVlcqgNe23z_1PtRfrSKLgKiZ0XEfjteQmBPsBX2SitpSJgJRr_ehkO1UaDuR3hygdhi-Vb8MCYf6TWxdeiXStPBL8nAoZBvisu_eC8EBbe6cPVewNNL8lA5oahmvlLatTnRUx2BfysCb7NqifXwb0Uy_83k Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 51fdacaa518c4e69a3af11d7e92dec1e Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "tempest-type-58461595", "name": "tempest-service-1229007773", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_51fdacaa518c4e69a3af11d7e92dec1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/51fdacaa518c4e69a3af11d7e92dec1e"}]}] Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 51fdacaa518c4e69a3af11d7e92dec1e Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerGroupTestJSON-306423488 Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerGroupTestJSON-306423488-project Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: dcd7c1f106fe47bab0c75bd81a3689ee Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerGroupTestJSON-306423488-project Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance group 1d33ee28-784c-41e8-b806-be23a20d3a7e could not be found. Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '1d33ee28-784c-41e8-b806-be23a20d3a7e'} Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1d33ee28-784c-41e8-b806-be23a20d3a7e could not be found. Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1d33ee28-784c-41e8-b806-be23a20d3a7e could not be found. Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:02.781612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.789010 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:02.789010 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:02.789010 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:02.789010 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:57:02.789010 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:57:02.789010 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1d33ee28-784c-41e8-b806-be23a20d3a7e could not be found. Jul 28 03:57:02.789010 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:57:02.794130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-deef3712-7328-41d4-99c2-76bceb0a49d8 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Returning 404 to user: Instance group 1d33ee28-784c-41e8-b806-be23a20d3a7e could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:57:02.796067 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-deef3712-7328-41d4-99c2-76bceb0a49d8 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/1d33ee28-784c-41e8-b806-be23a20d3a7e" status: 404 len: 117 microversion: 2.1 time: 0.059747 Jul 28 03:57:02.803810 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2007/4491] 10.222.0.48 () {58 vars in 1266 bytes} [Thu Jul 28 03:57:02 2022] DELETE /compute/v2.1/os-server-groups/1d33ee28-784c-41e8-b806-be23a20d3a7e => generated 117 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:57:02.815598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-73f2ffc1-d137-43cc-b9eb-2fe2b4801638 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:02.862404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e082ef1b-e758-463b-91e0-ac34963243a5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:02.865038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:02.869442 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-73f2ffc1-d137-43cc-b9eb-2fe2b4801638 tempest-ServerGroupTestJSON-306423488 tempest-ServerGroupTestJSON-306423488-project] 10.222.0.48 "DELETE /compute/v2.1/os-server-groups/cce60740-8ec7-40ca-952f-2e87457f2118" status: 204 len: 0 microversion: 2.1 time: 0.063938 Jul 28 03:57:02.875804 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2008/4492] 10.222.0.48 () {58 vars in 1266 bytes} [Thu Jul 28 03:57:02 2022] DELETE /compute/v2.1/os-server-groups/cce60740-8ec7-40ca-952f-2e87457f2118 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:57:02.886260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e082ef1b-e758-463b-91e0-ac34963243a5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:02.888324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e082ef1b-e758-463b-91e0-ac34963243a5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:02.889939 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e082ef1b-e758-463b-91e0-ac34963243a5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1661 microversion: 2.32 time: 0.607355 Jul 28 03:57:02.893124 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2485/4493] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:02 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1661 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:03.085278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a14c8fa7-7b24-4d30-b378-b178eb58db07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:03.088825 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a14c8fa7-7b24-4d30-b378-b178eb58db07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:03.113606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a14c8fa7-7b24-4d30-b378-b178eb58db07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:03.114794 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a14c8fa7-7b24-4d30-b378-b178eb58db07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:03.118841 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a14c8fa7-7b24-4d30-b378-b178eb58db07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:03.121671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a14c8fa7-7b24-4d30-b378-b178eb58db07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:03.322060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eec49744-80a4-48bb-a462-5aba2a57b188 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:03.324084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eec49744-80a4-48bb-a462-5aba2a57b188 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:03.350786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eec49744-80a4-48bb-a462-5aba2a57b188 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:03.352684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eec49744-80a4-48bb-a462-5aba2a57b188 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:03.354413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eec49744-80a4-48bb-a462-5aba2a57b188 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:03.357038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eec49744-80a4-48bb-a462-5aba2a57b188 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:03.709107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eec49744-80a4-48bb-a462-5aba2a57b188 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:03.718856 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eec49744-80a4-48bb-a462-5aba2a57b188 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1522 microversion: 2.1 time: 0.402745 Jul 28 03:57:03.723196 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2486/4494] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:03 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:03.747726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a9c8042-c25d-4c92-8fc8-c50dd011ed0f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:03.749046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1a9c8042-c25d-4c92-8fc8-c50dd011ed0f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:03.759630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a9c8042-c25d-4c92-8fc8-c50dd011ed0f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:03.760385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a9c8042-c25d-4c92-8fc8-c50dd011ed0f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:03.761354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a9c8042-c25d-4c92-8fc8-c50dd011ed0f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:03.761961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a9c8042-c25d-4c92-8fc8-c50dd011ed0f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:03.774014 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a14c8fa7-7b24-4d30-b378-b178eb58db07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:03.781269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:03.790537 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a14c8fa7-7b24-4d30-b378-b178eb58db07 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1511 microversion: 2.1 time: 0.714419 Jul 28 03:57:03.808583 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2009/4495] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:03 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1511 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:03.916975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2276e4b7-64c0-4fcb-986f-817462042d15 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:03.920059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2276e4b7-64c0-4fcb-986f-817462042d15 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:03.935024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2276e4b7-64c0-4fcb-986f-817462042d15 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:03.935870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2276e4b7-64c0-4fcb-986f-817462042d15 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:03.936900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2276e4b7-64c0-4fcb-986f-817462042d15 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:03.937502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2276e4b7-64c0-4fcb-986f-817462042d15 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:03.999345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1a9c8042-c25d-4c92-8fc8-c50dd011ed0f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:04.009064 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1a9c8042-c25d-4c92-8fc8-c50dd011ed0f tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1522 microversion: 2.1 time: 0.265245 Jul 28 03:57:04.010529 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2487/4496] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:03 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:57:04.032740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-547f3414-3ac3-416e-857f-6011730f4a67 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1033011019"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:04.035770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-547f3414-3ac3-416e-857f-6011730f4a67 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:04.043167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-547f3414-3ac3-416e-857f-6011730f4a67 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:04.043909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-547f3414-3ac3-416e-857f-6011730f4a67 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:04.044976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-547f3414-3ac3-416e-857f-6011730f4a67 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:04.045608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-547f3414-3ac3-416e-857f-6011730f4a67 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:04.307767 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-547f3414-3ac3-416e-857f-6011730f4a67 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "POST /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea/action" status: 202 len: 0 microversion: 2.1 time: 0.279577 Jul 28 03:57:04.309915 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2488/4497] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:57:04 2022] POST /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 03:57:04.323119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d0d79e69-acec-4239-bae1-53b1a4c5f31b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '.version_select at 0x7ffa740bdb80>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:04.542601 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2276e4b7-64c0-4fcb-986f-817462042d15 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:04.549064 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d0d79e69-acec-4239-bae1-53b1a4c5f31b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "DELETE /compute/v2.1/images/a6641cd8-bbc0-4f8a-9a3c-818588837bf6" status: 204 len: 0 microversion: 2.1 time: 0.231256 Jul 28 03:57:04.549966 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2489/4498] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:04 2022] DELETE /compute/v2.1/images/a6641cd8-bbc0-4f8a-9a3c-818588837bf6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:57:04.560014 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2276e4b7-64c0-4fcb-986f-817462042d15 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:04.561870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2276e4b7-64c0-4fcb-986f-817462042d15 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:04.563316 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2276e4b7-64c0-4fcb-986f-817462042d15 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1661 microversion: 2.32 time: 0.650511 Jul 28 03:57:04.565239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a009d8b-9b6c-4b65-965a-a07bc081c39a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '.version_select at 0x7ffa79957700>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:04.596740 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2010/4499] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:03 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1661 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:57:04.612211 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-1a009d8b-9b6c-4b65-965a-a07bc081c39a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] HTTP exception thrown: Image not found. Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a009d8b-9b6c-4b65-965a-a07bc081c39a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Request method failure captured: Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/images/a6641cd8-bbc0-4f8a-9a3c-818588837bf6 HTTP/1.1 Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjBY0mYKCXtj0_d2uaizZHT_bTm8g67l0hNznQ_KVINZT1siV-lKxZREHB__mQh0Osf7Cog-lCJIGpJJ_mIo_1i4LQ-Uw87qYT7Q9LIdNSOqrDCo-x87gq81TQtloPebhhpc4TesbUzk376RJomPlfVbclxoCv7QtBWHpejAHdY1so Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}] Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 5265a6963e6e46c8bc7657bcf081362a Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: exception: Image not found. Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a6641cd8-bbc0-4f8a-9a3c-818588837bf6'} Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a6641cd8-bbc0-4f8a-9a3c-818588837bf6 Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 28 03:57:04.616543 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a6641cd8-bbc0-4f8a-9a3c-818588837bf6 could not be found. Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a009d8b-9b6c-4b65-965a-a07bc081c39a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Returning 404 to user: Image not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1a009d8b-9b6c-4b65-965a-a07bc081c39a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/images/a6641cd8-bbc0-4f8a-9a3c-818588837bf6" status: 404 len: 62 microversion: 2.1 time: 0.063906 Jul 28 03:57:04.625324 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2490/4500] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Jul 28 03:57:04 2022] GET /compute/v2.1/images/a6641cd8-bbc0-4f8a-9a3c-818588837bf6 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 03:57:04.630653 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5e405dc0-2808-452c-826d-2f972d7701d3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:04.631462 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5e405dc0-2808-452c-826d-2f972d7701d3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:04.635739 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:04.658799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e405dc0-2808-452c-826d-2f972d7701d3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:04.659246 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e405dc0-2808-452c-826d-2f972d7701d3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:04.660312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e405dc0-2808-452c-826d-2f972d7701d3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:04.661573 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e405dc0-2808-452c-826d-2f972d7701d3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:04.816809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f79351ff-56a4-4f64-b933-dc119e87b953 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:04.818020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f79351ff-56a4-4f64-b933-dc119e87b953 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:04.836777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f79351ff-56a4-4f64-b933-dc119e87b953 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:04.837481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f79351ff-56a4-4f64-b933-dc119e87b953 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:04.838441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f79351ff-56a4-4f64-b933-dc119e87b953 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:04.839029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f79351ff-56a4-4f64-b933-dc119e87b953 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:05.264312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:05.383619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f79351ff-56a4-4f64-b933-dc119e87b953 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:05.396078 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f79351ff-56a4-4f64-b933-dc119e87b953 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1532 microversion: 2.1 time: 0.584368 Jul 28 03:57:05.400668 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2491/4501] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:04 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1532 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:05.594703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-22589d4f-fc50-4b11-8831-7d085533be64 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:05.595432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-22589d4f-fc50-4b11-8831-7d085533be64 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:05.616542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22589d4f-fc50-4b11-8831-7d085533be64 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:05.620984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22589d4f-fc50-4b11-8831-7d085533be64 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:05.622757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22589d4f-fc50-4b11-8831-7d085533be64 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:05.624849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22589d4f-fc50-4b11-8831-7d085533be64 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:05.722965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5e405dc0-2808-452c-826d-2f972d7701d3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:05.743392 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5e405dc0-2808-452c-826d-2f972d7701d3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1534 microversion: 2.1 time: 1.118062 Jul 28 03:57:05.748830 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2011/4502] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:04 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1534 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:06.113890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-22589d4f-fc50-4b11-8831-7d085533be64 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:06.130425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-22589d4f-fc50-4b11-8831-7d085533be64 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:06.164833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-22589d4f-fc50-4b11-8831-7d085533be64 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:06.174671 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-22589d4f-fc50-4b11-8831-7d085533be64 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1661 microversion: 2.32 time: 0.583773 Jul 28 03:57:06.194095 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2492/4503] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:05 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1661 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:06.422300 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-79e3ec2a-b65d-48a1-b9dd-afb400d14b6e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:06.424506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-79e3ec2a-b65d-48a1-b9dd-afb400d14b6e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:06.440384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-79e3ec2a-b65d-48a1-b9dd-afb400d14b6e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:06.440853 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-79e3ec2a-b65d-48a1-b9dd-afb400d14b6e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:06.445745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-79e3ec2a-b65d-48a1-b9dd-afb400d14b6e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:06.445872 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-79e3ec2a-b65d-48a1-b9dd-afb400d14b6e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:06.767769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a5f052ce-2b61-4649-8524-08b18b385fc2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:06.768623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a5f052ce-2b61-4649-8524-08b18b385fc2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:06.796550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5f052ce-2b61-4649-8524-08b18b385fc2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:06.801041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5f052ce-2b61-4649-8524-08b18b385fc2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:06.802395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5f052ce-2b61-4649-8524-08b18b385fc2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:06.803005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5f052ce-2b61-4649-8524-08b18b385fc2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:07.300117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=10 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:07.323918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a5f052ce-2b61-4649-8524-08b18b385fc2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:07.344084 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a5f052ce-2b61-4649-8524-08b18b385fc2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1540 microversion: 2.1 time: 0.581378 Jul 28 03:57:07.367545 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2493/4504] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:06 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1540 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:57:07.373300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f5e635c3-1dd0-434d-b9fb-1c187820159f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:07.377445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f5e635c3-1dd0-434d-b9fb-1c187820159f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:07.391423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5e635c3-1dd0-434d-b9fb-1c187820159f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:07.392990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5e635c3-1dd0-434d-b9fb-1c187820159f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:07.394149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5e635c3-1dd0-434d-b9fb-1c187820159f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:07.395215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5e635c3-1dd0-434d-b9fb-1c187820159f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:07.583664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-79e3ec2a-b65d-48a1-b9dd-afb400d14b6e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:07.638635 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-79e3ec2a-b65d-48a1-b9dd-afb400d14b6e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 1.222236 Jul 28 03:57:07.644062 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2012/4505] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:06 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:07.971905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f5e635c3-1dd0-434d-b9fb-1c187820159f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:07.992015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f5e635c3-1dd0-434d-b9fb-1c187820159f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:07.994377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f5e635c3-1dd0-434d-b9fb-1c187820159f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:07.995691 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f5e635c3-1dd0-434d-b9fb-1c187820159f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1708 microversion: 2.32 time: 0.626904 Jul 28 03:57:08.001002 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2494/4506] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:07 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1708 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:08.376066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1de07a56-f9e4-4296-b419-1525be779f73 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:08.376825 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1de07a56-f9e4-4296-b419-1525be779f73 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:08.384262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1de07a56-f9e4-4296-b419-1525be779f73 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:08.395370 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1de07a56-f9e4-4296-b419-1525be779f73 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:08.399439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1de07a56-f9e4-4296-b419-1525be779f73 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:08.402667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1de07a56-f9e4-4296-b419-1525be779f73 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:08.666090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df6a4923-d45e-4ae8-be25-b043ffaa50c3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:08.666707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-df6a4923-d45e-4ae8-be25-b043ffaa50c3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:08.682570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df6a4923-d45e-4ae8-be25-b043ffaa50c3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:08.686204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df6a4923-d45e-4ae8-be25-b043ffaa50c3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:08.688901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df6a4923-d45e-4ae8-be25-b043ffaa50c3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:08.692574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df6a4923-d45e-4ae8-be25-b043ffaa50c3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:08.912843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-df6a4923-d45e-4ae8-be25-b043ffaa50c3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:08.925913 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-df6a4923-d45e-4ae8-be25-b043ffaa50c3 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 0.263665 Jul 28 03:57:08.927121 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2495/4507] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:08 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:09.030086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-325994ec-879e-4872-a0db-2f4d2d2718ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:09.031990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-325994ec-879e-4872-a0db-2f4d2d2718ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:09.047739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-325994ec-879e-4872-a0db-2f4d2d2718ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:09.048663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-325994ec-879e-4872-a0db-2f4d2d2718ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:09.049903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-325994ec-879e-4872-a0db-2f4d2d2718ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:09.059753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-325994ec-879e-4872-a0db-2f4d2d2718ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:09.409896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-325994ec-879e-4872-a0db-2f4d2d2718ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:09.427609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-325994ec-879e-4872-a0db-2f4d2d2718ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:09.429484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-325994ec-879e-4872-a0db-2f4d2d2718ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:09.431405 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-325994ec-879e-4872-a0db-2f4d2d2718ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1708 microversion: 2.32 time: 0.407867 Jul 28 03:57:09.434632 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2496/4508] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:09 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1708 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:57:09.952154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a2d0c931-8234-439d-a11b-71ef76982d26 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:09.953188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a2d0c931-8234-439d-a11b-71ef76982d26 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:09.969414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2d0c931-8234-439d-a11b-71ef76982d26 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:09.970254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2d0c931-8234-439d-a11b-71ef76982d26 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:09.971320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2d0c931-8234-439d-a11b-71ef76982d26 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:09.971963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2d0c931-8234-439d-a11b-71ef76982d26 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:10.304336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a2d0c931-8234-439d-a11b-71ef76982d26 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:10.314716 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a2d0c931-8234-439d-a11b-71ef76982d26 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 0.366836 Jul 28 03:57:10.317681 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2497/4509] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:09 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:10.459299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62b7583f-0926-4cb2-9df3-cecf4d660885 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:10.459929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-62b7583f-0926-4cb2-9df3-cecf4d660885 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:10.472513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62b7583f-0926-4cb2-9df3-cecf4d660885 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:10.473403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62b7583f-0926-4cb2-9df3-cecf4d660885 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:10.475223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62b7583f-0926-4cb2-9df3-cecf4d660885 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:10.476317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62b7583f-0926-4cb2-9df3-cecf4d660885 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:10.565562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1de07a56-f9e4-4296-b419-1525be779f73 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:10.586275 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1de07a56-f9e4-4296-b419-1525be779f73 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1522 microversion: 2.1 time: 2.212984 Jul 28 03:57:10.589558 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2013/4510] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:08 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1522 bytes in 2218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:10.616374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0007527c-408c-48fa-bbae-c941de9150bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:10.618019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0007527c-408c-48fa-bbae-c941de9150bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:10.640173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0007527c-408c-48fa-bbae-c941de9150bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:10.643318 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0007527c-408c-48fa-bbae-c941de9150bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:10.645152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0007527c-408c-48fa-bbae-c941de9150bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:10.646986 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0007527c-408c-48fa-bbae-c941de9150bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:10.758044 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0007527c-408c-48fa-bbae-c941de9150bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:57:11.104655 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0007527c-408c-48fa-bbae-c941de9150bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "DELETE /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 204 len: 0 microversion: 2.1 time: 0.494426 Jul 28 03:57:11.106174 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2014/4511] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:57:10 2022] DELETE /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:57:11.143302 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-86abb5e1-e8e3-46a4-9559-f6e400db00da tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:11.144827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-86abb5e1-e8e3-46a4-9559-f6e400db00da tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:11.187282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86abb5e1-e8e3-46a4-9559-f6e400db00da tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:11.188115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86abb5e1-e8e3-46a4-9559-f6e400db00da tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:11.189498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86abb5e1-e8e3-46a4-9559-f6e400db00da tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:11.203812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86abb5e1-e8e3-46a4-9559-f6e400db00da tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:11.780522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62b7583f-0926-4cb2-9df3-cecf4d660885 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:11.821923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62b7583f-0926-4cb2-9df3-cecf4d660885 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:11.853311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62b7583f-0926-4cb2-9df3-cecf4d660885 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:11.856882 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-62b7583f-0926-4cb2-9df3-cecf4d660885 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1755 microversion: 2.32 time: 1.401298 Jul 28 03:57:11.863312 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2498/4512] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:10 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1755 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:11.895677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f84530e6-93a3-4ae0-89a0-ffd8af3b69a1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:11.900086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f84530e6-93a3-4ae0-89a0-ffd8af3b69a1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:11.980326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f84530e6-93a3-4ae0-89a0-ffd8af3b69a1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:11.985177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f84530e6-93a3-4ae0-89a0-ffd8af3b69a1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:11.986985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f84530e6-93a3-4ae0-89a0-ffd8af3b69a1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:11.988800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f84530e6-93a3-4ae0-89a0-ffd8af3b69a1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:12.941476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f84530e6-93a3-4ae0-89a0-ffd8af3b69a1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:12.955193 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f84530e6-93a3-4ae0-89a0-ffd8af3b69a1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 1.079810 Jul 28 03:57:12.961609 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2499/4513] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:11 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:12.967350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4b24ba24-5436-4b82-8f09-cdb88dad8c0a req-4e81dd6c-e7df-4be0-9746-e409849e7998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d97b518-6a6e-44f8-9be3-940b6fa8c853", "name": "network-vif-plugged", "status": "completed", "tag": "9ce2e89e-838e-4b08-b1df-2e933c36e5d1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:12.988093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4b24ba24-5436-4b82-8f09-cdb88dad8c0a req-4e81dd6c-e7df-4be0-9746-e409849e7998 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:12.989033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4b24ba24-5436-4b82-8f09-cdb88dad8c0a req-4e81dd6c-e7df-4be0-9746-e409849e7998 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:13.009931 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4b24ba24-5436-4b82-8f09-cdb88dad8c0a req-4e81dd6c-e7df-4be0-9746-e409849e7998 service nova] Creating event network-vif-plugged:9ce2e89e-838e-4b08-b1df-2e933c36e5d1 for instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 on n-h1-826756-3 Jul 28 03:57:13.019439 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4b24ba24-5436-4b82-8f09-cdb88dad8c0a req-4e81dd6c-e7df-4be0-9746-e409849e7998 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055182 Jul 28 03:57:13.021487 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2500/4514] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:13.030556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8da93c43-4565-4d9e-b3ae-92740db3fce5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:13.031577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8da93c43-4565-4d9e-b3ae-92740db3fce5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:13.040086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8da93c43-4565-4d9e-b3ae-92740db3fce5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:13.040767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8da93c43-4565-4d9e-b3ae-92740db3fce5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:13.041757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8da93c43-4565-4d9e-b3ae-92740db3fce5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:13.042405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8da93c43-4565-4d9e-b3ae-92740db3fce5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:13.343252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-86abb5e1-e8e3-46a4-9559-f6e400db00da tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:13.361362 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-86abb5e1-e8e3-46a4-9559-f6e400db00da tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1528 microversion: 2.1 time: 2.247315 Jul 28 03:57:13.375678 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2015/4515] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:11 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1528 bytes in 2263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:13.659304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8da93c43-4565-4d9e-b3ae-92740db3fce5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:13.685707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8da93c43-4565-4d9e-b3ae-92740db3fce5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:13.687819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8da93c43-4565-4d9e-b3ae-92740db3fce5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:13.695936 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8da93c43-4565-4d9e-b3ae-92740db3fce5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1755 microversion: 2.32 time: 0.672314 Jul 28 03:57:13.697038 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2501/4516] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:13 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1755 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:13.986901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-334fb4ed-3dc6-4ece-aa4c-954b74bdad5a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:13.987836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-334fb4ed-3dc6-4ece-aa4c-954b74bdad5a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:14.013307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-334fb4ed-3dc6-4ece-aa4c-954b74bdad5a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:14.014463 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-334fb4ed-3dc6-4ece-aa4c-954b74bdad5a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:14.017144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-334fb4ed-3dc6-4ece-aa4c-954b74bdad5a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:14.019681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-334fb4ed-3dc6-4ece-aa4c-954b74bdad5a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:14.383113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-309903db-6723-4c1b-ba52-fc9f4e1fc0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:14.383718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-309903db-6723-4c1b-ba52-fc9f4e1fc0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:14.411785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-309903db-6723-4c1b-ba52-fc9f4e1fc0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:14.412724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-309903db-6723-4c1b-ba52-fc9f4e1fc0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:14.414222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-309903db-6723-4c1b-ba52-fc9f4e1fc0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:14.414828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-309903db-6723-4c1b-ba52-fc9f4e1fc0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:15.084797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-309903db-6723-4c1b-ba52-fc9f4e1fc0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:15.110706 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-309903db-6723-4c1b-ba52-fc9f4e1fc0bd tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1528 microversion: 2.1 time: 0.731440 Jul 28 03:57:15.116870 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2502/4517] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:14 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1528 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:57:15.123523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-32de9d4b-8092-4bd8-a44e-40fe74206294 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:15.124155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-32de9d4b-8092-4bd8-a44e-40fe74206294 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:15.148863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32de9d4b-8092-4bd8-a44e-40fe74206294 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:15.149337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32de9d4b-8092-4bd8-a44e-40fe74206294 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:15.152539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32de9d4b-8092-4bd8-a44e-40fe74206294 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:15.155567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32de9d4b-8092-4bd8-a44e-40fe74206294 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:15.167049 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-334fb4ed-3dc6-4ece-aa4c-954b74bdad5a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:15.191000 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-334fb4ed-3dc6-4ece-aa4c-954b74bdad5a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 1.211282 Jul 28 03:57:15.206011 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2016/4518] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:13 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:15.221649 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-34be9cfd-e7e1-47e8-b9b2-e44f422e9849 req-f0f9397f-b78a-4ce0-abd3-b7540384d0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb45614-0607-46f1-90bc-e064c206adea", "name": "network-vif-plugged", "status": "completed", "tag": "72d248d2-7689-4773-96a2-0a68ee2aa720"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:15.232988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-34be9cfd-e7e1-47e8-b9b2-e44f422e9849 req-f0f9397f-b78a-4ce0-abd3-b7540384d0f7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:15.233782 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-34be9cfd-e7e1-47e8-b9b2-e44f422e9849 req-f0f9397f-b78a-4ce0-abd3-b7540384d0f7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:15.252608 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-34be9cfd-e7e1-47e8-b9b2-e44f422e9849 req-f0f9397f-b78a-4ce0-abd3-b7540384d0f7 service nova] Creating event network-vif-plugged:72d248d2-7689-4773-96a2-0a68ee2aa720 for instance acb45614-0607-46f1-90bc-e064c206adea on n-h2-826756-3 Jul 28 03:57:15.258275 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-34be9cfd-e7e1-47e8-b9b2-e44f422e9849 req-f0f9397f-b78a-4ce0-abd3-b7540384d0f7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050724 Jul 28 03:57:15.259379 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2017/4519] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:15.553007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-32de9d4b-8092-4bd8-a44e-40fe74206294 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:15.562478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:15.582619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-32de9d4b-8092-4bd8-a44e-40fe74206294 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:15.584451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-32de9d4b-8092-4bd8-a44e-40fe74206294 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:15.587421 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-32de9d4b-8092-4bd8-a44e-40fe74206294 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1755 microversion: 2.32 time: 0.473632 Jul 28 03:57:15.589510 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2503/4520] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:15 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1755 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:16.022549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5a18ac5b-9382-4d64-8358-21021edbcc02 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:16.022549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5a18ac5b-9382-4d64-8358-21021edbcc02 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:16.029588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a18ac5b-9382-4d64-8358-21021edbcc02 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:16.030864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a18ac5b-9382-4d64-8358-21021edbcc02 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:16.032720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a18ac5b-9382-4d64-8358-21021edbcc02 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:16.033149 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a18ac5b-9382-4d64-8358-21021edbcc02 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:16.084112 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5a18ac5b-9382-4d64-8358-21021edbcc02 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8/ips" status: 200 len: 153 microversion: 2.20 time: 0.068954 Jul 28 03:57:16.085130 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2018/4521] 10.222.0.48 () {60 vars in 1289 bytes} [Thu Jul 28 03:57:16 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8/ips => generated 153 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:57:16.141839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63961058-c8ed-4903-9016-7fd176d26320 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:16.142228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63961058-c8ed-4903-9016-7fd176d26320 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:16.174259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63961058-c8ed-4903-9016-7fd176d26320 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:16.174716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63961058-c8ed-4903-9016-7fd176d26320 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:16.175513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63961058-c8ed-4903-9016-7fd176d26320 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:16.175959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63961058-c8ed-4903-9016-7fd176d26320 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:16.223422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6d9de9fa-5605-48da-b571-ed5b3e59149d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:16.224726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6d9de9fa-5605-48da-b571-ed5b3e59149d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:16.238431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6d9de9fa-5605-48da-b571-ed5b3e59149d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:16.239307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6d9de9fa-5605-48da-b571-ed5b3e59149d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:16.240333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6d9de9fa-5605-48da-b571-ed5b3e59149d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:16.241026 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6d9de9fa-5605-48da-b571-ed5b3e59149d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:16.550954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63961058-c8ed-4903-9016-7fd176d26320 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:16.576985 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63961058-c8ed-4903-9016-7fd176d26320 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1528 microversion: 2.1 time: 0.436807 Jul 28 03:57:16.578034 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2504/4522] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:16 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1528 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:16.622133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-07dec49b-92ce-4ca8-8b75-5841bac940bb tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:16.622867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-07dec49b-92ce-4ca8-8b75-5841bac940bb tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:16.634665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07dec49b-92ce-4ca8-8b75-5841bac940bb tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:16.635127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07dec49b-92ce-4ca8-8b75-5841bac940bb tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:16.635926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07dec49b-92ce-4ca8-8b75-5841bac940bb tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:16.636381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07dec49b-92ce-4ca8-8b75-5841bac940bb tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:16.974169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-07dec49b-92ce-4ca8-8b75-5841bac940bb tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:16.997773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-07dec49b-92ce-4ca8-8b75-5841bac940bb tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:17.001611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-07dec49b-92ce-4ca8-8b75-5841bac940bb tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:17.005659 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-07dec49b-92ce-4ca8-8b75-5841bac940bb tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1755 microversion: 2.32 time: 0.387826 Jul 28 03:57:17.006524 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2505/4523] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:16 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1755 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:17.374970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6d9de9fa-5605-48da-b571-ed5b3e59149d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:17.383912 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6d9de9fa-5605-48da-b571-ed5b3e59149d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 1.164571 Jul 28 03:57:17.396857 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2019/4524] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:16 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:17.600800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3ebcb5f9-67e0-4a62-82c4-01245a90ffa2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:17.601543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3ebcb5f9-67e0-4a62-82c4-01245a90ffa2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:17.637271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ebcb5f9-67e0-4a62-82c4-01245a90ffa2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:17.642662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ebcb5f9-67e0-4a62-82c4-01245a90ffa2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:17.644032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ebcb5f9-67e0-4a62-82c4-01245a90ffa2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:17.644591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ebcb5f9-67e0-4a62-82c4-01245a90ffa2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:17.894230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3ebcb5f9-67e0-4a62-82c4-01245a90ffa2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:17.903436 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3ebcb5f9-67e0-4a62-82c4-01245a90ffa2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1486 microversion: 2.1 time: 0.307501 Jul 28 03:57:17.911470 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2506/4525] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:17 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1486 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:18.034949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9189ddb4-d7ae-4f5a-a5bf-a83daabb6967 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:18.035629 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9189ddb4-d7ae-4f5a-a5bf-a83daabb6967 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:18.058402 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9189ddb4-d7ae-4f5a-a5bf-a83daabb6967 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:18.058866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9189ddb4-d7ae-4f5a-a5bf-a83daabb6967 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:18.066534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9189ddb4-d7ae-4f5a-a5bf-a83daabb6967 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:18.067128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9189ddb4-d7ae-4f5a-a5bf-a83daabb6967 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:18.405465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1ffe0211-acde-49e8-8686-2efb14e29c17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:18.406358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1ffe0211-acde-49e8-8686-2efb14e29c17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:18.422647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ffe0211-acde-49e8-8686-2efb14e29c17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:18.425592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ffe0211-acde-49e8-8686-2efb14e29c17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:18.429131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ffe0211-acde-49e8-8686-2efb14e29c17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:18.432163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ffe0211-acde-49e8-8686-2efb14e29c17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:19.192141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9189ddb4-d7ae-4f5a-a5bf-a83daabb6967 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:19.237061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9189ddb4-d7ae-4f5a-a5bf-a83daabb6967 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:19.247693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9189ddb4-d7ae-4f5a-a5bf-a83daabb6967 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:19.251954 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9189ddb4-d7ae-4f5a-a5bf-a83daabb6967 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1802 microversion: 2.32 time: 1.220771 Jul 28 03:57:19.255166 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2020/4526] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:18 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1802 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:19.291793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-acb87c64-26f9-493a-958c-6d465ebd26bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:19.294588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-acb87c64-26f9-493a-958c-6d465ebd26bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:19.310476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acb87c64-26f9-493a-958c-6d465ebd26bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:19.324668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acb87c64-26f9-493a-958c-6d465ebd26bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:19.332623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acb87c64-26f9-493a-958c-6d465ebd26bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:19.337731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acb87c64-26f9-493a-958c-6d465ebd26bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:19.449332 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acb87c64-26f9-493a-958c-6d465ebd26bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:19.450244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-acb87c64-26f9-493a-958c-6d465ebd26bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:19.451404 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-acb87c64-26f9-493a-958c-6d465ebd26bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lazy-loading 'fault' on Instance uuid acb45614-0607-46f1-90bc-e064c206adea {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:57:19.625619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-acb87c64-26f9-493a-958c-6d465ebd26bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:19.639960 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-acb87c64-26f9-493a-958c-6d465ebd26bc tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 200 len: 1314 microversion: 2.1 time: 0.370460 Jul 28 03:57:19.650146 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2021/4527] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:19 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:19.668386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-a766a58f-d574-4891-ac29-dcc30c28d090 req-97375046-7603-48b8-a9b4-3a052be9bcbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acb45614-0607-46f1-90bc-e064c206adea", "name": "network-vif-deleted", "tag": "72d248d2-7689-4773-96a2-0a68ee2aa720"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:19.702900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a766a58f-d574-4891-ac29-dcc30c28d090 req-97375046-7603-48b8-a9b4-3a052be9bcbe service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:19.706941 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a766a58f-d574-4891-ac29-dcc30c28d090 req-97375046-7603-48b8-a9b4-3a052be9bcbe service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:19.793485 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-a766a58f-d574-4891-ac29-dcc30c28d090 req-97375046-7603-48b8-a9b4-3a052be9bcbe service nova] Creating event network-vif-deleted:72d248d2-7689-4773-96a2-0a68ee2aa720 for instance acb45614-0607-46f1-90bc-e064c206adea on n-h2-826756-3 Jul 28 03:57:19.852467 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-a766a58f-d574-4891-ac29-dcc30c28d090 req-97375046-7603-48b8-a9b4-3a052be9bcbe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191106 Jul 28 03:57:19.857581 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2022/4528] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:19.975945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1ffe0211-acde-49e8-8686-2efb14e29c17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:20.006314 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1ffe0211-acde-49e8-8686-2efb14e29c17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 1.604955 Jul 28 03:57:20.018649 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2507/4529] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:18 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:20.283759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e05e8ba4-d58d-44d3-b98b-ca2260e55fd0 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:20.285829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e05e8ba4-d58d-44d3-b98b-ca2260e55fd0 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:20.308564 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e05e8ba4-d58d-44d3-b98b-ca2260e55fd0 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:20.316108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e05e8ba4-d58d-44d3-b98b-ca2260e55fd0 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:20.317034 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e05e8ba4-d58d-44d3-b98b-ca2260e55fd0 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:20.317477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e05e8ba4-d58d-44d3-b98b-ca2260e55fd0 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:20.683887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fe4b271e-dcaa-42a1-84c1-3fa3ce10a6df tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:20.684605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fe4b271e-dcaa-42a1-84c1-3fa3ce10a6df tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:20.702495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe4b271e-dcaa-42a1-84c1-3fa3ce10a6df tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:20.703145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe4b271e-dcaa-42a1-84c1-3fa3ce10a6df tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:20.704236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe4b271e-dcaa-42a1-84c1-3fa3ce10a6df tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:20.705187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe4b271e-dcaa-42a1-84c1-3fa3ce10a6df tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:20.746272 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-fe4b271e-dcaa-42a1-84c1-3fa3ce10a6df tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] HTTP exception thrown: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fe4b271e-dcaa-42a1-84c1-3fa3ce10a6df tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Request method failure captured: Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea HTTP/1.1 Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjBY0mYKCXtj0_d2uaizZHT_bTm8g67l0hNznQ_KVINZT1siV-lKxZREHB__mQh0Osf7Cog-lCJIGpJJ_mIo_1i4LQ-Uw87qYT7Q9LIdNSOqrDCo-x87gq81TQtloPebhhpc4TesbUzk376RJomPlfVbclxoCv7QtBWHpejAHdY1so Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}] Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 5265a6963e6e46c8bc7657bcf081362a Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'acb45614-0607-46f1-90bc-e064c206adea'} Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:20.748665 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:20.753286 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:20.753286 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:20.753286 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:20.753286 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:20.753286 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:57:20.753286 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:57:20.753286 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:57:20.753286 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:20.754821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fe4b271e-dcaa-42a1-84c1-3fa3ce10a6df tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Returning 404 to user: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:57:20.757093 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fe4b271e-dcaa-42a1-84c1-3fa3ce10a6df tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 404 len: 111 microversion: 2.1 time: 0.077287 Jul 28 03:57:20.760522 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2508/4530] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:20 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:57:20.776100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ec2e0a6-d072-4ebc-ac84-9645d2abe79a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:20.778205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ec2e0a6-d072-4ebc-ac84-9645d2abe79a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:20.793317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ec2e0a6-d072-4ebc-ac84-9645d2abe79a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:20.794125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ec2e0a6-d072-4ebc-ac84-9645d2abe79a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:20.795176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ec2e0a6-d072-4ebc-ac84-9645d2abe79a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:20.796903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ec2e0a6-d072-4ebc-ac84-9645d2abe79a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:20.893655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-0ec2e0a6-d072-4ebc-ac84-9645d2abe79a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lazy-loading 'flavor' on Instance uuid 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:57:21.322136 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ec2e0a6-d072-4ebc-ac84-9645d2abe79a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "POST /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8/action" status: 202 len: 0 microversion: 2.20 time: 0.551682 Jul 28 03:57:21.331149 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2509/4531] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 03:57:20 2022] POST /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:57:21.345853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-be2ca2e9-7430-4f43-94be-9fcfdcf5dd10 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:21.347369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-be2ca2e9-7430-4f43-94be-9fcfdcf5dd10 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:21.367964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be2ca2e9-7430-4f43-94be-9fcfdcf5dd10 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:21.372559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be2ca2e9-7430-4f43-94be-9fcfdcf5dd10 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:21.376505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be2ca2e9-7430-4f43-94be-9fcfdcf5dd10 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:21.377272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be2ca2e9-7430-4f43-94be-9fcfdcf5dd10 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:21.436029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e05e8ba4-d58d-44d3-b98b-ca2260e55fd0 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:21.464755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e05e8ba4-d58d-44d3-b98b-ca2260e55fd0 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:21.468032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e05e8ba4-d58d-44d3-b98b-ca2260e55fd0 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:21.476168 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e05e8ba4-d58d-44d3-b98b-ca2260e55fd0 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1802 microversion: 2.32 time: 1.198634 Jul 28 03:57:21.488547 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2023/4532] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:20 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1802 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:21.501990 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-470678787", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:21.668135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] validate_networks() for [('2af3b349-fc32-4cc8-84a4-341a88489282', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:57:22.368043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be2ca2e9-7430-4f43-94be-9fcfdcf5dd10 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:22.376881 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-be2ca2e9-7430-4f43-94be-9fcfdcf5dd10 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 1.044177 Jul 28 03:57:22.381528 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2510/4533] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:21 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:22.390389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8c53f4a2-9f86-480d-b9e3-439e4ff14c6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:22.395143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8c53f4a2-9f86-480d-b9e3-439e4ff14c6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:22.430652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c53f4a2-9f86-480d-b9e3-439e4ff14c6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:22.431499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c53f4a2-9f86-480d-b9e3-439e4ff14c6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:22.432649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c53f4a2-9f86-480d-b9e3-439e4ff14c6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:22.435771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c53f4a2-9f86-480d-b9e3-439e4ff14c6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:23.014290 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:57:23.014849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:57:23.015320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:57:23.017402 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:57:23.020091 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:57:23.066614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:23.067084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:23.069284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:23.069726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:23.086957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8c53f4a2-9f86-480d-b9e3-439e4ff14c6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:23.099150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8c53f4a2-9f86-480d-b9e3-439e4ff14c6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:23.107478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8c53f4a2-9f86-480d-b9e3-439e4ff14c6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:23.109051 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8c53f4a2-9f86-480d-b9e3-439e4ff14c6b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1726 microversion: 2.20 time: 0.726231 Jul 28 03:57:23.115582 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2511/4534] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:22 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1726 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:23.128637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f8100fee-ccb7-4538-87ef-f0dfb283f28b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:23.129822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f8100fee-ccb7-4538-87ef-f0dfb283f28b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:23.141986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8100fee-ccb7-4538-87ef-f0dfb283f28b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:23.147656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8100fee-ccb7-4538-87ef-f0dfb283f28b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:23.148852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8100fee-ccb7-4538-87ef-f0dfb283f28b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:23.149494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8100fee-ccb7-4538-87ef-f0dfb283f28b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:23.158516 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Getting quotas for project 48efc7f6c8c94d428bc418846baeab4f. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:57:23.226667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Getting quotas for user 5265a6963e6e46c8bc7657bcf081362a and project 48efc7f6c8c94d428bc418846baeab4f. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:57:23.333362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:57:23.354159 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:57:23.515644 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ea02ee48-222b-4150-8bbb-7a466d82b785 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.025535 Jul 28 03:57:23.519601 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2024/4535] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:57:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:57:23.534052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-68e9e1eb-050b-47fc-8e3d-17cce200d9be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:23.535311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-68e9e1eb-050b-47fc-8e3d-17cce200d9be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:23.558498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-68e9e1eb-050b-47fc-8e3d-17cce200d9be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:23.576176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-68e9e1eb-050b-47fc-8e3d-17cce200d9be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:23.582561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-68e9e1eb-050b-47fc-8e3d-17cce200d9be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:23.583358 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-68e9e1eb-050b-47fc-8e3d-17cce200d9be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:24.625758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f8100fee-ccb7-4538-87ef-f0dfb283f28b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:24.681635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f8100fee-ccb7-4538-87ef-f0dfb283f28b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:24.692277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f8100fee-ccb7-4538-87ef-f0dfb283f28b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:24.698123 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f8100fee-ccb7-4538-87ef-f0dfb283f28b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1849 microversion: 2.32 time: 1.578455 Jul 28 03:57:24.702533 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2512/4536] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:23 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1849 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:24.723697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6511ecae-3734-4501-9889-d11ad62ac1e8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:24.726923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6511ecae-3734-4501-9889-d11ad62ac1e8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:24.760028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6511ecae-3734-4501-9889-d11ad62ac1e8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:24.762224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6511ecae-3734-4501-9889-d11ad62ac1e8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:24.769052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6511ecae-3734-4501-9889-d11ad62ac1e8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:24.770407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6511ecae-3734-4501-9889-d11ad62ac1e8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:24.788060 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-68e9e1eb-050b-47fc-8e3d-17cce200d9be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:24.803243 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-68e9e1eb-050b-47fc-8e3d-17cce200d9be tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 1.278948 Jul 28 03:57:24.806903 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2025/4537] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:23 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:24.829491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c294aaf9-c18b-4db0-bcc1-f64984a591e7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:24.831236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c294aaf9-c18b-4db0-bcc1-f64984a591e7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:24.856754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c294aaf9-c18b-4db0-bcc1-f64984a591e7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:24.857294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c294aaf9-c18b-4db0-bcc1-f64984a591e7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:24.858148 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c294aaf9-c18b-4db0-bcc1-f64984a591e7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:24.861033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c294aaf9-c18b-4db0-bcc1-f64984a591e7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:25.066819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6511ecae-3734-4501-9889-d11ad62ac1e8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:25.075767 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6511ecae-3734-4501-9889-d11ad62ac1e8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1228 microversion: 2.1 time: 0.371845 Jul 28 03:57:25.084933 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2513/4538] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:24 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1228 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:25.343365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c294aaf9-c18b-4db0-bcc1-f64984a591e7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:25.347851 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:25.359799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c294aaf9-c18b-4db0-bcc1-f64984a591e7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:25.362787 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c294aaf9-c18b-4db0-bcc1-f64984a591e7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:25.381204 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c294aaf9-c18b-4db0-bcc1-f64984a591e7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1726 microversion: 2.20 time: 0.561802 Jul 28 03:57:25.382027 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2026/4539] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:24 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1726 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:25.594528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3e3c01b3-4acc-45f8-b909-cdc5654c8273 req-141d43df-9ebb-4d40-852c-2d7ccc2dec3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "tag": "50bb8633-534f-4450-8396-9a18c45b70b2"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:25.648718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3e3c01b3-4acc-45f8-b909-cdc5654c8273 req-141d43df-9ebb-4d40-852c-2d7ccc2dec3a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:25.649293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3e3c01b3-4acc-45f8-b909-cdc5654c8273 req-141d43df-9ebb-4d40-852c-2d7ccc2dec3a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:25.707859 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3e3c01b3-4acc-45f8-b909-cdc5654c8273 req-141d43df-9ebb-4d40-852c-2d7ccc2dec3a service nova] Creating event network-changed:50bb8633-534f-4450-8396-9a18c45b70b2 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:57:25.727940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8de00473-77b1-4506-abf0-e0927af776ab tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:25.728712 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8de00473-77b1-4506-abf0-e0927af776ab tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:25.746511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8de00473-77b1-4506-abf0-e0927af776ab tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:25.748987 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3e3c01b3-4acc-45f8-b909-cdc5654c8273 req-141d43df-9ebb-4d40-852c-2d7ccc2dec3a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155047 Jul 28 03:57:25.755220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8de00473-77b1-4506-abf0-e0927af776ab tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:25.758742 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2514/4540] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:25.759110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8de00473-77b1-4506-abf0-e0927af776ab tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:25.762919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8de00473-77b1-4506-abf0-e0927af776ab tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:25.838409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ef0eb0b-2163-4016-94ef-88ec11b0c192 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:25.842245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ef0eb0b-2163-4016-94ef-88ec11b0c192 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:25.860905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ef0eb0b-2163-4016-94ef-88ec11b0c192 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:25.861364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ef0eb0b-2163-4016-94ef-88ec11b0c192 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:25.871400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ef0eb0b-2163-4016-94ef-88ec11b0c192 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:25.871856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ef0eb0b-2163-4016-94ef-88ec11b0c192 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:26.833776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8de00473-77b1-4506-abf0-e0927af776ab tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:26.865236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8de00473-77b1-4506-abf0-e0927af776ab tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:26.877339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8de00473-77b1-4506-abf0-e0927af776ab tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:26.878690 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8de00473-77b1-4506-abf0-e0927af776ab tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1849 microversion: 2.32 time: 1.155400 Jul 28 03:57:26.901684 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2027/4541] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:25 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1849 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:57:26.910264 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-36a8f284-a2b5-4e3c-96e7-c19c24044d4b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:26.914247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-36a8f284-a2b5-4e3c-96e7-c19c24044d4b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:26.940583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-36a8f284-a2b5-4e3c-96e7-c19c24044d4b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:26.943340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-36a8f284-a2b5-4e3c-96e7-c19c24044d4b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:26.944574 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-36a8f284-a2b5-4e3c-96e7-c19c24044d4b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:26.948190 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-36a8f284-a2b5-4e3c-96e7-c19c24044d4b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:27.119482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2ef0eb0b-2163-4016-94ef-88ec11b0c192 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:27.155571 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ef0eb0b-2163-4016-94ef-88ec11b0c192 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 1.327811 Jul 28 03:57:27.169969 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2515/4542] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:25 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:27.186266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-46d53911-8762-464a-88f7-deadb9b593ba tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:27.191226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-46d53911-8762-464a-88f7-deadb9b593ba tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:27.207173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:27.208808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46d53911-8762-464a-88f7-deadb9b593ba tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:27.209262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46d53911-8762-464a-88f7-deadb9b593ba tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:27.214368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46d53911-8762-464a-88f7-deadb9b593ba tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:27.217454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46d53911-8762-464a-88f7-deadb9b593ba tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:27.996259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-46d53911-8762-464a-88f7-deadb9b593ba tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:28.009228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-46d53911-8762-464a-88f7-deadb9b593ba tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:28.011440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-46d53911-8762-464a-88f7-deadb9b593ba tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:28.013436 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-46d53911-8762-464a-88f7-deadb9b593ba tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1726 microversion: 2.20 time: 0.840690 Jul 28 03:57:28.026267 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2516/4543] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:27 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1726 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:28.037998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c3dcfbc6-491c-493e-b7c5-3a94303be01a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:28.038881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c3dcfbc6-491c-493e-b7c5-3a94303be01a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:28.047362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3dcfbc6-491c-493e-b7c5-3a94303be01a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:28.048186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3dcfbc6-491c-493e-b7c5-3a94303be01a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:28.049361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3dcfbc6-491c-493e-b7c5-3a94303be01a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:28.050031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3dcfbc6-491c-493e-b7c5-3a94303be01a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:28.290534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-36a8f284-a2b5-4e3c-96e7-c19c24044d4b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:28.304046 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-36a8f284-a2b5-4e3c-96e7-c19c24044d4b tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1282 microversion: 2.1 time: 1.401156 Jul 28 03:57:28.318536 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2028/4544] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:26 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1282 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:28.328960 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-74a9fa4f-6bfe-40cf-bdae-8864550a9d92 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:28.329587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-74a9fa4f-6bfe-40cf-bdae-8864550a9d92 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:28.359847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-74a9fa4f-6bfe-40cf-bdae-8864550a9d92 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:28.360446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-74a9fa4f-6bfe-40cf-bdae-8864550a9d92 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:28.361331 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-74a9fa4f-6bfe-40cf-bdae-8864550a9d92 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:28.361785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-74a9fa4f-6bfe-40cf-bdae-8864550a9d92 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:28.739861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c3dcfbc6-491c-493e-b7c5-3a94303be01a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:28.759521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c3dcfbc6-491c-493e-b7c5-3a94303be01a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:28.761722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c3dcfbc6-491c-493e-b7c5-3a94303be01a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:28.766668 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c3dcfbc6-491c-493e-b7c5-3a94303be01a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1849 microversion: 2.32 time: 0.735305 Jul 28 03:57:28.772405 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2517/4545] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:28 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1849 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:29.048770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3f2b7cf1-804a-4c9d-b5dd-37762e786472 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:29.049655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3f2b7cf1-804a-4c9d-b5dd-37762e786472 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:29.068142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f2b7cf1-804a-4c9d-b5dd-37762e786472 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:29.071111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f2b7cf1-804a-4c9d-b5dd-37762e786472 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:29.076665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f2b7cf1-804a-4c9d-b5dd-37762e786472 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:29.077411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f2b7cf1-804a-4c9d-b5dd-37762e786472 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:29.450632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-74a9fa4f-6bfe-40cf-bdae-8864550a9d92 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:29.465764 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-74a9fa4f-6bfe-40cf-bdae-8864550a9d92 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 1.147244 Jul 28 03:57:29.470818 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2029/4546] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:28 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:29.486301 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dbac3c68-de72-4652-90dd-4ea944487e86 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:29.487617 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dbac3c68-de72-4652-90dd-4ea944487e86 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:29.502710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dbac3c68-de72-4652-90dd-4ea944487e86 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:29.506830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dbac3c68-de72-4652-90dd-4ea944487e86 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:29.507752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dbac3c68-de72-4652-90dd-4ea944487e86 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:29.508191 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dbac3c68-de72-4652-90dd-4ea944487e86 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:29.584665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3f2b7cf1-804a-4c9d-b5dd-37762e786472 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:29.609669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3f2b7cf1-804a-4c9d-b5dd-37762e786472 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:29.615308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3f2b7cf1-804a-4c9d-b5dd-37762e786472 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:29.617098 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3f2b7cf1-804a-4c9d-b5dd-37762e786472 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1726 microversion: 2.20 time: 0.577620 Jul 28 03:57:29.636803 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2518/4547] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:29 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1726 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:57:29.796554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c7e7fcfe-b291-4660-b2cc-b35b3cdf439e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:29.797398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c7e7fcfe-b291-4660-b2cc-b35b3cdf439e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:29.811616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7e7fcfe-b291-4660-b2cc-b35b3cdf439e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:29.813195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7e7fcfe-b291-4660-b2cc-b35b3cdf439e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:29.815311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7e7fcfe-b291-4660-b2cc-b35b3cdf439e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:29.818007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7e7fcfe-b291-4660-b2cc-b35b3cdf439e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:30.260592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c7e7fcfe-b291-4660-b2cc-b35b3cdf439e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:30.263503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:30.284374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c7e7fcfe-b291-4660-b2cc-b35b3cdf439e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:30.289609 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dbac3c68-de72-4652-90dd-4ea944487e86 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:30.291237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c7e7fcfe-b291-4660-b2cc-b35b3cdf439e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:30.297908 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c7e7fcfe-b291-4660-b2cc-b35b3cdf439e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1870 microversion: 2.32 time: 0.508104 Jul 28 03:57:30.302612 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dbac3c68-de72-4652-90dd-4ea944487e86 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1282 microversion: 2.1 time: 0.830235 Jul 28 03:57:30.304857 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2519/4548] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:29 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1870 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:57:30.305673 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2030/4549] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:29 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1282 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:30.487324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-09f361fb-4bff-40da-ace1-671cd3b70d17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:30.487954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-09f361fb-4bff-40da-ace1-671cd3b70d17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:30.499980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09f361fb-4bff-40da-ace1-671cd3b70d17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:30.506102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09f361fb-4bff-40da-ace1-671cd3b70d17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:30.509945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09f361fb-4bff-40da-ace1-671cd3b70d17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:30.513463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09f361fb-4bff-40da-ace1-671cd3b70d17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:30.643445 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-490d0109-a699-4e03-b986-a07405de7dca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:30.643992 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-490d0109-a699-4e03-b986-a07405de7dca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:30.657184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-490d0109-a699-4e03-b986-a07405de7dca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:30.670830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-490d0109-a699-4e03-b986-a07405de7dca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:30.672579 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-490d0109-a699-4e03-b986-a07405de7dca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:30.673178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-490d0109-a699-4e03-b986-a07405de7dca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:31.445495 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-490d0109-a699-4e03-b986-a07405de7dca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:31.474766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-490d0109-a699-4e03-b986-a07405de7dca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:31.483063 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-490d0109-a699-4e03-b986-a07405de7dca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:31.489648 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-490d0109-a699-4e03-b986-a07405de7dca tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1726 microversion: 2.20 time: 0.850156 Jul 28 03:57:31.499072 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2031/4550] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:30 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1726 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:31.521061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-09f361fb-4bff-40da-ace1-671cd3b70d17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:31.528151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ebac0ac7-a5d5-4b45-ab25-be2d14f62ac4 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:31.536662 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ebac0ac7-a5d5-4b45-ab25-be2d14f62ac4 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:31.542711 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-09f361fb-4bff-40da-ace1-671cd3b70d17 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 1.059287 Jul 28 03:57:31.546288 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2520/4551] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:30 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:31.553074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abcaa7ba-71f1-4bc4-aa23-a228516f5cb3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:31.563918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-abcaa7ba-71f1-4bc4-aa23-a228516f5cb3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:31.583310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebac0ac7-a5d5-4b45-ab25-be2d14f62ac4 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:31.585118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebac0ac7-a5d5-4b45-ab25-be2d14f62ac4 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:31.594366 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebac0ac7-a5d5-4b45-ab25-be2d14f62ac4 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:31.594577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abcaa7ba-71f1-4bc4-aa23-a228516f5cb3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:31.596295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ebac0ac7-a5d5-4b45-ab25-be2d14f62ac4 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:31.605199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abcaa7ba-71f1-4bc4-aa23-a228516f5cb3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:31.606281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abcaa7ba-71f1-4bc4-aa23-a228516f5cb3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:31.606842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abcaa7ba-71f1-4bc4-aa23-a228516f5cb3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:31.963402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-abcaa7ba-71f1-4bc4-aa23-a228516f5cb3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:31.976529 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-abcaa7ba-71f1-4bc4-aa23-a228516f5cb3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1282 microversion: 2.1 time: 0.427213 Jul 28 03:57:31.977141 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2521/4552] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:31 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1282 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:31.995960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d9265ea6-ac30-45a8-945b-1489475e69a4 req-d3a2d969-23e7-4f73-a7b8-a359b59c7c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "tag": "64c0dac1-8c71-4869-8d21-34d221428489"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:32.054273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d9265ea6-ac30-45a8-945b-1489475e69a4 req-d3a2d969-23e7-4f73-a7b8-a359b59c7c4e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:32.055071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d9265ea6-ac30-45a8-945b-1489475e69a4 req-d3a2d969-23e7-4f73-a7b8-a359b59c7c4e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:32.106238 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-d9265ea6-ac30-45a8-945b-1489475e69a4 req-d3a2d969-23e7-4f73-a7b8-a359b59c7c4e service nova] Creating event network-changed:64c0dac1-8c71-4869-8d21-34d221428489 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:57:32.119987 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d9265ea6-ac30-45a8-945b-1489475e69a4 req-d3a2d969-23e7-4f73-a7b8-a359b59c7c4e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134763 Jul 28 03:57:32.127993 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2522/4553] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:32.520840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d907c27-4b09-475e-8ca3-2de0473ed635 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:32.521553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d907c27-4b09-475e-8ca3-2de0473ed635 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:32.541707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d907c27-4b09-475e-8ca3-2de0473ed635 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:32.542531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d907c27-4b09-475e-8ca3-2de0473ed635 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:32.543727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d907c27-4b09-475e-8ca3-2de0473ed635 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:32.544455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d907c27-4b09-475e-8ca3-2de0473ed635 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:33.099889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:33.199443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ebac0ac7-a5d5-4b45-ab25-be2d14f62ac4 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:33.220995 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ebac0ac7-a5d5-4b45-ab25-be2d14f62ac4 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:33.226603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ebac0ac7-a5d5-4b45-ab25-be2d14f62ac4 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:33.232821 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ebac0ac7-a5d5-4b45-ab25-be2d14f62ac4 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1870 microversion: 2.32 time: 1.732157 Jul 28 03:57:33.237299 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2032/4554] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:31 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1870 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:33.244461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9545b484-81bb-4248-b528-e4a092cb1210 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:33.245440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9545b484-81bb-4248-b528-e4a092cb1210 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:33.255727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9545b484-81bb-4248-b528-e4a092cb1210 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:33.256735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9545b484-81bb-4248-b528-e4a092cb1210 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:33.257783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9545b484-81bb-4248-b528-e4a092cb1210 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:33.259664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9545b484-81bb-4248-b528-e4a092cb1210 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:33.305068 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:33.979529 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9545b484-81bb-4248-b528-e4a092cb1210 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:33.990127 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9545b484-81bb-4248-b528-e4a092cb1210 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 0.750702 Jul 28 03:57:33.993203 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2033/4555] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:33 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:34.010130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9d907c27-4b09-475e-8ca3-2de0473ed635 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:34.011754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c5ff1f96-586f-48be-87f7-ba43dacfd893 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:34.013572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c5ff1f96-586f-48be-87f7-ba43dacfd893 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:34.031649 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5ff1f96-586f-48be-87f7-ba43dacfd893 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:34.032364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5ff1f96-586f-48be-87f7-ba43dacfd893 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:34.034243 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5ff1f96-586f-48be-87f7-ba43dacfd893 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:34.035021 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5ff1f96-586f-48be-87f7-ba43dacfd893 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:34.042069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9d907c27-4b09-475e-8ca3-2de0473ed635 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:34.043616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9d907c27-4b09-475e-8ca3-2de0473ed635 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:34.080960 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d907c27-4b09-475e-8ca3-2de0473ed635 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1726 microversion: 2.20 time: 1.555877 Jul 28 03:57:34.082448 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2523/4556] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:32 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1726 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:57:34.264530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c37e1ad5-779e-4f2c-a2cf-53755a7ec910 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:34.265366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c37e1ad5-779e-4f2c-a2cf-53755a7ec910 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:34.283464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c37e1ad5-779e-4f2c-a2cf-53755a7ec910 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:34.286615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c37e1ad5-779e-4f2c-a2cf-53755a7ec910 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:34.292135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c37e1ad5-779e-4f2c-a2cf-53755a7ec910 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:34.295518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c37e1ad5-779e-4f2c-a2cf-53755a7ec910 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:35.484572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c37e1ad5-779e-4f2c-a2cf-53755a7ec910 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:35.514322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c37e1ad5-779e-4f2c-a2cf-53755a7ec910 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:35.517560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c37e1ad5-779e-4f2c-a2cf-53755a7ec910 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:35.522311 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c37e1ad5-779e-4f2c-a2cf-53755a7ec910 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1858 microversion: 2.32 time: 1.262890 Jul 28 03:57:35.524271 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2524/4557] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:34 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1858 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:57:35.537724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bca1014f-0033-4643-a108-e85e3aa6bf18 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:35.554043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bca1014f-0033-4643-a108-e85e3aa6bf18 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:35.589788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bca1014f-0033-4643-a108-e85e3aa6bf18 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:35.597382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bca1014f-0033-4643-a108-e85e3aa6bf18 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:35.600162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bca1014f-0033-4643-a108-e85e3aa6bf18 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:35.601973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bca1014f-0033-4643-a108-e85e3aa6bf18 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:36.204266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bca1014f-0033-4643-a108-e85e3aa6bf18 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:36.217028 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bca1014f-0033-4643-a108-e85e3aa6bf18 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 0.688887 Jul 28 03:57:36.220114 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2525/4558] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:35 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:36.231717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8fa04c47-27dd-4d5f-b69f-12ccb542a99b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:36.234444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8fa04c47-27dd-4d5f-b69f-12ccb542a99b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:36.249479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fa04c47-27dd-4d5f-b69f-12ccb542a99b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:36.252935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fa04c47-27dd-4d5f-b69f-12ccb542a99b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:36.256177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fa04c47-27dd-4d5f-b69f-12ccb542a99b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:36.256915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fa04c47-27dd-4d5f-b69f-12ccb542a99b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:36.539063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8fa04c47-27dd-4d5f-b69f-12ccb542a99b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:36.549075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8fa04c47-27dd-4d5f-b69f-12ccb542a99b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:36.556670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8fa04c47-27dd-4d5f-b69f-12ccb542a99b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:36.559627 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8fa04c47-27dd-4d5f-b69f-12ccb542a99b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1726 microversion: 2.20 time: 0.336430 Jul 28 03:57:36.563535 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2526/4559] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:36 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1726 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:36.581507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fd0ec900-c6de-4060-b7ae-9d353c9f96ae tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:36.582489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fd0ec900-c6de-4060-b7ae-9d353c9f96ae tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:36.595535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd0ec900-c6de-4060-b7ae-9d353c9f96ae tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:36.596295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd0ec900-c6de-4060-b7ae-9d353c9f96ae tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:36.597839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd0ec900-c6de-4060-b7ae-9d353c9f96ae tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:36.598688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd0ec900-c6de-4060-b7ae-9d353c9f96ae tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:36.949685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c5ff1f96-586f-48be-87f7-ba43dacfd893 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:36.963275 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c5ff1f96-586f-48be-87f7-ba43dacfd893 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1324 microversion: 2.1 time: 2.968269 Jul 28 03:57:36.964326 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2034/4560] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:33 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1324 bytes in 2970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:37.248294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-26ca2a9e-f42d-456e-b069-5035642b11fe tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:37.249210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-26ca2a9e-f42d-456e-b069-5035642b11fe tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:37.253072 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:37.278396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26ca2a9e-f42d-456e-b069-5035642b11fe tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:37.280716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26ca2a9e-f42d-456e-b069-5035642b11fe tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:37.281576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26ca2a9e-f42d-456e-b069-5035642b11fe tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:37.285463 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26ca2a9e-f42d-456e-b069-5035642b11fe tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:37.381436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fd0ec900-c6de-4060-b7ae-9d353c9f96ae tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:37.391808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fd0ec900-c6de-4060-b7ae-9d353c9f96ae tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:37.393657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fd0ec900-c6de-4060-b7ae-9d353c9f96ae tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:37.395171 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fd0ec900-c6de-4060-b7ae-9d353c9f96ae tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1858 microversion: 2.32 time: 0.830171 Jul 28 03:57:37.412942 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2527/4561] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:36 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1858 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:37.593077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a69bc97-5611-417b-9749-aac85fb18313 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:37.593680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7a69bc97-5611-417b-9749-aac85fb18313 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:37.602032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a69bc97-5611-417b-9749-aac85fb18313 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:37.605329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a69bc97-5611-417b-9749-aac85fb18313 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:37.607803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a69bc97-5611-417b-9749-aac85fb18313 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:37.608249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a69bc97-5611-417b-9749-aac85fb18313 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:37.797951 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-26ca2a9e-f42d-456e-b069-5035642b11fe tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:37.807277 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-26ca2a9e-f42d-456e-b069-5035642b11fe tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1527 microversion: 2.1 time: 0.564946 Jul 28 03:57:37.808905 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2035/4562] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:37 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1527 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:57:37.991651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-52ad4784-fda8-4a05-9fd4-8b863fdb2005 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:37.993860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-52ad4784-fda8-4a05-9fd4-8b863fdb2005 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:38.002758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52ad4784-fda8-4a05-9fd4-8b863fdb2005 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:38.003812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52ad4784-fda8-4a05-9fd4-8b863fdb2005 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:38.004858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52ad4784-fda8-4a05-9fd4-8b863fdb2005 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:38.005808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52ad4784-fda8-4a05-9fd4-8b863fdb2005 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:38.466964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a69bc97-5611-417b-9749-aac85fb18313 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:38.477484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a69bc97-5611-417b-9749-aac85fb18313 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:38.479415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a69bc97-5611-417b-9749-aac85fb18313 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:38.480954 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7a69bc97-5611-417b-9749-aac85fb18313 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1726 microversion: 2.20 time: 0.893337 Jul 28 03:57:38.482122 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2528/4563] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:37 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1726 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:38.487109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-16e17b3d-a90d-47cc-bc9d-8e6dcefe2068 req-aa4cd53d-c208-4ac9-a159-6b35325a10b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "tag": "8d43bc33-8f3a-406e-99fa-b66c536b9ca4"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:38.499027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-16e17b3d-a90d-47cc-bc9d-8e6dcefe2068 req-aa4cd53d-c208-4ac9-a159-6b35325a10b4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:38.499807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-16e17b3d-a90d-47cc-bc9d-8e6dcefe2068 req-aa4cd53d-c208-4ac9-a159-6b35325a10b4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:38.522983 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-16e17b3d-a90d-47cc-bc9d-8e6dcefe2068 req-aa4cd53d-c208-4ac9-a159-6b35325a10b4 service nova] Creating event network-changed:8d43bc33-8f3a-406e-99fa-b66c536b9ca4 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:57:38.543604 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-16e17b3d-a90d-47cc-bc9d-8e6dcefe2068 req-aa4cd53d-c208-4ac9-a159-6b35325a10b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059768 Jul 28 03:57:38.544829 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2529/4564] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:38.551120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-49819c7b-52a1-4c05-b509-e5a2f48716f9 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:38.552238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-49819c7b-52a1-4c05-b509-e5a2f48716f9 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:38.566454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49819c7b-52a1-4c05-b509-e5a2f48716f9 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:38.567319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49819c7b-52a1-4c05-b509-e5a2f48716f9 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:38.569075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49819c7b-52a1-4c05-b509-e5a2f48716f9 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:38.570026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49819c7b-52a1-4c05-b509-e5a2f48716f9 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:38.721588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-52ad4784-fda8-4a05-9fd4-8b863fdb2005 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:38.747859 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-52ad4784-fda8-4a05-9fd4-8b863fdb2005 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1324 microversion: 2.1 time: 0.761635 Jul 28 03:57:38.753375 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2036/4565] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:37 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1324 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:57:38.830999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-441b097e-39b6-4e7d-9172-c6bc1b96da6c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:38.831616 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-441b097e-39b6-4e7d-9172-c6bc1b96da6c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:38.844661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-441b097e-39b6-4e7d-9172-c6bc1b96da6c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:38.845152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-441b097e-39b6-4e7d-9172-c6bc1b96da6c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:38.848385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-441b097e-39b6-4e7d-9172-c6bc1b96da6c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:38.850753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-441b097e-39b6-4e7d-9172-c6bc1b96da6c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:39.377472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-49819c7b-52a1-4c05-b509-e5a2f48716f9 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:39.396281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-49819c7b-52a1-4c05-b509-e5a2f48716f9 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:39.398943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-49819c7b-52a1-4c05-b509-e5a2f48716f9 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:39.401874 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-49819c7b-52a1-4c05-b509-e5a2f48716f9 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.855056 Jul 28 03:57:39.418797 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2530/4566] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:38 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:39.448823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-441b097e-39b6-4e7d-9172-c6bc1b96da6c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:39.462805 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-441b097e-39b6-4e7d-9172-c6bc1b96da6c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1509 microversion: 2.1 time: 0.636436 Jul 28 03:57:39.463344 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2037/4567] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:38 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1509 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:39.509829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d8023ca1-c191-4911-930b-3ff3e7a6c25d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:39.510893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d8023ca1-c191-4911-930b-3ff3e7a6c25d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:39.518783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8023ca1-c191-4911-930b-3ff3e7a6c25d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:39.519387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8023ca1-c191-4911-930b-3ff3e7a6c25d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:39.520275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8023ca1-c191-4911-930b-3ff3e7a6c25d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:39.521154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8023ca1-c191-4911-930b-3ff3e7a6c25d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:39.773056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fcc811b2-7ea7-49fc-a7fc-f1daa225ac6d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:39.773844 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fcc811b2-7ea7-49fc-a7fc-f1daa225ac6d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:39.781477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fcc811b2-7ea7-49fc-a7fc-f1daa225ac6d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:39.782280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fcc811b2-7ea7-49fc-a7fc-f1daa225ac6d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:39.783313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fcc811b2-7ea7-49fc-a7fc-f1daa225ac6d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:39.784067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fcc811b2-7ea7-49fc-a7fc-f1daa225ac6d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:40.095604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d8023ca1-c191-4911-930b-3ff3e7a6c25d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:40.109032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d8023ca1-c191-4911-930b-3ff3e7a6c25d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:40.111825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d8023ca1-c191-4911-930b-3ff3e7a6c25d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:40.113628 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d8023ca1-c191-4911-930b-3ff3e7a6c25d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1726 microversion: 2.20 time: 0.608524 Jul 28 03:57:40.114847 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2531/4568] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:39 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1726 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:40.443035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e6652d9-c963-4bf3-b724-409865daafbf tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:40.450318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4e6652d9-c963-4bf3-b724-409865daafbf tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:40.467088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e6652d9-c963-4bf3-b724-409865daafbf tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:40.467607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e6652d9-c963-4bf3-b724-409865daafbf tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:40.468505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e6652d9-c963-4bf3-b724-409865daafbf tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:40.469000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e6652d9-c963-4bf3-b724-409865daafbf tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:40.647037 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fcc811b2-7ea7-49fc-a7fc-f1daa225ac6d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:40.661199 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fcc811b2-7ea7-49fc-a7fc-f1daa225ac6d tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1324 microversion: 2.1 time: 0.892026 Jul 28 03:57:40.665658 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2038/4569] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:39 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1324 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:57:40.676401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1615575f-0495-477a-9d5b-2a68f251e23f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:40.679568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1615575f-0495-477a-9d5b-2a68f251e23f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:40.698252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1615575f-0495-477a-9d5b-2a68f251e23f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:40.699487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1615575f-0495-477a-9d5b-2a68f251e23f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:40.701709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1615575f-0495-477a-9d5b-2a68f251e23f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:40.704247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1615575f-0495-477a-9d5b-2a68f251e23f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:41.360517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e6652d9-c963-4bf3-b724-409865daafbf tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:41.376471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e6652d9-c963-4bf3-b724-409865daafbf tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:41.378388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e6652d9-c963-4bf3-b724-409865daafbf tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:41.382008 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e6652d9-c963-4bf3-b724-409865daafbf tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.957408 Jul 28 03:57:41.383945 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2532/4570] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:40 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:41.392328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-544e542e-2116-49a6-8eaa-09bb553e1113 req-c4aba117-77d5-4ca6-8a5f-593b975deffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a1c942a-4526-4211-b817-be3d04684034", "tag": "6a278b38-026b-4813-aeb3-4c97e440b23a"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:41.416760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-544e542e-2116-49a6-8eaa-09bb553e1113 req-c4aba117-77d5-4ca6-8a5f-593b975deffa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:41.421042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-544e542e-2116-49a6-8eaa-09bb553e1113 req-c4aba117-77d5-4ca6-8a5f-593b975deffa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:41.451286 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-544e542e-2116-49a6-8eaa-09bb553e1113 req-c4aba117-77d5-4ca6-8a5f-593b975deffa service nova] Creating event network-changed:6a278b38-026b-4813-aeb3-4c97e440b23a for instance 7a1c942a-4526-4211-b817-be3d04684034 on n-h1-826756-3 Jul 28 03:57:41.465629 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-544e542e-2116-49a6-8eaa-09bb553e1113 req-c4aba117-77d5-4ca6-8a5f-593b975deffa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078034 Jul 28 03:57:41.477251 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2533/4571] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:41.484008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-22198a64-7ab0-48dc-bdd3-b77be8dd88fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:41.484998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-22198a64-7ab0-48dc-bdd3-b77be8dd88fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:41.493216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22198a64-7ab0-48dc-bdd3-b77be8dd88fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:41.494422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22198a64-7ab0-48dc-bdd3-b77be8dd88fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:41.495649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22198a64-7ab0-48dc-bdd3-b77be8dd88fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:41.496421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22198a64-7ab0-48dc-bdd3-b77be8dd88fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:41.658902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1615575f-0495-477a-9d5b-2a68f251e23f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:41.686995 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1615575f-0495-477a-9d5b-2a68f251e23f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1509 microversion: 2.1 time: 1.014428 Jul 28 03:57:41.688175 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2039/4572] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:40 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1509 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:41.705622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7f084f5e-22fd-48df-b36e-60372fc6a91a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:41.706285 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7f084f5e-22fd-48df-b36e-60372fc6a91a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:41.722203 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f084f5e-22fd-48df-b36e-60372fc6a91a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:41.722660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f084f5e-22fd-48df-b36e-60372fc6a91a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:41.733640 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f084f5e-22fd-48df-b36e-60372fc6a91a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:41.734232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7f084f5e-22fd-48df-b36e-60372fc6a91a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:42.156183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-22198a64-7ab0-48dc-bdd3-b77be8dd88fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:42.172828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-22198a64-7ab0-48dc-bdd3-b77be8dd88fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:42.177542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-22198a64-7ab0-48dc-bdd3-b77be8dd88fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:42.182420 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-22198a64-7ab0-48dc-bdd3-b77be8dd88fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1726 microversion: 2.20 time: 0.701827 Jul 28 03:57:42.183244 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2534/4573] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:41 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1726 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:42.201115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d8c3549a-08bc-43b8-886d-442993684d7d req-f677a436-88d9-4037-93d2-665017cbb831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d97b518-6a6e-44f8-9be3-940b6fa8c853", "name": "network-vif-unplugged", "status": "completed", "tag": "9ce2e89e-838e-4b08-b1df-2e933c36e5d1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:42.231552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d8c3549a-08bc-43b8-886d-442993684d7d req-f677a436-88d9-4037-93d2-665017cbb831 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:42.236946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d8c3549a-08bc-43b8-886d-442993684d7d req-f677a436-88d9-4037-93d2-665017cbb831 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:42.280072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.compute.server_external_events [req-d8c3549a-08bc-43b8-886d-442993684d7d req-f677a436-88d9-4037-93d2-665017cbb831 service nova] Unable to find a host for instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853. Dropping event network-vif-unplugged {{(pid=126071) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 03:57:42.283087 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d8c3549a-08bc-43b8-886d-442993684d7d req-f677a436-88d9-4037-93d2-665017cbb831 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.089753 Jul 28 03:57:42.284032 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2535/4574] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 95 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 03:57:42.407646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83beaa3b-5d6e-4ac8-82bc-7fe18fcbee17 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:42.408307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-83beaa3b-5d6e-4ac8-82bc-7fe18fcbee17 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:42.422275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83beaa3b-5d6e-4ac8-82bc-7fe18fcbee17 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:42.422740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83beaa3b-5d6e-4ac8-82bc-7fe18fcbee17 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:42.423570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83beaa3b-5d6e-4ac8-82bc-7fe18fcbee17 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:42.430788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83beaa3b-5d6e-4ac8-82bc-7fe18fcbee17 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:42.922289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-83beaa3b-5d6e-4ac8-82bc-7fe18fcbee17 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:42.937016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-83beaa3b-5d6e-4ac8-82bc-7fe18fcbee17 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:42.948620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-83beaa3b-5d6e-4ac8-82bc-7fe18fcbee17 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:42.950083 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-83beaa3b-5d6e-4ac8-82bc-7fe18fcbee17 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.546700 Jul 28 03:57:42.950776 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2536/4575] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:42 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:57:42.975668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-913db7b2-092f-4ac2-a6df-1e1baf34b4ae tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:42.976692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-913db7b2-092f-4ac2-a6df-1e1baf34b4ae tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:42.984103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-913db7b2-092f-4ac2-a6df-1e1baf34b4ae tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:42.984824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-913db7b2-092f-4ac2-a6df-1e1baf34b4ae tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:42.985842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-913db7b2-092f-4ac2-a6df-1e1baf34b4ae tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:42.986509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-913db7b2-092f-4ac2-a6df-1e1baf34b4ae tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:43.468659 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7f084f5e-22fd-48df-b36e-60372fc6a91a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:43.483023 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7f084f5e-22fd-48df-b36e-60372fc6a91a tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1324 microversion: 2.1 time: 1.793220 Jul 28 03:57:43.486667 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2040/4576] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:41 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1324 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:43.498037 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-264cd00d-0789-4f40-a5d1-140d0cc507af tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:43.500611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-264cd00d-0789-4f40-a5d1-140d0cc507af tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:43.523300 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-264cd00d-0789-4f40-a5d1-140d0cc507af tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:43.523829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-264cd00d-0789-4f40-a5d1-140d0cc507af tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:43.525000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-264cd00d-0789-4f40-a5d1-140d0cc507af tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:43.525569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-264cd00d-0789-4f40-a5d1-140d0cc507af tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:43.957689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-913db7b2-092f-4ac2-a6df-1e1baf34b4ae tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:43.969347 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-913db7b2-092f-4ac2-a6df-1e1baf34b4ae tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1452 microversion: 2.1 time: 0.998717 Jul 28 03:57:43.976841 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2537/4577] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:42 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1452 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:43.987147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-cf47dc15-86a0-4d6a-bab2-629bba602206 req-bf5cdb3a-42d5-481e-be1e-8d2cdc0eddc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "tag": "38bf4b83-740e-43e2-b390-d6fec119fa7f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:44.015750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cf47dc15-86a0-4d6a-bab2-629bba602206 req-bf5cdb3a-42d5-481e-be1e-8d2cdc0eddc3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:44.016555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cf47dc15-86a0-4d6a-bab2-629bba602206 req-bf5cdb3a-42d5-481e-be1e-8d2cdc0eddc3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:44.040200 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-cf47dc15-86a0-4d6a-bab2-629bba602206 req-bf5cdb3a-42d5-481e-be1e-8d2cdc0eddc3 service nova] Creating event network-changed:38bf4b83-740e-43e2-b390-d6fec119fa7f for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:57:44.054696 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-cf47dc15-86a0-4d6a-bab2-629bba602206 req-bf5cdb3a-42d5-481e-be1e-8d2cdc0eddc3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076284 Jul 28 03:57:44.060762 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2538/4578] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:44.068502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0122d299-dc71-4bff-b24d-fdb154eb9712 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:44.076564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0122d299-dc71-4bff-b24d-fdb154eb9712 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:44.098189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0122d299-dc71-4bff-b24d-fdb154eb9712 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:44.099035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0122d299-dc71-4bff-b24d-fdb154eb9712 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:44.099455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0122d299-dc71-4bff-b24d-fdb154eb9712 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:44.099876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0122d299-dc71-4bff-b24d-fdb154eb9712 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:44.764296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-264cd00d-0789-4f40-a5d1-140d0cc507af tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:44.784552 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-264cd00d-0789-4f40-a5d1-140d0cc507af tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:44.809738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-264cd00d-0789-4f40-a5d1-140d0cc507af tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:44.810951 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-264cd00d-0789-4f40-a5d1-140d0cc507af tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1747 microversion: 2.20 time: 1.322955 Jul 28 03:57:44.811558 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2041/4579] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:43 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1747 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:44.828467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6c68d90b-fe9d-4d56-a07a-da1cb9b9ac71 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:44.829512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6c68d90b-fe9d-4d56-a07a-da1cb9b9ac71 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:44.836867 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6c68d90b-fe9d-4d56-a07a-da1cb9b9ac71 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:44.845128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6c68d90b-fe9d-4d56-a07a-da1cb9b9ac71 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:44.846353 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6c68d90b-fe9d-4d56-a07a-da1cb9b9ac71 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:44.848317 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6c68d90b-fe9d-4d56-a07a-da1cb9b9ac71 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:45.386173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0122d299-dc71-4bff-b24d-fdb154eb9712 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:45.389239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:45.412397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0122d299-dc71-4bff-b24d-fdb154eb9712 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:45.417961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0122d299-dc71-4bff-b24d-fdb154eb9712 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:45.425275 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0122d299-dc71-4bff-b24d-fdb154eb9712 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 1.360419 Jul 28 03:57:45.425275 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2539/4580] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:44 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:45.436618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8847f44d-f0d9-4af0-a8b0-4083b47277a5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:45.441179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8847f44d-f0d9-4af0-a8b0-4083b47277a5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:45.453714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8847f44d-f0d9-4af0-a8b0-4083b47277a5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:45.455514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8847f44d-f0d9-4af0-a8b0-4083b47277a5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:45.458536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8847f44d-f0d9-4af0-a8b0-4083b47277a5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:45.459508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8847f44d-f0d9-4af0-a8b0-4083b47277a5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:46.183699 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6c68d90b-fe9d-4d56-a07a-da1cb9b9ac71 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:46.192219 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6c68d90b-fe9d-4d56-a07a-da1cb9b9ac71 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1452 microversion: 2.1 time: 1.379279 Jul 28 03:57:46.195843 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2042/4581] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:44 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1452 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:46.206657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-67816ea4-02b6-4978-ad4b-d5ed8d05f5a5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:46.207505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-67816ea4-02b6-4978-ad4b-d5ed8d05f5a5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:46.225903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67816ea4-02b6-4978-ad4b-d5ed8d05f5a5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:46.226681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67816ea4-02b6-4978-ad4b-d5ed8d05f5a5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:46.227646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67816ea4-02b6-4978-ad4b-d5ed8d05f5a5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:46.231630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8847f44d-f0d9-4af0-a8b0-4083b47277a5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:46.235518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67816ea4-02b6-4978-ad4b-d5ed8d05f5a5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:46.244002 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8847f44d-f0d9-4af0-a8b0-4083b47277a5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1324 microversion: 2.1 time: 0.816783 Jul 28 03:57:46.246038 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2540/4582] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:45 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1324 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:46.278784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:46.280596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8acbe884-e9b1-43ef-8d70-0be9c1e7b622 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:46.281652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8acbe884-e9b1-43ef-8d70-0be9c1e7b622 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:46.290606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8acbe884-e9b1-43ef-8d70-0be9c1e7b622 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:46.291544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8acbe884-e9b1-43ef-8d70-0be9c1e7b622 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:46.292577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8acbe884-e9b1-43ef-8d70-0be9c1e7b622 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:46.293260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8acbe884-e9b1-43ef-8d70-0be9c1e7b622 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:46.330622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-8acbe884-e9b1-43ef-8d70-0be9c1e7b622 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lazy-loading 'flavor' on Instance uuid 1d97b518-6a6e-44f8-9be3-940b6fa8c853 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:57:46.345727 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-8acbe884-e9b1-43ef-8d70-0be9c1e7b622 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Cannot 'shelve' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state shelved_offloaded Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8acbe884-e9b1-43ef-8d70-0be9c1e7b622 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action HTTP/1.1 Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 14 Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: {"shelve": {}} Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: exception: Cannot 'shelve' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state shelved_offloaded Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1d97b518-6a6e-44f8-9be3-940b6fa8c853', 'body': {'shelve': {}}} Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 276, in inner Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 28 03:57:46.347943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 03:57:46.352686 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 03:57:46.352686 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 03:57:46.352686 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state shelved_offloaded Jul 28 03:57:46.352686 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:46.352686 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:57:46.352686 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:46.352686 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:57:46.352686 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:57:46.352686 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:57:46.352686 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:57:46.352686 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:57:46.352686 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state shelved_offloaded Jul 28 03:57:46.352686 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:57:46.366787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8acbe884-e9b1-43ef-8d70-0be9c1e7b622 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 409 to user: Cannot 'shelve' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state shelved_offloaded {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:57:46.368258 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8acbe884-e9b1-43ef-8d70-0be9c1e7b622 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action" status: 409 len: 155 microversion: 2.1 time: 0.094357 Jul 28 03:57:46.369857 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2541/4583] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:57:46 2022] POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action => generated 155 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 28 03:57:46.378224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-69ebf567-e882-440b-a647-5f27da04a615 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:46.378835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-69ebf567-e882-440b-a647-5f27da04a615 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:46.403353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69ebf567-e882-440b-a647-5f27da04a615 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:46.404011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69ebf567-e882-440b-a647-5f27da04a615 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:46.405254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69ebf567-e882-440b-a647-5f27da04a615 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:46.405701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69ebf567-e882-440b-a647-5f27da04a615 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:46.509668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-69ebf567-e882-440b-a647-5f27da04a615 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126071) unshelve /opt/stack/nova/nova/compute/api.py:4575}} Jul 28 03:57:46.735965 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-69ebf567-e882-440b-a647-5f27da04a615 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action" status: 202 len: 0 microversion: 2.1 time: 0.361534 Jul 28 03:57:46.739112 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2542/4584] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:57:46 2022] POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:57:46.760472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c23f894-8d7a-4a87-b93c-8c1622546faa tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:46.761613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c23f894-8d7a-4a87-b93c-8c1622546faa tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:46.787611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c23f894-8d7a-4a87-b93c-8c1622546faa tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:46.788283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c23f894-8d7a-4a87-b93c-8c1622546faa tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:46.789374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c23f894-8d7a-4a87-b93c-8c1622546faa tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:46.790009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c23f894-8d7a-4a87-b93c-8c1622546faa tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:47.288871 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-67816ea4-02b6-4978-ad4b-d5ed8d05f5a5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:47.301969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-67816ea4-02b6-4978-ad4b-d5ed8d05f5a5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:47.303484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-67816ea4-02b6-4978-ad4b-d5ed8d05f5a5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:47.304708 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-67816ea4-02b6-4978-ad4b-d5ed8d05f5a5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1742 microversion: 2.20 time: 1.103428 Jul 28 03:57:47.312205 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2043/4585] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:46 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1742 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:47.343588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c5f83dd6-2662-4bf0-9004-64e966be4661 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:47.344537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c5f83dd6-2662-4bf0-9004-64e966be4661 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:47.364424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5f83dd6-2662-4bf0-9004-64e966be4661 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:47.369978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5f83dd6-2662-4bf0-9004-64e966be4661 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:47.371258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5f83dd6-2662-4bf0-9004-64e966be4661 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:47.372943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5f83dd6-2662-4bf0-9004-64e966be4661 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:48.151065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c5f83dd6-2662-4bf0-9004-64e966be4661 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:48.178449 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c5f83dd6-2662-4bf0-9004-64e966be4661 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1460 microversion: 2.1 time: 0.840526 Jul 28 03:57:48.198035 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2044/4586] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:47 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1460 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:48.203749 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-e8b3488b-3650-4893-9a2f-bc626fcbc191 req-44f5ae58-6167-4350-b9da-7e3befad5b62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "tag": "c99034ef-97e5-4be0-9e5c-c75bd4555ab6"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:48.217112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e8b3488b-3650-4893-9a2f-bc626fcbc191 req-44f5ae58-6167-4350-b9da-7e3befad5b62 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:48.222437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e8b3488b-3650-4893-9a2f-bc626fcbc191 req-44f5ae58-6167-4350-b9da-7e3befad5b62 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:48.248011 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-e8b3488b-3650-4893-9a2f-bc626fcbc191 req-44f5ae58-6167-4350-b9da-7e3befad5b62 service nova] Creating event network-changed:c99034ef-97e5-4be0-9e5c-c75bd4555ab6 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:57:48.257537 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-e8b3488b-3650-4893-9a2f-bc626fcbc191 req-44f5ae58-6167-4350-b9da-7e3befad5b62 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058132 Jul 28 03:57:48.258472 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2045/4587] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:48.270874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9224b007-71ff-4af6-858c-54fc85390477 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:48.271914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9224b007-71ff-4af6-858c-54fc85390477 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:48.281054 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9224b007-71ff-4af6-858c-54fc85390477 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:48.281813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9224b007-71ff-4af6-858c-54fc85390477 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:48.282934 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9224b007-71ff-4af6-858c-54fc85390477 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:48.283539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9224b007-71ff-4af6-858c-54fc85390477 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:48.500616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c23f894-8d7a-4a87-b93c-8c1622546faa tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:48.510763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c23f894-8d7a-4a87-b93c-8c1622546faa tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:48.512340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c23f894-8d7a-4a87-b93c-8c1622546faa tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:48.513761 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c23f894-8d7a-4a87-b93c-8c1622546faa tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 1.771434 Jul 28 03:57:48.514804 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2543/4588] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:46 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:48.529520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-efbe07c8-9420-42f8-939b-a30a1a98003d req-12989b8d-f343-45ce-b423-faa56c34f67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8", "name": "network-vif-plugged", "status": "completed", "tag": "565bb390-f25a-4510-b22a-3975e600ba96"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:48.552980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-efbe07c8-9420-42f8-939b-a30a1a98003d req-12989b8d-f343-45ce-b423-faa56c34f67f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:48.553749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-efbe07c8-9420-42f8-939b-a30a1a98003d req-12989b8d-f343-45ce-b423-faa56c34f67f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:48.580071 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-efbe07c8-9420-42f8-939b-a30a1a98003d req-12989b8d-f343-45ce-b423-faa56c34f67f service nova] Creating event network-vif-plugged:565bb390-f25a-4510-b22a-3975e600ba96 for instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 on n-h2-826756-3 Jul 28 03:57:48.590627 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-efbe07c8-9420-42f8-939b-a30a1a98003d req-12989b8d-f343-45ce-b423-faa56c34f67f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074399 Jul 28 03:57:48.595817 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2544/4589] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:48.610479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3018b51b-ec07-4d04-83c7-31399da4ad8b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:48.611659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3018b51b-ec07-4d04-83c7-31399da4ad8b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:48.627731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3018b51b-ec07-4d04-83c7-31399da4ad8b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:48.630110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3018b51b-ec07-4d04-83c7-31399da4ad8b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:48.631379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3018b51b-ec07-4d04-83c7-31399da4ad8b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:48.632096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3018b51b-ec07-4d04-83c7-31399da4ad8b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:48.741837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9224b007-71ff-4af6-858c-54fc85390477 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:48.752303 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9224b007-71ff-4af6-858c-54fc85390477 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1324 microversion: 2.1 time: 0.492454 Jul 28 03:57:48.756799 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2046/4590] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:48 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1324 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:49.208017 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-372aeeb5-1866-48e8-9094-33786fff4ced tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:49.208750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-372aeeb5-1866-48e8-9094-33786fff4ced tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:49.221217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-372aeeb5-1866-48e8-9094-33786fff4ced tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:49.221670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-372aeeb5-1866-48e8-9094-33786fff4ced tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:49.235705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-372aeeb5-1866-48e8-9094-33786fff4ced tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:49.238901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-372aeeb5-1866-48e8-9094-33786fff4ced tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:49.660725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3018b51b-ec07-4d04-83c7-31399da4ad8b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:49.695087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3018b51b-ec07-4d04-83c7-31399da4ad8b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:49.708279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3018b51b-ec07-4d04-83c7-31399da4ad8b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:49.714221 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3018b51b-ec07-4d04-83c7-31399da4ad8b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1742 microversion: 2.20 time: 1.115193 Jul 28 03:57:49.728389 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2545/4591] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:48 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1742 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:49.741033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-de93e9ad-d6a7-4b23-adb9-c2a3eef52013 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:49.741662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-de93e9ad-d6a7-4b23-adb9-c2a3eef52013 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:49.752261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de93e9ad-d6a7-4b23-adb9-c2a3eef52013 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:49.752777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de93e9ad-d6a7-4b23-adb9-c2a3eef52013 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:49.753686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de93e9ad-d6a7-4b23-adb9-c2a3eef52013 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:49.754984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de93e9ad-d6a7-4b23-adb9-c2a3eef52013 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:49.894230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-372aeeb5-1866-48e8-9094-33786fff4ced tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:49.903798 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-372aeeb5-1866-48e8-9094-33786fff4ced tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 0.699639 Jul 28 03:57:49.908586 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2047/4592] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:49 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:49.918348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9791b48a-c803-4820-a3dd-b6017119a6f4 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:49.920859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9791b48a-c803-4820-a3dd-b6017119a6f4 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:49.948065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9791b48a-c803-4820-a3dd-b6017119a6f4 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:49.950100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9791b48a-c803-4820-a3dd-b6017119a6f4 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:49.951094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9791b48a-c803-4820-a3dd-b6017119a6f4 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:49.951711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9791b48a-c803-4820-a3dd-b6017119a6f4 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:50.376468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9791b48a-c803-4820-a3dd-b6017119a6f4 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:50.389377 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9791b48a-c803-4820-a3dd-b6017119a6f4 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1324 microversion: 2.1 time: 0.478896 Jul 28 03:57:50.390567 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2048/4593] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:49 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1324 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:50.555026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-de93e9ad-d6a7-4b23-adb9-c2a3eef52013 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:50.573336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-de93e9ad-d6a7-4b23-adb9-c2a3eef52013 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:50.575300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-de93e9ad-d6a7-4b23-adb9-c2a3eef52013 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:50.577095 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-de93e9ad-d6a7-4b23-adb9-c2a3eef52013 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.842413 Jul 28 03:57:50.577689 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2546/4594] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:49 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:50.626505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-4dd4d6a5-1f4a-4089-b46c-539f7ac1376a req-95b0c751-6f3c-434e-b1ad-1410e4df6381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "tag": "be6e42cc-90f4-4e57-8cd7-6338a1670214"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:50.645635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4dd4d6a5-1f4a-4089-b46c-539f7ac1376a req-95b0c751-6f3c-434e-b1ad-1410e4df6381 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:50.651904 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4dd4d6a5-1f4a-4089-b46c-539f7ac1376a req-95b0c751-6f3c-434e-b1ad-1410e4df6381 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:50.685648 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-4dd4d6a5-1f4a-4089-b46c-539f7ac1376a req-95b0c751-6f3c-434e-b1ad-1410e4df6381 service nova] Creating event network-changed:be6e42cc-90f4-4e57-8cd7-6338a1670214 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:57:50.702226 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-4dd4d6a5-1f4a-4089-b46c-539f7ac1376a req-95b0c751-6f3c-434e-b1ad-1410e4df6381 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079309 Jul 28 03:57:50.708855 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2049/4595] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:50.743720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f77f3137-ab5f-47ee-8ed8-71e8b13cb27a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:50.744344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f77f3137-ab5f-47ee-8ed8-71e8b13cb27a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:50.771437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f77f3137-ab5f-47ee-8ed8-71e8b13cb27a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:50.772030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f77f3137-ab5f-47ee-8ed8-71e8b13cb27a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:50.772921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f77f3137-ab5f-47ee-8ed8-71e8b13cb27a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:50.773367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f77f3137-ab5f-47ee-8ed8-71e8b13cb27a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:50.934566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dcf1baf5-5a7f-44ce-849e-e36241f3c1c4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:50.935857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dcf1baf5-5a7f-44ce-849e-e36241f3c1c4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:50.953078 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dcf1baf5-5a7f-44ce-849e-e36241f3c1c4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:50.953937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dcf1baf5-5a7f-44ce-849e-e36241f3c1c4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:50.955089 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dcf1baf5-5a7f-44ce-849e-e36241f3c1c4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:50.958351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dcf1baf5-5a7f-44ce-849e-e36241f3c1c4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:51.824967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f77f3137-ab5f-47ee-8ed8-71e8b13cb27a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:51.835353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f77f3137-ab5f-47ee-8ed8-71e8b13cb27a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:51.845208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f77f3137-ab5f-47ee-8ed8-71e8b13cb27a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:51.850413 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f77f3137-ab5f-47ee-8ed8-71e8b13cb27a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1742 microversion: 2.20 time: 1.111046 Jul 28 03:57:51.851560 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2547/4596] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:50 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1742 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:51.856707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ea0272f2-e4e0-4f70-bebd-165b4a42fc04 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:51.869461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ea0272f2-e4e0-4f70-bebd-165b4a42fc04 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:51.896238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea0272f2-e4e0-4f70-bebd-165b4a42fc04 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:51.896744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea0272f2-e4e0-4f70-bebd-165b4a42fc04 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:51.897516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea0272f2-e4e0-4f70-bebd-165b4a42fc04 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:51.898142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea0272f2-e4e0-4f70-bebd-165b4a42fc04 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:51.955663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dcf1baf5-5a7f-44ce-849e-e36241f3c1c4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:51.971570 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dcf1baf5-5a7f-44ce-849e-e36241f3c1c4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 1.041882 Jul 28 03:57:51.976439 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2050/4597] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:50 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:51.986729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b0e8f35e-b51f-4d27-9ca9-06332ee6f78a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:51.988980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b0e8f35e-b51f-4d27-9ca9-06332ee6f78a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:52.004240 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0e8f35e-b51f-4d27-9ca9-06332ee6f78a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:52.006665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0e8f35e-b51f-4d27-9ca9-06332ee6f78a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:52.008386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0e8f35e-b51f-4d27-9ca9-06332ee6f78a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:52.009873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b0e8f35e-b51f-4d27-9ca9-06332ee6f78a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:52.377302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ea0272f2-e4e0-4f70-bebd-165b4a42fc04 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:52.392449 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ea0272f2-e4e0-4f70-bebd-165b4a42fc04 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1324 microversion: 2.1 time: 0.539322 Jul 28 03:57:52.393134 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2548/4598] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:51 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1324 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:52.868853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1080685255", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "d9172a61-4f2e-479f-b066-cfcfa8231c4d"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:53.010338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] validate_networks() for [('d9172a61-4f2e-479f-b066-cfcfa8231c4d', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:57:53.576939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b0e8f35e-b51f-4d27-9ca9-06332ee6f78a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:53.593439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b0e8f35e-b51f-4d27-9ca9-06332ee6f78a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:53.605589 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b0e8f35e-b51f-4d27-9ca9-06332ee6f78a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:53.616587 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b0e8f35e-b51f-4d27-9ca9-06332ee6f78a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 1.636645 Jul 28 03:57:53.618463 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2051/4599] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:51 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:53.647661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-faee3f5a-850e-4a5f-ac75-5cb07028b8f1 req-50c6f6d3-581d-46ff-b17a-4898c4d5e509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1c942a-4526-4211-b817-be3d04684034", "name": "network-vif-plugged", "status": "completed", "tag": "6a278b38-026b-4813-aeb3-4c97e440b23a"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:53.670020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-faee3f5a-850e-4a5f-ac75-5cb07028b8f1 req-50c6f6d3-581d-46ff-b17a-4898c4d5e509 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:53.671587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-faee3f5a-850e-4a5f-ac75-5cb07028b8f1 req-50c6f6d3-581d-46ff-b17a-4898c4d5e509 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:53.711673 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-faee3f5a-850e-4a5f-ac75-5cb07028b8f1 req-50c6f6d3-581d-46ff-b17a-4898c4d5e509 service nova] Creating event network-vif-plugged:6a278b38-026b-4813-aeb3-4c97e440b23a for instance 7a1c942a-4526-4211-b817-be3d04684034 on n-h1-826756-3 Jul 28 03:57:53.719172 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-faee3f5a-850e-4a5f-ac75-5cb07028b8f1 req-50c6f6d3-581d-46ff-b17a-4898c4d5e509 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083928 Jul 28 03:57:53.727934 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2052/4600] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:53.735117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-166a18d7-e487-4902-870d-a898de48ddb6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:53.742985 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-166a18d7-e487-4902-870d-a898de48ddb6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:53.780306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-166a18d7-e487-4902-870d-a898de48ddb6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:53.782147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-166a18d7-e487-4902-870d-a898de48ddb6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:53.784876 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-166a18d7-e487-4902-870d-a898de48ddb6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:53.788326 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-166a18d7-e487-4902-870d-a898de48ddb6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:54.557869 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-166a18d7-e487-4902-870d-a898de48ddb6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:54.576586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-166a18d7-e487-4902-870d-a898de48ddb6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:54.588199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-166a18d7-e487-4902-870d-a898de48ddb6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:54.593008 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-166a18d7-e487-4902-870d-a898de48ddb6 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1742 microversion: 2.20 time: 0.862786 Jul 28 03:57:54.595387 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2053/4601] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:53 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1742 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:54.619082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-53030ab0-a639-47a6-9454-d4592ff9f10e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:54.620598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-53030ab0-a639-47a6-9454-d4592ff9f10e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:54.627645 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-53030ab0-a639-47a6-9454-d4592ff9f10e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:54.628494 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-53030ab0-a639-47a6-9454-d4592ff9f10e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:54.629508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-53030ab0-a639-47a6-9454-d4592ff9f10e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:54.639367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-53030ab0-a639-47a6-9454-d4592ff9f10e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:55.407871 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-53030ab0-a639-47a6-9454-d4592ff9f10e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:55.430521 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-53030ab0-a639-47a6-9454-d4592ff9f10e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 0.816604 Jul 28 03:57:55.435121 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2054/4602] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:54 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:55.454157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f025600d-5fb5-4adb-a1b1-01a03609f3f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:55.457561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f025600d-5fb5-4adb-a1b1-01a03609f3f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:55.488051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f025600d-5fb5-4adb-a1b1-01a03609f3f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:55.491964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f025600d-5fb5-4adb-a1b1-01a03609f3f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:55.497090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f025600d-5fb5-4adb-a1b1-01a03609f3f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:55.504247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f025600d-5fb5-4adb-a1b1-01a03609f3f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:56.455654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f025600d-5fb5-4adb-a1b1-01a03609f3f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:56.466863 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f025600d-5fb5-4adb-a1b1-01a03609f3f5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1324 microversion: 2.1 time: 1.030415 Jul 28 03:57:56.469402 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2055/4603] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:55 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1324 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:56.475893 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3f8a6248-cd8c-4933-8661-5e47216e2cb8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:56.489117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3f8a6248-cd8c-4933-8661-5e47216e2cb8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:56.513181 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f8a6248-cd8c-4933-8661-5e47216e2cb8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:56.513905 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f8a6248-cd8c-4933-8661-5e47216e2cb8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:56.514854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f8a6248-cd8c-4933-8661-5e47216e2cb8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:56.515435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f8a6248-cd8c-4933-8661-5e47216e2cb8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:57.445086 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3f8a6248-cd8c-4933-8661-5e47216e2cb8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:57.470949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3f8a6248-cd8c-4933-8661-5e47216e2cb8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:57.479473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3f8a6248-cd8c-4933-8661-5e47216e2cb8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:57.486490 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3f8a6248-cd8c-4933-8661-5e47216e2cb8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 1.013407 Jul 28 03:57:57.511881 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2056/4604] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:56 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:57.532826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-441d5978-71a3-4b3b-99b6-a1571318e11a req-68b31d9e-2fa2-4b7c-8b3c-ea19e5261844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "tag": "34b7d23e-2c19-42f4-9d5c-35c32bdd3b9a"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:57:57.564285 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-441d5978-71a3-4b3b-99b6-a1571318e11a req-68b31d9e-2fa2-4b7c-8b3c-ea19e5261844 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:57.565032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-441d5978-71a3-4b3b-99b6-a1571318e11a req-68b31d9e-2fa2-4b7c-8b3c-ea19e5261844 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:57.587702 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-441d5978-71a3-4b3b-99b6-a1571318e11a req-68b31d9e-2fa2-4b7c-8b3c-ea19e5261844 service nova] Creating event network-changed:34b7d23e-2c19-42f4-9d5c-35c32bdd3b9a for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:57:57.606383 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-441d5978-71a3-4b3b-99b6-a1571318e11a req-68b31d9e-2fa2-4b7c-8b3c-ea19e5261844 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092944 Jul 28 03:57:57.613073 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2057/4605] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:57.630964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fa3c31f6-efd4-4c16-97b9-2789ac3cab7c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:57.635389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fa3c31f6-efd4-4c16-97b9-2789ac3cab7c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:57.651175 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa3c31f6-efd4-4c16-97b9-2789ac3cab7c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:57.654517 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa3c31f6-efd4-4c16-97b9-2789ac3cab7c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:57.655701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa3c31f6-efd4-4c16-97b9-2789ac3cab7c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:57.656898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fa3c31f6-efd4-4c16-97b9-2789ac3cab7c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:57.848204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:57:57.848723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:57:57.849113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:57:57.849522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:57:57.849930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:57:57.854411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:57.886212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:57.892019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:57.898237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:57.900378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:58.006829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Getting quotas for project f58c45a3aea94254bd0a33d571392445. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:57:58.015624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Getting quotas for user 6d2e71606e2b4d13aa991bf4fd7367da and project f58c45a3aea94254bd0a33d571392445. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:57:58.064937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:57:58.067850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:57:58.170593 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74f49203-c495-46a2-90c3-ebc276d16097 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 5.771602 Jul 28 03:57:58.184183 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2549/4606] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:57:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 5785 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 03:57:58.214664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-92b9ede6-2546-4d6f-a474-5122a473de29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:58.215516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-92b9ede6-2546-4d6f-a474-5122a473de29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:58.257955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92b9ede6-2546-4d6f-a474-5122a473de29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:58.259239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92b9ede6-2546-4d6f-a474-5122a473de29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:58.260069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92b9ede6-2546-4d6f-a474-5122a473de29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:58.263363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92b9ede6-2546-4d6f-a474-5122a473de29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:58.290096 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fa3c31f6-efd4-4c16-97b9-2789ac3cab7c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:58.325191 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fa3c31f6-efd4-4c16-97b9-2789ac3cab7c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:58.338886 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fa3c31f6-efd4-4c16-97b9-2789ac3cab7c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:58.345027 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fa3c31f6-efd4-4c16-97b9-2789ac3cab7c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1742 microversion: 2.20 time: 0.728265 Jul 28 03:57:58.363069 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2058/4607] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:57 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1742 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:58.385340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-25419025-3140-4b96-9ca7-dd64849cfce2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:58.385959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-25419025-3140-4b96-9ca7-dd64849cfce2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:58.396002 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25419025-3140-4b96-9ca7-dd64849cfce2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:58.398521 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25419025-3140-4b96-9ca7-dd64849cfce2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:58.399714 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25419025-3140-4b96-9ca7-dd64849cfce2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:58.400318 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25419025-3140-4b96-9ca7-dd64849cfce2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:59.097093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-25419025-3140-4b96-9ca7-dd64849cfce2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:59.115048 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-25419025-3140-4b96-9ca7-dd64849cfce2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1522 microversion: 2.1 time: 0.750458 Jul 28 03:57:59.130476 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2059/4608] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:58 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1522 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:57:59.139573 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dd6e8f4f-9357-4964-ac87-22a3142de928 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:59.153700 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dd6e8f4f-9357-4964-ac87-22a3142de928 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:59.674929 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dd6e8f4f-9357-4964-ac87-22a3142de928 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:59.700429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dd6e8f4f-9357-4964-ac87-22a3142de928 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:59.709227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dd6e8f4f-9357-4964-ac87-22a3142de928 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:57:59.714189 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dd6e8f4f-9357-4964-ac87-22a3142de928 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1262 microversion: 2.26 time: 0.581488 Jul 28 03:57:59.733898 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2060/4609] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:59 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1262 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:59.742682 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4747f790-a1b5-4ac3-935a-6e8589e408c6 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:59.743563 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4747f790-a1b5-4ac3-935a-6e8589e408c6 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:57:59.753268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4747f790-a1b5-4ac3-935a-6e8589e408c6 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:59.754113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4747f790-a1b5-4ac3-935a-6e8589e408c6 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:59.755875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4747f790-a1b5-4ac3-935a-6e8589e408c6 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:59.756666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4747f790-a1b5-4ac3-935a-6e8589e408c6 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:00.228740 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4747f790-a1b5-4ac3-935a-6e8589e408c6 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:00.243319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4747f790-a1b5-4ac3-935a-6e8589e408c6 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:00.245064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4747f790-a1b5-4ac3-935a-6e8589e408c6 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:00.291164 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4747f790-a1b5-4ac3-935a-6e8589e408c6 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.511678 Jul 28 03:58:00.291164 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2061/4610] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:57:59 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:00.291164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8e8d2486-82ea-4674-aa27-38bda6ff5141 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:00.291164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8e8d2486-82ea-4674-aa27-38bda6ff5141 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:00.291164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e8d2486-82ea-4674-aa27-38bda6ff5141 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:00.291164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e8d2486-82ea-4674-aa27-38bda6ff5141 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:00.291164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e8d2486-82ea-4674-aa27-38bda6ff5141 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:00.291164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e8d2486-82ea-4674-aa27-38bda6ff5141 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:00.306598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8e8d2486-82ea-4674-aa27-38bda6ff5141 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:58:00.336990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-92b9ede6-2546-4d6f-a474-5122a473de29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:00.377592 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-92b9ede6-2546-4d6f-a474-5122a473de29 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 2.177244 Jul 28 03:58:00.380062 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2550/4611] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:57:58 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 2194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:00.408610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f60381f8-bd72-4aa4-a5d0-dc1993350855 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:00.417990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f60381f8-bd72-4aa4-a5d0-dc1993350855 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:00.431520 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:00.452564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f60381f8-bd72-4aa4-a5d0-dc1993350855 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:00.454556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f60381f8-bd72-4aa4-a5d0-dc1993350855 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:00.471679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f60381f8-bd72-4aa4-a5d0-dc1993350855 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:00.474501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f60381f8-bd72-4aa4-a5d0-dc1993350855 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:00.587664 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8e8d2486-82ea-4674-aa27-38bda6ff5141 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 204 len: 0 microversion: 2.1 time: 0.337545 Jul 28 03:58:00.589930 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2062/4612] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:58:00 2022] DELETE /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:58:00.607749 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d74887cf-6f7e-47ec-80c4-9549d46a34c5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:00.610688 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d74887cf-6f7e-47ec-80c4-9549d46a34c5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:00.624853 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d74887cf-6f7e-47ec-80c4-9549d46a34c5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:00.625384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d74887cf-6f7e-47ec-80c4-9549d46a34c5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:00.626196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d74887cf-6f7e-47ec-80c4-9549d46a34c5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:00.628397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d74887cf-6f7e-47ec-80c4-9549d46a34c5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:00.963511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f60381f8-bd72-4aa4-a5d0-dc1993350855 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:00.974444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f60381f8-bd72-4aa4-a5d0-dc1993350855 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:00.975980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f60381f8-bd72-4aa4-a5d0-dc1993350855 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:00.981970 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f60381f8-bd72-4aa4-a5d0-dc1993350855 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1742 microversion: 2.20 time: 0.593298 Jul 28 03:58:00.983175 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2551/4613] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:00 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1742 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:00.988142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d12fbb63-62e2-4404-bc30-ab0938fa5c09 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:00.989015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d12fbb63-62e2-4404-bc30-ab0938fa5c09 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:01.014025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d12fbb63-62e2-4404-bc30-ab0938fa5c09 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:01.017482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d12fbb63-62e2-4404-bc30-ab0938fa5c09 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:01.019821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d12fbb63-62e2-4404-bc30-ab0938fa5c09 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:01.020478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d12fbb63-62e2-4404-bc30-ab0938fa5c09 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:01.131052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d12fbb63-62e2-4404-bc30-ab0938fa5c09 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:01.146670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d12fbb63-62e2-4404-bc30-ab0938fa5c09 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:01.149085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d12fbb63-62e2-4404-bc30-ab0938fa5c09 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:01.150916 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d12fbb63-62e2-4404-bc30-ab0938fa5c09 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1322 microversion: 2.26 time: 0.166080 Jul 28 03:58:01.153952 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2552/4614] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:00 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:01.306971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d74887cf-6f7e-47ec-80c4-9549d46a34c5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:01.313823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51ecfba7-dfab-4eab-9a37-9e181a4ccb02 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:01.314459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-51ecfba7-dfab-4eab-9a37-9e181a4ccb02 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:01.320085 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d74887cf-6f7e-47ec-80c4-9549d46a34c5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1528 microversion: 2.1 time: 0.724767 Jul 28 03:58:01.324226 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2063/4615] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:00 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1528 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:01.339355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51ecfba7-dfab-4eab-9a37-9e181a4ccb02 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:01.340848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51ecfba7-dfab-4eab-9a37-9e181a4ccb02 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:01.341952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51ecfba7-dfab-4eab-9a37-9e181a4ccb02 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:01.343121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51ecfba7-dfab-4eab-9a37-9e181a4ccb02 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:01.410485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-26a9c171-054f-4d1b-ad00-49f6f90403ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:01.411895 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-26a9c171-054f-4d1b-ad00-49f6f90403ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:01.420885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26a9c171-054f-4d1b-ad00-49f6f90403ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:01.421882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26a9c171-054f-4d1b-ad00-49f6f90403ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:01.423081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26a9c171-054f-4d1b-ad00-49f6f90403ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:01.424003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-26a9c171-054f-4d1b-ad00-49f6f90403ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:01.873079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-51ecfba7-dfab-4eab-9a37-9e181a4ccb02 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:01.888681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-51ecfba7-dfab-4eab-9a37-9e181a4ccb02 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:01.894520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-51ecfba7-dfab-4eab-9a37-9e181a4ccb02 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:01.897019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-26a9c171-054f-4d1b-ad00-49f6f90403ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:01.899727 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51ecfba7-dfab-4eab-9a37-9e181a4ccb02 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.589985 Jul 28 03:58:01.901497 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2553/4616] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:01 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:01.923960 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-26a9c171-054f-4d1b-ad00-49f6f90403ea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 0.522812 Jul 28 03:58:01.925134 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2064/4617] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:01 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:02.009605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0881c5ab-1f9b-4445-9bc4-ce3dfa23fb1e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:02.010486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0881c5ab-1f9b-4445-9bc4-ce3dfa23fb1e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:02.021139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0881c5ab-1f9b-4445-9bc4-ce3dfa23fb1e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:02.029168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0881c5ab-1f9b-4445-9bc4-ce3dfa23fb1e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:02.031601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0881c5ab-1f9b-4445-9bc4-ce3dfa23fb1e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:02.033641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0881c5ab-1f9b-4445-9bc4-ce3dfa23fb1e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:02.179873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-47feb681-daa2-4c51-baa0-462c421c6745 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:02.180707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-47feb681-daa2-4c51-baa0-462c421c6745 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:02.187937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47feb681-daa2-4c51-baa0-462c421c6745 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:02.198745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47feb681-daa2-4c51-baa0-462c421c6745 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:02.200716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47feb681-daa2-4c51-baa0-462c421c6745 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:02.210257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47feb681-daa2-4c51-baa0-462c421c6745 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:02.586119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-47feb681-daa2-4c51-baa0-462c421c6745 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:02.589834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0881c5ab-1f9b-4445-9bc4-ce3dfa23fb1e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:02.601294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-47feb681-daa2-4c51-baa0-462c421c6745 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:02.606678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0881c5ab-1f9b-4445-9bc4-ce3dfa23fb1e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:02.610572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0881c5ab-1f9b-4445-9bc4-ce3dfa23fb1e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:02.611516 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-47feb681-daa2-4c51-baa0-462c421c6745 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:02.612984 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-47feb681-daa2-4c51-baa0-462c421c6745 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1332 microversion: 2.26 time: 0.437775 Jul 28 03:58:02.613727 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2065/4618] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:02 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1332 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:02.622999 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0881c5ab-1f9b-4445-9bc4-ce3dfa23fb1e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1742 microversion: 2.20 time: 0.607705 Jul 28 03:58:02.626688 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2554/4619] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:02 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1742 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:02.629354 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-426a22fc-a05f-48cd-a65c-07d8b13f86f9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:02.630278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-426a22fc-a05f-48cd-a65c-07d8b13f86f9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:02.655507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-426a22fc-a05f-48cd-a65c-07d8b13f86f9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:02.656321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-426a22fc-a05f-48cd-a65c-07d8b13f86f9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:02.658056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-426a22fc-a05f-48cd-a65c-07d8b13f86f9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:02.659048 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-426a22fc-a05f-48cd-a65c-07d8b13f86f9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:02.929051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-015b2812-c50e-4849-92ed-036c3bfd7be5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:02.929988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-015b2812-c50e-4849-92ed-036c3bfd7be5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:02.947974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-015b2812-c50e-4849-92ed-036c3bfd7be5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:02.949227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-015b2812-c50e-4849-92ed-036c3bfd7be5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:02.950513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-015b2812-c50e-4849-92ed-036c3bfd7be5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:02.951258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-015b2812-c50e-4849-92ed-036c3bfd7be5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:03.626776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-015b2812-c50e-4849-92ed-036c3bfd7be5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:03.643563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-015b2812-c50e-4849-92ed-036c3bfd7be5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:03.645214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-015b2812-c50e-4849-92ed-036c3bfd7be5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:03.646444 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-015b2812-c50e-4849-92ed-036c3bfd7be5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.722337 Jul 28 03:58:03.671186 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2555/4620] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:02 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:03.679660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-541dbc6a-c0b2-4fc2-afba-91bf86b87548 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:03.682687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-541dbc6a-c0b2-4fc2-afba-91bf86b87548 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:03.705623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-541dbc6a-c0b2-4fc2-afba-91bf86b87548 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:03.706332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-541dbc6a-c0b2-4fc2-afba-91bf86b87548 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:03.707415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-541dbc6a-c0b2-4fc2-afba-91bf86b87548 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:03.708149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-541dbc6a-c0b2-4fc2-afba-91bf86b87548 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:03.926800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-541dbc6a-c0b2-4fc2-afba-91bf86b87548 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:03.939545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:03.949353 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-541dbc6a-c0b2-4fc2-afba-91bf86b87548 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 0.275769 Jul 28 03:58:03.953331 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2556/4621] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:03 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:03.966374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0329931-2c95-4189-bf8f-d14c97551047 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:03.967758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e0329931-2c95-4189-bf8f-d14c97551047 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:03.982815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0329931-2c95-4189-bf8f-d14c97551047 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:03.985587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0329931-2c95-4189-bf8f-d14c97551047 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:03.990046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0329931-2c95-4189-bf8f-d14c97551047 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:03.996121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0329931-2c95-4189-bf8f-d14c97551047 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:04.695943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e0329931-2c95-4189-bf8f-d14c97551047 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:04.725774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e0329931-2c95-4189-bf8f-d14c97551047 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:04.727880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e0329931-2c95-4189-bf8f-d14c97551047 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:04.738868 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e0329931-2c95-4189-bf8f-d14c97551047 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1742 microversion: 2.20 time: 0.781591 Jul 28 03:58:04.741117 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2557/4622] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:03 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1742 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:04.787510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e342baaf-b82b-4f0a-8848-40040739cc05 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:04.790735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e342baaf-b82b-4f0a-8848-40040739cc05 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:04.837084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e342baaf-b82b-4f0a-8848-40040739cc05 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:04.838115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e342baaf-b82b-4f0a-8848-40040739cc05 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:04.845011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e342baaf-b82b-4f0a-8848-40040739cc05 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:04.845504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e342baaf-b82b-4f0a-8848-40040739cc05 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:04.849195 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-426a22fc-a05f-48cd-a65c-07d8b13f86f9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:04.862593 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-426a22fc-a05f-48cd-a65c-07d8b13f86f9 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1528 microversion: 2.1 time: 2.246791 Jul 28 03:58:04.864646 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2066/4623] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:02 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1528 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:04.879850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-09febfca-7978-4117-9ae2-ea797717d21c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:04.881273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-09febfca-7978-4117-9ae2-ea797717d21c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:04.901138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09febfca-7978-4117-9ae2-ea797717d21c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:04.901927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09febfca-7978-4117-9ae2-ea797717d21c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:04.903063 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09febfca-7978-4117-9ae2-ea797717d21c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:04.903712 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-09febfca-7978-4117-9ae2-ea797717d21c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:06.017680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-09febfca-7978-4117-9ae2-ea797717d21c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:06.035424 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-09febfca-7978-4117-9ae2-ea797717d21c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:06.042378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-09febfca-7978-4117-9ae2-ea797717d21c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:06.044214 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-09febfca-7978-4117-9ae2-ea797717d21c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 1.178281 Jul 28 03:58:06.058187 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2067/4624] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:04 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:06.071623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b553be91-c642-4ba4-97fa-9a900b7525b4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:06.078100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b553be91-c642-4ba4-97fa-9a900b7525b4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:06.091197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b553be91-c642-4ba4-97fa-9a900b7525b4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:06.098307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b553be91-c642-4ba4-97fa-9a900b7525b4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:06.099466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b553be91-c642-4ba4-97fa-9a900b7525b4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:06.100110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b553be91-c642-4ba4-97fa-9a900b7525b4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:06.467453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e342baaf-b82b-4f0a-8848-40040739cc05 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:06.485381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e342baaf-b82b-4f0a-8848-40040739cc05 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:06.492399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e342baaf-b82b-4f0a-8848-40040739cc05 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:06.492399 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e342baaf-b82b-4f0a-8848-40040739cc05 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1362 microversion: 2.26 time: 1.723683 Jul 28 03:58:06.501409 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2558/4625] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:04 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1362 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:06.511014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9f2df59-0ce6-4c44-92d0-a8a8bbd4e31f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:06.512072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9f2df59-0ce6-4c44-92d0-a8a8bbd4e31f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:06.520258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9f2df59-0ce6-4c44-92d0-a8a8bbd4e31f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:06.520978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9f2df59-0ce6-4c44-92d0-a8a8bbd4e31f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:06.521929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9f2df59-0ce6-4c44-92d0-a8a8bbd4e31f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:06.522654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9f2df59-0ce6-4c44-92d0-a8a8bbd4e31f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:06.747817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b553be91-c642-4ba4-97fa-9a900b7525b4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:06.765012 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b553be91-c642-4ba4-97fa-9a900b7525b4 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 0.697092 Jul 28 03:58:06.780411 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2068/4626] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:06 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:06.785706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6503a84f-283e-4314-8fa8-22d33f3dec88 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:06.785883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b9f2df59-0ce6-4c44-92d0-a8a8bbd4e31f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:06.791116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6503a84f-283e-4314-8fa8-22d33f3dec88 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:06.802603 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6503a84f-283e-4314-8fa8-22d33f3dec88 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:06.802859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b9f2df59-0ce6-4c44-92d0-a8a8bbd4e31f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:06.803831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6503a84f-283e-4314-8fa8-22d33f3dec88 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:06.804309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b9f2df59-0ce6-4c44-92d0-a8a8bbd4e31f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:06.805788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6503a84f-283e-4314-8fa8-22d33f3dec88 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:06.808261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6503a84f-283e-4314-8fa8-22d33f3dec88 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:06.811861 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9f2df59-0ce6-4c44-92d0-a8a8bbd4e31f tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1742 microversion: 2.20 time: 0.308475 Jul 28 03:58:06.812488 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2559/4627] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:06 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1742 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:07.076098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-815746ff-4916-48b0-84d2-c58a7cc16264 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:07.077059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-815746ff-4916-48b0-84d2-c58a7cc16264 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:07.100745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-815746ff-4916-48b0-84d2-c58a7cc16264 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:07.101510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-815746ff-4916-48b0-84d2-c58a7cc16264 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:07.102687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-815746ff-4916-48b0-84d2-c58a7cc16264 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:07.103356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-815746ff-4916-48b0-84d2-c58a7cc16264 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:07.449513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-815746ff-4916-48b0-84d2-c58a7cc16264 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:07.467221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-815746ff-4916-48b0-84d2-c58a7cc16264 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:07.469488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-815746ff-4916-48b0-84d2-c58a7cc16264 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:07.471047 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-815746ff-4916-48b0-84d2-c58a7cc16264 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.401058 Jul 28 03:58:07.472289 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2560/4628] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:07 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:07.519800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-261c7d25-8899-4223-9f9f-38a265e99470 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:07.521202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-261c7d25-8899-4223-9f9f-38a265e99470 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:07.540549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-261c7d25-8899-4223-9f9f-38a265e99470 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:07.541724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-261c7d25-8899-4223-9f9f-38a265e99470 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:07.545541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-261c7d25-8899-4223-9f9f-38a265e99470 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:07.547330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-261c7d25-8899-4223-9f9f-38a265e99470 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:07.771897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-261c7d25-8899-4223-9f9f-38a265e99470 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:07.785527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-261c7d25-8899-4223-9f9f-38a265e99470 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:07.787464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-261c7d25-8899-4223-9f9f-38a265e99470 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:07.789238 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-261c7d25-8899-4223-9f9f-38a265e99470 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1362 microversion: 2.26 time: 0.277712 Jul 28 03:58:07.790652 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2561/4629] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:07 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:07.797530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c96cffae-f426-4fdb-aafe-44ec850603ff tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:07.798712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c96cffae-f426-4fdb-aafe-44ec850603ff tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:07.807384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c96cffae-f426-4fdb-aafe-44ec850603ff tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:07.808424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c96cffae-f426-4fdb-aafe-44ec850603ff tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:07.809424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c96cffae-f426-4fdb-aafe-44ec850603ff tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:07.810100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c96cffae-f426-4fdb-aafe-44ec850603ff tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:07.971567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:08.003637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6503a84f-283e-4314-8fa8-22d33f3dec88 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:08.027439 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6503a84f-283e-4314-8fa8-22d33f3dec88 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1528 microversion: 2.1 time: 1.244139 Jul 28 03:58:08.042506 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2069/4630] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:06 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1528 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:08.057095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:08.061103 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c387585a-7629-43a0-b3e9-74df8f36acc5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:08.065259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c387585a-7629-43a0-b3e9-74df8f36acc5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:08.073969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:08.076193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c387585a-7629-43a0-b3e9-74df8f36acc5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:08.077284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c387585a-7629-43a0-b3e9-74df8f36acc5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:08.078555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c387585a-7629-43a0-b3e9-74df8f36acc5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:08.079215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c387585a-7629-43a0-b3e9-74df8f36acc5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:08.157243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c96cffae-f426-4fdb-aafe-44ec850603ff tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:08.176565 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c96cffae-f426-4fdb-aafe-44ec850603ff tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 0.384116 Jul 28 03:58:08.178003 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2562/4631] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:07 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:08.495862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d003bebf-d87c-4a4e-be60-455b62466105 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:08.497087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d003bebf-d87c-4a4e-be60-455b62466105 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:08.531698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d003bebf-d87c-4a4e-be60-455b62466105 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:08.532894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d003bebf-d87c-4a4e-be60-455b62466105 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:08.535030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d003bebf-d87c-4a4e-be60-455b62466105 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:08.539710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d003bebf-d87c-4a4e-be60-455b62466105 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:08.928044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d003bebf-d87c-4a4e-be60-455b62466105 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:08.940670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d003bebf-d87c-4a4e-be60-455b62466105 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:08.942520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d003bebf-d87c-4a4e-be60-455b62466105 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:08.944729 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d003bebf-d87c-4a4e-be60-455b62466105 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.454246 Jul 28 03:58:08.945966 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2563/4632] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:08 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:08.964550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3865abe0-4434-4719-8560-289a088f9ba5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:08.969375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3865abe0-4434-4719-8560-289a088f9ba5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:08.988872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3865abe0-4434-4719-8560-289a088f9ba5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:08.989501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3865abe0-4434-4719-8560-289a088f9ba5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:08.992318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3865abe0-4434-4719-8560-289a088f9ba5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:08.992318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3865abe0-4434-4719-8560-289a088f9ba5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:09.297975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3865abe0-4434-4719-8560-289a088f9ba5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:09.314121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3865abe0-4434-4719-8560-289a088f9ba5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:09.315674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3865abe0-4434-4719-8560-289a088f9ba5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:09.317185 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3865abe0-4434-4719-8560-289a088f9ba5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1362 microversion: 2.26 time: 0.369653 Jul 28 03:58:09.332924 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2564/4633] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:08 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:09.345553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cb3b0221-0654-4314-979c-cc29115784e2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:09.347523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cb3b0221-0654-4314-979c-cc29115784e2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:09.354648 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c387585a-7629-43a0-b3e9-74df8f36acc5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:09.366340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb3b0221-0654-4314-979c-cc29115784e2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:09.366801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb3b0221-0654-4314-979c-cc29115784e2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:09.369158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb3b0221-0654-4314-979c-cc29115784e2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:09.369654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb3b0221-0654-4314-979c-cc29115784e2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:09.395778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c387585a-7629-43a0-b3e9-74df8f36acc5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:09.397361 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c387585a-7629-43a0-b3e9-74df8f36acc5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:09.419179 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c387585a-7629-43a0-b3e9-74df8f36acc5 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1742 microversion: 2.20 time: 1.374725 Jul 28 03:58:09.422588 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2070/4634] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:08 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1742 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:09.431950 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6e04b0f6-8118-4777-ad89-f6de0a306ee7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:09.432583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6e04b0f6-8118-4777-ad89-f6de0a306ee7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:09.449659 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e04b0f6-8118-4777-ad89-f6de0a306ee7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:09.453059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e04b0f6-8118-4777-ad89-f6de0a306ee7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:09.454244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e04b0f6-8118-4777-ad89-f6de0a306ee7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:09.455694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e04b0f6-8118-4777-ad89-f6de0a306ee7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:09.472241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb3b0221-0654-4314-979c-cc29115784e2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:09.475167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb3b0221-0654-4314-979c-cc29115784e2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:09.477268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-cb3b0221-0654-4314-979c-cc29115784e2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lazy-loading 'fault' on Instance uuid 7a1c942a-4526-4211-b817-be3d04684034 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:09.554543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cb3b0221-0654-4314-979c-cc29115784e2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:09.584432 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cb3b0221-0654-4314-979c-cc29115784e2 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1314 microversion: 2.1 time: 0.248312 Jul 28 03:58:09.587100 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2565/4635] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:09 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:09.604338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0e97365f-8226-4786-8d52-6072a33f0844 req-031f4223-cf21-4c5f-9442-9f0d0c760ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1c942a-4526-4211-b817-be3d04684034", "name": "network-vif-deleted", "tag": "6a278b38-026b-4813-aeb3-4c97e440b23a"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:09.641087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0e97365f-8226-4786-8d52-6072a33f0844 req-031f4223-cf21-4c5f-9442-9f0d0c760ede service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:09.641853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0e97365f-8226-4786-8d52-6072a33f0844 req-031f4223-cf21-4c5f-9442-9f0d0c760ede service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:09.670880 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0e97365f-8226-4786-8d52-6072a33f0844 req-031f4223-cf21-4c5f-9442-9f0d0c760ede service nova] Creating event network-vif-deleted:6a278b38-026b-4813-aeb3-4c97e440b23a for instance 7a1c942a-4526-4211-b817-be3d04684034 on n-h1-826756-3 Jul 28 03:58:09.685540 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:09.708997 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0e97365f-8226-4786-8d52-6072a33f0844 req-031f4223-cf21-4c5f-9442-9f0d0c760ede service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118974 Jul 28 03:58:09.712049 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2566/4636] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:09.985866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-77587c27-3371-4319-980c-b9052bb6d438 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:09.986907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-77587c27-3371-4319-980c-b9052bb6d438 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:10.016384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77587c27-3371-4319-980c-b9052bb6d438 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:10.020182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77587c27-3371-4319-980c-b9052bb6d438 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:10.023547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77587c27-3371-4319-980c-b9052bb6d438 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:10.027293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77587c27-3371-4319-980c-b9052bb6d438 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:10.154195 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6e04b0f6-8118-4777-ad89-f6de0a306ee7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:10.167986 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6e04b0f6-8118-4777-ad89-f6de0a306ee7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 0.742367 Jul 28 03:58:10.173090 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2071/4637] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:09 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:10.346507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5a316218-8749-44a7-90a1-4e7b5ad0038c tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:10.347146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5a316218-8749-44a7-90a1-4e7b5ad0038c tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:10.362029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a316218-8749-44a7-90a1-4e7b5ad0038c tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:10.362704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a316218-8749-44a7-90a1-4e7b5ad0038c tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:10.363261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a316218-8749-44a7-90a1-4e7b5ad0038c tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:10.363681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a316218-8749-44a7-90a1-4e7b5ad0038c tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:10.851635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-77587c27-3371-4319-980c-b9052bb6d438 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:10.865866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-77587c27-3371-4319-980c-b9052bb6d438 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:10.867376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-77587c27-3371-4319-980c-b9052bb6d438 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:10.875791 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-77587c27-3371-4319-980c-b9052bb6d438 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.905659 Jul 28 03:58:10.879125 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2567/4638] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:09 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:10.896933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3ca1a9d2-43e4-4a89-b4ce-dd94fed993fb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:10.897548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3ca1a9d2-43e4-4a89-b4ce-dd94fed993fb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:10.907456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ca1a9d2-43e4-4a89-b4ce-dd94fed993fb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:10.907906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ca1a9d2-43e4-4a89-b4ce-dd94fed993fb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:10.908742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ca1a9d2-43e4-4a89-b4ce-dd94fed993fb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:10.915629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ca1a9d2-43e4-4a89-b4ce-dd94fed993fb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:10.943153 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5a316218-8749-44a7-90a1-4e7b5ad0038c tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:10.955297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5a316218-8749-44a7-90a1-4e7b5ad0038c tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:10.962310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5a316218-8749-44a7-90a1-4e7b5ad0038c tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:10.963593 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5a316218-8749-44a7-90a1-4e7b5ad0038c tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1362 microversion: 2.26 time: 0.628078 Jul 28 03:58:10.964106 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2072/4639] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:10 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1362 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:10.981725 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2f27a18a-eee2-4b3f-b9b2-0a4f3dead6f8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:10.986351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2f27a18a-eee2-4b3f-b9b2-0a4f3dead6f8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:11.003145 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f27a18a-eee2-4b3f-b9b2-0a4f3dead6f8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:11.003914 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f27a18a-eee2-4b3f-b9b2-0a4f3dead6f8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:11.007026 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f27a18a-eee2-4b3f-b9b2-0a4f3dead6f8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:11.008032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f27a18a-eee2-4b3f-b9b2-0a4f3dead6f8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:11.171197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f27a18a-eee2-4b3f-b9b2-0a4f3dead6f8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:11.180553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f27a18a-eee2-4b3f-b9b2-0a4f3dead6f8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:11.184681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-2f27a18a-eee2-4b3f-b9b2-0a4f3dead6f8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lazy-loading 'fault' on Instance uuid 7a1c942a-4526-4211-b817-be3d04684034 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:11.325585 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2f27a18a-eee2-4b3f-b9b2-0a4f3dead6f8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5265a6963e6e46c8bc7657bcf081362a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48efc7f6c8c94d428bc418846baeab4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:11.341836 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2f27a18a-eee2-4b3f-b9b2-0a4f3dead6f8 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 200 len: 1314 microversion: 2.1 time: 0.371551 Jul 28 03:58:11.344869 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2073/4640] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:10 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:11.361330 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c654aede-7e12-4694-8555-51ec751d54bf tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:11.362242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c654aede-7e12-4694-8555-51ec751d54bf tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:11.377275 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c654aede-7e12-4694-8555-51ec751d54bf tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:11.378220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c654aede-7e12-4694-8555-51ec751d54bf tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:11.403568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c654aede-7e12-4694-8555-51ec751d54bf tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:11.410680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c654aede-7e12-4694-8555-51ec751d54bf tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:11.616435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3ca1a9d2-43e4-4a89-b4ce-dd94fed993fb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:11.639292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3ca1a9d2-43e4-4a89-b4ce-dd94fed993fb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:11.644064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3ca1a9d2-43e4-4a89-b4ce-dd94fed993fb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:11.649170 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3ca1a9d2-43e4-4a89-b4ce-dd94fed993fb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1724 microversion: 2.20 time: 0.768923 Jul 28 03:58:11.650086 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2568/4641] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:10 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1724 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:11.751352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-20cf18a4-6fc8-446d-8874-b2759cb2471e req-7472c130-9130-452a-8e47-ff60d69c1643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8", "name": "network-vif-unplugged", "status": "completed", "tag": "565bb390-f25a-4510-b22a-3975e600ba96"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:11.779196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-20cf18a4-6fc8-446d-8874-b2759cb2471e req-7472c130-9130-452a-8e47-ff60d69c1643 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:11.779861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-20cf18a4-6fc8-446d-8874-b2759cb2471e req-7472c130-9130-452a-8e47-ff60d69c1643 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:11.801870 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-20cf18a4-6fc8-446d-8874-b2759cb2471e req-7472c130-9130-452a-8e47-ff60d69c1643 service nova] Creating event network-vif-unplugged:565bb390-f25a-4510-b22a-3975e600ba96 for instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 on n-h2-826756-3 Jul 28 03:58:11.808560 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-20cf18a4-6fc8-446d-8874-b2759cb2471e req-7472c130-9130-452a-8e47-ff60d69c1643 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071461 Jul 28 03:58:11.809867 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2569/4642] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:58:11.816406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-47af3a18-993f-41ea-922a-7c6952b13e2b req-22455be4-9d0c-4c01-aec2-d6f2353932bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56baa57-5713-488a-9d14-cb60e7543654", "tag": "097211cd-e316-4a04-9413-e6262141b61b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:11.832156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-47af3a18-993f-41ea-922a-7c6952b13e2b req-22455be4-9d0c-4c01-aec2-d6f2353932bc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:11.834007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-47af3a18-993f-41ea-922a-7c6952b13e2b req-22455be4-9d0c-4c01-aec2-d6f2353932bc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:11.854579 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-47af3a18-993f-41ea-922a-7c6952b13e2b req-22455be4-9d0c-4c01-aec2-d6f2353932bc service nova] Creating event network-changed:097211cd-e316-4a04-9413-e6262141b61b for instance c56baa57-5713-488a-9d14-cb60e7543654 on n-h1-826756-3 Jul 28 03:58:11.872573 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-47af3a18-993f-41ea-922a-7c6952b13e2b req-22455be4-9d0c-4c01-aec2-d6f2353932bc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059902 Jul 28 03:58:11.874195 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2570/4643] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:11.909330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-33902aad-8826-47e6-b029-7b0e731727b1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:11.909782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-33902aad-8826-47e6-b029-7b0e731727b1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:11.927587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33902aad-8826-47e6-b029-7b0e731727b1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:11.928915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33902aad-8826-47e6-b029-7b0e731727b1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:11.932872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33902aad-8826-47e6-b029-7b0e731727b1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:11.934620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33902aad-8826-47e6-b029-7b0e731727b1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:12.092990 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c654aede-7e12-4694-8555-51ec751d54bf tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:12.107402 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c654aede-7e12-4694-8555-51ec751d54bf tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 0.760049 Jul 28 03:58:12.111477 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2074/4644] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:11 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:12.122905 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d35df2db-7b8d-4add-96a2-d510fbca30e8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:12.124105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d35df2db-7b8d-4add-96a2-d510fbca30e8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:12.132607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d35df2db-7b8d-4add-96a2-d510fbca30e8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:12.133321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d35df2db-7b8d-4add-96a2-d510fbca30e8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:12.134382 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d35df2db-7b8d-4add-96a2-d510fbca30e8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:12.135168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d35df2db-7b8d-4add-96a2-d510fbca30e8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:12.345621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-33902aad-8826-47e6-b029-7b0e731727b1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:12.366145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-33902aad-8826-47e6-b029-7b0e731727b1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:12.368687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-33902aad-8826-47e6-b029-7b0e731727b1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:12.370721 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-33902aad-8826-47e6-b029-7b0e731727b1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.467300 Jul 28 03:58:12.371483 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2571/4645] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:11 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:12.380112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d948ed0-801d-4f38-a22e-857e3e22e2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:12.380750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8d948ed0-801d-4f38-a22e-857e3e22e2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 7a1c942a-4526-4211-b817-be3d04684034] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:12.393933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d948ed0-801d-4f38-a22e-857e3e22e2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:12.394510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d948ed0-801d-4f38-a22e-857e3e22e2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:12.395441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d948ed0-801d-4f38-a22e-857e3e22e2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:12.396103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d948ed0-801d-4f38-a22e-857e3e22e2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:12.411865 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-8d948ed0-801d-4f38-a22e-857e3e22e2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] HTTP exception thrown: Instance 7a1c942a-4526-4211-b817-be3d04684034 could not be found. Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d948ed0-801d-4f38-a22e-857e3e22e2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Request method failure captured: Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 HTTP/1.1 Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjBY0mYKCXtj0_d2uaizZHT_bTm8g67l0hNznQ_KVINZT1siV-lKxZREHB__mQh0Osf7Cog-lCJIGpJJ_mIo_1i4LQ-Uw87qYT7Q9LIdNSOqrDCo-x87gq81TQtloPebhhpc4TesbUzk376RJomPlfVbclxoCv7QtBWHpejAHdY1so Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}] Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 5265a6963e6e46c8bc7657bcf081362a Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 7a1c942a-4526-4211-b817-be3d04684034 could not be found. Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '7a1c942a-4526-4211-b817-be3d04684034'} Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a1c942a-4526-4211-b817-be3d04684034 could not be found. Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a1c942a-4526-4211-b817-be3d04684034 could not be found. Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.414304 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:12.419021 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.419021 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:12.419021 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:12.419021 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:12.419021 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:12.419021 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:12.419021 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a1c942a-4526-4211-b817-be3d04684034 could not be found. Jul 28 03:58:12.419021 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.420088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d948ed0-801d-4f38-a22e-857e3e22e2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Returning 404 to user: Instance 7a1c942a-4526-4211-b817-be3d04684034 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:12.421521 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8d948ed0-801d-4f38-a22e-857e3e22e2d5 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034" status: 404 len: 111 microversion: 2.1 time: 0.048522 Jul 28 03:58:12.422762 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2572/4646] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:12 2022] GET /compute/v2.1/servers/7a1c942a-4526-4211-b817-be3d04684034 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:58:12.430889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f04900c-5cee-4361-a9bd-11a1b8573145 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '.version_select at 0x7ffa799f0e50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:12.465828 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-0f04900c-5cee-4361-a9bd-11a1b8573145 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] HTTP exception thrown: Image not found. Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f04900c-5cee-4361-a9bd-11a1b8573145 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Request method failure captured: Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/images/a6641cd8-bbc0-4f8a-9a3c-818588837bf6 HTTP/1.1 Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjBY0mYKCXtj0_d2uaizZHT_bTm8g67l0hNznQ_KVINZT1siV-lKxZREHB__mQh0Osf7Cog-lCJIGpJJ_mIo_1i4LQ-Uw87qYT7Q9LIdNSOqrDCo-x87gq81TQtloPebhhpc4TesbUzk376RJomPlfVbclxoCv7QtBWHpejAHdY1so Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}] Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 5265a6963e6e46c8bc7657bcf081362a Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: exception: Image not found. Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a6641cd8-bbc0-4f8a-9a3c-818588837bf6'} Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a6641cd8-bbc0-4f8a-9a3c-818588837bf6 to delete Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a6641cd8-bbc0-4f8a-9a3c-818588837bf6 could not be found. Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:12.468284 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f04900c-5cee-4361-a9bd-11a1b8573145 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Returning 404 to user: Image not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0f04900c-5cee-4361-a9bd-11a1b8573145 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "DELETE /compute/v2.1/images/a6641cd8-bbc0-4f8a-9a3c-818588837bf6" status: 404 len: 62 microversion: 2.1 time: 0.043020 Jul 28 03:58:12.474339 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2573/4647] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:12 2022] DELETE /compute/v2.1/images/a6641cd8-bbc0-4f8a-9a3c-818588837bf6 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 03:58:12.479707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-46139de5-86d7-4588-a52b-2e9dff8ac13c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:12.480344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-46139de5-86d7-4588-a52b-2e9dff8ac13c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:12.500405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46139de5-86d7-4588-a52b-2e9dff8ac13c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:12.500822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46139de5-86d7-4588-a52b-2e9dff8ac13c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:12.501601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46139de5-86d7-4588-a52b-2e9dff8ac13c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:12.502032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46139de5-86d7-4588-a52b-2e9dff8ac13c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:12.516423 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-46139de5-86d7-4588-a52b-2e9dff8ac13c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] HTTP exception thrown: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-46139de5-86d7-4588-a52b-2e9dff8ac13c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Request method failure captured: Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea HTTP/1.1 Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjBY0mYKCXtj0_d2uaizZHT_bTm8g67l0hNznQ_KVINZT1siV-lKxZREHB__mQh0Osf7Cog-lCJIGpJJ_mIo_1i4LQ-Uw87qYT7Q9LIdNSOqrDCo-x87gq81TQtloPebhhpc4TesbUzk376RJomPlfVbclxoCv7QtBWHpejAHdY1so Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}] Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 5265a6963e6e46c8bc7657bcf081362a Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'acb45614-0607-46f1-90bc-e064c206adea'} Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:58:12.518417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:12.522971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:58:12.522971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.522971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:12.522971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.522971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:12.522971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:12.522971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:12.522971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:12.522971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:12.522971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:58:12.522971 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.524724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-46139de5-86d7-4588-a52b-2e9dff8ac13c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Returning 404 to user: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:12.525771 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-46139de5-86d7-4588-a52b-2e9dff8ac13c tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "DELETE /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 404 len: 111 microversion: 2.1 time: 0.050984 Jul 28 03:58:12.526829 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2574/4648] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:58:12 2022] DELETE /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:58:12.541315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f35a50b-ceeb-40f3-9ba5-217f38c69c0e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:12.541941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6f35a50b-ceeb-40f3-9ba5-217f38c69c0e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: acb45614-0607-46f1-90bc-e064c206adea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:12.555115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f35a50b-ceeb-40f3-9ba5-217f38c69c0e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:12.555355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f35a50b-ceeb-40f3-9ba5-217f38c69c0e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:12.556657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f35a50b-ceeb-40f3-9ba5-217f38c69c0e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:12.557467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f35a50b-ceeb-40f3-9ba5-217f38c69c0e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:12.609761 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-6f35a50b-ceeb-40f3-9ba5-217f38c69c0e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] HTTP exception thrown: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f35a50b-ceeb-40f3-9ba5-217f38c69c0e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Request method failure captured: Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea HTTP/1.1 Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjBY0mYKCXtj0_d2uaizZHT_bTm8g67l0hNznQ_KVINZT1siV-lKxZREHB__mQh0Osf7Cog-lCJIGpJJ_mIo_1i4LQ-Uw87qYT7Q9LIdNSOqrDCo-x87gq81TQtloPebhhpc4TesbUzk376RJomPlfVbclxoCv7QtBWHpejAHdY1so Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}] Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 5265a6963e6e46c8bc7657bcf081362a Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'acb45614-0607-46f1-90bc-e064c206adea'} Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.614326 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:12.618821 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.618821 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:12.618821 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:12.618821 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:12.618821 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:12.618821 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:12.618821 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. Jul 28 03:58:12.618821 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:12.620098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f35a50b-ceeb-40f3-9ba5-217f38c69c0e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Returning 404 to user: Instance acb45614-0607-46f1-90bc-e064c206adea could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:12.621787 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6f35a50b-ceeb-40f3-9ba5-217f38c69c0e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea" status: 404 len: 111 microversion: 2.1 time: 0.085570 Jul 28 03:58:12.627609 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2575/4649] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:12 2022] GET /compute/v2.1/servers/acb45614-0607-46f1-90bc-e064c206adea => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:58:12.636430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19ab8265-b55f-4415-b1b5-7c2bce5a4219 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '.version_select at 0x7ffa67444820>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:12.672026 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-19ab8265-b55f-4415-b1b5-7c2bce5a4219 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899350001" status: 202 len: 0 microversion: 2.1 time: 0.041968 Jul 28 03:58:12.672582 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2576/4650] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 03:58:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899350001 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:58:12.681005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5dbd34ff-30da-4a48-a9bb-4ee9bbdb7733 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:12.681888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5dbd34ff-30da-4a48-a9bb-4ee9bbdb7733 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:12.691852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dbd34ff-30da-4a48-a9bb-4ee9bbdb7733 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:12.692713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dbd34ff-30da-4a48-a9bb-4ee9bbdb7733 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:12.693721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dbd34ff-30da-4a48-a9bb-4ee9bbdb7733 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:12.694651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dbd34ff-30da-4a48-a9bb-4ee9bbdb7733 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:13.027885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d35df2db-7b8d-4add-96a2-d510fbca30e8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:13.053888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d35df2db-7b8d-4add-96a2-d510fbca30e8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:13.057410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d35df2db-7b8d-4add-96a2-d510fbca30e8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:13.059050 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d35df2db-7b8d-4add-96a2-d510fbca30e8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1362 microversion: 2.26 time: 0.944180 Jul 28 03:58:13.059507 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2075/4651] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:12 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1362 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:13.143032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-db9800a7-c923-4351-8f29-f20d71a25172 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:13.145434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-db9800a7-c923-4351-8f29-f20d71a25172 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:13.154680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db9800a7-c923-4351-8f29-f20d71a25172 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:13.155362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db9800a7-c923-4351-8f29-f20d71a25172 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:13.157062 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db9800a7-c923-4351-8f29-f20d71a25172 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:13.157662 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db9800a7-c923-4351-8f29-f20d71a25172 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:13.176367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5dbd34ff-30da-4a48-a9bb-4ee9bbdb7733 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:13.185758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5dbd34ff-30da-4a48-a9bb-4ee9bbdb7733 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:13.192545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5dbd34ff-30da-4a48-a9bb-4ee9bbdb7733 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:13.194058 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5dbd34ff-30da-4a48-a9bb-4ee9bbdb7733 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1724 microversion: 2.20 time: 0.520140 Jul 28 03:58:13.201638 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2577/4652] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:12 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1724 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:13.396764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b8302e4b-8624-4d65-9601-2bdc0a99a180 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:13.397851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b8302e4b-8624-4d65-9601-2bdc0a99a180 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:13.405940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8302e4b-8624-4d65-9601-2bdc0a99a180 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:13.406723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8302e4b-8624-4d65-9601-2bdc0a99a180 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:13.407711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8302e4b-8624-4d65-9601-2bdc0a99a180 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:13.408634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8302e4b-8624-4d65-9601-2bdc0a99a180 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:13.690670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-db9800a7-c923-4351-8f29-f20d71a25172 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:13.699829 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-db9800a7-c923-4351-8f29-f20d71a25172 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 0.570184 Jul 28 03:58:13.712832 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2076/4653] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:13 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:13.768013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8302e4b-8624-4d65-9601-2bdc0a99a180 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:13.779209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8302e4b-8624-4d65-9601-2bdc0a99a180 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:13.781715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8302e4b-8624-4d65-9601-2bdc0a99a180 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:13.783406 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b8302e4b-8624-4d65-9601-2bdc0a99a180 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.391477 Jul 28 03:58:13.784619 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2578/4654] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:13 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:14.084823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cd30c6bf-72fe-46ad-a84a-644dd3d812bf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:14.086480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cd30c6bf-72fe-46ad-a84a-644dd3d812bf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:14.096499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd30c6bf-72fe-46ad-a84a-644dd3d812bf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:14.097439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd30c6bf-72fe-46ad-a84a-644dd3d812bf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:14.098748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd30c6bf-72fe-46ad-a84a-644dd3d812bf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:14.099731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd30c6bf-72fe-46ad-a84a-644dd3d812bf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:14.231304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1dfdd7b4-5040-4454-95b4-bfa5cea8ce81 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:14.232716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1dfdd7b4-5040-4454-95b4-bfa5cea8ce81 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:14.245049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1dfdd7b4-5040-4454-95b4-bfa5cea8ce81 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:14.268571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1dfdd7b4-5040-4454-95b4-bfa5cea8ce81 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:14.271390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1dfdd7b4-5040-4454-95b4-bfa5cea8ce81 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:14.273324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1dfdd7b4-5040-4454-95b4-bfa5cea8ce81 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:14.285081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:14.535866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd30c6bf-72fe-46ad-a84a-644dd3d812bf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:14.555739 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd30c6bf-72fe-46ad-a84a-644dd3d812bf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:14.557625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd30c6bf-72fe-46ad-a84a-644dd3d812bf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:14.558815 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cd30c6bf-72fe-46ad-a84a-644dd3d812bf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1362 microversion: 2.26 time: 0.479592 Jul 28 03:58:14.563131 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2077/4655] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:14 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1362 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:14.725581 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d2eb7426-8994-446e-8220-545f679e324d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:14.726392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d2eb7426-8994-446e-8220-545f679e324d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:14.738124 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2eb7426-8994-446e-8220-545f679e324d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:14.739572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2eb7426-8994-446e-8220-545f679e324d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:14.741594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2eb7426-8994-446e-8220-545f679e324d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:14.742522 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d2eb7426-8994-446e-8220-545f679e324d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:14.775595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:14.909442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1dfdd7b4-5040-4454-95b4-bfa5cea8ce81 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:14.932070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1dfdd7b4-5040-4454-95b4-bfa5cea8ce81 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:14.941004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1dfdd7b4-5040-4454-95b4-bfa5cea8ce81 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:14.944607 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1dfdd7b4-5040-4454-95b4-bfa5cea8ce81 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1724 microversion: 2.20 time: 0.719570 Jul 28 03:58:14.954236 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2579/4656] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:14 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1724 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:14.975210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cce70095-300b-4849-87da-efa13b24dddf tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '.version_select at 0x7ffa6749b310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:15.009373 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-cce70095-300b-4849-87da-efa13b24dddf tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] HTTP exception thrown: Image not found. Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cce70095-300b-4849-87da-efa13b24dddf tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Request method failure captured: Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/images/311b9a8f-bbc1-4808-8e18-648e6e388a5d HTTP/1.1 Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gjBY0mYKCXtj0_d2uaizZHT_bTm8g67l0hNznQ_KVINZT1siV-lKxZREHB__mQh0Osf7Cog-lCJIGpJJ_mIo_1i4LQ-Uw87qYT7Q9LIdNSOqrDCo-x87gq81TQtloPebhhpc4TesbUzk376RJomPlfVbclxoCv7QtBWHpejAHdY1so Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}] Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 5265a6963e6e46c8bc7657bcf081362a Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: exception: Image not found. Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '311b9a8f-bbc1-4808-8e18-648e6e388a5d'} Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 311b9a8f-bbc1-4808-8e18-648e6e388a5d to delete Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 311b9a8f-bbc1-4808-8e18-648e6e388a5d could not be found. Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:15.011705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 28 03:58:15.016414 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.018589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cce70095-300b-4849-87da-efa13b24dddf tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Returning 404 to user: Image not found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:15.019562 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cce70095-300b-4849-87da-efa13b24dddf tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "DELETE /compute/v2.1/images/311b9a8f-bbc1-4808-8e18-648e6e388a5d" status: 404 len: 62 microversion: 2.1 time: 0.059855 Jul 28 03:58:15.023565 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2580/4657] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:14 2022] DELETE /compute/v2.1/images/311b9a8f-bbc1-4808-8e18-648e6e388a5d => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:58:15.029699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7e45cffa-7ec5-4bb0-a052-091f13c51d88 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:15.030731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7e45cffa-7ec5-4bb0-a052-091f13c51d88 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:15.067704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e45cffa-7ec5-4bb0-a052-091f13c51d88 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:15.068570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e45cffa-7ec5-4bb0-a052-091f13c51d88 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:15.069558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e45cffa-7ec5-4bb0-a052-091f13c51d88 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:15.070861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e45cffa-7ec5-4bb0-a052-091f13c51d88 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:15.231229 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d2eb7426-8994-446e-8220-545f679e324d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:15.249361 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d2eb7426-8994-446e-8220-545f679e324d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 0.530072 Jul 28 03:58:15.250853 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2078/4658] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:14 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:58:15.264590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-184a4d16-c4a3-4e2f-8422-f230faf2998e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:15.267429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-184a4d16-c4a3-4e2f-8422-f230faf2998e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:15.282933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-184a4d16-c4a3-4e2f-8422-f230faf2998e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:15.284731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-184a4d16-c4a3-4e2f-8422-f230faf2998e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:15.287459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-184a4d16-c4a3-4e2f-8422-f230faf2998e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:15.289059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-184a4d16-c4a3-4e2f-8422-f230faf2998e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:15.314461 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-184a4d16-c4a3-4e2f-8422-f230faf2998e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] HTTP exception thrown: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-184a4d16-c4a3-4e2f-8422-f230faf2998e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Request method failure captured: Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f HTTP/1.1 Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gjBY0mYKCXtj0_d2uaizZHT_bTm8g67l0hNznQ_KVINZT1siV-lKxZREHB__mQh0Osf7Cog-lCJIGpJJ_mIo_1i4LQ-Uw87qYT7Q9LIdNSOqrDCo-x87gq81TQtloPebhhpc4TesbUzk376RJomPlfVbclxoCv7QtBWHpejAHdY1so Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}] Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 5265a6963e6e46c8bc7657bcf081362a Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f'} Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:58:15.317314 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:15.321640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:58:15.321640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.321640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:15.321640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.321640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:15.321640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:15.321640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:15.321640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:15.321640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:15.321640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:58:15.321640 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.323255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-184a4d16-c4a3-4e2f-8422-f230faf2998e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Returning 404 to user: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:15.340232 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-184a4d16-c4a3-4e2f-8422-f230faf2998e tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 404 len: 111 microversion: 2.1 time: 0.088113 Jul 28 03:58:15.350475 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2079/4659] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:58:15 2022] DELETE /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:58:15.362812 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-31dc4f64-be61-4ee1-af06-df31ab46a2e3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:15.364263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-31dc4f64-be61-4ee1-af06-df31ab46a2e3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] [instance: 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:15.376944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-31dc4f64-be61-4ee1-af06-df31ab46a2e3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:15.381177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-31dc4f64-be61-4ee1-af06-df31ab46a2e3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:15.384389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-31dc4f64-be61-4ee1-af06-df31ab46a2e3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:15.385011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-31dc4f64-be61-4ee1-af06-df31ab46a2e3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:15.420477 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-31dc4f64-be61-4ee1-af06-df31ab46a2e3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] HTTP exception thrown: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-31dc4f64-be61-4ee1-af06-df31ab46a2e3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Request method failure captured: Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f HTTP/1.1 Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gjBY0mYKCXtj0_d2uaizZHT_bTm8g67l0hNznQ_KVINZT1siV-lKxZREHB__mQh0Osf7Cog-lCJIGpJJ_mIo_1i4LQ-Uw87qYT7Q9LIdNSOqrDCo-x87gq81TQtloPebhhpc4TesbUzk376RJomPlfVbclxoCv7QtBWHpejAHdY1so Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_48efc7f6c8c94d428bc418846baeab4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/48efc7f6c8c94d428bc418846baeab4f"}]}] Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 48efc7f6c8c94d428bc418846baeab4f Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849 Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 5265a6963e6e46c8bc7657bcf081362a Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1310066849-project Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f'} Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.426505 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:15.433085 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.433085 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:15.433085 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:15.433085 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:15.433085 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:15.433085 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:15.433085 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. Jul 28 03:58:15.433085 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:15.433085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-31dc4f64-be61-4ee1-af06-df31ab46a2e3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] Returning 404 to user: Instance 8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:15.433085 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-31dc4f64-be61-4ee1-af06-df31ab46a2e3 tempest-ImagesOneServerNegativeTestJSON-1310066849 tempest-ImagesOneServerNegativeTestJSON-1310066849-project] 10.222.0.48 "GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f" status: 404 len: 111 microversion: 2.1 time: 0.076538 Jul 28 03:58:15.433085 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2080/4660] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:15 2022] GET /compute/v2.1/servers/8aa7dbbc-d7bf-4d5e-9464-c0c04de3308f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:58:15.439342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7e45cffa-7ec5-4bb0-a052-091f13c51d88 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:15.453844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7e45cffa-7ec5-4bb0-a052-091f13c51d88 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:15.457396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7e45cffa-7ec5-4bb0-a052-091f13c51d88 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:15.460143 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7e45cffa-7ec5-4bb0-a052-091f13c51d88 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.438091 Jul 28 03:58:15.476622 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2581/4661] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:15 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:15.583208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4e4e980b-ee23-446d-b857-ad81053df075 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:15.583799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4e4e980b-ee23-446d-b857-ad81053df075 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:15.594877 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e4e980b-ee23-446d-b857-ad81053df075 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:15.595258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e4e980b-ee23-446d-b857-ad81053df075 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:15.596242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e4e980b-ee23-446d-b857-ad81053df075 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:15.596879 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e4e980b-ee23-446d-b857-ad81053df075 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:15.976953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a52cf33-cbc8-4d48-acf6-11ef253fd0fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:15.977483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8a52cf33-cbc8-4d48-acf6-11ef253fd0fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:15.991877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a52cf33-cbc8-4d48-acf6-11ef253fd0fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:15.992336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a52cf33-cbc8-4d48-acf6-11ef253fd0fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:15.993174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a52cf33-cbc8-4d48-acf6-11ef253fd0fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:15.993621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a52cf33-cbc8-4d48-acf6-11ef253fd0fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:16.087159 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4e4e980b-ee23-446d-b857-ad81053df075 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:16.117340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4e4e980b-ee23-446d-b857-ad81053df075 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:16.121962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4e4e980b-ee23-446d-b857-ad81053df075 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:16.123175 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4e4e980b-ee23-446d-b857-ad81053df075 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1362 microversion: 2.26 time: 0.544483 Jul 28 03:58:16.123755 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2081/4662] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:15 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1362 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:16.271136 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1ba441c3-3c36-40e7-819b-4e349b537c3d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:16.271837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1ba441c3-3c36-40e7-819b-4e349b537c3d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:16.282143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1ba441c3-3c36-40e7-819b-4e349b537c3d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:16.285032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1ba441c3-3c36-40e7-819b-4e349b537c3d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:16.289686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1ba441c3-3c36-40e7-819b-4e349b537c3d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:16.290268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1ba441c3-3c36-40e7-819b-4e349b537c3d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:16.474185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a52cf33-cbc8-4d48-acf6-11ef253fd0fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:16.495581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a52cf33-cbc8-4d48-acf6-11ef253fd0fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:16.501150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a52cf33-cbc8-4d48-acf6-11ef253fd0fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:16.502417 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a52cf33-cbc8-4d48-acf6-11ef253fd0fd tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1727 microversion: 2.20 time: 0.529666 Jul 28 03:58:16.503868 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2582/4663] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:15 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1727 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:16.526074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4c050b3e-a0d9-453a-b456-bb09d56842ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:16.528417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4c050b3e-a0d9-453a-b456-bb09d56842ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:16.539849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c050b3e-a0d9-453a-b456-bb09d56842ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:16.542651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c050b3e-a0d9-453a-b456-bb09d56842ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:16.545352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c050b3e-a0d9-453a-b456-bb09d56842ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:16.551378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c050b3e-a0d9-453a-b456-bb09d56842ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:17.042753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1ba441c3-3c36-40e7-819b-4e349b537c3d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:17.055614 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1ba441c3-3c36-40e7-819b-4e349b537c3d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 0.788363 Jul 28 03:58:17.058141 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2082/4664] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:16 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:58:17.058898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4c050b3e-a0d9-453a-b456-bb09d56842ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:17.074267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4c050b3e-a0d9-453a-b456-bb09d56842ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:17.076707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f9b4aa81-1a35-42e3-ac7a-11666343225d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ebb4915-24e7-4114-8b9b-8eaa698abd75"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:17.077447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4c050b3e-a0d9-453a-b456-bb09d56842ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:17.078807 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4c050b3e-a0d9-453a-b456-bb09d56842ee tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.573640 Jul 28 03:58:17.079303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f9b4aa81-1a35-42e3-ac7a-11666343225d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:17.079630 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2583/4665] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:16 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:17.098217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9b4aa81-1a35-42e3-ac7a-11666343225d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:17.104618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9b4aa81-1a35-42e3-ac7a-11666343225d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:17.105796 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9b4aa81-1a35-42e3-ac7a-11666343225d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:17.106711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f9b4aa81-1a35-42e3-ac7a-11666343225d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:17.165705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a9fd3f06-fa18-4b55-b9bd-51324280fe91 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:17.167219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a9fd3f06-fa18-4b55-b9bd-51324280fe91 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:17.210255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9fd3f06-fa18-4b55-b9bd-51324280fe91 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:17.211183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9fd3f06-fa18-4b55-b9bd-51324280fe91 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:17.212996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9fd3f06-fa18-4b55-b9bd-51324280fe91 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:17.213441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9fd3f06-fa18-4b55-b9bd-51324280fe91 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:17.659348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a9fd3f06-fa18-4b55-b9bd-51324280fe91 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:17.693516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a9fd3f06-fa18-4b55-b9bd-51324280fe91 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:17.699669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a9fd3f06-fa18-4b55-b9bd-51324280fe91 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:17.704336 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f9b4aa81-1a35-42e3-ac7a-11666343225d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "POST /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.643409 Jul 28 03:58:17.709975 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a9fd3f06-fa18-4b55-b9bd-51324280fe91 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1362 microversion: 2.26 time: 0.557141 Jul 28 03:58:17.717097 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2083/4666] 10.222.0.48 () {62 vars in 1364 bytes} [Thu Jul 28 03:58:17 2022] POST /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8/os-volume_attachments => generated 188 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:58:17.726493 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2584/4667] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:17 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1362 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:17.926543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0ea2efc7-cdd2-4942-812e-5e33868cca73 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:17.927186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0ea2efc7-cdd2-4942-812e-5e33868cca73 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:17.944298 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ea2efc7-cdd2-4942-812e-5e33868cca73 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:17.946228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ea2efc7-cdd2-4942-812e-5e33868cca73 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:17.949350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ea2efc7-cdd2-4942-812e-5e33868cca73 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:17.951629 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0ea2efc7-cdd2-4942-812e-5e33868cca73 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:17.971624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-232bbb23-d923-4ad9-9ce5-cff5c9b9ccb6 req-8933e530-4d89-4c2b-ab6c-37231b259706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d97b518-6a6e-44f8-9be3-940b6fa8c853", "name": "network-vif-plugged", "status": "completed", "tag": "9ce2e89e-838e-4b08-b1df-2e933c36e5d1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:18.003794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-232bbb23-d923-4ad9-9ce5-cff5c9b9ccb6 req-8933e530-4d89-4c2b-ab6c-37231b259706 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:18.004544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-232bbb23-d923-4ad9-9ce5-cff5c9b9ccb6 req-8933e530-4d89-4c2b-ab6c-37231b259706 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:18.032983 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-232bbb23-d923-4ad9-9ce5-cff5c9b9ccb6 req-8933e530-4d89-4c2b-ab6c-37231b259706 service nova] Creating event network-vif-plugged:9ce2e89e-838e-4b08-b1df-2e933c36e5d1 for instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 on n-h1-826756-3 Jul 28 03:58:18.051959 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-232bbb23-d923-4ad9-9ce5-cff5c9b9ccb6 req-8933e530-4d89-4c2b-ab6c-37231b259706 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084980 Jul 28 03:58:18.056163 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2585/4668] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:58:18.078948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a74fb6e4-a65b-4a91-8c73-9fd6a4726fea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:18.081702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a74fb6e4-a65b-4a91-8c73-9fd6a4726fea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:18.091116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a74fb6e4-a65b-4a91-8c73-9fd6a4726fea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:18.093021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a74fb6e4-a65b-4a91-8c73-9fd6a4726fea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:18.094215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a74fb6e4-a65b-4a91-8c73-9fd6a4726fea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:18.094898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a74fb6e4-a65b-4a91-8c73-9fd6a4726fea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:18.570477 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0ea2efc7-cdd2-4942-812e-5e33868cca73 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8/os-volume_attachments/3ebb4915-24e7-4114-8b9b-8eaa698abd75" status: 202 len: 0 microversion: 2.20 time: 0.649401 Jul 28 03:58:18.574904 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2084/4669] 10.222.0.48 () {60 vars in 1457 bytes} [Thu Jul 28 03:58:17 2022] DELETE /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8/os-volume_attachments/3ebb4915-24e7-4114-8b9b-8eaa698abd75 => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:58:18.581525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-98ed8307-4841-496b-a055-354286d1026e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:18.597107 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-98ed8307-4841-496b-a055-354286d1026e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:18.614600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98ed8307-4841-496b-a055-354286d1026e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:18.617990 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98ed8307-4841-496b-a055-354286d1026e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:18.623529 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98ed8307-4841-496b-a055-354286d1026e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:18.623992 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98ed8307-4841-496b-a055-354286d1026e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:19.208204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-98ed8307-4841-496b-a055-354286d1026e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:19.226485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-98ed8307-4841-496b-a055-354286d1026e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:19.231921 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-98ed8307-4841-496b-a055-354286d1026e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:19.233297 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-98ed8307-4841-496b-a055-354286d1026e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.657129 Jul 28 03:58:19.238436 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2085/4670] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:18 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:19.252494 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1e814b57-2d01-403b-908c-7799fd679c5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:19.253271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1e814b57-2d01-403b-908c-7799fd679c5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:19.273917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e814b57-2d01-403b-908c-7799fd679c5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:19.274453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e814b57-2d01-403b-908c-7799fd679c5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:19.275756 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e814b57-2d01-403b-908c-7799fd679c5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:19.278008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e814b57-2d01-403b-908c-7799fd679c5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:19.377150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a74fb6e4-a65b-4a91-8c73-9fd6a4726fea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:19.392404 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a74fb6e4-a65b-4a91-8c73-9fd6a4726fea tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 1.318143 Jul 28 03:58:19.394110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1e814b57-2d01-403b-908c-7799fd679c5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126072) unshelve /opt/stack/nova/nova/compute/api.py:4575}} Jul 28 03:58:19.410084 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2586/4671] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:18 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:19.418599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40c2dced-cf77-4349-8e79-11f87c845129 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:19.423400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40c2dced-cf77-4349-8e79-11f87c845129 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:19.445011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40c2dced-cf77-4349-8e79-11f87c845129 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:19.446633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40c2dced-cf77-4349-8e79-11f87c845129 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:19.448340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40c2dced-cf77-4349-8e79-11f87c845129 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:19.450816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40c2dced-cf77-4349-8e79-11f87c845129 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:19.575894 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1e814b57-2d01-403b-908c-7799fd679c5d tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "POST /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8/action" status: 202 len: 0 microversion: 2.20 time: 0.336247 Jul 28 03:58:19.584253 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2086/4672] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Jul 28 03:58:19 2022] POST /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 03:58:19.600189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-25b83407-33d6-4c51-9c49-d73e8a6ece07 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:19.611856 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-25b83407-33d6-4c51-9c49-d73e8a6ece07 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:19.631721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25b83407-33d6-4c51-9c49-d73e8a6ece07 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:19.635338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25b83407-33d6-4c51-9c49-d73e8a6ece07 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:19.636504 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25b83407-33d6-4c51-9c49-d73e8a6ece07 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:19.637117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-25b83407-33d6-4c51-9c49-d73e8a6ece07 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:20.120919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-25b83407-33d6-4c51-9c49-d73e8a6ece07 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:20.143846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-25b83407-33d6-4c51-9c49-d73e8a6ece07 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:20.152196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-25b83407-33d6-4c51-9c49-d73e8a6ece07 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:20.157889 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-25b83407-33d6-4c51-9c49-d73e8a6ece07 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1675 microversion: 2.20 time: 0.568499 Jul 28 03:58:20.158827 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2087/4673] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:19 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1675 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:20.175252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-09a56e3e-a0a3-4d51-a9c9-16bd160a76ae req-56667995-eb7c-4cf8-973f-8944b1fceb18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56baa57-5713-488a-9d14-cb60e7543654", "name": "network-vif-plugged", "status": "completed", "tag": "097211cd-e316-4a04-9413-e6262141b61b"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:20.203322 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-09a56e3e-a0a3-4d51-a9c9-16bd160a76ae req-56667995-eb7c-4cf8-973f-8944b1fceb18 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:20.206628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-09a56e3e-a0a3-4d51-a9c9-16bd160a76ae req-56667995-eb7c-4cf8-973f-8944b1fceb18 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:20.245649 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-09a56e3e-a0a3-4d51-a9c9-16bd160a76ae req-56667995-eb7c-4cf8-973f-8944b1fceb18 service nova] Creating event network-vif-plugged:097211cd-e316-4a04-9413-e6262141b61b for instance c56baa57-5713-488a-9d14-cb60e7543654 on n-h1-826756-3 Jul 28 03:58:20.287052 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-09a56e3e-a0a3-4d51-a9c9-16bd160a76ae req-56667995-eb7c-4cf8-973f-8944b1fceb18 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101138 Jul 28 03:58:20.292849 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2088/4674] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:20.315719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dd8b0eb8-eb2d-4bdb-80b9-6ac0874ec610 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:20.316710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dd8b0eb8-eb2d-4bdb-80b9-6ac0874ec610 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:20.324829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd8b0eb8-eb2d-4bdb-80b9-6ac0874ec610 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:20.325640 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd8b0eb8-eb2d-4bdb-80b9-6ac0874ec610 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:20.326814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd8b0eb8-eb2d-4bdb-80b9-6ac0874ec610 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:20.328323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dd8b0eb8-eb2d-4bdb-80b9-6ac0874ec610 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:20.498931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40c2dced-cf77-4349-8e79-11f87c845129 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:20.511301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40c2dced-cf77-4349-8e79-11f87c845129 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:20.512765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40c2dced-cf77-4349-8e79-11f87c845129 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:20.516195 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40c2dced-cf77-4349-8e79-11f87c845129 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1362 microversion: 2.26 time: 1.104523 Jul 28 03:58:20.519481 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2587/4675] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:19 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1362 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:20.536546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-64d0c8f4-599d-4561-9767-8e991b6fce2a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:20.537437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-64d0c8f4-599d-4561-9767-8e991b6fce2a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:20.544845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64d0c8f4-599d-4561-9767-8e991b6fce2a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:20.545543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64d0c8f4-599d-4561-9767-8e991b6fce2a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:20.546582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64d0c8f4-599d-4561-9767-8e991b6fce2a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:20.547204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64d0c8f4-599d-4561-9767-8e991b6fce2a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:20.971858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dd8b0eb8-eb2d-4bdb-80b9-6ac0874ec610 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:21.000745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dd8b0eb8-eb2d-4bdb-80b9-6ac0874ec610 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:21.006172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dd8b0eb8-eb2d-4bdb-80b9-6ac0874ec610 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:21.011721 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dd8b0eb8-eb2d-4bdb-80b9-6ac0874ec610 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.717488 Jul 28 03:58:21.012325 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2089/4676] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:20 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:21.187283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3351e378-eaa3-4846-94ac-c8cdae99b81e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:21.188467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3351e378-eaa3-4846-94ac-c8cdae99b81e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:21.201269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3351e378-eaa3-4846-94ac-c8cdae99b81e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:21.203237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3351e378-eaa3-4846-94ac-c8cdae99b81e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:21.210147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3351e378-eaa3-4846-94ac-c8cdae99b81e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:21.211664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3351e378-eaa3-4846-94ac-c8cdae99b81e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:21.248063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-64d0c8f4-599d-4561-9767-8e991b6fce2a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:21.270984 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-64d0c8f4-599d-4561-9767-8e991b6fce2a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1518 microversion: 2.1 time: 0.750170 Jul 28 03:58:21.272181 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2588/4677] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:20 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1518 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:21.543143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bf3c353d-26b5-45c6-a492-ccd036ee9235 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:21.544083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bf3c353d-26b5-45c6-a492-ccd036ee9235 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:21.551539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf3c353d-26b5-45c6-a492-ccd036ee9235 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:21.552497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf3c353d-26b5-45c6-a492-ccd036ee9235 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:21.554116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf3c353d-26b5-45c6-a492-ccd036ee9235 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:21.555306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf3c353d-26b5-45c6-a492-ccd036ee9235 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:21.753516 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3351e378-eaa3-4846-94ac-c8cdae99b81e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:21.767612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3351e378-eaa3-4846-94ac-c8cdae99b81e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:21.775330 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3351e378-eaa3-4846-94ac-c8cdae99b81e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:21.778880 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3351e378-eaa3-4846-94ac-c8cdae99b81e tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1675 microversion: 2.20 time: 0.595293 Jul 28 03:58:21.780715 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2090/4678] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:21 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1675 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:22.018419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bf3c353d-26b5-45c6-a492-ccd036ee9235 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:22.034332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bf3c353d-26b5-45c6-a492-ccd036ee9235 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:22.035862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bf3c353d-26b5-45c6-a492-ccd036ee9235 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:22.037291 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bf3c353d-26b5-45c6-a492-ccd036ee9235 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1362 microversion: 2.26 time: 0.498222 Jul 28 03:58:22.039830 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2589/4679] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:21 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1362 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:22.060811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c9ea2b4d-0b39-40bf-9ea8-469b7024ec51 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:22.065747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c9ea2b4d-0b39-40bf-9ea8-469b7024ec51 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:22.089835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9ea2b4d-0b39-40bf-9ea8-469b7024ec51 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:22.090905 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9ea2b4d-0b39-40bf-9ea8-469b7024ec51 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:22.095207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9ea2b4d-0b39-40bf-9ea8-469b7024ec51 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:22.102031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9ea2b4d-0b39-40bf-9ea8-469b7024ec51 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:22.139757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:22.298710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fedcd8af-95ea-41d9-ba80-aeb804fe222d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:22.299543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fedcd8af-95ea-41d9-ba80-aeb804fe222d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:22.311867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fedcd8af-95ea-41d9-ba80-aeb804fe222d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:22.312644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fedcd8af-95ea-41d9-ba80-aeb804fe222d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:22.316729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fedcd8af-95ea-41d9-ba80-aeb804fe222d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:22.317407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fedcd8af-95ea-41d9-ba80-aeb804fe222d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:22.668908 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c9ea2b4d-0b39-40bf-9ea8-469b7024ec51 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:22.685945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c9ea2b4d-0b39-40bf-9ea8-469b7024ec51 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:22.691225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c9ea2b4d-0b39-40bf-9ea8-469b7024ec51 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:22.695366 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c9ea2b4d-0b39-40bf-9ea8-469b7024ec51 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.662662 Jul 28 03:58:22.696126 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2091/4680] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:22 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:22.808076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bf50ee63-a614-4bf2-995a-7b2cba2cae8c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:22.810715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bf50ee63-a614-4bf2-995a-7b2cba2cae8c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:22.829024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf50ee63-a614-4bf2-995a-7b2cba2cae8c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:22.830097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf50ee63-a614-4bf2-995a-7b2cba2cae8c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:22.831935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf50ee63-a614-4bf2-995a-7b2cba2cae8c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:22.835223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bf50ee63-a614-4bf2-995a-7b2cba2cae8c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:23.091179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fedcd8af-95ea-41d9-ba80-aeb804fe222d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:23.117240 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fedcd8af-95ea-41d9-ba80-aeb804fe222d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.809570 Jul 28 03:58:23.132581 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2590/4681] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:22 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:23.138275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9fedf2f2-c4d1-45e0-8fed-1723913939e7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:23.140896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9fedf2f2-c4d1-45e0-8fed-1723913939e7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:23.162696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fedf2f2-c4d1-45e0-8fed-1723913939e7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:23.165800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fedf2f2-c4d1-45e0-8fed-1723913939e7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:23.167016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fedf2f2-c4d1-45e0-8fed-1723913939e7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:23.167825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fedf2f2-c4d1-45e0-8fed-1723913939e7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:23.518902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bf50ee63-a614-4bf2-995a-7b2cba2cae8c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:23.534478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bf50ee63-a614-4bf2-995a-7b2cba2cae8c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:23.536076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bf50ee63-a614-4bf2-995a-7b2cba2cae8c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:23.537640 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bf50ee63-a614-4bf2-995a-7b2cba2cae8c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 0.734265 Jul 28 03:58:23.554549 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2092/4682] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:22 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:23.572589 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d03ebd71-e99f-46b9-9216-8f5da472e709 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:23.576425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d03ebd71-e99f-46b9-9216-8f5da472e709 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:23.589884 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d03ebd71-e99f-46b9-9216-8f5da472e709 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:23.591105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d03ebd71-e99f-46b9-9216-8f5da472e709 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:23.592161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d03ebd71-e99f-46b9-9216-8f5da472e709 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:23.598648 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d03ebd71-e99f-46b9-9216-8f5da472e709 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:23.626348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9fedf2f2-c4d1-45e0-8fed-1723913939e7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:23.641980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9fedf2f2-c4d1-45e0-8fed-1723913939e7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:23.646237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9fedf2f2-c4d1-45e0-8fed-1723913939e7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:23.648525 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9fedf2f2-c4d1-45e0-8fed-1723913939e7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1547 microversion: 2.26 time: 0.518342 Jul 28 03:58:23.653016 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2591/4683] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:23 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1547 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:23.672617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-08f10286-2a7b-4887-b071-57e4f73146c5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa6766b4c0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:23.683519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08f10286-2a7b-4887-b071-57e4f73146c5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:23.684044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08f10286-2a7b-4887-b071-57e4f73146c5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:23.684793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-08f10286-2a7b-4887-b071-57e4f73146c5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:23.690920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:23.693271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08f10286-2a7b-4887-b071-57e4f73146c5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:23.693948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08f10286-2a7b-4887-b071-57e4f73146c5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:23.694952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08f10286-2a7b-4887-b071-57e4f73146c5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:23.695593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08f10286-2a7b-4887-b071-57e4f73146c5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:23.743597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08f10286-2a7b-4887-b071-57e4f73146c5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:23.744494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08f10286-2a7b-4887-b071-57e4f73146c5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:23.775684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08f10286-2a7b-4887-b071-57e4f73146c5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:23.776237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08f10286-2a7b-4887-b071-57e4f73146c5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:23.815735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-08f10286-2a7b-4887-b071-57e4f73146c5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lazy-loading 'flavor' on Instance uuid c56baa57-5713-488a-9d14-cb60e7543654 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:23.837256 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-08f10286-2a7b-4887-b071-57e4f73146c5 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "PUT /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-146275482" status: 201 len: 0 microversion: 2.26 time: 0.168748 Jul 28 03:58:23.839232 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2592/4684] 10.222.0.48 () {62 vars in 1377 bytes} [Thu Jul 28 03:58:23 2022] PUT /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-146275482 => generated 0 bytes in 171 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 28 03:58:23.845254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b4836015-fcee-4b13-b36b-1801b6a3e9de tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:23.846100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4836015-fcee-4b13-b36b-1801b6a3e9de tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:23.853526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4836015-fcee-4b13-b36b-1801b6a3e9de tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:23.854407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4836015-fcee-4b13-b36b-1801b6a3e9de tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:23.855813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4836015-fcee-4b13-b36b-1801b6a3e9de tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:23.856744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4836015-fcee-4b13-b36b-1801b6a3e9de tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:24.017357 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d03ebd71-e99f-46b9-9216-8f5da472e709 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:24.026755 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d03ebd71-e99f-46b9-9216-8f5da472e709 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.470716 Jul 28 03:58:24.027738 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2093/4685] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:23 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:24.032880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2df63abf-4385-4252-83d2-3a45e7c7f72b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa6740eb80>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:24.058545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2df63abf-4385-4252-83d2-3a45e7c7f72b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:24.059247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2df63abf-4385-4252-83d2-3a45e7c7f72b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:24.095688 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2df63abf-4385-4252-83d2-3a45e7c7f72b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-146275482" status: 204 len: 0 microversion: 2.26 time: 0.066568 Jul 28 03:58:24.100645 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2094/4686] 10.222.0.48 () {60 vars in 1358 bytes} [Thu Jul 28 03:58:24 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-146275482 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:58:24.106448 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9e7522af-aef8-4eec-9eb2-2072ec247680 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:24.107433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9e7522af-aef8-4eec-9eb2-2072ec247680 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:24.114209 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e7522af-aef8-4eec-9eb2-2072ec247680 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:24.115169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e7522af-aef8-4eec-9eb2-2072ec247680 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:24.116189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e7522af-aef8-4eec-9eb2-2072ec247680 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:24.119768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e7522af-aef8-4eec-9eb2-2072ec247680 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:24.464682 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9e7522af-aef8-4eec-9eb2-2072ec247680 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:24.473920 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9e7522af-aef8-4eec-9eb2-2072ec247680 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.371798 Jul 28 03:58:24.474750 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2095/4687] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:24 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:24.485907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4cc2c680-c992-4efd-b0fe-0332ca47b181 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa674bc8b0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:24.497786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4cc2c680-c992-4efd-b0fe-0332ca47b181 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:24.498701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4cc2c680-c992-4efd-b0fe-0332ca47b181 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:24.499193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4cc2c680-c992-4efd-b0fe-0332ca47b181 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:24.505717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4cc2c680-c992-4efd-b0fe-0332ca47b181 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:24.506179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4cc2c680-c992-4efd-b0fe-0332ca47b181 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:24.507062 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4cc2c680-c992-4efd-b0fe-0332ca47b181 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:24.507758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4cc2c680-c992-4efd-b0fe-0332ca47b181 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:24.534276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4cc2c680-c992-4efd-b0fe-0332ca47b181 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:24.535034 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4cc2c680-c992-4efd-b0fe-0332ca47b181 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:24.565342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-4cc2c680-c992-4efd-b0fe-0332ca47b181 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lazy-loading 'flavor' on Instance uuid c56baa57-5713-488a-9d14-cb60e7543654 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:24.584808 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4cc2c680-c992-4efd-b0fe-0332ca47b181 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags" status: 204 len: 0 microversion: 2.26 time: 0.108746 Jul 28 03:58:24.592232 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2096/4688] 10.222.0.48 () {60 vars in 1295 bytes} [Thu Jul 28 03:58:24 2022] DELETE /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:58:24.599468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-372b7945-deb3-44e6-9900-f54327be406b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:24.605887 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-372b7945-deb3-44e6-9900-f54327be406b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance 2023c976-0b0c-49b7-a041-045186cdcd69 has no mapping to a cell. Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-372b7945-deb3-44e6-9900-f54327be406b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/2023c976-0b0c-49b7-a041-045186cdcd69/action HTTP/1.1 Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 15 Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: {"os-stop": {}} Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 2023c976-0b0c-49b7-a041-045186cdcd69 has no mapping to a cell. Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '2023c976-0b0c-49b7-a041-045186cdcd69', 'body': {'os-stop': {}}} Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 2023c976-0b0c-49b7-a041-045186cdcd69 has no mapping to a cell. Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:24.614049 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2023c976-0b0c-49b7-a041-045186cdcd69 has no mapping to a cell. Jul 28 03:58:24.618107 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:24.618107 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:24.618107 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:24.618107 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:24.618107 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:24.618107 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:24.618107 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:24.618107 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:24.618107 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2023c976-0b0c-49b7-a041-045186cdcd69 has no mapping to a cell. Jul 28 03:58:24.618107 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:24.618107 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-372b7945-deb3-44e6-9900-f54327be406b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance 2023c976-0b0c-49b7-a041-045186cdcd69 has no mapping to a cell. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:24.619170 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-372b7945-deb3-44e6-9900-f54327be406b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/2023c976-0b0c-49b7-a041-045186cdcd69/action" status: 404 len: 117 microversion: 2.1 time: 0.028362 Jul 28 03:58:24.623869 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2097/4689] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:58:24 2022] POST /compute/v2.1/servers/2023c976-0b0c-49b7-a041-045186cdcd69/action => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:58:24.628779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-44b2a8a5-aa87-4962-9b28-284010195b9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:24.629381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-44b2a8a5-aa87-4962-9b28-284010195b9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:24.635731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b4836015-fcee-4b13-b36b-1801b6a3e9de tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:24.652224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b4836015-fcee-4b13-b36b-1801b6a3e9de tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:24.656596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44b2a8a5-aa87-4962-9b28-284010195b9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:24.657487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44b2a8a5-aa87-4962-9b28-284010195b9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:24.658502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44b2a8a5-aa87-4962-9b28-284010195b9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:24.659085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44b2a8a5-aa87-4962-9b28-284010195b9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:24.668319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b4836015-fcee-4b13-b36b-1801b6a3e9de tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:24.669834 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b4836015-fcee-4b13-b36b-1801b6a3e9de tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.829413 Jul 28 03:58:24.671750 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2593/4690] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:23 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:24.680852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-541c2b93-e7e5-4fec-b085-ad3db7bb6922 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa6766b310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:24.692131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-541c2b93-e7e5-4fec-b085-ad3db7bb6922 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:24.696170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-541c2b93-e7e5-4fec-b085-ad3db7bb6922 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:24.711365 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-541c2b93-e7e5-4fec-b085-ad3db7bb6922 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags" status: 200 len: 12 microversion: 2.26 time: 0.038179 Jul 28 03:58:24.719598 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2594/4691] 10.222.0.48 () {60 vars in 1292 bytes} [Thu Jul 28 03:58:24 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags => generated 12 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:24.725257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-41d26e30-d313-46d6-bd99-511407a63c48 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:24.725874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-41d26e30-d313-46d6-bd99-511407a63c48 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:24.733041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41d26e30-d313-46d6-bd99-511407a63c48 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:24.734578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41d26e30-d313-46d6-bd99-511407a63c48 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:24.735680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41d26e30-d313-46d6-bd99-511407a63c48 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:24.736343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41d26e30-d313-46d6-bd99-511407a63c48 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.204308 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-44b2a8a5-aa87-4962-9b28-284010195b9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:25.220799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-44b2a8a5-aa87-4962-9b28-284010195b9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:25.223127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-44b2a8a5-aa87-4962-9b28-284010195b9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:25.225665 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-44b2a8a5-aa87-4962-9b28-284010195b9b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 0.600832 Jul 28 03:58:25.227345 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2098/4692] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:24 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:25.234940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9a9d43a2-e28a-4689-923d-7bc15710ecd7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa6740e160>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:25.238238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-41d26e30-d313-46d6-bd99-511407a63c48 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:25.247230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a9d43a2-e28a-4689-923d-7bc15710ecd7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.248095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a9d43a2-e28a-4689-923d-7bc15710ecd7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.249276 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-41d26e30-d313-46d6-bd99-511407a63c48 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.532289 Jul 28 03:58:25.249988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9a9d43a2-e28a-4689-923d-7bc15710ecd7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:25.251295 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2595/4693] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:24 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:25.258699 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a9d43a2-e28a-4689-923d-7bc15710ecd7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.259516 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a9d43a2-e28a-4689-923d-7bc15710ecd7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.260528 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a9d43a2-e28a-4689-923d-7bc15710ecd7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.262174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e717e201-600e-4530-907a-dca06d0e027a req-0476f85e-451a-4d9d-bef6-990fc35c7c90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8", "tag": "565bb390-f25a-4510-b22a-3975e600ba96"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:25.263598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a9d43a2-e28a-4689-923d-7bc15710ecd7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.285624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e717e201-600e-4530-907a-dca06d0e027a req-0476f85e-451a-4d9d-bef6-990fc35c7c90 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.287223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e717e201-600e-4530-907a-dca06d0e027a req-0476f85e-451a-4d9d-bef6-990fc35c7c90 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.303141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a9d43a2-e28a-4689-923d-7bc15710ecd7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.303947 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a9d43a2-e28a-4689-923d-7bc15710ecd7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.311384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:25.313790 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e717e201-600e-4530-907a-dca06d0e027a req-0476f85e-451a-4d9d-bef6-990fc35c7c90 service nova] Creating event network-changed:565bb390-f25a-4510-b22a-3975e600ba96 for instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 on n-h1-826756-3 Jul 28 03:58:25.315226 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a9d43a2-e28a-4689-923d-7bc15710ecd7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.315932 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a9d43a2-e28a-4689-923d-7bc15710ecd7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.326132 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e717e201-600e-4530-907a-dca06d0e027a req-0476f85e-451a-4d9d-bef6-990fc35c7c90 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073543 Jul 28 03:58:25.327785 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2596/4694] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:25.338257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a201282a-371f-4d3b-8ae8-a30ecd307936 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:25.339313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a201282a-371f-4d3b-8ae8-a30ecd307936 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:25.358507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-9a9d43a2-e28a-4689-923d-7bc15710ecd7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lazy-loading 'flavor' on Instance uuid c56baa57-5713-488a-9d14-cb60e7543654 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:25.366418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a201282a-371f-4d3b-8ae8-a30ecd307936 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.367266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a201282a-371f-4d3b-8ae8-a30ecd307936 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.368268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a201282a-371f-4d3b-8ae8-a30ecd307936 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.368941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a201282a-371f-4d3b-8ae8-a30ecd307936 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.385337 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9a9d43a2-e28a-4689-923d-7bc15710ecd7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "PUT /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-1612653610" status: 201 len: 0 microversion: 2.26 time: 0.156072 Jul 28 03:58:25.406800 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2099/4695] 10.222.0.48 () {62 vars in 1380 bytes} [Thu Jul 28 03:58:25 2022] PUT /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-1612653610 => generated 0 bytes in 172 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 28 03:58:25.416434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-58f25ed1-beb2-4957-8702-d6f202ff70cb tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa674331f0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:25.444661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-58f25ed1-beb2-4957-8702-d6f202ff70cb tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.445119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-58f25ed1-beb2-4957-8702-d6f202ff70cb tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.468065 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-58f25ed1-beb2-4957-8702-d6f202ff70cb tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags" status: 200 len: 36 microversion: 2.26 time: 0.059286 Jul 28 03:58:25.469222 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2100/4696] 10.222.0.48 () {60 vars in 1292 bytes} [Thu Jul 28 03:58:25 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags => generated 36 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:25.483751 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-41e8911c-c925-40ac-8c25-f7af7593001e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa67433040>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:25.492533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41e8911c-c925-40ac-8c25-f7af7593001e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.493690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41e8911c-c925-40ac-8c25-f7af7593001e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.494788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-41e8911c-c925-40ac-8c25-f7af7593001e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:25.502675 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41e8911c-c925-40ac-8c25-f7af7593001e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.503805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41e8911c-c925-40ac-8c25-f7af7593001e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.505224 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41e8911c-c925-40ac-8c25-f7af7593001e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.505940 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41e8911c-c925-40ac-8c25-f7af7593001e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.538801 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41e8911c-c925-40ac-8c25-f7af7593001e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.539392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-41e8911c-c925-40ac-8c25-f7af7593001e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.569247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-41e8911c-c925-40ac-8c25-f7af7593001e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lazy-loading 'flavor' on Instance uuid c56baa57-5713-488a-9d14-cb60e7543654 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:25.589700 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-41e8911c-c925-40ac-8c25-f7af7593001e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-1612653610" status: 204 len: 0 microversion: 2.26 time: 0.113702 Jul 28 03:58:25.592430 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2101/4697] 10.222.0.48 () {60 vars in 1364 bytes} [Thu Jul 28 03:58:25 2022] DELETE /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-1612653610 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 03:58:25.602895 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-88f33e7b-d878-4541-90a3-18608f39dd12 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa67431280>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:25.613893 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-88f33e7b-d878-4541-90a3-18608f39dd12 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.614665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-88f33e7b-d878-4541-90a3-18608f39dd12 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.629294 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-88f33e7b-d878-4541-90a3-18608f39dd12 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags" status: 200 len: 12 microversion: 2.26 time: 0.033270 Jul 28 03:58:25.630343 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2102/4698] 10.222.0.48 () {60 vars in 1292 bytes} [Thu Jul 28 03:58:25 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags => generated 12 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:58:25.641040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b6312c47-5722-443d-970d-72997352219b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa674e60d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:25.649771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6312c47-5722-443d-970d-72997352219b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.650698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6312c47-5722-443d-970d-72997352219b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.651241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b6312c47-5722-443d-970d-72997352219b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:25.666536 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6312c47-5722-443d-970d-72997352219b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.667225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6312c47-5722-443d-970d-72997352219b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.668200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6312c47-5722-443d-970d-72997352219b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.668864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6312c47-5722-443d-970d-72997352219b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.694519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6312c47-5722-443d-970d-72997352219b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.695298 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b6312c47-5722-443d-970d-72997352219b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.708861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-b6312c47-5722-443d-970d-72997352219b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lazy-loading 'flavor' on Instance uuid c56baa57-5713-488a-9d14-cb60e7543654 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:25.726172 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b6312c47-5722-443d-970d-72997352219b tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags" status: 204 len: 0 microversion: 2.26 time: 0.089354 Jul 28 03:58:25.727112 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2103/4699] 10.222.0.48 () {60 vars in 1295 bytes} [Thu Jul 28 03:58:25 2022] DELETE /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 03:58:25.735473 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-947ee5da-2fdd-428b-a04e-0316e7f2eeac tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:25.736440 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-947ee5da-2fdd-428b-a04e-0316e7f2eeac tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:25.743900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-947ee5da-2fdd-428b-a04e-0316e7f2eeac tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.744619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-947ee5da-2fdd-428b-a04e-0316e7f2eeac tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.745508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-947ee5da-2fdd-428b-a04e-0316e7f2eeac tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.745935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-947ee5da-2fdd-428b-a04e-0316e7f2eeac tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.789649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a201282a-371f-4d3b-8ae8-a30ecd307936 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:25.800509 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a201282a-371f-4d3b-8ae8-a30ecd307936 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.467589 Jul 28 03:58:25.802213 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2597/4700] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:25 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:25.807316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94fb1bf6-bb9a-4e13-886d-220a6ae7c94e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa678b9310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:25.818582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fb1bf6-bb9a-4e13-886d-220a6ae7c94e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.819270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fb1bf6-bb9a-4e13-886d-220a6ae7c94e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.820179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-94fb1bf6-bb9a-4e13-886d-220a6ae7c94e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:25.827106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fb1bf6-bb9a-4e13-886d-220a6ae7c94e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.827556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fb1bf6-bb9a-4e13-886d-220a6ae7c94e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.829232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fb1bf6-bb9a-4e13-886d-220a6ae7c94e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.829671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fb1bf6-bb9a-4e13-886d-220a6ae7c94e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.866057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fb1bf6-bb9a-4e13-886d-220a6ae7c94e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.866513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fb1bf6-bb9a-4e13-886d-220a6ae7c94e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.877911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fb1bf6-bb9a-4e13-886d-220a6ae7c94e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.878386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fb1bf6-bb9a-4e13-886d-220a6ae7c94e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.918662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-94fb1bf6-bb9a-4e13-886d-220a6ae7c94e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lazy-loading 'flavor' on Instance uuid c56baa57-5713-488a-9d14-cb60e7543654 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:25.944380 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-94fb1bf6-bb9a-4e13-886d-220a6ae7c94e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "PUT /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-23352364" status: 201 len: 0 microversion: 2.26 time: 0.140875 Jul 28 03:58:25.945069 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2598/4701] 10.222.0.48 () {62 vars in 1374 bytes} [Thu Jul 28 03:58:25 2022] PUT /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-23352364 => generated 0 bytes in 142 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Jul 28 03:58:25.953265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2bb98d80-1898-49fb-af2c-7dcbc1ea4ccc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:25.954540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2bb98d80-1898-49fb-af2c-7dcbc1ea4ccc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: e9e665a5-3c94-4681-be78-179abffd401e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:25.960332 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-2bb98d80-1898-49fb-af2c-7dcbc1ea4ccc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance e9e665a5-3c94-4681-be78-179abffd401e could not be found. Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2bb98d80-1898-49fb-af2c-7dcbc1ea4ccc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/e9e665a5-3c94-4681-be78-179abffd401e/action HTTP/1.1 Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 15 Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: {"suspend": {}} Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance e9e665a5-3c94-4681-be78-179abffd401e could not be found. Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'e9e665a5-3c94-4681-be78-179abffd401e', 'body': {'suspend': {}}} Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9e665a5-3c94-4681-be78-179abffd401e could not be found. Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9e665a5-3c94-4681-be78-179abffd401e could not be found. Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:25.962126 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:25.967770 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:25.967770 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:25.967770 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9e665a5-3c94-4681-be78-179abffd401e could not be found. Jul 28 03:58:25.967770 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:25.969078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2bb98d80-1898-49fb-af2c-7dcbc1ea4ccc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance e9e665a5-3c94-4681-be78-179abffd401e could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:25.970417 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2bb98d80-1898-49fb-af2c-7dcbc1ea4ccc tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/e9e665a5-3c94-4681-be78-179abffd401e/action" status: 404 len: 111 microversion: 2.1 time: 0.024235 Jul 28 03:58:25.971456 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2599/4702] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:58:25 2022] POST /compute/v2.1/servers/e9e665a5-3c94-4681-be78-179abffd401e/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:58:25.976846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3503f7e6-a1d8-486e-a5e1-336456abe549 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa74b72820>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:25.990778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3503f7e6-a1d8-486e-a5e1-336456abe549 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:25.991251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3503f7e6-a1d8-486e-a5e1-336456abe549 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:25.991742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3503f7e6-a1d8-486e-a5e1-336456abe549 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:25.999726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3503f7e6-a1d8-486e-a5e1-336456abe549 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:26.000553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3503f7e6-a1d8-486e-a5e1-336456abe549 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:26.001515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3503f7e6-a1d8-486e-a5e1-336456abe549 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:26.001955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3503f7e6-a1d8-486e-a5e1-336456abe549 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:26.051305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3503f7e6-a1d8-486e-a5e1-336456abe549 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:26.051807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3503f7e6-a1d8-486e-a5e1-336456abe549 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:26.066845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3503f7e6-a1d8-486e-a5e1-336456abe549 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:26.067482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3503f7e6-a1d8-486e-a5e1-336456abe549 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:26.102771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-3503f7e6-a1d8-486e-a5e1-336456abe549 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lazy-loading 'flavor' on Instance uuid c56baa57-5713-488a-9d14-cb60e7543654 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:26.124405 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3503f7e6-a1d8-486e-a5e1-336456abe549 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "PUT /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-1777036009" status: 201 len: 0 microversion: 2.26 time: 0.151726 Jul 28 03:58:26.125647 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2600/4703] 10.222.0.48 () {62 vars in 1380 bytes} [Thu Jul 28 03:58:25 2022] PUT /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-1777036009 => generated 0 bytes in 153 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 28 03:58:26.132838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70190a10-2c7b-41c7-8511-ca8b4fb66982 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:26.133452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-70190a10-2c7b-41c7-8511-ca8b4fb66982 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:26.140068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70190a10-2c7b-41c7-8511-ca8b4fb66982 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:26.140557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70190a10-2c7b-41c7-8511-ca8b4fb66982 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:26.141324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70190a10-2c7b-41c7-8511-ca8b4fb66982 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:26.141754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70190a10-2c7b-41c7-8511-ca8b4fb66982 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:26.453170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-947ee5da-2fdd-428b-a04e-0316e7f2eeac tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:26.472846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-947ee5da-2fdd-428b-a04e-0316e7f2eeac tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:26.476118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-947ee5da-2fdd-428b-a04e-0316e7f2eeac tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:26.477896 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-947ee5da-2fdd-428b-a04e-0316e7f2eeac tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.749330 Jul 28 03:58:26.490036 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2104/4704] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:25 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:26.505870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bdd0cc38-1cbf-4fdd-8c1a-a37f9df935d7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa67442550>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:26.516974 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bdd0cc38-1cbf-4fdd-8c1a-a37f9df935d7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:26.517627 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bdd0cc38-1cbf-4fdd-8c1a-a37f9df935d7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:26.518271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bdd0cc38-1cbf-4fdd-8c1a-a37f9df935d7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:26.526284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bdd0cc38-1cbf-4fdd-8c1a-a37f9df935d7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:26.526949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bdd0cc38-1cbf-4fdd-8c1a-a37f9df935d7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:26.527854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bdd0cc38-1cbf-4fdd-8c1a-a37f9df935d7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:26.528338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bdd0cc38-1cbf-4fdd-8c1a-a37f9df935d7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:26.587257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bdd0cc38-1cbf-4fdd-8c1a-a37f9df935d7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:26.590673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bdd0cc38-1cbf-4fdd-8c1a-a37f9df935d7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:26.627135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-bdd0cc38-1cbf-4fdd-8c1a-a37f9df935d7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lazy-loading 'flavor' on Instance uuid c56baa57-5713-488a-9d14-cb60e7543654 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:26.640782 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:26.662795 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bdd0cc38-1cbf-4fdd-8c1a-a37f9df935d7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags" status: 204 len: 0 microversion: 2.26 time: 0.171347 Jul 28 03:58:26.664119 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2105/4705] 10.222.0.48 () {60 vars in 1295 bytes} [Thu Jul 28 03:58:26 2022] DELETE /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:58:26.682541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f0b3d52c-4c62-41ae-aa34-bd239fcf559c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:26.683644 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f0b3d52c-4c62-41ae-aa34-bd239fcf559c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:26.698726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f0b3d52c-4c62-41ae-aa34-bd239fcf559c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:26.704658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f0b3d52c-4c62-41ae-aa34-bd239fcf559c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:26.705863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f0b3d52c-4c62-41ae-aa34-bd239fcf559c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:26.706660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f0b3d52c-4c62-41ae-aa34-bd239fcf559c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:27.081749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-70190a10-2c7b-41c7-8511-ca8b4fb66982 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:27.100293 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-70190a10-2c7b-41c7-8511-ca8b4fb66982 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.972937 Jul 28 03:58:27.100879 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2601/4706] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:26 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:27.111615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c5224a80-8179-46eb-bf64-1efa6b9ad0c7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa76a455e0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:27.131892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5224a80-8179-46eb-bf64-1efa6b9ad0c7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:27.132853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5224a80-8179-46eb-bf64-1efa6b9ad0c7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:27.156851 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c5224a80-8179-46eb-bf64-1efa6b9ad0c7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags" status: 200 len: 12 microversion: 2.26 time: 0.054532 Jul 28 03:58:27.162963 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2602/4707] 10.222.0.48 () {60 vars in 1292 bytes} [Thu Jul 28 03:58:27 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags => generated 12 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:27.180484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6cf4102f-a247-43eb-b903-5b2ef53a36ec tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:27.181675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6cf4102f-a247-43eb-b903-5b2ef53a36ec tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:27.188649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cf4102f-a247-43eb-b903-5b2ef53a36ec tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:27.189399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cf4102f-a247-43eb-b903-5b2ef53a36ec tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:27.190507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cf4102f-a247-43eb-b903-5b2ef53a36ec tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:27.191212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cf4102f-a247-43eb-b903-5b2ef53a36ec tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:27.636968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6cf4102f-a247-43eb-b903-5b2ef53a36ec tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:27.646576 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6cf4102f-a247-43eb-b903-5b2ef53a36ec tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.482084 Jul 28 03:58:27.650589 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2603/4708] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:27 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:27.658539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f53ca9af-2d96-4184-9e8c-f91a8bc81daf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa799f0e50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:27.675995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f53ca9af-2d96-4184-9e8c-f91a8bc81daf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:27.695446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f53ca9af-2d96-4184-9e8c-f91a8bc81daf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:27.697714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f53ca9af-2d96-4184-9e8c-f91a8bc81daf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:27.723833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f53ca9af-2d96-4184-9e8c-f91a8bc81daf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:27.729259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f53ca9af-2d96-4184-9e8c-f91a8bc81daf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:27.730529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f53ca9af-2d96-4184-9e8c-f91a8bc81daf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:27.734718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f53ca9af-2d96-4184-9e8c-f91a8bc81daf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:27.820583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f53ca9af-2d96-4184-9e8c-f91a8bc81daf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:27.826568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f53ca9af-2d96-4184-9e8c-f91a8bc81daf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:27.885013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-f53ca9af-2d96-4184-9e8c-f91a8bc81daf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lazy-loading 'flavor' on Instance uuid c56baa57-5713-488a-9d14-cb60e7543654 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:27.960737 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f53ca9af-2d96-4184-9e8c-f91a8bc81daf tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags" status: 204 len: 0 microversion: 2.26 time: 0.305732 Jul 28 03:58:27.962977 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2604/4709] 10.222.0.48 () {60 vars in 1295 bytes} [Thu Jul 28 03:58:27 2022] DELETE /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:58:27.978451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-401e73bf-6152-46c9-b586-62134918843b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:27.981045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-401e73bf-6152-46c9-b586-62134918843b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:27.998527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-401e73bf-6152-46c9-b586-62134918843b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:28.001085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-401e73bf-6152-46c9-b586-62134918843b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:28.002372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-401e73bf-6152-46c9-b586-62134918843b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:28.003301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-401e73bf-6152-46c9-b586-62134918843b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:28.096639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f0b3d52c-4c62-41ae-aa34-bd239fcf559c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:28.144945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f0b3d52c-4c62-41ae-aa34-bd239fcf559c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:28.146855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f0b3d52c-4c62-41ae-aa34-bd239fcf559c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:28.159835 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f0b3d52c-4c62-41ae-aa34-bd239fcf559c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 1.482987 Jul 28 03:58:28.165389 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2106/4710] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:26 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:28.194704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-05f502c4-c5da-48a2-8f8f-a8bc127d01f7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:28.197583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-05f502c4-c5da-48a2-8f8f-a8bc127d01f7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:28.226354 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-05f502c4-c5da-48a2-8f8f-a8bc127d01f7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:28.227338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-05f502c4-c5da-48a2-8f8f-a8bc127d01f7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:28.229685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-05f502c4-c5da-48a2-8f8f-a8bc127d01f7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:28.230324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-05f502c4-c5da-48a2-8f8f-a8bc127d01f7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:28.320978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-05f502c4-c5da-48a2-8f8f-a8bc127d01f7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lazy-loading 'flavor' on Instance uuid 1d97b518-6a6e-44f8-9be3-940b6fa8c853 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:28.535199 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-05f502c4-c5da-48a2-8f8f-a8bc127d01f7 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action" status: 202 len: 0 microversion: 2.1 time: 0.364685 Jul 28 03:58:28.547099 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2107/4711] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:58:28 2022] POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:58:28.563850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0fa0eede-fab7-4cdd-9219-9b8ca8a38f32 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa674eeca0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:28.592122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fa0eede-fab7-4cdd-9219-9b8ca8a38f32 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:28.599600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fa0eede-fab7-4cdd-9219-9b8ca8a38f32 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:28.600380 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0fa0eede-fab7-4cdd-9219-9b8ca8a38f32 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:28.621978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fa0eede-fab7-4cdd-9219-9b8ca8a38f32 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:28.625658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fa0eede-fab7-4cdd-9219-9b8ca8a38f32 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:28.629917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fa0eede-fab7-4cdd-9219-9b8ca8a38f32 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:28.630452 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fa0eede-fab7-4cdd-9219-9b8ca8a38f32 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:28.709856 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fa0eede-fab7-4cdd-9219-9b8ca8a38f32 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:28.710348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fa0eede-fab7-4cdd-9219-9b8ca8a38f32 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:28.759501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fa0eede-fab7-4cdd-9219-9b8ca8a38f32 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:28.761744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0fa0eede-fab7-4cdd-9219-9b8ca8a38f32 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:28.844164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-0fa0eede-fab7-4cdd-9219-9b8ca8a38f32 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lazy-loading 'flavor' on Instance uuid c56baa57-5713-488a-9d14-cb60e7543654 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:28.918441 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0fa0eede-fab7-4cdd-9219-9b8ca8a38f32 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "PUT /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-1174956142" status: 201 len: 0 microversion: 2.26 time: 0.369235 Jul 28 03:58:28.924537 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2108/4712] 10.222.0.48 () {62 vars in 1380 bytes} [Thu Jul 28 03:58:28 2022] PUT /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-1174956142 => generated 0 bytes in 377 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 28 03:58:28.937533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e1bbd793-8867-4a6c-be0b-f7067341aaed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:28.938580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e1bbd793-8867-4a6c-be0b-f7067341aaed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:28.979566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e1bbd793-8867-4a6c-be0b-f7067341aaed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:28.980035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e1bbd793-8867-4a6c-be0b-f7067341aaed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:28.985800 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e1bbd793-8867-4a6c-be0b-f7067341aaed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:28.986295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e1bbd793-8867-4a6c-be0b-f7067341aaed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:28.996644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-401e73bf-6152-46c9-b586-62134918843b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:29.015042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-401e73bf-6152-46c9-b586-62134918843b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:29.030218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-401e73bf-6152-46c9-b586-62134918843b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:29.031532 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-401e73bf-6152-46c9-b586-62134918843b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 1.067050 Jul 28 03:58:29.032455 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2605/4713] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:27 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:29.037489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9ac24920-a898-4914-b9f8-4a16c400a26e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa675e83a0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:29.128810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ac24920-a898-4914-b9f8-4a16c400a26e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:29.129446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ac24920-a898-4914-b9f8-4a16c400a26e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:29.129988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9ac24920-a898-4914-b9f8-4a16c400a26e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:29.153805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ac24920-a898-4914-b9f8-4a16c400a26e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:29.154216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ac24920-a898-4914-b9f8-4a16c400a26e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:29.155117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ac24920-a898-4914-b9f8-4a16c400a26e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:29.178049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ac24920-a898-4914-b9f8-4a16c400a26e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:29.280291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ac24920-a898-4914-b9f8-4a16c400a26e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:29.281799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ac24920-a898-4914-b9f8-4a16c400a26e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:29.296714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ac24920-a898-4914-b9f8-4a16c400a26e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:29.297457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ac24920-a898-4914-b9f8-4a16c400a26e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:29.354699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-9ac24920-a898-4914-b9f8-4a16c400a26e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lazy-loading 'flavor' on Instance uuid c56baa57-5713-488a-9d14-cb60e7543654 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:29.397799 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9ac24920-a898-4914-b9f8-4a16c400a26e tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "PUT /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-1153378018" status: 201 len: 0 microversion: 2.26 time: 0.363907 Jul 28 03:58:29.406729 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2606/4714] 10.222.0.48 () {62 vars in 1380 bytes} [Thu Jul 28 03:58:29 2022] PUT /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags/tempest-tag-1153378018 => generated 0 bytes in 370 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 28 03:58:29.423372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5081be27-3d91-4347-9301-778baf524bbb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:29.429249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5081be27-3d91-4347-9301-778baf524bbb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:29.454664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5081be27-3d91-4347-9301-778baf524bbb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:29.458601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5081be27-3d91-4347-9301-778baf524bbb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:29.460884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5081be27-3d91-4347-9301-778baf524bbb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:29.462322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5081be27-3d91-4347-9301-778baf524bbb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:29.639491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e1bbd793-8867-4a6c-be0b-f7067341aaed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:29.654220 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e1bbd793-8867-4a6c-be0b-f7067341aaed tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1513 microversion: 2.1 time: 0.727424 Jul 28 03:58:29.676097 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2109/4715] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:28 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1513 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:29.687845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0e686422-ed72-46df-998f-7c56a6723e10 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Action: 'update_all', calling method: .version_select at 0x7ffa6757aa60>, body: {"tags": ["tempest-tag-2110511036", "tempest-tag-1876211005"]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:29.705799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:29.714989 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e686422-ed72-46df-998f-7c56a6723e10 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:29.717982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e686422-ed72-46df-998f-7c56a6723e10 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:29.718793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0e686422-ed72-46df-998f-7c56a6723e10 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:29.740045 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e686422-ed72-46df-998f-7c56a6723e10 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:29.740998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e686422-ed72-46df-998f-7c56a6723e10 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:29.744276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e686422-ed72-46df-998f-7c56a6723e10 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:29.745619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e686422-ed72-46df-998f-7c56a6723e10 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:29.812344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e686422-ed72-46df-998f-7c56a6723e10 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:29.815370 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e686422-ed72-46df-998f-7c56a6723e10 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:29.863882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-0e686422-ed72-46df-998f-7c56a6723e10 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lazy-loading 'flavor' on Instance uuid c56baa57-5713-488a-9d14-cb60e7543654 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:29.903683 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0e686422-ed72-46df-998f-7c56a6723e10 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "PUT /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags" status: 200 len: 62 microversion: 2.26 time: 0.225985 Jul 28 03:58:29.910592 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2110/4716] 10.222.0.48 () {62 vars in 1312 bytes} [Thu Jul 28 03:58:29 2022] PUT /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags => generated 62 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:29.922897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a962925c-e372-4408-97a9-a2eca1c1e30c tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa6740eb80>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:29.944434 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a962925c-e372-4408-97a9-a2eca1c1e30c tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:29.945501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a962925c-e372-4408-97a9-a2eca1c1e30c tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:29.973461 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a962925c-e372-4408-97a9-a2eca1c1e30c tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags" status: 200 len: 62 microversion: 2.26 time: 0.056889 Jul 28 03:58:29.977687 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2111/4717] 10.222.0.48 () {60 vars in 1292 bytes} [Thu Jul 28 03:58:29 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags => generated 62 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:58:29.989437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8b547b6e-bfa4-457d-a2b2-8b5f4537beb8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '.version_select at 0x7ffa674bcaf0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:30.009036 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b547b6e-bfa4-457d-a2b2-8b5f4537beb8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:30.009672 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b547b6e-bfa4-457d-a2b2-8b5f4537beb8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:30.010334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8b547b6e-bfa4-457d-a2b2-8b5f4537beb8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:30.025254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b547b6e-bfa4-457d-a2b2-8b5f4537beb8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:30.027428 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b547b6e-bfa4-457d-a2b2-8b5f4537beb8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:30.030334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b547b6e-bfa4-457d-a2b2-8b5f4537beb8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:30.031828 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b547b6e-bfa4-457d-a2b2-8b5f4537beb8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:30.107307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b547b6e-bfa4-457d-a2b2-8b5f4537beb8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:30.109567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8b547b6e-bfa4-457d-a2b2-8b5f4537beb8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:30.148994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-8b547b6e-bfa4-457d-a2b2-8b5f4537beb8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lazy-loading 'flavor' on Instance uuid c56baa57-5713-488a-9d14-cb60e7543654 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:30.187847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5081be27-3d91-4347-9301-778baf524bbb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:30.191429 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8b547b6e-bfa4-457d-a2b2-8b5f4537beb8 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags" status: 204 len: 0 microversion: 2.26 time: 0.208579 Jul 28 03:58:30.200286 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2112/4718] 10.222.0.48 () {60 vars in 1295 bytes} [Thu Jul 28 03:58:29 2022] DELETE /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654/tags => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:58:30.205737 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f4b9ca50-856f-4b3c-b9c6-e8236ffc4e3c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:30.209807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f4b9ca50-856f-4b3c-b9c6-e8236ffc4e3c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:30.214231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5081be27-3d91-4347-9301-778baf524bbb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:30.216690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5081be27-3d91-4347-9301-778baf524bbb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:30.218456 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5081be27-3d91-4347-9301-778baf524bbb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 0.807147 Jul 28 03:58:30.219495 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2607/4719] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:29 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:30.232082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f4b9ca50-856f-4b3c-b9c6-e8236ffc4e3c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:30.232918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f4b9ca50-856f-4b3c-b9c6-e8236ffc4e3c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:30.233990 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f4b9ca50-856f-4b3c-b9c6-e8236ffc4e3c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:30.234712 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f4b9ca50-856f-4b3c-b9c6-e8236ffc4e3c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:30.236342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-baa2bbe6-09a2-4e9e-9099-1ac3a880a7a1 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:30.236912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-baa2bbe6-09a2-4e9e-9099-1ac3a880a7a1 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:30.253023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-baa2bbe6-09a2-4e9e-9099-1ac3a880a7a1 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:30.254903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-baa2bbe6-09a2-4e9e-9099-1ac3a880a7a1 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:30.255768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-baa2bbe6-09a2-4e9e-9099-1ac3a880a7a1 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:30.256420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-baa2bbe6-09a2-4e9e-9099-1ac3a880a7a1 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:30.337879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-baa2bbe6-09a2-4e9e-9099-1ac3a880a7a1 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:58:30.348464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:30.578573 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-baa2bbe6-09a2-4e9e-9099-1ac3a880a7a1 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 204 len: 0 microversion: 2.26 time: 0.357495 Jul 28 03:58:30.582077 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2608/4720] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:58:30 2022] DELETE /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:58:30.587960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d34aa0b-876c-49ee-a19e-8514248466f7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:30.588756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5d34aa0b-876c-49ee-a19e-8514248466f7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:30.605505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d34aa0b-876c-49ee-a19e-8514248466f7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:30.606001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d34aa0b-876c-49ee-a19e-8514248466f7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:30.608448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d34aa0b-876c-49ee-a19e-8514248466f7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:30.608919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d34aa0b-876c-49ee-a19e-8514248466f7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:30.885334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5d34aa0b-876c-49ee-a19e-8514248466f7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:30.895104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5d34aa0b-876c-49ee-a19e-8514248466f7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:30.896830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5d34aa0b-876c-49ee-a19e-8514248466f7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:30.898197 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5d34aa0b-876c-49ee-a19e-8514248466f7 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1553 microversion: 2.26 time: 0.314710 Jul 28 03:58:30.899207 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2609/4721] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:30 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1553 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:30.904091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-493c59dc-52b6-42f1-a65a-6d7bb704daef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:30.904758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-493c59dc-52b6-42f1-a65a-6d7bb704daef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:30.914109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-493c59dc-52b6-42f1-a65a-6d7bb704daef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:30.914109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-493c59dc-52b6-42f1-a65a-6d7bb704daef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:30.914109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-493c59dc-52b6-42f1-a65a-6d7bb704daef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:30.914538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-493c59dc-52b6-42f1-a65a-6d7bb704daef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:31.125121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-493c59dc-52b6-42f1-a65a-6d7bb704daef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:31.135277 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-493c59dc-52b6-42f1-a65a-6d7bb704daef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1496 microversion: 2.1 time: 0.234887 Jul 28 03:58:31.136427 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2610/4722] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:30 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1496 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:31.176804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f380e5d8-89c9-468c-8e94-d649e51b0a2d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:31.177656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f380e5d8-89c9-468c-8e94-d649e51b0a2d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:31.187027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f380e5d8-89c9-468c-8e94-d649e51b0a2d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:31.187857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f380e5d8-89c9-468c-8e94-d649e51b0a2d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:31.188693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f380e5d8-89c9-468c-8e94-d649e51b0a2d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:31.189127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f380e5d8-89c9-468c-8e94-d649e51b0a2d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:31.222679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-f380e5d8-89c9-468c-8e94-d649e51b0a2d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lazy-loading 'flavor' on Instance uuid 1d97b518-6a6e-44f8-9be3-940b6fa8c853 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:31.236473 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-f380e5d8-89c9-468c-8e94-d649e51b0a2d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Cannot 'suspend' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state suspended Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f380e5d8-89c9-468c-8e94-d649e51b0a2d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action HTTP/1.1 Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 15 Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: {"suspend": {}} Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: exception: Cannot 'suspend' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state suspended Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1d97b518-6a6e-44f8-9be3-940b6fa8c853', 'body': {'suspend': {}}} Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 257, in inner Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 28 03:58:31.238577 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state suspended Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state suspended Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f380e5d8-89c9-468c-8e94-d649e51b0a2d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 409 to user: Cannot 'suspend' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state suspended {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f380e5d8-89c9-468c-8e94-d649e51b0a2d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action" status: 409 len: 148 microversion: 2.1 time: 0.081112 Jul 28 03:58:31.242407 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2611/4723] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:58:31 2022] POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action => generated 148 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:58:31.247805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-755543b8-72b2-486c-a00f-68e2bfa9e57a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:31.248599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-755543b8-72b2-486c-a00f-68e2bfa9e57a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:31.268278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-755543b8-72b2-486c-a00f-68e2bfa9e57a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:31.272313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-755543b8-72b2-486c-a00f-68e2bfa9e57a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:31.273504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-755543b8-72b2-486c-a00f-68e2bfa9e57a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:31.274740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-755543b8-72b2-486c-a00f-68e2bfa9e57a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:31.418212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f4b9ca50-856f-4b3c-b9c6-e8236ffc4e3c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:31.445041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f4b9ca50-856f-4b3c-b9c6-e8236ffc4e3c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:31.449715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f4b9ca50-856f-4b3c-b9c6-e8236ffc4e3c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:31.455916 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f4b9ca50-856f-4b3c-b9c6-e8236ffc4e3c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 1.253569 Jul 28 03:58:31.471240 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2113/4724] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:30 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:31.480104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-755543b8-72b2-486c-a00f-68e2bfa9e57a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:31.496195 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3bd0b532-c4e0-4c38-b76f-7a58984be7f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:31.497347 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3bd0b532-c4e0-4c38-b76f-7a58984be7f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:31.498130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-755543b8-72b2-486c-a00f-68e2bfa9e57a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:31.499852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-755543b8-72b2-486c-a00f-68e2bfa9e57a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:31.501163 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-755543b8-72b2-486c-a00f-68e2bfa9e57a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 0.259145 Jul 28 03:58:31.501718 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2612/4725] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:31 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:31.514273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3bd0b532-c4e0-4c38-b76f-7a58984be7f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:31.514732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3bd0b532-c4e0-4c38-b76f-7a58984be7f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:31.516061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3bd0b532-c4e0-4c38-b76f-7a58984be7f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:31.517062 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3bd0b532-c4e0-4c38-b76f-7a58984be7f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:31.603473 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3bd0b532-c4e0-4c38-b76f-7a58984be7f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action" status: 202 len: 0 microversion: 2.1 time: 0.122585 Jul 28 03:58:31.604553 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2114/4726] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:58:31 2022] POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:58:31.614703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-caec0d76-1291-4d49-bec2-711ba562c7e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:31.615610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-caec0d76-1291-4d49-bec2-711ba562c7e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:31.630012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-caec0d76-1291-4d49-bec2-711ba562c7e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:31.630597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-caec0d76-1291-4d49-bec2-711ba562c7e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:31.631558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-caec0d76-1291-4d49-bec2-711ba562c7e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:31.632126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-caec0d76-1291-4d49-bec2-711ba562c7e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:31.929283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-caec0d76-1291-4d49-bec2-711ba562c7e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:31.932853 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-52715eb9-98b6-4a67-a264-43b303ff4c88 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:31.934224 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-52715eb9-98b6-4a67-a264-43b303ff4c88 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:31.943236 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-caec0d76-1291-4d49-bec2-711ba562c7e5 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1502 microversion: 2.1 time: 0.333329 Jul 28 03:58:31.944151 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2613/4727] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:31 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1502 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:31.945381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52715eb9-98b6-4a67-a264-43b303ff4c88 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:31.946208 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52715eb9-98b6-4a67-a264-43b303ff4c88 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:31.947196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52715eb9-98b6-4a67-a264-43b303ff4c88 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:31.947829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-52715eb9-98b6-4a67-a264-43b303ff4c88 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:32.386922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-52715eb9-98b6-4a67-a264-43b303ff4c88 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:32.400197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-52715eb9-98b6-4a67-a264-43b303ff4c88 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:32.402977 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-52715eb9-98b6-4a67-a264-43b303ff4c88 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:32.408211 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-52715eb9-98b6-4a67-a264-43b303ff4c88 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1553 microversion: 2.26 time: 0.484749 Jul 28 03:58:32.408864 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2115/4728] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:31 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1553 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:32.488167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-188515bd-0cd0-4e6f-8ce1-ac3a3b7796e2 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:32.488983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-188515bd-0cd0-4e6f-8ce1-ac3a3b7796e2 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:32.519552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-188515bd-0cd0-4e6f-8ce1-ac3a3b7796e2 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:32.529025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0dc4aead-6043-4ba1-a847-b9970a1f07a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:32.531981 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0dc4aead-6043-4ba1-a847-b9970a1f07a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:32.534888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-188515bd-0cd0-4e6f-8ce1-ac3a3b7796e2 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:32.538686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-188515bd-0cd0-4e6f-8ce1-ac3a3b7796e2 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:32.542523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-188515bd-0cd0-4e6f-8ce1-ac3a3b7796e2 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:32.563567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0dc4aead-6043-4ba1-a847-b9970a1f07a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:32.567467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0dc4aead-6043-4ba1-a847-b9970a1f07a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:32.570948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0dc4aead-6043-4ba1-a847-b9970a1f07a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:32.572944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0dc4aead-6043-4ba1-a847-b9970a1f07a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:33.402924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-188515bd-0cd0-4e6f-8ce1-ac3a3b7796e2 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:33.420883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-188515bd-0cd0-4e6f-8ce1-ac3a3b7796e2 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:33.423962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-188515bd-0cd0-4e6f-8ce1-ac3a3b7796e2 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:33.425658 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-188515bd-0cd0-4e6f-8ce1-ac3a3b7796e2 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.945061 Jul 28 03:58:33.440061 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2614/4729] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:32 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:33.454326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a85b6f6e-b420-4da8-b1a5-edd93c04195a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:33.455190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a85b6f6e-b420-4da8-b1a5-edd93c04195a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:33.464140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a85b6f6e-b420-4da8-b1a5-edd93c04195a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:33.464971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a85b6f6e-b420-4da8-b1a5-edd93c04195a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:33.466315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a85b6f6e-b420-4da8-b1a5-edd93c04195a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:33.466937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a85b6f6e-b420-4da8-b1a5-edd93c04195a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:34.070492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a85b6f6e-b420-4da8-b1a5-edd93c04195a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:34.087012 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a85b6f6e-b420-4da8-b1a5-edd93c04195a tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1502 microversion: 2.1 time: 0.637882 Jul 28 03:58:34.091733 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2615/4730] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:33 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1502 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:34.109736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e5636ae-30d8-429d-8d85-7636cc661a31 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:34.110526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4e5636ae-30d8-429d-8d85-7636cc661a31 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:34.134251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e5636ae-30d8-429d-8d85-7636cc661a31 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:34.135117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e5636ae-30d8-429d-8d85-7636cc661a31 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:34.136712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e5636ae-30d8-429d-8d85-7636cc661a31 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:34.139900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e5636ae-30d8-429d-8d85-7636cc661a31 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:34.196637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0dc4aead-6043-4ba1-a847-b9970a1f07a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:34.208112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0dc4aead-6043-4ba1-a847-b9970a1f07a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:34.222438 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0dc4aead-6043-4ba1-a847-b9970a1f07a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:34.224134 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0dc4aead-6043-4ba1-a847-b9970a1f07a0 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 1.701300 Jul 28 03:58:34.225132 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2116/4731] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:32 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:34.455269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-df0bca77-a9c2-401b-a8ca-339df9b5bc54 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:34.455943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-df0bca77-a9c2-401b-a8ca-339df9b5bc54 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:34.470067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df0bca77-a9c2-401b-a8ca-339df9b5bc54 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:34.470618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df0bca77-a9c2-401b-a8ca-339df9b5bc54 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:34.471536 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df0bca77-a9c2-401b-a8ca-339df9b5bc54 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:34.471975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df0bca77-a9c2-401b-a8ca-339df9b5bc54 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:34.481291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:34.801981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e5636ae-30d8-429d-8d85-7636cc661a31 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:34.833053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e5636ae-30d8-429d-8d85-7636cc661a31 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:34.843305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e5636ae-30d8-429d-8d85-7636cc661a31 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:34.851635 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e5636ae-30d8-429d-8d85-7636cc661a31 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1553 microversion: 2.26 time: 0.756862 Jul 28 03:58:34.854409 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2616/4732] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:34 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1553 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:35.117915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-53165c05-215a-40ce-959c-a52d1b0a6dd8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:35.119992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-53165c05-215a-40ce-959c-a52d1b0a6dd8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:35.142712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53165c05-215a-40ce-959c-a52d1b0a6dd8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:35.143515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53165c05-215a-40ce-959c-a52d1b0a6dd8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:35.144686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53165c05-215a-40ce-959c-a52d1b0a6dd8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:35.145262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53165c05-215a-40ce-959c-a52d1b0a6dd8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:35.682442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-53165c05-215a-40ce-959c-a52d1b0a6dd8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:35.698949 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-53165c05-215a-40ce-959c-a52d1b0a6dd8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1502 microversion: 2.1 time: 0.589048 Jul 28 03:58:35.702730 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2617/4733] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:35 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1502 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:35.716109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-204e1be2-aeb1-4240-b59d-611252988da9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:35.718843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-204e1be2-aeb1-4240-b59d-611252988da9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:35.739047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-204e1be2-aeb1-4240-b59d-611252988da9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:35.740664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-204e1be2-aeb1-4240-b59d-611252988da9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:35.745518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-204e1be2-aeb1-4240-b59d-611252988da9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:35.746159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-204e1be2-aeb1-4240-b59d-611252988da9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:35.758227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-df0bca77-a9c2-401b-a8ca-339df9b5bc54 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:35.804343 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-df0bca77-a9c2-401b-a8ca-339df9b5bc54 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:35.809874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-df0bca77-a9c2-401b-a8ca-339df9b5bc54 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:35.811306 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-df0bca77-a9c2-401b-a8ca-339df9b5bc54 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 1.360321 Jul 28 03:58:35.817375 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2117/4734] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:34 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:35.885238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-95806575-16a6-4ac6-adc9-6882fbb32371 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:35.886367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-95806575-16a6-4ac6-adc9-6882fbb32371 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:35.900183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-95806575-16a6-4ac6-adc9-6882fbb32371 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:35.900994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-95806575-16a6-4ac6-adc9-6882fbb32371 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:35.902233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-95806575-16a6-4ac6-adc9-6882fbb32371 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:35.912887 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-95806575-16a6-4ac6-adc9-6882fbb32371 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:36.100296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-204e1be2-aeb1-4240-b59d-611252988da9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:36.113501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-204e1be2-aeb1-4240-b59d-611252988da9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:36.115023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-204e1be2-aeb1-4240-b59d-611252988da9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:36.116213 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-204e1be2-aeb1-4240-b59d-611252988da9 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 0.412046 Jul 28 03:58:36.122579 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2618/4735] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:35 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:36.574147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-95806575-16a6-4ac6-adc9-6882fbb32371 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:36.591621 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-95806575-16a6-4ac6-adc9-6882fbb32371 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:36.604729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-95806575-16a6-4ac6-adc9-6882fbb32371 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:36.606844 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-95806575-16a6-4ac6-adc9-6882fbb32371 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1553 microversion: 2.26 time: 0.727220 Jul 28 03:58:36.609105 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2118/4736] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:35 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1553 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:36.724858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3250aa1b-a2a0-46a5-96ae-f9e1d6067809 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:36.725692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3250aa1b-a2a0-46a5-96ae-f9e1d6067809 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:36.758802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3250aa1b-a2a0-46a5-96ae-f9e1d6067809 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:36.759405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3250aa1b-a2a0-46a5-96ae-f9e1d6067809 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:36.766993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-859bd11e-f005-4ee1-863d-a5063046587b req-2ecf3f29-a5c3-4e3f-bea2-8d139153e83f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56baa57-5713-488a-9d14-cb60e7543654", "name": "network-vif-deleted", "tag": "097211cd-e316-4a04-9413-e6262141b61b"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:36.768745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3250aa1b-a2a0-46a5-96ae-f9e1d6067809 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:36.769307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3250aa1b-a2a0-46a5-96ae-f9e1d6067809 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:36.803982 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-859bd11e-f005-4ee1-863d-a5063046587b req-2ecf3f29-a5c3-4e3f-bea2-8d139153e83f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:36.808714 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-859bd11e-f005-4ee1-863d-a5063046587b req-2ecf3f29-a5c3-4e3f-bea2-8d139153e83f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:36.853896 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-859bd11e-f005-4ee1-863d-a5063046587b req-2ecf3f29-a5c3-4e3f-bea2-8d139153e83f service nova] Creating event network-vif-deleted:097211cd-e316-4a04-9413-e6262141b61b for instance c56baa57-5713-488a-9d14-cb60e7543654 on n-h1-826756-3 Jul 28 03:58:36.879044 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-859bd11e-f005-4ee1-863d-a5063046587b req-2ecf3f29-a5c3-4e3f-bea2-8d139153e83f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116704 Jul 28 03:58:36.882292 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2119/4737] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:36.888573 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2f12a22c-8cfd-4f23-9a34-8ddb515790cc tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:36.907614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2f12a22c-8cfd-4f23-9a34-8ddb515790cc tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:36.929183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f12a22c-8cfd-4f23-9a34-8ddb515790cc tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:36.930048 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f12a22c-8cfd-4f23-9a34-8ddb515790cc tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:36.931497 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f12a22c-8cfd-4f23-9a34-8ddb515790cc tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:36.932509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f12a22c-8cfd-4f23-9a34-8ddb515790cc tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:37.725936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2f12a22c-8cfd-4f23-9a34-8ddb515790cc tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:37.764222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2f12a22c-8cfd-4f23-9a34-8ddb515790cc tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:37.768475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2f12a22c-8cfd-4f23-9a34-8ddb515790cc tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:37.773311 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2f12a22c-8cfd-4f23-9a34-8ddb515790cc tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.887977 Jul 28 03:58:37.796455 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2120/4738] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:36 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:37.808228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3f03a74e-2cf4-41d2-8252-823b08d192b8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:37.808901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3f03a74e-2cf4-41d2-8252-823b08d192b8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:37.820687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3250aa1b-a2a0-46a5-96ae-f9e1d6067809 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:37.824253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f03a74e-2cf4-41d2-8252-823b08d192b8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:37.831241 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3250aa1b-a2a0-46a5-96ae-f9e1d6067809 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1502 microversion: 2.1 time: 1.111687 Jul 28 03:58:37.832646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f03a74e-2cf4-41d2-8252-823b08d192b8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:37.833766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f03a74e-2cf4-41d2-8252-823b08d192b8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:37.834396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3f03a74e-2cf4-41d2-8252-823b08d192b8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:37.839792 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2619/4739] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:36 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1502 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:58:37.867307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40fa0463-4398-477a-abb0-8c27d38cbd83 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:37.870692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40fa0463-4398-477a-abb0-8c27d38cbd83 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:37.898343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40fa0463-4398-477a-abb0-8c27d38cbd83 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:37.899024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40fa0463-4398-477a-abb0-8c27d38cbd83 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:37.901154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40fa0463-4398-477a-abb0-8c27d38cbd83 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:37.902777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40fa0463-4398-477a-abb0-8c27d38cbd83 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:38.059015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40fa0463-4398-477a-abb0-8c27d38cbd83 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:38.060521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40fa0463-4398-477a-abb0-8c27d38cbd83 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:38.061255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-40fa0463-4398-477a-abb0-8c27d38cbd83 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lazy-loading 'fault' on Instance uuid c56baa57-5713-488a-9d14-cb60e7543654 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:58:38.194172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40fa0463-4398-477a-abb0-8c27d38cbd83 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:38.208177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40fa0463-4398-477a-abb0-8c27d38cbd83 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:38.212692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40fa0463-4398-477a-abb0-8c27d38cbd83 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d2e71606e2b4d13aa991bf4fd7367da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f58c45a3aea94254bd0a33d571392445', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:38.221412 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40fa0463-4398-477a-abb0-8c27d38cbd83 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 200 len: 1352 microversion: 2.26 time: 0.376246 Jul 28 03:58:38.224466 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2620/4740] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:37 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 1352 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:38.506790 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3f03a74e-2cf4-41d2-8252-823b08d192b8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:38.548626 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3f03a74e-2cf4-41d2-8252-823b08d192b8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:38.563685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3f03a74e-2cf4-41d2-8252-823b08d192b8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:38.571695 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3f03a74e-2cf4-41d2-8252-823b08d192b8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 0.772052 Jul 28 03:58:38.598433 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2121/4741] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:37 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:38.809765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86099ef2-df54-44bc-b628-4a0e93995e45 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:38.811399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-86099ef2-df54-44bc-b628-4a0e93995e45 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:38.827488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86099ef2-df54-44bc-b628-4a0e93995e45 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:38.831239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86099ef2-df54-44bc-b628-4a0e93995e45 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:38.834063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86099ef2-df54-44bc-b628-4a0e93995e45 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:38.835093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86099ef2-df54-44bc-b628-4a0e93995e45 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:38.867625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2a738272-68b2-47db-bce0-0e48c2aceae8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:38.869046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2a738272-68b2-47db-bce0-0e48c2aceae8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:38.880760 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a738272-68b2-47db-bce0-0e48c2aceae8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:38.881211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a738272-68b2-47db-bce0-0e48c2aceae8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:38.882002 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a738272-68b2-47db-bce0-0e48c2aceae8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:38.884992 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a738272-68b2-47db-bce0-0e48c2aceae8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:39.648084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2a738272-68b2-47db-bce0-0e48c2aceae8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:39.668060 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2a738272-68b2-47db-bce0-0e48c2aceae8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.805347 Jul 28 03:58:39.671750 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2122/4742] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:38 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:58:39.680550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e02a253d-ba2e-4889-9320-2776d6825242 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:39.684144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e02a253d-ba2e-4889-9320-2776d6825242 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] [instance: c56baa57-5713-488a-9d14-cb60e7543654] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:39.703620 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e02a253d-ba2e-4889-9320-2776d6825242 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:39.713206 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e02a253d-ba2e-4889-9320-2776d6825242 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:39.725993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e02a253d-ba2e-4889-9320-2776d6825242 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:39.726761 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e02a253d-ba2e-4889-9320-2776d6825242 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:39.775382 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-e02a253d-ba2e-4889-9320-2776d6825242 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] HTTP exception thrown: Instance c56baa57-5713-488a-9d14-cb60e7543654 could not be found. Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e02a253d-ba2e-4889-9320-2776d6825242 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Request method failure captured: Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 HTTP/1.1 Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gk_o8BL_aO3Emw41QZJkQ6bVXGoly7En1hwvFcI1gWAVaXpP-KPMIrOU_tarjgWSCTUefn4Zn3ze6wpsnGq1pFyqGeboiQ0LO22OUu3PJ72vNOkZE0tdxi4BtuA_poQlXEpbDunx2kkV-QqycnV5xcpU2PYcIrC18N25d9J2iVf0Jw Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Openstack-Nova-Api-Version: 2.26 Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: f58c45a3aea94254bd0a33d571392445 Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerTagsTestJSON-110995347 Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f58c45a3aea94254bd0a33d571392445"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f58c45a3aea94254bd0a33d571392445"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f58c45a3aea94254bd0a33d571392445"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f58c45a3aea94254bd0a33d571392445"}]}] Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerTagsTestJSON-110995347 Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: f58c45a3aea94254bd0a33d571392445 Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerTagsTestJSON-110995347 Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerTagsTestJSON-110995347-project Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 6d2e71606e2b4d13aa991bf4fd7367da Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerTagsTestJSON-110995347-project Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance c56baa57-5713-488a-9d14-cb60e7543654 could not be found. Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'c56baa57-5713-488a-9d14-cb60e7543654'} Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56baa57-5713-488a-9d14-cb60e7543654 could not be found. Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56baa57-5713-488a-9d14-cb60e7543654 could not be found. Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:39.786917 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:39.797754 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:39.797754 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:39.797754 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:39.797754 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:39.797754 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:39.797754 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56baa57-5713-488a-9d14-cb60e7543654 could not be found. Jul 28 03:58:39.797754 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:39.797754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e02a253d-ba2e-4889-9320-2776d6825242 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] Returning 404 to user: Instance c56baa57-5713-488a-9d14-cb60e7543654 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:39.797754 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e02a253d-ba2e-4889-9320-2776d6825242 tempest-ServerTagsTestJSON-110995347 tempest-ServerTagsTestJSON-110995347-project] 10.222.0.48 "GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654" status: 404 len: 111 microversion: 2.26 time: 0.114041 Jul 28 03:58:39.797754 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2123/4743] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:39 2022] GET /compute/v2.1/servers/c56baa57-5713-488a-9d14-cb60e7543654 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:58:39.804303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2ccbd3a4-fee8-4ba7-b5dd-ea5b30041d4c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:39.825654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2ccbd3a4-fee8-4ba7-b5dd-ea5b30041d4c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:39.843479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-86099ef2-df54-44bc-b628-4a0e93995e45 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:39.846001 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ccbd3a4-fee8-4ba7-b5dd-ea5b30041d4c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:39.851744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ccbd3a4-fee8-4ba7-b5dd-ea5b30041d4c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:39.852817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ccbd3a4-fee8-4ba7-b5dd-ea5b30041d4c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:39.853547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ccbd3a4-fee8-4ba7-b5dd-ea5b30041d4c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:39.877704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-86099ef2-df54-44bc-b628-4a0e93995e45 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:39.885814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-86099ef2-df54-44bc-b628-4a0e93995e45 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:39.891121 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-86099ef2-df54-44bc-b628-4a0e93995e45 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 1.086671 Jul 28 03:58:39.891842 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2621/4744] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:38 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:39.919262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fc898975-37bd-4ef5-93fd-b7426627a67e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:39.919901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fc898975-37bd-4ef5-93fd-b7426627a67e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:39.927944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc898975-37bd-4ef5-93fd-b7426627a67e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:39.928461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc898975-37bd-4ef5-93fd-b7426627a67e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:39.933806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc898975-37bd-4ef5-93fd-b7426627a67e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:39.934408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fc898975-37bd-4ef5-93fd-b7426627a67e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:40.922079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc898975-37bd-4ef5-93fd-b7426627a67e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:40.938085 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fc898975-37bd-4ef5-93fd-b7426627a67e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 1.028794 Jul 28 03:58:40.938963 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2622/4745] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:39 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:40.944154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d0df5e24-4fd4-4ea4-a954-3c67db31352d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:40.944786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d0df5e24-4fd4-4ea4-a954-3c67db31352d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:40.952495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0df5e24-4fd4-4ea4-a954-3c67db31352d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:40.953239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0df5e24-4fd4-4ea4-a954-3c67db31352d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:40.954664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0df5e24-4fd4-4ea4-a954-3c67db31352d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:40.955155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0df5e24-4fd4-4ea4-a954-3c67db31352d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:40.985629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:41.095763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2ccbd3a4-fee8-4ba7-b5dd-ea5b30041d4c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:41.113128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2ccbd3a4-fee8-4ba7-b5dd-ea5b30041d4c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:41.116980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2ccbd3a4-fee8-4ba7-b5dd-ea5b30041d4c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:41.119144 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2ccbd3a4-fee8-4ba7-b5dd-ea5b30041d4c tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 1.321687 Jul 28 03:58:41.119923 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2124/4746] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:39 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:41.125121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1d05bbf7-f1d7-49ef-9857-bc2711592273 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:41.125888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1d05bbf7-f1d7-49ef-9857-bc2711592273 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 4c7a8905-7454-45e1-8977-0019c84e5ef4] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:41.133276 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-1d05bbf7-f1d7-49ef-9857-bc2711592273 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance 4c7a8905-7454-45e1-8977-0019c84e5ef4 could not be found. Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1d05bbf7-f1d7-49ef-9857-bc2711592273 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/4c7a8905-7454-45e1-8977-0019c84e5ef4/action HTTP/1.1 Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 15 Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: {"unpause": {}} Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 4c7a8905-7454-45e1-8977-0019c84e5ef4 could not be found. Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '4c7a8905-7454-45e1-8977-0019c84e5ef4', 'body': {'unpause': {}}} Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c7a8905-7454-45e1-8977-0019c84e5ef4 could not be found. Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c7a8905-7454-45e1-8977-0019c84e5ef4 could not be found. Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:41.135348 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:41.140924 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:41.140924 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:41.140924 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c7a8905-7454-45e1-8977-0019c84e5ef4 could not be found. Jul 28 03:58:41.140924 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:41.142596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1d05bbf7-f1d7-49ef-9857-bc2711592273 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance 4c7a8905-7454-45e1-8977-0019c84e5ef4 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:41.143812 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1d05bbf7-f1d7-49ef-9857-bc2711592273 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/4c7a8905-7454-45e1-8977-0019c84e5ef4/action" status: 404 len: 111 microversion: 2.1 time: 0.022604 Jul 28 03:58:41.145071 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2125/4747] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:58:41 2022] POST /compute/v2.1/servers/4c7a8905-7454-45e1-8977-0019c84e5ef4/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:58:41.158695 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-415fc865-1ac6-411a-bb26-86df9a01f822 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:41.159920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-415fc865-1ac6-411a-bb26-86df9a01f822 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:41.171689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-415fc865-1ac6-411a-bb26-86df9a01f822 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:41.173160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-415fc865-1ac6-411a-bb26-86df9a01f822 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:41.174131 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-415fc865-1ac6-411a-bb26-86df9a01f822 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:41.174860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-415fc865-1ac6-411a-bb26-86df9a01f822 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:41.613710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d0df5e24-4fd4-4ea4-a954-3c67db31352d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:41.624053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-415fc865-1ac6-411a-bb26-86df9a01f822 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:41.635901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d0df5e24-4fd4-4ea4-a954-3c67db31352d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:41.637474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d0df5e24-4fd4-4ea4-a954-3c67db31352d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:41.638656 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d0df5e24-4fd4-4ea4-a954-3c67db31352d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.698486 Jul 28 03:58:41.639259 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2623/4748] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:40 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:41.654886 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-415fc865-1ac6-411a-bb26-86df9a01f822 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.500605 Jul 28 03:58:41.660259 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2126/4749] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:41 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:41.685934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a2261ee-4df8-4122-94d6-49584bfab18e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:41.686571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8a2261ee-4df8-4122-94d6-49584bfab18e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:41.694460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a2261ee-4df8-4122-94d6-49584bfab18e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:41.694914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a2261ee-4df8-4122-94d6-49584bfab18e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:41.705639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a2261ee-4df8-4122-94d6-49584bfab18e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:41.706586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a2261ee-4df8-4122-94d6-49584bfab18e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:42.092712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a2261ee-4df8-4122-94d6-49584bfab18e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:42.105016 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a2261ee-4df8-4122-94d6-49584bfab18e tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.422924 Jul 28 03:58:42.137726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d6ba85d4-7b1b-4fa1-a914-ee63571ff917 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:42.138254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d6ba85d4-7b1b-4fa1-a914-ee63571ff917 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:42.143121 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2624/4750] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:41 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:42.154669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1fb63aa0-7115-4ff7-93cd-dee18a6d0a85 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:42.157142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1fb63aa0-7115-4ff7-93cd-dee18a6d0a85 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:42.160339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6ba85d4-7b1b-4fa1-a914-ee63571ff917 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:42.160929 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6ba85d4-7b1b-4fa1-a914-ee63571ff917 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:42.164743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6ba85d4-7b1b-4fa1-a914-ee63571ff917 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:42.168242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6ba85d4-7b1b-4fa1-a914-ee63571ff917 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:42.177440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fb63aa0-7115-4ff7-93cd-dee18a6d0a85 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:42.178153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fb63aa0-7115-4ff7-93cd-dee18a6d0a85 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:42.180629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fb63aa0-7115-4ff7-93cd-dee18a6d0a85 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:42.185444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fb63aa0-7115-4ff7-93cd-dee18a6d0a85 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:42.238667 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-d6ba85d4-7b1b-4fa1-a914-ee63571ff917 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Cannot 'unpause' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d6ba85d4-7b1b-4fa1-a914-ee63571ff917 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action HTTP/1.1 Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 15 Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: {"unpause": {}} Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: exception: Cannot 'unpause' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '1d97b518-6a6e-44f8-9be3-940b6fa8c853', 'body': {'unpause': {}}} Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 in vm_state active. Cannot unpause while the instance is in this state. Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:42.244483 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:42.249849 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:42.249849 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:42.249849 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:42.249849 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:58:42.249849 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:42.249849 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d6ba85d4-7b1b-4fa1-a914-ee63571ff917 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 409 to user: Cannot 'unpause' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:42.249849 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d6ba85d4-7b1b-4fa1-a914-ee63571ff917 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action" status: 409 len: 145 microversion: 2.1 time: 0.117187 Jul 28 03:58:42.249849 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2127/4751] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:58:42 2022] POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action => generated 145 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 28 03:58:42.263788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-6e00a0b4-1d55-439a-bd03-250c0cf76019 req-7d6cc3af-800d-4a67-a002-bd5d32b888ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-plugged", "status": "completed", "tag": "38bf4b83-740e-43e2-b390-d6fec119fa7f"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:42.286024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-6e00a0b4-1d55-439a-bd03-250c0cf76019 req-7d6cc3af-800d-4a67-a002-bd5d32b888ec service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:42.286467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-6e00a0b4-1d55-439a-bd03-250c0cf76019 req-7d6cc3af-800d-4a67-a002-bd5d32b888ec service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:42.313882 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-6e00a0b4-1d55-439a-bd03-250c0cf76019 req-7d6cc3af-800d-4a67-a002-bd5d32b888ec service nova] Creating event network-vif-plugged:38bf4b83-740e-43e2-b390-d6fec119fa7f for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:58:42.330560 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-6e00a0b4-1d55-439a-bd03-250c0cf76019 req-7d6cc3af-800d-4a67-a002-bd5d32b888ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081354 Jul 28 03:58:42.335759 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2128/4752] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:42.350457 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a437a0b0-ca1f-4cf2-80ff-6bd2e6b2fab8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:42.355271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a437a0b0-ca1f-4cf2-80ff-6bd2e6b2fab8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:42.368830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a437a0b0-ca1f-4cf2-80ff-6bd2e6b2fab8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:42.369286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a437a0b0-ca1f-4cf2-80ff-6bd2e6b2fab8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:42.374357 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a437a0b0-ca1f-4cf2-80ff-6bd2e6b2fab8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:42.374818 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a437a0b0-ca1f-4cf2-80ff-6bd2e6b2fab8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:42.858523 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a437a0b0-ca1f-4cf2-80ff-6bd2e6b2fab8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:42.881864 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a437a0b0-ca1f-4cf2-80ff-6bd2e6b2fab8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.535708 Jul 28 03:58:42.882567 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2129/4753] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:42 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:42.901773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bbce5370-4adf-42c6-8eef-b46b87432640 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:42.902435 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bbce5370-4adf-42c6-8eef-b46b87432640 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:42.921376 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bbce5370-4adf-42c6-8eef-b46b87432640 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:42.921976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bbce5370-4adf-42c6-8eef-b46b87432640 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:42.922979 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bbce5370-4adf-42c6-8eef-b46b87432640 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:42.923710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bbce5370-4adf-42c6-8eef-b46b87432640 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:43.263198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1fb63aa0-7115-4ff7-93cd-dee18a6d0a85 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:43.283393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1fb63aa0-7115-4ff7-93cd-dee18a6d0a85 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:43.285292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1fb63aa0-7115-4ff7-93cd-dee18a6d0a85 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:43.286510 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1fb63aa0-7115-4ff7-93cd-dee18a6d0a85 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 1.142091 Jul 28 03:58:43.287089 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2625/4754] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:42 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:43.295779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c26667f-daad-468f-858d-8c579870f86c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:43.299798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c26667f-daad-468f-858d-8c579870f86c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:43.314922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c26667f-daad-468f-858d-8c579870f86c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:43.315375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c26667f-daad-468f-858d-8c579870f86c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:43.316465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c26667f-daad-468f-858d-8c579870f86c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:43.316895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c26667f-daad-468f-858d-8c579870f86c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:43.473872 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bbce5370-4adf-42c6-8eef-b46b87432640 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:43.491259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bbce5370-4adf-42c6-8eef-b46b87432640 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:43.493283 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bbce5370-4adf-42c6-8eef-b46b87432640 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:43.498077 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bbce5370-4adf-42c6-8eef-b46b87432640 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.609091 Jul 28 03:58:43.499216 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2130/4755] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:42 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:43.821407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c26667f-daad-468f-858d-8c579870f86c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:43.831246 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c26667f-daad-468f-858d-8c579870f86c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.542993 Jul 28 03:58:43.831843 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2626/4756] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:43 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:43.852118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-85639ccf-1cd6-419c-be18-5f3f2adf5a8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:43.852936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-85639ccf-1cd6-419c-be18-5f3f2adf5a8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: af9fdfc8-e099-4728-a5b5-060c65225390] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:43.860295 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-85639ccf-1cd6-419c-be18-5f3f2adf5a8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance af9fdfc8-e099-4728-a5b5-060c65225390 could not be found. Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-85639ccf-1cd6-419c-be18-5f3f2adf5a8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/af9fdfc8-e099-4728-a5b5-060c65225390/action HTTP/1.1 Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 18 Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: {"unshelve": null} Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance af9fdfc8-e099-4728-a5b5-060c65225390 could not be found. Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'af9fdfc8-e099-4728-a5b5-060c65225390', 'body': {'unshelve': None}} Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af9fdfc8-e099-4728-a5b5-060c65225390 could not be found. Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af9fdfc8-e099-4728-a5b5-060c65225390 could not be found. Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:43.865421 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:43.870336 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:43.870336 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:43.870336 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:43.870336 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:43.870336 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:43.870336 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:43.870336 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af9fdfc8-e099-4728-a5b5-060c65225390 could not be found. Jul 28 03:58:43.870336 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:43.870336 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-85639ccf-1cd6-419c-be18-5f3f2adf5a8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance af9fdfc8-e099-4728-a5b5-060c65225390 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:43.870336 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-85639ccf-1cd6-419c-be18-5f3f2adf5a8d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/af9fdfc8-e099-4728-a5b5-060c65225390/action" status: 404 len: 111 microversion: 2.1 time: 0.022322 Jul 28 03:58:43.872069 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2131/4757] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:58:43 2022] POST /compute/v2.1/servers/af9fdfc8-e099-4728-a5b5-060c65225390/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:58:43.881465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-883b536e-7897-4008-b7ac-1e43df0b1cef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:43.883896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-883b536e-7897-4008-b7ac-1e43df0b1cef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:43.898292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-883b536e-7897-4008-b7ac-1e43df0b1cef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:43.898988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-883b536e-7897-4008-b7ac-1e43df0b1cef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:43.900286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-883b536e-7897-4008-b7ac-1e43df0b1cef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:43.901225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-883b536e-7897-4008-b7ac-1e43df0b1cef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:44.260612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-883b536e-7897-4008-b7ac-1e43df0b1cef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:44.280513 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-883b536e-7897-4008-b7ac-1e43df0b1cef tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.400653 Jul 28 03:58:44.282894 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2627/4758] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:43 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:44.305296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ea9bc861-7cc1-4db5-a6f2-1e0f2f544cd1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:44.309539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ea9bc861-7cc1-4db5-a6f2-1e0f2f544cd1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:44.311709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eeb891eb-8594-4309-b56d-2d02c99e9c1a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:44.312332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eeb891eb-8594-4309-b56d-2d02c99e9c1a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:44.324651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eeb891eb-8594-4309-b56d-2d02c99e9c1a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:44.325108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eeb891eb-8594-4309-b56d-2d02c99e9c1a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:44.325903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eeb891eb-8594-4309-b56d-2d02c99e9c1a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:44.326338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eeb891eb-8594-4309-b56d-2d02c99e9c1a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:44.613188 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea9bc861-7cc1-4db5-a6f2-1e0f2f544cd1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:44.613720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea9bc861-7cc1-4db5-a6f2-1e0f2f544cd1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:44.614530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea9bc861-7cc1-4db5-a6f2-1e0f2f544cd1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:44.614808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea9bc861-7cc1-4db5-a6f2-1e0f2f544cd1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:45.070784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eeb891eb-8594-4309-b56d-2d02c99e9c1a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:45.090600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eeb891eb-8594-4309-b56d-2d02c99e9c1a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:45.093422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eeb891eb-8594-4309-b56d-2d02c99e9c1a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:45.094926 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eeb891eb-8594-4309-b56d-2d02c99e9c1a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 0.788525 Jul 28 03:58:45.111803 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2628/4759] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:44 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:45.119796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0e107ea7-de26-4997-b7ea-5abd22fd96ed req-5cf3b1ed-20f2-495a-a610-3c7288a75f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-plugged", "status": "completed", "tag": "8d43bc33-8f3a-406e-99fa-b66c536b9ca4"}, {"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-plugged", "status": "completed", "tag": "64c0dac1-8c71-4869-8d21-34d221428489"}, {"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-plugged", "status": "completed", "tag": "50bb8633-534f-4450-8396-9a18c45b70b2"}, {"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-plugged", "status": "completed", "tag": "34b7d23e-2c19-42f4-9d5c-35c32bdd3b9a"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:45.143723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0e107ea7-de26-4997-b7ea-5abd22fd96ed req-5cf3b1ed-20f2-495a-a610-3c7288a75f1e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:45.144819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0e107ea7-de26-4997-b7ea-5abd22fd96ed req-5cf3b1ed-20f2-495a-a610-3c7288a75f1e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:45.164561 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0e107ea7-de26-4997-b7ea-5abd22fd96ed req-5cf3b1ed-20f2-495a-a610-3c7288a75f1e service nova] Creating event network-vif-plugged:8d43bc33-8f3a-406e-99fa-b66c536b9ca4 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:58:45.165755 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0e107ea7-de26-4997-b7ea-5abd22fd96ed req-5cf3b1ed-20f2-495a-a610-3c7288a75f1e service nova] Creating event network-vif-plugged:64c0dac1-8c71-4869-8d21-34d221428489 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:58:45.166591 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0e107ea7-de26-4997-b7ea-5abd22fd96ed req-5cf3b1ed-20f2-495a-a610-3c7288a75f1e service nova] Creating event network-vif-plugged:50bb8633-534f-4450-8396-9a18c45b70b2 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:58:45.167462 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0e107ea7-de26-4997-b7ea-5abd22fd96ed req-5cf3b1ed-20f2-495a-a610-3c7288a75f1e service nova] Creating event network-vif-plugged:34b7d23e-2c19-42f4-9d5c-35c32bdd3b9a for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:58:45.175198 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0e107ea7-de26-4997-b7ea-5abd22fd96ed req-5cf3b1ed-20f2-495a-a610-3c7288a75f1e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.060911 Jul 28 03:58:45.176582 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2629/4760] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:45.182806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-427ab7d4-6660-4486-9e31-afa12ddb7ea3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:45.184110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-427ab7d4-6660-4486-9e31-afa12ddb7ea3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:45.191614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-427ab7d4-6660-4486-9e31-afa12ddb7ea3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:45.192616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-427ab7d4-6660-4486-9e31-afa12ddb7ea3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:45.193981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-427ab7d4-6660-4486-9e31-afa12ddb7ea3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:45.194639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-427ab7d4-6660-4486-9e31-afa12ddb7ea3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:45.585495 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ea9bc861-7cc1-4db5-a6f2-1e0f2f544cd1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:45.600863 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ea9bc861-7cc1-4db5-a6f2-1e0f2f544cd1 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 1.300453 Jul 28 03:58:45.618571 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2132/4761] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:44 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:45.629383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4f5d0386-7227-4a31-881b-44414d3ace9f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:45.630338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4f5d0386-7227-4a31-881b-44414d3ace9f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:45.638357 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f5d0386-7227-4a31-881b-44414d3ace9f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:45.639168 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f5d0386-7227-4a31-881b-44414d3ace9f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:45.640202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f5d0386-7227-4a31-881b-44414d3ace9f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:45.640882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f5d0386-7227-4a31-881b-44414d3ace9f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:45.669938 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-4f5d0386-7227-4a31-881b-44414d3ace9f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Cannot 'unshelve' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4f5d0386-7227-4a31-881b-44414d3ace9f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action HTTP/1.1 Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 18 Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: {"unshelve": null} Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: exception: Cannot 'unshelve' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '1d97b518-6a6e-44f8-9be3-940b6fa8c853', 'body': {'unshelve': None}} Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 376, in inner Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 in vm_state active. Cannot unshelve while the instance is in this state. Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 03:58:45.672722 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 03:58:45.676677 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:58:45.676677 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:45.676677 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:45.676677 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:45.676677 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:45.676677 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:45.676677 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:45.676677 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:45.676677 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:45.676677 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active Jul 28 03:58:45.676677 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:45.679898 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4f5d0386-7227-4a31-881b-44414d3ace9f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 409 to user: Cannot 'unshelve' instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 while it is in vm_state active {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:45.681037 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4f5d0386-7227-4a31-881b-44414d3ace9f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action" status: 409 len: 146 microversion: 2.1 time: 0.056819 Jul 28 03:58:45.685573 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2133/4762] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:58:45 2022] POST /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853/action => generated 146 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 03:58:45.692082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9b97d6eb-6d79-42c1-b328-30f55040f20c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:45.693060 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9b97d6eb-6d79-42c1-b328-30f55040f20c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:45.700561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9b97d6eb-6d79-42c1-b328-30f55040f20c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:45.701369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9b97d6eb-6d79-42c1-b328-30f55040f20c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:45.702374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9b97d6eb-6d79-42c1-b328-30f55040f20c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:45.703041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9b97d6eb-6d79-42c1-b328-30f55040f20c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:46.238767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9b97d6eb-6d79-42c1-b328-30f55040f20c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:46.248222 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9b97d6eb-6d79-42c1-b328-30f55040f20c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.561213 Jul 28 03:58:46.255973 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2134/4763] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:45 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:46.269004 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4270f010-8aa9-42d7-8554-abb70ceafebb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:46.269854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4270f010-8aa9-42d7-8554-abb70ceafebb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:46.288811 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4270f010-8aa9-42d7-8554-abb70ceafebb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:46.289732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4270f010-8aa9-42d7-8554-abb70ceafebb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:46.290789 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4270f010-8aa9-42d7-8554-abb70ceafebb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:46.291644 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4270f010-8aa9-42d7-8554-abb70ceafebb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:46.323280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-427ab7d4-6660-4486-9e31-afa12ddb7ea3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:46.357952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-427ab7d4-6660-4486-9e31-afa12ddb7ea3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:46.365624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-427ab7d4-6660-4486-9e31-afa12ddb7ea3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:46.370372 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-427ab7d4-6660-4486-9e31-afa12ddb7ea3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 1.191573 Jul 28 03:58:46.373600 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2630/4764] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:45 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:46.393551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3c8baaab-be80-4268-829f-76919932a433 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:46.395622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3c8baaab-be80-4268-829f-76919932a433 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:46.410843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c8baaab-be80-4268-829f-76919932a433 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:46.414575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c8baaab-be80-4268-829f-76919932a433 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:46.415459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c8baaab-be80-4268-829f-76919932a433 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:46.415893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c8baaab-be80-4268-829f-76919932a433 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:46.693929 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4270f010-8aa9-42d7-8554-abb70ceafebb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:46.712813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4270f010-8aa9-42d7-8554-abb70ceafebb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:46.721774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4270f010-8aa9-42d7-8554-abb70ceafebb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:46.730454 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4270f010-8aa9-42d7-8554-abb70ceafebb tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 0.470693 Jul 28 03:58:46.747900 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2135/4765] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:46 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:47.284444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-a43a038b-44ce-47e3-b6c0-ede1f7719118 req-ced417fc-a45d-48ef-97ba-41422e21711d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-plugged", "status": "completed", "tag": "be6e42cc-90f4-4e57-8cd7-6338a1670214"}, {"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-plugged", "status": "completed", "tag": "c99034ef-97e5-4be0-9e5c-c75bd4555ab6"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:47.313804 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a43a038b-44ce-47e3-b6c0-ede1f7719118 req-ced417fc-a45d-48ef-97ba-41422e21711d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:47.314265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-a43a038b-44ce-47e3-b6c0-ede1f7719118 req-ced417fc-a45d-48ef-97ba-41422e21711d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:47.343444 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-a43a038b-44ce-47e3-b6c0-ede1f7719118 req-ced417fc-a45d-48ef-97ba-41422e21711d service nova] Creating event network-vif-plugged:be6e42cc-90f4-4e57-8cd7-6338a1670214 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:58:47.345308 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-a43a038b-44ce-47e3-b6c0-ede1f7719118 req-ced417fc-a45d-48ef-97ba-41422e21711d service nova] Creating event network-vif-plugged:c99034ef-97e5-4be0-9e5c-c75bd4555ab6 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:58:47.359227 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-a43a038b-44ce-47e3-b6c0-ede1f7719118 req-ced417fc-a45d-48ef-97ba-41422e21711d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077996 Jul 28 03:58:47.362582 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2136/4766] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:47.397909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9ca4b051-ea45-42cb-a286-3fbd0359bae8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:47.399050 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9ca4b051-ea45-42cb-a286-3fbd0359bae8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:47.410933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9ca4b051-ea45-42cb-a286-3fbd0359bae8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:47.425530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9ca4b051-ea45-42cb-a286-3fbd0359bae8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:47.427245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9ca4b051-ea45-42cb-a286-3fbd0359bae8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:47.427874 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9ca4b051-ea45-42cb-a286-3fbd0359bae8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:47.468002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3c8baaab-be80-4268-829f-76919932a433 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:47.481468 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3c8baaab-be80-4268-829f-76919932a433 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 1.101355 Jul 28 03:58:47.484306 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2631/4767] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:46 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:47.505883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a265709-16d7-4687-89da-b03b512a75cf tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-501943993_updated"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:47.513172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7a265709-16d7-4687-89da-b03b512a75cf tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 4d211898-0c6c-452f-b381-b221b9c5d79d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:47.537841 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-7a265709-16d7-4687-89da-b03b512a75cf tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance 4d211898-0c6c-452f-b381-b221b9c5d79d could not be found. Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a265709-16d7-4687-89da-b03b512a75cf tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: request: PUT /compute/v2.1/servers/4d211898-0c6c-452f-b381-b221b9c5d79d HTTP/1.1 Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 80 Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-501943993_updated"}} Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 4d211898-0c6c-452f-b381-b221b9c5d79d could not be found. Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '4d211898-0c6c-452f-b381-b221b9c5d79d', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-501943993_updated'}}} Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d211898-0c6c-452f-b381-b221b9c5d79d could not be found. Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 28 03:58:47.540187 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:58:47.544942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:58:47.544942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:58:47.544942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:58:47.544942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d211898-0c6c-452f-b381-b221b9c5d79d could not be found. Jul 28 03:58:47.544942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:47.544942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:47.544942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:47.544942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:47.544942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:47.544942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:47.544942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:58:47.544942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:58:47.544942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d211898-0c6c-452f-b381-b221b9c5d79d could not be found. Jul 28 03:58:47.544942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:47.549366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a265709-16d7-4687-89da-b03b512a75cf tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance 4d211898-0c6c-452f-b381-b221b9c5d79d could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:47.551175 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7a265709-16d7-4687-89da-b03b512a75cf tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "PUT /compute/v2.1/servers/4d211898-0c6c-452f-b381-b221b9c5d79d" status: 404 len: 111 microversion: 2.1 time: 0.049515 Jul 28 03:58:47.557781 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2632/4768] 10.222.0.48 () {60 vars in 1256 bytes} [Thu Jul 28 03:58:47 2022] PUT /compute/v2.1/servers/4d211898-0c6c-452f-b381-b221b9c5d79d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:58:47.568593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1619e76-f751-463f-8dd3-4360ccbc20ab tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:47.569217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1619e76-f751-463f-8dd3-4360ccbc20ab tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:47.582312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1619e76-f751-463f-8dd3-4360ccbc20ab tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:47.582769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1619e76-f751-463f-8dd3-4360ccbc20ab tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:47.583556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1619e76-f751-463f-8dd3-4360ccbc20ab tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:47.584000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1619e76-f751-463f-8dd3-4360ccbc20ab tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:48.066798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b1619e76-f751-463f-8dd3-4360ccbc20ab tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:48.084801 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1619e76-f751-463f-8dd3-4360ccbc20ab tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.522081 Jul 28 03:58:48.090562 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2633/4769] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:47 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:48.101332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2527cf2d-4348-48da-a28a-e17257cd7929 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:48.104932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2527cf2d-4348-48da-a28a-e17257cd7929 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:48.121021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:48.124127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2527cf2d-4348-48da-a28a-e17257cd7929 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:48.127364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2527cf2d-4348-48da-a28a-e17257cd7929 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:48.127364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2527cf2d-4348-48da-a28a-e17257cd7929 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:48.127364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2527cf2d-4348-48da-a28a-e17257cd7929 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:48.350873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9ca4b051-ea45-42cb-a286-3fbd0359bae8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:48.361013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9ca4b051-ea45-42cb-a286-3fbd0359bae8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:48.362730 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9ca4b051-ea45-42cb-a286-3fbd0359bae8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:48.363848 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9ca4b051-ea45-42cb-a286-3fbd0359bae8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.970770 Jul 28 03:58:48.380789 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2137/4770] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:47 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:48.393053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-45d3cb49-d7cd-41c3-8234-5f4248b93f5b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:48.402041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-45d3cb49-d7cd-41c3-8234-5f4248b93f5b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:48.421571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-45d3cb49-d7cd-41c3-8234-5f4248b93f5b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:48.422020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-45d3cb49-d7cd-41c3-8234-5f4248b93f5b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:48.423311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-45d3cb49-d7cd-41c3-8234-5f4248b93f5b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:48.426470 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-45d3cb49-d7cd-41c3-8234-5f4248b93f5b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:48.793855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2527cf2d-4348-48da-a28a-e17257cd7929 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:48.816220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2527cf2d-4348-48da-a28a-e17257cd7929 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:48.822606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2527cf2d-4348-48da-a28a-e17257cd7929 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:48.834213 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2527cf2d-4348-48da-a28a-e17257cd7929 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 0.742159 Jul 28 03:58:48.835144 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2634/4771] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:48 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:49.245949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-45d3cb49-d7cd-41c3-8234-5f4248b93f5b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:49.262878 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-45d3cb49-d7cd-41c3-8234-5f4248b93f5b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.880697 Jul 28 03:58:49.280382 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2138/4772] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:48 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:49.288912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2faab773-a54c-4f9c-a077-b39ac229e939 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2faab773-a54c-4f9c-a077-b39ac229e939 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: request: PUT /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 HTTP/1.1 Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 280 Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1d97b518-6a6e-44f8-9be3-940b6fa8c853', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:49.294037 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 28 03:58:49.297474 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:58:49.305072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2faab773-a54c-4f9c-a077-b39ac229e939 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:49.306416 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2faab773-a54c-4f9c-a077-b39ac229e939 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "PUT /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 400 len: 619 microversion: 2.1 time: 0.021658 Jul 28 03:58:49.307360 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2635/4773] 10.222.0.48 () {60 vars in 1257 bytes} [Thu Jul 28 03:58:49 2022] PUT /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:58:49.347630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5fa9da96-d3c3-4df4-97ff-0e068473216c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:49.350304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5fa9da96-d3c3-4df4-97ff-0e068473216c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:49.372498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5fa9da96-d3c3-4df4-97ff-0e068473216c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:49.376676 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5fa9da96-d3c3-4df4-97ff-0e068473216c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:49.379506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5fa9da96-d3c3-4df4-97ff-0e068473216c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:49.380227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5fa9da96-d3c3-4df4-97ff-0e068473216c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:49.394383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-680c8df0-e68b-4ca4-b4ab-5d33306e5e46 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:49.395278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-680c8df0-e68b-4ca4-b4ab-5d33306e5e46 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:49.397705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:58:49.415263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-680c8df0-e68b-4ca4-b4ab-5d33306e5e46 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:49.417935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-680c8df0-e68b-4ca4-b4ab-5d33306e5e46 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:49.418985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-680c8df0-e68b-4ca4-b4ab-5d33306e5e46 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:49.422295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-680c8df0-e68b-4ca4-b4ab-5d33306e5e46 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:50.026722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-680c8df0-e68b-4ca4-b4ab-5d33306e5e46 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:50.047202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-680c8df0-e68b-4ca4-b4ab-5d33306e5e46 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:50.057228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-680c8df0-e68b-4ca4-b4ab-5d33306e5e46 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:50.058517 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-680c8df0-e68b-4ca4-b4ab-5d33306e5e46 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1879 microversion: 2.32 time: 0.669477 Jul 28 03:58:50.073231 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2636/4774] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:49 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1879 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:50.087174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3be2193a-2aa5-49fa-886d-899a0f15f386 req-701a3b42-2c6f-4d95-bc1e-3e4ab56a5ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8", "name": "network-vif-plugged", "status": "completed", "tag": "565bb390-f25a-4510-b22a-3975e600ba96"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:50.098774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3be2193a-2aa5-49fa-886d-899a0f15f386 req-701a3b42-2c6f-4d95-bc1e-3e4ab56a5ead service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:50.099228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3be2193a-2aa5-49fa-886d-899a0f15f386 req-701a3b42-2c6f-4d95-bc1e-3e4ab56a5ead service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:50.112895 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3be2193a-2aa5-49fa-886d-899a0f15f386 req-701a3b42-2c6f-4d95-bc1e-3e4ab56a5ead service nova] Creating event network-vif-plugged:565bb390-f25a-4510-b22a-3975e600ba96 for instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 on n-h1-826756-3 Jul 28 03:58:50.120099 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5fa9da96-d3c3-4df4-97ff-0e068473216c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:50.125862 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3be2193a-2aa5-49fa-886d-899a0f15f386 req-701a3b42-2c6f-4d95-bc1e-3e4ab56a5ead service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050882 Jul 28 03:58:50.127439 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2637/4775] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:50.133036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5bd712ef-a90f-466e-849d-ea24b6f5c287 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:50.133755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5bd712ef-a90f-466e-849d-ea24b6f5c287 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:50.145278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5bd712ef-a90f-466e-849d-ea24b6f5c287 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:50.145774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5bd712ef-a90f-466e-849d-ea24b6f5c287 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:50.146597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5bd712ef-a90f-466e-849d-ea24b6f5c287 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:50.147044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5bd712ef-a90f-466e-849d-ea24b6f5c287 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:50.165185 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5fa9da96-d3c3-4df4-97ff-0e068473216c tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.839787 Jul 28 03:58:50.165185 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2139/4776] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:49 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:50.198139 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1e0c4268-032d-484b-a6a0-48f7cded796d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:50.201599 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1e0c4268-032d-484b-a6a0-48f7cded796d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:50.222406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e0c4268-032d-484b-a6a0-48f7cded796d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:50.226635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e0c4268-032d-484b-a6a0-48f7cded796d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:50.230696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e0c4268-032d-484b-a6a0-48f7cded796d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:50.231581 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1e0c4268-032d-484b-a6a0-48f7cded796d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:50.614854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5bd712ef-a90f-466e-849d-ea24b6f5c287 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:50.656086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5bd712ef-a90f-466e-849d-ea24b6f5c287 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:50.664938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5bd712ef-a90f-466e-849d-ea24b6f5c287 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:50.669168 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5bd712ef-a90f-466e-849d-ea24b6f5c287 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 0.539630 Jul 28 03:58:50.670540 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2638/4777] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:50 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:51.043775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1e0c4268-032d-484b-a6a0-48f7cded796d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:51.066660 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1e0c4268-032d-484b-a6a0-48f7cded796d tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 0.882642 Jul 28 03:58:51.088563 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2140/4778] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:50 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:51.102179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a9ff60a9-88a3-47f2-820b-67a3ac58f087 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a9ff60a9-88a3-47f2-820b-67a3ac58f087 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: request: PUT /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 HTTP/1.1 Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 24 Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: {"server": {"name": ""}} Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '1d97b518-6a6e-44f8-9be3-940b6fa8c853', 'body': {'server': {'name': ''}}} Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi '' Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:58:51.115345 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 28 03:58:51.123052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:51.123052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:58:51.123052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:51.123052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:58:51.123052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:58:51.123052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:58:51.123052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:58:51.123052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:58:51.123052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 28 03:58:51.123052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:58:51.126768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a9ff60a9-88a3-47f2-820b-67a3ac58f087 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:58:51.130334 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a9ff60a9-88a3-47f2-820b-67a3ac58f087 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "PUT /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 400 len: 108 microversion: 2.1 time: 0.037044 Jul 28 03:58:51.137114 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2141/4779] 10.222.0.48 () {60 vars in 1256 bytes} [Thu Jul 28 03:58:51 2022] PUT /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 108 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:58:51.151002 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2a5cc717-349f-4e38-9de9-46daeebc94a3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:51.152287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2a5cc717-349f-4e38-9de9-46daeebc94a3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:51.170531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a5cc717-349f-4e38-9de9-46daeebc94a3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:51.171174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a5cc717-349f-4e38-9de9-46daeebc94a3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:51.174237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a5cc717-349f-4e38-9de9-46daeebc94a3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:51.177003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2a5cc717-349f-4e38-9de9-46daeebc94a3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:51.444015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e5e36dd4-5816-4880-b1d9-4b8de23bb579 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'create', calling method: .version_select at 0x7ffa66fced30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-72796757", "description": "tempest-description-1794286600"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:51.629879 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2a5cc717-349f-4e38-9de9-46daeebc94a3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:51.647996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2a5cc717-349f-4e38-9de9-46daeebc94a3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:51.650071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2a5cc717-349f-4e38-9de9-46daeebc94a3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:51.653200 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2a5cc717-349f-4e38-9de9-46daeebc94a3 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 2831 microversion: 2.32 time: 0.514306 Jul 28 03:58:51.654650 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2142/4780] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:51 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 2831 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:51.660890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8e5a5073-b0fc-43a4-86d7-36038fac54f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:51.661728 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8e5a5073-b0fc-43a4-86d7-36038fac54f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:51.670560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e5a5073-b0fc-43a4-86d7-36038fac54f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:51.671320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e5a5073-b0fc-43a4-86d7-36038fac54f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:51.672287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e5a5073-b0fc-43a4-86d7-36038fac54f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:51.673052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e5a5073-b0fc-43a4-86d7-36038fac54f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:52.565632 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e5e36dd4-5816-4880-b1d9-4b8de23bb579 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.572252 Jul 28 03:58:52.575030 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2639/4781] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:58:50 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:58:52.583329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0068eb24-495f-47f6-b7ae-c4488ff0a628 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:52.587033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0068eb24-495f-47f6-b7ae-c4488ff0a628 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:52.619538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0068eb24-495f-47f6-b7ae-c4488ff0a628 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:52.620160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0068eb24-495f-47f6-b7ae-c4488ff0a628 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:52.625917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0068eb24-495f-47f6-b7ae-c4488ff0a628 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:52.626543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0068eb24-495f-47f6-b7ae-c4488ff0a628 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:52.651748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8e5a5073-b0fc-43a4-86d7-36038fac54f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:52.671480 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8e5a5073-b0fc-43a4-86d7-36038fac54f2 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1505 microversion: 2.1 time: 1.005418 Jul 28 03:58:52.678492 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2143/4782] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:51 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1505 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:52.700099 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-764be64e-0956-465d-9712-7637668ccfd4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:52.700654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-764be64e-0956-465d-9712-7637668ccfd4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:52.724590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-764be64e-0956-465d-9712-7637668ccfd4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:52.729037 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-764be64e-0956-465d-9712-7637668ccfd4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:52.732567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-764be64e-0956-465d-9712-7637668ccfd4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:52.736475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-764be64e-0956-465d-9712-7637668ccfd4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:53.046132 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0068eb24-495f-47f6-b7ae-c4488ff0a628 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.468848 Jul 28 03:58:53.047711 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2640/4783] 10.222.0.48 () {60 vars in 1316 bytes} [Thu Jul 28 03:58:52 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579/os-interface => generated 1831 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:53.069307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97fa1276-4c2c-4f24-b003-d765ba288516 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'create', calling method: .version_select at 0x7ffa674be3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1382635483", "description": "tempest-description-1189271162"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:53.619085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-764be64e-0956-465d-9712-7637668ccfd4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:53.629039 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-764be64e-0956-465d-9712-7637668ccfd4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:53.637295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-764be64e-0956-465d-9712-7637668ccfd4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:53.647508 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-764be64e-0956-465d-9712-7637668ccfd4 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1733 microversion: 2.20 time: 0.965472 Jul 28 03:58:53.650914 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2144/4784] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:52 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1733 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:54.678646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-073e99ee-6d98-48b7-a6d9-40186d3ea0a2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:54.679256 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-073e99ee-6d98-48b7-a6d9-40186d3ea0a2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:54.693772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-073e99ee-6d98-48b7-a6d9-40186d3ea0a2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:54.694225 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-073e99ee-6d98-48b7-a6d9-40186d3ea0a2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:54.695288 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-073e99ee-6d98-48b7-a6d9-40186d3ea0a2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:54.695724 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-073e99ee-6d98-48b7-a6d9-40186d3ea0a2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:54.895154 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-97fa1276-4c2c-4f24-b003-d765ba288516 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.845766 Jul 28 03:58:54.904395 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2641/4785] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:58:53 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:55.196718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1289515814", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "b1c33403-2aff-4441-879e-fad31a228d8d"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:55.295873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] validate_networks() for [('b1c33403-2aff-4441-879e-fad31a228d8d', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:58:55.982101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-073e99ee-6d98-48b7-a6d9-40186d3ea0a2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:55.997057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-073e99ee-6d98-48b7-a6d9-40186d3ea0a2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:56.025180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-073e99ee-6d98-48b7-a6d9-40186d3ea0a2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:56.026846 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-073e99ee-6d98-48b7-a6d9-40186d3ea0a2 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1720 microversion: 2.20 time: 1.352743 Jul 28 03:58:56.041470 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2145/4786] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:58:54 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1720 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:58:57.241663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:58:57.242073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:58:57.242547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:58:57.242952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:58:57.243409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:58:57.261155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:57.265249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:57.266797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:57.267509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:57.326863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Getting quotas for project 684191c692c445ad92f5d76f10790418. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:58:57.341555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Getting quotas for user ada96f18e88f47b7b9c1994d0d7dbcaf and project 684191c692c445ad92f5d76f10790418. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:58:57.378103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:58:57.384231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:58:57.496373 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-61ce3bff-2ec1-46bd-8321-e61c17bc947c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.303534 Jul 28 03:58:57.499759 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2642/4787] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:58:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:58:57.510706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0264d33b-c009-4fa6-9406-cec4a60d0512 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:57.512142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0264d33b-c009-4fa6-9406-cec4a60d0512 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:57.715870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0264d33b-c009-4fa6-9406-cec4a60d0512 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:57.723037 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0264d33b-c009-4fa6-9406-cec4a60d0512 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1216 microversion: 2.1 time: 0.217015 Jul 28 03:58:57.723629 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2146/4788] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:57 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1216 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:58.194154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e165e30f-f5b8-4825-b4cf-cdca9633750d req-8a1db866-c08f-4d47-bdf0-a53417d18071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "tag": "50bb8633-534f-4450-8396-9a18c45b70b2"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:58.232028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e165e30f-f5b8-4825-b4cf-cdca9633750d req-8a1db866-c08f-4d47-bdf0-a53417d18071 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:58.232573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e165e30f-f5b8-4825-b4cf-cdca9633750d req-8a1db866-c08f-4d47-bdf0-a53417d18071 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:58.264758 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e165e30f-f5b8-4825-b4cf-cdca9633750d req-8a1db866-c08f-4d47-bdf0-a53417d18071 service nova] Creating event network-changed:50bb8633-534f-4450-8396-9a18c45b70b2 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 03:58:58.291624 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e165e30f-f5b8-4825-b4cf-cdca9633750d req-8a1db866-c08f-4d47-bdf0-a53417d18071 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101065 Jul 28 03:58:58.297949 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2643/4789] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:58:58.747654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-77d13b9b-c5b9-43e4-8968-670e3b939905 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:58:58.747654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-77d13b9b-c5b9-43e4-8968-670e3b939905 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:58:58.759653 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77d13b9b-c5b9-43e4-8968-670e3b939905 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:58.763178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77d13b9b-c5b9-43e4-8968-670e3b939905 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:58.764403 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77d13b9b-c5b9-43e4-8968-670e3b939905 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:58.764872 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77d13b9b-c5b9-43e4-8968-670e3b939905 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:58.977207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-77d13b9b-c5b9-43e4-8968-670e3b939905 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:58:58.986236 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-77d13b9b-c5b9-43e4-8968-670e3b939905 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1220 microversion: 2.1 time: 0.243443 Jul 28 03:58:58.993565 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2147/4790] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:58:58 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1220 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:58:59.482605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-2045972655", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": "none"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:58:59.604236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:58:59.604701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:58:59.607269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:58:59.607711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:58:59.609519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:58:59.650854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:59.653368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:59.657413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:59.658100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:59.710881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Getting quotas for project 5708a9145a0e4f989a7ae77bd824fc6f. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:58:59.725105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Getting quotas for user dee9ba6b0ce24bb7ac81c5a1af2bc7e0 and project 5708a9145a0e4f989a7ae77bd824fc6f. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:58:59.774079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:58:59.795429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:59:00.033759 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cc542dce-476a-4137-90b9-3e9fabbffdc5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:00.034804 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6fde0fb2-0347-4816-840a-e8e4665e046a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.859290 Jul 28 03:59:00.036129 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2644/4791] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Jul 28 03:58:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 03:59:00.047875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cc542dce-476a-4137-90b9-3e9fabbffdc5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:00.049076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4e47332-5cef-4a02-ac97-162e6e89fc12 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:00.056971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e4e47332-5cef-4a02-ac97-162e6e89fc12 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:00.067748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=79 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:00.078704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cc542dce-476a-4137-90b9-3e9fabbffdc5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:00.083841 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cc542dce-476a-4137-90b9-3e9fabbffdc5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:00.090291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cc542dce-476a-4137-90b9-3e9fabbffdc5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:00.091038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cc542dce-476a-4137-90b9-3e9fabbffdc5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:00.241265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e4e47332-5cef-4a02-ac97-162e6e89fc12 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:00.265211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e4e47332-5cef-4a02-ac97-162e6e89fc12 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:00.277019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e4e47332-5cef-4a02-ac97-162e6e89fc12 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:00.279383 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e4e47332-5cef-4a02-ac97-162e6e89fc12 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1278 microversion: 2.57 time: 0.236205 Jul 28 03:59:00.296468 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2645/4792] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:00 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1278 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:00.343644 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cc542dce-476a-4137-90b9-3e9fabbffdc5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:00.357511 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cc542dce-476a-4137-90b9-3e9fabbffdc5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1286 microversion: 2.1 time: 0.333812 Jul 28 03:59:00.358878 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2148/4793] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:00 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1286 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:01.313838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44e24095-8074-4cf4-b8da-066f1cf8cf4a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:01.314743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-44e24095-8074-4cf4-b8da-066f1cf8cf4a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:01.354359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44e24095-8074-4cf4-b8da-066f1cf8cf4a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:01.358752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44e24095-8074-4cf4-b8da-066f1cf8cf4a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:01.359781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44e24095-8074-4cf4-b8da-066f1cf8cf4a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:01.360233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44e24095-8074-4cf4-b8da-066f1cf8cf4a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:01.380784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ed5b5e3e-96ec-460c-80a3-618152fb03c0 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:01.384318 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ed5b5e3e-96ec-460c-80a3-618152fb03c0 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:01.401360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed5b5e3e-96ec-460c-80a3-618152fb03c0 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:01.403896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed5b5e3e-96ec-460c-80a3-618152fb03c0 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:01.405829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed5b5e3e-96ec-460c-80a3-618152fb03c0 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:01.410736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ed5b5e3e-96ec-460c-80a3-618152fb03c0 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:01.502785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44e24095-8074-4cf4-b8da-066f1cf8cf4a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:01.525951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44e24095-8074-4cf4-b8da-066f1cf8cf4a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:01.536779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44e24095-8074-4cf4-b8da-066f1cf8cf4a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:01.538102 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-44e24095-8074-4cf4-b8da-066f1cf8cf4a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1274 microversion: 2.57 time: 0.230628 Jul 28 03:59:01.538723 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2646/4794] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:01 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1274 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:01.756032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ed5b5e3e-96ec-460c-80a3-618152fb03c0 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:01.773908 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ed5b5e3e-96ec-460c-80a3-618152fb03c0 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1274 microversion: 2.1 time: 0.398094 Jul 28 03:59:01.777024 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2149/4795] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:01 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1274 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:02.567453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f719f4aa-55ac-49c3-a940-336b881c684b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:02.568077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f719f4aa-55ac-49c3-a940-336b881c684b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:02.584015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f719f4aa-55ac-49c3-a940-336b881c684b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:02.584792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f719f4aa-55ac-49c3-a940-336b881c684b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:02.587074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f719f4aa-55ac-49c3-a940-336b881c684b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:02.587756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f719f4aa-55ac-49c3-a940-336b881c684b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:02.803376 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-83773d5b-c2bd-49e5-9743-af79354f6b8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:02.803917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-83773d5b-c2bd-49e5-9743-af79354f6b8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:02.822980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83773d5b-c2bd-49e5-9743-af79354f6b8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:02.823632 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83773d5b-c2bd-49e5-9743-af79354f6b8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:02.824827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83773d5b-c2bd-49e5-9743-af79354f6b8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:02.827714 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-83773d5b-c2bd-49e5-9743-af79354f6b8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:02.856296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f719f4aa-55ac-49c3-a940-336b881c684b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:02.872238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f719f4aa-55ac-49c3-a940-336b881c684b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:02.878913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f719f4aa-55ac-49c3-a940-336b881c684b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:02.884807 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f719f4aa-55ac-49c3-a940-336b881c684b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1336 microversion: 2.57 time: 0.319456 Jul 28 03:59:02.887619 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2647/4796] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:02 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1336 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:03.179872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f8638c6a-eb98-48b9-a582-3bfe6c813e7b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:03.180790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f8638c6a-eb98-48b9-a582-3bfe6c813e7b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:03.203936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8638c6a-eb98-48b9-a582-3bfe6c813e7b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:03.205105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8638c6a-eb98-48b9-a582-3bfe6c813e7b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:03.217606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8638c6a-eb98-48b9-a582-3bfe6c813e7b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:03.218315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8638c6a-eb98-48b9-a582-3bfe6c813e7b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:03.233818 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-f8638c6a-eb98-48b9-a582-3bfe6c813e7b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f8638c6a-eb98-48b9-a582-3bfe6c813e7b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd HTTP/1.1 Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd4b66483-933e-4f43-ae0a-51f310b354bd'} Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:59:03.240274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:03.244301 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:59:03.244301 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:03.244301 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:03.244301 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:03.244301 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:03.244301 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:03.244301 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:03.244301 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:03.244301 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:03.244301 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:59:03.244301 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:03.248663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f8638c6a-eb98-48b9-a582-3bfe6c813e7b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:03.252659 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f8638c6a-eb98-48b9-a582-3bfe6c813e7b tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 404 len: 111 microversion: 2.1 time: 0.079909 Jul 28 03:59:03.253837 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2648/4797] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:59:03 2022] DELETE /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:59:03.263129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ca31057-6e5e-4f50-82ca-ecd1d39ff7eb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:03.265164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ca31057-6e5e-4f50-82ca-ecd1d39ff7eb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: d4b66483-933e-4f43-ae0a-51f310b354bd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:03.280026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ca31057-6e5e-4f50-82ca-ecd1d39ff7eb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:03.283613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ca31057-6e5e-4f50-82ca-ecd1d39ff7eb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:03.288106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ca31057-6e5e-4f50-82ca-ecd1d39ff7eb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:03.288847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ca31057-6e5e-4f50-82ca-ecd1d39ff7eb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:03.305602 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-0ca31057-6e5e-4f50-82ca-ecd1d39ff7eb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ca31057-6e5e-4f50-82ca-ecd1d39ff7eb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd HTTP/1.1 Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd4b66483-933e-4f43-ae0a-51f310b354bd'} Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:03.307563 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:03.311755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:03.311755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:03.311755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:03.311755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:03.311755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:03.311755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. Jul 28 03:59:03.311755 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:03.314041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ca31057-6e5e-4f50-82ca-ecd1d39ff7eb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance d4b66483-933e-4f43-ae0a-51f310b354bd could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:03.315131 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ca31057-6e5e-4f50-82ca-ecd1d39ff7eb tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd" status: 404 len: 111 microversion: 2.1 time: 0.056926 Jul 28 03:59:03.316401 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2649/4798] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:03 2022] GET /compute/v2.1/servers/d4b66483-933e-4f43-ae0a-51f310b354bd => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:59:03.324040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9622d3f0-87fd-4951-a0a6-958935e1bf94 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:03.324852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9622d3f0-87fd-4951-a0a6-958935e1bf94 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:03.332047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9622d3f0-87fd-4951-a0a6-958935e1bf94 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:03.332894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9622d3f0-87fd-4951-a0a6-958935e1bf94 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:03.334022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9622d3f0-87fd-4951-a0a6-958935e1bf94 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:03.334656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9622d3f0-87fd-4951-a0a6-958935e1bf94 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:03.342866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:03.375420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9622d3f0-87fd-4951-a0a6-958935e1bf94 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:59:03.434471 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-83773d5b-c2bd-49e5-9743-af79354f6b8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:03.455467 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-83773d5b-c2bd-49e5-9743-af79354f6b8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1316 microversion: 2.1 time: 0.657030 Jul 28 03:59:03.456090 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2150/4799] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:02 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1316 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:03.496388 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9622d3f0-87fd-4951-a0a6-958935e1bf94 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 204 len: 0 microversion: 2.1 time: 0.175357 Jul 28 03:59:03.500084 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2650/4800] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 03:59:03 2022] DELETE /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 03:59:03.507565 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-21b4c86d-6f4f-4ae3-b8f4-fe9a9621fdf8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:03.508188 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-21b4c86d-6f4f-4ae3-b8f4-fe9a9621fdf8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:03.514599 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21b4c86d-6f4f-4ae3-b8f4-fe9a9621fdf8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:03.515408 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21b4c86d-6f4f-4ae3-b8f4-fe9a9621fdf8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:03.516425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21b4c86d-6f4f-4ae3-b8f4-fe9a9621fdf8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:03.517061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-21b4c86d-6f4f-4ae3-b8f4-fe9a9621fdf8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:03.930131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-69a56f96-5097-4063-8ef8-687a433b5a2f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:03.933573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-69a56f96-5097-4063-8ef8-687a433b5a2f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:03.945836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69a56f96-5097-4063-8ef8-687a433b5a2f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:03.946841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69a56f96-5097-4063-8ef8-687a433b5a2f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:03.948607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69a56f96-5097-4063-8ef8-687a433b5a2f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:03.949581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69a56f96-5097-4063-8ef8-687a433b5a2f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:04.124015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-69a56f96-5097-4063-8ef8-687a433b5a2f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:04.138297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-69a56f96-5097-4063-8ef8-687a433b5a2f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:04.164750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-69a56f96-5097-4063-8ef8-687a433b5a2f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:04.170793 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-69a56f96-5097-4063-8ef8-687a433b5a2f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1336 microversion: 2.57 time: 0.254605 Jul 28 03:59:04.176181 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2651/4801] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:03 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1336 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:04.375978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-21b4c86d-6f4f-4ae3-b8f4-fe9a9621fdf8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:04.397945 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-21b4c86d-6f4f-4ae3-b8f4-fe9a9621fdf8 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1511 microversion: 2.1 time: 0.894349 Jul 28 03:59:04.398567 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2151/4802] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:03 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1511 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:04.460608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-2ef8dd73-09e3-44a1-8b9c-40a25e0ff466 req-4743f6fa-e596-425f-aff8-60d2faf14ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c73547-c0da-4d3f-a9c5-e13817f28211", "tag": "54af3d75-c44e-49da-844e-aea727885d7d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:04.479455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2ef8dd73-09e3-44a1-8b9c-40a25e0ff466 req-4743f6fa-e596-425f-aff8-60d2faf14ae6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:04.480312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ac3e6031-911a-4efc-9ac0-1922af61b1b2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:04.480966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ac3e6031-911a-4efc-9ac0-1922af61b1b2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:04.493326 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac3e6031-911a-4efc-9ac0-1922af61b1b2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:04.494044 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac3e6031-911a-4efc-9ac0-1922af61b1b2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:04.494800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2ef8dd73-09e3-44a1-8b9c-40a25e0ff466 req-4743f6fa-e596-425f-aff8-60d2faf14ae6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:04.495282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac3e6031-911a-4efc-9ac0-1922af61b1b2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:04.495783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ac3e6031-911a-4efc-9ac0-1922af61b1b2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:04.534453 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-2ef8dd73-09e3-44a1-8b9c-40a25e0ff466 req-4743f6fa-e596-425f-aff8-60d2faf14ae6 service nova] Creating event network-changed:54af3d75-c44e-49da-844e-aea727885d7d for instance 57c73547-c0da-4d3f-a9c5-e13817f28211 on n-h1-826756-3 Jul 28 03:59:04.557489 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-2ef8dd73-09e3-44a1-8b9c-40a25e0ff466 req-4743f6fa-e596-425f-aff8-60d2faf14ae6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100472 Jul 28 03:59:04.566366 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2652/4803] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:04.882707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ac3e6031-911a-4efc-9ac0-1922af61b1b2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:04.891825 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ac3e6031-911a-4efc-9ac0-1922af61b1b2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1316 microversion: 2.1 time: 0.416327 Jul 28 03:59:04.906870 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2152/4804] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:04 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1316 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:05.209484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-010d0673-0224-4956-b3d5-0e59d0e97664 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:05.211738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-010d0673-0224-4956-b3d5-0e59d0e97664 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:05.239408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-010d0673-0224-4956-b3d5-0e59d0e97664 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:05.239988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-010d0673-0224-4956-b3d5-0e59d0e97664 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:05.240892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-010d0673-0224-4956-b3d5-0e59d0e97664 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:05.241674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-010d0673-0224-4956-b3d5-0e59d0e97664 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:05.426819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8a95cad4-734e-4948-8ffc-4ccf0b62a0b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:05.428251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8a95cad4-734e-4948-8ffc-4ccf0b62a0b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:05.435061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a95cad4-734e-4948-8ffc-4ccf0b62a0b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:05.438431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a95cad4-734e-4948-8ffc-4ccf0b62a0b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:05.442130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a95cad4-734e-4948-8ffc-4ccf0b62a0b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:05.442919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8a95cad4-734e-4948-8ffc-4ccf0b62a0b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:05.516270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-010d0673-0224-4956-b3d5-0e59d0e97664 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:05.533959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-010d0673-0224-4956-b3d5-0e59d0e97664 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:05.537892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-010d0673-0224-4956-b3d5-0e59d0e97664 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:05.542528 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-010d0673-0224-4956-b3d5-0e59d0e97664 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1336 microversion: 2.57 time: 0.341896 Jul 28 03:59:05.544574 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2653/4805] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:05 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1336 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:05.943253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-208fb0b3-ef9f-4d30-90b1-e55c8cb76dcc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:05.944754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-208fb0b3-ef9f-4d30-90b1-e55c8cb76dcc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:05.971387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-208fb0b3-ef9f-4d30-90b1-e55c8cb76dcc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:05.973830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-208fb0b3-ef9f-4d30-90b1-e55c8cb76dcc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:05.977353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-208fb0b3-ef9f-4d30-90b1-e55c8cb76dcc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:05.981482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-208fb0b3-ef9f-4d30-90b1-e55c8cb76dcc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:06.302877 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8a95cad4-734e-4948-8ffc-4ccf0b62a0b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:06.316135 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8a95cad4-734e-4948-8ffc-4ccf0b62a0b9 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1511 microversion: 2.1 time: 0.895585 Jul 28 03:59:06.316767 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2153/4806] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:05 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1511 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:06.432957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-208fb0b3-ef9f-4d30-90b1-e55c8cb76dcc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:06.455268 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-208fb0b3-ef9f-4d30-90b1-e55c8cb76dcc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1316 microversion: 2.1 time: 0.516089 Jul 28 03:59:06.456585 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2654/4807] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:05 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1316 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:06.595455 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-73e9706d-32e5-4328-a1a3-05069607004e tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:06.596076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-73e9706d-32e5-4328-a1a3-05069607004e tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:06.609771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73e9706d-32e5-4328-a1a3-05069607004e tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:06.610222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73e9706d-32e5-4328-a1a3-05069607004e tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:06.611006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73e9706d-32e5-4328-a1a3-05069607004e tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:06.611628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-73e9706d-32e5-4328-a1a3-05069607004e tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:06.816790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c369be8c-887e-453d-8694-32d8d681a0ee req-bd93012c-dd2f-435e-8303-8b4bf095ccd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d97b518-6a6e-44f8-9be3-940b6fa8c853", "name": "network-vif-deleted", "tag": "9ce2e89e-838e-4b08-b1df-2e933c36e5d1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:06.840441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c369be8c-887e-453d-8694-32d8d681a0ee req-bd93012c-dd2f-435e-8303-8b4bf095ccd9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:06.841195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c369be8c-887e-453d-8694-32d8d681a0ee req-bd93012c-dd2f-435e-8303-8b4bf095ccd9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:06.863205 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-73e9706d-32e5-4328-a1a3-05069607004e tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:06.884547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-73e9706d-32e5-4328-a1a3-05069607004e tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:06.889342 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c369be8c-887e-453d-8694-32d8d681a0ee req-bd93012c-dd2f-435e-8303-8b4bf095ccd9 service nova] Creating event network-vif-deleted:9ce2e89e-838e-4b08-b1df-2e933c36e5d1 for instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 on n-h1-826756-3 Jul 28 03:59:06.891392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-73e9706d-32e5-4328-a1a3-05069607004e tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:06.892915 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-73e9706d-32e5-4328-a1a3-05069607004e tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1357 microversion: 2.57 time: 0.301626 Jul 28 03:59:06.895914 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2154/4808] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:06 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1357 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:06.911782 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c369be8c-887e-453d-8694-32d8d681a0ee req-bd93012c-dd2f-435e-8303-8b4bf095ccd9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099481 Jul 28 03:59:06.913317 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2655/4809] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:59:06.925710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:06.932692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:06.970888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:06.971690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:06.974128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:06.974128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:07.148953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:59:07.150143 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:59:07.150972 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:59:07.151738 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:59:07.152610 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:59:07.309959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:07.330030 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:07.340156 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:07.343315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:07.346592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:07.347784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b5fca44-daf6-453c-bc12-1f99551c5c5f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:07.348965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b5fca44-daf6-453c-bc12-1f99551c5c5f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:07.387274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b5fca44-daf6-453c-bc12-1f99551c5c5f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:07.390556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b5fca44-daf6-453c-bc12-1f99551c5c5f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:07.392502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:07.402094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b5fca44-daf6-453c-bc12-1f99551c5c5f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:07.406238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b5fca44-daf6-453c-bc12-1f99551c5c5f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:07.445519 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3bd5803a-acc4-4f1b-90f9-0495e043899c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "POST /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74/action" status: 202 len: 1138 microversion: 2.57 time: 0.514803 Jul 28 03:59:07.451717 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2155/4810] 10.222.0.48 () {62 vars in 1320 bytes} [Thu Jul 28 03:59:06 2022] POST /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74/action => generated 1138 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 28 03:59:07.475365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fba74840-c4c4-4742-892d-46d5d774af0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:07.476008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fba74840-c4c4-4742-892d-46d5d774af0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:07.485523 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fba74840-c4c4-4742-892d-46d5d774af0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:07.490291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fba74840-c4c4-4742-892d-46d5d774af0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:07.492895 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fba74840-c4c4-4742-892d-46d5d774af0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:07.495011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fba74840-c4c4-4742-892d-46d5d774af0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:07.529037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b5fca44-daf6-453c-bc12-1f99551c5c5f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:07.533971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b5fca44-daf6-453c-bc12-1f99551c5c5f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:07.535887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-4b5fca44-daf6-453c-bc12-1f99551c5c5f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lazy-loading 'fault' on Instance uuid 1d97b518-6a6e-44f8-9be3-940b6fa8c853 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 03:59:07.639294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fba74840-c4c4-4742-892d-46d5d774af0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:07.663417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b5fca44-daf6-453c-bc12-1f99551c5c5f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36bace2510942d4bb94ec23a6b3a053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea989471cdf641f389e0f61166fdb28a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:07.666795 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fba74840-c4c4-4742-892d-46d5d774af0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:07.672799 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fba74840-c4c4-4742-892d-46d5d774af0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:07.676191 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fba74840-c4c4-4742-892d-46d5d774af0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.206350 Jul 28 03:59:07.678126 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2156/4811] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:07 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:07.687226 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b5fca44-daf6-453c-bc12-1f99551c5c5f tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 200 len: 1306 microversion: 2.1 time: 0.351602 Jul 28 03:59:07.690126 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2656/4812] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:07 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 1306 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:07.703368 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6fc5fa33-6efd-44ff-b565-abcac6f3c4d9 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:07.711138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6fc5fa33-6efd-44ff-b565-abcac6f3c4d9 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:07.727463 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:07.733236 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6fc5fa33-6efd-44ff-b565-abcac6f3c4d9 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:07.733446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6fc5fa33-6efd-44ff-b565-abcac6f3c4d9 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:07.734329 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6fc5fa33-6efd-44ff-b565-abcac6f3c4d9 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:07.734767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6fc5fa33-6efd-44ff-b565-abcac6f3c4d9 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:08.027689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6fc5fa33-6efd-44ff-b565-abcac6f3c4d9 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:08.054887 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6fc5fa33-6efd-44ff-b565-abcac6f3c4d9 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1316 microversion: 2.1 time: 0.374802 Jul 28 03:59:08.062766 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2157/4813] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:07 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1316 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:08.723809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a53e6ac4-730a-4168-a0b3-6b71876d6aab tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:08.724663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a53e6ac4-730a-4168-a0b3-6b71876d6aab tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:08.726379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6ec65b3a-bb6b-4e58-8b12-020209909465 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:08.727025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6ec65b3a-bb6b-4e58-8b12-020209909465 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] [instance: 1d97b518-6a6e-44f8-9be3-940b6fa8c853] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:08.740340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ec65b3a-bb6b-4e58-8b12-020209909465 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:08.740887 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ec65b3a-bb6b-4e58-8b12-020209909465 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:08.742482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a53e6ac4-730a-4168-a0b3-6b71876d6aab tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:08.746816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a53e6ac4-730a-4168-a0b3-6b71876d6aab tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:08.747691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ec65b3a-bb6b-4e58-8b12-020209909465 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:08.748247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6ec65b3a-bb6b-4e58-8b12-020209909465 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:08.749166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a53e6ac4-730a-4168-a0b3-6b71876d6aab tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:08.756069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a53e6ac4-730a-4168-a0b3-6b71876d6aab tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:08.791668 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-6ec65b3a-bb6b-4e58-8b12-020209909465 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] HTTP exception thrown: Instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 could not be found. Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6ec65b3a-bb6b-4e58-8b12-020209909465 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Request method failure captured: Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 HTTP/1.1 Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gh5I2h98QvadEqVXWYTJbTl-1BDltSNMnSoZavaZnY7GQvjr5LA1R6_TRmS2iGopRymkbD0QLopNc4G9eWRdSb4uzsQ4Pkfh_n8r7N4HEXk_wDL5G_UhKCDI52r3lxw-0RBTU_YodKRN50pviCQtApQaobDuQXjxE249oh48pk-ZVk Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ea989471cdf641f389e0f61166fdb28a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ea989471cdf641f389e0f61166fdb28a"}]}] Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ea989471cdf641f389e0f61166fdb28a Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1973503060 Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: a36bace2510942d4bb94ec23a6b3a053 Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServersNegativeTestJSON-1973503060-project Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 could not be found. Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '1d97b518-6a6e-44f8-9be3-940b6fa8c853'} Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 could not be found. Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 could not be found. Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:08.802789 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:08.808076 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:08.808076 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:08.808076 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:08.808076 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:08.808076 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:08.808076 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 could not be found. Jul 28 03:59:08.808076 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:08.813471 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6ec65b3a-bb6b-4e58-8b12-020209909465 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] Returning 404 to user: Instance 1d97b518-6a6e-44f8-9be3-940b6fa8c853 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:08.816586 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6ec65b3a-bb6b-4e58-8b12-020209909465 tempest-ServersNegativeTestJSON-1973503060 tempest-ServersNegativeTestJSON-1973503060-project] 10.222.0.48 "GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853" status: 404 len: 111 microversion: 2.1 time: 0.093588 Jul 28 03:59:08.820042 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2158/4814] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:08 2022] GET /compute/v2.1/servers/1d97b518-6a6e-44f8-9be3-940b6fa8c853 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 03:59:09.078658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-618a3f82-5b8a-4da9-9034-f2af31d72e22 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:09.079491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-618a3f82-5b8a-4da9-9034-f2af31d72e22 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:09.114502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-618a3f82-5b8a-4da9-9034-f2af31d72e22 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:09.114953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-618a3f82-5b8a-4da9-9034-f2af31d72e22 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:09.116201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-618a3f82-5b8a-4da9-9034-f2af31d72e22 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:09.116809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-618a3f82-5b8a-4da9-9034-f2af31d72e22 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:09.176444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a53e6ac4-730a-4168-a0b3-6b71876d6aab tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:09.221478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a53e6ac4-730a-4168-a0b3-6b71876d6aab tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:09.239253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a53e6ac4-730a-4168-a0b3-6b71876d6aab tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:09.241462 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a53e6ac4-730a-4168-a0b3-6b71876d6aab tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.521981 Jul 28 03:59:09.243071 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2657/4815] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:08 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:10.033407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-618a3f82-5b8a-4da9-9034-f2af31d72e22 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:10.057876 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-618a3f82-5b8a-4da9-9034-f2af31d72e22 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1316 microversion: 2.1 time: 0.983981 Jul 28 03:59:10.058681 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2159/4816] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:09 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1316 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:10.286597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63c4b07b-8710-4a4b-8fe6-a26cc45aa8cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:10.292301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63c4b07b-8710-4a4b-8fe6-a26cc45aa8cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:10.298599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:10.307246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=14 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:10.336432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63c4b07b-8710-4a4b-8fe6-a26cc45aa8cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:10.337780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63c4b07b-8710-4a4b-8fe6-a26cc45aa8cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:10.342831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63c4b07b-8710-4a4b-8fe6-a26cc45aa8cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:10.344255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63c4b07b-8710-4a4b-8fe6-a26cc45aa8cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:10.737121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63c4b07b-8710-4a4b-8fe6-a26cc45aa8cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:10.826549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63c4b07b-8710-4a4b-8fe6-a26cc45aa8cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:10.833894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63c4b07b-8710-4a4b-8fe6-a26cc45aa8cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:10.835897 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63c4b07b-8710-4a4b-8fe6-a26cc45aa8cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.556631 Jul 28 03:59:10.856411 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2658/4817] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:10 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:11.092653 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-268575dc-8023-42b0-ae5f-8f77a37c1c7c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:11.097494 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-268575dc-8023-42b0-ae5f-8f77a37c1c7c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:11.130237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-268575dc-8023-42b0-ae5f-8f77a37c1c7c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:11.130683 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-268575dc-8023-42b0-ae5f-8f77a37c1c7c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:11.131465 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-268575dc-8023-42b0-ae5f-8f77a37c1c7c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:11.131894 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-268575dc-8023-42b0-ae5f-8f77a37c1c7c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:11.551703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-268575dc-8023-42b0-ae5f-8f77a37c1c7c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:11.565205 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-268575dc-8023-42b0-ae5f-8f77a37c1c7c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1316 microversion: 2.1 time: 0.478570 Jul 28 03:59:11.566778 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2160/4818] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:11 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:11.873759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6069786d-75ad-4b19-ab3e-101dc0ed9264 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:11.875004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6069786d-75ad-4b19-ab3e-101dc0ed9264 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:11.901029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6069786d-75ad-4b19-ab3e-101dc0ed9264 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:11.902222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6069786d-75ad-4b19-ab3e-101dc0ed9264 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:11.903254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6069786d-75ad-4b19-ab3e-101dc0ed9264 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:11.903864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6069786d-75ad-4b19-ab3e-101dc0ed9264 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:12.191328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6069786d-75ad-4b19-ab3e-101dc0ed9264 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:12.235490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6069786d-75ad-4b19-ab3e-101dc0ed9264 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:12.237542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6069786d-75ad-4b19-ab3e-101dc0ed9264 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:12.238982 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6069786d-75ad-4b19-ab3e-101dc0ed9264 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.370382 Jul 28 03:59:12.255369 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2659/4819] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:11 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:12.588241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7bfb12c6-b0dc-4a2e-be19-f8876d9c959b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:12.589538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7bfb12c6-b0dc-4a2e-be19-f8876d9c959b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:12.601220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7bfb12c6-b0dc-4a2e-be19-f8876d9c959b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:12.601657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7bfb12c6-b0dc-4a2e-be19-f8876d9c959b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:12.602803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7bfb12c6-b0dc-4a2e-be19-f8876d9c959b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:12.603490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7bfb12c6-b0dc-4a2e-be19-f8876d9c959b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:12.981148 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7bfb12c6-b0dc-4a2e-be19-f8876d9c959b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:12.998711 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7bfb12c6-b0dc-4a2e-be19-f8876d9c959b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1316 microversion: 2.1 time: 0.414901 Jul 28 03:59:13.003899 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2161/4820] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:12 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1316 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:13.281166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f78753db-fcf0-472d-899d-da19a39023c1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:13.282935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f78753db-fcf0-472d-899d-da19a39023c1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:13.309180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78753db-fcf0-472d-899d-da19a39023c1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:13.310401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78753db-fcf0-472d-899d-da19a39023c1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:13.311334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78753db-fcf0-472d-899d-da19a39023c1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:13.311694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78753db-fcf0-472d-899d-da19a39023c1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:13.538776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f78753db-fcf0-472d-899d-da19a39023c1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:13.547874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f78753db-fcf0-472d-899d-da19a39023c1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:13.549852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f78753db-fcf0-472d-899d-da19a39023c1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:13.551286 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f78753db-fcf0-472d-899d-da19a39023c1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.280924 Jul 28 03:59:13.552179 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2660/4821] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:13 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:13.614228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-64e248d2-e62f-47d0-95f5-4819b1de7ef0 req-f063c6e5-5610-45ae-82d2-53d12bc2f7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c73547-c0da-4d3f-a9c5-e13817f28211", "name": "network-vif-plugged", "status": "completed", "tag": "54af3d75-c44e-49da-844e-aea727885d7d"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:13.638680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-64e248d2-e62f-47d0-95f5-4819b1de7ef0 req-f063c6e5-5610-45ae-82d2-53d12bc2f7b7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:13.639126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-64e248d2-e62f-47d0-95f5-4819b1de7ef0 req-f063c6e5-5610-45ae-82d2-53d12bc2f7b7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:13.663662 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-64e248d2-e62f-47d0-95f5-4819b1de7ef0 req-f063c6e5-5610-45ae-82d2-53d12bc2f7b7 service nova] Creating event network-vif-plugged:54af3d75-c44e-49da-844e-aea727885d7d for instance 57c73547-c0da-4d3f-a9c5-e13817f28211 on n-h1-826756-3 Jul 28 03:59:13.676532 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-64e248d2-e62f-47d0-95f5-4819b1de7ef0 req-f063c6e5-5610-45ae-82d2-53d12bc2f7b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067670 Jul 28 03:59:13.680965 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2162/4822] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:14.026587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c2987a2-698c-453b-b5ed-9ddf78a0da32 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:14.029354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c2987a2-698c-453b-b5ed-9ddf78a0da32 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:14.060950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c2987a2-698c-453b-b5ed-9ddf78a0da32 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:14.067814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c2987a2-698c-453b-b5ed-9ddf78a0da32 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:14.077247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c2987a2-698c-453b-b5ed-9ddf78a0da32 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:14.079233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c2987a2-698c-453b-b5ed-9ddf78a0da32 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:14.508590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1c2987a2-698c-453b-b5ed-9ddf78a0da32 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:14.522123 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c2987a2-698c-453b-b5ed-9ddf78a0da32 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1316 microversion: 2.1 time: 0.499468 Jul 28 03:59:14.540658 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2661/4823] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:14 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1316 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:14.578696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6e1ea093-167b-4fab-bc64-659413390771 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:14.579523 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6e1ea093-167b-4fab-bc64-659413390771 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:14.596375 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e1ea093-167b-4fab-bc64-659413390771 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:14.596375 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e1ea093-167b-4fab-bc64-659413390771 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:14.597019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e1ea093-167b-4fab-bc64-659413390771 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:14.597452 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6e1ea093-167b-4fab-bc64-659413390771 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:14.733480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6e1ea093-167b-4fab-bc64-659413390771 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:14.764394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6e1ea093-167b-4fab-bc64-659413390771 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:14.768119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6e1ea093-167b-4fab-bc64-659413390771 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:14.769424 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6e1ea093-167b-4fab-bc64-659413390771 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.195101 Jul 28 03:59:14.780167 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2163/4824] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:14 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:15.549805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5061d1fa-c1b3-4dbb-896d-7afd3d1b5b86 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:15.550404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5061d1fa-c1b3-4dbb-896d-7afd3d1b5b86 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:15.566911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5061d1fa-c1b3-4dbb-896d-7afd3d1b5b86 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:15.567407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5061d1fa-c1b3-4dbb-896d-7afd3d1b5b86 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:15.568151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5061d1fa-c1b3-4dbb-896d-7afd3d1b5b86 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:15.568618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5061d1fa-c1b3-4dbb-896d-7afd3d1b5b86 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:15.807305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d028f820-4d63-429d-b1e1-df99244e53fe tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:15.807946 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d028f820-4d63-429d-b1e1-df99244e53fe tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:15.819221 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d028f820-4d63-429d-b1e1-df99244e53fe tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:15.819221 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d028f820-4d63-429d-b1e1-df99244e53fe tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:15.819597 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d028f820-4d63-429d-b1e1-df99244e53fe tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:15.820248 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d028f820-4d63-429d-b1e1-df99244e53fe tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:15.869301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5061d1fa-c1b3-4dbb-896d-7afd3d1b5b86 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:15.884600 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5061d1fa-c1b3-4dbb-896d-7afd3d1b5b86 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1504 microversion: 2.1 time: 0.336327 Jul 28 03:59:15.899087 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2662/4825] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:15 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:15.911311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cb143a24-e2b9-4325-a957-1c8991835e40 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-72796757"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:15.915573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cb143a24-e2b9-4325-a957-1c8991835e40 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:15.928107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb143a24-e2b9-4325-a957-1c8991835e40 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:15.928984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb143a24-e2b9-4325-a957-1c8991835e40 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:15.930009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb143a24-e2b9-4325-a957-1c8991835e40 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:15.930667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb143a24-e2b9-4325-a957-1c8991835e40 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:15.960397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d028f820-4d63-429d-b1e1-df99244e53fe tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:15.970860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d028f820-4d63-429d-b1e1-df99244e53fe tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:15.972856 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d028f820-4d63-429d-b1e1-df99244e53fe tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:15.974086 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d028f820-4d63-429d-b1e1-df99244e53fe tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.170965 Jul 28 03:59:15.974649 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2164/4826] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:15 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:16.392222 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.network.security_group_api [None req-cb143a24-e2b9-4325-a957-1c8991835e40 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Adding security group d0059dca-b2a9-4169-b748-1128824087cb to port 54af3d75-c44e-49da-844e-aea727885d7d Jul 28 03:59:17.012481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a7a3d70d-31aa-41eb-8b9c-c857943ec9b9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:17.013747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a7a3d70d-31aa-41eb-8b9c-c857943ec9b9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:17.034696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7a3d70d-31aa-41eb-8b9c-c857943ec9b9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:17.035250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7a3d70d-31aa-41eb-8b9c-c857943ec9b9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:17.036041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7a3d70d-31aa-41eb-8b9c-c857943ec9b9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:17.036937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7a3d70d-31aa-41eb-8b9c-c857943ec9b9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:17.252282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a7a3d70d-31aa-41eb-8b9c-c857943ec9b9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:17.278877 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a7a3d70d-31aa-41eb-8b9c-c857943ec9b9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:17.281742 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a7a3d70d-31aa-41eb-8b9c-c857943ec9b9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:17.283877 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a7a3d70d-31aa-41eb-8b9c-c857943ec9b9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.279330 Jul 28 03:59:17.285162 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2165/4827] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:17 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:17.732530 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cb143a24-e2b9-4325-a957-1c8991835e40 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211/action" status: 202 len: 0 microversion: 2.1 time: 1.828027 Jul 28 03:59:17.733888 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2663/4828] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:59:15 2022] POST /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211/action => generated 0 bytes in 1830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:59:17.746282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-02fa781e-5392-4b4f-a131-a73b57f59216 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1382635483"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:17.746984 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-02fa781e-5392-4b4f-a131-a73b57f59216 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:17.750558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c80413ff-fd23-4f2d-9844-95b052dde1df req-ea3b23a5-c00b-4557-97fe-7b49ba7f731b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c73547-c0da-4d3f-a9c5-e13817f28211", "tag": "54af3d75-c44e-49da-844e-aea727885d7d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:17.774094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c80413ff-fd23-4f2d-9844-95b052dde1df req-ea3b23a5-c00b-4557-97fe-7b49ba7f731b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:17.776479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c80413ff-fd23-4f2d-9844-95b052dde1df req-ea3b23a5-c00b-4557-97fe-7b49ba7f731b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:17.779678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02fa781e-5392-4b4f-a131-a73b57f59216 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:17.780975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02fa781e-5392-4b4f-a131-a73b57f59216 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:17.787428 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02fa781e-5392-4b4f-a131-a73b57f59216 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:17.788220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02fa781e-5392-4b4f-a131-a73b57f59216 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:17.810013 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c80413ff-fd23-4f2d-9844-95b052dde1df req-ea3b23a5-c00b-4557-97fe-7b49ba7f731b service nova] Creating event network-changed:54af3d75-c44e-49da-844e-aea727885d7d for instance 57c73547-c0da-4d3f-a9c5-e13817f28211 on n-h1-826756-3 Jul 28 03:59:17.822097 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c80413ff-fd23-4f2d-9844-95b052dde1df req-ea3b23a5-c00b-4557-97fe-7b49ba7f731b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077250 Jul 28 03:59:17.828003 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2664/4829] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:59:18.317676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8039b465-9ab8-4951-af99-0cf1d2dde1dd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:18.319012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8039b465-9ab8-4951-af99-0cf1d2dde1dd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:18.333634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:18.350770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8039b465-9ab8-4951-af99-0cf1d2dde1dd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:18.351623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8039b465-9ab8-4951-af99-0cf1d2dde1dd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:18.354722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8039b465-9ab8-4951-af99-0cf1d2dde1dd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:18.355648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8039b465-9ab8-4951-af99-0cf1d2dde1dd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:18.563353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8039b465-9ab8-4951-af99-0cf1d2dde1dd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:18.613986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8039b465-9ab8-4951-af99-0cf1d2dde1dd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:18.615817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8039b465-9ab8-4951-af99-0cf1d2dde1dd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:18.635645 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8039b465-9ab8-4951-af99-0cf1d2dde1dd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.306532 Jul 28 03:59:18.640719 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2665/4830] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:18 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:18.709498 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.network.security_group_api [None req-02fa781e-5392-4b4f-a131-a73b57f59216 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Adding security group f93cf120-b2ba-426d-85dc-1778891817c0 to port 54af3d75-c44e-49da-844e-aea727885d7d Jul 28 03:59:19.669304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-42a845ac-7040-4af9-b3ea-335a5d183adf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:19.670455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-42a845ac-7040-4af9-b3ea-335a5d183adf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:19.693637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42a845ac-7040-4af9-b3ea-335a5d183adf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:19.694338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42a845ac-7040-4af9-b3ea-335a5d183adf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:19.695442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42a845ac-7040-4af9-b3ea-335a5d183adf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:19.696054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42a845ac-7040-4af9-b3ea-335a5d183adf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:19.848474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-42a845ac-7040-4af9-b3ea-335a5d183adf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:19.869231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-42a845ac-7040-4af9-b3ea-335a5d183adf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:19.872331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-42a845ac-7040-4af9-b3ea-335a5d183adf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:19.876741 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-42a845ac-7040-4af9-b3ea-335a5d183adf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.213808 Jul 28 03:59:19.877520 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2666/4831] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:19 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:20.466315 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-02fa781e-5392-4b4f-a131-a73b57f59216 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211/action" status: 202 len: 0 microversion: 2.1 time: 2.726432 Jul 28 03:59:20.467101 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2166/4832] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:59:17 2022] POST /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211/action => generated 0 bytes in 2728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:59:20.488244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9fea4115-2379-4bd1-a89f-e4fba7b21a51 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:20.492382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9fea4115-2379-4bd1-a89f-e4fba7b21a51 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:20.499263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-075e54fc-6ed3-47e0-8aa4-ad90ef6a02cf req-86207876-c23a-47cd-b2a0-35ebc221f018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c73547-c0da-4d3f-a9c5-e13817f28211", "tag": "54af3d75-c44e-49da-844e-aea727885d7d"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:20.521486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fea4115-2379-4bd1-a89f-e4fba7b21a51 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:20.524325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fea4115-2379-4bd1-a89f-e4fba7b21a51 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:20.525452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fea4115-2379-4bd1-a89f-e4fba7b21a51 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:20.528627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fea4115-2379-4bd1-a89f-e4fba7b21a51 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:20.537721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-075e54fc-6ed3-47e0-8aa4-ad90ef6a02cf req-86207876-c23a-47cd-b2a0-35ebc221f018 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:20.538172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-075e54fc-6ed3-47e0-8aa4-ad90ef6a02cf req-86207876-c23a-47cd-b2a0-35ebc221f018 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:20.546894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:20.608020 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-075e54fc-6ed3-47e0-8aa4-ad90ef6a02cf req-86207876-c23a-47cd-b2a0-35ebc221f018 service nova] Creating event network-changed:54af3d75-c44e-49da-844e-aea727885d7d for instance 57c73547-c0da-4d3f-a9c5-e13817f28211 on n-h1-826756-3 Jul 28 03:59:20.634087 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-075e54fc-6ed3-47e0-8aa4-ad90ef6a02cf req-86207876-c23a-47cd-b2a0-35ebc221f018 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150502 Jul 28 03:59:20.643592 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2167/4833] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:59:20.918998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4e41e7a8-2fcb-47cc-8a66-8e3e37729387 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:20.926082 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4e41e7a8-2fcb-47cc-8a66-8e3e37729387 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:20.961664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e41e7a8-2fcb-47cc-8a66-8e3e37729387 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:20.962985 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e41e7a8-2fcb-47cc-8a66-8e3e37729387 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:20.963847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e41e7a8-2fcb-47cc-8a66-8e3e37729387 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:20.966146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4e41e7a8-2fcb-47cc-8a66-8e3e37729387 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:21.157472 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4e41e7a8-2fcb-47cc-8a66-8e3e37729387 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:21.173436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4e41e7a8-2fcb-47cc-8a66-8e3e37729387 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:21.175447 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4e41e7a8-2fcb-47cc-8a66-8e3e37729387 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:21.176726 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4e41e7a8-2fcb-47cc-8a66-8e3e37729387 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.275707 Jul 28 03:59:21.177312 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2168/4834] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:20 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:21.322757 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9fea4115-2379-4bd1-a89f-e4fba7b21a51 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.848710 Jul 28 03:59:21.325101 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2667/4835] 10.222.0.48 () {58 vars in 1293 bytes} [Thu Jul 28 03:59:20 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211/os-security-groups => generated 1157 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:21.340549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a4035bf2-0ca7-4f40-98f9-30feb65f6dbe tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'create', calling method: .version_select at 0x7ffa6749f820>, body: {"security_group": {"name": " tempest-securitygroup -1448290389 ", "description": "tempest-description-1307082610"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:22.178535 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a4035bf2-0ca7-4f40-98f9-30feb65f6dbe tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.842624 Jul 28 03:59:22.179975 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2169/4836] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:59:21 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:22.200731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-04ce586e-154d-48f4-8713-8b29e09f847e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa675e8670>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:22.210216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fd908c64-989a-45a2-b380-79ebb2d41119 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:22.210932 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fd908c64-989a-45a2-b380-79ebb2d41119 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:22.226635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd908c64-989a-45a2-b380-79ebb2d41119 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:22.227119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd908c64-989a-45a2-b380-79ebb2d41119 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:22.228033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd908c64-989a-45a2-b380-79ebb2d41119 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:22.232379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd908c64-989a-45a2-b380-79ebb2d41119 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:22.355112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fd908c64-989a-45a2-b380-79ebb2d41119 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:22.365013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fd908c64-989a-45a2-b380-79ebb2d41119 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:22.367961 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fd908c64-989a-45a2-b380-79ebb2d41119 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:22.370394 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fd908c64-989a-45a2-b380-79ebb2d41119 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.165148 Jul 28 03:59:22.371791 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2170/4837] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:22 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:22.377175 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-04ce586e-154d-48f4-8713-8b29e09f847e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/ae076cda-edaa-4afa-a8c3-92fde0b0ce77" status: 200 len: 224 microversion: 2.1 time: 0.182317 Jul 28 03:59:22.377954 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2668/4838] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 03:59:22 2022] GET /compute/v2.1/os-security-groups/ae076cda-edaa-4afa-a8c3-92fde0b0ce77 => generated 224 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:59:22.393103 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fe108271-54d5-4a49-85cc-4394720f270b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa673f64c0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:22.806305 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fe108271-54d5-4a49-85cc-4394720f270b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/ae076cda-edaa-4afa-a8c3-92fde0b0ce77" status: 202 len: 0 microversion: 2.1 time: 0.418080 Jul 28 03:59:22.810036 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2171/4839] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:59:22 2022] DELETE /compute/v2.1/os-security-groups/ae076cda-edaa-4afa-a8c3-92fde0b0ce77 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:59:22.817274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ff20fc02-0d94-4786-9b70-6db4137be163 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa66fe2940>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:22.896045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG neutronclient.v2_0.client [None req-ff20fc02-0d94-4786-9b70-6db4137be163 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist", "detail": ""}} {{(pid=126071) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:59:22.897222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.security_group_api [None req-ff20fc02-0d94-4786-9b70-6db4137be163 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Neutron security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 not found {{(pid=126071) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 03:59:22.897962 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-ff20fc02-0d94-4786-9b70-6db4137be163 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist Jul 28 03:59:22.897962 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-ce18cde2-1ff6-4f61-9bd9-230fbf409756'] Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ff20fc02-0d94-4786-9b70-6db4137be163 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/os-security-groups/ae076cda-edaa-4afa-a8c3-92fde0b0ce77 HTTP/1.1 Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: exception: Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-ce18cde2-1ff6-4f61-9bd9-230fbf409756'] Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'ae076cda-edaa-4afa-a8c3-92fde0b0ce77'} Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:59:22.901307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce18cde2-1ff6-4f61-9bd9-230fbf409756'] Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce18cde2-1ff6-4f61-9bd9-230fbf409756'] Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce18cde2-1ff6-4f61-9bd9-230fbf409756'] Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ce18cde2-1ff6-4f61-9bd9-230fbf409756'] Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ff20fc02-0d94-4786-9b70-6db4137be163 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 404 to user: Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist Jul 28 03:59:22.906139 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-ce18cde2-1ff6-4f61-9bd9-230fbf409756'] {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:22.911200 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ff20fc02-0d94-4786-9b70-6db4137be163 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/ae076cda-edaa-4afa-a8c3-92fde0b0ce77" status: 404 len: 194 microversion: 2.1 time: 0.094157 Jul 28 03:59:22.911200 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2669/4840] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 03:59:22 2022] GET /compute/v2.1/os-security-groups/ae076cda-edaa-4afa-a8c3-92fde0b0ce77 => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:59:22.921949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b4922c4d-e1ee-4c50-9de1-f0194eb67f7f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'create', calling method: .version_select at 0x7ffa677cd430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-40821825", "description": "tempest-description-1004397587"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:23.396427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e9dd9e0a-54d8-4a96-9b72-51941c9bef07 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:23.401686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e9dd9e0a-54d8-4a96-9b72-51941c9bef07 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:23.416875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9dd9e0a-54d8-4a96-9b72-51941c9bef07 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:23.417315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9dd9e0a-54d8-4a96-9b72-51941c9bef07 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:23.422458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9dd9e0a-54d8-4a96-9b72-51941c9bef07 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:23.424602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9dd9e0a-54d8-4a96-9b72-51941c9bef07 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:23.541335 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b4922c4d-e1ee-4c50-9de1-f0194eb67f7f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.626447 Jul 28 03:59:23.543185 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2172/4841] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:59:22 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:23.556684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4f35c8d9-bf5c-45d7-84f2-5589d4302295 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'create', calling method: .version_select at 0x7ffa67482dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-174017784", "description": "tempest-description-261915922"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:23.576497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e9dd9e0a-54d8-4a96-9b72-51941c9bef07 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:23.594233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e9dd9e0a-54d8-4a96-9b72-51941c9bef07 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:23.597712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e9dd9e0a-54d8-4a96-9b72-51941c9bef07 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:23.600296 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e9dd9e0a-54d8-4a96-9b72-51941c9bef07 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.209713 Jul 28 03:59:23.602142 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2670/4842] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:23 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:23.987756 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4f35c8d9-bf5c-45d7-84f2-5589d4302295 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.435669 Jul 28 03:59:23.995992 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2173/4843] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:59:23 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:24.003914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6b0e3f47-94f2-413f-b342-199fdedd7163 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'create', calling method: .version_select at 0x7ffa67761d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-916514916", "description": "tempest-description-1056993846"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:24.537293 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6b0e3f47-94f2-413f-b342-199fdedd7163 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.538815 Jul 28 03:59:24.538871 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2671/4844] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:59:23 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:24.551462 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-84a0257d-3dd2-43b7-9378-505e94f46b7c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa67482f70>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:24.628797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b36c0a3c-0fb5-4517-9b66-ffc23ad0e800 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:24.629728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b36c0a3c-0fb5-4517-9b66-ffc23ad0e800 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:24.643897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b36c0a3c-0fb5-4517-9b66-ffc23ad0e800 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:24.645600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b36c0a3c-0fb5-4517-9b66-ffc23ad0e800 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:24.646637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b36c0a3c-0fb5-4517-9b66-ffc23ad0e800 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:24.647979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b36c0a3c-0fb5-4517-9b66-ffc23ad0e800 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:24.805995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b36c0a3c-0fb5-4517-9b66-ffc23ad0e800 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:24.823033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b36c0a3c-0fb5-4517-9b66-ffc23ad0e800 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:24.824907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b36c0a3c-0fb5-4517-9b66-ffc23ad0e800 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:24.830234 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b36c0a3c-0fb5-4517-9b66-ffc23ad0e800 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.206131 Jul 28 03:59:24.830853 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2672/4845] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:24 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:25.062881 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-84a0257d-3dd2-43b7-9378-505e94f46b7c tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.515351 Jul 28 03:59:25.073446 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2174/4846] 10.222.0.48 () {58 vars in 1158 bytes} [Thu Jul 28 03:59:24 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:25.077562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f93c1de0-5bbc-4c2f-93e0-1404004401dc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa66fe2940>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:25.649346 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f93c1de0-5bbc-4c2f-93e0-1404004401dc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/bf4b5198-75d6-484b-9e6c-f93e972adb5a" status: 202 len: 0 microversion: 2.1 time: 0.575614 Jul 28 03:59:25.650280 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2673/4847] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:59:25 2022] DELETE /compute/v2.1/os-security-groups/bf4b5198-75d6-484b-9e6c-f93e972adb5a => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:59:25.665483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0c30be6f-3d05-48cb-9a8c-1046d6d3f181 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa677cd670>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:25.724232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG neutronclient.v2_0.client [None req-0c30be6f-3d05-48cb-9a8c-1046d6d3f181 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist", "detail": ""}} {{(pid=126072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:59:25.725348 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.security_group_api [None req-0c30be6f-3d05-48cb-9a8c-1046d6d3f181 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Neutron security group bf4b5198-75d6-484b-9e6c-f93e972adb5a not found {{(pid=126072) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 03:59:25.726316 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-0c30be6f-3d05-48cb-9a8c-1046d6d3f181 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist Jul 28 03:59:25.726316 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-5c920deb-bd11-401d-9d9d-1166f3908a29'] Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0c30be6f-3d05-48cb-9a8c-1046d6d3f181 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-security-groups/bf4b5198-75d6-484b-9e6c-f93e972adb5a HTTP/1.1 Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: exception: Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-5c920deb-bd11-401d-9d9d-1166f3908a29'] Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'bf4b5198-75d6-484b-9e6c-f93e972adb5a'} Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:59:25.731357 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c920deb-bd11-401d-9d9d-1166f3908a29'] Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c920deb-bd11-401d-9d9d-1166f3908a29'] Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c920deb-bd11-401d-9d9d-1166f3908a29'] Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5c920deb-bd11-401d-9d9d-1166f3908a29'] Jul 28 03:59:25.739612 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:25.755410 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0c30be6f-3d05-48cb-9a8c-1046d6d3f181 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 404 to user: Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist Jul 28 03:59:25.755410 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-5c920deb-bd11-401d-9d9d-1166f3908a29'] {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:25.757572 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0c30be6f-3d05-48cb-9a8c-1046d6d3f181 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/bf4b5198-75d6-484b-9e6c-f93e972adb5a" status: 404 len: 194 microversion: 2.1 time: 0.101529 Jul 28 03:59:25.766863 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2175/4848] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 03:59:25 2022] GET /compute/v2.1/os-security-groups/bf4b5198-75d6-484b-9e6c-f93e972adb5a => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:59:25.778006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5766df37-98ff-4b51-b051-04324f74f757 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa66fda9d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:25.863446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-22e26cdd-dbb3-4c1e-911e-9799755a7a5c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:25.865066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-22e26cdd-dbb3-4c1e-911e-9799755a7a5c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:25.886594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22e26cdd-dbb3-4c1e-911e-9799755a7a5c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:25.887500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22e26cdd-dbb3-4c1e-911e-9799755a7a5c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:25.888968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22e26cdd-dbb3-4c1e-911e-9799755a7a5c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:25.898976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-22e26cdd-dbb3-4c1e-911e-9799755a7a5c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:26.081105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-22e26cdd-dbb3-4c1e-911e-9799755a7a5c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:26.093163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-22e26cdd-dbb3-4c1e-911e-9799755a7a5c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:26.095084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-22e26cdd-dbb3-4c1e-911e-9799755a7a5c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:26.096801 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-22e26cdd-dbb3-4c1e-911e-9799755a7a5c tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.245278 Jul 28 03:59:26.097978 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2176/4849] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:25 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:26.489183 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5766df37-98ff-4b51-b051-04324f74f757 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/97dba6ab-250d-4e40-94c6-15b43f43baac" status: 202 len: 0 microversion: 2.1 time: 0.720871 Jul 28 03:59:26.489766 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2674/4850] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:59:25 2022] DELETE /compute/v2.1/os-security-groups/97dba6ab-250d-4e40-94c6-15b43f43baac => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:59:26.498395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-47f4ed5a-c23b-4a66-b3c5-af7300e44d09 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa67381a60>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:26.533888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG neutronclient.v2_0.client [None req-47f4ed5a-c23b-4a66-b3c5-af7300e44d09 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist", "detail": ""}} {{(pid=126072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:59:26.534502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.security_group_api [None req-47f4ed5a-c23b-4a66-b3c5-af7300e44d09 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Neutron security group 97dba6ab-250d-4e40-94c6-15b43f43baac not found {{(pid=126072) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 03:59:26.535037 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-47f4ed5a-c23b-4a66-b3c5-af7300e44d09 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist Jul 28 03:59:26.535037 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-e68e7410-69f3-4163-b23d-a4d0a8c59ae9'] Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-47f4ed5a-c23b-4a66-b3c5-af7300e44d09 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-security-groups/97dba6ab-250d-4e40-94c6-15b43f43baac HTTP/1.1 Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: exception: Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-e68e7410-69f3-4163-b23d-a4d0a8c59ae9'] Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '97dba6ab-250d-4e40-94c6-15b43f43baac'} Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:59:26.536953 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e68e7410-69f3-4163-b23d-a4d0a8c59ae9'] Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e68e7410-69f3-4163-b23d-a4d0a8c59ae9'] Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e68e7410-69f3-4163-b23d-a4d0a8c59ae9'] Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e68e7410-69f3-4163-b23d-a4d0a8c59ae9'] Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-47f4ed5a-c23b-4a66-b3c5-af7300e44d09 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 404 to user: Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-e68e7410-69f3-4163-b23d-a4d0a8c59ae9'] {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:26.544781 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-47f4ed5a-c23b-4a66-b3c5-af7300e44d09 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/97dba6ab-250d-4e40-94c6-15b43f43baac" status: 404 len: 194 microversion: 2.1 time: 0.044040 Jul 28 03:59:26.552245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4dcdef17-39ab-4a66-abf4-a56a2e98ed99 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa66ff23a0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:26.554302 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2177/4851] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 03:59:26 2022] GET /compute/v2.1/os-security-groups/97dba6ab-250d-4e40-94c6-15b43f43baac => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:59:27.119389 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-89437d23-b41b-4106-b196-d78be5d98c3b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:27.131477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-89437d23-b41b-4106-b196-d78be5d98c3b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:27.151858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-89437d23-b41b-4106-b196-d78be5d98c3b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:27.153519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-89437d23-b41b-4106-b196-d78be5d98c3b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:27.154689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-89437d23-b41b-4106-b196-d78be5d98c3b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:27.155303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-89437d23-b41b-4106-b196-d78be5d98c3b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:27.158714 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4dcdef17-39ab-4a66-abf4-a56a2e98ed99 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/76885417-4a3e-4c02-8fa3-08fc506c4a58" status: 202 len: 0 microversion: 2.1 time: 0.614353 Jul 28 03:59:27.164624 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2675/4852] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:59:26 2022] DELETE /compute/v2.1/os-security-groups/76885417-4a3e-4c02-8fa3-08fc506c4a58 => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:59:27.176494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-01424ca8-db11-4660-a5fa-14209852e812 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:27.179096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-01424ca8-db11-4660-a5fa-14209852e812 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:27.215909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01424ca8-db11-4660-a5fa-14209852e812 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:27.216500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01424ca8-db11-4660-a5fa-14209852e812 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:27.217353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01424ca8-db11-4660-a5fa-14209852e812 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:27.225287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01424ca8-db11-4660-a5fa-14209852e812 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:27.307676 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-89437d23-b41b-4106-b196-d78be5d98c3b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.211869 Jul 28 03:59:27.309739 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2178/4853] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Jul 28 03:59:27 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8/os-volume_attachments => generated 25 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:27.334510 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f81f3142-e088-4422-92f8-c60d9df70be6 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa67455af0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:27.426370 n-d-826756-3 devstack@n-api.service[126072]: DEBUG neutronclient.v2_0.client [None req-f81f3142-e088-4422-92f8-c60d9df70be6 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist", "detail": ""}} {{(pid=126072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:59:27.427365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.security_group_api [None req-f81f3142-e088-4422-92f8-c60d9df70be6 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Neutron security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 not found {{(pid=126072) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 03:59:27.428755 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-f81f3142-e088-4422-92f8-c60d9df70be6 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist Jul 28 03:59:27.428755 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-259f35d0-6e5e-43d9-aa07-27649e507540'] Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f81f3142-e088-4422-92f8-c60d9df70be6 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-security-groups/76885417-4a3e-4c02-8fa3-08fc506c4a58 HTTP/1.1 Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: exception: Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-259f35d0-6e5e-43d9-aa07-27649e507540'] Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '76885417-4a3e-4c02-8fa3-08fc506c4a58'} Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:59:27.431767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-259f35d0-6e5e-43d9-aa07-27649e507540'] Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-259f35d0-6e5e-43d9-aa07-27649e507540'] Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-259f35d0-6e5e-43d9-aa07-27649e507540'] Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-259f35d0-6e5e-43d9-aa07-27649e507540'] Jul 28 03:59:27.436050 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:27.440595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f81f3142-e088-4422-92f8-c60d9df70be6 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 404 to user: Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist Jul 28 03:59:27.440595 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-259f35d0-6e5e-43d9-aa07-27649e507540'] {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:27.442676 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f81f3142-e088-4422-92f8-c60d9df70be6 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/76885417-4a3e-4c02-8fa3-08fc506c4a58" status: 404 len: 194 microversion: 2.1 time: 0.131848 Jul 28 03:59:27.447521 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2179/4854] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 03:59:27 2022] GET /compute/v2.1/os-security-groups/76885417-4a3e-4c02-8fa3-08fc506c4a58 => generated 194 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:59:27.458474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c3a72b1d-7985-4cee-a247-a55267582e25 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:27.462016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c3a72b1d-7985-4cee-a247-a55267582e25 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:27.479873 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3a72b1d-7985-4cee-a247-a55267582e25 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:27.484305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3a72b1d-7985-4cee-a247-a55267582e25 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:27.485815 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3a72b1d-7985-4cee-a247-a55267582e25 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:27.488436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c3a72b1d-7985-4cee-a247-a55267582e25 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:27.576299 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c3a72b1d-7985-4cee-a247-a55267582e25 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:59:27.641807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-01424ca8-db11-4660-a5fa-14209852e812 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:27.658875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-01424ca8-db11-4660-a5fa-14209852e812 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:27.665389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-01424ca8-db11-4660-a5fa-14209852e812 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:27.669225 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-01424ca8-db11-4660-a5fa-14209852e812 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.503002 Jul 28 03:59:27.689007 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2676/4855] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:27 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:27.694593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c1f45705-7252-4abc-9df7-37b3000446cc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa66ff2820>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:27.753754 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c3a72b1d-7985-4cee-a247-a55267582e25 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 204 len: 0 microversion: 2.20 time: 0.304078 Jul 28 03:59:27.755502 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2180/4856] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:59:27 2022] DELETE /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:59:27.767173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a34aab55-7fda-41f3-be4f-aa5b5986c915 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:27.768186 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a34aab55-7fda-41f3-be4f-aa5b5986c915 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:27.777024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a34aab55-7fda-41f3-be4f-aa5b5986c915 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:27.777763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a34aab55-7fda-41f3-be4f-aa5b5986c915 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:27.778843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a34aab55-7fda-41f3-be4f-aa5b5986c915 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:27.779596 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a34aab55-7fda-41f3-be4f-aa5b5986c915 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:27.785259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:28.000833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a34aab55-7fda-41f3-be4f-aa5b5986c915 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:28.031534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a34aab55-7fda-41f3-be4f-aa5b5986c915 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:28.035232 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a34aab55-7fda-41f3-be4f-aa5b5986c915 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:28.046741 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a34aab55-7fda-41f3-be4f-aa5b5986c915 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1726 microversion: 2.20 time: 0.276095 Jul 28 03:59:28.048220 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2181/4857] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:27 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1726 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:28.421332 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c1f45705-7252-4abc-9df7-37b3000446cc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.730737 Jul 28 03:59:28.421994 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2677/4858] 10.222.0.48 () {58 vars in 1158 bytes} [Thu Jul 28 03:59:27 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:28.444952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-44c8fc60-a956-4059-b03f-22d31be42ce4 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'create', calling method: .version_select at 0x7ffa674824c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1144492388", "description": "tempest-description-2024903124"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:28.699697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b571f5df-da1a-47c6-b55e-0f3f26f94765 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:28.703233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b571f5df-da1a-47c6-b55e-0f3f26f94765 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:28.755317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b571f5df-da1a-47c6-b55e-0f3f26f94765 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:28.756118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b571f5df-da1a-47c6-b55e-0f3f26f94765 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:28.757781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b571f5df-da1a-47c6-b55e-0f3f26f94765 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:28.761705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b571f5df-da1a-47c6-b55e-0f3f26f94765 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:28.913430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b571f5df-da1a-47c6-b55e-0f3f26f94765 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:28.934506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b571f5df-da1a-47c6-b55e-0f3f26f94765 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:28.936648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b571f5df-da1a-47c6-b55e-0f3f26f94765 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:28.938465 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b571f5df-da1a-47c6-b55e-0f3f26f94765 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.247161 Jul 28 03:59:28.939401 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2678/4859] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:28 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:29.072981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f3e0223-9df7-4252-9ba1-38fd684e39c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:29.074057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f3e0223-9df7-4252-9ba1-38fd684e39c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:29.087008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f3e0223-9df7-4252-9ba1-38fd684e39c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:29.087791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f3e0223-9df7-4252-9ba1-38fd684e39c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:29.089271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f3e0223-9df7-4252-9ba1-38fd684e39c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:29.090446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f3e0223-9df7-4252-9ba1-38fd684e39c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:29.290933 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-44c8fc60-a956-4059-b03f-22d31be42ce4 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.854030 Jul 28 03:59:29.303427 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2182/4860] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:59:28 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:59:29.311502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bbcb8c9e-c64b-4cf0-8e01-a79ab7bebfe2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'create', calling method: .version_select at 0x7ffa673f6940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-201616080", "description": "tempest-description-399468311"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:29.378202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f3e0223-9df7-4252-9ba1-38fd684e39c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:29.397756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f3e0223-9df7-4252-9ba1-38fd684e39c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:29.400849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f3e0223-9df7-4252-9ba1-38fd684e39c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:29.403014 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f3e0223-9df7-4252-9ba1-38fd684e39c8 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1726 microversion: 2.20 time: 0.335262 Jul 28 03:59:29.403973 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2679/4861] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:29 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1726 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:29.963358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-76b9d604-6e9d-4ed4-a390-78181e590212 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:29.965156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-76b9d604-6e9d-4ed4-a390-78181e590212 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:29.982384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76b9d604-6e9d-4ed4-a390-78181e590212 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:29.983131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76b9d604-6e9d-4ed4-a390-78181e590212 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:29.984098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76b9d604-6e9d-4ed4-a390-78181e590212 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:29.984736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76b9d604-6e9d-4ed4-a390-78181e590212 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:30.060046 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bbcb8c9e-c64b-4cf0-8e01-a79ab7bebfe2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.747233 Jul 28 03:59:30.065438 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2183/4862] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 03:59:29 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:30.143292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-76b9d604-6e9d-4ed4-a390-78181e590212 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:30.165650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-76b9d604-6e9d-4ed4-a390-78181e590212 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:30.167293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-76b9d604-6e9d-4ed4-a390-78181e590212 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:30.168649 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-76b9d604-6e9d-4ed4-a390-78181e590212 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.210060 Jul 28 03:59:30.169424 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2680/4863] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:29 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:30.437157 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f8398cbc-7136-4025-87c4-1fceefde6467 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:30.446702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f8398cbc-7136-4025-87c4-1fceefde6467 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:30.470625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:30.496099 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f8398cbc-7136-4025-87c4-1fceefde6467 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:30.498162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f8398cbc-7136-4025-87c4-1fceefde6467 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:30.498450 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f8398cbc-7136-4025-87c4-1fceefde6467 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:30.499042 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f8398cbc-7136-4025-87c4-1fceefde6467 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:30.683372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1508737763", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "b1c33403-2aff-4441-879e-fad31a228d8d"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:30.835157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] validate_networks() for [('b1c33403-2aff-4441-879e-fad31a228d8d', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:59:31.088682 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f8398cbc-7136-4025-87c4-1fceefde6467 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:31.121907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f8398cbc-7136-4025-87c4-1fceefde6467 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:31.130531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f8398cbc-7136-4025-87c4-1fceefde6467 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:31.137333 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f8398cbc-7136-4025-87c4-1fceefde6467 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1726 microversion: 2.20 time: 0.710023 Jul 28 03:59:31.138081 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2184/4864] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:30 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1726 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:31.240342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-02f5491c-e61b-418a-b11c-ac4819258e64 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:31.245790 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-02f5491c-e61b-418a-b11c-ac4819258e64 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:31.273915 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02f5491c-e61b-418a-b11c-ac4819258e64 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.275534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02f5491c-e61b-418a-b11c-ac4819258e64 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.276915 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02f5491c-e61b-418a-b11c-ac4819258e64 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:31.277930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-02f5491c-e61b-418a-b11c-ac4819258e64 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:31.423791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-02f5491c-e61b-418a-b11c-ac4819258e64 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:31.459351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-02f5491c-e61b-418a-b11c-ac4819258e64 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:31.466395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-02f5491c-e61b-418a-b11c-ac4819258e64 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:31.476654 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-02f5491c-e61b-418a-b11c-ac4819258e64 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.245646 Jul 28 03:59:31.479654 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2185/4865] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:31 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:32.034679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:59:32.035379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:59:32.035720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:59:32.036396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:59:32.036771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:59:32.082272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.084116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:32.085576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.086272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:32.141546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Getting quotas for project 684191c692c445ad92f5d76f10790418. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:32.158577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Getting quotas for user ada96f18e88f47b7b9c1994d0d7dbcaf and project 684191c692c445ad92f5d76f10790418. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:32.180987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:59:32.184148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 03:59:32.187102 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8e211a6e-db84-4151-83d1-442e9c306f06 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:32.190854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8e211a6e-db84-4151-83d1-442e9c306f06 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:32.225980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e211a6e-db84-4151-83d1-442e9c306f06 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.226706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e211a6e-db84-4151-83d1-442e9c306f06 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:32.228150 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e211a6e-db84-4151-83d1-442e9c306f06 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.234944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e211a6e-db84-4151-83d1-442e9c306f06 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:32.318909 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-579e97c3-63c6-4f86-ab03-3407b9c1a76f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.637369 Jul 28 03:59:32.327062 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2681/4866] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 03:59:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:59:32.335803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ac54d753-7d60-48b5-9b17-661c041dea50 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:32.339976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ac54d753-7d60-48b5-9b17-661c041dea50 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:32.486686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8e211a6e-db84-4151-83d1-442e9c306f06 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:32.500850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8e211a6e-db84-4151-83d1-442e9c306f06 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:32.505365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8e211a6e-db84-4151-83d1-442e9c306f06 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea947ad72ea74f439474ac4703fb0ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f0f82bb0014564bff4c739314d25a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:32.506620 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8e211a6e-db84-4151-83d1-442e9c306f06 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 200 len: 1658 microversion: 2.20 time: 0.327034 Jul 28 03:59:32.520399 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2186/4867] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:32 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 1658 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:32.520399 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-6243e988-027b-4406-8332-a84dcc3dbf84 req-e53b11d3-e5bf-4812-a06f-e9db7b53f0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8", "name": "network-vif-deleted", "tag": "565bb390-f25a-4510-b22a-3975e600ba96"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:32.544156 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-6243e988-027b-4406-8332-a84dcc3dbf84 req-e53b11d3-e5bf-4812-a06f-e9db7b53f0d1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.545472 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-6243e988-027b-4406-8332-a84dcc3dbf84 req-e53b11d3-e5bf-4812-a06f-e9db7b53f0d1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:32.561520 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-6243e988-027b-4406-8332-a84dcc3dbf84 req-e53b11d3-e5bf-4812-a06f-e9db7b53f0d1 service nova] Creating event network-vif-deleted:565bb390-f25a-4510-b22a-3975e600ba96 for instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 on n-h1-826756-3 Jul 28 03:59:32.562439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ac54d753-7d60-48b5-9b17-661c041dea50 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:32.575124 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ac54d753-7d60-48b5-9b17-661c041dea50 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1216 microversion: 2.1 time: 0.246553 Jul 28 03:59:32.578968 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2682/4868] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:32 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1216 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:32.596146 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-6243e988-027b-4406-8332-a84dcc3dbf84 req-e53b11d3-e5bf-4812-a06f-e9db7b53f0d1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084825 Jul 28 03:59:32.599545 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2187/4869] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:32.600879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-07d981db-903c-4ac8-ab80-4a763733c326 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:32.605616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-07d981db-903c-4ac8-ab80-4a763733c326 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:32.615593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07d981db-903c-4ac8-ab80-4a763733c326 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.616502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07d981db-903c-4ac8-ab80-4a763733c326 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:32.617589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07d981db-903c-4ac8-ab80-4a763733c326 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:32.618323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07d981db-903c-4ac8-ab80-4a763733c326 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:32.785604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-07d981db-903c-4ac8-ab80-4a763733c326 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:32.814518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-07d981db-903c-4ac8-ab80-4a763733c326 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:32.820901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-07d981db-903c-4ac8-ab80-4a763733c326 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:32.835035 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-07d981db-903c-4ac8-ab80-4a763733c326 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.241080 Jul 28 03:59:32.836197 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2683/4870] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:32 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:33.542128 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3576faeb-8ca1-4b09-8d39-74bc922b3d3a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:33.546866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3576faeb-8ca1-4b09-8d39-74bc922b3d3a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:33.580556 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3576faeb-8ca1-4b09-8d39-74bc922b3d3a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:33.581956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3576faeb-8ca1-4b09-8d39-74bc922b3d3a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:33.583673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3576faeb-8ca1-4b09-8d39-74bc922b3d3a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:33.585474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3576faeb-8ca1-4b09-8d39-74bc922b3d3a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:33.602293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-00ad8c32-90e5-4a61-ba92-1aa4c2968cd7 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:33.603869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-00ad8c32-90e5-4a61-ba92-1aa4c2968cd7 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:33.623679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00ad8c32-90e5-4a61-ba92-1aa4c2968cd7 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:33.624875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00ad8c32-90e5-4a61-ba92-1aa4c2968cd7 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:33.625728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00ad8c32-90e5-4a61-ba92-1aa4c2968cd7 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:33.626203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-00ad8c32-90e5-4a61-ba92-1aa4c2968cd7 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:33.638655 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-3576faeb-8ca1-4b09-8d39-74bc922b3d3a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] HTTP exception thrown: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3576faeb-8ca1-4b09-8d39-74bc922b3d3a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Request method failure captured: Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 HTTP/1.1 Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4ge0nTQTH4Nnkv87cBSSTP3AKpCz3wDCSgcz7a6Avf43CRxluuwes7dUSpAOw0bfyuhbm-Ooorxp6zBwWAliV_zY_19Da40Q-zXhAZ5o4Aysg6CTx68R3ahhmMht8Nkg5bJacHNsHPKx1ufUKpvBjLBThH5BfdoBkGSqH9Zrs3kIXTc Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 98f0f82bb0014564bff4c739314d25a4 Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f0f82bb0014564bff4c739314d25a4"}]}] Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 98f0f82bb0014564bff4c739314d25a4 Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-AttachVolumeShelveTestJSON-958508241-project Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ea947ad72ea74f439474ac4703fb0ebb Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-AttachVolumeShelveTestJSON-958508241-project Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8'} Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:33.644286 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:33.650130 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:33.650130 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:33.650130 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:33.650130 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:33.650130 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:33.650130 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:33.650130 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:33.650130 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 03:59:33.652270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3576faeb-8ca1-4b09-8d39-74bc922b3d3a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Returning 404 to user: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:33.656196 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3576faeb-8ca1-4b09-8d39-74bc922b3d3a tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 404 len: 111 microversion: 2.20 time: 0.121805 Jul 28 03:59:33.657642 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2188/4871] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:33 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:59:33.668485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7d933cb4-c46f-449e-aca1-e3d85be4c602 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '.version_select at 0x7ffa673f6790>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:33.716618 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7d933cb4-c46f-449e-aca1-e3d85be4c602 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022284047" status: 204 len: 0 microversion: 2.20 time: 0.053212 Jul 28 03:59:33.717798 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2189/4872] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Jul 28 03:59:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022284047 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 03:59:33.782621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-00ad8c32-90e5-4a61-ba92-1aa4c2968cd7 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:33.800191 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-00ad8c32-90e5-4a61-ba92-1aa4c2968cd7 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1212 microversion: 2.1 time: 0.202096 Jul 28 03:59:33.800848 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2684/4873] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:33 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1212 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:33.892894 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b67ffdc1-4bd2-426c-ae28-80dd314bd1de tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:33.894477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b67ffdc1-4bd2-426c-ae28-80dd314bd1de tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:33.912260 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b67ffdc1-4bd2-426c-ae28-80dd314bd1de tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:33.913305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b67ffdc1-4bd2-426c-ae28-80dd314bd1de tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:33.914535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b67ffdc1-4bd2-426c-ae28-80dd314bd1de tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:33.916289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b67ffdc1-4bd2-426c-ae28-80dd314bd1de tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:34.105569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b67ffdc1-4bd2-426c-ae28-80dd314bd1de tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:34.132013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b67ffdc1-4bd2-426c-ae28-80dd314bd1de tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:34.138499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b67ffdc1-4bd2-426c-ae28-80dd314bd1de tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:34.141810 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b67ffdc1-4bd2-426c-ae28-80dd314bd1de tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.265902 Jul 28 03:59:34.164575 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2190/4874] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:33 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:34.828597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3334735-ba77-426a-85f1-43ea8cc36f59 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:34.830167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3334735-ba77-426a-85f1-43ea8cc36f59 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:34.846596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3334735-ba77-426a-85f1-43ea8cc36f59 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:34.847090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3334735-ba77-426a-85f1-43ea8cc36f59 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:34.848000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3334735-ba77-426a-85f1-43ea8cc36f59 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:34.848492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3334735-ba77-426a-85f1-43ea8cc36f59 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:35.185212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6628f13f-0225-4234-a035-d1eb2b412c45 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:35.187395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6628f13f-0225-4234-a035-d1eb2b412c45 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:35.207067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6628f13f-0225-4234-a035-d1eb2b412c45 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:35.209052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6628f13f-0225-4234-a035-d1eb2b412c45 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:35.210835 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6628f13f-0225-4234-a035-d1eb2b412c45 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:35.213245 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6628f13f-0225-4234-a035-d1eb2b412c45 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:35.347085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3334735-ba77-426a-85f1-43ea8cc36f59 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:35.357733 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3334735-ba77-426a-85f1-43ea8cc36f59 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1274 microversion: 2.1 time: 0.533666 Jul 28 03:59:35.361340 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2685/4875] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:34 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1274 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:35.414878 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6628f13f-0225-4234-a035-d1eb2b412c45 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:35.438891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6628f13f-0225-4234-a035-d1eb2b412c45 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:35.440679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6628f13f-0225-4234-a035-d1eb2b412c45 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:35.442367 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6628f13f-0225-4234-a035-d1eb2b412c45 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.271431 Jul 28 03:59:35.457799 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2191/4876] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:35 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:36.385178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-24417252-ba77-4d2f-944a-87e3927ccff1 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:36.386316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-24417252-ba77-4d2f-944a-87e3927ccff1 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:36.404579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24417252-ba77-4d2f-944a-87e3927ccff1 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:36.406265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24417252-ba77-4d2f-944a-87e3927ccff1 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:36.407375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24417252-ba77-4d2f-944a-87e3927ccff1 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:36.407979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24417252-ba77-4d2f-944a-87e3927ccff1 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:36.472234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-88228c83-6e39-4f6c-94bb-c94d6f36c2a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:36.472939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-88228c83-6e39-4f6c-94bb-c94d6f36c2a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:36.493085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-88228c83-6e39-4f6c-94bb-c94d6f36c2a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:36.493552 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-88228c83-6e39-4f6c-94bb-c94d6f36c2a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:36.497221 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-88228c83-6e39-4f6c-94bb-c94d6f36c2a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:36.500462 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-88228c83-6e39-4f6c-94bb-c94d6f36c2a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:36.677945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-88228c83-6e39-4f6c-94bb-c94d6f36c2a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:36.692598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-88228c83-6e39-4f6c-94bb-c94d6f36c2a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:36.701802 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-88228c83-6e39-4f6c-94bb-c94d6f36c2a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:36.703192 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-88228c83-6e39-4f6c-94bb-c94d6f36c2a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.235858 Jul 28 03:59:36.706286 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2192/4877] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:36 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:37.073551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-24417252-ba77-4d2f-944a-87e3927ccff1 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:37.087510 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-24417252-ba77-4d2f-944a-87e3927ccff1 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1316 microversion: 2.1 time: 0.705817 Jul 28 03:59:37.089849 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2686/4878] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:36 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1316 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:37.736107 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c04a3d53-5fac-4735-9e5e-cbad354578f9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:37.736818 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c04a3d53-5fac-4735-9e5e-cbad354578f9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:37.750956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c04a3d53-5fac-4735-9e5e-cbad354578f9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:37.751427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c04a3d53-5fac-4735-9e5e-cbad354578f9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:37.753267 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c04a3d53-5fac-4735-9e5e-cbad354578f9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:37.753718 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c04a3d53-5fac-4735-9e5e-cbad354578f9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:37.989731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c04a3d53-5fac-4735-9e5e-cbad354578f9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:38.026852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c04a3d53-5fac-4735-9e5e-cbad354578f9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:38.031350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c04a3d53-5fac-4735-9e5e-cbad354578f9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:38.040645 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c04a3d53-5fac-4735-9e5e-cbad354578f9 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.308941 Jul 28 03:59:38.041601 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2193/4879] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:37 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:38.116754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0905bcf5-f1ce-4fa7-b23e-7eda16f57b66 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:38.117518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0905bcf5-f1ce-4fa7-b23e-7eda16f57b66 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:38.141174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0905bcf5-f1ce-4fa7-b23e-7eda16f57b66 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:38.149180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0905bcf5-f1ce-4fa7-b23e-7eda16f57b66 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:38.151235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0905bcf5-f1ce-4fa7-b23e-7eda16f57b66 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:38.169515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0905bcf5-f1ce-4fa7-b23e-7eda16f57b66 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:38.525266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0905bcf5-f1ce-4fa7-b23e-7eda16f57b66 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:38.553228 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0905bcf5-f1ce-4fa7-b23e-7eda16f57b66 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1316 microversion: 2.1 time: 0.440955 Jul 28 03:59:38.555055 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2687/4880] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:38 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1316 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:38.872144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-c2409162-0e94-4a0a-8888-7649c827e471 req-de6757d1-627c-4cb7-ac0e-6d67b2d5da63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e", "tag": "d3b3da2d-010a-471c-a63f-7d0f42e50be2"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:38.905666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c2409162-0e94-4a0a-8888-7649c827e471 req-de6757d1-627c-4cb7-ac0e-6d67b2d5da63 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:38.913138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c2409162-0e94-4a0a-8888-7649c827e471 req-de6757d1-627c-4cb7-ac0e-6d67b2d5da63 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:38.955026 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-c2409162-0e94-4a0a-8888-7649c827e471 req-de6757d1-627c-4cb7-ac0e-6d67b2d5da63 service nova] Creating event network-changed:d3b3da2d-010a-471c-a63f-7d0f42e50be2 for instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e on n-h1-826756-3 Jul 28 03:59:38.971226 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-c2409162-0e94-4a0a-8888-7649c827e471 req-de6757d1-627c-4cb7-ac0e-6d67b2d5da63 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104997 Jul 28 03:59:38.972319 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2194/4881] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:39.072774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9089c2c3-1baf-4403-827d-944c8ef934c6 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:39.073558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9089c2c3-1baf-4403-827d-944c8ef934c6 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:39.088861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9089c2c3-1baf-4403-827d-944c8ef934c6 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:39.091115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9089c2c3-1baf-4403-827d-944c8ef934c6 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:39.094252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9089c2c3-1baf-4403-827d-944c8ef934c6 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:39.098898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9089c2c3-1baf-4403-827d-944c8ef934c6 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:39.365709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9089c2c3-1baf-4403-827d-944c8ef934c6 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:39.377503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9089c2c3-1baf-4403-827d-944c8ef934c6 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:39.379948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9089c2c3-1baf-4403-827d-944c8ef934c6 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:39.381364 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9089c2c3-1baf-4403-827d-944c8ef934c6 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1366 microversion: 2.57 time: 0.316080 Jul 28 03:59:39.382631 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2688/4882] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:39 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:39.582770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f7b0e17e-ae96-4f23-92b8-a7a8b468a131 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:39.584165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f7b0e17e-ae96-4f23-92b8-a7a8b468a131 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:39.596412 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7b0e17e-ae96-4f23-92b8-a7a8b468a131 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:39.612184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7b0e17e-ae96-4f23-92b8-a7a8b468a131 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:39.614373 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7b0e17e-ae96-4f23-92b8-a7a8b468a131 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:39.617202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7b0e17e-ae96-4f23-92b8-a7a8b468a131 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.418096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-756b94a2-862c-4a30-9414-3276c9c564a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:40.420942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-756b94a2-862c-4a30-9414-3276c9c564a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:40.438740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-756b94a2-862c-4a30-9414-3276c9c564a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.440857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-756b94a2-862c-4a30-9414-3276c9c564a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.444104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-756b94a2-862c-4a30-9414-3276c9c564a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.444859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-756b94a2-862c-4a30-9414-3276c9c564a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.709215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-756b94a2-862c-4a30-9414-3276c9c564a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:40.731112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-756b94a2-862c-4a30-9414-3276c9c564a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:40.732760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-756b94a2-862c-4a30-9414-3276c9c564a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:40.740541 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-756b94a2-862c-4a30-9414-3276c9c564a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1372 microversion: 2.57 time: 0.326213 Jul 28 03:59:40.741400 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2689/4883] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:40 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1372 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:40.774166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44ff692d-0eab-42e3-a8c3-f46cb8d347cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:40.781166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-44ff692d-0eab-42e3-a8c3-f46cb8d347cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:40.818540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44ff692d-0eab-42e3-a8c3-f46cb8d347cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.819229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44ff692d-0eab-42e3-a8c3-f46cb8d347cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.820219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44ff692d-0eab-42e3-a8c3-f46cb8d347cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.821489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44ff692d-0eab-42e3-a8c3-f46cb8d347cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.869333 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-44ff692d-0eab-42e3-a8c3-f46cb8d347cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] HTTP exception thrown: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44ff692d-0eab-42e3-a8c3-f46cb8d347cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Request method failure captured: Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 HTTP/1.1 Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ge0nTQTH4Nnkv87cBSSTP3AKpCz3wDCSgcz7a6Avf43CRxluuwes7dUSpAOw0bfyuhbm-Ooorxp6zBwWAliV_zY_19Da40Q-zXhAZ5o4Aysg6CTx68R3ahhmMht8Nkg5bJacHNsHPKx1ufUKpvBjLBThH5BfdoBkGSqH9Zrs3kIXTc Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 98f0f82bb0014564bff4c739314d25a4 Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f0f82bb0014564bff4c739314d25a4"}]}] Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 98f0f82bb0014564bff4c739314d25a4 Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeShelveTestJSON-958508241-project Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ea947ad72ea74f439474ac4703fb0ebb Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeShelveTestJSON-958508241-project Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8'} Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:59:40.873919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:40.881090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:40.881090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:40.881090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:40.881090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:40.881090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:40.881090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:40.881090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:40.881090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:40.881090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:40.881090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:40.881090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:40.881090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44ff692d-0eab-42e3-a8c3-f46cb8d347cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Returning 404 to user: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:40.881090 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-44ff692d-0eab-42e3-a8c3-f46cb8d347cc tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 404 len: 111 microversion: 2.20 time: 0.121044 Jul 28 03:59:40.881090 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2690/4884] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:59:40 2022] DELETE /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:59:40.897075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8cd04b15-5609-40a1-a6d5-056d0458657b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:40.899355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8cd04b15-5609-40a1-a6d5-056d0458657b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:40.913899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cd04b15-5609-40a1-a6d5-056d0458657b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.919116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cd04b15-5609-40a1-a6d5-056d0458657b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.919334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cd04b15-5609-40a1-a6d5-056d0458657b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:40.919948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cd04b15-5609-40a1-a6d5-056d0458657b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:40.962084 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-8cd04b15-5609-40a1-a6d5-056d0458657b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] HTTP exception thrown: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8cd04b15-5609-40a1-a6d5-056d0458657b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Request method failure captured: Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 HTTP/1.1 Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ge0nTQTH4Nnkv87cBSSTP3AKpCz3wDCSgcz7a6Avf43CRxluuwes7dUSpAOw0bfyuhbm-Ooorxp6zBwWAliV_zY_19Da40Q-zXhAZ5o4Aysg6CTx68R3ahhmMht8Nkg5bJacHNsHPKx1ufUKpvBjLBThH5BfdoBkGSqH9Zrs3kIXTc Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 98f0f82bb0014564bff4c739314d25a4 Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f0f82bb0014564bff4c739314d25a4"}]}] Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 98f0f82bb0014564bff4c739314d25a4 Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeShelveTestJSON-958508241-project Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ea947ad72ea74f439474ac4703fb0ebb Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeShelveTestJSON-958508241-project Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8'} Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:40.967403 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:40.975741 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:40.975741 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:40.975741 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:40.975741 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:40.975741 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:40.975741 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:40.975741 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. Jul 28 03:59:40.975741 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:40.975741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8cd04b15-5609-40a1-a6d5-056d0458657b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Returning 404 to user: Instance 8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:40.975741 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8cd04b15-5609-40a1-a6d5-056d0458657b tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8" status: 404 len: 111 microversion: 2.20 time: 0.083362 Jul 28 03:59:40.975741 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2691/4885] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:40 2022] GET /compute/v2.1/servers/8c4a10d5-dfc8-49dd-a2a2-48ec6718f4c8 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:59:40.981030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a3fdd0f-a2f1-458b-8225-9aa3a3ecb8ff tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:40.984460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f7b0e17e-ae96-4f23-92b8-a7a8b468a131 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:40.986147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1a3fdd0f-a2f1-458b-8225-9aa3a3ecb8ff tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:40.999673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a3fdd0f-a2f1-458b-8225-9aa3a3ecb8ff tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:41.001606 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f7b0e17e-ae96-4f23-92b8-a7a8b468a131 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1316 microversion: 2.1 time: 1.423456 Jul 28 03:59:41.005641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a3fdd0f-a2f1-458b-8225-9aa3a3ecb8ff tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:41.006769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a3fdd0f-a2f1-458b-8225-9aa3a3ecb8ff tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:41.007220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a3fdd0f-a2f1-458b-8225-9aa3a3ecb8ff tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:41.022911 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2195/4886] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:39 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1316 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:41.717931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1a3fdd0f-a2f1-458b-8225-9aa3a3ecb8ff tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:41.734812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1a3fdd0f-a2f1-458b-8225-9aa3a3ecb8ff tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:41.741436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1a3fdd0f-a2f1-458b-8225-9aa3a3ecb8ff tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:41.743146 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1a3fdd0f-a2f1-458b-8225-9aa3a3ecb8ff tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 2950 microversion: 2.32 time: 0.769411 Jul 28 03:59:41.745028 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2692/4887] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:40 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 2950 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:41.777362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d8aa5f43-bf48-46d9-875e-57bc78ef7893 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:41.780444 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e92f4874-fa21-47a9-97d1-a99183c1d5a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:41.781152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e92f4874-fa21-47a9-97d1-a99183c1d5a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:41.788964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d8aa5f43-bf48-46d9-875e-57bc78ef7893 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:41.803064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e92f4874-fa21-47a9-97d1-a99183c1d5a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:41.807827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e92f4874-fa21-47a9-97d1-a99183c1d5a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:41.809932 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e92f4874-fa21-47a9-97d1-a99183c1d5a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:41.810910 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e92f4874-fa21-47a9-97d1-a99183c1d5a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:41.822252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8aa5f43-bf48-46d9-875e-57bc78ef7893 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:41.828178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8aa5f43-bf48-46d9-875e-57bc78ef7893 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:41.838327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8aa5f43-bf48-46d9-875e-57bc78ef7893 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:41.849067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8aa5f43-bf48-46d9-875e-57bc78ef7893 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:42.118154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:42.406870 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e92f4874-fa21-47a9-97d1-a99183c1d5a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:42.413122 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d8aa5f43-bf48-46d9-875e-57bc78ef7893 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.640447 Jul 28 03:59:42.414038 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2693/4888] 10.222.0.48 () {60 vars in 1316 bytes} [Thu Jul 28 03:59:41 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579/os-interface => generated 1831 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:42.417277 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e92f4874-fa21-47a9-97d1-a99183c1d5a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:42.420465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-48c31b36-cdcf-4bee-bc53-81ad80db0ceb tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:42.421192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-48c31b36-cdcf-4bee-bc53-81ad80db0ceb tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:42.422768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e92f4874-fa21-47a9-97d1-a99183c1d5a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:42.429656 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e92f4874-fa21-47a9-97d1-a99183c1d5a5 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1372 microversion: 2.57 time: 0.663059 Jul 28 03:59:42.431883 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2196/4889] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:41 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1372 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:42.467109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48c31b36-cdcf-4bee-bc53-81ad80db0ceb tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:42.469267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48c31b36-cdcf-4bee-bc53-81ad80db0ceb tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:42.474233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48c31b36-cdcf-4bee-bc53-81ad80db0ceb tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:42.475777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48c31b36-cdcf-4bee-bc53-81ad80db0ceb tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:42.542608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:42.570786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:42.898511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-48c31b36-cdcf-4bee-bc53-81ad80db0ceb tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:42.910924 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-48c31b36-cdcf-4bee-bc53-81ad80db0ceb tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1316 microversion: 2.1 time: 0.495105 Jul 28 03:59:42.912599 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2694/4890] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:42 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:43.466290 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d040a70c-8665-46e7-b89c-a8940a35af56 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:43.467203 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d040a70c-8665-46e7-b89c-a8940a35af56 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:43.498390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d040a70c-8665-46e7-b89c-a8940a35af56 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:43.498846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d040a70c-8665-46e7-b89c-a8940a35af56 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:43.499640 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d040a70c-8665-46e7-b89c-a8940a35af56 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:43.500928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d040a70c-8665-46e7-b89c-a8940a35af56 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:43.942022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bd512660-7002-4d53-a442-7cb5f7a89548 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:43.944807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bd512660-7002-4d53-a442-7cb5f7a89548 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:43.986736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d040a70c-8665-46e7-b89c-a8940a35af56 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:43.995132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd512660-7002-4d53-a442-7cb5f7a89548 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:43.997222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd512660-7002-4d53-a442-7cb5f7a89548 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:44.001086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd512660-7002-4d53-a442-7cb5f7a89548 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:44.003512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd512660-7002-4d53-a442-7cb5f7a89548 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:44.010316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d040a70c-8665-46e7-b89c-a8940a35af56 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:44.016319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d040a70c-8665-46e7-b89c-a8940a35af56 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:44.018079 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d040a70c-8665-46e7-b89c-a8940a35af56 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1372 microversion: 2.57 time: 0.558205 Jul 28 03:59:44.025036 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2197/4891] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:43 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1372 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:44.461286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bd512660-7002-4d53-a442-7cb5f7a89548 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:44.478410 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bd512660-7002-4d53-a442-7cb5f7a89548 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1316 microversion: 2.1 time: 0.543446 Jul 28 03:59:44.479114 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2695/4892] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:43 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1316 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:45.051886 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6c100504-b625-410b-bc8c-b6702af86eaf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:45.053198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6c100504-b625-410b-bc8c-b6702af86eaf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:45.075748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6c100504-b625-410b-bc8c-b6702af86eaf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.078595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6c100504-b625-410b-bc8c-b6702af86eaf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.080109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6c100504-b625-410b-bc8c-b6702af86eaf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.083254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6c100504-b625-410b-bc8c-b6702af86eaf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.283757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6c100504-b625-410b-bc8c-b6702af86eaf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:45.306568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6c100504-b625-410b-bc8c-b6702af86eaf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:45.310328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6c100504-b625-410b-bc8c-b6702af86eaf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:45.320754 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6c100504-b625-410b-bc8c-b6702af86eaf tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1357 microversion: 2.57 time: 0.265153 Jul 28 03:59:45.341496 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2198/4893] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:45 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1357 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:45.377618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80cf6283-882c-4f3d-94cc-55ff566f91cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:45.378498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-80cf6283-882c-4f3d-94cc-55ff566f91cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:45.395333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80cf6283-882c-4f3d-94cc-55ff566f91cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.395788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80cf6283-882c-4f3d-94cc-55ff566f91cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.398159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80cf6283-882c-4f3d-94cc-55ff566f91cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.404398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80cf6283-882c-4f3d-94cc-55ff566f91cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.477421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-80cf6283-882c-4f3d-94cc-55ff566f91cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 03:59:45.503691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-736c396a-c512-4204-94bd-68d4845d053b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:45.504321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-736c396a-c512-4204-94bd-68d4845d053b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:45.528220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-736c396a-c512-4204-94bd-68d4845d053b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.528813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-736c396a-c512-4204-94bd-68d4845d053b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.529658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-736c396a-c512-4204-94bd-68d4845d053b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.530102 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-736c396a-c512-4204-94bd-68d4845d053b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.678492 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-80cf6283-882c-4f3d-94cc-55ff566f91cd tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 204 len: 0 microversion: 2.57 time: 0.301990 Jul 28 03:59:45.683336 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2696/4894] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:59:45 2022] DELETE /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 03:59:45.700113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0121ea4e-18c2-434e-9680-db6c0a83d599 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:45.702057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0121ea4e-18c2-434e-9680-db6c0a83d599 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:45.718872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0121ea4e-18c2-434e-9680-db6c0a83d599 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.719338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0121ea4e-18c2-434e-9680-db6c0a83d599 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.720300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0121ea4e-18c2-434e-9680-db6c0a83d599 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.721019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0121ea4e-18c2-434e-9680-db6c0a83d599 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.911818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0121ea4e-18c2-434e-9680-db6c0a83d599 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:45.935876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0121ea4e-18c2-434e-9680-db6c0a83d599 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:45.937621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0121ea4e-18c2-434e-9680-db6c0a83d599 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:45.941420 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0121ea4e-18c2-434e-9680-db6c0a83d599 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1363 microversion: 2.57 time: 0.247000 Jul 28 03:59:45.944093 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2697/4895] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:45 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:46.977281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a467ee2-1b4b-41b0-a680-0da144b12f8b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:46.978175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7a467ee2-1b4b-41b0-a680-0da144b12f8b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:46.998506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a467ee2-1b4b-41b0-a680-0da144b12f8b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:46.998968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a467ee2-1b4b-41b0-a680-0da144b12f8b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:46.999763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a467ee2-1b4b-41b0-a680-0da144b12f8b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:47.000203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a467ee2-1b4b-41b0-a680-0da144b12f8b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:47.219297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a467ee2-1b4b-41b0-a680-0da144b12f8b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:47.234216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a467ee2-1b4b-41b0-a680-0da144b12f8b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:47.242285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a467ee2-1b4b-41b0-a680-0da144b12f8b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:47.244690 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7a467ee2-1b4b-41b0-a680-0da144b12f8b tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1363 microversion: 2.57 time: 0.271982 Jul 28 03:59:47.248737 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2698/4896] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:46 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:59:47.264703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2681a262-1781-43d3-9593-eced3ecae4a7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:47.265543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2681a262-1781-43d3-9593-eced3ecae4a7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:47.277763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2681a262-1781-43d3-9593-eced3ecae4a7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:47.278221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2681a262-1781-43d3-9593-eced3ecae4a7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:47.281579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2681a262-1781-43d3-9593-eced3ecae4a7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:47.287105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2681a262-1781-43d3-9593-eced3ecae4a7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:47.319709 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-2681a262-1781-43d3-9593-eced3ecae4a7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] HTTP exception thrown: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2681a262-1781-43d3-9593-eced3ecae4a7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Request method failure captured: Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 HTTP/1.1 Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ge0nTQTH4Nnkv87cBSSTP3AKpCz3wDCSgcz7a6Avf43CRxluuwes7dUSpAOw0bfyuhbm-Ooorxp6zBwWAliV_zY_19Da40Q-zXhAZ5o4Aysg6CTx68R3ahhmMht8Nkg5bJacHNsHPKx1ufUKpvBjLBThH5BfdoBkGSqH9Zrs3kIXTc Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 98f0f82bb0014564bff4c739314d25a4 Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f0f82bb0014564bff4c739314d25a4"}]}] Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 98f0f82bb0014564bff4c739314d25a4 Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeShelveTestJSON-958508241-project Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ea947ad72ea74f439474ac4703fb0ebb Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeShelveTestJSON-958508241-project Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '99d0126e-11bf-4048-9e35-7309c228b534'} Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:59:47.321711 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:47.327316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:59:47.327316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:47.327316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:47.327316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:47.327316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:47.327316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:47.327316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:47.327316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:47.327316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:47.327316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:59:47.327316 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:47.334854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2681a262-1781-43d3-9593-eced3ecae4a7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Returning 404 to user: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:47.335967 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2681a262-1781-43d3-9593-eced3ecae4a7 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "DELETE /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 404 len: 111 microversion: 2.20 time: 0.086084 Jul 28 03:59:47.336991 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2699/4897] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 03:59:47 2022] DELETE /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:59:47.346812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5a3fe1fc-051d-4df7-b5ab-751064d7f119 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:47.347718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5a3fe1fc-051d-4df7-b5ab-751064d7f119 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] [instance: 99d0126e-11bf-4048-9e35-7309c228b534] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:47.355786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a3fe1fc-051d-4df7-b5ab-751064d7f119 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:47.369172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a3fe1fc-051d-4df7-b5ab-751064d7f119 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:47.370035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a3fe1fc-051d-4df7-b5ab-751064d7f119 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:47.370484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a3fe1fc-051d-4df7-b5ab-751064d7f119 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:47.399209 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-5a3fe1fc-051d-4df7-b5ab-751064d7f119 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] HTTP exception thrown: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5a3fe1fc-051d-4df7-b5ab-751064d7f119 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Request method failure captured: Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 HTTP/1.1 Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4ge0nTQTH4Nnkv87cBSSTP3AKpCz3wDCSgcz7a6Avf43CRxluuwes7dUSpAOw0bfyuhbm-Ooorxp6zBwWAliV_zY_19Da40Q-zXhAZ5o4Aysg6CTx68R3ahhmMht8Nkg5bJacHNsHPKx1ufUKpvBjLBThH5BfdoBkGSqH9Zrs3kIXTc Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 98f0f82bb0014564bff4c739314d25a4 Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_98f0f82bb0014564bff4c739314d25a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/98f0f82bb0014564bff4c739314d25a4"}]}] Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 98f0f82bb0014564bff4c739314d25a4 Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-958508241 Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeShelveTestJSON-958508241-project Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ea947ad72ea74f439474ac4703fb0ebb Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeShelveTestJSON-958508241-project Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '99d0126e-11bf-4048-9e35-7309c228b534'} Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:47.401062 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:47.406527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:47.406527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:47.406527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:47.406527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:47.406527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:47.406527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:47.406527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. Jul 28 03:59:47.406527 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:47.406527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5a3fe1fc-051d-4df7-b5ab-751064d7f119 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] Returning 404 to user: Instance 99d0126e-11bf-4048-9e35-7309c228b534 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:47.406527 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5a3fe1fc-051d-4df7-b5ab-751064d7f119 tempest-AttachVolumeShelveTestJSON-958508241 tempest-AttachVolumeShelveTestJSON-958508241-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534" status: 404 len: 111 microversion: 2.20 time: 0.060787 Jul 28 03:59:47.409839 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2700/4898] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:47 2022] GET /compute/v2.1/servers/99d0126e-11bf-4048-9e35-7309c228b534 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 03:59:47.638341 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-736c396a-c512-4204-94bd-68d4845d053b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:47.652603 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-736c396a-c512-4204-94bd-68d4845d053b tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1316 microversion: 2.1 time: 2.153975 Jul 28 03:59:47.653760 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2199/4899] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:45 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1316 bytes in 2156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:47.731195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e7bb6545-2e18-48b4-93e6-2cf3907b6624 req-c4b60d1b-fb37-4f13-9347-7db5c198b8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e", "name": "network-vif-plugged", "status": "completed", "tag": "d3b3da2d-010a-471c-a63f-7d0f42e50be2"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:47.751405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e7bb6545-2e18-48b4-93e6-2cf3907b6624 req-c4b60d1b-fb37-4f13-9347-7db5c198b8b5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:47.751816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e7bb6545-2e18-48b4-93e6-2cf3907b6624 req-c4b60d1b-fb37-4f13-9347-7db5c198b8b5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:47.780048 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e7bb6545-2e18-48b4-93e6-2cf3907b6624 req-c4b60d1b-fb37-4f13-9347-7db5c198b8b5 service nova] Creating event network-vif-plugged:d3b3da2d-010a-471c-a63f-7d0f42e50be2 for instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e on n-h1-826756-3 Jul 28 03:59:47.787894 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e7bb6545-2e18-48b4-93e6-2cf3907b6624 req-c4b60d1b-fb37-4f13-9347-7db5c198b8b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059763 Jul 28 03:59:47.789641 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2701/4900] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:48.268313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-78f1010d-c149-49f1-9f56-c0768358cf0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:48.270556 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-78f1010d-c149-49f1-9f56-c0768358cf0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:48.285192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78f1010d-c149-49f1-9f56-c0768358cf0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:48.289840 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78f1010d-c149-49f1-9f56-c0768358cf0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:48.291219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78f1010d-c149-49f1-9f56-c0768358cf0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:48.291938 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-78f1010d-c149-49f1-9f56-c0768358cf0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:48.512814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-78f1010d-c149-49f1-9f56-c0768358cf0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:48.527338 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-78f1010d-c149-49f1-9f56-c0768358cf0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:48.534280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-78f1010d-c149-49f1-9f56-c0768358cf0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:48.539511 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-78f1010d-c149-49f1-9f56-c0768358cf0f tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1363 microversion: 2.57 time: 0.275393 Jul 28 03:59:48.540691 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2200/4901] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:48 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:48.682488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d47c43b2-f75c-436b-8b16-4bf4d28d3550 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:48.685606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d47c43b2-f75c-436b-8b16-4bf4d28d3550 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:48.693035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:48.704812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d47c43b2-f75c-436b-8b16-4bf4d28d3550 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:48.706320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d47c43b2-f75c-436b-8b16-4bf4d28d3550 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:48.707469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d47c43b2-f75c-436b-8b16-4bf4d28d3550 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:48.708589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d47c43b2-f75c-436b-8b16-4bf4d28d3550 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:49.324399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d47c43b2-f75c-436b-8b16-4bf4d28d3550 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:49.338634 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d47c43b2-f75c-436b-8b16-4bf4d28d3550 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1316 microversion: 2.1 time: 0.663765 Jul 28 03:59:49.353765 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2702/4902] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:48 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1316 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:49.586779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2f6e2dac-8bc1-4806-a711-008ce1d3eaf1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:49.589862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2f6e2dac-8bc1-4806-a711-008ce1d3eaf1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:49.599792 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f6e2dac-8bc1-4806-a711-008ce1d3eaf1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:49.600238 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f6e2dac-8bc1-4806-a711-008ce1d3eaf1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:49.601077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f6e2dac-8bc1-4806-a711-008ce1d3eaf1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:49.601731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2f6e2dac-8bc1-4806-a711-008ce1d3eaf1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:49.783336 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2f6e2dac-8bc1-4806-a711-008ce1d3eaf1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:49.802858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2f6e2dac-8bc1-4806-a711-008ce1d3eaf1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:49.807190 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2f6e2dac-8bc1-4806-a711-008ce1d3eaf1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dee9ba6b0ce24bb7ac81c5a1af2bc7e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5708a9145a0e4f989a7ae77bd824fc6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:49.809367 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2f6e2dac-8bc1-4806-a711-008ce1d3eaf1 tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 200 len: 1363 microversion: 2.57 time: 0.249046 Jul 28 03:59:49.810276 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2201/4903] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:49 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:59:50.376380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-acdfb55d-cb5b-49cb-88de-4ed5835e83fc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:50.379009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-acdfb55d-cb5b-49cb-88de-4ed5835e83fc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:50.396901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acdfb55d-cb5b-49cb-88de-4ed5835e83fc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:50.398779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acdfb55d-cb5b-49cb-88de-4ed5835e83fc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:50.400056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acdfb55d-cb5b-49cb-88de-4ed5835e83fc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:50.401368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acdfb55d-cb5b-49cb-88de-4ed5835e83fc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:50.681259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-acdfb55d-cb5b-49cb-88de-4ed5835e83fc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:50.691635 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-acdfb55d-cb5b-49cb-88de-4ed5835e83fc tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1504 microversion: 2.1 time: 0.328222 Jul 28 03:59:50.693380 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2703/4904] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:50 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:50.727352 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ae4fa916-30cf-47cc-9c16-705f6cd96b00 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1144492388"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:50.728048 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ae4fa916-30cf-47cc-9c16-705f6cd96b00 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:50.738586 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae4fa916-30cf-47cc-9c16-705f6cd96b00 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:50.739376 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae4fa916-30cf-47cc-9c16-705f6cd96b00 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:50.740468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae4fa916-30cf-47cc-9c16-705f6cd96b00 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:50.741076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae4fa916-30cf-47cc-9c16-705f6cd96b00 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:50.841568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-011d172f-c0d1-4d29-859e-698c372eca3a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:50.843067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-011d172f-c0d1-4d29-859e-698c372eca3a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] [instance: 3539c9c0-fda3-4654-98a4-8edb7b536d74] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:50.852766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-011d172f-c0d1-4d29-859e-698c372eca3a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:50.853764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-011d172f-c0d1-4d29-859e-698c372eca3a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:50.855150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-011d172f-c0d1-4d29-859e-698c372eca3a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:50.855804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-011d172f-c0d1-4d29-859e-698c372eca3a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:50.884575 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-011d172f-c0d1-4d29-859e-698c372eca3a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] HTTP exception thrown: Instance 3539c9c0-fda3-4654-98a4-8edb7b536d74 could not be found. Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-011d172f-c0d1-4d29-859e-698c372eca3a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Request method failure captured: Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 HTTP/1.1 Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gmCLI03ZE58C7jmt6v3kceYfz7rfrMnY6llKVXgiQ1dcds0R7p0a2NeAKXFLi1VH6N37uVu998G6SwH1_ISurm9ok3BDYuuKUPy501ukok78-wxCj8htPeh5okjCsyQbf96VSfQlJ2Lb1QgWJ8fk8ciULA_W52uM5Z8DHHw7zA00sw Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.57 Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 5708a9145a0e4f989a7ae77bd824fc6f Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerShowV257Test-172844812 Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5708a9145a0e4f989a7ae77bd824fc6f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5708a9145a0e4f989a7ae77bd824fc6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5708a9145a0e4f989a7ae77bd824fc6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5708a9145a0e4f989a7ae77bd824fc6f"}]}] Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerShowV257Test-172844812 Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 5708a9145a0e4f989a7ae77bd824fc6f Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerShowV257Test-172844812 Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerShowV257Test-172844812-project Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: dee9ba6b0ce24bb7ac81c5a1af2bc7e0 Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerShowV257Test-172844812-project Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 3539c9c0-fda3-4654-98a4-8edb7b536d74 could not be found. Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '3539c9c0-fda3-4654-98a4-8edb7b536d74'} Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3539c9c0-fda3-4654-98a4-8edb7b536d74 could not be found. Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3539c9c0-fda3-4654-98a4-8edb7b536d74 could not be found. Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:50.886393 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:50.891417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:50.891417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:50.891417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:50.891417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:50.891417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:50.891417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3539c9c0-fda3-4654-98a4-8edb7b536d74 could not be found. Jul 28 03:59:50.891417 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:50.892848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-011d172f-c0d1-4d29-859e-698c372eca3a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] Returning 404 to user: Instance 3539c9c0-fda3-4654-98a4-8edb7b536d74 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:50.894567 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-011d172f-c0d1-4d29-859e-698c372eca3a tempest-ServerShowV257Test-172844812 tempest-ServerShowV257Test-172844812-project] 10.222.0.48 "GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74" status: 404 len: 111 microversion: 2.57 time: 0.061093 Jul 28 03:59:50.896055 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2704/4905] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 03:59:50 2022] GET /compute/v2.1/servers/3539c9c0-fda3-4654-98a4-8edb7b536d74 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:59:51.557344 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.network.security_group_api [None req-ae4fa916-30cf-47cc-9c16-705f6cd96b00 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Adding security group 1dc0da65-7183-4752-aad4-cd816895ce0b to port d3b3da2d-010a-471c-a63f-7d0f42e50be2 Jul 28 03:59:53.837320 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ae4fa916-30cf-47cc-9c16-705f6cd96b00 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e/action" status: 202 len: 0 microversion: 2.1 time: 3.118989 Jul 28 03:59:53.837958 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2202/4906] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:59:50 2022] POST /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e/action => generated 0 bytes in 3121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:59:53.850888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d319f2d5-e9f6-44c2-9a22-78bc30386815 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa66ffb670>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:53.858580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-6b9a191b-a47a-439c-83c3-cabcc1e13483 req-06731b80-b9f9-42fa-a9fc-791ab4201520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e", "tag": "d3b3da2d-010a-471c-a63f-7d0f42e50be2"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:53.889142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-6b9a191b-a47a-439c-83c3-cabcc1e13483 req-06731b80-b9f9-42fa-a9fc-791ab4201520 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:53.889975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-6b9a191b-a47a-439c-83c3-cabcc1e13483 req-06731b80-b9f9-42fa-a9fc-791ab4201520 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:53.904031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:53.933247 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-6b9a191b-a47a-439c-83c3-cabcc1e13483 req-06731b80-b9f9-42fa-a9fc-791ab4201520 service nova] Creating event network-changed:d3b3da2d-010a-471c-a63f-7d0f42e50be2 for instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e on n-h1-826756-3 Jul 28 03:59:53.945042 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-6b9a191b-a47a-439c-83c3-cabcc1e13483 req-06731b80-b9f9-42fa-a9fc-791ab4201520 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095372 Jul 28 03:59:53.948679 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2203/4907] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:54.939607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG neutronclient.v2_0.client [None req-d319f2d5-e9f6-44c2-9a22-78bc30386815 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 1dc0da65-7183-4752-aad4-cd816895ce0b in use.", "detail": ""}} {{(pid=126071) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 03:59:54.940404 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-d319f2d5-e9f6-44c2-9a22-78bc30386815 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Security Group 1dc0da65-7183-4752-aad4-cd816895ce0b in use. Jul 28 03:59:54.940404 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-ae77814d-c25a-4264-816d-99e0aef1e9da'] Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d319f2d5-e9f6-44c2-9a22-78bc30386815 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/os-security-groups/1dc0da65-7183-4752-aad4-cd816895ce0b HTTP/1.1 Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: exception: Security Group 1dc0da65-7183-4752-aad4-cd816895ce0b in use. Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-ae77814d-c25a-4264-816d-99e0aef1e9da'] Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1dc0da65-7183-4752-aad4-cd816895ce0b'} Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 03:59:54.943368 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 1dc0da65-7183-4752-aad4-cd816895ce0b in use. Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae77814d-c25a-4264-816d-99e0aef1e9da'] Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 1dc0da65-7183-4752-aad4-cd816895ce0b in use. Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae77814d-c25a-4264-816d-99e0aef1e9da'] Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 1dc0da65-7183-4752-aad4-cd816895ce0b in use. Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae77814d-c25a-4264-816d-99e0aef1e9da'] Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 1dc0da65-7183-4752-aad4-cd816895ce0b in use. Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ae77814d-c25a-4264-816d-99e0aef1e9da'] Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d319f2d5-e9f6-44c2-9a22-78bc30386815 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 400 to user: Security Group 1dc0da65-7183-4752-aad4-cd816895ce0b in use. Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-ae77814d-c25a-4264-816d-99e0aef1e9da'] {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:54.948076 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d319f2d5-e9f6-44c2-9a22-78bc30386815 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/1dc0da65-7183-4752-aad4-cd816895ce0b" status: 400 len: 185 microversion: 2.1 time: 1.102520 Jul 28 03:59:54.951215 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2705/4908] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 03:59:53 2022] DELETE /compute/v2.1/os-security-groups/1dc0da65-7183-4752-aad4-cd816895ce0b => generated 185 bytes in 1107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:59:54.958326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-68087705-cd73-4b6f-b494-ad77e0109c82 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:54.972916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-68087705-cd73-4b6f-b494-ad77e0109c82 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:54.983645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68087705-cd73-4b6f-b494-ad77e0109c82 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:54.984008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68087705-cd73-4b6f-b494-ad77e0109c82 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:54.985439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68087705-cd73-4b6f-b494-ad77e0109c82 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:54.985439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68087705-cd73-4b6f-b494-ad77e0109c82 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:55.064797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b422f6a7-f335-4adb-bff4-64c757acdc45 tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] Action: 'create', calling method: .version_select at 0x7ffa67482af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1366573316", "metadata": {"Type": "work"}}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:55.159669 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-68087705-cd73-4b6f-b494-ad77e0109c82 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e/action" status: 202 len: 0 microversion: 2.1 time: 0.204452 Jul 28 03:59:55.161161 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2706/4909] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 03:59:54 2022] POST /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:59:55.228069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc84b1ed-3226-4ff4-a799-acbe213e656f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:55.232061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cc84b1ed-3226-4ff4-a799-acbe213e656f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:55.272929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc84b1ed-3226-4ff4-a799-acbe213e656f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:55.273523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc84b1ed-3226-4ff4-a799-acbe213e656f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:55.281025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc84b1ed-3226-4ff4-a799-acbe213e656f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:55.284776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc84b1ed-3226-4ff4-a799-acbe213e656f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:55.702738 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b422f6a7-f335-4adb-bff4-64c757acdc45 tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.904384 Jul 28 03:59:55.703732 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2204/4910] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Jul 28 03:59:54 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 906 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 03:59:55.718265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-02e503f7-85ac-4b9f-8daa-ba9008a223b4 tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] Calling method '.version_select at 0x7ffa675bc790>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:55.818635 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-02e503f7-85ac-4b9f-8daa-ba9008a223b4 tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418" status: 200 len: 353 microversion: 2.1 time: 0.105401 Jul 28 03:59:55.819216 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2205/4911] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:55 2022] GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:56.008387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cc84b1ed-3226-4ff4-a799-acbe213e656f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:56.017044 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cc84b1ed-3226-4ff4-a799-acbe213e656f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1575 microversion: 2.1 time: 0.850027 Jul 28 03:59:56.035150 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2707/4912] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:55 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1575 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:56.834698 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-41a73930-4ded-4831-81fe-f3f139d53756 tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] Calling method '.version_select at 0x7ffa67482700>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:56.946411 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-41a73930-4ded-4831-81fe-f3f139d53756 tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418" status: 200 len: 353 microversion: 2.1 time: 0.117933 Jul 28 03:59:56.947546 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2206/4913] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:56 2022] GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:57.044198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-628a37e3-ebe8-4e8a-aafc-8d3ba9e2af2e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:57.045575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-628a37e3-ebe8-4e8a-aafc-8d3ba9e2af2e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:57.056692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-628a37e3-ebe8-4e8a-aafc-8d3ba9e2af2e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:57.059846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-628a37e3-ebe8-4e8a-aafc-8d3ba9e2af2e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:57.060980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-628a37e3-ebe8-4e8a-aafc-8d3ba9e2af2e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:57.061674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-628a37e3-ebe8-4e8a-aafc-8d3ba9e2af2e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:57.302151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-628a37e3-ebe8-4e8a-aafc-8d3ba9e2af2e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:57.311848 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-628a37e3-ebe8-4e8a-aafc-8d3ba9e2af2e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1575 microversion: 2.1 time: 0.272886 Jul 28 03:59:57.325759 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2708/4914] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:57 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1575 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:57.961544 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c8fa9505-6395-4931-8558-db5a34b6bdfd tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] Calling method '.version_select at 0x7ffa673814c0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:58.049615 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c8fa9505-6395-4931-8558-db5a34b6bdfd tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418" status: 200 len: 354 microversion: 2.1 time: 0.092657 Jul 28 03:59:58.056689 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2207/4915] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:57 2022] GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:58.063634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e780560b-d822-44fc-9b6c-f0db57759fc9 tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] Calling method '.version_select at 0x7ffa6789d310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:58.130790 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e780560b-d822-44fc-9b6c-f0db57759fc9 tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418" status: 200 len: 354 microversion: 2.1 time: 0.069763 Jul 28 03:59:58.144980 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2709/4916] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:58 2022] GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:58.150241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-31a733e8-2eab-4aba-bab4-f0a6349824aa tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] Calling method '.version_select at 0x7ffa67482d30>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:58.276526 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-31a733e8-2eab-4aba-bab4-f0a6349824aa tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418" status: 202 len: 0 microversion: 2.1 time: 0.131606 Jul 28 03:59:58.277726 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2208/4917] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 03:59:58 2022] DELETE /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:59:58.286495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e77e0f3-5834-4fc0-aa6c-f0b5dea6293a tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] Calling method '.version_select at 0x7ffa66fea3a0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:58.335506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-38dc33a9-48d7-4b36-947b-b5f9b77b2e88 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:58.338026 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-38dc33a9-48d7-4b36-947b-b5f9b77b2e88 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 03:59:58.347163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38dc33a9-48d7-4b36-947b-b5f9b77b2e88 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:58.347917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38dc33a9-48d7-4b36-947b-b5f9b77b2e88 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:58.350130 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38dc33a9-48d7-4b36-947b-b5f9b77b2e88 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:58.350871 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38dc33a9-48d7-4b36-947b-b5f9b77b2e88 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:58.436503 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e77e0f3-5834-4fc0-aa6c-f0b5dea6293a tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418" status: 200 len: 353 microversion: 2.1 time: 0.154105 Jul 28 03:59:58.437572 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2710/4918] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:58 2022] GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418 => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:59.081270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-38dc33a9-48d7-4b36-947b-b5f9b77b2e88 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:59.101907 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-38dc33a9-48d7-4b36-947b-b5f9b77b2e88 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1575 microversion: 2.1 time: 0.771856 Jul 28 03:59:59.103694 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2209/4919] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:58 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1575 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:59.456833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-23ee2b77-299c-4430-8673-10ac46dd901a tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] Calling method '.version_select at 0x7ffa66f9f3a0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:59.638150 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-23ee2b77-299c-4430-8673-10ac46dd901a tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418" status: 200 len: 353 microversion: 2.1 time: 0.191139 Jul 28 03:59:59.641921 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2711/4920] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:59 2022] GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418 => generated 353 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:00.135231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b7964de3-b957-404a-a1d5-659e03228bf3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:00.137709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b7964de3-b957-404a-a1d5-659e03228bf3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:00.166368 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7964de3-b957-404a-a1d5-659e03228bf3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:00.171000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7964de3-b957-404a-a1d5-659e03228bf3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:00.174935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7964de3-b957-404a-a1d5-659e03228bf3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:00.177779 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7964de3-b957-404a-a1d5-659e03228bf3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:00.657594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63de041e-cf2b-47b7-96f7-3da3e0b2c863 tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] Calling method '.version_select at 0x7ffa66fea1f0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:00.748948 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b7964de3-b957-404a-a1d5-659e03228bf3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:00.766913 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b7964de3-b957-404a-a1d5-659e03228bf3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1573 microversion: 2.1 time: 0.642235 Jul 28 04:00:00.771163 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63de041e-cf2b-47b7-96f7-3da3e0b2c863 tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418" status: 200 len: 353 microversion: 2.1 time: 0.120246 Jul 28 04:00:00.784564 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2210/4921] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:00 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1573 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:00.785278 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2712/4922] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 04:00:00 2022] GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418 => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:00.791311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b51e4a07-384e-4f5c-a175-7a2117e8f6d2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-201616080"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:00.792173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b51e4a07-384e-4f5c-a175-7a2117e8f6d2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:00.800661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:00.802973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b51e4a07-384e-4f5c-a175-7a2117e8f6d2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:00.803715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b51e4a07-384e-4f5c-a175-7a2117e8f6d2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:00.805568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b51e4a07-384e-4f5c-a175-7a2117e8f6d2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:00.806401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b51e4a07-384e-4f5c-a175-7a2117e8f6d2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.324939 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.network.security_group_api [None req-b51e4a07-384e-4f5c-a175-7a2117e8f6d2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Adding security group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e to port d3b3da2d-010a-471c-a63f-7d0f42e50be2 Jul 28 04:00:01.786892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ace99d04-5a40-446b-8a40-107021370f48 tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] Calling method '.version_select at 0x7ffa747da820>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:01.873988 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ace99d04-5a40-446b-8a40-107021370f48 tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418" status: 200 len: 353 microversion: 2.1 time: 0.091193 Jul 28 04:00:01.876581 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2713/4923] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 04:00:01 2022] GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:00:02.030737 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b51e4a07-384e-4f5c-a175-7a2117e8f6d2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e/action" status: 202 len: 0 microversion: 2.1 time: 1.244429 Jul 28 04:00:02.040323 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2211/4924] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:00:00 2022] POST /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e/action => generated 0 bytes in 1250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:00:02.043124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83715441-800c-43bf-ac17-7c68873804a2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa747da280>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:02.064851 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-1cbe613f-ae50-4e54-aa36-7c6c756c14b4 req-39c5b518-b275-472f-ad7d-fddcfc8edfaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e", "tag": "d3b3da2d-010a-471c-a63f-7d0f42e50be2"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:02.095291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1cbe613f-ae50-4e54-aa36-7c6c756c14b4 req-39c5b518-b275-472f-ad7d-fddcfc8edfaa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:02.111553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1cbe613f-ae50-4e54-aa36-7c6c756c14b4 req-39c5b518-b275-472f-ad7d-fddcfc8edfaa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:02.145274 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-1cbe613f-ae50-4e54-aa36-7c6c756c14b4 req-39c5b518-b275-472f-ad7d-fddcfc8edfaa service nova] Creating event network-changed:d3b3da2d-010a-471c-a63f-7d0f42e50be2 for instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e on n-h1-826756-3 Jul 28 04:00:02.156461 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-1cbe613f-ae50-4e54-aa36-7c6c756c14b4 req-39c5b518-b275-472f-ad7d-fddcfc8edfaa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095074 Jul 28 04:00:02.168679 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2212/4925] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:00:02.889917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-06ef6841-2dac-44a5-a7aa-7bb93453821c tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] Calling method '.version_select at 0x7ffa67750040>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:02.950267 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-06ef6841-2dac-44a5-a7aa-7bb93453821c tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] HTTP exception thrown: Volume 6c763d3f-5fb2-42da-8175-735745fb3418 could not be found. Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-06ef6841-2dac-44a5-a7aa-7bb93453821c tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] Request method failure captured: Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418 HTTP/1.1 Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gm6BjAp6BSAEHrEtKciwHr7OVA7fK6_Yl-0wjJ92bvniSCtfXX7f1wMmI-qUT0Fm0keryL4UIacZo3zd_z5cFg4ZKz7dWrElYOp2pLYFKBz3m5D9T6I8ZZS9t26AW7-pg34FS5CnCdS46-V3fiih6FYYRLn-PbWKA5aGgE8_8u8BhA Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 9ed7808bac3447ddb99f6be6169ad327 Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-VolumesGetTestJSON-1449304441 Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9ed7808bac3447ddb99f6be6169ad327"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9ed7808bac3447ddb99f6be6169ad327"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9ed7808bac3447ddb99f6be6169ad327"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9ed7808bac3447ddb99f6be6169ad327"}]}] Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-VolumesGetTestJSON-1449304441 Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 9ed7808bac3447ddb99f6be6169ad327 Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-VolumesGetTestJSON-1449304441 Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-VolumesGetTestJSON-1449304441-project Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 90db5756b2aa4338b9a5708d41f50306 Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-VolumesGetTestJSON-1449304441-project Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: exception: Volume 6c763d3f-5fb2-42da-8175-735745fb3418 could not be found. Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '6c763d3f-5fb2-42da-8175-735745fb3418'} Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c763d3f-5fb2-42da-8175-735745fb3418 could not be found. (HTTP 404) (Request-ID: req-03d3dcbd-5afe-4014-ab7c-577d1f4320dc) Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 04:00:02.952401 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c763d3f-5fb2-42da-8175-735745fb3418 could not be found. Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c763d3f-5fb2-42da-8175-735745fb3418 could not be found. Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c763d3f-5fb2-42da-8175-735745fb3418 could not be found. Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-06ef6841-2dac-44a5-a7aa-7bb93453821c tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] Returning 404 to user: Volume 6c763d3f-5fb2-42da-8175-735745fb3418 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:02.956480 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-06ef6841-2dac-44a5-a7aa-7bb93453821c tempest-VolumesGetTestJSON-1449304441 tempest-VolumesGetTestJSON-1449304441-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418" status: 404 len: 109 microversion: 2.1 time: 0.069086 Jul 28 04:00:02.962245 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2213/4926] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 04:00:02 2022] GET /compute/v2.1/os-volumes/6c763d3f-5fb2-42da-8175-735745fb3418 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:03.692099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG neutronclient.v2_0.client [None req-83715441-800c-43bf-ac17-7c68873804a2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e in use.", "detail": ""}} {{(pid=126071) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 04:00:03.693906 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-83715441-800c-43bf-ac17-7c68873804a2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Security Group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e in use. Jul 28 04:00:03.693906 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-33651b0d-588a-4b83-8c24-d97a9fa9f291'] Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83715441-800c-43bf-ac17-7c68873804a2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/os-security-groups/8c4a9f92-b347-48c8-91a4-b9570e2cd22e HTTP/1.1 Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: exception: Security Group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e in use. Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-33651b0d-588a-4b83-8c24-d97a9fa9f291'] Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8c4a9f92-b347-48c8-91a4-b9570e2cd22e'} Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 04:00:03.696864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e in use. Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33651b0d-588a-4b83-8c24-d97a9fa9f291'] Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e in use. Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33651b0d-588a-4b83-8c24-d97a9fa9f291'] Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e in use. Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33651b0d-588a-4b83-8c24-d97a9fa9f291'] Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e in use. Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33651b0d-588a-4b83-8c24-d97a9fa9f291'] Jul 28 04:00:03.700717 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:03.709939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83715441-800c-43bf-ac17-7c68873804a2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 400 to user: Security Group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e in use. Jul 28 04:00:03.709939 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-33651b0d-588a-4b83-8c24-d97a9fa9f291'] {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:03.712211 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-83715441-800c-43bf-ac17-7c68873804a2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/8c4a9f92-b347-48c8-91a4-b9570e2cd22e" status: 400 len: 185 microversion: 2.1 time: 1.675013 Jul 28 04:00:03.713587 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2714/4927] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 04:00:02 2022] DELETE /compute/v2.1/os-security-groups/8c4a9f92-b347-48c8-91a4-b9570e2cd22e => generated 185 bytes in 1677 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:00:03.723347 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-de2483db-4d9b-4188-a250-47f716d31004 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:03.724483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-de2483db-4d9b-4188-a250-47f716d31004 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:03.735176 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de2483db-4d9b-4188-a250-47f716d31004 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:03.735991 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de2483db-4d9b-4188-a250-47f716d31004 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:03.737690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de2483db-4d9b-4188-a250-47f716d31004 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:03.738363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-de2483db-4d9b-4188-a250-47f716d31004 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:03.811651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-de2483db-4d9b-4188-a250-47f716d31004 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:00:03.976886 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-de2483db-4d9b-4188-a250-47f716d31004 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 204 len: 0 microversion: 2.1 time: 0.257979 Jul 28 04:00:03.980587 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2214/4928] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:00:03 2022] DELETE /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:00:03.990790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5857f75f-661c-4abc-a0f8-b7ad4c0588c5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:03.991665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5857f75f-661c-4abc-a0f8-b7ad4c0588c5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:04.012793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5857f75f-661c-4abc-a0f8-b7ad4c0588c5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:04.013310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5857f75f-661c-4abc-a0f8-b7ad4c0588c5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:04.014146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5857f75f-661c-4abc-a0f8-b7ad4c0588c5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:04.014594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5857f75f-661c-4abc-a0f8-b7ad4c0588c5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:04.525913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5857f75f-661c-4abc-a0f8-b7ad4c0588c5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:04.558402 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5857f75f-661c-4abc-a0f8-b7ad4c0588c5 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1647 microversion: 2.1 time: 0.571620 Jul 28 04:00:04.560993 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2715/4929] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:03 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1647 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:05.583654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bba114da-526c-4ea9-9f0d-c155e4234745 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:05.584930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bba114da-526c-4ea9-9f0d-c155e4234745 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:05.600088 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bba114da-526c-4ea9-9f0d-c155e4234745 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:05.600751 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bba114da-526c-4ea9-9f0d-c155e4234745 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:05.601720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bba114da-526c-4ea9-9f0d-c155e4234745 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:05.602222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bba114da-526c-4ea9-9f0d-c155e4234745 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:05.953000 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bba114da-526c-4ea9-9f0d-c155e4234745 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:05.971362 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bba114da-526c-4ea9-9f0d-c155e4234745 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 200 len: 1647 microversion: 2.1 time: 0.392562 Jul 28 04:00:05.974653 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2215/4930] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:05 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 1647 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:06.316042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a20e810b-e4d0-4b8c-9378-58ce98f81a96 req-760fc315-1988-4cc2-87d1-deac54f8178e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e", "name": "network-vif-deleted", "tag": "d3b3da2d-010a-471c-a63f-7d0f42e50be2"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:06.346336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a20e810b-e4d0-4b8c-9378-58ce98f81a96 req-760fc315-1988-4cc2-87d1-deac54f8178e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:06.354403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a20e810b-e4d0-4b8c-9378-58ce98f81a96 req-760fc315-1988-4cc2-87d1-deac54f8178e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:06.400726 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a20e810b-e4d0-4b8c-9378-58ce98f81a96 req-760fc315-1988-4cc2-87d1-deac54f8178e service nova] Creating event network-vif-deleted:d3b3da2d-010a-471c-a63f-7d0f42e50be2 for instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e on n-h1-826756-3 Jul 28 04:00:06.421717 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a20e810b-e4d0-4b8c-9378-58ce98f81a96 req-760fc315-1988-4cc2-87d1-deac54f8178e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109340 Jul 28 04:00:06.424283 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2716/4931] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:06.996542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9d939d0e-6e33-4be1-af53-155b2b5ecf27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:06.998125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9d939d0e-6e33-4be1-af53-155b2b5ecf27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:07.033761 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d939d0e-6e33-4be1-af53-155b2b5ecf27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:07.037040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d939d0e-6e33-4be1-af53-155b2b5ecf27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:07.039802 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d939d0e-6e33-4be1-af53-155b2b5ecf27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:07.045233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d939d0e-6e33-4be1-af53-155b2b5ecf27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:07.127209 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-9d939d0e-6e33-4be1-af53-155b2b5ecf27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9d939d0e-6e33-4be1-af53-155b2b5ecf27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e HTTP/1.1 Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e'} Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:07.132733 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:07.138533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:07.138533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:07.138533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:07.138533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:07.138533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:07.138533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:07.138533 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:07.140110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9d939d0e-6e33-4be1-af53-155b2b5ecf27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 404 to user: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:07.142060 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9d939d0e-6e33-4be1-af53-155b2b5ecf27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 404 len: 111 microversion: 2.1 time: 0.149757 Jul 28 04:00:07.146098 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2216/4932] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:06 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:07.155845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c67be2f-1351-490c-86cd-254858f10a7a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa67015160>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:08.101485 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5c67be2f-1351-490c-86cd-254858f10a7a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/1dc0da65-7183-4752-aad4-cd816895ce0b" status: 202 len: 0 microversion: 2.1 time: 0.950206 Jul 28 04:00:08.102102 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2717/4933] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 04:00:07 2022] DELETE /compute/v2.1/os-security-groups/1dc0da65-7183-4752-aad4-cd816895ce0b => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:00:08.111274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fe009246-82ad-4897-a1a8-1eaff1a02b7e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa66fbe820>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:08.462247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6db1f431-6b5a-4e29-bfcc-e73f3d2ddf6a tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Action: 'create', calling method: .version_select at 0x7ffa6752bd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1520304345", "metadata": {"Type": "work"}}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6db1f431-6b5a-4e29-bfcc-e73f3d2ddf6a tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Request method failure captured: Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 122 Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gnHjw3PhhOPCUB_WrxzYorkU2odStuTaZt9ZcLwkvS48uhOq8KUTy7VyHQr9NbF-iUGHw_8cW-YJ7ofsq466ikI4bTrj5iile2bgWEmwk16Me9h6JlxLVOi2baGSIlm18RSe2RNO4ERS1g1YgV8Thfm4DC8K2Lx-wrx5oKmPcf6Rnk Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 6c3c360b299340d8a80e9073027ff496 Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6c3c360b299340d8a80e9073027ff496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c3c360b299340d8a80e9073027ff496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6c3c360b299340d8a80e9073027ff496"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c3c360b299340d8a80e9073027ff496"}]}] Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 6c3c360b299340d8a80e9073027ff496 Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-VolumesNegativeTest-1771589107-project Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: f25b558b0d624af387e7c3a1c9ceec5d Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-VolumesNegativeTest-1771589107-project Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1520304345", "metadata": {"Type": "work"}}} Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1520304345', 'metadata': {'Type': 'work'}}}} Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 04:00:08.466639 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 04:00:08.472052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 04:00:08.472052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.472052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:08.472052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.472052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:08.472052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:08.472052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:08.472052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 04:00:08.472052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 04:00:08.472052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 04:00:08.472052 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.472052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6db1f431-6b5a-4e29-bfcc-e73f3d2ddf6a tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:08.472052 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6db1f431-6b5a-4e29-bfcc-e73f3d2ddf6a tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.779286 Jul 28 04:00:08.473469 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2217/4934] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Jul 28 04:00:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 785 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:00:08.483008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-42113c8f-c2db-4fd7-8d86-d4a9cedd1f3c tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Action: 'create', calling method: .version_select at 0x7ffa67482670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1867198456", "metadata": {"Type": "work"}}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-42113c8f-c2db-4fd7-8d86-d4a9cedd1f3c tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Request method failure captured: Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 120 Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gnHjw3PhhOPCUB_WrxzYorkU2odStuTaZt9ZcLwkvS48uhOq8KUTy7VyHQr9NbF-iUGHw_8cW-YJ7ofsq466ikI4bTrj5iile2bgWEmwk16Me9h6JlxLVOi2baGSIlm18RSe2RNO4ERS1g1YgV8Thfm4DC8K2Lx-wrx5oKmPcf6Rnk Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 6c3c360b299340d8a80e9073027ff496 Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6c3c360b299340d8a80e9073027ff496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c3c360b299340d8a80e9073027ff496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6c3c360b299340d8a80e9073027ff496"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c3c360b299340d8a80e9073027ff496"}]}] Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 6c3c360b299340d8a80e9073027ff496 Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-VolumesNegativeTest-1771589107-project Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: f25b558b0d624af387e7c3a1c9ceec5d Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-VolumesNegativeTest-1771589107-project Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1867198456", "metadata": {"Type": "work"}}} Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1867198456', 'metadata': {'Type': 'work'}}}} Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi '0' Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 04:00:08.495587 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 04:00:08.500638 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 04:00:08.500638 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.500638 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:08.500638 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.500638 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:08.500638 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:08.500638 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:08.500638 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 04:00:08.500638 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 04:00:08.500638 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 04:00:08.500638 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.500638 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-42113c8f-c2db-4fd7-8d86-d4a9cedd1f3c tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:08.500638 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-42113c8f-c2db-4fd7-8d86-d4a9cedd1f3c tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021303 Jul 28 04:00:08.500638 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2218/4935] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Jul 28 04:00:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:00:08.517379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6ae9d3d9-d483-464b-bad4-00e46d0ab011 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Action: 'create', calling method: .version_select at 0x7ffa673f6040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-851023928", "metadata": {"Type": "work"}}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6ae9d3d9-d483-464b-bad4-00e46d0ab011 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Request method failure captured: Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 118 Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gnHjw3PhhOPCUB_WrxzYorkU2odStuTaZt9ZcLwkvS48uhOq8KUTy7VyHQr9NbF-iUGHw_8cW-YJ7ofsq466ikI4bTrj5iile2bgWEmwk16Me9h6JlxLVOi2baGSIlm18RSe2RNO4ERS1g1YgV8Thfm4DC8K2Lx-wrx5oKmPcf6Rnk Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 6c3c360b299340d8a80e9073027ff496 Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6c3c360b299340d8a80e9073027ff496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c3c360b299340d8a80e9073027ff496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6c3c360b299340d8a80e9073027ff496"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c3c360b299340d8a80e9073027ff496"}]}] Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 6c3c360b299340d8a80e9073027ff496 Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-VolumesNegativeTest-1771589107-project Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: f25b558b0d624af387e7c3a1c9ceec5d Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-VolumesNegativeTest-1771589107-project Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-851023928", "metadata": {"Type": "work"}}} Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-851023928', 'metadata': {'Type': 'work'}}}} Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise error Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi '' Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 04:00:08.521083 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 04:00:08.526058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 04:00:08.526058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.526058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:08.526058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.526058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:08.526058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:08.526058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:08.526058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 04:00:08.526058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 04:00:08.526058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 04:00:08.526058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:08.526058 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6ae9d3d9-d483-464b-bad4-00e46d0ab011 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:08.526058 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6ae9d3d9-d483-464b-bad4-00e46d0ab011 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009057 Jul 28 04:00:08.526058 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2219/4936] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Jul 28 04:00:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:00:08.535777 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1598d49f-3d19-475a-9846-a759f4307ed1 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Calling method '.version_select at 0x7ffa6740e5e0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:08.593766 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fe009246-82ad-4897-a1a8-1eaff1a02b7e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/8c4a9f92-b347-48c8-91a4-b9570e2cd22e" status: 202 len: 0 microversion: 2.1 time: 0.485864 Jul 28 04:00:08.593966 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2718/4937] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 04:00:08 2022] DELETE /compute/v2.1/os-security-groups/8c4a9f92-b347-48c8-91a4-b9570e2cd22e => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:00:08.609625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6ed68f01-4fa2-4a55-910a-3edc810e78c2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'create', calling method: .version_select at 0x7ffa66fbe1f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1133138652", "description": "tempest-description-1320309261"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:08.827783 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6ed68f01-4fa2-4a55-910a-3edc810e78c2 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.222219 Jul 28 04:00:08.829126 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2719/4938] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 04:00:08 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:08.844310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2e26a578-16b0-4c7c-b877-70a5342ce206 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Action: 'update', calling method: .version_select at 0x7ffa66fea550>, body: {"security_group": {"name": "tempest-sg-hth-1047553499", "description": "tempest-description-hth-711920833"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:09.006023 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-1598d49f-3d19-475a-9846-a759f4307ed1 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] HTTP exception thrown: Volume tempest-invalid-608029835 could not be found. Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1598d49f-3d19-475a-9846-a759f4307ed1 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Request method failure captured: Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-608029835 HTTP/1.1 Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gnHjw3PhhOPCUB_WrxzYorkU2odStuTaZt9ZcLwkvS48uhOq8KUTy7VyHQr9NbF-iUGHw_8cW-YJ7ofsq466ikI4bTrj5iile2bgWEmwk16Me9h6JlxLVOi2baGSIlm18RSe2RNO4ERS1g1YgV8Thfm4DC8K2Lx-wrx5oKmPcf6Rnk Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 6c3c360b299340d8a80e9073027ff496 Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6c3c360b299340d8a80e9073027ff496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c3c360b299340d8a80e9073027ff496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6c3c360b299340d8a80e9073027ff496"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c3c360b299340d8a80e9073027ff496"}]}] Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 6c3c360b299340d8a80e9073027ff496 Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-VolumesNegativeTest-1771589107-project Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: f25b558b0d624af387e7c3a1c9ceec5d Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-VolumesNegativeTest-1771589107-project Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: exception: Volume tempest-invalid-608029835 could not be found. Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'tempest-invalid-608029835'} Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-608029835 could not be found. (HTTP 404) (Request-ID: req-10b23cf6-023b-424a-ba58-fb0568aad8ac) Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:00:09.009491 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-608029835 could not be found. Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-608029835 could not be found. Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-608029835 could not be found. Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1598d49f-3d19-475a-9846-a759f4307ed1 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Returning 404 to user: Volume tempest-invalid-608029835 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1598d49f-3d19-475a-9846-a759f4307ed1 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-608029835" status: 404 len: 98 microversion: 2.1 time: 0.479806 Jul 28 04:00:09.014818 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2220/4939] 10.222.0.48 () {58 vars in 1215 bytes} [Thu Jul 28 04:00:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-608029835 => generated 98 bytes in 485 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 04:00:09.027017 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-59acfe49-608e-4aed-9ffc-ec5e2f29fea9 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009951 Jul 28 04:00:09.027785 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2221/4940] 10.222.0.48 () {58 vars in 1140 bytes} [Thu Jul 28 04:00:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 04:00:09.061035 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-53c3297d-ab00-4f64-8794-1623aae10d3b tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017780 Jul 28 04:00:09.062875 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2222/4941] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 04:00:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 04:00:09.081351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3867efbd-ae82-4642-bebb-777b91c4267f tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Calling method '.version_select at 0x7ffa6752b940>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:09.099935 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2e26a578-16b0-4c7c-b877-70a5342ce206 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "PUT /compute/v2.1/os-security-groups/b4439bcd-bad8-41a5-83c7-6b5085cb3b5d" status: 200 len: 217 microversion: 2.1 time: 0.259488 Jul 28 04:00:09.101051 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2720/4942] 10.222.0.48 () {60 vars in 1290 bytes} [Thu Jul 28 04:00:08 2022] PUT /compute/v2.1/os-security-groups/b4439bcd-bad8-41a5-83c7-6b5085cb3b5d => generated 217 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:09.115802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5dadc28b-e435-4790-98ea-ae74c16160c0 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa66fb0790>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:09.159347 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-3867efbd-ae82-4642-bebb-777b91c4267f tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] HTTP exception thrown: Volume 6803bd19-d4c3-4b2a-91c5-cc55ac188faf could not be found. Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3867efbd-ae82-4642-bebb-777b91c4267f tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Request method failure captured: Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/os-volumes/6803bd19-d4c3-4b2a-91c5-cc55ac188faf HTTP/1.1 Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gnHjw3PhhOPCUB_WrxzYorkU2odStuTaZt9ZcLwkvS48uhOq8KUTy7VyHQr9NbF-iUGHw_8cW-YJ7ofsq466ikI4bTrj5iile2bgWEmwk16Me9h6JlxLVOi2baGSIlm18RSe2RNO4ERS1g1YgV8Thfm4DC8K2Lx-wrx5oKmPcf6Rnk Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 6c3c360b299340d8a80e9073027ff496 Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6c3c360b299340d8a80e9073027ff496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c3c360b299340d8a80e9073027ff496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6c3c360b299340d8a80e9073027ff496"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c3c360b299340d8a80e9073027ff496"}]}] Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 6c3c360b299340d8a80e9073027ff496 Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-VolumesNegativeTest-1771589107-project Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: f25b558b0d624af387e7c3a1c9ceec5d Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-VolumesNegativeTest-1771589107-project Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: exception: Volume 6803bd19-d4c3-4b2a-91c5-cc55ac188faf could not be found. Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '6803bd19-d4c3-4b2a-91c5-cc55ac188faf'} Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6803bd19-d4c3-4b2a-91c5-cc55ac188faf could not be found. (HTTP 404) (Request-ID: req-be86187e-0192-42b5-96bd-1f2657f14b8b) Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 04:00:09.161719 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6803bd19-d4c3-4b2a-91c5-cc55ac188faf could not be found. Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6803bd19-d4c3-4b2a-91c5-cc55ac188faf could not be found. Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6803bd19-d4c3-4b2a-91c5-cc55ac188faf could not be found. Jul 28 04:00:09.166058 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.170137 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3867efbd-ae82-4642-bebb-777b91c4267f tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Returning 404 to user: Volume 6803bd19-d4c3-4b2a-91c5-cc55ac188faf could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:09.171439 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3867efbd-ae82-4642-bebb-777b91c4267f tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/6803bd19-d4c3-4b2a-91c5-cc55ac188faf" status: 404 len: 109 microversion: 2.1 time: 0.102787 Jul 28 04:00:09.172314 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2223/4943] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 04:00:09 2022] DELETE /compute/v2.1/os-volumes/6803bd19-d4c3-4b2a-91c5-cc55ac188faf => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:09.192460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-03ef4e4d-6f43-440d-8bcd-c42ead386936 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Calling method '.version_select at 0x7ffa675bcc10>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:09.274199 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-03ef4e4d-6f43-440d-8bcd-c42ead386936 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] HTTP exception thrown: Volume 101ec151-a000-4a06-8309-b33b9a866da9 could not be found. Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-03ef4e4d-6f43-440d-8bcd-c42ead386936 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Request method failure captured: Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/os-volumes/101ec151-a000-4a06-8309-b33b9a866da9 HTTP/1.1 Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gnHjw3PhhOPCUB_WrxzYorkU2odStuTaZt9ZcLwkvS48uhOq8KUTy7VyHQr9NbF-iUGHw_8cW-YJ7ofsq466ikI4bTrj5iile2bgWEmwk16Me9h6JlxLVOi2baGSIlm18RSe2RNO4ERS1g1YgV8Thfm4DC8K2Lx-wrx5oKmPcf6Rnk Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 6c3c360b299340d8a80e9073027ff496 Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6c3c360b299340d8a80e9073027ff496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c3c360b299340d8a80e9073027ff496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6c3c360b299340d8a80e9073027ff496"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6c3c360b299340d8a80e9073027ff496"}]}] Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 6c3c360b299340d8a80e9073027ff496 Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-VolumesNegativeTest-1771589107 Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-VolumesNegativeTest-1771589107-project Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: f25b558b0d624af387e7c3a1c9ceec5d Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-VolumesNegativeTest-1771589107-project Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: exception: Volume 101ec151-a000-4a06-8309-b33b9a866da9 could not be found. Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '101ec151-a000-4a06-8309-b33b9a866da9'} Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 101ec151-a000-4a06-8309-b33b9a866da9 could not be found. (HTTP 404) (Request-ID: req-52b4f93d-f572-456d-b515-cb5b28f97c54) Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 04:00:09.276197 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 101ec151-a000-4a06-8309-b33b9a866da9 could not be found. Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 101ec151-a000-4a06-8309-b33b9a866da9 could not be found. Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 101ec151-a000-4a06-8309-b33b9a866da9 could not be found. Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-03ef4e4d-6f43-440d-8bcd-c42ead386936 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] Returning 404 to user: Volume 101ec151-a000-4a06-8309-b33b9a866da9 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-03ef4e4d-6f43-440d-8bcd-c42ead386936 tempest-VolumesNegativeTest-1771589107 tempest-VolumesNegativeTest-1771589107-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/101ec151-a000-4a06-8309-b33b9a866da9" status: 404 len: 109 microversion: 2.1 time: 0.093104 Jul 28 04:00:09.280161 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2224/4944] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Jul 28 04:00:09 2022] GET /compute/v2.1/os-volumes/101ec151-a000-4a06-8309-b33b9a866da9 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:09.364059 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5dadc28b-e435-4790-98ea-ae74c16160c0 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/os-security-groups/b4439bcd-bad8-41a5-83c7-6b5085cb3b5d" status: 200 len: 217 microversion: 2.1 time: 0.253950 Jul 28 04:00:09.364945 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2721/4945] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 04:00:09 2022] GET /compute/v2.1/os-security-groups/b4439bcd-bad8-41a5-83c7-6b5085cb3b5d => generated 217 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:09.378920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9e88b625-d6c0-42e8-9b80-2c3a3991a1ec tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa675fae50>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:09.855811 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9e88b625-d6c0-42e8-9b80-2c3a3991a1ec tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/b4439bcd-bad8-41a5-83c7-6b5085cb3b5d" status: 202 len: 0 microversion: 2.1 time: 0.481111 Jul 28 04:00:09.859782 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2225/4946] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 04:00:09 2022] DELETE /compute/v2.1/os-security-groups/b4439bcd-bad8-41a5-83c7-6b5085cb3b5d => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:00:09.872268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-161881ef-206b-4913-b6c5-9de3940e5afa tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:09.874201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-161881ef-206b-4913-b6c5-9de3940e5afa tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:09.908831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-161881ef-206b-4913-b6c5-9de3940e5afa tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:09.910996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-161881ef-206b-4913-b6c5-9de3940e5afa tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.920703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-161881ef-206b-4913-b6c5-9de3940e5afa tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:09.921501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-161881ef-206b-4913-b6c5-9de3940e5afa tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.979136 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-161881ef-206b-4913-b6c5-9de3940e5afa tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-161881ef-206b-4913-b6c5-9de3940e5afa tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e HTTP/1.1 Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e'} Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:00:09.982108 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:09.990846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:09.990846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.990846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:09.990846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.990846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:09.990846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:09.990846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:09.990846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:09.990846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:09.990846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:09.990846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:09.990846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-161881ef-206b-4913-b6c5-9de3940e5afa tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 404 to user: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:09.990846 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-161881ef-206b-4913-b6c5-9de3940e5afa tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 404 len: 111 microversion: 2.1 time: 0.121970 Jul 28 04:00:09.990846 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2722/4947] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:00:09 2022] DELETE /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:10.003276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4735717b-16bd-438b-9296-f1b41b722e8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:10.003895 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4735717b-16bd-438b-9296-f1b41b722e8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:10.011847 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4735717b-16bd-438b-9296-f1b41b722e8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:10.012311 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4735717b-16bd-438b-9296-f1b41b722e8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:10.013141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4735717b-16bd-438b-9296-f1b41b722e8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:10.013580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4735717b-16bd-438b-9296-f1b41b722e8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:10.042466 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-4735717b-16bd-438b-9296-f1b41b722e8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4735717b-16bd-438b-9296-f1b41b722e8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e HTTP/1.1 Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e'} Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.045025 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.049006 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.049006 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:10.049006 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:10.049006 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:10.049006 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:10.049006 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. Jul 28 04:00:10.049006 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.054406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4735717b-16bd-438b-9296-f1b41b722e8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 404 to user: Instance 7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:10.054693 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4735717b-16bd-438b-9296-f1b41b722e8a tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e" status: 404 len: 111 microversion: 2.1 time: 0.064636 Jul 28 04:00:10.057510 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2226/4948] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:09 2022] GET /compute/v2.1/servers/7a5f0c38-cee8-47fc-8715-dfa0fad3fe6e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:10.065484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-29873ef2-68f4-450f-ac1d-05ab06e18f5e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa747da1f0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:10.127646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG neutronclient.v2_0.client [None req-29873ef2-68f4-450f-ac1d-05ab06e18f5e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e does not exist", "detail": ""}} {{(pid=126071) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 04:00:10.128801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.security_group_api [None req-29873ef2-68f4-450f-ac1d-05ab06e18f5e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Neutron security group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e not found {{(pid=126071) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 04:00:10.129748 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-29873ef2-68f4-450f-ac1d-05ab06e18f5e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Security group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e does not exist Jul 28 04:00:10.129748 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-cfb1ac74-a21e-4470-87df-0aad9d9da72e'] Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-29873ef2-68f4-450f-ac1d-05ab06e18f5e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/os-security-groups/8c4a9f92-b347-48c8-91a4-b9570e2cd22e HTTP/1.1 Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: exception: Security group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e does not exist Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-cfb1ac74-a21e-4470-87df-0aad9d9da72e'] Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8c4a9f92-b347-48c8-91a4-b9570e2cd22e'} Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 04:00:10.133086 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e does not exist Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfb1ac74-a21e-4470-87df-0aad9d9da72e'] Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e does not exist Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfb1ac74-a21e-4470-87df-0aad9d9da72e'] Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e does not exist Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfb1ac74-a21e-4470-87df-0aad9d9da72e'] Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e does not exist Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cfb1ac74-a21e-4470-87df-0aad9d9da72e'] Jul 28 04:00:10.138125 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.147549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-29873ef2-68f4-450f-ac1d-05ab06e18f5e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 404 to user: Security group 8c4a9f92-b347-48c8-91a4-b9570e2cd22e does not exist Jul 28 04:00:10.147549 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-cfb1ac74-a21e-4470-87df-0aad9d9da72e'] {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:10.147549 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-29873ef2-68f4-450f-ac1d-05ab06e18f5e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/8c4a9f92-b347-48c8-91a4-b9570e2cd22e" status: 404 len: 194 microversion: 2.1 time: 0.086859 Jul 28 04:00:10.148697 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2723/4949] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 04:00:10 2022] DELETE /compute/v2.1/os-security-groups/8c4a9f92-b347-48c8-91a4-b9570e2cd22e => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:10.157768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f42a3540-c197-4ced-92fb-2c2b91f2bed8 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa675ac5e0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:10.224123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG neutronclient.v2_0.client [None req-f42a3540-c197-4ced-92fb-2c2b91f2bed8 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1dc0da65-7183-4752-aad4-cd816895ce0b does not exist", "detail": ""}} {{(pid=126072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 04:00:10.225148 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.security_group_api [None req-f42a3540-c197-4ced-92fb-2c2b91f2bed8 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Neutron security group 1dc0da65-7183-4752-aad4-cd816895ce0b not found {{(pid=126072) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 04:00:10.225835 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-f42a3540-c197-4ced-92fb-2c2b91f2bed8 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Security group 1dc0da65-7183-4752-aad4-cd816895ce0b does not exist Jul 28 04:00:10.225835 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-1a0f4103-5d02-4b69-bf5b-cf00150640b8'] Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f42a3540-c197-4ced-92fb-2c2b91f2bed8 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/os-security-groups/1dc0da65-7183-4752-aad4-cd816895ce0b HTTP/1.1 Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: exception: Security group 1dc0da65-7183-4752-aad4-cd816895ce0b does not exist Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-1a0f4103-5d02-4b69-bf5b-cf00150640b8'] Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '1dc0da65-7183-4752-aad4-cd816895ce0b'} Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 04:00:10.229370 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1dc0da65-7183-4752-aad4-cd816895ce0b does not exist Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a0f4103-5d02-4b69-bf5b-cf00150640b8'] Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1dc0da65-7183-4752-aad4-cd816895ce0b does not exist Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a0f4103-5d02-4b69-bf5b-cf00150640b8'] Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1dc0da65-7183-4752-aad4-cd816895ce0b does not exist Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a0f4103-5d02-4b69-bf5b-cf00150640b8'] Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1dc0da65-7183-4752-aad4-cd816895ce0b does not exist Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1a0f4103-5d02-4b69-bf5b-cf00150640b8'] Jul 28 04:00:10.234405 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.239198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f42a3540-c197-4ced-92fb-2c2b91f2bed8 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 404 to user: Security group 1dc0da65-7183-4752-aad4-cd816895ce0b does not exist Jul 28 04:00:10.239198 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-1a0f4103-5d02-4b69-bf5b-cf00150640b8'] {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:10.240086 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f42a3540-c197-4ced-92fb-2c2b91f2bed8 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/1dc0da65-7183-4752-aad4-cd816895ce0b" status: 404 len: 194 microversion: 2.1 time: 0.087112 Jul 28 04:00:10.240755 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2227/4950] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 04:00:10 2022] DELETE /compute/v2.1/os-security-groups/1dc0da65-7183-4752-aad4-cd816895ce0b => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:00:10.249480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d02d4f1e-7b6a-434d-981c-9ca049a59681 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa66fbe310>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:10.357008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG neutronclient.v2_0.client [None req-d02d4f1e-7b6a-434d-981c-9ca049a59681 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist", "detail": ""}} {{(pid=126071) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 04:00:10.357665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.security_group_api [None req-d02d4f1e-7b6a-434d-981c-9ca049a59681 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Neutron security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 not found {{(pid=126071) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 04:00:10.358289 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-d02d4f1e-7b6a-434d-981c-9ca049a59681 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist Jul 28 04:00:10.358289 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-ee56b24f-39b1-44dd-826e-3651a546d3f1'] Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d02d4f1e-7b6a-434d-981c-9ca049a59681 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/os-security-groups/76885417-4a3e-4c02-8fa3-08fc506c4a58 HTTP/1.1 Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: exception: Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-ee56b24f-39b1-44dd-826e-3651a546d3f1'] Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '76885417-4a3e-4c02-8fa3-08fc506c4a58'} Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 04:00:10.360199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee56b24f-39b1-44dd-826e-3651a546d3f1'] Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee56b24f-39b1-44dd-826e-3651a546d3f1'] Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee56b24f-39b1-44dd-826e-3651a546d3f1'] Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee56b24f-39b1-44dd-826e-3651a546d3f1'] Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d02d4f1e-7b6a-434d-981c-9ca049a59681 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 404 to user: Security group 76885417-4a3e-4c02-8fa3-08fc506c4a58 does not exist Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-ee56b24f-39b1-44dd-826e-3651a546d3f1'] {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d02d4f1e-7b6a-434d-981c-9ca049a59681 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/76885417-4a3e-4c02-8fa3-08fc506c4a58" status: 404 len: 194 microversion: 2.1 time: 0.116149 Jul 28 04:00:10.368746 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2724/4951] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 04:00:10 2022] DELETE /compute/v2.1/os-security-groups/76885417-4a3e-4c02-8fa3-08fc506c4a58 => generated 194 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:10.371694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-25a2a2ef-afa6-46e8-b1b6-d7adc60b6575 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa674f9f70>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:10.461624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG neutronclient.v2_0.client [None req-25a2a2ef-afa6-46e8-b1b6-d7adc60b6575 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist", "detail": ""}} {{(pid=126072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 04:00:10.462271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.security_group_api [None req-25a2a2ef-afa6-46e8-b1b6-d7adc60b6575 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Neutron security group 97dba6ab-250d-4e40-94c6-15b43f43baac not found {{(pid=126072) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 04:00:10.462730 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-25a2a2ef-afa6-46e8-b1b6-d7adc60b6575 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist Jul 28 04:00:10.462730 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-fadf574d-9ec8-4818-94d3-02d5a20b1d88'] Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-25a2a2ef-afa6-46e8-b1b6-d7adc60b6575 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/os-security-groups/97dba6ab-250d-4e40-94c6-15b43f43baac HTTP/1.1 Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: exception: Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-fadf574d-9ec8-4818-94d3-02d5a20b1d88'] Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '97dba6ab-250d-4e40-94c6-15b43f43baac'} Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 04:00:10.465053 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fadf574d-9ec8-4818-94d3-02d5a20b1d88'] Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fadf574d-9ec8-4818-94d3-02d5a20b1d88'] Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fadf574d-9ec8-4818-94d3-02d5a20b1d88'] Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fadf574d-9ec8-4818-94d3-02d5a20b1d88'] Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-25a2a2ef-afa6-46e8-b1b6-d7adc60b6575 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 404 to user: Security group 97dba6ab-250d-4e40-94c6-15b43f43baac does not exist Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-fadf574d-9ec8-4818-94d3-02d5a20b1d88'] {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-25a2a2ef-afa6-46e8-b1b6-d7adc60b6575 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/97dba6ab-250d-4e40-94c6-15b43f43baac" status: 404 len: 194 microversion: 2.1 time: 0.099962 Jul 28 04:00:10.468912 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2228/4952] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 04:00:10 2022] DELETE /compute/v2.1/os-security-groups/97dba6ab-250d-4e40-94c6-15b43f43baac => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:10.475593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-55418e96-62a5-4f50-a814-80d4e6af405f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa66f9fe50>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:10.566257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG neutronclient.v2_0.client [None req-55418e96-62a5-4f50-a814-80d4e6af405f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist", "detail": ""}} {{(pid=126071) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 04:00:10.566859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.security_group_api [None req-55418e96-62a5-4f50-a814-80d4e6af405f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Neutron security group bf4b5198-75d6-484b-9e6c-f93e972adb5a not found {{(pid=126071) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 04:00:10.567381 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-55418e96-62a5-4f50-a814-80d4e6af405f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist Jul 28 04:00:10.567381 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-6af95913-fcf2-4a89-8fd6-beb80ee9d389'] Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-55418e96-62a5-4f50-a814-80d4e6af405f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/os-security-groups/bf4b5198-75d6-484b-9e6c-f93e972adb5a HTTP/1.1 Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: method: Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: exception: Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-6af95913-fcf2-4a89-8fd6-beb80ee9d389'] Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'bf4b5198-75d6-484b-9e6c-f93e972adb5a'} Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 04:00:10.569248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6af95913-fcf2-4a89-8fd6-beb80ee9d389'] Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6af95913-fcf2-4a89-8fd6-beb80ee9d389'] Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6af95913-fcf2-4a89-8fd6-beb80ee9d389'] Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6af95913-fcf2-4a89-8fd6-beb80ee9d389'] Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-55418e96-62a5-4f50-a814-80d4e6af405f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 404 to user: Security group bf4b5198-75d6-484b-9e6c-f93e972adb5a does not exist Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: Neutron server returns request_ids: ['req-6af95913-fcf2-4a89-8fd6-beb80ee9d389'] {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-55418e96-62a5-4f50-a814-80d4e6af405f tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/bf4b5198-75d6-484b-9e6c-f93e972adb5a" status: 404 len: 194 microversion: 2.1 time: 0.099318 Jul 28 04:00:10.573530 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2725/4953] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 04:00:10 2022] DELETE /compute/v2.1/os-security-groups/bf4b5198-75d6-484b-9e6c-f93e972adb5a => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:10.580665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e9c0cb16-8fb1-4200-8b5d-d6e0af4fd814 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa675ac430>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:10.778123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG neutronclient.v2_0.client [None req-e9c0cb16-8fb1-4200-8b5d-d6e0af4fd814 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist", "detail": ""}} {{(pid=126072) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 28 04:00:10.778740 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.security_group_api [None req-e9c0cb16-8fb1-4200-8b5d-d6e0af4fd814 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Neutron security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 not found {{(pid=126072) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 28 04:00:10.779393 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-e9c0cb16-8fb1-4200-8b5d-d6e0af4fd814 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist Jul 28 04:00:10.779393 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-6d00efd7-ecc6-4ea1-b777-9efb8597aec2'] Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e9c0cb16-8fb1-4200-8b5d-d6e0af4fd814 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: request: DELETE /compute/v2.1/os-security-groups/ae076cda-edaa-4afa-a8c3-92fde0b0ce77 HTTP/1.1 Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: exception: Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-6d00efd7-ecc6-4ea1-b777-9efb8597aec2'] Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'ae076cda-edaa-4afa-a8c3-92fde0b0ce77'} Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 28 04:00:10.781694 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d00efd7-ecc6-4ea1-b777-9efb8597aec2'] Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d00efd7-ecc6-4ea1-b777-9efb8597aec2'] Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d00efd7-ecc6-4ea1-b777-9efb8597aec2'] Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d00efd7-ecc6-4ea1-b777-9efb8597aec2'] Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e9c0cb16-8fb1-4200-8b5d-d6e0af4fd814 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 404 to user: Security group ae076cda-edaa-4afa-a8c3-92fde0b0ce77 does not exist Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: Neutron server returns request_ids: ['req-6d00efd7-ecc6-4ea1-b777-9efb8597aec2'] {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e9c0cb16-8fb1-4200-8b5d-d6e0af4fd814 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/ae076cda-edaa-4afa-a8c3-92fde0b0ce77" status: 404 len: 194 microversion: 2.1 time: 0.207437 Jul 28 04:00:10.786005 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2229/4954] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 04:00:10 2022] DELETE /compute/v2.1/os-security-groups/ae076cda-edaa-4afa-a8c3-92fde0b0ce77 => generated 194 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:10.798981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c72bd99-d571-4bce-bdd2-fa5b6b9b814e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:10.799465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c72bd99-d571-4bce-bdd2-fa5b6b9b814e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:10.818014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c72bd99-d571-4bce-bdd2-fa5b6b9b814e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:10.818497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c72bd99-d571-4bce-bdd2-fa5b6b9b814e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:10.819300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c72bd99-d571-4bce-bdd2-fa5b6b9b814e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:10.821694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c72bd99-d571-4bce-bdd2-fa5b6b9b814e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:10.886867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c72bd99-d571-4bce-bdd2-fa5b6b9b814e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:00:10.968746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:11.172436 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c72bd99-d571-4bce-bdd2-fa5b6b9b814e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 204 len: 0 microversion: 2.1 time: 0.380568 Jul 28 04:00:11.174025 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2726/4955] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:00:10 2022] DELETE /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:00:11.185257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6b5d256d-85b5-424d-9409-83660aef99ec tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:11.195590 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6b5d256d-85b5-424d-9409-83660aef99ec tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:11.224386 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6b5d256d-85b5-424d-9409-83660aef99ec tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:11.233503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6b5d256d-85b5-424d-9409-83660aef99ec tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:11.234296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6b5d256d-85b5-424d-9409-83660aef99ec tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:11.234747 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6b5d256d-85b5-424d-9409-83660aef99ec tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:11.568239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6b5d256d-85b5-424d-9409-83660aef99ec tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:11.578533 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6b5d256d-85b5-424d-9409-83660aef99ec tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1646 microversion: 2.1 time: 0.399621 Jul 28 04:00:11.597625 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2230/4956] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:11 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1646 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:12.612502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-64756f1e-7cb3-406d-a86a-7178e8676a27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:12.613352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-64756f1e-7cb3-406d-a86a-7178e8676a27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:12.622428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64756f1e-7cb3-406d-a86a-7178e8676a27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:12.623969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64756f1e-7cb3-406d-a86a-7178e8676a27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:12.625002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64756f1e-7cb3-406d-a86a-7178e8676a27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:12.627840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64756f1e-7cb3-406d-a86a-7178e8676a27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:13.301492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-64756f1e-7cb3-406d-a86a-7178e8676a27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:13.317744 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-64756f1e-7cb3-406d-a86a-7178e8676a27 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1646 microversion: 2.1 time: 0.708733 Jul 28 04:00:13.332467 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2727/4957] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:12 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1646 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:14.346344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-afe6df6d-6479-4680-bbd8-e4b487496cb3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:14.347626 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-afe6df6d-6479-4680-bbd8-e4b487496cb3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:14.355615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afe6df6d-6479-4680-bbd8-e4b487496cb3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:14.355776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afe6df6d-6479-4680-bbd8-e4b487496cb3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:14.356599 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afe6df6d-6479-4680-bbd8-e4b487496cb3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:14.357057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afe6df6d-6479-4680-bbd8-e4b487496cb3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:15.043118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-000aa428-ddc8-4354-81a9-391ef117dff4 req-d463c9d9-329d-4ca7-aac8-1f56e7e7b68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c73547-c0da-4d3f-a9c5-e13817f28211", "name": "network-vif-deleted", "tag": "54af3d75-c44e-49da-844e-aea727885d7d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:15.066316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-000aa428-ddc8-4354-81a9-391ef117dff4 req-d463c9d9-329d-4ca7-aac8-1f56e7e7b68a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:15.066767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-000aa428-ddc8-4354-81a9-391ef117dff4 req-d463c9d9-329d-4ca7-aac8-1f56e7e7b68a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:15.118573 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-000aa428-ddc8-4354-81a9-391ef117dff4 req-d463c9d9-329d-4ca7-aac8-1f56e7e7b68a service nova] Creating event network-vif-deleted:54af3d75-c44e-49da-844e-aea727885d7d for instance 57c73547-c0da-4d3f-a9c5-e13817f28211 on n-h1-826756-3 Jul 28 04:00:15.137499 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-000aa428-ddc8-4354-81a9-391ef117dff4 req-d463c9d9-329d-4ca7-aac8-1f56e7e7b68a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098174 Jul 28 04:00:15.138184 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2728/4958] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:15.158877 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-afe6df6d-6479-4680-bbd8-e4b487496cb3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ada96f18e88f47b7b9c1994d0d7dbcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '684191c692c445ad92f5d76f10790418', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:15.179260 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-afe6df6d-6479-4680-bbd8-e4b487496cb3 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 200 len: 1646 microversion: 2.1 time: 0.834616 Jul 28 04:00:15.181142 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2231/4959] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:14 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 1646 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:16.204181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0374b7f7-cda8-454b-9a1b-a89d37128f6e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:16.206085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0374b7f7-cda8-454b-9a1b-a89d37128f6e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] [instance: 57c73547-c0da-4d3f-a9c5-e13817f28211] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:16.218699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0374b7f7-cda8-454b-9a1b-a89d37128f6e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:16.220292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0374b7f7-cda8-454b-9a1b-a89d37128f6e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:16.222064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0374b7f7-cda8-454b-9a1b-a89d37128f6e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:16.224946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0374b7f7-cda8-454b-9a1b-a89d37128f6e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:16.257921 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-0374b7f7-cda8-454b-9a1b-a89d37128f6e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] HTTP exception thrown: Instance 57c73547-c0da-4d3f-a9c5-e13817f28211 could not be found. Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0374b7f7-cda8-454b-9a1b-a89d37128f6e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Request method failure captured: Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 HTTP/1.1 Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gl61vwEgbqoz9s0dInuFzbY_ECeqvplEJaXnX4FvKTrz6wUA4DGVanjLgjNKUDVqoVtmkS9zcnhal-qRjIxEBoIVXudDbdKeRUemonkxdv3f9S8_U77XMcxVjaR3OQaSTdIjK-WruFy3BlZEr68qPRMSQsnKs1jarx3_U6V8GG5iMg Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/684191c692c445ad92f5d76f10790418"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_684191c692c445ad92f5d76f10790418"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/684191c692c445ad92f5d76f10790418"}]}] Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 684191c692c445ad92f5d76f10790418 Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1443517100 Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ada96f18e88f47b7b9c1994d0d7dbcaf Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-SecurityGroupsTestJSON-1443517100-project Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 57c73547-c0da-4d3f-a9c5-e13817f28211 could not be found. Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '57c73547-c0da-4d3f-a9c5-e13817f28211'} Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57c73547-c0da-4d3f-a9c5-e13817f28211 could not be found. Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57c73547-c0da-4d3f-a9c5-e13817f28211 could not be found. Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:16.262680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:16.266702 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:16.266702 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:16.266702 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:16.266702 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:16.266702 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:16.266702 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57c73547-c0da-4d3f-a9c5-e13817f28211 could not be found. Jul 28 04:00:16.266702 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:00:16.269200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0374b7f7-cda8-454b-9a1b-a89d37128f6e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Returning 404 to user: Instance 57c73547-c0da-4d3f-a9c5-e13817f28211 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:16.270525 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0374b7f7-cda8-454b-9a1b-a89d37128f6e tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211" status: 404 len: 111 microversion: 2.1 time: 0.071778 Jul 28 04:00:16.276645 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2729/4960] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:16 2022] GET /compute/v2.1/servers/57c73547-c0da-4d3f-a9c5-e13817f28211 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:16.284140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eb533f0d-34e7-4d5e-87fa-33bafe35bab8 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa674ed940>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:17.234664 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-eb533f0d-34e7-4d5e-87fa-33bafe35bab8 tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/f93cf120-b2ba-426d-85dc-1778891817c0" status: 202 len: 0 microversion: 2.1 time: 0.954110 Jul 28 04:00:17.239889 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2232/4961] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 04:00:16 2022] DELETE /compute/v2.1/os-security-groups/f93cf120-b2ba-426d-85dc-1778891817c0 => generated 0 bytes in 956 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:00:17.246777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8aa579ab-c738-4e99-ae31-1db1d670d6ee tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] Calling method '.version_select at 0x7ffa66fbe040>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:18.788405 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8aa579ab-c738-4e99-ae31-1db1d670d6ee tempest-SecurityGroupsTestJSON-1443517100 tempest-SecurityGroupsTestJSON-1443517100-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/d0059dca-b2a9-4169-b748-1128824087cb" status: 202 len: 0 microversion: 2.1 time: 1.547778 Jul 28 04:00:18.795029 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2730/4962] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 04:00:17 2022] DELETE /compute/v2.1/os-security-groups/d0059dca-b2a9-4169-b748-1128824087cb => generated 0 bytes in 1556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:00:43.465559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:43.466750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:44.478422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4f3232db-c280-4308-ab9a-2ee0863e6f25 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Action: 'create', calling method: .version_select at 0x7ffa745b7ee0>, body: {"keypair": {"name": "tempest-keypair-681810439", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsTNQIVM7IxzhItBx3gm9o7BF2w/VCpyjZ/msrrhVkSNCa2GYqf1IkgxaHVJcPyUpczr1j+8eEwYi4CtXjaR+Dca3kd9CPoh4MiARHVFnPg1fjRKhTnvRHi8nq9uQcM5w=="}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:44.519561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-4f3232db-c280-4308-ab9a-2ee0863e6f25 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Getting quotas for project 5ac07fd57ffd4d27a729e8c8fea64ba9. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:00:44.534717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-4f3232db-c280-4308-ab9a-2ee0863e6f25 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Getting quotas for user 444b45fabb6847598b6f6430ad678845 and project 5ac07fd57ffd4d27a729e8c8fea64ba9. Resources: {'key_pairs'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:00:44.606005 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4f3232db-c280-4308-ab9a-2ee0863e6f25 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.148120 Jul 28 04:00:44.606625 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2233/4963] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:00:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:49.793702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-851843092", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2fab2753-76f2-428f-98d8-6f89235c9e5e"}], "security_groups": [{"name": "tempest-securitygroup--1181881571"}], "key_name": "tempest-keypair-681810439", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:49.818808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:49.819489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:50.170247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] validate_networks() for [('2fab2753-76f2-428f-98d8-6f89235c9e5e', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:00:51.747659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Getting quotas for project 5ac07fd57ffd4d27a729e8c8fea64ba9. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:00:51.766855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Getting quotas for user 444b45fabb6847598b6f6430ad678845 and project 5ac07fd57ffd4d27a729e8c8fea64ba9. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:00:51.788036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:00:51.788626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:00:51.789112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:00:51.789521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:00:51.789935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:00:51.800973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.801423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.802402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.802782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.826097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Getting quotas for project 5ac07fd57ffd4d27a729e8c8fea64ba9. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:00:51.833211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Getting quotas for user 444b45fabb6847598b6f6430ad678845 and project 5ac07fd57ffd4d27a729e8c8fea64ba9. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:00:51.851201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:00:51.854359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:00:51.918954 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-69b130a6-c7e4-4294-bc2f-a95ba143c941 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.130771 Jul 28 04:00:51.920118 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2731/4964] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:00:49 2022] POST /compute/v2.1/servers => generated 407 bytes in 2133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:00:51.934284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-46e4fccd-5662-431a-ad48-916cd8d11672 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:51.935552 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-46e4fccd-5662-431a-ad48-916cd8d11672 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:52.108282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-46e4fccd-5662-431a-ad48-916cd8d11672 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:52.119877 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-46e4fccd-5662-431a-ad48-916cd8d11672 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1268 microversion: 2.1 time: 0.192590 Jul 28 04:00:52.124376 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2234/4965] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:51 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1268 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:53.145277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d55da75-538e-4cf4-9568-659c5cb5b32b tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:53.145896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d55da75-538e-4cf4-9568-659c5cb5b32b tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:53.324444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7d55da75-538e-4cf4-9568-659c5cb5b32b tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:53.337098 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d55da75-538e-4cf4-9568-659c5cb5b32b tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1268 microversion: 2.1 time: 0.197349 Jul 28 04:00:53.345102 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2732/4966] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:53 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1268 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:54.367746 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c52115d6-93c4-4e5f-a3aa-6539c9914a8e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:54.368554 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c52115d6-93c4-4e5f-a3aa-6539c9914a8e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:54.377321 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c52115d6-93c4-4e5f-a3aa-6539c9914a8e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.377866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c52115d6-93c4-4e5f-a3aa-6539c9914a8e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.378745 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c52115d6-93c4-4e5f-a3aa-6539c9914a8e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.380693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c52115d6-93c4-4e5f-a3aa-6539c9914a8e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.636611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c52115d6-93c4-4e5f-a3aa-6539c9914a8e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:54.649437 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c52115d6-93c4-4e5f-a3aa-6539c9914a8e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1326 microversion: 2.1 time: 0.285940 Jul 28 04:00:54.654710 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2235/4967] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:54 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1326 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:55.675706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5afc43a2-8131-4ab5-9d5a-97afd9e29f80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:55.677235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5afc43a2-8131-4ab5-9d5a-97afd9e29f80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:55.713321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5afc43a2-8131-4ab5-9d5a-97afd9e29f80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.715750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5afc43a2-8131-4ab5-9d5a-97afd9e29f80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.718081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5afc43a2-8131-4ab5-9d5a-97afd9e29f80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.718684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5afc43a2-8131-4ab5-9d5a-97afd9e29f80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.905206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5afc43a2-8131-4ab5-9d5a-97afd9e29f80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:55.921069 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5afc43a2-8131-4ab5-9d5a-97afd9e29f80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1326 microversion: 2.1 time: 0.253611 Jul 28 04:00:55.923402 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2733/4968] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:55 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1326 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:56.943699 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e15c07f9-40c7-47b1-95dd-f4ca6a63b4ad tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:56.944993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e15c07f9-40c7-47b1-95dd-f4ca6a63b4ad tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:56.960285 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e15c07f9-40c7-47b1-95dd-f4ca6a63b4ad tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:56.961842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e15c07f9-40c7-47b1-95dd-f4ca6a63b4ad tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:56.962631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e15c07f9-40c7-47b1-95dd-f4ca6a63b4ad tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:56.963075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e15c07f9-40c7-47b1-95dd-f4ca6a63b4ad tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:57.301309 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e15c07f9-40c7-47b1-95dd-f4ca6a63b4ad tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:57.313105 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e15c07f9-40c7-47b1-95dd-f4ca6a63b4ad tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1394 microversion: 2.1 time: 0.373656 Jul 28 04:00:57.314958 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2236/4969] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:56 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1394 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:58.339052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1b3a37f7-4a90-47f8-8c5d-c1bd21a3655b tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:58.341019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1b3a37f7-4a90-47f8-8c5d-c1bd21a3655b tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:58.370137 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b3a37f7-4a90-47f8-8c5d-c1bd21a3655b tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.372443 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b3a37f7-4a90-47f8-8c5d-c1bd21a3655b tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.373656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b3a37f7-4a90-47f8-8c5d-c1bd21a3655b tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.376258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1b3a37f7-4a90-47f8-8c5d-c1bd21a3655b tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.650032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1ffecec0-9c9a-4bc2-a15d-dd4e2d2651f6 req-75b3cd1e-715e-4ff1-a0d4-d9f687410630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e615e47-4b7a-44dd-aa63-8aa8ef0601f2", "tag": "b6699880-f665-4513-82a1-e4c7fd044be5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:58.673972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1ffecec0-9c9a-4bc2-a15d-dd4e2d2651f6 req-75b3cd1e-715e-4ff1-a0d4-d9f687410630 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.675918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1ffecec0-9c9a-4bc2-a15d-dd4e2d2651f6 req-75b3cd1e-715e-4ff1-a0d4-d9f687410630 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.718831 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1ffecec0-9c9a-4bc2-a15d-dd4e2d2651f6 req-75b3cd1e-715e-4ff1-a0d4-d9f687410630 service nova] Creating event network-changed:b6699880-f665-4513-82a1-e4c7fd044be5 for instance 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 on n-h1-826756-3 Jul 28 04:00:58.727077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1b3a37f7-4a90-47f8-8c5d-c1bd21a3655b tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:58.735224 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1ffecec0-9c9a-4bc2-a15d-dd4e2d2651f6 req-75b3cd1e-715e-4ff1-a0d4-d9f687410630 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.686823 Jul 28 04:00:58.738488 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2734/4970] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:58.741764 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1b3a37f7-4a90-47f8-8c5d-c1bd21a3655b tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1394 microversion: 2.1 time: 0.410674 Jul 28 04:00:58.747357 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2237/4971] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:58 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1394 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:59.766450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d61ab078-73bc-442a-a349-08b807c2bbb3 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:59.767355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d61ab078-73bc-442a-a349-08b807c2bbb3 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:00:59.798950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d61ab078-73bc-442a-a349-08b807c2bbb3 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:59.804814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d61ab078-73bc-442a-a349-08b807c2bbb3 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:59.810190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d61ab078-73bc-442a-a349-08b807c2bbb3 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:59.811342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d61ab078-73bc-442a-a349-08b807c2bbb3 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.164563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d61ab078-73bc-442a-a349-08b807c2bbb3 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:00.176832 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d61ab078-73bc-442a-a349-08b807c2bbb3 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1394 microversion: 2.1 time: 0.416752 Jul 28 04:01:00.178127 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2735/4972] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:59 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1394 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:01.199215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8890f62c-bbbb-4d05-b480-5430c36c9d01 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:01.200622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8890f62c-bbbb-4d05-b480-5430c36c9d01 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:01.221459 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8890f62c-bbbb-4d05-b480-5430c36c9d01 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:01.229385 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8890f62c-bbbb-4d05-b480-5430c36c9d01 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:01.230569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8890f62c-bbbb-4d05-b480-5430c36c9d01 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:01.233470 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8890f62c-bbbb-4d05-b480-5430c36c9d01 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:01.820661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8890f62c-bbbb-4d05-b480-5430c36c9d01 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:01.847990 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8890f62c-bbbb-4d05-b480-5430c36c9d01 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1394 microversion: 2.1 time: 0.646767 Jul 28 04:01:01.850951 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2238/4973] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:01 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1394 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:02.879746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-30a8bbdb-8751-4835-8960-250c5cecf37f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:02.880474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-30a8bbdb-8751-4835-8960-250c5cecf37f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:02.896376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:02.900637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30a8bbdb-8751-4835-8960-250c5cecf37f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.901607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30a8bbdb-8751-4835-8960-250c5cecf37f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.902575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30a8bbdb-8751-4835-8960-250c5cecf37f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.903938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30a8bbdb-8751-4835-8960-250c5cecf37f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:03.330751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:03.507119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-30a8bbdb-8751-4835-8960-250c5cecf37f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:03.519559 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-30a8bbdb-8751-4835-8960-250c5cecf37f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1394 microversion: 2.1 time: 0.647980 Jul 28 04:01:03.520485 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2736/4974] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:02 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1394 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:04.546145 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b3a2efc0-e840-4b5a-93cd-c41cadd5ef4c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:04.551818 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b3a2efc0-e840-4b5a-93cd-c41cadd5ef4c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:04.571966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:04.578958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3a2efc0-e840-4b5a-93cd-c41cadd5ef4c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:04.579735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3a2efc0-e840-4b5a-93cd-c41cadd5ef4c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:04.580807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3a2efc0-e840-4b5a-93cd-c41cadd5ef4c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:04.582315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b3a2efc0-e840-4b5a-93cd-c41cadd5ef4c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.391228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b3a2efc0-e840-4b5a-93cd-c41cadd5ef4c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:05.410372 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b3a2efc0-e840-4b5a-93cd-c41cadd5ef4c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1394 microversion: 2.1 time: 0.870717 Jul 28 04:01:05.412562 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2239/4975] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:04 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1394 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:06.434953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b695fd42-f8c9-4afd-8bdf-ec7a1d139814 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:06.437008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b695fd42-f8c9-4afd-8bdf-ec7a1d139814 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:06.454796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b695fd42-f8c9-4afd-8bdf-ec7a1d139814 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:06.457934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b695fd42-f8c9-4afd-8bdf-ec7a1d139814 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:06.461918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b695fd42-f8c9-4afd-8bdf-ec7a1d139814 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:06.464497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b695fd42-f8c9-4afd-8bdf-ec7a1d139814 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:06.674770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b695fd42-f8c9-4afd-8bdf-ec7a1d139814 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:06.693569 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b695fd42-f8c9-4afd-8bdf-ec7a1d139814 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1394 microversion: 2.1 time: 0.260468 Jul 28 04:01:06.708115 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2737/4976] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:06 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1394 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:07.716025 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e699e46a-46bc-4c99-ab4e-893065a5ac3a tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:07.717264 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e699e46a-46bc-4c99-ab4e-893065a5ac3a tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:07.730456 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e699e46a-46bc-4c99-ab4e-893065a5ac3a tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:07.731198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e699e46a-46bc-4c99-ab4e-893065a5ac3a tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:07.732164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e699e46a-46bc-4c99-ab4e-893065a5ac3a tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:07.737474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e699e46a-46bc-4c99-ab4e-893065a5ac3a tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:07.999652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e699e46a-46bc-4c99-ab4e-893065a5ac3a tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:08.011339 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e699e46a-46bc-4c99-ab4e-893065a5ac3a tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1394 microversion: 2.1 time: 0.299592 Jul 28 04:01:08.013008 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2240/4977] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:07 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1394 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:08.607927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4923493d-02ac-4e3e-858d-1d71054ba11f req-3595ae26-7c57-4442-ae18-2c809db9150b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e615e47-4b7a-44dd-aa63-8aa8ef0601f2", "name": "network-vif-plugged", "status": "completed", "tag": "b6699880-f665-4513-82a1-e4c7fd044be5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:08.642482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4923493d-02ac-4e3e-858d-1d71054ba11f req-3595ae26-7c57-4442-ae18-2c809db9150b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:08.645517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4923493d-02ac-4e3e-858d-1d71054ba11f req-3595ae26-7c57-4442-ae18-2c809db9150b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.680279 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4923493d-02ac-4e3e-858d-1d71054ba11f req-3595ae26-7c57-4442-ae18-2c809db9150b service nova] Creating event network-vif-plugged:b6699880-f665-4513-82a1-e4c7fd044be5 for instance 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 on n-h1-826756-3 Jul 28 04:01:08.721968 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4923493d-02ac-4e3e-858d-1d71054ba11f req-3595ae26-7c57-4442-ae18-2c809db9150b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097047 Jul 28 04:01:08.725636 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2738/4978] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:09.049105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bab73197-f006-4a1f-b8c7-fac0b9603d52 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:09.051525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bab73197-f006-4a1f-b8c7-fac0b9603d52 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:09.077591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bab73197-f006-4a1f-b8c7-fac0b9603d52 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.078167 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bab73197-f006-4a1f-b8c7-fac0b9603d52 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.078845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bab73197-f006-4a1f-b8c7-fac0b9603d52 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.079282 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bab73197-f006-4a1f-b8c7-fac0b9603d52 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.404863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bab73197-f006-4a1f-b8c7-fac0b9603d52 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:09.427372 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bab73197-f006-4a1f-b8c7-fac0b9603d52 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1394 microversion: 2.1 time: 0.396561 Jul 28 04:01:09.429057 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2241/4979] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:09 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1394 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:10.452739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-87440ea1-dfd6-4f7f-9a66-7e1e2c78a4bc tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:10.454420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-87440ea1-dfd6-4f7f-9a66-7e1e2c78a4bc tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:10.484132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87440ea1-dfd6-4f7f-9a66-7e1e2c78a4bc tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:10.484623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87440ea1-dfd6-4f7f-9a66-7e1e2c78a4bc tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:10.485422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87440ea1-dfd6-4f7f-9a66-7e1e2c78a4bc tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:10.485862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87440ea1-dfd6-4f7f-9a66-7e1e2c78a4bc tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:10.905089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-87440ea1-dfd6-4f7f-9a66-7e1e2c78a4bc tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:10.917959 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-87440ea1-dfd6-4f7f-9a66-7e1e2c78a4bc tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1394 microversion: 2.1 time: 0.468363 Jul 28 04:01:10.934439 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2739/4980] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:10 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1394 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:11.942964 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0b05ddbc-ba4c-4954-bd60-a204593c2e2f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:11.944559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0b05ddbc-ba4c-4954-bd60-a204593c2e2f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:11.964911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b05ddbc-ba4c-4954-bd60-a204593c2e2f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:11.965463 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b05ddbc-ba4c-4954-bd60-a204593c2e2f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:11.966320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b05ddbc-ba4c-4954-bd60-a204593c2e2f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:11.971988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b05ddbc-ba4c-4954-bd60-a204593c2e2f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:12.601729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0b05ddbc-ba4c-4954-bd60-a204593c2e2f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:12.622227 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0b05ddbc-ba4c-4954-bd60-a204593c2e2f tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1575 microversion: 2.1 time: 0.683236 Jul 28 04:01:12.623573 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2242/4981] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:11 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1575 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:12.644103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a6befc51-d42a-4896-b688-b9e78ef7db80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:12.645242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a6befc51-d42a-4896-b688-b9e78ef7db80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:12.654323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6befc51-d42a-4896-b688-b9e78ef7db80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:12.655057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6befc51-d42a-4896-b688-b9e78ef7db80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:12.656056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6befc51-d42a-4896-b688-b9e78ef7db80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:12.656784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6befc51-d42a-4896-b688-b9e78ef7db80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:12.803685 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a6befc51-d42a-4896-b688-b9e78ef7db80 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162206 Jul 28 04:01:12.816893 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2740/4982] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 04:01:12 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:15.205593 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-00e47fc5-82ad-4a07-8da3-71b9153a2c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:15.206381 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-00e47fc5-82ad-4a07-8da3-71b9153a2c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:15.223244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:15.231293 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00e47fc5-82ad-4a07-8da3-71b9153a2c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:15.233396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00e47fc5-82ad-4a07-8da3-71b9153a2c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:15.245512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00e47fc5-82ad-4a07-8da3-71b9153a2c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:15.246144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-00e47fc5-82ad-4a07-8da3-71b9153a2c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:15.696041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-87977f5e-de7f-4301-81ef-ed7d6836c222 req-08db7eab-76ee-4365-93ff-84a02ca73a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e615e47-4b7a-44dd-aa63-8aa8ef0601f2", "tag": "b6699880-f665-4513-82a1-e4c7fd044be5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:15.725160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-87977f5e-de7f-4301-81ef-ed7d6836c222 req-08db7eab-76ee-4365-93ff-84a02ca73a79 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:15.725624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-87977f5e-de7f-4301-81ef-ed7d6836c222 req-08db7eab-76ee-4365-93ff-84a02ca73a79 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:15.777878 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-87977f5e-de7f-4301-81ef-ed7d6836c222 req-08db7eab-76ee-4365-93ff-84a02ca73a79 service nova] Creating event network-changed:b6699880-f665-4513-82a1-e4c7fd044be5 for instance 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 on n-h1-826756-3 Jul 28 04:01:15.795654 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-87977f5e-de7f-4301-81ef-ed7d6836c222 req-08db7eab-76ee-4365-93ff-84a02ca73a79 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.553719 Jul 28 04:01:15.804096 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2741/4983] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:01:16.067843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-00e47fc5-82ad-4a07-8da3-71b9153a2c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:16.078469 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-00e47fc5-82ad-4a07-8da3-71b9153a2c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1575 microversion: 2.1 time: 0.877908 Jul 28 04:01:16.079163 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2243/4984] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:15 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1575 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:44.532312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0628f8d7-5b7f-46da-989a-3fe94800f072 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:44.542196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0628f8d7-5b7f-46da-989a-3fe94800f072 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:44.544376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0628f8d7-5b7f-46da-989a-3fe94800f072 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Searching by: {'deleted': False, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 04:01:44.555685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:44.557157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=42 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:44.566904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0628f8d7-5b7f-46da-989a-3fe94800f072 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:44.568864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0628f8d7-5b7f-46da-989a-3fe94800f072 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:44.570062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0628f8d7-5b7f-46da-989a-3fe94800f072 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:44.574937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0628f8d7-5b7f-46da-989a-3fe94800f072 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:44.655195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-0628f8d7-5b7f-46da-989a-3fe94800f072 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 04:01:44.718465 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0628f8d7-5b7f-46da-989a-3fe94800f072 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.190213 Jul 28 04:01:44.736005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9f014db8-cab3-4748-959b-60c7f3147194 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:44.741383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9f014db8-cab3-4748-959b-60c7f3147194 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:44.742270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9f014db8-cab3-4748-959b-60c7f3147194 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Searching by: {'deleted': False, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 04:01:44.745530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:44.746177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=54 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:44.746621 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2742/4985] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 04:01:44 2022] GET /compute/v2.1/servers => generated 333 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:44.754268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f014db8-cab3-4748-959b-60c7f3147194 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:44.754777 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f014db8-cab3-4748-959b-60c7f3147194 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:44.755626 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f014db8-cab3-4748-959b-60c7f3147194 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:44.756067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f014db8-cab3-4748-959b-60c7f3147194 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:44.826463 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.multi_cell_list [None req-9f014db8-cab3-4748-959b-60c7f3147194 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126072) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 04:01:44.909943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9f014db8-cab3-4748-959b-60c7f3147194 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:44.974040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f014db8-cab3-4748-959b-60c7f3147194 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:44.976340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9f014db8-cab3-4748-959b-60c7f3147194 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:45.763671 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9f014db8-cab3-4748-959b-60c7f3147194 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 1.035578 Jul 28 04:01:45.766266 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2244/4986] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 04:01:44 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:45.789067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eccbd4bd-3fb9-4dd8-8fc3-a8bf1523351e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:45.820243 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eccbd4bd-3fb9-4dd8-8fc3-a8bf1523351e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030747 Jul 28 04:01:45.821775 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2743/4987] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 04:01:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:46.211295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b7155569-71e7-44b3-a064-05958d812c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:46.214127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b7155569-71e7-44b3-a064-05958d812c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:46.245669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7155569-71e7-44b3-a064-05958d812c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:46.246480 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7155569-71e7-44b3-a064-05958d812c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:46.247526 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7155569-71e7-44b3-a064-05958d812c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:46.248165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b7155569-71e7-44b3-a064-05958d812c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:46.314662 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b7155569-71e7-44b3-a064-05958d812c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:01:46.586367 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b7155569-71e7-44b3-a064-05958d812c9e tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 204 len: 0 microversion: 2.1 time: 0.379426 Jul 28 04:01:46.588642 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2245/4988] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:01:46 2022] DELETE /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:01:46.598566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63c62b3c-da63-4f46-8943-1832133260d0 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:46.599477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63c62b3c-da63-4f46-8943-1832133260d0 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:46.611462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63c62b3c-da63-4f46-8943-1832133260d0 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:46.613246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63c62b3c-da63-4f46-8943-1832133260d0 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:46.615993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63c62b3c-da63-4f46-8943-1832133260d0 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:46.618746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63c62b3c-da63-4f46-8943-1832133260d0 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:47.232863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63c62b3c-da63-4f46-8943-1832133260d0 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:47.266612 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63c62b3c-da63-4f46-8943-1832133260d0 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1699 microversion: 2.1 time: 0.673624 Jul 28 04:01:47.267218 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2744/4989] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:46 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1699 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:48.289567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6608a356-eefc-4d27-8e43-1270aa6abb3d tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:48.290931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6608a356-eefc-4d27-8e43-1270aa6abb3d tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:48.303132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6608a356-eefc-4d27-8e43-1270aa6abb3d tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:48.307040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6608a356-eefc-4d27-8e43-1270aa6abb3d tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:48.310900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6608a356-eefc-4d27-8e43-1270aa6abb3d tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:48.312665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6608a356-eefc-4d27-8e43-1270aa6abb3d tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:48.375343 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4b9ab274-6256-4757-86d8-2b2b4dbf37ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363 tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363-project-admin] Calling method '.version_select at 0x7ffa674ed0d0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:48.376510 n-d-826756-3 devstack@n-api.service[126072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:01:48.376510 n-d-826756-3 devstack@n-api.service[126072]: warnings.warn(msg) Jul 28 04:01:48.377978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b9ab274-6256-4757-86d8-2b2b4dbf37ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363 tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:48.378538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b9ab274-6256-4757-86d8-2b2b4dbf37ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363 tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:48.423233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b9ab274-6256-4757-86d8-2b2b4dbf37ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363 tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:48.426669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b9ab274-6256-4757-86d8-2b2b4dbf37ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363 tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:48.482121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b9ab274-6256-4757-86d8-2b2b4dbf37ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363 tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:48.482591 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4b9ab274-6256-4757-86d8-2b2b4dbf37ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363 tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:48.548313 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4b9ab274-6256-4757-86d8-2b2b4dbf37ff tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363 tempest-PortsAdminExtendedAttrsIpV6TestJSON-631224363-project-admin] 10.222.0.48 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.745796 Jul 28 04:01:48.551754 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2246/4990] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 04:01:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:48.882574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6608a356-eefc-4d27-8e43-1270aa6abb3d tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:48.901437 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6608a356-eefc-4d27-8e43-1270aa6abb3d tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1699 microversion: 2.1 time: 0.617105 Jul 28 04:01:48.907326 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2745/4991] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:48 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1699 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:49.593371 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-875f2e13-460d-45c5-bcc9-31a98b104f2f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:49.594118 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-875f2e13-460d-45c5-bcc9-31a98b104f2f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:49.601392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-875f2e13-460d-45c5-bcc9-31a98b104f2f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:49.601938 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-875f2e13-460d-45c5-bcc9-31a98b104f2f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:49.602831 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-875f2e13-460d-45c5-bcc9-31a98b104f2f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:49.603357 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-875f2e13-460d-45c5-bcc9-31a98b104f2f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:49.662032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-875f2e13-460d-45c5-bcc9-31a98b104f2f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:01:49.852024 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-875f2e13-460d-45c5-bcc9-31a98b104f2f tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 204 len: 0 microversion: 2.32 time: 0.478022 Jul 28 04:01:49.856117 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2247/4992] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 04:01:49 2022] DELETE /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 04:01:49.863922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-14284627-0116-412c-8cbc-f2ef87238b27 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:49.864906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-14284627-0116-412c-8cbc-f2ef87238b27 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:49.886899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-14284627-0116-412c-8cbc-f2ef87238b27 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:49.891938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-14284627-0116-412c-8cbc-f2ef87238b27 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:49.897499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-14284627-0116-412c-8cbc-f2ef87238b27 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:49.898397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-14284627-0116-412c-8cbc-f2ef87238b27 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:49.929052 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fcf7dce7-a3fb-4574-9704-3da63ea35d5c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:49.929813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fcf7dce7-a3fb-4574-9704-3da63ea35d5c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:49.943732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fcf7dce7-a3fb-4574-9704-3da63ea35d5c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:49.944507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fcf7dce7-a3fb-4574-9704-3da63ea35d5c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:49.945470 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fcf7dce7-a3fb-4574-9704-3da63ea35d5c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:49.946086 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fcf7dce7-a3fb-4574-9704-3da63ea35d5c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:50.408000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-14284627-0116-412c-8cbc-f2ef87238b27 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:50.422833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-14284627-0116-412c-8cbc-f2ef87238b27 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:50.428153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-14284627-0116-412c-8cbc-f2ef87238b27 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:50.430160 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-14284627-0116-412c-8cbc-f2ef87238b27 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 2956 microversion: 2.32 time: 0.571186 Jul 28 04:01:50.444390 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2746/4993] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:49 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 2956 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:50.805696 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fcf7dce7-a3fb-4574-9704-3da63ea35d5c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:50.826661 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fcf7dce7-a3fb-4574-9704-3da63ea35d5c tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1699 microversion: 2.1 time: 0.903063 Jul 28 04:01:50.827998 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2248/4994] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:49 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1699 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:51.459872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf316eeb-fe87-41dd-a344-8476fda00a93 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:51.461114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cf316eeb-fe87-41dd-a344-8476fda00a93 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:51.477227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf316eeb-fe87-41dd-a344-8476fda00a93 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:51.477979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf316eeb-fe87-41dd-a344-8476fda00a93 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:51.478778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf316eeb-fe87-41dd-a344-8476fda00a93 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:51.479212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf316eeb-fe87-41dd-a344-8476fda00a93 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:51.850906 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d316aa71-6d75-4738-9dd6-e13fb9f6adb1 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:51.851737 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d316aa71-6d75-4738-9dd6-e13fb9f6adb1 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:51.872300 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d316aa71-6d75-4738-9dd6-e13fb9f6adb1 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:51.875801 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d316aa71-6d75-4738-9dd6-e13fb9f6adb1 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:51.888477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d316aa71-6d75-4738-9dd6-e13fb9f6adb1 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:51.890709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d316aa71-6d75-4738-9dd6-e13fb9f6adb1 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:52.321593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf316eeb-fe87-41dd-a344-8476fda00a93 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:52.335815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf316eeb-fe87-41dd-a344-8476fda00a93 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:52.338174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf316eeb-fe87-41dd-a344-8476fda00a93 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:52.340731 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf316eeb-fe87-41dd-a344-8476fda00a93 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 2956 microversion: 2.32 time: 0.885171 Jul 28 04:01:52.341887 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2747/4995] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:51 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 2956 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:52.595138 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d316aa71-6d75-4738-9dd6-e13fb9f6adb1 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:52.621673 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d316aa71-6d75-4738-9dd6-e13fb9f6adb1 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1631 microversion: 2.1 time: 0.771874 Jul 28 04:01:52.628750 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2249/4996] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:51 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1631 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:53.122717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-7efb5479-5ffd-465a-99b8-92d053dbe745 req-e17d6d8b-a37d-4ae3-8a8f-0d0e0b797ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e615e47-4b7a-44dd-aa63-8aa8ef0601f2", "name": "network-vif-deleted", "tag": "b6699880-f665-4513-82a1-e4c7fd044be5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:53.143930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7efb5479-5ffd-465a-99b8-92d053dbe745 req-e17d6d8b-a37d-4ae3-8a8f-0d0e0b797ae0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:53.144440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7efb5479-5ffd-465a-99b8-92d053dbe745 req-e17d6d8b-a37d-4ae3-8a8f-0d0e0b797ae0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:53.177659 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-7efb5479-5ffd-465a-99b8-92d053dbe745 req-e17d6d8b-a37d-4ae3-8a8f-0d0e0b797ae0 service nova] Creating event network-vif-deleted:b6699880-f665-4513-82a1-e4c7fd044be5 for instance 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 on n-h1-826756-3 Jul 28 04:01:53.189042 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-7efb5479-5ffd-465a-99b8-92d053dbe745 req-e17d6d8b-a37d-4ae3-8a8f-0d0e0b797ae0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067686 Jul 28 04:01:53.192497 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2748/4997] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:53.368437 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-595f3e2d-1222-481e-9f47-c59e0e974849 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:53.369803 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-595f3e2d-1222-481e-9f47-c59e0e974849 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:53.388525 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-595f3e2d-1222-481e-9f47-c59e0e974849 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:53.389578 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-595f3e2d-1222-481e-9f47-c59e0e974849 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:53.391163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-595f3e2d-1222-481e-9f47-c59e0e974849 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:53.392190 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-595f3e2d-1222-481e-9f47-c59e0e974849 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:53.654904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47c2402a-17b9-4b5a-a470-9048871edf73 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:53.655709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-47c2402a-17b9-4b5a-a470-9048871edf73 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:53.672109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47c2402a-17b9-4b5a-a470-9048871edf73 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:53.672604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47c2402a-17b9-4b5a-a470-9048871edf73 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:53.673421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47c2402a-17b9-4b5a-a470-9048871edf73 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:53.679227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47c2402a-17b9-4b5a-a470-9048871edf73 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:53.823719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47c2402a-17b9-4b5a-a470-9048871edf73 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:53.832606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47c2402a-17b9-4b5a-a470-9048871edf73 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:53.833660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-47c2402a-17b9-4b5a-a470-9048871edf73 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lazy-loading 'fault' on Instance uuid 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:01:54.134613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-47c2402a-17b9-4b5a-a470-9048871edf73 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '444b45fabb6847598b6f6430ad678845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac07fd57ffd4d27a729e8c8fea64ba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:54.160760 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-47c2402a-17b9-4b5a-a470-9048871edf73 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 200 len: 1358 microversion: 2.1 time: 0.510098 Jul 28 04:01:54.168725 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2749/4998] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:53 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 1358 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:54.796994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:54.912912 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:55.000967 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-595f3e2d-1222-481e-9f47-c59e0e974849 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:55.010861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-595f3e2d-1222-481e-9f47-c59e0e974849 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:55.048472 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-595f3e2d-1222-481e-9f47-c59e0e974849 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:55.055762 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-595f3e2d-1222-481e-9f47-c59e0e974849 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 2956 microversion: 2.32 time: 1.691319 Jul 28 04:01:55.076089 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2250/4999] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:53 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 2956 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:55.182170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7218b1e1-8f51-4557-958c-2b58585893ae tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:55.182815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7218b1e1-8f51-4557-958c-2b58585893ae tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] [instance: 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:55.200946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:55.207125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7218b1e1-8f51-4557-958c-2b58585893ae tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:55.207625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7218b1e1-8f51-4557-958c-2b58585893ae tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:55.208474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7218b1e1-8f51-4557-958c-2b58585893ae tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:55.208917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7218b1e1-8f51-4557-958c-2b58585893ae tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:55.278054 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-7218b1e1-8f51-4557-958c-2b58585893ae tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] HTTP exception thrown: Instance 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 could not be found. Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7218b1e1-8f51-4557-958c-2b58585893ae tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Request method failure captured: Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 HTTP/1.1 Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gnrM9x9T_udqjmijUuh0a_QvCcKrCL8jRa0689EeN8lexntwPwEZkgI6zWuCx_cvEGdCrn9Re8pn_uJz29cEMx7llN9xwMkYa4gDUVC0YsO37hlY6rPKtJ-wOXEqh9_fdSpTE7KEerYoCNFcaOoTRVb2oJVONOayosqa8jl7tTqAjw Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 5ac07fd57ffd4d27a729e8c8fea64ba9 Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1070307557 Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5ac07fd57ffd4d27a729e8c8fea64ba9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ac07fd57ffd4d27a729e8c8fea64ba9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5ac07fd57ffd4d27a729e8c8fea64ba9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5ac07fd57ffd4d27a729e8c8fea64ba9"}]}] Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1070307557 Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 5ac07fd57ffd4d27a729e8c8fea64ba9 Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1070307557 Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1070307557-project Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 444b45fabb6847598b6f6430ad678845 Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1070307557-project Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 could not be found. Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '3e615e47-4b7a-44dd-aa63-8aa8ef0601f2'} Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 could not be found. Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 could not be found. Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:01:55.279837 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:55.286229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:55.286229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:55.286229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:01:55.286229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:01:55.286229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 could not be found. Jul 28 04:01:55.286229 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:01:55.286229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7218b1e1-8f51-4557-958c-2b58585893ae tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Returning 404 to user: Instance 3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:01:55.286229 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7218b1e1-8f51-4557-958c-2b58585893ae tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2" status: 404 len: 111 microversion: 2.1 time: 0.103136 Jul 28 04:01:55.290316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-131304b1-7bd8-4556-9956-df043fa388a9 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] Calling method '.version_select at 0x7ffa67750790>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:55.307655 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2750/5000] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:55 2022] GET /compute/v2.1/servers/3e615e47-4b7a-44dd-aa63-8aa8ef0601f2 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:01:55.344218 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-131304b1-7bd8-4556-9956-df043fa388a9 tempest-ServersTestJSON-1070307557 tempest-ServersTestJSON-1070307557-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-681810439" status: 202 len: 0 microversion: 2.1 time: 0.057732 Jul 28 04:01:55.345273 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2251/5001] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 04:01:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-681810439 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:01:56.084642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0a22466b-e41e-4931-af00-5f800d4c9283 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:56.085320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0a22466b-e41e-4931-af00-5f800d4c9283 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:56.104093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a22466b-e41e-4931-af00-5f800d4c9283 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:56.104584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a22466b-e41e-4931-af00-5f800d4c9283 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:56.105475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a22466b-e41e-4931-af00-5f800d4c9283 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:56.105915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a22466b-e41e-4931-af00-5f800d4c9283 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:56.643779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0a22466b-e41e-4931-af00-5f800d4c9283 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:56.671710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0a22466b-e41e-4931-af00-5f800d4c9283 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:56.690275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0a22466b-e41e-4931-af00-5f800d4c9283 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:56.706636 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0a22466b-e41e-4931-af00-5f800d4c9283 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 2956 microversion: 2.32 time: 0.611732 Jul 28 04:01:56.709412 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2751/5002] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:56 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 2956 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:57.742131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-92063a87-e542-40ef-91f3-49c7187e9e8b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:57.743827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-92063a87-e542-40ef-91f3-49c7187e9e8b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:57.757002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92063a87-e542-40ef-91f3-49c7187e9e8b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:57.761289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92063a87-e542-40ef-91f3-49c7187e9e8b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:57.762668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92063a87-e542-40ef-91f3-49c7187e9e8b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:57.763422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92063a87-e542-40ef-91f3-49c7187e9e8b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:57.960791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-f0a40072-8ddb-498f-bfa2-a246e0316e0d req-461795ca-294c-4b43-9301-1d85f9423da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-unplugged", "status": "completed", "tag": "50bb8633-534f-4450-8396-9a18c45b70b2"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:57.983031 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f0a40072-8ddb-498f-bfa2-a246e0316e0d req-461795ca-294c-4b43-9301-1d85f9423da3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:57.983476 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-f0a40072-8ddb-498f-bfa2-a246e0316e0d req-461795ca-294c-4b43-9301-1d85f9423da3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:58.011118 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-f0a40072-8ddb-498f-bfa2-a246e0316e0d req-461795ca-294c-4b43-9301-1d85f9423da3 service nova] Creating event network-vif-unplugged:50bb8633-534f-4450-8396-9a18c45b70b2 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 04:01:58.025776 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-f0a40072-8ddb-498f-bfa2-a246e0316e0d req-461795ca-294c-4b43-9301-1d85f9423da3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.507333 Jul 28 04:01:58.032689 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2252/5003] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:58.254466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-92063a87-e542-40ef-91f3-49c7187e9e8b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:58.272907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-92063a87-e542-40ef-91f3-49c7187e9e8b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:58.275459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-92063a87-e542-40ef-91f3-49c7187e9e8b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:58.277482 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-92063a87-e542-40ef-91f3-49c7187e9e8b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 2935 microversion: 2.32 time: 0.539981 Jul 28 04:01:58.278689 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2752/5004] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:57 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 2935 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:01:59.311305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e3cb3dbb-b162-4aaf-b7fa-92dc7c14c14b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:59.312024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e3cb3dbb-b162-4aaf-b7fa-92dc7c14c14b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:01:59.328149 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3cb3dbb-b162-4aaf-b7fa-92dc7c14c14b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:59.328911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3cb3dbb-b162-4aaf-b7fa-92dc7c14c14b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:59.330328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3cb3dbb-b162-4aaf-b7fa-92dc7c14c14b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:59.332227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3cb3dbb-b162-4aaf-b7fa-92dc7c14c14b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:00.117074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-cb22b208-b3ad-447d-bdd0-5fa9c8e463e5 req-aef0c141-04b6-4d2f-9a5e-6f5deccc7e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-unplugged", "status": "completed", "tag": "38bf4b83-740e-43e2-b390-d6fec119fa7f"}, {"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-unplugged", "status": "completed", "tag": "be6e42cc-90f4-4e57-8cd7-6338a1670214"}, {"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-unplugged", "status": "completed", "tag": "c99034ef-97e5-4be0-9e5c-c75bd4555ab6"}, {"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-unplugged", "status": "completed", "tag": "34b7d23e-2c19-42f4-9d5c-35c32bdd3b9a"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:00.146112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cb22b208-b3ad-447d-bdd0-5fa9c8e463e5 req-aef0c141-04b6-4d2f-9a5e-6f5deccc7e5f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:00.146483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cb22b208-b3ad-447d-bdd0-5fa9c8e463e5 req-aef0c141-04b6-4d2f-9a5e-6f5deccc7e5f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:00.169348 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-cb22b208-b3ad-447d-bdd0-5fa9c8e463e5 req-aef0c141-04b6-4d2f-9a5e-6f5deccc7e5f service nova] Creating event network-vif-unplugged:38bf4b83-740e-43e2-b390-d6fec119fa7f for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 04:02:00.169597 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-cb22b208-b3ad-447d-bdd0-5fa9c8e463e5 req-aef0c141-04b6-4d2f-9a5e-6f5deccc7e5f service nova] Creating event network-vif-unplugged:be6e42cc-90f4-4e57-8cd7-6338a1670214 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 04:02:00.170000 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-cb22b208-b3ad-447d-bdd0-5fa9c8e463e5 req-aef0c141-04b6-4d2f-9a5e-6f5deccc7e5f service nova] Creating event network-vif-unplugged:c99034ef-97e5-4be0-9e5c-c75bd4555ab6 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 04:02:00.175376 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-cb22b208-b3ad-447d-bdd0-5fa9c8e463e5 req-aef0c141-04b6-4d2f-9a5e-6f5deccc7e5f service nova] Creating event network-vif-unplugged:34b7d23e-2c19-42f4-9d5c-35c32bdd3b9a for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 04:02:00.187676 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-cb22b208-b3ad-447d-bdd0-5fa9c8e463e5 req-aef0c141-04b6-4d2f-9a5e-6f5deccc7e5f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.076798 Jul 28 04:02:00.200136 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2753/5005] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:02:00.503152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e3cb3dbb-b162-4aaf-b7fa-92dc7c14c14b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:00.520801 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e3cb3dbb-b162-4aaf-b7fa-92dc7c14c14b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:00.522693 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e3cb3dbb-b162-4aaf-b7fa-92dc7c14c14b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:00.526416 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e3cb3dbb-b162-4aaf-b7fa-92dc7c14c14b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 2914 microversion: 2.32 time: 1.219792 Jul 28 04:02:00.527194 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2253/5006] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:01:59 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 2914 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:01.557415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e242517d-45d2-43c4-8d1d-52f546631ef1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:01.558124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e242517d-45d2-43c4-8d1d-52f546631ef1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:01.567621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e242517d-45d2-43c4-8d1d-52f546631ef1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:01.574805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e242517d-45d2-43c4-8d1d-52f546631ef1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:01.576303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e242517d-45d2-43c4-8d1d-52f546631ef1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:01.579042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e242517d-45d2-43c4-8d1d-52f546631ef1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:01.748332 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-3ac540b8-97c7-4f3e-849e-eb3260398051 req-3af5f49d-f269-49db-9e82-e36cc5c94318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-deleted", "tag": "c99034ef-97e5-4be0-9e5c-c75bd4555ab6"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:01.770885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3ac540b8-97c7-4f3e-849e-eb3260398051 req-3af5f49d-f269-49db-9e82-e36cc5c94318 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:01.772227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-3ac540b8-97c7-4f3e-849e-eb3260398051 req-3af5f49d-f269-49db-9e82-e36cc5c94318 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:01.802215 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-3ac540b8-97c7-4f3e-849e-eb3260398051 req-3af5f49d-f269-49db-9e82-e36cc5c94318 service nova] Creating event network-vif-deleted:c99034ef-97e5-4be0-9e5c-c75bd4555ab6 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 04:02:01.814499 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-3ac540b8-97c7-4f3e-849e-eb3260398051 req-3af5f49d-f269-49db-9e82-e36cc5c94318 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069966 Jul 28 04:02:01.820667 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2254/5007] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:02:02.597543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e242517d-45d2-43c4-8d1d-52f546631ef1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:02.628320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e242517d-45d2-43c4-8d1d-52f546631ef1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:02.630711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e242517d-45d2-43c4-8d1d-52f546631ef1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:02.638207 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e242517d-45d2-43c4-8d1d-52f546631ef1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 2867 microversion: 2.32 time: 1.086501 Jul 28 04:02:02.639508 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2754/5008] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:01 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 2867 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:03.670163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-602efc03-8d7f-4a63-857f-467f639d7588 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:03.675534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-602efc03-8d7f-4a63-857f-467f639d7588 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:03.702973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-602efc03-8d7f-4a63-857f-467f639d7588 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:03.703477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-602efc03-8d7f-4a63-857f-467f639d7588 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:03.704290 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-602efc03-8d7f-4a63-857f-467f639d7588 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:03.705136 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-602efc03-8d7f-4a63-857f-467f639d7588 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:04.053610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a323a1da-48f0-40a4-bd6d-d7bcc832ebab req-c9687117-7af1-4aa4-bdb5-77b1e683b8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-deleted", "tag": "34b7d23e-2c19-42f4-9d5c-35c32bdd3b9a"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:04.079165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a323a1da-48f0-40a4-bd6d-d7bcc832ebab req-c9687117-7af1-4aa4-bdb5-77b1e683b8b7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:04.079917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a323a1da-48f0-40a4-bd6d-d7bcc832ebab req-c9687117-7af1-4aa4-bdb5-77b1e683b8b7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:04.097938 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a323a1da-48f0-40a4-bd6d-d7bcc832ebab req-c9687117-7af1-4aa4-bdb5-77b1e683b8b7 service nova] Creating event network-vif-deleted:34b7d23e-2c19-42f4-9d5c-35c32bdd3b9a for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 04:02:04.109791 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a323a1da-48f0-40a4-bd6d-d7bcc832ebab req-c9687117-7af1-4aa4-bdb5-77b1e683b8b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062380 Jul 28 04:02:04.110424 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2755/5009] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:02:04.501902 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-602efc03-8d7f-4a63-857f-467f639d7588 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:04.533624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-602efc03-8d7f-4a63-857f-467f639d7588 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:04.551562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-602efc03-8d7f-4a63-857f-467f639d7588 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:04.562979 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-602efc03-8d7f-4a63-857f-467f639d7588 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 2706 microversion: 2.32 time: 0.899794 Jul 28 04:02:04.566274 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2255/5010] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:03 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 2706 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:05.596139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9cac9546-3040-4b84-b560-e9d57d05f508 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:05.596936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9cac9546-3040-4b84-b560-e9d57d05f508 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:05.616647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cac9546-3040-4b84-b560-e9d57d05f508 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:05.617691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cac9546-3040-4b84-b560-e9d57d05f508 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:05.618868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cac9546-3040-4b84-b560-e9d57d05f508 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:05.619660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cac9546-3040-4b84-b560-e9d57d05f508 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:06.071555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9cac9546-3040-4b84-b560-e9d57d05f508 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:06.088480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9cac9546-3040-4b84-b560-e9d57d05f508 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:06.090552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9cac9546-3040-4b84-b560-e9d57d05f508 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:06.098766 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9cac9546-3040-4b84-b560-e9d57d05f508 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 2592 microversion: 2.32 time: 0.507114 Jul 28 04:02:06.100337 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2756/5011] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:05 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 2592 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:06.349468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-0f8abebe-6e8e-4577-9f0d-dc5b3c4f5599 req-ad0ac4d2-43c0-456d-95bc-d0c155ff499c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-deleted", "tag": "be6e42cc-90f4-4e57-8cd7-6338a1670214"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:06.381780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-0f8abebe-6e8e-4577-9f0d-dc5b3c4f5599 req-ad0ac4d2-43c0-456d-95bc-d0c155ff499c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:06.382324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-0f8abebe-6e8e-4577-9f0d-dc5b3c4f5599 req-ad0ac4d2-43c0-456d-95bc-d0c155ff499c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:06.412278 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-0f8abebe-6e8e-4577-9f0d-dc5b3c4f5599 req-ad0ac4d2-43c0-456d-95bc-d0c155ff499c service nova] Creating event network-vif-deleted:be6e42cc-90f4-4e57-8cd7-6338a1670214 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 04:02:06.419282 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-0f8abebe-6e8e-4577-9f0d-dc5b3c4f5599 req-ad0ac4d2-43c0-456d-95bc-d0c155ff499c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081625 Jul 28 04:02:06.420576 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2256/5012] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:02:07.130871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70ebdc3c-0464-4ebe-85cb-3cc4c632b916 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:07.131600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-70ebdc3c-0464-4ebe-85cb-3cc4c632b916 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:07.148586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70ebdc3c-0464-4ebe-85cb-3cc4c632b916 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:07.149245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70ebdc3c-0464-4ebe-85cb-3cc4c632b916 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:07.150226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70ebdc3c-0464-4ebe-85cb-3cc4c632b916 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:07.153248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70ebdc3c-0464-4ebe-85cb-3cc4c632b916 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:08.361738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-70ebdc3c-0464-4ebe-85cb-3cc4c632b916 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:08.379641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-70ebdc3c-0464-4ebe-85cb-3cc4c632b916 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:08.382654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-70ebdc3c-0464-4ebe-85cb-3cc4c632b916 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:08.384709 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-70ebdc3c-0464-4ebe-85cb-3cc4c632b916 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 2388 microversion: 2.32 time: 1.261078 Jul 28 04:02:08.398629 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2757/5013] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:07 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 2388 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:09.412553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6a095b03-0186-467c-bfa4-cc48d1225703 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:09.413631 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6a095b03-0186-467c-bfa4-cc48d1225703 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:09.426354 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a095b03-0186-467c-bfa4-cc48d1225703 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:09.427814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a095b03-0186-467c-bfa4-cc48d1225703 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:09.431588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a095b03-0186-467c-bfa4-cc48d1225703 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:09.432253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a095b03-0186-467c-bfa4-cc48d1225703 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:10.334921 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6a095b03-0186-467c-bfa4-cc48d1225703 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:10.361162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6a095b03-0186-467c-bfa4-cc48d1225703 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:10.371657 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6a095b03-0186-467c-bfa4-cc48d1225703 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:10.378532 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6a095b03-0186-467c-bfa4-cc48d1225703 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 2341 microversion: 2.32 time: 0.966550 Jul 28 04:02:10.379341 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2257/5014] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:09 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 2341 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:10.705784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f753bdcf-41cc-4c84-aa56-32b34481de82 req-c172ab78-a206-4b38-9b46-b07f0f4dd66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-deleted", "tag": "50bb8633-534f-4450-8396-9a18c45b70b2"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:10.738348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f753bdcf-41cc-4c84-aa56-32b34481de82 req-c172ab78-a206-4b38-9b46-b07f0f4dd66a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:10.739303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f753bdcf-41cc-4c84-aa56-32b34481de82 req-c172ab78-a206-4b38-9b46-b07f0f4dd66a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:10.766214 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f753bdcf-41cc-4c84-aa56-32b34481de82 req-c172ab78-a206-4b38-9b46-b07f0f4dd66a service nova] Creating event network-vif-deleted:50bb8633-534f-4450-8396-9a18c45b70b2 for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 04:02:10.778986 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f753bdcf-41cc-4c84-aa56-32b34481de82 req-c172ab78-a206-4b38-9b46-b07f0f4dd66a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076808 Jul 28 04:02:10.784473 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2758/5015] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:11.408201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-707a93a5-1b77-477a-be6e-38b05b0e2489 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:11.408798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-707a93a5-1b77-477a-be6e-38b05b0e2489 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:11.434173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-707a93a5-1b77-477a-be6e-38b05b0e2489 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:11.439543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-707a93a5-1b77-477a-be6e-38b05b0e2489 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:11.441559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-707a93a5-1b77-477a-be6e-38b05b0e2489 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:11.448622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-707a93a5-1b77-477a-be6e-38b05b0e2489 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:11.878727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-707a93a5-1b77-477a-be6e-38b05b0e2489 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:11.898512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-707a93a5-1b77-477a-be6e-38b05b0e2489 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:11.903294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-707a93a5-1b77-477a-be6e-38b05b0e2489 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:11.906479 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-707a93a5-1b77-477a-be6e-38b05b0e2489 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 2053 microversion: 2.32 time: 0.503188 Jul 28 04:02:11.909626 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2258/5016] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:11 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 2053 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:12.939295 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3178c641-f1b8-4ac2-be85-f2c129296c43 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:12.941587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-234c69df-3103-4718-bf98-a9be599e693f req-c655e758-6003-4c5d-aed0-fd2db2a5dd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2435442e-fb0d-4ee1-844f-e8f57df3d579", "name": "network-vif-deleted", "tag": "38bf4b83-740e-43e2-b390-d6fec119fa7f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:12.944183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3178c641-f1b8-4ac2-be85-f2c129296c43 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:12.958487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3178c641-f1b8-4ac2-be85-f2c129296c43 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:12.960114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3178c641-f1b8-4ac2-be85-f2c129296c43 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:12.961798 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3178c641-f1b8-4ac2-be85-f2c129296c43 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:12.962987 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3178c641-f1b8-4ac2-be85-f2c129296c43 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:13.011828 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:13.012135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-234c69df-3103-4718-bf98-a9be599e693f req-c655e758-6003-4c5d-aed0-fd2db2a5dd39 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:13.013385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-234c69df-3103-4718-bf98-a9be599e693f req-c655e758-6003-4c5d-aed0-fd2db2a5dd39 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:13.031490 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-234c69df-3103-4718-bf98-a9be599e693f req-c655e758-6003-4c5d-aed0-fd2db2a5dd39 service nova] Creating event network-vif-deleted:38bf4b83-740e-43e2-b390-d6fec119fa7f for instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 on n-h2-826756-3 Jul 28 04:02:13.047033 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-234c69df-3103-4718-bf98-a9be599e693f req-c655e758-6003-4c5d-aed0-fd2db2a5dd39 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121347 Jul 28 04:02:13.049341 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2759/5017] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:13.916010 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3178c641-f1b8-4ac2-be85-f2c129296c43 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:13.935460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3178c641-f1b8-4ac2-be85-f2c129296c43 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:13.941439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3178c641-f1b8-4ac2-be85-f2c129296c43 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:13.948824 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3178c641-f1b8-4ac2-be85-f2c129296c43 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 1.011005 Jul 28 04:02:13.951825 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2259/5018] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:12 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:14.988220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-32733234-85b2-4d04-9558-bcdfe733849b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:14.989157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-32733234-85b2-4d04-9558-bcdfe733849b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:15.010925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32733234-85b2-4d04-9558-bcdfe733849b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:15.011424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32733234-85b2-4d04-9558-bcdfe733849b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:15.012263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32733234-85b2-4d04-9558-bcdfe733849b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:15.012737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32733234-85b2-4d04-9558-bcdfe733849b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:15.097903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=83 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:15.271519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-32733234-85b2-4d04-9558-bcdfe733849b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:15.293289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-32733234-85b2-4d04-9558-bcdfe733849b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:15.304694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-32733234-85b2-4d04-9558-bcdfe733849b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:15.306920 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-32733234-85b2-4d04-9558-bcdfe733849b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.329643 Jul 28 04:02:15.320511 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2760/5019] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:14 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:16.338771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-360996d2-2b42-476b-af0d-4c16bc20152a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:16.339911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-360996d2-2b42-476b-af0d-4c16bc20152a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:16.354719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:16.358936 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-360996d2-2b42-476b-af0d-4c16bc20152a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:16.362501 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-360996d2-2b42-476b-af0d-4c16bc20152a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:16.367830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-360996d2-2b42-476b-af0d-4c16bc20152a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:16.368595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-360996d2-2b42-476b-af0d-4c16bc20152a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:17.840061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-360996d2-2b42-476b-af0d-4c16bc20152a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:17.862699 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-360996d2-2b42-476b-af0d-4c16bc20152a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:17.870692 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-360996d2-2b42-476b-af0d-4c16bc20152a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:17.872232 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-360996d2-2b42-476b-af0d-4c16bc20152a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 1.541591 Jul 28 04:02:17.879530 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2260/5020] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:16 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:18.903145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4cba5222-1c2c-44c9-a12c-13a5ef137022 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:18.903747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4cba5222-1c2c-44c9-a12c-13a5ef137022 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:18.907076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=41 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:18.916657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cba5222-1c2c-44c9-a12c-13a5ef137022 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:18.928427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cba5222-1c2c-44c9-a12c-13a5ef137022 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:18.932185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cba5222-1c2c-44c9-a12c-13a5ef137022 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:18.932907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cba5222-1c2c-44c9-a12c-13a5ef137022 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:19.440453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4cba5222-1c2c-44c9-a12c-13a5ef137022 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:19.458146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4cba5222-1c2c-44c9-a12c-13a5ef137022 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:19.459919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4cba5222-1c2c-44c9-a12c-13a5ef137022 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:19.464059 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4cba5222-1c2c-44c9-a12c-13a5ef137022 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.565635 Jul 28 04:02:19.466956 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2761/5021] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:18 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:20.497588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fb89bd62-bb58-4a2c-975b-8a1f3ca47731 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:20.499228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fb89bd62-bb58-4a2c-975b-8a1f3ca47731 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:20.526009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb89bd62-bb58-4a2c-975b-8a1f3ca47731 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:20.526553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb89bd62-bb58-4a2c-975b-8a1f3ca47731 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:20.529054 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb89bd62-bb58-4a2c-975b-8a1f3ca47731 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:20.531362 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fb89bd62-bb58-4a2c-975b-8a1f3ca47731 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:20.837108 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fb89bd62-bb58-4a2c-975b-8a1f3ca47731 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:20.856705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fb89bd62-bb58-4a2c-975b-8a1f3ca47731 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:20.867720 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fb89bd62-bb58-4a2c-975b-8a1f3ca47731 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:20.870914 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fb89bd62-bb58-4a2c-975b-8a1f3ca47731 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.377841 Jul 28 04:02:20.871536 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2261/5022] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:20 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:21.898998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f558b1b-3784-4a05-92a2-b7e4c0c1d0c8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:21.899605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f558b1b-3784-4a05-92a2-b7e4c0c1d0c8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:21.914332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f558b1b-3784-4a05-92a2-b7e4c0c1d0c8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:21.918776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f558b1b-3784-4a05-92a2-b7e4c0c1d0c8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:21.921511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f558b1b-3784-4a05-92a2-b7e4c0c1d0c8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:21.921958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f558b1b-3784-4a05-92a2-b7e4c0c1d0c8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:22.162067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f558b1b-3784-4a05-92a2-b7e4c0c1d0c8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:22.182085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f558b1b-3784-4a05-92a2-b7e4c0c1d0c8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:22.183925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f558b1b-3784-4a05-92a2-b7e4c0c1d0c8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:22.188541 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f558b1b-3784-4a05-92a2-b7e4c0c1d0c8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.292411 Jul 28 04:02:22.219379 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2762/5023] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:21 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:23.217467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9fb0d9da-4195-4738-9bdc-41eee1a9c7ad tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:23.218184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9fb0d9da-4195-4738-9bdc-41eee1a9c7ad tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:23.251347 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9fb0d9da-4195-4738-9bdc-41eee1a9c7ad tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:23.251806 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9fb0d9da-4195-4738-9bdc-41eee1a9c7ad tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:23.271742 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9fb0d9da-4195-4738-9bdc-41eee1a9c7ad tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:23.272260 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9fb0d9da-4195-4738-9bdc-41eee1a9c7ad tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:23.651271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9fb0d9da-4195-4738-9bdc-41eee1a9c7ad tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:23.661358 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9fb0d9da-4195-4738-9bdc-41eee1a9c7ad tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:23.662880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9fb0d9da-4195-4738-9bdc-41eee1a9c7ad tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:23.673985 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9fb0d9da-4195-4738-9bdc-41eee1a9c7ad tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.461514 Jul 28 04:02:23.676664 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2262/5024] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:23 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:24.704660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-95c8dd59-662c-4c4e-977a-86c6dde2f82c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:24.705452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-95c8dd59-662c-4c4e-977a-86c6dde2f82c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:24.734967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95c8dd59-662c-4c4e-977a-86c6dde2f82c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:24.739268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95c8dd59-662c-4c4e-977a-86c6dde2f82c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:24.766452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95c8dd59-662c-4c4e-977a-86c6dde2f82c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:24.772192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95c8dd59-662c-4c4e-977a-86c6dde2f82c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:25.019987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-95c8dd59-662c-4c4e-977a-86c6dde2f82c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:25.053958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-95c8dd59-662c-4c4e-977a-86c6dde2f82c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:25.060431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-95c8dd59-662c-4c4e-977a-86c6dde2f82c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:25.068142 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-95c8dd59-662c-4c4e-977a-86c6dde2f82c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.368682 Jul 28 04:02:25.080995 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2763/5025] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:24 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:26.096290 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-436b3198-02ad-42bd-93aa-5fd4197d465d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:26.098154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-436b3198-02ad-42bd-93aa-5fd4197d465d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:26.115776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-436b3198-02ad-42bd-93aa-5fd4197d465d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:26.118969 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-436b3198-02ad-42bd-93aa-5fd4197d465d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:26.125413 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-436b3198-02ad-42bd-93aa-5fd4197d465d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:26.127490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-436b3198-02ad-42bd-93aa-5fd4197d465d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:26.397580 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-436b3198-02ad-42bd-93aa-5fd4197d465d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:26.413080 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-436b3198-02ad-42bd-93aa-5fd4197d465d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:26.414684 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-436b3198-02ad-42bd-93aa-5fd4197d465d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:26.426341 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-436b3198-02ad-42bd-93aa-5fd4197d465d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.324380 Jul 28 04:02:26.427021 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2263/5026] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:26 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:02:27.454108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e89b15e1-377f-495c-a91f-b02402191e28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:27.454881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e89b15e1-377f-495c-a91f-b02402191e28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:27.472323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e89b15e1-377f-495c-a91f-b02402191e28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:27.483364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e89b15e1-377f-495c-a91f-b02402191e28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:27.484429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e89b15e1-377f-495c-a91f-b02402191e28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:27.484894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e89b15e1-377f-495c-a91f-b02402191e28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:28.146803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e89b15e1-377f-495c-a91f-b02402191e28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:28.178379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e89b15e1-377f-495c-a91f-b02402191e28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:28.180080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e89b15e1-377f-495c-a91f-b02402191e28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:28.181367 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e89b15e1-377f-495c-a91f-b02402191e28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.731711 Jul 28 04:02:28.216737 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2764/5027] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:27 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:29.209543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-df8800de-f8bc-41b2-a381-d4d113c75c38 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:29.210918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-df8800de-f8bc-41b2-a381-d4d113c75c38 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:29.222628 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df8800de-f8bc-41b2-a381-d4d113c75c38 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:29.233254 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df8800de-f8bc-41b2-a381-d4d113c75c38 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:29.234647 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df8800de-f8bc-41b2-a381-d4d113c75c38 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:29.235329 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-df8800de-f8bc-41b2-a381-d4d113c75c38 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:29.998028 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-df8800de-f8bc-41b2-a381-d4d113c75c38 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:30.019911 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-df8800de-f8bc-41b2-a381-d4d113c75c38 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:30.022336 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-df8800de-f8bc-41b2-a381-d4d113c75c38 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:30.025749 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-df8800de-f8bc-41b2-a381-d4d113c75c38 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.820348 Jul 28 04:02:30.056414 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2264/5028] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:29 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:31.069325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-75d7baac-ddc7-42b1-b73f-b5cbdab46fc8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:31.070611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-75d7baac-ddc7-42b1-b73f-b5cbdab46fc8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:31.090579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75d7baac-ddc7-42b1-b73f-b5cbdab46fc8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:31.091306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75d7baac-ddc7-42b1-b73f-b5cbdab46fc8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:31.093497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75d7baac-ddc7-42b1-b73f-b5cbdab46fc8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:31.098874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75d7baac-ddc7-42b1-b73f-b5cbdab46fc8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:32.419682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-75d7baac-ddc7-42b1-b73f-b5cbdab46fc8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:32.442665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-75d7baac-ddc7-42b1-b73f-b5cbdab46fc8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:32.451990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-75d7baac-ddc7-42b1-b73f-b5cbdab46fc8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:32.453303 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-75d7baac-ddc7-42b1-b73f-b5cbdab46fc8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 1.388203 Jul 28 04:02:32.453900 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2765/5029] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:31 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:33.482669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-bd8ac64c-7ccb-44d0-a2e6-bcb31762a571 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:33.483330 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-bd8ac64c-7ccb-44d0-a2e6-bcb31762a571 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:33.511763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd8ac64c-7ccb-44d0-a2e6-bcb31762a571 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:33.514723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd8ac64c-7ccb-44d0-a2e6-bcb31762a571 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:33.515749 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd8ac64c-7ccb-44d0-a2e6-bcb31762a571 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:33.516190 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-bd8ac64c-7ccb-44d0-a2e6-bcb31762a571 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:33.841658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bd8ac64c-7ccb-44d0-a2e6-bcb31762a571 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:33.897428 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bd8ac64c-7ccb-44d0-a2e6-bcb31762a571 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:33.916702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-bd8ac64c-7ccb-44d0-a2e6-bcb31762a571 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:33.918091 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-bd8ac64c-7ccb-44d0-a2e6-bcb31762a571 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.440821 Jul 28 04:02:33.936998 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2265/5030] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:33 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:34.949220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-37c2227e-d2b5-48d1-9e61-95ed31c7fe8e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:34.950619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-37c2227e-d2b5-48d1-9e61-95ed31c7fe8e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:34.971810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37c2227e-d2b5-48d1-9e61-95ed31c7fe8e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:34.972843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37c2227e-d2b5-48d1-9e61-95ed31c7fe8e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:34.980507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37c2227e-d2b5-48d1-9e61-95ed31c7fe8e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:34.981437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37c2227e-d2b5-48d1-9e61-95ed31c7fe8e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:36.097051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-37c2227e-d2b5-48d1-9e61-95ed31c7fe8e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:36.119441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-37c2227e-d2b5-48d1-9e61-95ed31c7fe8e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:36.124316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-37c2227e-d2b5-48d1-9e61-95ed31c7fe8e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:36.126322 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-37c2227e-d2b5-48d1-9e61-95ed31c7fe8e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 1.181701 Jul 28 04:02:36.137134 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2766/5031] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:34 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:37.163131 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3ba43583-06fa-4afa-ba99-ac99079c321c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:37.164559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3ba43583-06fa-4afa-ba99-ac99079c321c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:37.181762 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ba43583-06fa-4afa-ba99-ac99079c321c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:37.182406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ba43583-06fa-4afa-ba99-ac99079c321c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:37.185885 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ba43583-06fa-4afa-ba99-ac99079c321c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:37.202353 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ba43583-06fa-4afa-ba99-ac99079c321c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:37.471837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3ba43583-06fa-4afa-ba99-ac99079c321c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:37.490623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3ba43583-06fa-4afa-ba99-ac99079c321c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:37.492201 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3ba43583-06fa-4afa-ba99-ac99079c321c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:37.493508 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3ba43583-06fa-4afa-ba99-ac99079c321c tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.338088 Jul 28 04:02:37.519948 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2266/5032] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:37 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:38.527277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7921fbba-d656-4fd9-8202-0cdd401943e1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:38.533558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7921fbba-d656-4fd9-8202-0cdd401943e1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:38.586098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7921fbba-d656-4fd9-8202-0cdd401943e1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:38.587716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7921fbba-d656-4fd9-8202-0cdd401943e1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:38.591041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7921fbba-d656-4fd9-8202-0cdd401943e1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:38.593667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7921fbba-d656-4fd9-8202-0cdd401943e1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:38.804586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7921fbba-d656-4fd9-8202-0cdd401943e1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:38.821629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7921fbba-d656-4fd9-8202-0cdd401943e1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:38.823169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7921fbba-d656-4fd9-8202-0cdd401943e1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:38.831854 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7921fbba-d656-4fd9-8202-0cdd401943e1 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.315820 Jul 28 04:02:38.832508 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2767/5033] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:38 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:39.864868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f1e42566-2450-40cd-a6dc-54c1ba686b1b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:39.865638 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f1e42566-2450-40cd-a6dc-54c1ba686b1b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:39.882671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1e42566-2450-40cd-a6dc-54c1ba686b1b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:39.883658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1e42566-2450-40cd-a6dc-54c1ba686b1b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:39.884562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1e42566-2450-40cd-a6dc-54c1ba686b1b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:39.888260 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f1e42566-2450-40cd-a6dc-54c1ba686b1b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:40.165131 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f1e42566-2450-40cd-a6dc-54c1ba686b1b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:40.199179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f1e42566-2450-40cd-a6dc-54c1ba686b1b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:40.201029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f1e42566-2450-40cd-a6dc-54c1ba686b1b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:40.214763 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f1e42566-2450-40cd-a6dc-54c1ba686b1b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.358189 Jul 28 04:02:40.215390 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2267/5034] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:39 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:40.551289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2122818121", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "462e9086-df54-488f-a03f-5e8360013b0d"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:40.674924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] validate_networks() for [('462e9086-df54-488f-a03f-5e8360013b0d', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:02:41.251862 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cdc1ec28-b912-499f-aafc-871d81d333f8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:41.253924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cdc1ec28-b912-499f-aafc-871d81d333f8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:41.314184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cdc1ec28-b912-499f-aafc-871d81d333f8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:41.321482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cdc1ec28-b912-499f-aafc-871d81d333f8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:41.327933 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cdc1ec28-b912-499f-aafc-871d81d333f8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:41.333101 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cdc1ec28-b912-499f-aafc-871d81d333f8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:41.686274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cdc1ec28-b912-499f-aafc-871d81d333f8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:41.705429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cdc1ec28-b912-499f-aafc-871d81d333f8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:41.710150 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cdc1ec28-b912-499f-aafc-871d81d333f8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:41.720914 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cdc1ec28-b912-499f-aafc-871d81d333f8 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.478703 Jul 28 04:02:41.724058 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2268/5035] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:41 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:02:42.745150 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-67231645-4315-4161-8308-0b9ba9eec91e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:42.746173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-67231645-4315-4161-8308-0b9ba9eec91e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:42.774710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67231645-4315-4161-8308-0b9ba9eec91e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:42.779777 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67231645-4315-4161-8308-0b9ba9eec91e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:42.790096 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67231645-4315-4161-8308-0b9ba9eec91e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:42.793515 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-67231645-4315-4161-8308-0b9ba9eec91e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:43.120159 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-67231645-4315-4161-8308-0b9ba9eec91e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:43.122547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=61 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:43.132697 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-67231645-4315-4161-8308-0b9ba9eec91e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:43.134228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-67231645-4315-4161-8308-0b9ba9eec91e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:43.135460 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-67231645-4315-4161-8308-0b9ba9eec91e tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.394636 Jul 28 04:02:43.156761 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2269/5036] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:42 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:02:43.828469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:02:43.830835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:02:43.831485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:02:43.832013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:02:43.836324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:02:43.885857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:43.890735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:43.898435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:43.900899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.050928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Getting quotas for project 20141383097d4e2fa18337fdb001e7a2. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:02:44.088582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Getting quotas for user 7cf7921de39349739835f1ebd23ac77b and project 20141383097d4e2fa18337fdb001e7a2. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:02:44.158650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:02:44.169993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cd486078-c131-42bd-aaf7-c8846147b312 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:44.170745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:02:44.170934 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cd486078-c131-42bd-aaf7-c8846147b312 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:44.194423 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd486078-c131-42bd-aaf7-c8846147b312 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.194894 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd486078-c131-42bd-aaf7-c8846147b312 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.201728 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd486078-c131-42bd-aaf7-c8846147b312 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.203939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd486078-c131-42bd-aaf7-c8846147b312 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.374638 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0856a0b9-66c7-4802-bed3-36df4647dfe3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.406505 Jul 28 04:02:44.379637 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2768/5037] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:02:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 4421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:02:44.389403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-445f3151-756e-4233-8bf6-a0b0a40f9023 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:44.411061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-445f3151-756e-4233-8bf6-a0b0a40f9023 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:44.559183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd486078-c131-42bd-aaf7-c8846147b312 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:44.616855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd486078-c131-42bd-aaf7-c8846147b312 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:44.622370 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd486078-c131-42bd-aaf7-c8846147b312 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:44.623691 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cd486078-c131-42bd-aaf7-c8846147b312 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.459909 Jul 28 04:02:44.628023 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2270/5038] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:44 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:02:44.752649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-445f3151-756e-4233-8bf6-a0b0a40f9023 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:44.765909 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-445f3151-756e-4233-8bf6-a0b0a40f9023 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1218 microversion: 2.1 time: 0.380340 Jul 28 04:02:44.769949 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2769/5039] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:44 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1218 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:45.648198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8acb8339-fd58-4bad-8214-b12541f2a645 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:45.649034 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8acb8339-fd58-4bad-8214-b12541f2a645 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:45.675325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8acb8339-fd58-4bad-8214-b12541f2a645 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:45.676068 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8acb8339-fd58-4bad-8214-b12541f2a645 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:45.678872 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8acb8339-fd58-4bad-8214-b12541f2a645 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:45.683406 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8acb8339-fd58-4bad-8214-b12541f2a645 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:45.794728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3fbab649-519b-43cd-abf7-795d67a0ad75 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:45.796567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3fbab649-519b-43cd-abf7-795d67a0ad75 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:45.874706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fbab649-519b-43cd-abf7-795d67a0ad75 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:45.883210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fbab649-519b-43cd-abf7-795d67a0ad75 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:45.884340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fbab649-519b-43cd-abf7-795d67a0ad75 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:45.884971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fbab649-519b-43cd-abf7-795d67a0ad75 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:45.895422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=50 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:46.085059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8acb8339-fd58-4bad-8214-b12541f2a645 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:46.105939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8acb8339-fd58-4bad-8214-b12541f2a645 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:46.114604 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8acb8339-fd58-4bad-8214-b12541f2a645 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:46.116578 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8acb8339-fd58-4bad-8214-b12541f2a645 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 0.473247 Jul 28 04:02:46.121229 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2271/5040] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:45 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:46.274458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3fbab649-519b-43cd-abf7-795d67a0ad75 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:46.288293 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3fbab649-519b-43cd-abf7-795d67a0ad75 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1222 microversion: 2.1 time: 0.495622 Jul 28 04:02:46.289762 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2770/5041] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:45 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1222 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:47.148966 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d92d2499-a687-477e-ad5b-09b93dc1969d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:47.149716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d92d2499-a687-477e-ad5b-09b93dc1969d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:47.159707 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=24 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:47.167202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d92d2499-a687-477e-ad5b-09b93dc1969d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:47.169592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d92d2499-a687-477e-ad5b-09b93dc1969d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:47.173539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d92d2499-a687-477e-ad5b-09b93dc1969d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:47.174188 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d92d2499-a687-477e-ad5b-09b93dc1969d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:47.311426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-387d97ce-0e39-4389-80cd-6be552f9377e tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:47.312772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-387d97ce-0e39-4389-80cd-6be552f9377e tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:47.326963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-387d97ce-0e39-4389-80cd-6be552f9377e tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:47.330492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-387d97ce-0e39-4389-80cd-6be552f9377e tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:47.333312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-387d97ce-0e39-4389-80cd-6be552f9377e tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:47.334735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-387d97ce-0e39-4389-80cd-6be552f9377e tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:47.514567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-387d97ce-0e39-4389-80cd-6be552f9377e tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:47.526290 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-387d97ce-0e39-4389-80cd-6be552f9377e tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1288 microversion: 2.1 time: 0.220136 Jul 28 04:02:47.531499 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2771/5042] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:47 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1288 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:48.555791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b8cfec2f-ffae-4833-95a4-f12267de15d5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:48.557616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b8cfec2f-ffae-4833-95a4-f12267de15d5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:48.591698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8cfec2f-ffae-4833-95a4-f12267de15d5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:48.592565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8cfec2f-ffae-4833-95a4-f12267de15d5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:48.593603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8cfec2f-ffae-4833-95a4-f12267de15d5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:48.595415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8cfec2f-ffae-4833-95a4-f12267de15d5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:48.799336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8cfec2f-ffae-4833-95a4-f12267de15d5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:48.817330 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b8cfec2f-ffae-4833-95a4-f12267de15d5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1276 microversion: 2.1 time: 0.266160 Jul 28 04:02:48.819217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d92d2499-a687-477e-ad5b-09b93dc1969d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:48.821514 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2772/5043] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:48 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1276 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:48.840244 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d92d2499-a687-477e-ad5b-09b93dc1969d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:48.847761 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d92d2499-a687-477e-ad5b-09b93dc1969d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4acaa84bd52e40d9ad5809a5acf0e5a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc3cf9680194c01945e8764c0aa2985', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:48.857952 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d92d2499-a687-477e-ad5b-09b93dc1969d tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 200 len: 1604 microversion: 2.32 time: 1.713478 Jul 28 04:02:48.866725 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2272/5044] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:47 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 1604 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:02:49.846341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2fb0a4ab-412c-45c1-9e6e-5cf5e84ab650 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:49.847558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2fb0a4ab-412c-45c1-9e6e-5cf5e84ab650 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:49.851729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:49.892454 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-afdbcb74-9961-4926-afa2-86875c139d7a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:49.892964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2fb0a4ab-412c-45c1-9e6e-5cf5e84ab650 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:49.893211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-afdbcb74-9961-4926-afa2-86875c139d7a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:49.893441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2fb0a4ab-412c-45c1-9e6e-5cf5e84ab650 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:49.894277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2fb0a4ab-412c-45c1-9e6e-5cf5e84ab650 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:49.894718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2fb0a4ab-412c-45c1-9e6e-5cf5e84ab650 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:49.909323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afdbcb74-9961-4926-afa2-86875c139d7a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:49.909788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afdbcb74-9961-4926-afa2-86875c139d7a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:49.910601 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afdbcb74-9961-4926-afa2-86875c139d7a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:49.911045 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-afdbcb74-9961-4926-afa2-86875c139d7a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:49.963313 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-afdbcb74-9961-4926-afa2-86875c139d7a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] HTTP exception thrown: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-afdbcb74-9961-4926-afa2-86875c139d7a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Request method failure captured: Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 HTTP/1.1 Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4girWQpT64Z9owAdC8KxlFimee82DG2Vm3A5u1bb9xav2KQgDbi0OejoCa9ldK_BfspPhSTAiYlH-5mL_la5jSCDacuszeyrhjbGD7QQqbx3LB2xbuDP12DX2gRrmIef2xhpmnaJ1MDYnmXtpmkCD3LfhyCx9ObMBnnupDWfQHJMqwA Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Openstack-Nova-Api-Version: 2.32 Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: fbc3cf9680194c01945e8764c0aa2985 Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-TaggedBootDevicesTest-1590694750 Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fbc3cf9680194c01945e8764c0aa2985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fbc3cf9680194c01945e8764c0aa2985"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fbc3cf9680194c01945e8764c0aa2985"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fbc3cf9680194c01945e8764c0aa2985"}]}] Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-TaggedBootDevicesTest-1590694750 Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: fbc3cf9680194c01945e8764c0aa2985 Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1590694750 Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-TaggedBootDevicesTest-1590694750-project Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 4acaa84bd52e40d9ad5809a5acf0e5a9 Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-TaggedBootDevicesTest-1590694750-project Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '2435442e-fb0d-4ee1-844f-e8f57df3d579'} Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:02:49.969307 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:02:49.977040 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:49.977040 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:02:49.977040 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:02:49.977040 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:02:49.977040 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:02:49.977040 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:02:49.977040 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:02:49.984547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-afdbcb74-9961-4926-afa2-86875c139d7a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Returning 404 to user: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:02:49.985462 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-afdbcb74-9961-4926-afa2-86875c139d7a tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 404 len: 111 microversion: 2.32 time: 0.098060 Jul 28 04:02:49.986119 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2273/5045] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:02:49 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 04:02:49.998095 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-efc5ac0a-88cd-429b-9394-27b5ee0238a5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '.version_select at 0x7ffa67750310>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:50.047920 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-efc5ac0a-88cd-429b-9394-27b5ee0238a5 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444746979" status: 204 len: 0 microversion: 2.32 time: 0.054004 Jul 28 04:02:50.049441 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2274/5046] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Jul 28 04:02:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1444746979 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 04:02:50.204323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2fb0a4ab-412c-45c1-9e6e-5cf5e84ab650 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:50.214060 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2fb0a4ab-412c-45c1-9e6e-5cf5e84ab650 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1276 microversion: 2.1 time: 0.371723 Jul 28 04:02:50.230111 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2773/5047] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:49 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1276 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:51.239845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9d7e7dd2-7ef4-4f68-a215-177eea39a195 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:51.241016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9d7e7dd2-7ef4-4f68-a215-177eea39a195 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:51.257418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d7e7dd2-7ef4-4f68-a215-177eea39a195 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:51.258589 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d7e7dd2-7ef4-4f68-a215-177eea39a195 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:51.259503 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d7e7dd2-7ef4-4f68-a215-177eea39a195 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:51.260171 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d7e7dd2-7ef4-4f68-a215-177eea39a195 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:51.521615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9d7e7dd2-7ef4-4f68-a215-177eea39a195 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:51.538003 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9d7e7dd2-7ef4-4f68-a215-177eea39a195 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1318 microversion: 2.1 time: 0.303129 Jul 28 04:02:51.551728 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2275/5048] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:51 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:51.727564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-79b7ad8e-b245-43ac-b6e1-b52fcb40c8a0 req-74750c12-84f1-45ad-9207-5f3009ba182f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933e568e-aa6a-4dfa-b053-2628d1fef93b", "tag": "6518f4f4-d55e-44fc-91f4-150d143e36dd"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:51.753444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-79b7ad8e-b245-43ac-b6e1-b52fcb40c8a0 req-74750c12-84f1-45ad-9207-5f3009ba182f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:51.760245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-79b7ad8e-b245-43ac-b6e1-b52fcb40c8a0 req-74750c12-84f1-45ad-9207-5f3009ba182f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:51.778947 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-79b7ad8e-b245-43ac-b6e1-b52fcb40c8a0 req-74750c12-84f1-45ad-9207-5f3009ba182f service nova] Creating event network-changed:6518f4f4-d55e-44fc-91f4-150d143e36dd for instance 933e568e-aa6a-4dfa-b053-2628d1fef93b on n-h1-826756-3 Jul 28 04:02:51.791715 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-79b7ad8e-b245-43ac-b6e1-b52fcb40c8a0 req-74750c12-84f1-45ad-9207-5f3009ba182f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067316 Jul 28 04:02:51.792766 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2774/5049] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:52.563549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d6a901af-07ac-4964-9fc0-2e8fa75906aa tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:52.564384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d6a901af-07ac-4964-9fc0-2e8fa75906aa tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:52.578886 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6a901af-07ac-4964-9fc0-2e8fa75906aa tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:52.579336 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6a901af-07ac-4964-9fc0-2e8fa75906aa tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:52.583518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6a901af-07ac-4964-9fc0-2e8fa75906aa tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:52.584533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6a901af-07ac-4964-9fc0-2e8fa75906aa tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:53.591945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d6a901af-07ac-4964-9fc0-2e8fa75906aa tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:53.606496 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d6a901af-07ac-4964-9fc0-2e8fa75906aa tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1318 microversion: 2.1 time: 1.049875 Jul 28 04:02:53.608029 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2276/5050] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:52 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1318 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:54.630011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d379d162-a0f7-410a-9404-01dbae9837f9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:54.630777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d379d162-a0f7-410a-9404-01dbae9837f9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:54.644054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:54.650378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d379d162-a0f7-410a-9404-01dbae9837f9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:54.650860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d379d162-a0f7-410a-9404-01dbae9837f9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:54.651669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d379d162-a0f7-410a-9404-01dbae9837f9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:54.654272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d379d162-a0f7-410a-9404-01dbae9837f9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:54.759001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:55.374292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d379d162-a0f7-410a-9404-01dbae9837f9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:55.383734 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d379d162-a0f7-410a-9404-01dbae9837f9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1318 microversion: 2.1 time: 0.758082 Jul 28 04:02:55.386798 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2775/5051] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:54 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1318 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:56.407716 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-387e0be0-cbbd-4329-bb79-eba935a965df tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:56.408436 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-387e0be0-cbbd-4329-bb79-eba935a965df tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:56.419733 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-387e0be0-cbbd-4329-bb79-eba935a965df tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:56.426705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-387e0be0-cbbd-4329-bb79-eba935a965df tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:56.427778 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-387e0be0-cbbd-4329-bb79-eba935a965df tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:56.428334 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-387e0be0-cbbd-4329-bb79-eba935a965df tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:57.136262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-387e0be0-cbbd-4329-bb79-eba935a965df tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:57.146518 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-387e0be0-cbbd-4329-bb79-eba935a965df tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1318 microversion: 2.1 time: 0.742246 Jul 28 04:02:57.147865 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2277/5052] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:56 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1318 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:58.171348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-272bc2e6-f1ce-4c7f-b418-7661d7f5f010 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:58.171954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-272bc2e6-f1ce-4c7f-b418-7661d7f5f010 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:02:58.193215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-272bc2e6-f1ce-4c7f-b418-7661d7f5f010 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:58.193878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-272bc2e6-f1ce-4c7f-b418-7661d7f5f010 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:58.194837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-272bc2e6-f1ce-4c7f-b418-7661d7f5f010 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:58.195471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-272bc2e6-f1ce-4c7f-b418-7661d7f5f010 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:59.166249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-272bc2e6-f1ce-4c7f-b418-7661d7f5f010 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:59.174510 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-272bc2e6-f1ce-4c7f-b418-7661d7f5f010 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1318 microversion: 2.1 time: 1.006958 Jul 28 04:02:59.193925 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2776/5053] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:58 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1318 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:00.197979 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-76110bc9-b304-4504-8162-d7bccc96c6a9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:00.199358 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-76110bc9-b304-4504-8162-d7bccc96c6a9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:00.222194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76110bc9-b304-4504-8162-d7bccc96c6a9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:00.222675 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76110bc9-b304-4504-8162-d7bccc96c6a9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:00.224479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76110bc9-b304-4504-8162-d7bccc96c6a9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:00.225610 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-76110bc9-b304-4504-8162-d7bccc96c6a9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:00.664807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-76110bc9-b304-4504-8162-d7bccc96c6a9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:00.678271 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-76110bc9-b304-4504-8162-d7bccc96c6a9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1318 microversion: 2.1 time: 0.485823 Jul 28 04:03:00.682183 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2278/5054] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:00 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1318 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:01.708886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8dcd1c87-7d27-44ae-b223-60eb9aab523c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:01.709653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8dcd1c87-7d27-44ae-b223-60eb9aab523c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:01.733825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dcd1c87-7d27-44ae-b223-60eb9aab523c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:01.734991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dcd1c87-7d27-44ae-b223-60eb9aab523c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:01.735907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dcd1c87-7d27-44ae-b223-60eb9aab523c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:01.736373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dcd1c87-7d27-44ae-b223-60eb9aab523c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:02.459503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8dcd1c87-7d27-44ae-b223-60eb9aab523c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:02.479695 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8dcd1c87-7d27-44ae-b223-60eb9aab523c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1318 microversion: 2.1 time: 0.777660 Jul 28 04:03:02.485435 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2777/5055] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:01 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1318 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:02.805286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-61609bc9-eea5-4192-8c18-c2e9b190a9a6 req-1704ea89-a175-428c-9c5b-42119b8e7c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933e568e-aa6a-4dfa-b053-2628d1fef93b", "name": "network-vif-plugged", "status": "completed", "tag": "6518f4f4-d55e-44fc-91f4-150d143e36dd"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:02.827401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-61609bc9-eea5-4192-8c18-c2e9b190a9a6 req-1704ea89-a175-428c-9c5b-42119b8e7c04 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:02.833451 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-61609bc9-eea5-4192-8c18-c2e9b190a9a6 req-1704ea89-a175-428c-9c5b-42119b8e7c04 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:02.866182 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-61609bc9-eea5-4192-8c18-c2e9b190a9a6 req-1704ea89-a175-428c-9c5b-42119b8e7c04 service nova] Creating event network-vif-plugged:6518f4f4-d55e-44fc-91f4-150d143e36dd for instance 933e568e-aa6a-4dfa-b053-2628d1fef93b on n-h1-826756-3 Jul 28 04:03:02.882562 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-61609bc9-eea5-4192-8c18-c2e9b190a9a6 req-1704ea89-a175-428c-9c5b-42119b8e7c04 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077183 Jul 28 04:03:02.884312 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2279/5056] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:03.514354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c249b287-2185-4557-ab38-e12391f0af05 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:03.515006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c249b287-2185-4557-ab38-e12391f0af05 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:03.529040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c249b287-2185-4557-ab38-e12391f0af05 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:03.530262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c249b287-2185-4557-ab38-e12391f0af05 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:03.536385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c249b287-2185-4557-ab38-e12391f0af05 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:03.536385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c249b287-2185-4557-ab38-e12391f0af05 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:04.918377 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-469565290", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:04.980066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c249b287-2185-4557-ab38-e12391f0af05 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:04.988792 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c249b287-2185-4557-ab38-e12391f0af05 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1318 microversion: 2.1 time: 1.479452 Jul 28 04:03:04.989389 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2778/5057] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:03 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1318 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:05.031325 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] validate_networks() for None {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:03:05.865564 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:03:05.866106 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:03:05.866658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:03:05.870040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:03:05.870595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:03:05.919498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:05.923609 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:05.929797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:05.933685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:05.997479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Getting quotas for project 031d396edf334c0280e3d5ecc2270b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:03:06.011559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0abb1de1-d72b-41bf-afbd-9331da1f409c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:06.012824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0abb1de1-d72b-41bf-afbd-9331da1f409c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:06.027571 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Getting quotas for user 1908fee100354163ae1da54e7f2a5319 and project 031d396edf334c0280e3d5ecc2270b7b. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:03:06.029866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0abb1de1-d72b-41bf-afbd-9331da1f409c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:06.042084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0abb1de1-d72b-41bf-afbd-9331da1f409c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:06.057223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0abb1de1-d72b-41bf-afbd-9331da1f409c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:06.060956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0abb1de1-d72b-41bf-afbd-9331da1f409c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:06.096079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:03:06.100280 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:03:06.197925 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7ad79ac1-4b28-4813-8008-2ea192fb6b67 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.283599 Jul 28 04:03:06.201648 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2280/5058] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:03:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:03:06.211351 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6e8cfa36-fe46-4418-993a-38947f81654a tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:06.221393 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6e8cfa36-fe46-4418-993a-38947f81654a tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:06.517027 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6e8cfa36-fe46-4418-993a-38947f81654a tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:06.530353 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6e8cfa36-fe46-4418-993a-38947f81654a tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1213 microversion: 2.1 time: 0.323175 Jul 28 04:03:06.549811 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2281/5059] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:06 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1213 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:06.627536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0abb1de1-d72b-41bf-afbd-9331da1f409c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:06.642476 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0abb1de1-d72b-41bf-afbd-9331da1f409c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1509 microversion: 2.1 time: 0.634984 Jul 28 04:03:06.660971 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2779/5060] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:06 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1509 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:06.674887 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-398127ba-2d4e-4ccb-9785-21a067936959 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:06.675715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-398127ba-2d4e-4ccb-9785-21a067936959 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:06.689687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-398127ba-2d4e-4ccb-9785-21a067936959 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:06.696786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-398127ba-2d4e-4ccb-9785-21a067936959 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:06.697979 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-398127ba-2d4e-4ccb-9785-21a067936959 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:06.704016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-398127ba-2d4e-4ccb-9785-21a067936959 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:07.255325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4fd399e3-6780-4cb1-867e-c14effdb417b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:07.255929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4fd399e3-6780-4cb1-867e-c14effdb417b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:07.269872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4fd399e3-6780-4cb1-867e-c14effdb417b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:07.270326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4fd399e3-6780-4cb1-867e-c14effdb417b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:07.287617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4fd399e3-6780-4cb1-867e-c14effdb417b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:07.290238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4fd399e3-6780-4cb1-867e-c14effdb417b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:07.340908 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-4fd399e3-6780-4cb1-867e-c14effdb417b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] HTTP exception thrown: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4fd399e3-6780-4cb1-867e-c14effdb417b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Request method failure captured: Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 HTTP/1.1 Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4girWQpT64Z9owAdC8KxlFimee82DG2Vm3A5u1bb9xav2KQgDbi0OejoCa9ldK_BfspPhSTAiYlH-5mL_la5jSCDacuszeyrhjbGD7QQqbx3LB2xbuDP12DX2gRrmIef2xhpmnaJ1MDYnmXtpmkCD3LfhyCx9ObMBnnupDWfQHJMqwA Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.32 Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: fbc3cf9680194c01945e8764c0aa2985 Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TaggedBootDevicesTest-1590694750 Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fbc3cf9680194c01945e8764c0aa2985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fbc3cf9680194c01945e8764c0aa2985"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fbc3cf9680194c01945e8764c0aa2985"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fbc3cf9680194c01945e8764c0aa2985"}]}] Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TaggedBootDevicesTest-1590694750 Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: fbc3cf9680194c01945e8764c0aa2985 Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1590694750 Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TaggedBootDevicesTest-1590694750-project Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 4acaa84bd52e40d9ad5809a5acf0e5a9 Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TaggedBootDevicesTest-1590694750-project Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2435442e-fb0d-4ee1-844f-e8f57df3d579'} Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:03:07.347265 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:03:07.351980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:03:07.351980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:03:07.351980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:07.351980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:03:07.351980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:07.351980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:07.351980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:07.351980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:03:07.351980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:03:07.351980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:03:07.351980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:03:07.351980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4fd399e3-6780-4cb1-867e-c14effdb417b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Returning 404 to user: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:03:07.351980 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4fd399e3-6780-4cb1-867e-c14effdb417b tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 404 len: 111 microversion: 2.32 time: 0.100638 Jul 28 04:03:07.353742 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2780/5061] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Jul 28 04:03:07 2022] DELETE /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 28 04:03:07.374473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-37bce828-86e0-49aa-ac33-5aa5408c4a28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:07.375218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-37bce828-86e0-49aa-ac33-5aa5408c4a28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] [instance: 2435442e-fb0d-4ee1-844f-e8f57df3d579] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:07.394879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37bce828-86e0-49aa-ac33-5aa5408c4a28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:07.395556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37bce828-86e0-49aa-ac33-5aa5408c4a28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:07.397363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37bce828-86e0-49aa-ac33-5aa5408c4a28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:07.399231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37bce828-86e0-49aa-ac33-5aa5408c4a28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:07.459792 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-37bce828-86e0-49aa-ac33-5aa5408c4a28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] HTTP exception thrown: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-37bce828-86e0-49aa-ac33-5aa5408c4a28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Request method failure captured: Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 HTTP/1.1 Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4girWQpT64Z9owAdC8KxlFimee82DG2Vm3A5u1bb9xav2KQgDbi0OejoCa9ldK_BfspPhSTAiYlH-5mL_la5jSCDacuszeyrhjbGD7QQqbx3LB2xbuDP12DX2gRrmIef2xhpmnaJ1MDYnmXtpmkCD3LfhyCx9ObMBnnupDWfQHJMqwA Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Openstack-Nova-Api-Version: 2.32 Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: fbc3cf9680194c01945e8764c0aa2985 Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TaggedBootDevicesTest-1590694750 Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fbc3cf9680194c01945e8764c0aa2985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fbc3cf9680194c01945e8764c0aa2985"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fbc3cf9680194c01945e8764c0aa2985"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fbc3cf9680194c01945e8764c0aa2985"}]}] Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TaggedBootDevicesTest-1590694750 Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: fbc3cf9680194c01945e8764c0aa2985 Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1590694750 Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TaggedBootDevicesTest-1590694750-project Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 4acaa84bd52e40d9ad5809a5acf0e5a9 Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TaggedBootDevicesTest-1590694750-project Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2435442e-fb0d-4ee1-844f-e8f57df3d579'} Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:07.466477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:03:07.472240 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:07.472240 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:07.472240 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:07.472240 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:03:07.472240 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:03:07.472240 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. Jul 28 04:03:07.472240 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:03:07.473858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-37bce828-86e0-49aa-ac33-5aa5408c4a28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] Returning 404 to user: Instance 2435442e-fb0d-4ee1-844f-e8f57df3d579 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:03:07.474932 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-37bce828-86e0-49aa-ac33-5aa5408c4a28 tempest-TaggedBootDevicesTest-1590694750 tempest-TaggedBootDevicesTest-1590694750-project] 10.222.0.48 "GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579" status: 404 len: 111 microversion: 2.32 time: 0.117414 Jul 28 04:03:07.476684 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2781/5062] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jul 28 04:03:07 2022] GET /compute/v2.1/servers/2435442e-fb0d-4ee1-844f-e8f57df3d579 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:03:07.555432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-829d828e-386c-4062-8389-48aee4f22295 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:07.556051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-829d828e-386c-4062-8389-48aee4f22295 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:07.566274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-829d828e-386c-4062-8389-48aee4f22295 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:07.566722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-829d828e-386c-4062-8389-48aee4f22295 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:07.582107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-829d828e-386c-4062-8389-48aee4f22295 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:07.582757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-829d828e-386c-4062-8389-48aee4f22295 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:07.843755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-398127ba-2d4e-4ccb-9785-21a067936959 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:07.854153 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-398127ba-2d4e-4ccb-9785-21a067936959 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1509 microversion: 2.1 time: 1.183843 Jul 28 04:03:07.859656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-829d828e-386c-4062-8389-48aee4f22295 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:07.868499 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-829d828e-386c-4062-8389-48aee4f22295 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1209 microversion: 2.1 time: 0.317043 Jul 28 04:03:07.869094 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2782/5063] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:07 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1209 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:07.889344 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2282/5064] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:06 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1509 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:07.896658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:07.910783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:07.922075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:07.926377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:07.927725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:07.931596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:08.133917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:03:08.134322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:03:08.134792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:03:08.135203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:03:08.135617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:03:08.351126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:08.404378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:08.407074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:08.412595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:08.414723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:08.598370 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-94804ca8-27df-4da9-80e7-cd1de300ef7d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "POST /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b/action" status: 202 len: 1111 microversion: 2.1 time: 0.706274 Jul 28 04:03:08.604140 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2783/5065] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:03:07 2022] POST /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b/action => generated 1111 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 28 04:03:08.619892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-44e6f998-347f-4ed5-8149-7eb39f0179b5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:08.620834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-44e6f998-347f-4ed5-8149-7eb39f0179b5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:08.629097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44e6f998-347f-4ed5-8149-7eb39f0179b5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:08.637390 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44e6f998-347f-4ed5-8149-7eb39f0179b5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:08.638543 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44e6f998-347f-4ed5-8149-7eb39f0179b5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:08.643507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-44e6f998-347f-4ed5-8149-7eb39f0179b5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:08.892329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a6386b30-cc65-4f26-86a4-25c7198388ed tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:08.892997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a6386b30-cc65-4f26-86a4-25c7198388ed tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:08.916734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6386b30-cc65-4f26-86a4-25c7198388ed tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:08.917296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6386b30-cc65-4f26-86a4-25c7198388ed tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:08.934544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6386b30-cc65-4f26-86a4-25c7198388ed tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:08.937397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6386b30-cc65-4f26-86a4-25c7198388ed tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:09.165149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a6386b30-cc65-4f26-86a4-25c7198388ed tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:09.174691 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a6386b30-cc65-4f26-86a4-25c7198388ed tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1271 microversion: 2.1 time: 0.287869 Jul 28 04:03:09.175308 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2784/5066] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:08 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1271 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:09.429670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-44e6f998-347f-4ed5-8149-7eb39f0179b5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:09.438183 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-44e6f998-347f-4ed5-8149-7eb39f0179b5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 0.822121 Jul 28 04:03:09.454465 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2283/5067] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:08 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:10.197024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2770c65f-9282-4b04-8c63-d9db86f1b225 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:10.198403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2770c65f-9282-4b04-8c63-d9db86f1b225 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:10.211366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2770c65f-9282-4b04-8c63-d9db86f1b225 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:10.218313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2770c65f-9282-4b04-8c63-d9db86f1b225 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:10.219790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2770c65f-9282-4b04-8c63-d9db86f1b225 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:10.220583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2770c65f-9282-4b04-8c63-d9db86f1b225 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:10.385769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2770c65f-9282-4b04-8c63-d9db86f1b225 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:10.403423 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2770c65f-9282-4b04-8c63-d9db86f1b225 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1271 microversion: 2.1 time: 0.210291 Jul 28 04:03:10.404734 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2785/5068] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:10 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:10.463158 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-10f92f73-0da3-4f60-82c2-d9fc41393479 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:10.464326 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-10f92f73-0da3-4f60-82c2-d9fc41393479 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:10.491848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-10f92f73-0da3-4f60-82c2-d9fc41393479 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:10.504721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-10f92f73-0da3-4f60-82c2-d9fc41393479 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:10.509892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-10f92f73-0da3-4f60-82c2-d9fc41393479 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:10.509892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-10f92f73-0da3-4f60-82c2-d9fc41393479 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:11.428031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-003f9238-75b9-4985-a911-71389e242857 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:11.428837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-003f9238-75b9-4985-a911-71389e242857 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:11.447802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-003f9238-75b9-4985-a911-71389e242857 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:11.450082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-003f9238-75b9-4985-a911-71389e242857 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:11.452750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-003f9238-75b9-4985-a911-71389e242857 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:11.453560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-003f9238-75b9-4985-a911-71389e242857 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:11.742414 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-10f92f73-0da3-4f60-82c2-d9fc41393479 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:11.754559 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-10f92f73-0da3-4f60-82c2-d9fc41393479 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 1.295961 Jul 28 04:03:11.768385 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2284/5069] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:10 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:12.216188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-003f9238-75b9-4985-a911-71389e242857 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:12.220781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:12.250785 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-003f9238-75b9-4985-a911-71389e242857 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1271 microversion: 2.1 time: 0.823268 Jul 28 04:03:12.272904 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2786/5070] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:11 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1271 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:12.782235 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-86fc0dff-ccaf-41bd-bf00-65e030288d54 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:12.783019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-86fc0dff-ccaf-41bd-bf00-65e030288d54 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:12.801531 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86fc0dff-ccaf-41bd-bf00-65e030288d54 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:12.801951 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86fc0dff-ccaf-41bd-bf00-65e030288d54 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:12.802743 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86fc0dff-ccaf-41bd-bf00-65e030288d54 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:12.803177 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-86fc0dff-ccaf-41bd-bf00-65e030288d54 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:13.287208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b886ec1-9c05-4db6-ae60-0553af0be8ab tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:13.291574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b886ec1-9c05-4db6-ae60-0553af0be8ab tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:13.314345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b886ec1-9c05-4db6-ae60-0553af0be8ab tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:13.314798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b886ec1-9c05-4db6-ae60-0553af0be8ab tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:13.315581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b886ec1-9c05-4db6-ae60-0553af0be8ab tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:13.316036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b886ec1-9c05-4db6-ae60-0553af0be8ab tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:13.556147 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-86fc0dff-ccaf-41bd-bf00-65e030288d54 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:13.568880 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-86fc0dff-ccaf-41bd-bf00-65e030288d54 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 0.789553 Jul 28 04:03:13.582938 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2285/5071] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:12 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:13.989307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7b886ec1-9c05-4db6-ae60-0553af0be8ab tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:14.009533 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b886ec1-9c05-4db6-ae60-0553af0be8ab tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1313 microversion: 2.1 time: 0.736387 Jul 28 04:03:14.013208 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2787/5072] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:13 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1313 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:14.599230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ef59de7b-497d-47a7-9e07-0ec850276cd3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:14.612602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ef59de7b-497d-47a7-9e07-0ec850276cd3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:14.644511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ef59de7b-497d-47a7-9e07-0ec850276cd3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:14.645089 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ef59de7b-497d-47a7-9e07-0ec850276cd3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:14.645930 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ef59de7b-497d-47a7-9e07-0ec850276cd3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:14.650281 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ef59de7b-497d-47a7-9e07-0ec850276cd3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:14.691512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=74 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:15.032932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ea2dfcd-420a-410b-b584-a1785483eaf0 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:15.034319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ea2dfcd-420a-410b-b584-a1785483eaf0 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:15.052941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ea2dfcd-420a-410b-b584-a1785483eaf0 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:15.061092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ea2dfcd-420a-410b-b584-a1785483eaf0 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:15.068280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ea2dfcd-420a-410b-b584-a1785483eaf0 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:15.069937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ea2dfcd-420a-410b-b584-a1785483eaf0 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:15.159378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ef59de7b-497d-47a7-9e07-0ec850276cd3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:15.169154 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ef59de7b-497d-47a7-9e07-0ec850276cd3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 0.582194 Jul 28 04:03:15.184436 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2286/5073] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:14 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:16.001049 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-c2e9ba10-4a85-42da-a090-5dd75ed9ce63 req-4b72c623-bdb5-4c41-8532-37b9102e6a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01805b7-987d-4a67-934e-e173ce2d85c3", "tag": "fbb5cf86-d9f0-4020-8085-0e1c998ac852"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:16.014825 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:16.046422 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c2e9ba10-4a85-42da-a090-5dd75ed9ce63 req-4b72c623-bdb5-4c41-8532-37b9102e6a65 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:16.047190 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c2e9ba10-4a85-42da-a090-5dd75ed9ce63 req-4b72c623-bdb5-4c41-8532-37b9102e6a65 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:16.099478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ea2dfcd-420a-410b-b584-a1785483eaf0 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:16.107695 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-c2e9ba10-4a85-42da-a090-5dd75ed9ce63 req-4b72c623-bdb5-4c41-8532-37b9102e6a65 service nova] Creating event network-changed:fbb5cf86-d9f0-4020-8085-0e1c998ac852 for instance c01805b7-987d-4a67-934e-e173ce2d85c3 on n-h2-826756-3 Jul 28 04:03:16.111746 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ea2dfcd-420a-410b-b584-a1785483eaf0 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1313 microversion: 2.1 time: 1.083587 Jul 28 04:03:16.121190 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2788/5074] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:15 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1313 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:16.144531 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-c2e9ba10-4a85-42da-a090-5dd75ed9ce63 req-4b72c623-bdb5-4c41-8532-37b9102e6a65 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128150 Jul 28 04:03:16.146301 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2287/5075] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:16.200415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f6966898-666c-42f4-9317-c81f6e8c99a1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:16.201437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f6966898-666c-42f4-9317-c81f6e8c99a1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:16.222062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6966898-666c-42f4-9317-c81f6e8c99a1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:16.222530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6966898-666c-42f4-9317-c81f6e8c99a1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:16.223337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6966898-666c-42f4-9317-c81f6e8c99a1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:16.223781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6966898-666c-42f4-9317-c81f6e8c99a1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:17.148511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ae0993b4-54b8-499f-b4f5-ee2291d3514f tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:17.149228 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ae0993b4-54b8-499f-b4f5-ee2291d3514f tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:17.158654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=8 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:17.166315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae0993b4-54b8-499f-b4f5-ee2291d3514f tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:17.168076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae0993b4-54b8-499f-b4f5-ee2291d3514f tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:17.169090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae0993b4-54b8-499f-b4f5-ee2291d3514f tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:17.171922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ae0993b4-54b8-499f-b4f5-ee2291d3514f tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:17.574640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f6966898-666c-42f4-9317-c81f6e8c99a1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:17.589973 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f6966898-666c-42f4-9317-c81f6e8c99a1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 1.395423 Jul 28 04:03:17.595674 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2789/5076] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:16 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:17.811221 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ae0993b4-54b8-499f-b4f5-ee2291d3514f tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:17.827388 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ae0993b4-54b8-499f-b4f5-ee2291d3514f tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1313 microversion: 2.1 time: 0.683899 Jul 28 04:03:17.840643 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2288/5077] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:17 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1313 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:18.621347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bf71e951-6ce4-44e6-95e7-52770382a20a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:18.621985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bf71e951-6ce4-44e6-95e7-52770382a20a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:18.641372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf71e951-6ce4-44e6-95e7-52770382a20a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:18.644558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf71e951-6ce4-44e6-95e7-52770382a20a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:18.645509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf71e951-6ce4-44e6-95e7-52770382a20a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:18.645924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf71e951-6ce4-44e6-95e7-52770382a20a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:18.859071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2bcbebaa-fd1d-419e-9927-6d72d91f4cb4 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:18.860333 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2bcbebaa-fd1d-419e-9927-6d72d91f4cb4 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:18.872954 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:18.877196 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2bcbebaa-fd1d-419e-9927-6d72d91f4cb4 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:18.880427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2bcbebaa-fd1d-419e-9927-6d72d91f4cb4 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:18.881729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2bcbebaa-fd1d-419e-9927-6d72d91f4cb4 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:18.884066 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2bcbebaa-fd1d-419e-9927-6d72d91f4cb4 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:19.204207 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2bcbebaa-fd1d-419e-9927-6d72d91f4cb4 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:19.221146 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2bcbebaa-fd1d-419e-9927-6d72d91f4cb4 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1313 microversion: 2.1 time: 0.367172 Jul 28 04:03:19.221775 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2289/5078] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:18 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:19.509831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bf71e951-6ce4-44e6-95e7-52770382a20a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:19.524451 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bf71e951-6ce4-44e6-95e7-52770382a20a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 0.903500 Jul 28 04:03:19.525496 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2790/5079] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:18 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:20.243367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-eda321a5-15b5-4afa-978d-624c3512c075 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:20.243994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-eda321a5-15b5-4afa-978d-624c3512c075 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:20.257598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eda321a5-15b5-4afa-978d-624c3512c075 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:20.258053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eda321a5-15b5-4afa-978d-624c3512c075 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:20.258860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eda321a5-15b5-4afa-978d-624c3512c075 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:20.259486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-eda321a5-15b5-4afa-978d-624c3512c075 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:20.496133 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-eda321a5-15b5-4afa-978d-624c3512c075 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:20.505931 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-eda321a5-15b5-4afa-978d-624c3512c075 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1313 microversion: 2.1 time: 0.267169 Jul 28 04:03:20.507664 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2290/5080] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:20 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:20.546569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-530ed475-944e-4154-9c2b-df506f415df3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:20.547866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-530ed475-944e-4154-9c2b-df506f415df3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:20.551742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=40 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:20.567037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-530ed475-944e-4154-9c2b-df506f415df3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:20.567283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-530ed475-944e-4154-9c2b-df506f415df3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:20.568330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-530ed475-944e-4154-9c2b-df506f415df3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:20.568996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-530ed475-944e-4154-9c2b-df506f415df3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:21.240389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-530ed475-944e-4154-9c2b-df506f415df3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:21.256312 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-530ed475-944e-4154-9c2b-df506f415df3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 0.711306 Jul 28 04:03:21.261357 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2791/5081] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:20 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:21.527511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-50506d9f-d60d-44b6-9c23-d0203ccbd5a6 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:21.528805 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-50506d9f-d60d-44b6-9c23-d0203ccbd5a6 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:21.559723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50506d9f-d60d-44b6-9c23-d0203ccbd5a6 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:21.560178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50506d9f-d60d-44b6-9c23-d0203ccbd5a6 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:21.567032 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50506d9f-d60d-44b6-9c23-d0203ccbd5a6 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:21.567717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-50506d9f-d60d-44b6-9c23-d0203ccbd5a6 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:22.284253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-29ce98f8-f9e1-4e85-9b51-9975a12a6b78 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:22.285778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-29ce98f8-f9e1-4e85-9b51-9975a12a6b78 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:22.305082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ce98f8-f9e1-4e85-9b51-9975a12a6b78 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:22.306099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ce98f8-f9e1-4e85-9b51-9975a12a6b78 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:22.307742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ce98f8-f9e1-4e85-9b51-9975a12a6b78 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:22.309924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ce98f8-f9e1-4e85-9b51-9975a12a6b78 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:22.397910 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-50506d9f-d60d-44b6-9c23-d0203ccbd5a6 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:22.410621 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-50506d9f-d60d-44b6-9c23-d0203ccbd5a6 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1313 microversion: 2.1 time: 0.885953 Jul 28 04:03:22.411245 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2291/5082] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:21 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1313 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:22.989047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-29ce98f8-f9e1-4e85-9b51-9975a12a6b78 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:23.009897 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-29ce98f8-f9e1-4e85-9b51-9975a12a6b78 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 0.723516 Jul 28 04:03:23.011613 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2792/5083] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:22 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:23.437523 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5b3c698b-a12a-4132-b50a-0327679c44ff tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:23.438605 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5b3c698b-a12a-4132-b50a-0327679c44ff tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:23.462651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b3c698b-a12a-4132-b50a-0327679c44ff tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:23.463115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b3c698b-a12a-4132-b50a-0327679c44ff tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:23.467056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b3c698b-a12a-4132-b50a-0327679c44ff tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:23.467516 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b3c698b-a12a-4132-b50a-0327679c44ff tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.035513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c6287b0-296a-4878-b002-85a544059fb7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:24.036225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5c6287b0-296a-4878-b002-85a544059fb7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:24.050528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c6287b0-296a-4878-b002-85a544059fb7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.056643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c6287b0-296a-4878-b002-85a544059fb7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.059408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c6287b0-296a-4878-b002-85a544059fb7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.060082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c6287b0-296a-4878-b002-85a544059fb7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.181221 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5b3c698b-a12a-4132-b50a-0327679c44ff tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:24.196509 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5b3c698b-a12a-4132-b50a-0327679c44ff tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1313 microversion: 2.1 time: 0.766675 Jul 28 04:03:24.201433 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2292/5084] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:23 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1313 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:24.430517 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-077066ba-40ec-4551-864c-691d589a2d64 req-e5117443-5294-408e-88b8-0b1e64ade713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01805b7-987d-4a67-934e-e173ce2d85c3", "name": "network-vif-plugged", "status": "completed", "tag": "fbb5cf86-d9f0-4020-8085-0e1c998ac852"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:24.451127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-077066ba-40ec-4551-864c-691d589a2d64 req-e5117443-5294-408e-88b8-0b1e64ade713 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.453643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-077066ba-40ec-4551-864c-691d589a2d64 req-e5117443-5294-408e-88b8-0b1e64ade713 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.484157 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-077066ba-40ec-4551-864c-691d589a2d64 req-e5117443-5294-408e-88b8-0b1e64ade713 service nova] Creating event network-vif-plugged:fbb5cf86-d9f0-4020-8085-0e1c998ac852 for instance c01805b7-987d-4a67-934e-e173ce2d85c3 on n-h2-826756-3 Jul 28 04:03:24.500608 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-077066ba-40ec-4551-864c-691d589a2d64 req-e5117443-5294-408e-88b8-0b1e64ade713 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074278 Jul 28 04:03:24.502122 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2293/5085] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:24.591703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5c6287b0-296a-4878-b002-85a544059fb7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:24.602965 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5c6287b0-296a-4878-b002-85a544059fb7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 0.572163 Jul 28 04:03:24.604493 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2793/5086] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:24 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:25.224841 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-47dd903c-ec53-4cf7-a17c-9e251a9865c9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:25.225935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-47dd903c-ec53-4cf7-a17c-9e251a9865c9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:25.237285 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47dd903c-ec53-4cf7-a17c-9e251a9865c9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:25.246350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47dd903c-ec53-4cf7-a17c-9e251a9865c9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:25.247499 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47dd903c-ec53-4cf7-a17c-9e251a9865c9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:25.248174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-47dd903c-ec53-4cf7-a17c-9e251a9865c9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:25.638580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e7d38de5-5057-41ea-9fa3-a8306fd6f6ba tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:25.639218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e7d38de5-5057-41ea-9fa3-a8306fd6f6ba tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:25.657930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7d38de5-5057-41ea-9fa3-a8306fd6f6ba tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:25.661484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7d38de5-5057-41ea-9fa3-a8306fd6f6ba tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:25.661484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7d38de5-5057-41ea-9fa3-a8306fd6f6ba tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:25.661484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7d38de5-5057-41ea-9fa3-a8306fd6f6ba tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:25.686879 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-47dd903c-ec53-4cf7-a17c-9e251a9865c9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:25.700661 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-47dd903c-ec53-4cf7-a17c-9e251a9865c9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1313 microversion: 2.1 time: 0.480093 Jul 28 04:03:25.703756 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2294/5087] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:25 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:26.180860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e7d38de5-5057-41ea-9fa3-a8306fd6f6ba tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:26.200295 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e7d38de5-5057-41ea-9fa3-a8306fd6f6ba tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 0.564785 Jul 28 04:03:26.201321 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2794/5088] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:25 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:26.725606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-971b3260-9dd6-4a08-a80d-3a70acd4c2fa tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:26.726363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-971b3260-9dd6-4a08-a80d-3a70acd4c2fa tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:26.739272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-971b3260-9dd6-4a08-a80d-3a70acd4c2fa tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:26.740785 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-971b3260-9dd6-4a08-a80d-3a70acd4c2fa tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:26.741854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-971b3260-9dd6-4a08-a80d-3a70acd4c2fa tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:26.750669 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-971b3260-9dd6-4a08-a80d-3a70acd4c2fa tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:27.223538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93e9cd62-bdb8-4690-a34c-b97268d70b06 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:27.224172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93e9cd62-bdb8-4690-a34c-b97268d70b06 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:27.237749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93e9cd62-bdb8-4690-a34c-b97268d70b06 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:27.238212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93e9cd62-bdb8-4690-a34c-b97268d70b06 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:27.239014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93e9cd62-bdb8-4690-a34c-b97268d70b06 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:27.239454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93e9cd62-bdb8-4690-a34c-b97268d70b06 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:27.289139 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-971b3260-9dd6-4a08-a80d-3a70acd4c2fa tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:27.309161 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-971b3260-9dd6-4a08-a80d-3a70acd4c2fa tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1463 microversion: 2.1 time: 0.587369 Jul 28 04:03:27.314720 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2295/5089] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:26 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1463 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:27.339678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-38645429-5e87-4ddd-99c5-b13a278b42c1 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bf84256-f6ba-4895-9c58-9d005da8558a", "device": "/dev/sdb"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:27.349328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-38645429-5e87-4ddd-99c5-b13a278b42c1 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:27.357670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38645429-5e87-4ddd-99c5-b13a278b42c1 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:27.358432 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38645429-5e87-4ddd-99c5-b13a278b42c1 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:27.359618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38645429-5e87-4ddd-99c5-b13a278b42c1 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:27.360276 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-38645429-5e87-4ddd-99c5-b13a278b42c1 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:27.787539 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-38645429-5e87-4ddd-99c5-b13a278b42c1 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "POST /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452296 Jul 28 04:03:27.789811 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2296/5090] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 04:03:27 2022] POST /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:03:28.226974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93e9cd62-bdb8-4690-a34c-b97268d70b06 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:28.237213 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93e9cd62-bdb8-4690-a34c-b97268d70b06 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 1.018357 Jul 28 04:03:28.237840 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2795/5091] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:27 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:29.273199 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b82eb9af-c133-4f4d-aea6-7d759e9fdbc8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:29.274889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b82eb9af-c133-4f4d-aea6-7d759e9fdbc8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:29.287053 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b82eb9af-c133-4f4d-aea6-7d759e9fdbc8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:29.288922 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b82eb9af-c133-4f4d-aea6-7d759e9fdbc8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:29.293658 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b82eb9af-c133-4f4d-aea6-7d759e9fdbc8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:29.296258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b82eb9af-c133-4f4d-aea6-7d759e9fdbc8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:29.839506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b82eb9af-c133-4f4d-aea6-7d759e9fdbc8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:29.848000 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b82eb9af-c133-4f4d-aea6-7d759e9fdbc8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 0.590519 Jul 28 04:03:29.854151 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2297/5092] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:29 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:30.875225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0dfc640f-67b4-439c-a977-b496015e9f2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:30.878340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0dfc640f-67b4-439c-a977-b496015e9f2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:30.891287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dfc640f-67b4-439c-a977-b496015e9f2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:30.901975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dfc640f-67b4-439c-a977-b496015e9f2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:30.902956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dfc640f-67b4-439c-a977-b496015e9f2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:30.903824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dfc640f-67b4-439c-a977-b496015e9f2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:32.134478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0dfc640f-67b4-439c-a977-b496015e9f2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:32.143766 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0dfc640f-67b4-439c-a977-b496015e9f2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 1.272592 Jul 28 04:03:32.151320 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2796/5093] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:30 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:33.165542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-392d4593-2ad7-4bef-a58d-6faafe3a0af1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:33.166306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-392d4593-2ad7-4bef-a58d-6faafe3a0af1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:33.181234 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-392d4593-2ad7-4bef-a58d-6faafe3a0af1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:33.181828 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-392d4593-2ad7-4bef-a58d-6faafe3a0af1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:33.183163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-392d4593-2ad7-4bef-a58d-6faafe3a0af1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:33.186383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-392d4593-2ad7-4bef-a58d-6faafe3a0af1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:33.962156 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-392d4593-2ad7-4bef-a58d-6faafe3a0af1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:33.976414 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-392d4593-2ad7-4bef-a58d-6faafe3a0af1 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 0.814657 Jul 28 04:03:33.979549 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2298/5094] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:33 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:34.999791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6496ed43-0900-4eff-9b30-174a3f257d36 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:35.000693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6496ed43-0900-4eff-9b30-174a3f257d36 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:35.029143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6496ed43-0900-4eff-9b30-174a3f257d36 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:35.029610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6496ed43-0900-4eff-9b30-174a3f257d36 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:35.030420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6496ed43-0900-4eff-9b30-174a3f257d36 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:35.030865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6496ed43-0900-4eff-9b30-174a3f257d36 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:35.563636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6496ed43-0900-4eff-9b30-174a3f257d36 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:35.575687 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6496ed43-0900-4eff-9b30-174a3f257d36 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1516 microversion: 2.1 time: 0.579903 Jul 28 04:03:35.590976 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2797/5095] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:34 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1516 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:36.600794 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-06b7b55b-c37d-483d-98cb-6d369c17513d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:36.602588 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-06b7b55b-c37d-483d-98cb-6d369c17513d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:36.621625 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06b7b55b-c37d-483d-98cb-6d369c17513d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:36.628618 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06b7b55b-c37d-483d-98cb-6d369c17513d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:36.636884 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06b7b55b-c37d-483d-98cb-6d369c17513d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:36.637823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-06b7b55b-c37d-483d-98cb-6d369c17513d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:37.113040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-06b7b55b-c37d-483d-98cb-6d369c17513d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:37.136121 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-06b7b55b-c37d-483d-98cb-6d369c17513d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1522 microversion: 2.1 time: 0.540500 Jul 28 04:03:37.137798 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2299/5096] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:36 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1522 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:38.158599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-437b3e2a-edf1-4a7e-a379-95bcab562c24 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:38.161203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-437b3e2a-edf1-4a7e-a379-95bcab562c24 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:38.172264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-437b3e2a-edf1-4a7e-a379-95bcab562c24 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:38.177053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-437b3e2a-edf1-4a7e-a379-95bcab562c24 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:38.178074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-437b3e2a-edf1-4a7e-a379-95bcab562c24 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:38.178640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-437b3e2a-edf1-4a7e-a379-95bcab562c24 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:38.448592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-437b3e2a-edf1-4a7e-a379-95bcab562c24 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:38.457440 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-437b3e2a-edf1-4a7e-a379-95bcab562c24 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1522 microversion: 2.1 time: 0.302975 Jul 28 04:03:38.469031 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2798/5097] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:38 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:38.954709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-9dde2702-7349-4d37-bb3f-f30f85e66c8f req-5bb6429e-a28e-4554-990a-ac6b7c7a343e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933e568e-aa6a-4dfa-b053-2628d1fef93b", "name": "network-vif-unplugged", "status": "completed", "tag": "6518f4f4-d55e-44fc-91f4-150d143e36dd"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:39.032994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9dde2702-7349-4d37-bb3f-f30f85e66c8f req-5bb6429e-a28e-4554-990a-ac6b7c7a343e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:39.033448 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9dde2702-7349-4d37-bb3f-f30f85e66c8f req-5bb6429e-a28e-4554-990a-ac6b7c7a343e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:39.092775 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-9dde2702-7349-4d37-bb3f-f30f85e66c8f req-5bb6429e-a28e-4554-990a-ac6b7c7a343e service nova] Creating event network-vif-unplugged:6518f4f4-d55e-44fc-91f4-150d143e36dd for instance 933e568e-aa6a-4dfa-b053-2628d1fef93b on n-h1-826756-3 Jul 28 04:03:39.116774 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-9dde2702-7349-4d37-bb3f-f30f85e66c8f req-5bb6429e-a28e-4554-990a-ac6b7c7a343e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171102 Jul 28 04:03:39.121901 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2300/5098] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:39.480453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e2f6b14-c65a-4672-92f8-2d4d91a7be11 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:39.481743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e2f6b14-c65a-4672-92f8-2d4d91a7be11 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:39.496982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e2f6b14-c65a-4672-92f8-2d4d91a7be11 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:39.497714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e2f6b14-c65a-4672-92f8-2d4d91a7be11 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:39.498830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e2f6b14-c65a-4672-92f8-2d4d91a7be11 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:39.499439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e2f6b14-c65a-4672-92f8-2d4d91a7be11 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:39.852436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e2f6b14-c65a-4672-92f8-2d4d91a7be11 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:39.864789 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e2f6b14-c65a-4672-92f8-2d4d91a7be11 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1522 microversion: 2.1 time: 0.387324 Jul 28 04:03:39.865859 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2799/5099] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:39 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:40.887918 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b113916a-5cc5-4451-857f-3d18da4f160c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:40.889337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b113916a-5cc5-4451-857f-3d18da4f160c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:40.899955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b113916a-5cc5-4451-857f-3d18da4f160c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:40.900797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b113916a-5cc5-4451-857f-3d18da4f160c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:40.902093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b113916a-5cc5-4451-857f-3d18da4f160c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:40.902882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b113916a-5cc5-4451-857f-3d18da4f160c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:42.087633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b113916a-5cc5-4451-857f-3d18da4f160c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:42.116302 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b113916a-5cc5-4451-857f-3d18da4f160c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1522 microversion: 2.1 time: 1.234110 Jul 28 04:03:42.119176 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2301/5100] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:40 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1522 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:43.154847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-45cfb1a8-5623-45a8-a40c-6c0405767c1f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:43.158871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-45cfb1a8-5623-45a8-a40c-6c0405767c1f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:43.198929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45cfb1a8-5623-45a8-a40c-6c0405767c1f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:43.200211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45cfb1a8-5623-45a8-a40c-6c0405767c1f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:43.201764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45cfb1a8-5623-45a8-a40c-6c0405767c1f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:43.208868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45cfb1a8-5623-45a8-a40c-6c0405767c1f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.378521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-45cfb1a8-5623-45a8-a40c-6c0405767c1f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:44.381124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=84 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:44.388052 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-45cfb1a8-5623-45a8-a40c-6c0405767c1f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1522 microversion: 2.1 time: 1.239275 Jul 28 04:03:44.396603 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2800/5101] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:43 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1522 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:44.401640 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-5ff4aa89-45cf-4025-a026-9479c09b8e4d req-84a1f4b2-dccd-44ee-85dc-ff635c6f1ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933e568e-aa6a-4dfa-b053-2628d1fef93b", "name": "network-vif-plugged", "status": "completed", "tag": "6518f4f4-d55e-44fc-91f4-150d143e36dd"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:44.426261 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5ff4aa89-45cf-4025-a026-9479c09b8e4d req-84a1f4b2-dccd-44ee-85dc-ff635c6f1ce9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.426694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5ff4aa89-45cf-4025-a026-9479c09b8e4d req-84a1f4b2-dccd-44ee-85dc-ff635c6f1ce9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.470894 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-5ff4aa89-45cf-4025-a026-9479c09b8e4d req-84a1f4b2-dccd-44ee-85dc-ff635c6f1ce9 service nova] Creating event network-vif-plugged:6518f4f4-d55e-44fc-91f4-150d143e36dd for instance 933e568e-aa6a-4dfa-b053-2628d1fef93b on n-h1-826756-3 Jul 28 04:03:44.484127 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-5ff4aa89-45cf-4025-a026-9479c09b8e4d req-84a1f4b2-dccd-44ee-85dc-ff635c6f1ce9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087816 Jul 28 04:03:44.484786 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2302/5102] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:03:45.421961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-42fc3c2a-3fc1-4ab4-9768-9d2cc6c829af tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:45.424820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-42fc3c2a-3fc1-4ab4-9768-9d2cc6c829af tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:45.440254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42fc3c2a-3fc1-4ab4-9768-9d2cc6c829af tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.441168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42fc3c2a-3fc1-4ab4-9768-9d2cc6c829af tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.449134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42fc3c2a-3fc1-4ab4-9768-9d2cc6c829af tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.450024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42fc3c2a-3fc1-4ab4-9768-9d2cc6c829af tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:46.607082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-42fc3c2a-3fc1-4ab4-9768-9d2cc6c829af tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:46.628459 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-42fc3c2a-3fc1-4ab4-9768-9d2cc6c829af tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1522 microversion: 2.1 time: 1.210409 Jul 28 04:03:46.636326 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2801/5103] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:45 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1522 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:47.665114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9e77eb01-d06d-4ece-9eaa-25517b3c8e2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:47.666952 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9e77eb01-d06d-4ece-9eaa-25517b3c8e2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:47.687576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e77eb01-d06d-4ece-9eaa-25517b3c8e2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:47.689943 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e77eb01-d06d-4ece-9eaa-25517b3c8e2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:47.691315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e77eb01-d06d-4ece-9eaa-25517b3c8e2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:47.699998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e77eb01-d06d-4ece-9eaa-25517b3c8e2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:47.718513 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:48.192815 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9e77eb01-d06d-4ece-9eaa-25517b3c8e2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:48.212519 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9e77eb01-d06d-4ece-9eaa-25517b3c8e2d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1507 microversion: 2.1 time: 0.551832 Jul 28 04:03:48.220797 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2303/5104] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:47 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1507 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:48.241482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-983c76fa-e699-40a6-9acf-08f364fb6967 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:48.242402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-983c76fa-e699-40a6-9acf-08f364fb6967 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:48.259490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-983c76fa-e699-40a6-9acf-08f364fb6967 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.260885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-983c76fa-e699-40a6-9acf-08f364fb6967 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:48.263113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-983c76fa-e699-40a6-9acf-08f364fb6967 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.266708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-983c76fa-e699-40a6-9acf-08f364fb6967 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:49.064106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-983c76fa-e699-40a6-9acf-08f364fb6967 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:49.124959 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-983c76fa-e699-40a6-9acf-08f364fb6967 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 200 len: 1507 microversion: 2.1 time: 0.887349 Jul 28 04:03:49.129447 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2802/5105] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:48 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 1507 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:49.148892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7ed3714d-11a0-46f5-bb93-7669c2d23c68 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:49.150223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7ed3714d-11a0-46f5-bb93-7669c2d23c68 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:49.153700 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=30 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:49.192188 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ed3714d-11a0-46f5-bb93-7669c2d23c68 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:49.197516 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ed3714d-11a0-46f5-bb93-7669c2d23c68 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:49.199671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ed3714d-11a0-46f5-bb93-7669c2d23c68 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:49.201668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7ed3714d-11a0-46f5-bb93-7669c2d23c68 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:49.325526 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7ed3714d-11a0-46f5-bb93-7669c2d23c68 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:03:49.716428 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7ed3714d-11a0-46f5-bb93-7669c2d23c68 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "DELETE /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 204 len: 0 microversion: 2.1 time: 0.570709 Jul 28 04:03:49.721100 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2304/5106] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:03:49 2022] DELETE /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:03:50.231818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1924138195", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "462e9086-df54-488f-a03f-5e8360013b0d"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:50.327404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] validate_networks() for [('462e9086-df54-488f-a03f-5e8360013b0d', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:03:52.687294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:03:52.688342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:03:52.689017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:03:52.689595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:03:52.690192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:03:52.692577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=26 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:52.711306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:52.719938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:52.721250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:52.721864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:52.770288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Getting quotas for project 20141383097d4e2fa18337fdb001e7a2. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:03:52.798394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Getting quotas for user 7cf7921de39349739835f1ebd23ac77b and project 20141383097d4e2fa18337fdb001e7a2. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:03:52.818900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:03:52.821376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:03:52.931208 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2a05d0ab-569f-46b7-af9f-d3cbf13a7f59 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.706115 Jul 28 04:03:52.937882 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2803/5107] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:03:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:03:52.944175 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cc239d29-8ec7-4eea-9ba7-965db26d6f18 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:52.944992 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cc239d29-8ec7-4eea-9ba7-965db26d6f18 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:53.259821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cc239d29-8ec7-4eea-9ba7-965db26d6f18 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:53.273434 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cc239d29-8ec7-4eea-9ba7-965db26d6f18 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1218 microversion: 2.1 time: 0.334013 Jul 28 04:03:53.283331 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2305/5108] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:52 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1218 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:53.671975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3b951c51-7dd2-490b-843a-2a95c17a88f1 req-905e3d5c-c87e-448a-8a2a-c6e431587867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933e568e-aa6a-4dfa-b053-2628d1fef93b", "name": "network-vif-deleted", "tag": "6518f4f4-d55e-44fc-91f4-150d143e36dd"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:53.700745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3b951c51-7dd2-490b-843a-2a95c17a88f1 req-905e3d5c-c87e-448a-8a2a-c6e431587867 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:53.701422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3b951c51-7dd2-490b-843a-2a95c17a88f1 req-905e3d5c-c87e-448a-8a2a-c6e431587867 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:53.740309 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3b951c51-7dd2-490b-843a-2a95c17a88f1 req-905e3d5c-c87e-448a-8a2a-c6e431587867 service nova] Creating event network-vif-deleted:6518f4f4-d55e-44fc-91f4-150d143e36dd for instance 933e568e-aa6a-4dfa-b053-2628d1fef93b on n-h1-826756-3 Jul 28 04:03:53.750834 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3b951c51-7dd2-490b-843a-2a95c17a88f1 req-905e3d5c-c87e-448a-8a2a-c6e431587867 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083678 Jul 28 04:03:53.756735 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2804/5109] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:54.310910 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d6c455c3-3568-4e09-a641-f9149bd08381 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:54.311624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d6c455c3-3568-4e09-a641-f9149bd08381 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:54.336665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6c455c3-3568-4e09-a641-f9149bd08381 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:54.337576 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6c455c3-3568-4e09-a641-f9149bd08381 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:54.341614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6c455c3-3568-4e09-a641-f9149bd08381 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:54.342367 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d6c455c3-3568-4e09-a641-f9149bd08381 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:54.503113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d6c455c3-3568-4e09-a641-f9149bd08381 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:54.520099 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d6c455c3-3568-4e09-a641-f9149bd08381 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1222 microversion: 2.1 time: 0.218436 Jul 28 04:03:54.534261 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2306/5110] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:54 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1222 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:55.556035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2669880e-75c5-4200-9c9f-d11b30fa20c5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:55.556803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2669880e-75c5-4200-9c9f-d11b30fa20c5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:55.575815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2669880e-75c5-4200-9c9f-d11b30fa20c5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:55.577522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2669880e-75c5-4200-9c9f-d11b30fa20c5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:55.579510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2669880e-75c5-4200-9c9f-d11b30fa20c5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:55.582958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2669880e-75c5-4200-9c9f-d11b30fa20c5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:55.947502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2669880e-75c5-4200-9c9f-d11b30fa20c5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:55.971498 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2669880e-75c5-4200-9c9f-d11b30fa20c5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1288 microversion: 2.1 time: 0.420267 Jul 28 04:03:55.976637 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2805/5111] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:55 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1288 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:57.034302 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a404c56f-b403-4601-bb3f-5893c88e501f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:57.038368 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a404c56f-b403-4601-bb3f-5893c88e501f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:57.051022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a404c56f-b403-4601-bb3f-5893c88e501f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:57.051479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a404c56f-b403-4601-bb3f-5893c88e501f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:57.052286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a404c56f-b403-4601-bb3f-5893c88e501f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:57.059954 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a404c56f-b403-4601-bb3f-5893c88e501f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:58.090183 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a404c56f-b403-4601-bb3f-5893c88e501f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:58.110091 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a404c56f-b403-4601-bb3f-5893c88e501f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1276 microversion: 2.1 time: 1.117147 Jul 28 04:03:58.118834 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2307/5112] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:56 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1276 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:59.174394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63657510-0db4-4dc1-a948-50da2506477c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:59.175012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63657510-0db4-4dc1-a948-50da2506477c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:03:59.192401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63657510-0db4-4dc1-a948-50da2506477c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:59.192882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63657510-0db4-4dc1-a948-50da2506477c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:59.193740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63657510-0db4-4dc1-a948-50da2506477c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:59.194184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63657510-0db4-4dc1-a948-50da2506477c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:59.446035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63657510-0db4-4dc1-a948-50da2506477c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:59.477648 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63657510-0db4-4dc1-a948-50da2506477c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1276 microversion: 2.1 time: 0.307222 Jul 28 04:03:59.479818 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2806/5113] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:59 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1276 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:00.513962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5abe7d7d-2163-4f2c-b4da-e693b30f50f7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:00.523782 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5abe7d7d-2163-4f2c-b4da-e693b30f50f7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:00.550286 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5abe7d7d-2163-4f2c-b4da-e693b30f50f7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:00.552022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5abe7d7d-2163-4f2c-b4da-e693b30f50f7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:00.557408 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5abe7d7d-2163-4f2c-b4da-e693b30f50f7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:00.558087 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5abe7d7d-2163-4f2c-b4da-e693b30f50f7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:01.024766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5abe7d7d-2163-4f2c-b4da-e693b30f50f7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:01.066175 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5abe7d7d-2163-4f2c-b4da-e693b30f50f7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1318 microversion: 2.1 time: 0.566053 Jul 28 04:04:01.070210 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2308/5114] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:00 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:02.093241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b55eb5ea-cfc2-4a8e-9bb0-6073e4d323ea req-f2a92040-edb7-4209-a91a-a38893eb9316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb57b591-927c-4af5-a304-c7a48ef1d679", "tag": "6efe01b3-6dd9-4b88-96e3-a62a4ce9fee1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:02.102928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-486e7ded-2935-4b30-980c-69271fc76db3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:02.104342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-486e7ded-2935-4b30-980c-69271fc76db3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:02.119602 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-486e7ded-2935-4b30-980c-69271fc76db3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:02.132116 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-486e7ded-2935-4b30-980c-69271fc76db3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:02.136553 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-486e7ded-2935-4b30-980c-69271fc76db3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:02.143274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-486e7ded-2935-4b30-980c-69271fc76db3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:02.147565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b55eb5ea-cfc2-4a8e-9bb0-6073e4d323ea req-f2a92040-edb7-4209-a91a-a38893eb9316 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:02.149025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b55eb5ea-cfc2-4a8e-9bb0-6073e4d323ea req-f2a92040-edb7-4209-a91a-a38893eb9316 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:02.199331 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b55eb5ea-cfc2-4a8e-9bb0-6073e4d323ea req-f2a92040-edb7-4209-a91a-a38893eb9316 service nova] Creating event network-changed:6efe01b3-6dd9-4b88-96e3-a62a4ce9fee1 for instance fb57b591-927c-4af5-a304-c7a48ef1d679 on n-h2-826756-3 Jul 28 04:04:02.215345 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b55eb5ea-cfc2-4a8e-9bb0-6073e4d323ea req-f2a92040-edb7-4209-a91a-a38893eb9316 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124631 Jul 28 04:04:02.221456 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2807/5115] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:04:02.774240 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-486e7ded-2935-4b30-980c-69271fc76db3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:02.808630 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-486e7ded-2935-4b30-980c-69271fc76db3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1318 microversion: 2.1 time: 0.711457 Jul 28 04:04:02.811538 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2309/5116] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:02 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1318 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:03.832117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d6f88a37-4d23-4cd7-b342-0e197fc7da82 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:03.834052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d6f88a37-4d23-4cd7-b342-0e197fc7da82 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:03.846543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:03.847967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:03.855443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6f88a37-4d23-4cd7-b342-0e197fc7da82 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:03.858288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6f88a37-4d23-4cd7-b342-0e197fc7da82 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:03.864647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6f88a37-4d23-4cd7-b342-0e197fc7da82 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:03.866055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6f88a37-4d23-4cd7-b342-0e197fc7da82 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:03.940052 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:04:03.941342 n-d-826756-3 devstack@n-api.service[126071]: Thu Jul 28 04:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 (ip 10.222.0.48) !!! Jul 28 04:04:05.070126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d6f88a37-4d23-4cd7-b342-0e197fc7da82 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:05.087123 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d6f88a37-4d23-4cd7-b342-0e197fc7da82 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1318 microversion: 2.1 time: 1.256766 Jul 28 04:04:05.090364 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2808/5117] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:03 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1318 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:06.111158 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ffbb817e-9095-4410-84b2-3f1f4d508e92 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:06.112664 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ffbb817e-9095-4410-84b2-3f1f4d508e92 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:06.127227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:06.132150 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ffbb817e-9095-4410-84b2-3f1f4d508e92 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:06.133021 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ffbb817e-9095-4410-84b2-3f1f4d508e92 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:06.134013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ffbb817e-9095-4410-84b2-3f1f4d508e92 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:06.135291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ffbb817e-9095-4410-84b2-3f1f4d508e92 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:06.902029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ffbb817e-9095-4410-84b2-3f1f4d508e92 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:06.916640 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ffbb817e-9095-4410-84b2-3f1f4d508e92 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1318 microversion: 2.1 time: 0.809702 Jul 28 04:04:06.935474 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2310/5118] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:06 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1318 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:07.943959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-612b62ff-5eaf-46aa-9c18-08baaebb2e13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:07.946698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-612b62ff-5eaf-46aa-9c18-08baaebb2e13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:07.964647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-612b62ff-5eaf-46aa-9c18-08baaebb2e13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:07.966898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-612b62ff-5eaf-46aa-9c18-08baaebb2e13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:07.969873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-612b62ff-5eaf-46aa-9c18-08baaebb2e13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:07.973348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-612b62ff-5eaf-46aa-9c18-08baaebb2e13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:09.678613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-612b62ff-5eaf-46aa-9c18-08baaebb2e13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:09.694442 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-612b62ff-5eaf-46aa-9c18-08baaebb2e13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1318 microversion: 2.1 time: 1.753302 Jul 28 04:04:09.696561 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2809/5119] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:07 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1318 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:10.717093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5ab63923-ed5d-486a-8c08-b5c60ab0cd51 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:10.718573 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5ab63923-ed5d-486a-8c08-b5c60ab0cd51 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:10.735980 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5ab63923-ed5d-486a-8c08-b5c60ab0cd51 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:10.736833 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5ab63923-ed5d-486a-8c08-b5c60ab0cd51 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:10.738484 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5ab63923-ed5d-486a-8c08-b5c60ab0cd51 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:10.739100 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5ab63923-ed5d-486a-8c08-b5c60ab0cd51 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:11.269619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5ab63923-ed5d-486a-8c08-b5c60ab0cd51 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:11.283502 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5ab63923-ed5d-486a-8c08-b5c60ab0cd51 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1318 microversion: 2.1 time: 0.570288 Jul 28 04:04:11.291448 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2311/5120] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:10 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1318 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:12.316298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2f0f072-fa74-4733-8e66-4ff5d52b88a2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:12.317898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2f0f072-fa74-4733-8e66-4ff5d52b88a2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:12.337699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2f0f072-fa74-4733-8e66-4ff5d52b88a2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:12.338302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2f0f072-fa74-4733-8e66-4ff5d52b88a2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:12.339320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2f0f072-fa74-4733-8e66-4ff5d52b88a2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:12.339870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2f0f072-fa74-4733-8e66-4ff5d52b88a2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:12.951655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b2f0f072-fa74-4733-8e66-4ff5d52b88a2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:12.977793 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b2f0f072-fa74-4733-8e66-4ff5d52b88a2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1318 microversion: 2.1 time: 0.666586 Jul 28 04:04:12.978918 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2810/5121] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:12 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:13.421821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-549ad006-f4d1-4525-abb1-25d2c9725138 req-ec2900ea-f1c4-4396-9ff2-d0642291b219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb57b591-927c-4af5-a304-c7a48ef1d679", "name": "network-vif-plugged", "status": "completed", "tag": "6efe01b3-6dd9-4b88-96e3-a62a4ce9fee1"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:13.462026 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-549ad006-f4d1-4525-abb1-25d2c9725138 req-ec2900ea-f1c4-4396-9ff2-d0642291b219 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:13.463308 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-549ad006-f4d1-4525-abb1-25d2c9725138 req-ec2900ea-f1c4-4396-9ff2-d0642291b219 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:13.495584 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-549ad006-f4d1-4525-abb1-25d2c9725138 req-ec2900ea-f1c4-4396-9ff2-d0642291b219 service nova] Creating event network-vif-plugged:6efe01b3-6dd9-4b88-96e3-a62a4ce9fee1 for instance fb57b591-927c-4af5-a304-c7a48ef1d679 on n-h2-826756-3 Jul 28 04:04:13.507484 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-549ad006-f4d1-4525-abb1-25d2c9725138 req-ec2900ea-f1c4-4396-9ff2-d0642291b219 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092109 Jul 28 04:04:13.510907 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2312/5122] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:04:13.999614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-da65c84c-58b2-43e3-985d-d8558df4bb60 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:14.000459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-da65c84c-58b2-43e3-985d-d8558df4bb60 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:14.027803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da65c84c-58b2-43e3-985d-d8558df4bb60 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:14.034505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da65c84c-58b2-43e3-985d-d8558df4bb60 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:14.035940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da65c84c-58b2-43e3-985d-d8558df4bb60 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:14.037580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da65c84c-58b2-43e3-985d-d8558df4bb60 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:15.193962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-da65c84c-58b2-43e3-985d-d8558df4bb60 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:15.203954 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-da65c84c-58b2-43e3-985d-d8558df4bb60 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1318 microversion: 2.1 time: 1.208426 Jul 28 04:04:15.208513 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2811/5123] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:13 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1318 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:16.240494 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d320ebbf-5008-482e-aedf-476ee7dfa7cc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:16.241871 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d320ebbf-5008-482e-aedf-476ee7dfa7cc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:16.260447 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d320ebbf-5008-482e-aedf-476ee7dfa7cc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:16.261256 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d320ebbf-5008-482e-aedf-476ee7dfa7cc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:16.262289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d320ebbf-5008-482e-aedf-476ee7dfa7cc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:16.263817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d320ebbf-5008-482e-aedf-476ee7dfa7cc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:17.174051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d320ebbf-5008-482e-aedf-476ee7dfa7cc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:17.187553 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d320ebbf-5008-482e-aedf-476ee7dfa7cc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1508 microversion: 2.1 time: 0.951855 Jul 28 04:04:17.204447 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2313/5124] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:16 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1508 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:17.209392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3750086e-7854-4138-93ad-c6b6a384be47 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:17.211628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3750086e-7854-4138-93ad-c6b6a384be47 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:17.223185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3750086e-7854-4138-93ad-c6b6a384be47 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:17.223944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3750086e-7854-4138-93ad-c6b6a384be47 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:17.225195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3750086e-7854-4138-93ad-c6b6a384be47 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:17.226423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3750086e-7854-4138-93ad-c6b6a384be47 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:17.262265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=56 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:17.766910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3750086e-7854-4138-93ad-c6b6a384be47 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:17.778203 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3750086e-7854-4138-93ad-c6b6a384be47 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1508 microversion: 2.1 time: 0.572602 Jul 28 04:04:17.795047 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2812/5125] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:17 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1508 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:17.804106 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a39e641c-88cc-41f1-b38d-e0eed2013622 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:17.806916 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a39e641c-88cc-41f1-b38d-e0eed2013622 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:17.824401 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a39e641c-88cc-41f1-b38d-e0eed2013622 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:17.824854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a39e641c-88cc-41f1-b38d-e0eed2013622 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:17.825652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a39e641c-88cc-41f1-b38d-e0eed2013622 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:17.826092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a39e641c-88cc-41f1-b38d-e0eed2013622 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:17.829160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:17.931407 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a39e641c-88cc-41f1-b38d-e0eed2013622 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "PUT /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1080 microversion: 2.1 time: 0.132131 Jul 28 04:04:17.943952 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2314/5126] 10.222.0.48 () {60 vars in 1256 bytes} [Thu Jul 28 04:04:17 2022] PUT /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1080 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:17.950065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2b9ecf42-4717-45fb-995e-f4508c51830c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:17.950695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2b9ecf42-4717-45fb-995e-f4508c51830c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:17.957637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b9ecf42-4717-45fb-995e-f4508c51830c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:17.958386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b9ecf42-4717-45fb-995e-f4508c51830c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:17.959692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b9ecf42-4717-45fb-995e-f4508c51830c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:17.960564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b9ecf42-4717-45fb-995e-f4508c51830c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:19.487575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2b9ecf42-4717-45fb-995e-f4508c51830c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:19.497156 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2b9ecf42-4717-45fb-995e-f4508c51830c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1506 microversion: 2.1 time: 1.551427 Jul 28 04:04:19.508444 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2813/5127] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:17 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1506 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:19.521122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e3180a5b-10f4-4014-b393-8dcbccef7f28 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:19.521758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e3180a5b-10f4-4014-b393-8dcbccef7f28 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:19.525879 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:19.530306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3180a5b-10f4-4014-b393-8dcbccef7f28 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:19.530858 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3180a5b-10f4-4014-b393-8dcbccef7f28 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:19.531548 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3180a5b-10f4-4014-b393-8dcbccef7f28 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:19.531995 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e3180a5b-10f4-4014-b393-8dcbccef7f28 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:20.148279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e3180a5b-10f4-4014-b393-8dcbccef7f28 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:20.160393 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e3180a5b-10f4-4014-b393-8dcbccef7f28 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1506 microversion: 2.1 time: 0.643358 Jul 28 04:04:20.165787 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2315/5128] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:19 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1506 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:20.188210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:20.192626 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:20.231487 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:20.233414 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:20.237606 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:20.238887 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:20.462550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-833401556", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "ec5c57ca-fad1-4531-b79a-a413aa364117"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:20.468783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:04:20.469222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:04:20.469701 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:04:20.470117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:04:20.470533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:04:20.582221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] validate_networks() for [('ec5c57ca-fad1-4531-b79a-a413aa364117', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:04:20.646836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:20.672486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:20.673064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:20.674278 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:20.674372 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:20.748945 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0122497a-dcdc-409b-8b0a-dfb7e8fbb54f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "POST /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679/action" status: 202 len: 1112 microversion: 2.1 time: 0.565236 Jul 28 04:04:20.760462 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2316/5129] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:04:20 2022] POST /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679/action => generated 1112 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 28 04:04:20.768610 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8e2fbd85-ea99-4e19-a409-42707883e3dd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:20.769296 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8e2fbd85-ea99-4e19-a409-42707883e3dd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:20.788398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e2fbd85-ea99-4e19-a409-42707883e3dd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:20.789413 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e2fbd85-ea99-4e19-a409-42707883e3dd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:20.790681 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e2fbd85-ea99-4e19-a409-42707883e3dd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:20.791622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8e2fbd85-ea99-4e19-a409-42707883e3dd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:21.265551 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8e2fbd85-ea99-4e19-a409-42707883e3dd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:21.280143 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8e2fbd85-ea99-4e19-a409-42707883e3dd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 0.515508 Jul 28 04:04:21.285863 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2317/5130] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:20 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:22.309622 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c5bce65d-0687-4e77-8c1b-4eef86d0be6a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:22.310560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c5bce65d-0687-4e77-8c1b-4eef86d0be6a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:22.322158 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5bce65d-0687-4e77-8c1b-4eef86d0be6a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:22.323102 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5bce65d-0687-4e77-8c1b-4eef86d0be6a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:22.325015 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5bce65d-0687-4e77-8c1b-4eef86d0be6a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:22.326135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5bce65d-0687-4e77-8c1b-4eef86d0be6a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:22.666410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:04:22.666896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:04:22.667479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:04:22.667972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:04:22.669406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:04:22.692299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:22.695716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:22.700068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:22.700942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:22.757259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:22.778735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Getting quotas for project d7d71a51e1be442cbeb1d557163cbf49. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:04:22.794006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Getting quotas for user f9a947e069054652a96e56d73e64b402 and project d7d71a51e1be442cbeb1d557163cbf49. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:04:22.828402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:04:22.830825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:04:22.949478 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8af2b797-b052-40ba-8c32-d246151fbbef tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.865429 Jul 28 04:04:22.958057 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2814/5131] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:04:22.975048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9ce79583-764f-4d06-8e38-476e7eef963b tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:22.977834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9ce79583-764f-4d06-8e38-476e7eef963b tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:23.188241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9ce79583-764f-4d06-8e38-476e7eef963b tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:23.196885 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9ce79583-764f-4d06-8e38-476e7eef963b tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1224 microversion: 2.1 time: 0.237000 Jul 28 04:04:23.200771 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2815/5132] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:22 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1224 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:23.534343 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c5bce65d-0687-4e77-8c1b-4eef86d0be6a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:23.547288 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c5bce65d-0687-4e77-8c1b-4eef86d0be6a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 1.243591 Jul 28 04:04:23.564385 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2318/5133] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:22 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:24.223134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-efb4f962-d021-4a41-ab72-406adebefc79 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:24.223767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-efb4f962-d021-4a41-ab72-406adebefc79 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:24.256986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efb4f962-d021-4a41-ab72-406adebefc79 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:24.257552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efb4f962-d021-4a41-ab72-406adebefc79 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:24.258478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efb4f962-d021-4a41-ab72-406adebefc79 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:24.258936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efb4f962-d021-4a41-ab72-406adebefc79 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:24.453195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-efb4f962-d021-4a41-ab72-406adebefc79 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:24.472469 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-efb4f962-d021-4a41-ab72-406adebefc79 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1276 microversion: 2.1 time: 0.253609 Jul 28 04:04:24.480279 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2816/5134] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:24 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1276 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:24.576889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c5f10b42-eade-4e20-9a28-3b2090bbff07 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:24.578209 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c5f10b42-eade-4e20-9a28-3b2090bbff07 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:24.586757 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5f10b42-eade-4e20-9a28-3b2090bbff07 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:24.587554 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5f10b42-eade-4e20-9a28-3b2090bbff07 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:24.588871 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5f10b42-eade-4e20-9a28-3b2090bbff07 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:24.589600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c5f10b42-eade-4e20-9a28-3b2090bbff07 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:25.314477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c5f10b42-eade-4e20-9a28-3b2090bbff07 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:25.331065 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c5f10b42-eade-4e20-9a28-3b2090bbff07 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 0.759037 Jul 28 04:04:25.349738 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2319/5135] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:24 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:25.505398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4b0bc78-a149-4dde-bb82-726e08ae3a3c tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:25.506982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e4b0bc78-a149-4dde-bb82-726e08ae3a3c tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:25.516865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4b0bc78-a149-4dde-bb82-726e08ae3a3c tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:25.517868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4b0bc78-a149-4dde-bb82-726e08ae3a3c tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:25.518879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4b0bc78-a149-4dde-bb82-726e08ae3a3c tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:25.519400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4b0bc78-a149-4dde-bb82-726e08ae3a3c tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:26.237057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e4b0bc78-a149-4dde-bb82-726e08ae3a3c tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:26.258395 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e4b0bc78-a149-4dde-bb82-726e08ae3a3c tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1282 microversion: 2.1 time: 0.755651 Jul 28 04:04:26.259040 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2817/5136] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:25 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1282 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:26.357172 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a7e40ae4-7994-4e6f-a195-3f1314a59a8c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:26.358091 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a7e40ae4-7994-4e6f-a195-3f1314a59a8c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:26.378498 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7e40ae4-7994-4e6f-a195-3f1314a59a8c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:26.378955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7e40ae4-7994-4e6f-a195-3f1314a59a8c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:26.379749 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7e40ae4-7994-4e6f-a195-3f1314a59a8c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:26.380204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a7e40ae4-7994-4e6f-a195-3f1314a59a8c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:27.280708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-afcbfe68-3d10-4b5b-ac5d-a5b39e5e462d tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:27.281940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-afcbfe68-3d10-4b5b-ac5d-a5b39e5e462d tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:27.302329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afcbfe68-3d10-4b5b-ac5d-a5b39e5e462d tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:27.304030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afcbfe68-3d10-4b5b-ac5d-a5b39e5e462d tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:27.309788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afcbfe68-3d10-4b5b-ac5d-a5b39e5e462d tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:27.311015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afcbfe68-3d10-4b5b-ac5d-a5b39e5e462d tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:27.530634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-afcbfe68-3d10-4b5b-ac5d-a5b39e5e462d tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:27.543056 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-afcbfe68-3d10-4b5b-ac5d-a5b39e5e462d tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1282 microversion: 2.1 time: 0.267547 Jul 28 04:04:27.575261 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2818/5137] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:27 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1282 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:27.977306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a7e40ae4-7994-4e6f-a195-3f1314a59a8c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:27.991318 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a7e40ae4-7994-4e6f-a195-3f1314a59a8c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 1.637613 Jul 28 04:04:27.999658 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2320/5138] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:26 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:28.586747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a01f9aa9-ec52-43c3-8952-59f9331bb8a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:28.589030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a01f9aa9-ec52-43c3-8952-59f9331bb8a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:28.608075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a01f9aa9-ec52-43c3-8952-59f9331bb8a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:28.609947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a01f9aa9-ec52-43c3-8952-59f9331bb8a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:28.612025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a01f9aa9-ec52-43c3-8952-59f9331bb8a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:28.612507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a01f9aa9-ec52-43c3-8952-59f9331bb8a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:28.768327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a01f9aa9-ec52-43c3-8952-59f9331bb8a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:28.789761 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a01f9aa9-ec52-43c3-8952-59f9331bb8a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1282 microversion: 2.1 time: 0.214259 Jul 28 04:04:28.804126 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2819/5139] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:28 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1282 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:29.023926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9d35e278-0244-4e90-b2f9-48d5726808d6 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:29.025508 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9d35e278-0244-4e90-b2f9-48d5726808d6 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:29.044855 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d35e278-0244-4e90-b2f9-48d5726808d6 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:29.045369 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d35e278-0244-4e90-b2f9-48d5726808d6 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:29.046216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d35e278-0244-4e90-b2f9-48d5726808d6 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:29.046996 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d35e278-0244-4e90-b2f9-48d5726808d6 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:29.575155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9d35e278-0244-4e90-b2f9-48d5726808d6 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:29.585180 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9d35e278-0244-4e90-b2f9-48d5726808d6 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 0.567194 Jul 28 04:04:29.593507 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2321/5140] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:29 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:29.817894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70629e6d-2e83-4bf5-a96d-d5d2b3686e1a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:29.818952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-70629e6d-2e83-4bf5-a96d-d5d2b3686e1a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:29.832838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70629e6d-2e83-4bf5-a96d-d5d2b3686e1a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:29.833314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70629e6d-2e83-4bf5-a96d-d5d2b3686e1a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:29.834124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70629e6d-2e83-4bf5-a96d-d5d2b3686e1a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:29.834559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70629e6d-2e83-4bf5-a96d-d5d2b3686e1a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:30.311739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-70629e6d-2e83-4bf5-a96d-d5d2b3686e1a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:30.320038 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-70629e6d-2e83-4bf5-a96d-d5d2b3686e1a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1324 microversion: 2.1 time: 0.506277 Jul 28 04:04:30.320686 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2820/5141] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:29 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1324 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:30.616808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e4cf0954-bdaf-4944-b68d-c36c240fb9ad tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:30.618193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e4cf0954-bdaf-4944-b68d-c36c240fb9ad tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:30.632090 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e4cf0954-bdaf-4944-b68d-c36c240fb9ad tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:30.632926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e4cf0954-bdaf-4944-b68d-c36c240fb9ad tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:30.633867 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e4cf0954-bdaf-4944-b68d-c36c240fb9ad tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:30.635310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e4cf0954-bdaf-4944-b68d-c36c240fb9ad tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:31.345233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a23891b-a066-41c6-a6c0-1b3de364aede tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:31.346710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4a23891b-a066-41c6-a6c0-1b3de364aede tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:31.360198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a23891b-a066-41c6-a6c0-1b3de364aede tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:31.362811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a23891b-a066-41c6-a6c0-1b3de364aede tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:31.364224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a23891b-a066-41c6-a6c0-1b3de364aede tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:31.367410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a23891b-a066-41c6-a6c0-1b3de364aede tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:31.477665 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e4cf0954-bdaf-4944-b68d-c36c240fb9ad tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:31.500843 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e4cf0954-bdaf-4944-b68d-c36c240fb9ad tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 0.888046 Jul 28 04:04:31.514769 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2322/5142] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:30 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:31.809204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a23891b-a066-41c6-a6c0-1b3de364aede tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:31.818016 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4a23891b-a066-41c6-a6c0-1b3de364aede tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1324 microversion: 2.1 time: 0.478263 Jul 28 04:04:31.832858 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2821/5143] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:31 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1324 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:32.212962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-5c7832ea-3e8a-4627-9c77-0487c0b4cc3c req-d07a404d-b8c6-4136-aa02-605aa85eedf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811ee089-df2c-4249-baad-4df593985992", "tag": "ce69671b-5254-4769-bd1b-a9451999842a"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:32.226013 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5c7832ea-3e8a-4627-9c77-0487c0b4cc3c req-d07a404d-b8c6-4136-aa02-605aa85eedf8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:32.226737 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-5c7832ea-3e8a-4627-9c77-0487c0b4cc3c req-d07a404d-b8c6-4136-aa02-605aa85eedf8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:32.253927 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-5c7832ea-3e8a-4627-9c77-0487c0b4cc3c req-d07a404d-b8c6-4136-aa02-605aa85eedf8 service nova] Creating event network-changed:ce69671b-5254-4769-bd1b-a9451999842a for instance 811ee089-df2c-4249-baad-4df593985992 on n-h1-826756-3 Jul 28 04:04:32.267455 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-5c7832ea-3e8a-4627-9c77-0487c0b4cc3c req-d07a404d-b8c6-4136-aa02-605aa85eedf8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059106 Jul 28 04:04:32.268866 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2323/5144] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:32.522038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e119d55f-c87b-4f10-b273-2960292caa13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:32.522648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e119d55f-c87b-4f10-b273-2960292caa13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:32.535382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e119d55f-c87b-4f10-b273-2960292caa13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:32.536190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e119d55f-c87b-4f10-b273-2960292caa13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:32.537201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e119d55f-c87b-4f10-b273-2960292caa13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:32.539303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e119d55f-c87b-4f10-b273-2960292caa13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:32.748252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:32.857474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0b5bf0e8-42ab-4704-8bea-e50c927440d4 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:32.858164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0b5bf0e8-42ab-4704-8bea-e50c927440d4 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:32.869817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b5bf0e8-42ab-4704-8bea-e50c927440d4 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:32.870272 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b5bf0e8-42ab-4704-8bea-e50c927440d4 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:32.871051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b5bf0e8-42ab-4704-8bea-e50c927440d4 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:32.871485 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0b5bf0e8-42ab-4704-8bea-e50c927440d4 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:33.197005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:33.204419 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0b5bf0e8-42ab-4704-8bea-e50c927440d4 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:33.217200 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0b5bf0e8-42ab-4704-8bea-e50c927440d4 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1324 microversion: 2.1 time: 0.364045 Jul 28 04:04:33.218641 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2324/5145] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:32 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1324 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:33.585027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e119d55f-c87b-4f10-b273-2960292caa13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:33.610261 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e119d55f-c87b-4f10-b273-2960292caa13 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 1.091973 Jul 28 04:04:33.630997 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2822/5146] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:32 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:34.238178 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ea120bed-ea9d-4d32-bdc5-c29cc44e62d2 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:34.239652 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ea120bed-ea9d-4d32-bdc5-c29cc44e62d2 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:34.268085 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea120bed-ea9d-4d32-bdc5-c29cc44e62d2 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:34.268927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea120bed-ea9d-4d32-bdc5-c29cc44e62d2 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:34.271043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea120bed-ea9d-4d32-bdc5-c29cc44e62d2 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:34.277567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ea120bed-ea9d-4d32-bdc5-c29cc44e62d2 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:34.661460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-10730ce0-351c-4eb0-9389-a748bc7ab908 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:34.662085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-10730ce0-351c-4eb0-9389-a748bc7ab908 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:34.679297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10730ce0-351c-4eb0-9389-a748bc7ab908 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:34.679991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10730ce0-351c-4eb0-9389-a748bc7ab908 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:34.680896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ea120bed-ea9d-4d32-bdc5-c29cc44e62d2 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:34.681115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10730ce0-351c-4eb0-9389-a748bc7ab908 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:34.681688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10730ce0-351c-4eb0-9389-a748bc7ab908 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:34.689782 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ea120bed-ea9d-4d32-bdc5-c29cc44e62d2 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1324 microversion: 2.1 time: 0.455452 Jul 28 04:04:34.690390 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2325/5147] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:34 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1324 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:35.311295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-10730ce0-351c-4eb0-9389-a748bc7ab908 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:35.324653 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-10730ce0-351c-4eb0-9389-a748bc7ab908 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 0.677307 Jul 28 04:04:35.326071 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2823/5148] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:34 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:35.711714 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0d5742ef-5ad9-4690-9a4a-5d8af2c090f3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:35.713258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0d5742ef-5ad9-4690-9a4a-5d8af2c090f3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:35.731162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d5742ef-5ad9-4690-9a4a-5d8af2c090f3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:35.731774 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d5742ef-5ad9-4690-9a4a-5d8af2c090f3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:35.732781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d5742ef-5ad9-4690-9a4a-5d8af2c090f3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:35.733219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0d5742ef-5ad9-4690-9a4a-5d8af2c090f3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:36.374927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4633c7be-a3cd-463f-a991-a15cc266c29c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:36.375644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4633c7be-a3cd-463f-a991-a15cc266c29c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:36.390429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4633c7be-a3cd-463f-a991-a15cc266c29c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:36.396920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4633c7be-a3cd-463f-a991-a15cc266c29c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:36.397981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4633c7be-a3cd-463f-a991-a15cc266c29c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:36.398601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4633c7be-a3cd-463f-a991-a15cc266c29c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:36.594691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0d5742ef-5ad9-4690-9a4a-5d8af2c090f3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:36.607173 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0d5742ef-5ad9-4690-9a4a-5d8af2c090f3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1324 microversion: 2.1 time: 0.899648 Jul 28 04:04:36.626289 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2326/5149] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:35 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1324 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:36.762716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4633c7be-a3cd-463f-a991-a15cc266c29c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:36.770793 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4633c7be-a3cd-463f-a991-a15cc266c29c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 0.416871 Jul 28 04:04:36.771402 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2824/5150] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:36 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:37.635449 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1664d88b-dd89-4730-9005-c2e9f7263683 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:37.636753 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1664d88b-dd89-4730-9005-c2e9f7263683 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:37.645890 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1664d88b-dd89-4730-9005-c2e9f7263683 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:37.646834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1664d88b-dd89-4730-9005-c2e9f7263683 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:37.648125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1664d88b-dd89-4730-9005-c2e9f7263683 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:37.648761 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1664d88b-dd89-4730-9005-c2e9f7263683 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:37.809202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f1a43a81-3fe8-45c3-b2da-6578d13c7e39 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:37.812133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f1a43a81-3fe8-45c3-b2da-6578d13c7e39 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:37.836860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1a43a81-3fe8-45c3-b2da-6578d13c7e39 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:37.839139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1a43a81-3fe8-45c3-b2da-6578d13c7e39 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:37.843440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1a43a81-3fe8-45c3-b2da-6578d13c7e39 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:37.844392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1a43a81-3fe8-45c3-b2da-6578d13c7e39 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:38.127323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1664d88b-dd89-4730-9005-c2e9f7263683 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:38.167291 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1664d88b-dd89-4730-9005-c2e9f7263683 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1324 microversion: 2.1 time: 0.528557 Jul 28 04:04:38.181602 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2327/5151] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:37 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1324 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:38.330840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f1a43a81-3fe8-45c3-b2da-6578d13c7e39 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:38.370101 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f1a43a81-3fe8-45c3-b2da-6578d13c7e39 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 0.577207 Jul 28 04:04:38.384214 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2825/5152] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:37 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:39.189765 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2bd707ea-2b7a-429c-adf9-5a01eec46424 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:39.190471 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2bd707ea-2b7a-429c-adf9-5a01eec46424 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:39.200430 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2bd707ea-2b7a-429c-adf9-5a01eec46424 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:39.201654 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2bd707ea-2b7a-429c-adf9-5a01eec46424 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:39.203607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2bd707ea-2b7a-429c-adf9-5a01eec46424 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:39.204212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2bd707ea-2b7a-429c-adf9-5a01eec46424 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:39.228930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e02d28b4-a785-4269-ac51-6697d37d8f2c req-2d9f0b97-81bd-4a10-a122-f1065c2244bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811ee089-df2c-4249-baad-4df593985992", "name": "network-vif-plugged", "status": "completed", "tag": "ce69671b-5254-4769-bd1b-a9451999842a"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:39.246590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e02d28b4-a785-4269-ac51-6697d37d8f2c req-2d9f0b97-81bd-4a10-a122-f1065c2244bf service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:39.247036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e02d28b4-a785-4269-ac51-6697d37d8f2c req-2d9f0b97-81bd-4a10-a122-f1065c2244bf service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:39.283784 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e02d28b4-a785-4269-ac51-6697d37d8f2c req-2d9f0b97-81bd-4a10-a122-f1065c2244bf service nova] Creating event network-vif-plugged:ce69671b-5254-4769-bd1b-a9451999842a for instance 811ee089-df2c-4249-baad-4df593985992 on n-h1-826756-3 Jul 28 04:04:39.295181 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e02d28b4-a785-4269-ac51-6697d37d8f2c req-2d9f0b97-81bd-4a10-a122-f1065c2244bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065411 Jul 28 04:04:39.296249 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2826/5153] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:04:39.402967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0800d6ce-969c-4201-8fd2-6d920b9df948 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:39.405124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0800d6ce-969c-4201-8fd2-6d920b9df948 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:39.418837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0800d6ce-969c-4201-8fd2-6d920b9df948 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:39.420742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0800d6ce-969c-4201-8fd2-6d920b9df948 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:39.421973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0800d6ce-969c-4201-8fd2-6d920b9df948 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:39.422665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0800d6ce-969c-4201-8fd2-6d920b9df948 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:39.963977 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2bd707ea-2b7a-429c-adf9-5a01eec46424 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:39.970640 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:39.982273 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2bd707ea-2b7a-429c-adf9-5a01eec46424 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1324 microversion: 2.1 time: 0.798421 Jul 28 04:04:39.982936 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2328/5154] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:39 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1324 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:40.101277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0800d6ce-969c-4201-8fd2-6d920b9df948 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:40.119934 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0800d6ce-969c-4201-8fd2-6d920b9df948 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 0.730313 Jul 28 04:04:40.132892 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2827/5155] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:39 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:41.004340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0df34c28-3f84-4023-b977-74ed1f86322a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:41.005047 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0df34c28-3f84-4023-b977-74ed1f86322a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:41.041872 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0df34c28-3f84-4023-b977-74ed1f86322a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:41.042507 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0df34c28-3f84-4023-b977-74ed1f86322a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:41.048973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0df34c28-3f84-4023-b977-74ed1f86322a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:41.049826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0df34c28-3f84-4023-b977-74ed1f86322a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:41.148634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f7b8467b-9e68-4847-9fd3-22adae60c81b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:41.149436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f7b8467b-9e68-4847-9fd3-22adae60c81b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:41.158967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7b8467b-9e68-4847-9fd3-22adae60c81b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:41.159791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7b8467b-9e68-4847-9fd3-22adae60c81b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:41.160897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7b8467b-9e68-4847-9fd3-22adae60c81b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:41.161611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7b8467b-9e68-4847-9fd3-22adae60c81b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:41.496859 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0df34c28-3f84-4023-b977-74ed1f86322a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:41.507868 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0df34c28-3f84-4023-b977-74ed1f86322a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1324 microversion: 2.1 time: 0.508146 Jul 28 04:04:41.521539 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2329/5156] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:40 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1324 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:42.204869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f7b8467b-9e68-4847-9fd3-22adae60c81b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:42.217150 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f7b8467b-9e68-4847-9fd3-22adae60c81b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 1.073489 Jul 28 04:04:42.220551 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2828/5157] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:41 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:42.531726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6a33ec6f-1656-45ea-83ab-6ab940568a2e tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:42.533003 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6a33ec6f-1656-45ea-83ab-6ab940568a2e tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:42.541776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a33ec6f-1656-45ea-83ab-6ab940568a2e tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:42.546500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a33ec6f-1656-45ea-83ab-6ab940568a2e tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:42.548710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a33ec6f-1656-45ea-83ab-6ab940568a2e tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:42.549106 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6a33ec6f-1656-45ea-83ab-6ab940568a2e tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:43.239631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-355b27bf-5086-46cd-8fa4-5858e3314584 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:43.240045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-355b27bf-5086-46cd-8fa4-5858e3314584 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:43.264065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-355b27bf-5086-46cd-8fa4-5858e3314584 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:43.264714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-355b27bf-5086-46cd-8fa4-5858e3314584 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:43.265730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-355b27bf-5086-46cd-8fa4-5858e3314584 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:43.266482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-355b27bf-5086-46cd-8fa4-5858e3314584 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:43.476867 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6a33ec6f-1656-45ea-83ab-6ab940568a2e tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:43.492577 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6a33ec6f-1656-45ea-83ab-6ab940568a2e tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1520 microversion: 2.1 time: 0.964931 Jul 28 04:04:43.493652 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2330/5158] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:42 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1520 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:43.518409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a8ca4268-b35f-4f89-a0ff-2ec63810f2a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:43.518889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a8ca4268-b35f-4f89-a0ff-2ec63810f2a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:43.529089 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8ca4268-b35f-4f89-a0ff-2ec63810f2a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:43.532766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8ca4268-b35f-4f89-a0ff-2ec63810f2a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:43.536619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8ca4268-b35f-4f89-a0ff-2ec63810f2a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:43.537242 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a8ca4268-b35f-4f89-a0ff-2ec63810f2a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:43.611123 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-a8ca4268-b35f-4f89-a0ff-2ec63810f2a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] HTTP exception thrown: Instance is not a member of specified network Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a8ca4268-b35f-4f89-a0ff-2ec63810f2a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Request method failure captured: Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992/ips/invalid HTTP/1.1 Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4grDN7i3jYctp8IKj6V5S15IvPjRE8TdJbttgFWxErdh-Ksah0otdEFYOaIbGAcQt4UHVrXphh32s4oqEAZ0U-AiNK_3d1a_yremdoCM3lFa7iv_U7yFyo6CwI_G3t9iUuyDXiqUbKEqsqG7DZfUJ7QCfUuoqA9FqS7W7lxZjygjIvU Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: d7d71a51e1be442cbeb1d557163cbf49 Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-426590630 Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7d71a51e1be442cbeb1d557163cbf49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7d71a51e1be442cbeb1d557163cbf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7d71a51e1be442cbeb1d557163cbf49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7d71a51e1be442cbeb1d557163cbf49"}]}] Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-426590630 Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: d7d71a51e1be442cbeb1d557163cbf49 Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-426590630 Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerAddressesNegativeTestJSON-426590630-project Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: f9a947e069054652a96e56d73e64b402 Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-426590630-project Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance is not a member of specified network Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'server_id': '811ee089-df2c-4249-baad-4df593985992', 'id': 'invalid'} Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 28 04:04:43.617945 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:04:43.621888 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a8ca4268-b35f-4f89-a0ff-2ec63810f2a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Returning 404 to user: Instance is not a member of specified network {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:04:43.623412 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a8ca4268-b35f-4f89-a0ff-2ec63810f2a3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.109833 Jul 28 04:04:43.628118 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2331/5159] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 04:04:43 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992/ips/invalid => generated 91 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 04:04:43.650156 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3d8ad761-d3e2-45ec-9ce5-ced9c80b75d3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:43.650651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3d8ad761-d3e2-45ec-9ce5-ced9c80b75d3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Failed to fetch instance by id 999 {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2972}} Jul 28 04:04:43.651163 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-3d8ad761-d3e2-45ec-9ce5-ced9c80b75d3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] HTTP exception thrown: Instance 999 could not be found. Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3d8ad761-d3e2-45ec-9ce5-ced9c80b75d3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Request method failure captured: Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4grDN7i3jYctp8IKj6V5S15IvPjRE8TdJbttgFWxErdh-Ksah0otdEFYOaIbGAcQt4UHVrXphh32s4oqEAZ0U-AiNK_3d1a_yremdoCM3lFa7iv_U7yFyo6CwI_G3t9iUuyDXiqUbKEqsqG7DZfUJ7QCfUuoqA9FqS7W7lxZjygjIvU Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: d7d71a51e1be442cbeb1d557163cbf49 Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-426590630 Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7d71a51e1be442cbeb1d557163cbf49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7d71a51e1be442cbeb1d557163cbf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7d71a51e1be442cbeb1d557163cbf49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7d71a51e1be442cbeb1d557163cbf49"}]}] Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-426590630 Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: d7d71a51e1be442cbeb1d557163cbf49 Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-426590630 Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerAddressesNegativeTestJSON-426590630-project Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: f9a947e069054652a96e56d73e64b402 Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-426590630-project Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 999 could not be found. Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'server_id': '999'} Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2973, in get Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 28 04:04:43.652680 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:04:43.655926 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3d8ad761-d3e2-45ec-9ce5-ced9c80b75d3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Returning 404 to user: Instance 999 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:04:43.655926 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3d8ad761-d3e2-45ec-9ce5-ced9c80b75d3 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.023618 Jul 28 04:04:43.655926 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2332/5160] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Jul 28 04:04:43 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 04:04:43.680614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0a956f47-2559-46aa-a6d8-9587258a209a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:43.681212 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0a956f47-2559-46aa-a6d8-9587258a209a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:43.696783 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a956f47-2559-46aa-a6d8-9587258a209a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:43.698097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a956f47-2559-46aa-a6d8-9587258a209a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:43.699723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a956f47-2559-46aa-a6d8-9587258a209a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:43.701396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0a956f47-2559-46aa-a6d8-9587258a209a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:43.755140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0a956f47-2559-46aa-a6d8-9587258a209a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:04:43.910245 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0a956f47-2559-46aa-a6d8-9587258a209a tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "DELETE /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 204 len: 0 microversion: 2.1 time: 0.242521 Jul 28 04:04:43.910846 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2333/5161] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:04:43 2022] DELETE /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:04:43.929142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-64df7d84-4bfa-4b9f-a363-513993690df9 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:43.929892 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-64df7d84-4bfa-4b9f-a363-513993690df9 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:43.937429 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64df7d84-4bfa-4b9f-a363-513993690df9 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:43.937881 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64df7d84-4bfa-4b9f-a363-513993690df9 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:43.938689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64df7d84-4bfa-4b9f-a363-513993690df9 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:43.939174 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-64df7d84-4bfa-4b9f-a363-513993690df9 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:43.962159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-355b27bf-5086-46cd-8fa4-5858e3314584 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:43.980277 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-355b27bf-5086-46cd-8fa4-5858e3314584 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 0.745195 Jul 28 04:04:43.983210 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2829/5162] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:43 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:44.270262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-64df7d84-4bfa-4b9f-a363-513993690df9 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:44.283104 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-64df7d84-4bfa-4b9f-a363-513993690df9 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1526 microversion: 2.1 time: 0.360453 Jul 28 04:04:44.284031 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2334/5163] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:43 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1526 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:45.003831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fe2eadc1-ef91-4a5e-b883-856944d05bc5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:45.004489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fe2eadc1-ef91-4a5e-b883-856944d05bc5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:45.023256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe2eadc1-ef91-4a5e-b883-856944d05bc5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:45.023702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe2eadc1-ef91-4a5e-b883-856944d05bc5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:45.028201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe2eadc1-ef91-4a5e-b883-856944d05bc5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:45.030810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe2eadc1-ef91-4a5e-b883-856944d05bc5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:45.310161 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ab5266de-f5b6-47bf-98f0-1d5e6acb6da8 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:45.311372 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ab5266de-f5b6-47bf-98f0-1d5e6acb6da8 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:45.335731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ab5266de-f5b6-47bf-98f0-1d5e6acb6da8 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:45.338273 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ab5266de-f5b6-47bf-98f0-1d5e6acb6da8 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:45.344412 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ab5266de-f5b6-47bf-98f0-1d5e6acb6da8 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:45.348034 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ab5266de-f5b6-47bf-98f0-1d5e6acb6da8 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:45.551550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fe2eadc1-ef91-4a5e-b883-856944d05bc5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:45.561889 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fe2eadc1-ef91-4a5e-b883-856944d05bc5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 0.562011 Jul 28 04:04:45.579050 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2830/5164] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:44 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:46.382991 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ab5266de-f5b6-47bf-98f0-1d5e6acb6da8 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:46.394494 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ab5266de-f5b6-47bf-98f0-1d5e6acb6da8 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1526 microversion: 2.1 time: 1.092687 Jul 28 04:04:46.395094 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2335/5165] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:45 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1526 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:46.600403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-860b16cc-0074-40f7-bab2-caaea4d796c7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:46.602409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-860b16cc-0074-40f7-bab2-caaea4d796c7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:46.611892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-860b16cc-0074-40f7-bab2-caaea4d796c7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:46.612748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-860b16cc-0074-40f7-bab2-caaea4d796c7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:46.613783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-860b16cc-0074-40f7-bab2-caaea4d796c7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:46.614420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-860b16cc-0074-40f7-bab2-caaea4d796c7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:46.647349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:46.883899 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-20d4ab89-a5b2-4cef-988f-e7f362ba7c16 req-0c28d545-1ebc-46cd-a83f-1f1ea6d821f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811ee089-df2c-4249-baad-4df593985992", "name": "network-vif-deleted", "tag": "ce69671b-5254-4769-bd1b-a9451999842a"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:46.927989 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-20d4ab89-a5b2-4cef-988f-e7f362ba7c16 req-0c28d545-1ebc-46cd-a83f-1f1ea6d821f0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:46.928464 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-20d4ab89-a5b2-4cef-988f-e7f362ba7c16 req-0c28d545-1ebc-46cd-a83f-1f1ea6d821f0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:46.958161 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-20d4ab89-a5b2-4cef-988f-e7f362ba7c16 req-0c28d545-1ebc-46cd-a83f-1f1ea6d821f0 service nova] Creating event network-vif-deleted:ce69671b-5254-4769-bd1b-a9451999842a for instance 811ee089-df2c-4249-baad-4df593985992 on n-h1-826756-3 Jul 28 04:04:46.971939 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-20d4ab89-a5b2-4cef-988f-e7f362ba7c16 req-0c28d545-1ebc-46cd-a83f-1f1ea6d821f0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095144 Jul 28 04:04:46.977084 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2336/5166] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:47.416160 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39c8d41b-aa6e-4628-b6ed-c2f3ae3e2169 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:47.416881 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-39c8d41b-aa6e-4628-b6ed-c2f3ae3e2169 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:47.427482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39c8d41b-aa6e-4628-b6ed-c2f3ae3e2169 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:47.434313 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39c8d41b-aa6e-4628-b6ed-c2f3ae3e2169 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:47.442939 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39c8d41b-aa6e-4628-b6ed-c2f3ae3e2169 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:47.446769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39c8d41b-aa6e-4628-b6ed-c2f3ae3e2169 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:47.528305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39c8d41b-aa6e-4628-b6ed-c2f3ae3e2169 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:47.529717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39c8d41b-aa6e-4628-b6ed-c2f3ae3e2169 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:47.530600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-39c8d41b-aa6e-4628-b6ed-c2f3ae3e2169 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lazy-loading 'fault' on Instance uuid 811ee089-df2c-4249-baad-4df593985992 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:04:47.643770 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-39c8d41b-aa6e-4628-b6ed-c2f3ae3e2169 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a947e069054652a96e56d73e64b402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7d71a51e1be442cbeb1d557163cbf49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:47.653850 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-39c8d41b-aa6e-4628-b6ed-c2f3ae3e2169 tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 200 len: 1314 microversion: 2.1 time: 0.241833 Jul 28 04:04:47.660086 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2337/5167] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:47 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:47.882464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-860b16cc-0074-40f7-bab2-caaea4d796c7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:47.896099 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-860b16cc-0074-40f7-bab2-caaea4d796c7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1517 microversion: 2.1 time: 1.299729 Jul 28 04:04:47.897938 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2831/5168] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:46 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1517 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:48.684641 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-92b0ef8f-84fe-4f91-838f-663ab9fc743f tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:48.685291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-92b0ef8f-84fe-4f91-838f-663ab9fc743f tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] [instance: 811ee089-df2c-4249-baad-4df593985992] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:48.696298 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92b0ef8f-84fe-4f91-838f-663ab9fc743f tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:48.697162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92b0ef8f-84fe-4f91-838f-663ab9fc743f tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:48.698162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92b0ef8f-84fe-4f91-838f-663ab9fc743f tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:48.699075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-92b0ef8f-84fe-4f91-838f-663ab9fc743f tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:48.736301 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-92b0ef8f-84fe-4f91-838f-663ab9fc743f tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] HTTP exception thrown: Instance 811ee089-df2c-4249-baad-4df593985992 could not be found. Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-92b0ef8f-84fe-4f91-838f-663ab9fc743f tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Request method failure captured: Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 HTTP/1.1 Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4grDN7i3jYctp8IKj6V5S15IvPjRE8TdJbttgFWxErdh-Ksah0otdEFYOaIbGAcQt4UHVrXphh32s4oqEAZ0U-AiNK_3d1a_yremdoCM3lFa7iv_U7yFyo6CwI_G3t9iUuyDXiqUbKEqsqG7DZfUJ7QCfUuoqA9FqS7W7lxZjygjIvU Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: d7d71a51e1be442cbeb1d557163cbf49 Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-426590630 Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d7d71a51e1be442cbeb1d557163cbf49"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7d71a51e1be442cbeb1d557163cbf49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d7d71a51e1be442cbeb1d557163cbf49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d7d71a51e1be442cbeb1d557163cbf49"}]}] Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-426590630 Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: d7d71a51e1be442cbeb1d557163cbf49 Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-426590630 Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-ServerAddressesNegativeTestJSON-426590630-project Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: f9a947e069054652a96e56d73e64b402 Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-426590630-project Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 811ee089-df2c-4249-baad-4df593985992 could not be found. Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': '811ee089-df2c-4249-baad-4df593985992'} Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811ee089-df2c-4249-baad-4df593985992 could not be found. Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811ee089-df2c-4249-baad-4df593985992 could not be found. Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:04:48.748248 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:48.753081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:04:48.753081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:48.753081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:48.753081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:48.753081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:04:48.753081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:04:48.753081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811ee089-df2c-4249-baad-4df593985992 could not be found. Jul 28 04:04:48.753081 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:04:48.753081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-92b0ef8f-84fe-4f91-838f-663ab9fc743f tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] Returning 404 to user: Instance 811ee089-df2c-4249-baad-4df593985992 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:04:48.756850 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-92b0ef8f-84fe-4f91-838f-663ab9fc743f tempest-ServerAddressesNegativeTestJSON-426590630 tempest-ServerAddressesNegativeTestJSON-426590630-project] 10.222.0.48 "GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992" status: 404 len: 111 microversion: 2.1 time: 0.076056 Jul 28 04:04:48.762124 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2338/5169] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:48 2022] GET /compute/v2.1/servers/811ee089-df2c-4249-baad-4df593985992 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:04:48.919334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f0d8d649-e131-44c0-843c-a152d330767d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:48.919899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f0d8d649-e131-44c0-843c-a152d330767d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:48.938504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0d8d649-e131-44c0-843c-a152d330767d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:48.939363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0d8d649-e131-44c0-843c-a152d330767d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:48.940293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0d8d649-e131-44c0-843c-a152d330767d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:48.940885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0d8d649-e131-44c0-843c-a152d330767d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:49.291805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f0d8d649-e131-44c0-843c-a152d330767d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:49.301254 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f0d8d649-e131-44c0-843c-a152d330767d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1523 microversion: 2.1 time: 0.387894 Jul 28 04:04:49.303095 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2832/5170] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:48 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:50.328114 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4c47790a-b2ce-48cb-8ba1-f1dda6de4c40 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:50.328772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4c47790a-b2ce-48cb-8ba1-f1dda6de4c40 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:50.331793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:50.346364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c47790a-b2ce-48cb-8ba1-f1dda6de4c40 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:50.347005 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c47790a-b2ce-48cb-8ba1-f1dda6de4c40 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:50.347814 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c47790a-b2ce-48cb-8ba1-f1dda6de4c40 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:50.348247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4c47790a-b2ce-48cb-8ba1-f1dda6de4c40 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:50.637864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4c47790a-b2ce-48cb-8ba1-f1dda6de4c40 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:50.652936 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4c47790a-b2ce-48cb-8ba1-f1dda6de4c40 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1523 microversion: 2.1 time: 0.329423 Jul 28 04:04:50.674064 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2339/5171] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:50 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:51.694171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7774f4b4-0d68-4b67-b413-589d6b126e7f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:51.696437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7774f4b4-0d68-4b67-b413-589d6b126e7f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:51.708680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7774f4b4-0d68-4b67-b413-589d6b126e7f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:51.711178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7774f4b4-0d68-4b67-b413-589d6b126e7f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:51.712199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7774f4b4-0d68-4b67-b413-589d6b126e7f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:51.715300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7774f4b4-0d68-4b67-b413-589d6b126e7f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:52.306545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7774f4b4-0d68-4b67-b413-589d6b126e7f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:52.354478 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7774f4b4-0d68-4b67-b413-589d6b126e7f tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1523 microversion: 2.1 time: 0.665131 Jul 28 04:04:52.361556 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2833/5172] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:51 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1523 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:53.386413 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-cd8d3270-2cae-47c3-81d4-972edc461777 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:53.387112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-cd8d3270-2cae-47c3-81d4-972edc461777 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:53.410545 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd8d3270-2cae-47c3-81d4-972edc461777 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:53.418928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd8d3270-2cae-47c3-81d4-972edc461777 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:53.420179 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd8d3270-2cae-47c3-81d4-972edc461777 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:53.420679 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-cd8d3270-2cae-47c3-81d4-972edc461777 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:53.738508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d7400bc7-f72c-4ca3-a426-557ffea2d0d9 req-1f24010d-e963-485e-9c22-354fdeba243b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb57b591-927c-4af5-a304-c7a48ef1d679", "name": "network-vif-plugged", "status": "completed", "tag": "6efe01b3-6dd9-4b88-96e3-a62a4ce9fee1"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:53.747763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:53.754303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d7400bc7-f72c-4ca3-a426-557ffea2d0d9 req-1f24010d-e963-485e-9c22-354fdeba243b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:53.754756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d7400bc7-f72c-4ca3-a426-557ffea2d0d9 req-1f24010d-e963-485e-9c22-354fdeba243b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:53.787329 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-d7400bc7-f72c-4ca3-a426-557ffea2d0d9 req-1f24010d-e963-485e-9c22-354fdeba243b service nova] Creating event network-vif-plugged:6efe01b3-6dd9-4b88-96e3-a62a4ce9fee1 for instance fb57b591-927c-4af5-a304-c7a48ef1d679 on n-h2-826756-3 Jul 28 04:04:53.796833 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d7400bc7-f72c-4ca3-a426-557ffea2d0d9 req-1f24010d-e963-485e-9c22-354fdeba243b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061881 Jul 28 04:04:53.797838 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2834/5173] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:04:54.152848 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-cd8d3270-2cae-47c3-81d4-972edc461777 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:54.167022 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-cd8d3270-2cae-47c3-81d4-972edc461777 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1523 microversion: 2.1 time: 0.788531 Jul 28 04:04:54.167631 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2340/5174] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:53 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1523 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:55.202284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f7714772-c995-4b1e-94df-741d63f1ad52 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:55.203230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f7714772-c995-4b1e-94df-741d63f1ad52 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:55.228665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7714772-c995-4b1e-94df-741d63f1ad52 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:55.230184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7714772-c995-4b1e-94df-741d63f1ad52 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:55.230659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7714772-c995-4b1e-94df-741d63f1ad52 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:55.231101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7714772-c995-4b1e-94df-741d63f1ad52 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:56.588714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f7714772-c995-4b1e-94df-741d63f1ad52 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:56.618884 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f7714772-c995-4b1e-94df-741d63f1ad52 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1523 microversion: 2.1 time: 1.422397 Jul 28 04:04:56.619523 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2835/5175] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:55 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1523 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:57.641504 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1f8d02cb-fd63-4f2f-b3fd-6e9a5789f8ed tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:57.642193 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1f8d02cb-fd63-4f2f-b3fd-6e9a5789f8ed tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:57.658121 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f8d02cb-fd63-4f2f-b3fd-6e9a5789f8ed tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:57.660997 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f8d02cb-fd63-4f2f-b3fd-6e9a5789f8ed tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:57.661998 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f8d02cb-fd63-4f2f-b3fd-6e9a5789f8ed tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:57.662630 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1f8d02cb-fd63-4f2f-b3fd-6e9a5789f8ed tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:59.105094 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1f8d02cb-fd63-4f2f-b3fd-6e9a5789f8ed tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:59.167287 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1f8d02cb-fd63-4f2f-b3fd-6e9a5789f8ed tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1508 microversion: 2.1 time: 1.521139 Jul 28 04:04:59.168167 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2341/5176] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:57 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1508 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:59.190488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f974c0e-fbcd-444c-a45a-c467fe353ab5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:59.191098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6f974c0e-fbcd-444c-a45a-c467fe353ab5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:04:59.214013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f974c0e-fbcd-444c-a45a-c467fe353ab5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:59.216990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f974c0e-fbcd-444c-a45a-c467fe353ab5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:59.217981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f974c0e-fbcd-444c-a45a-c467fe353ab5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:59.221548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f974c0e-fbcd-444c-a45a-c467fe353ab5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:00.469058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6f974c0e-fbcd-444c-a45a-c467fe353ab5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:00.479476 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6f974c0e-fbcd-444c-a45a-c467fe353ab5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 200 len: 1508 microversion: 2.1 time: 1.293067 Jul 28 04:05:00.497074 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2836/5177] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:59 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 1508 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:00.508678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4f0469f2-fb0b-434b-977b-ca225f586804 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:00.509206 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4f0469f2-fb0b-434b-977b-ca225f586804 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:00.520686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f0469f2-fb0b-434b-977b-ca225f586804 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:00.527189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f0469f2-fb0b-434b-977b-ca225f586804 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:00.528398 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f0469f2-fb0b-434b-977b-ca225f586804 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:00.529012 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4f0469f2-fb0b-434b-977b-ca225f586804 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:00.585375 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4f0469f2-fb0b-434b-977b-ca225f586804 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:05:00.784834 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4f0469f2-fb0b-434b-977b-ca225f586804 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 204 len: 0 microversion: 2.1 time: 0.279993 Jul 28 04:05:00.816011 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2342/5178] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:00 2022] DELETE /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:05:01.120145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-479143832", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "462e9086-df54-488f-a03f-5e8360013b0d"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:01.206574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] validate_networks() for [('462e9086-df54-488f-a03f-5e8360013b0d', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:05:02.821635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:05:02.822252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:05:02.822764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:05:02.823721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:05:02.824338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:05:02.847072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:02.847767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:02.848599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:02.849042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:02.875638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Getting quotas for project 20141383097d4e2fa18337fdb001e7a2. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:05:02.883367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Getting quotas for user 7cf7921de39349739835f1ebd23ac77b and project 20141383097d4e2fa18337fdb001e7a2. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:05:02.898360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:05:02.902017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:05:02.968613 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-acc88bbd-1ae6-44a2-90da-48f36605e704 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.853332 Jul 28 04:05:02.981983 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-aff42735-c2bb-439e-8f21-edf2840af865 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:02.982694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-aff42735-c2bb-439e-8f21-edf2840af865 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:02.986668 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2837/5179] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:05:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:05:03.521468 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-aff42735-c2bb-439e-8f21-edf2840af865 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:03.536410 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-aff42735-c2bb-439e-8f21-edf2840af865 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1217 microversion: 2.1 time: 0.555832 Jul 28 04:05:03.543302 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2343/5180] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:02 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1217 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:04.564556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7f353978-6f3c-4eb8-9d82-70481fd57f46 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:04.565210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7f353978-6f3c-4eb8-9d82-70481fd57f46 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:04.578455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f353978-6f3c-4eb8-9d82-70481fd57f46 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:04.578917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f353978-6f3c-4eb8-9d82-70481fd57f46 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:04.579704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f353978-6f3c-4eb8-9d82-70481fd57f46 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:04.584630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f353978-6f3c-4eb8-9d82-70481fd57f46 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:05.137158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7f353978-6f3c-4eb8-9d82-70481fd57f46 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:05.147714 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7f353978-6f3c-4eb8-9d82-70481fd57f46 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1277 microversion: 2.1 time: 0.588254 Jul 28 04:05:05.152104 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2838/5181] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:04 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1277 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:05.997202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-4702d60c-a75b-4d5c-be7f-983e1e679162 req-5f5f7c94-72fb-4e06-98da-af28cd9e73cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb57b591-927c-4af5-a304-c7a48ef1d679", "name": "network-vif-deleted", "tag": "6efe01b3-6dd9-4b88-96e3-a62a4ce9fee1"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:06.017735 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4702d60c-a75b-4d5c-be7f-983e1e679162 req-5f5f7c94-72fb-4e06-98da-af28cd9e73cb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:06.018568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-4702d60c-a75b-4d5c-be7f-983e1e679162 req-5f5f7c94-72fb-4e06-98da-af28cd9e73cb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:06.060158 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-4702d60c-a75b-4d5c-be7f-983e1e679162 req-5f5f7c94-72fb-4e06-98da-af28cd9e73cb service nova] Creating event network-vif-deleted:6efe01b3-6dd9-4b88-96e3-a62a4ce9fee1 for instance fb57b591-927c-4af5-a304-c7a48ef1d679 on n-h2-826756-3 Jul 28 04:05:06.068098 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-4702d60c-a75b-4d5c-be7f-983e1e679162 req-5f5f7c94-72fb-4e06-98da-af28cd9e73cb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075845 Jul 28 04:05:06.071870 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2344/5182] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:06.178784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3dfd13f9-d753-492c-9a73-a393a3e1f568 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:06.180198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3dfd13f9-d753-492c-9a73-a393a3e1f568 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:06.209082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3dfd13f9-d753-492c-9a73-a393a3e1f568 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:06.211112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3dfd13f9-d753-492c-9a73-a393a3e1f568 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:06.212822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3dfd13f9-d753-492c-9a73-a393a3e1f568 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:06.214225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3dfd13f9-d753-492c-9a73-a393a3e1f568 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:06.385953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3dfd13f9-d753-492c-9a73-a393a3e1f568 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:06.400046 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3dfd13f9-d753-492c-9a73-a393a3e1f568 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1275 microversion: 2.1 time: 0.224934 Jul 28 04:05:06.404259 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2839/5183] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:06 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1275 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:07.423843 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c07169f7-16e6-4e0e-8294-12f0efc37a41 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:07.425222 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c07169f7-16e6-4e0e-8294-12f0efc37a41 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:07.439788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c07169f7-16e6-4e0e-8294-12f0efc37a41 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:07.440536 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c07169f7-16e6-4e0e-8294-12f0efc37a41 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:07.441723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c07169f7-16e6-4e0e-8294-12f0efc37a41 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:07.442383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c07169f7-16e6-4e0e-8294-12f0efc37a41 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:07.575595 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c07169f7-16e6-4e0e-8294-12f0efc37a41 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:07.583679 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c07169f7-16e6-4e0e-8294-12f0efc37a41 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1275 microversion: 2.1 time: 0.164189 Jul 28 04:05:07.584267 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2345/5184] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:07 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:08.608581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-36bcd1d1-a180-4164-98f1-23215c8e4352 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:08.609946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-36bcd1d1-a180-4164-98f1-23215c8e4352 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:08.617299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36bcd1d1-a180-4164-98f1-23215c8e4352 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:08.620325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36bcd1d1-a180-4164-98f1-23215c8e4352 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:08.620325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36bcd1d1-a180-4164-98f1-23215c8e4352 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:08.620325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36bcd1d1-a180-4164-98f1-23215c8e4352 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:08.956973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-36bcd1d1-a180-4164-98f1-23215c8e4352 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:08.972460 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-36bcd1d1-a180-4164-98f1-23215c8e4352 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1317 microversion: 2.1 time: 0.367641 Jul 28 04:05:08.977323 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2840/5185] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:08 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:09.994370 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-415863aa-28f1-4c40-912c-adaf10ff638d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:09.994990 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-415863aa-28f1-4c40-912c-adaf10ff638d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:10.009478 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-415863aa-28f1-4c40-912c-adaf10ff638d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:10.010164 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-415863aa-28f1-4c40-912c-adaf10ff638d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:10.011111 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-415863aa-28f1-4c40-912c-adaf10ff638d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:10.012202 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-415863aa-28f1-4c40-912c-adaf10ff638d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:10.062594 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:11.238583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-415863aa-28f1-4c40-912c-adaf10ff638d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:11.252994 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-415863aa-28f1-4c40-912c-adaf10ff638d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1317 microversion: 2.1 time: 1.260347 Jul 28 04:05:11.255041 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2346/5186] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:09 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1317 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:11.857950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0904dc62-fd60-45e6-8e4a-9ad983ef4fd0 req-1bf2b80b-78ef-4006-a566-60e4d2aa7422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de97a878-9762-409e-af83-b9bb65b33112", "tag": "f4f16605-649b-4074-ba5e-da746306d678"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:11.874720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0904dc62-fd60-45e6-8e4a-9ad983ef4fd0 req-1bf2b80b-78ef-4006-a566-60e4d2aa7422 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:11.875172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0904dc62-fd60-45e6-8e4a-9ad983ef4fd0 req-1bf2b80b-78ef-4006-a566-60e4d2aa7422 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:11.894632 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0904dc62-fd60-45e6-8e4a-9ad983ef4fd0 req-1bf2b80b-78ef-4006-a566-60e4d2aa7422 service nova] Creating event network-changed:f4f16605-649b-4074-ba5e-da746306d678 for instance de97a878-9762-409e-af83-b9bb65b33112 on n-h1-826756-3 Jul 28 04:05:11.902344 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0904dc62-fd60-45e6-8e4a-9ad983ef4fd0 req-1bf2b80b-78ef-4006-a566-60e4d2aa7422 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048977 Jul 28 04:05:11.906102 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2841/5187] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:12.274538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d4edbc4a-d09f-4337-bff4-37072b6874d0 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:12.275712 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d4edbc4a-d09f-4337-bff4-37072b6874d0 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:12.286344 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d4edbc4a-d09f-4337-bff4-37072b6874d0 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:12.293583 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d4edbc4a-d09f-4337-bff4-37072b6874d0 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:12.295549 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d4edbc4a-d09f-4337-bff4-37072b6874d0 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:12.295984 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d4edbc4a-d09f-4337-bff4-37072b6874d0 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:12.849722 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d4edbc4a-d09f-4337-bff4-37072b6874d0 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:12.860156 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d4edbc4a-d09f-4337-bff4-37072b6874d0 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1317 microversion: 2.1 time: 0.589563 Jul 28 04:05:12.873866 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2347/5188] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:12 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:13.886382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-176ec769-e917-45f4-8b4d-0cb0f06ac72d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:13.888640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-176ec769-e917-45f4-8b4d-0cb0f06ac72d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:13.891551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:13.902122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:13.918874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-176ec769-e917-45f4-8b4d-0cb0f06ac72d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:13.919600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-176ec769-e917-45f4-8b4d-0cb0f06ac72d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:13.921199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-176ec769-e917-45f4-8b4d-0cb0f06ac72d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:13.922082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-176ec769-e917-45f4-8b4d-0cb0f06ac72d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:14.517072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-176ec769-e917-45f4-8b4d-0cb0f06ac72d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:14.555995 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-176ec769-e917-45f4-8b4d-0cb0f06ac72d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1317 microversion: 2.1 time: 0.674433 Jul 28 04:05:14.573259 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2842/5189] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:13 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1317 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:15.584403 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e91b3c95-c58e-47b5-9036-177fd09d5a99 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:15.585555 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e91b3c95-c58e-47b5-9036-177fd09d5a99 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:15.588769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:15.611675 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e91b3c95-c58e-47b5-9036-177fd09d5a99 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:15.612135 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e91b3c95-c58e-47b5-9036-177fd09d5a99 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:15.613022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e91b3c95-c58e-47b5-9036-177fd09d5a99 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:15.615866 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e91b3c95-c58e-47b5-9036-177fd09d5a99 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:15.922486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e91b3c95-c58e-47b5-9036-177fd09d5a99 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:15.934222 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e91b3c95-c58e-47b5-9036-177fd09d5a99 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1317 microversion: 2.1 time: 0.351987 Jul 28 04:05:15.937061 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2348/5190] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:15 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:16.967214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c2dd6851-80c0-4226-9d77-08c23bebe2ec tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:16.967838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c2dd6851-80c0-4226-9d77-08c23bebe2ec tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:16.978171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c2dd6851-80c0-4226-9d77-08c23bebe2ec tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.978619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c2dd6851-80c0-4226-9d77-08c23bebe2ec tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:16.979412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c2dd6851-80c0-4226-9d77-08c23bebe2ec tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.979854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c2dd6851-80c0-4226-9d77-08c23bebe2ec tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:17.012242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=60 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:17.358566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c2dd6851-80c0-4226-9d77-08c23bebe2ec tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:17.367893 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c2dd6851-80c0-4226-9d77-08c23bebe2ec tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1317 microversion: 2.1 time: 0.412532 Jul 28 04:05:17.389229 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2843/5191] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:16 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:18.395656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9a930085-4845-43f7-8959-b4c291875e8a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:18.396569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9a930085-4845-43f7-8959-b4c291875e8a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:18.429231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a930085-4845-43f7-8959-b4c291875e8a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:18.431319 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a930085-4845-43f7-8959-b4c291875e8a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:18.432448 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a930085-4845-43f7-8959-b4c291875e8a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:18.433709 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a930085-4845-43f7-8959-b4c291875e8a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:18.443460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c32dec20-cc9c-4727-bb9c-bf0fafc906f7 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:18.444066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c32dec20-cc9c-4727-bb9c-bf0fafc906f7 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:18.468269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c32dec20-cc9c-4727-bb9c-bf0fafc906f7 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:18.468808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c32dec20-cc9c-4727-bb9c-bf0fafc906f7 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:18.469846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c32dec20-cc9c-4727-bb9c-bf0fafc906f7 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:18.470486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c32dec20-cc9c-4727-bb9c-bf0fafc906f7 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:18.915228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-c32dec20-cc9c-4727-bb9c-bf0fafc906f7 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lazy-loading 'services' on Instance uuid c01805b7-987d-4a67-934e-e173ce2d85c3 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:05:19.163807 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c32dec20-cc9c-4727-bb9c-bf0fafc906f7 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3/os-volume_attachments/0bf84256-f6ba-4895-9c58-9d005da8558a" status: 202 len: 0 microversion: 2.1 time: 0.724760 Jul 28 04:05:19.165176 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2844/5192] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:05:18 2022] DELETE /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3/os-volume_attachments/0bf84256-f6ba-4895-9c58-9d005da8558a => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:05:19.218396 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9a930085-4845-43f7-8959-b4c291875e8a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:19.249593 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9a930085-4845-43f7-8959-b4c291875e8a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1317 microversion: 2.1 time: 0.858249 Jul 28 04:05:19.252993 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2349/5193] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:18 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1317 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:20.273387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8fdc17a4-3756-4cf1-91df-7eaa65361b17 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:20.274195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8fdc17a4-3756-4cf1-91df-7eaa65361b17 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:20.287561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fdc17a4-3756-4cf1-91df-7eaa65361b17 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:20.288199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fdc17a4-3756-4cf1-91df-7eaa65361b17 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:20.289233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fdc17a4-3756-4cf1-91df-7eaa65361b17 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:20.292563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fdc17a4-3756-4cf1-91df-7eaa65361b17 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:20.935225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8fdc17a4-3756-4cf1-91df-7eaa65361b17 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:20.963381 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8fdc17a4-3756-4cf1-91df-7eaa65361b17 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1317 microversion: 2.1 time: 0.695295 Jul 28 04:05:20.968029 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2845/5194] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:20 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1317 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:21.705769 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-9a89f07a-d145-42c8-a19f-b83fc28e4cd8 req-e6331a8d-448b-4cc4-a036-30884cf0a90b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de97a878-9762-409e-af83-b9bb65b33112", "name": "network-vif-plugged", "status": "completed", "tag": "f4f16605-649b-4074-ba5e-da746306d678"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:21.729279 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:21.748019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9a89f07a-d145-42c8-a19f-b83fc28e4cd8 req-e6331a8d-448b-4cc4-a036-30884cf0a90b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:21.760461 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9a89f07a-d145-42c8-a19f-b83fc28e4cd8 req-e6331a8d-448b-4cc4-a036-30884cf0a90b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:21.792488 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-9a89f07a-d145-42c8-a19f-b83fc28e4cd8 req-e6331a8d-448b-4cc4-a036-30884cf0a90b service nova] Creating event network-vif-plugged:f4f16605-649b-4074-ba5e-da746306d678 for instance de97a878-9762-409e-af83-b9bb65b33112 on n-h1-826756-3 Jul 28 04:05:21.816118 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-9a89f07a-d145-42c8-a19f-b83fc28e4cd8 req-e6331a8d-448b-4cc4-a036-30884cf0a90b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115386 Jul 28 04:05:21.835976 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2350/5195] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:21.990026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-972455f2-8141-4bfe-983d-786e7176a6bd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:21.990656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-972455f2-8141-4bfe-983d-786e7176a6bd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:22.011768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-972455f2-8141-4bfe-983d-786e7176a6bd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:22.020464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-972455f2-8141-4bfe-983d-786e7176a6bd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:22.021313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-972455f2-8141-4bfe-983d-786e7176a6bd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:22.021765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-972455f2-8141-4bfe-983d-786e7176a6bd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:22.562207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-972455f2-8141-4bfe-983d-786e7176a6bd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:22.581955 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-972455f2-8141-4bfe-983d-786e7176a6bd tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1317 microversion: 2.1 time: 0.596289 Jul 28 04:05:22.582553 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2846/5196] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:21 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1317 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:23.610615 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9057e466-99fc-4eb8-8a0c-7cd9a8fbd81c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:23.612192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9057e466-99fc-4eb8-8a0c-7cd9a8fbd81c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:23.634247 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9057e466-99fc-4eb8-8a0c-7cd9a8fbd81c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:23.636994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9057e466-99fc-4eb8-8a0c-7cd9a8fbd81c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:23.638014 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9057e466-99fc-4eb8-8a0c-7cd9a8fbd81c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:23.642773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9057e466-99fc-4eb8-8a0c-7cd9a8fbd81c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:24.135418 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9057e466-99fc-4eb8-8a0c-7cd9a8fbd81c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:24.145912 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9057e466-99fc-4eb8-8a0c-7cd9a8fbd81c tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1317 microversion: 2.1 time: 0.540184 Jul 28 04:05:24.148584 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2351/5197] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:23 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:25.169451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bfea408c-8c94-4325-bd5e-87b8748a413d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:25.170189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bfea408c-8c94-4325-bd5e-87b8748a413d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:25.185524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfea408c-8c94-4325-bd5e-87b8748a413d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:25.187281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfea408c-8c94-4325-bd5e-87b8748a413d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:25.190531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfea408c-8c94-4325-bd5e-87b8748a413d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:25.191279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfea408c-8c94-4325-bd5e-87b8748a413d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:25.516331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bfea408c-8c94-4325-bd5e-87b8748a413d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:25.526424 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bfea408c-8c94-4325-bd5e-87b8748a413d tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1508 microversion: 2.1 time: 0.362794 Jul 28 04:05:25.527715 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2847/5198] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:25 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1508 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:25.548394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-24e2b90a-90f9-4cf9-b6da-fe91cfcfc8b2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:25.548782 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-24e2b90a-90f9-4cf9-b6da-fe91cfcfc8b2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:25.556231 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24e2b90a-90f9-4cf9-b6da-fe91cfcfc8b2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:25.556717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24e2b90a-90f9-4cf9-b6da-fe91cfcfc8b2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:25.557515 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24e2b90a-90f9-4cf9-b6da-fe91cfcfc8b2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:25.558079 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24e2b90a-90f9-4cf9-b6da-fe91cfcfc8b2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:26.081170 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-24e2b90a-90f9-4cf9-b6da-fe91cfcfc8b2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:26.089744 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-24e2b90a-90f9-4cf9-b6da-fe91cfcfc8b2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1508 microversion: 2.1 time: 0.545409 Jul 28 04:05:26.093756 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2352/5199] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:25 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1508 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:26.113606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a87f4044-100c-4553-848c-6d29a533f0e2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:26.116175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a87f4044-100c-4553-848c-6d29a533f0e2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:26.118603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:26.134393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a87f4044-100c-4553-848c-6d29a533f0e2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:26.145114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a87f4044-100c-4553-848c-6d29a533f0e2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:26.146227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a87f4044-100c-4553-848c-6d29a533f0e2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:26.146807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a87f4044-100c-4553-848c-6d29a533f0e2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:26.266754 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-843022455", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:26.277643 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a87f4044-100c-4553-848c-6d29a533f0e2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "PUT /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1080 microversion: 2.1 time: 0.164755 Jul 28 04:05:26.291452 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2848/5200] 10.222.0.48 () {60 vars in 1256 bytes} [Thu Jul 28 04:05:26 2022] PUT /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1080 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:26.302246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-997c1566-5529-4d20-a288-a521698f6dc7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:26.302864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-997c1566-5529-4d20-a288-a521698f6dc7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:26.320329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-997c1566-5529-4d20-a288-a521698f6dc7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:26.320629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-997c1566-5529-4d20-a288-a521698f6dc7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:26.321407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-997c1566-5529-4d20-a288-a521698f6dc7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:26.321833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-997c1566-5529-4d20-a288-a521698f6dc7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:26.374189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] validate_networks() for [('c18286c4-4a22-4a75-8b17-8a9a24c04e87', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:05:26.848273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-997c1566-5529-4d20-a288-a521698f6dc7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:26.865702 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-997c1566-5529-4d20-a288-a521698f6dc7 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1506 microversion: 2.1 time: 0.572395 Jul 28 04:05:26.891089 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2849/5201] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:26 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:26.932947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9b36ef99-137e-4514-83fc-d2554c72b59b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:26.935556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9b36ef99-137e-4514-83fc-d2554c72b59b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:26.961037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b36ef99-137e-4514-83fc-d2554c72b59b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:26.962466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b36ef99-137e-4514-83fc-d2554c72b59b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:26.966206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b36ef99-137e-4514-83fc-d2554c72b59b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:26.966912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b36ef99-137e-4514-83fc-d2554c72b59b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:27.616247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9b36ef99-137e-4514-83fc-d2554c72b59b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:27.635429 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9b36ef99-137e-4514-83fc-d2554c72b59b tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1506 microversion: 2.1 time: 0.741797 Jul 28 04:05:27.636072 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2850/5202] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:26 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1506 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:27.660011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90383e3e-91f9-4d17-8282-a25e8137c767 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:27.664982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-90383e3e-91f9-4d17-8282-a25e8137c767 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:27.683521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90383e3e-91f9-4d17-8282-a25e8137c767 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:27.685141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90383e3e-91f9-4d17-8282-a25e8137c767 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:27.690216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90383e3e-91f9-4d17-8282-a25e8137c767 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:27.690945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90383e3e-91f9-4d17-8282-a25e8137c767 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:27.771754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-90383e3e-91f9-4d17-8282-a25e8137c767 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:05:27.938510 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90383e3e-91f9-4d17-8282-a25e8137c767 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 204 len: 0 microversion: 2.1 time: 0.285946 Jul 28 04:05:27.940184 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2851/5203] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:27 2022] DELETE /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:05:27.952920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca3f39fb-2fd4-4286-a10e-045517c2b096 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:27.962836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca3f39fb-2fd4-4286-a10e-045517c2b096 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:27.976299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca3f39fb-2fd4-4286-a10e-045517c2b096 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:27.977261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca3f39fb-2fd4-4286-a10e-045517c2b096 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:27.978471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca3f39fb-2fd4-4286-a10e-045517c2b096 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:27.979117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca3f39fb-2fd4-4286-a10e-045517c2b096 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.089999 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca3f39fb-2fd4-4286-a10e-045517c2b096 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "PUT /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1082 microversion: 2.1 time: 0.145689 Jul 28 04:05:28.092228 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2852/5204] 10.222.0.48 () {60 vars in 1256 bytes} [Thu Jul 28 04:05:27 2022] PUT /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1082 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:28.103761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a61688bb-61e3-48d1-a65a-1013ddfea037 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:28.104920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a61688bb-61e3-48d1-a65a-1013ddfea037 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:28.114913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a61688bb-61e3-48d1-a65a-1013ddfea037 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.116318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a61688bb-61e3-48d1-a65a-1013ddfea037 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.117275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a61688bb-61e3-48d1-a65a-1013ddfea037 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.117794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a61688bb-61e3-48d1-a65a-1013ddfea037 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.430830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a61688bb-61e3-48d1-a65a-1013ddfea037 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:28.448583 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a61688bb-61e3-48d1-a65a-1013ddfea037 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1469 microversion: 2.1 time: 0.354543 Jul 28 04:05:28.449301 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2853/5205] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:28 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1469 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:28.461518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ab01ef8d-887c-41c6-bc8d-a3fc21feeee2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:28.462147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ab01ef8d-887c-41c6-bc8d-a3fc21feeee2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:28.475666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab01ef8d-887c-41c6-bc8d-a3fc21feeee2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.476121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab01ef8d-887c-41c6-bc8d-a3fc21feeee2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.476950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab01ef8d-887c-41c6-bc8d-a3fc21feeee2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.477394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab01ef8d-887c-41c6-bc8d-a3fc21feeee2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.723378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ab01ef8d-887c-41c6-bc8d-a3fc21feeee2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:28.740626 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ab01ef8d-887c-41c6-bc8d-a3fc21feeee2 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1508 microversion: 2.1 time: 0.284332 Jul 28 04:05:28.743875 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2854/5206] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:28 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:28.761476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-21b50335-a4e8-401b-b450-02b60cb649c8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:28.762399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-21b50335-a4e8-401b-b450-02b60cb649c8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:28.770696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21b50335-a4e8-401b-b450-02b60cb649c8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.771454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21b50335-a4e8-401b-b450-02b60cb649c8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.772478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21b50335-a4e8-401b-b450-02b60cb649c8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.773127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21b50335-a4e8-401b-b450-02b60cb649c8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.980867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-21b50335-a4e8-401b-b450-02b60cb649c8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:28.998137 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-21b50335-a4e8-401b-b450-02b60cb649c8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1508 microversion: 2.1 time: 0.237937 Jul 28 04:05:28.999479 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2855/5207] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:28 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1508 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:29.023553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4cb8d258-0af5-4965-93bf-26c3e11eaaa5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:29.024479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4cb8d258-0af5-4965-93bf-26c3e11eaaa5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:29.044938 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:05:29.045414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cb8d258-0af5-4965-93bf-26c3e11eaaa5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.045511 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:05:29.045837 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:05:29.046252 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:05:29.046667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:05:29.066559 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.067022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.068323 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.071954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cb8d258-0af5-4965-93bf-26c3e11eaaa5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.072432 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.073060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cb8d258-0af5-4965-93bf-26c3e11eaaa5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.073590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cb8d258-0af5-4965-93bf-26c3e11eaaa5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.090218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:29.139896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Getting quotas for project f51da76758cc4d5c81c0104f97a65e66. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:05:29.153903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4cb8d258-0af5-4965-93bf-26c3e11eaaa5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:05:29.172287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Getting quotas for user 87824c5db1e04c5d9360d71cd4165c0d and project f51da76758cc4d5c81c0104f97a65e66. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:05:29.193059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:05:29.198850 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:05:29.316675 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a708ea88-ef9b-4f7a-a67b-8766f4be6073 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.188205 Jul 28 04:05:29.325826 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4cb8d258-0af5-4965-93bf-26c3e11eaaa5 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "DELETE /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 204 len: 0 microversion: 2.1 time: 0.306713 Jul 28 04:05:29.327691 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2856/5208] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:29 2022] DELETE /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:05:29.340742 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2353/5209] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:05:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 3215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:05:29.346566 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ef546b44-f513-43b4-a996-a4b2dc618b42 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:29.350439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ef546b44-f513-43b4-a996-a4b2dc618b42 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:29.367368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-084b1f65-79d8-487e-8365-cbdfb3f799a8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:29.373642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-084b1f65-79d8-487e-8365-cbdfb3f799a8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:29.404023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-084b1f65-79d8-487e-8365-cbdfb3f799a8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.413108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-084b1f65-79d8-487e-8365-cbdfb3f799a8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.416803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-084b1f65-79d8-487e-8365-cbdfb3f799a8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.418021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-084b1f65-79d8-487e-8365-cbdfb3f799a8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.504233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-084b1f65-79d8-487e-8365-cbdfb3f799a8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:05:29.633810 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.compute.api [None req-084b1f65-79d8-487e-8365-cbdfb3f799a8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Instance is already in deleting state, ignoring this request Jul 28 04:05:29.635253 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-084b1f65-79d8-487e-8365-cbdfb3f799a8 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "DELETE /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 204 len: 0 microversion: 2.1 time: 0.297711 Jul 28 04:05:29.636605 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2857/5210] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:29 2022] DELETE /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:05:29.647602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-53627a25-aab3-487b-a945-2f8932a69018 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:29.650560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-53627a25-aab3-487b-a945-2f8932a69018 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:29.669435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53627a25-aab3-487b-a945-2f8932a69018 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.670110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53627a25-aab3-487b-a945-2f8932a69018 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.671799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53627a25-aab3-487b-a945-2f8932a69018 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.672588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53627a25-aab3-487b-a945-2f8932a69018 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.737074 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ef546b44-f513-43b4-a996-a4b2dc618b42 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:29.758344 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ef546b44-f513-43b4-a996-a4b2dc618b42 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1222 microversion: 2.1 time: 0.416003 Jul 28 04:05:29.776687 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2354/5211] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:29 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1222 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:29.776687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-98306147-f8e2-492d-afae-7457c0ca8737 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:29.776687 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-98306147-f8e2-492d-afae-7457c0ca8737 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:29.793091 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98306147-f8e2-492d-afae-7457c0ca8737 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.797715 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98306147-f8e2-492d-afae-7457c0ca8737 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.798949 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98306147-f8e2-492d-afae-7457c0ca8737 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.799152 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-98306147-f8e2-492d-afae-7457c0ca8737 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:30.131892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-53627a25-aab3-487b-a945-2f8932a69018 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:30.145133 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-53627a25-aab3-487b-a945-2f8932a69018 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1469 microversion: 2.1 time: 0.507408 Jul 28 04:05:30.165571 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2858/5212] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:29 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1469 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:30.791254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb394119-ab38-4078-97c2-28a3aa1474bc tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:30.792703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb394119-ab38-4078-97c2-28a3aa1474bc tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:30.801065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb394119-ab38-4078-97c2-28a3aa1474bc tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:30.801984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb394119-ab38-4078-97c2-28a3aa1474bc tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:30.802998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb394119-ab38-4078-97c2-28a3aa1474bc tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:30.803593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb394119-ab38-4078-97c2-28a3aa1474bc tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:31.002760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb394119-ab38-4078-97c2-28a3aa1474bc tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:31.034306 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb394119-ab38-4078-97c2-28a3aa1474bc tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1274 microversion: 2.1 time: 0.244496 Jul 28 04:05:31.039443 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2859/5213] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:30 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1274 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:05:31.106577 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-98306147-f8e2-492d-afae-7457c0ca8737 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:31.133617 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-98306147-f8e2-492d-afae-7457c0ca8737 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1514 microversion: 2.1 time: 1.361623 Jul 28 04:05:31.135454 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2355/5214] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:29 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1514 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:31.175955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-357d00b9-f701-4dba-86b7-33c312d38d25 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:31.177612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-357d00b9-f701-4dba-86b7-33c312d38d25 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:31.190787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-357d00b9-f701-4dba-86b7-33c312d38d25 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:31.193674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-357d00b9-f701-4dba-86b7-33c312d38d25 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:31.196160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-357d00b9-f701-4dba-86b7-33c312d38d25 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:31.198043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-357d00b9-f701-4dba-86b7-33c312d38d25 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:31.673230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-357d00b9-f701-4dba-86b7-33c312d38d25 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:31.690288 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-357d00b9-f701-4dba-86b7-33c312d38d25 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1469 microversion: 2.1 time: 0.520527 Jul 28 04:05:31.713085 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2860/5215] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:31 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1469 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:32.067891 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-269bc99b-b899-4462-a344-c8bbd6cf8de3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:32.069198 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-269bc99b-b899-4462-a344-c8bbd6cf8de3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:32.077539 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-269bc99b-b899-4462-a344-c8bbd6cf8de3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:32.078291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-269bc99b-b899-4462-a344-c8bbd6cf8de3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:32.080063 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-269bc99b-b899-4462-a344-c8bbd6cf8de3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:32.080706 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-269bc99b-b899-4462-a344-c8bbd6cf8de3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:32.159034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8cf81b5d-28b8-48f2-893a-131d732e2bf9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:32.159895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8cf81b5d-28b8-48f2-893a-131d732e2bf9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:32.181070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cf81b5d-28b8-48f2-893a-131d732e2bf9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:32.181747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cf81b5d-28b8-48f2-893a-131d732e2bf9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:32.182666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cf81b5d-28b8-48f2-893a-131d732e2bf9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:32.183193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cf81b5d-28b8-48f2-893a-131d732e2bf9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:32.307284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8cf81b5d-28b8-48f2-893a-131d732e2bf9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cf7921de39349739835f1ebd23ac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20141383097d4e2fa18337fdb001e7a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:32.327954 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8cf81b5d-28b8-48f2-893a-131d732e2bf9 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 200 len: 1472 microversion: 2.1 time: 0.175851 Jul 28 04:05:32.329252 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2861/5216] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:32 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 1472 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:05:32.432062 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-269bc99b-b899-4462-a344-c8bbd6cf8de3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:32.447838 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-269bc99b-b899-4462-a344-c8bbd6cf8de3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1280 microversion: 2.1 time: 0.385467 Jul 28 04:05:32.462340 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2356/5217] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:32 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1280 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:32.622233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-5fa1aa12-2889-4907-9765-2c46647d6b34 req-303c3b3d-6aae-4885-b98c-75aaca04951a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de97a878-9762-409e-af83-b9bb65b33112", "name": "network-vif-deleted", "tag": "f4f16605-649b-4074-ba5e-da746306d678"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:32.671644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5fa1aa12-2889-4907-9765-2c46647d6b34 req-303c3b3d-6aae-4885-b98c-75aaca04951a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:32.672136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5fa1aa12-2889-4907-9765-2c46647d6b34 req-303c3b3d-6aae-4885-b98c-75aaca04951a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:32.691348 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5fa1aa12-2889-4907-9765-2c46647d6b34 req-303c3b3d-6aae-4885-b98c-75aaca04951a service nova] Creating event network-vif-deleted:f4f16605-649b-4074-ba5e-da746306d678 for instance de97a878-9762-409e-af83-b9bb65b33112 on n-h1-826756-3 Jul 28 04:05:32.698477 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-5fa1aa12-2889-4907-9765-2c46647d6b34 req-303c3b3d-6aae-4885-b98c-75aaca04951a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089096 Jul 28 04:05:32.700002 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2862/5218] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:32.721431 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f6147f94-2194-4369-ac68-4de2033bdac9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:32.722293 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f6147f94-2194-4369-ac68-4de2033bdac9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:32.731126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f6147f94-2194-4369-ac68-4de2033bdac9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:32.732006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f6147f94-2194-4369-ac68-4de2033bdac9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:32.734022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f6147f94-2194-4369-ac68-4de2033bdac9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:32.734723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f6147f94-2194-4369-ac68-4de2033bdac9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:32.935990 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-f6147f94-2194-4369-ac68-4de2033bdac9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1908fee100354163ae1da54e7f2a5319', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '031d396edf334c0280e3d5ecc2270b7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:32.976754 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f6147f94-2194-4369-ac68-4de2033bdac9 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 200 len: 1427 microversion: 2.1 time: 0.263368 Jul 28 04:05:32.977657 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2357/5219] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:32 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 1427 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:33.351241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f3c10b35-b81e-4260-b45c-565beb20fac3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:33.353402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f3c10b35-b81e-4260-b45c-565beb20fac3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: de97a878-9762-409e-af83-b9bb65b33112] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:33.391595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3c10b35-b81e-4260-b45c-565beb20fac3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.395201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3c10b35-b81e-4260-b45c-565beb20fac3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.398958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3c10b35-b81e-4260-b45c-565beb20fac3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.401079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3c10b35-b81e-4260-b45c-565beb20fac3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.443154 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-f3c10b35-b81e-4260-b45c-565beb20fac3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] HTTP exception thrown: Instance de97a878-9762-409e-af83-b9bb65b33112 could not be found. Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f3c10b35-b81e-4260-b45c-565beb20fac3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Request method failure captured: Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 HTTP/1.1 Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gpfyUNgO9c7IatnAQ3I95LlpqGTW-q2-rizQILxn_b_uQ0g0_vIv0ZKbZ89uP2S1r4KPvARkn3WGkHcNmGMBnXsg3tuwK-OkGosBiIFXDcngy4nwvSeQpi39SDIe0JByM91M2Pt1sHdCzApkyylRFFkYkn9Pg7kf3kPQKD0EVvb1yY Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 20141383097d4e2fa18337fdb001e7a2 Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/20141383097d4e2fa18337fdb001e7a2"}]}] Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 20141383097d4e2fa18337fdb001e7a2 Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerDiskConfigTestJSON-1716618450-project Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 7cf7921de39349739835f1ebd23ac77b Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerDiskConfigTestJSON-1716618450-project Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance de97a878-9762-409e-af83-b9bb65b33112 could not be found. Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'de97a878-9762-409e-af83-b9bb65b33112'} Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de97a878-9762-409e-af83-b9bb65b33112 could not be found. Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de97a878-9762-409e-af83-b9bb65b33112 could not be found. Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.446550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.451208 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.451208 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.451208 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.451208 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:33.451208 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:33.451208 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de97a878-9762-409e-af83-b9bb65b33112 could not be found. Jul 28 04:05:33.451208 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.463955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f3c10b35-b81e-4260-b45c-565beb20fac3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Returning 404 to user: Instance de97a878-9762-409e-af83-b9bb65b33112 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:33.471379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4991b0c5-d972-4640-a2d4-787b04e6c201 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:33.473784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4991b0c5-d972-4640-a2d4-787b04e6c201 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:33.482672 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f3c10b35-b81e-4260-b45c-565beb20fac3 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112" status: 404 len: 111 microversion: 2.1 time: 0.134424 Jul 28 04:05:33.489909 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2863/5220] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:33 2022] GET /compute/v2.1/servers/de97a878-9762-409e-af83-b9bb65b33112 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:33.504472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c812603-ea3c-456e-a390-c1788156e212 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:33.505767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c812603-ea3c-456e-a390-c1788156e212 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:33.511768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4991b0c5-d972-4640-a2d4-787b04e6c201 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.512491 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4991b0c5-d972-4640-a2d4-787b04e6c201 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.515691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c812603-ea3c-456e-a390-c1788156e212 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.516602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c812603-ea3c-456e-a390-c1788156e212 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.516942 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4991b0c5-d972-4640-a2d4-787b04e6c201 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.517541 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4991b0c5-d972-4640-a2d4-787b04e6c201 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.518169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c812603-ea3c-456e-a390-c1788156e212 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.518844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c812603-ea3c-456e-a390-c1788156e212 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.567856 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-7c812603-ea3c-456e-a390-c1788156e212 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] HTTP exception thrown: Instance fb57b591-927c-4af5-a304-c7a48ef1d679 could not be found. Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c812603-ea3c-456e-a390-c1788156e212 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Request method failure captured: Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 HTTP/1.1 Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gpfyUNgO9c7IatnAQ3I95LlpqGTW-q2-rizQILxn_b_uQ0g0_vIv0ZKbZ89uP2S1r4KPvARkn3WGkHcNmGMBnXsg3tuwK-OkGosBiIFXDcngy4nwvSeQpi39SDIe0JByM91M2Pt1sHdCzApkyylRFFkYkn9Pg7kf3kPQKD0EVvb1yY Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 20141383097d4e2fa18337fdb001e7a2 Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/20141383097d4e2fa18337fdb001e7a2"}]}] Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 20141383097d4e2fa18337fdb001e7a2 Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerDiskConfigTestJSON-1716618450-project Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 7cf7921de39349739835f1ebd23ac77b Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerDiskConfigTestJSON-1716618450-project Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance fb57b591-927c-4af5-a304-c7a48ef1d679 could not be found. Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'fb57b591-927c-4af5-a304-c7a48ef1d679'} Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb57b591-927c-4af5-a304-c7a48ef1d679 could not be found. Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:33.571522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:33.575156 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb57b591-927c-4af5-a304-c7a48ef1d679 could not be found. Jul 28 04:05:33.575156 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.575156 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.575156 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.575156 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.575156 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.575156 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.575156 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:33.575156 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:33.575156 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb57b591-927c-4af5-a304-c7a48ef1d679 could not be found. Jul 28 04:05:33.575156 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.579275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c812603-ea3c-456e-a390-c1788156e212 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Returning 404 to user: Instance fb57b591-927c-4af5-a304-c7a48ef1d679 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:33.580902 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7c812603-ea3c-456e-a390-c1788156e212 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 404 len: 111 microversion: 2.1 time: 0.086248 Jul 28 04:05:33.601143 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2864/5221] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:33 2022] DELETE /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:33.627165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3868cc1e-b6d4-42db-8970-edd21275e940 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:33.628795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3868cc1e-b6d4-42db-8970-edd21275e940 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: fb57b591-927c-4af5-a304-c7a48ef1d679] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:33.669955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3868cc1e-b6d4-42db-8970-edd21275e940 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.670637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3868cc1e-b6d4-42db-8970-edd21275e940 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.673216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3868cc1e-b6d4-42db-8970-edd21275e940 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.675497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3868cc1e-b6d4-42db-8970-edd21275e940 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.706078 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-3868cc1e-b6d4-42db-8970-edd21275e940 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] HTTP exception thrown: Instance fb57b591-927c-4af5-a304-c7a48ef1d679 could not be found. Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3868cc1e-b6d4-42db-8970-edd21275e940 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Request method failure captured: Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 HTTP/1.1 Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gpfyUNgO9c7IatnAQ3I95LlpqGTW-q2-rizQILxn_b_uQ0g0_vIv0ZKbZ89uP2S1r4KPvARkn3WGkHcNmGMBnXsg3tuwK-OkGosBiIFXDcngy4nwvSeQpi39SDIe0JByM91M2Pt1sHdCzApkyylRFFkYkn9Pg7kf3kPQKD0EVvb1yY Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 20141383097d4e2fa18337fdb001e7a2 Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/20141383097d4e2fa18337fdb001e7a2"}]}] Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 20141383097d4e2fa18337fdb001e7a2 Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerDiskConfigTestJSON-1716618450-project Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 7cf7921de39349739835f1ebd23ac77b Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerDiskConfigTestJSON-1716618450-project Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance fb57b591-927c-4af5-a304-c7a48ef1d679 could not be found. Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'fb57b591-927c-4af5-a304-c7a48ef1d679'} Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb57b591-927c-4af5-a304-c7a48ef1d679 could not be found. Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb57b591-927c-4af5-a304-c7a48ef1d679 could not be found. Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.707923 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.712584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.712584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.712584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.712584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:33.712584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:33.712584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb57b591-927c-4af5-a304-c7a48ef1d679 could not be found. Jul 28 04:05:33.712584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.717095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3868cc1e-b6d4-42db-8970-edd21275e940 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Returning 404 to user: Instance fb57b591-927c-4af5-a304-c7a48ef1d679 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:33.718332 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3868cc1e-b6d4-42db-8970-edd21275e940 tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679" status: 404 len: 111 microversion: 2.1 time: 0.114848 Jul 28 04:05:33.719099 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2865/5222] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:33 2022] GET /compute/v2.1/servers/fb57b591-927c-4af5-a304-c7a48ef1d679 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:33.731917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66578a0e-20d7-45e8-8a8d-53ef200277dc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:33.732813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-66578a0e-20d7-45e8-8a8d-53ef200277dc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:33.742070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66578a0e-20d7-45e8-8a8d-53ef200277dc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.742849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66578a0e-20d7-45e8-8a8d-53ef200277dc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.744003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66578a0e-20d7-45e8-8a8d-53ef200277dc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.744207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66578a0e-20d7-45e8-8a8d-53ef200277dc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.778966 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-66578a0e-20d7-45e8-8a8d-53ef200277dc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] HTTP exception thrown: Instance 933e568e-aa6a-4dfa-b053-2628d1fef93b could not be found. Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66578a0e-20d7-45e8-8a8d-53ef200277dc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Request method failure captured: Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b HTTP/1.1 Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gpfyUNgO9c7IatnAQ3I95LlpqGTW-q2-rizQILxn_b_uQ0g0_vIv0ZKbZ89uP2S1r4KPvARkn3WGkHcNmGMBnXsg3tuwK-OkGosBiIFXDcngy4nwvSeQpi39SDIe0JByM91M2Pt1sHdCzApkyylRFFkYkn9Pg7kf3kPQKD0EVvb1yY Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 20141383097d4e2fa18337fdb001e7a2 Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/20141383097d4e2fa18337fdb001e7a2"}]}] Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 20141383097d4e2fa18337fdb001e7a2 Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerDiskConfigTestJSON-1716618450-project Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 7cf7921de39349739835f1ebd23ac77b Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerDiskConfigTestJSON-1716618450-project Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 933e568e-aa6a-4dfa-b053-2628d1fef93b could not be found. Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '933e568e-aa6a-4dfa-b053-2628d1fef93b'} Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 933e568e-aa6a-4dfa-b053-2628d1fef93b could not be found. Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:33.780605 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:33.785780 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 933e568e-aa6a-4dfa-b053-2628d1fef93b could not be found. Jul 28 04:05:33.785780 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.785780 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.785780 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.785780 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.785780 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.785780 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.785780 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:33.785780 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:33.785780 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 933e568e-aa6a-4dfa-b053-2628d1fef93b could not be found. Jul 28 04:05:33.785780 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.785780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66578a0e-20d7-45e8-8a8d-53ef200277dc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Returning 404 to user: Instance 933e568e-aa6a-4dfa-b053-2628d1fef93b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:33.785780 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-66578a0e-20d7-45e8-8a8d-53ef200277dc tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "DELETE /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 404 len: 111 microversion: 2.1 time: 0.057065 Jul 28 04:05:33.790538 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2866/5223] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:33 2022] DELETE /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:33.800856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3ae035fd-c442-4637-9334-2467494e169a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:33.802920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3ae035fd-c442-4637-9334-2467494e169a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] [instance: 933e568e-aa6a-4dfa-b053-2628d1fef93b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:33.811349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ae035fd-c442-4637-9334-2467494e169a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.813508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ae035fd-c442-4637-9334-2467494e169a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.815194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ae035fd-c442-4637-9334-2467494e169a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:33.820748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ae035fd-c442-4637-9334-2467494e169a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:33.848872 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-3ae035fd-c442-4637-9334-2467494e169a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] HTTP exception thrown: Instance 933e568e-aa6a-4dfa-b053-2628d1fef93b could not be found. Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3ae035fd-c442-4637-9334-2467494e169a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Request method failure captured: Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b HTTP/1.1 Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gpfyUNgO9c7IatnAQ3I95LlpqGTW-q2-rizQILxn_b_uQ0g0_vIv0ZKbZ89uP2S1r4KPvARkn3WGkHcNmGMBnXsg3tuwK-OkGosBiIFXDcngy4nwvSeQpi39SDIe0JByM91M2Pt1sHdCzApkyylRFFkYkn9Pg7kf3kPQKD0EVvb1yY Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 20141383097d4e2fa18337fdb001e7a2 Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_20141383097d4e2fa18337fdb001e7a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/20141383097d4e2fa18337fdb001e7a2"}]}] Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 20141383097d4e2fa18337fdb001e7a2 Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1716618450 Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerDiskConfigTestJSON-1716618450-project Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 7cf7921de39349739835f1ebd23ac77b Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerDiskConfigTestJSON-1716618450-project Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 933e568e-aa6a-4dfa-b053-2628d1fef93b could not be found. Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '933e568e-aa6a-4dfa-b053-2628d1fef93b'} Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 933e568e-aa6a-4dfa-b053-2628d1fef93b could not be found. Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 933e568e-aa6a-4dfa-b053-2628d1fef93b could not be found. Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:33.851820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.857258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:33.857258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:33.857258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:33.857258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:33.857258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:33.857258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 933e568e-aa6a-4dfa-b053-2628d1fef93b could not be found. Jul 28 04:05:33.857258 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:33.859681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3ae035fd-c442-4637-9334-2467494e169a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] Returning 404 to user: Instance 933e568e-aa6a-4dfa-b053-2628d1fef93b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:33.860882 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3ae035fd-c442-4637-9334-2467494e169a tempest-ServerDiskConfigTestJSON-1716618450 tempest-ServerDiskConfigTestJSON-1716618450-project] 10.222.0.48 "GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b" status: 404 len: 111 microversion: 2.1 time: 0.068738 Jul 28 04:05:33.868573 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2867/5224] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:33 2022] GET /compute/v2.1/servers/933e568e-aa6a-4dfa-b053-2628d1fef93b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:34.000776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f91731b2-34f6-43be-969e-e08537667204 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:34.001395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f91731b2-34f6-43be-969e-e08537667204 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] [instance: c01805b7-987d-4a67-934e-e173ce2d85c3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:34.009869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f91731b2-34f6-43be-969e-e08537667204 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:34.014311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f91731b2-34f6-43be-969e-e08537667204 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:34.017439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f91731b2-34f6-43be-969e-e08537667204 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:34.019445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f91731b2-34f6-43be-969e-e08537667204 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:34.063415 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-f91731b2-34f6-43be-969e-e08537667204 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] HTTP exception thrown: Instance c01805b7-987d-4a67-934e-e173ce2d85c3 could not be found. Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f91731b2-34f6-43be-969e-e08537667204 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Request method failure captured: Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 HTTP/1.1 Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gp1ewzmy6j1k1X1wm_9DXkkEuPvWF1_HOJWL5mbz4Mp4_2eRly1VZA0JMwItwOvof_q6-IxjWx_Hu6whjTIyIq3bndtTz9rNPSRMaXAjD7HIJu_9DU9AqMC58vWdJCS_H8vdN_xWlj6ATIO3opL2A8i3E-aAjuryfmEqFARq_3hYpo Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 031d396edf334c0280e3d5ecc2270b7b Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-VolumesBackupsTest-446878240 Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/031d396edf334c0280e3d5ecc2270b7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/031d396edf334c0280e3d5ecc2270b7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_031d396edf334c0280e3d5ecc2270b7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/031d396edf334c0280e3d5ecc2270b7b"}]}] Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-VolumesBackupsTest-446878240 Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 031d396edf334c0280e3d5ecc2270b7b Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-VolumesBackupsTest-446878240 Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-VolumesBackupsTest-446878240-project Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 1908fee100354163ae1da54e7f2a5319 Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-VolumesBackupsTest-446878240-project Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c01805b7-987d-4a67-934e-e173ce2d85c3 could not be found. Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c01805b7-987d-4a67-934e-e173ce2d85c3'} Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c01805b7-987d-4a67-934e-e173ce2d85c3 could not be found. Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c01805b7-987d-4a67-934e-e173ce2d85c3 could not be found. Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:34.066942 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:34.071022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:34.071022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:34.071022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:34.071022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:34.071022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:34.071022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c01805b7-987d-4a67-934e-e173ce2d85c3 could not be found. Jul 28 04:05:34.071022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:05:34.071022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f91731b2-34f6-43be-969e-e08537667204 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] Returning 404 to user: Instance c01805b7-987d-4a67-934e-e173ce2d85c3 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:34.071022 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f91731b2-34f6-43be-969e-e08537667204 tempest-VolumesBackupsTest-446878240 tempest-VolumesBackupsTest-446878240-project] 10.222.0.48 "GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3" status: 404 len: 111 microversion: 2.1 time: 0.072824 Jul 28 04:05:34.073771 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2868/5225] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:33 2022] GET /compute/v2.1/servers/c01805b7-987d-4a67-934e-e173ce2d85c3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:05:34.782257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3f3ef3a6-d0fd-4cba-a80e-8a5dcf84a52c req-2b1e753c-797a-400f-a81a-d11573f046fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01805b7-987d-4a67-934e-e173ce2d85c3", "name": "network-vif-deleted", "tag": "fbb5cf86-d9f0-4020-8085-0e1c998ac852"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:34.802399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3f3ef3a6-d0fd-4cba-a80e-8a5dcf84a52c req-2b1e753c-797a-400f-a81a-d11573f046fa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:34.802880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3f3ef3a6-d0fd-4cba-a80e-8a5dcf84a52c req-2b1e753c-797a-400f-a81a-d11573f046fa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:34.807524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4991b0c5-d972-4640-a2d4-787b04e6c201 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:34.822909 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4991b0c5-d972-4640-a2d4-787b04e6c201 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1322 microversion: 2.1 time: 1.354706 Jul 28 04:05:34.825573 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3f3ef3a6-d0fd-4cba-a80e-8a5dcf84a52c req-2b1e753c-797a-400f-a81a-d11573f046fa service nova] Creating event network-vif-deleted:fbb5cf86-d9f0-4020-8085-0e1c998ac852 for instance c01805b7-987d-4a67-934e-e173ce2d85c3 on n-h2-826756-3 Jul 28 04:05:34.825696 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2358/5226] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:33 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1322 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:05:34.832211 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3f3ef3a6-d0fd-4cba-a80e-8a5dcf84a52c req-2b1e753c-797a-400f-a81a-d11573f046fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053530 Jul 28 04:05:34.833451 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2869/5227] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:05:35.854900 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1390628f-c9b6-4570-9ec3-571ed16ff08e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:35.861097 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1390628f-c9b6-4570-9ec3-571ed16ff08e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:35.875268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1390628f-c9b6-4570-9ec3-571ed16ff08e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:35.876016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1390628f-c9b6-4570-9ec3-571ed16ff08e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:35.879408 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1390628f-c9b6-4570-9ec3-571ed16ff08e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:35.880035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1390628f-c9b6-4570-9ec3-571ed16ff08e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:36.788210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1390628f-c9b6-4570-9ec3-571ed16ff08e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:36.798488 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1390628f-c9b6-4570-9ec3-571ed16ff08e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1322 microversion: 2.1 time: 0.953528 Jul 28 04:05:36.800658 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2359/5228] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:35 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1322 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:37.829363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cda65666-4466-40a4-af82-35eeb8c36858 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:37.830108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cda65666-4466-40a4-af82-35eeb8c36858 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:37.850211 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-91f8af20-c4fc-4439-9be0-f8bc8f4b1eff req-c7d4d9e8-8aa5-4e4f-8f1c-1a8841b04c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97", "tag": "75ef116f-f70a-4789-ae0e-6b7650f6d3f3"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:37.871828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cda65666-4466-40a4-af82-35eeb8c36858 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:37.874620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cda65666-4466-40a4-af82-35eeb8c36858 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:37.884108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cda65666-4466-40a4-af82-35eeb8c36858 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:37.884627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cda65666-4466-40a4-af82-35eeb8c36858 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:37.894374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-91f8af20-c4fc-4439-9be0-f8bc8f4b1eff req-c7d4d9e8-8aa5-4e4f-8f1c-1a8841b04c0c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:37.894842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-91f8af20-c4fc-4439-9be0-f8bc8f4b1eff req-c7d4d9e8-8aa5-4e4f-8f1c-1a8841b04c0c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:37.949444 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-91f8af20-c4fc-4439-9be0-f8bc8f4b1eff req-c7d4d9e8-8aa5-4e4f-8f1c-1a8841b04c0c service nova] Creating event network-changed:75ef116f-f70a-4789-ae0e-6b7650f6d3f3 for instance d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 on n-h2-826756-3 Jul 28 04:05:37.962602 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-91f8af20-c4fc-4439-9be0-f8bc8f4b1eff req-c7d4d9e8-8aa5-4e4f-8f1c-1a8841b04c0c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117632 Jul 28 04:05:37.965058 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2360/5229] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:05:38.383556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cda65666-4466-40a4-af82-35eeb8c36858 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:38.397491 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cda65666-4466-40a4-af82-35eeb8c36858 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1322 microversion: 2.1 time: 0.576467 Jul 28 04:05:38.398090 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2870/5230] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:37 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1322 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:39.424653 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:39.449150 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8bbdd836-6502-4942-a463-a263c2273218 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:39.452896 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8bbdd836-6502-4942-a463-a263c2273218 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:39.478836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bbdd836-6502-4942-a463-a263c2273218 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:39.482889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bbdd836-6502-4942-a463-a263c2273218 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:39.485906 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bbdd836-6502-4942-a463-a263c2273218 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:39.490284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8bbdd836-6502-4942-a463-a263c2273218 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:39.757653 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=8 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:40.457705 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8bbdd836-6502-4942-a463-a263c2273218 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:40.462860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=76 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:40.470856 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8bbdd836-6502-4942-a463-a263c2273218 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1322 microversion: 2.1 time: 1.053266 Jul 28 04:05:40.472582 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2361/5231] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:39 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1322 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:41.492575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7f3426bc-6849-4c96-a0fa-8f7682556756 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:41.493206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7f3426bc-6849-4c96-a0fa-8f7682556756 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:41.522904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f3426bc-6849-4c96-a0fa-8f7682556756 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:41.527206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f3426bc-6849-4c96-a0fa-8f7682556756 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:41.533014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f3426bc-6849-4c96-a0fa-8f7682556756 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:41.533715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f3426bc-6849-4c96-a0fa-8f7682556756 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:42.148052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7f3426bc-6849-4c96-a0fa-8f7682556756 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:42.165323 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7f3426bc-6849-4c96-a0fa-8f7682556756 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1322 microversion: 2.1 time: 0.673418 Jul 28 04:05:42.166012 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2871/5232] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:41 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1322 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:43.189647 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-db86ca2f-a0a0-4332-a363-859f05fde694 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:43.190438 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-db86ca2f-a0a0-4332-a363-859f05fde694 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:43.205572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db86ca2f-a0a0-4332-a363-859f05fde694 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:43.213466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db86ca2f-a0a0-4332-a363-859f05fde694 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:43.216953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db86ca2f-a0a0-4332-a363-859f05fde694 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:43.217680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-db86ca2f-a0a0-4332-a363-859f05fde694 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:43.960971 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-db86ca2f-a0a0-4332-a363-859f05fde694 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:43.978309 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-db86ca2f-a0a0-4332-a363-859f05fde694 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1322 microversion: 2.1 time: 0.793058 Jul 28 04:05:43.983439 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2362/5233] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:43 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1322 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:05:45.003508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-25b40559-8b08-4c23-aa53-9cba595298d9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:45.004127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-25b40559-8b08-4c23-aa53-9cba595298d9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:45.025103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25b40559-8b08-4c23-aa53-9cba595298d9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:45.025640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25b40559-8b08-4c23-aa53-9cba595298d9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:45.026507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25b40559-8b08-4c23-aa53-9cba595298d9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:45.026931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25b40559-8b08-4c23-aa53-9cba595298d9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:45.599715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-25b40559-8b08-4c23-aa53-9cba595298d9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:45.610129 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-25b40559-8b08-4c23-aa53-9cba595298d9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1322 microversion: 2.1 time: 0.610712 Jul 28 04:05:45.620688 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2872/5234] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:44 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1322 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:46.636315 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4bf4b21a-37f5-4235-8c75-5402624163d5 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:46.636984 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4bf4b21a-37f5-4235-8c75-5402624163d5 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:46.648125 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bf4b21a-37f5-4235-8c75-5402624163d5 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:46.654446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bf4b21a-37f5-4235-8c75-5402624163d5 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:46.655521 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bf4b21a-37f5-4235-8c75-5402624163d5 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:46.656113 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4bf4b21a-37f5-4235-8c75-5402624163d5 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:47.180656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d2f15e66-3258-4a43-bdf7-de96632411fe req-10bdfe79-83f0-40cd-90ce-9e19d126a1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97", "name": "network-vif-plugged", "status": "completed", "tag": "75ef116f-f70a-4789-ae0e-6b7650f6d3f3"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:47.226423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d2f15e66-3258-4a43-bdf7-de96632411fe req-10bdfe79-83f0-40cd-90ce-9e19d126a1aa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:47.227877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d2f15e66-3258-4a43-bdf7-de96632411fe req-10bdfe79-83f0-40cd-90ce-9e19d126a1aa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:47.252593 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-d2f15e66-3258-4a43-bdf7-de96632411fe req-10bdfe79-83f0-40cd-90ce-9e19d126a1aa service nova] Creating event network-vif-plugged:75ef116f-f70a-4789-ae0e-6b7650f6d3f3 for instance d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 on n-h2-826756-3 Jul 28 04:05:47.270518 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d2f15e66-3258-4a43-bdf7-de96632411fe req-10bdfe79-83f0-40cd-90ce-9e19d126a1aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094293 Jul 28 04:05:47.274679 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2873/5235] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:47.762460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4bf4b21a-37f5-4235-8c75-5402624163d5 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:47.774471 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4bf4b21a-37f5-4235-8c75-5402624163d5 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1322 microversion: 2.1 time: 1.143004 Jul 28 04:05:47.777222 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2363/5236] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:46 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1322 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:48.799069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4abab9f-ed24-4726-88b1-105014dc44d4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:48.799817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4abab9f-ed24-4726-88b1-105014dc44d4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:48.812041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4abab9f-ed24-4726-88b1-105014dc44d4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:48.813362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4abab9f-ed24-4726-88b1-105014dc44d4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:48.818669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4abab9f-ed24-4726-88b1-105014dc44d4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:48.820036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4abab9f-ed24-4726-88b1-105014dc44d4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:49.110348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a4abab9f-ed24-4726-88b1-105014dc44d4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:49.126968 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4abab9f-ed24-4726-88b1-105014dc44d4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1322 microversion: 2.1 time: 0.333153 Jul 28 04:05:49.145077 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2874/5237] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:48 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:50.151519 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-6623b6ed-13bd-4349-a430-9629e665613c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:50.152762 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-6623b6ed-13bd-4349-a430-9629e665613c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:50.172072 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6623b6ed-13bd-4349-a430-9629e665613c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:50.172777 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6623b6ed-13bd-4349-a430-9629e665613c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:50.173813 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6623b6ed-13bd-4349-a430-9629e665613c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:50.174415 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-6623b6ed-13bd-4349-a430-9629e665613c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:50.551065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-6623b6ed-13bd-4349-a430-9629e665613c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:50.561538 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-6623b6ed-13bd-4349-a430-9629e665613c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1518 microversion: 2.1 time: 0.414158 Jul 28 04:05:50.562466 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2364/5238] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:50 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1518 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:50.589254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca260d7f-a667-40cd-865f-7ab0d56cb9b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:50.592187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca260d7f-a667-40cd-865f-7ab0d56cb9b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:50.609225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca260d7f-a667-40cd-865f-7ab0d56cb9b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:50.611550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca260d7f-a667-40cd-865f-7ab0d56cb9b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:50.615060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca260d7f-a667-40cd-865f-7ab0d56cb9b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:50.615687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca260d7f-a667-40cd-865f-7ab0d56cb9b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:50.646063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-ca260d7f-a667-40cd-865f-7ab0d56cb9b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lazy-loading 'flavor' on Instance uuid d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:05:50.649247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:50.774993 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca260d7f-a667-40cd-865f-7ab0d56cb9b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "POST /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97/action" status: 200 len: 32 microversion: 2.1 time: 0.191705 Jul 28 04:05:50.776675 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2875/5239] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:05:50 2022] POST /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:05:50.786686 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2ad0d191-e4a4-46ac-9b76-3672c6292057 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:50.788342 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2ad0d191-e4a4-46ac-9b76-3672c6292057 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:50.800439 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ad0d191-e4a4-46ac-9b76-3672c6292057 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:50.803290 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ad0d191-e4a4-46ac-9b76-3672c6292057 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:50.806425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ad0d191-e4a4-46ac-9b76-3672c6292057 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:50.808154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2ad0d191-e4a4-46ac-9b76-3672c6292057 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:51.922637 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2ad0d191-e4a4-46ac-9b76-3672c6292057 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:51.931573 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2ad0d191-e4a4-46ac-9b76-3672c6292057 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 1.148946 Jul 28 04:05:51.945262 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2365/5240] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:50 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:05:52.957255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ea0db3a-17dc-450e-9cc5-7d7bd6efbf01 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:52.958131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5ea0db3a-17dc-450e-9cc5-7d7bd6efbf01 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:53.014703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ea0db3a-17dc-450e-9cc5-7d7bd6efbf01 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:53.019600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ea0db3a-17dc-450e-9cc5-7d7bd6efbf01 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:53.021010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ea0db3a-17dc-450e-9cc5-7d7bd6efbf01 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:53.027204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ea0db3a-17dc-450e-9cc5-7d7bd6efbf01 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:53.988911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ea0db3a-17dc-450e-9cc5-7d7bd6efbf01 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:54.009008 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ea0db3a-17dc-450e-9cc5-7d7bd6efbf01 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 1.058517 Jul 28 04:05:54.017031 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2876/5241] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:52 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:55.039889 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5e29c59e-250e-43ba-acd6-c0bf4b685dab tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:55.042755 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5e29c59e-250e-43ba-acd6-c0bf4b685dab tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:55.081365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:55.083702 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e29c59e-250e-43ba-acd6-c0bf4b685dab tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:55.084166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e29c59e-250e-43ba-acd6-c0bf4b685dab tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:55.085354 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e29c59e-250e-43ba-acd6-c0bf4b685dab tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:55.086109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5e29c59e-250e-43ba-acd6-c0bf4b685dab tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:55.822536 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5e29c59e-250e-43ba-acd6-c0bf4b685dab tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:55.839759 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5e29c59e-250e-43ba-acd6-c0bf4b685dab tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 0.803715 Jul 28 04:05:55.840815 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2366/5242] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:55 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:56.863291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7ee11d8e-50a5-4f0f-be29-eeb5fd8954dd tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:56.863904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7ee11d8e-50a5-4f0f-be29-eeb5fd8954dd tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:56.866855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:56.893742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ee11d8e-50a5-4f0f-be29-eeb5fd8954dd tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:56.894553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ee11d8e-50a5-4f0f-be29-eeb5fd8954dd tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:56.895585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ee11d8e-50a5-4f0f-be29-eeb5fd8954dd tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:56.901248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ee11d8e-50a5-4f0f-be29-eeb5fd8954dd tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:57.458644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7ee11d8e-50a5-4f0f-be29-eeb5fd8954dd tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:57.472334 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7ee11d8e-50a5-4f0f-be29-eeb5fd8954dd tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 0.612862 Jul 28 04:05:57.472967 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2877/5243] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:56 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:58.496953 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4a87560c-bf8f-45a3-8a1f-810fc8b8a915 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:58.497612 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4a87560c-bf8f-45a3-8a1f-810fc8b8a915 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:05:58.515809 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a87560c-bf8f-45a3-8a1f-810fc8b8a915 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:58.516340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a87560c-bf8f-45a3-8a1f-810fc8b8a915 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:58.517181 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a87560c-bf8f-45a3-8a1f-810fc8b8a915 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:58.517626 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4a87560c-bf8f-45a3-8a1f-810fc8b8a915 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:58.966527 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-4a87560c-bf8f-45a3-8a1f-810fc8b8a915 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:58.985447 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4a87560c-bf8f-45a3-8a1f-810fc8b8a915 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 0.492525 Jul 28 04:05:58.990809 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2367/5244] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:58 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:00.013960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ff57a9d-b2a4-4f3a-9fe0-c77957620c0a tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:00.015198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ff57a9d-b2a4-4f3a-9fe0-c77957620c0a tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:00.027680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ff57a9d-b2a4-4f3a-9fe0-c77957620c0a tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:00.032647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ff57a9d-b2a4-4f3a-9fe0-c77957620c0a tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:00.033899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ff57a9d-b2a4-4f3a-9fe0-c77957620c0a tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:00.034558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ff57a9d-b2a4-4f3a-9fe0-c77957620c0a tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:01.037670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ff57a9d-b2a4-4f3a-9fe0-c77957620c0a tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:01.048471 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ff57a9d-b2a4-4f3a-9fe0-c77957620c0a tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 1.038945 Jul 28 04:06:01.049691 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2878/5245] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:00 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:01.056216 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1489260411", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "7e853db1-8bab-46f4-9604-3cdbd1f58cd5"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:01.166081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] validate_networks() for [('7e853db1-8bab-46f4-9604-3cdbd1f58cd5', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:06:01.969786 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:06:01.970567 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:06:01.971064 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:06:01.971481 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:06:01.971897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:06:02.001102 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:02.001928 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:02.005772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:02.006270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:02.049493 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Getting quotas for project 08d5b539932d47eea095700153dba311. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:06:02.058327 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Getting quotas for user 7a0acf76d0e149b1998d37062801b1c7 and project 08d5b539932d47eea095700153dba311. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:06:02.074704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62468095-e59a-441f-a639-d6ec48fc5797 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:02.076084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-62468095-e59a-441f-a639-d6ec48fc5797 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:02.096803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62468095-e59a-441f-a639-d6ec48fc5797 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:02.100252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62468095-e59a-441f-a639-d6ec48fc5797 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:02.101128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62468095-e59a-441f-a639-d6ec48fc5797 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:02.104769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62468095-e59a-441f-a639-d6ec48fc5797 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:02.106564 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:06:02.112868 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:06:02.269400 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-f7144468-f74f-4268-a6a8-6ec757920642 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.479190 Jul 28 04:06:02.283937 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2368/5246] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:06:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:06:02.308726 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-793668b0-43ff-4129-a3d5-993d7a249ad6 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:02.310248 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-793668b0-43ff-4129-a3d5-993d7a249ad6 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:02.482357 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-793668b0-43ff-4129-a3d5-993d7a249ad6 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0acf76d0e149b1998d37062801b1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5b539932d47eea095700153dba311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:02.493211 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-793668b0-43ff-4129-a3d5-993d7a249ad6 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 200 len: 1225 microversion: 2.1 time: 0.196985 Jul 28 04:06:02.493745 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2369/5247] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:02 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 1225 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:03.339023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62468095-e59a-441f-a639-d6ec48fc5797 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:03.361904 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-62468095-e59a-441f-a639-d6ec48fc5797 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 1.292729 Jul 28 04:06:03.365511 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2879/5248] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:02 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:03.515646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-828fb27e-42e9-4e08-a76d-82a4de722e7c tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:03.516377 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-828fb27e-42e9-4e08-a76d-82a4de722e7c tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:03.816250 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-828fb27e-42e9-4e08-a76d-82a4de722e7c tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0acf76d0e149b1998d37062801b1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5b539932d47eea095700153dba311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:03.824224 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-828fb27e-42e9-4e08-a76d-82a4de722e7c tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 200 len: 1225 microversion: 2.1 time: 0.312708 Jul 28 04:06:03.835999 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2370/5249] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:03 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 1225 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:04.395034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-491c9f57-8b4c-456c-9385-96da487aa134 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:04.396708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-491c9f57-8b4c-456c-9385-96da487aa134 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:04.404059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-491c9f57-8b4c-456c-9385-96da487aa134 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:04.405851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-491c9f57-8b4c-456c-9385-96da487aa134 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:04.406702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-491c9f57-8b4c-456c-9385-96da487aa134 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:04.406702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-491c9f57-8b4c-456c-9385-96da487aa134 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:04.870235 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-24a4160f-a956-4242-9aa9-eea7684499b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:04.871711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-24a4160f-a956-4242-9aa9-eea7684499b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:04.892667 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24a4160f-a956-4242-9aa9-eea7684499b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:04.902723 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24a4160f-a956-4242-9aa9-eea7684499b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:04.905913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24a4160f-a956-4242-9aa9-eea7684499b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:04.907258 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24a4160f-a956-4242-9aa9-eea7684499b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:05.179215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-24a4160f-a956-4242-9aa9-eea7684499b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0acf76d0e149b1998d37062801b1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5b539932d47eea095700153dba311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:05.194638 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-24a4160f-a956-4242-9aa9-eea7684499b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 200 len: 1285 microversion: 2.1 time: 0.336553 Jul 28 04:06:05.208753 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2371/5250] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:04 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 1285 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:06.217496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fe19fe57-1549-42de-b11f-3c0dfe126bde tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:06.221399 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fe19fe57-1549-42de-b11f-3c0dfe126bde tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:06.253659 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe19fe57-1549-42de-b11f-3c0dfe126bde tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:06.256908 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe19fe57-1549-42de-b11f-3c0dfe126bde tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:06.259290 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe19fe57-1549-42de-b11f-3c0dfe126bde tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:06.262297 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fe19fe57-1549-42de-b11f-3c0dfe126bde tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:06.763094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-491c9f57-8b4c-456c-9385-96da487aa134 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:06.772309 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-491c9f57-8b4c-456c-9385-96da487aa134 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 2.381146 Jul 28 04:06:06.778223 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2880/5251] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:04 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 2388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:07.391829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-fe19fe57-1549-42de-b11f-3c0dfe126bde tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0acf76d0e149b1998d37062801b1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5b539932d47eea095700153dba311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:07.399894 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fe19fe57-1549-42de-b11f-3c0dfe126bde tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 200 len: 1325 microversion: 2.1 time: 1.187329 Jul 28 04:06:07.417623 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2372/5252] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:06 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 1325 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:07.804575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aced5106-d3e0-4bda-8d7f-8bdef1d85412 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:07.805180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aced5106-d3e0-4bda-8d7f-8bdef1d85412 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:07.816833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aced5106-d3e0-4bda-8d7f-8bdef1d85412 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:07.817289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aced5106-d3e0-4bda-8d7f-8bdef1d85412 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:07.818091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aced5106-d3e0-4bda-8d7f-8bdef1d85412 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:07.818536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aced5106-d3e0-4bda-8d7f-8bdef1d85412 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:08.443512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1556987e-c19c-431c-a230-8068997a6e7f tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:08.444126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1556987e-c19c-431c-a230-8068997a6e7f tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:08.465639 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1556987e-c19c-431c-a230-8068997a6e7f tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:08.467924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1556987e-c19c-431c-a230-8068997a6e7f tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:08.470060 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1556987e-c19c-431c-a230-8068997a6e7f tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:08.471237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1556987e-c19c-431c-a230-8068997a6e7f tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:09.030093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aced5106-d3e0-4bda-8d7f-8bdef1d85412 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:09.039984 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aced5106-d3e0-4bda-8d7f-8bdef1d85412 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 1.239613 Jul 28 04:06:09.069724 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2881/5253] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:07 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:09.302836 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1556987e-c19c-431c-a230-8068997a6e7f tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0acf76d0e149b1998d37062801b1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5b539932d47eea095700153dba311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:09.351029 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1556987e-c19c-431c-a230-8068997a6e7f tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 200 len: 1325 microversion: 2.1 time: 0.905393 Jul 28 04:06:09.367615 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2373/5254] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:08 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 1325 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:10.065531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b47765f7-fd91-4563-bdbf-7c246119ae6d req-df2538a5-30dc-4d65-bef1-3c9345f70802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c61aa174-e1e4-4ee9-b135-3d32e57a7495", "tag": "49974d47-6ac9-4f11-ac4f-6a8a530ed585"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:10.083217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-beed3011-570f-4199-abeb-771ffc78e354 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:10.084577 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-beed3011-570f-4199-abeb-771ffc78e354 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:10.097350 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-beed3011-570f-4199-abeb-771ffc78e354 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:10.097790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b47765f7-fd91-4563-bdbf-7c246119ae6d req-df2538a5-30dc-4d65-bef1-3c9345f70802 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:10.098922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b47765f7-fd91-4563-bdbf-7c246119ae6d req-df2538a5-30dc-4d65-bef1-3c9345f70802 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:10.099420 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-beed3011-570f-4199-abeb-771ffc78e354 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:10.100303 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-beed3011-570f-4199-abeb-771ffc78e354 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:10.104834 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-beed3011-570f-4199-abeb-771ffc78e354 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:10.157263 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b47765f7-fd91-4563-bdbf-7c246119ae6d req-df2538a5-30dc-4d65-bef1-3c9345f70802 service nova] Creating event network-changed:49974d47-6ac9-4f11-ac4f-6a8a530ed585 for instance c61aa174-e1e4-4ee9-b135-3d32e57a7495 on n-h1-826756-3 Jul 28 04:06:10.164415 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b47765f7-fd91-4563-bdbf-7c246119ae6d req-df2538a5-30dc-4d65-bef1-3c9345f70802 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.428169 Jul 28 04:06:10.165223 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2882/5255] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:10.374992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fda9ae29-0717-49f0-a97c-ef209a7fe9dd tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:10.376016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fda9ae29-0717-49f0-a97c-ef209a7fe9dd tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:10.388702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fda9ae29-0717-49f0-a97c-ef209a7fe9dd tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:10.395635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fda9ae29-0717-49f0-a97c-ef209a7fe9dd tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:10.396705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fda9ae29-0717-49f0-a97c-ef209a7fe9dd tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:10.397466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fda9ae29-0717-49f0-a97c-ef209a7fe9dd tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:11.003691 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-beed3011-570f-4199-abeb-771ffc78e354 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:11.006232 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-beed3011-570f-4199-abeb-771ffc78e354 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 0.927647 Jul 28 04:06:11.006842 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2374/5256] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:10 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:11.095596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fda9ae29-0717-49f0-a97c-ef209a7fe9dd tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0acf76d0e149b1998d37062801b1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5b539932d47eea095700153dba311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:11.119501 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fda9ae29-0717-49f0-a97c-ef209a7fe9dd tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 200 len: 1325 microversion: 2.1 time: 0.738103 Jul 28 04:06:11.125954 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2883/5257] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:10 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 1325 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:12.031370 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2da602a7-f70f-4c96-bf60-7fe5d5dff34c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:12.035776 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2da602a7-f70f-4c96-bf60-7fe5d5dff34c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:12.063043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:12.069483 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2da602a7-f70f-4c96-bf60-7fe5d5dff34c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:12.070828 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2da602a7-f70f-4c96-bf60-7fe5d5dff34c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:12.074452 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2da602a7-f70f-4c96-bf60-7fe5d5dff34c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:12.076656 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2da602a7-f70f-4c96-bf60-7fe5d5dff34c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:12.167620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df3c629f-661e-4800-92f8-da6ac3f0b1d0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:12.168248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-df3c629f-661e-4800-92f8-da6ac3f0b1d0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:12.180300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df3c629f-661e-4800-92f8-da6ac3f0b1d0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:12.188975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df3c629f-661e-4800-92f8-da6ac3f0b1d0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:12.189852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df3c629f-661e-4800-92f8-da6ac3f0b1d0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:12.190297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df3c629f-661e-4800-92f8-da6ac3f0b1d0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:12.702441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-df3c629f-661e-4800-92f8-da6ac3f0b1d0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0acf76d0e149b1998d37062801b1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5b539932d47eea095700153dba311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:12.711750 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-df3c629f-661e-4800-92f8-da6ac3f0b1d0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 200 len: 1325 microversion: 2.1 time: 0.548031 Jul 28 04:06:12.721454 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2884/5258] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:12 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 1325 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:12.943180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2da602a7-f70f-4c96-bf60-7fe5d5dff34c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:12.952771 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2da602a7-f70f-4c96-bf60-7fe5d5dff34c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 0.925296 Jul 28 04:06:12.970961 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2375/5259] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:12 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:13.744822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93289551-9331-4d3e-9f9c-1ebd22c87e9c tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:13.745452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93289551-9331-4d3e-9f9c-1ebd22c87e9c tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:13.774033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93289551-9331-4d3e-9f9c-1ebd22c87e9c tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:13.774624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93289551-9331-4d3e-9f9c-1ebd22c87e9c tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:13.775477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93289551-9331-4d3e-9f9c-1ebd22c87e9c tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:13.775948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93289551-9331-4d3e-9f9c-1ebd22c87e9c tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:13.977993 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3e24c84b-7541-41f4-abd3-b10c83ed709d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:13.978807 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3e24c84b-7541-41f4-abd3-b10c83ed709d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:13.986864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=10 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:13.991324 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e24c84b-7541-41f4-abd3-b10c83ed709d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:14.000040 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e24c84b-7541-41f4-abd3-b10c83ed709d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:14.001119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e24c84b-7541-41f4-abd3-b10c83ed709d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:14.001680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e24c84b-7541-41f4-abd3-b10c83ed709d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:14.005569 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=70 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:14.507068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93289551-9331-4d3e-9f9c-1ebd22c87e9c tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0acf76d0e149b1998d37062801b1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5b539932d47eea095700153dba311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:14.520217 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93289551-9331-4d3e-9f9c-1ebd22c87e9c tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 200 len: 1325 microversion: 2.1 time: 0.779320 Jul 28 04:06:14.524482 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2885/5260] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:13 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 1325 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:14.706365 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3e24c84b-7541-41f4-abd3-b10c83ed709d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:14.715829 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3e24c84b-7541-41f4-abd3-b10c83ed709d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 0.742061 Jul 28 04:06:14.728225 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2376/5261] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:13 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:15.544642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bf3fbe9f-b07c-4291-9379-86c71cb44bba tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:15.546576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bf3fbe9f-b07c-4291-9379-86c71cb44bba tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:15.553320 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-9e7e0017-b537-491d-bb65-6de8d9160ffc req-34234d4e-ca3b-4b6d-ba19-6881d25e49f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61aa174-e1e4-4ee9-b135-3d32e57a7495", "name": "network-vif-plugged", "status": "completed", "tag": "49974d47-6ac9-4f11-ac4f-6a8a530ed585"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:15.559530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf3fbe9f-b07c-4291-9379-86c71cb44bba tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:15.560140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf3fbe9f-b07c-4291-9379-86c71cb44bba tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:15.561004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf3fbe9f-b07c-4291-9379-86c71cb44bba tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:15.561463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf3fbe9f-b07c-4291-9379-86c71cb44bba tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:15.578204 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9e7e0017-b537-491d-bb65-6de8d9160ffc req-34234d4e-ca3b-4b6d-ba19-6881d25e49f8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:15.578710 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-9e7e0017-b537-491d-bb65-6de8d9160ffc req-34234d4e-ca3b-4b6d-ba19-6881d25e49f8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:15.665771 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-9e7e0017-b537-491d-bb65-6de8d9160ffc req-34234d4e-ca3b-4b6d-ba19-6881d25e49f8 service nova] Creating event network-vif-plugged:49974d47-6ac9-4f11-ac4f-6a8a530ed585 for instance c61aa174-e1e4-4ee9-b135-3d32e57a7495 on n-h1-826756-3 Jul 28 04:06:15.680821 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-9e7e0017-b537-491d-bb65-6de8d9160ffc req-34234d4e-ca3b-4b6d-ba19-6881d25e49f8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133500 Jul 28 04:06:15.681591 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2377/5262] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:15.751599 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c9e0011e-d448-414d-8659-62dda1be7220 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:15.752312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c9e0011e-d448-414d-8659-62dda1be7220 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:15.773392 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9e0011e-d448-414d-8659-62dda1be7220 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:15.773973 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9e0011e-d448-414d-8659-62dda1be7220 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:15.793572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9e0011e-d448-414d-8659-62dda1be7220 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:15.794029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9e0011e-d448-414d-8659-62dda1be7220 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:16.201044 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c9e0011e-d448-414d-8659-62dda1be7220 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:16.215124 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c9e0011e-d448-414d-8659-62dda1be7220 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 0.464937 Jul 28 04:06:16.216715 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2378/5263] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:15 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:16.390407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bf3fbe9f-b07c-4291-9379-86c71cb44bba tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0acf76d0e149b1998d37062801b1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5b539932d47eea095700153dba311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:16.399272 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bf3fbe9f-b07c-4291-9379-86c71cb44bba tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 200 len: 1325 microversion: 2.1 time: 0.859369 Jul 28 04:06:16.405803 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2886/5264] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:15 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 1325 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:17.241059 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-28f803cb-7eaa-4035-af09-3b689d8edcb4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:17.242611 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-28f803cb-7eaa-4035-af09-3b689d8edcb4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:17.262081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-28f803cb-7eaa-4035-af09-3b689d8edcb4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:17.284380 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-28f803cb-7eaa-4035-af09-3b689d8edcb4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:17.285312 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-28f803cb-7eaa-4035-af09-3b689d8edcb4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:17.285746 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-28f803cb-7eaa-4035-af09-3b689d8edcb4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:17.427646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2a4e55dd-8b18-4eca-ac6a-887736ec5850 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:17.428280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2a4e55dd-8b18-4eca-ac6a-887736ec5850 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:17.452481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a4e55dd-8b18-4eca-ac6a-887736ec5850 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:17.454100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a4e55dd-8b18-4eca-ac6a-887736ec5850 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:17.461336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a4e55dd-8b18-4eca-ac6a-887736ec5850 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:17.461791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a4e55dd-8b18-4eca-ac6a-887736ec5850 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:17.839552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2a4e55dd-8b18-4eca-ac6a-887736ec5850 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0acf76d0e149b1998d37062801b1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5b539932d47eea095700153dba311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:17.847651 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2a4e55dd-8b18-4eca-ac6a-887736ec5850 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 200 len: 1523 microversion: 2.1 time: 0.424652 Jul 28 04:06:17.860803 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2887/5265] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:17 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 1523 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:17.871533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c0a8d1ff-5c61-4e4f-8f92-ac52e80eeee4 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:17.872586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c0a8d1ff-5c61-4e4f-8f92-ac52e80eeee4 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:17.879136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c0a8d1ff-5c61-4e4f-8f92-ac52e80eeee4 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:17.886768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-28f803cb-7eaa-4035-af09-3b689d8edcb4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:17.895857 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-28f803cb-7eaa-4035-af09-3b689d8edcb4 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 0.658623 Jul 28 04:06:17.896477 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2379/5266] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:17 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:17.897281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c0a8d1ff-5c61-4e4f-8f92-ac52e80eeee4 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:17.899473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c0a8d1ff-5c61-4e4f-8f92-ac52e80eeee4 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:17.903028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c0a8d1ff-5c61-4e4f-8f92-ac52e80eeee4 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:17.974848 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-c0a8d1ff-5c61-4e4f-8f92-ac52e80eeee4 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] HTTP exception thrown: Action 999 not found Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c0a8d1ff-5c61-4e4f-8f92-ac52e80eeee4 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Request method failure captured: Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495/os-instance-actions/999 HTTP/1.1 Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gsoJZRqq3TKBqdARsrU4OtqyAsRAHwHiPvidFbEFfe_75EGYQmfagAqZvgTh1IRnwf4DaBsW03ZczSn-_Xv1j_d3M7-YXM5l63fXqd3wwfadOTCeW-9-tJuBlt1LuCMGWzGYVUuSnLM1N1iA8Dl9Ue3AgYuZWOxvqHcc5rwDM_4wlc Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 08d5b539932d47eea095700153dba311 Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-131272274 Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/08d5b539932d47eea095700153dba311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/08d5b539932d47eea095700153dba311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_08d5b539932d47eea095700153dba311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/08d5b539932d47eea095700153dba311"}]}] Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-131272274 Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 08d5b539932d47eea095700153dba311 Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-131272274 Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-InstanceActionsNegativeTestJSON-131272274-project Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 7a0acf76d0e149b1998d37062801b1c7 Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-131272274-project Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: exception: Action 999 not found Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': 'c61aa174-e1e4-4ee9-b135-3d32e57a7495', 'id': '999'} Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 28 04:06:17.986050 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:06:17.990918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c0a8d1ff-5c61-4e4f-8f92-ac52e80eeee4 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Returning 404 to user: Action 999 not found {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:17.991945 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c0a8d1ff-5c61-4e4f-8f92-ac52e80eeee4 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.125182 Jul 28 04:06:17.993662 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2888/5267] 10.222.0.48 () {58 vars in 1308 bytes} [Thu Jul 28 04:06:17 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495/os-instance-actions/999 => generated 66 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 04:06:18.004677 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b668dc98-7071-45f7-bb5c-b71ae4c6e143 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '.version_select at 0x7ffa749dbee0>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:18.005419 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b668dc98-7071-45f7-bb5c-b71ae4c6e143 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: 826f6ca1-23f8-43b6-ba69-a0d1ff2d1856] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:18.018731 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-b668dc98-7071-45f7-bb5c-b71ae4c6e143 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] HTTP exception thrown: Instance 826f6ca1-23f8-43b6-ba69-a0d1ff2d1856 could not be found. Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b668dc98-7071-45f7-bb5c-b71ae4c6e143 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Request method failure captured: Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/826f6ca1-23f8-43b6-ba69-a0d1ff2d1856/os-instance-actions HTTP/1.1 Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gsoJZRqq3TKBqdARsrU4OtqyAsRAHwHiPvidFbEFfe_75EGYQmfagAqZvgTh1IRnwf4DaBsW03ZczSn-_Xv1j_d3M7-YXM5l63fXqd3wwfadOTCeW-9-tJuBlt1LuCMGWzGYVUuSnLM1N1iA8Dl9Ue3AgYuZWOxvqHcc5rwDM_4wlc Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: 08d5b539932d47eea095700153dba311 Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-131272274 Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/08d5b539932d47eea095700153dba311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/08d5b539932d47eea095700153dba311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_08d5b539932d47eea095700153dba311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/08d5b539932d47eea095700153dba311"}]}] Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-131272274 Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: 08d5b539932d47eea095700153dba311 Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-131272274 Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-InstanceActionsNegativeTestJSON-131272274-project Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 7a0acf76d0e149b1998d37062801b1c7 Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-131272274-project Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: method: Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance 826f6ca1-23f8-43b6-ba69-a0d1ff2d1856 could not be found. Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'server_id': '826f6ca1-23f8-43b6-ba69-a0d1ff2d1856'} Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 826f6ca1-23f8-43b6-ba69-a0d1ff2d1856 could not be found. Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:18.021407 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:18.025233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 826f6ca1-23f8-43b6-ba69-a0d1ff2d1856 could not be found. Jul 28 04:06:18.025233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.025233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:18.025233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.025233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:18.025233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:18.025233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:18.025233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:18.025233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:18.025233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 826f6ca1-23f8-43b6-ba69-a0d1ff2d1856 could not be found. Jul 28 04:06:18.025233 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:06:18.027820 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b668dc98-7071-45f7-bb5c-b71ae4c6e143 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Returning 404 to user: Instance 826f6ca1-23f8-43b6-ba69-a0d1ff2d1856 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:18.031662 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b668dc98-7071-45f7-bb5c-b71ae4c6e143 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/826f6ca1-23f8-43b6-ba69-a0d1ff2d1856/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.030734 Jul 28 04:06:18.038709 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2380/5268] 10.222.0.48 () {58 vars in 1296 bytes} [Thu Jul 28 04:06:17 2022] GET /compute/v2.1/servers/826f6ca1-23f8-43b6-ba69-a0d1ff2d1856/os-instance-actions => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:18.056606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af761407-94fd-441a-b260-19a57c0933b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:18.057112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-af761407-94fd-441a-b260-19a57c0933b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:18.077015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af761407-94fd-441a-b260-19a57c0933b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:18.077418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af761407-94fd-441a-b260-19a57c0933b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:18.078205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af761407-94fd-441a-b260-19a57c0933b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:18.078634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af761407-94fd-441a-b260-19a57c0933b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:18.150133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-af761407-94fd-441a-b260-19a57c0933b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:06:18.241313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:18.335770 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-af761407-94fd-441a-b260-19a57c0933b0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 204 len: 0 microversion: 2.1 time: 0.290288 Jul 28 04:06:18.347991 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2889/5269] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:06:18 2022] DELETE /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:06:18.360780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-18c8bd0f-8f6d-4f6c-bcc1-8661b0a52bad tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:18.360780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-18c8bd0f-8f6d-4f6c-bcc1-8661b0a52bad tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:18.371627 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18c8bd0f-8f6d-4f6c-bcc1-8661b0a52bad tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:18.372287 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18c8bd0f-8f6d-4f6c-bcc1-8661b0a52bad tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:18.373306 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18c8bd0f-8f6d-4f6c-bcc1-8661b0a52bad tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:18.374920 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-18c8bd0f-8f6d-4f6c-bcc1-8661b0a52bad tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:18.862041 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-18c8bd0f-8f6d-4f6c-bcc1-8661b0a52bad tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0acf76d0e149b1998d37062801b1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5b539932d47eea095700153dba311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:18.881778 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-18c8bd0f-8f6d-4f6c-bcc1-8661b0a52bad tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 200 len: 1529 microversion: 2.1 time: 0.525394 Jul 28 04:06:18.882605 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2381/5270] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:18 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 1529 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:18.921772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a6756047-b0cc-4db0-becb-5038ebf63a99 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:18.922475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a6756047-b0cc-4db0-becb-5038ebf63a99 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:18.938762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6756047-b0cc-4db0-becb-5038ebf63a99 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:18.939593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6756047-b0cc-4db0-becb-5038ebf63a99 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:18.940966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6756047-b0cc-4db0-becb-5038ebf63a99 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:18.941555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6756047-b0cc-4db0-becb-5038ebf63a99 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:19.233162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a6756047-b0cc-4db0-becb-5038ebf63a99 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:19.241461 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a6756047-b0cc-4db0-becb-5038ebf63a99 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 0.324378 Jul 28 04:06:19.245850 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2890/5271] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:18 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:19.903142 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5b77365f-7639-4fa6-be03-1fa875db4fb3 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:19.904378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5b77365f-7639-4fa6-be03-1fa875db4fb3 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:19.915215 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b77365f-7639-4fa6-be03-1fa875db4fb3 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:19.920663 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b77365f-7639-4fa6-be03-1fa875db4fb3 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:19.921784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b77365f-7639-4fa6-be03-1fa875db4fb3 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:19.922379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5b77365f-7639-4fa6-be03-1fa875db4fb3 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:20.264380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b8df15c-a4e0-40f3-bbe0-f3a956454889 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:20.265003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3b8df15c-a4e0-40f3-bbe0-f3a956454889 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:20.277694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b8df15c-a4e0-40f3-bbe0-f3a956454889 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:20.280758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b8df15c-a4e0-40f3-bbe0-f3a956454889 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:20.281835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b8df15c-a4e0-40f3-bbe0-f3a956454889 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:20.285828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b8df15c-a4e0-40f3-bbe0-f3a956454889 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:20.379577 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5b77365f-7639-4fa6-be03-1fa875db4fb3 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0acf76d0e149b1998d37062801b1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5b539932d47eea095700153dba311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:20.389731 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5b77365f-7639-4fa6-be03-1fa875db4fb3 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 200 len: 1529 microversion: 2.1 time: 0.490474 Jul 28 04:06:20.407546 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2382/5272] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:19 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 1529 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:20.714846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3b8df15c-a4e0-40f3-bbe0-f3a956454889 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:20.733113 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3b8df15c-a4e0-40f3-bbe0-f3a956454889 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 0.474024 Jul 28 04:06:20.734001 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2891/5273] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:20 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:21.336533 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-bcb81809-0ec1-4493-97a4-f9189e30e2a9 req-84e1e0c1-20ed-4c56-b432-cc4a3d5b2dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61aa174-e1e4-4ee9-b135-3d32e57a7495", "name": "network-vif-deleted", "tag": "49974d47-6ac9-4f11-ac4f-6a8a530ed585"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:21.367974 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-bcb81809-0ec1-4493-97a4-f9189e30e2a9 req-84e1e0c1-20ed-4c56-b432-cc4a3d5b2dcd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:21.372678 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-bcb81809-0ec1-4493-97a4-f9189e30e2a9 req-84e1e0c1-20ed-4c56-b432-cc4a3d5b2dcd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:21.402266 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-bcb81809-0ec1-4493-97a4-f9189e30e2a9 req-84e1e0c1-20ed-4c56-b432-cc4a3d5b2dcd service nova] Creating event network-vif-deleted:49974d47-6ac9-4f11-ac4f-6a8a530ed585 for instance c61aa174-e1e4-4ee9-b135-3d32e57a7495 on n-h1-826756-3 Jul 28 04:06:21.416807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05912bdb-d85b-4572-acb0-56e834e7421b tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:21.418170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-05912bdb-d85b-4572-acb0-56e834e7421b tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:21.431813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05912bdb-d85b-4572-acb0-56e834e7421b tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:21.435999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05912bdb-d85b-4572-acb0-56e834e7421b tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:21.442990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05912bdb-d85b-4572-acb0-56e834e7421b tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:21.443699 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-bcb81809-0ec1-4493-97a4-f9189e30e2a9 req-84e1e0c1-20ed-4c56-b432-cc4a3d5b2dcd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106517 Jul 28 04:06:21.445201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05912bdb-d85b-4572-acb0-56e834e7421b tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:21.446312 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2383/5274] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:21.756030 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5557fa67-d91a-4494-aebd-dec4c6c119a7 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:21.757194 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5557fa67-d91a-4494-aebd-dec4c6c119a7 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:21.787458 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5557fa67-d91a-4494-aebd-dec4c6c119a7 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:21.788230 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5557fa67-d91a-4494-aebd-dec4c6c119a7 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:21.789364 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5557fa67-d91a-4494-aebd-dec4c6c119a7 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:21.789904 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5557fa67-d91a-4494-aebd-dec4c6c119a7 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:22.369484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-05912bdb-d85b-4572-acb0-56e834e7421b tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a0acf76d0e149b1998d37062801b1c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d5b539932d47eea095700153dba311', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:22.376871 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-05912bdb-d85b-4572-acb0-56e834e7421b tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 200 len: 1310 microversion: 2.1 time: 0.965536 Jul 28 04:06:22.379400 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2892/5275] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:21 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 1310 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:23.042043 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5557fa67-d91a-4494-aebd-dec4c6c119a7 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:23.056394 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5557fa67-d91a-4494-aebd-dec4c6c119a7 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 1.304538 Jul 28 04:06:23.057181 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2384/5276] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:21 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:23.402458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb92cbb5-6675-4679-aeda-ad421df6b3a0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:23.404050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb92cbb5-6675-4679-aeda-ad421df6b3a0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] [instance: c61aa174-e1e4-4ee9-b135-3d32e57a7495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:23.424178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb92cbb5-6675-4679-aeda-ad421df6b3a0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:23.425617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb92cbb5-6675-4679-aeda-ad421df6b3a0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:23.426483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb92cbb5-6675-4679-aeda-ad421df6b3a0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:23.426933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb92cbb5-6675-4679-aeda-ad421df6b3a0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:23.470641 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-fb92cbb5-6675-4679-aeda-ad421df6b3a0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] HTTP exception thrown: Instance c61aa174-e1e4-4ee9-b135-3d32e57a7495 could not be found. Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb92cbb5-6675-4679-aeda-ad421df6b3a0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Request method failure captured: Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 HTTP/1.1 Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gsoJZRqq3TKBqdARsrU4OtqyAsRAHwHiPvidFbEFfe_75EGYQmfagAqZvgTh1IRnwf4DaBsW03ZczSn-_Xv1j_d3M7-YXM5l63fXqd3wwfadOTCeW-9-tJuBlt1LuCMGWzGYVUuSnLM1N1iA8Dl9Ue3AgYuZWOxvqHcc5rwDM_4wlc Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 08d5b539932d47eea095700153dba311 Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-131272274 Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/08d5b539932d47eea095700153dba311"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/08d5b539932d47eea095700153dba311"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_08d5b539932d47eea095700153dba311"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/08d5b539932d47eea095700153dba311"}]}] Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-131272274 Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 08d5b539932d47eea095700153dba311 Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-131272274 Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-InstanceActionsNegativeTestJSON-131272274-project Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 7a0acf76d0e149b1998d37062801b1c7 Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-131272274-project Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c61aa174-e1e4-4ee9-b135-3d32e57a7495 could not be found. Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c61aa174-e1e4-4ee9-b135-3d32e57a7495'} Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61aa174-e1e4-4ee9-b135-3d32e57a7495 could not be found. Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61aa174-e1e4-4ee9-b135-3d32e57a7495 could not be found. Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:06:23.473248 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:23.477324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:06:23.477324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:23.477324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:23.477324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:23.477324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:23.477324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:23.477324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61aa174-e1e4-4ee9-b135-3d32e57a7495 could not be found. Jul 28 04:06:23.477324 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:06:23.479126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb92cbb5-6675-4679-aeda-ad421df6b3a0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] Returning 404 to user: Instance c61aa174-e1e4-4ee9-b135-3d32e57a7495 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:23.480227 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fb92cbb5-6675-4679-aeda-ad421df6b3a0 tempest-InstanceActionsNegativeTestJSON-131272274 tempest-InstanceActionsNegativeTestJSON-131272274-project] 10.222.0.48 "GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495" status: 404 len: 111 microversion: 2.1 time: 0.084940 Jul 28 04:06:23.484634 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2893/5277] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:23 2022] GET /compute/v2.1/servers/c61aa174-e1e4-4ee9-b135-3d32e57a7495 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:24.079474 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b297bd25-76fb-41c1-af93-19b071308f97 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:24.083383 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b297bd25-76fb-41c1-af93-19b071308f97 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:24.104370 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b297bd25-76fb-41c1-af93-19b071308f97 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:24.104959 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b297bd25-76fb-41c1-af93-19b071308f97 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:24.109189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b297bd25-76fb-41c1-af93-19b071308f97 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:24.114099 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b297bd25-76fb-41c1-af93-19b071308f97 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:25.305970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b297bd25-76fb-41c1-af93-19b071308f97 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:25.316045 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b297bd25-76fb-41c1-af93-19b071308f97 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 1.242292 Jul 28 04:06:25.330275 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2385/5278] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:24 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:26.339867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9e70d388-741a-408c-9dc0-4b5dada6685c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:26.340776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9e70d388-741a-408c-9dc0-4b5dada6685c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:26.381378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e70d388-741a-408c-9dc0-4b5dada6685c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:26.381832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e70d388-741a-408c-9dc0-4b5dada6685c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:26.387500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e70d388-741a-408c-9dc0-4b5dada6685c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:26.390674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e70d388-741a-408c-9dc0-4b5dada6685c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:27.190213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9e70d388-741a-408c-9dc0-4b5dada6685c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:27.199615 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9e70d388-741a-408c-9dc0-4b5dada6685c tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1524 microversion: 2.1 time: 0.865658 Jul 28 04:06:27.200783 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2894/5279] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:26 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1524 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:28.242797 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7856150b-52b4-4a29-aeb8-d80fe2e067ac tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:28.243931 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7856150b-52b4-4a29-aeb8-d80fe2e067ac tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:28.257554 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:28.290339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7856150b-52b4-4a29-aeb8-d80fe2e067ac tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:28.291055 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7856150b-52b4-4a29-aeb8-d80fe2e067ac tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:28.296827 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7856150b-52b4-4a29-aeb8-d80fe2e067ac tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:28.305668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7856150b-52b4-4a29-aeb8-d80fe2e067ac tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:29.267394 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7856150b-52b4-4a29-aeb8-d80fe2e067ac tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:29.283442 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7856150b-52b4-4a29-aeb8-d80fe2e067ac tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1504 microversion: 2.1 time: 1.044412 Jul 28 04:06:29.297358 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2386/5280] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:28 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1504 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:29.309733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cb0e2ece-bdee-45c1-8613-b505608ca00d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Action: 'create', calling method: .version_select at 0x7ffa66e561f0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-876396641", "description": "tempest-description-87576553"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:29.909418 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cb0e2ece-bdee-45c1-8613-b505608ca00d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.603854 Jul 28 04:06:29.911742 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2895/5281] 10.222.0.48 () {60 vars in 1180 bytes} [Thu Jul 28 04:06:29 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:29.925729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7eb7fb75-af35-4c8e-bc1f-3305c7463148 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-876396641"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:29.926281 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7eb7fb75-af35-4c8e-bc1f-3305c7463148 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:29.939020 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7eb7fb75-af35-4c8e-bc1f-3305c7463148 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:29.951479 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7eb7fb75-af35-4c8e-bc1f-3305c7463148 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:29.952671 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7eb7fb75-af35-4c8e-bc1f-3305c7463148 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:29.953263 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7eb7fb75-af35-4c8e-bc1f-3305c7463148 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:30.560056 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.network.security_group_api [None req-7eb7fb75-af35-4c8e-bc1f-3305c7463148 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Adding security group 35c9d194-4c68-4fb6-833a-d0d90423f2fe to port 75ef116f-f70a-4789-ae0e-6b7650f6d3f3 Jul 28 04:06:32.538038 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7eb7fb75-af35-4c8e-bc1f-3305c7463148 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "POST /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97/action" status: 202 len: 0 microversion: 2.1 time: 2.612826 Jul 28 04:06:32.538787 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2387/5282] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:06:29 2022] POST /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97/action => generated 0 bytes in 2618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:06:32.548939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c930d52-7536-47be-adfa-5fa10473aea9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-876396641"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:32.549522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5c930d52-7536-47be-adfa-5fa10473aea9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:32.563300 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-63cc330d-2a4f-43f6-99d6-f0ca43ea5c81 req-e1b61a2d-277e-4e98-9870-57411cc5462b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97", "tag": "75ef116f-f70a-4789-ae0e-6b7650f6d3f3"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:32.588232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:32.598282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c930d52-7536-47be-adfa-5fa10473aea9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:32.598742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c930d52-7536-47be-adfa-5fa10473aea9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:32.605200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c930d52-7536-47be-adfa-5fa10473aea9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:32.605657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c930d52-7536-47be-adfa-5fa10473aea9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:32.609022 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-63cc330d-2a4f-43f6-99d6-f0ca43ea5c81 req-e1b61a2d-277e-4e98-9870-57411cc5462b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:32.611035 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-63cc330d-2a4f-43f6-99d6-f0ca43ea5c81 req-e1b61a2d-277e-4e98-9870-57411cc5462b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:32.645791 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-63cc330d-2a4f-43f6-99d6-f0ca43ea5c81 req-e1b61a2d-277e-4e98-9870-57411cc5462b service nova] Creating event network-changed:75ef116f-f70a-4789-ae0e-6b7650f6d3f3 for instance d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 on n-h2-826756-3 Jul 28 04:06:32.659205 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-63cc330d-2a4f-43f6-99d6-f0ca43ea5c81 req-e1b61a2d-277e-4e98-9870-57411cc5462b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104583 Jul 28 04:06:32.661510 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2388/5283] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:33.154939 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.network.security_group_api [None req-5c930d52-7536-47be-adfa-5fa10473aea9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Removing security group 35c9d194-4c68-4fb6-833a-d0d90423f2fe from port 75ef116f-f70a-4789-ae0e-6b7650f6d3f3 Jul 28 04:06:35.644274 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5c930d52-7536-47be-adfa-5fa10473aea9 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "POST /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97/action" status: 202 len: 0 microversion: 2.1 time: 3.101270 Jul 28 04:06:35.644953 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2896/5284] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:06:32 2022] POST /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97/action => generated 0 bytes in 3103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:06:35.654829 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3eab1ea8-f3bd-4b0e-9fb4-1a3830084cdd tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Action: 'create', calling method: .version_select at 0x7ffa742c0160>, body: {"pool": null} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:35.997866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f2a74af4-cb76-4bbd-a79e-5a2780bc2984 req-b8edb368-b775-4432-b6b2-c0bfe3f338ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97", "tag": "75ef116f-f70a-4789-ae0e-6b7650f6d3f3"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:36.022203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f2a74af4-cb76-4bbd-a79e-5a2780bc2984 req-b8edb368-b775-4432-b6b2-c0bfe3f338ee service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:36.022983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f2a74af4-cb76-4bbd-a79e-5a2780bc2984 req-b8edb368-b775-4432-b6b2-c0bfe3f338ee service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:36.061211 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f2a74af4-cb76-4bbd-a79e-5a2780bc2984 req-b8edb368-b775-4432-b6b2-c0bfe3f338ee service nova] Creating event network-changed:75ef116f-f70a-4789-ae0e-6b7650f6d3f3 for instance d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 on n-h2-826756-3 Jul 28 04:06:36.086930 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f2a74af4-cb76-4bbd-a79e-5a2780bc2984 req-b8edb368-b775-4432-b6b2-c0bfe3f338ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.407068 Jul 28 04:06:36.087577 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2897/5285] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:42.604978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=5 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:42.630197 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=57 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:43.489674 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3eab1ea8-f3bd-4b0e-9fb4-1a3830084cdd tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.839042 Jul 28 04:06:43.490300 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2389/5286] 10.222.0.48 () {60 vars in 1170 bytes} [Thu Jul 28 04:06:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:43.504012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3f2b6f3a-43a7-4498-a42e-29cbb4d90159 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.243"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:43.508761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3f2b6f3a-43a7-4498-a42e-29cbb4d90159 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:43.528492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f2b6f3a-43a7-4498-a42e-29cbb4d90159 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:43.529203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f2b6f3a-43a7-4498-a42e-29cbb4d90159 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:43.530206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f2b6f3a-43a7-4498-a42e-29cbb4d90159 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:43.530833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f2b6f3a-43a7-4498-a42e-29cbb4d90159 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:43.589522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f2b6f3a-43a7-4498-a42e-29cbb4d90159 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Acquired lock "refresh_cache-d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 04:06:49.206602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-3f2b6f3a-43a7-4498-a42e-29cbb4d90159 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Building network info cache for instance {{(pid=126071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 04:06:49.213730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:49.233773 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-149d320a-8c36-466e-b97a-9195a64aeade req-fd6f8b06-9864-4dc0-a649-63637b4d85ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97", "tag": "75ef116f-f70a-4789-ae0e-6b7650f6d3f3"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:49.260122 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-149d320a-8c36-466e-b97a-9195a64aeade req-fd6f8b06-9864-4dc0-a649-63637b4d85ad service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:49.260670 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-149d320a-8c36-466e-b97a-9195a64aeade req-fd6f8b06-9864-4dc0-a649-63637b4d85ad service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:49.284044 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-149d320a-8c36-466e-b97a-9195a64aeade req-fd6f8b06-9864-4dc0-a649-63637b4d85ad service nova] Creating event network-changed:75ef116f-f70a-4789-ae0e-6b7650f6d3f3 for instance d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 on n-h2-826756-3 Jul 28 04:06:49.300331 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-149d320a-8c36-466e-b97a-9195a64aeade req-fd6f8b06-9864-4dc0-a649-63637b4d85ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071567 Jul 28 04:06:49.304502 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2390/5287] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:53.524225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-3f2b6f3a-43a7-4498-a42e-29cbb4d90159 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Updating instance_info_cache with network_info: [{"id": "75ef116f-f70a-4789-ae0e-6b7650f6d3f3", "address": "fa:16:3e:ef:71:c5", "network": {"id": "c18286c4-4a22-4a75-8b17-8a9a24c04e87", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1785883471-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f51da76758cc4d5c81c0104f97a65e66", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap75ef116f-f7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 04:06:53.532683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=5 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:53.534163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f2b6f3a-43a7-4498-a42e-29cbb4d90159 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Releasing lock "refresh_cache-d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" {{(pid=126071) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 04:06:53.535064 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3f2b6f3a-43a7-4498-a42e-29cbb4d90159 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "POST /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97/action" status: 202 len: 0 microversion: 2.1 time: 10.035796 Jul 28 04:06:53.535714 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2898/5288] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:06:43 2022] POST /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97/action => generated 0 bytes in 10037 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 04:06:53.545919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dfd15452-667f-4ba0-8333-b4d55ff729f3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.243"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:54.389217 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dfd15452-667f-4ba0-8333-b4d55ff729f3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:06:54.396690 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dfd15452-667f-4ba0-8333-b4d55ff729f3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:54.402788 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dfd15452-667f-4ba0-8333-b4d55ff729f3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:54.404817 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dfd15452-667f-4ba0-8333-b4d55ff729f3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:54.416011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dfd15452-667f-4ba0-8333-b4d55ff729f3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:55.733748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dfd15452-667f-4ba0-8333-b4d55ff729f3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Acquired lock "refresh_cache-d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" {{(pid=126072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 04:06:59.842304 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-dfd15452-667f-4ba0-8333-b4d55ff729f3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Building network info cache for instance {{(pid=126072) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 28 04:06:59.865574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6e513e11-f24f-4104-b933-f9790f0edf05 req-a7cd20ed-d094-44eb-bda2-bb61e35cf56f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97", "tag": "75ef116f-f70a-4789-ae0e-6b7650f6d3f3"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:59.964025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6e513e11-f24f-4104-b933-f9790f0edf05 req-a7cd20ed-d094-44eb-bda2-bb61e35cf56f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:59.964509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6e513e11-f24f-4104-b933-f9790f0edf05 req-a7cd20ed-d094-44eb-bda2-bb61e35cf56f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:00.088104 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6e513e11-f24f-4104-b933-f9790f0edf05 req-a7cd20ed-d094-44eb-bda2-bb61e35cf56f service nova] Creating event network-changed:75ef116f-f70a-4789-ae0e-6b7650f6d3f3 for instance d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 on n-h2-826756-3 Jul 28 04:07:00.107131 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6e513e11-f24f-4104-b933-f9790f0edf05 req-a7cd20ed-d094-44eb-bda2-bb61e35cf56f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245242 Jul 28 04:07:00.109836 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2899/5289] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:07:01.115332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-494244393", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "89d830b8-ba77-4dd2-a6c3-b47f1d8ced84"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:01.231907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] validate_networks() for [('89d830b8-ba77-4dd2-a6c3-b47f1d8ced84', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:07:01.943788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:07:01.944426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:07:01.945059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:07:01.947097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:07:01.947669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:07:01.967907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:01.968364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:01.969358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:01.970082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:02.010803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Getting quotas for project ba8f8ab85fef40e180ac94560a25cac4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:07:02.017963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Getting quotas for user 2bd5450439494a0dbf4f0927461a07a4 and project ba8f8ab85fef40e180ac94560a25cac4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:07:02.042585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Going to run 2 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:07:02.049643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: 7fe58088-9c6f-4974-a8be-d8a436744d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:07:02.169442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=7fe58088-9c6f-4974-a8be-d8a436744d4e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:07:02.433402 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aebf8c25-8ebc-4e87-a039-5e0c83d549d2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.563887 Jul 28 04:07:02.433402 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2900/5290] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:07:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:07:02.433402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7bf4c6d1-98de-45de-8aa3-2e5d64f175e5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:02.433402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7bf4c6d1-98de-45de-8aa3-2e5d64f175e5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:02.433402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7bf4c6d1-98de-45de-8aa3-2e5d64f175e5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Searching by: {'deleted': False, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 04:07:02.433402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bf4c6d1-98de-45de-8aa3-2e5d64f175e5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:02.433402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bf4c6d1-98de-45de-8aa3-2e5d64f175e5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:02.433402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bf4c6d1-98de-45de-8aa3-2e5d64f175e5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:02.433402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bf4c6d1-98de-45de-8aa3-2e5d64f175e5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:02.463003 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7bf4c6d1-98de-45de-8aa3-2e5d64f175e5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.097037 Jul 28 04:07:02.471290 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2901/5291] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 04:07:02 2022] GET /compute/v2.1/servers => generated 675 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:02.545881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c5f8e04d-5583-48ab-8f25-6c85709fc26f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:02.545881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c5f8e04d-5583-48ab-8f25-6c85709fc26f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:02.599880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c5f8e04d-5583-48ab-8f25-6c85709fc26f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:02.609119 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c5f8e04d-5583-48ab-8f25-6c85709fc26f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1219 microversion: 2.1 time: 0.135088 Jul 28 04:07:02.623621 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2902/5292] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:02 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:03.635282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e794149c-fa73-442e-ace7-18d66f0ccf54 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:03.636572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e794149c-fa73-442e-ace7-18d66f0ccf54 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:04.394600 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=4 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:04.930978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e794149c-fa73-442e-ace7-18d66f0ccf54 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:04.942937 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e794149c-fa73-442e-ace7-18d66f0ccf54 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1219 microversion: 2.1 time: 1.314583 Jul 28 04:07:04.943861 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2903/5293] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:03 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1219 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:05.135650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-dfd15452-667f-4ba0-8333-b4d55ff729f3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Updating instance_info_cache with network_info: [{"id": "75ef116f-f70a-4789-ae0e-6b7650f6d3f3", "address": "fa:16:3e:ef:71:c5", "network": {"id": "c18286c4-4a22-4a75-8b17-8a9a24c04e87", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1785883471-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f51da76758cc4d5c81c0104f97a65e66", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap75ef116f-f7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=126072) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 28 04:07:05.174854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dfd15452-667f-4ba0-8333-b4d55ff729f3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Releasing lock "refresh_cache-d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" {{(pid=126072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 04:07:05.180314 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dfd15452-667f-4ba0-8333-b4d55ff729f3 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "POST /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97/action" status: 202 len: 0 microversion: 2.1 time: 11.634856 Jul 28 04:07:05.184581 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2391/5294] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:06:53 2022] POST /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97/action => generated 0 bytes in 11643 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 28 04:07:05.192487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-64178c28-4058-4a25-8c3d-8e7d1841a522 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '.version_select at 0x7ffa66e65ee0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:05.965195 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3176c161-5e77-4e25-bb6c-c8d408f4a422 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:05.965721 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3176c161-5e77-4e25-bb6c-c8d408f4a422 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:06.007619 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3176c161-5e77-4e25-bb6c-c8d408f4a422 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:06.011934 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3176c161-5e77-4e25-bb6c-c8d408f4a422 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:06.016962 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3176c161-5e77-4e25-bb6c-c8d408f4a422 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:06.020924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3176c161-5e77-4e25-bb6c-c8d408f4a422 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:07.496572 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3176c161-5e77-4e25-bb6c-c8d408f4a422 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:07.505822 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3176c161-5e77-4e25-bb6c-c8d408f4a422 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1279 microversion: 2.1 time: 1.544924 Jul 28 04:07:07.506440 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2392/5295] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:05 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1279 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:07:07.626614 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-64178c28-4058-4a25-8c3d-8e7d1841a522 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "DELETE /compute/v2.1/os-floating-ips/fec61e40-79bc-405d-a260-ce932bed11dc" status: 202 len: 0 microversion: 2.1 time: 2.439498 Jul 28 04:07:07.633067 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2904/5296] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 04:07:05 2022] DELETE /compute/v2.1/os-floating-ips/fec61e40-79bc-405d-a260-ce932bed11dc => generated 0 bytes in 2446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:07:07.638714 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-41ea79cb-a749-4d74-8799-4c7aa481ce29 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '.version_select at 0x7ffa677ac940>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:08.538406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9a30ca7-523e-406c-9647-c460b087cc85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:08.539364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9a30ca7-523e-406c-9647-c460b087cc85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:08.576389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9a30ca7-523e-406c-9647-c460b087cc85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:08.576922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9a30ca7-523e-406c-9647-c460b087cc85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:08.577862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9a30ca7-523e-406c-9647-c460b087cc85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:08.578373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9a30ca7-523e-406c-9647-c460b087cc85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:08.680723 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-41ea79cb-a749-4d74-8799-4c7aa481ce29 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "DELETE /compute/v2.1/os-security-groups/35c9d194-4c68-4fb6-833a-d0d90423f2fe" status: 202 len: 0 microversion: 2.1 time: 1.045749 Jul 28 04:07:08.681357 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2393/5297] 10.222.0.48 () {58 vars in 1272 bytes} [Thu Jul 28 04:07:07 2022] DELETE /compute/v2.1/os-security-groups/35c9d194-4c68-4fb6-833a-d0d90423f2fe => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:07:08.691203 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-4add090e-ae71-4b8f-b7b5-0df78197e545 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:08.691826 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4add090e-ae71-4b8f-b7b5-0df78197e545 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:08.720643 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4add090e-ae71-4b8f-b7b5-0df78197e545 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:08.728668 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4add090e-ae71-4b8f-b7b5-0df78197e545 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:08.731378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4add090e-ae71-4b8f-b7b5-0df78197e545 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:08.731857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-4add090e-ae71-4b8f-b7b5-0df78197e545 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:08.796408 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-4add090e-ae71-4b8f-b7b5-0df78197e545 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:07:08.999223 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-4add090e-ae71-4b8f-b7b5-0df78197e545 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 204 len: 0 microversion: 2.1 time: 0.313045 Jul 28 04:07:09.000020 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2394/5298] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:07:08 2022] DELETE /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:07:09.017241 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-dc63cb0e-3fdb-4fdd-8fc7-5d8737c077b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:09.021266 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-dc63cb0e-3fdb-4fdd-8fc7-5d8737c077b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:09.069924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc63cb0e-3fdb-4fdd-8fc7-5d8737c077b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:09.070486 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc63cb0e-3fdb-4fdd-8fc7-5d8737c077b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:09.080329 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc63cb0e-3fdb-4fdd-8fc7-5d8737c077b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:09.083845 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-dc63cb0e-3fdb-4fdd-8fc7-5d8737c077b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:09.461795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b9a30ca7-523e-406c-9647-c460b087cc85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:09.486298 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9a30ca7-523e-406c-9647-c460b087cc85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1277 microversion: 2.1 time: 0.946200 Jul 28 04:07:09.486517 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2905/5299] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:08 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1277 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:09.510636 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-dc63cb0e-3fdb-4fdd-8fc7-5d8737c077b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:09.546413 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-dc63cb0e-3fdb-4fdd-8fc7-5d8737c077b8 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1510 microversion: 2.1 time: 0.536521 Jul 28 04:07:09.564214 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2395/5300] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:09 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1510 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:10.509896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e6bf56e-1d59-41b0-a3c8-d06b54a378af tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:10.511053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e6bf56e-1d59-41b0-a3c8-d06b54a378af tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:10.562293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e6bf56e-1d59-41b0-a3c8-d06b54a378af tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:10.563398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e6bf56e-1d59-41b0-a3c8-d06b54a378af tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:10.566537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e6bf56e-1d59-41b0-a3c8-d06b54a378af tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:10.569464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e6bf56e-1d59-41b0-a3c8-d06b54a378af tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:10.570607 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-356f447e-7e73-4ad7-9486-2a260bd80ae0 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:10.577055 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-356f447e-7e73-4ad7-9486-2a260bd80ae0 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:10.587819 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-356f447e-7e73-4ad7-9486-2a260bd80ae0 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:10.595793 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-356f447e-7e73-4ad7-9486-2a260bd80ae0 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:10.598552 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-356f447e-7e73-4ad7-9486-2a260bd80ae0 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:10.603182 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-356f447e-7e73-4ad7-9486-2a260bd80ae0 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:11.007380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e6bf56e-1d59-41b0-a3c8-d06b54a378af tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:11.029915 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e6bf56e-1d59-41b0-a3c8-d06b54a378af tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1277 microversion: 2.1 time: 0.517333 Jul 28 04:07:11.033422 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2906/5301] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:10 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1277 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:11.254327 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-356f447e-7e73-4ad7-9486-2a260bd80ae0 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:11.264470 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-356f447e-7e73-4ad7-9486-2a260bd80ae0 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1510 microversion: 2.1 time: 0.697764 Jul 28 04:07:11.265093 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2396/5302] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:10 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1510 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:07:12.058581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d7879984-2ccf-4d99-a772-ea2bc2560bd2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:12.059221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d7879984-2ccf-4d99-a772-ea2bc2560bd2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:12.093861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7879984-2ccf-4d99-a772-ea2bc2560bd2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:12.107122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7879984-2ccf-4d99-a772-ea2bc2560bd2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:12.108985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7879984-2ccf-4d99-a772-ea2bc2560bd2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:12.110514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7879984-2ccf-4d99-a772-ea2bc2560bd2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:12.294752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9182c36e-4d26-4c9b-aaea-b14b9275d15d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:12.295929 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9182c36e-4d26-4c9b-aaea-b14b9275d15d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:12.313880 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9182c36e-4d26-4c9b-aaea-b14b9275d15d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:12.324292 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9182c36e-4d26-4c9b-aaea-b14b9275d15d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:12.325316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9182c36e-4d26-4c9b-aaea-b14b9275d15d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:12.325775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9182c36e-4d26-4c9b-aaea-b14b9275d15d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:12.449582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:12.813605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d7879984-2ccf-4d99-a772-ea2bc2560bd2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:12.827307 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d7879984-2ccf-4d99-a772-ea2bc2560bd2 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1319 microversion: 2.1 time: 0.770400 Jul 28 04:07:12.828250 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2907/5303] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:12 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1319 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:13.160662 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9182c36e-4d26-4c9b-aaea-b14b9275d15d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:13.163087 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=47,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:13.181287 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9182c36e-4d26-4c9b-aaea-b14b9275d15d tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1510 microversion: 2.1 time: 0.890970 Jul 28 04:07:13.183622 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2397/5304] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:12 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1510 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:13.850394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c27acdbf-f74a-4e8c-9193-895706fec7f7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:13.851288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c27acdbf-f74a-4e8c-9193-895706fec7f7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:13.866497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c27acdbf-f74a-4e8c-9193-895706fec7f7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:13.870895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c27acdbf-f74a-4e8c-9193-895706fec7f7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:13.877617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c27acdbf-f74a-4e8c-9193-895706fec7f7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:13.881791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c27acdbf-f74a-4e8c-9193-895706fec7f7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:14.202425 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5a115bb8-62f4-4c02-a40f-23f857656e1e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:14.204112 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5a115bb8-62f4-4c02-a40f-23f857656e1e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:14.222274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a115bb8-62f4-4c02-a40f-23f857656e1e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:14.225127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a115bb8-62f4-4c02-a40f-23f857656e1e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:14.236008 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a115bb8-62f4-4c02-a40f-23f857656e1e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:14.236731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-5a115bb8-62f4-4c02-a40f-23f857656e1e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:14.936135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=10 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:14.960865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c27acdbf-f74a-4e8c-9193-895706fec7f7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:14.989155 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c27acdbf-f74a-4e8c-9193-895706fec7f7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1319 microversion: 2.1 time: 1.142334 Jul 28 04:07:14.991031 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2908/5305] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:13 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1319 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:15.363209 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5a115bb8-62f4-4c02-a40f-23f857656e1e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:15.381473 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5a115bb8-62f4-4c02-a40f-23f857656e1e tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1510 microversion: 2.1 time: 1.183260 Jul 28 04:07:15.396967 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2398/5306] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:14 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1510 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:15.794350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-30c70ece-aa5f-431a-bf93-6e67f1d65315 req-86061b36-5869-41e9-84a0-924074ebcd4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97", "name": "network-vif-deleted", "tag": "75ef116f-f70a-4789-ae0e-6b7650f6d3f3"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:15.841124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-30c70ece-aa5f-431a-bf93-6e67f1d65315 req-86061b36-5869-41e9-84a0-924074ebcd4f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:15.842891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-30c70ece-aa5f-431a-bf93-6e67f1d65315 req-86061b36-5869-41e9-84a0-924074ebcd4f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:15.932993 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-30c70ece-aa5f-431a-bf93-6e67f1d65315 req-86061b36-5869-41e9-84a0-924074ebcd4f service nova] Creating event network-vif-deleted:75ef116f-f70a-4789-ae0e-6b7650f6d3f3 for instance d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 on n-h2-826756-3 Jul 28 04:07:15.973026 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-30c70ece-aa5f-431a-bf93-6e67f1d65315 req-86061b36-5869-41e9-84a0-924074ebcd4f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182004 Jul 28 04:07:15.974634 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2909/5307] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:16.013009 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7b97a811-0bd1-4707-8b2a-7ca73ffaab61 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:16.013268 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7b97a811-0bd1-4707-8b2a-7ca73ffaab61 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:16.026808 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7b97a811-0bd1-4707-8b2a-7ca73ffaab61 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:16.028502 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7b97a811-0bd1-4707-8b2a-7ca73ffaab61 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:16.041961 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7b97a811-0bd1-4707-8b2a-7ca73ffaab61 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:16.042904 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7b97a811-0bd1-4707-8b2a-7ca73ffaab61 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:16.416595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b4d4d37c-385b-4f38-bb76-d63cf92f3657 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:16.417340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4d4d37c-385b-4f38-bb76-d63cf92f3657 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:16.440636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4d4d37c-385b-4f38-bb76-d63cf92f3657 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:16.441136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4d4d37c-385b-4f38-bb76-d63cf92f3657 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:16.441998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4d4d37c-385b-4f38-bb76-d63cf92f3657 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:16.442456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4d4d37c-385b-4f38-bb76-d63cf92f3657 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:16.530766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4d4d37c-385b-4f38-bb76-d63cf92f3657 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:16.531244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4d4d37c-385b-4f38-bb76-d63cf92f3657 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:16.531738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-b4d4d37c-385b-4f38-bb76-d63cf92f3657 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lazy-loading 'fault' on Instance uuid d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:07:16.649948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b4d4d37c-385b-4f38-bb76-d63cf92f3657 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87824c5db1e04c5d9360d71cd4165c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51da76758cc4d5c81c0104f97a65e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:16.658380 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b4d4d37c-385b-4f38-bb76-d63cf92f3657 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 200 len: 1312 microversion: 2.1 time: 0.248820 Jul 28 04:07:16.675273 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2910/5308] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:16 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 1312 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:17.485361 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7b97a811-0bd1-4707-8b2a-7ca73ffaab61 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:17.498118 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7b97a811-0bd1-4707-8b2a-7ca73ffaab61 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1319 microversion: 2.1 time: 1.490146 Jul 28 04:07:17.500317 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2399/5309] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:16 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1319 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:17.683833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5075a9fe-0ee4-48c1-a5d9-e23d0b5a1bf1 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:17.684193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5075a9fe-0ee4-48c1-a5d9-e23d0b5a1bf1 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] [instance: d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:17.696112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5075a9fe-0ee4-48c1-a5d9-e23d0b5a1bf1 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:17.696602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5075a9fe-0ee4-48c1-a5d9-e23d0b5a1bf1 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:17.706034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5075a9fe-0ee4-48c1-a5d9-e23d0b5a1bf1 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:17.706504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5075a9fe-0ee4-48c1-a5d9-e23d0b5a1bf1 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:17.739376 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-5075a9fe-0ee4-48c1-a5d9-e23d0b5a1bf1 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] HTTP exception thrown: Instance d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 could not be found. Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5075a9fe-0ee4-48c1-a5d9-e23d0b5a1bf1 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Request method failure captured: Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 HTTP/1.1 Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gsFzM-qntYlkuQywgM8nxLxN-jwzrq9Ag_Vq9ZHY-hmfHhD7_DAYM41k0elXliUDXC7VtXG8NOKF_cgRC1ZjoMUcE88K3A_L0ZCPJwh8AFWROT0qcVCyKdqtgPTbC4Y4BoH437YjdO3HNJbg-SMNCmf5rTHAtDj3Eu7ZGbQR-7zFDQ Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f51da76758cc4d5c81c0104f97a65e66 Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1718915603 Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f51da76758cc4d5c81c0104f97a65e66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f51da76758cc4d5c81c0104f97a65e66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f51da76758cc4d5c81c0104f97a65e66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f51da76758cc4d5c81c0104f97a65e66"}]}] Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1718915603 Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f51da76758cc4d5c81c0104f97a65e66 Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1718915603 Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerRescueTestJSONUnderV235-1718915603-project Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 87824c5db1e04c5d9360d71cd4165c0d Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1718915603-project Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 could not be found. Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd4d53a37-e23f-4dbf-b1fb-e6220e1fcb97'} Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 could not be found. Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 could not be found. Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:07:17.741154 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:07:17.746362 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:07:17.746362 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:07:17.746362 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:07:17.746362 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:07:17.746362 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:07:17.746362 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:07:17.746362 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 could not be found. Jul 28 04:07:17.746362 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:07:17.758868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5075a9fe-0ee4-48c1-a5d9-e23d0b5a1bf1 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] Returning 404 to user: Instance d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:07:17.760779 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5075a9fe-0ee4-48c1-a5d9-e23d0b5a1bf1 tempest-ServerRescueTestJSONUnderV235-1718915603 tempest-ServerRescueTestJSONUnderV235-1718915603-project] 10.222.0.48 "GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97" status: 404 len: 111 microversion: 2.1 time: 0.080897 Jul 28 04:07:17.760779 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2911/5310] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:17 2022] GET /compute/v2.1/servers/d4d53a37-e23f-4dbf-b1fb-e6220e1fcb97 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:07:18.137209 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-c2dd6d11-1b40-4d54-9d31-08a59b878ce9 req-6f389078-f580-4aad-9354-79bfd584024f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe58088-9c6f-4974-a8be-d8a436744d4e", "tag": "8f1ff312-0dba-4e4b-b184-be951861cee0"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:18.154897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c2dd6d11-1b40-4d54-9d31-08a59b878ce9 req-6f389078-f580-4aad-9354-79bfd584024f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:18.159542 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-c2dd6d11-1b40-4d54-9d31-08a59b878ce9 req-6f389078-f580-4aad-9354-79bfd584024f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:18.188080 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-c2dd6d11-1b40-4d54-9d31-08a59b878ce9 req-6f389078-f580-4aad-9354-79bfd584024f service nova] Creating event network-changed:8f1ff312-0dba-4e4b-b184-be951861cee0 for instance 7fe58088-9c6f-4974-a8be-d8a436744d4e on n-h1-826756-3 Jul 28 04:07:18.195699 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-c2dd6d11-1b40-4d54-9d31-08a59b878ce9 req-6f389078-f580-4aad-9354-79bfd584024f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063228 Jul 28 04:07:18.202999 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2400/5311] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:18.521698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-07a9180f-750f-40a3-9538-9e467a022bb9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:18.522328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-07a9180f-750f-40a3-9538-9e467a022bb9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:18.532856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07a9180f-750f-40a3-9538-9e467a022bb9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:18.533310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07a9180f-750f-40a3-9538-9e467a022bb9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:18.538459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07a9180f-750f-40a3-9538-9e467a022bb9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:18.539144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07a9180f-750f-40a3-9538-9e467a022bb9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:18.862884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-07a9180f-750f-40a3-9538-9e467a022bb9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:18.882447 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-07a9180f-750f-40a3-9538-9e467a022bb9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1319 microversion: 2.1 time: 0.364527 Jul 28 04:07:18.887022 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2912/5312] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:18 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:19.908717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-297e4d20-73af-4453-a66a-87d45b9b5e50 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:19.909537 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-297e4d20-73af-4453-a66a-87d45b9b5e50 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:19.950970 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-297e4d20-73af-4453-a66a-87d45b9b5e50 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:19.956328 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-297e4d20-73af-4453-a66a-87d45b9b5e50 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:19.957633 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-297e4d20-73af-4453-a66a-87d45b9b5e50 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:19.958598 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-297e4d20-73af-4453-a66a-87d45b9b5e50 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:20.337448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b84854d7-b333-485c-9c52-488fcab68486 req-dcba8e94-ce46-4a83-b340-0366f5b35b87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1fec99c-1704-4638-905d-cb19c64aab7a", "tag": "c6277b33-7de9-40dc-bb06-644767fb97a5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:20.350598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b84854d7-b333-485c-9c52-488fcab68486 req-dcba8e94-ce46-4a83-b340-0366f5b35b87 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:20.351342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b84854d7-b333-485c-9c52-488fcab68486 req-dcba8e94-ce46-4a83-b340-0366f5b35b87 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:20.364644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=52,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:20.367227 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b84854d7-b333-485c-9c52-488fcab68486 req-dcba8e94-ce46-4a83-b340-0366f5b35b87 service nova] Creating event network-changed:c6277b33-7de9-40dc-bb06-644767fb97a5 for instance e1fec99c-1704-4638-905d-cb19c64aab7a on n-h2-826756-3 Jul 28 04:07:20.373928 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b84854d7-b333-485c-9c52-488fcab68486 req-dcba8e94-ce46-4a83-b340-0366f5b35b87 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041131 Jul 28 04:07:20.375126 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2913/5313] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:07:20.661938 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-297e4d20-73af-4453-a66a-87d45b9b5e50 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:20.682301 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-297e4d20-73af-4453-a66a-87d45b9b5e50 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1319 microversion: 2.1 time: 0.776315 Jul 28 04:07:20.686908 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2401/5314] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:19 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1319 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:21.714572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-730a56ee-077a-4cf1-8584-9fbd34e9bf11 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:21.715296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-730a56ee-077a-4cf1-8584-9fbd34e9bf11 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:21.763478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-730a56ee-077a-4cf1-8584-9fbd34e9bf11 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:21.764055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-730a56ee-077a-4cf1-8584-9fbd34e9bf11 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:21.773378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-730a56ee-077a-4cf1-8584-9fbd34e9bf11 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:21.774108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-730a56ee-077a-4cf1-8584-9fbd34e9bf11 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:22.232701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-730a56ee-077a-4cf1-8584-9fbd34e9bf11 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:22.270997 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-730a56ee-077a-4cf1-8584-9fbd34e9bf11 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1319 microversion: 2.1 time: 0.538247 Jul 28 04:07:22.278097 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2914/5315] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:21 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1319 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:23.301869 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3feb1cf8-7ebc-4bd5-8a08-0fe2c34b1765 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:23.303169 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3feb1cf8-7ebc-4bd5-8a08-0fe2c34b1765 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:23.339975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3feb1cf8-7ebc-4bd5-8a08-0fe2c34b1765 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:23.342065 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3feb1cf8-7ebc-4bd5-8a08-0fe2c34b1765 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:23.351257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3feb1cf8-7ebc-4bd5-8a08-0fe2c34b1765 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:23.357958 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3feb1cf8-7ebc-4bd5-8a08-0fe2c34b1765 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:23.955932 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:07:23.956556 n-d-826756-3 devstack@n-api.service[126071]: Thu Jul 28 04:07:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:07:25.127910 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3feb1cf8-7ebc-4bd5-8a08-0fe2c34b1765 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:25.147783 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3feb1cf8-7ebc-4bd5-8a08-0fe2c34b1765 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1319 microversion: 2.1 time: 1.850363 Jul 28 04:07:25.150652 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2402/5316] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:23 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1319 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:26.172264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-346b977a-b467-4091-9dbb-072b9ca552aa tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:26.173004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-346b977a-b467-4091-9dbb-072b9ca552aa tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:26.207349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-346b977a-b467-4091-9dbb-072b9ca552aa tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:26.208887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-346b977a-b467-4091-9dbb-072b9ca552aa tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:26.209782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-346b977a-b467-4091-9dbb-072b9ca552aa tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:26.211915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-346b977a-b467-4091-9dbb-072b9ca552aa tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:27.190313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-346b977a-b467-4091-9dbb-072b9ca552aa tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:27.204643 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-346b977a-b467-4091-9dbb-072b9ca552aa tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1319 microversion: 2.1 time: 1.037352 Jul 28 04:07:27.209022 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2915/5317] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:26 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1319 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:27.288711 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-d93a5f46-ac06-48dc-8993-4c764e28a683 req-66730c9b-7f54-42a1-9902-2be9fda38980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe58088-9c6f-4974-a8be-d8a436744d4e", "name": "network-vif-plugged", "status": "completed", "tag": "8f1ff312-0dba-4e4b-b184-be951861cee0"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:27.323956 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-d93a5f46-ac06-48dc-8993-4c764e28a683 req-66730c9b-7f54-42a1-9902-2be9fda38980 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:27.325239 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-d93a5f46-ac06-48dc-8993-4c764e28a683 req-66730c9b-7f54-42a1-9902-2be9fda38980 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:27.353255 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-d93a5f46-ac06-48dc-8993-4c764e28a683 req-66730c9b-7f54-42a1-9902-2be9fda38980 service nova] Creating event network-vif-plugged:8f1ff312-0dba-4e4b-b184-be951861cee0 for instance 7fe58088-9c6f-4974-a8be-d8a436744d4e on n-h1-826756-3 Jul 28 04:07:27.371168 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-d93a5f46-ac06-48dc-8993-4c764e28a683 req-66730c9b-7f54-42a1-9902-2be9fda38980 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.667588 Jul 28 04:07:27.372005 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2403/5318] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:28.233174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9cee3cbb-4c82-4d7c-bdb1-2021d8a49eec tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:28.233798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9cee3cbb-4c82-4d7c-bdb1-2021d8a49eec tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:28.253318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cee3cbb-4c82-4d7c-bdb1-2021d8a49eec tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:28.257288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cee3cbb-4c82-4d7c-bdb1-2021d8a49eec tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:28.258248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cee3cbb-4c82-4d7c-bdb1-2021d8a49eec tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:28.258705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cee3cbb-4c82-4d7c-bdb1-2021d8a49eec tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:28.743050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9cee3cbb-4c82-4d7c-bdb1-2021d8a49eec tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:28.761945 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9cee3cbb-4c82-4d7c-bdb1-2021d8a49eec tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1319 microversion: 2.1 time: 0.531503 Jul 28 04:07:28.763999 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2916/5319] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:28 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1319 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:29.399270 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-bba05024-71f6-4ef2-8580-658bd02feacd req-df3aa3f7-5505-4403-8528-e72e46010edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fec99c-1704-4638-905d-cb19c64aab7a", "name": "network-vif-plugged", "status": "completed", "tag": "c6277b33-7de9-40dc-bb06-644767fb97a5"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:29.447861 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-bba05024-71f6-4ef2-8580-658bd02feacd req-df3aa3f7-5505-4403-8528-e72e46010edf service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:29.448314 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-bba05024-71f6-4ef2-8580-658bd02feacd req-df3aa3f7-5505-4403-8528-e72e46010edf service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:29.488536 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-bba05024-71f6-4ef2-8580-658bd02feacd req-df3aa3f7-5505-4403-8528-e72e46010edf service nova] Creating event network-vif-plugged:c6277b33-7de9-40dc-bb06-644767fb97a5 for instance e1fec99c-1704-4638-905d-cb19c64aab7a on n-h2-826756-3 Jul 28 04:07:29.508003 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-bba05024-71f6-4ef2-8580-658bd02feacd req-df3aa3f7-5505-4403-8528-e72e46010edf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114250 Jul 28 04:07:29.513699 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2404/5320] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:29.783475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a2ece5e-53a6-47fe-917c-0db6a5fb4b53 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:29.784187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9a2ece5e-53a6-47fe-917c-0db6a5fb4b53 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:29.802909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a2ece5e-53a6-47fe-917c-0db6a5fb4b53 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:29.806081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a2ece5e-53a6-47fe-917c-0db6a5fb4b53 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:29.807149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a2ece5e-53a6-47fe-917c-0db6a5fb4b53 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:29.809241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a2ece5e-53a6-47fe-917c-0db6a5fb4b53 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:30.191100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9a2ece5e-53a6-47fe-917c-0db6a5fb4b53 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:30.214910 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9a2ece5e-53a6-47fe-917c-0db6a5fb4b53 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1319 microversion: 2.1 time: 0.433788 Jul 28 04:07:30.216010 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2917/5321] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:29 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:31.240155 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-ce6b6a71-b8ea-4cf4-a819-a6b7eb568558 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:31.241846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-ce6b6a71-b8ea-4cf4-a819-a6b7eb568558 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:31.254109 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce6b6a71-b8ea-4cf4-a819-a6b7eb568558 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:31.259119 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce6b6a71-b8ea-4cf4-a819-a6b7eb568558 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:31.260378 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce6b6a71-b8ea-4cf4-a819-a6b7eb568558 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:31.263162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-ce6b6a71-b8ea-4cf4-a819-a6b7eb568558 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:32.080259 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-ce6b6a71-b8ea-4cf4-a819-a6b7eb568558 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:32.101971 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-ce6b6a71-b8ea-4cf4-a819-a6b7eb568558 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1319 microversion: 2.1 time: 0.864144 Jul 28 04:07:32.119139 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2405/5322] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:31 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1319 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:33.128088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-496683bb-f381-4eed-9dff-cae16386bfc4 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:33.129467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-496683bb-f381-4eed-9dff-cae16386bfc4 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:33.147341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:33.158157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-496683bb-f381-4eed-9dff-cae16386bfc4 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:33.158970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-496683bb-f381-4eed-9dff-cae16386bfc4 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:33.164392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-496683bb-f381-4eed-9dff-cae16386bfc4 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:33.165079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-496683bb-f381-4eed-9dff-cae16386bfc4 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:34.320315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-496683bb-f381-4eed-9dff-cae16386bfc4 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:34.329024 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-496683bb-f381-4eed-9dff-cae16386bfc4 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 200 len: 1506 microversion: 2.1 time: 1.206912 Jul 28 04:07:34.329625 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2918/5323] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:33 2022] GET /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 1506 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:34.357791 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-36601a25-0ac3-444a-9e9c-89bf065b2939 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:34.360934 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-36601a25-0ac3-444a-9e9c-89bf065b2939 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: 7fe58088-9c6f-4974-a8be-d8a436744d4e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:34.377875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-36601a25-0ac3-444a-9e9c-89bf065b2939 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:34.378680 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-36601a25-0ac3-444a-9e9c-89bf065b2939 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:34.381731 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-36601a25-0ac3-444a-9e9c-89bf065b2939 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:34.382760 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-36601a25-0ac3-444a-9e9c-89bf065b2939 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:34.871582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-36601a25-0ac3-444a-9e9c-89bf065b2939 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:34.890115 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-36601a25-0ac3-444a-9e9c-89bf065b2939 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/7fe58088-9c6f-4974-a8be-d8a436744d4e" status: 200 len: 1507 microversion: 2.1 time: 0.541618 Jul 28 04:07:34.890728 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2406/5324] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:34 2022] GET /compute/v2.1/servers/7fe58088-9c6f-4974-a8be-d8a436744d4e => generated 1507 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:34.915763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-154dcc64-93dd-4c44-acdd-56a9b6edc2cf tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:34.916519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-154dcc64-93dd-4c44-acdd-56a9b6edc2cf tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: 7fe58088-9c6f-4974-a8be-d8a436744d4e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:34.928987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-154dcc64-93dd-4c44-acdd-56a9b6edc2cf tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:34.932543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-154dcc64-93dd-4c44-acdd-56a9b6edc2cf tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:34.933573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-154dcc64-93dd-4c44-acdd-56a9b6edc2cf tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:34.934036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-154dcc64-93dd-4c44-acdd-56a9b6edc2cf tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:34.986676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-154dcc64-93dd-4c44-acdd-56a9b6edc2cf tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: 7fe58088-9c6f-4974-a8be-d8a436744d4e] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:07:35.241238 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-154dcc64-93dd-4c44-acdd-56a9b6edc2cf tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7fe58088-9c6f-4974-a8be-d8a436744d4e" status: 204 len: 0 microversion: 2.1 time: 0.328655 Jul 28 04:07:35.248087 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2919/5325] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:07:34 2022] DELETE /compute/v2.1/servers/7fe58088-9c6f-4974-a8be-d8a436744d4e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:07:35.251749 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-39f4b78b-d447-4433-a8dd-dbfd1ae974bb tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:35.252490 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-39f4b78b-d447-4433-a8dd-dbfd1ae974bb tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:35.256903 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:35.271830 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39f4b78b-d447-4433-a8dd-dbfd1ae974bb tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:35.272462 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39f4b78b-d447-4433-a8dd-dbfd1ae974bb tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:35.283727 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39f4b78b-d447-4433-a8dd-dbfd1ae974bb tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:35.284192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-39f4b78b-d447-4433-a8dd-dbfd1ae974bb tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:35.407019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-39f4b78b-d447-4433-a8dd-dbfd1ae974bb tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: e1fec99c-1704-4638-905d-cb19c64aab7a] Going to try to terminate instance {{(pid=126072) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:07:35.667589 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-39f4b78b-d447-4433-a8dd-dbfd1ae974bb tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a" status: 204 len: 0 microversion: 2.1 time: 0.419573 Jul 28 04:07:35.668222 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2407/5326] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:07:35 2022] DELETE /compute/v2.1/servers/e1fec99c-1704-4638-905d-cb19c64aab7a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:07:35.958242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-744064015", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "89d830b8-ba77-4dd2-a6c3-b47f1d8ced84"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:36.091009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] validate_networks() for [('89d830b8-ba77-4dd2-a6c3-b47f1d8ced84', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:07:37.421289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-e2ca57a2-020c-4188-86ee-e29d2caa88a2 req-8d0c7eb2-8d7b-40e6-ab42-37b38b0239f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe58088-9c6f-4974-a8be-d8a436744d4e", "name": "network-vif-deleted", "tag": "8f1ff312-0dba-4e4b-b184-be951861cee0"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:37.441307 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e2ca57a2-020c-4188-86ee-e29d2caa88a2 req-8d0c7eb2-8d7b-40e6-ab42-37b38b0239f9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:37.442191 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-e2ca57a2-020c-4188-86ee-e29d2caa88a2 req-8d0c7eb2-8d7b-40e6-ab42-37b38b0239f9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:37.483996 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-e2ca57a2-020c-4188-86ee-e29d2caa88a2 req-8d0c7eb2-8d7b-40e6-ab42-37b38b0239f9 service nova] Creating event network-vif-deleted:8f1ff312-0dba-4e4b-b184-be951861cee0 for instance 7fe58088-9c6f-4974-a8be-d8a436744d4e on n-h1-826756-3 Jul 28 04:07:37.495752 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-e2ca57a2-020c-4188-86ee-e29d2caa88a2 req-8d0c7eb2-8d7b-40e6-ab42-37b38b0239f9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076630 Jul 28 04:07:37.496957 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2408/5327] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:39.520051 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-1238203f-563e-47b5-a774-ac2d01fe031f req-afb17335-090b-42e2-bbeb-7fee03568c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1fec99c-1704-4638-905d-cb19c64aab7a", "name": "network-vif-deleted", "tag": "c6277b33-7de9-40dc-bb06-644767fb97a5"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:39.560752 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1238203f-563e-47b5-a774-ac2d01fe031f req-afb17335-090b-42e2-bbeb-7fee03568c26 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:39.565180 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-1238203f-563e-47b5-a774-ac2d01fe031f req-afb17335-090b-42e2-bbeb-7fee03568c26 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:39.600072 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-1238203f-563e-47b5-a774-ac2d01fe031f req-afb17335-090b-42e2-bbeb-7fee03568c26 service nova] Creating event network-vif-deleted:c6277b33-7de9-40dc-bb06-644767fb97a5 for instance e1fec99c-1704-4638-905d-cb19c64aab7a on n-h2-826756-3 Jul 28 04:07:39.606115 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-1238203f-563e-47b5-a774-ac2d01fe031f req-afb17335-090b-42e2-bbeb-7fee03568c26 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091318 Jul 28 04:07:39.612269 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2409/5328] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:40.616312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:07:40.616910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:07:40.617498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:07:40.618021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:07:40.618557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:07:40.641525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:40.645340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:40.646365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:40.648174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:40.719695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Getting quotas for project ba8f8ab85fef40e180ac94560a25cac4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:07:40.733326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Getting quotas for user 2bd5450439494a0dbf4f0927461a07a4 and project ba8f8ab85fef40e180ac94560a25cac4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:07:40.787362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Going to run 2 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:07:40.790054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: 0882b936-ae38-4478-b9c3-d594e900b1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:07:40.937364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=0882b936-ae38-4478-b9c3-d594e900b1d3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:07:41.088221 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40e55903-99f7-43fc-9a17-73fe46566897 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 5.130871 Jul 28 04:07:41.111974 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c22f9892-c057-4687-97b6-93c43a57c3b3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:41.112578 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2920/5329] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:07:35 2022] POST /compute/v2.1/servers => generated 32 bytes in 5152 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 28 04:07:41.125349 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c22f9892-c057-4687-97b6-93c43a57c3b3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:41.132818 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c22f9892-c057-4687-97b6-93c43a57c3b3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Searching by: {'deleted': False, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4'} {{(pid=126072) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 04:07:41.218084 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c22f9892-c057-4687-97b6-93c43a57c3b3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:41.222075 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c22f9892-c057-4687-97b6-93c43a57c3b3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:41.223067 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c22f9892-c057-4687-97b6-93c43a57c3b3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:41.223407 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c22f9892-c057-4687-97b6-93c43a57c3b3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:41.377416 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c22f9892-c057-4687-97b6-93c43a57c3b3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 671 microversion: 2.1 time: 0.264005 Jul 28 04:07:41.378855 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2410/5330] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 04:07:41 2022] GET /compute/v2.1/servers => generated 671 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:41.393024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e1c5743-252e-41b4-be6a-f81cf595424e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:41.393781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e1c5743-252e-41b4-be6a-f81cf595424e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:41.758959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e1c5743-252e-41b4-be6a-f81cf595424e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:41.788814 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e1c5743-252e-41b4-be6a-f81cf595424e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1217 microversion: 2.1 time: 0.401448 Jul 28 04:07:41.808608 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2921/5331] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:41 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1217 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:07:42.816646 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2c673bc9-444c-406d-a098-91756af856be tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:42.819210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2c673bc9-444c-406d-a098-91756af856be tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:43.104524 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2c673bc9-444c-406d-a098-91756af856be tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:43.114063 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2c673bc9-444c-406d-a098-91756af856be tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1217 microversion: 2.1 time: 0.303291 Jul 28 04:07:43.117713 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2411/5332] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:42 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1217 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:44.139169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2da3eeb-f0dd-4130-9f02-6251b3d93d23 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:44.139679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2da3eeb-f0dd-4130-9f02-6251b3d93d23 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:44.152518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2da3eeb-f0dd-4130-9f02-6251b3d93d23 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:44.152961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2da3eeb-f0dd-4130-9f02-6251b3d93d23 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:44.153787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2da3eeb-f0dd-4130-9f02-6251b3d93d23 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:44.154486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2da3eeb-f0dd-4130-9f02-6251b3d93d23 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:44.362208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b2da3eeb-f0dd-4130-9f02-6251b3d93d23 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:44.388864 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b2da3eeb-f0dd-4130-9f02-6251b3d93d23 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1269 microversion: 2.1 time: 0.252359 Jul 28 04:07:44.389510 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2922/5333] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:44 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1269 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:45.423092 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-03a10908-114c-465d-aa8a-975bb99c8f10 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:45.424402 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-03a10908-114c-465d-aa8a-975bb99c8f10 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:45.450163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03a10908-114c-465d-aa8a-975bb99c8f10 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:45.451255 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03a10908-114c-465d-aa8a-975bb99c8f10 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:45.452251 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03a10908-114c-465d-aa8a-975bb99c8f10 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:45.471260 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-03a10908-114c-465d-aa8a-975bb99c8f10 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:45.484530 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:45.939123 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-03a10908-114c-465d-aa8a-975bb99c8f10 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:45.957113 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-03a10908-114c-465d-aa8a-975bb99c8f10 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1275 microversion: 2.1 time: 0.547183 Jul 28 04:07:45.961107 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2412/5334] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:45 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1275 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:07:45.988017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1577801830", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:46.103624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] validate_networks() for [('93888a19-c008-4d58-b562-71421173bc0c', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:07:46.989310 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-8351ea1c-77b6-46c7-9434-e2494f7781e9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:46.991132 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-8351ea1c-77b6-46c7-9434-e2494f7781e9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:47.042257 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8351ea1c-77b6-46c7-9434-e2494f7781e9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:47.046200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8351ea1c-77b6-46c7-9434-e2494f7781e9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:47.055864 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8351ea1c-77b6-46c7-9434-e2494f7781e9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:47.060547 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-8351ea1c-77b6-46c7-9434-e2494f7781e9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:47.118110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:07:47.118798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:07:47.119177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:07:47.119590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:07:47.120012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:07:47.155928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:47.156414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:47.157220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:47.157670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:47.249952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Getting quotas for project 404ce0264e584456bfc6b523e914c408. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:07:47.271954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Getting quotas for user 0083854f0de14631ad15751829e34537 and project 404ce0264e584456bfc6b523e914c408. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:07:47.311502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:07:47.319263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:07:47.465170 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b4bdbb2d-09a7-4009-8b70-7c83e23d2683 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.712829 Jul 28 04:07:47.466188 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2923/5335] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:07:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:07:47.477309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ac5a4430-8a81-4f16-b7a1-873e28f39d8f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:47.480486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ac5a4430-8a81-4f16-b7a1-873e28f39d8f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:47.696515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ac5a4430-8a81-4f16-b7a1-873e28f39d8f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:47.704885 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ac5a4430-8a81-4f16-b7a1-873e28f39d8f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1222 microversion: 2.1 time: 0.231543 Jul 28 04:07:47.719714 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2924/5336] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:47 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1222 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:07:48.081416 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-8351ea1c-77b6-46c7-9434-e2494f7781e9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:48.089942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1398063118", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:48.111062 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-8351ea1c-77b6-46c7-9434-e2494f7781e9 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1275 microversion: 2.1 time: 1.128940 Jul 28 04:07:48.111580 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2413/5337] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:46 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1275 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:48.219837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] validate_networks() for [('93888a19-c008-4d58-b562-71421173bc0c', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:07:49.138127 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-0e455240-3461-4a06-b753-e8d9b31117c3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:49.139518 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-0e455240-3461-4a06-b753-e8d9b31117c3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:49.172336 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e455240-3461-4a06-b753-e8d9b31117c3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:49.173115 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e455240-3461-4a06-b753-e8d9b31117c3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:49.175562 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e455240-3461-4a06-b753-e8d9b31117c3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:49.178057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-0e455240-3461-4a06-b753-e8d9b31117c3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:49.476477 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-0e455240-3461-4a06-b753-e8d9b31117c3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:49.496647 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-0e455240-3461-4a06-b753-e8d9b31117c3 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1275 microversion: 2.1 time: 0.359170 Jul 28 04:07:49.496647 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2414/5338] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:49 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1275 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:49.516048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:07:49.518273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:07:49.519007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:07:49.519643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:07:49.520291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:07:49.535081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:49.535921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:49.537004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:49.537781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:49.558586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Getting quotas for project 404ce0264e584456bfc6b523e914c408. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:07:49.565643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Getting quotas for user 0083854f0de14631ad15751829e34537 and project 404ce0264e584456bfc6b523e914c408. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:07:49.588444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:07:49.590930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:07:49.662825 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-322e97a6-b579-453a-90fe-81f0a4499c27 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.576640 Jul 28 04:07:49.663917 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2925/5339] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:07:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:07:49.675298 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-5cb5058b-0132-4f9c-9114-8eb21a1f7e87 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:49.676151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-5cb5058b-0132-4f9c-9114-8eb21a1f7e87 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:49.852901 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-5cb5058b-0132-4f9c-9114-8eb21a1f7e87 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:49.867147 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-5cb5058b-0132-4f9c-9114-8eb21a1f7e87 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1222 microversion: 2.1 time: 0.196223 Jul 28 04:07:49.871279 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2415/5340] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:49 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1222 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:50.531109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1f880fce-6629-4778-8259-d23166f1290e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:50.531664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1f880fce-6629-4778-8259-d23166f1290e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:50.567356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f880fce-6629-4778-8259-d23166f1290e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:50.570384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f880fce-6629-4778-8259-d23166f1290e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:50.574273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f880fce-6629-4778-8259-d23166f1290e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:50.575392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f880fce-6629-4778-8259-d23166f1290e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:50.799920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1f880fce-6629-4778-8259-d23166f1290e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:50.813406 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1f880fce-6629-4778-8259-d23166f1290e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1275 microversion: 2.1 time: 0.291007 Jul 28 04:07:50.827767 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2926/5341] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:50 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1275 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:50.887512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-838508a5-5fed-4f5e-afa4-1ed9fa34beea tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:50.888136 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-838508a5-5fed-4f5e-afa4-1ed9fa34beea tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:51.280685 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-838508a5-5fed-4f5e-afa4-1ed9fa34beea tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:51.310937 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=2 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:51.314866 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-838508a5-5fed-4f5e-afa4-1ed9fa34beea tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1222 microversion: 2.1 time: 0.431435 Jul 28 04:07:51.315642 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2416/5342] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:50 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1222 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:51.837206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2b21f662-eee6-4ad6-be63-4320e2379024 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:51.849417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2b21f662-eee6-4ad6-be63-4320e2379024 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:51.869050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b21f662-eee6-4ad6-be63-4320e2379024 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:51.872132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b21f662-eee6-4ad6-be63-4320e2379024 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:51.877931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b21f662-eee6-4ad6-be63-4320e2379024 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:51.878689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b21f662-eee6-4ad6-be63-4320e2379024 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:51.902906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:52.176492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2b21f662-eee6-4ad6-be63-4320e2379024 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:52.207419 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2b21f662-eee6-4ad6-be63-4320e2379024 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1275 microversion: 2.1 time: 0.375602 Jul 28 04:07:52.208886 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2927/5343] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:51 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1275 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:52.339140 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9afd1a8b-aefd-4dcd-b097-b42437a3f7c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:52.340316 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9afd1a8b-aefd-4dcd-b097-b42437a3f7c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:52.353771 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9afd1a8b-aefd-4dcd-b097-b42437a3f7c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:52.354233 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9afd1a8b-aefd-4dcd-b097-b42437a3f7c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:52.355001 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9afd1a8b-aefd-4dcd-b097-b42437a3f7c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:52.355446 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9afd1a8b-aefd-4dcd-b097-b42437a3f7c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:52.691744 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9afd1a8b-aefd-4dcd-b097-b42437a3f7c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:52.709539 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9afd1a8b-aefd-4dcd-b097-b42437a3f7c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1280 microversion: 2.1 time: 0.375978 Jul 28 04:07:52.710569 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2417/5344] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:52 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1280 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:07:53.232478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0fd0228a-862a-43b4-abf1-cd86b5b3dd7e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:53.233855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0fd0228a-862a-43b4-abf1-cd86b5b3dd7e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:53.246729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fd0228a-862a-43b4-abf1-cd86b5b3dd7e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:53.253735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fd0228a-862a-43b4-abf1-cd86b5b3dd7e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:53.254964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fd0228a-862a-43b4-abf1-cd86b5b3dd7e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:53.255674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fd0228a-862a-43b4-abf1-cd86b5b3dd7e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:53.731453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9a6d3f2e-8048-4b59-b391-2c4105f1e2c0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:53.732218 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9a6d3f2e-8048-4b59-b391-2c4105f1e2c0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:53.751416 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a6d3f2e-8048-4b59-b391-2c4105f1e2c0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:53.754014 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a6d3f2e-8048-4b59-b391-2c4105f1e2c0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:53.754925 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a6d3f2e-8048-4b59-b391-2c4105f1e2c0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:53.755372 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9a6d3f2e-8048-4b59-b391-2c4105f1e2c0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:53.961136 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9a6d3f2e-8048-4b59-b391-2c4105f1e2c0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:53.974266 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9a6d3f2e-8048-4b59-b391-2c4105f1e2c0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1280 microversion: 2.1 time: 0.247163 Jul 28 04:07:53.978980 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2418/5345] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:53 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:54.122918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0fd0228a-862a-43b4-abf1-cd86b5b3dd7e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:54.152325 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0fd0228a-862a-43b4-abf1-cd86b5b3dd7e tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1317 microversion: 2.1 time: 0.914830 Jul 28 04:07:54.154744 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2928/5346] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:53 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1317 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:54.997854 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3ebf5a4e-28c1-49f9-b49a-2ebb0b6eeb34 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:54.998506 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3ebf5a4e-28c1-49f9-b49a-2ebb0b6eeb34 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:55.021274 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ebf5a4e-28c1-49f9-b49a-2ebb0b6eeb34 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:55.022028 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ebf5a4e-28c1-49f9-b49a-2ebb0b6eeb34 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:55.023024 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ebf5a4e-28c1-49f9-b49a-2ebb0b6eeb34 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:55.023863 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3ebf5a4e-28c1-49f9-b49a-2ebb0b6eeb34 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:55.181329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7562ae76-0191-4fb6-af67-f020fca2250d tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:55.182553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7562ae76-0191-4fb6-af67-f020fca2250d tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:55.198143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7562ae76-0191-4fb6-af67-f020fca2250d tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:55.203819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7562ae76-0191-4fb6-af67-f020fca2250d tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:55.206136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7562ae76-0191-4fb6-af67-f020fca2250d tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:55.209145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7562ae76-0191-4fb6-af67-f020fca2250d tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:55.637592 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3ebf5a4e-28c1-49f9-b49a-2ebb0b6eeb34 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:55.667577 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3ebf5a4e-28c1-49f9-b49a-2ebb0b6eeb34 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1280 microversion: 2.1 time: 0.655878 Jul 28 04:07:55.668967 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2419/5347] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:54 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1280 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:56.067842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7562ae76-0191-4fb6-af67-f020fca2250d tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:56.095801 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7562ae76-0191-4fb6-af67-f020fca2250d tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1317 microversion: 2.1 time: 0.915562 Jul 28 04:07:56.096536 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2929/5348] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:55 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1317 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:07:56.691339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-97830d92-9a21-40d1-96d1-06360271552f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:56.691968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-97830d92-9a21-40d1-96d1-06360271552f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:56.707317 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-97830d92-9a21-40d1-96d1-06360271552f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:56.708141 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-97830d92-9a21-40d1-96d1-06360271552f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:56.716682 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-97830d92-9a21-40d1-96d1-06360271552f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:56.717269 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-97830d92-9a21-40d1-96d1-06360271552f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:57.117061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e2910084-595f-453f-87bc-f05a0437ef37 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:57.117670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e2910084-595f-453f-87bc-f05a0437ef37 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:57.138873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2910084-595f-453f-87bc-f05a0437ef37 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:57.139709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2910084-595f-453f-87bc-f05a0437ef37 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:57.140753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2910084-595f-453f-87bc-f05a0437ef37 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:57.149171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2910084-595f-453f-87bc-f05a0437ef37 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:57.541340 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-97830d92-9a21-40d1-96d1-06360271552f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:57.553315 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-97830d92-9a21-40d1-96d1-06360271552f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1280 microversion: 2.1 time: 0.863690 Jul 28 04:07:57.554050 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2420/5349] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:56 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1280 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:57.682130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e2910084-595f-453f-87bc-f05a0437ef37 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:57.741505 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e2910084-595f-453f-87bc-f05a0437ef37 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1317 microversion: 2.1 time: 0.628224 Jul 28 04:07:57.742161 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2930/5350] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:57 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1317 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:07:58.526975 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-52294360-009c-4716-aef5-e412088de513 req-4d08565a-d57f-4455-934a-aed2b77aac1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0882b936-ae38-4478-b9c3-d594e900b1d3", "tag": "533f3bee-6a4e-48a0-985a-ca82b98faed8"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:58.554339 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-52294360-009c-4716-aef5-e412088de513 req-4d08565a-d57f-4455-934a-aed2b77aac1b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:58.555151 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-52294360-009c-4716-aef5-e412088de513 req-4d08565a-d57f-4455-934a-aed2b77aac1b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:58.575680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e92d94d-cfcd-487a-8529-3942bf51e394 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:58.576993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4e92d94d-cfcd-487a-8529-3942bf51e394 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:58.596794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e92d94d-cfcd-487a-8529-3942bf51e394 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:58.599462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e92d94d-cfcd-487a-8529-3942bf51e394 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:58.605874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e92d94d-cfcd-487a-8529-3942bf51e394 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:58.609759 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-52294360-009c-4716-aef5-e412088de513 req-4d08565a-d57f-4455-934a-aed2b77aac1b service nova] Creating event network-changed:533f3bee-6a4e-48a0-985a-ca82b98faed8 for instance 0882b936-ae38-4478-b9c3-d594e900b1d3 on n-h1-826756-3 Jul 28 04:07:58.610487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e92d94d-cfcd-487a-8529-3942bf51e394 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:58.631429 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-52294360-009c-4716-aef5-e412088de513 req-4d08565a-d57f-4455-934a-aed2b77aac1b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108025 Jul 28 04:07:58.634010 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2421/5351] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:58.763614 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c2e32635-98d9-4f9c-b101-7eeb64964d72 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:58.764732 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c2e32635-98d9-4f9c-b101-7eeb64964d72 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:07:58.785191 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2e32635-98d9-4f9c-b101-7eeb64964d72 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:58.787154 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2e32635-98d9-4f9c-b101-7eeb64964d72 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:58.788397 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2e32635-98d9-4f9c-b101-7eeb64964d72 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:58.792450 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c2e32635-98d9-4f9c-b101-7eeb64964d72 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:59.159278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e92d94d-cfcd-487a-8529-3942bf51e394 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:59.170327 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e92d94d-cfcd-487a-8529-3942bf51e394 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1322 microversion: 2.1 time: 0.599777 Jul 28 04:07:59.178679 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2931/5352] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:58 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:59.960704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c2e32635-98d9-4f9c-b101-7eeb64964d72 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:59.968961 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c2e32635-98d9-4f9c-b101-7eeb64964d72 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1317 microversion: 2.1 time: 1.209853 Jul 28 04:07:59.969564 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2422/5353] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:58 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1317 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:00.199027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-faa820c9-304a-412e-84d5-dd1b829ec662 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:00.199651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-faa820c9-304a-412e-84d5-dd1b829ec662 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:00.208808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:00.211920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=22 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:00.221795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faa820c9-304a-412e-84d5-dd1b829ec662 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:00.222539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faa820c9-304a-412e-84d5-dd1b829ec662 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:00.223532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faa820c9-304a-412e-84d5-dd1b829ec662 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:00.225185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faa820c9-304a-412e-84d5-dd1b829ec662 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:00.754989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-faa820c9-304a-412e-84d5-dd1b829ec662 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:00.769662 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-faa820c9-304a-412e-84d5-dd1b829ec662 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1322 microversion: 2.1 time: 0.571828 Jul 28 04:08:00.773063 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2932/5354] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:00 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1322 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:00.993275 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-d001c14e-df4a-4140-9faf-9c76ba24aa34 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:00.994651 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-d001c14e-df4a-4140-9faf-9c76ba24aa34 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:01.007371 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d001c14e-df4a-4140-9faf-9c76ba24aa34 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:01.008299 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d001c14e-df4a-4140-9faf-9c76ba24aa34 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:01.009337 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d001c14e-df4a-4140-9faf-9c76ba24aa34 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:01.020046 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-d001c14e-df4a-4140-9faf-9c76ba24aa34 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:01.312081 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell0:SELECT=6 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:01.573229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-67b5c434-6d9e-4e18-baf9-c5af4e2cbb66 req-0285e227-c0e2-4826-808d-03188aab8022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc17b242-9f90-4d82-9fe8-1b7d4e013717", "tag": "da891fb8-c2bf-4222-a80a-a90187b73ca3"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:01.589354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-67b5c434-6d9e-4e18-baf9-c5af4e2cbb66 req-0285e227-c0e2-4826-808d-03188aab8022 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:01.593448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-67b5c434-6d9e-4e18-baf9-c5af4e2cbb66 req-0285e227-c0e2-4826-808d-03188aab8022 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:01.642138 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-67b5c434-6d9e-4e18-baf9-c5af4e2cbb66 req-0285e227-c0e2-4826-808d-03188aab8022 service nova] Creating event network-changed:da891fb8-c2bf-4222-a80a-a90187b73ca3 for instance bc17b242-9f90-4d82-9fe8-1b7d4e013717 on n-h2-826756-3 Jul 28 04:08:01.665489 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-67b5c434-6d9e-4e18-baf9-c5af4e2cbb66 req-0285e227-c0e2-4826-808d-03188aab8022 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096150 Jul 28 04:08:01.666451 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2933/5355] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:01.796482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9b3a33f9-185d-4570-af43-d2353f2458fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:01.797344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9b3a33f9-185d-4570-af43-d2353f2458fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:01.808780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b3a33f9-185d-4570-af43-d2353f2458fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:01.809235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b3a33f9-185d-4570-af43-d2353f2458fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:01.810028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b3a33f9-185d-4570-af43-d2353f2458fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:01.810457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b3a33f9-185d-4570-af43-d2353f2458fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:02.466482 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-d001c14e-df4a-4140-9faf-9c76ba24aa34 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:02.480644 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-d001c14e-df4a-4140-9faf-9c76ba24aa34 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1317 microversion: 2.1 time: 1.483553 Jul 28 04:08:02.481437 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2423/5356] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:00 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1317 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:02.557263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9b3a33f9-185d-4570-af43-d2353f2458fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:02.590106 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9b3a33f9-185d-4570-af43-d2353f2458fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1322 microversion: 2.1 time: 0.792350 Jul 28 04:08:02.591403 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2934/5357] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:01 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1322 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:03.501661 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c6fb0fae-6389-4db4-a8c9-842f8797543f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:03.502291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c6fb0fae-6389-4db4-a8c9-842f8797543f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:03.518689 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6fb0fae-6389-4db4-a8c9-842f8797543f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:03.519162 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6fb0fae-6389-4db4-a8c9-842f8797543f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:03.519955 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6fb0fae-6389-4db4-a8c9-842f8797543f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:03.523029 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c6fb0fae-6389-4db4-a8c9-842f8797543f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:03.610831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7e093519-fff8-45ff-8e47-0680bf7d4058 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:03.611451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7e093519-fff8-45ff-8e47-0680bf7d4058 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:03.617898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:03.626084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e093519-fff8-45ff-8e47-0680bf7d4058 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:03.626727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e093519-fff8-45ff-8e47-0680bf7d4058 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:03.643558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e093519-fff8-45ff-8e47-0680bf7d4058 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:03.644481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e093519-fff8-45ff-8e47-0680bf7d4058 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:04.061729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7e093519-fff8-45ff-8e47-0680bf7d4058 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:04.081064 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7e093519-fff8-45ff-8e47-0680bf7d4058 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1322 microversion: 2.1 time: 0.472484 Jul 28 04:08:04.098222 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2935/5358] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:03 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1322 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:04.109511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-80f9cea5-71b4-485d-b4cd-a82bd69570eb req-5b2bc60c-e8cd-40db-b60b-ac07c361d150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b6d7c1-b65f-465c-97d1-fe40465a3321", "tag": "c05ec157-6086-4d52-a5b3-5be3fab3ce01"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:04.138208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-80f9cea5-71b4-485d-b4cd-a82bd69570eb req-5b2bc60c-e8cd-40db-b60b-ac07c361d150 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:04.138695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-80f9cea5-71b4-485d-b4cd-a82bd69570eb req-5b2bc60c-e8cd-40db-b60b-ac07c361d150 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:04.165611 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-80f9cea5-71b4-485d-b4cd-a82bd69570eb req-5b2bc60c-e8cd-40db-b60b-ac07c361d150 service nova] Creating event network-changed:c05ec157-6086-4d52-a5b3-5be3fab3ce01 for instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 on n-h2-826756-3 Jul 28 04:08:04.177290 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-80f9cea5-71b4-485d-b4cd-a82bd69570eb req-5b2bc60c-e8cd-40db-b60b-ac07c361d150 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074181 Jul 28 04:08:04.178254 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2936/5359] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:05.075305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c6fb0fae-6389-4db4-a8c9-842f8797543f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:05.094028 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c6fb0fae-6389-4db4-a8c9-842f8797543f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1317 microversion: 2.1 time: 1.596383 Jul 28 04:08:05.094795 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2424/5360] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:03 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1317 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:05.125963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-260270fc-8579-444d-b1a5-ad00addcc8e0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:05.126778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-260270fc-8579-444d-b1a5-ad00addcc8e0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:05.135945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-260270fc-8579-444d-b1a5-ad00addcc8e0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:05.136726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-260270fc-8579-444d-b1a5-ad00addcc8e0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:05.137907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-260270fc-8579-444d-b1a5-ad00addcc8e0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:05.138555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-260270fc-8579-444d-b1a5-ad00addcc8e0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:05.526080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-260270fc-8579-444d-b1a5-ad00addcc8e0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:05.558235 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-260270fc-8579-444d-b1a5-ad00addcc8e0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1322 microversion: 2.1 time: 0.434814 Jul 28 04:08:05.578164 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2937/5361] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:05 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1322 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:06.121906 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-24c9cfa4-0754-44f9-8f1c-7c65829cfa85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:06.123163 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-24c9cfa4-0754-44f9-8f1c-7c65829cfa85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:06.133166 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:06.145057 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24c9cfa4-0754-44f9-8f1c-7c65829cfa85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:06.147038 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24c9cfa4-0754-44f9-8f1c-7c65829cfa85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:06.148924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24c9cfa4-0754-44f9-8f1c-7c65829cfa85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:06.149897 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-24c9cfa4-0754-44f9-8f1c-7c65829cfa85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:06.222386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9eb31fe7-3a07-4639-b0b3-44beff2dbb07 req-f1b1a50b-c88c-4ef4-9df2-6e2337bb8ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0882b936-ae38-4478-b9c3-d594e900b1d3", "name": "network-vif-plugged", "status": "completed", "tag": "533f3bee-6a4e-48a0-985a-ca82b98faed8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:06.252818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9eb31fe7-3a07-4639-b0b3-44beff2dbb07 req-f1b1a50b-c88c-4ef4-9df2-6e2337bb8ab1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:06.253278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9eb31fe7-3a07-4639-b0b3-44beff2dbb07 req-f1b1a50b-c88c-4ef4-9df2-6e2337bb8ab1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:06.312440 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9eb31fe7-3a07-4639-b0b3-44beff2dbb07 req-f1b1a50b-c88c-4ef4-9df2-6e2337bb8ab1 service nova] Creating event network-vif-plugged:533f3bee-6a4e-48a0-985a-ca82b98faed8 for instance 0882b936-ae38-4478-b9c3-d594e900b1d3 on n-h1-826756-3 Jul 28 04:08:06.329418 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9eb31fe7-3a07-4639-b0b3-44beff2dbb07 req-f1b1a50b-c88c-4ef4-9df2-6e2337bb8ab1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106303 Jul 28 04:08:06.332801 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2938/5362] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:06.376484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-19e87fc7-2542-4a82-9e7e-14dfe2e5a8b4 req-98f1e06e-c7ca-4959-ac36-2a6bcae0d3ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3e85786-076b-4d13-bdb2-31d5441af52e", "tag": "3d453000-6aeb-4a83-b405-0132af142085"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:06.432378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-19e87fc7-2542-4a82-9e7e-14dfe2e5a8b4 req-98f1e06e-c7ca-4959-ac36-2a6bcae0d3ce service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:06.432378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-19e87fc7-2542-4a82-9e7e-14dfe2e5a8b4 req-98f1e06e-c7ca-4959-ac36-2a6bcae0d3ce service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:06.453825 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-19e87fc7-2542-4a82-9e7e-14dfe2e5a8b4 req-98f1e06e-c7ca-4959-ac36-2a6bcae0d3ce service nova] Creating event network-changed:3d453000-6aeb-4a83-b405-0132af142085 for instance b3e85786-076b-4d13-bdb2-31d5441af52e on n-h1-826756-3 Jul 28 04:08:06.466228 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-19e87fc7-2542-4a82-9e7e-14dfe2e5a8b4 req-98f1e06e-c7ca-4959-ac36-2a6bcae0d3ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117611 Jul 28 04:08:06.471973 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2939/5363] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:06.585761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1aa076ee-b1fa-471b-a7d1-585e36b782be tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:06.586616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1aa076ee-b1fa-471b-a7d1-585e36b782be tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:06.638873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1aa076ee-b1fa-471b-a7d1-585e36b782be tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:06.642086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1aa076ee-b1fa-471b-a7d1-585e36b782be tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:06.649550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1aa076ee-b1fa-471b-a7d1-585e36b782be tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:06.661550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1aa076ee-b1fa-471b-a7d1-585e36b782be tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:06.919860 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-24c9cfa4-0754-44f9-8f1c-7c65829cfa85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:06.935507 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-24c9cfa4-0754-44f9-8f1c-7c65829cfa85 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1317 microversion: 2.1 time: 0.818008 Jul 28 04:08:06.939496 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2425/5364] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:06 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1317 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:06.979497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1aa076ee-b1fa-471b-a7d1-585e36b782be tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:07.000653 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1aa076ee-b1fa-471b-a7d1-585e36b782be tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1322 microversion: 2.1 time: 0.409407 Jul 28 04:08:07.001345 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2940/5365] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:06 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:07.963496 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-87b31833-d757-4a74-a8dc-c7d32e4b2952 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:07.964093 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-87b31833-d757-4a74-a8dc-c7d32e4b2952 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:07.975289 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-87b31833-d757-4a74-a8dc-c7d32e4b2952 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:07.975741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-87b31833-d757-4a74-a8dc-c7d32e4b2952 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:07.977673 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-87b31833-d757-4a74-a8dc-c7d32e4b2952 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:07.978823 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-87b31833-d757-4a74-a8dc-c7d32e4b2952 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:08.023596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-281e70e5-dfa5-4ba1-b6eb-b9ed463314ec tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:08.024578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-281e70e5-dfa5-4ba1-b6eb-b9ed463314ec tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:08.039947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-281e70e5-dfa5-4ba1-b6eb-b9ed463314ec tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:08.039947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-281e70e5-dfa5-4ba1-b6eb-b9ed463314ec tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:08.039947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-281e70e5-dfa5-4ba1-b6eb-b9ed463314ec tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:08.039947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-281e70e5-dfa5-4ba1-b6eb-b9ed463314ec tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:08.337821 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-87b31833-d757-4a74-a8dc-c7d32e4b2952 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:08.343111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-281e70e5-dfa5-4ba1-b6eb-b9ed463314ec tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:08.350131 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-87b31833-d757-4a74-a8dc-c7d32e4b2952 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1317 microversion: 2.1 time: 0.391670 Jul 28 04:08:08.352650 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2426/5366] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:07 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:08.356532 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-281e70e5-dfa5-4ba1-b6eb-b9ed463314ec tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1322 microversion: 2.1 time: 0.338310 Jul 28 04:08:08.368399 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2941/5367] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:08 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:09.379707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-004806ea-f309-45b1-beef-230891b0f411 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:09.381121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-004806ea-f309-45b1-beef-230891b0f411 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:09.386271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-27ccfbcd-cd25-4b69-ba0b-0a8dd0282781 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:09.387851 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-27ccfbcd-cd25-4b69-ba0b-0a8dd0282781 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:09.404391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-004806ea-f309-45b1-beef-230891b0f411 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:09.412223 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27ccfbcd-cd25-4b69-ba0b-0a8dd0282781 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:09.414204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-004806ea-f309-45b1-beef-230891b0f411 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:09.415450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-004806ea-f309-45b1-beef-230891b0f411 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:09.415868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-004806ea-f309-45b1-beef-230891b0f411 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:09.422714 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27ccfbcd-cd25-4b69-ba0b-0a8dd0282781 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:09.423568 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27ccfbcd-cd25-4b69-ba0b-0a8dd0282781 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:09.424011 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-27ccfbcd-cd25-4b69-ba0b-0a8dd0282781 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:09.839494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-004806ea-f309-45b1-beef-230891b0f411 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:09.892235 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-004806ea-f309-45b1-beef-230891b0f411 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1322 microversion: 2.1 time: 0.516344 Jul 28 04:08:09.900227 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2942/5368] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:09 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:10.371384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-27ccfbcd-cd25-4b69-ba0b-0a8dd0282781 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:10.425039 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-27ccfbcd-cd25-4b69-ba0b-0a8dd0282781 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1317 microversion: 2.1 time: 1.055553 Jul 28 04:08:10.428817 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2427/5369] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:09 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1317 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:10.916476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-493c5c13-0d42-4a5e-98d0-2b118ced0365 req-dc04c7f8-0dde-4021-97ed-a5f47983235c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc17b242-9f90-4d82-9fe8-1b7d4e013717", "name": "network-vif-plugged", "status": "completed", "tag": "da891fb8-c2bf-4222-a80a-a90187b73ca3"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:10.918469 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-1d04b621-c0c6-485b-ac76-67974413cbfb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:10.926857 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-1d04b621-c0c6-485b-ac76-67974413cbfb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:10.958871 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1d04b621-c0c6-485b-ac76-67974413cbfb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:10.959748 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1d04b621-c0c6-485b-ac76-67974413cbfb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:10.960846 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1d04b621-c0c6-485b-ac76-67974413cbfb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:10.961742 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-1d04b621-c0c6-485b-ac76-67974413cbfb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:10.969730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-493c5c13-0d42-4a5e-98d0-2b118ced0365 req-dc04c7f8-0dde-4021-97ed-a5f47983235c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:10.970208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-493c5c13-0d42-4a5e-98d0-2b118ced0365 req-dc04c7f8-0dde-4021-97ed-a5f47983235c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:11.012253 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-493c5c13-0d42-4a5e-98d0-2b118ced0365 req-dc04c7f8-0dde-4021-97ed-a5f47983235c service nova] Creating event network-vif-plugged:da891fb8-c2bf-4222-a80a-a90187b73ca3 for instance bc17b242-9f90-4d82-9fe8-1b7d4e013717 on n-h2-826756-3 Jul 28 04:08:11.018121 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-493c5c13-0d42-4a5e-98d0-2b118ced0365 req-dc04c7f8-0dde-4021-97ed-a5f47983235c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106836 Jul 28 04:08:11.028423 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2943/5370] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:11.450224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d63fd81-bdbf-4b6a-b70b-bfee0b000476 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:11.451333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d63fd81-bdbf-4b6a-b70b-bfee0b000476 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:11.463258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d63fd81-bdbf-4b6a-b70b-bfee0b000476 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:11.464100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d63fd81-bdbf-4b6a-b70b-bfee0b000476 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:11.465160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d63fd81-bdbf-4b6a-b70b-bfee0b000476 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:11.470161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d63fd81-bdbf-4b6a-b70b-bfee0b000476 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:11.664191 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-1d04b621-c0c6-485b-ac76-67974413cbfb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:11.679528 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-1d04b621-c0c6-485b-ac76-67974413cbfb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1322 microversion: 2.1 time: 0.765645 Jul 28 04:08:11.695885 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2428/5371] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:10 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1322 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:11.787599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9d63fd81-bdbf-4b6a-b70b-bfee0b000476 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:11.808593 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d63fd81-bdbf-4b6a-b70b-bfee0b000476 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1317 microversion: 2.1 time: 0.356858 Jul 28 04:08:11.811887 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2944/5372] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:11 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:12.705219 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-c9ba63a3-d001-4b97-a2c7-80fe149a917e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:12.705919 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-c9ba63a3-d001-4b97-a2c7-80fe149a917e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:12.728780 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9ba63a3-d001-4b97-a2c7-80fe149a917e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:12.730965 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9ba63a3-d001-4b97-a2c7-80fe149a917e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:12.732815 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9ba63a3-d001-4b97-a2c7-80fe149a917e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:12.734719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-c9ba63a3-d001-4b97-a2c7-80fe149a917e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:12.854603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dfa2c6b9-9fe8-443f-9cbe-839e767d4273 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:12.855799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dfa2c6b9-9fe8-443f-9cbe-839e767d4273 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:12.891364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfa2c6b9-9fe8-443f-9cbe-839e767d4273 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:12.895406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfa2c6b9-9fe8-443f-9cbe-839e767d4273 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:12.902901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfa2c6b9-9fe8-443f-9cbe-839e767d4273 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:12.904068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfa2c6b9-9fe8-443f-9cbe-839e767d4273 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:13.328766 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-c9ba63a3-d001-4b97-a2c7-80fe149a917e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:13.338789 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-c9ba63a3-d001-4b97-a2c7-80fe149a917e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1322 microversion: 2.1 time: 0.638790 Jul 28 04:08:13.340006 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2429/5373] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:12 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1322 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:13.345214 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-8d550395-1f9b-48b2-b684-20a8719767be req-c6af3959-3233-45d3-b270-21ae27660ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3e85786-076b-4d13-bdb2-31d5441af52e", "name": "network-vif-plugged", "status": "completed", "tag": "3d453000-6aeb-4a83-b405-0132af142085"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:13.353819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dfa2c6b9-9fe8-443f-9cbe-839e767d4273 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:13.357917 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-8d550395-1f9b-48b2-b684-20a8719767be req-c6af3959-3233-45d3-b270-21ae27660ab8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:13.358360 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-8d550395-1f9b-48b2-b684-20a8719767be req-c6af3959-3233-45d3-b270-21ae27660ab8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:13.363555 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dfa2c6b9-9fe8-443f-9cbe-839e767d4273 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1317 microversion: 2.1 time: 0.534860 Jul 28 04:08:13.366013 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2945/5374] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:12 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:13.373728 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-8d550395-1f9b-48b2-b684-20a8719767be req-c6af3959-3233-45d3-b270-21ae27660ab8 service nova] Creating event network-vif-plugged:3d453000-6aeb-4a83-b405-0132af142085 for instance b3e85786-076b-4d13-bdb2-31d5441af52e on n-h1-826756-3 Jul 28 04:08:13.393719 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-8d550395-1f9b-48b2-b684-20a8719767be req-c6af3959-3233-45d3-b270-21ae27660ab8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052128 Jul 28 04:08:13.394455 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2430/5375] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:14.361421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-68cb67d6-bffa-4924-a18c-452f21a6255b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:14.362299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-68cb67d6-bffa-4924-a18c-452f21a6255b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:14.373641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68cb67d6-bffa-4924-a18c-452f21a6255b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:14.377709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68cb67d6-bffa-4924-a18c-452f21a6255b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:14.378661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68cb67d6-bffa-4924-a18c-452f21a6255b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:14.382177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68cb67d6-bffa-4924-a18c-452f21a6255b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:14.388441 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-77fcf58c-f947-48fd-8fa1-6d78a1d1c637 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:14.389674 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-77fcf58c-f947-48fd-8fa1-6d78a1d1c637 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:14.412412 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77fcf58c-f947-48fd-8fa1-6d78a1d1c637 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:14.413165 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77fcf58c-f947-48fd-8fa1-6d78a1d1c637 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:14.413999 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77fcf58c-f947-48fd-8fa1-6d78a1d1c637 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:14.414467 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-77fcf58c-f947-48fd-8fa1-6d78a1d1c637 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:14.714772 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-77fcf58c-f947-48fd-8fa1-6d78a1d1c637 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:14.726435 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-77fcf58c-f947-48fd-8fa1-6d78a1d1c637 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1505 microversion: 2.1 time: 0.342628 Jul 28 04:08:14.742508 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2431/5376] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:14 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:14.759144 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-404e29b0-7c4d-4a34-ae03-fbb76cd07b5f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:14.762876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-68cb67d6-bffa-4924-a18c-452f21a6255b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:14.772237 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-404e29b0-7c4d-4a34-ae03-fbb76cd07b5f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: 0882b936-ae38-4478-b9c3-d594e900b1d3] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:14.782608 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-68cb67d6-bffa-4924-a18c-452f21a6255b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1322 microversion: 2.1 time: 0.419297 Jul 28 04:08:14.784119 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2946/5377] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:14 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:14.788395 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-404e29b0-7c4d-4a34-ae03-fbb76cd07b5f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:14.789083 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-404e29b0-7c4d-4a34-ae03-fbb76cd07b5f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:14.790227 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-404e29b0-7c4d-4a34-ae03-fbb76cd07b5f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:14.790876 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-404e29b0-7c4d-4a34-ae03-fbb76cd07b5f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:14.794305 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=100 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:15.115763 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-404e29b0-7c4d-4a34-ae03-fbb76cd07b5f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:15.133626 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-404e29b0-7c4d-4a34-ae03-fbb76cd07b5f tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/0882b936-ae38-4478-b9c3-d594e900b1d3" status: 200 len: 1504 microversion: 2.1 time: 0.378752 Jul 28 04:08:15.139259 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2432/5378] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:14 2022] GET /compute/v2.1/servers/0882b936-ae38-4478-b9c3-d594e900b1d3 => generated 1504 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:15.160914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8780bf12-1653-4a29-b5b4-9a807b495eb8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:15.161823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8780bf12-1653-4a29-b5b4-9a807b495eb8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: 0882b936-ae38-4478-b9c3-d594e900b1d3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:15.171815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8780bf12-1653-4a29-b5b4-9a807b495eb8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:15.172604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8780bf12-1653-4a29-b5b4-9a807b495eb8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:15.173704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8780bf12-1653-4a29-b5b4-9a807b495eb8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:15.174327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8780bf12-1653-4a29-b5b4-9a807b495eb8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:15.180507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:15.255361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8780bf12-1653-4a29-b5b4-9a807b495eb8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: 0882b936-ae38-4478-b9c3-d594e900b1d3] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:08:15.417635 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [req-40fe94e7-77f8-456c-88c8-bec9c37dde35 req-aa9bca4b-9ff6-4ea0-b21e-864b66ba88e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b6d7c1-b65f-465c-97d1-fe40465a3321", "name": "network-vif-plugged", "status": "completed", "tag": "c05ec157-6086-4d52-a5b3-5be3fab3ce01"}]} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:15.431920 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8780bf12-1653-4a29-b5b4-9a807b495eb8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0882b936-ae38-4478-b9c3-d594e900b1d3" status: 204 len: 0 microversion: 2.1 time: 0.274874 Jul 28 04:08:15.432913 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2947/5379] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:08:15 2022] DELETE /compute/v2.1/servers/0882b936-ae38-4478-b9c3-d594e900b1d3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:08:15.441397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d727b697-0dda-4ff0-9ab7-23d8f9d6a6c1 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:15.442041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d727b697-0dda-4ff0-9ab7-23d8f9d6a6c1 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:15.443120 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-40fe94e7-77f8-456c-88c8-bec9c37dde35 req-aa9bca4b-9ff6-4ea0-b21e-864b66ba88e9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:15.447613 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [req-40fe94e7-77f8-456c-88c8-bec9c37dde35 req-aa9bca4b-9ff6-4ea0-b21e-864b66ba88e9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:15.456281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d727b697-0dda-4ff0-9ab7-23d8f9d6a6c1 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:15.457002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d727b697-0dda-4ff0-9ab7-23d8f9d6a6c1 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:15.460752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d727b697-0dda-4ff0-9ab7-23d8f9d6a6c1 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:15.461242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d727b697-0dda-4ff0-9ab7-23d8f9d6a6c1 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:15.479677 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.compute.server_external_events [req-40fe94e7-77f8-456c-88c8-bec9c37dde35 req-aa9bca4b-9ff6-4ea0-b21e-864b66ba88e9 service nova] Creating event network-vif-plugged:c05ec157-6086-4d52-a5b3-5be3fab3ce01 for instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 on n-h2-826756-3 Jul 28 04:08:15.487122 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [req-40fe94e7-77f8-456c-88c8-bec9c37dde35 req-aa9bca4b-9ff6-4ea0-b21e-864b66ba88e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073425 Jul 28 04:08:15.490467 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2433/5380] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:08:15.521221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d727b697-0dda-4ff0-9ab7-23d8f9d6a6c1 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:08:15.705884 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d727b697-0dda-4ff0-9ab7-23d8f9d6a6c1 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 204 len: 0 microversion: 2.1 time: 0.266904 Jul 28 04:08:15.708127 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2948/5381] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:08:15 2022] DELETE /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:08:15.717647 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b59faad0-2d32-4759-98ac-1038cc621b62 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:15.718529 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b59faad0-2d32-4759-98ac-1038cc621b62 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: 0882b936-ae38-4478-b9c3-d594e900b1d3] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:15.734893 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b59faad0-2d32-4759-98ac-1038cc621b62 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:15.735345 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b59faad0-2d32-4759-98ac-1038cc621b62 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:15.736129 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b59faad0-2d32-4759-98ac-1038cc621b62 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:15.736587 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b59faad0-2d32-4759-98ac-1038cc621b62 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:15.807299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3833e973-c45d-4ab6-9fc2-9f53bb023dde tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:15.808769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3833e973-c45d-4ab6-9fc2-9f53bb023dde tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:15.828676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3833e973-c45d-4ab6-9fc2-9f53bb023dde tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:15.829136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3833e973-c45d-4ab6-9fc2-9f53bb023dde tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:15.829925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3833e973-c45d-4ab6-9fc2-9f53bb023dde tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:15.830363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3833e973-c45d-4ab6-9fc2-9f53bb023dde tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:16.157976 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-b59faad0-2d32-4759-98ac-1038cc621b62 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:16.172628 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b59faad0-2d32-4759-98ac-1038cc621b62 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/0882b936-ae38-4478-b9c3-d594e900b1d3" status: 200 len: 1510 microversion: 2.1 time: 0.460345 Jul 28 04:08:16.187305 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2434/5382] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:15 2022] GET /compute/v2.1/servers/0882b936-ae38-4478-b9c3-d594e900b1d3 => generated 1510 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:16.479563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3833e973-c45d-4ab6-9fc2-9f53bb023dde tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:16.497144 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3833e973-c45d-4ab6-9fc2-9f53bb023dde tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1517 microversion: 2.1 time: 0.695312 Jul 28 04:08:16.514842 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2949/5383] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:15 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1517 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:16.521963 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b77ef8a0-a6f3-4f2d-97ef-dcbbf0d6cf28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:16.538354 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-b77ef8a0-a6f3-4f2d-97ef-dcbbf0d6cf28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:16.557294 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b77ef8a0-a6f3-4f2d-97ef-dcbbf0d6cf28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:16.559136 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b77ef8a0-a6f3-4f2d-97ef-dcbbf0d6cf28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:16.562694 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b77ef8a0-a6f3-4f2d-97ef-dcbbf0d6cf28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:16.563736 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-b77ef8a0-a6f3-4f2d-97ef-dcbbf0d6cf28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:16.599006 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-b77ef8a0-a6f3-4f2d-97ef-dcbbf0d6cf28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lazy-loading 'flavor' on Instance uuid b3e85786-076b-4d13-bdb2-31d5441af52e {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:08:16.784839 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-b77ef8a0-a6f3-4f2d-97ef-dcbbf0d6cf28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e/action" status: 200 len: 32 microversion: 2.1 time: 0.267701 Jul 28 04:08:16.787657 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2435/5384] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:08:16 2022] POST /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e/action => generated 32 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 04:08:16.799281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-96bbd607-172c-417b-b41a-7bcc7d2009ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:16.799905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-96bbd607-172c-417b-b41a-7bcc7d2009ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:16.816492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96bbd607-172c-417b-b41a-7bcc7d2009ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:16.819792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96bbd607-172c-417b-b41a-7bcc7d2009ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:16.821210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96bbd607-172c-417b-b41a-7bcc7d2009ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:16.821936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96bbd607-172c-417b-b41a-7bcc7d2009ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:17.202465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-96bbd607-172c-417b-b41a-7bcc7d2009ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:17.222363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-08da6925-136e-425b-9f13-b79edaa39ec8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:17.231907 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-08da6925-136e-425b-9f13-b79edaa39ec8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: 0882b936-ae38-4478-b9c3-d594e900b1d3] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:17.261871 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-96bbd607-172c-417b-b41a-7bcc7d2009ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.468036 Jul 28 04:08:17.272579 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2950/5385] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:16 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:17.322061 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-08da6925-136e-425b-9f13-b79edaa39ec8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:17.324500 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-08da6925-136e-425b-9f13-b79edaa39ec8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:17.325719 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-08da6925-136e-425b-9f13-b79edaa39ec8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:17.330660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-08da6925-136e-425b-9f13-b79edaa39ec8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:17.845189 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-08da6925-136e-425b-9f13-b79edaa39ec8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:17.854557 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-08da6925-136e-425b-9f13-b79edaa39ec8 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/0882b936-ae38-4478-b9c3-d594e900b1d3" status: 200 len: 1510 microversion: 2.1 time: 0.661210 Jul 28 04:08:17.861479 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2436/5386] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:17 2022] GET /compute/v2.1/servers/0882b936-ae38-4478-b9c3-d594e900b1d3 => generated 1510 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:18.295314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-677ac53c-9c7e-4993-83a5-4475d70e7b85 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:18.296083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-677ac53c-9c7e-4993-83a5-4475d70e7b85 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:18.310817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-677ac53c-9c7e-4993-83a5-4475d70e7b85 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:18.312792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-677ac53c-9c7e-4993-83a5-4475d70e7b85 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:18.315048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-677ac53c-9c7e-4993-83a5-4475d70e7b85 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:18.317658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-677ac53c-9c7e-4993-83a5-4475d70e7b85 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:18.738476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-677ac53c-9c7e-4993-83a5-4475d70e7b85 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:18.759089 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-677ac53c-9c7e-4993-83a5-4475d70e7b85 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.469004 Jul 28 04:08:18.764459 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2951/5387] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:18 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:18.888055 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9e3e71ca-4964-4d1e-865f-6aff1adb1b00 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:18.889535 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9e3e71ca-4964-4d1e-865f-6aff1adb1b00 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: 0882b936-ae38-4478-b9c3-d594e900b1d3] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:18.909561 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e3e71ca-4964-4d1e-865f-6aff1adb1b00 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:18.910056 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e3e71ca-4964-4d1e-865f-6aff1adb1b00 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:18.910968 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e3e71ca-4964-4d1e-865f-6aff1adb1b00 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:18.914781 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9e3e71ca-4964-4d1e-865f-6aff1adb1b00 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:19.425433 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9e3e71ca-4964-4d1e-865f-6aff1adb1b00 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:19.434162 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9e3e71ca-4964-4d1e-865f-6aff1adb1b00 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/0882b936-ae38-4478-b9c3-d594e900b1d3" status: 200 len: 1468 microversion: 2.1 time: 0.551494 Jul 28 04:08:19.439276 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2437/5388] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:18 2022] GET /compute/v2.1/servers/0882b936-ae38-4478-b9c3-d594e900b1d3 => generated 1468 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:19.685027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-35880446-95f8-4bcd-b1e3-a41922f6b976 req-401c17a4-8a34-49fd-8e0f-b52f32437cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0882b936-ae38-4478-b9c3-d594e900b1d3", "name": "network-vif-deleted", "tag": "533f3bee-6a4e-48a0-985a-ca82b98faed8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:19.773123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-35880446-95f8-4bcd-b1e3-a41922f6b976 req-401c17a4-8a34-49fd-8e0f-b52f32437cd7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:19.782784 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-a79bd225-383f-410e-9d0d-baf5fc252733 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:19.783409 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-a79bd225-383f-410e-9d0d-baf5fc252733 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:19.799117 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a79bd225-383f-410e-9d0d-baf5fc252733 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:19.799602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-35880446-95f8-4bcd-b1e3-a41922f6b976 req-401c17a4-8a34-49fd-8e0f-b52f32437cd7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:19.804077 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a79bd225-383f-410e-9d0d-baf5fc252733 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:19.806978 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a79bd225-383f-410e-9d0d-baf5fc252733 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:19.811262 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-a79bd225-383f-410e-9d0d-baf5fc252733 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:19.834904 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-35880446-95f8-4bcd-b1e3-a41922f6b976 req-401c17a4-8a34-49fd-8e0f-b52f32437cd7 service nova] Creating event network-vif-deleted:533f3bee-6a4e-48a0-985a-ca82b98faed8 for instance 0882b936-ae38-4478-b9c3-d594e900b1d3 on n-h1-826756-3 Jul 28 04:08:19.864661 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-35880446-95f8-4bcd-b1e3-a41922f6b976 req-401c17a4-8a34-49fd-8e0f-b52f32437cd7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200495 Jul 28 04:08:19.872835 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2952/5389] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:20.226016 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-a79bd225-383f-410e-9d0d-baf5fc252733 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:20.245497 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-a79bd225-383f-410e-9d0d-baf5fc252733 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.466213 Jul 28 04:08:20.268999 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2438/5390] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:19 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:20.469196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-69c30dea-df72-48af-8db0-9c5005d417d7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:20.470967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-69c30dea-df72-48af-8db0-9c5005d417d7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: 0882b936-ae38-4478-b9c3-d594e900b1d3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:20.507887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69c30dea-df72-48af-8db0-9c5005d417d7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:20.508388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69c30dea-df72-48af-8db0-9c5005d417d7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:20.512965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69c30dea-df72-48af-8db0-9c5005d417d7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:20.515500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69c30dea-df72-48af-8db0-9c5005d417d7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:20.546740 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-69c30dea-df72-48af-8db0-9c5005d417d7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] HTTP exception thrown: Instance 0882b936-ae38-4478-b9c3-d594e900b1d3 could not be found. Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-69c30dea-df72-48af-8db0-9c5005d417d7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Request method failure captured: Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/0882b936-ae38-4478-b9c3-d594e900b1d3 HTTP/1.1 Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gtksIYbrHJ2fh3xUrxiqom1lhh4fTijYzwsRqBHux4VaXXG11Xw-GMmNTihmNdfnoT0xIuN5qWU8AZ5X8OL76exqu6fT_WFa48PNvoNjpw6LuwBAzCSkZ6sq5j9QLYFX7daapU35rnQf-WWfvWeDhgdNas9cFG9fM0AmgxHsDLssS4 Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ba8f8ab85fef40e180ac94560a25cac4 Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-MultipleCreateTestJSON-1187558111 Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ba8f8ab85fef40e180ac94560a25cac4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba8f8ab85fef40e180ac94560a25cac4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ba8f8ab85fef40e180ac94560a25cac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba8f8ab85fef40e180ac94560a25cac4"}]}] Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-MultipleCreateTestJSON-1187558111 Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ba8f8ab85fef40e180ac94560a25cac4 Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1187558111 Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-MultipleCreateTestJSON-1187558111-project Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 2bd5450439494a0dbf4f0927461a07a4 Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-MultipleCreateTestJSON-1187558111-project Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 0882b936-ae38-4478-b9c3-d594e900b1d3 could not be found. Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '0882b936-ae38-4478-b9c3-d594e900b1d3'} Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0882b936-ae38-4478-b9c3-d594e900b1d3 could not be found. Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0882b936-ae38-4478-b9c3-d594e900b1d3 could not be found. Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:08:20.548748 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:20.553427 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:20.553427 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:08:20.553427 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:08:20.553427 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:08:20.553427 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:08:20.553427 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0882b936-ae38-4478-b9c3-d594e900b1d3 could not be found. Jul 28 04:08:20.553427 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:20.555460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-69c30dea-df72-48af-8db0-9c5005d417d7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Returning 404 to user: Instance 0882b936-ae38-4478-b9c3-d594e900b1d3 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:08:20.556843 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-69c30dea-df72-48af-8db0-9c5005d417d7 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/0882b936-ae38-4478-b9c3-d594e900b1d3" status: 404 len: 111 microversion: 2.1 time: 0.096912 Jul 28 04:08:20.557620 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2953/5391] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:20 2022] GET /compute/v2.1/servers/0882b936-ae38-4478-b9c3-d594e900b1d3 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:08:20.568550 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-940780f8-27a6-436b-9007-22405ac8e3f5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:20.569184 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-940780f8-27a6-436b-9007-22405ac8e3f5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:20.593995 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-940780f8-27a6-436b-9007-22405ac8e3f5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:20.594453 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-940780f8-27a6-436b-9007-22405ac8e3f5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:20.595240 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-940780f8-27a6-436b-9007-22405ac8e3f5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:20.595675 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-940780f8-27a6-436b-9007-22405ac8e3f5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:20.709534 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-940780f8-27a6-436b-9007-22405ac8e3f5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:20.710285 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-940780f8-27a6-436b-9007-22405ac8e3f5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:20.710924 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.objects.instance [None req-940780f8-27a6-436b-9007-22405ac8e3f5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lazy-loading 'fault' on Instance uuid bc17b242-9f90-4d82-9fe8-1b7d4e013717 {{(pid=126072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:08:20.803354 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-940780f8-27a6-436b-9007-22405ac8e3f5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bd5450439494a0dbf4f0927461a07a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba8f8ab85fef40e180ac94560a25cac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:20.812688 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-940780f8-27a6-436b-9007-22405ac8e3f5 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 200 len: 1307 microversion: 2.1 time: 0.250668 Jul 28 04:08:20.813835 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2439/5392] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:20 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 1307 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:21.275081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-da7eae74-7293-45ad-8329-9f1cffc6c229 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:21.275610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-da7eae74-7293-45ad-8329-9f1cffc6c229 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:21.316431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da7eae74-7293-45ad-8329-9f1cffc6c229 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:21.316909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da7eae74-7293-45ad-8329-9f1cffc6c229 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:21.317797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da7eae74-7293-45ad-8329-9f1cffc6c229 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:21.318235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da7eae74-7293-45ad-8329-9f1cffc6c229 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:21.753626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-da7eae74-7293-45ad-8329-9f1cffc6c229 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:21.765920 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-da7eae74-7293-45ad-8329-9f1cffc6c229 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.494935 Jul 28 04:08:21.767944 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2954/5393] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:21 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:21.835945 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3e91f381-32d7-4508-888a-a7b934810029 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:21.836729 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3e91f381-32d7-4508-888a-a7b934810029 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] [instance: bc17b242-9f90-4d82-9fe8-1b7d4e013717] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:21.846442 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e91f381-32d7-4508-888a-a7b934810029 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:21.846909 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e91f381-32d7-4508-888a-a7b934810029 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:21.847713 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e91f381-32d7-4508-888a-a7b934810029 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:21.848146 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3e91f381-32d7-4508-888a-a7b934810029 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:21.882202 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.wsgi [None req-3e91f381-32d7-4508-888a-a7b934810029 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] HTTP exception thrown: Instance bc17b242-9f90-4d82-9fe8-1b7d4e013717 could not be found. Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3e91f381-32d7-4508-888a-a7b934810029 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Request method failure captured: Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: request: GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 HTTP/1.1 Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: Accept: application/json Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: Accept-Encoding: identity Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: Connection: close Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: Content-Length: 0 Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: Content-Type: application/json Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: Host: 10.222.0.48 Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: Openstack-System-Scope: None Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: User-Agent: python-urllib3/1.26.10 Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Auth-Token: gAAAAABi4gtksIYbrHJ2fh3xUrxiqom1lhh4fTijYzwsRqBHux4VaXXG11Xw-GMmNTihmNdfnoT0xIuN5qWU8AZ5X8OL76exqu6fT_WFa48PNvoNjpw6LuwBAzCSkZ6sq5j9QLYFX7daapU35rnQf-WWfvWeDhgdNas9cFG9fM0AmgxHsDLssS4 Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Id: None Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Domain-Name: None Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Identity-Status: Confirmed Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Is-Admin-Project: True Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Id: default Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Domain-Name: Default Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Id: ba8f8ab85fef40e180ac94560a25cac4 Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Project-Name: tempest-MultipleCreateTestJSON-1187558111 Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Role: reader,member Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Roles: reader,member Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ba8f8ab85fef40e180ac94560a25cac4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba8f8ab85fef40e180ac94560a25cac4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ba8f8ab85fef40e180ac94560a25cac4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ba8f8ab85fef40e180ac94560a25cac4"}]}] Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant: tempest-MultipleCreateTestJSON-1187558111 Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Id: ba8f8ab85fef40e180ac94560a25cac4 Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1187558111 Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-User: tempest-MultipleCreateTestJSON-1187558111-project Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Id: default Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-User-Domain-Name: Default Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-User-Id: 2bd5450439494a0dbf4f0927461a07a4 Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: X-User-Name: tempest-MultipleCreateTestJSON-1187558111-project Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: method: > Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: exception: Instance bc17b242-9f90-4d82-9fe8-1b7d4e013717 could not be found. Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: action_args: {'id': 'bc17b242-9f90-4d82-9fe8-1b7d4e013717'} Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc17b242-9f90-4d82-9fe8-1b7d4e013717 could not be found. Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc17b242-9f90-4d82-9fe8-1b7d4e013717 could not be found. Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:08:21.886767 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:08:21.890792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:21.890792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:08:21.890792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:08:21.890792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:08:21.890792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:08:21.890792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc17b242-9f90-4d82-9fe8-1b7d4e013717 could not be found. Jul 28 04:08:21.890792 n-d-826756-3 devstack@n-api.service[126072]: ERROR nova.api.openstack.wsgi Jul 28 04:08:21.895427 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3e91f381-32d7-4508-888a-a7b934810029 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] Returning 404 to user: Instance bc17b242-9f90-4d82-9fe8-1b7d4e013717 could not be found. {{(pid=126072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:08:21.897595 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3e91f381-32d7-4508-888a-a7b934810029 tempest-MultipleCreateTestJSON-1187558111 tempest-MultipleCreateTestJSON-1187558111-project] 10.222.0.48 "GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717" status: 404 len: 111 microversion: 2.1 time: 0.068108 Jul 28 04:08:21.900783 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2440/5394] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:21 2022] GET /compute/v2.1/servers/bc17b242-9f90-4d82-9fe8-1b7d4e013717 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:08:21.913418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-5349a01a-4136-4d83-b11d-d60ce4bf4c13 req-3a867ba3-0114-46b2-bb2b-3b9700f87c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc17b242-9f90-4d82-9fe8-1b7d4e013717", "name": "network-vif-deleted", "tag": "da891fb8-c2bf-4222-a80a-a90187b73ca3"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:21.955343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5349a01a-4136-4d83-b11d-d60ce4bf4c13 req-3a867ba3-0114-46b2-bb2b-3b9700f87c14 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:21.955800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5349a01a-4136-4d83-b11d-d60ce4bf4c13 req-3a867ba3-0114-46b2-bb2b-3b9700f87c14 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:21.993844 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5349a01a-4136-4d83-b11d-d60ce4bf4c13 req-3a867ba3-0114-46b2-bb2b-3b9700f87c14 service nova] Creating event network-vif-deleted:da891fb8-c2bf-4222-a80a-a90187b73ca3 for instance bc17b242-9f90-4d82-9fe8-1b7d4e013717 on n-h2-826756-3 Jul 28 04:08:22.033834 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-5349a01a-4136-4d83-b11d-d60ce4bf4c13 req-3a867ba3-0114-46b2-bb2b-3b9700f87c14 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122034 Jul 28 04:08:22.044706 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2955/5395] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:22.798374 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-9d63025e-9e3e-4f3d-85a4-5225c53ab2fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:22.800740 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-9d63025e-9e3e-4f3d-85a4-5225c53ab2fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:22.823336 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d63025e-9e3e-4f3d-85a4-5225c53ab2fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:22.828281 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d63025e-9e3e-4f3d-85a4-5225c53ab2fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:22.840045 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d63025e-9e3e-4f3d-85a4-5225c53ab2fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:22.843033 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-9d63025e-9e3e-4f3d-85a4-5225c53ab2fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:23.150988 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-9d63025e-9e3e-4f3d-85a4-5225c53ab2fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:23.172584 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-9d63025e-9e3e-4f3d-85a4-5225c53ab2fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.382816 Jul 28 04:08:23.190025 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2441/5396] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:22 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:24.202702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c824b40b-68da-45d5-b3e8-ad09aa23272a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:24.212106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c824b40b-68da-45d5-b3e8-ad09aa23272a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:24.258224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c824b40b-68da-45d5-b3e8-ad09aa23272a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:24.258988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c824b40b-68da-45d5-b3e8-ad09aa23272a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:24.259995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c824b40b-68da-45d5-b3e8-ad09aa23272a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:24.260610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c824b40b-68da-45d5-b3e8-ad09aa23272a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:24.762441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c824b40b-68da-45d5-b3e8-ad09aa23272a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:24.806286 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c824b40b-68da-45d5-b3e8-ad09aa23272a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.611560 Jul 28 04:08:24.837069 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2956/5397] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:24 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:25.659143 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:08:25.660660 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:08:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:08:25.686584 n-d-826756-3 devstack@n-api.service[126072]: Traceback (most recent call last): Jul 28 04:08:25.686851 n-d-826756-3 devstack@n-api.service[126072]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 28 04:08:25.686851 n-d-826756-3 devstack@n-api.service[126072]: timer() Jul 28 04:08:25.687091 n-d-826756-3 devstack@n-api.service[126072]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 28 04:08:25.687091 n-d-826756-3 devstack@n-api.service[126072]: cb(*args, **kw) Jul 28 04:08:25.687305 n-d-826756-3 devstack@n-api.service[126072]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jul 28 04:08:25.687305 n-d-826756-3 devstack@n-api.service[126072]: waiter.switch() Jul 28 04:08:25.687544 n-d-826756-3 devstack@n-api.service[126072]: greenlet.error: cannot switch to a different thread Jul 28 04:08:25.856704 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-781e5a59-4ca5-4dce-a601-c8fcd7495645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:25.857717 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-781e5a59-4ca5-4dce-a601-c8fcd7495645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:25.876370 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-781e5a59-4ca5-4dce-a601-c8fcd7495645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:25.876852 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-781e5a59-4ca5-4dce-a601-c8fcd7495645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:25.878086 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-781e5a59-4ca5-4dce-a601-c8fcd7495645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:25.878532 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-781e5a59-4ca5-4dce-a601-c8fcd7495645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:26.296284 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-781e5a59-4ca5-4dce-a601-c8fcd7495645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:26.314955 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-781e5a59-4ca5-4dce-a601-c8fcd7495645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.465184 Jul 28 04:08:26.316723 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2442/5398] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:25 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:27.342383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-667a2786-5ac2-4b87-a156-26bd69809fc9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:27.343397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-667a2786-5ac2-4b87-a156-26bd69809fc9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:27.393617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-667a2786-5ac2-4b87-a156-26bd69809fc9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:27.394088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-667a2786-5ac2-4b87-a156-26bd69809fc9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:27.394905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-667a2786-5ac2-4b87-a156-26bd69809fc9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:27.395428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-667a2786-5ac2-4b87-a156-26bd69809fc9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:27.710212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-667a2786-5ac2-4b87-a156-26bd69809fc9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:27.747561 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-667a2786-5ac2-4b87-a156-26bd69809fc9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.411324 Jul 28 04:08:27.750943 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2957/5399] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:27 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:28.777265 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e011a72a-7563-4667-94e1-a41abcb8343a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:28.778347 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e011a72a-7563-4667-94e1-a41abcb8343a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:28.815475 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e011a72a-7563-4667-94e1-a41abcb8343a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:28.826935 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e011a72a-7563-4667-94e1-a41abcb8343a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:28.827989 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e011a72a-7563-4667-94e1-a41abcb8343a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:28.829538 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e011a72a-7563-4667-94e1-a41abcb8343a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:30.034293 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e011a72a-7563-4667-94e1-a41abcb8343a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:30.046473 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e011a72a-7563-4667-94e1-a41abcb8343a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 1.275062 Jul 28 04:08:30.049379 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2443/5400] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:28 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:31.072943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2aee79d3-7e7b-4107-964a-29c831518111 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:31.074406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2aee79d3-7e7b-4107-964a-29c831518111 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:31.124753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2aee79d3-7e7b-4107-964a-29c831518111 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.126268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2aee79d3-7e7b-4107-964a-29c831518111 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.128731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2aee79d3-7e7b-4107-964a-29c831518111 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.131116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2aee79d3-7e7b-4107-964a-29c831518111 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.550021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2aee79d3-7e7b-4107-964a-29c831518111 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:31.563053 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2aee79d3-7e7b-4107-964a-29c831518111 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.496318 Jul 28 04:08:31.563978 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2958/5401] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:31 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:32.607777 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-7b0cb6e4-32db-4a80-9dec-df9618abd38c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:32.607777 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-7b0cb6e4-32db-4a80-9dec-df9618abd38c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:32.616623 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7b0cb6e4-32db-4a80-9dec-df9618abd38c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:32.617071 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7b0cb6e4-32db-4a80-9dec-df9618abd38c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:32.618047 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7b0cb6e4-32db-4a80-9dec-df9618abd38c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:32.618624 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-7b0cb6e4-32db-4a80-9dec-df9618abd38c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:32.864076 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-7b0cb6e4-32db-4a80-9dec-df9618abd38c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:32.882371 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-7b0cb6e4-32db-4a80-9dec-df9618abd38c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.293581 Jul 28 04:08:32.898034 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2444/5402] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:32 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:33.905625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd710099-e74f-430c-8f7d-908ce07976c5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:33.906224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd710099-e74f-430c-8f7d-908ce07976c5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:33.915027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:33.917972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd710099-e74f-430c-8f7d-908ce07976c5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:33.919761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd710099-e74f-430c-8f7d-908ce07976c5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:33.921301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd710099-e74f-430c-8f7d-908ce07976c5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:33.921764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd710099-e74f-430c-8f7d-908ce07976c5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:34.126842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dd710099-e74f-430c-8f7d-908ce07976c5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:34.136275 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd710099-e74f-430c-8f7d-908ce07976c5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.234577 Jul 28 04:08:34.136907 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2959/5403] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:33 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:35.159110 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-e6c6d070-9865-44a5-90cb-2036642d655c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:35.159768 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-e6c6d070-9865-44a5-90cb-2036642d655c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:35.174363 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6c6d070-9865-44a5-90cb-2036642d655c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:35.175512 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6c6d070-9865-44a5-90cb-2036642d655c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:35.180560 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6c6d070-9865-44a5-90cb-2036642d655c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:35.181253 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-e6c6d070-9865-44a5-90cb-2036642d655c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:35.519200 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-e6c6d070-9865-44a5-90cb-2036642d655c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:35.530609 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-e6c6d070-9865-44a5-90cb-2036642d655c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.376622 Jul 28 04:08:35.533556 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2445/5404] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:35 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:36.566192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4eb14b8e-e10d-4060-a2e9-1379d92d9d69 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:36.572894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4eb14b8e-e10d-4060-a2e9-1379d92d9d69 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:36.592820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4eb14b8e-e10d-4060-a2e9-1379d92d9d69 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:36.594830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4eb14b8e-e10d-4060-a2e9-1379d92d9d69 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:36.595849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4eb14b8e-e10d-4060-a2e9-1379d92d9d69 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:36.597543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4eb14b8e-e10d-4060-a2e9-1379d92d9d69 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:36.954665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4eb14b8e-e10d-4060-a2e9-1379d92d9d69 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:36.964340 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4eb14b8e-e10d-4060-a2e9-1379d92d9d69 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.410303 Jul 28 04:08:36.969630 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2960/5405] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:36 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:37.987915 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-3254cd88-6901-4e11-b1cf-da784736bb24 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:37.988750 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-3254cd88-6901-4e11-b1cf-da784736bb24 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:37.995291 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_api:SELECT=44 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:38.017703 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3254cd88-6901-4e11-b1cf-da784736bb24 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:38.018182 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3254cd88-6901-4e11-b1cf-da784736bb24 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:38.022818 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3254cd88-6901-4e11-b1cf-da784736bb24 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:38.026650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-3254cd88-6901-4e11-b1cf-da784736bb24 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:38.408210 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-3254cd88-6901-4e11-b1cf-da784736bb24 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:38.417609 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-3254cd88-6901-4e11-b1cf-da784736bb24 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.434314 Jul 28 04:08:38.418205 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2446/5406] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:37 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:39.439170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df2a1e7d-4039-4f69-bdf4-1090192c122d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:39.439808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-df2a1e7d-4039-4f69-bdf4-1090192c122d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:39.470214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df2a1e7d-4039-4f69-bdf4-1090192c122d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:39.470702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df2a1e7d-4039-4f69-bdf4-1090192c122d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:39.475252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df2a1e7d-4039-4f69-bdf4-1090192c122d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:39.479038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df2a1e7d-4039-4f69-bdf4-1090192c122d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:39.836201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-df2a1e7d-4039-4f69-bdf4-1090192c122d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:39.861443 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-df2a1e7d-4039-4f69-bdf4-1090192c122d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.426538 Jul 28 04:08:39.862628 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2961/5407] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:39 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:40.497842 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1823993236", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "584e7f8f-88c1-4e41-a5a1-6904e44c78f3"}]}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:40.600872 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.network.neutron [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] validate_networks() for [('584e7f8f-88c1-4e41-a5a1-6904e44c78f3', None, None, None, None, None)] {{(pid=126072) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:08:40.887318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d74d1ea-1ddf-47f3-a3db-c7ee1bc59836 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:40.891807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5d74d1ea-1ddf-47f3-a3db-c7ee1bc59836 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:40.945947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d74d1ea-1ddf-47f3-a3db-c7ee1bc59836 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:40.946402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d74d1ea-1ddf-47f3-a3db-c7ee1bc59836 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:40.947211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d74d1ea-1ddf-47f3-a3db-c7ee1bc59836 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:40.947655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d74d1ea-1ddf-47f3-a3db-c7ee1bc59836 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:41.000403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:41.333420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5d74d1ea-1ddf-47f3-a3db-c7ee1bc59836 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:41.370244 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5d74d1ea-1ddf-47f3-a3db-c7ee1bc59836 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.489079 Jul 28 04:08:41.377042 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2962/5408] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:40 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:42.412479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b46d9a7d-d13d-431d-8560-148c9e4cc462 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:42.413899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b46d9a7d-d13d-431d-8560-148c9e4cc462 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:42.435186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b46d9a7d-d13d-431d-8560-148c9e4cc462 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:42.438614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b46d9a7d-d13d-431d-8560-148c9e4cc462 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:42.441276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b46d9a7d-d13d-431d-8560-148c9e4cc462 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:42.451075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b46d9a7d-d13d-431d-8560-148c9e4cc462 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:42.874071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b46d9a7d-d13d-431d-8560-148c9e4cc462 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:42.884851 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b46d9a7d-d13d-431d-8560-148c9e4cc462 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.477443 Jul 28 04:08:42.889425 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2963/5409] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:42 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:42.895460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Flavor limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:08:42.896173 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Image limits 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:08:42.897018 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Flavor pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:08:42.897714 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Image pref 0:0:0 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:08:42.898403 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.virt.hardware [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:08:42.917271 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:42.919509 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:42.927741 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:42.928660 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:42.997345 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Getting quotas for project 334b2c98f9a24fe88bf86505eb5863f9. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:08:43.028126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Getting quotas for user a23ab0ed18c4425c9f2ccce44b7201f7 and project 334b2c98f9a24fe88bf86505eb5863f9. Resources: {'instances', 'ram', 'cores'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:08:43.084775 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Going to run 1 instances... {{(pid=126072) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:08:43.088105 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:08:43.195528 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-fd1922c2-c39b-422e-bf28-91ddaf120614 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.702409 Jul 28 04:08:43.209477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-813d4656-810b-4fa6-bbc8-5e0a883f5aca tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:43.211325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-813d4656-810b-4fa6-bbc8-5e0a883f5aca tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:43.217436 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2447/5410] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:08:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:08:43.400708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-813d4656-810b-4fa6-bbc8-5e0a883f5aca tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:43.417593 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-813d4656-810b-4fa6-bbc8-5e0a883f5aca tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1214 microversion: 2.1 time: 0.213125 Jul 28 04:08:43.423174 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2964/5411] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:43 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1214 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:43.910582 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-14791f52-9345-4a76-9cb7-15bc51d37a7c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:43.912126 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-14791f52-9345-4a76-9cb7-15bc51d37a7c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:43.944882 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-14791f52-9345-4a76-9cb7-15bc51d37a7c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:43.947913 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-14791f52-9345-4a76-9cb7-15bc51d37a7c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:43.954466 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-14791f52-9345-4a76-9cb7-15bc51d37a7c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:43.956551 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-14791f52-9345-4a76-9cb7-15bc51d37a7c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:44.011384 n-d-826756-3 devstack@n-api.service[126072]: DEBUG dbcounter [-] [126072] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126072) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:44.448200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-26eec9b9-5290-4f06-8890-9c9c844fc0bd tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:44.449287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-26eec9b9-5290-4f06-8890-9c9c844fc0bd tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:44.464873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26eec9b9-5290-4f06-8890-9c9c844fc0bd tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:44.469779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26eec9b9-5290-4f06-8890-9c9c844fc0bd tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:44.490001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26eec9b9-5290-4f06-8890-9c9c844fc0bd tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:44.490920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26eec9b9-5290-4f06-8890-9c9c844fc0bd tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:44.507875 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-14791f52-9345-4a76-9cb7-15bc51d37a7c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:44.539117 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-14791f52-9345-4a76-9cb7-15bc51d37a7c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.631679 Jul 28 04:08:44.543398 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2448/5412] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:43 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:44.740206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-26eec9b9-5290-4f06-8890-9c9c844fc0bd tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:44.750874 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-26eec9b9-5290-4f06-8890-9c9c844fc0bd tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1218 microversion: 2.1 time: 0.307588 Jul 28 04:08:44.757054 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2965/5413] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:44 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1218 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:45.570994 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-55dc891b-e525-4bfe-b80d-f09657f8deca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:45.571895 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-55dc891b-e525-4bfe-b80d-f09657f8deca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:45.597650 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-55dc891b-e525-4bfe-b80d-f09657f8deca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:45.600666 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-55dc891b-e525-4bfe-b80d-f09657f8deca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:45.606192 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-55dc891b-e525-4bfe-b80d-f09657f8deca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:45.607019 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-55dc891b-e525-4bfe-b80d-f09657f8deca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:45.782406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ff41e75a-e793-422d-a546-3642bb17e82b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:45.785006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ff41e75a-e793-422d-a546-3642bb17e82b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:45.807120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff41e75a-e793-422d-a546-3642bb17e82b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:45.819642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff41e75a-e793-422d-a546-3642bb17e82b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:45.820942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff41e75a-e793-422d-a546-3642bb17e82b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:45.821494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff41e75a-e793-422d-a546-3642bb17e82b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:46.022510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ff41e75a-e793-422d-a546-3642bb17e82b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:46.034316 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ff41e75a-e793-422d-a546-3642bb17e82b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1266 microversion: 2.1 time: 0.255889 Jul 28 04:08:46.046809 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2966/5414] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:45 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:46.261927 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-55dc891b-e525-4bfe-b80d-f09657f8deca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:46.297184 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-55dc891b-e525-4bfe-b80d-f09657f8deca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.729605 Jul 28 04:08:46.297737 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2449/5415] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:45 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:47.070220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a111873b-ea10-4652-902c-3300efdf0aed tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:47.072151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a111873b-ea10-4652-902c-3300efdf0aed tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:47.110832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a111873b-ea10-4652-902c-3300efdf0aed tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:47.112326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a111873b-ea10-4652-902c-3300efdf0aed tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:47.113524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a111873b-ea10-4652-902c-3300efdf0aed tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:47.121602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a111873b-ea10-4652-902c-3300efdf0aed tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:47.321758 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-2093bb63-9181-4a6f-ad3b-72b104edf147 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:47.322379 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.compute.api [None req-2093bb63-9181-4a6f-ad3b-72b104edf147 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126072) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:47.347405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a111873b-ea10-4652-902c-3300efdf0aed tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:47.351091 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2093bb63-9181-4a6f-ad3b-72b104edf147 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:47.351564 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2093bb63-9181-4a6f-ad3b-72b104edf147 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:47.355944 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2093bb63-9181-4a6f-ad3b-72b104edf147 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:47.365460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG oslo_concurrency.lockutils [None req-2093bb63-9181-4a6f-ad3b-72b104edf147 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:47.385461 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a111873b-ea10-4652-902c-3300efdf0aed tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1272 microversion: 2.1 time: 0.321542 Jul 28 04:08:47.396997 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2967/5416] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:47 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1272 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:48.409947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9bb7ee96-8495-47b2-9add-7fc2a2c9aaab tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:48.410812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9bb7ee96-8495-47b2-9add-7fc2a2c9aaab tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:48.426810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bb7ee96-8495-47b2-9add-7fc2a2c9aaab tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:48.430592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bb7ee96-8495-47b2-9add-7fc2a2c9aaab tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:48.432713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bb7ee96-8495-47b2-9add-7fc2a2c9aaab tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:48.434086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bb7ee96-8495-47b2-9add-7fc2a2c9aaab tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:48.548220 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.policy [None req-2093bb63-9181-4a6f-ad3b-72b104edf147 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126072) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:48.570760 n-d-826756-3 devstack@n-api.service[126072]: INFO nova.api.openstack.requestlog [None req-2093bb63-9181-4a6f-ad3b-72b104edf147 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 1.251693 Jul 28 04:08:48.578456 n-d-826756-3 devstack@n-api.service[126072]: [pid: 126072|app: 0|req: 2450/5417] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:47 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:48.605644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9bb7ee96-8495-47b2-9add-7fc2a2c9aaab tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:48.623771 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9bb7ee96-8495-47b2-9add-7fc2a2c9aaab tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1272 microversion: 2.1 time: 0.217475 Jul 28 04:08:48.624724 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2968/5418] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:48 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:49.598813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-656de10d-e2f2-4137-868e-008621981720 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:49.599695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-656de10d-e2f2-4137-868e-008621981720 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:49.613654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-656de10d-e2f2-4137-868e-008621981720 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:49.614116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-656de10d-e2f2-4137-868e-008621981720 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:49.622494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-656de10d-e2f2-4137-868e-008621981720 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:49.622958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-656de10d-e2f2-4137-868e-008621981720 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:49.672460 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.api.openstack.wsgi [None req-b9bc20c2-523f-4c60-b306-aef340f4256c tempest-ServerGroup264TestJSON-1838661886 tempest-ServerGroup264TestJSON-1838661886-project] Action: 'create', calling method: .version_select at 0x7ffa677cca60>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=126072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:49.723037 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-b9bc20c2-523f-4c60-b306-aef340f4256c tempest-ServerGroup264TestJSON-1838661886 tempest-ServerGroup264TestJSON-1838661886-project] Getting quotas for project 37f3bd96933b45f389ed3ae77d8ddbc8. Resources: {'server_groups'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:08:49.751497 n-d-826756-3 devstack@n-api.service[126072]: DEBUG nova.quota [None req-b9bc20c2-523f-4c60-b306-aef340f4256c tempest-ServerGroup264TestJSON-1838661886 tempest-ServerGroup264TestJSON-1838661886-project] Getting quotas for user 69c73fd95dab48b89a1cfd2e900505d2 and project 37f3bd96933b45f389ed3ae77d8ddbc8. Resources: {'server_groups'} {{(pid=126072) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:08:49.890313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-656de10d-e2f2-4137-868e-008621981720 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:49.901089 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-656de10d-e2f2-4137-868e-008621981720 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.305922 Jul 28 04:08:49.902998 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2969/5419] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:49 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:49.914317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a076f53-b6a7-4773-b21b-f0e5eb5b695c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:49.914950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9a076f53-b6a7-4773-b21b-f0e5eb5b695c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:49.933199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a076f53-b6a7-4773-b21b-f0e5eb5b695c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:49.934077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a076f53-b6a7-4773-b21b-f0e5eb5b695c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:49.935128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a076f53-b6a7-4773-b21b-f0e5eb5b695c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:49.938647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a076f53-b6a7-4773-b21b-f0e5eb5b695c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:50.258075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9a076f53-b6a7-4773-b21b-f0e5eb5b695c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:50.272728 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9a076f53-b6a7-4773-b21b-f0e5eb5b695c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1314 microversion: 2.1 time: 0.367523 Jul 28 04:08:50.274403 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2970/5420] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:49 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:50.901640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-8e39375e-4464-48c0-8d57-4c25295d7737 req-27709804-d987-4e84-90f0-c7a8a87412a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8aed485d-7cfe-4cc2-ac19-7410ddde40bc", "tag": "255db851-4e99-4c40-82ce-a46cc3e38ee9"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:50.925158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8e39375e-4464-48c0-8d57-4c25295d7737 req-27709804-d987-4e84-90f0-c7a8a87412a2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:50.925650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8e39375e-4464-48c0-8d57-4c25295d7737 req-27709804-d987-4e84-90f0-c7a8a87412a2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:50.975141 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-8e39375e-4464-48c0-8d57-4c25295d7737 req-27709804-d987-4e84-90f0-c7a8a87412a2 service nova] Creating event network-changed:255db851-4e99-4c40-82ce-a46cc3e38ee9 for instance 8aed485d-7cfe-4cc2-ac19-7410ddde40bc on n-h2-826756-3 Jul 28 04:08:50.984392 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-8e39375e-4464-48c0-8d57-4c25295d7737 req-27709804-d987-4e84-90f0-c7a8a87412a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086420 Jul 28 04:08:50.985243 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2971/5421] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:08:50.996442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5dfcf4c9-06ba-400d-b851-3fe534a434eb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:51.003742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5dfcf4c9-06ba-400d-b851-3fe534a434eb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:51.017507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dfcf4c9-06ba-400d-b851-3fe534a434eb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:51.020552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dfcf4c9-06ba-400d-b851-3fe534a434eb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:51.023182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dfcf4c9-06ba-400d-b851-3fe534a434eb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:51.024974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dfcf4c9-06ba-400d-b851-3fe534a434eb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:51.378329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5dfcf4c9-06ba-400d-b851-3fe534a434eb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:51.387418 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5dfcf4c9-06ba-400d-b851-3fe534a434eb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1523 microversion: 2.1 time: 0.396164 Jul 28 04:08:51.401245 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2972/5422] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:50 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1523 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:51.414249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d21325b2-3c1f-4260-a750-1c988adf8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:51.414249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d21325b2-3c1f-4260-a750-1c988adf8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:51.414249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d21325b2-3c1f-4260-a750-1c988adf8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:51.414249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d21325b2-3c1f-4260-a750-1c988adf8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:51.415216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d21325b2-3c1f-4260-a750-1c988adf8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:51.415850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d21325b2-3c1f-4260-a750-1c988adf8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:51.729816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d21325b2-3c1f-4260-a750-1c988adf8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:51.740093 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d21325b2-3c1f-4260-a750-1c988adf8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1314 microversion: 2.1 time: 0.350585 Jul 28 04:08:51.741454 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2973/5423] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:51 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:52.426520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f55757b6-854a-4af5-b001-07577413e5d3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:52.427209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f55757b6-854a-4af5-b001-07577413e5d3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:52.442408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f55757b6-854a-4af5-b001-07577413e5d3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:52.444645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f55757b6-854a-4af5-b001-07577413e5d3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:52.446397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f55757b6-854a-4af5-b001-07577413e5d3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:52.447851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f55757b6-854a-4af5-b001-07577413e5d3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:52.786784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f55757b6-854a-4af5-b001-07577413e5d3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:52.807012 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f55757b6-854a-4af5-b001-07577413e5d3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1503 microversion: 2.1 time: 0.384462 Jul 28 04:08:52.810876 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2974/5424] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:52 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1503 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:52.842647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f20f2e4c-4246-4ce0-98f6-0da07144125e tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:52.843437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f20f2e4c-4246-4ce0-98f6-0da07144125e tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:52.850415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f20f2e4c-4246-4ce0-98f6-0da07144125e tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:52.850872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f20f2e4c-4246-4ce0-98f6-0da07144125e tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:52.853651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f20f2e4c-4246-4ce0-98f6-0da07144125e tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:52.854132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f20f2e4c-4246-4ce0-98f6-0da07144125e tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:53.131610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f20f2e4c-4246-4ce0-98f6-0da07144125e tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:53.145259 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f20f2e4c-4246-4ce0-98f6-0da07144125e tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1314 microversion: 2.1 time: 0.329241 Jul 28 04:08:53.148133 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2975/5425] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:52 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:53.178804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb2f3679-901a-4bb7-9ef5-61c5b7fa800a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:53.183908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eb2f3679-901a-4bb7-9ef5-61c5b7fa800a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:53.202679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb2f3679-901a-4bb7-9ef5-61c5b7fa800a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:53.206137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb2f3679-901a-4bb7-9ef5-61c5b7fa800a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:53.207645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb2f3679-901a-4bb7-9ef5-61c5b7fa800a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:53.210536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb2f3679-901a-4bb7-9ef5-61c5b7fa800a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:53.408810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:53.556058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eb2f3679-901a-4bb7-9ef5-61c5b7fa800a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:53.566605 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb2f3679-901a-4bb7-9ef5-61c5b7fa800a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1516 microversion: 2.1 time: 0.410079 Jul 28 04:08:53.567867 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2976/5426] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:53 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1516 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:53.599120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15f29fd0-2089-4d4c-b4b4-b4855944143a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:53.608127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15f29fd0-2089-4d4c-b4b4-b4855944143a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: e907735f-658b-4626-b05c-ef72a578378b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:53.625550 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-15f29fd0-2089-4d4c-b4b4-b4855944143a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] HTTP exception thrown: Instance e907735f-658b-4626-b05c-ef72a578378b could not be found. Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15f29fd0-2089-4d4c-b4b4-b4855944143a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Request method failure captured: Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/e907735f-658b-4626-b05c-ef72a578378b/action HTTP/1.1 Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 14 Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4guRH7cRyy41e8TMK6yH4E4vas5YneK3wNd43QNSbwP-vnU4KJvI9xnqarrFpgm_3d_MoR1ZpAdJmMyZ8u5FsxNmotKsW-BhbDNoNezHFEg5JbZI4uqCMDxre0Fl2vlF1EpCS09lknpXT0acA4YXSeuR-688T4pmq6O5npCWbGdqMXs Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/404ce0264e584456bfc6b523e914c408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_404ce0264e584456bfc6b523e914c408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}] Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0083854f0de14631ad15751829e34537 Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: {"rescue": {}} Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance e907735f-658b-4626-b05c-ef72a578378b could not be found. Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'e907735f-658b-4626-b05c-ef72a578378b', 'body': {'rescue': {}}} Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e907735f-658b-4626-b05c-ef72a578378b could not be found. Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e907735f-658b-4626-b05c-ef72a578378b could not be found. Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:53.634591 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:53.639079 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:08:53.639079 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:08:53.639079 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:08:53.639079 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:08:53.639079 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e907735f-658b-4626-b05c-ef72a578378b could not be found. Jul 28 04:08:53.639079 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:53.643969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15f29fd0-2089-4d4c-b4b4-b4855944143a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Returning 404 to user: Instance e907735f-658b-4626-b05c-ef72a578378b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:08:53.645878 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15f29fd0-2089-4d4c-b4b4-b4855944143a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers/e907735f-658b-4626-b05c-ef72a578378b/action" status: 404 len: 111 microversion: 2.1 time: 0.054503 Jul 28 04:08:53.646992 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2977/5427] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:08:53 2022] POST /compute/v2.1/servers/e907735f-658b-4626-b05c-ef72a578378b/action => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:08:53.682154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1406b5ed-27f1-4e6c-9f5f-02151df7ba48 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:53.683329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1406b5ed-27f1-4e6c-9f5f-02151df7ba48 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:53.707525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1406b5ed-27f1-4e6c-9f5f-02151df7ba48 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:53.708435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1406b5ed-27f1-4e6c-9f5f-02151df7ba48 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:53.710072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1406b5ed-27f1-4e6c-9f5f-02151df7ba48 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:53.710752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1406b5ed-27f1-4e6c-9f5f-02151df7ba48 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:53.818527 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1406b5ed-27f1-4e6c-9f5f-02151df7ba48 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321/action" status: 202 len: 0 microversion: 2.1 time: 0.162779 Jul 28 04:08:53.823401 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2978/5428] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:08:53 2022] POST /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:08:53.833447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f3b0b40-cc17-4002-84bb-bbeecb759e2d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:53.855047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6f3b0b40-cc17-4002-84bb-bbeecb759e2d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:53.875835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f3b0b40-cc17-4002-84bb-bbeecb759e2d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:53.877889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f3b0b40-cc17-4002-84bb-bbeecb759e2d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:53.881184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f3b0b40-cc17-4002-84bb-bbeecb759e2d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:53.882207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f3b0b40-cc17-4002-84bb-bbeecb759e2d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:54.131651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6f3b0b40-cc17-4002-84bb-bbeecb759e2d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:54.149024 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6f3b0b40-cc17-4002-84bb-bbeecb759e2d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1521 microversion: 2.1 time: 0.324170 Jul 28 04:08:54.149980 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2979/5429] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:53 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:54.186584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-10e5c68c-6cb6-4250-9d18-d0c671dc2064 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:54.187567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-10e5c68c-6cb6-4250-9d18-d0c671dc2064 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:54.197074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10e5c68c-6cb6-4250-9d18-d0c671dc2064 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:54.197866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10e5c68c-6cb6-4250-9d18-d0c671dc2064 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:54.198901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10e5c68c-6cb6-4250-9d18-d0c671dc2064 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:54.199661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10e5c68c-6cb6-4250-9d18-d0c671dc2064 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:54.464081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-10e5c68c-6cb6-4250-9d18-d0c671dc2064 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:54.471639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:54.476488 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-10e5c68c-6cb6-4250-9d18-d0c671dc2064 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1314 microversion: 2.1 time: 0.293290 Jul 28 04:08:54.477431 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2980/5430] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:54 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:55.172318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4524972f-6935-4f7c-a847-1b897ad65cca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:55.173078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4524972f-6935-4f7c-a847-1b897ad65cca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:55.199576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4524972f-6935-4f7c-a847-1b897ad65cca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:55.199958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4524972f-6935-4f7c-a847-1b897ad65cca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:55.200734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4524972f-6935-4f7c-a847-1b897ad65cca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:55.201177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4524972f-6935-4f7c-a847-1b897ad65cca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:55.548246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4524972f-6935-4f7c-a847-1b897ad65cca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:55.567059 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4524972f-6935-4f7c-a847-1b897ad65cca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1501 microversion: 2.1 time: 0.394909 Jul 28 04:08:55.568579 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2981/5431] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:55 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1501 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:55.590213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-37052c7e-105f-4c04-ad7b-cb16f919924b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:55.603903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-37052c7e-105f-4c04-ad7b-cb16f919924b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:55.633818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37052c7e-105f-4c04-ad7b-cb16f919924b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:55.634282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37052c7e-105f-4c04-ad7b-cb16f919924b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:55.635312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37052c7e-105f-4c04-ad7b-cb16f919924b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:55.642608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37052c7e-105f-4c04-ad7b-cb16f919924b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:55.910078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-37052c7e-105f-4c04-ad7b-cb16f919924b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:55.921900 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-37052c7e-105f-4c04-ad7b-cb16f919924b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1314 microversion: 2.1 time: 0.351093 Jul 28 04:08:55.924811 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2982/5432] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:55 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:55.934475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4fc496a-bc67-470a-8a82-a291e0a8684a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:55.942997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e4fc496a-bc67-470a-8a82-a291e0a8684a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:55.959086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4fc496a-bc67-470a-8a82-a291e0a8684a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:55.961462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4fc496a-bc67-470a-8a82-a291e0a8684a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:55.963740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4fc496a-bc67-470a-8a82-a291e0a8684a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:55.966814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4fc496a-bc67-470a-8a82-a291e0a8684a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:56.024664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-e4fc496a-bc67-470a-8a82-a291e0a8684a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lazy-loading 'flavor' on Instance uuid d4b6d7c1-b65f-465c-97d1-fe40465a3321 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:08:56.044608 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e4fc496a-bc67-470a-8a82-a291e0a8684a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] HTTP exception thrown: Cannot 'rescue' instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 while it is in vm_state paused Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4fc496a-bc67-470a-8a82-a291e0a8684a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Request method failure captured: Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321/action HTTP/1.1 Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 14 Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4guRH7cRyy41e8TMK6yH4E4vas5YneK3wNd43QNSbwP-vnU4KJvI9xnqarrFpgm_3d_MoR1ZpAdJmMyZ8u5FsxNmotKsW-BhbDNoNezHFEg5JbZI4uqCMDxre0Fl2vlF1EpCS09lknpXT0acA4YXSeuR-688T4pmq6O5npCWbGdqMXs Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/404ce0264e584456bfc6b523e914c408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_404ce0264e584456bfc6b523e914c408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}] Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0083854f0de14631ad15751829e34537 Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: {"rescue": {}} Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: exception: Cannot 'rescue' instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 while it is in vm_state paused Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd4b6d7c1-b65f-465c-97d1-fe40465a3321', 'body': {'rescue': {}}} Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 276, in inner Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 in vm_state paused. Cannot rescue while the instance is in this state. Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 while it is in vm_state paused Jul 28 04:08:56.057864 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:56.064237 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:08:56.064237 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:56.064237 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:56.064237 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:08:56.064237 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:08:56.064237 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:08:56.064237 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:08:56.064237 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 while it is in vm_state paused Jul 28 04:08:56.064237 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:08:56.064237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4fc496a-bc67-470a-8a82-a291e0a8684a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Returning 409 to user: Cannot 'rescue' instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 while it is in vm_state paused {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:08:56.064237 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e4fc496a-bc67-470a-8a82-a291e0a8684a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321/action" status: 409 len: 144 microversion: 2.1 time: 0.133090 Jul 28 04:08:56.064237 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2983/5433] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:08:55 2022] POST /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321/action => generated 144 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 04:08:56.073934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-491bcfb1-1ae6-4c06-a4a0-c8bbbd47b5a6 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:56.074477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-491bcfb1-1ae6-4c06-a4a0-c8bbbd47b5a6 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:56.081899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-491bcfb1-1ae6-4c06-a4a0-c8bbbd47b5a6 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:56.096024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-491bcfb1-1ae6-4c06-a4a0-c8bbbd47b5a6 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:56.097207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-491bcfb1-1ae6-4c06-a4a0-c8bbbd47b5a6 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:56.097797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-491bcfb1-1ae6-4c06-a4a0-c8bbbd47b5a6 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:56.346074 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-491bcfb1-1ae6-4c06-a4a0-c8bbbd47b5a6 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321/action" status: 202 len: 0 microversion: 2.1 time: 0.278445 Jul 28 04:08:56.353809 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2984/5434] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:08:56 2022] POST /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:08:56.368534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-567cd81f-3d45-42bf-a6e4-6296d6e38719 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:56.372975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-567cd81f-3d45-42bf-a6e4-6296d6e38719 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:56.392877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-567cd81f-3d45-42bf-a6e4-6296d6e38719 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:56.394368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-567cd81f-3d45-42bf-a6e4-6296d6e38719 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:56.397493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-567cd81f-3d45-42bf-a6e4-6296d6e38719 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:56.399129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-567cd81f-3d45-42bf-a6e4-6296d6e38719 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:56.802125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-567cd81f-3d45-42bf-a6e4-6296d6e38719 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:56.821958 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-567cd81f-3d45-42bf-a6e4-6296d6e38719 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1508 microversion: 2.1 time: 0.466528 Jul 28 04:08:56.825897 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2985/5435] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:56 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1508 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:56.943564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-67af6292-2028-438e-85e7-1648d973f66b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:56.944333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-67af6292-2028-438e-85e7-1648d973f66b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:56.959240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67af6292-2028-438e-85e7-1648d973f66b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:56.960377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67af6292-2028-438e-85e7-1648d973f66b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:56.962929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67af6292-2028-438e-85e7-1648d973f66b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:56.963718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67af6292-2028-438e-85e7-1648d973f66b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:57.235296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-67af6292-2028-438e-85e7-1648d973f66b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:57.248822 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-67af6292-2028-438e-85e7-1648d973f66b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1314 microversion: 2.1 time: 0.309152 Jul 28 04:08:57.253605 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2986/5436] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:56 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:57.260620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-7768e23b-ad51-48f2-b1da-5a5c97bcea1e req-500ca867-5b52-4712-a1bf-8294fc4f63fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aed485d-7cfe-4cc2-ac19-7410ddde40bc", "name": "network-vif-plugged", "status": "completed", "tag": "255db851-4e99-4c40-82ce-a46cc3e38ee9"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:57.274758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7768e23b-ad51-48f2-b1da-5a5c97bcea1e req-500ca867-5b52-4712-a1bf-8294fc4f63fc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:57.275651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7768e23b-ad51-48f2-b1da-5a5c97bcea1e req-500ca867-5b52-4712-a1bf-8294fc4f63fc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:57.293553 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-7768e23b-ad51-48f2-b1da-5a5c97bcea1e req-500ca867-5b52-4712-a1bf-8294fc4f63fc service nova] Creating event network-vif-plugged:255db851-4e99-4c40-82ce-a46cc3e38ee9 for instance 8aed485d-7cfe-4cc2-ac19-7410ddde40bc on n-h2-826756-3 Jul 28 04:08:57.301140 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-7768e23b-ad51-48f2-b1da-5a5c97bcea1e req-500ca867-5b52-4712-a1bf-8294fc4f63fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045455 Jul 28 04:08:57.302393 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2987/5437] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:57.855622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0614e9b4-94f1-40fa-bda0-fa8564a9401e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:57.860788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0614e9b4-94f1-40fa-bda0-fa8564a9401e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:57.872112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0614e9b4-94f1-40fa-bda0-fa8564a9401e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:57.873567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0614e9b4-94f1-40fa-bda0-fa8564a9401e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:57.876057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0614e9b4-94f1-40fa-bda0-fa8564a9401e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:57.877879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0614e9b4-94f1-40fa-bda0-fa8564a9401e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:58.162339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0614e9b4-94f1-40fa-bda0-fa8564a9401e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:58.178424 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0614e9b4-94f1-40fa-bda0-fa8564a9401e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1516 microversion: 2.1 time: 0.331189 Jul 28 04:08:58.180267 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2988/5438] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:57 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1516 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:58.271760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eea19fd2-ae3a-480f-8acc-e50b0921d268 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:58.272205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eea19fd2-ae3a-480f-8acc-e50b0921d268 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:58.281852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eea19fd2-ae3a-480f-8acc-e50b0921d268 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:58.283360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eea19fd2-ae3a-480f-8acc-e50b0921d268 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:58.286180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eea19fd2-ae3a-480f-8acc-e50b0921d268 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:58.288960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eea19fd2-ae3a-480f-8acc-e50b0921d268 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:58.600834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eea19fd2-ae3a-480f-8acc-e50b0921d268 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:58.617267 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eea19fd2-ae3a-480f-8acc-e50b0921d268 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1314 microversion: 2.1 time: 0.350625 Jul 28 04:08:58.618669 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2989/5439] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:58 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:59.640447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c1c884c5-4b70-427f-9442-5c6b4977816d tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:59.641183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c1c884c5-4b70-427f-9442-5c6b4977816d tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:08:59.657541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1c884c5-4b70-427f-9442-5c6b4977816d tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:59.660567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1c884c5-4b70-427f-9442-5c6b4977816d tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:59.661386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1c884c5-4b70-427f-9442-5c6b4977816d tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:59.661826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1c884c5-4b70-427f-9442-5c6b4977816d tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:00.023977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c1c884c5-4b70-427f-9442-5c6b4977816d tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:00.034881 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c1c884c5-4b70-427f-9442-5c6b4977816d tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1498 microversion: 2.1 time: 0.398270 Jul 28 04:09:00.058165 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2990/5440] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:59 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1498 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:00.891618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e8d4a84c-69a0-4990-a412-edfe2d591427 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:00.893934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e8d4a84c-69a0-4990-a412-edfe2d591427 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:00.904101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8d4a84c-69a0-4990-a412-edfe2d591427 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:00.904582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8d4a84c-69a0-4990-a412-edfe2d591427 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:00.905474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8d4a84c-69a0-4990-a412-edfe2d591427 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:00.910622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8d4a84c-69a0-4990-a412-edfe2d591427 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:00.965812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e8d4a84c-69a0-4990-a412-edfe2d591427 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:09:01.122838 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e8d4a84c-69a0-4990-a412-edfe2d591427 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 204 len: 0 microversion: 2.1 time: 0.235949 Jul 28 04:09:01.123555 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2991/5441] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:09:00 2022] DELETE /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:09:01.133033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cfa94d15-f22a-4c3b-9860-9f817f6fb79c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:01.133914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cfa94d15-f22a-4c3b-9860-9f817f6fb79c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:01.156624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfa94d15-f22a-4c3b-9860-9f817f6fb79c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:01.157683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfa94d15-f22a-4c3b-9860-9f817f6fb79c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:01.161470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfa94d15-f22a-4c3b-9860-9f817f6fb79c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:01.162150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfa94d15-f22a-4c3b-9860-9f817f6fb79c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:01.389449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cfa94d15-f22a-4c3b-9860-9f817f6fb79c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:01.401112 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cfa94d15-f22a-4c3b-9860-9f817f6fb79c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1504 microversion: 2.1 time: 0.273038 Jul 28 04:09:01.403654 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2992/5442] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:01 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1504 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:01.409542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7092fdca-8e47-47d2-a1da-e73560042809 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:01.412230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7092fdca-8e47-47d2-a1da-e73560042809 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:01.419379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7092fdca-8e47-47d2-a1da-e73560042809 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:01.420097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7092fdca-8e47-47d2-a1da-e73560042809 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:01.421117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7092fdca-8e47-47d2-a1da-e73560042809 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:01.421714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7092fdca-8e47-47d2-a1da-e73560042809 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:01.459400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-7092fdca-8e47-47d2-a1da-e73560042809 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lazy-loading 'flavor' on Instance uuid d4b6d7c1-b65f-465c-97d1-fe40465a3321 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:09:01.551685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:01.586055 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7092fdca-8e47-47d2-a1da-e73560042809 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321/action" status: 200 len: 32 microversion: 2.1 time: 0.180465 Jul 28 04:09:01.587037 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2993/5443] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:09:01 2022] POST /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:09:01.603690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b874e0d-6bf2-4373-b48d-c6047e75a043 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:01.605380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3b874e0d-6bf2-4373-b48d-c6047e75a043 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:01.629936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b874e0d-6bf2-4373-b48d-c6047e75a043 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:01.630408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b874e0d-6bf2-4373-b48d-c6047e75a043 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:01.633017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b874e0d-6bf2-4373-b48d-c6047e75a043 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:01.633548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b874e0d-6bf2-4373-b48d-c6047e75a043 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:01.839850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3b874e0d-6bf2-4373-b48d-c6047e75a043 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:01.848210 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3b874e0d-6bf2-4373-b48d-c6047e75a043 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.252536 Jul 28 04:09:01.852447 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2994/5444] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:01 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:02.427637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d0bcc032-c607-46e3-9568-ab6b01fc320c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:02.429776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d0bcc032-c607-46e3-9568-ab6b01fc320c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:02.445897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0bcc032-c607-46e3-9568-ab6b01fc320c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:02.447248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0bcc032-c607-46e3-9568-ab6b01fc320c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:02.449281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0bcc032-c607-46e3-9568-ab6b01fc320c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:02.450567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0bcc032-c607-46e3-9568-ab6b01fc320c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:02.687394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d0bcc032-c607-46e3-9568-ab6b01fc320c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:02.709612 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d0bcc032-c607-46e3-9568-ab6b01fc320c tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1504 microversion: 2.1 time: 0.286394 Jul 28 04:09:02.711177 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2995/5445] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:02 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:02.871002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a62f7bf-6b37-4ae1-9fef-7c3d25496b50 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:02.871860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8a62f7bf-6b37-4ae1-9fef-7c3d25496b50 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:02.879269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a62f7bf-6b37-4ae1-9fef-7c3d25496b50 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:02.879950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a62f7bf-6b37-4ae1-9fef-7c3d25496b50 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:02.880886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a62f7bf-6b37-4ae1-9fef-7c3d25496b50 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:02.881395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a62f7bf-6b37-4ae1-9fef-7c3d25496b50 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:03.114814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a62f7bf-6b37-4ae1-9fef-7c3d25496b50 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:03.124648 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a62f7bf-6b37-4ae1-9fef-7c3d25496b50 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.258241 Jul 28 04:09:03.126833 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2996/5446] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:02 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:03.739730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f328515c-2971-447f-8f12-399a049c8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:03.741822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f328515c-2971-447f-8f12-399a049c8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:03.750339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f328515c-2971-447f-8f12-399a049c8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:03.751102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f328515c-2971-447f-8f12-399a049c8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:03.752132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f328515c-2971-447f-8f12-399a049c8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:03.752822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f328515c-2971-447f-8f12-399a049c8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:03.938826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f328515c-2971-447f-8f12-399a049c8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:03.949044 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f328515c-2971-447f-8f12-399a049c8313 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1504 microversion: 2.1 time: 0.213629 Jul 28 04:09:03.954860 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2997/5447] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:03 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:04.150252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b071cbdd-2939-4af9-bc2b-c3b9347d3a3c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:04.151099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b071cbdd-2939-4af9-bc2b-c3b9347d3a3c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:04.153849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:04.160044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b071cbdd-2939-4af9-bc2b-c3b9347d3a3c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:04.160784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b071cbdd-2939-4af9-bc2b-c3b9347d3a3c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:04.161759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b071cbdd-2939-4af9-bc2b-c3b9347d3a3c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:04.162476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b071cbdd-2939-4af9-bc2b-c3b9347d3a3c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:04.392078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b071cbdd-2939-4af9-bc2b-c3b9347d3a3c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:04.402940 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b071cbdd-2939-4af9-bc2b-c3b9347d3a3c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.260632 Jul 28 04:09:04.403890 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2998/5448] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:04 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:04.694405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-50dd5a21-7e40-4e0d-b04c-f9e379c92d5c req-1dcb080e-26d9-4ad7-a584-49ed5d952b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8aed485d-7cfe-4cc2-ac19-7410ddde40bc", "name": "network-vif-deleted", "tag": "255db851-4e99-4c40-82ce-a46cc3e38ee9"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:04.705333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-50dd5a21-7e40-4e0d-b04c-f9e379c92d5c req-1dcb080e-26d9-4ad7-a584-49ed5d952b6b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:04.705777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-50dd5a21-7e40-4e0d-b04c-f9e379c92d5c req-1dcb080e-26d9-4ad7-a584-49ed5d952b6b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:04.719145 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-50dd5a21-7e40-4e0d-b04c-f9e379c92d5c req-1dcb080e-26d9-4ad7-a584-49ed5d952b6b service nova] Creating event network-vif-deleted:255db851-4e99-4c40-82ce-a46cc3e38ee9 for instance 8aed485d-7cfe-4cc2-ac19-7410ddde40bc on n-h2-826756-3 Jul 28 04:09:04.724730 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-50dd5a21-7e40-4e0d-b04c-f9e379c92d5c req-1dcb080e-26d9-4ad7-a584-49ed5d952b6b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034562 Jul 28 04:09:04.725536 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 2999/5449] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:09:05.088008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5107391d-2ba9-4d3f-9904-50a29ebfea6f tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:05.088799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5107391d-2ba9-4d3f-9904-50a29ebfea6f tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:05.096630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5107391d-2ba9-4d3f-9904-50a29ebfea6f tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:05.097560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5107391d-2ba9-4d3f-9904-50a29ebfea6f tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:05.098406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5107391d-2ba9-4d3f-9904-50a29ebfea6f tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:05.098861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5107391d-2ba9-4d3f-9904-50a29ebfea6f tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:05.150536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5107391d-2ba9-4d3f-9904-50a29ebfea6f tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:05.151212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5107391d-2ba9-4d3f-9904-50a29ebfea6f tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:05.151846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-5107391d-2ba9-4d3f-9904-50a29ebfea6f tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lazy-loading 'fault' on Instance uuid 8aed485d-7cfe-4cc2-ac19-7410ddde40bc {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:09:05.400058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5107391d-2ba9-4d3f-9904-50a29ebfea6f tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:05.400058 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5107391d-2ba9-4d3f-9904-50a29ebfea6f tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 200 len: 1304 microversion: 2.1 time: 0.156590 Jul 28 04:09:05.400058 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3000/5450] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:05 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 1304 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:05.434217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43fbb97d-2839-4980-96a3-fe1e3cb3098a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:05.434854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-43fbb97d-2839-4980-96a3-fe1e3cb3098a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:05.453926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43fbb97d-2839-4980-96a3-fe1e3cb3098a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:05.454747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43fbb97d-2839-4980-96a3-fe1e3cb3098a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:05.455552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43fbb97d-2839-4980-96a3-fe1e3cb3098a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:05.455991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43fbb97d-2839-4980-96a3-fe1e3cb3098a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:06.072569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-43fbb97d-2839-4980-96a3-fe1e3cb3098a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:06.092339 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43fbb97d-2839-4980-96a3-fe1e3cb3098a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.670549 Jul 28 04:09:06.094127 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3001/5451] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:05 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:06.284768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2a5785ef-4129-4736-97a3-b45bc9f2b852 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:06.289279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2a5785ef-4129-4736-97a3-b45bc9f2b852 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 8aed485d-7cfe-4cc2-ac19-7410ddde40bc] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:06.325410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a5785ef-4129-4736-97a3-b45bc9f2b852 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:06.326639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a5785ef-4129-4736-97a3-b45bc9f2b852 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:06.328153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a5785ef-4129-4736-97a3-b45bc9f2b852 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:06.337594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a5785ef-4129-4736-97a3-b45bc9f2b852 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:06.371416 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-2a5785ef-4129-4736-97a3-b45bc9f2b852 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] HTTP exception thrown: Instance 8aed485d-7cfe-4cc2-ac19-7410ddde40bc could not be found. Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2a5785ef-4129-4736-97a3-b45bc9f2b852 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Request method failure captured: Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc HTTP/1.1 Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gvE6jzromIhVNklyNJp_I5ZnBOCAwppi-zyiKTfLMnKrBVHWjzfhvpuXV0HddYeQVyKbn9okjXwnlv11H2cFje1W_oHsFZ36lXrwFUYvcqGkCZmfkf8KvzsQ6NkJ7Rr0mwSoBFSTWdrYVJqrtxh2gWQmK_bF9rfZAuP6XH27m_0MF4 Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 334b2c98f9a24fe88bf86505eb5863f9 Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-VolumesActionsTest-839331337 Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/334b2c98f9a24fe88bf86505eb5863f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/334b2c98f9a24fe88bf86505eb5863f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_334b2c98f9a24fe88bf86505eb5863f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/334b2c98f9a24fe88bf86505eb5863f9"}]}] Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-VolumesActionsTest-839331337 Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 334b2c98f9a24fe88bf86505eb5863f9 Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-VolumesActionsTest-839331337 Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-VolumesActionsTest-839331337-project Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a23ab0ed18c4425c9f2ccce44b7201f7 Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-VolumesActionsTest-839331337-project Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 8aed485d-7cfe-4cc2-ac19-7410ddde40bc could not be found. Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8aed485d-7cfe-4cc2-ac19-7410ddde40bc'} Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8aed485d-7cfe-4cc2-ac19-7410ddde40bc could not be found. Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8aed485d-7cfe-4cc2-ac19-7410ddde40bc could not be found. Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:09:06.378792 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:06.383520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:06.383520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:09:06.383520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:09:06.383520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:09:06.383520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:09:06.383520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8aed485d-7cfe-4cc2-ac19-7410ddde40bc could not be found. Jul 28 04:09:06.383520 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:06.385510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2a5785ef-4129-4736-97a3-b45bc9f2b852 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Returning 404 to user: Instance 8aed485d-7cfe-4cc2-ac19-7410ddde40bc could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:09:06.386672 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2a5785ef-4129-4736-97a3-b45bc9f2b852 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc" status: 404 len: 111 microversion: 2.1 time: 0.129131 Jul 28 04:09:06.394525 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3002/5452] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:06 2022] GET /compute/v2.1/servers/8aed485d-7cfe-4cc2-ac19-7410ddde40bc => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:09:06.541835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2143975780", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "584e7f8f-88c1-4e41-a5a1-6904e44c78f3"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:06.621387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] validate_networks() for [('584e7f8f-88c1-4e41-a5a1-6904e44c78f3', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:09:07.317786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:09:07.319612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:09:07.320341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:09:07.321035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:09:07.321673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:09:07.335161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:07.336188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:07.338177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:07.338880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:07.372909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Getting quotas for project 334b2c98f9a24fe88bf86505eb5863f9. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:09:07.380454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Getting quotas for user a23ab0ed18c4425c9f2ccce44b7201f7 and project 334b2c98f9a24fe88bf86505eb5863f9. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:09:07.399056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:09:07.402213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:09:07.492137 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd9fc192-452d-41cf-a398-a8c24ee02683 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956245 Jul 28 04:09:07.495082 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3003/5453] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:09:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:09:07.510455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a5bea0de-49e0-4657-a6f5-f55c6dff258e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:07.510989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a5bea0de-49e0-4657-a6f5-f55c6dff258e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:07.526105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5bea0de-49e0-4657-a6f5-f55c6dff258e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:07.526836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5bea0de-49e0-4657-a6f5-f55c6dff258e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:07.527661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5bea0de-49e0-4657-a6f5-f55c6dff258e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:07.528110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5bea0de-49e0-4657-a6f5-f55c6dff258e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:07.802934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a5bea0de-49e0-4657-a6f5-f55c6dff258e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:07.815471 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a5bea0de-49e0-4657-a6f5-f55c6dff258e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.313374 Jul 28 04:09:07.828380 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3004/5454] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:07 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:07.828380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-425228a1-257b-4b7f-ad55-cd50f60c4a22 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:07.828380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-425228a1-257b-4b7f-ad55-cd50f60c4a22 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:07.959679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-425228a1-257b-4b7f-ad55-cd50f60c4a22 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:07.980255 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-425228a1-257b-4b7f-ad55-cd50f60c4a22 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 200 len: 1214 microversion: 2.1 time: 0.160702 Jul 28 04:09:07.983043 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3005/5455] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:07 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 1214 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:08.838013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59998ee4-826d-40a2-962e-de46dac61f03 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:08.839416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59998ee4-826d-40a2-962e-de46dac61f03 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:08.857914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59998ee4-826d-40a2-962e-de46dac61f03 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:08.858941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59998ee4-826d-40a2-962e-de46dac61f03 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:08.860110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59998ee4-826d-40a2-962e-de46dac61f03 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:08.860785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59998ee4-826d-40a2-962e-de46dac61f03 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:09.171235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-59998ee4-826d-40a2-962e-de46dac61f03 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:09.186729 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59998ee4-826d-40a2-962e-de46dac61f03 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.352727 Jul 28 04:09:09.188231 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3006/5456] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:08 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:09.193738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-72966f99-6a65-4264-95bf-38b1ba0e82f9 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:09.194708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-72966f99-6a65-4264-95bf-38b1ba0e82f9 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:09.202516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72966f99-6a65-4264-95bf-38b1ba0e82f9 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:09.202970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72966f99-6a65-4264-95bf-38b1ba0e82f9 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:09.204045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72966f99-6a65-4264-95bf-38b1ba0e82f9 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:09.204804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72966f99-6a65-4264-95bf-38b1ba0e82f9 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:09.357421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-72966f99-6a65-4264-95bf-38b1ba0e82f9 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:09.368995 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-72966f99-6a65-4264-95bf-38b1ba0e82f9 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 200 len: 1274 microversion: 2.1 time: 0.179213 Jul 28 04:09:09.370287 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3007/5457] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:09 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 1274 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:10.211417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c7543368-7f74-419f-9af5-fe7063ecb31b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:10.214124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c7543368-7f74-419f-9af5-fe7063ecb31b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:10.226039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7543368-7f74-419f-9af5-fe7063ecb31b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:10.226845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7543368-7f74-419f-9af5-fe7063ecb31b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:10.227883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7543368-7f74-419f-9af5-fe7063ecb31b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:10.228603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7543368-7f74-419f-9af5-fe7063ecb31b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:10.574577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c7543368-7f74-419f-9af5-fe7063ecb31b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:10.586696 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c7543368-7f74-419f-9af5-fe7063ecb31b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.381097 Jul 28 04:09:10.587897 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3008/5458] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:10 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:10.593623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9ffc4341-21f0-4551-a799-91b37c288284 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:10.594668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9ffc4341-21f0-4551-a799-91b37c288284 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:10.603459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ffc4341-21f0-4551-a799-91b37c288284 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:10.604252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ffc4341-21f0-4551-a799-91b37c288284 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:10.605310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ffc4341-21f0-4551-a799-91b37c288284 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:10.605906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ffc4341-21f0-4551-a799-91b37c288284 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:10.791835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9ffc4341-21f0-4551-a799-91b37c288284 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:10.813826 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9ffc4341-21f0-4551-a799-91b37c288284 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 200 len: 1314 microversion: 2.1 time: 0.223185 Jul 28 04:09:10.816229 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3009/5459] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:10 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:11.578144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-5f0d2e1c-1738-4247-a3a9-1bddf3e4bd3e req-874c3aac-92bc-4d1e-beae-9fe48de3b770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "529072f5-5148-4f45-a6af-27f26c3fb872", "tag": "eeedd05d-e287-4d78-bd08-1f735f6dcb35"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:11.622302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5f0d2e1c-1738-4247-a3a9-1bddf3e4bd3e req-874c3aac-92bc-4d1e-beae-9fe48de3b770 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:11.637790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5f0d2e1c-1738-4247-a3a9-1bddf3e4bd3e req-874c3aac-92bc-4d1e-beae-9fe48de3b770 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:11.691162 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5f0d2e1c-1738-4247-a3a9-1bddf3e4bd3e req-874c3aac-92bc-4d1e-beae-9fe48de3b770 service nova] Creating event network-changed:eeedd05d-e287-4d78-bd08-1f735f6dcb35 for instance 529072f5-5148-4f45-a6af-27f26c3fb872 on n-h2-826756-3 Jul 28 04:09:11.697566 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-5f0d2e1c-1738-4247-a3a9-1bddf3e4bd3e req-874c3aac-92bc-4d1e-beae-9fe48de3b770 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122346 Jul 28 04:09:11.698977 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3010/5460] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:09:11.706048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9ec39ad9-b57a-4006-aa87-b68d36d7a2f5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:11.706941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9ec39ad9-b57a-4006-aa87-b68d36d7a2f5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:11.756644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ec39ad9-b57a-4006-aa87-b68d36d7a2f5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:11.757107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ec39ad9-b57a-4006-aa87-b68d36d7a2f5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:11.757921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ec39ad9-b57a-4006-aa87-b68d36d7a2f5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:11.758355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ec39ad9-b57a-4006-aa87-b68d36d7a2f5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:11.996483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9ec39ad9-b57a-4006-aa87-b68d36d7a2f5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:12.010016 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9ec39ad9-b57a-4006-aa87-b68d36d7a2f5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.308395 Jul 28 04:09:12.011812 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3011/5461] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:11 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:12.020291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bca0e633-04a6-4f11-a544-b8eb65943690 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:12.020943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bca0e633-04a6-4f11-a544-b8eb65943690 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:12.027573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bca0e633-04a6-4f11-a544-b8eb65943690 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:12.028022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bca0e633-04a6-4f11-a544-b8eb65943690 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:12.028825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bca0e633-04a6-4f11-a544-b8eb65943690 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:12.029301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bca0e633-04a6-4f11-a544-b8eb65943690 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:12.233888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bca0e633-04a6-4f11-a544-b8eb65943690 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:12.242898 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bca0e633-04a6-4f11-a544-b8eb65943690 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 200 len: 1314 microversion: 2.1 time: 0.229235 Jul 28 04:09:12.243497 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3012/5462] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:12 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:13.035058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b42e0ee8-0b3d-4657-ba9e-1fa65486b408 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:13.036920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b42e0ee8-0b3d-4657-ba9e-1fa65486b408 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:13.062845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b42e0ee8-0b3d-4657-ba9e-1fa65486b408 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:13.063218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b42e0ee8-0b3d-4657-ba9e-1fa65486b408 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:13.064051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b42e0ee8-0b3d-4657-ba9e-1fa65486b408 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:13.068511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b42e0ee8-0b3d-4657-ba9e-1fa65486b408 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:13.100614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:13.310236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b42e0ee8-0b3d-4657-ba9e-1fa65486b408 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:13.319109 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b42e0ee8-0b3d-4657-ba9e-1fa65486b408 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.289976 Jul 28 04:09:13.319712 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3013/5463] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:13 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:13.325307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-718c5d1b-4ddc-4282-a633-ea49b7cc2cbe tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:13.326404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-718c5d1b-4ddc-4282-a633-ea49b7cc2cbe tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:13.336916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-718c5d1b-4ddc-4282-a633-ea49b7cc2cbe tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:13.337364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-718c5d1b-4ddc-4282-a633-ea49b7cc2cbe tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:13.338164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-718c5d1b-4ddc-4282-a633-ea49b7cc2cbe tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:13.338608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-718c5d1b-4ddc-4282-a633-ea49b7cc2cbe tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:13.610375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-718c5d1b-4ddc-4282-a633-ea49b7cc2cbe tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:13.619889 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-718c5d1b-4ddc-4282-a633-ea49b7cc2cbe tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 200 len: 1314 microversion: 2.1 time: 0.298894 Jul 28 04:09:13.620528 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3014/5464] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:13 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:14.362428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b879b69-0f16-4677-9498-73b3a6cf687a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:14.365008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3b879b69-0f16-4677-9498-73b3a6cf687a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:14.374322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b879b69-0f16-4677-9498-73b3a6cf687a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:14.374702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b879b69-0f16-4677-9498-73b3a6cf687a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:14.376120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b879b69-0f16-4677-9498-73b3a6cf687a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:14.376797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b879b69-0f16-4677-9498-73b3a6cf687a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:14.585978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3b879b69-0f16-4677-9498-73b3a6cf687a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:14.595677 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3b879b69-0f16-4677-9498-73b3a6cf687a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.247828 Jul 28 04:09:14.596563 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3015/5465] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:14 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:14.640629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e20fa838-a100-42ba-86bb-c04506133068 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:14.641323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e20fa838-a100-42ba-86bb-c04506133068 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:14.651094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e20fa838-a100-42ba-86bb-c04506133068 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:14.651644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e20fa838-a100-42ba-86bb-c04506133068 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:14.652365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e20fa838-a100-42ba-86bb-c04506133068 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:14.652861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e20fa838-a100-42ba-86bb-c04506133068 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:14.946028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e20fa838-a100-42ba-86bb-c04506133068 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:14.973042 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e20fa838-a100-42ba-86bb-c04506133068 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 200 len: 1314 microversion: 2.1 time: 0.332129 Jul 28 04:09:14.978053 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3016/5466] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:14 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:15.617310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0827bfbd-1f11-4ae3-a51c-0b64215a9f28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:15.617963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0827bfbd-1f11-4ae3-a51c-0b64215a9f28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:15.625318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0827bfbd-1f11-4ae3-a51c-0b64215a9f28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:15.625781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0827bfbd-1f11-4ae3-a51c-0b64215a9f28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:15.626592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0827bfbd-1f11-4ae3-a51c-0b64215a9f28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:15.627038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0827bfbd-1f11-4ae3-a51c-0b64215a9f28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:15.892121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0827bfbd-1f11-4ae3-a51c-0b64215a9f28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:15.902652 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0827bfbd-1f11-4ae3-a51c-0b64215a9f28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.289237 Jul 28 04:09:15.918574 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3017/5467] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:15 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:15.997929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f021d82-8bb6-4ff6-9af3-161235821a8b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:15.998655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f021d82-8bb6-4ff6-9af3-161235821a8b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:16.007777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f021d82-8bb6-4ff6-9af3-161235821a8b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:16.008180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f021d82-8bb6-4ff6-9af3-161235821a8b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:16.009034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f021d82-8bb6-4ff6-9af3-161235821a8b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:16.009477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f021d82-8bb6-4ff6-9af3-161235821a8b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:16.211373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f021d82-8bb6-4ff6-9af3-161235821a8b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:16.225574 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f021d82-8bb6-4ff6-9af3-161235821a8b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 200 len: 1314 microversion: 2.1 time: 0.232081 Jul 28 04:09:16.227347 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3018/5468] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:15 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:16.926584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-404d6d2e-ba3c-49e4-bb2c-08ee8e654a44 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:16.927306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-404d6d2e-ba3c-49e4-bb2c-08ee8e654a44 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:16.938553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-404d6d2e-ba3c-49e4-bb2c-08ee8e654a44 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:16.940486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-404d6d2e-ba3c-49e4-bb2c-08ee8e654a44 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:16.941399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-404d6d2e-ba3c-49e4-bb2c-08ee8e654a44 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:16.944944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-404d6d2e-ba3c-49e4-bb2c-08ee8e654a44 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:17.145074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-404d6d2e-ba3c-49e4-bb2c-08ee8e654a44 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:17.154261 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-404d6d2e-ba3c-49e4-bb2c-08ee8e654a44 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.232349 Jul 28 04:09:17.155453 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3019/5469] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:16 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:17.185722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-96f285cc-ed47-435a-bc4e-deac7e4a837a req-d2b65242-97cb-4e6d-9472-3ab2aa586296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "529072f5-5148-4f45-a6af-27f26c3fb872", "name": "network-vif-plugged", "status": "completed", "tag": "eeedd05d-e287-4d78-bd08-1f735f6dcb35"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:17.209116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-96f285cc-ed47-435a-bc4e-deac7e4a837a req-d2b65242-97cb-4e6d-9472-3ab2aa586296 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:17.209564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-96f285cc-ed47-435a-bc4e-deac7e4a837a req-d2b65242-97cb-4e6d-9472-3ab2aa586296 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:17.236294 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-96f285cc-ed47-435a-bc4e-deac7e4a837a req-d2b65242-97cb-4e6d-9472-3ab2aa586296 service nova] Creating event network-vif-plugged:eeedd05d-e287-4d78-bd08-1f735f6dcb35 for instance 529072f5-5148-4f45-a6af-27f26c3fb872 on n-h2-826756-3 Jul 28 04:09:17.242585 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-96f285cc-ed47-435a-bc4e-deac7e4a837a req-d2b65242-97cb-4e6d-9472-3ab2aa586296 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060689 Jul 28 04:09:17.246466 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3020/5470] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:09:17.255781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4943fc0-5bad-4dd2-baea-cf7271f7a425 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:17.262727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4943fc0-5bad-4dd2-baea-cf7271f7a425 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:17.279553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4943fc0-5bad-4dd2-baea-cf7271f7a425 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:17.280204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4943fc0-5bad-4dd2-baea-cf7271f7a425 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:17.284003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4943fc0-5bad-4dd2-baea-cf7271f7a425 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:17.284473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4943fc0-5bad-4dd2-baea-cf7271f7a425 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:17.358700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:17.539144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f4943fc0-5bad-4dd2-baea-cf7271f7a425 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:17.548804 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4943fc0-5bad-4dd2-baea-cf7271f7a425 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 200 len: 1314 microversion: 2.1 time: 0.300572 Jul 28 04:09:17.549496 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3021/5471] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:17 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:18.183724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8142cec7-67b6-446d-ac20-6aacb9f5f8da tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:18.184403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8142cec7-67b6-446d-ac20-6aacb9f5f8da tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:18.192117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:18.194078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8142cec7-67b6-446d-ac20-6aacb9f5f8da tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:18.194711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8142cec7-67b6-446d-ac20-6aacb9f5f8da tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:18.195680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8142cec7-67b6-446d-ac20-6aacb9f5f8da tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:18.196292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8142cec7-67b6-446d-ac20-6aacb9f5f8da tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:18.410255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8142cec7-67b6-446d-ac20-6aacb9f5f8da tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:18.421885 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8142cec7-67b6-446d-ac20-6aacb9f5f8da tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.246855 Jul 28 04:09:18.422828 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3022/5472] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:18 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:18.573213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97ea0081-249a-4f18-a3e9-c32d554b4a9b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:18.574087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-97ea0081-249a-4f18-a3e9-c32d554b4a9b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:18.590467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97ea0081-249a-4f18-a3e9-c32d554b4a9b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:18.590467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97ea0081-249a-4f18-a3e9-c32d554b4a9b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:18.590467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97ea0081-249a-4f18-a3e9-c32d554b4a9b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:18.590467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97ea0081-249a-4f18-a3e9-c32d554b4a9b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:18.799891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-97ea0081-249a-4f18-a3e9-c32d554b4a9b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:18.811315 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-97ea0081-249a-4f18-a3e9-c32d554b4a9b tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 200 len: 1314 microversion: 2.1 time: 0.242155 Jul 28 04:09:18.826911 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3023/5473] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:18 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:19.443932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-58700c6a-302b-44ca-b8f4-18fea094f415 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:19.452738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-58700c6a-302b-44ca-b8f4-18fea094f415 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:19.475962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58700c6a-302b-44ca-b8f4-18fea094f415 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:19.482139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58700c6a-302b-44ca-b8f4-18fea094f415 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:19.489584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58700c6a-302b-44ca-b8f4-18fea094f415 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:19.490418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58700c6a-302b-44ca-b8f4-18fea094f415 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:19.731925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-58700c6a-302b-44ca-b8f4-18fea094f415 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:19.742005 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-58700c6a-302b-44ca-b8f4-18fea094f415 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.302492 Jul 28 04:09:19.754205 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3024/5474] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:19 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:19.835690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-486a6e89-c8d9-4bb7-92cb-41ae37804cb7 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:19.836322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-486a6e89-c8d9-4bb7-92cb-41ae37804cb7 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:19.844788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-486a6e89-c8d9-4bb7-92cb-41ae37804cb7 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:19.845671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-486a6e89-c8d9-4bb7-92cb-41ae37804cb7 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:19.867172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-486a6e89-c8d9-4bb7-92cb-41ae37804cb7 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:19.867995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-486a6e89-c8d9-4bb7-92cb-41ae37804cb7 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:20.156902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-486a6e89-c8d9-4bb7-92cb-41ae37804cb7 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:20.174589 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-486a6e89-c8d9-4bb7-92cb-41ae37804cb7 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 200 len: 1499 microversion: 2.1 time: 0.343014 Jul 28 04:09:20.176133 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3025/5475] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:19 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 1499 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:20.768609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2387b353-a242-40c5-970b-4be3ec84c49f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:20.770681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2387b353-a242-40c5-970b-4be3ec84c49f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:20.784846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2387b353-a242-40c5-970b-4be3ec84c49f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:20.785324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2387b353-a242-40c5-970b-4be3ec84c49f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:20.786127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2387b353-a242-40c5-970b-4be3ec84c49f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:20.786567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2387b353-a242-40c5-970b-4be3ec84c49f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:21.108280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2387b353-a242-40c5-970b-4be3ec84c49f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:21.121599 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2387b353-a242-40c5-970b-4be3ec84c49f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.356973 Jul 28 04:09:21.126084 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3026/5476] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:20 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:21.225038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8edadeaf-011f-4ae9-8dff-1b9842a74c00 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:21.225608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8edadeaf-011f-4ae9-8dff-1b9842a74c00 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:21.232803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8edadeaf-011f-4ae9-8dff-1b9842a74c00 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:21.233580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8edadeaf-011f-4ae9-8dff-1b9842a74c00 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:21.234650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8edadeaf-011f-4ae9-8dff-1b9842a74c00 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:21.235304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8edadeaf-011f-4ae9-8dff-1b9842a74c00 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:21.265312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8edadeaf-011f-4ae9-8dff-1b9842a74c00 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:09:21.450475 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8edadeaf-011f-4ae9-8dff-1b9842a74c00 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "DELETE /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 204 len: 0 microversion: 2.1 time: 0.229603 Jul 28 04:09:21.451448 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3027/5477] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:09:21 2022] DELETE /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:09:21.465573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cef28254-96ec-495f-8205-4e9106043019 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:21.466935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cef28254-96ec-495f-8205-4e9106043019 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:21.474897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cef28254-96ec-495f-8205-4e9106043019 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:21.475600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cef28254-96ec-495f-8205-4e9106043019 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:21.476580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cef28254-96ec-495f-8205-4e9106043019 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:21.477167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cef28254-96ec-495f-8205-4e9106043019 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:21.899274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cef28254-96ec-495f-8205-4e9106043019 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:21.917023 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cef28254-96ec-495f-8205-4e9106043019 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 200 len: 1505 microversion: 2.1 time: 0.457353 Jul 28 04:09:21.918535 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3028/5478] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:21 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:22.150522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94efb46c-bb79-4e36-863c-b4e6a92e13ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:22.152481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-94efb46c-bb79-4e36-863c-b4e6a92e13ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:22.164739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94efb46c-bb79-4e36-863c-b4e6a92e13ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:22.167939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94efb46c-bb79-4e36-863c-b4e6a92e13ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:22.169880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94efb46c-bb79-4e36-863c-b4e6a92e13ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:22.170841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94efb46c-bb79-4e36-863c-b4e6a92e13ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:22.176987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:22.395798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-94efb46c-bb79-4e36-863c-b4e6a92e13ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:22.404160 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-94efb46c-bb79-4e36-863c-b4e6a92e13ac tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.261024 Jul 28 04:09:22.405077 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3029/5479] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:22 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:22.952616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c28d50cb-334c-4eb0-9f88-cffdc51c8e45 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:22.954722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c28d50cb-334c-4eb0-9f88-cffdc51c8e45 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:22.970020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c28d50cb-334c-4eb0-9f88-cffdc51c8e45 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:22.973099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c28d50cb-334c-4eb0-9f88-cffdc51c8e45 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:22.977097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c28d50cb-334c-4eb0-9f88-cffdc51c8e45 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:22.977683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c28d50cb-334c-4eb0-9f88-cffdc51c8e45 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:23.322480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c28d50cb-334c-4eb0-9f88-cffdc51c8e45 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:23.334937 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c28d50cb-334c-4eb0-9f88-cffdc51c8e45 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 200 len: 1505 microversion: 2.1 time: 0.399361 Jul 28 04:09:23.337167 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3030/5480] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:22 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:23.426173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e87193df-774f-4fa4-954f-5257af950aef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:23.426840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e87193df-774f-4fa4-954f-5257af950aef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:23.445329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e87193df-774f-4fa4-954f-5257af950aef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:23.446051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e87193df-774f-4fa4-954f-5257af950aef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:23.449286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e87193df-774f-4fa4-954f-5257af950aef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:23.451413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e87193df-774f-4fa4-954f-5257af950aef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:23.816808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e87193df-774f-4fa4-954f-5257af950aef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:23.827013 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e87193df-774f-4fa4-954f-5257af950aef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.404870 Jul 28 04:09:23.838368 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3031/5481] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:23 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:24.358108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fba7e00b-8002-4e24-ba82-0ce1c60b7457 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:24.358756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fba7e00b-8002-4e24-ba82-0ce1c60b7457 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:24.385725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fba7e00b-8002-4e24-ba82-0ce1c60b7457 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:24.386315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fba7e00b-8002-4e24-ba82-0ce1c60b7457 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:24.389051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fba7e00b-8002-4e24-ba82-0ce1c60b7457 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:24.394477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fba7e00b-8002-4e24-ba82-0ce1c60b7457 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:24.587129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fba7e00b-8002-4e24-ba82-0ce1c60b7457 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:24.615494 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fba7e00b-8002-4e24-ba82-0ce1c60b7457 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 200 len: 1463 microversion: 2.1 time: 0.261382 Jul 28 04:09:24.636328 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3032/5482] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:24 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 1463 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:24.641840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-92e37f03-7b21-4fa4-812a-7d9b92e36d25 req-475b4a14-058d-4651-a497-c084b8b87f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "529072f5-5148-4f45-a6af-27f26c3fb872", "name": "network-vif-deleted", "tag": "eeedd05d-e287-4d78-bd08-1f735f6dcb35"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:24.679242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-92e37f03-7b21-4fa4-812a-7d9b92e36d25 req-475b4a14-058d-4651-a497-c084b8b87f2d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:24.680291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-92e37f03-7b21-4fa4-812a-7d9b92e36d25 req-475b4a14-058d-4651-a497-c084b8b87f2d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:24.710473 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-92e37f03-7b21-4fa4-812a-7d9b92e36d25 req-475b4a14-058d-4651-a497-c084b8b87f2d service nova] Creating event network-vif-deleted:eeedd05d-e287-4d78-bd08-1f735f6dcb35 for instance 529072f5-5148-4f45-a6af-27f26c3fb872 on n-h2-826756-3 Jul 28 04:09:24.729117 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-92e37f03-7b21-4fa4-812a-7d9b92e36d25 req-475b4a14-058d-4651-a497-c084b8b87f2d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078265 Jul 28 04:09:24.730087 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3033/5483] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:09:24.862619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-69efe81b-9f5f-47db-978f-acf4236b164b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:24.863446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-69efe81b-9f5f-47db-978f-acf4236b164b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:24.881895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69efe81b-9f5f-47db-978f-acf4236b164b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:24.882635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69efe81b-9f5f-47db-978f-acf4236b164b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:24.888716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69efe81b-9f5f-47db-978f-acf4236b164b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:24.891324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69efe81b-9f5f-47db-978f-acf4236b164b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:25.146515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-69efe81b-9f5f-47db-978f-acf4236b164b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:25.159306 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-69efe81b-9f5f-47db-978f-acf4236b164b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.303696 Jul 28 04:09:25.160394 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3034/5484] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:24 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:25.647978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-88bbbcfd-3ff5-428b-9d31-ee81dd081d99 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:25.652593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-88bbbcfd-3ff5-428b-9d31-ee81dd081d99 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:25.667733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88bbbcfd-3ff5-428b-9d31-ee81dd081d99 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:25.673070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88bbbcfd-3ff5-428b-9d31-ee81dd081d99 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:25.674326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88bbbcfd-3ff5-428b-9d31-ee81dd081d99 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:25.675285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88bbbcfd-3ff5-428b-9d31-ee81dd081d99 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:25.755565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:25.766670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88bbbcfd-3ff5-428b-9d31-ee81dd081d99 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:25.767383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88bbbcfd-3ff5-428b-9d31-ee81dd081d99 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:25.768006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-88bbbcfd-3ff5-428b-9d31-ee81dd081d99 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lazy-loading 'fault' on Instance uuid 529072f5-5148-4f45-a6af-27f26c3fb872 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:09:25.832009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-88bbbcfd-3ff5-428b-9d31-ee81dd081d99 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a23ab0ed18c4425c9f2ccce44b7201f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334b2c98f9a24fe88bf86505eb5863f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:25.844330 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-88bbbcfd-3ff5-428b-9d31-ee81dd081d99 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 200 len: 1304 microversion: 2.1 time: 0.205904 Jul 28 04:09:25.848244 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3035/5485] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:25 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 1304 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:26.186616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62b46c34-ae2f-4cf3-8b79-a832f756fd5c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:26.188083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-62b46c34-ae2f-4cf3-8b79-a832f756fd5c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:26.197910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62b46c34-ae2f-4cf3-8b79-a832f756fd5c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:26.202016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62b46c34-ae2f-4cf3-8b79-a832f756fd5c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:26.208512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62b46c34-ae2f-4cf3-8b79-a832f756fd5c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:26.209071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62b46c34-ae2f-4cf3-8b79-a832f756fd5c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:26.514217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62b46c34-ae2f-4cf3-8b79-a832f756fd5c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:26.523867 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-62b46c34-ae2f-4cf3-8b79-a832f756fd5c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.342457 Jul 28 04:09:26.525755 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3036/5486] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:26 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:26.867243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-136e6095-26e6-4746-925f-008ae466b8a5 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:26.867983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-136e6095-26e6-4746-925f-008ae466b8a5 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] [instance: 529072f5-5148-4f45-a6af-27f26c3fb872] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:26.901082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-136e6095-26e6-4746-925f-008ae466b8a5 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:26.901726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-136e6095-26e6-4746-925f-008ae466b8a5 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:26.903888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-136e6095-26e6-4746-925f-008ae466b8a5 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:26.904369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-136e6095-26e6-4746-925f-008ae466b8a5 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:26.941728 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-136e6095-26e6-4746-925f-008ae466b8a5 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] HTTP exception thrown: Instance 529072f5-5148-4f45-a6af-27f26c3fb872 could not be found. Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-136e6095-26e6-4746-925f-008ae466b8a5 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Request method failure captured: Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 HTTP/1.1 Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gvE6jzromIhVNklyNJp_I5ZnBOCAwppi-zyiKTfLMnKrBVHWjzfhvpuXV0HddYeQVyKbn9okjXwnlv11H2cFje1W_oHsFZ36lXrwFUYvcqGkCZmfkf8KvzsQ6NkJ7Rr0mwSoBFSTWdrYVJqrtxh2gWQmK_bF9rfZAuP6XH27m_0MF4 Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 334b2c98f9a24fe88bf86505eb5863f9 Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-VolumesActionsTest-839331337 Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/334b2c98f9a24fe88bf86505eb5863f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/334b2c98f9a24fe88bf86505eb5863f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_334b2c98f9a24fe88bf86505eb5863f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/334b2c98f9a24fe88bf86505eb5863f9"}]}] Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-VolumesActionsTest-839331337 Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 334b2c98f9a24fe88bf86505eb5863f9 Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-VolumesActionsTest-839331337 Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-VolumesActionsTest-839331337-project Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: a23ab0ed18c4425c9f2ccce44b7201f7 Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-VolumesActionsTest-839331337-project Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 529072f5-5148-4f45-a6af-27f26c3fb872 could not be found. Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '529072f5-5148-4f45-a6af-27f26c3fb872'} Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 529072f5-5148-4f45-a6af-27f26c3fb872 could not be found. Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 529072f5-5148-4f45-a6af-27f26c3fb872 could not be found. Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:09:26.949628 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:26.964281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:26.964281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:09:26.964281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:09:26.964281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:09:26.964281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:09:26.964281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 529072f5-5148-4f45-a6af-27f26c3fb872 could not be found. Jul 28 04:09:26.964281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:26.964281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-136e6095-26e6-4746-925f-008ae466b8a5 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] Returning 404 to user: Instance 529072f5-5148-4f45-a6af-27f26c3fb872 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:09:26.964281 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-136e6095-26e6-4746-925f-008ae466b8a5 tempest-VolumesActionsTest-839331337 tempest-VolumesActionsTest-839331337-project] 10.222.0.48 "GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872" status: 404 len: 111 microversion: 2.1 time: 0.089549 Jul 28 04:09:26.964281 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3037/5487] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:26 2022] GET /compute/v2.1/servers/529072f5-5148-4f45-a6af-27f26c3fb872 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:09:27.577221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-520c1824-5d82-42b4-8ba9-041f60fdff78 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:27.577945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-520c1824-5d82-42b4-8ba9-041f60fdff78 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:27.598512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-520c1824-5d82-42b4-8ba9-041f60fdff78 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:27.599093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-520c1824-5d82-42b4-8ba9-041f60fdff78 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:27.599844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-520c1824-5d82-42b4-8ba9-041f60fdff78 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:27.613087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-520c1824-5d82-42b4-8ba9-041f60fdff78 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:27.992056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-520c1824-5d82-42b4-8ba9-041f60fdff78 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:28.005098 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-520c1824-5d82-42b4-8ba9-041f60fdff78 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1502 microversion: 2.1 time: 0.446240 Jul 28 04:09:28.007007 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3038/5488] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:27 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1502 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:28.042939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f33e2ee7-edd5-41be-9646-9f2bc87657bd tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64815390-3f3a-4806-a721-54b379078345"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:28.057026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f33e2ee7-edd5-41be-9646-9f2bc87657bd tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:28.075454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f33e2ee7-edd5-41be-9646-9f2bc87657bd tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:28.076213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f33e2ee7-edd5-41be-9646-9f2bc87657bd tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:28.078270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f33e2ee7-edd5-41be-9646-9f2bc87657bd tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:28.078734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f33e2ee7-edd5-41be-9646-9f2bc87657bd tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:28.136936 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-f33e2ee7-edd5-41be-9646-9f2bc87657bd tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] HTTP exception thrown: Cannot 'attach_volume' instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 while it is in vm_state rescued Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f33e2ee7-edd5-41be-9646-9f2bc87657bd tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Request method failure captured: Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321/os-volume_attachments HTTP/1.1 Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 74 Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4guRH7cRyy41e8TMK6yH4E4vas5YneK3wNd43QNSbwP-vnU4KJvI9xnqarrFpgm_3d_MoR1ZpAdJmMyZ8u5FsxNmotKsW-BhbDNoNezHFEg5JbZI4uqCMDxre0Fl2vlF1EpCS09lknpXT0acA4YXSeuR-688T4pmq6O5npCWbGdqMXs Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/404ce0264e584456bfc6b523e914c408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_404ce0264e584456bfc6b523e914c408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}] Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0083854f0de14631ad15751829e34537 Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: {"volumeAttachment": {"volumeId": "64815390-3f3a-4806-a721-54b379078345"}} Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: exception: Cannot 'attach_volume' instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 while it is in vm_state rescued Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': 'd4b6d7c1-b65f-465c-97d1-fe40465a3321', 'body': {'volumeAttachment': {'volumeId': '64815390-3f3a-4806-a721-54b379078345'}}} Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 04:09:28.139621 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 04:09:28.143862 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 04:09:28.143862 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 04:09:28.143862 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 while it is in vm_state rescued Jul 28 04:09:28.143862 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:28.143862 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:09:28.143862 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:28.143862 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:28.143862 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:09:28.143862 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:09:28.143862 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:09:28.143862 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:09:28.143862 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 while it is in vm_state rescued Jul 28 04:09:28.143862 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:09:28.146369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f33e2ee7-edd5-41be-9646-9f2bc87657bd tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Returning 409 to user: Cannot 'attach_volume' instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 while it is in vm_state rescued {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:09:28.147514 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f33e2ee7-edd5-41be-9646-9f2bc87657bd tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.120652 Jul 28 04:09:28.152059 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3039/5489] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 04:09:28 2022] POST /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321/os-volume_attachments => generated 152 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 04:09:28.157103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0897dbdd-7e08-4e05-870d-619aa6573453 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:28.157652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0897dbdd-7e08-4e05-870d-619aa6573453 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:28.169138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0897dbdd-7e08-4e05-870d-619aa6573453 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:28.169824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0897dbdd-7e08-4e05-870d-619aa6573453 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:28.170948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0897dbdd-7e08-4e05-870d-619aa6573453 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:28.171616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0897dbdd-7e08-4e05-870d-619aa6573453 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:28.369887 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0897dbdd-7e08-4e05-870d-619aa6573453 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321/action" status: 202 len: 0 microversion: 2.1 time: 0.216279 Jul 28 04:09:28.370505 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3040/5490] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:09:28 2022] POST /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:09:28.390906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0dfcf155-2d78-486a-b9e6-77aed1184921 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:28.401910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0dfcf155-2d78-486a-b9e6-77aed1184921 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:28.454390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dfcf155-2d78-486a-b9e6-77aed1184921 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:28.454857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dfcf155-2d78-486a-b9e6-77aed1184921 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:28.455702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dfcf155-2d78-486a-b9e6-77aed1184921 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:28.470131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dfcf155-2d78-486a-b9e6-77aed1184921 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:28.779074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0dfcf155-2d78-486a-b9e6-77aed1184921 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:28.791607 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0dfcf155-2d78-486a-b9e6-77aed1184921 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1510 microversion: 2.1 time: 0.414593 Jul 28 04:09:28.804385 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3041/5491] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:28 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1510 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:29.824461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1b19d07b-2755-4e9a-b7ba-8877400eaa66 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:29.825169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1b19d07b-2755-4e9a-b7ba-8877400eaa66 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:29.855616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b19d07b-2755-4e9a-b7ba-8877400eaa66 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:29.856097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b19d07b-2755-4e9a-b7ba-8877400eaa66 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:29.856935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b19d07b-2755-4e9a-b7ba-8877400eaa66 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:29.857380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b19d07b-2755-4e9a-b7ba-8877400eaa66 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:30.333689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1b19d07b-2755-4e9a-b7ba-8877400eaa66 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:30.344318 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1b19d07b-2755-4e9a-b7ba-8877400eaa66 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1510 microversion: 2.1 time: 0.528236 Jul 28 04:09:30.347566 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3042/5492] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:29 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1510 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:31.370477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3fee3b13-5a3b-463a-90f3-72dbf75641c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:31.373315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3fee3b13-5a3b-463a-90f3-72dbf75641c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:31.400116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fee3b13-5a3b-463a-90f3-72dbf75641c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:31.405015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fee3b13-5a3b-463a-90f3-72dbf75641c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:31.408106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fee3b13-5a3b-463a-90f3-72dbf75641c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:31.411888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fee3b13-5a3b-463a-90f3-72dbf75641c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:31.741498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3fee3b13-5a3b-463a-90f3-72dbf75641c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:31.754368 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3fee3b13-5a3b-463a-90f3-72dbf75641c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1516 microversion: 2.1 time: 0.388895 Jul 28 04:09:31.756400 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3043/5493] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:31 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1516 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:34.825025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bfb8a8bb-33a1-40d5-a93d-bf5a46e6a90e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'create', calling method: .version_select at 0x7ffa66fb91f0>, body: {"keypair": {"name": "tempest-keypair-248800435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNuphd4zg4H9rwBpacb7i+BXwtYGix1qCs3InXyGb/SG/rxV0wAexhw4FgLxyfna7KJ9gcVY5uOvw3czy/al2Plvs0amrfLyn5OvuD7WO8LOeGvC9IYtkjMOpGshCj8Vw=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:34.877644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-bfb8a8bb-33a1-40d5-a93d-bf5a46e6a90e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Getting quotas for project 404ce0264e584456bfc6b523e914c408. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:09:34.897473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-bfb8a8bb-33a1-40d5-a93d-bf5a46e6a90e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Getting quotas for user 0083854f0de14631ad15751829e34537 and project 404ce0264e584456bfc6b523e914c408. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:09:34.965236 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bfb8a8bb-33a1-40d5-a93d-bf5a46e6a90e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146679 Jul 28 04:09:34.967875 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3044/5494] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:09:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:09:38.514560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-931605641", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93888a19-c008-4d58-b562-71421173bc0c"}], "security_groups": [{"name": "tempest-securitygroup--957114023"}], "key_name": "tempest-keypair-248800435", "user_data": "}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:38.795622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] validate_networks() for [('93888a19-c008-4d58-b562-71421173bc0c', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:09:39.873933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:09:39.874863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:09:39.875256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:09:39.875576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:09:39.876161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:09:39.907483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:39.907949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:39.908818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:39.918377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:39.989501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Getting quotas for project 404ce0264e584456bfc6b523e914c408. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:09:40.003346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Getting quotas for user 0083854f0de14631ad15751829e34537 and project 404ce0264e584456bfc6b523e914c408. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:09:40.033765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:09:40.036269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:09:40.123641 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-316e84dc-258a-4b26-bb2d-05d21607f5ce tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.613569 Jul 28 04:09:40.124374 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3045/5495] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:09:38 2022] POST /compute/v2.1/servers => generated 408 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:09:40.140884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b19134ff-caad-436e-bcf1-c27c73a87863 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:40.149892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b19134ff-caad-436e-bcf1-c27c73a87863 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:40.272814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b19134ff-caad-436e-bcf1-c27c73a87863 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:40.292613 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b19134ff-caad-436e-bcf1-c27c73a87863 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1244 microversion: 2.1 time: 0.156770 Jul 28 04:09:40.302240 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3046/5496] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:40 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1244 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:41.337343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43bbfc82-e380-47bf-a347-2c1dae9e8645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:41.339459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-43bbfc82-e380-47bf-a347-2c1dae9e8645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:41.368006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43bbfc82-e380-47bf-a347-2c1dae9e8645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:41.369351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43bbfc82-e380-47bf-a347-2c1dae9e8645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:41.372543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43bbfc82-e380-47bf-a347-2c1dae9e8645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:41.375787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43bbfc82-e380-47bf-a347-2c1dae9e8645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:41.655263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-43bbfc82-e380-47bf-a347-2c1dae9e8645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:41.678781 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43bbfc82-e380-47bf-a347-2c1dae9e8645 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1248 microversion: 2.1 time: 0.345319 Jul 28 04:09:41.681880 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3047/5497] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:41 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1248 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:42.709095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cbcc9036-8f51-4c67-9042-7fb7a0c9ed1d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:42.710490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cbcc9036-8f51-4c67-9042-7fb7a0c9ed1d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:42.720849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbcc9036-8f51-4c67-9042-7fb7a0c9ed1d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:42.721662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbcc9036-8f51-4c67-9042-7fb7a0c9ed1d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:42.722894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbcc9036-8f51-4c67-9042-7fb7a0c9ed1d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:42.723838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbcc9036-8f51-4c67-9042-7fb7a0c9ed1d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:42.908371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cbcc9036-8f51-4c67-9042-7fb7a0c9ed1d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:42.915405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:42.934821 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cbcc9036-8f51-4c67-9042-7fb7a0c9ed1d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1302 microversion: 2.1 time: 0.231679 Jul 28 04:09:42.952692 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3048/5498] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:42 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1302 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:43.960491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f089e3a8-b85c-4365-a6a5-c9153a3153ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:43.962003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f089e3a8-b85c-4365-a6a5-c9153a3153ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:43.983357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f089e3a8-b85c-4365-a6a5-c9153a3153ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:43.983807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f089e3a8-b85c-4365-a6a5-c9153a3153ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:43.984633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f089e3a8-b85c-4365-a6a5-c9153a3153ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:43.985080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f089e3a8-b85c-4365-a6a5-c9153a3153ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:44.153540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f089e3a8-b85c-4365-a6a5-c9153a3153ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:44.166031 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f089e3a8-b85c-4365-a6a5-c9153a3153ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1302 microversion: 2.1 time: 0.210202 Jul 28 04:09:44.202270 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3049/5499] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:43 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1302 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:45.197594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-216cbe55-9f0e-4f57-b1b1-199fd7f66b4b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:45.198164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-216cbe55-9f0e-4f57-b1b1-199fd7f66b4b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:45.214064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-216cbe55-9f0e-4f57-b1b1-199fd7f66b4b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:45.214961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-216cbe55-9f0e-4f57-b1b1-199fd7f66b4b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:45.216605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-216cbe55-9f0e-4f57-b1b1-199fd7f66b4b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:45.218847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-216cbe55-9f0e-4f57-b1b1-199fd7f66b4b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:45.458748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-216cbe55-9f0e-4f57-b1b1-199fd7f66b4b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:45.482589 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-216cbe55-9f0e-4f57-b1b1-199fd7f66b4b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1302 microversion: 2.1 time: 0.289894 Jul 28 04:09:45.489975 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3050/5500] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:45 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1302 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:46.522922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-064fa599-f4d0-4e0d-b6d5-31b7c3be08ed tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:46.526696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-064fa599-f4d0-4e0d-b6d5-31b7c3be08ed tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:46.561282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-064fa599-f4d0-4e0d-b6d5-31b7c3be08ed tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:46.572657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-064fa599-f4d0-4e0d-b6d5-31b7c3be08ed tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:46.587692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-064fa599-f4d0-4e0d-b6d5-31b7c3be08ed tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:46.590894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-064fa599-f4d0-4e0d-b6d5-31b7c3be08ed tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:47.229487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-064fa599-f4d0-4e0d-b6d5-31b7c3be08ed tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:47.246618 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-064fa599-f4d0-4e0d-b6d5-31b7c3be08ed tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1369 microversion: 2.1 time: 0.736655 Jul 28 04:09:47.247576 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3051/5501] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:46 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1369 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:48.275319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-692bf8c5-2c39-45d0-95a3-974fcd181dd3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:48.276013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-692bf8c5-2c39-45d0-95a3-974fcd181dd3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:48.313670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-692bf8c5-2c39-45d0-95a3-974fcd181dd3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:48.321028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-692bf8c5-2c39-45d0-95a3-974fcd181dd3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:48.321916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-692bf8c5-2c39-45d0-95a3-974fcd181dd3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:48.332296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-692bf8c5-2c39-45d0-95a3-974fcd181dd3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:48.769302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-692bf8c5-2c39-45d0-95a3-974fcd181dd3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:48.777380 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-692bf8c5-2c39-45d0-95a3-974fcd181dd3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1369 microversion: 2.1 time: 0.506795 Jul 28 04:09:48.777986 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3052/5502] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:48 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1369 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:48.793879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-bc337469-12be-4cac-9929-62a0566cea70 req-2927b398-847c-4d6c-9f02-f77906cec007 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81aa2809-5b04-4192-bba4-580cf02c2aa1", "tag": "303c8daa-a35d-4f2d-ac53-6573c50b1e8b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:48.845001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bc337469-12be-4cac-9929-62a0566cea70 req-2927b398-847c-4d6c-9f02-f77906cec007 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:48.845987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bc337469-12be-4cac-9929-62a0566cea70 req-2927b398-847c-4d6c-9f02-f77906cec007 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:48.888038 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-bc337469-12be-4cac-9929-62a0566cea70 req-2927b398-847c-4d6c-9f02-f77906cec007 service nova] Creating event network-changed:303c8daa-a35d-4f2d-ac53-6573c50b1e8b for instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 on n-h2-826756-3 Jul 28 04:09:48.910875 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-bc337469-12be-4cac-9929-62a0566cea70 req-2927b398-847c-4d6c-9f02-f77906cec007 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120835 Jul 28 04:09:48.911850 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3053/5503] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:09:49.835392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f5c10148-5c28-4f55-86fd-a696db550b82 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:49.840290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f5c10148-5c28-4f55-86fd-a696db550b82 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:49.875539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5c10148-5c28-4f55-86fd-a696db550b82 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:49.876004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5c10148-5c28-4f55-86fd-a696db550b82 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:49.876915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5c10148-5c28-4f55-86fd-a696db550b82 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:49.881083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5c10148-5c28-4f55-86fd-a696db550b82 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:50.024839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:50.278603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:50.311712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f5c10148-5c28-4f55-86fd-a696db550b82 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:50.329956 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f5c10148-5c28-4f55-86fd-a696db550b82 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1369 microversion: 2.1 time: 0.509512 Jul 28 04:09:50.331562 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3054/5504] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:49 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1369 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:51.354102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-495b32eb-a00e-4168-8806-1991481363db tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:51.356369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-495b32eb-a00e-4168-8806-1991481363db tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:51.372316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-495b32eb-a00e-4168-8806-1991481363db tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:51.372813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-495b32eb-a00e-4168-8806-1991481363db tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:51.374967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-495b32eb-a00e-4168-8806-1991481363db tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:51.375757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-495b32eb-a00e-4168-8806-1991481363db tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:52.461061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-495b32eb-a00e-4168-8806-1991481363db tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:52.477993 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-495b32eb-a00e-4168-8806-1991481363db tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1369 microversion: 2.1 time: 1.129783 Jul 28 04:09:52.480422 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3055/5505] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:51 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1369 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:53.164074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9ab589e5-afec-4a56-b2f1-fe945ca3abb6 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Action: 'create', calling method: .version_select at 0x7ffa79958f70>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1680788241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXqz5Of2/dBxhMrfP8yvcb8OIXQkBmVp2sD1z6zGOX1nBRmXuhEkMQADsyic0Bmhs4+KtoyapjPQX4zCL59hAXMXodPnfMaxU7w7hsLrAAD6wy7mTrWbgJtzyyAMWd5LA=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:53.225762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-9ab589e5-afec-4a56-b2f1-fe945ca3abb6 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Getting quotas for project 8940b525df4f43299c0496ba2d40501e. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:09:53.244078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-9ab589e5-afec-4a56-b2f1-fe945ca3abb6 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Getting quotas for user 2511fdb208c64d51848647df54c7510e and project 8940b525df4f43299c0496ba2d40501e. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:09:53.298487 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9ab589e5-afec-4a56-b2f1-fe945ca3abb6 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.816537 Jul 28 04:09:53.301693 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3056/5506] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:09:52 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:09:53.499357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ddaca5d6-2917-4b15-8988-21a0f95ce1d9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:53.500742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ddaca5d6-2917-4b15-8988-21a0f95ce1d9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:53.529224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ddaca5d6-2917-4b15-8988-21a0f95ce1d9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:53.529224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ddaca5d6-2917-4b15-8988-21a0f95ce1d9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:53.529224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ddaca5d6-2917-4b15-8988-21a0f95ce1d9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:53.529224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ddaca5d6-2917-4b15-8988-21a0f95ce1d9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:53.822167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ddaca5d6-2917-4b15-8988-21a0f95ce1d9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:53.836656 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ddaca5d6-2917-4b15-8988-21a0f95ce1d9 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1369 microversion: 2.1 time: 0.340657 Jul 28 04:09:53.837753 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3057/5507] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:53 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1369 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:54.871349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb08b2f6-6a67-4394-8d38-a36c14b84269 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:54.875538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eb08b2f6-6a67-4394-8d38-a36c14b84269 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:54.892515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb08b2f6-6a67-4394-8d38-a36c14b84269 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:54.893855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb08b2f6-6a67-4394-8d38-a36c14b84269 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:54.895524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb08b2f6-6a67-4394-8d38-a36c14b84269 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:54.896188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb08b2f6-6a67-4394-8d38-a36c14b84269 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:55.711171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eb08b2f6-6a67-4394-8d38-a36c14b84269 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:55.740597 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb08b2f6-6a67-4394-8d38-a36c14b84269 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1369 microversion: 2.1 time: 0.880255 Jul 28 04:09:55.741706 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3058/5508] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:54 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1369 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:56.768932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ba5c24e0-3c68-4cb7-8ddb-fa54bcb6cc81 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:56.769832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ba5c24e0-3c68-4cb7-8ddb-fa54bcb6cc81 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:56.803514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:56.806763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba5c24e0-3c68-4cb7-8ddb-fa54bcb6cc81 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:56.810474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba5c24e0-3c68-4cb7-8ddb-fa54bcb6cc81 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:56.813735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba5c24e0-3c68-4cb7-8ddb-fa54bcb6cc81 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:56.819341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba5c24e0-3c68-4cb7-8ddb-fa54bcb6cc81 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:57.352873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ba5c24e0-3c68-4cb7-8ddb-fa54bcb6cc81 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:57.367784 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ba5c24e0-3c68-4cb7-8ddb-fa54bcb6cc81 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1369 microversion: 2.1 time: 0.605029 Jul 28 04:09:57.368683 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3059/5509] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:56 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1369 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:09:57.750578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c6b0d509-06c7-4735-bb98-ead492faf281 req-5235d7d4-fb72-460a-856a-3272809dd48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aa2809-5b04-4192-bba4-580cf02c2aa1", "name": "network-vif-plugged", "status": "completed", "tag": "303c8daa-a35d-4f2d-ac53-6573c50b1e8b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:57.789731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c6b0d509-06c7-4735-bb98-ead492faf281 req-5235d7d4-fb72-460a-856a-3272809dd48d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:57.793089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c6b0d509-06c7-4735-bb98-ead492faf281 req-5235d7d4-fb72-460a-856a-3272809dd48d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:57.857193 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c6b0d509-06c7-4735-bb98-ead492faf281 req-5235d7d4-fb72-460a-856a-3272809dd48d service nova] Creating event network-vif-plugged:303c8daa-a35d-4f2d-ac53-6573c50b1e8b for instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 on n-h2-826756-3 Jul 28 04:09:57.889350 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c6b0d509-06c7-4735-bb98-ead492faf281 req-5235d7d4-fb72-460a-856a-3272809dd48d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137865 Jul 28 04:09:57.890395 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3060/5510] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:09:58.391054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fde6f0f1-af91-44d4-a738-f610c8a2b245 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:58.392771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fde6f0f1-af91-44d4-a738-f610c8a2b245 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:58.420688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fde6f0f1-af91-44d4-a738-f610c8a2b245 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:58.426499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fde6f0f1-af91-44d4-a738-f610c8a2b245 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:58.428747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fde6f0f1-af91-44d4-a738-f610c8a2b245 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:58.434617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fde6f0f1-af91-44d4-a738-f610c8a2b245 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:58.846291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fde6f0f1-af91-44d4-a738-f610c8a2b245 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:58.863155 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fde6f0f1-af91-44d4-a738-f610c8a2b245 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1369 microversion: 2.1 time: 0.476636 Jul 28 04:09:58.876724 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3061/5511] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:58 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1369 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:59.890939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-56a52d0d-deb5-4a03-9d3f-1813328d7350 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:59.891845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-56a52d0d-deb5-4a03-9d3f-1813328d7350 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:09:59.966927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56a52d0d-deb5-4a03-9d3f-1813328d7350 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:59.967689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56a52d0d-deb5-4a03-9d3f-1813328d7350 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:59.983296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56a52d0d-deb5-4a03-9d3f-1813328d7350 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:59.989321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56a52d0d-deb5-4a03-9d3f-1813328d7350 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:00.617047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-56a52d0d-deb5-4a03-9d3f-1813328d7350 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:00.628435 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-56a52d0d-deb5-4a03-9d3f-1813328d7350 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1369 microversion: 2.1 time: 0.747810 Jul 28 04:10:00.629993 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3062/5512] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:59 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1369 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:01.650700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-31249732-13d2-4b82-970a-da36f93e002c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:01.652559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-31249732-13d2-4b82-970a-da36f93e002c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:01.675427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31249732-13d2-4b82-970a-da36f93e002c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:01.678477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31249732-13d2-4b82-970a-da36f93e002c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:01.683906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31249732-13d2-4b82-970a-da36f93e002c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:01.688908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31249732-13d2-4b82-970a-da36f93e002c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:02.585568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-31249732-13d2-4b82-970a-da36f93e002c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:02.594048 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-31249732-13d2-4b82-970a-da36f93e002c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1563 microversion: 2.1 time: 0.947682 Jul 28 04:10:02.604821 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3063/5513] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:01 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1563 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:03.059006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-166768536", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f91f49a4-53ee-4276-92bd-ef8085b97e70"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:03.268818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:12.175127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] validate_networks() for [('f91f49a4-53ee-4276-92bd-ef8085b97e70', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:10:12.592829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=77 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:12.993968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:10:12.994619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:10:12.995279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:10:12.995893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:10:12.996663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:10:13.016513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:13.017226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:13.018241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:13.020919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:13.084012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Getting quotas for project cee57c14af81482db82880d1482f3210. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:10:13.105129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Getting quotas for user ebef4cb34b104f5f8e0d77d6285e11b3 and project cee57c14af81482db82880d1482f3210. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:10:13.158439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:10:13.161963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:10:13.335780 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a56ba93a-d677-47d9-bca9-1a8b3e436cce tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.735780 Jul 28 04:10:13.348251 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3064/5514] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:10:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 10743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:10:13.360828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-11c52e16-4cf6-4eb9-b062-ad6e1b169432 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:13.371413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-11c52e16-4cf6-4eb9-b062-ad6e1b169432 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:13.410549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11c52e16-4cf6-4eb9-b062-ad6e1b169432 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:13.415946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11c52e16-4cf6-4eb9-b062-ad6e1b169432 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:13.417737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11c52e16-4cf6-4eb9-b062-ad6e1b169432 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:13.418737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11c52e16-4cf6-4eb9-b062-ad6e1b169432 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:13.686591 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-11c52e16-4cf6-4eb9-b062-ad6e1b169432 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.342297 Jul 28 04:10:13.687678 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3065/5515] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 04:10:13 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-interface => generated 284 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:13.695966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8730a9f9-f369-43b4-abc6-0b25f05f575a tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:13.704586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8730a9f9-f369-43b4-abc6-0b25f05f575a tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:13.974354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8730a9f9-f369-43b4-abc6-0b25f05f575a tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:13.982847 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8730a9f9-f369-43b4-abc6-0b25f05f575a tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1213 microversion: 2.1 time: 0.293308 Jul 28 04:10:13.990954 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3066/5516] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:13 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1213 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:15.009192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b8d8b71a-cba8-4f95-a021-f641ac6e15cd tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:15.011107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b8d8b71a-cba8-4f95-a021-f641ac6e15cd tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:15.029682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8d8b71a-cba8-4f95-a021-f641ac6e15cd tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:15.032850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8d8b71a-cba8-4f95-a021-f641ac6e15cd tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:15.035348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8d8b71a-cba8-4f95-a021-f641ac6e15cd tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:15.036026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8d8b71a-cba8-4f95-a021-f641ac6e15cd tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:16.427592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8d8b71a-cba8-4f95-a021-f641ac6e15cd tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:16.437935 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b8d8b71a-cba8-4f95-a021-f641ac6e15cd tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1209 microversion: 2.1 time: 1.432672 Jul 28 04:10:16.449180 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3067/5517] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:15 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1209 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:17.274148 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:10:17.275670 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:10:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:10:17.460889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cae6cb5c-462c-4a93-be8c-3563ce8d2dcb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:17.462190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cae6cb5c-462c-4a93-be8c-3563ce8d2dcb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:17.498747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cae6cb5c-462c-4a93-be8c-3563ce8d2dcb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:17.505529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cae6cb5c-462c-4a93-be8c-3563ce8d2dcb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:17.507155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cae6cb5c-462c-4a93-be8c-3563ce8d2dcb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:17.511265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cae6cb5c-462c-4a93-be8c-3563ce8d2dcb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:17.717231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cae6cb5c-462c-4a93-be8c-3563ce8d2dcb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:17.727341 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cae6cb5c-462c-4a93-be8c-3563ce8d2dcb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1271 microversion: 2.1 time: 0.272011 Jul 28 04:10:17.732238 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3068/5518] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:17 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1271 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:18.313884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b9ab43a0-26ef-4f76-8e41-0a74d44cb125 req-51b207fc-99ad-4706-8c4a-1b8580abe001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81aa2809-5b04-4192-bba4-580cf02c2aa1", "tag": "303c8daa-a35d-4f2d-ac53-6573c50b1e8b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:18.405636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b9ab43a0-26ef-4f76-8e41-0a74d44cb125 req-51b207fc-99ad-4706-8c4a-1b8580abe001 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:18.406091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b9ab43a0-26ef-4f76-8e41-0a74d44cb125 req-51b207fc-99ad-4706-8c4a-1b8580abe001 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:18.468737 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b9ab43a0-26ef-4f76-8e41-0a74d44cb125 req-51b207fc-99ad-4706-8c4a-1b8580abe001 service nova] Creating event network-changed:303c8daa-a35d-4f2d-ac53-6573c50b1e8b for instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 on n-h2-826756-3 Jul 28 04:10:18.493327 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b9ab43a0-26ef-4f76-8e41-0a74d44cb125 req-51b207fc-99ad-4706-8c4a-1b8580abe001 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183713 Jul 28 04:10:18.499659 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3069/5519] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:18.759616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-da701a6c-f22d-4ed5-9b15-a6a4f5caa448 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:18.760704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-da701a6c-f22d-4ed5-9b15-a6a4f5caa448 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:18.791233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da701a6c-f22d-4ed5-9b15-a6a4f5caa448 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:18.791697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da701a6c-f22d-4ed5-9b15-a6a4f5caa448 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:18.792535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da701a6c-f22d-4ed5-9b15-a6a4f5caa448 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:18.792979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da701a6c-f22d-4ed5-9b15-a6a4f5caa448 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:19.482614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-da701a6c-f22d-4ed5-9b15-a6a4f5caa448 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:19.499185 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-da701a6c-f22d-4ed5-9b15-a6a4f5caa448 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1271 microversion: 2.1 time: 0.746278 Jul 28 04:10:19.499822 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3070/5520] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:18 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1271 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:10:19.538304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1408792187-access_point-2020372324", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "8d576a79-26c7-45f5-a03e-ea4e14233c3c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1680788241", "security_groups": [{"name": "tempest-secgroup_access--825490248"}, {"name": "tempest-secgroup_general--433406225"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:20.061775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] validate_networks() for [('8d576a79-26c7-45f5-a03e-ea4e14233c3c', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:10:21.279077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:10:21.280322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:10:21.281022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:10:21.281931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:10:21.282540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:10:21.300562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:21.304933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:21.306258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:21.306930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:21.360464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Getting quotas for project 8940b525df4f43299c0496ba2d40501e. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:10:21.374991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Getting quotas for user 2511fdb208c64d51848647df54c7510e and project 8940b525df4f43299c0496ba2d40501e. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:10:21.419234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:10:21.422400 n-d-826756-3 devstack@n-api.service[126071]: WARNING nova.utils [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1408792187-access_point-2020372324 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1408792187-ac Jul 28 04:10:21.423280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:10:21.546260 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e7348f4b-1e3f-4ed7-9a07-3090dba53f3c tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 2.022199 Jul 28 04:10:21.546948 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3071/5521] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:10:19 2022] POST /compute/v2.1/servers => generated 456 bytes in 2035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:10:21.563725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-91e4f9ac-e143-4798-bb86-61d5a17d9e59 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:21.564905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-91e4f9ac-e143-4798-bb86-61d5a17d9e59 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:21.572308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91e4f9ac-e143-4798-bb86-61d5a17d9e59 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:21.573091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91e4f9ac-e143-4798-bb86-61d5a17d9e59 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:21.574045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91e4f9ac-e143-4798-bb86-61d5a17d9e59 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:21.575919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91e4f9ac-e143-4798-bb86-61d5a17d9e59 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:21.976245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-91e4f9ac-e143-4798-bb86-61d5a17d9e59 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:21.996987 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-91e4f9ac-e143-4798-bb86-61d5a17d9e59 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1313 microversion: 2.1 time: 0.439516 Jul 28 04:10:22.001764 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3072/5522] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:21 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:22.027344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d699a17d-fcfe-4f8a-88aa-64655b206f7d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:22.028734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d699a17d-fcfe-4f8a-88aa-64655b206f7d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:22.191968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d699a17d-fcfe-4f8a-88aa-64655b206f7d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:22.211869 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d699a17d-fcfe-4f8a-88aa-64655b206f7d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1295 microversion: 2.1 time: 0.193203 Jul 28 04:10:22.215169 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3073/5523] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:22 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1295 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:23.030173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a22204ae-93f3-4152-99de-0f5b79842e75 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:23.031565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a22204ae-93f3-4152-99de-0f5b79842e75 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:23.085395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a22204ae-93f3-4152-99de-0f5b79842e75 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:23.092475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a22204ae-93f3-4152-99de-0f5b79842e75 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:23.094601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a22204ae-93f3-4152-99de-0f5b79842e75 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:23.095495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a22204ae-93f3-4152-99de-0f5b79842e75 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:23.373773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a22204ae-93f3-4152-99de-0f5b79842e75 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:23.383532 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a22204ae-93f3-4152-99de-0f5b79842e75 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1313 microversion: 2.1 time: 0.358716 Jul 28 04:10:23.402076 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3074/5524] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:23 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:10:23.417782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-730ee1a8-6120-464b-bed5-7f4eaec4acba tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:23.421167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-730ee1a8-6120-464b-bed5-7f4eaec4acba tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:23.434764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-730ee1a8-6120-464b-bed5-7f4eaec4acba tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:23.436074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-730ee1a8-6120-464b-bed5-7f4eaec4acba tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:23.437013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-730ee1a8-6120-464b-bed5-7f4eaec4acba tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:23.437757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-730ee1a8-6120-464b-bed5-7f4eaec4acba tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:23.542321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-730ee1a8-6120-464b-bed5-7f4eaec4acba tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:23.554626 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-730ee1a8-6120-464b-bed5-7f4eaec4acba tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1347 microversion: 2.1 time: 0.146460 Jul 28 04:10:23.555393 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3075/5525] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:23 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1347 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:24.391263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e0b9fa94-c995-465d-891d-4008befa6eea req-599be6d0-cc70-4e47-b4a7-0d99d754fd00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f427208-0c0e-4be7-ac7b-420c8110ceb7", "tag": "d6f9962d-9c66-456c-a3ab-7e048f16f5ed"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:24.440707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e0b9fa94-c995-465d-891d-4008befa6eea req-599be6d0-cc70-4e47-b4a7-0d99d754fd00 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:24.441699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e0b9fa94-c995-465d-891d-4008befa6eea req-599be6d0-cc70-4e47-b4a7-0d99d754fd00 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:24.474219 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e0b9fa94-c995-465d-891d-4008befa6eea req-599be6d0-cc70-4e47-b4a7-0d99d754fd00 service nova] Creating event network-changed:d6f9962d-9c66-456c-a3ab-7e048f16f5ed for instance 8f427208-0c0e-4be7-ac7b-420c8110ceb7 on n-h1-826756-3 Jul 28 04:10:24.495561 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e0b9fa94-c995-465d-891d-4008befa6eea req-599be6d0-cc70-4e47-b4a7-0d99d754fd00 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117813 Jul 28 04:10:24.497305 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3076/5526] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:24.509522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bab0100a-2321-43da-9dc3-408be4bfd1e0 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:24.510372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bab0100a-2321-43da-9dc3-408be4bfd1e0 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:24.532015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bab0100a-2321-43da-9dc3-408be4bfd1e0 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:24.534362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bab0100a-2321-43da-9dc3-408be4bfd1e0 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:24.536586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bab0100a-2321-43da-9dc3-408be4bfd1e0 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:24.539565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bab0100a-2321-43da-9dc3-408be4bfd1e0 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:24.921241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bab0100a-2321-43da-9dc3-408be4bfd1e0 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:24.951075 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bab0100a-2321-43da-9dc3-408be4bfd1e0 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1313 microversion: 2.1 time: 0.451699 Jul 28 04:10:24.952503 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3077/5527] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:24 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:24.958589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05e52403-cc60-41e1-b165-11ce05d6c4cc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:24.959213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-05e52403-cc60-41e1-b165-11ce05d6c4cc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:24.982106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05e52403-cc60-41e1-b165-11ce05d6c4cc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:24.982566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05e52403-cc60-41e1-b165-11ce05d6c4cc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:24.983387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05e52403-cc60-41e1-b165-11ce05d6c4cc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:24.983840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05e52403-cc60-41e1-b165-11ce05d6c4cc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:25.155887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-05e52403-cc60-41e1-b165-11ce05d6c4cc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:25.165561 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-05e52403-cc60-41e1-b165-11ce05d6c4cc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1353 microversion: 2.1 time: 0.211462 Jul 28 04:10:25.177216 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3078/5528] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:24 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1353 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:25.956556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1923703736", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "942500be-05b0-478f-8797-cdf9e19a4ee1"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:26.049983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] validate_networks() for [('942500be-05b0-478f-8797-cdf9e19a4ee1', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:10:26.880345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:10:26.880796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:10:26.881271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:10:26.881682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:10:26.882095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:10:26.901239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:26.901688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:26.902555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:26.903302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:26.948897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:10:26.964762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:26.966481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for user 24e6476d226840c4adc1ea6c54dfd527 and project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:10:27.004544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:10:27.007889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:10:27.112415 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1a734b80-6275-400e-97aa-f03d16495e30 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.245866 Jul 28 04:10:27.125053 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3079/5529] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:10:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:10:27.139226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-416ac8ee-abca-4c5f-a4a2-5c9ccf1c4e40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:27.141275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-416ac8ee-abca-4c5f-a4a2-5c9ccf1c4e40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:27.170960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-416ac8ee-abca-4c5f-a4a2-5c9ccf1c4e40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:27.172971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-416ac8ee-abca-4c5f-a4a2-5c9ccf1c4e40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:27.174841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-416ac8ee-abca-4c5f-a4a2-5c9ccf1c4e40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:27.176021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-416ac8ee-abca-4c5f-a4a2-5c9ccf1c4e40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:27.651152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-416ac8ee-abca-4c5f-a4a2-5c9ccf1c4e40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:27.691508 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-416ac8ee-abca-4c5f-a4a2-5c9ccf1c4e40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1313 microversion: 2.1 time: 0.564692 Jul 28 04:10:27.701411 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3080/5530] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:27 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1313 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:27.725129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c7adfc79-16e9-4042-b72c-71de735d1663 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:27.726170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c7adfc79-16e9-4042-b72c-71de735d1663 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:27.761739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7adfc79-16e9-4042-b72c-71de735d1663 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:27.762704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7adfc79-16e9-4042-b72c-71de735d1663 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:27.769371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7adfc79-16e9-4042-b72c-71de735d1663 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:27.772389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7adfc79-16e9-4042-b72c-71de735d1663 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:28.187259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c7adfc79-16e9-4042-b72c-71de735d1663 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:28.219963 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c7adfc79-16e9-4042-b72c-71de735d1663 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1471 microversion: 2.1 time: 0.508368 Jul 28 04:10:28.229433 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3081/5531] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:27 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1471 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:28.255549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7fc0a8be-5941-4c2b-b953-3321afd49580 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:28.262717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7fc0a8be-5941-4c2b-b953-3321afd49580 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:28.411183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7fc0a8be-5941-4c2b-b953-3321afd49580 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:28.420533 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7fc0a8be-5941-4c2b-b953-3321afd49580 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1193 microversion: 2.1 time: 0.189710 Jul 28 04:10:28.426445 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3082/5532] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:28 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1193 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:28.723775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f0fb81b4-4fde-4e99-a660-8edcbf706916 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:28.724609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f0fb81b4-4fde-4e99-a660-8edcbf706916 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:28.734703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0fb81b4-4fde-4e99-a660-8edcbf706916 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:28.737741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0fb81b4-4fde-4e99-a660-8edcbf706916 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:28.740631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0fb81b4-4fde-4e99-a660-8edcbf706916 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:28.741350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0fb81b4-4fde-4e99-a660-8edcbf706916 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:29.055147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f0fb81b4-4fde-4e99-a660-8edcbf706916 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:29.070472 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f0fb81b4-4fde-4e99-a660-8edcbf706916 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1313 microversion: 2.1 time: 0.345323 Jul 28 04:10:29.071744 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3083/5533] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:28 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:29.252097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b389177-478d-4d9d-a502-f3278f96e005 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:29.252097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3b389177-478d-4d9d-a502-f3278f96e005 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:29.264976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b389177-478d-4d9d-a502-f3278f96e005 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:29.265933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b389177-478d-4d9d-a502-f3278f96e005 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:29.266328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b389177-478d-4d9d-a502-f3278f96e005 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:29.266850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b389177-478d-4d9d-a502-f3278f96e005 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:29.998949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3b389177-478d-4d9d-a502-f3278f96e005 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:30.014037 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3b389177-478d-4d9d-a502-f3278f96e005 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1471 microversion: 2.1 time: 0.768888 Jul 28 04:10:30.021278 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3084/5534] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:29 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1471 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:10:30.030384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-be7048d3-2a0d-4755-9dd4-6f46b1ef5527 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:30.030571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-be7048d3-2a0d-4755-9dd4-6f46b1ef5527 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:30.083659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be7048d3-2a0d-4755-9dd4-6f46b1ef5527 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:30.084321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be7048d3-2a0d-4755-9dd4-6f46b1ef5527 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:30.085353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be7048d3-2a0d-4755-9dd4-6f46b1ef5527 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:30.085853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be7048d3-2a0d-4755-9dd4-6f46b1ef5527 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:30.273408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be7048d3-2a0d-4755-9dd4-6f46b1ef5527 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:30.284576 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-be7048d3-2a0d-4755-9dd4-6f46b1ef5527 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1251 microversion: 2.1 time: 0.261633 Jul 28 04:10:30.285175 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3085/5535] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:30 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1251 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:30.301959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1b1bcafd-4114-4b02-ba1b-7512f41408a8 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:30.302946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1b1bcafd-4114-4b02-ba1b-7512f41408a8 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:30.343019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b1bcafd-4114-4b02-ba1b-7512f41408a8 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:30.343481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b1bcafd-4114-4b02-ba1b-7512f41408a8 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:30.344643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b1bcafd-4114-4b02-ba1b-7512f41408a8 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:30.345093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b1bcafd-4114-4b02-ba1b-7512f41408a8 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:30.933836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1b1bcafd-4114-4b02-ba1b-7512f41408a8 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:30.944906 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1b1bcafd-4114-4b02-ba1b-7512f41408a8 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1313 microversion: 2.1 time: 0.657270 Jul 28 04:10:30.956940 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3086/5536] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:30 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1313 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:30.974685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-948af020-e7d1-4b50-84bd-f2232225f21f req-546d2f74-b815-4e9f-8851-fe5cc5adab6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befd4e30-8159-4bd1-9567-141e24513282", "tag": "93bb52e4-eb60-4508-a0d2-fbd60ad3cd6c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:31.009661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-948af020-e7d1-4b50-84bd-f2232225f21f req-546d2f74-b815-4e9f-8851-fe5cc5adab6a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:31.010124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-948af020-e7d1-4b50-84bd-f2232225f21f req-546d2f74-b815-4e9f-8851-fe5cc5adab6a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:31.015046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:31.026197 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-948af020-e7d1-4b50-84bd-f2232225f21f req-546d2f74-b815-4e9f-8851-fe5cc5adab6a service nova] Creating event network-changed:93bb52e4-eb60-4508-a0d2-fbd60ad3cd6c for instance befd4e30-8159-4bd1-9567-141e24513282 on n-h2-826756-3 Jul 28 04:10:31.045315 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-948af020-e7d1-4b50-84bd-f2232225f21f req-546d2f74-b815-4e9f-8851-fe5cc5adab6a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074390 Jul 28 04:10:31.046513 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3087/5537] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:31.066044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0c5b7b4b-e22e-4ae1-9fa3-02ca03b9ced6 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:31.066852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0c5b7b4b-e22e-4ae1-9fa3-02ca03b9ced6 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:31.101333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c5b7b4b-e22e-4ae1-9fa3-02ca03b9ced6 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:31.102167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c5b7b4b-e22e-4ae1-9fa3-02ca03b9ced6 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:31.103264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c5b7b4b-e22e-4ae1-9fa3-02ca03b9ced6 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:31.103911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c5b7b4b-e22e-4ae1-9fa3-02ca03b9ced6 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:31.533348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0c5b7b4b-e22e-4ae1-9fa3-02ca03b9ced6 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:31.548045 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0c5b7b4b-e22e-4ae1-9fa3-02ca03b9ced6 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1471 microversion: 2.1 time: 0.499748 Jul 28 04:10:31.550183 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3088/5538] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:31 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1471 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:31.570151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51d244e4-362e-46b0-a187-2b96b8577f0f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:31.570905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-51d244e4-362e-46b0-a187-2b96b8577f0f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:31.589374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51d244e4-362e-46b0-a187-2b96b8577f0f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:31.590041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51d244e4-362e-46b0-a187-2b96b8577f0f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:31.591181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51d244e4-362e-46b0-a187-2b96b8577f0f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:31.592805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51d244e4-362e-46b0-a187-2b96b8577f0f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:31.920735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-51d244e4-362e-46b0-a187-2b96b8577f0f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:31.936679 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51d244e4-362e-46b0-a187-2b96b8577f0f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1251 microversion: 2.1 time: 0.380988 Jul 28 04:10:31.952828 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3089/5539] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:31 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1251 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:31.984839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80e7e431-bbce-4d55-a036-0f79cf971cbb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:31.985423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-80e7e431-bbce-4d55-a036-0f79cf971cbb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:31.995630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80e7e431-bbce-4d55-a036-0f79cf971cbb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:31.998800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80e7e431-bbce-4d55-a036-0f79cf971cbb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:31.999664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80e7e431-bbce-4d55-a036-0f79cf971cbb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:32.000206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80e7e431-bbce-4d55-a036-0f79cf971cbb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:32.397923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-80e7e431-bbce-4d55-a036-0f79cf971cbb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:32.414053 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-80e7e431-bbce-4d55-a036-0f79cf971cbb tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1313 microversion: 2.1 time: 0.435944 Jul 28 04:10:32.414776 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3090/5540] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:31 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:32.586034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f6e9105-cc5b-4043-97bb-69ba4769a35b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:32.588192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f6e9105-cc5b-4043-97bb-69ba4769a35b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:32.597099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f6e9105-cc5b-4043-97bb-69ba4769a35b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:32.598071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f6e9105-cc5b-4043-97bb-69ba4769a35b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:32.599456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f6e9105-cc5b-4043-97bb-69ba4769a35b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:32.600628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f6e9105-cc5b-4043-97bb-69ba4769a35b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:33.077759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f6e9105-cc5b-4043-97bb-69ba4769a35b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:33.087414 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f6e9105-cc5b-4043-97bb-69ba4769a35b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1471 microversion: 2.1 time: 0.519702 Jul 28 04:10:33.088954 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3091/5541] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:32 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1471 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:33.104798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9f29ffcc-f205-4ddc-9a35-52d8d0959f01 req-649959fa-8fa0-4f6c-beae-fb4ce49f16ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f427208-0c0e-4be7-ac7b-420c8110ceb7", "name": "network-vif-plugged", "status": "completed", "tag": "d6f9962d-9c66-456c-a3ab-7e048f16f5ed"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:33.131080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9f29ffcc-f205-4ddc-9a35-52d8d0959f01 req-649959fa-8fa0-4f6c-beae-fb4ce49f16ec service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:33.131964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9f29ffcc-f205-4ddc-9a35-52d8d0959f01 req-649959fa-8fa0-4f6c-beae-fb4ce49f16ec service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:33.164050 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9f29ffcc-f205-4ddc-9a35-52d8d0959f01 req-649959fa-8fa0-4f6c-beae-fb4ce49f16ec service nova] Creating event network-vif-plugged:d6f9962d-9c66-456c-a3ab-7e048f16f5ed for instance 8f427208-0c0e-4be7-ac7b-420c8110ceb7 on n-h1-826756-3 Jul 28 04:10:33.175831 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9f29ffcc-f205-4ddc-9a35-52d8d0959f01 req-649959fa-8fa0-4f6c-beae-fb4ce49f16ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084949 Jul 28 04:10:33.176926 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3092/5542] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:33.185645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6562119c-ca3d-4bb7-9b75-a67113862f27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:33.187084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6562119c-ca3d-4bb7-9b75-a67113862f27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:33.196860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6562119c-ca3d-4bb7-9b75-a67113862f27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:33.197392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6562119c-ca3d-4bb7-9b75-a67113862f27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:33.198397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6562119c-ca3d-4bb7-9b75-a67113862f27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:33.199023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6562119c-ca3d-4bb7-9b75-a67113862f27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:33.534987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6562119c-ca3d-4bb7-9b75-a67113862f27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:33.546443 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6562119c-ca3d-4bb7-9b75-a67113862f27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1293 microversion: 2.1 time: 0.367736 Jul 28 04:10:33.560569 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3093/5543] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:33 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1293 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:33.566319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6cb38243-3347-42b1-b3d9-02d4a7400101 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:33.567164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6cb38243-3347-42b1-b3d9-02d4a7400101 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:33.576330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cb38243-3347-42b1-b3d9-02d4a7400101 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:33.577093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cb38243-3347-42b1-b3d9-02d4a7400101 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:33.578247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cb38243-3347-42b1-b3d9-02d4a7400101 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:33.578907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cb38243-3347-42b1-b3d9-02d4a7400101 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:33.822745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6cb38243-3347-42b1-b3d9-02d4a7400101 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:33.837838 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6cb38243-3347-42b1-b3d9-02d4a7400101 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1313 microversion: 2.1 time: 0.275076 Jul 28 04:10:33.852266 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3094/5544] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:33 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:34.125107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0139f4a3-0433-4ac8-8afb-7765aa6f4706 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:34.125848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0139f4a3-0433-4ac8-8afb-7765aa6f4706 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:34.140766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0139f4a3-0433-4ac8-8afb-7765aa6f4706 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:34.141392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0139f4a3-0433-4ac8-8afb-7765aa6f4706 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:34.142547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0139f4a3-0433-4ac8-8afb-7765aa6f4706 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:34.143457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0139f4a3-0433-4ac8-8afb-7765aa6f4706 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:34.421722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0139f4a3-0433-4ac8-8afb-7765aa6f4706 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:34.434694 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0139f4a3-0433-4ac8-8afb-7765aa6f4706 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1471 microversion: 2.1 time: 0.322335 Jul 28 04:10:34.440406 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3095/5545] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:34 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1471 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:34.570164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4ba5186b-ec42-4949-a992-6fa1b0aa1b54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:34.572298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4ba5186b-ec42-4949-a992-6fa1b0aa1b54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:34.591886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ba5186b-ec42-4949-a992-6fa1b0aa1b54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:34.592758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ba5186b-ec42-4949-a992-6fa1b0aa1b54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:34.594436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ba5186b-ec42-4949-a992-6fa1b0aa1b54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:34.596294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ba5186b-ec42-4949-a992-6fa1b0aa1b54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:34.817292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4ba5186b-ec42-4949-a992-6fa1b0aa1b54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:34.826164 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4ba5186b-ec42-4949-a992-6fa1b0aa1b54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1293 microversion: 2.1 time: 0.261900 Jul 28 04:10:34.842178 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3096/5546] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:34 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1293 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:10:34.871595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d8b20176-4a82-4c85-b9c1-389bd7cefe2d tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:34.872236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d8b20176-4a82-4c85-b9c1-389bd7cefe2d tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:34.898801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8b20176-4a82-4c85-b9c1-389bd7cefe2d tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:34.899267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8b20176-4a82-4c85-b9c1-389bd7cefe2d tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:34.900073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8b20176-4a82-4c85-b9c1-389bd7cefe2d tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:34.900544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8b20176-4a82-4c85-b9c1-389bd7cefe2d tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:35.292423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d8b20176-4a82-4c85-b9c1-389bd7cefe2d tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:35.305867 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d8b20176-4a82-4c85-b9c1-389bd7cefe2d tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1497 microversion: 2.1 time: 0.438158 Jul 28 04:10:35.305867 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3097/5547] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:34 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1497 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:10:35.464186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ba543b00-f6dd-4b83-9cd3-848a5571e020 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:35.464850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ba543b00-f6dd-4b83-9cd3-848a5571e020 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:35.471950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba543b00-f6dd-4b83-9cd3-848a5571e020 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:35.472343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba543b00-f6dd-4b83-9cd3-848a5571e020 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:35.473202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba543b00-f6dd-4b83-9cd3-848a5571e020 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:35.473648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba543b00-f6dd-4b83-9cd3-848a5571e020 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:35.996931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ba543b00-f6dd-4b83-9cd3-848a5571e020 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:36.008966 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ba543b00-f6dd-4b83-9cd3-848a5571e020 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1471 microversion: 2.1 time: 0.548527 Jul 28 04:10:36.009582 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3098/5548] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:35 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1471 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:10:36.026353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4b000fb2-2fe3-446e-a989-63ccd6db88b6 req-c3787fdf-6576-4c0d-a9b8-7bf27ab37446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2d47858-4b4a-4292-869e-185e1ec5012f", "tag": "8e2eef61-5181-4874-bc24-425a4b45d0d5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:36.062429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4b000fb2-2fe3-446e-a989-63ccd6db88b6 req-c3787fdf-6576-4c0d-a9b8-7bf27ab37446 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:36.063770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4b000fb2-2fe3-446e-a989-63ccd6db88b6 req-c3787fdf-6576-4c0d-a9b8-7bf27ab37446 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:36.115939 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4b000fb2-2fe3-446e-a989-63ccd6db88b6 req-c3787fdf-6576-4c0d-a9b8-7bf27ab37446 service nova] Creating event network-changed:8e2eef61-5181-4874-bc24-425a4b45d0d5 for instance d2d47858-4b4a-4292-869e-185e1ec5012f on n-h1-826756-3 Jul 28 04:10:36.138530 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4b000fb2-2fe3-446e-a989-63ccd6db88b6 req-c3787fdf-6576-4c0d-a9b8-7bf27ab37446 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124144 Jul 28 04:10:36.139551 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3099/5549] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:36.163559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b9a8236-5ad8-49ca-85cf-845c99666007 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:36.164929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b9a8236-5ad8-49ca-85cf-845c99666007 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:36.220080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b9a8236-5ad8-49ca-85cf-845c99666007 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:36.221455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b9a8236-5ad8-49ca-85cf-845c99666007 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:36.225004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b9a8236-5ad8-49ca-85cf-845c99666007 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:36.227317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b9a8236-5ad8-49ca-85cf-845c99666007 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:36.504844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7b9a8236-5ad8-49ca-85cf-845c99666007 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:36.515011 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b9a8236-5ad8-49ca-85cf-845c99666007 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1293 microversion: 2.1 time: 0.373014 Jul 28 04:10:36.533979 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3100/5550] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:36 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1293 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:37.051681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f1dcdbcf-6ba6-4c27-b87a-e826bd0c5a02 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:37.054716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f1dcdbcf-6ba6-4c27-b87a-e826bd0c5a02 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:37.068164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:37.081658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1dcdbcf-6ba6-4c27-b87a-e826bd0c5a02 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:37.082756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1dcdbcf-6ba6-4c27-b87a-e826bd0c5a02 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:37.084739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1dcdbcf-6ba6-4c27-b87a-e826bd0c5a02 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:37.086331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1dcdbcf-6ba6-4c27-b87a-e826bd0c5a02 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:37.409428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f1dcdbcf-6ba6-4c27-b87a-e826bd0c5a02 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:37.432034 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f1dcdbcf-6ba6-4c27-b87a-e826bd0c5a02 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1471 microversion: 2.1 time: 0.384023 Jul 28 04:10:37.452932 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3101/5551] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:37 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1471 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:37.550620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-386c1b45-c7b4-47ba-b25a-1752e5c5fd76 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:37.559605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-386c1b45-c7b4-47ba-b25a-1752e5c5fd76 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:37.570641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-386c1b45-c7b4-47ba-b25a-1752e5c5fd76 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:37.580980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-386c1b45-c7b4-47ba-b25a-1752e5c5fd76 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:37.582041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-386c1b45-c7b4-47ba-b25a-1752e5c5fd76 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:37.582642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-386c1b45-c7b4-47ba-b25a-1752e5c5fd76 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:37.872427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-386c1b45-c7b4-47ba-b25a-1752e5c5fd76 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:37.885066 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-386c1b45-c7b4-47ba-b25a-1752e5c5fd76 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1293 microversion: 2.1 time: 0.343787 Jul 28 04:10:37.885671 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3102/5552] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:37 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1293 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:37.904092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-ddcbeba1-e91a-468f-9005-86feba18eaa9 req-5a525e91-c59b-4b9d-b145-1a4bafa9d5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befd4e30-8159-4bd1-9567-141e24513282", "name": "network-vif-plugged", "status": "completed", "tag": "93bb52e4-eb60-4508-a0d2-fbd60ad3cd6c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:37.927707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ddcbeba1-e91a-468f-9005-86feba18eaa9 req-5a525e91-c59b-4b9d-b145-1a4bafa9d5ca service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:37.928546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ddcbeba1-e91a-468f-9005-86feba18eaa9 req-5a525e91-c59b-4b9d-b145-1a4bafa9d5ca service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:37.953562 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-ddcbeba1-e91a-468f-9005-86feba18eaa9 req-5a525e91-c59b-4b9d-b145-1a4bafa9d5ca service nova] Creating event network-vif-plugged:93bb52e4-eb60-4508-a0d2-fbd60ad3cd6c for instance befd4e30-8159-4bd1-9567-141e24513282 on n-h2-826756-3 Jul 28 04:10:37.961214 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-ddcbeba1-e91a-468f-9005-86feba18eaa9 req-5a525e91-c59b-4b9d-b145-1a4bafa9d5ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061562 Jul 28 04:10:37.961843 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3103/5553] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:38.462127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=24 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:38.480277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa724bfb-468e-4cfa-8229-74627c9b95fb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:38.481118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fa724bfb-468e-4cfa-8229-74627c9b95fb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:38.503033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa724bfb-468e-4cfa-8229-74627c9b95fb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:38.503499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa724bfb-468e-4cfa-8229-74627c9b95fb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:38.515142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa724bfb-468e-4cfa-8229-74627c9b95fb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:38.519468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa724bfb-468e-4cfa-8229-74627c9b95fb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:39.086415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa724bfb-468e-4cfa-8229-74627c9b95fb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:39.098004 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fa724bfb-468e-4cfa-8229-74627c9b95fb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1471 microversion: 2.1 time: 0.638182 Jul 28 04:10:39.112430 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3104/5554] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:38 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1471 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:39.118603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fec5c693-4b4c-48af-87f1-f0e58f6b2a1f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:39.119574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fec5c693-4b4c-48af-87f1-f0e58f6b2a1f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:39.127884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fec5c693-4b4c-48af-87f1-f0e58f6b2a1f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:39.128758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fec5c693-4b4c-48af-87f1-f0e58f6b2a1f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:39.129822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fec5c693-4b4c-48af-87f1-f0e58f6b2a1f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:39.130478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fec5c693-4b4c-48af-87f1-f0e58f6b2a1f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:39.451899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fec5c693-4b4c-48af-87f1-f0e58f6b2a1f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:39.476279 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fec5c693-4b4c-48af-87f1-f0e58f6b2a1f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1293 microversion: 2.1 time: 0.359481 Jul 28 04:10:39.477436 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3105/5555] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:39 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1293 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:39.910572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-112a57da-7241-412b-bbe5-665344411563 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9034970-95ff-4c94-8ece-c1806890b451"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:39.920664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-112a57da-7241-412b-bbe5-665344411563 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:39.959183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-112a57da-7241-412b-bbe5-665344411563 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:39.960409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-112a57da-7241-412b-bbe5-665344411563 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:39.964385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-112a57da-7241-412b-bbe5-665344411563 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:39.967735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-112a57da-7241-412b-bbe5-665344411563 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:40.044335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:40.668479 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-112a57da-7241-412b-bbe5-665344411563 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.770948 Jul 28 04:10:40.669579 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3106/5556] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 04:10:39 2022] POST /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments => generated 194 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:10:40.675670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-98b037f6-b166-47b7-a801-c6ddce1985df tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:40.677586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-98b037f6-b166-47b7-a801-c6ddce1985df tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:40.700804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-98b037f6-b166-47b7-a801-c6ddce1985df tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:40.701417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-98b037f6-b166-47b7-a801-c6ddce1985df tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:40.702446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-98b037f6-b166-47b7-a801-c6ddce1985df tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:40.703847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-98b037f6-b166-47b7-a801-c6ddce1985df tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:40.971445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-98b037f6-b166-47b7-a801-c6ddce1985df tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:40.984235 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-98b037f6-b166-47b7-a801-c6ddce1985df tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1643 microversion: 2.1 time: 0.312998 Jul 28 04:10:40.997302 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3107/5557] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:40 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1643 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:41.009978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c6de787-f5d6-496b-908e-0de2d94f868a tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:41.011394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c6de787-f5d6-496b-908e-0de2d94f868a tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:41.035780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c6de787-f5d6-496b-908e-0de2d94f868a tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:41.039288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c6de787-f5d6-496b-908e-0de2d94f868a tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:41.040571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c6de787-f5d6-496b-908e-0de2d94f868a tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:41.046209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c6de787-f5d6-496b-908e-0de2d94f868a tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:41.106619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c6de787-f5d6-496b-908e-0de2d94f868a tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:10:41.246276 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7c6de787-f5d6-496b-908e-0de2d94f868a tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 204 len: 0 microversion: 2.1 time: 0.245554 Jul 28 04:10:41.247240 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3108/5558] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:10:40 2022] DELETE /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:10:41.256885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9b4a62c-3604-4853-ab30-af726e61cb9f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:41.257922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9b4a62c-3604-4853-ab30-af726e61cb9f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:41.265009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9b4a62c-3604-4853-ab30-af726e61cb9f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:41.265521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9b4a62c-3604-4853-ab30-af726e61cb9f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:41.266586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9b4a62c-3604-4853-ab30-af726e61cb9f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:41.267119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9b4a62c-3604-4853-ab30-af726e61cb9f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:41.528386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b9b4a62c-3604-4853-ab30-af726e61cb9f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:41.536895 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9b4a62c-3604-4853-ab30-af726e61cb9f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1293 microversion: 2.1 time: 0.288303 Jul 28 04:10:41.542257 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3109/5559] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:41 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1293 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:41.551691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4e1e48dd-ff87-4490-a54a-e71f6769da71 req-b9f035d4-40d4-443c-85dc-06035dc616a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2d47858-4b4a-4292-869e-185e1ec5012f", "name": "network-vif-plugged", "status": "completed", "tag": "8e2eef61-5181-4874-bc24-425a4b45d0d5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:41.581365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4e1e48dd-ff87-4490-a54a-e71f6769da71 req-b9f035d4-40d4-443c-85dc-06035dc616a6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:41.583000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4e1e48dd-ff87-4490-a54a-e71f6769da71 req-b9f035d4-40d4-443c-85dc-06035dc616a6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:41.599228 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4e1e48dd-ff87-4490-a54a-e71f6769da71 req-b9f035d4-40d4-443c-85dc-06035dc616a6 service nova] Creating event network-vif-plugged:8e2eef61-5181-4874-bc24-425a4b45d0d5 for instance d2d47858-4b4a-4292-869e-185e1ec5012f on n-h1-826756-3 Jul 28 04:10:41.606415 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4e1e48dd-ff87-4490-a54a-e71f6769da71 req-b9f035d4-40d4-443c-85dc-06035dc616a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062530 Jul 28 04:10:41.607214 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3110/5560] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:41.615633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0659b13c-3cac-4062-9898-5a20596999d8 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:41.616386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0659b13c-3cac-4062-9898-5a20596999d8 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:41.625089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0659b13c-3cac-4062-9898-5a20596999d8 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:41.625641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0659b13c-3cac-4062-9898-5a20596999d8 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:41.626900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0659b13c-3cac-4062-9898-5a20596999d8 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:41.626900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0659b13c-3cac-4062-9898-5a20596999d8 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:41.872039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0659b13c-3cac-4062-9898-5a20596999d8 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:41.903048 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0659b13c-3cac-4062-9898-5a20596999d8 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1643 microversion: 2.1 time: 0.294592 Jul 28 04:10:41.903773 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3111/5561] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:41 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1643 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:41.917162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d1e4714-7b68-443e-8a3d-dcf630f6b6ad tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:41.918055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d1e4714-7b68-443e-8a3d-dcf630f6b6ad tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:41.938126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d1e4714-7b68-443e-8a3d-dcf630f6b6ad tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:41.938762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d1e4714-7b68-443e-8a3d-dcf630f6b6ad tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:41.939661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d1e4714-7b68-443e-8a3d-dcf630f6b6ad tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:41.940088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d1e4714-7b68-443e-8a3d-dcf630f6b6ad tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:42.174929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7d1e4714-7b68-443e-8a3d-dcf630f6b6ad tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:42.202342 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d1e4714-7b68-443e-8a3d-dcf630f6b6ad tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1503 microversion: 2.1 time: 0.297546 Jul 28 04:10:42.202342 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3112/5562] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:41 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:42.220439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cdd2b535-d701-4d8d-bdf5-50baa53ab65a tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:42.220439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cdd2b535-d701-4d8d-bdf5-50baa53ab65a tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:42.246659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cdd2b535-d701-4d8d-bdf5-50baa53ab65a tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:42.247125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cdd2b535-d701-4d8d-bdf5-50baa53ab65a tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:42.247926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cdd2b535-d701-4d8d-bdf5-50baa53ab65a tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:42.256546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cdd2b535-d701-4d8d-bdf5-50baa53ab65a tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:42.824165 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cdd2b535-d701-4d8d-bdf5-50baa53ab65a tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1794 microversion: 2.1 time: 0.619479 Jul 28 04:10:42.826404 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3113/5563] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:42 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1794 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:42.832095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c0e473e-6f64-488c-8208-ac223463cf88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:42.832629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5c0e473e-6f64-488c-8208-ac223463cf88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:42.839436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c0e473e-6f64-488c-8208-ac223463cf88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:42.840046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c0e473e-6f64-488c-8208-ac223463cf88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:42.840861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c0e473e-6f64-488c-8208-ac223463cf88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:42.841540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c0e473e-6f64-488c-8208-ac223463cf88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:43.636944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5c0e473e-6f64-488c-8208-ac223463cf88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:43.645948 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5c0e473e-6f64-488c-8208-ac223463cf88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1293 microversion: 2.1 time: 0.818438 Jul 28 04:10:43.659191 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3114/5564] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:42 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1293 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:43.680699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4152293c-d4c9-458c-abc6-1a00bbee0f40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:43.681871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4152293c-d4c9-458c-abc6-1a00bbee0f40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:43.704647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4152293c-d4c9-458c-abc6-1a00bbee0f40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:43.708567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4152293c-d4c9-458c-abc6-1a00bbee0f40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:43.713519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4152293c-d4c9-458c-abc6-1a00bbee0f40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:43.713982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4152293c-d4c9-458c-abc6-1a00bbee0f40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:43.893409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4152293c-d4c9-458c-abc6-1a00bbee0f40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebef4cb34b104f5f8e0d77d6285e11b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee57c14af81482db82880d1482f3210', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:43.913138 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4152293c-d4c9-458c-abc6-1a00bbee0f40 tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 200 len: 1461 microversion: 2.1 time: 0.251995 Jul 28 04:10:43.915994 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3115/5565] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:43 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 1461 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:43.946106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1de5ced9-9e52-42ac-9f5a-f1854d75fdd7 req-4275e814-8b70-4313-bb01-68aa1e09549e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f427208-0c0e-4be7-ac7b-420c8110ceb7", "name": "network-vif-deleted", "tag": "d6f9962d-9c66-456c-a3ab-7e048f16f5ed"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:43.968452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1de5ced9-9e52-42ac-9f5a-f1854d75fdd7 req-4275e814-8b70-4313-bb01-68aa1e09549e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:43.968890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1de5ced9-9e52-42ac-9f5a-f1854d75fdd7 req-4275e814-8b70-4313-bb01-68aa1e09549e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:43.998999 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1de5ced9-9e52-42ac-9f5a-f1854d75fdd7 req-4275e814-8b70-4313-bb01-68aa1e09549e service nova] Creating event network-vif-deleted:d6f9962d-9c66-456c-a3ab-7e048f16f5ed for instance 8f427208-0c0e-4be7-ac7b-420c8110ceb7 on n-h1-826756-3 Jul 28 04:10:44.012828 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1de5ced9-9e52-42ac-9f5a-f1854d75fdd7 req-4275e814-8b70-4313-bb01-68aa1e09549e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072488 Jul 28 04:10:44.013781 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3116/5566] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:44.678814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-67bd4f49-e10c-49da-a669-20aa98f39a5d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:44.680340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-67bd4f49-e10c-49da-a669-20aa98f39a5d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:44.700393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67bd4f49-e10c-49da-a669-20aa98f39a5d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:44.701145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67bd4f49-e10c-49da-a669-20aa98f39a5d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:44.702223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67bd4f49-e10c-49da-a669-20aa98f39a5d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:44.702993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67bd4f49-e10c-49da-a669-20aa98f39a5d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:45.137311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-67bd4f49-e10c-49da-a669-20aa98f39a5d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:45.153621 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-67bd4f49-e10c-49da-a669-20aa98f39a5d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1474 microversion: 2.1 time: 0.480101 Jul 28 04:10:45.156608 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3117/5567] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:44 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1474 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:45.194247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6994bcb1-90db-4909-a76e-cf5a0196b79f tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:45.208365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6994bcb1-90db-4909-a76e-cf5a0196b79f tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] [instance: 8f427208-0c0e-4be7-ac7b-420c8110ceb7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:45.235224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6994bcb1-90db-4909-a76e-cf5a0196b79f tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:45.236542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6994bcb1-90db-4909-a76e-cf5a0196b79f tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:45.237511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6994bcb1-90db-4909-a76e-cf5a0196b79f tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:45.238079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6994bcb1-90db-4909-a76e-cf5a0196b79f tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:45.271234 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-6994bcb1-90db-4909-a76e-cf5a0196b79f tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] HTTP exception thrown: Instance 8f427208-0c0e-4be7-ac7b-420c8110ceb7 could not be found. Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6994bcb1-90db-4909-a76e-cf5a0196b79f tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Request method failure captured: Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 HTTP/1.1 Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwVFkBa-liAGfOIkGAzqJOKaLdZjVCfpGliO035OZThwxx9WExalKsdxJDeiU8TwUZ5kaDx_j5mXtU_fsl0mAE3uaOT65lO3tTD-3W-_N-udGZCiy2GwOjenr8yduahE_ZR9QRzRlZ6LQfU70HjZIPm6il0HL22JO4ICRAVOYOJ4x8 Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: cee57c14af81482db82880d1482f3210 Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-VolumesActionsTest-789799230 Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cee57c14af81482db82880d1482f3210"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cee57c14af81482db82880d1482f3210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cee57c14af81482db82880d1482f3210"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cee57c14af81482db82880d1482f3210"}]}] Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-VolumesActionsTest-789799230 Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: cee57c14af81482db82880d1482f3210 Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-VolumesActionsTest-789799230 Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-VolumesActionsTest-789799230-project Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ebef4cb34b104f5f8e0d77d6285e11b3 Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-VolumesActionsTest-789799230-project Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 8f427208-0c0e-4be7-ac7b-420c8110ceb7 could not be found. Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8f427208-0c0e-4be7-ac7b-420c8110ceb7'} Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f427208-0c0e-4be7-ac7b-420c8110ceb7 could not be found. Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f427208-0c0e-4be7-ac7b-420c8110ceb7 could not be found. Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:10:45.285932 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:10:45.291654 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:45.291654 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:10:45.291654 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:10:45.291654 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:10:45.291654 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:10:45.291654 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f427208-0c0e-4be7-ac7b-420c8110ceb7 could not be found. Jul 28 04:10:45.291654 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:10:45.293451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6994bcb1-90db-4909-a76e-cf5a0196b79f tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] Returning 404 to user: Instance 8f427208-0c0e-4be7-ac7b-420c8110ceb7 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:10:45.294523 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6994bcb1-90db-4909-a76e-cf5a0196b79f tempest-VolumesActionsTest-789799230 tempest-VolumesActionsTest-789799230-project] 10.222.0.48 "GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7" status: 404 len: 111 microversion: 2.1 time: 0.138899 Jul 28 04:10:45.295290 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3118/5568] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:45 2022] GET /compute/v2.1/servers/8f427208-0c0e-4be7-ac7b-420c8110ceb7 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:10:45.389711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1973924203", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:45.475011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] validate_networks() for [('942500be-05b0-478f-8797-cdf9e19a4ee1', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:10:46.648833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:10:46.650518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:10:46.651226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:10:46.651885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:10:46.652674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:10:46.674603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:46.675481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:46.676978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:46.678043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:46.723333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:46.759924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:10:46.767180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for user 24e6476d226840c4adc1ea6c54dfd527 and project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:10:46.780926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:10:46.783654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9c0dd3e0-ef18-458c-addd-e4981c4b3a65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:10:46.940730 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a09c1126-6d97-41fb-a329-2e81533c1778 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.551376 Jul 28 04:10:46.944044 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3119/5569] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:10:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:10:46.965989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4911386-6736-4ac8-8d60-05935525c61e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:46.969126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4911386-6736-4ac8-8d60-05935525c61e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9c0dd3e0-ef18-458c-addd-e4981c4b3a65] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:47.000534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4911386-6736-4ac8-8d60-05935525c61e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9c0dd3e0-ef18-458c-addd-e4981c4b3a65] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:10:47.601544 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4911386-6736-4ac8-8d60-05935525c61e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9c0dd3e0-ef18-458c-addd-e4981c4b3a65" status: 204 len: 0 microversion: 2.1 time: 0.646635 Jul 28 04:10:47.608606 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3120/5570] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:10:46 2022] DELETE /compute/v2.1/servers/9c0dd3e0-ef18-458c-addd-e4981c4b3a65 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:10:47.622664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-209f4f1c-e30a-4a07-ad26-a10e34751aea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:47.629762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-209f4f1c-e30a-4a07-ad26-a10e34751aea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9c0dd3e0-ef18-458c-addd-e4981c4b3a65] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:47.685147 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-209f4f1c-e30a-4a07-ad26-a10e34751aea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-209f4f1c-e30a-4a07-ad26-a10e34751aea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/9c0dd3e0-ef18-458c-addd-e4981c4b3a65 HTTP/1.1 Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9c0dd3e0-ef18-458c-addd-e4981c4b3a65'} Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in _get_instance Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2935, in _get_instance Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:10:47.708183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:10:47.713850 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:10:47.717042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-209f4f1c-e30a-4a07-ad26-a10e34751aea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:10:47.718239 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-209f4f1c-e30a-4a07-ad26-a10e34751aea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9c0dd3e0-ef18-458c-addd-e4981c4b3a65" status: 404 len: 111 microversion: 2.1 time: 0.104542 Jul 28 04:10:47.719431 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3121/5571] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:47 2022] GET /compute/v2.1/servers/9c0dd3e0-ef18-458c-addd-e4981c4b3a65 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:10:47.776731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-06113afd-6fef-4d75-82b2-20f67062f97a req-811d24c3-8ce3-4983-8819-e801fd9e8890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befd4e30-8159-4bd1-9567-141e24513282", "tag": "93bb52e4-eb60-4508-a0d2-fbd60ad3cd6c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:47.816009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-06113afd-6fef-4d75-82b2-20f67062f97a req-811d24c3-8ce3-4983-8819-e801fd9e8890 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:47.816558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-06113afd-6fef-4d75-82b2-20f67062f97a req-811d24c3-8ce3-4983-8819-e801fd9e8890 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:47.855018 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-06113afd-6fef-4d75-82b2-20f67062f97a req-811d24c3-8ce3-4983-8819-e801fd9e8890 service nova] Creating event network-changed:93bb52e4-eb60-4508-a0d2-fbd60ad3cd6c for instance befd4e30-8159-4bd1-9567-141e24513282 on n-h2-826756-3 Jul 28 04:10:47.875473 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-06113afd-6fef-4d75-82b2-20f67062f97a req-811d24c3-8ce3-4983-8819-e801fd9e8890 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100672 Jul 28 04:10:47.876259 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3122/5572] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:10:47.912196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-486442687", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "942500be-05b0-478f-8797-cdf9e19a4ee1"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:48.088579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] validate_networks() for [('942500be-05b0-478f-8797-cdf9e19a4ee1', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:10:49.106457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:10:49.107162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:10:49.107335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:10:49.108457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:10:49.109085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:10:49.126855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:49.127623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:49.131466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:49.132169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:49.185280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:10:49.195800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for user 24e6476d226840c4adc1ea6c54dfd527 and project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:10:49.233008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:10:49.243246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:10:49.446812 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1b3e1ff-0ff0-4de6-8b35-cfe5de919d14 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.564815 Jul 28 04:10:49.449983 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3123/5573] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:10:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:10:49.464329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ac121eac-bdb7-4ccf-b506-2100dc72d465 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:49.465173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ac121eac-bdb7-4ccf-b506-2100dc72d465 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:49.581290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ac121eac-bdb7-4ccf-b506-2100dc72d465 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:49.592107 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ac121eac-bdb7-4ccf-b506-2100dc72d465 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1220 microversion: 2.1 time: 0.133195 Jul 28 04:10:49.603988 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3124/5574] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:49 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1220 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:50.621885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-622f8f84-de05-4a30-a42e-65112a852a29 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:50.623011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-622f8f84-de05-4a30-a42e-65112a852a29 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:50.654830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-622f8f84-de05-4a30-a42e-65112a852a29 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:50.655760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-622f8f84-de05-4a30-a42e-65112a852a29 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:50.658008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-622f8f84-de05-4a30-a42e-65112a852a29 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:50.661390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-622f8f84-de05-4a30-a42e-65112a852a29 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:50.770543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-622f8f84-de05-4a30-a42e-65112a852a29 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:50.785844 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-622f8f84-de05-4a30-a42e-65112a852a29 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1216 microversion: 2.1 time: 0.164504 Jul 28 04:10:50.796400 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3125/5575] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:50 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1216 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:10:51.814009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1e85b63d-32f2-43a6-bfde-414d8c136a75 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:51.814912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1e85b63d-32f2-43a6-bfde-414d8c136a75 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:51.837765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e85b63d-32f2-43a6-bfde-414d8c136a75 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:51.838228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e85b63d-32f2-43a6-bfde-414d8c136a75 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:51.839027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e85b63d-32f2-43a6-bfde-414d8c136a75 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:51.839491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e85b63d-32f2-43a6-bfde-414d8c136a75 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:51.987724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1e85b63d-32f2-43a6-bfde-414d8c136a75 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:51.998300 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1e85b63d-32f2-43a6-bfde-414d8c136a75 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1278 microversion: 2.1 time: 0.191223 Jul 28 04:10:52.006536 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3126/5576] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:51 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:53.062867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abc46d8e-4865-462d-9e7e-d404b0fe6ade tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:53.064424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-abc46d8e-4865-462d-9e7e-d404b0fe6ade tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:53.109360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abc46d8e-4865-462d-9e7e-d404b0fe6ade tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:53.109827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abc46d8e-4865-462d-9e7e-d404b0fe6ade tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:53.110644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abc46d8e-4865-462d-9e7e-d404b0fe6ade tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:53.111094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abc46d8e-4865-462d-9e7e-d404b0fe6ade tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:53.194805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:53.474593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-abc46d8e-4865-462d-9e7e-d404b0fe6ade tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:53.484624 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-abc46d8e-4865-462d-9e7e-d404b0fe6ade tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1320 microversion: 2.1 time: 0.456846 Jul 28 04:10:53.486182 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3127/5577] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:53 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1320 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:10:54.513951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51583009-7e04-485d-9056-3455fcaab94a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:54.515552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-51583009-7e04-485d-9056-3455fcaab94a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:54.532415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51583009-7e04-485d-9056-3455fcaab94a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:54.540959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51583009-7e04-485d-9056-3455fcaab94a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:54.542071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51583009-7e04-485d-9056-3455fcaab94a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:54.543444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51583009-7e04-485d-9056-3455fcaab94a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:54.848388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-51583009-7e04-485d-9056-3455fcaab94a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:54.864254 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51583009-7e04-485d-9056-3455fcaab94a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1320 microversion: 2.1 time: 0.354517 Jul 28 04:10:54.865181 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3128/5578] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:54 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1320 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:10:54.870214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-47b75224-9e4b-46d5-9080-1942a84e9c2c req-4bf64686-00f5-4cd1-add1-4141fecc16a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f30498a-75fb-440e-a219-aadced2bb957", "tag": "b27ce43b-e172-4612-a740-f18995952e5b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:54.890862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-47b75224-9e4b-46d5-9080-1942a84e9c2c req-4bf64686-00f5-4cd1-add1-4141fecc16a9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:54.901105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-47b75224-9e4b-46d5-9080-1942a84e9c2c req-4bf64686-00f5-4cd1-add1-4141fecc16a9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:54.930980 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-47b75224-9e4b-46d5-9080-1942a84e9c2c req-4bf64686-00f5-4cd1-add1-4141fecc16a9 service nova] Creating event network-changed:b27ce43b-e172-4612-a740-f18995952e5b for instance 9f30498a-75fb-440e-a219-aadced2bb957 on n-h2-826756-3 Jul 28 04:10:54.941981 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-47b75224-9e4b-46d5-9080-1942a84e9c2c req-4bf64686-00f5-4cd1-add1-4141fecc16a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075328 Jul 28 04:10:54.952711 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3129/5579] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:55.890593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-57c760c2-1026-4806-8a05-692ae3184c4e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:55.891576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-57c760c2-1026-4806-8a05-692ae3184c4e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:55.907942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57c760c2-1026-4806-8a05-692ae3184c4e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:55.908664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57c760c2-1026-4806-8a05-692ae3184c4e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:55.911116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57c760c2-1026-4806-8a05-692ae3184c4e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:55.911823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57c760c2-1026-4806-8a05-692ae3184c4e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:56.178298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-57c760c2-1026-4806-8a05-692ae3184c4e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:56.199461 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-57c760c2-1026-4806-8a05-692ae3184c4e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1320 microversion: 2.1 time: 0.312098 Jul 28 04:10:56.200525 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3130/5580] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:55 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1320 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:57.224048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-162436a8-be1b-4fb3-9a07-f0e7dcb12f59 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:57.224734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-162436a8-be1b-4fb3-9a07-f0e7dcb12f59 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:57.240160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-162436a8-be1b-4fb3-9a07-f0e7dcb12f59 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:57.240635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-162436a8-be1b-4fb3-9a07-f0e7dcb12f59 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:57.241655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-162436a8-be1b-4fb3-9a07-f0e7dcb12f59 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:57.242256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-162436a8-be1b-4fb3-9a07-f0e7dcb12f59 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:57.520102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-162436a8-be1b-4fb3-9a07-f0e7dcb12f59 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:57.543352 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-162436a8-be1b-4fb3-9a07-f0e7dcb12f59 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1320 microversion: 2.1 time: 0.320689 Jul 28 04:10:57.544801 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3131/5581] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:57 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1320 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:58.569869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83b10018-5b60-4e27-99ec-5b3673ca10f3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:58.569869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-83b10018-5b60-4e27-99ec-5b3673ca10f3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:10:58.602451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83b10018-5b60-4e27-99ec-5b3673ca10f3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:58.605177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83b10018-5b60-4e27-99ec-5b3673ca10f3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:58.606097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83b10018-5b60-4e27-99ec-5b3673ca10f3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:58.606535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83b10018-5b60-4e27-99ec-5b3673ca10f3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:58.946086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-83b10018-5b60-4e27-99ec-5b3673ca10f3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:58.957104 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-83b10018-5b60-4e27-99ec-5b3673ca10f3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1320 microversion: 2.1 time: 0.392291 Jul 28 04:10:58.964334 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3132/5582] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:58 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1320 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:59.962593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1ba424fd-fa9b-46d6-bedd-ae993d722797 req-4795c846-86f9-4aba-9e85-e8e42bd9deed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f30498a-75fb-440e-a219-aadced2bb957", "name": "network-vif-plugged", "status": "completed", "tag": "b27ce43b-e172-4612-a740-f18995952e5b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:59.988254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:59.991042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=16 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:00.002736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1ba424fd-fa9b-46d6-bedd-ae993d722797 req-4795c846-86f9-4aba-9e85-e8e42bd9deed service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:00.007338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1ba424fd-fa9b-46d6-bedd-ae993d722797 req-4795c846-86f9-4aba-9e85-e8e42bd9deed service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:00.078701 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1ba424fd-fa9b-46d6-bedd-ae993d722797 req-4795c846-86f9-4aba-9e85-e8e42bd9deed service nova] Creating event network-vif-plugged:b27ce43b-e172-4612-a740-f18995952e5b for instance 9f30498a-75fb-440e-a219-aadced2bb957 on n-h2-826756-3 Jul 28 04:11:00.088747 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1ba424fd-fa9b-46d6-bedd-ae993d722797 req-4795c846-86f9-4aba-9e85-e8e42bd9deed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154230 Jul 28 04:11:00.091361 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3133/5583] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:11:00.107935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-169d10a2-8c69-4b54-a6ed-32fd42d7bd5b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:00.108925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-169d10a2-8c69-4b54-a6ed-32fd42d7bd5b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:00.118209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-169d10a2-8c69-4b54-a6ed-32fd42d7bd5b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:00.118753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-169d10a2-8c69-4b54-a6ed-32fd42d7bd5b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:00.119930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-169d10a2-8c69-4b54-a6ed-32fd42d7bd5b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:00.121758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-169d10a2-8c69-4b54-a6ed-32fd42d7bd5b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:00.419021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-169d10a2-8c69-4b54-a6ed-32fd42d7bd5b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:00.443140 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-169d10a2-8c69-4b54-a6ed-32fd42d7bd5b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1320 microversion: 2.1 time: 0.350279 Jul 28 04:11:00.463246 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3134/5584] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:00 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1320 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:01.472618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0465147d-fb55-4691-a886-843b9a83d782 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:01.473582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0465147d-fb55-4691-a886-843b9a83d782 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:01.484520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0465147d-fb55-4691-a886-843b9a83d782 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:01.485229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0465147d-fb55-4691-a886-843b9a83d782 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:01.487321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0465147d-fb55-4691-a886-843b9a83d782 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:01.493773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0465147d-fb55-4691-a886-843b9a83d782 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:01.920521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0465147d-fb55-4691-a886-843b9a83d782 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:01.934518 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0465147d-fb55-4691-a886-843b9a83d782 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1320 microversion: 2.1 time: 0.467327 Jul 28 04:11:01.955362 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3135/5585] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:01 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1320 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:02.967853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-923cada3-8985-4540-829f-b765410191a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:02.969724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-923cada3-8985-4540-829f-b765410191a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:02.999024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-923cada3-8985-4540-829f-b765410191a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:02.999598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-923cada3-8985-4540-829f-b765410191a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:03.000630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-923cada3-8985-4540-829f-b765410191a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:03.001211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-923cada3-8985-4540-829f-b765410191a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:03.316664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-923cada3-8985-4540-829f-b765410191a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:03.327924 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-923cada3-8985-4540-829f-b765410191a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1500 microversion: 2.1 time: 0.367159 Jul 28 04:11:03.329359 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3136/5586] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:02 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1500 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:03.335665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a423cd9d-c7f5-4f48-8e3c-d069f5936df1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:03.338061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a423cd9d-c7f5-4f48-8e3c-d069f5936df1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:03.345359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a423cd9d-c7f5-4f48-8e3c-d069f5936df1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:03.346081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a423cd9d-c7f5-4f48-8e3c-d069f5936df1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:03.347077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a423cd9d-c7f5-4f48-8e3c-d069f5936df1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:03.347732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a423cd9d-c7f5-4f48-8e3c-d069f5936df1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:03.411703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-a423cd9d-c7f5-4f48-8e3c-d069f5936df1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lazy-loading 'flavor' on Instance uuid 81aa2809-5b04-4192-bba4-580cf02c2aa1 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:11:03.628941 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a423cd9d-c7f5-4f48-8e3c-d069f5936df1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/action" status: 200 len: 32 microversion: 2.1 time: 0.296992 Jul 28 04:11:03.640736 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3137/5587] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:11:03 2022] POST /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/action => generated 32 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:11:03.652486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8593ad5e-c1ad-4975-8d6f-8b992be89b38 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:03.654028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8593ad5e-c1ad-4975-8d6f-8b992be89b38 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:03.667429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8593ad5e-c1ad-4975-8d6f-8b992be89b38 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:03.668462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8593ad5e-c1ad-4975-8d6f-8b992be89b38 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:03.670210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8593ad5e-c1ad-4975-8d6f-8b992be89b38 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:03.671601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8593ad5e-c1ad-4975-8d6f-8b992be89b38 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:04.016848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8593ad5e-c1ad-4975-8d6f-8b992be89b38 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:04.072729 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8593ad5e-c1ad-4975-8d6f-8b992be89b38 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1500 microversion: 2.1 time: 0.429102 Jul 28 04:11:04.075838 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3138/5588] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:03 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1500 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:04.084742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aa1aecd1-eb6d-4f63-ab05-1975b826e236 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:04.086272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aa1aecd1-eb6d-4f63-ab05-1975b826e236 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:04.107291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa1aecd1-eb6d-4f63-ab05-1975b826e236 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:04.108156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa1aecd1-eb6d-4f63-ab05-1975b826e236 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:04.110055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa1aecd1-eb6d-4f63-ab05-1975b826e236 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:04.111105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa1aecd1-eb6d-4f63-ab05-1975b826e236 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:04.422668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aa1aecd1-eb6d-4f63-ab05-1975b826e236 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:04.438948 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aa1aecd1-eb6d-4f63-ab05-1975b826e236 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.360131 Jul 28 04:11:04.441767 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3139/5589] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:04 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:04.448690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5388155c-36a8-4c7c-910e-39c49b59404c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:04.449461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5388155c-36a8-4c7c-910e-39c49b59404c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:04.457708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5388155c-36a8-4c7c-910e-39c49b59404c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:04.458771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5388155c-36a8-4c7c-910e-39c49b59404c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:04.460065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5388155c-36a8-4c7c-910e-39c49b59404c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:04.461696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5388155c-36a8-4c7c-910e-39c49b59404c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:04.526125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5388155c-36a8-4c7c-910e-39c49b59404c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:11:04.669566 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5388155c-36a8-4c7c-910e-39c49b59404c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 204 len: 0 microversion: 2.1 time: 0.225616 Jul 28 04:11:04.670166 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3140/5590] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:11:04 2022] DELETE /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:11:04.687512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d129873b-6236-49c9-a01f-ed7e4fb06a95 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:04.688247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d129873b-6236-49c9-a01f-ed7e4fb06a95 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:04.696708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d129873b-6236-49c9-a01f-ed7e4fb06a95 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:04.697548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d129873b-6236-49c9-a01f-ed7e4fb06a95 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:04.698407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d129873b-6236-49c9-a01f-ed7e4fb06a95 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:04.698914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d129873b-6236-49c9-a01f-ed7e4fb06a95 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:04.726888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:04.982094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d129873b-6236-49c9-a01f-ed7e4fb06a95 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:04.990643 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d129873b-6236-49c9-a01f-ed7e4fb06a95 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1506 microversion: 2.1 time: 0.314900 Jul 28 04:11:05.004459 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3141/5591] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:04 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:05.463772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abec6f82-cb6b-4733-9395-0f38c1d5c133 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:05.464485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-abec6f82-cb6b-4733-9395-0f38c1d5c133 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:05.483466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abec6f82-cb6b-4733-9395-0f38c1d5c133 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:05.484016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abec6f82-cb6b-4733-9395-0f38c1d5c133 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:05.484808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abec6f82-cb6b-4733-9395-0f38c1d5c133 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:05.485267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abec6f82-cb6b-4733-9395-0f38c1d5c133 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:05.700890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-abec6f82-cb6b-4733-9395-0f38c1d5c133 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:05.711096 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-abec6f82-cb6b-4733-9395-0f38c1d5c133 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.252231 Jul 28 04:11:05.724908 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3142/5592] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:05 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:06.015268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2cbbfc7e-5e11-4c1e-9af9-7696eaf1e435 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:06.015924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2cbbfc7e-5e11-4c1e-9af9-7696eaf1e435 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:06.027207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2cbbfc7e-5e11-4c1e-9af9-7696eaf1e435 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:06.027649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2cbbfc7e-5e11-4c1e-9af9-7696eaf1e435 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:06.038781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2cbbfc7e-5e11-4c1e-9af9-7696eaf1e435 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:06.039854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2cbbfc7e-5e11-4c1e-9af9-7696eaf1e435 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:06.287329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2cbbfc7e-5e11-4c1e-9af9-7696eaf1e435 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:06.297657 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2cbbfc7e-5e11-4c1e-9af9-7696eaf1e435 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1506 microversion: 2.1 time: 0.286514 Jul 28 04:11:06.304771 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3143/5593] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:06 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:06.738038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e86e7582-a035-4314-84f3-00bb51b8c743 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:06.739102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e86e7582-a035-4314-84f3-00bb51b8c743 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:06.764663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:06.768686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e86e7582-a035-4314-84f3-00bb51b8c743 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:06.770101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e86e7582-a035-4314-84f3-00bb51b8c743 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:06.771697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e86e7582-a035-4314-84f3-00bb51b8c743 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:06.772741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e86e7582-a035-4314-84f3-00bb51b8c743 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:07.005407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e86e7582-a035-4314-84f3-00bb51b8c743 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:07.026037 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e86e7582-a035-4314-84f3-00bb51b8c743 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.295158 Jul 28 04:11:07.028672 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3144/5594] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:06 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:07.338000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a56db15-57eb-47d2-a98a-c7e5646e9081 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:07.338636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4a56db15-57eb-47d2-a98a-c7e5646e9081 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:07.346704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a56db15-57eb-47d2-a98a-c7e5646e9081 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:07.347162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a56db15-57eb-47d2-a98a-c7e5646e9081 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:07.348130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a56db15-57eb-47d2-a98a-c7e5646e9081 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:07.348684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a56db15-57eb-47d2-a98a-c7e5646e9081 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:07.710036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a56db15-57eb-47d2-a98a-c7e5646e9081 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:07.720549 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4a56db15-57eb-47d2-a98a-c7e5646e9081 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1506 microversion: 2.1 time: 0.387446 Jul 28 04:11:07.721299 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3145/5595] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:07 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:08.062946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c632cfbd-cb8b-4cab-b6e3-27089f2adb21 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:08.065447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c632cfbd-cb8b-4cab-b6e3-27089f2adb21 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:08.088017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c632cfbd-cb8b-4cab-b6e3-27089f2adb21 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:08.089232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c632cfbd-cb8b-4cab-b6e3-27089f2adb21 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:08.090835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c632cfbd-cb8b-4cab-b6e3-27089f2adb21 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:08.091616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c632cfbd-cb8b-4cab-b6e3-27089f2adb21 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:08.582387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c632cfbd-cb8b-4cab-b6e3-27089f2adb21 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:08.627578 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c632cfbd-cb8b-4cab-b6e3-27089f2adb21 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.570703 Jul 28 04:11:08.636406 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3146/5596] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:08 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:08.642198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-202ba253-f6ad-4c62-91dd-d705d8fd4311 req-9b2849d4-1563-4321-b5d4-93bff2a1d66b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f30498a-75fb-440e-a219-aadced2bb957", "name": "network-vif-deleted", "tag": "b27ce43b-e172-4612-a740-f18995952e5b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:08.672876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-202ba253-f6ad-4c62-91dd-d705d8fd4311 req-9b2849d4-1563-4321-b5d4-93bff2a1d66b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:08.673330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-202ba253-f6ad-4c62-91dd-d705d8fd4311 req-9b2849d4-1563-4321-b5d4-93bff2a1d66b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:08.704057 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-202ba253-f6ad-4c62-91dd-d705d8fd4311 req-9b2849d4-1563-4321-b5d4-93bff2a1d66b service nova] Creating event network-vif-deleted:b27ce43b-e172-4612-a740-f18995952e5b for instance 9f30498a-75fb-440e-a219-aadced2bb957 on n-h2-826756-3 Jul 28 04:11:08.722425 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-202ba253-f6ad-4c62-91dd-d705d8fd4311 req-9b2849d4-1563-4321-b5d4-93bff2a1d66b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083942 Jul 28 04:11:08.723088 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3147/5597] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:08.745172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5847fda9-85e8-47bd-9713-9721638669b5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:08.746151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5847fda9-85e8-47bd-9713-9721638669b5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:08.763135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5847fda9-85e8-47bd-9713-9721638669b5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:08.764007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5847fda9-85e8-47bd-9713-9721638669b5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:08.765083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5847fda9-85e8-47bd-9713-9721638669b5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:08.765690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5847fda9-85e8-47bd-9713-9721638669b5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:08.841612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5847fda9-85e8-47bd-9713-9721638669b5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:08.842287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5847fda9-85e8-47bd-9713-9721638669b5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:08.842868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-5847fda9-85e8-47bd-9713-9721638669b5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lazy-loading 'fault' on Instance uuid 9f30498a-75fb-440e-a219-aadced2bb957 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:11:08.939362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5847fda9-85e8-47bd-9713-9721638669b5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:08.959245 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5847fda9-85e8-47bd-9713-9721638669b5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 200 len: 1310 microversion: 2.1 time: 0.219505 Jul 28 04:11:08.973683 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3148/5598] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:08 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 1310 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:09.657028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-35470ec5-6d24-416e-91aa-b0f7b1568aa0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:09.658388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-35470ec5-6d24-416e-91aa-b0f7b1568aa0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:09.666166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35470ec5-6d24-416e-91aa-b0f7b1568aa0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:09.666893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35470ec5-6d24-416e-91aa-b0f7b1568aa0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:09.667900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35470ec5-6d24-416e-91aa-b0f7b1568aa0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:09.668534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35470ec5-6d24-416e-91aa-b0f7b1568aa0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:09.986065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-35470ec5-6d24-416e-91aa-b0f7b1568aa0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:09.999614 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-35470ec5-6d24-416e-91aa-b0f7b1568aa0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.346734 Jul 28 04:11:10.001093 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3149/5599] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:09 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:10.011786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1fbd9568-8584-4d16-962a-f7f4414fc033 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:10.012998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1fbd9568-8584-4d16-962a-f7f4414fc033 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:10.024777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fbd9568-8584-4d16-962a-f7f4414fc033 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:10.025578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fbd9568-8584-4d16-962a-f7f4414fc033 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:10.027258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fbd9568-8584-4d16-962a-f7f4414fc033 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:10.027866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fbd9568-8584-4d16-962a-f7f4414fc033 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:10.081469 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-1fbd9568-8584-4d16-962a-f7f4414fc033 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1fbd9568-8584-4d16-962a-f7f4414fc033 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 HTTP/1.1 Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9f30498a-75fb-440e-a219-aadced2bb957'} Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:10.085681 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:10.090293 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:10.090293 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:10.090293 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:11:10.090293 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:11:10.090293 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:11:10.090293 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:10.090293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1fbd9568-8584-4d16-962a-f7f4414fc033 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:11:10.090293 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1fbd9568-8584-4d16-962a-f7f4414fc033 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 404 len: 111 microversion: 2.1 time: 0.086903 Jul 28 04:11:10.090293 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3150/5600] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:10 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:11:10.103720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-20e09acb-888d-4ede-aa4a-243db1c52b9b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Action: 'create', calling method: .version_select at 0x7ffa74a2f670>, body: {"keypair": {"name": "tempest-key-1955416833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyXV4FiLNiMXhllr0kh396ju2NSvVND9rUA1LS1ox82yuxyPAAL7iO2Lk3LMgmWynDpDGr/KlwAHvY9EnLyRb/zfk/4tZwZ3+40cEHZsRnfp3XH/fLaE92KSXfA55ZLYQ=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:10.147140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-20e09acb-888d-4ede-aa4a-243db1c52b9b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for project 80687f6afee046a6bac1043f7c99677b. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:11:10.166002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-20e09acb-888d-4ede-aa4a-243db1c52b9b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for user 24e6476d226840c4adc1ea6c54dfd527 and project 80687f6afee046a6bac1043f7c99677b. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:11:10.226346 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-20e09acb-888d-4ede-aa4a-243db1c52b9b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.126765 Jul 28 04:11:10.227272 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3151/5601] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:11:10 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:10.238409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-360815d9-400e-4806-8dd1-6627b70e2898 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '.version_select at 0x7ffa746885e0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:10.248443 n-d-826756-3 devstack@n-api.service[126071]: WARNING oslo_db.sqlalchemy.utils [None req-360815d9-400e-4806-8dd1-6627b70e2898 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 28 04:11:10.259749 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-360815d9-400e-4806-8dd1-6627b70e2898 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.025526 Jul 28 04:11:10.269313 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3152/5602] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Jul 28 04:11:10 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:10.458946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2052253433", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "key_name": "tempest-key-1955416833", "networks": [{"uuid": "942500be-05b0-478f-8797-cdf9e19a4ee1"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:10.585762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] validate_networks() for [('942500be-05b0-478f-8797-cdf9e19a4ee1', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:11:11.833946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:11:11.834939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:11:11.835722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:11:11.836623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:11:11.837288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:11:11.865401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:11.866854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:11.868046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:11.870016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:11.923542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:11:11.930228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for user 24e6476d226840c4adc1ea6c54dfd527 and project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:11:11.945069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:11:11.948125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:11:12.049244 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eada56dd-65bb-41ff-be56-71c569cd9ace tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.593845 Jul 28 04:11:12.056386 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3153/5603] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:11:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:11:12.057252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d9156895-e9d2-4a43-8c40-3820a9334d25 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:12.057964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d9156895-e9d2-4a43-8c40-3820a9334d25 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:12.066862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9156895-e9d2-4a43-8c40-3820a9334d25 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:12.068657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9156895-e9d2-4a43-8c40-3820a9334d25 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:12.069614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9156895-e9d2-4a43-8c40-3820a9334d25 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:12.070455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9156895-e9d2-4a43-8c40-3820a9334d25 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:12.342808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d9156895-e9d2-4a43-8c40-3820a9334d25 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:12.357504 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d9156895-e9d2-4a43-8c40-3820a9334d25 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.305007 Jul 28 04:11:12.358156 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3154/5604] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:12 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:12.366997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fc8a5087-5ac0-46cf-b1b5-0f0d74bd14fa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:12.367967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fc8a5087-5ac0-46cf-b1b5-0f0d74bd14fa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:12.450862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fc8a5087-5ac0-46cf-b1b5-0f0d74bd14fa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:12.461434 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fc8a5087-5ac0-46cf-b1b5-0f0d74bd14fa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1229 microversion: 2.1 time: 0.101738 Jul 28 04:11:12.462410 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3155/5605] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:12 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:13.387494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0c7dec90-d536-4b7c-93fc-a40b09b5e74e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:13.389025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0c7dec90-d536-4b7c-93fc-a40b09b5e74e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:13.397021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c7dec90-d536-4b7c-93fc-a40b09b5e74e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:13.397774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c7dec90-d536-4b7c-93fc-a40b09b5e74e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:13.398783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c7dec90-d536-4b7c-93fc-a40b09b5e74e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:13.399607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c7dec90-d536-4b7c-93fc-a40b09b5e74e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:13.759716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0c7dec90-d536-4b7c-93fc-a40b09b5e74e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:13.774495 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0c7dec90-d536-4b7c-93fc-a40b09b5e74e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.389248 Jul 28 04:11:13.778834 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3156/5606] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:13 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:13.786378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-20f4b31e-544e-45ed-bf9d-e9ce7723dbda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:13.787585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-20f4b31e-544e-45ed-bf9d-e9ce7723dbda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:13.814223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20f4b31e-544e-45ed-bf9d-e9ce7723dbda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:13.815522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20f4b31e-544e-45ed-bf9d-e9ce7723dbda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:13.818554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20f4b31e-544e-45ed-bf9d-e9ce7723dbda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:13.820626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20f4b31e-544e-45ed-bf9d-e9ce7723dbda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:14.048569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-20f4b31e-544e-45ed-bf9d-e9ce7723dbda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:14.083004 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-20f4b31e-544e-45ed-bf9d-e9ce7723dbda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1281 microversion: 2.1 time: 0.296443 Jul 28 04:11:14.085105 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3157/5607] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:13 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1281 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:14.799764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e9fe716-836c-4222-a7ed-b8e1690f772a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:14.800487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e9fe716-836c-4222-a7ed-b8e1690f772a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:14.815100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e9fe716-836c-4222-a7ed-b8e1690f772a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:14.815638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e9fe716-836c-4222-a7ed-b8e1690f772a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:14.818482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e9fe716-836c-4222-a7ed-b8e1690f772a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:14.820786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e9fe716-836c-4222-a7ed-b8e1690f772a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:15.150502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e9fe716-836c-4222-a7ed-b8e1690f772a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:15.208096 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e9fe716-836c-4222-a7ed-b8e1690f772a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.405715 Jul 28 04:11:15.210754 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3158/5608] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:14 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:15.255274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c1053d3b-a498-417d-b631-852dcb248086 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:15.259303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c1053d3b-a498-417d-b631-852dcb248086 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:15.298115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1053d3b-a498-417d-b631-852dcb248086 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:15.299167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1053d3b-a498-417d-b631-852dcb248086 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:15.301465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1053d3b-a498-417d-b631-852dcb248086 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:15.302451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1053d3b-a498-417d-b631-852dcb248086 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:15.448575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c1053d3b-a498-417d-b631-852dcb248086 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:15.458988 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c1053d3b-a498-417d-b631-852dcb248086 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1287 microversion: 2.1 time: 0.244001 Jul 28 04:11:15.459904 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3159/5609] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:15 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1287 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:16.233571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e9cf37d-6db9-46ba-9320-c5dd9951397f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:16.234214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4e9cf37d-6db9-46ba-9320-c5dd9951397f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:16.243065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e9cf37d-6db9-46ba-9320-c5dd9951397f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:16.243791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e9cf37d-6db9-46ba-9320-c5dd9951397f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:16.244782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e9cf37d-6db9-46ba-9320-c5dd9951397f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:16.245398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e9cf37d-6db9-46ba-9320-c5dd9951397f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:16.442198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e9cf37d-6db9-46ba-9320-c5dd9951397f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:16.471637 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e9cf37d-6db9-46ba-9320-c5dd9951397f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.244480 Jul 28 04:11:16.473143 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3160/5610] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:16 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:16.483321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d217053-a691-460f-8f21-e32eed2be2a6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:16.489475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d217053-a691-460f-8f21-e32eed2be2a6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:16.507810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d217053-a691-460f-8f21-e32eed2be2a6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:16.511417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d217053-a691-460f-8f21-e32eed2be2a6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:16.519252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d217053-a691-460f-8f21-e32eed2be2a6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:16.519912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d217053-a691-460f-8f21-e32eed2be2a6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:16.906661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7d217053-a691-460f-8f21-e32eed2be2a6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:16.925680 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d217053-a691-460f-8f21-e32eed2be2a6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1329 microversion: 2.1 time: 0.446152 Jul 28 04:11:16.930559 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3161/5611] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:16 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1329 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:17.227062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-947d32f7-e57c-4dbb-9239-8a677f7c83d9 req-19b530da-e762-46e7-9de5-788a4951d458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9044a2af-7cb6-404a-8621-fa4f7f0f094c", "tag": "3867eb2b-71fe-4613-b22b-202882d12c3d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:17.246910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-947d32f7-e57c-4dbb-9239-8a677f7c83d9 req-19b530da-e762-46e7-9de5-788a4951d458 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:17.247478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-947d32f7-e57c-4dbb-9239-8a677f7c83d9 req-19b530da-e762-46e7-9de5-788a4951d458 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:17.273798 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-947d32f7-e57c-4dbb-9239-8a677f7c83d9 req-19b530da-e762-46e7-9de5-788a4951d458 service nova] Creating event network-changed:3867eb2b-71fe-4613-b22b-202882d12c3d for instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c on n-h2-826756-3 Jul 28 04:11:17.285693 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-947d32f7-e57c-4dbb-9239-8a677f7c83d9 req-19b530da-e762-46e7-9de5-788a4951d458 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.353787 Jul 28 04:11:17.286322 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3162/5612] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:17.499073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-77405857-e1d4-48a2-bacc-0a899a4dad4c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:17.499781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-77405857-e1d4-48a2-bacc-0a899a4dad4c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:17.518701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77405857-e1d4-48a2-bacc-0a899a4dad4c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:17.520644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77405857-e1d4-48a2-bacc-0a899a4dad4c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:17.523963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77405857-e1d4-48a2-bacc-0a899a4dad4c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:17.526901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-77405857-e1d4-48a2-bacc-0a899a4dad4c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:17.581466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:17.729063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-77405857-e1d4-48a2-bacc-0a899a4dad4c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:17.747310 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-77405857-e1d4-48a2-bacc-0a899a4dad4c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.252728 Jul 28 04:11:17.753827 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3163/5613] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:17 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:17.954867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-71ade7df-f7fb-4b44-8099-d4966e6240f6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:17.955745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-71ade7df-f7fb-4b44-8099-d4966e6240f6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:17.973275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71ade7df-f7fb-4b44-8099-d4966e6240f6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:17.974380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71ade7df-f7fb-4b44-8099-d4966e6240f6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:17.975541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71ade7df-f7fb-4b44-8099-d4966e6240f6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:17.976461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71ade7df-f7fb-4b44-8099-d4966e6240f6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:18.185156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-71ade7df-f7fb-4b44-8099-d4966e6240f6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:18.194988 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-71ade7df-f7fb-4b44-8099-d4966e6240f6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1329 microversion: 2.1 time: 0.244720 Jul 28 04:11:18.196191 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3164/5614] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:17 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1329 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:18.775840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2c68491-a0d8-474e-aeed-2a29e2365857 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:18.776530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d2c68491-a0d8-474e-aeed-2a29e2365857 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:18.786632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2c68491-a0d8-474e-aeed-2a29e2365857 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:18.787083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2c68491-a0d8-474e-aeed-2a29e2365857 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:18.787881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2c68491-a0d8-474e-aeed-2a29e2365857 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:18.788304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2c68491-a0d8-474e-aeed-2a29e2365857 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:19.265952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d2c68491-a0d8-474e-aeed-2a29e2365857 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:19.280607 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d2c68491-a0d8-474e-aeed-2a29e2365857 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.509254 Jul 28 04:11:19.282022 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3165/5615] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:18 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:19.288704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44b804eb-0d37-4b4d-86c0-05c969db9877 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:19.289643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-44b804eb-0d37-4b4d-86c0-05c969db9877 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:19.296817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44b804eb-0d37-4b4d-86c0-05c969db9877 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:19.299324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44b804eb-0d37-4b4d-86c0-05c969db9877 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:19.300575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44b804eb-0d37-4b4d-86c0-05c969db9877 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:19.302875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44b804eb-0d37-4b4d-86c0-05c969db9877 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:19.500329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44b804eb-0d37-4b4d-86c0-05c969db9877 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:19.537219 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-44b804eb-0d37-4b4d-86c0-05c969db9877 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1329 microversion: 2.1 time: 0.253212 Jul 28 04:11:19.538392 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3166/5616] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:19 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1329 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:20.302985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c18ffc9d-bc17-42c8-a15a-ef2156647eff tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:20.303669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c18ffc9d-bc17-42c8-a15a-ef2156647eff tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:20.330080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c18ffc9d-bc17-42c8-a15a-ef2156647eff tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:20.330633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c18ffc9d-bc17-42c8-a15a-ef2156647eff tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:20.331534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c18ffc9d-bc17-42c8-a15a-ef2156647eff tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:20.350150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c18ffc9d-bc17-42c8-a15a-ef2156647eff tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:20.686615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c18ffc9d-bc17-42c8-a15a-ef2156647eff tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:20.697150 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c18ffc9d-bc17-42c8-a15a-ef2156647eff tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.398292 Jul 28 04:11:20.704986 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3167/5617] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:20 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:20.711588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2bbbc9d0-1ba7-418b-87f6-951e37d7b9cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:20.718281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2bbbc9d0-1ba7-418b-87f6-951e37d7b9cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:20.736217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2bbbc9d0-1ba7-418b-87f6-951e37d7b9cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:20.738628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2bbbc9d0-1ba7-418b-87f6-951e37d7b9cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:20.742701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2bbbc9d0-1ba7-418b-87f6-951e37d7b9cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:20.744276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2bbbc9d0-1ba7-418b-87f6-951e37d7b9cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:21.001037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2bbbc9d0-1ba7-418b-87f6-951e37d7b9cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:21.010894 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2bbbc9d0-1ba7-418b-87f6-951e37d7b9cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1329 microversion: 2.1 time: 0.304363 Jul 28 04:11:21.025280 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3168/5618] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:20 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1329 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:21.719323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9ca4ad28-7d44-4cfe-84a5-d55d9ab0efca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:21.720117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9ca4ad28-7d44-4cfe-84a5-d55d9ab0efca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:21.739548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ca4ad28-7d44-4cfe-84a5-d55d9ab0efca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:21.740011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ca4ad28-7d44-4cfe-84a5-d55d9ab0efca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:21.740845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ca4ad28-7d44-4cfe-84a5-d55d9ab0efca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:21.741294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ca4ad28-7d44-4cfe-84a5-d55d9ab0efca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:21.909431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:22.119488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9ca4ad28-7d44-4cfe-84a5-d55d9ab0efca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:22.136221 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9ca4ad28-7d44-4cfe-84a5-d55d9ab0efca tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.420460 Jul 28 04:11:22.139795 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3169/5619] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:21 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:22.149730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ad4c42d-84ac-494c-bada-1b4d504a9b3c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:22.155010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ad4c42d-84ac-494c-bada-1b4d504a9b3c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:22.164303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ad4c42d-84ac-494c-bada-1b4d504a9b3c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:22.171481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ad4c42d-84ac-494c-bada-1b4d504a9b3c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:22.172705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ad4c42d-84ac-494c-bada-1b4d504a9b3c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:22.173386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ad4c42d-84ac-494c-bada-1b4d504a9b3c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:22.460682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:22.521305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ad4c42d-84ac-494c-bada-1b4d504a9b3c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:22.534373 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ad4c42d-84ac-494c-bada-1b4d504a9b3c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1329 microversion: 2.1 time: 0.392861 Jul 28 04:11:22.535237 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3170/5620] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:22 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1329 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:22.540311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-122e4a2f-8cd8-4ff2-aa84-c7c525f1ec43 req-1d1c41ce-4486-4e24-a882-b59eefc688dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9044a2af-7cb6-404a-8621-fa4f7f0f094c", "name": "network-vif-plugged", "status": "completed", "tag": "3867eb2b-71fe-4613-b22b-202882d12c3d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:22.550941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-122e4a2f-8cd8-4ff2-aa84-c7c525f1ec43 req-1d1c41ce-4486-4e24-a882-b59eefc688dd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:22.551647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-122e4a2f-8cd8-4ff2-aa84-c7c525f1ec43 req-1d1c41ce-4486-4e24-a882-b59eefc688dd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:22.566744 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-122e4a2f-8cd8-4ff2-aa84-c7c525f1ec43 req-1d1c41ce-4486-4e24-a882-b59eefc688dd service nova] Creating event network-vif-plugged:3867eb2b-71fe-4613-b22b-202882d12c3d for instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c on n-h2-826756-3 Jul 28 04:11:22.574366 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-122e4a2f-8cd8-4ff2-aa84-c7c525f1ec43 req-1d1c41ce-4486-4e24-a882-b59eefc688dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037483 Jul 28 04:11:22.581335 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3171/5621] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:23.160570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-532fe5c4-1a27-4fa9-914f-d7a8228318f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:23.161948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-532fe5c4-1a27-4fa9-914f-d7a8228318f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:23.173479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-532fe5c4-1a27-4fa9-914f-d7a8228318f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:23.173887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-532fe5c4-1a27-4fa9-914f-d7a8228318f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:23.174681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-532fe5c4-1a27-4fa9-914f-d7a8228318f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:23.175128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-532fe5c4-1a27-4fa9-914f-d7a8228318f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:23.377525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-532fe5c4-1a27-4fa9-914f-d7a8228318f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:23.387296 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-532fe5c4-1a27-4fa9-914f-d7a8228318f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.232009 Jul 28 04:11:23.403085 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3172/5622] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:23 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:23.555871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d1a274d-286e-456e-a546-ecd0300006be tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:23.556721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4d1a274d-286e-456e-a546-ecd0300006be tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:23.564517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d1a274d-286e-456e-a546-ecd0300006be tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:23.567321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d1a274d-286e-456e-a546-ecd0300006be tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:23.569395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d1a274d-286e-456e-a546-ecd0300006be tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:23.570444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d1a274d-286e-456e-a546-ecd0300006be tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:23.921535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d1a274d-286e-456e-a546-ecd0300006be tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:23.943709 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d1a274d-286e-456e-a546-ecd0300006be tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1329 microversion: 2.1 time: 0.391659 Jul 28 04:11:23.946248 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3173/5623] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:23 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1329 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:24.417617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7bc0c2f6-5d9c-4640-9289-0daf70d5fec1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:24.417617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7bc0c2f6-5d9c-4640-9289-0daf70d5fec1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:24.432534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bc0c2f6-5d9c-4640-9289-0daf70d5fec1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:24.433452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bc0c2f6-5d9c-4640-9289-0daf70d5fec1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:24.434459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bc0c2f6-5d9c-4640-9289-0daf70d5fec1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:24.435668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bc0c2f6-5d9c-4640-9289-0daf70d5fec1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:24.740938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7bc0c2f6-5d9c-4640-9289-0daf70d5fec1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:24.777704 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7bc0c2f6-5d9c-4640-9289-0daf70d5fec1 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.365068 Jul 28 04:11:24.804752 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3174/5624] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:24 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:24.978234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-732e9493-9de4-4cbc-bd79-d1e6cd361db4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:24.982104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-732e9493-9de4-4cbc-bd79-d1e6cd361db4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:24.999469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-732e9493-9de4-4cbc-bd79-d1e6cd361db4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:25.000802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-732e9493-9de4-4cbc-bd79-d1e6cd361db4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:25.003565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-732e9493-9de4-4cbc-bd79-d1e6cd361db4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:25.004678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-732e9493-9de4-4cbc-bd79-d1e6cd361db4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:25.300057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-732e9493-9de4-4cbc-bd79-d1e6cd361db4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:25.311442 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-732e9493-9de4-4cbc-bd79-d1e6cd361db4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1509 microversion: 2.1 time: 0.340729 Jul 28 04:11:25.313411 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3175/5625] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:24 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1509 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:25.381852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0b9e099e-1ae2-4175-97d4-9fc800b74193 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:25.382484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0b9e099e-1ae2-4175-97d4-9fc800b74193 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:25.398027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b9e099e-1ae2-4175-97d4-9fc800b74193 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:25.398388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b9e099e-1ae2-4175-97d4-9fc800b74193 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:25.399362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b9e099e-1ae2-4175-97d4-9fc800b74193 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:25.399963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b9e099e-1ae2-4175-97d4-9fc800b74193 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:25.873585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0b9e099e-1ae2-4175-97d4-9fc800b74193 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:25.893400 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0b9e099e-1ae2-4175-97d4-9fc800b74193 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1509 microversion: 2.1 time: 0.542728 Jul 28 04:11:25.893997 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3176/5626] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:25 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1509 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:25.899230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e1caaf01-30c6-459d-a655-97916706c98d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:25.901120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e1caaf01-30c6-459d-a655-97916706c98d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:25.917559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1caaf01-30c6-459d-a655-97916706c98d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:25.918648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1caaf01-30c6-459d-a655-97916706c98d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:25.921803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1caaf01-30c6-459d-a655-97916706c98d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:25.926838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1caaf01-30c6-459d-a655-97916706c98d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:26.198385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e1caaf01-30c6-459d-a655-97916706c98d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:26.213093 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e1caaf01-30c6-459d-a655-97916706c98d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.317735 Jul 28 04:11:26.219014 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3177/5627] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:25 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:26.227527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2db09476-e39f-4ce3-bce6-3abf6f9b19aa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:26.232506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2db09476-e39f-4ce3-bce6-3abf6f9b19aa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:26.246625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2db09476-e39f-4ce3-bce6-3abf6f9b19aa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:26.249203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2db09476-e39f-4ce3-bce6-3abf6f9b19aa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:26.250290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2db09476-e39f-4ce3-bce6-3abf6f9b19aa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:26.252190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2db09476-e39f-4ce3-bce6-3abf6f9b19aa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:26.349449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2db09476-e39f-4ce3-bce6-3abf6f9b19aa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:11:26.570336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:26.626327 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2db09476-e39f-4ce3-bce6-3abf6f9b19aa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 204 len: 0 microversion: 2.1 time: 0.405276 Jul 28 04:11:26.627262 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3178/5628] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:11:26 2022] DELETE /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:11:26.644169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6a7fb2d3-d11e-4fbe-b8fa-7f19cc8e17ba tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:26.647046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6a7fb2d3-d11e-4fbe-b8fa-7f19cc8e17ba tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:26.665752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a7fb2d3-d11e-4fbe-b8fa-7f19cc8e17ba tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:26.666572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a7fb2d3-d11e-4fbe-b8fa-7f19cc8e17ba tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:26.673018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a7fb2d3-d11e-4fbe-b8fa-7f19cc8e17ba tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:26.673991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a7fb2d3-d11e-4fbe-b8fa-7f19cc8e17ba tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:26.685511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:27.259621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6a7fb2d3-d11e-4fbe-b8fa-7f19cc8e17ba tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:27.272325 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6a7fb2d3-d11e-4fbe-b8fa-7f19cc8e17ba tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1515 microversion: 2.1 time: 0.639935 Jul 28 04:11:27.287234 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3179/5629] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:26 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1515 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:27.292629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2fbf896b-f424-4c5d-aa16-c66b0f3ae9cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:27.293672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2fbf896b-f424-4c5d-aa16-c66b0f3ae9cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:27.302813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2fbf896b-f424-4c5d-aa16-c66b0f3ae9cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:27.304928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2fbf896b-f424-4c5d-aa16-c66b0f3ae9cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:27.306821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2fbf896b-f424-4c5d-aa16-c66b0f3ae9cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:27.313642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2fbf896b-f424-4c5d-aa16-c66b0f3ae9cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:27.961302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2fbf896b-f424-4c5d-aa16-c66b0f3ae9cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:28.003374 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2fbf896b-f424-4c5d-aa16-c66b0f3ae9cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.709244 Jul 28 04:11:28.014956 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3180/5630] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:27 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:28.297023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5a86c6ac-2f7e-491b-af96-ae58ab76f3f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:28.297700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5a86c6ac-2f7e-491b-af96-ae58ab76f3f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:28.322637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a86c6ac-2f7e-491b-af96-ae58ab76f3f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:28.327430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a86c6ac-2f7e-491b-af96-ae58ab76f3f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:28.328760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a86c6ac-2f7e-491b-af96-ae58ab76f3f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:28.331264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a86c6ac-2f7e-491b-af96-ae58ab76f3f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:29.012050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5a86c6ac-2f7e-491b-af96-ae58ab76f3f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:29.032915 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5a86c6ac-2f7e-491b-af96-ae58ab76f3f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1515 microversion: 2.1 time: 0.734990 Jul 28 04:11:29.054815 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3181/5631] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:28 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1515 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:29.085775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8440ecb2-aed1-4560-ab41-9b43fa2af6d7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:29.085775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8440ecb2-aed1-4560-ab41-9b43fa2af6d7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:29.105351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8440ecb2-aed1-4560-ab41-9b43fa2af6d7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:29.106655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8440ecb2-aed1-4560-ab41-9b43fa2af6d7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:29.109333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8440ecb2-aed1-4560-ab41-9b43fa2af6d7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:29.119437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8440ecb2-aed1-4560-ab41-9b43fa2af6d7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:29.562504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8440ecb2-aed1-4560-ab41-9b43fa2af6d7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:29.573738 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8440ecb2-aed1-4560-ab41-9b43fa2af6d7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.509095 Jul 28 04:11:29.574263 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3182/5632] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:29 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:30.055362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c3a70643-f17c-4efd-b017-e3df80c113eb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:30.056337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c3a70643-f17c-4efd-b017-e3df80c113eb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:30.063052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3a70643-f17c-4efd-b017-e3df80c113eb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:30.073087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3a70643-f17c-4efd-b017-e3df80c113eb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:30.074194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3a70643-f17c-4efd-b017-e3df80c113eb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:30.074796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3a70643-f17c-4efd-b017-e3df80c113eb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:30.262307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c3a70643-f17c-4efd-b017-e3df80c113eb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:30.273614 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c3a70643-f17c-4efd-b017-e3df80c113eb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1473 microversion: 2.1 time: 0.222168 Jul 28 04:11:30.291979 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3183/5633] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:30 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1473 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:30.600690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-02ff3f45-60ac-46a8-bdcd-798394176a70 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:30.606106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-02ff3f45-60ac-46a8-bdcd-798394176a70 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:30.618962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02ff3f45-60ac-46a8-bdcd-798394176a70 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:30.619965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02ff3f45-60ac-46a8-bdcd-798394176a70 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:30.621277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02ff3f45-60ac-46a8-bdcd-798394176a70 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:30.623473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02ff3f45-60ac-46a8-bdcd-798394176a70 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:31.072740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-02ff3f45-60ac-46a8-bdcd-798394176a70 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:31.097870 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-02ff3f45-60ac-46a8-bdcd-798394176a70 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.505237 Jul 28 04:11:31.098851 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3184/5634] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:30 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:31.113983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1de8892f-9d99-4173-8170-8d68888b6830 req-d070e0fc-512e-4eed-8a8a-a99f88eca8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9044a2af-7cb6-404a-8621-fa4f7f0f094c", "name": "network-vif-deleted", "tag": "3867eb2b-71fe-4613-b22b-202882d12c3d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:31.134781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1de8892f-9d99-4173-8170-8d68888b6830 req-d070e0fc-512e-4eed-8a8a-a99f88eca8a9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:31.136640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1de8892f-9d99-4173-8170-8d68888b6830 req-d070e0fc-512e-4eed-8a8a-a99f88eca8a9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:31.160580 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1de8892f-9d99-4173-8170-8d68888b6830 req-d070e0fc-512e-4eed-8a8a-a99f88eca8a9 service nova] Creating event network-vif-deleted:3867eb2b-71fe-4613-b22b-202882d12c3d for instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c on n-h2-826756-3 Jul 28 04:11:31.178814 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1de8892f-9d99-4173-8170-8d68888b6830 req-d070e0fc-512e-4eed-8a8a-a99f88eca8a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077939 Jul 28 04:11:31.180024 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3185/5635] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:31.299862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f2e9d67-efd9-40fe-a3a0-2c9ccaf657ca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:31.300817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f2e9d67-efd9-40fe-a3a0-2c9ccaf657ca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:31.311719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f2e9d67-efd9-40fe-a3a0-2c9ccaf657ca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:31.317175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f2e9d67-efd9-40fe-a3a0-2c9ccaf657ca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:31.318306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f2e9d67-efd9-40fe-a3a0-2c9ccaf657ca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:31.318962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f2e9d67-efd9-40fe-a3a0-2c9ccaf657ca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:31.394276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f2e9d67-efd9-40fe-a3a0-2c9ccaf657ca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:31.395128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f2e9d67-efd9-40fe-a3a0-2c9ccaf657ca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:31.395808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-5f2e9d67-efd9-40fe-a3a0-2c9ccaf657ca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lazy-loading 'fault' on Instance uuid 9044a2af-7cb6-404a-8621-fa4f7f0f094c {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:11:31.510491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f2e9d67-efd9-40fe-a3a0-2c9ccaf657ca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:31.525329 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f2e9d67-efd9-40fe-a3a0-2c9ccaf657ca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 200 len: 1319 microversion: 2.1 time: 0.229277 Jul 28 04:11:31.526884 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3186/5636] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:31 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:32.125870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-55aeda64-de59-42ae-9c0d-c3153a32db80 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:32.126972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-55aeda64-de59-42ae-9c0d-c3153a32db80 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:32.138027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55aeda64-de59-42ae-9c0d-c3153a32db80 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:32.139146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55aeda64-de59-42ae-9c0d-c3153a32db80 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:32.141094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55aeda64-de59-42ae-9c0d-c3153a32db80 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:32.163064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55aeda64-de59-42ae-9c0d-c3153a32db80 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:32.465710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-55aeda64-de59-42ae-9c0d-c3153a32db80 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:32.474913 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-55aeda64-de59-42ae-9c0d-c3153a32db80 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.354075 Jul 28 04:11:32.475801 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3187/5637] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:32 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:32.547638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4ae4db4-a45f-4552-9831-02e2863522bb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:32.548251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4ae4db4-a45f-4552-9831-02e2863522bb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:32.557914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4ae4db4-a45f-4552-9831-02e2863522bb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:32.558642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4ae4db4-a45f-4552-9831-02e2863522bb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:32.559589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4ae4db4-a45f-4552-9831-02e2863522bb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:32.566489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4ae4db4-a45f-4552-9831-02e2863522bb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:32.635811 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-a4ae4db4-a45f-4552-9831-02e2863522bb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4ae4db4-a45f-4552-9831-02e2863522bb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c HTTP/1.1 Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9044a2af-7cb6-404a-8621-fa4f7f0f094c'} Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:32.637598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:32.643396 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:32.643396 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:32.643396 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:11:32.643396 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:11:32.643396 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:11:32.643396 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:32.643396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4ae4db4-a45f-4552-9831-02e2863522bb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:11:32.643396 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4ae4db4-a45f-4552-9831-02e2863522bb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 404 len: 111 microversion: 2.1 time: 0.095707 Jul 28 04:11:32.643396 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3188/5638] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:32 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:11:32.657382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f4e150a-9d36-4fcf-878c-13c4724c88fd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '.version_select at 0x7ffa6792f700>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:32.703396 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f4e150a-9d36-4fcf-878c-13c4724c88fd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-key-1955416833" status: 202 len: 0 microversion: 2.1 time: 0.053974 Jul 28 04:11:32.705187 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3189/5639] 10.222.0.48 () {58 vars in 1209 bytes} [Thu Jul 28 04:11:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1955416833 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:11:32.973984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1635353418", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "942500be-05b0-478f-8797-cdf9e19a4ee1"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:33.124047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] validate_networks() for [('942500be-05b0-478f-8797-cdf9e19a4ee1', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:11:34.099129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:11:34.104874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:11:34.106732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:11:34.107775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:11:34.113028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:11:34.135960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:34.140411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:34.141714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:34.142454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:34.189515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:11:34.212405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for user 24e6476d226840c4adc1ea6c54dfd527 and project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:11:34.229127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:11:34.234372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:11:34.317609 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-36f448b0-1042-4855-b03c-4aebf728d0a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.346265 Jul 28 04:11:34.319455 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3190/5640] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:11:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:11:34.334415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aeaa7f60-e5ae-4362-9dbf-f62632e8ead5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:34.335699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aeaa7f60-e5ae-4362-9dbf-f62632e8ead5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:34.347717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aeaa7f60-e5ae-4362-9dbf-f62632e8ead5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:34.348474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aeaa7f60-e5ae-4362-9dbf-f62632e8ead5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:34.350475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aeaa7f60-e5ae-4362-9dbf-f62632e8ead5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:34.351218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aeaa7f60-e5ae-4362-9dbf-f62632e8ead5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:34.822847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aeaa7f60-e5ae-4362-9dbf-f62632e8ead5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:34.838283 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aeaa7f60-e5ae-4362-9dbf-f62632e8ead5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.517023 Jul 28 04:11:34.838889 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3191/5641] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:34 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:34.854006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2efbef07-179a-4282-a6ee-2436a5e0d620 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:34.854643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2efbef07-179a-4282-a6ee-2436a5e0d620 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:35.027766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2efbef07-179a-4282-a6ee-2436a5e0d620 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:35.053747 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2efbef07-179a-4282-a6ee-2436a5e0d620 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1209 microversion: 2.1 time: 0.213687 Jul 28 04:11:35.077037 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3192/5642] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:34 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1209 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:35.860871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-009fb497-4bd3-4b32-9bd7-d2241daf4686 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:35.861593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-009fb497-4bd3-4b32-9bd7-d2241daf4686 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:35.889863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-009fb497-4bd3-4b32-9bd7-d2241daf4686 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:35.895158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-009fb497-4bd3-4b32-9bd7-d2241daf4686 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:35.896194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-009fb497-4bd3-4b32-9bd7-d2241daf4686 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:35.897511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-009fb497-4bd3-4b32-9bd7-d2241daf4686 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:36.584444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-009fb497-4bd3-4b32-9bd7-d2241daf4686 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:36.602925 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-009fb497-4bd3-4b32-9bd7-d2241daf4686 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1734 microversion: 2.1 time: 0.747319 Jul 28 04:11:36.604621 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3193/5643] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:35 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1734 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:36.617861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ab88726f-4edd-4256-9c96-b9e1b277d929 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:36.619121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ab88726f-4edd-4256-9c96-b9e1b277d929 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:36.654639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab88726f-4edd-4256-9c96-b9e1b277d929 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:36.655131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab88726f-4edd-4256-9c96-b9e1b277d929 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:36.656018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab88726f-4edd-4256-9c96-b9e1b277d929 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:36.662779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab88726f-4edd-4256-9c96-b9e1b277d929 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:36.993332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ab88726f-4edd-4256-9c96-b9e1b277d929 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:37.017284 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ab88726f-4edd-4256-9c96-b9e1b277d929 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1261 microversion: 2.1 time: 0.411369 Jul 28 04:11:37.034118 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3194/5644] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:36 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1261 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:37.632890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4ef5c063-fcbe-458a-9f8b-b7ae3b296735 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:37.634106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4ef5c063-fcbe-458a-9f8b-b7ae3b296735 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:37.650654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ef5c063-fcbe-458a-9f8b-b7ae3b296735 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:37.652625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ef5c063-fcbe-458a-9f8b-b7ae3b296735 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:37.658844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ef5c063-fcbe-458a-9f8b-b7ae3b296735 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:37.660828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ef5c063-fcbe-458a-9f8b-b7ae3b296735 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:38.909028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4ef5c063-fcbe-458a-9f8b-b7ae3b296735 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:38.926273 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4ef5c063-fcbe-458a-9f8b-b7ae3b296735 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1714 microversion: 2.1 time: 1.299361 Jul 28 04:11:38.932616 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3195/5645] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:37 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1714 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:38.984664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c4af0d2c-c1bf-4ab3-8e93-466f4ba616a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:38.992758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c4af0d2c-c1bf-4ab3-8e93-466f4ba616a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:39.005623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4af0d2c-c1bf-4ab3-8e93-466f4ba616a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:39.006390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4af0d2c-c1bf-4ab3-8e93-466f4ba616a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:39.007521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4af0d2c-c1bf-4ab3-8e93-466f4ba616a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:39.008177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4af0d2c-c1bf-4ab3-8e93-466f4ba616a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:39.395160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c4af0d2c-c1bf-4ab3-8e93-466f4ba616a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:39.412180 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c4af0d2c-c1bf-4ab3-8e93-466f4ba616a9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1267 microversion: 2.1 time: 0.468059 Jul 28 04:11:39.413134 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3196/5646] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:38 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1267 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:39.436199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-021aa6e4-0c91-41d6-a4f2-60c77c3f0a28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:39.438100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-021aa6e4-0c91-41d6-a4f2-60c77c3f0a28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:39.451993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-021aa6e4-0c91-41d6-a4f2-60c77c3f0a28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:39.453814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-021aa6e4-0c91-41d6-a4f2-60c77c3f0a28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:39.455237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-021aa6e4-0c91-41d6-a4f2-60c77c3f0a28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:39.455871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-021aa6e4-0c91-41d6-a4f2-60c77c3f0a28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:39.792090 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-021aa6e4-0c91-41d6-a4f2-60c77c3f0a28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] HTTP exception thrown: Cannot 'detach_volume' instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 while it is in vm_state rescued Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-021aa6e4-0c91-41d6-a4f2-60c77c3f0a28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Request method failure captured: Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments/b9034970-95ff-4c94-8ece-c1806890b451 HTTP/1.1 Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4guRH7cRyy41e8TMK6yH4E4vas5YneK3wNd43QNSbwP-vnU4KJvI9xnqarrFpgm_3d_MoR1ZpAdJmMyZ8u5FsxNmotKsW-BhbDNoNezHFEg5JbZI4uqCMDxre0Fl2vlF1EpCS09lknpXT0acA4YXSeuR-688T4pmq6O5npCWbGdqMXs Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/404ce0264e584456bfc6b523e914c408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_404ce0264e584456bfc6b523e914c408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}] Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0083854f0de14631ad15751829e34537 Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: exception: Cannot 'detach_volume' instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 while it is in vm_state rescued Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': '81aa2809-5b04-4192-bba4-580cf02c2aa1', 'id': 'b9034970-95ff-4c94-8ece-c1806890b451'} Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 while it is in vm_state rescued Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:39.796017 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:39.801550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:39.801550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:39.801550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:11:39.801550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:11:39.801550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 while it is in vm_state rescued Jul 28 04:11:39.801550 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:11:39.803628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-021aa6e4-0c91-41d6-a4f2-60c77c3f0a28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Returning 409 to user: Cannot 'detach_volume' instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 while it is in vm_state rescued {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:11:39.806080 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-021aa6e4-0c91-41d6-a4f2-60c77c3f0a28 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "DELETE /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments/b9034970-95ff-4c94-8ece-c1806890b451" status: 409 len: 152 microversion: 2.1 time: 0.391180 Jul 28 04:11:39.809241 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3197/5647] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:11:39 2022] DELETE /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments/b9034970-95ff-4c94-8ece-c1806890b451 => generated 152 bytes in 395 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 04:11:39.826353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-488532e6-4fc4-4745-b2a5-ea046ff0383f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:39.827222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-488532e6-4fc4-4745-b2a5-ea046ff0383f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:39.839007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-488532e6-4fc4-4745-b2a5-ea046ff0383f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:39.839846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-488532e6-4fc4-4745-b2a5-ea046ff0383f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:39.840991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-488532e6-4fc4-4745-b2a5-ea046ff0383f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:39.841667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-488532e6-4fc4-4745-b2a5-ea046ff0383f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:39.943818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:39.978539 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-488532e6-4fc4-4745-b2a5-ea046ff0383f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/action" status: 202 len: 0 microversion: 2.1 time: 0.162573 Jul 28 04:11:39.984126 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3198/5648] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:11:39 2022] POST /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:11:39.992435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-beeab392-cdbc-43d5-93ee-93c9c6a8a9d2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:39.994108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-beeab392-cdbc-43d5-93ee-93c9c6a8a9d2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:40.007458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-beeab392-cdbc-43d5-93ee-93c9c6a8a9d2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:40.027861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-beeab392-cdbc-43d5-93ee-93c9c6a8a9d2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:40.034831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-beeab392-cdbc-43d5-93ee-93c9c6a8a9d2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:40.036729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-beeab392-cdbc-43d5-93ee-93c9c6a8a9d2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:40.580269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-beeab392-cdbc-43d5-93ee-93c9c6a8a9d2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:40.615780 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-beeab392-cdbc-43d5-93ee-93c9c6a8a9d2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1722 microversion: 2.1 time: 0.625031 Jul 28 04:11:40.629588 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3199/5649] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:39 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1722 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:40.652273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b8e7dc0e-f594-4e24-a7fe-526d1ff98cda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:40.654943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b8e7dc0e-f594-4e24-a7fe-526d1ff98cda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:40.682444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8e7dc0e-f594-4e24-a7fe-526d1ff98cda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:40.683096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8e7dc0e-f594-4e24-a7fe-526d1ff98cda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:40.684036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8e7dc0e-f594-4e24-a7fe-526d1ff98cda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:40.687874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8e7dc0e-f594-4e24-a7fe-526d1ff98cda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:41.508883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8e7dc0e-f594-4e24-a7fe-526d1ff98cda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:41.537721 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b8e7dc0e-f594-4e24-a7fe-526d1ff98cda tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1309 microversion: 2.1 time: 0.891820 Jul 28 04:11:41.538428 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3200/5650] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:40 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1309 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:41.641438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6837446f-29f6-4e01-872a-1eeb5aebe621 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:41.642072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6837446f-29f6-4e01-872a-1eeb5aebe621 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:41.659647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6837446f-29f6-4e01-872a-1eeb5aebe621 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:41.660113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6837446f-29f6-4e01-872a-1eeb5aebe621 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:41.660952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6837446f-29f6-4e01-872a-1eeb5aebe621 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:41.661398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6837446f-29f6-4e01-872a-1eeb5aebe621 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:42.424240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6837446f-29f6-4e01-872a-1eeb5aebe621 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:42.440965 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6837446f-29f6-4e01-872a-1eeb5aebe621 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1722 microversion: 2.1 time: 0.803771 Jul 28 04:11:42.442028 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3201/5651] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:41 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1722 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:42.563954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7f0c7101-53d1-4a13-a2c2-442684aea6ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:42.564727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7f0c7101-53d1-4a13-a2c2-442684aea6ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:42.575094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f0c7101-53d1-4a13-a2c2-442684aea6ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:42.575548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f0c7101-53d1-4a13-a2c2-442684aea6ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:42.581102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f0c7101-53d1-4a13-a2c2-442684aea6ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:42.581553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f0c7101-53d1-4a13-a2c2-442684aea6ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:43.120935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7f0c7101-53d1-4a13-a2c2-442684aea6ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:43.148799 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7f0c7101-53d1-4a13-a2c2-442684aea6ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1309 microversion: 2.1 time: 0.580833 Jul 28 04:11:43.164599 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3202/5652] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:42 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1309 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:43.171042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-92582771", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "7e57cc76-7e9c-45ad-9f79-c172e5582f81"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1680788241", "security_groups": []}, "os:scheduler_hints": {"different_host": ["befd4e30-8159-4bd1-9567-141e24513282"]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:43.331508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] validate_networks() for [('7e57cc76-7e9c-45ad-9f79-c172e5582f81', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:11:44.155675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:44.983552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:11:44.984323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:11:44.985023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:11:44.985701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:11:44.986357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:11:45.001001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:45.006347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:45.008606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:45.011947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:45.114470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Getting quotas for project 8940b525df4f43299c0496ba2d40501e. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:11:45.132487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Getting quotas for user 2511fdb208c64d51848647df54c7510e and project 8940b525df4f43299c0496ba2d40501e. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:11:45.192393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:11:45.195810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:11:45.334440 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ab6fe9f9-0e70-453c-af91-fb8afa6bfd33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.164228 Jul 28 04:11:45.336883 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3203/5653] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:11:43 2022] POST /compute/v2.1/servers => generated 361 bytes in 2172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:11:45.366301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9f317ef7-d467-46de-81b0-6916881c47d4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:45.377498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9f317ef7-d467-46de-81b0-6916881c47d4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:45.385811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f317ef7-d467-46de-81b0-6916881c47d4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:45.392441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f317ef7-d467-46de-81b0-6916881c47d4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:45.393782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f317ef7-d467-46de-81b0-6916881c47d4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:45.394648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f317ef7-d467-46de-81b0-6916881c47d4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:45.701802 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:11:45.702220 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:11:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:11:45.963762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9f317ef7-d467-46de-81b0-6916881c47d4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:45.982565 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9f317ef7-d467-46de-81b0-6916881c47d4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1728 microversion: 2.1 time: 0.637840 Jul 28 04:11:46.009029 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3204/5654] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:45 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1728 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:46.028526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dcdfb9aa-2ac1-4e5d-86f6-ce9af9461551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:46.028526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dcdfb9aa-2ac1-4e5d-86f6-ce9af9461551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:46.064854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcdfb9aa-2ac1-4e5d-86f6-ce9af9461551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:46.076894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcdfb9aa-2ac1-4e5d-86f6-ce9af9461551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:46.078026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcdfb9aa-2ac1-4e5d-86f6-ce9af9461551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:46.082324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcdfb9aa-2ac1-4e5d-86f6-ce9af9461551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:46.638694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dcdfb9aa-2ac1-4e5d-86f6-ce9af9461551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:46.648785 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dcdfb9aa-2ac1-4e5d-86f6-ce9af9461551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1309 microversion: 2.1 time: 0.637701 Jul 28 04:11:46.652556 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3205/5655] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:46 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1309 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:46.661326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c70816fb-4fe4-401d-890b-2f1cbb142126 req-440c7451-ffbf-4028-8352-84acc65620aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ef009e0-fb20-466b-a10a-f9aa987ac790", "tag": "c69e84ff-8a42-4ed6-a826-8de81a4f42e9"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:46.704692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c70816fb-4fe4-401d-890b-2f1cbb142126 req-440c7451-ffbf-4028-8352-84acc65620aa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:46.717495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c70816fb-4fe4-401d-890b-2f1cbb142126 req-440c7451-ffbf-4028-8352-84acc65620aa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:46.749955 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c70816fb-4fe4-401d-890b-2f1cbb142126 req-440c7451-ffbf-4028-8352-84acc65620aa service nova] Creating event network-changed:c69e84ff-8a42-4ed6-a826-8de81a4f42e9 for instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 on n-h1-826756-3 Jul 28 04:11:46.795683 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c70816fb-4fe4-401d-890b-2f1cbb142126 req-440c7451-ffbf-4028-8352-84acc65620aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137872 Jul 28 04:11:46.796329 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3206/5656] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:46.838228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-28c79d95-cbc2-4a8b-922f-07fdbdc97187 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:46.838942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-28c79d95-cbc2-4a8b-922f-07fdbdc97187 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:46.866360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28c79d95-cbc2-4a8b-922f-07fdbdc97187 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:46.868936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28c79d95-cbc2-4a8b-922f-07fdbdc97187 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:46.869755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28c79d95-cbc2-4a8b-922f-07fdbdc97187 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:46.870189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28c79d95-cbc2-4a8b-922f-07fdbdc97187 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:47.361078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-28c79d95-cbc2-4a8b-922f-07fdbdc97187 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:47.370962 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-28c79d95-cbc2-4a8b-922f-07fdbdc97187 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1244 microversion: 2.1 time: 0.558808 Jul 28 04:11:47.384380 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3207/5657] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:46 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1244 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:47.405361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a3a0d5c8-94c8-45c4-89bc-1626c42a2632 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:47.405911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a3a0d5c8-94c8-45c4-89bc-1626c42a2632 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:47.435839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:47.449476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3a0d5c8-94c8-45c4-89bc-1626c42a2632 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:47.450347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3a0d5c8-94c8-45c4-89bc-1626c42a2632 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:47.452584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3a0d5c8-94c8-45c4-89bc-1626c42a2632 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:47.453173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3a0d5c8-94c8-45c4-89bc-1626c42a2632 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:47.901625 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a3a0d5c8-94c8-45c4-89bc-1626c42a2632 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.527617 Jul 28 04:11:47.909791 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3208/5658] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 04:11:47 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-interface => generated 284 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:47.929137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e48a650c-cd6f-442e-b123-8bc740fd264f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:47.932576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e48a650c-cd6f-442e-b123-8bc740fd264f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:47.949972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e48a650c-cd6f-442e-b123-8bc740fd264f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:47.951339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e48a650c-cd6f-442e-b123-8bc740fd264f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:47.954221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e48a650c-cd6f-442e-b123-8bc740fd264f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:47.956403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e48a650c-cd6f-442e-b123-8bc740fd264f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:49.137218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e48a650c-cd6f-442e-b123-8bc740fd264f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:49.159660 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e48a650c-cd6f-442e-b123-8bc740fd264f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1309 microversion: 2.1 time: 1.255049 Jul 28 04:11:49.160464 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3209/5659] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:47 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1309 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:49.175021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a9c0268-fb21-422b-882a-109a820ec833 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:49.177335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7a9c0268-fb21-422b-882a-109a820ec833 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:49.194131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a9c0268-fb21-422b-882a-109a820ec833 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:49.195084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a9c0268-fb21-422b-882a-109a820ec833 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:49.197199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a9c0268-fb21-422b-882a-109a820ec833 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:49.198871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a9c0268-fb21-422b-882a-109a820ec833 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:49.663467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a9c0268-fb21-422b-882a-109a820ec833 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:49.682631 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7a9c0268-fb21-422b-882a-109a820ec833 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1298 microversion: 2.1 time: 0.512516 Jul 28 04:11:49.684227 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3210/5660] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:49 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1298 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:50.190872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06cc10b2-966f-4f52-b889-533be4ca5e33 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:50.192970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-06cc10b2-966f-4f52-b889-533be4ca5e33 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:50.208095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06cc10b2-966f-4f52-b889-533be4ca5e33 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:50.209013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06cc10b2-966f-4f52-b889-533be4ca5e33 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:50.209879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06cc10b2-966f-4f52-b889-533be4ca5e33 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:50.210329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06cc10b2-966f-4f52-b889-533be4ca5e33 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:51.753833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-06cc10b2-966f-4f52-b889-533be4ca5e33 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:51.787119 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-06cc10b2-966f-4f52-b889-533be4ca5e33 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1309 microversion: 2.1 time: 1.593418 Jul 28 04:11:51.788666 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3211/5661] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:50 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1309 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:51.805575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d14eb11-1394-4673-a80c-745e61d93703 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:51.806539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4d14eb11-1394-4673-a80c-745e61d93703 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:51.826964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d14eb11-1394-4673-a80c-745e61d93703 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:51.827550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d14eb11-1394-4673-a80c-745e61d93703 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:51.828228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d14eb11-1394-4673-a80c-745e61d93703 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:51.842411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d14eb11-1394-4673-a80c-745e61d93703 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:52.060242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d14eb11-1394-4673-a80c-745e61d93703 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:52.070733 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d14eb11-1394-4673-a80c-745e61d93703 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1298 microversion: 2.1 time: 0.280604 Jul 28 04:11:52.090139 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3212/5662] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:51 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1298 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:52.809756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-310553f5-c807-459a-9660-59ef4537c9e0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:52.811169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-310553f5-c807-459a-9660-59ef4537c9e0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:52.824555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-310553f5-c807-459a-9660-59ef4537c9e0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:52.826823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-310553f5-c807-459a-9660-59ef4537c9e0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:52.827816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-310553f5-c807-459a-9660-59ef4537c9e0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:52.833019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-310553f5-c807-459a-9660-59ef4537c9e0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:53.586193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-310553f5-c807-459a-9660-59ef4537c9e0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:53.595887 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-310553f5-c807-459a-9660-59ef4537c9e0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1309 microversion: 2.1 time: 0.790459 Jul 28 04:11:53.600760 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3213/5663] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:52 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1309 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:53.610858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-96492319-0673-46a1-b98a-80f82747a659 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:53.611921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-96492319-0673-46a1-b98a-80f82747a659 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:53.646411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96492319-0673-46a1-b98a-80f82747a659 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:53.647183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96492319-0673-46a1-b98a-80f82747a659 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:53.648381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96492319-0673-46a1-b98a-80f82747a659 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:53.649015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96492319-0673-46a1-b98a-80f82747a659 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:53.938294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-96492319-0673-46a1-b98a-80f82747a659 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:53.947295 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-96492319-0673-46a1-b98a-80f82747a659 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1298 microversion: 2.1 time: 0.345015 Jul 28 04:11:53.947908 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3214/5664] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:53 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1298 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:53.979839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-fe1cacbd-47ee-4784-96fe-b56f99e6e019 req-c6418456-b72f-4bbe-be1c-7652620cf7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81aa2809-5b04-4192-bba4-580cf02c2aa1", "tag": "303c8daa-a35d-4f2d-ac53-6573c50b1e8b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:54.013330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fe1cacbd-47ee-4784-96fe-b56f99e6e019 req-c6418456-b72f-4bbe-be1c-7652620cf7c5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:54.014291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fe1cacbd-47ee-4784-96fe-b56f99e6e019 req-c6418456-b72f-4bbe-be1c-7652620cf7c5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:54.056130 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-fe1cacbd-47ee-4784-96fe-b56f99e6e019 req-c6418456-b72f-4bbe-be1c-7652620cf7c5 service nova] Creating event network-changed:303c8daa-a35d-4f2d-ac53-6573c50b1e8b for instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 on n-h2-826756-3 Jul 28 04:11:54.073105 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-fe1cacbd-47ee-4784-96fe-b56f99e6e019 req-c6418456-b72f-4bbe-be1c-7652620cf7c5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104041 Jul 28 04:11:54.076326 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3215/5665] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:54.627037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-725765e1-2896-4177-8618-61b056afbe7a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:54.628322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-725765e1-2896-4177-8618-61b056afbe7a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:54.652176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-725765e1-2896-4177-8618-61b056afbe7a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:54.653182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-725765e1-2896-4177-8618-61b056afbe7a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:54.657632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-725765e1-2896-4177-8618-61b056afbe7a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:54.659419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-725765e1-2896-4177-8618-61b056afbe7a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:55.090911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:55.168740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=14 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:55.424102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-725765e1-2896-4177-8618-61b056afbe7a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:55.439682 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-725765e1-2896-4177-8618-61b056afbe7a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1309 microversion: 2.1 time: 0.814728 Jul 28 04:11:55.442180 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3216/5666] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:54 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1309 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:55.457621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7dfa5469-278f-4fbe-a7fe-143d3f4444a5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:55.458671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7dfa5469-278f-4fbe-a7fe-143d3f4444a5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:55.475899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7dfa5469-278f-4fbe-a7fe-143d3f4444a5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:55.476826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7dfa5469-278f-4fbe-a7fe-143d3f4444a5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:55.477874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7dfa5469-278f-4fbe-a7fe-143d3f4444a5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:55.478545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7dfa5469-278f-4fbe-a7fe-143d3f4444a5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:55.519540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:55.764950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7dfa5469-278f-4fbe-a7fe-143d3f4444a5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:55.776983 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7dfa5469-278f-4fbe-a7fe-143d3f4444a5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1298 microversion: 2.1 time: 0.333091 Jul 28 04:11:55.780516 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3217/5667] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:55 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1298 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:56.117016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4c457a7f-5e56-44e8-bb04-4c7a56d261aa req-b14998a4-cf12-4fb3-9e20-15560d72ae40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81aa2809-5b04-4192-bba4-580cf02c2aa1", "tag": "303c8daa-a35d-4f2d-ac53-6573c50b1e8b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:56.135835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4c457a7f-5e56-44e8-bb04-4c7a56d261aa req-b14998a4-cf12-4fb3-9e20-15560d72ae40 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:56.136290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4c457a7f-5e56-44e8-bb04-4c7a56d261aa req-b14998a4-cf12-4fb3-9e20-15560d72ae40 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:56.167053 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4c457a7f-5e56-44e8-bb04-4c7a56d261aa req-b14998a4-cf12-4fb3-9e20-15560d72ae40 service nova] Creating event network-changed:303c8daa-a35d-4f2d-ac53-6573c50b1e8b for instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 on n-h2-826756-3 Jul 28 04:11:56.175071 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4c457a7f-5e56-44e8-bb04-4c7a56d261aa req-b14998a4-cf12-4fb3-9e20-15560d72ae40 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061893 Jul 28 04:11:56.176428 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3218/5668] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:11:56.467655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c23d6d75-c3b4-411f-9a85-e30978d96608 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:56.468718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c23d6d75-c3b4-411f-9a85-e30978d96608 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:56.492134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c23d6d75-c3b4-411f-9a85-e30978d96608 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:56.492834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c23d6d75-c3b4-411f-9a85-e30978d96608 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:56.493825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c23d6d75-c3b4-411f-9a85-e30978d96608 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:56.494435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c23d6d75-c3b4-411f-9a85-e30978d96608 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:56.776034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c23d6d75-c3b4-411f-9a85-e30978d96608 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:56.791002 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c23d6d75-c3b4-411f-9a85-e30978d96608 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1309 microversion: 2.1 time: 0.324806 Jul 28 04:11:56.791734 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3219/5669] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:56 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1309 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:56.805284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a760ce94-cbd6-4d07-b3b5-ee9129e54979 req-1088a7d6-f2be-4277-8ab8-41dc4dd14b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef009e0-fb20-466b-a10a-f9aa987ac790", "name": "network-vif-plugged", "status": "completed", "tag": "c69e84ff-8a42-4ed6-a826-8de81a4f42e9"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:56.834913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a760ce94-cbd6-4d07-b3b5-ee9129e54979 req-1088a7d6-f2be-4277-8ab8-41dc4dd14b4f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:56.837521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a760ce94-cbd6-4d07-b3b5-ee9129e54979 req-1088a7d6-f2be-4277-8ab8-41dc4dd14b4f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:56.866990 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a760ce94-cbd6-4d07-b3b5-ee9129e54979 req-1088a7d6-f2be-4277-8ab8-41dc4dd14b4f service nova] Creating event network-vif-plugged:c69e84ff-8a42-4ed6-a826-8de81a4f42e9 for instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 on n-h1-826756-3 Jul 28 04:11:56.875801 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a760ce94-cbd6-4d07-b3b5-ee9129e54979 req-1088a7d6-f2be-4277-8ab8-41dc4dd14b4f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082746 Jul 28 04:11:56.876440 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3220/5670] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:56.906261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ed3f38e-d4da-4108-89d2-c3426a048764 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:56.906991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ed3f38e-d4da-4108-89d2-c3426a048764 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:56.927716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ed3f38e-d4da-4108-89d2-c3426a048764 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:56.930081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ed3f38e-d4da-4108-89d2-c3426a048764 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:56.934665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ed3f38e-d4da-4108-89d2-c3426a048764 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:56.935540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ed3f38e-d4da-4108-89d2-c3426a048764 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:57.250736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2ed3f38e-d4da-4108-89d2-c3426a048764 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:57.268836 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ed3f38e-d4da-4108-89d2-c3426a048764 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1298 microversion: 2.1 time: 0.386624 Jul 28 04:11:57.269985 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3221/5671] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:56 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1298 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:57.815117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b10602e-e8ea-4c02-8ca2-a09a32d9deef tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:57.816175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5b10602e-e8ea-4c02-8ca2-a09a32d9deef tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:57.833305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b10602e-e8ea-4c02-8ca2-a09a32d9deef tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:57.835688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b10602e-e8ea-4c02-8ca2-a09a32d9deef tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:57.836822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b10602e-e8ea-4c02-8ca2-a09a32d9deef tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:57.838135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b10602e-e8ea-4c02-8ca2-a09a32d9deef tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:58.170988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5b10602e-e8ea-4c02-8ca2-a09a32d9deef tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:58.180921 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5b10602e-e8ea-4c02-8ca2-a09a32d9deef tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1309 microversion: 2.1 time: 0.372178 Jul 28 04:11:58.187085 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3222/5672] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:57 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1309 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:58.213324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-54c0cc7f-abea-4c88-a227-3c55bb561e73 req-53664d44-da2a-40f6-a6c6-2bed5e7686a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fefe9c14-8fbf-48ae-a430-c501adfe01c7", "tag": "e8ea42d1-21cb-49ad-b7bf-ca2f6ac1f9ec"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:58.225485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-54c0cc7f-abea-4c88-a227-3c55bb561e73 req-53664d44-da2a-40f6-a6c6-2bed5e7686a1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:58.226222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-54c0cc7f-abea-4c88-a227-3c55bb561e73 req-53664d44-da2a-40f6-a6c6-2bed5e7686a1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:58.240865 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-54c0cc7f-abea-4c88-a227-3c55bb561e73 req-53664d44-da2a-40f6-a6c6-2bed5e7686a1 service nova] Creating event network-changed:e8ea42d1-21cb-49ad-b7bf-ca2f6ac1f9ec for instance fefe9c14-8fbf-48ae-a430-c501adfe01c7 on n-h1-826756-3 Jul 28 04:11:58.248019 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-54c0cc7f-abea-4c88-a227-3c55bb561e73 req-53664d44-da2a-40f6-a6c6-2bed5e7686a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038592 Jul 28 04:11:58.249346 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3223/5673] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:11:58.293208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-728964d2-9d39-4ba0-bf90-d79a804011fd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:58.296049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-728964d2-9d39-4ba0-bf90-d79a804011fd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:58.312856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-728964d2-9d39-4ba0-bf90-d79a804011fd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:58.313741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-728964d2-9d39-4ba0-bf90-d79a804011fd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:58.317495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-728964d2-9d39-4ba0-bf90-d79a804011fd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:58.318243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-728964d2-9d39-4ba0-bf90-d79a804011fd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:59.146929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-728964d2-9d39-4ba0-bf90-d79a804011fd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:59.159432 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-728964d2-9d39-4ba0-bf90-d79a804011fd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1298 microversion: 2.1 time: 0.867766 Jul 28 04:11:59.188291 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3224/5674] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:58 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1298 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:11:59.233905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-233958d0-9e00-4a9e-95b6-61020214c7ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:59.234701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-233958d0-9e00-4a9e-95b6-61020214c7ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:11:59.256508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-233958d0-9e00-4a9e-95b6-61020214c7ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:59.259637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-233958d0-9e00-4a9e-95b6-61020214c7ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:59.279154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-233958d0-9e00-4a9e-95b6-61020214c7ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:59.279945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-233958d0-9e00-4a9e-95b6-61020214c7ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:59.834205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-233958d0-9e00-4a9e-95b6-61020214c7ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:59.863725 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-233958d0-9e00-4a9e-95b6-61020214c7ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1489 microversion: 2.1 time: 0.643407 Jul 28 04:11:59.866817 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3225/5675] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:11:59 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1489 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:00.191685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-08e41a02-10fc-4779-8bbc-c1d91613b6f5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:00.192502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-08e41a02-10fc-4779-8bbc-c1d91613b6f5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:00.209556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08e41a02-10fc-4779-8bbc-c1d91613b6f5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:00.212127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08e41a02-10fc-4779-8bbc-c1d91613b6f5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:00.213081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08e41a02-10fc-4779-8bbc-c1d91613b6f5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:00.216831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08e41a02-10fc-4779-8bbc-c1d91613b6f5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:00.557351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-08e41a02-10fc-4779-8bbc-c1d91613b6f5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:00.577537 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-08e41a02-10fc-4779-8bbc-c1d91613b6f5 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1298 microversion: 2.1 time: 0.399102 Jul 28 04:12:00.582724 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3226/5676] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:00 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1298 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:00.592378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1635353418", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "942500be-05b0-478f-8797-cdf9e19a4ee1"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:00.682758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] validate_networks() for [('942500be-05b0-478f-8797-cdf9e19a4ee1', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:12:02.046538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:12:02.047776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:12:02.048657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:12:02.049528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:12:02.050194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:12:02.084182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:02.084719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:02.085533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:02.086428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:02.202078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:12:02.225588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for user 24e6476d226840c4adc1ea6c54dfd527 and project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:12:02.280814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:12:02.289594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:12:02.416324 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-202de1d5-6a18-4421-bd91-29f2b95f6aaa tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.832218 Jul 28 04:12:02.423869 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3227/5677] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:12:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:12:02.443669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a4c0212-b100-4f97-8684-d59bac6c5e71 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:02.444991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8a4c0212-b100-4f97-8684-d59bac6c5e71 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:02.459284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a4c0212-b100-4f97-8684-d59bac6c5e71 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:02.464517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a4c0212-b100-4f97-8684-d59bac6c5e71 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:02.465777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a4c0212-b100-4f97-8684-d59bac6c5e71 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:02.467270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a4c0212-b100-4f97-8684-d59bac6c5e71 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:02.715420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a4c0212-b100-4f97-8684-d59bac6c5e71 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:02.732289 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a4c0212-b100-4f97-8684-d59bac6c5e71 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1298 microversion: 2.1 time: 0.298074 Jul 28 04:12:02.735308 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3228/5678] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:02 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1298 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:02.754141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d15e47f0-6187-4908-ae69-7c8c1da90f85 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:02.755170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d15e47f0-6187-4908-ae69-7c8c1da90f85 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:02.875144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d15e47f0-6187-4908-ae69-7c8c1da90f85 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:02.883613 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d15e47f0-6187-4908-ae69-7c8c1da90f85 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1209 microversion: 2.1 time: 0.146991 Jul 28 04:12:02.885894 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3229/5679] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:02 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1209 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:03.757292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cbbdcbd4-90ae-4ccb-8990-5b8e2770458e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:03.757916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cbbdcbd4-90ae-4ccb-8990-5b8e2770458e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:03.772210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbbdcbd4-90ae-4ccb-8990-5b8e2770458e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:03.778013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbbdcbd4-90ae-4ccb-8990-5b8e2770458e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:03.784104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbbdcbd4-90ae-4ccb-8990-5b8e2770458e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:03.784874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbbdcbd4-90ae-4ccb-8990-5b8e2770458e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:04.192672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cbbdcbd4-90ae-4ccb-8990-5b8e2770458e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:04.206747 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cbbdcbd4-90ae-4ccb-8990-5b8e2770458e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1298 microversion: 2.1 time: 0.453481 Jul 28 04:12:04.208473 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3230/5680] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:03 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1298 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:04.220030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a69f9e9-7ad5-4353-8fac-029f619aa997 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:04.221741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7a69f9e9-7ad5-4353-8fac-029f619aa997 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:04.240754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a69f9e9-7ad5-4353-8fac-029f619aa997 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:04.243669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a69f9e9-7ad5-4353-8fac-029f619aa997 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:04.245791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a69f9e9-7ad5-4353-8fac-029f619aa997 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:04.248721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a69f9e9-7ad5-4353-8fac-029f619aa997 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:04.513610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a69f9e9-7ad5-4353-8fac-029f619aa997 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:04.543047 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7a69f9e9-7ad5-4353-8fac-029f619aa997 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1205 microversion: 2.1 time: 0.333090 Jul 28 04:12:04.552078 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3231/5681] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:04 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1205 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:05.227853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c70b940-5ec8-408d-9373-6cafa41ca5d7 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:05.228505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c70b940-5ec8-408d-9373-6cafa41ca5d7 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:05.260642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c70b940-5ec8-408d-9373-6cafa41ca5d7 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:05.261251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c70b940-5ec8-408d-9373-6cafa41ca5d7 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:05.262188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c70b940-5ec8-408d-9373-6cafa41ca5d7 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:05.262824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c70b940-5ec8-408d-9373-6cafa41ca5d7 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:05.559955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c70b940-5ec8-408d-9373-6cafa41ca5d7 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:05.572773 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c70b940-5ec8-408d-9373-6cafa41ca5d7 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1298 microversion: 2.1 time: 0.349384 Jul 28 04:12:05.573375 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3232/5682] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:05 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1298 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:05.611971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0aa3c5d4-8c27-4f2e-9d94-55ad871bad81 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:05.616887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0aa3c5d4-8c27-4f2e-9d94-55ad871bad81 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:05.647490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0aa3c5d4-8c27-4f2e-9d94-55ad871bad81 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:05.647490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0aa3c5d4-8c27-4f2e-9d94-55ad871bad81 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:05.649481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0aa3c5d4-8c27-4f2e-9d94-55ad871bad81 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:05.649481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0aa3c5d4-8c27-4f2e-9d94-55ad871bad81 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:05.842215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0aa3c5d4-8c27-4f2e-9d94-55ad871bad81 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:05.855003 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0aa3c5d4-8c27-4f2e-9d94-55ad871bad81 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1267 microversion: 2.1 time: 0.280491 Jul 28 04:12:05.855908 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3233/5683] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:05 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1267 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:06.602522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8cf5e987-305c-4b74-9a02-06225a239d1a tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:06.603648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8cf5e987-305c-4b74-9a02-06225a239d1a tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:06.624460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cf5e987-305c-4b74-9a02-06225a239d1a tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:06.624926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cf5e987-305c-4b74-9a02-06225a239d1a tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:06.625726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cf5e987-305c-4b74-9a02-06225a239d1a tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:06.633955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cf5e987-305c-4b74-9a02-06225a239d1a tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:06.839500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8cf5e987-305c-4b74-9a02-06225a239d1a tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:06.854790 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8cf5e987-305c-4b74-9a02-06225a239d1a tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1298 microversion: 2.1 time: 0.254309 Jul 28 04:12:06.856862 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3234/5684] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:06 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1298 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:06.880791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb3b09b5-b2ff-4c93-b180-3fd712e04b7c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:06.881748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb3b09b5-b2ff-4c93-b180-3fd712e04b7c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:06.900696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb3b09b5-b2ff-4c93-b180-3fd712e04b7c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:06.901859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb3b09b5-b2ff-4c93-b180-3fd712e04b7c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:06.906448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb3b09b5-b2ff-4c93-b180-3fd712e04b7c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:06.907370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb3b09b5-b2ff-4c93-b180-3fd712e04b7c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:07.129666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fb3b09b5-b2ff-4c93-b180-3fd712e04b7c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:07.142389 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fb3b09b5-b2ff-4c93-b180-3fd712e04b7c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1267 microversion: 2.1 time: 0.266458 Jul 28 04:12:07.145589 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3235/5685] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:06 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1267 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:07.255973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a6bfb861-8589-4a89-885c-96e0c106a1c9 req-6f874e46-edc5-46c8-b224-eaa28d5788d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefe9c14-8fbf-48ae-a430-c501adfe01c7", "name": "network-vif-plugged", "status": "completed", "tag": "e8ea42d1-21cb-49ad-b7bf-ca2f6ac1f9ec"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:07.297077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a6bfb861-8589-4a89-885c-96e0c106a1c9 req-6f874e46-edc5-46c8-b224-eaa28d5788d7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:07.297501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a6bfb861-8589-4a89-885c-96e0c106a1c9 req-6f874e46-edc5-46c8-b224-eaa28d5788d7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:07.324329 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a6bfb861-8589-4a89-885c-96e0c106a1c9 req-6f874e46-edc5-46c8-b224-eaa28d5788d7 service nova] Creating event network-vif-plugged:e8ea42d1-21cb-49ad-b7bf-ca2f6ac1f9ec for instance fefe9c14-8fbf-48ae-a430-c501adfe01c7 on n-h1-826756-3 Jul 28 04:12:07.338646 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a6bfb861-8589-4a89-885c-96e0c106a1c9 req-6f874e46-edc5-46c8-b224-eaa28d5788d7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087469 Jul 28 04:12:07.340610 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3236/5686] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:07.878189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-408179ad-59d0-40a2-a883-9eea8c59b95d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:07.878908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-408179ad-59d0-40a2-a883-9eea8c59b95d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:07.897193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-408179ad-59d0-40a2-a883-9eea8c59b95d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:07.897976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-408179ad-59d0-40a2-a883-9eea8c59b95d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:07.898971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-408179ad-59d0-40a2-a883-9eea8c59b95d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:07.899585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-408179ad-59d0-40a2-a883-9eea8c59b95d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:08.152143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-408179ad-59d0-40a2-a883-9eea8c59b95d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:08.168479 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-408179ad-59d0-40a2-a883-9eea8c59b95d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1298 microversion: 2.1 time: 0.295038 Jul 28 04:12:08.179658 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3237/5687] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:07 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1298 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:08.186401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-832b3810-4205-42a0-86a3-2ab0aa6eb104 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:08.187542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-832b3810-4205-42a0-86a3-2ab0aa6eb104 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:08.217727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-832b3810-4205-42a0-86a3-2ab0aa6eb104 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:08.218737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-832b3810-4205-42a0-86a3-2ab0aa6eb104 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:08.229582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-832b3810-4205-42a0-86a3-2ab0aa6eb104 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:08.230263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-832b3810-4205-42a0-86a3-2ab0aa6eb104 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:08.299685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:08.591505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-832b3810-4205-42a0-86a3-2ab0aa6eb104 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:08.626177 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-832b3810-4205-42a0-86a3-2ab0aa6eb104 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1309 microversion: 2.1 time: 0.424560 Jul 28 04:12:08.627081 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3238/5688] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:08 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:09.217406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e75ee5da-7e0e-4680-a6f6-a86bacf57986 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:09.222284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e75ee5da-7e0e-4680-a6f6-a86bacf57986 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:09.244981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e75ee5da-7e0e-4680-a6f6-a86bacf57986 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:09.245923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e75ee5da-7e0e-4680-a6f6-a86bacf57986 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:09.247620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e75ee5da-7e0e-4680-a6f6-a86bacf57986 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:09.250725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e75ee5da-7e0e-4680-a6f6-a86bacf57986 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:10.362858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e75ee5da-7e0e-4680-a6f6-a86bacf57986 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:10.392666 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e75ee5da-7e0e-4680-a6f6-a86bacf57986 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1471 microversion: 2.1 time: 1.184371 Jul 28 04:12:10.393309 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3239/5689] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:09 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1471 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:10.399887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f3149973-cf52-4710-84a3-732eb82ab14b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:10.401066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f3149973-cf52-4710-84a3-732eb82ab14b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:10.425278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3149973-cf52-4710-84a3-732eb82ab14b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:10.436638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3149973-cf52-4710-84a3-732eb82ab14b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:10.437672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3149973-cf52-4710-84a3-732eb82ab14b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:10.438138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3149973-cf52-4710-84a3-732eb82ab14b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:10.840786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f3149973-cf52-4710-84a3-732eb82ab14b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:10.851814 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f3149973-cf52-4710-84a3-732eb82ab14b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1309 microversion: 2.1 time: 0.457066 Jul 28 04:12:10.852445 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3240/5690] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:10 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1309 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:10.868987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-2cad4f15-c989-46df-abf8-670a70f46c9d req-0a9b1a45-6ffe-4f1d-b6a5-5eeb3c192600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b75d20b-d073-429e-b73e-c8d2be126307", "tag": "ae7395e1-2540-42b7-856a-18240d068283"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:10.892517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2cad4f15-c989-46df-abf8-670a70f46c9d req-0a9b1a45-6ffe-4f1d-b6a5-5eeb3c192600 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:10.893012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2cad4f15-c989-46df-abf8-670a70f46c9d req-0a9b1a45-6ffe-4f1d-b6a5-5eeb3c192600 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:10.922533 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-2cad4f15-c989-46df-abf8-670a70f46c9d req-0a9b1a45-6ffe-4f1d-b6a5-5eeb3c192600 service nova] Creating event network-changed:ae7395e1-2540-42b7-856a-18240d068283 for instance 4b75d20b-d073-429e-b73e-c8d2be126307 on n-h2-826756-3 Jul 28 04:12:10.931830 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-2cad4f15-c989-46df-abf8-670a70f46c9d req-0a9b1a45-6ffe-4f1d-b6a5-5eeb3c192600 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073509 Jul 28 04:12:10.939612 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3241/5691] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:10.955028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d8e12e4-5253-4013-b2f5-d910cb38fcfc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:10.956056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6d8e12e4-5253-4013-b2f5-d910cb38fcfc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:10.978449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d8e12e4-5253-4013-b2f5-d910cb38fcfc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:10.978972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d8e12e4-5253-4013-b2f5-d910cb38fcfc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:10.979995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d8e12e4-5253-4013-b2f5-d910cb38fcfc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:10.980764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d8e12e4-5253-4013-b2f5-d910cb38fcfc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:11.174766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6d8e12e4-5253-4013-b2f5-d910cb38fcfc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:11.189492 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d8e12e4-5253-4013-b2f5-d910cb38fcfc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1471 microversion: 2.1 time: 0.245826 Jul 28 04:12:11.192897 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3242/5692] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:10 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1471 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:11.490481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e3ceb60d-e3b5-45a3-8e85-17a58e569292 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-20498464", "availability_zone": "foo_zone"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:11.529407 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:12:11.529407 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:12:11.530634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.aggregate [None req-e3ceb60d-e3b5-45a3-8e85-17a58e569292 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Generated uuid 2dc913be-cdbb-4166-aa9d-68f5acffd4d4 for aggregate {{(pid=126071) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 28 04:12:11.585832 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e3ceb60d-e3b5-45a3-8e85-17a58e569292 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates" status: 200 len: 207 microversion: 2.1 time: 0.391586 Jul 28 04:12:11.592523 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3243/5693] 10.222.0.48 () {60 vars in 1164 bytes} [Thu Jul 28 04:12:11 2022] POST /compute/v2.1/os-aggregates => generated 207 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:11.606033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d88b27e-ef14-46fb-b710-145b0949d02a tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:11.610440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d88b27e-ef14-46fb-b710-145b0949d02a tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:11.618210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d88b27e-ef14-46fb-b710-145b0949d02a tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:11.618951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d88b27e-ef14-46fb-b710-145b0949d02a tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:11.620108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d88b27e-ef14-46fb-b710-145b0949d02a tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:11.620759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d88b27e-ef14-46fb-b710-145b0949d02a tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:11.775696 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d88b27e-ef14-46fb-b710-145b0949d02a tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1622 microversion: 2.1 time: 0.181772 Jul 28 04:12:11.779942 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3244/5694] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:11 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1622 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:11.801179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d1d6d74-0db0-4f6d-ba92-a1a0da6a6855 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:11.804292 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:12:11.804292 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:12:11.838745 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8d1d6d74-0db0-4f6d-ba92-a1a0da6a6855 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 317 microversion: 2.1 time: 0.057264 Jul 28 04:12:11.839784 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3245/5695] 10.222.0.48 () {60 vars in 1194 bytes} [Thu Jul 28 04:12:11 2022] POST /compute/v2.1/os-aggregates/19/action => generated 317 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:11.856820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eebd78ac-ffc0-4871-97f2-bea6f85af521 tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:11.858184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eebd78ac-ffc0-4871-97f2-bea6f85af521 tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:11.861262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:11.874892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eebd78ac-ffc0-4871-97f2-bea6f85af521 tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:11.875901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eebd78ac-ffc0-4871-97f2-bea6f85af521 tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:11.876974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eebd78ac-ffc0-4871-97f2-bea6f85af521 tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:11.877629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eebd78ac-ffc0-4871-97f2-bea6f85af521 tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:12.151371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:12.301465 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eebd78ac-ffc0-4871-97f2-bea6f85af521 tempest-TestSecurityGroupsBasicOps-39789329 tempest-TestSecurityGroupsBasicOps-39789329-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1912 microversion: 2.1 time: 0.460023 Jul 28 04:12:12.310128 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3246/5696] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:11 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1912 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:12.325343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9302526-19e9-44a8-83f6-60275d52ae24 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:12.351918 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:12:12.351918 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:12:12.361345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9302526-19e9-44a8-83f6-60275d52ae24 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:12.369241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9302526-19e9-44a8-83f6-60275d52ae24 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:12.370181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9302526-19e9-44a8-83f6-60275d52ae24 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:12.376732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9302526-19e9-44a8-83f6-60275d52ae24 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:12.458965 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9302526-19e9-44a8-83f6-60275d52ae24 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] 10.222.0.48 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.142971 Jul 28 04:12:12.460568 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3247/5697] 10.222.0.48 () {58 vars in 1176 bytes} [Thu Jul 28 04:12:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:12.474291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-23e3bf5e-f6be-4e3c-ace4-e09876761eca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:12.476862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-23e3bf5e-f6be-4e3c-ace4-e09876761eca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:12.500780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23e3bf5e-f6be-4e3c-ace4-e09876761eca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:12.503213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23e3bf5e-f6be-4e3c-ace4-e09876761eca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:12.504982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23e3bf5e-f6be-4e3c-ace4-e09876761eca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:12.510084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23e3bf5e-f6be-4e3c-ace4-e09876761eca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:12.748102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-23e3bf5e-f6be-4e3c-ace4-e09876761eca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:12.759085 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-23e3bf5e-f6be-4e3c-ace4-e09876761eca tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1309 microversion: 2.1 time: 0.296722 Jul 28 04:12:12.773603 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3248/5698] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:12 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1309 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:12.782133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c1012be3-36a2-481e-93d8-975339fc9b74 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:12.784383 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:12:12.784383 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:12:12.792203 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c1012be3-36a2-481e-93d8-975339fc9b74 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates" status: 200 len: 296 microversion: 2.1 time: 0.016960 Jul 28 04:12:12.794493 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3249/5699] 10.222.0.48 () {58 vars in 1143 bytes} [Thu Jul 28 04:12:12 2022] GET /compute/v2.1/os-aggregates => generated 296 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:12.806638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-08a8cbf3-e0e4-4329-9d34-a328e234c95b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:12.807483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-08a8cbf3-e0e4-4329-9d34-a328e234c95b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:12.821936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08a8cbf3-e0e4-4329-9d34-a328e234c95b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:12.822387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08a8cbf3-e0e4-4329-9d34-a328e234c95b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:12.823194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08a8cbf3-e0e4-4329-9d34-a328e234c95b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:12.830166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08a8cbf3-e0e4-4329-9d34-a328e234c95b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:12.872683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-08a8cbf3-e0e4-4329-9d34-a328e234c95b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:12:12.885285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:13.102675 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-08a8cbf3-e0e4-4329-9d34-a328e234c95b tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 204 len: 0 microversion: 2.1 time: 0.306355 Jul 28 04:12:13.104520 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3250/5700] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:12:12 2022] DELETE /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:12:13.110539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-be862e60-0265-4ce1-bf75-763c1b809921 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-826756-3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:13.121830 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:12:13.121830 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:12:13.145710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be862e60-0265-4ce1-bf75-763c1b809921 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:13.146217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be862e60-0265-4ce1-bf75-763c1b809921 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:13.934444 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-be862e60-0265-4ce1-bf75-763c1b809921 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 308 microversion: 2.1 time: 0.828419 Jul 28 04:12:13.936154 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3251/5701] 10.222.0.48 () {60 vars in 1194 bytes} [Thu Jul 28 04:12:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 308 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:13.948610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0c0a442-43ce-4f8d-a1b6-c26a179d358f tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:13.950275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e0c0a442-43ce-4f8d-a1b6-c26a179d358f tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:13.962619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0c0a442-43ce-4f8d-a1b6-c26a179d358f tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:13.963603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0c0a442-43ce-4f8d-a1b6-c26a179d358f tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:13.965011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0c0a442-43ce-4f8d-a1b6-c26a179d358f tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:13.965750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0c0a442-43ce-4f8d-a1b6-c26a179d358f tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:14.238684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e0c0a442-43ce-4f8d-a1b6-c26a179d358f tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:14.251707 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e0c0a442-43ce-4f8d-a1b6-c26a179d358f tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1481 microversion: 2.1 time: 0.314231 Jul 28 04:12:14.255486 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3252/5702] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:13 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1481 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:14.270658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c1db9ad-da5d-4ebf-b321-204e67ceb78e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:14.273722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c1db9ad-da5d-4ebf-b321-204e67ceb78e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:14.302421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c1db9ad-da5d-4ebf-b321-204e67ceb78e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:14.305298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c1db9ad-da5d-4ebf-b321-204e67ceb78e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:14.306766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c1db9ad-da5d-4ebf-b321-204e67ceb78e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:14.307407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c1db9ad-da5d-4ebf-b321-204e67ceb78e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:14.637215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1c1db9ad-da5d-4ebf-b321-204e67ceb78e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:14.656151 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c1db9ad-da5d-4ebf-b321-204e67ceb78e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1309 microversion: 2.1 time: 0.399120 Jul 28 04:12:14.658331 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3253/5703] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:14 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1309 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:14.666133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-edba2fba-4351-449b-83cc-c3f7ec12dcac tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:14.675433 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:12:14.675433 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:12:14.700896 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-edba2fba-4351-449b-83cc-c3f7ec12dcac tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 308 microversion: 2.1 time: 0.039130 Jul 28 04:12:14.706238 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3254/5704] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 04:12:14 2022] GET /compute/v2.1/os-aggregates/19 => generated 308 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:14.731887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ddd6b6dc-2420-454e-b90b-a24eb68a99c3 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-2018528105", "availability_zone": "foo_zone"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:14.939039 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:12:14.939039 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:12:15.054062 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ddd6b6dc-2420-454e-b90b-a24eb68a99c3 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] 10.222.0.48 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.336076 Jul 28 04:12:15.054695 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3255/5705] 10.222.0.48 () {60 vars in 1173 bytes} [Thu Jul 28 04:12:14 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:15.066782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-457d55f7-eb2c-4cd5-8024-7adb644fa097 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:15.071291 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:12:15.071291 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:12:15.128364 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-457d55f7-eb2c-4cd5-8024-7adb644fa097 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.065382 Jul 28 04:12:15.130326 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3256/5706] 10.222.0.48 () {60 vars in 1194 bytes} [Thu Jul 28 04:12:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:12:15.141512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-adfac93c-2184-476f-a50f-eae2e08a98d0 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:15.142612 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:12:15.142612 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:12:15.161295 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-adfac93c-2184-476f-a50f-eae2e08a98d0 tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] 10.222.0.48 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.023618 Jul 28 04:12:15.163506 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3257/5707] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 28 04:12:15 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:15.175194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d4ccd5a-9979-4409-9536-83eaf0c1438c tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-826756-3"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:15.178257 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:12:15.178257 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:12:15.196767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d4ccd5a-9979-4409-9536-83eaf0c1438c tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:15.207454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d4ccd5a-9979-4409-9536-83eaf0c1438c tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:15.448834 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d4ccd5a-9979-4409-9536-83eaf0c1438c tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] 10.222.0.48 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.277391 Jul 28 04:12:15.466969 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3258/5708] 10.222.0.48 () {60 vars in 1194 bytes} [Thu Jul 28 04:12:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:12:15.494101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-23db9a42-c8b0-41ae-9df3-344b716a794e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:15.521594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-23db9a42-c8b0-41ae-9df3-344b716a794e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:15.563650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23db9a42-c8b0-41ae-9df3-344b716a794e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:15.572746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23db9a42-c8b0-41ae-9df3-344b716a794e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:15.574152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23db9a42-c8b0-41ae-9df3-344b716a794e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:15.574865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23db9a42-c8b0-41ae-9df3-344b716a794e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:15.723194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-23db9a42-c8b0-41ae-9df3-344b716a794e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:15.740998 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-23db9a42-c8b0-41ae-9df3-344b716a794e tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 200 len: 1477 microversion: 2.1 time: 0.251072 Jul 28 04:12:15.742192 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3259/5709] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:15 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 1477 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:15.747812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-77b5d7d9-69bc-4708-b8ea-7318fd04c61d tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:15.748684 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:12:15.748684 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:12:15.786922 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-77b5d7d9-69bc-4708-b8ea-7318fd04c61d tempest-TestAggregatesBasicOps-2134353421 tempest-TestAggregatesBasicOps-2134353421-project-admin] 10.222.0.48 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.043426 Jul 28 04:12:15.800835 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3260/5710] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Jul 28 04:12:15 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 28 04:12:15.810618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-fa71ad26-689d-4099-a682-f9f74a4aca65 req-b62c832a-6e65-450e-b557-c7194ccf1e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fefe9c14-8fbf-48ae-a430-c501adfe01c7", "name": "network-vif-deleted", "tag": "e8ea42d1-21cb-49ad-b7bf-ca2f6ac1f9ec"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:15.831236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fa71ad26-689d-4099-a682-f9f74a4aca65 req-b62c832a-6e65-450e-b557-c7194ccf1e20 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:15.832069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fa71ad26-689d-4099-a682-f9f74a4aca65 req-b62c832a-6e65-450e-b557-c7194ccf1e20 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:15.848142 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-fa71ad26-689d-4099-a682-f9f74a4aca65 req-b62c832a-6e65-450e-b557-c7194ccf1e20 service nova] Creating event network-vif-deleted:e8ea42d1-21cb-49ad-b7bf-ca2f6ac1f9ec for instance fefe9c14-8fbf-48ae-a430-c501adfe01c7 on n-h1-826756-3 Jul 28 04:12:15.859444 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-fa71ad26-689d-4099-a682-f9f74a4aca65 req-b62c832a-6e65-450e-b557-c7194ccf1e20 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053217 Jul 28 04:12:15.864088 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3261/5711] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:15.873627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ef37d19f-4b19-416b-a739-0bf89f684b84 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:15.874567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ef37d19f-4b19-416b-a739-0bf89f684b84 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:15.886421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef37d19f-4b19-416b-a739-0bf89f684b84 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:15.887076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef37d19f-4b19-416b-a739-0bf89f684b84 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:15.892142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef37d19f-4b19-416b-a739-0bf89f684b84 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:15.893135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef37d19f-4b19-416b-a739-0bf89f684b84 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:16.405061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ef37d19f-4b19-416b-a739-0bf89f684b84 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:16.420891 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ef37d19f-4b19-416b-a739-0bf89f684b84 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1309 microversion: 2.1 time: 0.554474 Jul 28 04:12:16.421602 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3262/5712] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:15 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1309 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:16.714022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-26e31d87-e845-44b6-b7b8-b5c02046ef43 req-04b09542-05c2-4b0a-8a45-aeec0128ea43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b75d20b-d073-429e-b73e-c8d2be126307", "name": "network-vif-plugged", "status": "completed", "tag": "ae7395e1-2540-42b7-856a-18240d068283"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:16.735099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-26e31d87-e845-44b6-b7b8-b5c02046ef43 req-04b09542-05c2-4b0a-8a45-aeec0128ea43 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:16.737969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-26e31d87-e845-44b6-b7b8-b5c02046ef43 req-04b09542-05c2-4b0a-8a45-aeec0128ea43 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:16.758316 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-26e31d87-e845-44b6-b7b8-b5c02046ef43 req-04b09542-05c2-4b0a-8a45-aeec0128ea43 service nova] Creating event network-vif-plugged:ae7395e1-2540-42b7-856a-18240d068283 for instance 4b75d20b-d073-429e-b73e-c8d2be126307 on n-h2-826756-3 Jul 28 04:12:16.765583 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-26e31d87-e845-44b6-b7b8-b5c02046ef43 req-04b09542-05c2-4b0a-8a45-aeec0128ea43 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055740 Jul 28 04:12:16.766589 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3263/5713] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:12:16.772463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fbcff63d-7c33-421c-8eed-126969e4fc33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:16.773514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fbcff63d-7c33-421c-8eed-126969e4fc33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: fefe9c14-8fbf-48ae-a430-c501adfe01c7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:16.782986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbcff63d-7c33-421c-8eed-126969e4fc33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:16.783911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbcff63d-7c33-421c-8eed-126969e4fc33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:16.785345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbcff63d-7c33-421c-8eed-126969e4fc33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:16.786006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbcff63d-7c33-421c-8eed-126969e4fc33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:16.816132 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-fbcff63d-7c33-421c-8eed-126969e4fc33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] HTTP exception thrown: Instance fefe9c14-8fbf-48ae-a430-c501adfe01c7 could not be found. Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fbcff63d-7c33-421c-8eed-126969e4fc33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Request method failure captured: Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 HTTP/1.1 Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwLsTvZ-oAkvhLTludmuwzF9bwVK0Ipdr46uPUS2A57WV6PmbyGXc566w51I8EksteMPiVu3kGb_ybxuDQv1k47SnynufCPvJKDN8vUEw8-IhBhIz73NUO5di51Y4T4y3kcVWEmY0HBoK21Ng9ttNEa9EgtU3ffzCRil9LvFWCGoTs Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 8940b525df4f43299c0496ba2d40501e Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1408792187 Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8940b525df4f43299c0496ba2d40501e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8940b525df4f43299c0496ba2d40501e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8940b525df4f43299c0496ba2d40501e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8940b525df4f43299c0496ba2d40501e"}]}] Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1408792187 Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 8940b525df4f43299c0496ba2d40501e Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1408792187 Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestSecurityGroupsBasicOps-1408792187-project Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 2511fdb208c64d51848647df54c7510e Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1408792187-project Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance fefe9c14-8fbf-48ae-a430-c501adfe01c7 could not be found. Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'fefe9c14-8fbf-48ae-a430-c501adfe01c7'} Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fefe9c14-8fbf-48ae-a430-c501adfe01c7 could not be found. Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fefe9c14-8fbf-48ae-a430-c501adfe01c7 could not be found. Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:16.818404 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:16.823443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:16.823443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:16.823443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:16.823443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:12:16.823443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:12:16.823443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fefe9c14-8fbf-48ae-a430-c501adfe01c7 could not be found. Jul 28 04:12:16.823443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:16.825755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fbcff63d-7c33-421c-8eed-126969e4fc33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Returning 404 to user: Instance fefe9c14-8fbf-48ae-a430-c501adfe01c7 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:12:16.827913 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fbcff63d-7c33-421c-8eed-126969e4fc33 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7" status: 404 len: 111 microversion: 2.1 time: 0.059110 Jul 28 04:12:16.830378 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3264/5714] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:16 2022] GET /compute/v2.1/servers/fefe9c14-8fbf-48ae-a430-c501adfe01c7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:12:17.449422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4dfa6a6-b544-4a80-a690-a324a369ffa4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:17.450707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4dfa6a6-b544-4a80-a690-a324a369ffa4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:17.474011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4dfa6a6-b544-4a80-a690-a324a369ffa4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:17.474557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4dfa6a6-b544-4a80-a690-a324a369ffa4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:17.482046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4dfa6a6-b544-4a80-a690-a324a369ffa4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:17.482515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4dfa6a6-b544-4a80-a690-a324a369ffa4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:17.568320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:17.854169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a4dfa6a6-b544-4a80-a690-a324a369ffa4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:17.864685 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4dfa6a6-b544-4a80-a690-a324a369ffa4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1309 microversion: 2.1 time: 0.422766 Jul 28 04:12:17.873818 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3265/5715] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:17 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1309 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:18.914345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6a2bb5e4-5f83-4ca2-aa0b-1ab4dadd2856 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:18.915249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6a2bb5e4-5f83-4ca2-aa0b-1ab4dadd2856 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:18.940575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a2bb5e4-5f83-4ca2-aa0b-1ab4dadd2856 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:18.941350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a2bb5e4-5f83-4ca2-aa0b-1ab4dadd2856 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:18.942509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a2bb5e4-5f83-4ca2-aa0b-1ab4dadd2856 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:18.945042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a2bb5e4-5f83-4ca2-aa0b-1ab4dadd2856 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:19.452018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6a2bb5e4-5f83-4ca2-aa0b-1ab4dadd2856 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:19.474743 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6a2bb5e4-5f83-4ca2-aa0b-1ab4dadd2856 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1309 microversion: 2.1 time: 0.569280 Jul 28 04:12:19.499274 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3266/5716] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:18 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1309 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:20.498659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-acc21dc7-983f-41ba-afd5-ad230c038509 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:20.499404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-acc21dc7-983f-41ba-afd5-ad230c038509 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:20.516541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acc21dc7-983f-41ba-afd5-ad230c038509 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:20.520403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acc21dc7-983f-41ba-afd5-ad230c038509 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:20.522448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acc21dc7-983f-41ba-afd5-ad230c038509 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:20.523004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acc21dc7-983f-41ba-afd5-ad230c038509 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:21.115584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-acc21dc7-983f-41ba-afd5-ad230c038509 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:21.144436 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-acc21dc7-983f-41ba-afd5-ad230c038509 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1490 microversion: 2.1 time: 0.639438 Jul 28 04:12:21.146470 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3267/5717] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:20 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1490 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:21.178927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47a7d962-11a0-471d-b4f0-7d37278c2801 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:21.199151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-47a7d962-11a0-471d-b4f0-7d37278c2801 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:21.209613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47a7d962-11a0-471d-b4f0-7d37278c2801 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:21.213893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47a7d962-11a0-471d-b4f0-7d37278c2801 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:21.215155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47a7d962-11a0-471d-b4f0-7d37278c2801 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:21.215719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47a7d962-11a0-471d-b4f0-7d37278c2801 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:22.392274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:22.415880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-47a7d962-11a0-471d-b4f0-7d37278c2801 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:22.432736 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-47a7d962-11a0-471d-b4f0-7d37278c2801 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1489 microversion: 2.1 time: 1.256295 Jul 28 04:12:22.434157 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3268/5718] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:21 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1489 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:22.461052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d842a6f8-71f1-47d3-95fd-47241edfa9a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:22.461671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d842a6f8-71f1-47d3-95fd-47241edfa9a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:22.475304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d842a6f8-71f1-47d3-95fd-47241edfa9a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:22.475855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d842a6f8-71f1-47d3-95fd-47241edfa9a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:22.476908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d842a6f8-71f1-47d3-95fd-47241edfa9a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:22.477482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d842a6f8-71f1-47d3-95fd-47241edfa9a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:22.794116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d842a6f8-71f1-47d3-95fd-47241edfa9a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:22.806155 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d842a6f8-71f1-47d3-95fd-47241edfa9a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1490 microversion: 2.1 time: 0.349290 Jul 28 04:12:22.808717 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3269/5719] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:22 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1490 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:22.854949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-115df105-5ff9-446d-82ee-5a11b248666a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:22.858484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-115df105-5ff9-446d-82ee-5a11b248666a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:22.906907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-115df105-5ff9-446d-82ee-5a11b248666a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:22.911450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-115df105-5ff9-446d-82ee-5a11b248666a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:22.911450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-115df105-5ff9-446d-82ee-5a11b248666a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:22.911450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-115df105-5ff9-446d-82ee-5a11b248666a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:23.031190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-115df105-5ff9-446d-82ee-5a11b248666a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:12:23.296373 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-115df105-5ff9-446d-82ee-5a11b248666a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 204 len: 0 microversion: 2.1 time: 0.460570 Jul 28 04:12:23.299213 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3270/5720] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:12:22 2022] DELETE /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:12:23.309656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-456780d9-f269-4785-b970-9eabb8269f79 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:23.310680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-456780d9-f269-4785-b970-9eabb8269f79 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:23.319634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-456780d9-f269-4785-b970-9eabb8269f79 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:23.320619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-456780d9-f269-4785-b970-9eabb8269f79 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:23.321977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-456780d9-f269-4785-b970-9eabb8269f79 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:23.322849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-456780d9-f269-4785-b970-9eabb8269f79 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:23.512333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-456780d9-f269-4785-b970-9eabb8269f79 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lazy-loading 'services' on Instance uuid 81aa2809-5b04-4192-bba4-580cf02c2aa1 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:12:23.835267 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-456780d9-f269-4785-b970-9eabb8269f79 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "DELETE /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments/b9034970-95ff-4c94-8ece-c1806890b451" status: 202 len: 0 microversion: 2.1 time: 0.532930 Jul 28 04:12:23.835903 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3271/5721] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:12:23 2022] DELETE /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments/b9034970-95ff-4c94-8ece-c1806890b451 => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:12:23.851640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ece7c25f-9ae3-475e-92e8-05c5440795ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:23.852775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ece7c25f-9ae3-475e-92e8-05c5440795ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:23.869524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ece7c25f-9ae3-475e-92e8-05c5440795ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:23.871177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ece7c25f-9ae3-475e-92e8-05c5440795ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:23.875235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ece7c25f-9ae3-475e-92e8-05c5440795ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:23.876218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ece7c25f-9ae3-475e-92e8-05c5440795ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:24.788621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ece7c25f-9ae3-475e-92e8-05c5440795ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:24.798401 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ece7c25f-9ae3-475e-92e8-05c5440795ea tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1496 microversion: 2.1 time: 0.957589 Jul 28 04:12:24.800802 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3272/5722] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:23 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1496 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:24.807831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a89b774-0163-4611-9265-865f199d0631 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:24.815350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7a89b774-0163-4611-9265-865f199d0631 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:24.830270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:24.836063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a89b774-0163-4611-9265-865f199d0631 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:24.838024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a89b774-0163-4611-9265-865f199d0631 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:24.841908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a89b774-0163-4611-9265-865f199d0631 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:24.842653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a89b774-0163-4611-9265-865f199d0631 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:24.924810 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7a89b774-0163-4611-9265-865f199d0631 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120801 Jul 28 04:12:24.930169 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3273/5723] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:12:24 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:25.830975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-58e410fd-5643-4403-8c7f-7da0205d7c88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:25.832592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-58e410fd-5643-4403-8c7f-7da0205d7c88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:25.841963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58e410fd-5643-4403-8c7f-7da0205d7c88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:25.842418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58e410fd-5643-4403-8c7f-7da0205d7c88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:25.843246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58e410fd-5643-4403-8c7f-7da0205d7c88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:25.843688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58e410fd-5643-4403-8c7f-7da0205d7c88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:26.486302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-58e410fd-5643-4403-8c7f-7da0205d7c88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:26.510721 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-58e410fd-5643-4403-8c7f-7da0205d7c88 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1496 microversion: 2.1 time: 0.684270 Jul 28 04:12:26.511404 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3274/5724] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:25 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1496 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:26.528790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-12211ac3-46b5-4e43-be86-25726101f93e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:26.532436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-12211ac3-46b5-4e43-be86-25726101f93e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:26.549359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12211ac3-46b5-4e43-be86-25726101f93e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:26.553108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12211ac3-46b5-4e43-be86-25726101f93e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:26.556392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12211ac3-46b5-4e43-be86-25726101f93e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:26.561218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12211ac3-46b5-4e43-be86-25726101f93e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:26.640611 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-12211ac3-46b5-4e43-be86-25726101f93e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127925 Jul 28 04:12:26.642082 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3275/5725] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:12:26 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:26.900231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-edc9dbfc-0786-41a9-80bd-382e1c8ddbdb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:26.901948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-edc9dbfc-0786-41a9-80bd-382e1c8ddbdb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:26.914548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edc9dbfc-0786-41a9-80bd-382e1c8ddbdb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:26.915265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edc9dbfc-0786-41a9-80bd-382e1c8ddbdb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:26.918517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edc9dbfc-0786-41a9-80bd-382e1c8ddbdb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:26.919131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edc9dbfc-0786-41a9-80bd-382e1c8ddbdb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:26.997559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-edc9dbfc-0786-41a9-80bd-382e1c8ddbdb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:12:27.303765 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-edc9dbfc-0786-41a9-80bd-382e1c8ddbdb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "DELETE /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 204 len: 0 microversion: 2.1 time: 0.407256 Jul 28 04:12:27.305067 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3276/5726] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:12:26 2022] DELETE /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:12:27.326977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-fb71457b-5576-4453-8d96-0847fc2de7c5 req-b5b0ef99-1537-4f1b-9dd0-7f5099cdf8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "befd4e30-8159-4bd1-9567-141e24513282", "tag": "93bb52e4-eb60-4508-a0d2-fbd60ad3cd6c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:27.379760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fb71457b-5576-4453-8d96-0847fc2de7c5 req-b5b0ef99-1537-4f1b-9dd0-7f5099cdf8b5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:27.380812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fb71457b-5576-4453-8d96-0847fc2de7c5 req-b5b0ef99-1537-4f1b-9dd0-7f5099cdf8b5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:27.421843 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-fb71457b-5576-4453-8d96-0847fc2de7c5 req-b5b0ef99-1537-4f1b-9dd0-7f5099cdf8b5 service nova] Creating event network-changed:93bb52e4-eb60-4508-a0d2-fbd60ad3cd6c for instance befd4e30-8159-4bd1-9567-141e24513282 on n-h2-826756-3 Jul 28 04:12:27.429174 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-fb71457b-5576-4453-8d96-0847fc2de7c5 req-b5b0ef99-1537-4f1b-9dd0-7f5099cdf8b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122396 Jul 28 04:12:27.430058 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3277/5727] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:27.446475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb2688e2-1f5d-4dcc-a37c-5b67f24e2fcc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:27.447488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb2688e2-1f5d-4dcc-a37c-5b67f24e2fcc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:27.456521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb2688e2-1f5d-4dcc-a37c-5b67f24e2fcc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:27.457528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb2688e2-1f5d-4dcc-a37c-5b67f24e2fcc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:27.458934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb2688e2-1f5d-4dcc-a37c-5b67f24e2fcc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:27.460847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb2688e2-1f5d-4dcc-a37c-5b67f24e2fcc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:27.992875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb2688e2-1f5d-4dcc-a37c-5b67f24e2fcc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:28.014484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:28.017634 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb2688e2-1f5d-4dcc-a37c-5b67f24e2fcc tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1767 microversion: 2.1 time: 0.579054 Jul 28 04:12:28.018610 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3278/5728] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:27 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1767 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:28.025293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2f710a6-ff90-4722-86fa-71b7e4dd86a3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:28.025922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d2f710a6-ff90-4722-86fa-71b7e4dd86a3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:28.033635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2f710a6-ff90-4722-86fa-71b7e4dd86a3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:28.034106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2f710a6-ff90-4722-86fa-71b7e4dd86a3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:28.034915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2f710a6-ff90-4722-86fa-71b7e4dd86a3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:28.035352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2f710a6-ff90-4722-86fa-71b7e4dd86a3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:28.100003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2f710a6-ff90-4722-86fa-71b7e4dd86a3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:28.100996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2f710a6-ff90-4722-86fa-71b7e4dd86a3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:28.101672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-d2f710a6-ff90-4722-86fa-71b7e4dd86a3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lazy-loading 'fault' on Instance uuid 4b75d20b-d073-429e-b73e-c8d2be126307 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:12:28.242551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d2f710a6-ff90-4722-86fa-71b7e4dd86a3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:28.274054 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d2f710a6-ff90-4722-86fa-71b7e4dd86a3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1299 microversion: 2.1 time: 0.254255 Jul 28 04:12:28.274992 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3279/5729] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:28 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1299 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:28.307045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cce33aa8-e36d-4e69-aa51-c2cc4fd9b384 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:28.314078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cce33aa8-e36d-4e69-aa51-c2cc4fd9b384 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:28.346075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cce33aa8-e36d-4e69-aa51-c2cc4fd9b384 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:28.347991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cce33aa8-e36d-4e69-aa51-c2cc4fd9b384 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:28.358349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cce33aa8-e36d-4e69-aa51-c2cc4fd9b384 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:28.361182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cce33aa8-e36d-4e69-aa51-c2cc4fd9b384 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:28.458446 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cce33aa8-e36d-4e69-aa51-c2cc4fd9b384 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182054 Jul 28 04:12:28.468480 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3280/5730] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:12:28 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:29.039324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d0fb2c7d-56e6-4c7a-9a5e-ba83502c796d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:29.040748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d0fb2c7d-56e6-4c7a-9a5e-ba83502c796d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:29.065454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0fb2c7d-56e6-4c7a-9a5e-ba83502c796d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:29.070372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0fb2c7d-56e6-4c7a-9a5e-ba83502c796d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:29.082205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0fb2c7d-56e6-4c7a-9a5e-ba83502c796d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:29.083436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0fb2c7d-56e6-4c7a-9a5e-ba83502c796d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:29.397974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d0fb2c7d-56e6-4c7a-9a5e-ba83502c796d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:29.417687 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d0fb2c7d-56e6-4c7a-9a5e-ba83502c796d tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1767 microversion: 2.1 time: 0.382317 Jul 28 04:12:29.445800 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3281/5731] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:29 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1767 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:29.460380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aeb425d6-ea35-4594-98bd-b331ad97ee4a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:29.467046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aeb425d6-ea35-4594-98bd-b331ad97ee4a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:29.480182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aeb425d6-ea35-4594-98bd-b331ad97ee4a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:29.481240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aeb425d6-ea35-4594-98bd-b331ad97ee4a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:29.483024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aeb425d6-ea35-4594-98bd-b331ad97ee4a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:29.484207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aeb425d6-ea35-4594-98bd-b331ad97ee4a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:29.630391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aeb425d6-ea35-4594-98bd-b331ad97ee4a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:29.630833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aeb425d6-ea35-4594-98bd-b331ad97ee4a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:29.631290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-aeb425d6-ea35-4594-98bd-b331ad97ee4a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lazy-loading 'fault' on Instance uuid 4b75d20b-d073-429e-b73e-c8d2be126307 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:12:29.740640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aeb425d6-ea35-4594-98bd-b331ad97ee4a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:29.754373 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aeb425d6-ea35-4594-98bd-b331ad97ee4a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 200 len: 1299 microversion: 2.1 time: 0.307182 Jul 28 04:12:29.754996 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3282/5732] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:29 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 1299 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:29.763795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-03ffa9a6-240e-4c92-89bb-711aee1d5248 req-a66247cc-aab1-4899-9bd2-d18b972b9d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b75d20b-d073-429e-b73e-c8d2be126307", "name": "network-vif-deleted", "tag": "ae7395e1-2540-42b7-856a-18240d068283"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:29.791413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-03ffa9a6-240e-4c92-89bb-711aee1d5248 req-a66247cc-aab1-4899-9bd2-d18b972b9d82 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:29.792085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-03ffa9a6-240e-4c92-89bb-711aee1d5248 req-a66247cc-aab1-4899-9bd2-d18b972b9d82 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:29.826612 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-03ffa9a6-240e-4c92-89bb-711aee1d5248 req-a66247cc-aab1-4899-9bd2-d18b972b9d82 service nova] Creating event network-vif-deleted:ae7395e1-2540-42b7-856a-18240d068283 for instance 4b75d20b-d073-429e-b73e-c8d2be126307 on n-h2-826756-3 Jul 28 04:12:29.835092 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-03ffa9a6-240e-4c92-89bb-711aee1d5248 req-a66247cc-aab1-4899-9bd2-d18b972b9d82 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078750 Jul 28 04:12:29.835702 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3283/5733] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:29.850238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6adbdebd-f0be-4608-be63-9addd47e5d60 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:29.858789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6adbdebd-f0be-4608-be63-9addd47e5d60 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:29.877900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6adbdebd-f0be-4608-be63-9addd47e5d60 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:29.885113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6adbdebd-f0be-4608-be63-9addd47e5d60 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:29.888266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6adbdebd-f0be-4608-be63-9addd47e5d60 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:29.890615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6adbdebd-f0be-4608-be63-9addd47e5d60 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:29.936888 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6adbdebd-f0be-4608-be63-9addd47e5d60 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097194 Jul 28 04:12:29.938118 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3284/5734] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:12:29 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:30.440708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1d3d3898-1008-42b5-932f-255e9e4014d2 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:30.441418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1d3d3898-1008-42b5-932f-255e9e4014d2 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:30.456260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d3d3898-1008-42b5-932f-255e9e4014d2 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:30.457783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d3d3898-1008-42b5-932f-255e9e4014d2 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:30.460708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d3d3898-1008-42b5-932f-255e9e4014d2 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:30.461960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d3d3898-1008-42b5-932f-255e9e4014d2 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:30.771256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1d3d3898-1008-42b5-932f-255e9e4014d2 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:30.781180 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1d3d3898-1008-42b5-932f-255e9e4014d2 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1767 microversion: 2.1 time: 0.345432 Jul 28 04:12:30.782326 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3285/5735] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:30 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1767 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:30.787181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70df9210-fad0-44d2-9bd4-e476e9f0f9dc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:30.787980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-70df9210-fad0-44d2-9bd4-e476e9f0f9dc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:30.795300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70df9210-fad0-44d2-9bd4-e476e9f0f9dc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:30.796166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70df9210-fad0-44d2-9bd4-e476e9f0f9dc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:30.797297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70df9210-fad0-44d2-9bd4-e476e9f0f9dc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:30.797890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70df9210-fad0-44d2-9bd4-e476e9f0f9dc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:30.822508 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-70df9210-fad0-44d2-9bd4-e476e9f0f9dc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70df9210-fad0-44d2-9bd4-e476e9f0f9dc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 HTTP/1.1 Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '4b75d20b-d073-429e-b73e-c8d2be126307'} Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:30.825226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:30.831606 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:30.831606 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:30.831606 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:12:30.831606 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:12:30.831606 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:12:30.831606 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:30.834050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70df9210-fad0-44d2-9bd4-e476e9f0f9dc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:12:30.835153 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-70df9210-fad0-44d2-9bd4-e476e9f0f9dc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 404 len: 111 microversion: 2.1 time: 0.051734 Jul 28 04:12:30.836238 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3286/5736] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:30 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:12:30.844608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2683e73d-a385-41f7-a24a-2386b676c481 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:30.845398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2683e73d-a385-41f7-a24a-2386b676c481 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:30.854616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2683e73d-a385-41f7-a24a-2386b676c481 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:30.855489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2683e73d-a385-41f7-a24a-2386b676c481 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:30.856519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2683e73d-a385-41f7-a24a-2386b676c481 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:30.857452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2683e73d-a385-41f7-a24a-2386b676c481 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:30.898244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2683e73d-a385-41f7-a24a-2386b676c481 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:12:31.135781 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2683e73d-a385-41f7-a24a-2386b676c481 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 204 len: 0 microversion: 2.1 time: 0.294959 Jul 28 04:12:31.137768 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3287/5737] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:12:30 2022] DELETE /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:12:31.144432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bcd36752-c829-43d0-b0c5-0fcca6e8282e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:31.147275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bcd36752-c829-43d0-b0c5-0fcca6e8282e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:31.156875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcd36752-c829-43d0-b0c5-0fcca6e8282e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:31.157332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcd36752-c829-43d0-b0c5-0fcca6e8282e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:31.158125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcd36752-c829-43d0-b0c5-0fcca6e8282e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:31.158965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcd36752-c829-43d0-b0c5-0fcca6e8282e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:31.202691 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bcd36752-c829-43d0-b0c5-0fcca6e8282e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064123 Jul 28 04:12:31.204718 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3288/5738] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:12:31 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:31.211232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f5f2507-6679-46a0-ac15-83ae95134268 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:31.212269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f5f2507-6679-46a0-ac15-83ae95134268 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:31.222005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f5f2507-6679-46a0-ac15-83ae95134268 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:31.222374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f5f2507-6679-46a0-ac15-83ae95134268 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:31.223559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f5f2507-6679-46a0-ac15-83ae95134268 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:31.224314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f5f2507-6679-46a0-ac15-83ae95134268 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:31.519005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f5f2507-6679-46a0-ac15-83ae95134268 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:31.545747 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f5f2507-6679-46a0-ac15-83ae95134268 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1495 microversion: 2.1 time: 0.339829 Jul 28 04:12:31.549878 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3289/5739] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:31 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1495 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:31.810425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-274ba9b4-f973-4029-901e-801be310e428 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:31.811218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-274ba9b4-f973-4029-901e-801be310e428 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:31.823784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-274ba9b4-f973-4029-901e-801be310e428 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:31.826178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-274ba9b4-f973-4029-901e-801be310e428 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:31.829103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-274ba9b4-f973-4029-901e-801be310e428 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:31.830715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-274ba9b4-f973-4029-901e-801be310e428 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:31.951682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-274ba9b4-f973-4029-901e-801be310e428 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2511fdb208c64d51848647df54c7510e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8940b525df4f43299c0496ba2d40501e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:31.964177 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-274ba9b4-f973-4029-901e-801be310e428 tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 200 len: 1531 microversion: 2.1 time: 0.160209 Jul 28 04:12:31.968610 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3290/5740] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:31 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 1531 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:31.982244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-2c2e4365-01a7-43ae-9bab-ebe4ab262053 req-52807751-015b-4b05-ae64-1aa109b56cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "befd4e30-8159-4bd1-9567-141e24513282", "name": "network-vif-deleted", "tag": "93bb52e4-eb60-4508-a0d2-fbd60ad3cd6c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:32.001811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2c2e4365-01a7-43ae-9bab-ebe4ab262053 req-52807751-015b-4b05-ae64-1aa109b56cf7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:32.005493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2c2e4365-01a7-43ae-9bab-ebe4ab262053 req-52807751-015b-4b05-ae64-1aa109b56cf7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:32.033740 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-2c2e4365-01a7-43ae-9bab-ebe4ab262053 req-52807751-015b-4b05-ae64-1aa109b56cf7 service nova] Creating event network-vif-deleted:93bb52e4-eb60-4508-a0d2-fbd60ad3cd6c for instance befd4e30-8159-4bd1-9567-141e24513282 on n-h2-826756-3 Jul 28 04:12:32.046334 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-2c2e4365-01a7-43ae-9bab-ebe4ab262053 req-52807751-015b-4b05-ae64-1aa109b56cf7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074619 Jul 28 04:12:32.051913 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3291/5741] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:32.217964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15a0fece-f332-4dc9-b0a8-2fdb3ddc3c61 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:32.221114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15a0fece-f332-4dc9-b0a8-2fdb3ddc3c61 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:32.241017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15a0fece-f332-4dc9-b0a8-2fdb3ddc3c61 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:32.242548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15a0fece-f332-4dc9-b0a8-2fdb3ddc3c61 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:32.247197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15a0fece-f332-4dc9-b0a8-2fdb3ddc3c61 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:32.248324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15a0fece-f332-4dc9-b0a8-2fdb3ddc3c61 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:32.333879 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15a0fece-f332-4dc9-b0a8-2fdb3ddc3c61 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122265 Jul 28 04:12:32.339734 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3292/5742] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:12:32 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:12:32.570433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-728aa619-b79a-49fd-b093-bd1e0e610c80 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:32.571147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-728aa619-b79a-49fd-b093-bd1e0e610c80 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:32.584222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-728aa619-b79a-49fd-b093-bd1e0e610c80 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:32.584711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-728aa619-b79a-49fd-b093-bd1e0e610c80 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:32.585530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-728aa619-b79a-49fd-b093-bd1e0e610c80 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:32.585974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-728aa619-b79a-49fd-b093-bd1e0e610c80 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:32.792555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-728aa619-b79a-49fd-b093-bd1e0e610c80 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:32.806597 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-728aa619-b79a-49fd-b093-bd1e0e610c80 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1495 microversion: 2.1 time: 0.237665 Jul 28 04:12:32.810044 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3293/5743] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:32 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1495 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:32.989529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2cba79f-f824-41c8-ba49-799f3bfcb8bd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:32.990719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2cba79f-f824-41c8-ba49-799f3bfcb8bd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] [instance: befd4e30-8159-4bd1-9567-141e24513282] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:32.998643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2cba79f-f824-41c8-ba49-799f3bfcb8bd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:32.999362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2cba79f-f824-41c8-ba49-799f3bfcb8bd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:33.000596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2cba79f-f824-41c8-ba49-799f3bfcb8bd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:33.001231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2cba79f-f824-41c8-ba49-799f3bfcb8bd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:33.018084 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-b2cba79f-f824-41c8-ba49-799f3bfcb8bd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] HTTP exception thrown: Instance befd4e30-8159-4bd1-9567-141e24513282 could not be found. Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2cba79f-f824-41c8-ba49-799f3bfcb8bd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Request method failure captured: Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 HTTP/1.1 Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwLsTvZ-oAkvhLTludmuwzF9bwVK0Ipdr46uPUS2A57WV6PmbyGXc566w51I8EksteMPiVu3kGb_ybxuDQv1k47SnynufCPvJKDN8vUEw8-IhBhIz73NUO5di51Y4T4y3kcVWEmY0HBoK21Ng9ttNEa9EgtU3ffzCRil9LvFWCGoTs Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 8940b525df4f43299c0496ba2d40501e Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1408792187 Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8940b525df4f43299c0496ba2d40501e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8940b525df4f43299c0496ba2d40501e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8940b525df4f43299c0496ba2d40501e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8940b525df4f43299c0496ba2d40501e"}]}] Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1408792187 Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 8940b525df4f43299c0496ba2d40501e Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1408792187 Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestSecurityGroupsBasicOps-1408792187-project Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 2511fdb208c64d51848647df54c7510e Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1408792187-project Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance befd4e30-8159-4bd1-9567-141e24513282 could not be found. Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'befd4e30-8159-4bd1-9567-141e24513282'} Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance befd4e30-8159-4bd1-9567-141e24513282 could not be found. Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance befd4e30-8159-4bd1-9567-141e24513282 could not be found. Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:33.021513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:33.027198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:33.027198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:33.027198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:33.027198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:12:33.027198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:12:33.027198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance befd4e30-8159-4bd1-9567-141e24513282 could not be found. Jul 28 04:12:33.027198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:33.030286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2cba79f-f824-41c8-ba49-799f3bfcb8bd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Returning 404 to user: Instance befd4e30-8159-4bd1-9567-141e24513282 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:12:33.030286 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b2cba79f-f824-41c8-ba49-799f3bfcb8bd tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282" status: 404 len: 111 microversion: 2.1 time: 0.045781 Jul 28 04:12:33.035894 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3294/5744] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:32 2022] GET /compute/v2.1/servers/befd4e30-8159-4bd1-9567-141e24513282 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:12:33.346988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80c98147-64d1-46a5-8053-98f0dd71a22e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:33.349903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-80c98147-64d1-46a5-8053-98f0dd71a22e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:33.368884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80c98147-64d1-46a5-8053-98f0dd71a22e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:33.372657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80c98147-64d1-46a5-8053-98f0dd71a22e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:33.386641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80c98147-64d1-46a5-8053-98f0dd71a22e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:33.387464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80c98147-64d1-46a5-8053-98f0dd71a22e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:33.466152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:33.472667 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-80c98147-64d1-46a5-8053-98f0dd71a22e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129841 Jul 28 04:12:33.485306 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3295/5745] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:12:33 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:12:33.839539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d91b2698-32f4-4241-adc3-5e435d194855 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:33.845062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d91b2698-32f4-4241-adc3-5e435d194855 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:33.882573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d91b2698-32f4-4241-adc3-5e435d194855 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:33.883388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d91b2698-32f4-4241-adc3-5e435d194855 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:33.884997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d91b2698-32f4-4241-adc3-5e435d194855 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:33.885703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d91b2698-32f4-4241-adc3-5e435d194855 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:34.103380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d91b2698-32f4-4241-adc3-5e435d194855 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:34.114834 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d91b2698-32f4-4241-adc3-5e435d194855 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 200 len: 1294 microversion: 2.1 time: 0.285590 Jul 28 04:12:34.120827 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3296/5746] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:33 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 1294 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:34.134415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b7080e69-aacc-4ef0-98c4-9e001bfc5e34 req-eb193cb7-1a1c-42eb-b6f8-a2de722dee9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef009e0-fb20-466b-a10a-f9aa987ac790", "name": "network-vif-deleted", "tag": "c69e84ff-8a42-4ed6-a826-8de81a4f42e9"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:34.170351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b7080e69-aacc-4ef0-98c4-9e001bfc5e34 req-eb193cb7-1a1c-42eb-b6f8-a2de722dee9e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:34.170834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b7080e69-aacc-4ef0-98c4-9e001bfc5e34 req-eb193cb7-1a1c-42eb-b6f8-a2de722dee9e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:34.206786 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b7080e69-aacc-4ef0-98c4-9e001bfc5e34 req-eb193cb7-1a1c-42eb-b6f8-a2de722dee9e service nova] Creating event network-vif-deleted:c69e84ff-8a42-4ed6-a826-8de81a4f42e9 for instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 on n-h1-826756-3 Jul 28 04:12:34.220238 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b7080e69-aacc-4ef0-98c4-9e001bfc5e34 req-eb193cb7-1a1c-42eb-b6f8-a2de722dee9e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097186 Jul 28 04:12:34.223810 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3297/5747] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:34.492635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e2af4b00-69fb-4716-81b6-575f2af8709f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:34.501334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e2af4b00-69fb-4716-81b6-575f2af8709f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:34.516843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2af4b00-69fb-4716-81b6-575f2af8709f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:34.517308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2af4b00-69fb-4716-81b6-575f2af8709f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:34.518116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2af4b00-69fb-4716-81b6-575f2af8709f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:34.522439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2af4b00-69fb-4716-81b6-575f2af8709f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:34.597037 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e2af4b00-69fb-4716-81b6-575f2af8709f tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113890 Jul 28 04:12:34.597643 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3298/5748] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:12:34 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:12:34.701268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-56398002-9d2e-46a8-92f8-ac4a3beac437 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:34.704120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-56398002-9d2e-46a8-92f8-ac4a3beac437 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:34.712628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56398002-9d2e-46a8-92f8-ac4a3beac437 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:34.713146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56398002-9d2e-46a8-92f8-ac4a3beac437 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:34.714367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56398002-9d2e-46a8-92f8-ac4a3beac437 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:34.714828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56398002-9d2e-46a8-92f8-ac4a3beac437 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:34.764542 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-56398002-9d2e-46a8-92f8-ac4a3beac437 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] HTTP exception thrown: Cannot 'reboot' instance b3e85786-076b-4d13-bdb2-31d5441af52e while it is in vm_state rescued Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-56398002-9d2e-46a8-92f8-ac4a3beac437 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Request method failure captured: Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e/action HTTP/1.1 Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 28 Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4guRH7cRyy41e8TMK6yH4E4vas5YneK3wNd43QNSbwP-vnU4KJvI9xnqarrFpgm_3d_MoR1ZpAdJmMyZ8u5FsxNmotKsW-BhbDNoNezHFEg5JbZI4uqCMDxre0Fl2vlF1EpCS09lknpXT0acA4YXSeuR-688T4pmq6O5npCWbGdqMXs Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/404ce0264e584456bfc6b523e914c408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_404ce0264e584456bfc6b523e914c408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}] Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0083854f0de14631ad15751829e34537 Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: {"reboot": {"type": "HARD"}} Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: exception: Cannot 'reboot' instance b3e85786-076b-4d13-bdb2-31d5441af52e while it is in vm_state rescued Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'b3e85786-076b-4d13-bdb2-31d5441af52e', 'body': {'reboot': {'type': 'HARD'}}} Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3543, in reboot Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b3e85786-076b-4d13-bdb2-31d5441af52e in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 04:12:34.769022 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 04:12:34.776570 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance b3e85786-076b-4d13-bdb2-31d5441af52e while it is in vm_state rescued Jul 28 04:12:34.776570 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:34.776570 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:34.776570 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:34.776570 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:34.776570 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:34.776570 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:34.776570 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:12:34.776570 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:12:34.776570 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance b3e85786-076b-4d13-bdb2-31d5441af52e while it is in vm_state rescued Jul 28 04:12:34.776570 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:34.779898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-56398002-9d2e-46a8-92f8-ac4a3beac437 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Returning 409 to user: Cannot 'reboot' instance b3e85786-076b-4d13-bdb2-31d5441af52e while it is in vm_state rescued {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:12:34.781698 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-56398002-9d2e-46a8-92f8-ac4a3beac437 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e/action" status: 409 len: 145 microversion: 2.1 time: 0.094286 Jul 28 04:12:34.782963 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3299/5749] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:12:34 2022] POST /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e/action => generated 145 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 04:12:34.794105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17e393f0-7eb4-4d0a-8f64-3fa1314e1e15 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:34.797315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-17e393f0-7eb4-4d0a-8f64-3fa1314e1e15 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:34.805668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17e393f0-7eb4-4d0a-8f64-3fa1314e1e15 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:34.806476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17e393f0-7eb4-4d0a-8f64-3fa1314e1e15 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:34.808199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17e393f0-7eb4-4d0a-8f64-3fa1314e1e15 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:34.808898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17e393f0-7eb4-4d0a-8f64-3fa1314e1e15 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:34.844589 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-17e393f0-7eb4-4d0a-8f64-3fa1314e1e15 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] HTTP exception thrown: Cannot 'rebuild' instance b3e85786-076b-4d13-bdb2-31d5441af52e while it is in vm_state rescued Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17e393f0-7eb4-4d0a-8f64-3fa1314e1e15 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Request method failure captured: Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e/action HTTP/1.1 Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 65 Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4guRH7cRyy41e8TMK6yH4E4vas5YneK3wNd43QNSbwP-vnU4KJvI9xnqarrFpgm_3d_MoR1ZpAdJmMyZ8u5FsxNmotKsW-BhbDNoNezHFEg5JbZI4uqCMDxre0Fl2vlF1EpCS09lknpXT0acA4YXSeuR-688T4pmq6O5npCWbGdqMXs Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/404ce0264e584456bfc6b523e914c408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_404ce0264e584456bfc6b523e914c408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}] Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0083854f0de14631ad15751829e34537 Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: {"rebuild": {"imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220"}} Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: exception: Cannot 'rebuild' instance b3e85786-076b-4d13-bdb2-31d5441af52e while it is in vm_state rescued Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'b3e85786-076b-4d13-bdb2-31d5441af52e', 'body': {'rebuild': {'imageRef': '5d43adf9-af92-4117-9ed9-35547daa1220'}}} Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 276, in inner Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b3e85786-076b-4d13-bdb2-31d5441af52e in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:12:34.848539 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance b3e85786-076b-4d13-bdb2-31d5441af52e while it is in vm_state rescued Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance b3e85786-076b-4d13-bdb2-31d5441af52e while it is in vm_state rescued Jul 28 04:12:34.855107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:34.858480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17e393f0-7eb4-4d0a-8f64-3fa1314e1e15 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Returning 409 to user: Cannot 'rebuild' instance b3e85786-076b-4d13-bdb2-31d5441af52e while it is in vm_state rescued {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:12:34.860115 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-17e393f0-7eb4-4d0a-8f64-3fa1314e1e15 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "POST /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e/action" status: 409 len: 146 microversion: 2.1 time: 0.069952 Jul 28 04:12:34.861478 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3300/5750] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:12:34 2022] POST /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e/action => generated 146 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 28 04:12:34.873888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d3507f6-4276-4e29-8643-cda2de376b2c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:34.875786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d3507f6-4276-4e29-8643-cda2de376b2c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:34.884420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d3507f6-4276-4e29-8643-cda2de376b2c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:34.885258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d3507f6-4276-4e29-8643-cda2de376b2c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:34.886367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d3507f6-4276-4e29-8643-cda2de376b2c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:34.887289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d3507f6-4276-4e29-8643-cda2de376b2c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:34.921688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d3507f6-4276-4e29-8643-cda2de376b2c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:12:35.131654 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d3507f6-4276-4e29-8643-cda2de376b2c tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "DELETE /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 204 len: 0 microversion: 2.1 time: 0.263908 Jul 28 04:12:35.143375 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3301/5751] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:12:34 2022] DELETE /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:12:35.161666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-676c7198-981d-415b-af22-2204b012da1d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:35.162493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-676c7198-981d-415b-af22-2204b012da1d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:35.170144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-676c7198-981d-415b-af22-2204b012da1d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:35.171001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-676c7198-981d-415b-af22-2204b012da1d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:35.172045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-676c7198-981d-415b-af22-2204b012da1d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:35.172985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-676c7198-981d-415b-af22-2204b012da1d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:35.191867 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-676c7198-981d-415b-af22-2204b012da1d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-676c7198-981d-415b-af22-2204b012da1d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 HTTP/1.1 Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '0ef009e0-fb20-466b-a10a-f9aa987ac790'} Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:35.194305 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:35.199175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:35.199175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:35.199175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:12:35.199175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:12:35.199175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:12:35.199175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:35.201285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-676c7198-981d-415b-af22-2204b012da1d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:12:35.202482 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-676c7198-981d-415b-af22-2204b012da1d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 404 len: 111 microversion: 2.1 time: 0.055348 Jul 28 04:12:35.203615 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3302/5752] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:35 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:12:35.208858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a82b29e9-c5ba-4cf4-9126-acebf1faebb3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:35.209741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a82b29e9-c5ba-4cf4-9126-acebf1faebb3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:35.219704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a82b29e9-c5ba-4cf4-9126-acebf1faebb3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:35.229482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a82b29e9-c5ba-4cf4-9126-acebf1faebb3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:35.233696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a82b29e9-c5ba-4cf4-9126-acebf1faebb3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:35.235802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a82b29e9-c5ba-4cf4-9126-acebf1faebb3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:35.680768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a82b29e9-c5ba-4cf4-9126-acebf1faebb3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:35.704160 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a82b29e9-c5ba-4cf4-9126-acebf1faebb3 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1688 microversion: 2.1 time: 0.499218 Jul 28 04:12:35.704990 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3303/5753] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:35 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1688 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:35.721137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-933747116", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "942500be-05b0-478f-8797-cdf9e19a4ee1"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:35.795242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] validate_networks() for [('942500be-05b0-478f-8797-cdf9e19a4ee1', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:12:37.008539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:12:37.009183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:12:37.009755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:12:37.010175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:12:37.010586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:12:37.024083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:37.024570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:37.027166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:37.027892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:37.063271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:12:37.070090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for user 24e6476d226840c4adc1ea6c54dfd527 and project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:12:37.089682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:12:37.092618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:12:37.205867 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4dae278-7de1-44ca-a9f4-fde98427875d tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.498859 Jul 28 04:12:37.212266 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3304/5754] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:12:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:12:37.230479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-703c64a5-330d-48c2-9439-9979a70ee920 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:37.231449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-703c64a5-330d-48c2-9439-9979a70ee920 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:37.240545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:37.274924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-703c64a5-330d-48c2-9439-9979a70ee920 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:37.279457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-703c64a5-330d-48c2-9439-9979a70ee920 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:37.284584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-703c64a5-330d-48c2-9439-9979a70ee920 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:37.285793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-703c64a5-330d-48c2-9439-9979a70ee920 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:37.746199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-703c64a5-330d-48c2-9439-9979a70ee920 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:37.746199 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-703c64a5-330d-48c2-9439-9979a70ee920 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1688 microversion: 2.1 time: 0.521345 Jul 28 04:12:37.747869 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3305/5755] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:37 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1688 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:37.754460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d74019c0-0a5e-4f42-8936-7fa78eb4a4c5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:37.755083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d74019c0-0a5e-4f42-8936-7fa78eb4a4c5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:37.863490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d74019c0-0a5e-4f42-8936-7fa78eb4a4c5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:37.891528 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d74019c0-0a5e-4f42-8936-7fa78eb4a4c5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1208 microversion: 2.1 time: 0.142443 Jul 28 04:12:37.894882 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3306/5756] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:37 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1208 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:38.342809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b6b62191-ed52-4825-b56d-d73598df4b8e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'create', calling method: .version_select at 0x7ffa66f67940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-921342836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWwR7rOHyJqHvirimEl2l+ItIIX+jWALQn1T2eZRU8S1SPP3tadm5hIVD+5bq1dRsoPsar7dScFNumJLEW16Axmw2MbPaekM5gAtiuEAUBTwMOIJ2tllmKTB+1fc5xqFQ=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:38.365572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b6b62191-ed52-4825-b56d-d73598df4b8e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for project 7ea463b2785d46a08c278fa7041654e4. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:12:38.378603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b6b62191-ed52-4825-b56d-d73598df4b8e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for user 63fc192385a7490aacce2d69bfc866ec and project 7ea463b2785d46a08c278fa7041654e4. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:12:38.427766 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b6b62191-ed52-4825-b56d-d73598df4b8e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.531563 Jul 28 04:12:38.430657 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3307/5757] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:12:37 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:38.772974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ec9c7f62-ee16-4d0f-9978-5c84f8bbdcd4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:38.774059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ec9c7f62-ee16-4d0f-9978-5c84f8bbdcd4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:38.788332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec9c7f62-ee16-4d0f-9978-5c84f8bbdcd4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:38.789663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec9c7f62-ee16-4d0f-9978-5c84f8bbdcd4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:38.793068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec9c7f62-ee16-4d0f-9978-5c84f8bbdcd4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:38.794485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec9c7f62-ee16-4d0f-9978-5c84f8bbdcd4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:39.283739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ec9c7f62-ee16-4d0f-9978-5c84f8bbdcd4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:39.295643 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ec9c7f62-ee16-4d0f-9978-5c84f8bbdcd4 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1688 microversion: 2.1 time: 0.527739 Jul 28 04:12:39.296457 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3308/5758] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:38 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1688 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:39.301387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cb6e1997-54f3-4b18-8eee-eee89c217a0b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:39.302212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cb6e1997-54f3-4b18-8eee-eee89c217a0b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:39.310265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb6e1997-54f3-4b18-8eee-eee89c217a0b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:39.310992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb6e1997-54f3-4b18-8eee-eee89c217a0b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:39.311923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb6e1997-54f3-4b18-8eee-eee89c217a0b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:39.312531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb6e1997-54f3-4b18-8eee-eee89c217a0b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:39.407391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cb6e1997-54f3-4b18-8eee-eee89c217a0b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:39.420074 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cb6e1997-54f3-4b18-8eee-eee89c217a0b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1260 microversion: 2.1 time: 0.122284 Jul 28 04:12:39.433827 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3309/5759] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:39 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1260 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:40.155253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80be941e-d40d-450b-9a30-a6b037b1a5eb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] Calling method '.version_select at 0x7ffa66f53550>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:40.194485 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-80be941e-d40d-450b-9a30-a6b037b1a5eb tempest-TestSecurityGroupsBasicOps-1408792187 tempest-TestSecurityGroupsBasicOps-1408792187-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1680788241" status: 202 len: 0 microversion: 2.1 time: 0.045605 Jul 28 04:12:40.194952 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3310/5760] 10.222.0.48 () {58 vars in 1278 bytes} [Thu Jul 28 04:12:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1680788241 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:12:40.326251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4d1d680-cb9e-4b0d-9790-d982cb5ee060 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:40.327159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4d1d680-cb9e-4b0d-9790-d982cb5ee060 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:40.340429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4d1d680-cb9e-4b0d-9790-d982cb5ee060 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:40.342484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4d1d680-cb9e-4b0d-9790-d982cb5ee060 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:40.346484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4d1d680-cb9e-4b0d-9790-d982cb5ee060 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:40.347140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4d1d680-cb9e-4b0d-9790-d982cb5ee060 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:40.795983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a4d1d680-cb9e-4b0d-9790-d982cb5ee060 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:40.809123 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4d1d680-cb9e-4b0d-9790-d982cb5ee060 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1688 microversion: 2.1 time: 0.486502 Jul 28 04:12:40.824393 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3311/5761] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:40 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1688 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:40.829910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-42e57184-31a3-47b5-8b9c-cd46fa50c6f0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:40.830874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-42e57184-31a3-47b5-8b9c-cd46fa50c6f0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:40.838470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42e57184-31a3-47b5-8b9c-cd46fa50c6f0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:40.839363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42e57184-31a3-47b5-8b9c-cd46fa50c6f0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:40.840345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42e57184-31a3-47b5-8b9c-cd46fa50c6f0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:40.840963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42e57184-31a3-47b5-8b9c-cd46fa50c6f0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:40.997123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-42e57184-31a3-47b5-8b9c-cd46fa50c6f0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:41.006728 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-42e57184-31a3-47b5-8b9c-cd46fa50c6f0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1266 microversion: 2.1 time: 0.180956 Jul 28 04:12:41.009827 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3312/5762] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:40 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:41.834280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e8c873d8-d511-4eb3-8107-5ef663fbc8f2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:41.840178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e8c873d8-d511-4eb3-8107-5ef663fbc8f2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:41.862420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c873d8-d511-4eb3-8107-5ef663fbc8f2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:41.864961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c873d8-d511-4eb3-8107-5ef663fbc8f2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:41.868563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c873d8-d511-4eb3-8107-5ef663fbc8f2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:41.869251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c873d8-d511-4eb3-8107-5ef663fbc8f2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:42.028876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e8c873d8-d511-4eb3-8107-5ef663fbc8f2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:42.039194 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e8c873d8-d511-4eb3-8107-5ef663fbc8f2 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1621 microversion: 2.1 time: 0.212016 Jul 28 04:12:42.041582 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3313/5763] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:41 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1621 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:42.064932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d0365c4f-61de-4678-9339-4f29f052e145 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:42.067129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d0365c4f-61de-4678-9339-4f29f052e145 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:42.091258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0365c4f-61de-4678-9339-4f29f052e145 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:42.092099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0365c4f-61de-4678-9339-4f29f052e145 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:42.094241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0365c4f-61de-4678-9339-4f29f052e145 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:42.094919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0365c4f-61de-4678-9339-4f29f052e145 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:42.210880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d0365c4f-61de-4678-9339-4f29f052e145 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:42.227969 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d0365c4f-61de-4678-9339-4f29f052e145 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1266 microversion: 2.1 time: 0.179787 Jul 28 04:12:42.230204 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3314/5764] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:42 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:42.411110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9cd11e2c-ec8d-4388-8f6d-13dba661d51a req-fbdbc566-1ebc-499f-9a31-0eebe1a3c93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81aa2809-5b04-4192-bba4-580cf02c2aa1", "name": "network-vif-deleted", "tag": "303c8daa-a35d-4f2d-ac53-6573c50b1e8b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:42.427801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9cd11e2c-ec8d-4388-8f6d-13dba661d51a req-fbdbc566-1ebc-499f-9a31-0eebe1a3c93f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:42.428782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9cd11e2c-ec8d-4388-8f6d-13dba661d51a req-fbdbc566-1ebc-499f-9a31-0eebe1a3c93f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:42.451237 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9cd11e2c-ec8d-4388-8f6d-13dba661d51a req-fbdbc566-1ebc-499f-9a31-0eebe1a3c93f service nova] Creating event network-vif-deleted:303c8daa-a35d-4f2d-ac53-6573c50b1e8b for instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 on n-h2-826756-3 Jul 28 04:12:42.475954 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9cd11e2c-ec8d-4388-8f6d-13dba661d51a req-fbdbc566-1ebc-499f-9a31-0eebe1a3c93f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069175 Jul 28 04:12:42.480424 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3315/5765] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:43.065804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bf5e071f-322e-4fec-86a3-a10bf2d34bef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:43.066654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bf5e071f-322e-4fec-86a3-a10bf2d34bef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:43.094378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf5e071f-322e-4fec-86a3-a10bf2d34bef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:43.094924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf5e071f-322e-4fec-86a3-a10bf2d34bef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:43.100226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf5e071f-322e-4fec-86a3-a10bf2d34bef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:43.100797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf5e071f-322e-4fec-86a3-a10bf2d34bef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:43.190719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf5e071f-322e-4fec-86a3-a10bf2d34bef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:43.191537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf5e071f-322e-4fec-86a3-a10bf2d34bef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:43.192213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-bf5e071f-322e-4fec-86a3-a10bf2d34bef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lazy-loading 'fault' on Instance uuid 81aa2809-5b04-4192-bba4-580cf02c2aa1 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:12:43.392079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bf5e071f-322e-4fec-86a3-a10bf2d34bef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:43.395941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:43.406975 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bf5e071f-322e-4fec-86a3-a10bf2d34bef tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 200 len: 1334 microversion: 2.1 time: 0.342656 Jul 28 04:12:43.406975 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3316/5766] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:43 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 1334 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:43.421813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e9d242b8-80f6-48ad-9db3-d60cd4319207 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:43.422974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e9d242b8-80f6-48ad-9db3-d60cd4319207 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:43.459727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9d242b8-80f6-48ad-9db3-d60cd4319207 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:43.460299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9d242b8-80f6-48ad-9db3-d60cd4319207 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:43.466947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9d242b8-80f6-48ad-9db3-d60cd4319207 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:43.469239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9d242b8-80f6-48ad-9db3-d60cd4319207 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:44.017878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e9d242b8-80f6-48ad-9db3-d60cd4319207 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:44.027859 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e9d242b8-80f6-48ad-9db3-d60cd4319207 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1308 microversion: 2.1 time: 0.619907 Jul 28 04:12:44.028496 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3317/5767] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:43 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1308 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:44.429000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d465190-f89f-4e9f-b63c-5d8d9efcc7fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:44.429708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6d465190-f89f-4e9f-b63c-5d8d9efcc7fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: 81aa2809-5b04-4192-bba4-580cf02c2aa1] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:44.449038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d465190-f89f-4e9f-b63c-5d8d9efcc7fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:44.449745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d465190-f89f-4e9f-b63c-5d8d9efcc7fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:44.451829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d465190-f89f-4e9f-b63c-5d8d9efcc7fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:44.454615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d465190-f89f-4e9f-b63c-5d8d9efcc7fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:44.490596 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-6d465190-f89f-4e9f-b63c-5d8d9efcc7fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] HTTP exception thrown: Instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 could not be found. Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d465190-f89f-4e9f-b63c-5d8d9efcc7fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Request method failure captured: Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 HTTP/1.1 Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4guRH7cRyy41e8TMK6yH4E4vas5YneK3wNd43QNSbwP-vnU4KJvI9xnqarrFpgm_3d_MoR1ZpAdJmMyZ8u5FsxNmotKsW-BhbDNoNezHFEg5JbZI4uqCMDxre0Fl2vlF1EpCS09lknpXT0acA4YXSeuR-688T4pmq6O5npCWbGdqMXs Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/404ce0264e584456bfc6b523e914c408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_404ce0264e584456bfc6b523e914c408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}] Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0083854f0de14631ad15751829e34537 Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 could not be found. Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '81aa2809-5b04-4192-bba4-580cf02c2aa1'} Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 could not be found. Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 could not be found. Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:44.498680 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:12:44.502886 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:44.502886 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:12:44.502886 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:12:44.502886 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:12:44.502886 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:12:44.502886 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:12:44.502886 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 could not be found. Jul 28 04:12:44.502886 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:12:44.502886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d465190-f89f-4e9f-b63c-5d8d9efcc7fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Returning 404 to user: Instance 81aa2809-5b04-4192-bba4-580cf02c2aa1 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:12:44.502886 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d465190-f89f-4e9f-b63c-5d8d9efcc7fb tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1" status: 404 len: 111 microversion: 2.1 time: 0.076397 Jul 28 04:12:44.504322 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3318/5768] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:44 2022] GET /compute/v2.1/servers/81aa2809-5b04-4192-bba4-580cf02c2aa1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:12:44.513893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-85237a8c-e136-4bfd-b178-94a02c43bd7d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '.version_select at 0x7ffa66ed79d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:44.563871 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-85237a8c-e136-4bfd-b178-94a02c43bd7d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-248800435" status: 202 len: 0 microversion: 2.1 time: 0.058256 Jul 28 04:12:44.567968 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3319/5769] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Jul 28 04:12:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-248800435 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:12:44.574763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0d8666d8-ec40-4aac-80ea-ccf674142dcf req-ed3edd76-79cb-45eb-9794-8871c2359903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e86fd69e-4852-4849-9e26-d0bf41a1668c", "tag": "b479cdf6-a90a-44ac-babb-eae995918419"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:44.601211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0d8666d8-ec40-4aac-80ea-ccf674142dcf req-ed3edd76-79cb-45eb-9794-8871c2359903 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:44.610094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0d8666d8-ec40-4aac-80ea-ccf674142dcf req-ed3edd76-79cb-45eb-9794-8871c2359903 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:44.628774 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0d8666d8-ec40-4aac-80ea-ccf674142dcf req-ed3edd76-79cb-45eb-9794-8871c2359903 service nova] Creating event network-changed:b479cdf6-a90a-44ac-babb-eae995918419 for instance e86fd69e-4852-4849-9e26-d0bf41a1668c on n-h2-826756-3 Jul 28 04:12:44.640607 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0d8666d8-ec40-4aac-80ea-ccf674142dcf req-ed3edd76-79cb-45eb-9794-8871c2359903 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071114 Jul 28 04:12:44.641967 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3320/5770] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:45.068111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0a1604a2-c285-4697-b3d9-eb486c4ab20b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:45.079258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0a1604a2-c285-4697-b3d9-eb486c4ab20b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:45.106711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a1604a2-c285-4697-b3d9-eb486c4ab20b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:45.109143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a1604a2-c285-4697-b3d9-eb486c4ab20b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:45.111679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a1604a2-c285-4697-b3d9-eb486c4ab20b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:45.112602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a1604a2-c285-4697-b3d9-eb486c4ab20b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:45.487157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0a1604a2-c285-4697-b3d9-eb486c4ab20b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:45.500282 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0a1604a2-c285-4697-b3d9-eb486c4ab20b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1308 microversion: 2.1 time: 0.447035 Jul 28 04:12:45.502303 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3321/5771] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:45 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1308 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:46.523906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3ae39ce-9bf1-4f47-90b2-51e300ecf6ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:46.526015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3ae39ce-9bf1-4f47-90b2-51e300ecf6ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:46.541029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3ae39ce-9bf1-4f47-90b2-51e300ecf6ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:46.541836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3ae39ce-9bf1-4f47-90b2-51e300ecf6ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:46.544066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3ae39ce-9bf1-4f47-90b2-51e300ecf6ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:46.545277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3ae39ce-9bf1-4f47-90b2-51e300ecf6ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:46.810802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3ae39ce-9bf1-4f47-90b2-51e300ecf6ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:46.819922 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3ae39ce-9bf1-4f47-90b2-51e300ecf6ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1308 microversion: 2.1 time: 0.300995 Jul 28 04:12:46.825308 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3322/5772] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:46 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1308 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:47.847652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e268ba06-0660-479c-90d2-952c758cf6fc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:47.849295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e268ba06-0660-479c-90d2-952c758cf6fc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:47.858726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:47.865187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e268ba06-0660-479c-90d2-952c758cf6fc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:47.868390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e268ba06-0660-479c-90d2-952c758cf6fc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:47.871342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e268ba06-0660-479c-90d2-952c758cf6fc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:47.872581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e268ba06-0660-479c-90d2-952c758cf6fc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:48.239681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e268ba06-0660-479c-90d2-952c758cf6fc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:48.251136 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e268ba06-0660-479c-90d2-952c758cf6fc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1308 microversion: 2.1 time: 0.408088 Jul 28 04:12:48.253141 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3323/5773] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:47 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1308 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:49.284842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59525795-0749-446c-90cc-cbbd39ec78a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:49.285845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59525795-0749-446c-90cc-cbbd39ec78a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:49.304726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:49.312639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59525795-0749-446c-90cc-cbbd39ec78a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:49.313989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59525795-0749-446c-90cc-cbbd39ec78a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:49.317055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59525795-0749-446c-90cc-cbbd39ec78a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:49.319033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59525795-0749-446c-90cc-cbbd39ec78a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:49.645613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-59525795-0749-446c-90cc-cbbd39ec78a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:49.660089 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59525795-0749-446c-90cc-cbbd39ec78a0 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1308 microversion: 2.1 time: 0.383419 Jul 28 04:12:49.672654 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3324/5774] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:49 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1308 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:50.682754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ea8e5d8-eb71-4d4a-a7ec-14624c0d412c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:50.684950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5ea8e5d8-eb71-4d4a-a7ec-14624c0d412c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:50.702608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ea8e5d8-eb71-4d4a-a7ec-14624c0d412c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:50.707844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ea8e5d8-eb71-4d4a-a7ec-14624c0d412c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:50.708997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ea8e5d8-eb71-4d4a-a7ec-14624c0d412c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:50.715922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ea8e5d8-eb71-4d4a-a7ec-14624c0d412c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:51.091148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ea8e5d8-eb71-4d4a-a7ec-14624c0d412c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:51.102288 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ea8e5d8-eb71-4d4a-a7ec-14624c0d412c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1308 microversion: 2.1 time: 0.423588 Jul 28 04:12:51.109432 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3325/5775] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:50 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:52.406367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-50130843", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "70535657-be8c-4bb9-b99d-05dcc2fdebd4"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:52.494206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] validate_networks() for [('70535657-be8c-4bb9-b99d-05dcc2fdebd4', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:12:53.377933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:12:53.378363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:12:53.378934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:12:53.379243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:12:53.380254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:12:53.402806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:53.403275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:53.405096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:53.405701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:53.430590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Getting quotas for project 01aafd04e21f4453b7833ee95d4937ff. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:12:53.437535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Getting quotas for user 548b20b462c24cdbbd4884a2ece2d6d2 and project 01aafd04e21f4453b7833ee95d4937ff. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:12:53.454210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:12:53.457721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:12:53.529315 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d2502514-31df-4006-90c7-1bfd8dcc3947 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.487385 Jul 28 04:12:53.537037 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3326/5776] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:12:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:12:53.573717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19ccaaa5-5855-4643-a633-64d8ac42becb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:53.576786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-19ccaaa5-5855-4643-a633-64d8ac42becb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:53.593895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19ccaaa5-5855-4643-a633-64d8ac42becb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:53.597390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19ccaaa5-5855-4643-a633-64d8ac42becb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:53.598354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19ccaaa5-5855-4643-a633-64d8ac42becb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:53.601101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19ccaaa5-5855-4643-a633-64d8ac42becb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:53.944091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19ccaaa5-5855-4643-a633-64d8ac42becb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:53.968643 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-19ccaaa5-5855-4643-a633-64d8ac42becb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1308 microversion: 2.1 time: 0.429659 Jul 28 04:12:53.969599 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3327/5777] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:53 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:54.115995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-16695ad5-7649-47d9-8df4-45f2d9f1411c req-2a1e9ebd-2895-4e23-aaf9-cb5bcbb1a2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86fd69e-4852-4849-9e26-d0bf41a1668c", "name": "network-vif-plugged", "status": "completed", "tag": "b479cdf6-a90a-44ac-babb-eae995918419"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:54.144799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-16695ad5-7649-47d9-8df4-45f2d9f1411c req-2a1e9ebd-2895-4e23-aaf9-cb5bcbb1a2f3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:54.146064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-16695ad5-7649-47d9-8df4-45f2d9f1411c req-2a1e9ebd-2895-4e23-aaf9-cb5bcbb1a2f3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:54.162558 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-16695ad5-7649-47d9-8df4-45f2d9f1411c req-2a1e9ebd-2895-4e23-aaf9-cb5bcbb1a2f3 service nova] Creating event network-vif-plugged:b479cdf6-a90a-44ac-babb-eae995918419 for instance e86fd69e-4852-4849-9e26-d0bf41a1668c on n-h2-826756-3 Jul 28 04:12:54.169568 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-16695ad5-7649-47d9-8df4-45f2d9f1411c req-2a1e9ebd-2895-4e23-aaf9-cb5bcbb1a2f3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198705 Jul 28 04:12:54.170610 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3328/5778] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:54.177158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd88584f-d77a-4269-8211-9cd9ef8a262f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:54.177883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd88584f-d77a-4269-8211-9cd9ef8a262f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:54.289941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dd88584f-d77a-4269-8211-9cd9ef8a262f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:54.300464 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd88584f-d77a-4269-8211-9cd9ef8a262f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1213 microversion: 2.1 time: 0.128336 Jul 28 04:12:54.304275 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3329/5779] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:54 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1213 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:54.322038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1001810565", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "74a27010-2ca7-4124-bf6b-514cd1b168ad"}], "key_name": "tempest-TestNetworkAdvancedServerOps-921342836", "security_groups": [{"name": "tempest-secgroup-smoke-763999673"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:54.642984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] validate_networks() for [('74a27010-2ca7-4124-bf6b-514cd1b168ad', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:12:55.721034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:12:55.721667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:12:55.721916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:12:55.722495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:12:55.722911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:12:55.759753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:55.760203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:55.764746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:55.771607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:55.859146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for project 7ea463b2785d46a08c278fa7041654e4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:12:55.888477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for user 63fc192385a7490aacce2d69bfc866ec and project 7ea463b2785d46a08c278fa7041654e4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:12:55.945035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:12:55.957745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:12:56.024519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:56.119530 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b044578a-998f-43fa-afa1-be9e7361e49a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.801183 Jul 28 04:12:56.124250 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3330/5780] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:12:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:12:56.134721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63106c34-3619-4833-8d9c-32e9b1770d26 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:56.139208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63106c34-3619-4833-8d9c-32e9b1770d26 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:56.157053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63106c34-3619-4833-8d9c-32e9b1770d26 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:56.157530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63106c34-3619-4833-8d9c-32e9b1770d26 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:56.158344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63106c34-3619-4833-8d9c-32e9b1770d26 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:56.158787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63106c34-3619-4833-8d9c-32e9b1770d26 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:56.575957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63106c34-3619-4833-8d9c-32e9b1770d26 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:56.598570 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63106c34-3619-4833-8d9c-32e9b1770d26 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1489 microversion: 2.1 time: 0.465299 Jul 28 04:12:56.605448 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3331/5781] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:56 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1489 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:56.632112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3fce81c4-a0a4-4540-90af-7080930c27e0 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:56.638772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3fce81c4-a0a4-4540-90af-7080930c27e0 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:56.672881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fce81c4-a0a4-4540-90af-7080930c27e0 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:56.681754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fce81c4-a0a4-4540-90af-7080930c27e0 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:56.682740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fce81c4-a0a4-4540-90af-7080930c27e0 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:56.688161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fce81c4-a0a4-4540-90af-7080930c27e0 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:56.872422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3fce81c4-a0a4-4540-90af-7080930c27e0 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:56.884891 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3fce81c4-a0a4-4540-90af-7080930c27e0 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1271 microversion: 2.1 time: 0.273086 Jul 28 04:12:56.885820 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3332/5782] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:56 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:56.897907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-359641b0-af20-4825-8b92-671dea311bd8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:56.898784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-359641b0-af20-4825-8b92-671dea311bd8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:57.020986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-359641b0-af20-4825-8b92-671dea311bd8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:57.030339 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-359641b0-af20-4825-8b92-671dea311bd8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1266 microversion: 2.1 time: 0.140795 Jul 28 04:12:57.031139 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3333/5783] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:56 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:57.044872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a32769a9-7253-44d8-9e28-74956e910c32 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:57.050756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a32769a9-7253-44d8-9e28-74956e910c32 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:57.069162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a32769a9-7253-44d8-9e28-74956e910c32 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:57.072741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a32769a9-7253-44d8-9e28-74956e910c32 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:57.073630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a32769a9-7253-44d8-9e28-74956e910c32 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:57.074073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a32769a9-7253-44d8-9e28-74956e910c32 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:57.256863 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a32769a9-7253-44d8-9e28-74956e910c32 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "PUT /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1084 microversion: 2.1 time: 0.219616 Jul 28 04:12:57.257375 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3334/5784] 10.222.0.48 () {60 vars in 1256 bytes} [Thu Jul 28 04:12:57 2022] PUT /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1084 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:57.276782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83e8534b-a563-4277-bdd2-70260177a765 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:57.277433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-83e8534b-a563-4277-bdd2-70260177a765 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:57.304966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83e8534b-a563-4277-bdd2-70260177a765 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:57.305561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83e8534b-a563-4277-bdd2-70260177a765 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:57.306421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83e8534b-a563-4277-bdd2-70260177a765 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:57.306865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83e8534b-a563-4277-bdd2-70260177a765 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:57.680475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-83e8534b-a563-4277-bdd2-70260177a765 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:57.694056 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-83e8534b-a563-4277-bdd2-70260177a765 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1510 microversion: 2.1 time: 0.421213 Jul 28 04:12:57.694870 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3335/5785] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:57 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:57.719642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-42b12321-d1a8-41dd-a3e2-62a8fd4d965e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:57.720588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-42b12321-d1a8-41dd-a3e2-62a8fd4d965e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:57.729977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42b12321-d1a8-41dd-a3e2-62a8fd4d965e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:57.734659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42b12321-d1a8-41dd-a3e2-62a8fd4d965e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:57.735736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42b12321-d1a8-41dd-a3e2-62a8fd4d965e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:57.736343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42b12321-d1a8-41dd-a3e2-62a8fd4d965e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:58.029285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-42b12321-d1a8-41dd-a3e2-62a8fd4d965e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:58.050889 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-42b12321-d1a8-41dd-a3e2-62a8fd4d965e tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1510 microversion: 2.1 time: 0.334504 Jul 28 04:12:58.069160 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3336/5786] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:57 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1510 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:12:58.078930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2809deb9-725d-42e5-8074-d41c7b9ecc01 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:58.079623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2809deb9-725d-42e5-8074-d41c7b9ecc01 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:58.092157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2809deb9-725d-42e5-8074-d41c7b9ecc01 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:58.092568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2809deb9-725d-42e5-8074-d41c7b9ecc01 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:58.093359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2809deb9-725d-42e5-8074-d41c7b9ecc01 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:58.093797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2809deb9-725d-42e5-8074-d41c7b9ecc01 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:58.395681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2809deb9-725d-42e5-8074-d41c7b9ecc01 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:58.408585 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2809deb9-725d-42e5-8074-d41c7b9ecc01 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1313 microversion: 2.1 time: 0.336689 Jul 28 04:12:58.409617 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3337/5787] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:58 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:58.425681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1d6e7df4-21e3-4c9d-aebb-277c6ee66f4e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:58.426313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1d6e7df4-21e3-4c9d-aebb-277c6ee66f4e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:58.457473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d6e7df4-21e3-4c9d-aebb-277c6ee66f4e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:58.457929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d6e7df4-21e3-4c9d-aebb-277c6ee66f4e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:58.470617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d6e7df4-21e3-4c9d-aebb-277c6ee66f4e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:58.471617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d6e7df4-21e3-4c9d-aebb-277c6ee66f4e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:58.751387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1d6e7df4-21e3-4c9d-aebb-277c6ee66f4e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:58.773922 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1d6e7df4-21e3-4c9d-aebb-277c6ee66f4e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1318 microversion: 2.1 time: 0.360912 Jul 28 04:12:58.774622 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3338/5788] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:58 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:58.800875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-58ac8ae3-2912-430a-b534-5cf316b5490a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:58.801539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-58ac8ae3-2912-430a-b534-5cf316b5490a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:58.809303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58ac8ae3-2912-430a-b534-5cf316b5490a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:58.809955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58ac8ae3-2912-430a-b534-5cf316b5490a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:58.811081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58ac8ae3-2912-430a-b534-5cf316b5490a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:58.811657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58ac8ae3-2912-430a-b534-5cf316b5490a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:58.851837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:58.858550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-58ac8ae3-2912-430a-b534-5cf316b5490a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:12:59.109713 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-58ac8ae3-2912-430a-b534-5cf316b5490a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 204 len: 0 microversion: 2.1 time: 0.330077 Jul 28 04:12:59.115911 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3339/5789] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:12:58 2022] DELETE /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:12:59.142682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-09b4fce0-f45c-4e02-9a04-b0be41d9b3fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:59.144107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-09b4fce0-f45c-4e02-9a04-b0be41d9b3fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:59.175667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09b4fce0-f45c-4e02-9a04-b0be41d9b3fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:59.179492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09b4fce0-f45c-4e02-9a04-b0be41d9b3fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:59.183192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09b4fce0-f45c-4e02-9a04-b0be41d9b3fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:59.183345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09b4fce0-f45c-4e02-9a04-b0be41d9b3fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:59.281200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-09b4fce0-f45c-4e02-9a04-b0be41d9b3fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:12:59.472747 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-09b4fce0-f45c-4e02-9a04-b0be41d9b3fc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 204 len: 0 microversion: 2.1 time: 0.352749 Jul 28 04:12:59.474641 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3340/5790] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:12:59 2022] DELETE /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:12:59.483332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-396af3a1-4b48-4cdc-9086-43dd76c68942 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:59.487199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-396af3a1-4b48-4cdc-9086-43dd76c68942 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:59.511421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-396af3a1-4b48-4cdc-9086-43dd76c68942 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:59.514780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-396af3a1-4b48-4cdc-9086-43dd76c68942 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:59.518546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-396af3a1-4b48-4cdc-9086-43dd76c68942 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:59.519359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-396af3a1-4b48-4cdc-9086-43dd76c68942 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:59.817008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-396af3a1-4b48-4cdc-9086-43dd76c68942 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:59.831617 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-396af3a1-4b48-4cdc-9086-43dd76c68942 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1516 microversion: 2.1 time: 0.354451 Jul 28 04:12:59.833103 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3341/5791] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:59 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1516 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:59.839849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4a1f37e-6e85-4a65-a155-d91ab2a55a48 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:59.840714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4a1f37e-6e85-4a65-a155-d91ab2a55a48 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:12:59.856530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4a1f37e-6e85-4a65-a155-d91ab2a55a48 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:59.856530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4a1f37e-6e85-4a65-a155-d91ab2a55a48 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:59.856530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4a1f37e-6e85-4a65-a155-d91ab2a55a48 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:59.864471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4a1f37e-6e85-4a65-a155-d91ab2a55a48 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:00.097956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f4a1f37e-6e85-4a65-a155-d91ab2a55a48 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:00.112383 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4a1f37e-6e85-4a65-a155-d91ab2a55a48 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1313 microversion: 2.1 time: 0.277349 Jul 28 04:13:00.114349 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3342/5792] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:59 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:00.125046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5136b4a-7142-492d-82a7-88771503d18a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:00.126097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b5136b4a-7142-492d-82a7-88771503d18a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:00.139235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5136b4a-7142-492d-82a7-88771503d18a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:00.140199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5136b4a-7142-492d-82a7-88771503d18a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:00.141601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5136b4a-7142-492d-82a7-88771503d18a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:00.142547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5136b4a-7142-492d-82a7-88771503d18a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:00.379666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b5136b4a-7142-492d-82a7-88771503d18a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:00.410980 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5136b4a-7142-492d-82a7-88771503d18a tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1509 microversion: 2.1 time: 0.278262 Jul 28 04:13:00.425897 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3343/5793] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:00 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1509 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:00.436654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-5fe2f356-12f3-49f9-8e11-a4bc27a48f86 req-79942da4-b7eb-4c72-90be-465836daf56a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ceb7cc-bc21-4f3d-835f-b1e579370843", "tag": "6ccc17f6-399f-4b3f-9a84-4a15da0f6083"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:00.455193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5fe2f356-12f3-49f9-8e11-a4bc27a48f86 req-79942da4-b7eb-4c72-90be-465836daf56a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:00.455647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5fe2f356-12f3-49f9-8e11-a4bc27a48f86 req-79942da4-b7eb-4c72-90be-465836daf56a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:00.472425 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5fe2f356-12f3-49f9-8e11-a4bc27a48f86 req-79942da4-b7eb-4c72-90be-465836daf56a service nova] Creating event network-changed:6ccc17f6-399f-4b3f-9a84-4a15da0f6083 for instance 44ceb7cc-bc21-4f3d-835f-b1e579370843 on n-h1-826756-3 Jul 28 04:13:00.491433 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-5fe2f356-12f3-49f9-8e11-a4bc27a48f86 req-79942da4-b7eb-4c72-90be-465836daf56a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060066 Jul 28 04:13:00.492373 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3344/5794] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:00.499859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-720b1df4-3db6-449c-ba45-90a7f9a6c972 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:00.500876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-720b1df4-3db6-449c-ba45-90a7f9a6c972 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:00.524094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-720b1df4-3db6-449c-ba45-90a7f9a6c972 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:00.524980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-720b1df4-3db6-449c-ba45-90a7f9a6c972 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:00.526415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-720b1df4-3db6-449c-ba45-90a7f9a6c972 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:00.527153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-720b1df4-3db6-449c-ba45-90a7f9a6c972 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:00.660128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-720b1df4-3db6-449c-ba45-90a7f9a6c972 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:00.671907 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-720b1df4-3db6-449c-ba45-90a7f9a6c972 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1324 microversion: 2.1 time: 0.178204 Jul 28 04:13:00.673312 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3345/5795] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:00 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1324 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:00.862476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3a58bce-464d-47c6-b74b-e3865683c962 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:00.863418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3a58bce-464d-47c6-b74b-e3865683c962 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:00.883319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a58bce-464d-47c6-b74b-e3865683c962 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:00.889112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a58bce-464d-47c6-b74b-e3865683c962 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:00.891826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a58bce-464d-47c6-b74b-e3865683c962 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:00.892636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3a58bce-464d-47c6-b74b-e3865683c962 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:01.189187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3a58bce-464d-47c6-b74b-e3865683c962 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:01.206987 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3a58bce-464d-47c6-b74b-e3865683c962 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1516 microversion: 2.1 time: 0.352071 Jul 28 04:13:01.209505 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3346/5796] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:00 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1516 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:01.216977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-942d43e5-ba53-434f-aa50-76f49205a49a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:01.217742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-942d43e5-ba53-434f-aa50-76f49205a49a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:01.236525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-942d43e5-ba53-434f-aa50-76f49205a49a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:01.237304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-942d43e5-ba53-434f-aa50-76f49205a49a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:01.238379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-942d43e5-ba53-434f-aa50-76f49205a49a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:01.239030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-942d43e5-ba53-434f-aa50-76f49205a49a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:01.543191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-942d43e5-ba53-434f-aa50-76f49205a49a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:01.553941 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-942d43e5-ba53-434f-aa50-76f49205a49a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1313 microversion: 2.1 time: 0.342639 Jul 28 04:13:01.554838 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3347/5797] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:01 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:01.571061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf6f5b1d-168b-4134-98bb-e5ef975ef2c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:01.571760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cf6f5b1d-168b-4134-98bb-e5ef975ef2c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:01.592995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf6f5b1d-168b-4134-98bb-e5ef975ef2c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:01.597550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf6f5b1d-168b-4134-98bb-e5ef975ef2c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:01.598411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf6f5b1d-168b-4134-98bb-e5ef975ef2c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:01.598850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf6f5b1d-168b-4134-98bb-e5ef975ef2c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:01.831787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf6f5b1d-168b-4134-98bb-e5ef975ef2c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:01.841007 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf6f5b1d-168b-4134-98bb-e5ef975ef2c7 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1509 microversion: 2.1 time: 0.274477 Jul 28 04:13:01.842058 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3348/5798] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:01 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:01.846950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f2beb1c-3eda-4301-8f54-dfd04d31b7fd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:01.847683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6f2beb1c-3eda-4301-8f54-dfd04d31b7fd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:01.862061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f2beb1c-3eda-4301-8f54-dfd04d31b7fd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:01.862666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f2beb1c-3eda-4301-8f54-dfd04d31b7fd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:01.863547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f2beb1c-3eda-4301-8f54-dfd04d31b7fd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:01.864064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f2beb1c-3eda-4301-8f54-dfd04d31b7fd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:01.957422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6f2beb1c-3eda-4301-8f54-dfd04d31b7fd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:01.967250 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6f2beb1c-3eda-4301-8f54-dfd04d31b7fd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1324 microversion: 2.1 time: 0.124035 Jul 28 04:13:01.968228 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3349/5799] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:01 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1324 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:02.230899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-02071da3-ec07-423d-b0d6-ab759026d002 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:02.232217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-02071da3-ec07-423d-b0d6-ab759026d002 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:02.244108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02071da3-ec07-423d-b0d6-ab759026d002 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:02.246358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02071da3-ec07-423d-b0d6-ab759026d002 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:02.247318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02071da3-ec07-423d-b0d6-ab759026d002 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:02.249805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-02071da3-ec07-423d-b0d6-ab759026d002 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:02.515858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-02071da3-ec07-423d-b0d6-ab759026d002 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:02.528817 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-02071da3-ec07-423d-b0d6-ab759026d002 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1516 microversion: 2.1 time: 0.302111 Jul 28 04:13:02.530337 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3350/5800] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:02 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1516 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:02.604479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-81db7eed-ab60-4b77-b6bc-5821edb753af tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:02.607115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-81db7eed-ab60-4b77-b6bc-5821edb753af tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:02.614197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81db7eed-ab60-4b77-b6bc-5821edb753af tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:02.614678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81db7eed-ab60-4b77-b6bc-5821edb753af tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:02.616955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81db7eed-ab60-4b77-b6bc-5821edb753af tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:02.617410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81db7eed-ab60-4b77-b6bc-5821edb753af tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:02.804280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-81db7eed-ab60-4b77-b6bc-5821edb753af tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:02.814422 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-81db7eed-ab60-4b77-b6bc-5821edb753af tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1313 microversion: 2.1 time: 0.236715 Jul 28 04:13:02.821579 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3351/5801] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:02 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:02.862534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c58f504-24cb-4534-9281-4266998fa1cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:02.863141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c58f504-24cb-4534-9281-4266998fa1cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:02.869523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c58f504-24cb-4534-9281-4266998fa1cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:02.869974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c58f504-24cb-4534-9281-4266998fa1cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:02.870756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c58f504-24cb-4534-9281-4266998fa1cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:02.871187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c58f504-24cb-4534-9281-4266998fa1cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:03.022901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7c58f504-24cb-4534-9281-4266998fa1cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:03.030850 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7c58f504-24cb-4534-9281-4266998fa1cc tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1509 microversion: 2.1 time: 0.172377 Jul 28 04:13:03.042633 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3352/5802] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:02 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:03.042633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f2280c58-c4eb-437e-9c89-a0c6c78c9756 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:03.042633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f2280c58-c4eb-437e-9c89-a0c6c78c9756 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:03.043743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2280c58-c4eb-437e-9c89-a0c6c78c9756 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:03.044415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2280c58-c4eb-437e-9c89-a0c6c78c9756 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:03.045356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2280c58-c4eb-437e-9c89-a0c6c78c9756 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:03.045940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2280c58-c4eb-437e-9c89-a0c6c78c9756 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:03.050700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:03.133113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f2280c58-c4eb-437e-9c89-a0c6c78c9756 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:03.141937 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f2280c58-c4eb-437e-9c89-a0c6c78c9756 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1324 microversion: 2.1 time: 0.108970 Jul 28 04:13:03.142525 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3353/5803] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:03 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1324 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:03.555544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0dd245fd-a325-4b76-8c56-091f3abb6ea5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:03.556955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0dd245fd-a325-4b76-8c56-091f3abb6ea5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:03.563698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dd245fd-a325-4b76-8c56-091f3abb6ea5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:03.564144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dd245fd-a325-4b76-8c56-091f3abb6ea5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:03.564942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dd245fd-a325-4b76-8c56-091f3abb6ea5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:03.565425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0dd245fd-a325-4b76-8c56-091f3abb6ea5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:03.741176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0dd245fd-a325-4b76-8c56-091f3abb6ea5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:03.758566 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0dd245fd-a325-4b76-8c56-091f3abb6ea5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 200 len: 1474 microversion: 2.1 time: 0.206963 Jul 28 04:13:03.783565 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3354/5804] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:03 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 1474 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:03.803407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-38913831-9e6c-401a-9c7d-741e4a53894a req-46a839d0-a9b7-4824-905f-95f4567c7164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3e85786-076b-4d13-bdb2-31d5441af52e", "name": "network-vif-deleted", "tag": "3d453000-6aeb-4a83-b405-0132af142085"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:03.829847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-38913831-9e6c-401a-9c7d-741e4a53894a req-46a839d0-a9b7-4824-905f-95f4567c7164 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:03.830265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-38913831-9e6c-401a-9c7d-741e4a53894a req-46a839d0-a9b7-4824-905f-95f4567c7164 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:03.844332 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-38913831-9e6c-401a-9c7d-741e4a53894a req-46a839d0-a9b7-4824-905f-95f4567c7164 service nova] Creating event network-vif-deleted:3d453000-6aeb-4a83-b405-0132af142085 for instance b3e85786-076b-4d13-bdb2-31d5441af52e on n-h1-826756-3 Jul 28 04:13:03.851820 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-38913831-9e6c-401a-9c7d-741e4a53894a req-46a839d0-a9b7-4824-905f-95f4567c7164 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066840 Jul 28 04:13:03.852908 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3355/5805] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:03.878948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7bcbeb66-26e2-40d3-b2cc-c8b66e75a7fd tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:03.883973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7bcbeb66-26e2-40d3-b2cc-c8b66e75a7fd tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:03.901670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bcbeb66-26e2-40d3-b2cc-c8b66e75a7fd tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:03.902131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bcbeb66-26e2-40d3-b2cc-c8b66e75a7fd tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:03.902933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bcbeb66-26e2-40d3-b2cc-c8b66e75a7fd tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:03.903381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bcbeb66-26e2-40d3-b2cc-c8b66e75a7fd tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:04.218836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7bcbeb66-26e2-40d3-b2cc-c8b66e75a7fd tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:04.231392 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7bcbeb66-26e2-40d3-b2cc-c8b66e75a7fd tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1313 microversion: 2.1 time: 0.372103 Jul 28 04:13:04.255100 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3356/5806] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:03 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:04.255100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-361ae058-d9df-4b20-9dda-b7ac88dad212 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:04.255100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-361ae058-d9df-4b20-9dda-b7ac88dad212 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:04.266694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-361ae058-d9df-4b20-9dda-b7ac88dad212 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:04.266694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-361ae058-d9df-4b20-9dda-b7ac88dad212 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:04.266694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-361ae058-d9df-4b20-9dda-b7ac88dad212 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:04.266694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-361ae058-d9df-4b20-9dda-b7ac88dad212 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:04.393755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-361ae058-d9df-4b20-9dda-b7ac88dad212 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:04.394229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-361ae058-d9df-4b20-9dda-b7ac88dad212 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:04.394713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-361ae058-d9df-4b20-9dda-b7ac88dad212 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lazy-loading 'fault' on Instance uuid b3e85786-076b-4d13-bdb2-31d5441af52e {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:13:04.513569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-361ae058-d9df-4b20-9dda-b7ac88dad212 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:04.528208 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-361ae058-d9df-4b20-9dda-b7ac88dad212 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 200 len: 1312 microversion: 2.1 time: 0.293955 Jul 28 04:13:04.546457 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3357/5807] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:04 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 1312 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:04.552796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3a9c9112-1448-4616-b09c-d8d7e5e7deff tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:04.555746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3a9c9112-1448-4616-b09c-d8d7e5e7deff tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:04.568369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a9c9112-1448-4616-b09c-d8d7e5e7deff tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:04.568854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a9c9112-1448-4616-b09c-d8d7e5e7deff tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:04.569684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a9c9112-1448-4616-b09c-d8d7e5e7deff tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:04.570125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a9c9112-1448-4616-b09c-d8d7e5e7deff tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:04.812536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3a9c9112-1448-4616-b09c-d8d7e5e7deff tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:04.825413 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3a9c9112-1448-4616-b09c-d8d7e5e7deff tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1391 microversion: 2.1 time: 0.276695 Jul 28 04:13:04.840708 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3358/5808] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:04 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1391 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:04.848313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f8afb8d7-8cd1-416f-b67c-ae0278393892 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:04.848956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f8afb8d7-8cd1-416f-b67c-ae0278393892 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:04.856109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8afb8d7-8cd1-416f-b67c-ae0278393892 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:04.856646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8afb8d7-8cd1-416f-b67c-ae0278393892 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:04.857675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8afb8d7-8cd1-416f-b67c-ae0278393892 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:04.858273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8afb8d7-8cd1-416f-b67c-ae0278393892 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:04.875632 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-f8afb8d7-8cd1-416f-b67c-ae0278393892 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f8afb8d7-8cd1-416f-b67c-ae0278393892 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c HTTP/1.1 Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'e86fd69e-4852-4849-9e26-d0bf41a1668c'} Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:04.877620 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:04.882264 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:04.882264 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:04.882264 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:13:04.882264 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:13:04.882264 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:13:04.882264 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:04.883440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f8afb8d7-8cd1-416f-b67c-ae0278393892 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:13:04.884297 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f8afb8d7-8cd1-416f-b67c-ae0278393892 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 404 len: 111 microversion: 2.1 time: 0.040577 Jul 28 04:13:04.884921 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3359/5809] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:04 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:13:05.132263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-832867165", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "942500be-05b0-478f-8797-cdf9e19a4ee1"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:05.203418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] validate_networks() for [('942500be-05b0-478f-8797-cdf9e19a4ee1', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:13:05.831769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:05.893210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:13:05.893887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:13:05.894417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:13:05.894820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:13:05.895683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:13:05.910633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:05.911423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:05.912974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:05.913496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:05.959471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:13:05.968518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Getting quotas for user 24e6476d226840c4adc1ea6c54dfd527 and project 80687f6afee046a6bac1043f7c99677b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:13:06.019104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:13:06.024901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:13:06.216149 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-98760837-6c55-406e-a044-bceed59c2d9a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092936 Jul 28 04:13:06.222729 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3360/5810] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:13:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:13:06.228627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cb436857-318d-49d1-a31a-19d46168f45f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:06.229577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cb436857-318d-49d1-a31a-19d46168f45f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:06.247627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb436857-318d-49d1-a31a-19d46168f45f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:06.253100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb436857-318d-49d1-a31a-19d46168f45f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:06.254436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb436857-318d-49d1-a31a-19d46168f45f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:06.255016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb436857-318d-49d1-a31a-19d46168f45f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:06.524009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cb436857-318d-49d1-a31a-19d46168f45f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:06.534859 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cb436857-318d-49d1-a31a-19d46168f45f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1313 microversion: 2.1 time: 0.310676 Jul 28 04:13:06.535625 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3361/5811] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:06 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:06.556673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e1d19c67-aa90-4192-a03f-fcb5388a5c5b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:06.558043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e1d19c67-aa90-4192-a03f-fcb5388a5c5b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: b3e85786-076b-4d13-bdb2-31d5441af52e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:06.587932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1d19c67-aa90-4192-a03f-fcb5388a5c5b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:06.593637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1d19c67-aa90-4192-a03f-fcb5388a5c5b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:06.600720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1d19c67-aa90-4192-a03f-fcb5388a5c5b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:06.602416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1d19c67-aa90-4192-a03f-fcb5388a5c5b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:06.658023 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e1d19c67-aa90-4192-a03f-fcb5388a5c5b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] HTTP exception thrown: Instance b3e85786-076b-4d13-bdb2-31d5441af52e could not be found. Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e1d19c67-aa90-4192-a03f-fcb5388a5c5b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Request method failure captured: Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e HTTP/1.1 Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4guRH7cRyy41e8TMK6yH4E4vas5YneK3wNd43QNSbwP-vnU4KJvI9xnqarrFpgm_3d_MoR1ZpAdJmMyZ8u5FsxNmotKsW-BhbDNoNezHFEg5JbZI4uqCMDxre0Fl2vlF1EpCS09lknpXT0acA4YXSeuR-688T4pmq6O5npCWbGdqMXs Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/404ce0264e584456bfc6b523e914c408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_404ce0264e584456bfc6b523e914c408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}] Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0083854f0de14631ad15751829e34537 Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance b3e85786-076b-4d13-bdb2-31d5441af52e could not be found. Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'b3e85786-076b-4d13-bdb2-31d5441af52e'} Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3e85786-076b-4d13-bdb2-31d5441af52e could not be found. Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3e85786-076b-4d13-bdb2-31d5441af52e could not be found. Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:06.662697 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:06.669513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:06.669513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:06.669513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:06.669513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:06.669513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:13:06.669513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:13:06.669513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3e85786-076b-4d13-bdb2-31d5441af52e could not be found. Jul 28 04:13:06.669513 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:06.673246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e1d19c67-aa90-4192-a03f-fcb5388a5c5b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Returning 404 to user: Instance b3e85786-076b-4d13-bdb2-31d5441af52e could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:13:06.674946 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e1d19c67-aa90-4192-a03f-fcb5388a5c5b tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e" status: 404 len: 111 microversion: 2.1 time: 0.131246 Jul 28 04:13:06.676022 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3362/5812] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:06 2022] GET /compute/v2.1/servers/b3e85786-076b-4d13-bdb2-31d5441af52e => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:13:06.687793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c1cc6c79-d30e-4c7e-95e0-c6650862e777 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:06.689053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c1cc6c79-d30e-4c7e-95e0-c6650862e777 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:06.727464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1cc6c79-d30e-4c7e-95e0-c6650862e777 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:06.727464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1cc6c79-d30e-4c7e-95e0-c6650862e777 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:06.727464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1cc6c79-d30e-4c7e-95e0-c6650862e777 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:06.727464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c1cc6c79-d30e-4c7e-95e0-c6650862e777 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:07.005616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c1cc6c79-d30e-4c7e-95e0-c6650862e777 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:07.021809 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c1cc6c79-d30e-4c7e-95e0-c6650862e777 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1391 microversion: 2.1 time: 0.339418 Jul 28 04:13:07.045950 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3363/5813] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:06 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1391 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:07.045950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-eef8d1ed-bede-4b35-9fca-f82b4c7ec308 req-4e913116-d739-4f04-a127-49751adfded9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e86fd69e-4852-4849-9e26-d0bf41a1668c", "name": "network-vif-deleted", "tag": "b479cdf6-a90a-44ac-babb-eae995918419"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:07.071778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-eef8d1ed-bede-4b35-9fca-f82b4c7ec308 req-4e913116-d739-4f04-a127-49751adfded9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:07.072797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-eef8d1ed-bede-4b35-9fca-f82b4c7ec308 req-4e913116-d739-4f04-a127-49751adfded9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:07.105561 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-eef8d1ed-bede-4b35-9fca-f82b4c7ec308 req-4e913116-d739-4f04-a127-49751adfded9 service nova] Creating event network-vif-deleted:b479cdf6-a90a-44ac-babb-eae995918419 for instance e86fd69e-4852-4849-9e26-d0bf41a1668c on n-h2-826756-3 Jul 28 04:13:07.115653 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-eef8d1ed-bede-4b35-9fca-f82b4c7ec308 req-4e913116-d739-4f04-a127-49751adfded9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078758 Jul 28 04:13:07.116925 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3364/5814] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:07.135621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e8001ca-fda9-4df9-863b-4a92fb84b4ed tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:07.139294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0e8001ca-fda9-4df9-863b-4a92fb84b4ed tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:07.150029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:07.256331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0e8001ca-fda9-4df9-863b-4a92fb84b4ed tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:07.264054 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0e8001ca-fda9-4df9-863b-4a92fb84b4ed tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1208 microversion: 2.1 time: 0.140337 Jul 28 04:13:07.265569 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3365/5815] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:07 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1208 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:07.274158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3f0de1db-d508-4443-944c-b327fc84e39d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:07.274723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3f0de1db-d508-4443-944c-b327fc84e39d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:07.282593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f0de1db-d508-4443-944c-b327fc84e39d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:07.283169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f0de1db-d508-4443-944c-b327fc84e39d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:07.284680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f0de1db-d508-4443-944c-b327fc84e39d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:07.285548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f0de1db-d508-4443-944c-b327fc84e39d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:07.328021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3f0de1db-d508-4443-944c-b327fc84e39d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:13:07.477195 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3f0de1db-d508-4443-944c-b327fc84e39d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 204 len: 0 microversion: 2.1 time: 0.207431 Jul 28 04:13:07.478521 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3366/5816] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:13:07 2022] DELETE /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:13:07.491646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-42de9f21-e53b-47c5-b992-634e847a26ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:07.492561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-42de9f21-e53b-47c5-b992-634e847a26ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:07.503243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42de9f21-e53b-47c5-b992-634e847a26ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:07.504318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42de9f21-e53b-47c5-b992-634e847a26ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:07.505653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42de9f21-e53b-47c5-b992-634e847a26ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:07.507028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42de9f21-e53b-47c5-b992-634e847a26ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:07.786714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-42de9f21-e53b-47c5-b992-634e847a26ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:07.805063 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-42de9f21-e53b-47c5-b992-634e847a26ab tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.319369 Jul 28 04:13:07.816376 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3367/5817] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:07 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:07.823026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e884199b-4fa5-4365-ac78-1efdf21c371a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:07.823026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e884199b-4fa5-4365-ac78-1efdf21c371a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:07.834842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e884199b-4fa5-4365-ac78-1efdf21c371a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:07.836498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e884199b-4fa5-4365-ac78-1efdf21c371a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:07.837520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e884199b-4fa5-4365-ac78-1efdf21c371a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:07.838298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e884199b-4fa5-4365-ac78-1efdf21c371a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:08.051230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e884199b-4fa5-4365-ac78-1efdf21c371a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:08.069259 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e884199b-4fa5-4365-ac78-1efdf21c371a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1313 microversion: 2.1 time: 0.259596 Jul 28 04:13:08.070188 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3368/5818] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:07 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:08.078109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15f36b0c-c0ff-4517-ab7d-86631d84aa5a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:08.079327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15f36b0c-c0ff-4517-ab7d-86631d84aa5a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:08.092615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15f36b0c-c0ff-4517-ab7d-86631d84aa5a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:08.093105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15f36b0c-c0ff-4517-ab7d-86631d84aa5a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:08.094090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15f36b0c-c0ff-4517-ab7d-86631d84aa5a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:08.094692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15f36b0c-c0ff-4517-ab7d-86631d84aa5a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:08.303625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-15f36b0c-c0ff-4517-ab7d-86631d84aa5a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:08.325126 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15f36b0c-c0ff-4517-ab7d-86631d84aa5a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1391 microversion: 2.1 time: 0.253073 Jul 28 04:13:08.326094 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3369/5819] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:08 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1391 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:08.331422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5a7e2400-31d6-4f9b-b862-cc2588ce0df2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:08.332547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5a7e2400-31d6-4f9b-b862-cc2588ce0df2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:08.348631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a7e2400-31d6-4f9b-b862-cc2588ce0df2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:08.349428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a7e2400-31d6-4f9b-b862-cc2588ce0df2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:08.351015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a7e2400-31d6-4f9b-b862-cc2588ce0df2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:08.352789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a7e2400-31d6-4f9b-b862-cc2588ce0df2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:08.459839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5a7e2400-31d6-4f9b-b862-cc2588ce0df2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:08.474593 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5a7e2400-31d6-4f9b-b862-cc2588ce0df2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1204 microversion: 2.1 time: 0.146893 Jul 28 04:13:08.475415 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3370/5820] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:08 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1204 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:08.833284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6adc32d7-40b7-4d9a-9b27-589729b4fa0e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:08.833944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6adc32d7-40b7-4d9a-9b27-589729b4fa0e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:08.845845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6adc32d7-40b7-4d9a-9b27-589729b4fa0e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:08.845845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6adc32d7-40b7-4d9a-9b27-589729b4fa0e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:08.846118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6adc32d7-40b7-4d9a-9b27-589729b4fa0e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:08.846533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6adc32d7-40b7-4d9a-9b27-589729b4fa0e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:09.127685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6adc32d7-40b7-4d9a-9b27-589729b4fa0e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:09.138467 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6adc32d7-40b7-4d9a-9b27-589729b4fa0e tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.310889 Jul 28 04:13:09.152980 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3371/5821] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:08 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:09.158604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-338c7d3b-737c-426a-aa1f-b4865906c53e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:09.159229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-338c7d3b-737c-426a-aa1f-b4865906c53e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:09.166358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-338c7d3b-737c-426a-aa1f-b4865906c53e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:09.167053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-338c7d3b-737c-426a-aa1f-b4865906c53e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:09.168008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-338c7d3b-737c-426a-aa1f-b4865906c53e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:09.168756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-338c7d3b-737c-426a-aa1f-b4865906c53e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:09.174230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:09.410498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-338c7d3b-737c-426a-aa1f-b4865906c53e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:09.420731 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-338c7d3b-737c-426a-aa1f-b4865906c53e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1313 microversion: 2.1 time: 0.266026 Jul 28 04:13:09.421718 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3372/5822] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:09 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:09.426754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3a302000-7fba-44fb-9673-dbf2b2faa6c5 req-d376da49-35cd-4b99-adf3-2696f0b36b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b621e0-6ff2-44af-b71b-9d9178e3fdbd", "tag": "12359d9a-9928-43ee-8d00-b4cef96dc189"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:09.445276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3a302000-7fba-44fb-9673-dbf2b2faa6c5 req-d376da49-35cd-4b99-adf3-2696f0b36b29 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:09.445765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3a302000-7fba-44fb-9673-dbf2b2faa6c5 req-d376da49-35cd-4b99-adf3-2696f0b36b29 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:09.482912 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3a302000-7fba-44fb-9673-dbf2b2faa6c5 req-d376da49-35cd-4b99-adf3-2696f0b36b29 service nova] Creating event network-changed:12359d9a-9928-43ee-8d00-b4cef96dc189 for instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd on n-h2-826756-3 Jul 28 04:13:09.502201 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3a302000-7fba-44fb-9673-dbf2b2faa6c5 req-d376da49-35cd-4b99-adf3-2696f0b36b29 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078854 Jul 28 04:13:09.508904 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3373/5823] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:09.519139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-25723f10-3581-40ff-a09d-d572596916e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:09.520282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-25723f10-3581-40ff-a09d-d572596916e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:09.535018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25723f10-3581-40ff-a09d-d572596916e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:09.535675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25723f10-3581-40ff-a09d-d572596916e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:09.545253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25723f10-3581-40ff-a09d-d572596916e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:09.550103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25723f10-3581-40ff-a09d-d572596916e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:09.739195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-25723f10-3581-40ff-a09d-d572596916e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:09.750394 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-25723f10-3581-40ff-a09d-d572596916e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1391 microversion: 2.1 time: 0.238461 Jul 28 04:13:09.751347 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3374/5824] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:09 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:09.756337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86664b60-59c3-4d59-8f98-6b59891b5ed6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:09.760338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-86664b60-59c3-4d59-8f98-6b59891b5ed6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:09.781564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86664b60-59c3-4d59-8f98-6b59891b5ed6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:09.782211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86664b60-59c3-4d59-8f98-6b59891b5ed6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:09.783071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86664b60-59c3-4d59-8f98-6b59891b5ed6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:09.783507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86664b60-59c3-4d59-8f98-6b59891b5ed6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:09.874571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-86664b60-59c3-4d59-8f98-6b59891b5ed6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:09.890908 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-86664b60-59c3-4d59-8f98-6b59891b5ed6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1260 microversion: 2.1 time: 0.138444 Jul 28 04:13:09.891516 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3375/5825] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:09 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1260 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:10.174307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cfce9d2e-a509-4714-bdda-b1d154c6986d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:10.176407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cfce9d2e-a509-4714-bdda-b1d154c6986d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:10.198162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfce9d2e-a509-4714-bdda-b1d154c6986d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:10.200263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfce9d2e-a509-4714-bdda-b1d154c6986d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:10.205453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfce9d2e-a509-4714-bdda-b1d154c6986d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:10.206193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfce9d2e-a509-4714-bdda-b1d154c6986d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:10.379567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cfce9d2e-a509-4714-bdda-b1d154c6986d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:10.389664 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cfce9d2e-a509-4714-bdda-b1d154c6986d tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.229625 Jul 28 04:13:10.402960 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3376/5826] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:10 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:10.479931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d8f8febf-9312-4424-8e7a-f4202ab520d4 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:10.483339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d8f8febf-9312-4424-8e7a-f4202ab520d4 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:10.492068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8f8febf-9312-4424-8e7a-f4202ab520d4 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:10.492571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8f8febf-9312-4424-8e7a-f4202ab520d4 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:10.493599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8f8febf-9312-4424-8e7a-f4202ab520d4 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:10.494109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8f8febf-9312-4424-8e7a-f4202ab520d4 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:10.804615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d8f8febf-9312-4424-8e7a-f4202ab520d4 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:10.815648 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d8f8febf-9312-4424-8e7a-f4202ab520d4 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1313 microversion: 2.1 time: 0.371292 Jul 28 04:13:10.822049 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3377/5827] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:10 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:10.827007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0279a4b7-d182-48b3-9b0b-434caece73c2 req-971b0ec1-450b-4d48-bd9f-003a150ed14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b621e0-6ff2-44af-b71b-9d9178e3fdbd", "name": "network-vif-plugged", "status": "completed", "tag": "12359d9a-9928-43ee-8d00-b4cef96dc189"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:10.853310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0279a4b7-d182-48b3-9b0b-434caece73c2 req-971b0ec1-450b-4d48-bd9f-003a150ed14e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:10.854097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0279a4b7-d182-48b3-9b0b-434caece73c2 req-971b0ec1-450b-4d48-bd9f-003a150ed14e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:10.878583 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0279a4b7-d182-48b3-9b0b-434caece73c2 req-971b0ec1-450b-4d48-bd9f-003a150ed14e service nova] Creating event network-vif-plugged:12359d9a-9928-43ee-8d00-b4cef96dc189 for instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd on n-h2-826756-3 Jul 28 04:13:10.886408 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0279a4b7-d182-48b3-9b0b-434caece73c2 req-971b0ec1-450b-4d48-bd9f-003a150ed14e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062952 Jul 28 04:13:10.887024 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3378/5828] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:10.893121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f26b2783-1fb1-4e93-8d10-b02c8b1b0eeb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:10.893789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f26b2783-1fb1-4e93-8d10-b02c8b1b0eeb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:10.900941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f26b2783-1fb1-4e93-8d10-b02c8b1b0eeb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:10.901485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f26b2783-1fb1-4e93-8d10-b02c8b1b0eeb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:10.902129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f26b2783-1fb1-4e93-8d10-b02c8b1b0eeb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:10.902594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f26b2783-1fb1-4e93-8d10-b02c8b1b0eeb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:11.076640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f26b2783-1fb1-4e93-8d10-b02c8b1b0eeb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:11.091036 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f26b2783-1fb1-4e93-8d10-b02c8b1b0eeb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1391 microversion: 2.1 time: 0.202362 Jul 28 04:13:11.095179 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3379/5829] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:10 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:11.100966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4dc475cb-f6cc-4691-9cf7-fc479ae5719f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:11.105742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4dc475cb-f6cc-4691-9cf7-fc479ae5719f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:11.122841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4dc475cb-f6cc-4691-9cf7-fc479ae5719f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:11.123840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4dc475cb-f6cc-4691-9cf7-fc479ae5719f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:11.126308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4dc475cb-f6cc-4691-9cf7-fc479ae5719f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:11.127221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4dc475cb-f6cc-4691-9cf7-fc479ae5719f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:11.217920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4dc475cb-f6cc-4691-9cf7-fc479ae5719f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:11.227545 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4dc475cb-f6cc-4691-9cf7-fc479ae5719f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1260 microversion: 2.1 time: 0.131162 Jul 28 04:13:11.232536 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3380/5830] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:11 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1260 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:11.412123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ba17bb49-fa77-4d3c-88ba-fb47fd06bf10 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:11.413119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ba17bb49-fa77-4d3c-88ba-fb47fd06bf10 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:11.425735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba17bb49-fa77-4d3c-88ba-fb47fd06bf10 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:11.426721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba17bb49-fa77-4d3c-88ba-fb47fd06bf10 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:11.427826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba17bb49-fa77-4d3c-88ba-fb47fd06bf10 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:11.428385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba17bb49-fa77-4d3c-88ba-fb47fd06bf10 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:11.986203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ba17bb49-fa77-4d3c-88ba-fb47fd06bf10 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:12.006835 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ba17bb49-fa77-4d3c-88ba-fb47fd06bf10 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.599701 Jul 28 04:13:12.007684 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3381/5831] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:11 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:12.025521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-26459c48-3be4-417b-a9fd-bc105b35e330 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:12.026146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-26459c48-3be4-417b-a9fd-bc105b35e330 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:12.053401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26459c48-3be4-417b-a9fd-bc105b35e330 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:12.053789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26459c48-3be4-417b-a9fd-bc105b35e330 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:12.055097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26459c48-3be4-417b-a9fd-bc105b35e330 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:12.055187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26459c48-3be4-417b-a9fd-bc105b35e330 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:12.464811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-26459c48-3be4-417b-a9fd-bc105b35e330 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:12.477960 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-26459c48-3be4-417b-a9fd-bc105b35e330 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1313 microversion: 2.1 time: 0.455763 Jul 28 04:13:12.480901 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3382/5832] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:12 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:12.487479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-16b4d8e6-4ab7-4909-b30c-85a0b16d6f66 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:12.488084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-16b4d8e6-4ab7-4909-b30c-85a0b16d6f66 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:12.506468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16b4d8e6-4ab7-4909-b30c-85a0b16d6f66 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:12.507070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16b4d8e6-4ab7-4909-b30c-85a0b16d6f66 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:12.507881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16b4d8e6-4ab7-4909-b30c-85a0b16d6f66 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:12.508320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16b4d8e6-4ab7-4909-b30c-85a0b16d6f66 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:12.844984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-16b4d8e6-4ab7-4909-b30c-85a0b16d6f66 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:12.859961 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-16b4d8e6-4ab7-4909-b30c-85a0b16d6f66 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1391 microversion: 2.1 time: 0.377873 Jul 28 04:13:12.878766 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3383/5833] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:12 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1391 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:12.887031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-479692f8-096d-46d8-8ecd-842ce2b5b51a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:12.888146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-479692f8-096d-46d8-8ecd-842ce2b5b51a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:12.894524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-479692f8-096d-46d8-8ecd-842ce2b5b51a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:12.895181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-479692f8-096d-46d8-8ecd-842ce2b5b51a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:12.896122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-479692f8-096d-46d8-8ecd-842ce2b5b51a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:12.896873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-479692f8-096d-46d8-8ecd-842ce2b5b51a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:13.037049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-479692f8-096d-46d8-8ecd-842ce2b5b51a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:13.047470 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-479692f8-096d-46d8-8ecd-842ce2b5b51a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1278 microversion: 2.1 time: 0.167337 Jul 28 04:13:13.048303 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3384/5834] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:12 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:13.067040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-7344a92d-1046-4051-b9de-3ec287dc535d req-28545797-ec37-4d56-8732-764795ff1de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ceb7cc-bc21-4f3d-835f-b1e579370843", "name": "network-vif-plugged", "status": "completed", "tag": "6ccc17f6-399f-4b3f-9a84-4a15da0f6083"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:13.084911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7344a92d-1046-4051-b9de-3ec287dc535d req-28545797-ec37-4d56-8732-764795ff1de0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:13.085398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7344a92d-1046-4051-b9de-3ec287dc535d req-28545797-ec37-4d56-8732-764795ff1de0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:13.102288 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-7344a92d-1046-4051-b9de-3ec287dc535d req-28545797-ec37-4d56-8732-764795ff1de0 service nova] Creating event network-vif-plugged:6ccc17f6-399f-4b3f-9a84-4a15da0f6083 for instance 44ceb7cc-bc21-4f3d-835f-b1e579370843 on n-h1-826756-3 Jul 28 04:13:13.110315 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-7344a92d-1046-4051-b9de-3ec287dc535d req-28545797-ec37-4d56-8732-764795ff1de0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046928 Jul 28 04:13:13.114313 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3385/5835] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:13.127805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-27f31923-fd99-4d3a-b141-0561040cc3d5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:13.128548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-27f31923-fd99-4d3a-b141-0561040cc3d5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:13.142562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27f31923-fd99-4d3a-b141-0561040cc3d5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:13.149942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27f31923-fd99-4d3a-b141-0561040cc3d5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:13.151250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27f31923-fd99-4d3a-b141-0561040cc3d5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:13.151250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27f31923-fd99-4d3a-b141-0561040cc3d5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:13.448042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-27f31923-fd99-4d3a-b141-0561040cc3d5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:13.459419 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-27f31923-fd99-4d3a-b141-0561040cc3d5 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1522 microversion: 2.1 time: 0.343436 Jul 28 04:13:13.462078 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3386/5836] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:13 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:13.499001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-13446fb6-6fe1-47f4-b6d2-8454e18b8817 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:13.499846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-13446fb6-6fe1-47f4-b6d2-8454e18b8817 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:13.509257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-13446fb6-6fe1-47f4-b6d2-8454e18b8817 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:13.510192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-13446fb6-6fe1-47f4-b6d2-8454e18b8817 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:13.511215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-13446fb6-6fe1-47f4-b6d2-8454e18b8817 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:13.511835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-13446fb6-6fe1-47f4-b6d2-8454e18b8817 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:13.726318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-13446fb6-6fe1-47f4-b6d2-8454e18b8817 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:13.735081 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-13446fb6-6fe1-47f4-b6d2-8454e18b8817 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1313 microversion: 2.1 time: 0.240999 Jul 28 04:13:13.750155 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3387/5837] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:13 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:13.772957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-85d56314-d5df-486e-8722-6cc2f752797a req-941008a8-c156-4381-8168-7d9d98467de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b6d7c1-b65f-465c-97d1-fe40465a3321", "name": "network-vif-deleted", "tag": "c05ec157-6086-4d52-a5b3-5be3fab3ce01"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:13.784034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-85d56314-d5df-486e-8722-6cc2f752797a req-941008a8-c156-4381-8168-7d9d98467de2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:13.784574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-85d56314-d5df-486e-8722-6cc2f752797a req-941008a8-c156-4381-8168-7d9d98467de2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:13.800437 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-85d56314-d5df-486e-8722-6cc2f752797a req-941008a8-c156-4381-8168-7d9d98467de2 service nova] Creating event network-vif-deleted:c05ec157-6086-4d52-a5b3-5be3fab3ce01 for instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 on n-h2-826756-3 Jul 28 04:13:13.803740 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-85d56314-d5df-486e-8722-6cc2f752797a req-941008a8-c156-4381-8168-7d9d98467de2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035069 Jul 28 04:13:13.804469 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3388/5838] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:13.886789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19d9b82e-6ea0-428e-8e9f-58a610c3a70c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:13.887658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-19d9b82e-6ea0-428e-8e9f-58a610c3a70c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:13.895576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19d9b82e-6ea0-428e-8e9f-58a610c3a70c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:13.896173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19d9b82e-6ea0-428e-8e9f-58a610c3a70c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:13.897061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19d9b82e-6ea0-428e-8e9f-58a610c3a70c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:13.897871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19d9b82e-6ea0-428e-8e9f-58a610c3a70c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:14.123700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19d9b82e-6ea0-428e-8e9f-58a610c3a70c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:14.153393 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-19d9b82e-6ea0-428e-8e9f-58a610c3a70c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1391 microversion: 2.1 time: 0.271282 Jul 28 04:13:14.171902 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3389/5839] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:13 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1391 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:14.200754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-528815b9-9531-410f-8ef8-30ad87852444 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:14.201187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-528815b9-9531-410f-8ef8-30ad87852444 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:14.209176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-528815b9-9531-410f-8ef8-30ad87852444 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:14.209836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-528815b9-9531-410f-8ef8-30ad87852444 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:14.210639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-528815b9-9531-410f-8ef8-30ad87852444 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:14.212713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-528815b9-9531-410f-8ef8-30ad87852444 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:14.319475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-528815b9-9531-410f-8ef8-30ad87852444 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:14.342965 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-528815b9-9531-410f-8ef8-30ad87852444 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1266 microversion: 2.1 time: 0.153225 Jul 28 04:13:14.344392 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3390/5840] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:14 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:14.487583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-69255d42-dc65-4cce-933c-8bc253e73183 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:14.488419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-69255d42-dc65-4cce-933c-8bc253e73183 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:14.513364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69255d42-dc65-4cce-933c-8bc253e73183 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:14.513963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69255d42-dc65-4cce-933c-8bc253e73183 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:14.515222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69255d42-dc65-4cce-933c-8bc253e73183 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:14.515666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69255d42-dc65-4cce-933c-8bc253e73183 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:14.617109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:14.699470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69255d42-dc65-4cce-933c-8bc253e73183 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:14.700923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69255d42-dc65-4cce-933c-8bc253e73183 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:14.701485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-69255d42-dc65-4cce-933c-8bc253e73183 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lazy-loading 'fault' on Instance uuid d4b6d7c1-b65f-465c-97d1-fe40465a3321 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:13:14.847951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-69255d42-dc65-4cce-933c-8bc253e73183 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0083854f0de14631ad15751829e34537', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '404ce0264e584456bfc6b523e914c408', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:14.864504 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-69255d42-dc65-4cce-933c-8bc253e73183 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 200 len: 1312 microversion: 2.1 time: 0.384993 Jul 28 04:13:14.865873 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3391/5841] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:14 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 1312 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:14.877589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-85b743ec-4310-4413-aa8b-c7c99e1f1a7d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:14.878933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-85b743ec-4310-4413-aa8b-c7c99e1f1a7d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:14.897286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85b743ec-4310-4413-aa8b-c7c99e1f1a7d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:14.898993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85b743ec-4310-4413-aa8b-c7c99e1f1a7d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:14.900054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85b743ec-4310-4413-aa8b-c7c99e1f1a7d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:14.903783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85b743ec-4310-4413-aa8b-c7c99e1f1a7d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:15.148547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-85b743ec-4310-4413-aa8b-c7c99e1f1a7d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:15.158422 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-85b743ec-4310-4413-aa8b-c7c99e1f1a7d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1500 microversion: 2.1 time: 0.290396 Jul 28 04:13:15.160904 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3392/5842] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:14 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1500 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:15.185004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b58b531-9ca8-47c8-9a88-394ea2977cdf tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:15.185960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b58b531-9ca8-47c8-9a88-394ea2977cdf tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:15.194076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b58b531-9ca8-47c8-9a88-394ea2977cdf tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:15.194754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b58b531-9ca8-47c8-9a88-394ea2977cdf tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:15.195693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b58b531-9ca8-47c8-9a88-394ea2977cdf tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:15.196305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b58b531-9ca8-47c8-9a88-394ea2977cdf tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:15.475521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b58b531-9ca8-47c8-9a88-394ea2977cdf tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:15.486301 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b58b531-9ca8-47c8-9a88-394ea2977cdf tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1500 microversion: 2.1 time: 0.309283 Jul 28 04:13:15.498228 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3393/5843] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:15 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1500 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:15.509081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca9637c8-b5e5-4c88-bb14-27f70f2baabe tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:15.509995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca9637c8-b5e5-4c88-bb14-27f70f2baabe tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:15.517252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca9637c8-b5e5-4c88-bb14-27f70f2baabe tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:15.518508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca9637c8-b5e5-4c88-bb14-27f70f2baabe tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:15.519477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca9637c8-b5e5-4c88-bb14-27f70f2baabe tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:15.520284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca9637c8-b5e5-4c88-bb14-27f70f2baabe tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:15.782508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca9637c8-b5e5-4c88-bb14-27f70f2baabe tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:15.796168 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca9637c8-b5e5-4c88-bb14-27f70f2baabe tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1562 microversion: 2.1 time: 0.296274 Jul 28 04:13:15.799866 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3394/5844] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:15 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1562 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:15.807092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44ca7e1d-7b6d-4059-8573-424a87338cf5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:15.808010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-44ca7e1d-7b6d-4059-8573-424a87338cf5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:15.818656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44ca7e1d-7b6d-4059-8573-424a87338cf5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:15.819362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44ca7e1d-7b6d-4059-8573-424a87338cf5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:15.820406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44ca7e1d-7b6d-4059-8573-424a87338cf5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:15.821083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44ca7e1d-7b6d-4059-8573-424a87338cf5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:15.939484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:16.242378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44ca7e1d-7b6d-4059-8573-424a87338cf5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:16.278966 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-44ca7e1d-7b6d-4059-8573-424a87338cf5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1308 microversion: 2.1 time: 0.475988 Jul 28 04:13:16.279896 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3395/5845] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:15 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1308 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:16.285209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-412c9458-ce73-4288-b4ee-726a6221ed40 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:16.285588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-412c9458-ce73-4288-b4ee-726a6221ed40 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:16.294321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-412c9458-ce73-4288-b4ee-726a6221ed40 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:16.305737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-412c9458-ce73-4288-b4ee-726a6221ed40 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:16.307328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-412c9458-ce73-4288-b4ee-726a6221ed40 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:16.313522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-412c9458-ce73-4288-b4ee-726a6221ed40 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:16.372745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-412c9458-ce73-4288-b4ee-726a6221ed40 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lazy-loading 'flavor' on Instance uuid 44ceb7cc-bc21-4f3d-835f-b1e579370843 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:13:16.490569 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-412c9458-ce73-4288-b4ee-726a6221ed40 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "POST /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843/action" status: 202 len: 0 microversion: 2.1 time: 0.208725 Jul 28 04:13:16.506885 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3396/5846] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:13:16 2022] POST /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:13:16.514404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b225610a-bf34-4e05-bb5c-70b90ad6ebd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:16.516495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b225610a-bf34-4e05-bb5c-70b90ad6ebd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:16.524486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b225610a-bf34-4e05-bb5c-70b90ad6ebd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:16.525739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b225610a-bf34-4e05-bb5c-70b90ad6ebd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:16.526845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b225610a-bf34-4e05-bb5c-70b90ad6ebd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:16.527645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b225610a-bf34-4e05-bb5c-70b90ad6ebd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:16.730386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b225610a-bf34-4e05-bb5c-70b90ad6ebd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:16.740859 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b225610a-bf34-4e05-bb5c-70b90ad6ebd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1562 microversion: 2.1 time: 0.232059 Jul 28 04:13:16.744932 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3397/5847] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:16 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1562 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:16.750227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dffbbfc8-c323-408b-9a75-6d676dfad6f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:16.751011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dffbbfc8-c323-408b-9a75-6d676dfad6f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] [instance: d4b6d7c1-b65f-465c-97d1-fe40465a3321] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:16.758868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dffbbfc8-c323-408b-9a75-6d676dfad6f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:16.759377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dffbbfc8-c323-408b-9a75-6d676dfad6f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:16.760174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dffbbfc8-c323-408b-9a75-6d676dfad6f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:16.760802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dffbbfc8-c323-408b-9a75-6d676dfad6f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:16.778997 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-dffbbfc8-c323-408b-9a75-6d676dfad6f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] HTTP exception thrown: Instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 could not be found. Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dffbbfc8-c323-408b-9a75-6d676dfad6f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Request method failure captured: Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 HTTP/1.1 Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4guRH7cRyy41e8TMK6yH4E4vas5YneK3wNd43QNSbwP-vnU4KJvI9xnqarrFpgm_3d_MoR1ZpAdJmMyZ8u5FsxNmotKsW-BhbDNoNezHFEg5JbZI4uqCMDxre0Fl2vlF1EpCS09lknpXT0acA4YXSeuR-688T4pmq6O5npCWbGdqMXs Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/404ce0264e584456bfc6b523e914c408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_404ce0264e584456bfc6b523e914c408"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/404ce0264e584456bfc6b523e914c408"}]}] Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 404ce0264e584456bfc6b523e914c408 Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1279517356 Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0083854f0de14631ad15751829e34537 Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1279517356-project Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 could not be found. Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd4b6d7c1-b65f-465c-97d1-fe40465a3321'} Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 could not be found. Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 could not be found. Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:16.780730 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:16.785045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:16.785045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:16.785045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:16.785045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:16.785045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:13:16.785045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:13:16.785045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 could not be found. Jul 28 04:13:16.785045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:16.785045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dffbbfc8-c323-408b-9a75-6d676dfad6f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] Returning 404 to user: Instance d4b6d7c1-b65f-465c-97d1-fe40465a3321 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:13:16.785045 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dffbbfc8-c323-408b-9a75-6d676dfad6f0 tempest-ServerRescueNegativeTestJSON-1279517356 tempest-ServerRescueNegativeTestJSON-1279517356-project] 10.222.0.48 "GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321" status: 404 len: 111 microversion: 2.1 time: 0.036510 Jul 28 04:13:16.785045 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3398/5848] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:16 2022] GET /compute/v2.1/servers/d4b6d7c1-b65f-465c-97d1-fe40465a3321 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:13:16.791928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e91609ee-5351-4bbf-b542-336f5a27cd80 req-4de6afe3-e115-4363-8ae5-19b4ee0a98e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3da1d44-8b38-4b60-afe7-4d1708c7abb3", "tag": "dd6483fb-9758-463e-bf54-d02588e1157f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:16.828390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e91609ee-5351-4bbf-b542-336f5a27cd80 req-4de6afe3-e115-4363-8ae5-19b4ee0a98e1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:16.828848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e91609ee-5351-4bbf-b542-336f5a27cd80 req-4de6afe3-e115-4363-8ae5-19b4ee0a98e1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:16.847973 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e91609ee-5351-4bbf-b542-336f5a27cd80 req-4de6afe3-e115-4363-8ae5-19b4ee0a98e1 service nova] Creating event network-changed:dd6483fb-9758-463e-bf54-d02588e1157f for instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 on n-h2-826756-3 Jul 28 04:13:16.858429 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e91609ee-5351-4bbf-b542-336f5a27cd80 req-4de6afe3-e115-4363-8ae5-19b4ee0a98e1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069677 Jul 28 04:13:16.860050 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3399/5849] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:16.866194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c0ec210-e0f4-4f27-8ceb-cf7edecd7aa3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:16.866931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c0ec210-e0f4-4f27-8ceb-cf7edecd7aa3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:16.875008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c0ec210-e0f4-4f27-8ceb-cf7edecd7aa3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:16.875472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c0ec210-e0f4-4f27-8ceb-cf7edecd7aa3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:16.876330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c0ec210-e0f4-4f27-8ceb-cf7edecd7aa3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:16.876793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c0ec210-e0f4-4f27-8ceb-cf7edecd7aa3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:17.111450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1c0ec210-e0f4-4f27-8ceb-cf7edecd7aa3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:17.128948 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c0ec210-e0f4-4f27-8ceb-cf7edecd7aa3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1508 microversion: 2.1 time: 0.267542 Jul 28 04:13:17.130030 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3400/5850] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:16 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:17.304426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-91a628a5-f932-4b7a-ad65-faaff2e380fd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:17.305054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-91a628a5-f932-4b7a-ad65-faaff2e380fd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:17.308165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=24 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:17.312704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91a628a5-f932-4b7a-ad65-faaff2e380fd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:17.313959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91a628a5-f932-4b7a-ad65-faaff2e380fd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:17.313959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91a628a5-f932-4b7a-ad65-faaff2e380fd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:17.314357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91a628a5-f932-4b7a-ad65-faaff2e380fd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:17.744970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-91a628a5-f932-4b7a-ad65-faaff2e380fd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:17.762137 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-91a628a5-f932-4b7a-ad65-faaff2e380fd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1308 microversion: 2.1 time: 0.460211 Jul 28 04:13:17.762497 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3401/5851] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:17 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1308 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:18.150673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1d2ea9d0-75fe-4682-aba7-3276e94a7aeb tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:18.151289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1d2ea9d0-75fe-4682-aba7-3276e94a7aeb tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:18.161595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d2ea9d0-75fe-4682-aba7-3276e94a7aeb tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:18.162047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d2ea9d0-75fe-4682-aba7-3276e94a7aeb tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:18.163337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d2ea9d0-75fe-4682-aba7-3276e94a7aeb tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:18.163780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d2ea9d0-75fe-4682-aba7-3276e94a7aeb tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:18.829236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1d2ea9d0-75fe-4682-aba7-3276e94a7aeb tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:18.843322 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1d2ea9d0-75fe-4682-aba7-3276e94a7aeb tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1491 microversion: 2.1 time: 0.696575 Jul 28 04:13:18.844936 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3402/5852] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:18 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1491 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:18.853246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-699019e6-716a-4c49-8bfb-99c8e48a152a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:18.854313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-699019e6-716a-4c49-8bfb-99c8e48a152a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:18.861285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-699019e6-716a-4c49-8bfb-99c8e48a152a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:18.862068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-699019e6-716a-4c49-8bfb-99c8e48a152a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:18.863006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-699019e6-716a-4c49-8bfb-99c8e48a152a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:18.863605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-699019e6-716a-4c49-8bfb-99c8e48a152a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:19.301292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-699019e6-716a-4c49-8bfb-99c8e48a152a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:19.318148 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-699019e6-716a-4c49-8bfb-99c8e48a152a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1308 microversion: 2.1 time: 0.471469 Jul 28 04:13:19.319652 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3403/5853] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:18 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1308 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:19.330462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8632f0f1-9355-41d1-8e06-beea88d1b165 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:19.332194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8632f0f1-9355-41d1-8e06-beea88d1b165 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:19.345507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8632f0f1-9355-41d1-8e06-beea88d1b165 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:19.346182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8632f0f1-9355-41d1-8e06-beea88d1b165 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:19.347271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8632f0f1-9355-41d1-8e06-beea88d1b165 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:19.347900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8632f0f1-9355-41d1-8e06-beea88d1b165 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:19.478096 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8632f0f1-9355-41d1-8e06-beea88d1b165 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "POST /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843/action" status: 202 len: 0 microversion: 2.1 time: 0.156299 Jul 28 04:13:19.479505 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3404/5854] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:13:19 2022] POST /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:13:19.488744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74910d9d-7f57-4f92-82a9-d4cbbf128c39 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:19.489571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74910d9d-7f57-4f92-82a9-d4cbbf128c39 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:19.503968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74910d9d-7f57-4f92-82a9-d4cbbf128c39 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:19.506653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74910d9d-7f57-4f92-82a9-d4cbbf128c39 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:19.509272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74910d9d-7f57-4f92-82a9-d4cbbf128c39 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:19.509893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74910d9d-7f57-4f92-82a9-d4cbbf128c39 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:20.296636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-74910d9d-7f57-4f92-82a9-d4cbbf128c39 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:20.325166 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74910d9d-7f57-4f92-82a9-d4cbbf128c39 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1497 microversion: 2.1 time: 0.841283 Jul 28 04:13:20.341162 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3405/5855] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:19 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1497 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:20.452407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cb94dd48-2fb3-472b-bba4-4afc3a31f8ac tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:20.453391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cb94dd48-2fb3-472b-bba4-4afc3a31f8ac tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:20.462390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb94dd48-2fb3-472b-bba4-4afc3a31f8ac tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:20.463101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb94dd48-2fb3-472b-bba4-4afc3a31f8ac tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:20.464097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb94dd48-2fb3-472b-bba4-4afc3a31f8ac tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:20.464877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb94dd48-2fb3-472b-bba4-4afc3a31f8ac tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:20.494987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:21.016734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cb94dd48-2fb3-472b-bba4-4afc3a31f8ac tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:21.029957 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cb94dd48-2fb3-472b-bba4-4afc3a31f8ac tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1308 microversion: 2.1 time: 0.581940 Jul 28 04:13:21.049225 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3406/5856] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:20 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1308 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:21.058348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-67e48e3a-af43-404f-b93e-b1a77dd94242 req-419986e5-124f-4fd5-b999-8e7aab30a379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3da1d44-8b38-4b60-afe7-4d1708c7abb3", "name": "network-vif-plugged", "status": "completed", "tag": "dd6483fb-9758-463e-bf54-d02588e1157f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:21.072027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-67e48e3a-af43-404f-b93e-b1a77dd94242 req-419986e5-124f-4fd5-b999-8e7aab30a379 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:21.072613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-67e48e3a-af43-404f-b93e-b1a77dd94242 req-419986e5-124f-4fd5-b999-8e7aab30a379 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:21.086881 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-67e48e3a-af43-404f-b93e-b1a77dd94242 req-419986e5-124f-4fd5-b999-8e7aab30a379 service nova] Creating event network-vif-plugged:dd6483fb-9758-463e-bf54-d02588e1157f for instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 on n-h2-826756-3 Jul 28 04:13:21.093740 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-67e48e3a-af43-404f-b93e-b1a77dd94242 req-419986e5-124f-4fd5-b999-8e7aab30a379 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041454 Jul 28 04:13:21.096815 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3407/5857] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:21.348247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-71e099e3-c200-4d8c-b20d-4995158c327e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:21.349964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-71e099e3-c200-4d8c-b20d-4995158c327e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:21.362615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71e099e3-c200-4d8c-b20d-4995158c327e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:21.364079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71e099e3-c200-4d8c-b20d-4995158c327e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:21.365139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71e099e3-c200-4d8c-b20d-4995158c327e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:21.365785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71e099e3-c200-4d8c-b20d-4995158c327e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:21.664620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-71e099e3-c200-4d8c-b20d-4995158c327e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:21.676940 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-71e099e3-c200-4d8c-b20d-4995158c327e tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1500 microversion: 2.1 time: 0.332952 Jul 28 04:13:21.704189 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3408/5858] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:21 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1500 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:21.715576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-341c7fc2-5acb-41ff-966f-5675305cf0f5 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:21.716134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-341c7fc2-5acb-41ff-966f-5675305cf0f5 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:21.724220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-341c7fc2-5acb-41ff-966f-5675305cf0f5 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:21.724742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-341c7fc2-5acb-41ff-966f-5675305cf0f5 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:21.725806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-341c7fc2-5acb-41ff-966f-5675305cf0f5 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:21.726292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-341c7fc2-5acb-41ff-966f-5675305cf0f5 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:21.771472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-341c7fc2-5acb-41ff-966f-5675305cf0f5 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lazy-loading 'flavor' on Instance uuid 44ceb7cc-bc21-4f3d-835f-b1e579370843 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:13:21.890118 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-341c7fc2-5acb-41ff-966f-5675305cf0f5 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "POST /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843/action" status: 202 len: 0 microversion: 2.1 time: 0.180392 Jul 28 04:13:21.891439 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3409/5859] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:13:21 2022] POST /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:13:21.924466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f2e1b55-d309-40d9-96f3-bb1680fe0519 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:21.927519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f2e1b55-d309-40d9-96f3-bb1680fe0519 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:21.934494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:21.936716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f2e1b55-d309-40d9-96f3-bb1680fe0519 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:21.937403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f2e1b55-d309-40d9-96f3-bb1680fe0519 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:21.938321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f2e1b55-d309-40d9-96f3-bb1680fe0519 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:21.938785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f2e1b55-d309-40d9-96f3-bb1680fe0519 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:22.330090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f2e1b55-d309-40d9-96f3-bb1680fe0519 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:22.343767 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f2e1b55-d309-40d9-96f3-bb1680fe0519 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1508 microversion: 2.1 time: 0.446852 Jul 28 04:13:22.344935 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3410/5860] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:21 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1508 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:22.364620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca92ae86-44a9-4739-8a9c-b52f878a67d5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:22.365591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca92ae86-44a9-4739-8a9c-b52f878a67d5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:22.373632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca92ae86-44a9-4739-8a9c-b52f878a67d5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:22.374116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca92ae86-44a9-4739-8a9c-b52f878a67d5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:22.375696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca92ae86-44a9-4739-8a9c-b52f878a67d5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:22.376149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca92ae86-44a9-4739-8a9c-b52f878a67d5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:22.668893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca92ae86-44a9-4739-8a9c-b52f878a67d5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:22.681660 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca92ae86-44a9-4739-8a9c-b52f878a67d5 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1308 microversion: 2.1 time: 0.333962 Jul 28 04:13:22.682299 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3411/5861] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:22 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1308 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:22.696593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa55c982-8b83-4ded-9e73-b53f52e77838 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:22.697548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fa55c982-8b83-4ded-9e73-b53f52e77838 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:22.711685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa55c982-8b83-4ded-9e73-b53f52e77838 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:22.712130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa55c982-8b83-4ded-9e73-b53f52e77838 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:22.717236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa55c982-8b83-4ded-9e73-b53f52e77838 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:22.717708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa55c982-8b83-4ded-9e73-b53f52e77838 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:23.113401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa55c982-8b83-4ded-9e73-b53f52e77838 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:23.126165 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fa55c982-8b83-4ded-9e73-b53f52e77838 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1562 microversion: 2.1 time: 0.442739 Jul 28 04:13:23.144297 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3412/5862] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:22 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1562 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:23.284979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-062c57f2-a9c2-4a13-8911-adfe4b5b2e8d req-871ff819-afc7-4338-b49c-0433566a2351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b621e0-6ff2-44af-b71b-9d9178e3fdbd", "tag": "12359d9a-9928-43ee-8d00-b4cef96dc189"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:23.312173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-062c57f2-a9c2-4a13-8911-adfe4b5b2e8d req-871ff819-afc7-4338-b49c-0433566a2351 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:23.312890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-062c57f2-a9c2-4a13-8911-adfe4b5b2e8d req-871ff819-afc7-4338-b49c-0433566a2351 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:23.366454 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-062c57f2-a9c2-4a13-8911-adfe4b5b2e8d req-871ff819-afc7-4338-b49c-0433566a2351 service nova] Creating event network-changed:12359d9a-9928-43ee-8d00-b4cef96dc189 for instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd on n-h2-826756-3 Jul 28 04:13:23.380213 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-062c57f2-a9c2-4a13-8911-adfe4b5b2e8d req-871ff819-afc7-4338-b49c-0433566a2351 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.234049 Jul 28 04:13:23.381588 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3413/5863] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:23.398836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-155edf16-7c83-4b25-99d8-90adafe5ee8a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:23.400774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-155edf16-7c83-4b25-99d8-90adafe5ee8a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:23.458193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-155edf16-7c83-4b25-99d8-90adafe5ee8a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:23.461403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-155edf16-7c83-4b25-99d8-90adafe5ee8a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:23.462415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-155edf16-7c83-4b25-99d8-90adafe5ee8a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:23.462879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-155edf16-7c83-4b25-99d8-90adafe5ee8a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:23.919106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-155edf16-7c83-4b25-99d8-90adafe5ee8a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:23.927853 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-155edf16-7c83-4b25-99d8-90adafe5ee8a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1491 microversion: 2.1 time: 0.544350 Jul 28 04:13:23.938519 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3414/5864] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:23 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1491 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:23.945888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-32f76c04-8394-439f-a58b-2f18e27fedb7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:23.949043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-32f76c04-8394-439f-a58b-2f18e27fedb7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:23.964627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32f76c04-8394-439f-a58b-2f18e27fedb7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:23.965322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32f76c04-8394-439f-a58b-2f18e27fedb7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:23.967332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32f76c04-8394-439f-a58b-2f18e27fedb7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:23.970091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32f76c04-8394-439f-a58b-2f18e27fedb7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:24.334510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-32f76c04-8394-439f-a58b-2f18e27fedb7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:24.373803 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-32f76c04-8394-439f-a58b-2f18e27fedb7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1488 microversion: 2.1 time: 0.433876 Jul 28 04:13:24.374448 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3415/5865] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:23 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1488 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:24.411854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7bdd33dc-47dc-4908-a180-82cb195fb39d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:24.412452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7bdd33dc-47dc-4908-a180-82cb195fb39d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:24.459417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bdd33dc-47dc-4908-a180-82cb195fb39d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:24.461216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bdd33dc-47dc-4908-a180-82cb195fb39d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:24.468554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bdd33dc-47dc-4908-a180-82cb195fb39d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:24.474094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bdd33dc-47dc-4908-a180-82cb195fb39d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:24.715027 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7bdd33dc-47dc-4908-a180-82cb195fb39d tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "POST /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843/action" status: 202 len: 0 microversion: 2.1 time: 0.314154 Jul 28 04:13:24.718630 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3416/5866] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:13:24 2022] POST /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:13:24.750751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3a6b3018-70e5-42f1-9879-8386766be286 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1615938371"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:24.757711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3a6b3018-70e5-42f1-9879-8386766be286 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:24.775352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a6b3018-70e5-42f1-9879-8386766be286 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:24.775755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a6b3018-70e5-42f1-9879-8386766be286 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:24.776943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a6b3018-70e5-42f1-9879-8386766be286 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:24.789438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a6b3018-70e5-42f1-9879-8386766be286 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:24.928587 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3a6b3018-70e5-42f1-9879-8386766be286 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "PUT /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1074 microversion: 2.1 time: 0.206668 Jul 28 04:13:24.940584 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3417/5867] 10.222.0.48 () {60 vars in 1256 bytes} [Thu Jul 28 04:13:24 2022] PUT /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1074 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:24.945646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc6ba735-c455-41d3-86b3-e123f69c7c7f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:24.946389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dc6ba735-c455-41d3-86b3-e123f69c7c7f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:24.961532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc6ba735-c455-41d3-86b3-e123f69c7c7f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:24.962056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc6ba735-c455-41d3-86b3-e123f69c7c7f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:24.962892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc6ba735-c455-41d3-86b3-e123f69c7c7f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:24.963346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc6ba735-c455-41d3-86b3-e123f69c7c7f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:25.890018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dc6ba735-c455-41d3-86b3-e123f69c7c7f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:25.902843 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc6ba735-c455-41d3-86b3-e123f69c7c7f tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1497 microversion: 2.1 time: 0.960755 Jul 28 04:13:25.903560 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3418/5868] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:24 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1497 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:25.910233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bfb56c14-f9af-4ba6-a142-c4183d131676 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:25.912558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bfb56c14-f9af-4ba6-a142-c4183d131676 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:25.924624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfb56c14-f9af-4ba6-a142-c4183d131676 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:25.925355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfb56c14-f9af-4ba6-a142-c4183d131676 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:25.926264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfb56c14-f9af-4ba6-a142-c4183d131676 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:25.928143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfb56c14-f9af-4ba6-a142-c4183d131676 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:26.142028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bfb56c14-f9af-4ba6-a142-c4183d131676 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:26.153967 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bfb56c14-f9af-4ba6-a142-c4183d131676 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1500 microversion: 2.1 time: 0.248477 Jul 28 04:13:26.154746 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3419/5869] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:25 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1500 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:26.176668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6a56502e-0c05-4b18-8713-55e3cc176064 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:26.177284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6a56502e-0c05-4b18-8713-55e3cc176064 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:26.183859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a56502e-0c05-4b18-8713-55e3cc176064 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:26.184311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a56502e-0c05-4b18-8713-55e3cc176064 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:26.185338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a56502e-0c05-4b18-8713-55e3cc176064 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:26.185784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a56502e-0c05-4b18-8713-55e3cc176064 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:26.381162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6a56502e-0c05-4b18-8713-55e3cc176064 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:26.390819 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6a56502e-0c05-4b18-8713-55e3cc176064 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1500 microversion: 2.1 time: 0.218532 Jul 28 04:13:26.392144 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3420/5870] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:26 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1500 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:26.417702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a389b4b1-0ff7-4d56-b7af-42772ecf490a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:26.425510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a389b4b1-0ff7-4d56-b7af-42772ecf490a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:26.425972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a389b4b1-0ff7-4d56-b7af-42772ecf490a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:26.430651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:26.481557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a389b4b1-0ff7-4d56-b7af-42772ecf490a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Going to try to stop instance {{(pid=126071) force_stop /opt/stack/nova/nova/compute/api.py:2753}} Jul 28 04:13:26.601184 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a389b4b1-0ff7-4d56-b7af-42772ecf490a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "POST /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3/action" status: 202 len: 0 microversion: 2.1 time: 0.188007 Jul 28 04:13:26.620195 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3421/5871] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:13:26 2022] POST /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:13:26.648720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bfc8d468-bb2e-43d6-9756-66d5c9ad9b64 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:26.655131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bfc8d468-bb2e-43d6-9756-66d5c9ad9b64 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:26.671896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfc8d468-bb2e-43d6-9756-66d5c9ad9b64 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:26.672311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfc8d468-bb2e-43d6-9756-66d5c9ad9b64 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:26.673125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfc8d468-bb2e-43d6-9756-66d5c9ad9b64 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:26.673614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfc8d468-bb2e-43d6-9756-66d5c9ad9b64 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:27.088108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bfc8d468-bb2e-43d6-9756-66d5c9ad9b64 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:27.098491 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bfc8d468-bb2e-43d6-9756-66d5c9ad9b64 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.472378 Jul 28 04:13:27.117237 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3422/5872] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:26 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:27.135916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-73cbab52-ce9a-4fc0-8494-6b80afad513b tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:27.136829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-73cbab52-ce9a-4fc0-8494-6b80afad513b tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:27.161767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73cbab52-ce9a-4fc0-8494-6b80afad513b tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:27.162528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73cbab52-ce9a-4fc0-8494-6b80afad513b tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:27.163532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73cbab52-ce9a-4fc0-8494-6b80afad513b tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:27.165848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73cbab52-ce9a-4fc0-8494-6b80afad513b tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:27.475770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-73cbab52-ce9a-4fc0-8494-6b80afad513b tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:27.486085 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-73cbab52-ce9a-4fc0-8494-6b80afad513b tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1497 microversion: 2.1 time: 0.356254 Jul 28 04:13:27.486953 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3423/5873] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:27 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1497 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:28.142920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83bb3a3a-b376-493b-957f-f03f2e7eb5e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:28.143820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-83bb3a3a-b376-493b-957f-f03f2e7eb5e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:28.160260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83bb3a3a-b376-493b-957f-f03f2e7eb5e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:28.160805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83bb3a3a-b376-493b-957f-f03f2e7eb5e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:28.161532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83bb3a3a-b376-493b-957f-f03f2e7eb5e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:28.162020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83bb3a3a-b376-493b-957f-f03f2e7eb5e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:28.481565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-83bb3a3a-b376-493b-957f-f03f2e7eb5e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:28.518785 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-83bb3a3a-b376-493b-957f-f03f2e7eb5e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.379896 Jul 28 04:13:28.532459 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3424/5874] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:28 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:28.537363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-277f1707-544d-461a-affc-7636ad2c780a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:28.541214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-277f1707-544d-461a-affc-7636ad2c780a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:28.559015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-277f1707-544d-461a-affc-7636ad2c780a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:28.559429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-277f1707-544d-461a-affc-7636ad2c780a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:28.560330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-277f1707-544d-461a-affc-7636ad2c780a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:28.560657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-277f1707-544d-461a-affc-7636ad2c780a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:28.915781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-277f1707-544d-461a-affc-7636ad2c780a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:28.938421 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-277f1707-544d-461a-affc-7636ad2c780a tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1500 microversion: 2.1 time: 0.404395 Jul 28 04:13:28.950921 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3425/5875] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:28 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1500 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:28.973235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-18b81076-a36d-4dc1-a3d6-5ba6ce10f9d3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:28.976125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-18b81076-a36d-4dc1-a3d6-5ba6ce10f9d3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:28.998416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18b81076-a36d-4dc1-a3d6-5ba6ce10f9d3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:28.999338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18b81076-a36d-4dc1-a3d6-5ba6ce10f9d3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:29.000394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18b81076-a36d-4dc1-a3d6-5ba6ce10f9d3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:29.001052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18b81076-a36d-4dc1-a3d6-5ba6ce10f9d3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:29.066030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-18b81076-a36d-4dc1-a3d6-5ba6ce10f9d3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:13:29.219525 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-18b81076-a36d-4dc1-a3d6-5ba6ce10f9d3 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "DELETE /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 204 len: 0 microversion: 2.1 time: 0.256306 Jul 28 04:13:29.224563 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3426/5876] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:13:28 2022] DELETE /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:13:29.238344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-56bcabd2-28ff-4cfe-9b98-4cb0bf70b932 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:29.239208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-56bcabd2-28ff-4cfe-9b98-4cb0bf70b932 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:29.258284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56bcabd2-28ff-4cfe-9b98-4cb0bf70b932 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:29.265359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56bcabd2-28ff-4cfe-9b98-4cb0bf70b932 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:29.265359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56bcabd2-28ff-4cfe-9b98-4cb0bf70b932 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:29.265359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56bcabd2-28ff-4cfe-9b98-4cb0bf70b932 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:29.494989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-56bcabd2-28ff-4cfe-9b98-4cb0bf70b932 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:29.505853 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-56bcabd2-28ff-4cfe-9b98-4cb0bf70b932 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1506 microversion: 2.1 time: 0.278289 Jul 28 04:13:29.520955 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3427/5877] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:29 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:29.543591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-33ce2b4c-d7a3-481c-8620-9f905a043378 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:29.544471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-33ce2b4c-d7a3-481c-8620-9f905a043378 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:29.554482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33ce2b4c-d7a3-481c-8620-9f905a043378 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:29.555171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33ce2b4c-d7a3-481c-8620-9f905a043378 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:29.556151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33ce2b4c-d7a3-481c-8620-9f905a043378 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:29.556855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33ce2b4c-d7a3-481c-8620-9f905a043378 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:29.788071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-33ce2b4c-d7a3-481c-8620-9f905a043378 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:29.799683 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-33ce2b4c-d7a3-481c-8620-9f905a043378 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.262037 Jul 28 04:13:29.799683 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3428/5878] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:29 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:30.527848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70ea34e0-60b1-4cd9-954c-1fb5cfdbbb04 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:30.529163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-70ea34e0-60b1-4cd9-954c-1fb5cfdbbb04 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:30.549841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70ea34e0-60b1-4cd9-954c-1fb5cfdbbb04 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:30.551316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70ea34e0-60b1-4cd9-954c-1fb5cfdbbb04 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:30.553905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70ea34e0-60b1-4cd9-954c-1fb5cfdbbb04 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:30.577201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70ea34e0-60b1-4cd9-954c-1fb5cfdbbb04 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:31.095263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-70ea34e0-60b1-4cd9-954c-1fb5cfdbbb04 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:31.110492 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-70ea34e0-60b1-4cd9-954c-1fb5cfdbbb04 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1506 microversion: 2.1 time: 0.584663 Jul 28 04:13:31.138199 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3429/5879] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:30 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1506 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:31.147524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-745c794d-f331-48e4-9151-34fc8928b3e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:31.149265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-745c794d-f331-48e4-9151-34fc8928b3e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:31.170720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-745c794d-f331-48e4-9151-34fc8928b3e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:31.177354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-745c794d-f331-48e4-9151-34fc8928b3e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:31.178602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-745c794d-f331-48e4-9151-34fc8928b3e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:31.179192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-745c794d-f331-48e4-9151-34fc8928b3e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:31.484153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-745c794d-f331-48e4-9151-34fc8928b3e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:31.495159 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-745c794d-f331-48e4-9151-34fc8928b3e9 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.355183 Jul 28 04:13:31.511186 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3430/5880] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:31 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:32.147457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e2edb317-8eb5-4c49-af99-78bedc3518c6 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:32.148895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e2edb317-8eb5-4c49-af99-78bedc3518c6 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:32.160026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2edb317-8eb5-4c49-af99-78bedc3518c6 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:32.160805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2edb317-8eb5-4c49-af99-78bedc3518c6 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:32.161932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2edb317-8eb5-4c49-af99-78bedc3518c6 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:32.162551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e2edb317-8eb5-4c49-af99-78bedc3518c6 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:32.469873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e2edb317-8eb5-4c49-af99-78bedc3518c6 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '548b20b462c24cdbbd4884a2ece2d6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01aafd04e21f4453b7833ee95d4937ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:32.493407 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e2edb317-8eb5-4c49-af99-78bedc3518c6 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 200 len: 1506 microversion: 2.1 time: 0.351922 Jul 28 04:13:32.495075 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3431/5881] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:32 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:32.520648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f60e533-77a3-4103-8789-544e553ef51f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:32.521279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2f60e533-77a3-4103-8789-544e553ef51f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:32.535145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f60e533-77a3-4103-8789-544e553ef51f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:32.535590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f60e533-77a3-4103-8789-544e553ef51f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:32.536381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f60e533-77a3-4103-8789-544e553ef51f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:32.538803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f60e533-77a3-4103-8789-544e553ef51f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:32.878042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2f60e533-77a3-4103-8789-544e553ef51f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:32.888203 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2f60e533-77a3-4103-8789-544e553ef51f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.375415 Jul 28 04:13:32.907275 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3432/5882] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:32 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:32.913883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-53368c2b-9626-4f6f-9e1f-f4fb1fc4be9f req-28dff0a4-f7b6-4ea7-b102-83cc8782c809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ceb7cc-bc21-4f3d-835f-b1e579370843", "name": "network-vif-deleted", "tag": "6ccc17f6-399f-4b3f-9a84-4a15da0f6083"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:32.928442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-53368c2b-9626-4f6f-9e1f-f4fb1fc4be9f req-28dff0a4-f7b6-4ea7-b102-83cc8782c809 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:32.929166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-53368c2b-9626-4f6f-9e1f-f4fb1fc4be9f req-28dff0a4-f7b6-4ea7-b102-83cc8782c809 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:32.943799 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-53368c2b-9626-4f6f-9e1f-f4fb1fc4be9f req-28dff0a4-f7b6-4ea7-b102-83cc8782c809 service nova] Creating event network-vif-deleted:6ccc17f6-399f-4b3f-9a84-4a15da0f6083 for instance 44ceb7cc-bc21-4f3d-835f-b1e579370843 on n-h1-826756-3 Jul 28 04:13:32.951309 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-53368c2b-9626-4f6f-9e1f-f4fb1fc4be9f req-28dff0a4-f7b6-4ea7-b102-83cc8782c809 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042381 Jul 28 04:13:32.952746 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3433/5883] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:33.518786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f322b520-6702-42fb-bd96-b057583b2c14 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:33.519512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f322b520-6702-42fb-bd96-b057583b2c14 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] [instance: 44ceb7cc-bc21-4f3d-835f-b1e579370843] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:33.539494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f322b520-6702-42fb-bd96-b057583b2c14 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:33.540001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f322b520-6702-42fb-bd96-b057583b2c14 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:33.545288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f322b520-6702-42fb-bd96-b057583b2c14 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:33.545755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f322b520-6702-42fb-bd96-b057583b2c14 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:33.598209 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-f322b520-6702-42fb-bd96-b057583b2c14 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] HTTP exception thrown: Instance 44ceb7cc-bc21-4f3d-835f-b1e579370843 could not be found. Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f322b520-6702-42fb-bd96-b057583b2c14 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Request method failure captured: Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 HTTP/1.1 Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gzAz3hgjGPlPoLqbOTrudELzuILQV83wov9lR41Vn0P382odzMdNRyw7VTSDvty77rTeIQJvY4K1B5mnyf2vaOkkHHX79lEDI3jbE1uMyjF-G3fIOnYGff_cDx7OTx0ZiET18bpM2SPlO3CdCMFBKcQMEAnSBDfdXiNY75ihmZlkVg Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 01aafd04e21f4453b7833ee95d4937ff Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestServerAdvancedOps-1528653066 Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/01aafd04e21f4453b7833ee95d4937ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/01aafd04e21f4453b7833ee95d4937ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_01aafd04e21f4453b7833ee95d4937ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/01aafd04e21f4453b7833ee95d4937ff"}]}] Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestServerAdvancedOps-1528653066 Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 01aafd04e21f4453b7833ee95d4937ff Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestServerAdvancedOps-1528653066 Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestServerAdvancedOps-1528653066-project Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 548b20b462c24cdbbd4884a2ece2d6d2 Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestServerAdvancedOps-1528653066-project Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 44ceb7cc-bc21-4f3d-835f-b1e579370843 could not be found. Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '44ceb7cc-bc21-4f3d-835f-b1e579370843'} Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44ceb7cc-bc21-4f3d-835f-b1e579370843 could not be found. Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44ceb7cc-bc21-4f3d-835f-b1e579370843 could not be found. Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:13:33.607183 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:33.611107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:13:33.611107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:13:33.611107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:13:33.611107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:13:33.611107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:13:33.611107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44ceb7cc-bc21-4f3d-835f-b1e579370843 could not be found. Jul 28 04:13:33.611107 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:13:33.612561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f322b520-6702-42fb-bd96-b057583b2c14 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] Returning 404 to user: Instance 44ceb7cc-bc21-4f3d-835f-b1e579370843 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:13:33.613612 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f322b520-6702-42fb-bd96-b057583b2c14 tempest-TestServerAdvancedOps-1528653066 tempest-TestServerAdvancedOps-1528653066-project] 10.222.0.48 "GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843" status: 404 len: 111 microversion: 2.1 time: 0.101649 Jul 28 04:13:33.614360 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3434/5884] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:33 2022] GET /compute/v2.1/servers/44ceb7cc-bc21-4f3d-835f-b1e579370843 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:13:33.918264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c11a12c9-c38a-4427-ba75-79400e39961b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:33.919561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c11a12c9-c38a-4427-ba75-79400e39961b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:33.934888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c11a12c9-c38a-4427-ba75-79400e39961b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:33.935353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c11a12c9-c38a-4427-ba75-79400e39961b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:33.936666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c11a12c9-c38a-4427-ba75-79400e39961b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:33.937352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c11a12c9-c38a-4427-ba75-79400e39961b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:34.145111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c11a12c9-c38a-4427-ba75-79400e39961b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:34.159935 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c11a12c9-c38a-4427-ba75-79400e39961b tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.249147 Jul 28 04:13:34.161203 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3435/5885] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:33 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:35.190946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8024714f-78e7-4cb3-87a2-644c118270f8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:35.193068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8024714f-78e7-4cb3-87a2-644c118270f8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:35.210667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8024714f-78e7-4cb3-87a2-644c118270f8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:35.211364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8024714f-78e7-4cb3-87a2-644c118270f8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:35.213001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8024714f-78e7-4cb3-87a2-644c118270f8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:35.214178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8024714f-78e7-4cb3-87a2-644c118270f8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:35.270483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:35.537032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8024714f-78e7-4cb3-87a2-644c118270f8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:35.547440 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8024714f-78e7-4cb3-87a2-644c118270f8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.362724 Jul 28 04:13:35.548024 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3436/5886] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:35 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:36.580564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40f0706c-edaa-4633-be81-d180938029bc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:36.582325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40f0706c-edaa-4633-be81-d180938029bc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:36.596590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40f0706c-edaa-4633-be81-d180938029bc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:36.597794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40f0706c-edaa-4633-be81-d180938029bc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:36.598836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40f0706c-edaa-4633-be81-d180938029bc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:36.599482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40f0706c-edaa-4633-be81-d180938029bc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:36.865883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40f0706c-edaa-4633-be81-d180938029bc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:36.876419 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40f0706c-edaa-4633-be81-d180938029bc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.307659 Jul 28 04:13:36.892704 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3437/5887] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:36 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:37.301452 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:13:37.301941 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:13:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:13:37.916931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3d423f2c-3e5d-419b-81b2-dc004da50469 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:37.919234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3d423f2c-3e5d-419b-81b2-dc004da50469 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:37.960710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d423f2c-3e5d-419b-81b2-dc004da50469 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:37.963120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d423f2c-3e5d-419b-81b2-dc004da50469 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:37.966799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d423f2c-3e5d-419b-81b2-dc004da50469 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:37.967467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d423f2c-3e5d-419b-81b2-dc004da50469 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:38.337386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3d423f2c-3e5d-419b-81b2-dc004da50469 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:38.349627 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3d423f2c-3e5d-419b-81b2-dc004da50469 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.451533 Jul 28 04:13:38.351832 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3438/5888] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:37 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:38.354300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3d423f2c-3e5d-419b-81b2-dc004da50469 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:38.356120 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3d423f2c-3e5d-419b-81b2-dc004da50469 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002652 Jul 28 04:13:38.358529 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3439/5889] 10.222.0.48 () {56 vars in 886 bytes} [Thu Jul 28 04:13:38 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 28 04:13:39.379753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-984fa0e2-cfcf-49a9-ae09-8511e989e3dd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:39.380658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-984fa0e2-cfcf-49a9-ae09-8511e989e3dd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:39.396146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-984fa0e2-cfcf-49a9-ae09-8511e989e3dd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:39.396813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-984fa0e2-cfcf-49a9-ae09-8511e989e3dd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:39.401965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-984fa0e2-cfcf-49a9-ae09-8511e989e3dd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:39.402635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-984fa0e2-cfcf-49a9-ae09-8511e989e3dd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:39.653516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-984fa0e2-cfcf-49a9-ae09-8511e989e3dd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:39.670885 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-984fa0e2-cfcf-49a9-ae09-8511e989e3dd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.295067 Jul 28 04:13:39.672620 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3440/5890] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:39 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:40.709228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f29878f4-0424-47dc-845a-8b104322fd63 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:40.710326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f29878f4-0424-47dc-845a-8b104322fd63 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:40.728402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f29878f4-0424-47dc-845a-8b104322fd63 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:40.728845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f29878f4-0424-47dc-845a-8b104322fd63 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:40.729628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f29878f4-0424-47dc-845a-8b104322fd63 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:40.730076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f29878f4-0424-47dc-845a-8b104322fd63 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:41.038739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f29878f4-0424-47dc-845a-8b104322fd63 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:41.049885 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f29878f4-0424-47dc-845a-8b104322fd63 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.357300 Jul 28 04:13:41.063416 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3441/5891] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:40 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:42.083939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aa61450e-d54e-409b-a9d2-73bf187ecf27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:42.084622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aa61450e-d54e-409b-a9d2-73bf187ecf27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:42.094375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa61450e-d54e-409b-a9d2-73bf187ecf27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:42.094816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa61450e-d54e-409b-a9d2-73bf187ecf27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:42.107780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa61450e-d54e-409b-a9d2-73bf187ecf27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:42.108527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa61450e-d54e-409b-a9d2-73bf187ecf27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:42.345269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aa61450e-d54e-409b-a9d2-73bf187ecf27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:42.370623 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aa61450e-d54e-409b-a9d2-73bf187ecf27 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.290498 Jul 28 04:13:42.374799 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3442/5892] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:42 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:43.398071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a6cc038f-bd87-4c88-bb5c-4ef30abf4761 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:43.400519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a6cc038f-bd87-4c88-bb5c-4ef30abf4761 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:43.430936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6cc038f-bd87-4c88-bb5c-4ef30abf4761 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:43.432532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6cc038f-bd87-4c88-bb5c-4ef30abf4761 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:43.434531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6cc038f-bd87-4c88-bb5c-4ef30abf4761 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:43.435154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6cc038f-bd87-4c88-bb5c-4ef30abf4761 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:43.876302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a6cc038f-bd87-4c88-bb5c-4ef30abf4761 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:43.888314 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a6cc038f-bd87-4c88-bb5c-4ef30abf4761 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.496833 Jul 28 04:13:43.888943 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3443/5893] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:43 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:44.912842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5e8b9fc-d2cc-492d-9eb3-dd3024875c8f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:44.914948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b5e8b9fc-d2cc-492d-9eb3-dd3024875c8f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:44.924726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5e8b9fc-d2cc-492d-9eb3-dd3024875c8f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:44.925397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5e8b9fc-d2cc-492d-9eb3-dd3024875c8f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:44.926632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5e8b9fc-d2cc-492d-9eb3-dd3024875c8f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:44.927471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5e8b9fc-d2cc-492d-9eb3-dd3024875c8f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:45.207615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b5e8b9fc-d2cc-492d-9eb3-dd3024875c8f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:45.217438 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5e8b9fc-d2cc-492d-9eb3-dd3024875c8f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.309945 Jul 28 04:13:45.218298 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3444/5894] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:44 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:46.224044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f511a27e-9165-49d3-9a17-2b6a08c64dce tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:46.227873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f511a27e-9165-49d3-9a17-2b6a08c64dce tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:46.247776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f511a27e-9165-49d3-9a17-2b6a08c64dce tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:46.248867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f511a27e-9165-49d3-9a17-2b6a08c64dce tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:46.250116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f511a27e-9165-49d3-9a17-2b6a08c64dce tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:46.250730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f511a27e-9165-49d3-9a17-2b6a08c64dce tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:46.343096 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f511a27e-9165-49d3-9a17-2b6a08c64dce tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd/action" status: 200 len: 24571 microversion: 2.1 time: 0.127379 Jul 28 04:13:46.343767 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3445/5895] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:13:46 2022] POST /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd/action => generated 24571 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:13:46.358403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8cf972cf-f9af-4d28-8804-14e8fef191d7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:46.359685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8cf972cf-f9af-4d28-8804-14e8fef191d7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:46.369090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cf972cf-f9af-4d28-8804-14e8fef191d7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:46.369994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cf972cf-f9af-4d28-8804-14e8fef191d7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:46.370957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cf972cf-f9af-4d28-8804-14e8fef191d7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:46.371541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cf972cf-f9af-4d28-8804-14e8fef191d7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:46.615327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8cf972cf-f9af-4d28-8804-14e8fef191d7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:46.635523 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8cf972cf-f9af-4d28-8804-14e8fef191d7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.278618 Jul 28 04:13:46.648101 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3446/5896] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:46 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:47.663427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d7afa8fb-6bbc-41ba-85f9-0f28aefde2d3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:47.665166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d7afa8fb-6bbc-41ba-85f9-0f28aefde2d3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:47.690640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7afa8fb-6bbc-41ba-85f9-0f28aefde2d3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:47.694731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7afa8fb-6bbc-41ba-85f9-0f28aefde2d3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:47.696311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7afa8fb-6bbc-41ba-85f9-0f28aefde2d3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:47.697117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d7afa8fb-6bbc-41ba-85f9-0f28aefde2d3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:47.919765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d7afa8fb-6bbc-41ba-85f9-0f28aefde2d3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:47.942590 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d7afa8fb-6bbc-41ba-85f9-0f28aefde2d3 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.286702 Jul 28 04:13:47.944128 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3447/5897] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:47 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:48.969425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ba5e112-fd06-4f2b-a252-7c60f214e680 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:48.970916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ba5e112-fd06-4f2b-a252-7c60f214e680 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:48.978284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ba5e112-fd06-4f2b-a252-7c60f214e680 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:48.978954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ba5e112-fd06-4f2b-a252-7c60f214e680 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:48.979921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ba5e112-fd06-4f2b-a252-7c60f214e680 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:48.980658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ba5e112-fd06-4f2b-a252-7c60f214e680 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:49.168445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2ba5e112-fd06-4f2b-a252-7c60f214e680 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:49.178587 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ba5e112-fd06-4f2b-a252-7c60f214e680 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.215146 Jul 28 04:13:49.187252 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3448/5898] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:48 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:50.199866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-89c17eda-11a0-43db-a955-130b261c8427 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:50.200958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-89c17eda-11a0-43db-a955-130b261c8427 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:50.208264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89c17eda-11a0-43db-a955-130b261c8427 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:50.208732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89c17eda-11a0-43db-a955-130b261c8427 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:50.209508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89c17eda-11a0-43db-a955-130b261c8427 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:50.209948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89c17eda-11a0-43db-a955-130b261c8427 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:50.454337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-89c17eda-11a0-43db-a955-130b261c8427 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:50.464702 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-89c17eda-11a0-43db-a955-130b261c8427 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.268697 Jul 28 04:13:50.466066 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3449/5899] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:50 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:51.490890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-073f1c6c-1779-4c82-af06-4baf0c8bc2f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:51.493157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-073f1c6c-1779-4c82-af06-4baf0c8bc2f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:51.506511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-073f1c6c-1779-4c82-af06-4baf0c8bc2f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:51.507316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-073f1c6c-1779-4c82-af06-4baf0c8bc2f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:51.508648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-073f1c6c-1779-4c82-af06-4baf0c8bc2f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:51.509731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-073f1c6c-1779-4c82-af06-4baf0c8bc2f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:51.737783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-073f1c6c-1779-4c82-af06-4baf0c8bc2f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:51.764487 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-073f1c6c-1779-4c82-af06-4baf0c8bc2f2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.266517 Jul 28 04:13:51.764487 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3450/5900] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:51 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:52.777808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-31886b79-f9da-4091-a0ac-5688195f98b8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:52.779046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-31886b79-f9da-4091-a0ac-5688195f98b8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:52.782280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:52.787142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31886b79-f9da-4091-a0ac-5688195f98b8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:52.787486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31886b79-f9da-4091-a0ac-5688195f98b8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:52.788456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31886b79-f9da-4091-a0ac-5688195f98b8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:52.789041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31886b79-f9da-4091-a0ac-5688195f98b8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:52.992928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-31886b79-f9da-4091-a0ac-5688195f98b8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:53.003236 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-31886b79-f9da-4091-a0ac-5688195f98b8 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.231204 Jul 28 04:13:53.004947 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3451/5901] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:52 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:54.024676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ee01411c-b634-4bce-be52-1a20b2b9fa54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:54.025721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ee01411c-b634-4bce-be52-1a20b2b9fa54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:54.035400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee01411c-b634-4bce-be52-1a20b2b9fa54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:54.036330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee01411c-b634-4bce-be52-1a20b2b9fa54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:54.037669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee01411c-b634-4bce-be52-1a20b2b9fa54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:54.038597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee01411c-b634-4bce-be52-1a20b2b9fa54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:54.231891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ee01411c-b634-4bce-be52-1a20b2b9fa54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:54.243872 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ee01411c-b634-4bce-be52-1a20b2b9fa54 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.222915 Jul 28 04:13:54.259862 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3452/5902] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:54 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:54.918639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1389654920", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:54.977732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:13:55.299157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:13:55.299157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:13:55.299157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:13:55.299157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:13:55.300136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:13:55.332685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:55.333142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:55.333932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:55.335897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:55.368256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Getting quotas for project b4ab37ec4f7d4c6fa7329faed8d570a3. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:13:55.377517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Getting quotas for user 51725aab85a2402a8ab18734e311a8f8 and project b4ab37ec4f7d4c6fa7329faed8d570a3. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:13:55.392782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:13:55.395480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:13:55.456723 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a0b02423-7585-4ea0-ab5e-1031d4bc063c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542167 Jul 28 04:13:55.464714 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3453/5903] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:13:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:13:55.475504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19aa2e05-5775-4d4f-80ad-f239d58a94ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:55.476859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-19aa2e05-5775-4d4f-80ad-f239d58a94ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:55.483825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19aa2e05-5775-4d4f-80ad-f239d58a94ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:55.484266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19aa2e05-5775-4d4f-80ad-f239d58a94ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:55.485069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19aa2e05-5775-4d4f-80ad-f239d58a94ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:55.485620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19aa2e05-5775-4d4f-80ad-f239d58a94ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:55.674283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19aa2e05-5775-4d4f-80ad-f239d58a94ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:55.684105 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-19aa2e05-5775-4d4f-80ad-f239d58a94ce tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.217762 Jul 28 04:13:55.684777 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3454/5904] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:55 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:55.690123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-229e5a23-39ab-4d38-bf71-9f1c96bfbe8d tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:55.690642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-229e5a23-39ab-4d38-bf71-9f1c96bfbe8d tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:55.758176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-229e5a23-39ab-4d38-bf71-9f1c96bfbe8d tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51725aab85a2402a8ab18734e311a8f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ab37ec4f7d4c6fa7329faed8d570a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:55.769715 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-229e5a23-39ab-4d38-bf71-9f1c96bfbe8d tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6" status: 200 len: 1215 microversion: 2.1 time: 0.082698 Jul 28 04:13:55.773134 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3455/5905] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:55 2022] GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:56.706521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce3e8431-5c3e-4e6b-8fba-1d23b74729ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:56.707300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ce3e8431-5c3e-4e6b-8fba-1d23b74729ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:56.716128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce3e8431-5c3e-4e6b-8fba-1d23b74729ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:56.718543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce3e8431-5c3e-4e6b-8fba-1d23b74729ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:56.720235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce3e8431-5c3e-4e6b-8fba-1d23b74729ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:56.720930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce3e8431-5c3e-4e6b-8fba-1d23b74729ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:56.731680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:13:56.928203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ce3e8431-5c3e-4e6b-8fba-1d23b74729ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:56.938173 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce3e8431-5c3e-4e6b-8fba-1d23b74729ec tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1510 microversion: 2.1 time: 0.235978 Jul 28 04:13:56.944667 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3456/5906] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:56 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:13:56.944667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-846d0f15-5ab0-4ecb-8f1b-9b294e8940a4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:56.944920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-846d0f15-5ab0-4ecb-8f1b-9b294e8940a4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:56.951451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-846d0f15-5ab0-4ecb-8f1b-9b294e8940a4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:56.952264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-846d0f15-5ab0-4ecb-8f1b-9b294e8940a4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:56.954173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-846d0f15-5ab0-4ecb-8f1b-9b294e8940a4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:56.954615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-846d0f15-5ab0-4ecb-8f1b-9b294e8940a4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:57.022435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-846d0f15-5ab0-4ecb-8f1b-9b294e8940a4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51725aab85a2402a8ab18734e311a8f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ab37ec4f7d4c6fa7329faed8d570a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:57.032694 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-846d0f15-5ab0-4ecb-8f1b-9b294e8940a4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6" status: 200 len: 1273 microversion: 2.1 time: 0.092423 Jul 28 04:13:57.041278 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3457/5907] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:56 2022] GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:57.441058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-436a2078-6253-4049-a2c6-a730cdfd55de tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:57.441677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-436a2078-6253-4049-a2c6-a730cdfd55de tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:57.450127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-436a2078-6253-4049-a2c6-a730cdfd55de tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:57.455250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-436a2078-6253-4049-a2c6-a730cdfd55de tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:57.456299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-436a2078-6253-4049-a2c6-a730cdfd55de tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:57.456946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-436a2078-6253-4049-a2c6-a730cdfd55de tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:58.229208 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-436a2078-6253-4049-a2c6-a730cdfd55de tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1831 microversion: 2.1 time: 0.796535 Jul 28 04:13:58.229936 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3458/5908] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:57 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1831 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:58.240693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a63679c0-a549-4f01-afdf-fd7ec5e38edc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:58.241701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a63679c0-a549-4f01-afdf-fd7ec5e38edc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:58.257051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a63679c0-a549-4f01-afdf-fd7ec5e38edc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:58.259089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a63679c0-a549-4f01-afdf-fd7ec5e38edc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:58.259089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a63679c0-a549-4f01-afdf-fd7ec5e38edc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:58.259089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a63679c0-a549-4f01-afdf-fd7ec5e38edc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:58.451518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a63679c0-a549-4f01-afdf-fd7ec5e38edc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:58.463069 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a63679c0-a549-4f01-afdf-fd7ec5e38edc tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1487 microversion: 2.1 time: 0.231089 Jul 28 04:13:58.463971 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3459/5909] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:58 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1487 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:58.477844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-57558984-d0d4-47b4-b56a-318459c2258c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:58.479817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-57558984-d0d4-47b4-b56a-318459c2258c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:58.487365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57558984-d0d4-47b4-b56a-318459c2258c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:58.487966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57558984-d0d4-47b4-b56a-318459c2258c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:58.489049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57558984-d0d4-47b4-b56a-318459c2258c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:58.490769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57558984-d0d4-47b4-b56a-318459c2258c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:58.736579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-57558984-d0d4-47b4-b56a-318459c2258c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51725aab85a2402a8ab18734e311a8f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ab37ec4f7d4c6fa7329faed8d570a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:58.748502 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-57558984-d0d4-47b4-b56a-318459c2258c tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6" status: 200 len: 1315 microversion: 2.1 time: 0.277670 Jul 28 04:13:58.749458 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3460/5910] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:58 2022] GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:58.754410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-883a0927-193a-4a92-8d71-ed28750f42b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:58.755029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-883a0927-193a-4a92-8d71-ed28750f42b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:58.775607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-883a0927-193a-4a92-8d71-ed28750f42b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:58.776086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-883a0927-193a-4a92-8d71-ed28750f42b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:58.776974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-883a0927-193a-4a92-8d71-ed28750f42b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:58.777713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-883a0927-193a-4a92-8d71-ed28750f42b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:59.019261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-883a0927-193a-4a92-8d71-ed28750f42b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:59.029830 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-883a0927-193a-4a92-8d71-ed28750f42b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1680 microversion: 2.1 time: 0.278211 Jul 28 04:13:59.030599 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3461/5911] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:58 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1680 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:59.048727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0def93c3-365d-449d-822a-d23c377958a4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-275884487"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:59.051498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0def93c3-365d-449d-822a-d23c377958a4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:59.074468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0def93c3-365d-449d-822a-d23c377958a4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:59.074935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0def93c3-365d-449d-822a-d23c377958a4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:59.075748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0def93c3-365d-449d-822a-d23c377958a4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:59.076193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0def93c3-365d-449d-822a-d23c377958a4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:59.208778 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0def93c3-365d-449d-822a-d23c377958a4 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "PUT /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1059 microversion: 2.1 time: 0.169083 Jul 28 04:13:59.220175 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3462/5912] 10.222.0.48 () {60 vars in 1256 bytes} [Thu Jul 28 04:13:59 2022] PUT /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1059 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:59.226155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-13060589-6aa1-4037-af32-50256f0652e2 req-a6b43433-3b46-4bb8-9d9f-77bd1c8ddc01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc9d61bc-58e6-465f-b27c-ca477224e6f6", "tag": "dcbb899c-9344-43ec-8824-ec0249205c1c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:59.242812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-13060589-6aa1-4037-af32-50256f0652e2 req-a6b43433-3b46-4bb8-9d9f-77bd1c8ddc01 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:59.243455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-13060589-6aa1-4037-af32-50256f0652e2 req-a6b43433-3b46-4bb8-9d9f-77bd1c8ddc01 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:59.271222 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-13060589-6aa1-4037-af32-50256f0652e2 req-a6b43433-3b46-4bb8-9d9f-77bd1c8ddc01 service nova] Creating event network-changed:dcbb899c-9344-43ec-8824-ec0249205c1c for instance dc9d61bc-58e6-465f-b27c-ca477224e6f6 on n-h1-826756-3 Jul 28 04:13:59.277719 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-13060589-6aa1-4037-af32-50256f0652e2 req-a6b43433-3b46-4bb8-9d9f-77bd1c8ddc01 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055696 Jul 28 04:13:59.278835 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3463/5913] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:59.285527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-89bb686b-0698-473a-8a9c-ef6b59594483 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:59.288825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-89bb686b-0698-473a-8a9c-ef6b59594483 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:59.297376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89bb686b-0698-473a-8a9c-ef6b59594483 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:59.298006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89bb686b-0698-473a-8a9c-ef6b59594483 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:59.298955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89bb686b-0698-473a-8a9c-ef6b59594483 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:59.299903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89bb686b-0698-473a-8a9c-ef6b59594483 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:59.387545 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-89bb686b-0698-473a-8a9c-ef6b59594483 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd/action" status: 200 len: 32656 microversion: 2.1 time: 0.107197 Jul 28 04:13:59.388378 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3464/5914] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:13:59 2022] POST /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd/action => generated 32656 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:13:59.396219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1318d783-286e-42c3-af4c-8d3a043467ff tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:13:59.397618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1318d783-286e-42c3-af4c-8d3a043467ff tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:59.410399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1318d783-286e-42c3-af4c-8d3a043467ff tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:59.413150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1318d783-286e-42c3-af4c-8d3a043467ff tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:59.414261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1318d783-286e-42c3-af4c-8d3a043467ff tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:59.414717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1318d783-286e-42c3-af4c-8d3a043467ff tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:59.649434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1318d783-286e-42c3-af4c-8d3a043467ff tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:59.657958 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1318d783-286e-42c3-af4c-8d3a043467ff tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1486 microversion: 2.1 time: 0.268236 Jul 28 04:13:59.658548 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3465/5915] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:13:59 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1486 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:13:59.677195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70d07917-dafd-4b43-bb17-bce0a3fe0029 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:13:59.677806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-70d07917-dafd-4b43-bb17-bce0a3fe0029 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:13:59.687422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70d07917-dafd-4b43-bb17-bce0a3fe0029 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:59.687881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70d07917-dafd-4b43-bb17-bce0a3fe0029 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:59.689084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70d07917-dafd-4b43-bb17-bce0a3fe0029 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:13:59.689682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70d07917-dafd-4b43-bb17-bce0a3fe0029 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:13:59.736061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-70d07917-dafd-4b43-bb17-bce0a3fe0029 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3769553cdd184c71af88602f84a884aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e52c516d0e64a7db78d31a11e92f72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:13:59.736720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-70d07917-dafd-4b43-bb17-bce0a3fe0029 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] flavor_id is None. Assuming migration. {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4188}} Jul 28 04:13:59.737145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-70d07917-dafd-4b43-bb17-bce0a3fe0029 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 04:14:00.072729 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-70d07917-dafd-4b43-bb17-bce0a3fe0029 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd/action" status: 202 len: 0 microversion: 2.1 time: 0.400481 Jul 28 04:14:00.073631 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3466/5916] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:13:59 2022] POST /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:14:00.078986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-604e8ef5-86da-4754-9105-6564868c7ddd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:00.079611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-604e8ef5-86da-4754-9105-6564868c7ddd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:00.086079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-604e8ef5-86da-4754-9105-6564868c7ddd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:00.086541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-604e8ef5-86da-4754-9105-6564868c7ddd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:00.087326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-604e8ef5-86da-4754-9105-6564868c7ddd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:00.087769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-604e8ef5-86da-4754-9105-6564868c7ddd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:00.244333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-604e8ef5-86da-4754-9105-6564868c7ddd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:00.256208 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-604e8ef5-86da-4754-9105-6564868c7ddd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1486 microversion: 2.1 time: 0.181490 Jul 28 04:14:00.257993 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3467/5917] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:00 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1486 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:00.264280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17e08a2c-ca48-496e-b6bb-637ab022708b tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:00.265194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-17e08a2c-ca48-496e-b6bb-637ab022708b tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:00.273817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17e08a2c-ca48-496e-b6bb-637ab022708b tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:00.274272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17e08a2c-ca48-496e-b6bb-637ab022708b tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:00.275055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17e08a2c-ca48-496e-b6bb-637ab022708b tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:00.275490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17e08a2c-ca48-496e-b6bb-637ab022708b tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:00.440007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-17e08a2c-ca48-496e-b6bb-637ab022708b tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51725aab85a2402a8ab18734e311a8f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ab37ec4f7d4c6fa7329faed8d570a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:00.451704 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-17e08a2c-ca48-496e-b6bb-637ab022708b tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6" status: 200 len: 1315 microversion: 2.1 time: 0.192180 Jul 28 04:14:00.464899 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3468/5918] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:00 2022] GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:00.464899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-224b65e7-1279-472c-8e0b-544457226baa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:00.464899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-224b65e7-1279-472c-8e0b-544457226baa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:00.474827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-224b65e7-1279-472c-8e0b-544457226baa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:00.475370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-224b65e7-1279-472c-8e0b-544457226baa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:00.476412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-224b65e7-1279-472c-8e0b-544457226baa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:00.476844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-224b65e7-1279-472c-8e0b-544457226baa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:00.713573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-224b65e7-1279-472c-8e0b-544457226baa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:00.724820 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-224b65e7-1279-472c-8e0b-544457226baa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1689 microversion: 2.1 time: 0.270722 Jul 28 04:14:00.726018 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3469/5919] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:00 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1689 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:00.734671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c3e41de9-5e81-422f-8646-1d8136ae9209 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:00.735184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c3e41de9-5e81-422f-8646-1d8136ae9209 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:00.746691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3e41de9-5e81-422f-8646-1d8136ae9209 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:00.747199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3e41de9-5e81-422f-8646-1d8136ae9209 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:00.748154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3e41de9-5e81-422f-8646-1d8136ae9209 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:00.748707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3e41de9-5e81-422f-8646-1d8136ae9209 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:00.781218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c3e41de9-5e81-422f-8646-1d8136ae9209 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:14:00.815515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:00.901444 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c3e41de9-5e81-422f-8646-1d8136ae9209 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 204 len: 0 microversion: 2.1 time: 0.173760 Jul 28 04:14:00.902160 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3470/5920] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:14:00 2022] DELETE /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:14:00.927778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b7c945e1-a207-4ec9-be6e-112411227076 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:00.934043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b7c945e1-a207-4ec9-be6e-112411227076 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:00.948010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7c945e1-a207-4ec9-be6e-112411227076 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:00.948806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7c945e1-a207-4ec9-be6e-112411227076 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:00.949975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7c945e1-a207-4ec9-be6e-112411227076 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:00.950633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7c945e1-a207-4ec9-be6e-112411227076 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:01.192088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b7c945e1-a207-4ec9-be6e-112411227076 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:01.204487 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b7c945e1-a207-4ec9-be6e-112411227076 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1492 microversion: 2.1 time: 0.282544 Jul 28 04:14:01.205599 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3471/5921] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:00 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1492 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:01.480234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-18d82ac9-0ff8-4bfa-b92f-1f18f6107437 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:01.482517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-18d82ac9-0ff8-4bfa-b92f-1f18f6107437 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:01.490624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18d82ac9-0ff8-4bfa-b92f-1f18f6107437 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:01.491359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18d82ac9-0ff8-4bfa-b92f-1f18f6107437 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:01.492707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18d82ac9-0ff8-4bfa-b92f-1f18f6107437 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:01.493644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18d82ac9-0ff8-4bfa-b92f-1f18f6107437 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:01.663420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-18d82ac9-0ff8-4bfa-b92f-1f18f6107437 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51725aab85a2402a8ab18734e311a8f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ab37ec4f7d4c6fa7329faed8d570a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:01.679252 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-18d82ac9-0ff8-4bfa-b92f-1f18f6107437 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6" status: 200 len: 1315 microversion: 2.1 time: 0.202919 Jul 28 04:14:01.690381 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3472/5922] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:01 2022] GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:01.749093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cfe4e095-97f7-4531-ae9e-f46ff3d7e99f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:01.749902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cfe4e095-97f7-4531-ae9e-f46ff3d7e99f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:01.756526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfe4e095-97f7-4531-ae9e-f46ff3d7e99f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:01.757354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfe4e095-97f7-4531-ae9e-f46ff3d7e99f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:01.758391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfe4e095-97f7-4531-ae9e-f46ff3d7e99f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:01.759160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cfe4e095-97f7-4531-ae9e-f46ff3d7e99f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:01.983113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cfe4e095-97f7-4531-ae9e-f46ff3d7e99f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:01.992700 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cfe4e095-97f7-4531-ae9e-f46ff3d7e99f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1689 microversion: 2.1 time: 0.246654 Jul 28 04:14:02.000605 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3473/5923] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:01 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1689 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:02.226641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-12a9724c-4e17-4a2c-a3b4-33e1bb0b20c2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:02.227264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-12a9724c-4e17-4a2c-a3b4-33e1bb0b20c2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:02.235883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12a9724c-4e17-4a2c-a3b4-33e1bb0b20c2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:02.236433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12a9724c-4e17-4a2c-a3b4-33e1bb0b20c2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:02.237256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12a9724c-4e17-4a2c-a3b4-33e1bb0b20c2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:02.237690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12a9724c-4e17-4a2c-a3b4-33e1bb0b20c2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:02.413296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-12a9724c-4e17-4a2c-a3b4-33e1bb0b20c2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:02.433220 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-12a9724c-4e17-4a2c-a3b4-33e1bb0b20c2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1492 microversion: 2.1 time: 0.199667 Jul 28 04:14:02.445484 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3474/5924] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:02 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1492 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:02.700904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-65200cee-b64a-4b34-bfb0-ce109b6a7cf5 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:02.700904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-65200cee-b64a-4b34-bfb0-ce109b6a7cf5 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:02.707252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65200cee-b64a-4b34-bfb0-ce109b6a7cf5 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:02.707784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65200cee-b64a-4b34-bfb0-ce109b6a7cf5 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:02.708690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65200cee-b64a-4b34-bfb0-ce109b6a7cf5 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:02.709229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65200cee-b64a-4b34-bfb0-ce109b6a7cf5 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:02.926905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-65200cee-b64a-4b34-bfb0-ce109b6a7cf5 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51725aab85a2402a8ab18734e311a8f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ab37ec4f7d4c6fa7329faed8d570a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:02.936601 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-65200cee-b64a-4b34-bfb0-ce109b6a7cf5 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6" status: 200 len: 1315 microversion: 2.1 time: 0.241200 Jul 28 04:14:02.948376 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3475/5925] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:02 2022] GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:03.015355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ac36c34c-2b2d-40f5-85e6-438c1b745f99 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:03.015989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ac36c34c-2b2d-40f5-85e6-438c1b745f99 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:03.030879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac36c34c-2b2d-40f5-85e6-438c1b745f99 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:03.032092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac36c34c-2b2d-40f5-85e6-438c1b745f99 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:03.034672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac36c34c-2b2d-40f5-85e6-438c1b745f99 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:03.036809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac36c34c-2b2d-40f5-85e6-438c1b745f99 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:03.287095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ac36c34c-2b2d-40f5-85e6-438c1b745f99 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:03.315048 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ac36c34c-2b2d-40f5-85e6-438c1b745f99 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1689 microversion: 2.1 time: 0.304462 Jul 28 04:14:03.316783 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3476/5926] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:03 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1689 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:03.459762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-87233f7c-a417-4faa-904c-e66bbbd1ef5a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:03.461207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-87233f7c-a417-4faa-904c-e66bbbd1ef5a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:03.471445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87233f7c-a417-4faa-904c-e66bbbd1ef5a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:03.472189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87233f7c-a417-4faa-904c-e66bbbd1ef5a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:03.473102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87233f7c-a417-4faa-904c-e66bbbd1ef5a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:03.473631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87233f7c-a417-4faa-904c-e66bbbd1ef5a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:03.644273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-87233f7c-a417-4faa-904c-e66bbbd1ef5a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:03.656020 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-87233f7c-a417-4faa-904c-e66bbbd1ef5a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1492 microversion: 2.1 time: 0.200564 Jul 28 04:14:03.657378 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3477/5927] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:03 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1492 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:03.951123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-eb9d8f64-6a04-4d55-b07e-964dc4abcd28 req-a37d356a-77d2-40f8-b308-260a0402db53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3da1d44-8b38-4b60-afe7-4d1708c7abb3", "name": "network-vif-deleted", "tag": "dd6483fb-9758-463e-bf54-d02588e1157f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:04.002506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-eb9d8f64-6a04-4d55-b07e-964dc4abcd28 req-a37d356a-77d2-40f8-b308-260a0402db53 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:04.002942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-eb9d8f64-6a04-4d55-b07e-964dc4abcd28 req-a37d356a-77d2-40f8-b308-260a0402db53 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:04.031923 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-eb9d8f64-6a04-4d55-b07e-964dc4abcd28 req-a37d356a-77d2-40f8-b308-260a0402db53 service nova] Creating event network-vif-deleted:dd6483fb-9758-463e-bf54-d02588e1157f for instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 on n-h2-826756-3 Jul 28 04:14:04.062797 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-eb9d8f64-6a04-4d55-b07e-964dc4abcd28 req-a37d356a-77d2-40f8-b308-260a0402db53 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096092 Jul 28 04:14:04.065860 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3478/5928] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:14:04.110899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4c3f0e27-9415-445a-9a42-5c19ca4e1143 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:04.113234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4c3f0e27-9415-445a-9a42-5c19ca4e1143 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:04.131752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c3f0e27-9415-445a-9a42-5c19ca4e1143 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:04.137259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c3f0e27-9415-445a-9a42-5c19ca4e1143 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:04.138600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c3f0e27-9415-445a-9a42-5c19ca4e1143 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:04.140774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c3f0e27-9415-445a-9a42-5c19ca4e1143 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:04.410136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4c3f0e27-9415-445a-9a42-5c19ca4e1143 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51725aab85a2402a8ab18734e311a8f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ab37ec4f7d4c6fa7329faed8d570a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:04.419721 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4c3f0e27-9415-445a-9a42-5c19ca4e1143 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6" status: 200 len: 1315 microversion: 2.1 time: 0.333038 Jul 28 04:14:04.420697 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3479/5929] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:04 2022] GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:04.437501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6e412c57-4812-4600-b42a-76659ab0037b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:04.438145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6e412c57-4812-4600-b42a-76659ab0037b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:04.446559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e412c57-4812-4600-b42a-76659ab0037b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:04.447027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e412c57-4812-4600-b42a-76659ab0037b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:04.448382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e412c57-4812-4600-b42a-76659ab0037b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:04.449909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e412c57-4812-4600-b42a-76659ab0037b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:04.659026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6e412c57-4812-4600-b42a-76659ab0037b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:04.677398 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6e412c57-4812-4600-b42a-76659ab0037b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1694 microversion: 2.1 time: 0.255307 Jul 28 04:14:04.678747 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3480/5930] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:04 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1694 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:04.698151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dfb517d9-6d3d-4305-b556-6db01829b88c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:04.699240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dfb517d9-6d3d-4305-b556-6db01829b88c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:04.706954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfb517d9-6d3d-4305-b556-6db01829b88c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:04.707549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfb517d9-6d3d-4305-b556-6db01829b88c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:04.708533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfb517d9-6d3d-4305-b556-6db01829b88c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:04.709367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfb517d9-6d3d-4305-b556-6db01829b88c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:04.780251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfb517d9-6d3d-4305-b556-6db01829b88c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:04.781211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfb517d9-6d3d-4305-b556-6db01829b88c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:04.781561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-dfb517d9-6d3d-4305-b556-6db01829b88c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lazy-loading 'fault' on Instance uuid c3da1d44-8b38-4b60-afe7-4d1708c7abb3 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:14:04.863802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dfb517d9-6d3d-4305-b556-6db01829b88c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:04.876466 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dfb517d9-6d3d-4305-b556-6db01829b88c tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 200 len: 1309 microversion: 2.1 time: 0.183971 Jul 28 04:14:04.877487 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3481/5931] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:04 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 1309 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:05.069677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-62260a49-397a-4854-9d78-4e6d73e9e8cd req-29b15787-8193-4ea5-b45c-54a893f53806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc9d61bc-58e6-465f-b27c-ca477224e6f6", "name": "network-vif-plugged", "status": "completed", "tag": "dcbb899c-9344-43ec-8824-ec0249205c1c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:05.082869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-62260a49-397a-4854-9d78-4e6d73e9e8cd req-29b15787-8193-4ea5-b45c-54a893f53806 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:05.083325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-62260a49-397a-4854-9d78-4e6d73e9e8cd req-29b15787-8193-4ea5-b45c-54a893f53806 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:05.102386 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-62260a49-397a-4854-9d78-4e6d73e9e8cd req-29b15787-8193-4ea5-b45c-54a893f53806 service nova] Creating event network-vif-plugged:dcbb899c-9344-43ec-8824-ec0249205c1c for instance dc9d61bc-58e6-465f-b27c-ca477224e6f6 on n-h1-826756-3 Jul 28 04:14:05.124603 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-62260a49-397a-4854-9d78-4e6d73e9e8cd req-29b15787-8193-4ea5-b45c-54a893f53806 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054915 Jul 28 04:14:05.140221 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3482/5932] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:05.439023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:05.445169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d4f8745-8261-42e7-991e-4eca3ad86bee tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:05.446625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5d4f8745-8261-42e7-991e-4eca3ad86bee tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:05.462895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d4f8745-8261-42e7-991e-4eca3ad86bee tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:05.463436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d4f8745-8261-42e7-991e-4eca3ad86bee tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:05.464420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d4f8745-8261-42e7-991e-4eca3ad86bee tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:05.467011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d4f8745-8261-42e7-991e-4eca3ad86bee tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:05.639016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5d4f8745-8261-42e7-991e-4eca3ad86bee tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51725aab85a2402a8ab18734e311a8f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ab37ec4f7d4c6fa7329faed8d570a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:05.647050 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5d4f8745-8261-42e7-991e-4eca3ad86bee tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6" status: 200 len: 1315 microversion: 2.1 time: 0.209142 Jul 28 04:14:05.647739 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3483/5933] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:05 2022] GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:05.706255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b0e03b2b-8a26-4447-8667-8e3c13960d04 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:05.707465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b0e03b2b-8a26-4447-8667-8e3c13960d04 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:05.716469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0e03b2b-8a26-4447-8667-8e3c13960d04 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:05.717079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0e03b2b-8a26-4447-8667-8e3c13960d04 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:05.718046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0e03b2b-8a26-4447-8667-8e3c13960d04 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:05.718489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0e03b2b-8a26-4447-8667-8e3c13960d04 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:05.769557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:05.890273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b0e03b2b-8a26-4447-8667-8e3c13960d04 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:05.899892 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b0e03b2b-8a26-4447-8667-8e3c13960d04 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1694 microversion: 2.1 time: 0.199372 Jul 28 04:14:05.912983 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3484/5934] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:05 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1694 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:05.919831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df388294-afe5-4d68-840b-67c5f4b2e739 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:05.920439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-df388294-afe5-4d68-840b-67c5f4b2e739 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:05.927531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df388294-afe5-4d68-840b-67c5f4b2e739 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:05.927982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df388294-afe5-4d68-840b-67c5f4b2e739 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:05.928768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df388294-afe5-4d68-840b-67c5f4b2e739 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:05.929217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df388294-afe5-4d68-840b-67c5f4b2e739 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:05.945390 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-df388294-afe5-4d68-840b-67c5f4b2e739 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df388294-afe5-4d68-840b-67c5f4b2e739 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 HTTP/1.1 Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c3da1d44-8b38-4b60-afe7-4d1708c7abb3'} Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:05.947597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:05.952234 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:05.952234 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:05.952234 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:05.952234 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:05.952234 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:05.952234 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:05.954162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df388294-afe5-4d68-840b-67c5f4b2e739 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:05.955060 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-df388294-afe5-4d68-840b-67c5f4b2e739 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 404 len: 111 microversion: 2.1 time: 0.039337 Jul 28 04:14:05.955755 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3485/5935] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:05 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:05.972921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c5985ce-f6c9-4d90-87c5-1e055c1f1b50 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:05.973683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c5985ce-f6c9-4d90-87c5-1e055c1f1b50 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:05.982292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c5985ce-f6c9-4d90-87c5-1e055c1f1b50 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:05.982831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c5985ce-f6c9-4d90-87c5-1e055c1f1b50 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:05.983950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c5985ce-f6c9-4d90-87c5-1e055c1f1b50 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:05.984756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c5985ce-f6c9-4d90-87c5-1e055c1f1b50 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.001294 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-1c5985ce-f6c9-4d90-87c5-1e055c1f1b50 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c5985ce-f6c9-4d90-87c5-1e055c1f1b50 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 HTTP/1.1 Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c3da1d44-8b38-4b60-afe7-4d1708c7abb3'} Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:06.004884 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:06.008899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.008899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.008899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.008899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.008899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.008899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.008899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:06.008899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:06.008899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:06.008899 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.010804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c5985ce-f6c9-4d90-87c5-1e055c1f1b50 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:06.011851 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c5985ce-f6c9-4d90-87c5-1e055c1f1b50 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 404 len: 111 microversion: 2.1 time: 0.044391 Jul 28 04:14:06.015903 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3486/5936] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:14:05 2022] DELETE /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:06.021827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a07250e7-5ec5-440d-a742-ee0698aff402 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.022614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a07250e7-5ec5-440d-a742-ee0698aff402 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: c3da1d44-8b38-4b60-afe7-4d1708c7abb3] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.029881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a07250e7-5ec5-440d-a742-ee0698aff402 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.030746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a07250e7-5ec5-440d-a742-ee0698aff402 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.031681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a07250e7-5ec5-440d-a742-ee0698aff402 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.032282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a07250e7-5ec5-440d-a742-ee0698aff402 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.062468 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-a07250e7-5ec5-440d-a742-ee0698aff402 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a07250e7-5ec5-440d-a742-ee0698aff402 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 HTTP/1.1 Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c3da1d44-8b38-4b60-afe7-4d1708c7abb3'} Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.064155 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.068592 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.068592 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.068592 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:06.068592 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:06.068592 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. Jul 28 04:14:06.068592 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.072023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a07250e7-5ec5-440d-a742-ee0698aff402 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance c3da1d44-8b38-4b60-afe7-4d1708c7abb3 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:06.074230 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a07250e7-5ec5-440d-a742-ee0698aff402 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3" status: 404 len: 111 microversion: 2.1 time: 0.056899 Jul 28 04:14:06.078392 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3487/5937] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:06 2022] GET /compute/v2.1/servers/c3da1d44-8b38-4b60-afe7-4d1708c7abb3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:06.086435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b2bf00b-fbf5-49e3-808b-32227760b656 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.087114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b2bf00b-fbf5-49e3-808b-32227760b656 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.094791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:06.097596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b2bf00b-fbf5-49e3-808b-32227760b656 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.098139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b2bf00b-fbf5-49e3-808b-32227760b656 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.099139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b2bf00b-fbf5-49e3-808b-32227760b656 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.099583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b2bf00b-fbf5-49e3-808b-32227760b656 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.119797 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-4b2bf00b-fbf5-49e3-808b-32227760b656 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b2bf00b-fbf5-49e3-808b-32227760b656 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c HTTP/1.1 Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'e86fd69e-4852-4849-9e26-d0bf41a1668c'} Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:06.122928 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:14:06.129477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.129477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.129477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.129477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.129477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.129477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.129477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:06.129477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:06.129477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:14:06.129477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.129477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b2bf00b-fbf5-49e3-808b-32227760b656 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:06.129477 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b2bf00b-fbf5-49e3-808b-32227760b656 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 404 len: 111 microversion: 2.1 time: 0.044122 Jul 28 04:14:06.129477 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3488/5938] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:14:06 2022] DELETE /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:06.134492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2447bdd3-cdce-438e-bc60-8d9ae8414163 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.135114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2447bdd3-cdce-438e-bc60-8d9ae8414163 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: e86fd69e-4852-4849-9e26-d0bf41a1668c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.142372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2447bdd3-cdce-438e-bc60-8d9ae8414163 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.142786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2447bdd3-cdce-438e-bc60-8d9ae8414163 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.143580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2447bdd3-cdce-438e-bc60-8d9ae8414163 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.144025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2447bdd3-cdce-438e-bc60-8d9ae8414163 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.159524 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-2447bdd3-cdce-438e-bc60-8d9ae8414163 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2447bdd3-cdce-438e-bc60-8d9ae8414163 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c HTTP/1.1 Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'e86fd69e-4852-4849-9e26-d0bf41a1668c'} Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.161242 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.167655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.167655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.167655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:06.167655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:06.167655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. Jul 28 04:14:06.167655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.167655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2447bdd3-cdce-438e-bc60-8d9ae8414163 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance e86fd69e-4852-4849-9e26-d0bf41a1668c could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:06.167655 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2447bdd3-cdce-438e-bc60-8d9ae8414163 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c" status: 404 len: 111 microversion: 2.1 time: 0.032446 Jul 28 04:14:06.167655 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3489/5939] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:06 2022] GET /compute/v2.1/servers/e86fd69e-4852-4849-9e26-d0bf41a1668c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:14:06.172258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70d49b16-d195-4802-897b-a3146c76205a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.172832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-70d49b16-d195-4802-897b-a3146c76205a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.179209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70d49b16-d195-4802-897b-a3146c76205a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.179707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70d49b16-d195-4802-897b-a3146c76205a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.180526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70d49b16-d195-4802-897b-a3146c76205a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.181208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70d49b16-d195-4802-897b-a3146c76205a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.198710 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-70d49b16-d195-4802-897b-a3146c76205a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70d49b16-d195-4802-897b-a3146c76205a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 HTTP/1.1 Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '4b75d20b-d073-429e-b73e-c8d2be126307'} Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:06.201028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70d49b16-d195-4802-897b-a3146c76205a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-70d49b16-d195-4802-897b-a3146c76205a tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 404 len: 111 microversion: 2.1 time: 0.034014 Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3490/5940] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:14:06 2022] DELETE /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-486274eb-5b0f-46de-b174-1ec7948038f7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.211789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-486274eb-5b0f-46de-b174-1ec7948038f7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 4b75d20b-d073-429e-b73e-c8d2be126307] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.225478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-486274eb-5b0f-46de-b174-1ec7948038f7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.225943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-486274eb-5b0f-46de-b174-1ec7948038f7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.226818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-486274eb-5b0f-46de-b174-1ec7948038f7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.227312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-486274eb-5b0f-46de-b174-1ec7948038f7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.243995 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-486274eb-5b0f-46de-b174-1ec7948038f7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-486274eb-5b0f-46de-b174-1ec7948038f7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 HTTP/1.1 Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '4b75d20b-d073-429e-b73e-c8d2be126307'} Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.245608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.249657 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.249657 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.249657 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:06.249657 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:06.249657 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. Jul 28 04:14:06.249657 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.249657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-486274eb-5b0f-46de-b174-1ec7948038f7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 4b75d20b-d073-429e-b73e-c8d2be126307 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:06.249657 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-486274eb-5b0f-46de-b174-1ec7948038f7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307" status: 404 len: 111 microversion: 2.1 time: 0.040115 Jul 28 04:14:06.249657 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3491/5941] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:06 2022] GET /compute/v2.1/servers/4b75d20b-d073-429e-b73e-c8d2be126307 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:06.257113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f628953-cbb3-41c1-aeeb-07985351bbd2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.257673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2f628953-cbb3-41c1-aeeb-07985351bbd2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.264674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f628953-cbb3-41c1-aeeb-07985351bbd2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.265216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f628953-cbb3-41c1-aeeb-07985351bbd2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.266069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f628953-cbb3-41c1-aeeb-07985351bbd2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.266584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f628953-cbb3-41c1-aeeb-07985351bbd2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.272040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:06.285625 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-2f628953-cbb3-41c1-aeeb-07985351bbd2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f628953-cbb3-41c1-aeeb-07985351bbd2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 HTTP/1.1 Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '0ef009e0-fb20-466b-a10a-f9aa987ac790'} Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:06.287306 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:14:06.291349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.291349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.291349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.291349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.291349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.291349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.291349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:06.291349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:06.291349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:14:06.291349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.291349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f628953-cbb3-41c1-aeeb-07985351bbd2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:06.291349 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2f628953-cbb3-41c1-aeeb-07985351bbd2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 404 len: 111 microversion: 2.1 time: 0.036548 Jul 28 04:14:06.293339 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3492/5942] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:14:06 2022] DELETE /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:06.305626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f446749-9f45-4566-942a-70e7de220a77 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.306369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2f446749-9f45-4566-942a-70e7de220a77 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 0ef009e0-fb20-466b-a10a-f9aa987ac790] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.319344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f446749-9f45-4566-942a-70e7de220a77 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.320198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f446749-9f45-4566-942a-70e7de220a77 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.321285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f446749-9f45-4566-942a-70e7de220a77 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.321822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f446749-9f45-4566-942a-70e7de220a77 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.348640 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-2f446749-9f45-4566-942a-70e7de220a77 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f446749-9f45-4566-942a-70e7de220a77 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 HTTP/1.1 Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '0ef009e0-fb20-466b-a10a-f9aa987ac790'} Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.350281 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.354071 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.354071 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.354071 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:06.354071 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:06.354071 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. Jul 28 04:14:06.354071 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.354071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f446749-9f45-4566-942a-70e7de220a77 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 0ef009e0-fb20-466b-a10a-f9aa987ac790 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:06.354071 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2f446749-9f45-4566-942a-70e7de220a77 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790" status: 404 len: 111 microversion: 2.1 time: 0.055200 Jul 28 04:14:06.355960 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3493/5943] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:06 2022] GET /compute/v2.1/servers/0ef009e0-fb20-466b-a10a-f9aa987ac790 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:06.361205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c782ff1-9deb-4c6e-adcb-4b30aaa78fdb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.361953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c782ff1-9deb-4c6e-adcb-4b30aaa78fdb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.368673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c782ff1-9deb-4c6e-adcb-4b30aaa78fdb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.369127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c782ff1-9deb-4c6e-adcb-4b30aaa78fdb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.369906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c782ff1-9deb-4c6e-adcb-4b30aaa78fdb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.370532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c782ff1-9deb-4c6e-adcb-4b30aaa78fdb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.385952 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-1c782ff1-9deb-4c6e-adcb-4b30aaa78fdb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c782ff1-9deb-4c6e-adcb-4b30aaa78fdb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c HTTP/1.1 Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9044a2af-7cb6-404a-8621-fa4f7f0f094c'} Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:06.388419 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:14:06.393232 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.393232 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.393232 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.393232 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.393232 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.393232 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.393232 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:06.393232 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:06.393232 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:14:06.393232 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.394441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c782ff1-9deb-4c6e-adcb-4b30aaa78fdb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:06.394734 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c782ff1-9deb-4c6e-adcb-4b30aaa78fdb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 404 len: 111 microversion: 2.1 time: 0.037630 Jul 28 04:14:06.395955 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3494/5944] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:14:06 2022] DELETE /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:06.405223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15160109-968c-4d8a-be0e-fc67274c3dc7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.410339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15160109-968c-4d8a-be0e-fc67274c3dc7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9044a2af-7cb6-404a-8621-fa4f7f0f094c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.415604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15160109-968c-4d8a-be0e-fc67274c3dc7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.416064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15160109-968c-4d8a-be0e-fc67274c3dc7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.416883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15160109-968c-4d8a-be0e-fc67274c3dc7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.417322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15160109-968c-4d8a-be0e-fc67274c3dc7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.436273 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-15160109-968c-4d8a-be0e-fc67274c3dc7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15160109-968c-4d8a-be0e-fc67274c3dc7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c HTTP/1.1 Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9044a2af-7cb6-404a-8621-fa4f7f0f094c'} Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.437994 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.446703 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.446703 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.446703 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:06.446703 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:06.446703 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. Jul 28 04:14:06.446703 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.446703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15160109-968c-4d8a-be0e-fc67274c3dc7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 9044a2af-7cb6-404a-8621-fa4f7f0f094c could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:06.446703 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15160109-968c-4d8a-be0e-fc67274c3dc7 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c" status: 404 len: 111 microversion: 2.1 time: 0.039512 Jul 28 04:14:06.446703 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3495/5945] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:06 2022] GET /compute/v2.1/servers/9044a2af-7cb6-404a-8621-fa4f7f0f094c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:06.448694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-051d055d-11e5-4487-b48d-162d0b981956 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.449202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-051d055d-11e5-4487-b48d-162d0b981956 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.456888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-051d055d-11e5-4487-b48d-162d0b981956 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.457337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-051d055d-11e5-4487-b48d-162d0b981956 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.458349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-051d055d-11e5-4487-b48d-162d0b981956 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.458781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-051d055d-11e5-4487-b48d-162d0b981956 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.488631 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-051d055d-11e5-4487-b48d-162d0b981956 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-051d055d-11e5-4487-b48d-162d0b981956 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 HTTP/1.1 Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9f30498a-75fb-440e-a219-aadced2bb957'} Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:06.490481 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:14:06.495715 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.495715 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.495715 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.495715 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.495715 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.495715 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.495715 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:06.495715 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:06.495715 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:14:06.495715 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.495715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-051d055d-11e5-4487-b48d-162d0b981956 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:06.495715 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-051d055d-11e5-4487-b48d-162d0b981956 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 404 len: 111 microversion: 2.1 time: 0.047309 Jul 28 04:14:06.499418 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3496/5946] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:14:06 2022] DELETE /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:06.504407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6bfc11a2-79a3-4dad-8ae7-e04f17f209d2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.505018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6bfc11a2-79a3-4dad-8ae7-e04f17f209d2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9f30498a-75fb-440e-a219-aadced2bb957] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.511630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6bfc11a2-79a3-4dad-8ae7-e04f17f209d2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.512364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6bfc11a2-79a3-4dad-8ae7-e04f17f209d2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.513324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6bfc11a2-79a3-4dad-8ae7-e04f17f209d2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.513904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6bfc11a2-79a3-4dad-8ae7-e04f17f209d2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.530570 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-6bfc11a2-79a3-4dad-8ae7-e04f17f209d2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6bfc11a2-79a3-4dad-8ae7-e04f17f209d2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 HTTP/1.1 Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9f30498a-75fb-440e-a219-aadced2bb957'} Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.532241 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.535761 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.535761 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.535761 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:06.535761 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:06.535761 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. Jul 28 04:14:06.535761 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.535761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6bfc11a2-79a3-4dad-8ae7-e04f17f209d2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 9f30498a-75fb-440e-a219-aadced2bb957 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:06.535761 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6bfc11a2-79a3-4dad-8ae7-e04f17f209d2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957" status: 404 len: 111 microversion: 2.1 time: 0.033329 Jul 28 04:14:06.535761 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3497/5947] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:06 2022] GET /compute/v2.1/servers/9f30498a-75fb-440e-a219-aadced2bb957 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:06.546464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-35257362-0ce7-4f22-8ff9-088badb654b6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.546969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-35257362-0ce7-4f22-8ff9-088badb654b6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9c0dd3e0-ef18-458c-addd-e4981c4b3a65] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.553286 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-35257362-0ce7-4f22-8ff9-088badb654b6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-35257362-0ce7-4f22-8ff9-088badb654b6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/9c0dd3e0-ef18-458c-addd-e4981c4b3a65 HTTP/1.1 Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9c0dd3e0-ef18-458c-addd-e4981c4b3a65'} Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.555057 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.559349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.559349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.559349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.559349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:06.559349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:06.559349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:14:06.559349 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.559349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-35257362-0ce7-4f22-8ff9-088badb654b6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:06.559349 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-35257362-0ce7-4f22-8ff9-088badb654b6 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9c0dd3e0-ef18-458c-addd-e4981c4b3a65" status: 404 len: 111 microversion: 2.1 time: 0.016718 Jul 28 04:14:06.559349 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3498/5948] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:14:06 2022] DELETE /compute/v2.1/servers/9c0dd3e0-ef18-458c-addd-e4981c4b3a65 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:06.565945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca989cb1-72e9-41f0-8483-68279f60fc80 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.566644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca989cb1-72e9-41f0-8483-68279f60fc80 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: 9c0dd3e0-ef18-458c-addd-e4981c4b3a65] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.574289 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-ca989cb1-72e9-41f0-8483-68279f60fc80 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca989cb1-72e9-41f0-8483-68279f60fc80 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/9c0dd3e0-ef18-458c-addd-e4981c4b3a65 HTTP/1.1 Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9c0dd3e0-ef18-458c-addd-e4981c4b3a65'} Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:06.575911 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:06.582052 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:06.582052 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:06.582052 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. Jul 28 04:14:06.582052 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:06.582052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca989cb1-72e9-41f0-8483-68279f60fc80 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance 9c0dd3e0-ef18-458c-addd-e4981c4b3a65 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:06.582052 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca989cb1-72e9-41f0-8483-68279f60fc80 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/9c0dd3e0-ef18-458c-addd-e4981c4b3a65" status: 404 len: 111 microversion: 2.1 time: 0.015886 Jul 28 04:14:06.582052 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3499/5949] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:06 2022] GET /compute/v2.1/servers/9c0dd3e0-ef18-458c-addd-e4981c4b3a65 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:06.587113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-18af08b8-8a6e-41ca-8755-826864851bf2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.587617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-18af08b8-8a6e-41ca-8755-826864851bf2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.595738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18af08b8-8a6e-41ca-8755-826864851bf2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.596275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18af08b8-8a6e-41ca-8755-826864851bf2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.597453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18af08b8-8a6e-41ca-8755-826864851bf2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.597971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18af08b8-8a6e-41ca-8755-826864851bf2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.631417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-18af08b8-8a6e-41ca-8755-826864851bf2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:14:06.754371 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-18af08b8-8a6e-41ca-8755-826864851bf2 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 204 len: 0 microversion: 2.1 time: 0.171175 Jul 28 04:14:06.758594 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3500/5950] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:14:06 2022] DELETE /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:14:06.764501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-36b21138-f8c7-4d85-b5f8-5cb0a53812e4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.765318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-36b21138-f8c7-4d85-b5f8-5cb0a53812e4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.773461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36b21138-f8c7-4d85-b5f8-5cb0a53812e4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.774301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36b21138-f8c7-4d85-b5f8-5cb0a53812e4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.775315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36b21138-f8c7-4d85-b5f8-5cb0a53812e4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.776212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36b21138-f8c7-4d85-b5f8-5cb0a53812e4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.930931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-36b21138-f8c7-4d85-b5f8-5cb0a53812e4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51725aab85a2402a8ab18734e311a8f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ab37ec4f7d4c6fa7329faed8d570a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:06.939196 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-36b21138-f8c7-4d85-b5f8-5cb0a53812e4 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6" status: 200 len: 1464 microversion: 2.1 time: 0.179180 Jul 28 04:14:06.939905 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3501/5951] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:06 2022] GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 => generated 1464 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:06.945600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ecdb1f2c-66c1-4b62-9e02-9da250191551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:06.946329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ecdb1f2c-66c1-4b62-9e02-9da250191551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:06.953082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ecdb1f2c-66c1-4b62-9e02-9da250191551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.953822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ecdb1f2c-66c1-4b62-9e02-9da250191551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:06.954845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ecdb1f2c-66c1-4b62-9e02-9da250191551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:06.956829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ecdb1f2c-66c1-4b62-9e02-9da250191551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:07.098645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ecdb1f2c-66c1-4b62-9e02-9da250191551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:07.106796 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ecdb1f2c-66c1-4b62-9e02-9da250191551 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1480 microversion: 2.1 time: 0.164860 Jul 28 04:14:07.107374 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3502/5952] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:06 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1480 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:07.111885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4344e6b6-08ca-45b5-937f-8526e68954c9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:07.112527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4344e6b6-08ca-45b5-937f-8526e68954c9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:07.119015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4344e6b6-08ca-45b5-937f-8526e68954c9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:07.119475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4344e6b6-08ca-45b5-937f-8526e68954c9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:07.120246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4344e6b6-08ca-45b5-937f-8526e68954c9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:07.120726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4344e6b6-08ca-45b5-937f-8526e68954c9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:07.271546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4344e6b6-08ca-45b5-937f-8526e68954c9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:07.281059 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4344e6b6-08ca-45b5-937f-8526e68954c9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1694 microversion: 2.1 time: 0.172371 Jul 28 04:14:07.281537 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3503/5953] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:07 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:07.286325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-65280a1d-583d-42ac-bfb4-809677e63620 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:07.286831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-65280a1d-583d-42ac-bfb4-809677e63620 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:07.293048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65280a1d-583d-42ac-bfb4-809677e63620 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:07.293718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65280a1d-583d-42ac-bfb4-809677e63620 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:07.294499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65280a1d-583d-42ac-bfb4-809677e63620 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:07.294942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65280a1d-583d-42ac-bfb4-809677e63620 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:07.340266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-65280a1d-583d-42ac-bfb4-809677e63620 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:14:07.448142 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-65280a1d-583d-42ac-bfb4-809677e63620 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6" status: 204 len: 0 microversion: 2.1 time: 0.165050 Jul 28 04:14:07.452297 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3504/5954] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:14:07 2022] DELETE /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:14:07.460292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a5785150-d229-46eb-9be8-2f5aa4b67939 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:07.461293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a5785150-d229-46eb-9be8-2f5aa4b67939 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:07.471111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5785150-d229-46eb-9be8-2f5aa4b67939 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:07.471736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5785150-d229-46eb-9be8-2f5aa4b67939 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:07.472633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5785150-d229-46eb-9be8-2f5aa4b67939 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:07.473125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5785150-d229-46eb-9be8-2f5aa4b67939 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:07.677294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a5785150-d229-46eb-9be8-2f5aa4b67939 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51725aab85a2402a8ab18734e311a8f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ab37ec4f7d4c6fa7329faed8d570a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:07.686857 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a5785150-d229-46eb-9be8-2f5aa4b67939 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6" status: 200 len: 1470 microversion: 2.1 time: 0.232019 Jul 28 04:14:07.688244 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3505/5955] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:07 2022] GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:08.128681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6191aaae-2994-4326-91cf-e553d42be49f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:08.129285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6191aaae-2994-4326-91cf-e553d42be49f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:08.136338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6191aaae-2994-4326-91cf-e553d42be49f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:08.136826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6191aaae-2994-4326-91cf-e553d42be49f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:08.137599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6191aaae-2994-4326-91cf-e553d42be49f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:08.138037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6191aaae-2994-4326-91cf-e553d42be49f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:08.312074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6191aaae-2994-4326-91cf-e553d42be49f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:08.324257 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6191aaae-2994-4326-91cf-e553d42be49f tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1480 microversion: 2.1 time: 0.199553 Jul 28 04:14:08.324887 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3506/5956] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:08 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1480 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:08.338250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83bacb6e-4832-454e-8100-16dc23f7de8c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:08.339070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-83bacb6e-4832-454e-8100-16dc23f7de8c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:08.345304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83bacb6e-4832-454e-8100-16dc23f7de8c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:08.345755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83bacb6e-4832-454e-8100-16dc23f7de8c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:08.346541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83bacb6e-4832-454e-8100-16dc23f7de8c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:08.346966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83bacb6e-4832-454e-8100-16dc23f7de8c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:08.500944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-83bacb6e-4832-454e-8100-16dc23f7de8c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:08.511132 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-83bacb6e-4832-454e-8100-16dc23f7de8c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1694 microversion: 2.1 time: 0.176988 Jul 28 04:14:08.512021 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3507/5957] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:08 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:08.708753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1df9611c-cbbe-4a30-ab59-b5c9660cbc76 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:08.709692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1df9611c-cbbe-4a30-ab59-b5c9660cbc76 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:08.718019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1df9611c-cbbe-4a30-ab59-b5c9660cbc76 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:08.719168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1df9611c-cbbe-4a30-ab59-b5c9660cbc76 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:08.719274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1df9611c-cbbe-4a30-ab59-b5c9660cbc76 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:08.719733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1df9611c-cbbe-4a30-ab59-b5c9660cbc76 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:09.263128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1df9611c-cbbe-4a30-ab59-b5c9660cbc76 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51725aab85a2402a8ab18734e311a8f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ab37ec4f7d4c6fa7329faed8d570a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:09.280247 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1df9611c-cbbe-4a30-ab59-b5c9660cbc76 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6" status: 200 len: 1470 microversion: 2.1 time: 0.575273 Jul 28 04:14:09.282300 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3508/5958] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:08 2022] GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 => generated 1470 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:09.349099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-db1989a5-c6bc-490d-bb13-e6e13211b2cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:09.350113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-db1989a5-c6bc-490d-bb13-e6e13211b2cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:09.360222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db1989a5-c6bc-490d-bb13-e6e13211b2cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:09.360733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db1989a5-c6bc-490d-bb13-e6e13211b2cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:09.361526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db1989a5-c6bc-490d-bb13-e6e13211b2cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:09.362089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db1989a5-c6bc-490d-bb13-e6e13211b2cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:09.527210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-db1989a5-c6bc-490d-bb13-e6e13211b2cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:09.541657 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-db1989a5-c6bc-490d-bb13-e6e13211b2cd tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1480 microversion: 2.1 time: 0.198458 Jul 28 04:14:09.543078 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3509/5959] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:09 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1480 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:09.556030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ecedf2e5-c680-4a44-89c9-b666113e8c63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:09.558521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ecedf2e5-c680-4a44-89c9-b666113e8c63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:09.570125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ecedf2e5-c680-4a44-89c9-b666113e8c63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:09.573804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ecedf2e5-c680-4a44-89c9-b666113e8c63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:09.574678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ecedf2e5-c680-4a44-89c9-b666113e8c63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:09.575134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ecedf2e5-c680-4a44-89c9-b666113e8c63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:09.780786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ecedf2e5-c680-4a44-89c9-b666113e8c63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:09.793781 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ecedf2e5-c680-4a44-89c9-b666113e8c63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1694 microversion: 2.1 time: 0.248995 Jul 28 04:14:09.808061 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3510/5960] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:09 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1694 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:10.101005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3c90822c-7f4b-4646-89d2-4a79beec4498 req-25fc8c93-a236-4109-b63e-a8f977f21fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc9d61bc-58e6-465f-b27c-ca477224e6f6", "name": "network-vif-deleted", "tag": "dcbb899c-9344-43ec-8824-ec0249205c1c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:10.118958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3c90822c-7f4b-4646-89d2-4a79beec4498 req-25fc8c93-a236-4109-b63e-a8f977f21fdd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:10.119420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3c90822c-7f4b-4646-89d2-4a79beec4498 req-25fc8c93-a236-4109-b63e-a8f977f21fdd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:10.154422 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3c90822c-7f4b-4646-89d2-4a79beec4498 req-25fc8c93-a236-4109-b63e-a8f977f21fdd service nova] Creating event network-vif-deleted:dcbb899c-9344-43ec-8824-ec0249205c1c for instance dc9d61bc-58e6-465f-b27c-ca477224e6f6 on n-h1-826756-3 Jul 28 04:14:10.163908 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3c90822c-7f4b-4646-89d2-4a79beec4498 req-25fc8c93-a236-4109-b63e-a8f977f21fdd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063025 Jul 28 04:14:10.165389 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3511/5961] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:14:10.308187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4823c130-650a-48d7-a4f7-87caf13ca2d7 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:10.310969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4823c130-650a-48d7-a4f7-87caf13ca2d7 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:10.325683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4823c130-650a-48d7-a4f7-87caf13ca2d7 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:10.327608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4823c130-650a-48d7-a4f7-87caf13ca2d7 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:10.328768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4823c130-650a-48d7-a4f7-87caf13ca2d7 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:10.329378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4823c130-650a-48d7-a4f7-87caf13ca2d7 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:10.341866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:10.397800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4823c130-650a-48d7-a4f7-87caf13ca2d7 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:10.400663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4823c130-650a-48d7-a4f7-87caf13ca2d7 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:10.401307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-4823c130-650a-48d7-a4f7-87caf13ca2d7 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lazy-loading 'fault' on Instance uuid dc9d61bc-58e6-465f-b27c-ca477224e6f6 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:14:10.465881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4823c130-650a-48d7-a4f7-87caf13ca2d7 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51725aab85a2402a8ab18734e311a8f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4ab37ec4f7d4c6fa7329faed8d570a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:10.478770 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4823c130-650a-48d7-a4f7-87caf13ca2d7 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6" status: 200 len: 1305 microversion: 2.1 time: 0.179643 Jul 28 04:14:10.479372 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3512/5962] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:10 2022] GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 => generated 1305 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:10.568745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-edc6f524-7bc2-4f5a-a362-c897492af5fb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:10.569368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-edc6f524-7bc2-4f5a-a362-c897492af5fb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:10.587141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edc6f524-7bc2-4f5a-a362-c897492af5fb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:10.587589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edc6f524-7bc2-4f5a-a362-c897492af5fb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:10.588408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edc6f524-7bc2-4f5a-a362-c897492af5fb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:10.588840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edc6f524-7bc2-4f5a-a362-c897492af5fb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:10.648265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edc6f524-7bc2-4f5a-a362-c897492af5fb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:10.648833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edc6f524-7bc2-4f5a-a362-c897492af5fb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:10.649350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-edc6f524-7bc2-4f5a-a362-c897492af5fb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lazy-loading 'fault' on Instance uuid d2d47858-4b4a-4292-869e-185e1ec5012f {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:14:10.715052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-edc6f524-7bc2-4f5a-a362-c897492af5fb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24e6476d226840c4adc1ea6c54dfd527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80687f6afee046a6bac1043f7c99677b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:10.723293 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-edc6f524-7bc2-4f5a-a362-c897492af5fb tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 200 len: 1283 microversion: 2.1 time: 0.161378 Jul 28 04:14:10.723968 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3513/5963] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:10 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 1283 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:10.815852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f7d726bd-787d-46fa-a806-c7b6cacf9f38 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:10.816747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f7d726bd-787d-46fa-a806-c7b6cacf9f38 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:10.826434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7d726bd-787d-46fa-a806-c7b6cacf9f38 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:10.827663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7d726bd-787d-46fa-a806-c7b6cacf9f38 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:10.828885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7d726bd-787d-46fa-a806-c7b6cacf9f38 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:10.829642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7d726bd-787d-46fa-a806-c7b6cacf9f38 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:11.096371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f7d726bd-787d-46fa-a806-c7b6cacf9f38 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:11.106656 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f7d726bd-787d-46fa-a806-c7b6cacf9f38 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1694 microversion: 2.1 time: 0.295271 Jul 28 04:14:11.107685 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3514/5964] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:10 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1694 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:11.504790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a9a5a2b3-e00a-4507-ac56-1325bc9f1236 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:11.507087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a9a5a2b3-e00a-4507-ac56-1325bc9f1236 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] [instance: dc9d61bc-58e6-465f-b27c-ca477224e6f6] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:11.516735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9a5a2b3-e00a-4507-ac56-1325bc9f1236 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:11.517566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9a5a2b3-e00a-4507-ac56-1325bc9f1236 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:11.518497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9a5a2b3-e00a-4507-ac56-1325bc9f1236 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:11.519300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9a5a2b3-e00a-4507-ac56-1325bc9f1236 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:11.536698 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-a9a5a2b3-e00a-4507-ac56-1325bc9f1236 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] HTTP exception thrown: Instance dc9d61bc-58e6-465f-b27c-ca477224e6f6 could not be found. Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a9a5a2b3-e00a-4507-ac56-1325bc9f1236 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Request method failure captured: Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 HTTP/1.1 Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gz_6dBjAsRXMk9zmBVYxRnewKiGCVsnwWjfeMzLS5FzKUJQUr3ll6JkGNN8nuI6tcoTh_GeTQ3_xcSOVTwB6ciux6ymrz4gQ-V6YlrP9l8Hdv7rfB_DwspH1p95ExXT-6EURzJwI2MkWTDAZmbt0wXqz9m89bgJGeXvDGtHa5xpd94 Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: b4ab37ec4f7d4c6fa7329faed8d570a3 Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-VolumesNegativeTest-1134288907 Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b4ab37ec4f7d4c6fa7329faed8d570a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b4ab37ec4f7d4c6fa7329faed8d570a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b4ab37ec4f7d4c6fa7329faed8d570a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b4ab37ec4f7d4c6fa7329faed8d570a3"}]}] Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-VolumesNegativeTest-1134288907 Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: b4ab37ec4f7d4c6fa7329faed8d570a3 Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-VolumesNegativeTest-1134288907 Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-VolumesNegativeTest-1134288907-project Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 51725aab85a2402a8ab18734e311a8f8 Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-VolumesNegativeTest-1134288907-project Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance dc9d61bc-58e6-465f-b27c-ca477224e6f6 could not be found. Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'dc9d61bc-58e6-465f-b27c-ca477224e6f6'} Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc9d61bc-58e6-465f-b27c-ca477224e6f6 could not be found. Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc9d61bc-58e6-465f-b27c-ca477224e6f6 could not be found. Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:11.538617 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:11.542482 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:11.542482 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:11.542482 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:11.542482 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:11.542482 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:11.542482 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc9d61bc-58e6-465f-b27c-ca477224e6f6 could not be found. Jul 28 04:14:11.542482 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:11.542482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a9a5a2b3-e00a-4507-ac56-1325bc9f1236 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] Returning 404 to user: Instance dc9d61bc-58e6-465f-b27c-ca477224e6f6 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:11.542482 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a9a5a2b3-e00a-4507-ac56-1325bc9f1236 tempest-VolumesNegativeTest-1134288907 tempest-VolumesNegativeTest-1134288907-project] 10.222.0.48 "GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6" status: 404 len: 111 microversion: 2.1 time: 0.039778 Jul 28 04:14:11.546308 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3515/5965] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:11 2022] GET /compute/v2.1/servers/dc9d61bc-58e6-465f-b27c-ca477224e6f6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:14:11.754085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4154781a-595d-4397-b97f-b867d6496181 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:11.754715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4154781a-595d-4397-b97f-b867d6496181 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] [instance: d2d47858-4b4a-4292-869e-185e1ec5012f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:11.766142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4154781a-595d-4397-b97f-b867d6496181 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:11.766530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4154781a-595d-4397-b97f-b867d6496181 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:11.767316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4154781a-595d-4397-b97f-b867d6496181 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:11.779073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4154781a-595d-4397-b97f-b867d6496181 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:11.795895 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-4154781a-595d-4397-b97f-b867d6496181 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] HTTP exception thrown: Instance d2d47858-4b4a-4292-869e-185e1ec5012f could not be found. Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4154781a-595d-4397-b97f-b867d6496181 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Request method failure captured: Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f HTTP/1.1 Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gwxnREu5Mco3KFioUvK4d7UgV0DaG38OlbBUIII6b54p8Aax27qXSdfL2Bqu4bBWzbVx_kp8fxwix0bwDZRKTkGPaWIgQAWiRSNdFw8xu8rxgTwbcuvhAymv8gwuyKsFNHAkK2dzh7QZpV6smPOFbir7ilw6NGnHOmeMsbXuwkyw6I Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_80687f6afee046a6bac1043f7c99677b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/80687f6afee046a6bac1043f7c99677b"}]}] Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersTestJSON-1560115403 Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 80687f6afee046a6bac1043f7c99677b Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersTestJSON-1560115403 Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 24e6476d226840c4adc1ea6c54dfd527 Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersTestJSON-1560115403-project Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d2d47858-4b4a-4292-869e-185e1ec5012f could not be found. Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd2d47858-4b4a-4292-869e-185e1ec5012f'} Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2d47858-4b4a-4292-869e-185e1ec5012f could not be found. Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2d47858-4b4a-4292-869e-185e1ec5012f could not be found. Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:11.797498 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:14:11.803758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:14:11.803758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:14:11.803758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:14:11.803758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:14:11.803758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2d47858-4b4a-4292-869e-185e1ec5012f could not be found. Jul 28 04:14:11.803758 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:14:11.803758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4154781a-595d-4397-b97f-b867d6496181 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] Returning 404 to user: Instance d2d47858-4b4a-4292-869e-185e1ec5012f could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:14:11.803758 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4154781a-595d-4397-b97f-b867d6496181 tempest-ServersTestJSON-1560115403 tempest-ServersTestJSON-1560115403-project] 10.222.0.48 "GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f" status: 404 len: 111 microversion: 2.1 time: 0.050809 Jul 28 04:14:11.803758 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3516/5966] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:11 2022] GET /compute/v2.1/servers/d2d47858-4b4a-4292-869e-185e1ec5012f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:14:12.133360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7488c3ff-3318-471d-88e5-d2d184240cb0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:12.134127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7488c3ff-3318-471d-88e5-d2d184240cb0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:12.144641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7488c3ff-3318-471d-88e5-d2d184240cb0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:12.146954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7488c3ff-3318-471d-88e5-d2d184240cb0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:12.149360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7488c3ff-3318-471d-88e5-d2d184240cb0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:12.150677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7488c3ff-3318-471d-88e5-d2d184240cb0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:12.466894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7488c3ff-3318-471d-88e5-d2d184240cb0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:12.491210 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7488c3ff-3318-471d-88e5-d2d184240cb0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1694 microversion: 2.1 time: 0.355773 Jul 28 04:14:12.491210 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3517/5967] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:12 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1694 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:12.491210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a18d95df-716c-4e55-becc-45cd181965c9 req-86c6e4a2-7361-4a81-98a1-5fc9e533cd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2d47858-4b4a-4292-869e-185e1ec5012f", "name": "network-vif-deleted", "tag": "8e2eef61-5181-4874-bc24-425a4b45d0d5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:12.501464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a18d95df-716c-4e55-becc-45cd181965c9 req-86c6e4a2-7361-4a81-98a1-5fc9e533cd27 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:12.503167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a18d95df-716c-4e55-becc-45cd181965c9 req-86c6e4a2-7361-4a81-98a1-5fc9e533cd27 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:12.517967 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a18d95df-716c-4e55-becc-45cd181965c9 req-86c6e4a2-7361-4a81-98a1-5fc9e533cd27 service nova] Creating event network-vif-deleted:8e2eef61-5181-4874-bc24-425a4b45d0d5 for instance d2d47858-4b4a-4292-869e-185e1ec5012f on n-h1-826756-3 Jul 28 04:14:12.524144 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a18d95df-716c-4e55-becc-45cd181965c9 req-86c6e4a2-7361-4a81-98a1-5fc9e533cd27 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039591 Jul 28 04:14:12.525281 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3518/5968] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:13.505345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-55ac8d25-d330-4d7a-94ce-6c64ef9bea3c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:13.506291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-55ac8d25-d330-4d7a-94ce-6c64ef9bea3c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:13.519244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55ac8d25-d330-4d7a-94ce-6c64ef9bea3c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:13.519782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55ac8d25-d330-4d7a-94ce-6c64ef9bea3c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:13.521999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55ac8d25-d330-4d7a-94ce-6c64ef9bea3c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:13.525481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55ac8d25-d330-4d7a-94ce-6c64ef9bea3c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:13.836539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-55ac8d25-d330-4d7a-94ce-6c64ef9bea3c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:13.852147 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-55ac8d25-d330-4d7a-94ce-6c64ef9bea3c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1694 microversion: 2.1 time: 0.352273 Jul 28 04:14:13.861206 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3519/5969] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:13 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1694 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:14.873900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0afe824c-189e-40b1-a410-a48672c35f57 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:14.874526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0afe824c-189e-40b1-a410-a48672c35f57 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:14.889285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0afe824c-189e-40b1-a410-a48672c35f57 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:14.889871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0afe824c-189e-40b1-a410-a48672c35f57 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:14.891228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0afe824c-189e-40b1-a410-a48672c35f57 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:14.891928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0afe824c-189e-40b1-a410-a48672c35f57 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:15.221955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0afe824c-189e-40b1-a410-a48672c35f57 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:15.243947 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0afe824c-189e-40b1-a410-a48672c35f57 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1694 microversion: 2.1 time: 0.373954 Jul 28 04:14:15.246078 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3520/5970] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:14 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1694 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:16.268005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59d77bbb-d354-4f3d-8752-37114f1f28ab tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:16.268710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59d77bbb-d354-4f3d-8752-37114f1f28ab tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:16.283916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59d77bbb-d354-4f3d-8752-37114f1f28ab tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:16.284387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59d77bbb-d354-4f3d-8752-37114f1f28ab tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:16.285363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59d77bbb-d354-4f3d-8752-37114f1f28ab tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:16.285957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59d77bbb-d354-4f3d-8752-37114f1f28ab tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:16.509134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-59d77bbb-d354-4f3d-8752-37114f1f28ab tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:16.524477 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59d77bbb-d354-4f3d-8752-37114f1f28ab tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1694 microversion: 2.1 time: 0.260398 Jul 28 04:14:16.532966 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3521/5971] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:16 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1694 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:17.546541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c00bd621-9da2-4de4-ba77-7428704fd18f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:17.547938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c00bd621-9da2-4de4-ba77-7428704fd18f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:17.559126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c00bd621-9da2-4de4-ba77-7428704fd18f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:17.559954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c00bd621-9da2-4de4-ba77-7428704fd18f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:17.561229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c00bd621-9da2-4de4-ba77-7428704fd18f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:17.562024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c00bd621-9da2-4de4-ba77-7428704fd18f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:17.779929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c00bd621-9da2-4de4-ba77-7428704fd18f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:17.790942 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c00bd621-9da2-4de4-ba77-7428704fd18f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1694 microversion: 2.1 time: 0.248266 Jul 28 04:14:17.791851 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3522/5972] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:17 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1694 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:18.422671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c4cd2b14-5ea4-4839-ba2a-1d22e1cb7c04 tempest-ComputeTenantNetworksTest-577898369 tempest-ComputeTenantNetworksTest-577898369-project] Calling method '.version_select at 0x7ffa747da1f0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:18.654101 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c4cd2b14-5ea4-4839-ba2a-1d22e1cb7c04 tempest-ComputeTenantNetworksTest-577898369 tempest-ComputeTenantNetworksTest-577898369-project] 10.222.0.48 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.363890 Jul 28 04:14:18.656658 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3523/5973] 10.222.0.48 () {58 vars in 1158 bytes} [Thu Jul 28 04:14:18 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:18.667009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d1be29af-3aa7-4b91-bba6-44e4fad444e7 tempest-ComputeTenantNetworksTest-577898369 tempest-ComputeTenantNetworksTest-577898369-project] Calling method '.version_select at 0x7ffa74239700>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:18.788606 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d1be29af-3aa7-4b91-bba6-44e4fad444e7 tempest-ComputeTenantNetworksTest-577898369 tempest-ComputeTenantNetworksTest-577898369-project] 10.222.0.48 "GET /compute/v2.1/os-tenant-networks/e0fe1e42-8407-43e5-ad76-f803f8fe69fa" status: 200 len: 140 microversion: 2.1 time: 0.126788 Jul 28 04:14:18.789596 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3524/5974] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 04:14:18 2022] GET /compute/v2.1/os-tenant-networks/e0fe1e42-8407-43e5-ad76-f803f8fe69fa => generated 140 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:18.817211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b831125-679a-4c14-b906-51a3c9dbbcd6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:18.818290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b831125-679a-4c14-b906-51a3c9dbbcd6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:18.835535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b831125-679a-4c14-b906-51a3c9dbbcd6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:18.836257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b831125-679a-4c14-b906-51a3c9dbbcd6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:18.837962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b831125-679a-4c14-b906-51a3c9dbbcd6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:18.838484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b831125-679a-4c14-b906-51a3c9dbbcd6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:19.111252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b831125-679a-4c14-b906-51a3c9dbbcd6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:19.121351 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b831125-679a-4c14-b906-51a3c9dbbcd6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1694 microversion: 2.1 time: 0.309278 Jul 28 04:14:19.137205 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3525/5975] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:18 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1694 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:20.145360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e97dd6d-8310-4c06-98d3-133276858c1e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:20.146073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4e97dd6d-8310-4c06-98d3-133276858c1e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:20.155920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e97dd6d-8310-4c06-98d3-133276858c1e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:20.156401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e97dd6d-8310-4c06-98d3-133276858c1e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:20.158261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e97dd6d-8310-4c06-98d3-133276858c1e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:20.159343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e97dd6d-8310-4c06-98d3-133276858c1e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:20.381941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e97dd6d-8310-4c06-98d3-133276858c1e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:20.392922 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e97dd6d-8310-4c06-98d3-133276858c1e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1694 microversion: 2.1 time: 0.251348 Jul 28 04:14:20.393759 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3526/5976] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:20 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1694 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:21.415825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0e263be-d60a-4ee1-b11d-49a960dcb5e3 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:21.416558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e0e263be-d60a-4ee1-b11d-49a960dcb5e3 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:21.424453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0e263be-d60a-4ee1-b11d-49a960dcb5e3 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:21.425072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0e263be-d60a-4ee1-b11d-49a960dcb5e3 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:21.426014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0e263be-d60a-4ee1-b11d-49a960dcb5e3 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:21.426516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0e263be-d60a-4ee1-b11d-49a960dcb5e3 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:21.691653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e0e263be-d60a-4ee1-b11d-49a960dcb5e3 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:21.707209 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e0e263be-d60a-4ee1-b11d-49a960dcb5e3 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1694 microversion: 2.1 time: 0.295668 Jul 28 04:14:21.708162 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3527/5977] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:21 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1694 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:22.732100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-222212e4-647d-491b-95c0-dbc92f81299f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:22.733453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-222212e4-647d-491b-95c0-dbc92f81299f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:22.742241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-222212e4-647d-491b-95c0-dbc92f81299f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:22.742736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-222212e4-647d-491b-95c0-dbc92f81299f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:22.743564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-222212e4-647d-491b-95c0-dbc92f81299f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:22.744007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-222212e4-647d-491b-95c0-dbc92f81299f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:23.003213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-222212e4-647d-491b-95c0-dbc92f81299f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:23.018330 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-222212e4-647d-491b-95c0-dbc92f81299f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1693 microversion: 2.1 time: 0.290759 Jul 28 04:14:23.019690 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3528/5978] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:22 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1693 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:23.042635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-412d2bfe-f4d2-4e16-942e-2b24ef9b91a6 req-7add7ce5-e0ab-48d4-aa17-df3089473a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b621e0-6ff2-44af-b71b-9d9178e3fdbd", "name": "network-vif-unplugged", "status": "completed", "tag": "12359d9a-9928-43ee-8d00-b4cef96dc189"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:23.080155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-412d2bfe-f4d2-4e16-942e-2b24ef9b91a6 req-7add7ce5-e0ab-48d4-aa17-df3089473a9d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:23.083921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-412d2bfe-f4d2-4e16-942e-2b24ef9b91a6 req-7add7ce5-e0ab-48d4-aa17-df3089473a9d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:23.111888 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-412d2bfe-f4d2-4e16-942e-2b24ef9b91a6 req-7add7ce5-e0ab-48d4-aa17-df3089473a9d service nova] Creating event network-vif-unplugged:12359d9a-9928-43ee-8d00-b4cef96dc189 for instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd on n-h1-826756-3 Jul 28 04:14:23.136238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-412d2bfe-f4d2-4e16-942e-2b24ef9b91a6 req-7add7ce5-e0ab-48d4-aa17-df3089473a9d service nova] Instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:14:23.149231 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-412d2bfe-f4d2-4e16-942e-2b24ef9b91a6 req-7add7ce5-e0ab-48d4-aa17-df3089473a9d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125245 Jul 28 04:14:23.156465 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3529/5979] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:24.058565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6a797685-5a4e-4db6-ab48-89ac7ea9805a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:24.060587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6a797685-5a4e-4db6-ab48-89ac7ea9805a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:24.069931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a797685-5a4e-4db6-ab48-89ac7ea9805a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:24.070653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a797685-5a4e-4db6-ab48-89ac7ea9805a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:24.071623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a797685-5a4e-4db6-ab48-89ac7ea9805a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:24.072261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a797685-5a4e-4db6-ab48-89ac7ea9805a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:24.546786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6a797685-5a4e-4db6-ab48-89ac7ea9805a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:24.562176 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6a797685-5a4e-4db6-ab48-89ac7ea9805a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1693 microversion: 2.1 time: 0.519097 Jul 28 04:14:24.563159 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3530/5980] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:24 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1693 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:25.519945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-eac2dd45-63af-4832-a556-77193f90b3e5 req-11c37aff-91c4-4da8-b248-0e2c225d8f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b621e0-6ff2-44af-b71b-9d9178e3fdbd", "tag": "12359d9a-9928-43ee-8d00-b4cef96dc189"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:25.541434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-eac2dd45-63af-4832-a556-77193f90b3e5 req-11c37aff-91c4-4da8-b248-0e2c225d8f74 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:25.542019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-eac2dd45-63af-4832-a556-77193f90b3e5 req-11c37aff-91c4-4da8-b248-0e2c225d8f74 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:25.596520 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-eac2dd45-63af-4832-a556-77193f90b3e5 req-11c37aff-91c4-4da8-b248-0e2c225d8f74 service nova] Creating event network-changed:12359d9a-9928-43ee-8d00-b4cef96dc189 for instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd on n-h1-826756-3 Jul 28 04:14:25.612447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-eac2dd45-63af-4832-a556-77193f90b3e5 req-11c37aff-91c4-4da8-b248-0e2c225d8f74 service nova] Instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:14:25.640884 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-eac2dd45-63af-4832-a556-77193f90b3e5 req-11c37aff-91c4-4da8-b248-0e2c225d8f74 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125587 Jul 28 04:14:25.644316 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3531/5981] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:25.660185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2256af9b-8cf6-444c-b701-07d6d06d165a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:25.660936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2256af9b-8cf6-444c-b701-07d6d06d165a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:25.666188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:25.681594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2256af9b-8cf6-444c-b701-07d6d06d165a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:25.682065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2256af9b-8cf6-444c-b701-07d6d06d165a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:25.682875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2256af9b-8cf6-444c-b701-07d6d06d165a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:25.683319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2256af9b-8cf6-444c-b701-07d6d06d165a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:26.399006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2256af9b-8cf6-444c-b701-07d6d06d165a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:26.402640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:26.415302 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2256af9b-8cf6-444c-b701-07d6d06d165a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1693 microversion: 2.1 time: 0.767920 Jul 28 04:14:26.416786 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3532/5982] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:25 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1693 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:27.442968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f6b24fe0-9a15-43cd-af26-178a5ff28f90 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:27.443787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f6b24fe0-9a15-43cd-af26-178a5ff28f90 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:27.465538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6b24fe0-9a15-43cd-af26-178a5ff28f90 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:27.466283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6b24fe0-9a15-43cd-af26-178a5ff28f90 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:27.467917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6b24fe0-9a15-43cd-af26-178a5ff28f90 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:27.468404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6b24fe0-9a15-43cd-af26-178a5ff28f90 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:27.851974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f6b24fe0-9a15-43cd-af26-178a5ff28f90 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:27.865562 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f6b24fe0-9a15-43cd-af26-178a5ff28f90 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1691 microversion: 2.1 time: 0.429464 Jul 28 04:14:27.867890 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3533/5983] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:27 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1691 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:28.890681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6edd5062-78e8-458c-962c-94adc7244f3a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:28.892053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6edd5062-78e8-458c-962c-94adc7244f3a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:28.903199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6edd5062-78e8-458c-962c-94adc7244f3a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:28.904169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6edd5062-78e8-458c-962c-94adc7244f3a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:28.905498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6edd5062-78e8-458c-962c-94adc7244f3a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:28.906295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6edd5062-78e8-458c-962c-94adc7244f3a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:29.100798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6edd5062-78e8-458c-962c-94adc7244f3a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:29.120039 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6edd5062-78e8-458c-962c-94adc7244f3a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1688 microversion: 2.1 time: 0.235345 Jul 28 04:14:29.121001 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3534/5984] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:28 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1688 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:29.422740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-066a59fe-987c-4c06-b23a-9e0662fc6fe0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Action: 'create', calling method: .version_select at 0x7ffa66f534c0>, body: {"keypair": {"name": "tempest-keypair-1883564665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnsiGjXcg8E1ERIzBIbsrV1t2ibsTE7sGZy4tzq/MZ8WjbyPRl9vKFtKz4gBFj1RPwcVlgcyC11HfXyu6nC5E3nuLvdYQVIrgLyQQaLL081mK7uRArOTD2KR0HxM098Yw=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:29.472699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-066a59fe-987c-4c06-b23a-9e0662fc6fe0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Getting quotas for project 55b218635b214337bf26fb6aec7303d1. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:14:29.482297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-066a59fe-987c-4c06-b23a-9e0662fc6fe0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Getting quotas for user 60995164494047448eaccf6c93997d69 and project 55b218635b214337bf26fb6aec7303d1. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:14:29.513589 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-066a59fe-987c-4c06-b23a-9e0662fc6fe0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.391482 Jul 28 04:14:29.514665 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3535/5985] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:14:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:29.523177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94676353-23c7-4998-a1a1-67522bbfabea tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:29.523927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-94676353-23c7-4998-a1a1-67522bbfabea tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:29.531274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94676353-23c7-4998-a1a1-67522bbfabea tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:29.531983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94676353-23c7-4998-a1a1-67522bbfabea tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:29.533065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94676353-23c7-4998-a1a1-67522bbfabea tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:29.533680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94676353-23c7-4998-a1a1-67522bbfabea tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:29.737548 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-94676353-23c7-4998-a1a1-67522bbfabea tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd/action" status: 204 len: 0 microversion: 2.1 time: 0.219364 Jul 28 04:14:29.741749 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3536/5986] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:14:29 2022] POST /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd/action => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:14:29.768679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1d4de96a-0281-4dcb-b9bb-154cf7f2e6c4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:29.769871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1d4de96a-0281-4dcb-b9bb-154cf7f2e6c4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:29.789647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d4de96a-0281-4dcb-b9bb-154cf7f2e6c4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:29.790215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d4de96a-0281-4dcb-b9bb-154cf7f2e6c4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:29.791113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d4de96a-0281-4dcb-b9bb-154cf7f2e6c4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:29.791634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d4de96a-0281-4dcb-b9bb-154cf7f2e6c4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:29.997181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1d4de96a-0281-4dcb-b9bb-154cf7f2e6c4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:30.007747 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1d4de96a-0281-4dcb-b9bb-154cf7f2e6c4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1688 microversion: 2.1 time: 0.263938 Jul 28 04:14:30.022322 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3537/5987] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:29 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1688 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:31.035534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8e282b70-4aaa-480c-bdbf-ed92f91fc3fb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:31.035534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8e282b70-4aaa-480c-bdbf-ed92f91fc3fb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:31.055861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e282b70-4aaa-480c-bdbf-ed92f91fc3fb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:31.056950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e282b70-4aaa-480c-bdbf-ed92f91fc3fb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:31.058520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e282b70-4aaa-480c-bdbf-ed92f91fc3fb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:31.059218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e282b70-4aaa-480c-bdbf-ed92f91fc3fb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:31.446109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8e282b70-4aaa-480c-bdbf-ed92f91fc3fb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:31.456029 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8e282b70-4aaa-480c-bdbf-ed92f91fc3fb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1688 microversion: 2.1 time: 0.429672 Jul 28 04:14:31.473501 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3538/5988] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:31 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1688 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:31.484430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-63a9ff47-24b8-433a-abac-14544cb04c4a req-ef36bf4b-fec4-49e9-8a3f-97aca9dd9c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b621e0-6ff2-44af-b71b-9d9178e3fdbd", "name": "network-vif-plugged", "status": "completed", "tag": "12359d9a-9928-43ee-8d00-b4cef96dc189"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:31.518912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-63a9ff47-24b8-433a-abac-14544cb04c4a req-ef36bf4b-fec4-49e9-8a3f-97aca9dd9c0b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:31.522913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-63a9ff47-24b8-433a-abac-14544cb04c4a req-ef36bf4b-fec4-49e9-8a3f-97aca9dd9c0b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:31.544290 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-63a9ff47-24b8-433a-abac-14544cb04c4a req-ef36bf4b-fec4-49e9-8a3f-97aca9dd9c0b service nova] Creating event network-vif-plugged:12359d9a-9928-43ee-8d00-b4cef96dc189 for instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd on n-h1-826756-3 Jul 28 04:14:31.551809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-63a9ff47-24b8-433a-abac-14544cb04c4a req-ef36bf4b-fec4-49e9-8a3f-97aca9dd9c0b service nova] Instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:14:31.575136 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-63a9ff47-24b8-433a-abac-14544cb04c4a req-ef36bf4b-fec4-49e9-8a3f-97aca9dd9c0b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099483 Jul 28 04:14:31.575880 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3539/5989] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:32.305680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1876429721", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23fcc26a-4916-49f3-b9c9-8b34fb69bd78"}], "security_groups": [{"name": "tempest-securitygroup--837078016"}], "key_name": "tempest-keypair-1883564665", "user_data": "}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:32.517478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] validate_networks() for [('23fcc26a-4916-49f3-b9c9-8b34fb69bd78', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:14:33.344899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:14:33.345852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:14:33.345852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:14:33.346198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:14:33.346930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:14:33.359195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:33.359910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:33.361083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:33.361772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:33.390633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Getting quotas for project 55b218635b214337bf26fb6aec7303d1. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:14:33.397324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Getting quotas for user 60995164494047448eaccf6c93997d69 and project 55b218635b214337bf26fb6aec7303d1. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:14:33.413258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:14:33.416318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:14:33.500151 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-369f90eb-4cf8-4214-add4-a915f83e547e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.201241 Jul 28 04:14:33.508610 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3540/5990] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:14:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:14:33.522272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-330cbf59-5dd6-40c3-ad1c-44f4e44871f1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:33.524716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-330cbf59-5dd6-40c3-ad1c-44f4e44871f1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:33.550115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-330cbf59-5dd6-40c3-ad1c-44f4e44871f1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:33.550770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-330cbf59-5dd6-40c3-ad1c-44f4e44871f1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:33.551913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-330cbf59-5dd6-40c3-ad1c-44f4e44871f1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:33.553423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-330cbf59-5dd6-40c3-ad1c-44f4e44871f1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:33.827125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-330cbf59-5dd6-40c3-ad1c-44f4e44871f1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:33.839425 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-330cbf59-5dd6-40c3-ad1c-44f4e44871f1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1680 microversion: 2.1 time: 0.329128 Jul 28 04:14:33.854569 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3541/5991] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:33 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1680 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:33.882598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-195fb9d4-f06f-4c57-9f1e-2a64eabe3662 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:33.888686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-195fb9d4-f06f-4c57-9f1e-2a64eabe3662 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:34.022518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-195fb9d4-f06f-4c57-9f1e-2a64eabe3662 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:34.030920 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-195fb9d4-f06f-4c57-9f1e-2a64eabe3662 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1238 microversion: 2.1 time: 0.175069 Jul 28 04:14:34.034924 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3542/5992] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:33 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1238 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:35.059779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1ab1d450-e897-46a1-9a0b-29445970d4ed tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:35.061119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1ab1d450-e897-46a1-9a0b-29445970d4ed tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:35.070457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ab1d450-e897-46a1-9a0b-29445970d4ed tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:35.071208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ab1d450-e897-46a1-9a0b-29445970d4ed tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:35.072166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ab1d450-e897-46a1-9a0b-29445970d4ed tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:35.072787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ab1d450-e897-46a1-9a0b-29445970d4ed tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:35.153138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1ab1d450-e897-46a1-9a0b-29445970d4ed tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:35.168044 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1ab1d450-e897-46a1-9a0b-29445970d4ed tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1290 microversion: 2.1 time: 0.113623 Jul 28 04:14:35.168690 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3543/5993] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:35 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1290 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:36.198920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c3943040-e06e-47fa-acdd-daf137b52b20 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:36.200214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c3943040-e06e-47fa-acdd-daf137b52b20 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:36.214243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3943040-e06e-47fa-acdd-daf137b52b20 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:36.216718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3943040-e06e-47fa-acdd-daf137b52b20 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:36.217903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3943040-e06e-47fa-acdd-daf137b52b20 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:36.218594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3943040-e06e-47fa-acdd-daf137b52b20 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:36.313578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c3943040-e06e-47fa-acdd-daf137b52b20 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:36.326017 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c3943040-e06e-47fa-acdd-daf137b52b20 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1296 microversion: 2.1 time: 0.136274 Jul 28 04:14:36.327423 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3544/5994] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:36 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1296 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:37.353430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-efefffa2-d85d-4bb9-be0c-3e5e4560bfc6 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:37.354460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-efefffa2-d85d-4bb9-be0c-3e5e4560bfc6 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:37.367516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efefffa2-d85d-4bb9-be0c-3e5e4560bfc6 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:37.367875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efefffa2-d85d-4bb9-be0c-3e5e4560bfc6 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:37.368838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efefffa2-d85d-4bb9-be0c-3e5e4560bfc6 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:37.370029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efefffa2-d85d-4bb9-be0c-3e5e4560bfc6 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:37.623860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-efefffa2-d85d-4bb9-be0c-3e5e4560bfc6 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:37.639444 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-efefffa2-d85d-4bb9-be0c-3e5e4560bfc6 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1363 microversion: 2.1 time: 0.292130 Jul 28 04:14:37.654024 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3545/5995] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:37 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:38.375472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-98e2cbf9-0ec9-4656-94e6-7d46fa4d3e0b req-d025b659-6e72-4476-a384-1c5417e2db72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f60937-da1d-4d73-896f-2330f115f960", "tag": "1a52fdfb-14c8-4d92-9b08-f6984c4d52b4"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:38.395375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-98e2cbf9-0ec9-4656-94e6-7d46fa4d3e0b req-d025b659-6e72-4476-a384-1c5417e2db72 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:38.395978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-98e2cbf9-0ec9-4656-94e6-7d46fa4d3e0b req-d025b659-6e72-4476-a384-1c5417e2db72 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:38.418156 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-98e2cbf9-0ec9-4656-94e6-7d46fa4d3e0b req-d025b659-6e72-4476-a384-1c5417e2db72 service nova] Creating event network-changed:1a52fdfb-14c8-4d92-9b08-f6984c4d52b4 for instance d6f60937-da1d-4d73-896f-2330f115f960 on n-h2-826756-3 Jul 28 04:14:38.425430 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-98e2cbf9-0ec9-4656-94e6-7d46fa4d3e0b req-d025b659-6e72-4476-a384-1c5417e2db72 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055041 Jul 28 04:14:38.426551 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3546/5996] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:38.664280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-30d32e80-7cb2-4e30-a398-354b3fcd5e49 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:38.665604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-30d32e80-7cb2-4e30-a398-354b3fcd5e49 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:38.678989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30d32e80-7cb2-4e30-a398-354b3fcd5e49 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:38.679867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30d32e80-7cb2-4e30-a398-354b3fcd5e49 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:38.681683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30d32e80-7cb2-4e30-a398-354b3fcd5e49 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:38.682430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-30d32e80-7cb2-4e30-a398-354b3fcd5e49 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:38.914150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-30d32e80-7cb2-4e30-a398-354b3fcd5e49 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:38.924534 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-30d32e80-7cb2-4e30-a398-354b3fcd5e49 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1363 microversion: 2.1 time: 0.266857 Jul 28 04:14:38.925913 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3547/5997] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:38 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:39.947406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9be8e66c-1795-4924-b319-938f6a212deb tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:39.949017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9be8e66c-1795-4924-b319-938f6a212deb tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:39.958456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9be8e66c-1795-4924-b319-938f6a212deb tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:39.959328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9be8e66c-1795-4924-b319-938f6a212deb tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:39.960658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9be8e66c-1795-4924-b319-938f6a212deb tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:39.961402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9be8e66c-1795-4924-b319-938f6a212deb tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:40.135068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9be8e66c-1795-4924-b319-938f6a212deb tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:40.143715 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9be8e66c-1795-4924-b319-938f6a212deb tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1363 microversion: 2.1 time: 0.200798 Jul 28 04:14:40.152797 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3548/5998] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:39 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:41.165498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c817287e-4999-4386-b602-c7a9fb0d12b1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:41.166318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c817287e-4999-4386-b602-c7a9fb0d12b1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:41.174219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c817287e-4999-4386-b602-c7a9fb0d12b1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:41.174443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c817287e-4999-4386-b602-c7a9fb0d12b1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:41.175568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c817287e-4999-4386-b602-c7a9fb0d12b1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:41.176155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c817287e-4999-4386-b602-c7a9fb0d12b1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:41.381274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c817287e-4999-4386-b602-c7a9fb0d12b1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:41.390234 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c817287e-4999-4386-b602-c7a9fb0d12b1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1363 microversion: 2.1 time: 0.228446 Jul 28 04:14:41.391007 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3549/5999] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:41 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:42.411422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dcb75975-7ceb-4861-8a29-830dec423d37 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:42.412543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dcb75975-7ceb-4861-8a29-830dec423d37 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:42.420388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcb75975-7ceb-4861-8a29-830dec423d37 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:42.420865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcb75975-7ceb-4861-8a29-830dec423d37 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:42.421821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcb75975-7ceb-4861-8a29-830dec423d37 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:42.422450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcb75975-7ceb-4861-8a29-830dec423d37 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:42.589235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dcb75975-7ceb-4861-8a29-830dec423d37 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:42.597678 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dcb75975-7ceb-4861-8a29-830dec423d37 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1363 microversion: 2.1 time: 0.190284 Jul 28 04:14:42.598484 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3550/6000] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:42 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:43.621051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9bad64f0-f743-460d-94e9-6b7d7a274df1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:43.622358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9bad64f0-f743-460d-94e9-6b7d7a274df1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:43.629058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:43.633381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bad64f0-f743-460d-94e9-6b7d7a274df1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:43.634072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bad64f0-f743-460d-94e9-6b7d7a274df1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:43.635028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bad64f0-f743-460d-94e9-6b7d7a274df1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:43.635642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bad64f0-f743-460d-94e9-6b7d7a274df1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:43.818662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9bad64f0-f743-460d-94e9-6b7d7a274df1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:43.833381 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9bad64f0-f743-460d-94e9-6b7d7a274df1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1363 microversion: 2.1 time: 0.216144 Jul 28 04:14:43.844330 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3551/6001] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:43 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:44.858924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f127110b-b3cf-48cb-adee-808daea879b8 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:44.860273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f127110b-b3cf-48cb-adee-808daea879b8 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:44.862388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:44.869502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f127110b-b3cf-48cb-adee-808daea879b8 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:44.870806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f127110b-b3cf-48cb-adee-808daea879b8 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:44.871609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f127110b-b3cf-48cb-adee-808daea879b8 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:44.872054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f127110b-b3cf-48cb-adee-808daea879b8 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:44.875145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:45.016547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f127110b-b3cf-48cb-adee-808daea879b8 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:45.027218 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f127110b-b3cf-48cb-adee-808daea879b8 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1363 microversion: 2.1 time: 0.172461 Jul 28 04:14:45.028003 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3552/6002] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:44 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:45.032903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-36655c27-526f-4c55-bb86-93110248e426 req-9dd70cb7-234c-4b4f-a852-81dc29420a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f60937-da1d-4d73-896f-2330f115f960", "name": "network-vif-plugged", "status": "completed", "tag": "1a52fdfb-14c8-4d92-9b08-f6984c4d52b4"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:45.043428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-36655c27-526f-4c55-bb86-93110248e426 req-9dd70cb7-234c-4b4f-a852-81dc29420a4a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:45.043990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-36655c27-526f-4c55-bb86-93110248e426 req-9dd70cb7-234c-4b4f-a852-81dc29420a4a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:45.061375 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-36655c27-526f-4c55-bb86-93110248e426 req-9dd70cb7-234c-4b4f-a852-81dc29420a4a service nova] Creating event network-vif-plugged:1a52fdfb-14c8-4d92-9b08-f6984c4d52b4 for instance d6f60937-da1d-4d73-896f-2330f115f960 on n-h2-826756-3 Jul 28 04:14:45.066511 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-36655c27-526f-4c55-bb86-93110248e426 req-9dd70cb7-234c-4b4f-a852-81dc29420a4a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037019 Jul 28 04:14:45.067128 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3553/6003] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:46.061650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5bfc9755-4073-4ac9-9984-9dad5ab9a553 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:46.062651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5bfc9755-4073-4ac9-9984-9dad5ab9a553 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:46.072479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5bfc9755-4073-4ac9-9984-9dad5ab9a553 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:46.073026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5bfc9755-4073-4ac9-9984-9dad5ab9a553 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:46.073913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5bfc9755-4073-4ac9-9984-9dad5ab9a553 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:46.074445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5bfc9755-4073-4ac9-9984-9dad5ab9a553 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:46.227537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5bfc9755-4073-4ac9-9984-9dad5ab9a553 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:46.235973 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5bfc9755-4073-4ac9-9984-9dad5ab9a553 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1363 microversion: 2.1 time: 0.181831 Jul 28 04:14:46.236685 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3554/6004] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:46 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:14:47.259463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74bc430d-70a3-443c-824f-a13bbe88f16e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:47.261741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74bc430d-70a3-443c-824f-a13bbe88f16e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:47.274458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74bc430d-70a3-443c-824f-a13bbe88f16e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:47.275413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74bc430d-70a3-443c-824f-a13bbe88f16e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:47.277137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74bc430d-70a3-443c-824f-a13bbe88f16e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:47.278252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74bc430d-70a3-443c-824f-a13bbe88f16e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:47.520072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-74bc430d-70a3-443c-824f-a13bbe88f16e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:47.528646 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74bc430d-70a3-443c-824f-a13bbe88f16e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1549 microversion: 2.1 time: 0.275864 Jul 28 04:14:47.529233 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3555/6005] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:47 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1549 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:47.550726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17c2f85b-2430-48e1-b35a-e703154fc332 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:47.551232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-17c2f85b-2430-48e1-b35a-e703154fc332 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:47.558781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17c2f85b-2430-48e1-b35a-e703154fc332 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:47.559422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17c2f85b-2430-48e1-b35a-e703154fc332 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:47.560375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17c2f85b-2430-48e1-b35a-e703154fc332 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:47.560969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17c2f85b-2430-48e1-b35a-e703154fc332 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:47.638333 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-17c2f85b-2430-48e1-b35a-e703154fc332 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092651 Jul 28 04:14:47.638944 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3556/6006] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 04:14:47 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:48.764689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-712adfb9-2673-42a7-a0a8-176b89d010e0 req-8b99905c-fec5-4f7a-89c9-be3977a75198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f60937-da1d-4d73-896f-2330f115f960", "tag": "1a52fdfb-14c8-4d92-9b08-f6984c4d52b4"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:48.778394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-712adfb9-2673-42a7-a0a8-176b89d010e0 req-8b99905c-fec5-4f7a-89c9-be3977a75198 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:48.778874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-712adfb9-2673-42a7-a0a8-176b89d010e0 req-8b99905c-fec5-4f7a-89c9-be3977a75198 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:48.804536 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-712adfb9-2673-42a7-a0a8-176b89d010e0 req-8b99905c-fec5-4f7a-89c9-be3977a75198 service nova] Creating event network-changed:1a52fdfb-14c8-4d92-9b08-f6984c4d52b4 for instance d6f60937-da1d-4d73-896f-2330f115f960 on n-h2-826756-3 Jul 28 04:14:48.810032 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-712adfb9-2673-42a7-a0a8-176b89d010e0 req-8b99905c-fec5-4f7a-89c9-be3977a75198 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050159 Jul 28 04:14:48.812044 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3557/6007] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:54.160736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5e918511-a7a1-4a1d-a5db-a388181b8940 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:54.163226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5e918511-a7a1-4a1d-a5db-a388181b8940 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:14:54.170028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e918511-a7a1-4a1d-a5db-a388181b8940 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:54.170753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e918511-a7a1-4a1d-a5db-a388181b8940 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:54.171606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e918511-a7a1-4a1d-a5db-a388181b8940 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:54.172118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e918511-a7a1-4a1d-a5db-a388181b8940 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:54.224805 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5e918511-a7a1-4a1d-a5db-a388181b8940 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd/action" status: 200 len: 24577 microversion: 2.1 time: 0.069524 Jul 28 04:14:54.225925 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3558/6008] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:14:54 2022] POST /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd/action => generated 24577 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:15:00.627184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-484d5ad7-31df-4b58-976d-7fe6c1b2ffeb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:00.628006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-484d5ad7-31df-4b58-976d-7fe6c1b2ffeb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:00.635060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:15:00.637291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-484d5ad7-31df-4b58-976d-7fe6c1b2ffeb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:00.637931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-484d5ad7-31df-4b58-976d-7fe6c1b2ffeb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:00.638724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-484d5ad7-31df-4b58-976d-7fe6c1b2ffeb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:00.639156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-484d5ad7-31df-4b58-976d-7fe6c1b2ffeb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:00.805366 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-484d5ad7-31df-4b58-976d-7fe6c1b2ffeb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1831 microversion: 2.1 time: 0.178457 Jul 28 04:15:00.806900 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3559/6009] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:00 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1831 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:02.183767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-da7b4721-c108-45f0-a278-624f29b7008c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:02.184322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-da7b4721-c108-45f0-a278-624f29b7008c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:02.196479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da7b4721-c108-45f0-a278-624f29b7008c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:02.197141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da7b4721-c108-45f0-a278-624f29b7008c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:02.197727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da7b4721-c108-45f0-a278-624f29b7008c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:02.198545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da7b4721-c108-45f0-a278-624f29b7008c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:02.229575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-da7b4721-c108-45f0-a278-624f29b7008c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:15:02.365842 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-da7b4721-c108-45f0-a278-624f29b7008c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "DELETE /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 204 len: 0 microversion: 2.1 time: 0.185418 Jul 28 04:15:02.367846 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3560/6010] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:15:02 2022] DELETE /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:15:02.377375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-35d004b4-da0a-4c3e-b145-b594be8fd08a req-ca2372ec-7b9a-4a3a-a648-29739c064024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41b621e0-6ff2-44af-b71b-9d9178e3fdbd", "tag": "12359d9a-9928-43ee-8d00-b4cef96dc189"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:02.391013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-35d004b4-da0a-4c3e-b145-b594be8fd08a req-ca2372ec-7b9a-4a3a-a648-29739c064024 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:02.391013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-35d004b4-da0a-4c3e-b145-b594be8fd08a req-ca2372ec-7b9a-4a3a-a648-29739c064024 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:02.405077 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-35d004b4-da0a-4c3e-b145-b594be8fd08a req-ca2372ec-7b9a-4a3a-a648-29739c064024 service nova] Creating event network-changed:12359d9a-9928-43ee-8d00-b4cef96dc189 for instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd on n-h1-826756-3 Jul 28 04:15:02.411315 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-35d004b4-da0a-4c3e-b145-b594be8fd08a req-ca2372ec-7b9a-4a3a-a648-29739c064024 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041372 Jul 28 04:15:02.417164 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3561/6011] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:15:02.423426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6122c71b-0909-483f-9380-765b5fc20850 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:02.424630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6122c71b-0909-483f-9380-765b5fc20850 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:02.432932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6122c71b-0909-483f-9380-765b5fc20850 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:02.433381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6122c71b-0909-483f-9380-765b5fc20850 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:02.435663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6122c71b-0909-483f-9380-765b5fc20850 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:02.436053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6122c71b-0909-483f-9380-765b5fc20850 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:02.651672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6122c71b-0909-483f-9380-765b5fc20850 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:02.660601 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6122c71b-0909-483f-9380-765b5fc20850 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1686 microversion: 2.1 time: 0.241549 Jul 28 04:15:02.661664 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3562/6012] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:02 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1686 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:03.682464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ecaed246-f75f-412f-86f1-f905082093d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:03.684455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ecaed246-f75f-412f-86f1-f905082093d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:03.692587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ecaed246-f75f-412f-86f1-f905082093d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:03.702481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ecaed246-f75f-412f-86f1-f905082093d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:03.703468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ecaed246-f75f-412f-86f1-f905082093d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:03.703936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ecaed246-f75f-412f-86f1-f905082093d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:03.889484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ecaed246-f75f-412f-86f1-f905082093d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:03.900464 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ecaed246-f75f-412f-86f1-f905082093d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1686 microversion: 2.1 time: 0.221389 Jul 28 04:15:03.901086 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3563/6013] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:03 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1686 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:04.486552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e6e3e1db-5bc8-4f9b-a753-e1aa44d9bece req-60d20c31-0822-4962-b175-f55af47910d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41b621e0-6ff2-44af-b71b-9d9178e3fdbd", "name": "network-vif-deleted", "tag": "12359d9a-9928-43ee-8d00-b4cef96dc189"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:04.514734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e6e3e1db-5bc8-4f9b-a753-e1aa44d9bece req-60d20c31-0822-4962-b175-f55af47910d5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:04.515402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e6e3e1db-5bc8-4f9b-a753-e1aa44d9bece req-60d20c31-0822-4962-b175-f55af47910d5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:04.532516 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e6e3e1db-5bc8-4f9b-a753-e1aa44d9bece req-60d20c31-0822-4962-b175-f55af47910d5 service nova] Creating event network-vif-deleted:12359d9a-9928-43ee-8d00-b4cef96dc189 for instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd on n-h1-826756-3 Jul 28 04:15:04.541631 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e6e3e1db-5bc8-4f9b-a753-e1aa44d9bece req-60d20c31-0822-4962-b175-f55af47910d5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068585 Jul 28 04:15:04.542681 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3564/6014] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:15:04.934872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1b3720df-c3cd-41e3-a5b1-b2e5c7fe2971 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:04.935642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1b3720df-c3cd-41e3-a5b1-b2e5c7fe2971 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:04.975525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b3720df-c3cd-41e3-a5b1-b2e5c7fe2971 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:04.976212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b3720df-c3cd-41e3-a5b1-b2e5c7fe2971 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:04.977437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b3720df-c3cd-41e3-a5b1-b2e5c7fe2971 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:04.978458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b3720df-c3cd-41e3-a5b1-b2e5c7fe2971 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:05.018125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b3720df-c3cd-41e3-a5b1-b2e5c7fe2971 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:05.018875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b3720df-c3cd-41e3-a5b1-b2e5c7fe2971 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:05.019497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-1b3720df-c3cd-41e3-a5b1-b2e5c7fe2971 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lazy-loading 'fault' on Instance uuid 41b621e0-6ff2-44af-b71b-9d9178e3fdbd {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:15:05.065433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1b3720df-c3cd-41e3-a5b1-b2e5c7fe2971 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:05.074305 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1b3720df-c3cd-41e3-a5b1-b2e5c7fe2971 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 200 len: 1356 microversion: 2.1 time: 0.155078 Jul 28 04:15:05.075073 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3565/6015] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:04 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:05.714826 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:15:05.715516 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:15:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:15:06.101254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-793947ba-6209-474f-a03f-b3faebb852de tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:06.102451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-793947ba-6209-474f-a03f-b3faebb852de tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 41b621e0-6ff2-44af-b71b-9d9178e3fdbd] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:06.109950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-793947ba-6209-474f-a03f-b3faebb852de tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:06.110597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-793947ba-6209-474f-a03f-b3faebb852de tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:06.111532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-793947ba-6209-474f-a03f-b3faebb852de tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:06.112114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-793947ba-6209-474f-a03f-b3faebb852de tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:06.127152 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-793947ba-6209-474f-a03f-b3faebb852de tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] HTTP exception thrown: Instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd could not be found. Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-793947ba-6209-474f-a03f-b3faebb852de tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Request method failure captured: Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd HTTP/1.1 Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gy0wHx96BVxhyrDFvyRJsSuYIisOw-l-wszQ9XKSZbRRP5vlwalQKYK5hBNyy9WnKnKBmW3QuxEmH_3MqtnQ-B8fUcW5QF0OqJPqXMuA7juF0K-NDS0wf4uTw9P7GbriXF73fWwKh9phWFNUD6o7PkvGEVFYXU7L-2lzVhpHOKHQ8M Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7ea463b2785d46a08c278fa7041654e4 Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1842633679 Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7ea463b2785d46a08c278fa7041654e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ea463b2785d46a08c278fa7041654e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7ea463b2785d46a08c278fa7041654e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ea463b2785d46a08c278fa7041654e4"}]}] Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1842633679 Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7ea463b2785d46a08c278fa7041654e4 Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1842633679 Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestNetworkAdvancedServerOps-1842633679-project Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 63fc192385a7490aacce2d69bfc866ec Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1842633679-project Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd could not be found. Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '41b621e0-6ff2-44af-b71b-9d9178e3fdbd'} Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd could not be found. Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd could not be found. Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:15:06.129405 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:15:06.133818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:15:06.133818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:15:06.133818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:15:06.133818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:15:06.133818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:15:06.133818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:15:06.133818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd could not be found. Jul 28 04:15:06.133818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:15:06.135652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-793947ba-6209-474f-a03f-b3faebb852de tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Returning 404 to user: Instance 41b621e0-6ff2-44af-b71b-9d9178e3fdbd could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:15:06.136824 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-793947ba-6209-474f-a03f-b3faebb852de tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd" status: 404 len: 111 microversion: 2.1 time: 0.039766 Jul 28 04:15:06.137665 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3566/6016] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:06 2022] GET /compute/v2.1/servers/41b621e0-6ff2-44af-b71b-9d9178e3fdbd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:15:10.870983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c997ec9e-5fcf-444a-845e-ff9c9761c58e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '.version_select at 0x7ffa674be3a0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:10.925127 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c997ec9e-5fcf-444a-845e-ff9c9761c58e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-921342836" status: 202 len: 0 microversion: 2.1 time: 0.058247 Jul 28 04:15:10.929920 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3567/6017] 10.222.0.48 () {58 vars in 1281 bytes} [Thu Jul 28 04:15:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-921342836 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:15:10.981875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-611d66d4-0702-49fd-a147-cf6b5b8dabb7 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'create', calling method: .version_select at 0x7ffa67ae7c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-43982873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmeAh0jSVUjcanQ05cPw/pikSI6O+m1qCPmAqF0GnAzCPdNIdDtrpyBlpLUEYerva/G3tlgfzzi5l/YsU9McBzU+j85PWXM0jwE9tSMEkv4dC7PTZoTQw0znOHgyAmb4Q=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:11.026686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-611d66d4-0702-49fd-a147-cf6b5b8dabb7 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for project 7ea463b2785d46a08c278fa7041654e4. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:15:11.033926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-611d66d4-0702-49fd-a147-cf6b5b8dabb7 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for user 63fc192385a7490aacce2d69bfc866ec and project 7ea463b2785d46a08c278fa7041654e4. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:15:11.119296 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-611d66d4-0702-49fd-a147-cf6b5b8dabb7 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.144511 Jul 28 04:15:11.130123 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3568/6018] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:15:10 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:15:19.093556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1822268465", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "20976045-8bff-41ee-8b72-1e146953d13a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-43982873", "security_groups": [{"name": "tempest-secgroup-smoke-505676783"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:19.137007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:15:19.349084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] validate_networks() for [('20976045-8bff-41ee-8b72-1e146953d13a', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:15:20.433178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:15:20.434592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:15:20.435446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:15:20.436227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:15:20.437282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:15:20.453721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:20.454820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:20.457422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:20.458422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:20.484325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for project 7ea463b2785d46a08c278fa7041654e4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:15:20.491177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for user 63fc192385a7490aacce2d69bfc866ec and project 7ea463b2785d46a08c278fa7041654e4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:15:20.509493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:15:20.513236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:15:20.574122 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1cc19aa4-b5fb-4c40-bad1-095ffa11cfd2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.488515 Jul 28 04:15:20.575575 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3569/6019] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:15:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:15:20.592535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a0e59364-472e-42c5-8575-7a13fff3087e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:20.593524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a0e59364-472e-42c5-8575-7a13fff3087e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:20.666028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a0e59364-472e-42c5-8575-7a13fff3087e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:20.675740 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a0e59364-472e-42c5-8575-7a13fff3087e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1265 microversion: 2.1 time: 0.086989 Jul 28 04:15:20.676595 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3570/6020] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:20 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:21.703290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca8f2dc3-b6c4-4eea-aa91-7a71b9e34013 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:21.703994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca8f2dc3-b6c4-4eea-aa91-7a71b9e34013 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:21.719085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca8f2dc3-b6c4-4eea-aa91-7a71b9e34013 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:21.719539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca8f2dc3-b6c4-4eea-aa91-7a71b9e34013 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:21.720391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca8f2dc3-b6c4-4eea-aa91-7a71b9e34013 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:21.720812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca8f2dc3-b6c4-4eea-aa91-7a71b9e34013 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:21.835122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca8f2dc3-b6c4-4eea-aa91-7a71b9e34013 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:21.858277 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca8f2dc3-b6c4-4eea-aa91-7a71b9e34013 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1317 microversion: 2.1 time: 0.159484 Jul 28 04:15:21.860280 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3571/6021] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:21 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:22.886240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a3231c31-ec19-4bd3-a35f-9cd2b13b96ed tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:22.887051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a3231c31-ec19-4bd3-a35f-9cd2b13b96ed tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:22.899450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3231c31-ec19-4bd3-a35f-9cd2b13b96ed tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:22.900049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3231c31-ec19-4bd3-a35f-9cd2b13b96ed tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:22.901302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3231c31-ec19-4bd3-a35f-9cd2b13b96ed tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:22.902989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3231c31-ec19-4bd3-a35f-9cd2b13b96ed tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:23.246502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a3231c31-ec19-4bd3-a35f-9cd2b13b96ed tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:23.259778 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a3231c31-ec19-4bd3-a35f-9cd2b13b96ed tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1390 microversion: 2.1 time: 0.381966 Jul 28 04:15:23.264482 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3572/6022] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:22 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1390 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:24.297114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-24383aa5-edc9-4f4a-bb95-985608e374a4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:24.298447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-24383aa5-edc9-4f4a-bb95-985608e374a4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:24.314096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24383aa5-edc9-4f4a-bb95-985608e374a4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:24.325401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24383aa5-edc9-4f4a-bb95-985608e374a4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:24.328419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24383aa5-edc9-4f4a-bb95-985608e374a4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:24.329113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24383aa5-edc9-4f4a-bb95-985608e374a4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:24.610272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-24383aa5-edc9-4f4a-bb95-985608e374a4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:24.620286 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-24383aa5-edc9-4f4a-bb95-985608e374a4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1390 microversion: 2.1 time: 0.329931 Jul 28 04:15:24.621479 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3573/6023] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:24 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1390 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:24.638463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4b1963f6-a763-44e8-af71-9748c2727369 req-beec8884-be73-4a15-abf3-b1a64eccdb60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ffc9184-9cca-41c1-9f1b-632b054335a0", "tag": "e7417f7a-8526-4fd3-8845-7740756e6cfe"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:24.656469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4b1963f6-a763-44e8-af71-9748c2727369 req-beec8884-be73-4a15-abf3-b1a64eccdb60 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:24.660672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4b1963f6-a763-44e8-af71-9748c2727369 req-beec8884-be73-4a15-abf3-b1a64eccdb60 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:24.682916 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4b1963f6-a763-44e8-af71-9748c2727369 req-beec8884-be73-4a15-abf3-b1a64eccdb60 service nova] Creating event network-changed:e7417f7a-8526-4fd3-8845-7740756e6cfe for instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 on n-h1-826756-3 Jul 28 04:15:24.689455 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4b1963f6-a763-44e8-af71-9748c2727369 req-beec8884-be73-4a15-abf3-b1a64eccdb60 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066474 Jul 28 04:15:24.692807 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3574/6024] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:15:25.192711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d1756ae6-7718-420c-b448-ce6c209e7af0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:25.193191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d1756ae6-7718-420c-b448-ce6c209e7af0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:25.200575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1756ae6-7718-420c-b448-ce6c209e7af0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:25.201029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1756ae6-7718-420c-b448-ce6c209e7af0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:25.201848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1756ae6-7718-420c-b448-ce6c209e7af0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:25.202619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1756ae6-7718-420c-b448-ce6c209e7af0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:25.228435 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d1756ae6-7718-420c-b448-ce6c209e7af0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/ips" status: 200 len: 146 microversion: 2.1 time: 0.040344 Jul 28 04:15:25.229021 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3575/6025] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 04:15:25 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:15:25.646076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc0cf2da-50fe-43c0-87f7-c09dc72f4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:25.646895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dc0cf2da-50fe-43c0-87f7-c09dc72f4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:25.656260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc0cf2da-50fe-43c0-87f7-c09dc72f4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:25.656747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc0cf2da-50fe-43c0-87f7-c09dc72f4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:25.659667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc0cf2da-50fe-43c0-87f7-c09dc72f4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:25.660336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc0cf2da-50fe-43c0-87f7-c09dc72f4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:25.829757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dc0cf2da-50fe-43c0-87f7-c09dc72f4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:25.846309 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc0cf2da-50fe-43c0-87f7-c09dc72f4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1390 microversion: 2.1 time: 0.204802 Jul 28 04:15:25.862299 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3576/6026] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:25 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1390 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:26.883464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8e1cc5e3-b1c1-41b3-b8c1-2ffed4ad8ddf tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:26.884164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8e1cc5e3-b1c1-41b3-b8c1-2ffed4ad8ddf tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:26.893887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e1cc5e3-b1c1-41b3-b8c1-2ffed4ad8ddf tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:26.894344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e1cc5e3-b1c1-41b3-b8c1-2ffed4ad8ddf tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:26.895684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e1cc5e3-b1c1-41b3-b8c1-2ffed4ad8ddf tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:26.896296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e1cc5e3-b1c1-41b3-b8c1-2ffed4ad8ddf tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:27.288863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8e1cc5e3-b1c1-41b3-b8c1-2ffed4ad8ddf tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:27.328032 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8e1cc5e3-b1c1-41b3-b8c1-2ffed4ad8ddf tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1390 microversion: 2.1 time: 0.439944 Jul 28 04:15:27.356032 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3577/6027] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:26 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1390 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:28.352205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c95b997-f0bd-4822-9375-0be2deb5bc11 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:28.356403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c95b997-f0bd-4822-9375-0be2deb5bc11 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:28.374507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c95b997-f0bd-4822-9375-0be2deb5bc11 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:28.374971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c95b997-f0bd-4822-9375-0be2deb5bc11 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:28.375816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c95b997-f0bd-4822-9375-0be2deb5bc11 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:28.376269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c95b997-f0bd-4822-9375-0be2deb5bc11 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:28.641868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1c95b997-f0bd-4822-9375-0be2deb5bc11 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:28.674642 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c95b997-f0bd-4822-9375-0be2deb5bc11 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1390 microversion: 2.1 time: 0.326460 Jul 28 04:15:28.685644 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3578/6028] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:28 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1390 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:29.381849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f62f56a1-fc50-4876-8848-5038a487b416 req-5e35b8cf-c42b-45aa-8da7-c76eb099261a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffc9184-9cca-41c1-9f1b-632b054335a0", "name": "network-vif-plugged", "status": "completed", "tag": "e7417f7a-8526-4fd3-8845-7740756e6cfe"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:29.394246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f62f56a1-fc50-4876-8848-5038a487b416 req-5e35b8cf-c42b-45aa-8da7-c76eb099261a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:29.394756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f62f56a1-fc50-4876-8848-5038a487b416 req-5e35b8cf-c42b-45aa-8da7-c76eb099261a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:29.408487 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f62f56a1-fc50-4876-8848-5038a487b416 req-5e35b8cf-c42b-45aa-8da7-c76eb099261a service nova] Creating event network-vif-plugged:e7417f7a-8526-4fd3-8845-7740756e6cfe for instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 on n-h1-826756-3 Jul 28 04:15:29.414874 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f62f56a1-fc50-4876-8848-5038a487b416 req-5e35b8cf-c42b-45aa-8da7-c76eb099261a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037139 Jul 28 04:15:29.415871 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3579/6029] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:15:29.698147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-34b7011d-7873-46b7-964f-da08ce39cd7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:29.698856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-34b7011d-7873-46b7-964f-da08ce39cd7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:29.707746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34b7011d-7873-46b7-964f-da08ce39cd7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:29.708531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34b7011d-7873-46b7-964f-da08ce39cd7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:29.709100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34b7011d-7873-46b7-964f-da08ce39cd7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:29.709559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34b7011d-7873-46b7-964f-da08ce39cd7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:29.870704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-34b7011d-7873-46b7-964f-da08ce39cd7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:29.881479 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-34b7011d-7873-46b7-964f-da08ce39cd7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1390 microversion: 2.1 time: 0.187625 Jul 28 04:15:29.888402 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3580/6030] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:29 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1390 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:30.078461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bd3025ec-d836-4245-8dbc-b1e2a0d629b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c742bdf8-6247-47e3-8a25-3cdb31d07b00"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:30.085356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bd3025ec-d836-4245-8dbc-b1e2a0d629b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:30.094452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd3025ec-d836-4245-8dbc-b1e2a0d629b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:30.094966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd3025ec-d836-4245-8dbc-b1e2a0d629b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:30.095812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd3025ec-d836-4245-8dbc-b1e2a0d629b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:30.096326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd3025ec-d836-4245-8dbc-b1e2a0d629b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:30.391442 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bd3025ec-d836-4245-8dbc-b1e2a0d629b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "POST /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322410 Jul 28 04:15:30.392144 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3581/6031] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 04:15:30 2022] POST /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:15:30.736622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-723185632", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "51bf8982-b1d1-4a27-a862-e8d3fef3a57a"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:30.748856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:15:30.749701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:15:30.750665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:15:30.798746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] validate_networks() for [('51bf8982-b1d1-4a27-a862-e8d3fef3a57a', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:15:31.199762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:15:31.200181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:15:31.200670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:15:31.201078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:15:31.201486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:15:31.211222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:31.211657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:31.212473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:31.212932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:31.232806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Getting quotas for project c33aaf3e6c6342528ceb7a615d2a7e36. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:15:31.238830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Getting quotas for user 7ae9d1b42c2e4525a18d7a1886346e71 and project c33aaf3e6c6342528ceb7a615d2a7e36. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:15:31.252651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:15:31.255086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:15:31.302502 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b4e35e5f-e719-4f8a-8e91-b3a9cd018130 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570155 Jul 28 04:15:31.303439 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3582/6032] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:15:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:15:31.313229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bbefd5b8-7014-47b8-bef7-d829e2abea43 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:31.313854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bbefd5b8-7014-47b8-bef7-d829e2abea43 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:31.321026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbefd5b8-7014-47b8-bef7-d829e2abea43 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:31.321413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbefd5b8-7014-47b8-bef7-d829e2abea43 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:31.322625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbefd5b8-7014-47b8-bef7-d829e2abea43 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:31.323085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbefd5b8-7014-47b8-bef7-d829e2abea43 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:31.489236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bbefd5b8-7014-47b8-bef7-d829e2abea43 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:31.504666 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bbefd5b8-7014-47b8-bef7-d829e2abea43 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1561 microversion: 2.1 time: 0.200357 Jul 28 04:15:31.505261 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3583/6033] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:31 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1561 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:31.513753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6c3c4590-3b6d-422d-8dae-7bad0982de5b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:31.514363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6c3c4590-3b6d-422d-8dae-7bad0982de5b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:31.577914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6c3c4590-3b6d-422d-8dae-7bad0982de5b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:31.586954 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6c3c4590-3b6d-422d-8dae-7bad0982de5b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 200 len: 1218 microversion: 2.1 time: 0.080509 Jul 28 04:15:31.587786 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3584/6034] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:31 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:31.592852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97d5c1c2-aca9-46d7-b747-91b6c4cd1d72 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:31.593685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-97d5c1c2-aca9-46d7-b747-91b6c4cd1d72 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:31.600154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97d5c1c2-aca9-46d7-b747-91b6c4cd1d72 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:31.600838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97d5c1c2-aca9-46d7-b747-91b6c4cd1d72 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:31.601781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97d5c1c2-aca9-46d7-b747-91b6c4cd1d72 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:31.602372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97d5c1c2-aca9-46d7-b747-91b6c4cd1d72 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:31.766812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-97d5c1c2-aca9-46d7-b747-91b6c4cd1d72 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:31.776725 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-97d5c1c2-aca9-46d7-b747-91b6c4cd1d72 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1561 microversion: 2.1 time: 0.187299 Jul 28 04:15:31.777623 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3585/6035] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:31 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:32.609280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6ffa89df-2aeb-439d-bf07-723161297caf tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:32.610794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6ffa89df-2aeb-439d-bf07-723161297caf tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:32.624327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ffa89df-2aeb-439d-bf07-723161297caf tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:32.625541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ffa89df-2aeb-439d-bf07-723161297caf tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:32.626567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ffa89df-2aeb-439d-bf07-723161297caf tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:32.627657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ffa89df-2aeb-439d-bf07-723161297caf tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:32.701263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6ffa89df-2aeb-439d-bf07-723161297caf tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:32.726962 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6ffa89df-2aeb-439d-bf07-723161297caf tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 200 len: 1278 microversion: 2.1 time: 0.118756 Jul 28 04:15:32.727719 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3586/6036] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:32 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:33.749046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3d0999ce-fafc-468f-a48d-c27483bc0500 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:33.750380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3d0999ce-fafc-468f-a48d-c27483bc0500 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:33.758352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d0999ce-fafc-468f-a48d-c27483bc0500 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:33.760145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d0999ce-fafc-468f-a48d-c27483bc0500 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:33.761166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d0999ce-fafc-468f-a48d-c27483bc0500 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:33.761817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d0999ce-fafc-468f-a48d-c27483bc0500 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:33.971763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3d0999ce-fafc-468f-a48d-c27483bc0500 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:33.981848 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3d0999ce-fafc-468f-a48d-c27483bc0500 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 200 len: 1318 microversion: 2.1 time: 0.236591 Jul 28 04:15:33.983066 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3587/6037] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:33 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:33.988475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-48073d16-4dfd-4ae6-90d3-aa193588d981 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:33.989385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-48073d16-4dfd-4ae6-90d3-aa193588d981 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:33.996190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48073d16-4dfd-4ae6-90d3-aa193588d981 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:33.996938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48073d16-4dfd-4ae6-90d3-aa193588d981 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:33.998197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48073d16-4dfd-4ae6-90d3-aa193588d981 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:33.998805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48073d16-4dfd-4ae6-90d3-aa193588d981 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:34.180655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-48073d16-4dfd-4ae6-90d3-aa193588d981 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:34.191942 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-48073d16-4dfd-4ae6-90d3-aa193588d981 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1561 microversion: 2.1 time: 0.207623 Jul 28 04:15:34.193323 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3588/6038] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:33 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1561 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:34.199077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-fe3eee73-8b63-4848-addd-14d1dc615cc2 req-0777dcf6-0022-4014-8b33-0fc8cfb90a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ffc9184-9cca-41c1-9f1b-632b054335a0", "tag": "e7417f7a-8526-4fd3-8845-7740756e6cfe"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:34.210389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fe3eee73-8b63-4848-addd-14d1dc615cc2 req-0777dcf6-0022-4014-8b33-0fc8cfb90a5c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:34.210935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fe3eee73-8b63-4848-addd-14d1dc615cc2 req-0777dcf6-0022-4014-8b33-0fc8cfb90a5c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:34.215607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:15:34.225002 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-fe3eee73-8b63-4848-addd-14d1dc615cc2 req-0777dcf6-0022-4014-8b33-0fc8cfb90a5c service nova] Creating event network-changed:e7417f7a-8526-4fd3-8845-7740756e6cfe for instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 on n-h1-826756-3 Jul 28 04:15:34.231414 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-fe3eee73-8b63-4848-addd-14d1dc615cc2 req-0777dcf6-0022-4014-8b33-0fc8cfb90a5c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036510 Jul 28 04:15:34.232702 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3589/6039] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:15:35.006198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eead7682-8b0d-41da-8fdf-a3b6ba2debda tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:35.007454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eead7682-8b0d-41da-8fdf-a3b6ba2debda tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:35.029516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eead7682-8b0d-41da-8fdf-a3b6ba2debda tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:35.031560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eead7682-8b0d-41da-8fdf-a3b6ba2debda tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:35.033020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eead7682-8b0d-41da-8fdf-a3b6ba2debda tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:35.033903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eead7682-8b0d-41da-8fdf-a3b6ba2debda tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:35.289849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eead7682-8b0d-41da-8fdf-a3b6ba2debda tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:35.302945 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eead7682-8b0d-41da-8fdf-a3b6ba2debda tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 200 len: 1318 microversion: 2.1 time: 0.302650 Jul 28 04:15:35.304039 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3590/6040] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:34 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:35.310136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-2bc228f2-4eff-4e70-9b01-fad714f4c3d7 req-013f8c60-4e7a-4437-87c6-93397baba4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9d8cad-2771-4dd5-a046-1068e1f04495", "tag": "5c75c802-ad15-45cc-84e5-e48c490da98d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:35.324933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2bc228f2-4eff-4e70-9b01-fad714f4c3d7 req-013f8c60-4e7a-4437-87c6-93397baba4ec service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:35.325660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2bc228f2-4eff-4e70-9b01-fad714f4c3d7 req-013f8c60-4e7a-4437-87c6-93397baba4ec service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:35.340318 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-2bc228f2-4eff-4e70-9b01-fad714f4c3d7 req-013f8c60-4e7a-4437-87c6-93397baba4ec service nova] Creating event network-changed:5c75c802-ad15-45cc-84e5-e48c490da98d for instance 2f9d8cad-2771-4dd5-a046-1068e1f04495 on n-h2-826756-3 Jul 28 04:15:35.348406 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-2bc228f2-4eff-4e70-9b01-fad714f4c3d7 req-013f8c60-4e7a-4437-87c6-93397baba4ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042626 Jul 28 04:15:35.350279 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3591/6041] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:15:36.325770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5505a370-e069-4521-b869-8a16ff62d334 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:36.327505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5505a370-e069-4521-b869-8a16ff62d334 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:36.338938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5505a370-e069-4521-b869-8a16ff62d334 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:36.339772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5505a370-e069-4521-b869-8a16ff62d334 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:36.341336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5505a370-e069-4521-b869-8a16ff62d334 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:36.342341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5505a370-e069-4521-b869-8a16ff62d334 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:36.505307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5505a370-e069-4521-b869-8a16ff62d334 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:36.513963 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5505a370-e069-4521-b869-8a16ff62d334 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 200 len: 1318 microversion: 2.1 time: 0.193353 Jul 28 04:15:36.514580 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3592/6042] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:36 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:37.539108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e63ca325-56ff-4afd-b46d-284f76209aed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:37.540094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e63ca325-56ff-4afd-b46d-284f76209aed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:37.547640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e63ca325-56ff-4afd-b46d-284f76209aed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:37.548191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e63ca325-56ff-4afd-b46d-284f76209aed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:37.549123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e63ca325-56ff-4afd-b46d-284f76209aed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:37.549604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e63ca325-56ff-4afd-b46d-284f76209aed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:37.684691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e63ca325-56ff-4afd-b46d-284f76209aed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:37.692992 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e63ca325-56ff-4afd-b46d-284f76209aed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 200 len: 1318 microversion: 2.1 time: 0.158315 Jul 28 04:15:37.693557 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3593/6043] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:37 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:38.714965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f9135338-445f-4e87-af46-c0033d20d37d tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:38.715643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f9135338-445f-4e87-af46-c0033d20d37d tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:38.722993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9135338-445f-4e87-af46-c0033d20d37d tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:38.723438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9135338-445f-4e87-af46-c0033d20d37d tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:38.724200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9135338-445f-4e87-af46-c0033d20d37d tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:38.724667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9135338-445f-4e87-af46-c0033d20d37d tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:38.891641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f9135338-445f-4e87-af46-c0033d20d37d tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:38.900542 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f9135338-445f-4e87-af46-c0033d20d37d tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 200 len: 1318 microversion: 2.1 time: 0.189637 Jul 28 04:15:38.901133 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3594/6044] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:38 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:39.923806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83b23a10-546b-4667-8e6f-693a661013c9 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:39.924484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-83b23a10-546b-4667-8e6f-693a661013c9 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:39.932449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83b23a10-546b-4667-8e6f-693a661013c9 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:39.932906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83b23a10-546b-4667-8e6f-693a661013c9 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:39.933724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83b23a10-546b-4667-8e6f-693a661013c9 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:39.934199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83b23a10-546b-4667-8e6f-693a661013c9 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:40.083067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-83b23a10-546b-4667-8e6f-693a661013c9 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:40.091779 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-83b23a10-546b-4667-8e6f-693a661013c9 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 200 len: 1318 microversion: 2.1 time: 0.173406 Jul 28 04:15:40.092401 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3595/6045] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:39 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:41.112726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df9545ee-61ca-438f-bf96-fdf2df653e78 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:41.114077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-df9545ee-61ca-438f-bf96-fdf2df653e78 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:41.122035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df9545ee-61ca-438f-bf96-fdf2df653e78 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:41.122456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df9545ee-61ca-438f-bf96-fdf2df653e78 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:41.123450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df9545ee-61ca-438f-bf96-fdf2df653e78 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:41.123889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df9545ee-61ca-438f-bf96-fdf2df653e78 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:41.222012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:15:41.275961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-df9545ee-61ca-438f-bf96-fdf2df653e78 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:41.284233 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-df9545ee-61ca-438f-bf96-fdf2df653e78 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 200 len: 1318 microversion: 2.1 time: 0.175484 Jul 28 04:15:41.284852 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3596/6046] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:41 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:41.289451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e22df8ae-200f-4a63-934a-fa5fc3115ea3 req-cde4f09d-57b4-4f40-b0f9-791477ad7ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9d8cad-2771-4dd5-a046-1068e1f04495", "name": "network-vif-plugged", "status": "completed", "tag": "5c75c802-ad15-45cc-84e5-e48c490da98d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:41.299098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e22df8ae-200f-4a63-934a-fa5fc3115ea3 req-cde4f09d-57b4-4f40-b0f9-791477ad7ea5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:41.299539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e22df8ae-200f-4a63-934a-fa5fc3115ea3 req-cde4f09d-57b4-4f40-b0f9-791477ad7ea5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:41.312805 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e22df8ae-200f-4a63-934a-fa5fc3115ea3 req-cde4f09d-57b4-4f40-b0f9-791477ad7ea5 service nova] Creating event network-vif-plugged:5c75c802-ad15-45cc-84e5-e48c490da98d for instance 2f9d8cad-2771-4dd5-a046-1068e1f04495 on n-h2-826756-3 Jul 28 04:15:41.317576 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e22df8ae-200f-4a63-934a-fa5fc3115ea3 req-cde4f09d-57b4-4f40-b0f9-791477ad7ea5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031594 Jul 28 04:15:41.318521 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3597/6047] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:15:42.306461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:15:42.314290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c540e9e3-87e6-4d3c-89ed-a113d574dfdd tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:42.315361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c540e9e3-87e6-4d3c-89ed-a113d574dfdd tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:42.326271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c540e9e3-87e6-4d3c-89ed-a113d574dfdd tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:42.326798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c540e9e3-87e6-4d3c-89ed-a113d574dfdd tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:42.327758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c540e9e3-87e6-4d3c-89ed-a113d574dfdd tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:42.328602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c540e9e3-87e6-4d3c-89ed-a113d574dfdd tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:42.495046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c540e9e3-87e6-4d3c-89ed-a113d574dfdd tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:42.503454 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c540e9e3-87e6-4d3c-89ed-a113d574dfdd tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 200 len: 1318 microversion: 2.1 time: 0.198942 Jul 28 04:15:42.504064 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3598/6048] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:42 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:43.405851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2753bfe2-cad6-4081-9002-a4e8e7e9864b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:43.413304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2753bfe2-cad6-4081-9002-a4e8e7e9864b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:43.413762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2753bfe2-cad6-4081-9002-a4e8e7e9864b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:43.437302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2753bfe2-cad6-4081-9002-a4e8e7e9864b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Going to try to stop instance {{(pid=126071) force_stop /opt/stack/nova/nova/compute/api.py:2753}} Jul 28 04:15:43.489622 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2753bfe2-cad6-4081-9002-a4e8e7e9864b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "POST /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/action" status: 202 len: 0 microversion: 2.1 time: 0.087596 Jul 28 04:15:43.490315 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3599/6049] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:15:43 2022] POST /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:15:43.499560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a9f87810-b45a-463b-9ea3-501c8930958e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:43.501059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a9f87810-b45a-463b-9ea3-501c8930958e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:43.508108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9f87810-b45a-463b-9ea3-501c8930958e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:43.508711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9f87810-b45a-463b-9ea3-501c8930958e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:43.509595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9f87810-b45a-463b-9ea3-501c8930958e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:43.510111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9f87810-b45a-463b-9ea3-501c8930958e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:43.656420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a9f87810-b45a-463b-9ea3-501c8930958e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:43.665906 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a9f87810-b45a-463b-9ea3-501c8930958e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1724 microversion: 2.1 time: 0.170705 Jul 28 04:15:43.666558 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3600/6050] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:43 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:43.675164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-16884cf3-ae6d-440a-8d68-26bada2096eb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:43.675782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-16884cf3-ae6d-440a-8d68-26bada2096eb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:43.682920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16884cf3-ae6d-440a-8d68-26bada2096eb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:43.684049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16884cf3-ae6d-440a-8d68-26bada2096eb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:43.684194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16884cf3-ae6d-440a-8d68-26bada2096eb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:43.684635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16884cf3-ae6d-440a-8d68-26bada2096eb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:43.830695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-16884cf3-ae6d-440a-8d68-26bada2096eb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:43.840928 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-16884cf3-ae6d-440a-8d68-26bada2096eb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 200 len: 1506 microversion: 2.1 time: 0.169695 Jul 28 04:15:43.842230 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3601/6051] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:43 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:44.687805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-375f9a23-1706-440d-9fe9-688354e53a02 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:44.689158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-375f9a23-1706-440d-9fe9-688354e53a02 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:44.698349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-375f9a23-1706-440d-9fe9-688354e53a02 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:44.698808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-375f9a23-1706-440d-9fe9-688354e53a02 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:44.699594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-375f9a23-1706-440d-9fe9-688354e53a02 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:44.700012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-375f9a23-1706-440d-9fe9-688354e53a02 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:44.860782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-375f9a23-1706-440d-9fe9-688354e53a02 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:44.870722 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-375f9a23-1706-440d-9fe9-688354e53a02 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1724 microversion: 2.1 time: 0.186937 Jul 28 04:15:44.872870 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3602/6052] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:44 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:45.901137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f3e35b96-a97a-40b4-9fcb-f2cf51def835 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:45.902462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f3e35b96-a97a-40b4-9fcb-f2cf51def835 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:45.909971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3e35b96-a97a-40b4-9fcb-f2cf51def835 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:45.910625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3e35b96-a97a-40b4-9fcb-f2cf51def835 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:45.911582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3e35b96-a97a-40b4-9fcb-f2cf51def835 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:45.912174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3e35b96-a97a-40b4-9fcb-f2cf51def835 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:46.096082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f3e35b96-a97a-40b4-9fcb-f2cf51def835 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:46.108720 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f3e35b96-a97a-40b4-9fcb-f2cf51def835 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1724 microversion: 2.1 time: 0.217047 Jul 28 04:15:46.121971 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3603/6053] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:45 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:47.130906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c9d6aeb7-9780-40d2-acbc-4396af27cd93 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:47.132439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c9d6aeb7-9780-40d2-acbc-4396af27cd93 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:47.140499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9d6aeb7-9780-40d2-acbc-4396af27cd93 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:47.140953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9d6aeb7-9780-40d2-acbc-4396af27cd93 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:47.141732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9d6aeb7-9780-40d2-acbc-4396af27cd93 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:47.142172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9d6aeb7-9780-40d2-acbc-4396af27cd93 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:47.296148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c9d6aeb7-9780-40d2-acbc-4396af27cd93 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:47.307681 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c9d6aeb7-9780-40d2-acbc-4396af27cd93 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1724 microversion: 2.1 time: 0.180668 Jul 28 04:15:47.308821 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3604/6054] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:47 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:48.330007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-12c83721-a7fd-4ff5-90f2-8104130535c4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:48.330678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-12c83721-a7fd-4ff5-90f2-8104130535c4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:48.338824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12c83721-a7fd-4ff5-90f2-8104130535c4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:48.339288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12c83721-a7fd-4ff5-90f2-8104130535c4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:48.340074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12c83721-a7fd-4ff5-90f2-8104130535c4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:48.340549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12c83721-a7fd-4ff5-90f2-8104130535c4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:48.479224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-12c83721-a7fd-4ff5-90f2-8104130535c4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:48.488469 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-12c83721-a7fd-4ff5-90f2-8104130535c4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1724 microversion: 2.1 time: 0.162771 Jul 28 04:15:48.502178 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3605/6055] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:48 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:49.510646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1e9cdbe3-ce3f-4827-a973-5cff128dfb98 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:49.511690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1e9cdbe3-ce3f-4827-a973-5cff128dfb98 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:49.519608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e9cdbe3-ce3f-4827-a973-5cff128dfb98 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:49.520463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e9cdbe3-ce3f-4827-a973-5cff128dfb98 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:49.521727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e9cdbe3-ce3f-4827-a973-5cff128dfb98 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:49.522531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e9cdbe3-ce3f-4827-a973-5cff128dfb98 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:49.682768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1e9cdbe3-ce3f-4827-a973-5cff128dfb98 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:49.686449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:15:49.693071 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1e9cdbe3-ce3f-4827-a973-5cff128dfb98 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1724 microversion: 2.1 time: 0.187166 Jul 28 04:15:49.694006 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3606/6056] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:49 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:50.715149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-91871864-bdf9-4f66-a528-df1317860412 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:50.716521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-91871864-bdf9-4f66-a528-df1317860412 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:50.727729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91871864-bdf9-4f66-a528-df1317860412 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:50.728155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91871864-bdf9-4f66-a528-df1317860412 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:50.729216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91871864-bdf9-4f66-a528-df1317860412 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:50.729876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91871864-bdf9-4f66-a528-df1317860412 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:50.890072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-91871864-bdf9-4f66-a528-df1317860412 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:50.904928 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-91871864-bdf9-4f66-a528-df1317860412 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1724 microversion: 2.1 time: 0.193297 Jul 28 04:15:50.906502 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3607/6057] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:50 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:51.927782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f68c972c-eed6-4860-aab6-2b1d7572f244 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:51.928448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f68c972c-eed6-4860-aab6-2b1d7572f244 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:51.935688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f68c972c-eed6-4860-aab6-2b1d7572f244 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:51.936232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f68c972c-eed6-4860-aab6-2b1d7572f244 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:51.937193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f68c972c-eed6-4860-aab6-2b1d7572f244 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:51.937605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f68c972c-eed6-4860-aab6-2b1d7572f244 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:52.084874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f68c972c-eed6-4860-aab6-2b1d7572f244 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:52.096464 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f68c972c-eed6-4860-aab6-2b1d7572f244 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1724 microversion: 2.1 time: 0.172808 Jul 28 04:15:52.097135 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3608/6058] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:51 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:53.126433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ff906c55-455d-40dd-8bc3-b2be4fdeed3e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:53.127400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ff906c55-455d-40dd-8bc3-b2be4fdeed3e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:53.141450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff906c55-455d-40dd-8bc3-b2be4fdeed3e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:53.143195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff906c55-455d-40dd-8bc3-b2be4fdeed3e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:53.144203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff906c55-455d-40dd-8bc3-b2be4fdeed3e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:53.144683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff906c55-455d-40dd-8bc3-b2be4fdeed3e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:53.312235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ff906c55-455d-40dd-8bc3-b2be4fdeed3e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:53.321557 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ff906c55-455d-40dd-8bc3-b2be4fdeed3e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1724 microversion: 2.1 time: 0.201049 Jul 28 04:15:53.333179 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3609/6059] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:53 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:54.345821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-888bf6b0-472f-49c0-94ee-3fc41f8b0551 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:54.346517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-888bf6b0-472f-49c0-94ee-3fc41f8b0551 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:54.354410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-888bf6b0-472f-49c0-94ee-3fc41f8b0551 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:54.354870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-888bf6b0-472f-49c0-94ee-3fc41f8b0551 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:54.356270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-888bf6b0-472f-49c0-94ee-3fc41f8b0551 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:54.356731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-888bf6b0-472f-49c0-94ee-3fc41f8b0551 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:54.507178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-888bf6b0-472f-49c0-94ee-3fc41f8b0551 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:54.516023 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-888bf6b0-472f-49c0-94ee-3fc41f8b0551 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1724 microversion: 2.1 time: 0.174193 Jul 28 04:15:54.516639 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3610/6060] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:54 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:55.538842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f22d32aa-543c-41af-9361-e6116f462310 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:55.539734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f22d32aa-543c-41af-9361-e6116f462310 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:55.548281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f22d32aa-543c-41af-9361-e6116f462310 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:55.548825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f22d32aa-543c-41af-9361-e6116f462310 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:55.550871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f22d32aa-543c-41af-9361-e6116f462310 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:55.550871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f22d32aa-543c-41af-9361-e6116f462310 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:55.710661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f22d32aa-543c-41af-9361-e6116f462310 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:55.719628 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f22d32aa-543c-41af-9361-e6116f462310 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1724 microversion: 2.1 time: 0.185672 Jul 28 04:15:55.720320 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3611/6061] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:55 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:55.916893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb3190f3-d231-4a22-a3d4-afcb6a92e5a8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:55.921082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eb3190f3-d231-4a22-a3d4-afcb6a92e5a8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:55.934281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb3190f3-d231-4a22-a3d4-afcb6a92e5a8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:55.935061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb3190f3-d231-4a22-a3d4-afcb6a92e5a8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:55.936265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb3190f3-d231-4a22-a3d4-afcb6a92e5a8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:55.937142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb3190f3-d231-4a22-a3d4-afcb6a92e5a8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:55.994259 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb3190f3-d231-4a22-a3d4-afcb6a92e5a8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0/action" status: 200 len: 24574 microversion: 2.1 time: 0.088072 Jul 28 04:15:55.995763 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3612/6062] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:15:55 2022] POST /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0/action => generated 24574 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 04:15:56.743409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ccd5a052-e6d0-4da0-990d-d675f0381639 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:56.744022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ccd5a052-e6d0-4da0-990d-d675f0381639 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:56.751960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccd5a052-e6d0-4da0-990d-d675f0381639 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:56.752504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccd5a052-e6d0-4da0-990d-d675f0381639 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:56.753288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccd5a052-e6d0-4da0-990d-d675f0381639 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:56.753729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccd5a052-e6d0-4da0-990d-d675f0381639 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:56.902515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ccd5a052-e6d0-4da0-990d-d675f0381639 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:56.913640 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ccd5a052-e6d0-4da0-990d-d675f0381639 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1724 microversion: 2.1 time: 0.174646 Jul 28 04:15:56.914277 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3613/6063] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:56 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:57.940748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2a8ec187-c66f-4e91-9013-592188eee783 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:57.941621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2a8ec187-c66f-4e91-9013-592188eee783 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:57.958008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a8ec187-c66f-4e91-9013-592188eee783 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:57.959649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a8ec187-c66f-4e91-9013-592188eee783 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:57.960767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a8ec187-c66f-4e91-9013-592188eee783 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:57.961425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a8ec187-c66f-4e91-9013-592188eee783 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:58.139953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2a8ec187-c66f-4e91-9013-592188eee783 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:58.156524 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2a8ec187-c66f-4e91-9013-592188eee783 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1724 microversion: 2.1 time: 0.221573 Jul 28 04:15:58.157218 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3614/6064] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:57 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:15:59.180004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ffb60be-1364-43c3-8b1e-6b403f1ed8d7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:59.180766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ffb60be-1364-43c3-8b1e-6b403f1ed8d7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:59.188182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ffb60be-1364-43c3-8b1e-6b403f1ed8d7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:59.188616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ffb60be-1364-43c3-8b1e-6b403f1ed8d7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:59.189417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ffb60be-1364-43c3-8b1e-6b403f1ed8d7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:59.189859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ffb60be-1364-43c3-8b1e-6b403f1ed8d7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:59.385636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2ffb60be-1364-43c3-8b1e-6b403f1ed8d7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:59.406085 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ffb60be-1364-43c3-8b1e-6b403f1ed8d7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1701 microversion: 2.1 time: 0.230588 Jul 28 04:15:59.409158 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3615/6065] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:59 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1701 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:59.435775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9397f539-579f-4c22-83d2-b302fdc4510b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:59.445358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9397f539-579f-4c22-83d2-b302fdc4510b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:59.445917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9397f539-579f-4c22-83d2-b302fdc4510b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:59.473920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9397f539-579f-4c22-83d2-b302fdc4510b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Going to try to start instance {{(pid=126071) start /opt/stack/nova/nova/compute/api.py:2776}} Jul 28 04:15:59.536528 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9397f539-579f-4c22-83d2-b302fdc4510b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "POST /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/action" status: 202 len: 0 microversion: 2.1 time: 0.109061 Jul 28 04:15:59.537439 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3616/6066] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:15:59 2022] POST /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:15:59.548746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-99a1df0f-9cb6-4d9a-a62b-fe66a70fcd09 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:59.549465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-99a1df0f-9cb6-4d9a-a62b-fe66a70fcd09 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:15:59.559046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-99a1df0f-9cb6-4d9a-a62b-fe66a70fcd09 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:59.559508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-99a1df0f-9cb6-4d9a-a62b-fe66a70fcd09 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:59.560492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-99a1df0f-9cb6-4d9a-a62b-fe66a70fcd09 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:59.560930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-99a1df0f-9cb6-4d9a-a62b-fe66a70fcd09 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:59.750274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-99a1df0f-9cb6-4d9a-a62b-fe66a70fcd09 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:59.761329 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-99a1df0f-9cb6-4d9a-a62b-fe66a70fcd09 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1710 microversion: 2.1 time: 0.218613 Jul 28 04:15:59.762927 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3617/6067] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:59 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1710 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:00.791979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bbdf5735-fc96-45b1-bc54-9a176fb2a414 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:00.794428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bbdf5735-fc96-45b1-bc54-9a176fb2a414 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:00.806130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:16:00.809700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbdf5735-fc96-45b1-bc54-9a176fb2a414 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:00.810342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbdf5735-fc96-45b1-bc54-9a176fb2a414 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:00.811305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbdf5735-fc96-45b1-bc54-9a176fb2a414 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:00.811915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbdf5735-fc96-45b1-bc54-9a176fb2a414 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:01.015770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bbdf5735-fc96-45b1-bc54-9a176fb2a414 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:01.026904 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bbdf5735-fc96-45b1-bc54-9a176fb2a414 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1710 microversion: 2.1 time: 0.243726 Jul 28 04:16:01.027621 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3618/6068] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:00 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1710 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:02.059678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f2086ad4-c959-45ca-8332-def0754c1519 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:02.060752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f2086ad4-c959-45ca-8332-def0754c1519 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:02.071260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2086ad4-c959-45ca-8332-def0754c1519 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:02.072104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2086ad4-c959-45ca-8332-def0754c1519 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:02.073629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2086ad4-c959-45ca-8332-def0754c1519 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:02.074228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2086ad4-c959-45ca-8332-def0754c1519 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:02.253042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f2086ad4-c959-45ca-8332-def0754c1519 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:02.264236 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f2086ad4-c959-45ca-8332-def0754c1519 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1714 microversion: 2.1 time: 0.212356 Jul 28 04:16:02.265261 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3619/6069] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:02 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1714 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:02.397771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6331324c-d4d7-48c1-956c-308bba06b966 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:02.398501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6331324c-d4d7-48c1-956c-308bba06b966 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:02.404706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6331324c-d4d7-48c1-956c-308bba06b966 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:02.405373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6331324c-d4d7-48c1-956c-308bba06b966 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:02.406149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6331324c-d4d7-48c1-956c-308bba06b966 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:02.406771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6331324c-d4d7-48c1-956c-308bba06b966 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:02.585083 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6331324c-d4d7-48c1-956c-308bba06b966 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1830 microversion: 2.1 time: 0.191100 Jul 28 04:16:02.585789 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3620/6070] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:02 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1830 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:02.591015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a5a7efd5-bf37-4d6e-82ca-b1cdecaeabcb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bdc56559-bc27-4d12-aee4-bdd0e946cd60", "device": "/dev/sdb"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:02.594129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a5a7efd5-bf37-4d6e-82ca-b1cdecaeabcb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:02.600829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5a7efd5-bf37-4d6e-82ca-b1cdecaeabcb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:02.601307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5a7efd5-bf37-4d6e-82ca-b1cdecaeabcb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:02.602160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5a7efd5-bf37-4d6e-82ca-b1cdecaeabcb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:02.602598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5a7efd5-bf37-4d6e-82ca-b1cdecaeabcb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:02.876473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:16:02.902695 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a5a7efd5-bf37-4d6e-82ca-b1cdecaeabcb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "POST /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315370 Jul 28 04:16:02.903780 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3621/6071] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 04:16:02 2022] POST /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:16:02.910058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ade72d03-1e9c-4fca-a496-72cce90d61ac tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:02.911146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ade72d03-1e9c-4fca-a496-72cce90d61ac tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:02.927821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ade72d03-1e9c-4fca-a496-72cce90d61ac tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:02.929572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ade72d03-1e9c-4fca-a496-72cce90d61ac tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:02.930941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ade72d03-1e9c-4fca-a496-72cce90d61ac tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:02.936562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ade72d03-1e9c-4fca-a496-72cce90d61ac tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:03.174440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ade72d03-1e9c-4fca-a496-72cce90d61ac tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:03.184985 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ade72d03-1e9c-4fca-a496-72cce90d61ac tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1679 microversion: 2.1 time: 0.279431 Jul 28 04:16:03.185745 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3622/6072] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:02 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1679 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:03.321193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ee254fd-4ac0-4e2d-9e5e-89e655d0b03a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:03.325046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ee254fd-4ac0-4e2d-9e5e-89e655d0b03a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:03.336323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ee254fd-4ac0-4e2d-9e5e-89e655d0b03a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:03.337090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ee254fd-4ac0-4e2d-9e5e-89e655d0b03a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:03.338100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ee254fd-4ac0-4e2d-9e5e-89e655d0b03a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:03.338713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ee254fd-4ac0-4e2d-9e5e-89e655d0b03a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:03.423607 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ee254fd-4ac0-4e2d-9e5e-89e655d0b03a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0/action" status: 200 len: 32649 microversion: 2.1 time: 0.107039 Jul 28 04:16:03.424883 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3623/6073] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:16:03 2022] POST /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0/action => generated 32649 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 04:16:03.620496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fd9fea54-42b9-4e57-8384-f41d1c78de97 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:03.621168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fd9fea54-42b9-4e57-8384-f41d1c78de97 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:03.628300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd9fea54-42b9-4e57-8384-f41d1c78de97 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:03.629241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd9fea54-42b9-4e57-8384-f41d1c78de97 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:03.630212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd9fea54-42b9-4e57-8384-f41d1c78de97 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:03.630808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd9fea54-42b9-4e57-8384-f41d1c78de97 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:03.662551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fd9fea54-42b9-4e57-8384-f41d1c78de97 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3769553cdd184c71af88602f84a884aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e52c516d0e64a7db78d31a11e92f72e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:03.663125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fd9fea54-42b9-4e57-8384-f41d1c78de97 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] flavor_id is None. Assuming migration. {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4188}} Jul 28 04:16:03.663606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fd9fea54-42b9-4e57-8384-f41d1c78de97 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 04:16:03.816888 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fd9fea54-42b9-4e57-8384-f41d1c78de97 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0/action" status: 202 len: 0 microversion: 2.1 time: 0.201331 Jul 28 04:16:03.821842 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3624/6074] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:16:03 2022] POST /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:16:03.831255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-41be43e2-4483-4924-882c-0b6005a1491e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:03.832442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-41be43e2-4483-4924-882c-0b6005a1491e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:03.843783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41be43e2-4483-4924-882c-0b6005a1491e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:03.844607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41be43e2-4483-4924-882c-0b6005a1491e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:03.846287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41be43e2-4483-4924-882c-0b6005a1491e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:03.847310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41be43e2-4483-4924-882c-0b6005a1491e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:04.114396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-41be43e2-4483-4924-882c-0b6005a1491e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:04.124184 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-41be43e2-4483-4924-882c-0b6005a1491e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1688 microversion: 2.1 time: 0.300827 Jul 28 04:16:04.125170 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3625/6075] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:03 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1688 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:05.151387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47914101-59b4-43b6-bf03-e5363938bc68 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:05.152412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-47914101-59b4-43b6-bf03-e5363938bc68 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:05.168983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47914101-59b4-43b6-bf03-e5363938bc68 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:05.169564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47914101-59b4-43b6-bf03-e5363938bc68 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:05.170651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47914101-59b4-43b6-bf03-e5363938bc68 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:05.171229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47914101-59b4-43b6-bf03-e5363938bc68 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:05.345917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-47914101-59b4-43b6-bf03-e5363938bc68 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:05.357909 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-47914101-59b4-43b6-bf03-e5363938bc68 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1688 microversion: 2.1 time: 0.214719 Jul 28 04:16:05.365017 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3626/6076] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:05 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1688 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:06.389420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b6ee0b81-31ac-4240-b6a2-913ec2bc3834 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:06.391002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b6ee0b81-31ac-4240-b6a2-913ec2bc3834 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:06.400958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6ee0b81-31ac-4240-b6a2-913ec2bc3834 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:06.401924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6ee0b81-31ac-4240-b6a2-913ec2bc3834 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:06.403094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6ee0b81-31ac-4240-b6a2-913ec2bc3834 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:06.404573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6ee0b81-31ac-4240-b6a2-913ec2bc3834 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:06.651339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b6ee0b81-31ac-4240-b6a2-913ec2bc3834 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:06.663592 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b6ee0b81-31ac-4240-b6a2-913ec2bc3834 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1688 microversion: 2.1 time: 0.279982 Jul 28 04:16:06.664380 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3627/6077] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:06 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1688 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:07.687518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-72ff91c7-e422-4d31-b10b-c03ae6acc08a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:07.688947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-72ff91c7-e422-4d31-b10b-c03ae6acc08a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:07.697383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72ff91c7-e422-4d31-b10b-c03ae6acc08a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:07.698076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72ff91c7-e422-4d31-b10b-c03ae6acc08a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:07.699075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72ff91c7-e422-4d31-b10b-c03ae6acc08a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:07.699574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72ff91c7-e422-4d31-b10b-c03ae6acc08a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:07.859720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-72ff91c7-e422-4d31-b10b-c03ae6acc08a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:07.872499 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-72ff91c7-e422-4d31-b10b-c03ae6acc08a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1693 microversion: 2.1 time: 0.189565 Jul 28 04:16:07.873468 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3628/6078] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:07 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1693 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:08.894232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c6214ee8-135c-4584-8701-c6b17f849350 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:08.895003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c6214ee8-135c-4584-8701-c6b17f849350 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:08.901795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6214ee8-135c-4584-8701-c6b17f849350 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:08.902245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6214ee8-135c-4584-8701-c6b17f849350 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:08.903018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6214ee8-135c-4584-8701-c6b17f849350 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:08.903450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6214ee8-135c-4584-8701-c6b17f849350 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:09.055773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c6214ee8-135c-4584-8701-c6b17f849350 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:09.063892 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c6214ee8-135c-4584-8701-c6b17f849350 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1693 microversion: 2.1 time: 0.173592 Jul 28 04:16:09.064534 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3629/6079] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:08 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:10.086601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-363f1114-682e-4a80-82fe-c95c945dde58 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:10.087528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-363f1114-682e-4a80-82fe-c95c945dde58 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:10.095640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-363f1114-682e-4a80-82fe-c95c945dde58 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:10.096084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-363f1114-682e-4a80-82fe-c95c945dde58 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:10.096979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-363f1114-682e-4a80-82fe-c95c945dde58 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:10.097417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-363f1114-682e-4a80-82fe-c95c945dde58 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:10.235509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-363f1114-682e-4a80-82fe-c95c945dde58 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:10.243758 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-363f1114-682e-4a80-82fe-c95c945dde58 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1693 microversion: 2.1 time: 0.161498 Jul 28 04:16:10.244738 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3630/6080] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:10 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:11.267110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-09393ad3-4fb7-4c55-b671-43a42a1bc33f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:11.267782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-09393ad3-4fb7-4c55-b671-43a42a1bc33f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:11.275812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09393ad3-4fb7-4c55-b671-43a42a1bc33f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:11.276280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09393ad3-4fb7-4c55-b671-43a42a1bc33f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:11.277170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09393ad3-4fb7-4c55-b671-43a42a1bc33f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:11.277617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09393ad3-4fb7-4c55-b671-43a42a1bc33f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:11.432927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-09393ad3-4fb7-4c55-b671-43a42a1bc33f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:11.444250 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-09393ad3-4fb7-4c55-b671-43a42a1bc33f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1693 microversion: 2.1 time: 0.180439 Jul 28 04:16:11.444250 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3631/6081] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:11 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:12.467575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-29500acb-62e6-432b-ae18-44d5f259ba45 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:12.468221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-29500acb-62e6-432b-ae18-44d5f259ba45 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:12.476009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29500acb-62e6-432b-ae18-44d5f259ba45 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:12.476506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29500acb-62e6-432b-ae18-44d5f259ba45 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:12.477292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29500acb-62e6-432b-ae18-44d5f259ba45 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:12.477733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29500acb-62e6-432b-ae18-44d5f259ba45 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:12.648776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-29500acb-62e6-432b-ae18-44d5f259ba45 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:12.656772 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-29500acb-62e6-432b-ae18-44d5f259ba45 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1693 microversion: 2.1 time: 0.193358 Jul 28 04:16:12.657654 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3632/6082] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:12 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1693 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:13.695662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e3bf1aa2-1014-41b4-8a11-9793bcd9c8cd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:13.696732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e3bf1aa2-1014-41b4-8a11-9793bcd9c8cd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:13.728931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3bf1aa2-1014-41b4-8a11-9793bcd9c8cd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:13.729716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3bf1aa2-1014-41b4-8a11-9793bcd9c8cd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:13.731253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3bf1aa2-1014-41b4-8a11-9793bcd9c8cd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:13.731969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3bf1aa2-1014-41b4-8a11-9793bcd9c8cd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:13.936671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e3bf1aa2-1014-41b4-8a11-9793bcd9c8cd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:13.945019 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e3bf1aa2-1014-41b4-8a11-9793bcd9c8cd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1693 microversion: 2.1 time: 0.257197 Jul 28 04:16:13.946645 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3633/6083] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:13 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1693 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:14.974453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2d4969a-e6d2-4f53-a695-60525e27e56e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:14.975617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2d4969a-e6d2-4f53-a695-60525e27e56e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:14.986313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2d4969a-e6d2-4f53-a695-60525e27e56e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:14.987246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2d4969a-e6d2-4f53-a695-60525e27e56e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:14.988215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2d4969a-e6d2-4f53-a695-60525e27e56e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:14.988836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2d4969a-e6d2-4f53-a695-60525e27e56e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:15.188593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b2d4969a-e6d2-4f53-a695-60525e27e56e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:15.197975 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b2d4969a-e6d2-4f53-a695-60525e27e56e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1693 microversion: 2.1 time: 0.231020 Jul 28 04:16:15.199092 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3634/6084] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:14 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1693 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:16.229243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f39bcb3e-304c-4f78-b26f-921a5f5f8e2c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:16.230310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f39bcb3e-304c-4f78-b26f-921a5f5f8e2c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:16.243078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f39bcb3e-304c-4f78-b26f-921a5f5f8e2c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:16.243866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f39bcb3e-304c-4f78-b26f-921a5f5f8e2c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:16.245520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f39bcb3e-304c-4f78-b26f-921a5f5f8e2c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:16.246331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f39bcb3e-304c-4f78-b26f-921a5f5f8e2c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:16.461026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f39bcb3e-304c-4f78-b26f-921a5f5f8e2c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:16.483031 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f39bcb3e-304c-4f78-b26f-921a5f5f8e2c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1693 microversion: 2.1 time: 0.257926 Jul 28 04:16:16.484929 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3635/6085] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:16 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1693 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:17.512387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-78701d3e-8254-4591-9ca5-f6018e13e207 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:17.513071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-78701d3e-8254-4591-9ca5-f6018e13e207 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:17.520739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78701d3e-8254-4591-9ca5-f6018e13e207 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:17.521164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78701d3e-8254-4591-9ca5-f6018e13e207 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:17.521960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78701d3e-8254-4591-9ca5-f6018e13e207 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:17.522432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78701d3e-8254-4591-9ca5-f6018e13e207 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:17.709581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-78701d3e-8254-4591-9ca5-f6018e13e207 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:17.716093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:16:17.718937 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-78701d3e-8254-4591-9ca5-f6018e13e207 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1693 microversion: 2.1 time: 0.211531 Jul 28 04:16:17.727949 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3636/6086] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:17 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1693 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:18.753423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e5c668e-f7fd-408a-82b6-86ed61649b3b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:18.755234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e5c668e-f7fd-408a-82b6-86ed61649b3b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:18.771710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e5c668e-f7fd-408a-82b6-86ed61649b3b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:18.771710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e5c668e-f7fd-408a-82b6-86ed61649b3b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:18.771710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e5c668e-f7fd-408a-82b6-86ed61649b3b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:18.771710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e5c668e-f7fd-408a-82b6-86ed61649b3b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:18.997552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e5c668e-f7fd-408a-82b6-86ed61649b3b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:19.009610 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e5c668e-f7fd-408a-82b6-86ed61649b3b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1693 microversion: 2.1 time: 0.272505 Jul 28 04:16:19.010858 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3637/6087] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:18 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1693 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:20.039621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-330125a5-b8b8-495f-a791-a62aed9fcf47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:20.039621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-330125a5-b8b8-495f-a791-a62aed9fcf47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:20.047570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-330125a5-b8b8-495f-a791-a62aed9fcf47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:20.048253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-330125a5-b8b8-495f-a791-a62aed9fcf47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:20.049436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-330125a5-b8b8-495f-a791-a62aed9fcf47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:20.050243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-330125a5-b8b8-495f-a791-a62aed9fcf47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:20.252558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-330125a5-b8b8-495f-a791-a62aed9fcf47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:20.270315 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-330125a5-b8b8-495f-a791-a62aed9fcf47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1693 microversion: 2.1 time: 0.240141 Jul 28 04:16:20.272475 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3638/6088] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:20 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1693 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:21.294536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a8868908-8678-434d-a35b-9ceb1419dee5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:21.295419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a8868908-8678-434d-a35b-9ceb1419dee5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:21.302532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8868908-8678-434d-a35b-9ceb1419dee5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:21.303347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8868908-8678-434d-a35b-9ceb1419dee5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:21.304541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8868908-8678-434d-a35b-9ceb1419dee5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:21.305227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8868908-8678-434d-a35b-9ceb1419dee5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:21.475480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a8868908-8678-434d-a35b-9ceb1419dee5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:21.485001 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a8868908-8678-434d-a35b-9ceb1419dee5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1693 microversion: 2.1 time: 0.194623 Jul 28 04:16:21.485719 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3639/6089] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:21 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:22.515809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0d2771b3-40e1-4674-ba56-91cb5a1c4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:22.517402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0d2771b3-40e1-4674-ba56-91cb5a1c4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:22.531797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d2771b3-40e1-4674-ba56-91cb5a1c4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:22.532258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d2771b3-40e1-4674-ba56-91cb5a1c4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:22.533069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d2771b3-40e1-4674-ba56-91cb5a1c4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:22.533503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d2771b3-40e1-4674-ba56-91cb5a1c4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:22.708790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0d2771b3-40e1-4674-ba56-91cb5a1c4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:22.719140 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0d2771b3-40e1-4674-ba56-91cb5a1c4285 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1693 microversion: 2.1 time: 0.208176 Jul 28 04:16:22.720508 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3640/6090] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:22 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1693 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:23.746092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7064d421-a6e8-43fd-a82d-92140548ec17 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:23.747952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7064d421-a6e8-43fd-a82d-92140548ec17 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:23.756561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7064d421-a6e8-43fd-a82d-92140548ec17 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:23.757470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7064d421-a6e8-43fd-a82d-92140548ec17 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:23.758498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7064d421-a6e8-43fd-a82d-92140548ec17 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:23.759128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7064d421-a6e8-43fd-a82d-92140548ec17 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:23.996705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7064d421-a6e8-43fd-a82d-92140548ec17 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:24.005450 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7064d421-a6e8-43fd-a82d-92140548ec17 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1692 microversion: 2.1 time: 0.265577 Jul 28 04:16:24.006040 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3641/6091] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:23 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1692 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:24.575366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0b384301-02e6-4c40-8c34-02cf819c7071 req-6c78e19e-2eab-41d9-bb21-677b89a5eee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffc9184-9cca-41c1-9f1b-632b054335a0", "name": "network-vif-unplugged", "status": "completed", "tag": "e7417f7a-8526-4fd3-8845-7740756e6cfe"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:24.589125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0b384301-02e6-4c40-8c34-02cf819c7071 req-6c78e19e-2eab-41d9-bb21-677b89a5eee3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:24.589606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0b384301-02e6-4c40-8c34-02cf819c7071 req-6c78e19e-2eab-41d9-bb21-677b89a5eee3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:24.624204 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0b384301-02e6-4c40-8c34-02cf819c7071 req-6c78e19e-2eab-41d9-bb21-677b89a5eee3 service nova] Creating event network-vif-unplugged:e7417f7a-8526-4fd3-8845-7740756e6cfe for instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 on n-h2-826756-3 Jul 28 04:16:24.636464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-0b384301-02e6-4c40-8c34-02cf819c7071 req-6c78e19e-2eab-41d9-bb21-677b89a5eee3 service nova] Instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:16:24.672171 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0b384301-02e6-4c40-8c34-02cf819c7071 req-6c78e19e-2eab-41d9-bb21-677b89a5eee3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.301719 Jul 28 04:16:24.673677 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3642/6092] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:16:25.043275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ae8e55b5-99ce-467f-be35-73a814d4efb7 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:25.044816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ae8e55b5-99ce-467f-be35-73a814d4efb7 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:25.062388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae8e55b5-99ce-467f-be35-73a814d4efb7 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:25.063049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae8e55b5-99ce-467f-be35-73a814d4efb7 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:25.064079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae8e55b5-99ce-467f-be35-73a814d4efb7 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:25.064727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae8e55b5-99ce-467f-be35-73a814d4efb7 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:25.359069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ae8e55b5-99ce-467f-be35-73a814d4efb7 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:25.374765 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ae8e55b5-99ce-467f-be35-73a814d4efb7 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1692 microversion: 2.1 time: 0.349168 Jul 28 04:16:25.376311 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3643/6093] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:25 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1692 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:26.402755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b6578edd-984a-4380-8025-78c2968590d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:26.404195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b6578edd-984a-4380-8025-78c2968590d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:26.417923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6578edd-984a-4380-8025-78c2968590d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:26.418597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6578edd-984a-4380-8025-78c2968590d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:26.420189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6578edd-984a-4380-8025-78c2968590d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:26.421225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6578edd-984a-4380-8025-78c2968590d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:26.647968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b6578edd-984a-4380-8025-78c2968590d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:26.660936 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b6578edd-984a-4380-8025-78c2968590d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1690 microversion: 2.1 time: 0.261978 Jul 28 04:16:26.679713 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3644/6094] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:26 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1690 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:26.712046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-97778962-8c97-456f-84a3-8cddbe5b0e0b req-a36d0d5f-04ee-4c20-89d3-c7fa65f331da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ffc9184-9cca-41c1-9f1b-632b054335a0", "tag": "e7417f7a-8526-4fd3-8845-7740756e6cfe"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:26.727335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-97778962-8c97-456f-84a3-8cddbe5b0e0b req-a36d0d5f-04ee-4c20-89d3-c7fa65f331da service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:26.728015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-97778962-8c97-456f-84a3-8cddbe5b0e0b req-a36d0d5f-04ee-4c20-89d3-c7fa65f331da service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:26.754141 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-97778962-8c97-456f-84a3-8cddbe5b0e0b req-a36d0d5f-04ee-4c20-89d3-c7fa65f331da service nova] Creating event network-changed:e7417f7a-8526-4fd3-8845-7740756e6cfe for instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 on n-h2-826756-3 Jul 28 04:16:26.770681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-97778962-8c97-456f-84a3-8cddbe5b0e0b req-a36d0d5f-04ee-4c20-89d3-c7fa65f331da service nova] Instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:16:26.785706 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-97778962-8c97-456f-84a3-8cddbe5b0e0b req-a36d0d5f-04ee-4c20-89d3-c7fa65f331da service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080042 Jul 28 04:16:26.793382 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3645/6095] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:16:27.688819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7ff497e0-45f0-47ff-8d8e-80544218bbd8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:27.690693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7ff497e0-45f0-47ff-8d8e-80544218bbd8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:27.697820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ff497e0-45f0-47ff-8d8e-80544218bbd8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:27.698337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ff497e0-45f0-47ff-8d8e-80544218bbd8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:27.699812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ff497e0-45f0-47ff-8d8e-80544218bbd8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:27.699812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ff497e0-45f0-47ff-8d8e-80544218bbd8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:27.910046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7ff497e0-45f0-47ff-8d8e-80544218bbd8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:27.918929 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7ff497e0-45f0-47ff-8d8e-80544218bbd8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1690 microversion: 2.1 time: 0.234746 Jul 28 04:16:27.919588 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3646/6096] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:27 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1690 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:28.427163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ff9240dc-a8fa-4b44-8cf0-d906b22a1ec2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:28.427671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ff9240dc-a8fa-4b44-8cf0-d906b22a1ec2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:28.435201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff9240dc-a8fa-4b44-8cf0-d906b22a1ec2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:28.435651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff9240dc-a8fa-4b44-8cf0-d906b22a1ec2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:28.437598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff9240dc-a8fa-4b44-8cf0-d906b22a1ec2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:28.438123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff9240dc-a8fa-4b44-8cf0-d906b22a1ec2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:28.559489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-ff9240dc-a8fa-4b44-8cf0-d906b22a1ec2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lazy-loading 'services' on Instance uuid 2f9d8cad-2771-4dd5-a046-1068e1f04495 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:16:28.674742 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ff9240dc-a8fa-4b44-8cf0-d906b22a1ec2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495/os-volume_attachments/bdc56559-bc27-4d12-aee4-bdd0e946cd60" status: 202 len: 0 microversion: 2.1 time: 0.252199 Jul 28 04:16:28.681188 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3647/6097] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:16:28 2022] DELETE /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495/os-volume_attachments/bdc56559-bc27-4d12-aee4-bdd0e946cd60 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:16:28.948457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5c77982-4723-4f42-b73f-874c4ac10f19 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:28.949382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b5c77982-4723-4f42-b73f-874c4ac10f19 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:28.956614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5c77982-4723-4f42-b73f-874c4ac10f19 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:28.957071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5c77982-4723-4f42-b73f-874c4ac10f19 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:28.957871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5c77982-4723-4f42-b73f-874c4ac10f19 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:28.958309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5c77982-4723-4f42-b73f-874c4ac10f19 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:29.144838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b5c77982-4723-4f42-b73f-874c4ac10f19 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:29.153513 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5c77982-4723-4f42-b73f-874c4ac10f19 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1687 microversion: 2.1 time: 0.210651 Jul 28 04:16:29.154213 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3648/6098] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:28 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1687 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:29.174837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b5efb64-b667-416c-9e64-88a7997b2094 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:29.175388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3b5efb64-b667-416c-9e64-88a7997b2094 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:29.182063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b5efb64-b667-416c-9e64-88a7997b2094 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:29.182492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b5efb64-b667-416c-9e64-88a7997b2094 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:29.183287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b5efb64-b667-416c-9e64-88a7997b2094 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:29.183723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b5efb64-b667-416c-9e64-88a7997b2094 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:29.323976 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3b5efb64-b667-416c-9e64-88a7997b2094 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0/action" status: 202 len: 0 microversion: 2.1 time: 0.152974 Jul 28 04:16:29.325026 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3649/6099] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:16:29 2022] POST /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:16:29.343150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-973b7044-c623-489f-9731-e2a66d938e14 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:29.343894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-973b7044-c623-489f-9731-e2a66d938e14 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:29.355929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-973b7044-c623-489f-9731-e2a66d938e14 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:29.356416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-973b7044-c623-489f-9731-e2a66d938e14 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:29.357443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-973b7044-c623-489f-9731-e2a66d938e14 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:29.357880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-973b7044-c623-489f-9731-e2a66d938e14 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:29.568567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-973b7044-c623-489f-9731-e2a66d938e14 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:29.582668 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-973b7044-c623-489f-9731-e2a66d938e14 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1686 microversion: 2.1 time: 0.252186 Jul 28 04:16:29.597205 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3650/6100] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:29 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1686 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:30.608783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0b6d1fd-a6b5-4ba0-89a3-7213b3404def tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:30.610394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e0b6d1fd-a6b5-4ba0-89a3-7213b3404def tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:30.618992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0b6d1fd-a6b5-4ba0-89a3-7213b3404def tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:30.619770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0b6d1fd-a6b5-4ba0-89a3-7213b3404def tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:30.620810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0b6d1fd-a6b5-4ba0-89a3-7213b3404def tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:30.621420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0b6d1fd-a6b5-4ba0-89a3-7213b3404def tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:30.814567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e0b6d1fd-a6b5-4ba0-89a3-7213b3404def tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:30.819999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:16:30.827474 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e0b6d1fd-a6b5-4ba0-89a3-7213b3404def tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1686 microversion: 2.1 time: 0.223226 Jul 28 04:16:30.828149 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3651/6101] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:30 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1686 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:31.708646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-7b0a0b22-de22-412e-947a-371db32919a0 req-c6756dab-6bca-4083-9445-5c7589c32d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffc9184-9cca-41c1-9f1b-632b054335a0", "name": "network-vif-plugged", "status": "completed", "tag": "e7417f7a-8526-4fd3-8845-7740756e6cfe"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:31.722394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=74 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:16:31.735297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7b0a0b22-de22-412e-947a-371db32919a0 req-c6756dab-6bca-4083-9445-5c7589c32d1a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:31.737030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7b0a0b22-de22-412e-947a-371db32919a0 req-c6756dab-6bca-4083-9445-5c7589c32d1a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:31.766261 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-7b0a0b22-de22-412e-947a-371db32919a0 req-c6756dab-6bca-4083-9445-5c7589c32d1a service nova] Creating event network-vif-plugged:e7417f7a-8526-4fd3-8845-7740756e6cfe for instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 on n-h2-826756-3 Jul 28 04:16:31.779326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-7b0a0b22-de22-412e-947a-371db32919a0 req-c6756dab-6bca-4083-9445-5c7589c32d1a service nova] Instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:16:31.802084 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-7b0a0b22-de22-412e-947a-371db32919a0 req-c6756dab-6bca-4083-9445-5c7589c32d1a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098897 Jul 28 04:16:31.803158 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3652/6102] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:16:31.857241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-34e61278-b900-4858-98ca-cc09fb9b825f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:31.857864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-34e61278-b900-4858-98ca-cc09fb9b825f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:31.866599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34e61278-b900-4858-98ca-cc09fb9b825f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:31.867129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34e61278-b900-4858-98ca-cc09fb9b825f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:31.867954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34e61278-b900-4858-98ca-cc09fb9b825f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:31.868501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34e61278-b900-4858-98ca-cc09fb9b825f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:32.086871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-34e61278-b900-4858-98ca-cc09fb9b825f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:32.103417 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-34e61278-b900-4858-98ca-cc09fb9b825f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1686 microversion: 2.1 time: 0.250619 Jul 28 04:16:32.108781 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3653/6103] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:31 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1686 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:33.127820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4c8c104-3716-4f7b-b690-68f6a9b6844e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:33.129529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4c8c104-3716-4f7b-b690-68f6a9b6844e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:33.145665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4c8c104-3716-4f7b-b690-68f6a9b6844e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:33.146176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4c8c104-3716-4f7b-b690-68f6a9b6844e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:33.147640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4c8c104-3716-4f7b-b690-68f6a9b6844e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:33.148096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4c8c104-3716-4f7b-b690-68f6a9b6844e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:33.325287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f4c8c104-3716-4f7b-b690-68f6a9b6844e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:33.339998 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4c8c104-3716-4f7b-b690-68f6a9b6844e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1686 microversion: 2.1 time: 0.216402 Jul 28 04:16:33.341047 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3654/6104] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:33 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1686 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:33.645933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-33e7e5a3-4ce9-424d-927c-ae267e6f8033 req-1d894760-451d-4abe-a024-c4cb1002903e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffc9184-9cca-41c1-9f1b-632b054335a0", "name": "network-vif-unplugged", "status": "completed", "tag": "e7417f7a-8526-4fd3-8845-7740756e6cfe"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:33.656605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-33e7e5a3-4ce9-424d-927c-ae267e6f8033 req-1d894760-451d-4abe-a024-c4cb1002903e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:33.657294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-33e7e5a3-4ce9-424d-927c-ae267e6f8033 req-1d894760-451d-4abe-a024-c4cb1002903e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:33.672854 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-33e7e5a3-4ce9-424d-927c-ae267e6f8033 req-1d894760-451d-4abe-a024-c4cb1002903e service nova] Creating event network-vif-unplugged:e7417f7a-8526-4fd3-8845-7740756e6cfe for instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 on n-h1-826756-3 Jul 28 04:16:33.679662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-33e7e5a3-4ce9-424d-927c-ae267e6f8033 req-1d894760-451d-4abe-a024-c4cb1002903e service nova] Instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:16:33.694629 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-33e7e5a3-4ce9-424d-927c-ae267e6f8033 req-1d894760-451d-4abe-a024-c4cb1002903e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053102 Jul 28 04:16:33.696838 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3655/6105] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:16:34.384650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dddd1473-33f0-4c25-b963-92b1257c1b1f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:34.385396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dddd1473-33f0-4c25-b963-92b1257c1b1f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:34.397489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dddd1473-33f0-4c25-b963-92b1257c1b1f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:34.397942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dddd1473-33f0-4c25-b963-92b1257c1b1f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:34.398883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dddd1473-33f0-4c25-b963-92b1257c1b1f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:34.399315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dddd1473-33f0-4c25-b963-92b1257c1b1f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:34.882436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dddd1473-33f0-4c25-b963-92b1257c1b1f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:34.891284 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dddd1473-33f0-4c25-b963-92b1257c1b1f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1686 microversion: 2.1 time: 0.531707 Jul 28 04:16:34.892266 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3656/6106] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:34 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1686 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:35.441507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ea2b6dda-beda-484b-aa02-08cc187c8c5c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:35.442165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ea2b6dda-beda-484b-aa02-08cc187c8c5c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:35.450030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea2b6dda-beda-484b-aa02-08cc187c8c5c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:35.450631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea2b6dda-beda-484b-aa02-08cc187c8c5c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:35.451528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea2b6dda-beda-484b-aa02-08cc187c8c5c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:35.452107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea2b6dda-beda-484b-aa02-08cc187c8c5c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:35.480940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ea2b6dda-beda-484b-aa02-08cc187c8c5c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:16:35.592884 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ea2b6dda-beda-484b-aa02-08cc187c8c5c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 204 len: 0 microversion: 2.1 time: 0.153154 Jul 28 04:16:35.594122 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3657/6107] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:16:35 2022] DELETE /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:16:35.606988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d1195b89-09ee-4fac-85fc-cf4c325d2d2c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:35.608205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d1195b89-09ee-4fac-85fc-cf4c325d2d2c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:35.617707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1195b89-09ee-4fac-85fc-cf4c325d2d2c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:35.618830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1195b89-09ee-4fac-85fc-cf4c325d2d2c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:35.619902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1195b89-09ee-4fac-85fc-cf4c325d2d2c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:35.620913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1195b89-09ee-4fac-85fc-cf4c325d2d2c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:36.221752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d1195b89-09ee-4fac-85fc-cf4c325d2d2c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:36.233403 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d1195b89-09ee-4fac-85fc-cf4c325d2d2c tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 200 len: 1512 microversion: 2.1 time: 0.632804 Jul 28 04:16:36.234241 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3658/6108] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:35 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 1512 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:36.239590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-bd485bb6-5739-4852-be68-4ded9ba1ecd6 req-4a839bad-ed24-4117-a0d9-60f59f43c8ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ffc9184-9cca-41c1-9f1b-632b054335a0", "tag": "e7417f7a-8526-4fd3-8845-7740756e6cfe"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:36.249828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bd485bb6-5739-4852-be68-4ded9ba1ecd6 req-4a839bad-ed24-4117-a0d9-60f59f43c8ca service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:36.250589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bd485bb6-5739-4852-be68-4ded9ba1ecd6 req-4a839bad-ed24-4117-a0d9-60f59f43c8ca service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:36.263190 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-bd485bb6-5739-4852-be68-4ded9ba1ecd6 req-4a839bad-ed24-4117-a0d9-60f59f43c8ca service nova] Creating event network-changed:e7417f7a-8526-4fd3-8845-7740756e6cfe for instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 on n-h1-826756-3 Jul 28 04:16:36.269240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-bd485bb6-5739-4852-be68-4ded9ba1ecd6 req-4a839bad-ed24-4117-a0d9-60f59f43c8ca service nova] Instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:16:36.282603 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-bd485bb6-5739-4852-be68-4ded9ba1ecd6 req-4a839bad-ed24-4117-a0d9-60f59f43c8ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046855 Jul 28 04:16:36.283336 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3659/6109] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:16:36.289521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c6f369b9-aa02-4992-8fe1-ee0209dd5954 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:36.290348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c6f369b9-aa02-4992-8fe1-ee0209dd5954 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:36.297088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6f369b9-aa02-4992-8fe1-ee0209dd5954 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:36.297517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6f369b9-aa02-4992-8fe1-ee0209dd5954 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:36.298306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6f369b9-aa02-4992-8fe1-ee0209dd5954 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:36.298751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6f369b9-aa02-4992-8fe1-ee0209dd5954 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:36.565773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c6f369b9-aa02-4992-8fe1-ee0209dd5954 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:36.578423 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c6f369b9-aa02-4992-8fe1-ee0209dd5954 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1686 microversion: 2.1 time: 0.293605 Jul 28 04:16:36.593595 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3660/6110] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:36 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1686 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:37.265072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74525033-c18f-42f5-bae4-c450fffe0f19 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:37.265597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74525033-c18f-42f5-bae4-c450fffe0f19 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:37.273473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74525033-c18f-42f5-bae4-c450fffe0f19 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:37.274074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74525033-c18f-42f5-bae4-c450fffe0f19 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:37.274981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74525033-c18f-42f5-bae4-c450fffe0f19 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:37.275505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74525033-c18f-42f5-bae4-c450fffe0f19 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:37.525741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-74525033-c18f-42f5-bae4-c450fffe0f19 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:37.535533 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74525033-c18f-42f5-bae4-c450fffe0f19 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 200 len: 1512 microversion: 2.1 time: 0.276315 Jul 28 04:16:37.536506 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3661/6111] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:37 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 1512 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:37.604640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e1efc998-fc97-486d-95ee-dceba51922fa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:37.606373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e1efc998-fc97-486d-95ee-dceba51922fa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:37.613406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1efc998-fc97-486d-95ee-dceba51922fa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:37.614240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1efc998-fc97-486d-95ee-dceba51922fa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:37.615314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1efc998-fc97-486d-95ee-dceba51922fa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:37.615983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1efc998-fc97-486d-95ee-dceba51922fa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:37.868657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e1efc998-fc97-486d-95ee-dceba51922fa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:37.880879 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e1efc998-fc97-486d-95ee-dceba51922fa tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1679 microversion: 2.1 time: 0.280315 Jul 28 04:16:37.882606 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3662/6112] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:37 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1679 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:38.567323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a7671996-1a08-4894-b651-903406c90f11 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:38.576317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a7671996-1a08-4894-b651-903406c90f11 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:38.593357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a7671996-1a08-4894-b651-903406c90f11 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:38.594559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a7671996-1a08-4894-b651-903406c90f11 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:38.596170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a7671996-1a08-4894-b651-903406c90f11 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:38.597333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a7671996-1a08-4894-b651-903406c90f11 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:38.863266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a7671996-1a08-4894-b651-903406c90f11 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:38.867019 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a7671996-1a08-4894-b651-903406c90f11 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 200 len: 1512 microversion: 2.1 time: 0.307374 Jul 28 04:16:38.867905 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3663/6113] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:38 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:38.882236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a3f7d8a1-c960-49e0-9d06-9d94edd1feed req-997501ac-d793-4ed4-be63-13e06dbfa18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9d8cad-2771-4dd5-a046-1068e1f04495", "name": "network-vif-deleted", "tag": "5c75c802-ad15-45cc-84e5-e48c490da98d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:38.900653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a3f7d8a1-c960-49e0-9d06-9d94edd1feed req-997501ac-d793-4ed4-be63-13e06dbfa18e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:38.901176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a3f7d8a1-c960-49e0-9d06-9d94edd1feed req-997501ac-d793-4ed4-be63-13e06dbfa18e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:38.941754 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a3f7d8a1-c960-49e0-9d06-9d94edd1feed req-997501ac-d793-4ed4-be63-13e06dbfa18e service nova] Creating event network-vif-deleted:5c75c802-ad15-45cc-84e5-e48c490da98d for instance 2f9d8cad-2771-4dd5-a046-1068e1f04495 on n-h2-826756-3 Jul 28 04:16:38.957434 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a3f7d8a1-c960-49e0-9d06-9d94edd1feed req-997501ac-d793-4ed4-be63-13e06dbfa18e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079658 Jul 28 04:16:38.958365 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3664/6114] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:16:39.802734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-451df583-f542-4489-9307-28faa42ddb04 req-26f50df5-7d8a-413c-a156-2fec9e649236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffc9184-9cca-41c1-9f1b-632b054335a0", "name": "network-vif-plugged", "status": "completed", "tag": "e7417f7a-8526-4fd3-8845-7740756e6cfe"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:39.821030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-451df583-f542-4489-9307-28faa42ddb04 req-26f50df5-7d8a-413c-a156-2fec9e649236 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:39.821556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-451df583-f542-4489-9307-28faa42ddb04 req-26f50df5-7d8a-413c-a156-2fec9e649236 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:39.836258 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-451df583-f542-4489-9307-28faa42ddb04 req-26f50df5-7d8a-413c-a156-2fec9e649236 service nova] Creating event network-vif-plugged:e7417f7a-8526-4fd3-8845-7740756e6cfe for instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 on n-h1-826756-3 Jul 28 04:16:39.846252 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-451df583-f542-4489-9307-28faa42ddb04 req-26f50df5-7d8a-413c-a156-2fec9e649236 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048147 Jul 28 04:16:39.848093 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3665/6115] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:16:39.893029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3898d7cf-9771-43d1-85ac-1caf7af01bb5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:39.893918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3898d7cf-9771-43d1-85ac-1caf7af01bb5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2f9d8cad-2771-4dd5-a046-1068e1f04495] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:39.900694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3898d7cf-9771-43d1-85ac-1caf7af01bb5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:39.901160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3898d7cf-9771-43d1-85ac-1caf7af01bb5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:39.901952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3898d7cf-9771-43d1-85ac-1caf7af01bb5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:39.902395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3898d7cf-9771-43d1-85ac-1caf7af01bb5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:39.917791 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-3898d7cf-9771-43d1-85ac-1caf7af01bb5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] HTTP exception thrown: Instance 2f9d8cad-2771-4dd5-a046-1068e1f04495 could not be found. Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3898d7cf-9771-43d1-85ac-1caf7af01bb5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Request method failure captured: Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 HTTP/1.1 Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g0dZSFDozqD_5zES-tB3Ke28Qmdwk5VDW_586GFylOL4XrGTpmcq2uairsSToBmNwx-UT_cICIKnWoYWaSjP3aqKqiw-VfRSBSGm-7M3wyt6iD6fCmkNWRxTIRle8AsvDShZIgmix93hHzqoVRsDJ-Y4RkGa9r_h-GMTq5JhCm3djM Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: c33aaf3e6c6342528ceb7a615d2a7e36 Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1944301969 Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c33aaf3e6c6342528ceb7a615d2a7e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c33aaf3e6c6342528ceb7a615d2a7e36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c33aaf3e6c6342528ceb7a615d2a7e36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c33aaf3e6c6342528ceb7a615d2a7e36"}]}] Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-VolumesSnapshotTestJSON-1944301969 Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: c33aaf3e6c6342528ceb7a615d2a7e36 Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1944301969 Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-VolumesSnapshotTestJSON-1944301969-project Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 7ae9d1b42c2e4525a18d7a1886346e71 Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-VolumesSnapshotTestJSON-1944301969-project Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2f9d8cad-2771-4dd5-a046-1068e1f04495 could not be found. Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2f9d8cad-2771-4dd5-a046-1068e1f04495'} Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f9d8cad-2771-4dd5-a046-1068e1f04495 could not be found. Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f9d8cad-2771-4dd5-a046-1068e1f04495 could not be found. Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:16:39.919596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:16:39.923731 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:16:39.923731 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:16:39.923731 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:16:39.923731 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:16:39.923731 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:16:39.923731 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f9d8cad-2771-4dd5-a046-1068e1f04495 could not be found. Jul 28 04:16:39.923731 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:16:39.926813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3898d7cf-9771-43d1-85ac-1caf7af01bb5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Returning 404 to user: Instance 2f9d8cad-2771-4dd5-a046-1068e1f04495 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:16:39.927817 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3898d7cf-9771-43d1-85ac-1caf7af01bb5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495" status: 404 len: 111 microversion: 2.1 time: 0.039187 Jul 28 04:16:39.932161 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3666/6116] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:39 2022] GET /compute/v2.1/servers/2f9d8cad-2771-4dd5-a046-1068e1f04495 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:16:44.075250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-960b43d4-0d42-4f1b-8e47-ac26988e865c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:44.076456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-960b43d4-0d42-4f1b-8e47-ac26988e865c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:44.087931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-960b43d4-0d42-4f1b-8e47-ac26988e865c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:44.088871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-960b43d4-0d42-4f1b-8e47-ac26988e865c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:44.090105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-960b43d4-0d42-4f1b-8e47-ac26988e865c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:44.090820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-960b43d4-0d42-4f1b-8e47-ac26988e865c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:44.247141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-960b43d4-0d42-4f1b-8e47-ac26988e865c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lazy-loading 'services' on Instance uuid d6f60937-da1d-4d73-896f-2330f115f960 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:16:44.396340 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-960b43d4-0d42-4f1b-8e47-ac26988e865c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/os-volume_attachments/c742bdf8-6247-47e3-8a25-3cdb31d07b00" status: 202 len: 0 microversion: 2.1 time: 0.326277 Jul 28 04:16:44.397227 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3667/6117] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:16:44 2022] DELETE /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/os-volume_attachments/c742bdf8-6247-47e3-8a25-3cdb31d07b00 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:16:48.406996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-677285239", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "51bf8982-b1d1-4a27-a862-e8d3fef3a57a"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:48.471756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] validate_networks() for [('51bf8982-b1d1-4a27-a862-e8d3fef3a57a', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:16:48.880759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:16:48.881372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:16:48.882030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:16:48.882621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:16:48.883328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:16:48.894942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:48.895855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:48.896832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:48.897445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:48.918035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Getting quotas for project c33aaf3e6c6342528ceb7a615d2a7e36. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:16:48.924003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Getting quotas for user 7ae9d1b42c2e4525a18d7a1886346e71 and project c33aaf3e6c6342528ceb7a615d2a7e36. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:16:48.938120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:16:48.941152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:16:49.014911 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-695a61a4-d5e6-48c9-bf7e-0ebf32da2fb8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613094 Jul 28 04:16:49.015723 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3668/6118] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:16:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:16:49.028545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-52edeb5e-8490-4dda-ab20-1b7711fc81fe tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:49.029461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-52edeb5e-8490-4dda-ab20-1b7711fc81fe tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:49.110632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-52edeb5e-8490-4dda-ab20-1b7711fc81fe tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:49.123795 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-52edeb5e-8490-4dda-ab20-1b7711fc81fe tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 200 len: 1218 microversion: 2.1 time: 0.100850 Jul 28 04:16:49.138887 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3669/6119] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:49 2022] GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:50.145420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6be07ea3-f7a8-437d-b32d-5cd795f83c14 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:50.147088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6be07ea3-f7a8-437d-b32d-5cd795f83c14 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:50.156313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6be07ea3-f7a8-437d-b32d-5cd795f83c14 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:50.157146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6be07ea3-f7a8-437d-b32d-5cd795f83c14 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:50.158013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6be07ea3-f7a8-437d-b32d-5cd795f83c14 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:50.158534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6be07ea3-f7a8-437d-b32d-5cd795f83c14 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:50.224323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6be07ea3-f7a8-437d-b32d-5cd795f83c14 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:50.228463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:16:50.234529 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6be07ea3-f7a8-437d-b32d-5cd795f83c14 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 200 len: 1270 microversion: 2.1 time: 0.093964 Jul 28 04:16:50.235346 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3670/6120] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:50 2022] GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:50.416852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f9b8a43-0b98-4cbf-b0d8-8e32e6736c35 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:50.426324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f9b8a43-0b98-4cbf-b0d8-8e32e6736c35 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:50.427017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f9b8a43-0b98-4cbf-b0d8-8e32e6736c35 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:50.456844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6f9b8a43-0b98-4cbf-b0d8-8e32e6736c35 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Going to try to stop instance {{(pid=126071) force_stop /opt/stack/nova/nova/compute/api.py:2753}} Jul 28 04:16:50.518379 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6f9b8a43-0b98-4cbf-b0d8-8e32e6736c35 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "POST /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/action" status: 202 len: 0 microversion: 2.1 time: 0.105657 Jul 28 04:16:50.522799 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3671/6121] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:16:50 2022] POST /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:16:50.535583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-566a8d97-be05-4511-b5a6-3ef3f0ae4999 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:50.537555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-566a8d97-be05-4511-b5a6-3ef3f0ae4999 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:50.551843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-566a8d97-be05-4511-b5a6-3ef3f0ae4999 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:50.552548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-566a8d97-be05-4511-b5a6-3ef3f0ae4999 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:50.556004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-566a8d97-be05-4511-b5a6-3ef3f0ae4999 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:50.556743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-566a8d97-be05-4511-b5a6-3ef3f0ae4999 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:50.747268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-566a8d97-be05-4511-b5a6-3ef3f0ae4999 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:50.762105 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-566a8d97-be05-4511-b5a6-3ef3f0ae4999 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1678 microversion: 2.1 time: 0.236495 Jul 28 04:16:50.763372 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3672/6122] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:50 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:51.258537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2b7a3c8e-1971-4763-b68a-ac4903784573 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:51.260973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2b7a3c8e-1971-4763-b68a-ac4903784573 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:51.269648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b7a3c8e-1971-4763-b68a-ac4903784573 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:51.270111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b7a3c8e-1971-4763-b68a-ac4903784573 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:51.273250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b7a3c8e-1971-4763-b68a-ac4903784573 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:51.273849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b7a3c8e-1971-4763-b68a-ac4903784573 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:51.474417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2b7a3c8e-1971-4763-b68a-ac4903784573 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:51.495749 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2b7a3c8e-1971-4763-b68a-ac4903784573 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 200 len: 1318 microversion: 2.1 time: 0.242817 Jul 28 04:16:51.496391 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3673/6123] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:51 2022] GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:51.786372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62178269-d3bf-488a-bd47-78404ccb93f1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:51.787443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-62178269-d3bf-488a-bd47-78404ccb93f1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:51.802491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62178269-d3bf-488a-bd47-78404ccb93f1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:51.802952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62178269-d3bf-488a-bd47-78404ccb93f1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:51.808391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62178269-d3bf-488a-bd47-78404ccb93f1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:51.809102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62178269-d3bf-488a-bd47-78404ccb93f1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:52.096340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62178269-d3bf-488a-bd47-78404ccb93f1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:52.114970 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-62178269-d3bf-488a-bd47-78404ccb93f1 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1678 microversion: 2.1 time: 0.332986 Jul 28 04:16:52.117877 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3674/6124] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:51 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1678 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:52.168173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9896c904-6831-4ad9-a37d-a5aa04f79f29 req-39d93f20-5eef-4810-90e6-c701035d032d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb994e6-a59c-4b9f-bd4a-f50944a19b68", "tag": "7f1c60d2-343d-4cec-adda-5a6cb1eeb0b8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:52.198519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9896c904-6831-4ad9-a37d-a5aa04f79f29 req-39d93f20-5eef-4810-90e6-c701035d032d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:52.199445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9896c904-6831-4ad9-a37d-a5aa04f79f29 req-39d93f20-5eef-4810-90e6-c701035d032d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:52.215817 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9896c904-6831-4ad9-a37d-a5aa04f79f29 req-39d93f20-5eef-4810-90e6-c701035d032d service nova] Creating event network-changed:7f1c60d2-343d-4cec-adda-5a6cb1eeb0b8 for instance 2eb994e6-a59c-4b9f-bd4a-f50944a19b68 on n-h1-826756-3 Jul 28 04:16:52.224463 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9896c904-6831-4ad9-a37d-a5aa04f79f29 req-39d93f20-5eef-4810-90e6-c701035d032d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062105 Jul 28 04:16:52.226107 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3675/6125] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:16:52.518808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-33df5341-1d86-4703-99e8-6c7fbd605b57 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:52.520001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-33df5341-1d86-4703-99e8-6c7fbd605b57 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:52.527780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33df5341-1d86-4703-99e8-6c7fbd605b57 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:52.528167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33df5341-1d86-4703-99e8-6c7fbd605b57 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:52.528998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33df5341-1d86-4703-99e8-6c7fbd605b57 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:52.529590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33df5341-1d86-4703-99e8-6c7fbd605b57 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:52.731513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-33df5341-1d86-4703-99e8-6c7fbd605b57 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:52.740271 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-33df5341-1d86-4703-99e8-6c7fbd605b57 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 200 len: 1318 microversion: 2.1 time: 0.226764 Jul 28 04:16:52.740908 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3676/6126] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:52 2022] GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:53.141006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e035184c-a84a-4ba5-a6d6-ddfbc65338bc tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:53.141679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e035184c-a84a-4ba5-a6d6-ddfbc65338bc tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:53.148316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e035184c-a84a-4ba5-a6d6-ddfbc65338bc tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:53.148844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e035184c-a84a-4ba5-a6d6-ddfbc65338bc tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:53.149632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e035184c-a84a-4ba5-a6d6-ddfbc65338bc tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:53.150074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e035184c-a84a-4ba5-a6d6-ddfbc65338bc tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:53.287712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e035184c-a84a-4ba5-a6d6-ddfbc65338bc tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:53.296813 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e035184c-a84a-4ba5-a6d6-ddfbc65338bc tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1678 microversion: 2.1 time: 0.159932 Jul 28 04:16:53.297367 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3677/6127] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:53 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:53.763870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3de50f1-38fd-459d-8b18-535356d0fecb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:53.764702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d3de50f1-38fd-459d-8b18-535356d0fecb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:53.775018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3de50f1-38fd-459d-8b18-535356d0fecb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:53.775941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3de50f1-38fd-459d-8b18-535356d0fecb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:53.776864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3de50f1-38fd-459d-8b18-535356d0fecb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:53.777264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3de50f1-38fd-459d-8b18-535356d0fecb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:53.944016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d3de50f1-38fd-459d-8b18-535356d0fecb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:53.960228 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d3de50f1-38fd-459d-8b18-535356d0fecb tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 200 len: 1318 microversion: 2.1 time: 0.200770 Jul 28 04:16:53.960888 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3678/6128] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:53 2022] GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:54.318948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-95d1b885-dcbb-42c0-b6b0-a90bc450b87b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:54.319984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-95d1b885-dcbb-42c0-b6b0-a90bc450b87b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:54.328588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95d1b885-dcbb-42c0-b6b0-a90bc450b87b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:54.329059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95d1b885-dcbb-42c0-b6b0-a90bc450b87b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:54.329845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95d1b885-dcbb-42c0-b6b0-a90bc450b87b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:54.330277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95d1b885-dcbb-42c0-b6b0-a90bc450b87b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:54.484899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-95d1b885-dcbb-42c0-b6b0-a90bc450b87b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:54.495558 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-95d1b885-dcbb-42c0-b6b0-a90bc450b87b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1678 microversion: 2.1 time: 0.180933 Jul 28 04:16:54.496830 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3679/6129] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:54 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:54.982300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a57c28a7-b9d2-48f1-8640-92c29a39a0fe tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:54.982993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a57c28a7-b9d2-48f1-8640-92c29a39a0fe tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:54.991592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a57c28a7-b9d2-48f1-8640-92c29a39a0fe tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:54.992172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a57c28a7-b9d2-48f1-8640-92c29a39a0fe tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:54.992995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a57c28a7-b9d2-48f1-8640-92c29a39a0fe tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:54.993438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a57c28a7-b9d2-48f1-8640-92c29a39a0fe tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:55.137903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a57c28a7-b9d2-48f1-8640-92c29a39a0fe tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:55.146218 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a57c28a7-b9d2-48f1-8640-92c29a39a0fe tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 200 len: 1318 microversion: 2.1 time: 0.167902 Jul 28 04:16:55.146811 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3680/6130] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:54 2022] GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:55.518368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-10d38972-e183-48be-b08c-f3a09e9e010a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:55.519245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-10d38972-e183-48be-b08c-f3a09e9e010a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:55.525795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10d38972-e183-48be-b08c-f3a09e9e010a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:55.526240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10d38972-e183-48be-b08c-f3a09e9e010a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:55.527014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10d38972-e183-48be-b08c-f3a09e9e010a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:55.527452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10d38972-e183-48be-b08c-f3a09e9e010a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:55.668851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-10d38972-e183-48be-b08c-f3a09e9e010a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:55.677334 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-10d38972-e183-48be-b08c-f3a09e9e010a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1678 microversion: 2.1 time: 0.162993 Jul 28 04:16:55.677925 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3681/6131] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:55 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:56.167143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1145ccba-b5db-4c81-b577-0c4c6747c18f tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:56.167812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1145ccba-b5db-4c81-b577-0c4c6747c18f tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:56.175990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1145ccba-b5db-4c81-b577-0c4c6747c18f tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:56.176470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1145ccba-b5db-4c81-b577-0c4c6747c18f tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:56.177823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1145ccba-b5db-4c81-b577-0c4c6747c18f tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:56.178271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1145ccba-b5db-4c81-b577-0c4c6747c18f tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:56.339971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1145ccba-b5db-4c81-b577-0c4c6747c18f tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:56.348888 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1145ccba-b5db-4c81-b577-0c4c6747c18f tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 200 len: 1318 microversion: 2.1 time: 0.185867 Jul 28 04:16:56.349719 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3682/6132] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:56 2022] GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:56.707347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5f1e127-8ddd-42a2-82a5-a93f252d51b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:56.707872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b5f1e127-8ddd-42a2-82a5-a93f252d51b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:56.714786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5f1e127-8ddd-42a2-82a5-a93f252d51b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:56.715232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5f1e127-8ddd-42a2-82a5-a93f252d51b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:56.716015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5f1e127-8ddd-42a2-82a5-a93f252d51b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:56.716482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5f1e127-8ddd-42a2-82a5-a93f252d51b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:56.856324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b5f1e127-8ddd-42a2-82a5-a93f252d51b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:56.864418 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5f1e127-8ddd-42a2-82a5-a93f252d51b3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1678 microversion: 2.1 time: 0.161552 Jul 28 04:16:56.865016 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3683/6133] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:56 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:57.312412 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:16:57.313184 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:16:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:16:57.369079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-61737e19-7fde-4d54-849d-44c905ec1f9b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:57.369699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61737e19-7fde-4d54-849d-44c905ec1f9b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:57.377529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61737e19-7fde-4d54-849d-44c905ec1f9b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:57.377999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61737e19-7fde-4d54-849d-44c905ec1f9b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:57.379076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61737e19-7fde-4d54-849d-44c905ec1f9b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:57.379527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61737e19-7fde-4d54-849d-44c905ec1f9b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:57.566301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-61737e19-7fde-4d54-849d-44c905ec1f9b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:57.580148 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-61737e19-7fde-4d54-849d-44c905ec1f9b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 200 len: 1318 microversion: 2.1 time: 0.214979 Jul 28 04:16:57.580934 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3684/6134] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:57 2022] GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:57.871400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-004dd528-1011-45fa-9452-d15449846ac2 req-0cd7cea9-07f6-4ff6-8753-149bc7ad9fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb994e6-a59c-4b9f-bd4a-f50944a19b68", "name": "network-vif-plugged", "status": "completed", "tag": "7f1c60d2-343d-4cec-adda-5a6cb1eeb0b8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:57.884043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-004dd528-1011-45fa-9452-d15449846ac2 req-0cd7cea9-07f6-4ff6-8753-149bc7ad9fdd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:57.884600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-004dd528-1011-45fa-9452-d15449846ac2 req-0cd7cea9-07f6-4ff6-8753-149bc7ad9fdd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:57.896533 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-004dd528-1011-45fa-9452-d15449846ac2 req-0cd7cea9-07f6-4ff6-8753-149bc7ad9fdd service nova] Creating event network-vif-plugged:7f1c60d2-343d-4cec-adda-5a6cb1eeb0b8 for instance 2eb994e6-a59c-4b9f-bd4a-f50944a19b68 on n-h1-826756-3 Jul 28 04:16:57.901668 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-004dd528-1011-45fa-9452-d15449846ac2 req-0cd7cea9-07f6-4ff6-8753-149bc7ad9fdd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034356 Jul 28 04:16:57.902814 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3685/6135] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:16:57.907895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-638fd1e8-02e6-4b6c-ba5d-323cbac82995 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:57.908665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-638fd1e8-02e6-4b6c-ba5d-323cbac82995 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:57.915303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-638fd1e8-02e6-4b6c-ba5d-323cbac82995 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:57.915754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-638fd1e8-02e6-4b6c-ba5d-323cbac82995 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:57.916568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-638fd1e8-02e6-4b6c-ba5d-323cbac82995 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:57.917003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-638fd1e8-02e6-4b6c-ba5d-323cbac82995 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:58.111770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-638fd1e8-02e6-4b6c-ba5d-323cbac82995 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:58.120311 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-638fd1e8-02e6-4b6c-ba5d-323cbac82995 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1678 microversion: 2.1 time: 0.216255 Jul 28 04:16:58.120931 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3686/6136] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:57 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:58.603844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-feb71c00-56a5-464a-ac29-3442649ad2ab tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:58.604550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-feb71c00-56a5-464a-ac29-3442649ad2ab tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:58.611791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb71c00-56a5-464a-ac29-3442649ad2ab tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:58.612239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb71c00-56a5-464a-ac29-3442649ad2ab tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:58.613047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb71c00-56a5-464a-ac29-3442649ad2ab tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:58.613479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb71c00-56a5-464a-ac29-3442649ad2ab tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:58.752585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-feb71c00-56a5-464a-ac29-3442649ad2ab tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:58.755041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:16:58.761887 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-feb71c00-56a5-464a-ac29-3442649ad2ab tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 200 len: 1318 microversion: 2.1 time: 0.163329 Jul 28 04:16:58.762486 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3687/6137] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:58 2022] GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:59.142771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b3fdfbe-2328-4f7c-9173-284b82597105 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:59.143513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b3fdfbe-2328-4f7c-9173-284b82597105 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:59.145948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:16:59.146668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:16:59.155047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b3fdfbe-2328-4f7c-9173-284b82597105 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:59.155504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b3fdfbe-2328-4f7c-9173-284b82597105 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:59.156322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b3fdfbe-2328-4f7c-9173-284b82597105 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:59.156796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b3fdfbe-2328-4f7c-9173-284b82597105 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:59.301863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b3fdfbe-2328-4f7c-9173-284b82597105 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:59.310467 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b3fdfbe-2328-4f7c-9173-284b82597105 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1678 microversion: 2.1 time: 0.171793 Jul 28 04:16:59.311069 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3688/6138] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:59 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:59.784367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f2577d21-37be-404c-8389-e58b788924b5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:59.785193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f2577d21-37be-404c-8389-e58b788924b5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:59.793444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2577d21-37be-404c-8389-e58b788924b5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:59.793897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2577d21-37be-404c-8389-e58b788924b5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:59.794713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2577d21-37be-404c-8389-e58b788924b5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:59.795173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2577d21-37be-404c-8389-e58b788924b5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:59.933911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f2577d21-37be-404c-8389-e58b788924b5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:59.942248 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f2577d21-37be-404c-8389-e58b788924b5 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 200 len: 1506 microversion: 2.1 time: 0.162236 Jul 28 04:16:59.942800 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3689/6139] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:59 2022] GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:59.963495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4842eda-77db-4919-bdf2-969667b7998b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0db2ee65-372f-4f81-942c-779d8f263e74", "device": "/dev/sdb"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:59.965994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e4842eda-77db-4919-bdf2-969667b7998b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:16:59.972413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4842eda-77db-4919-bdf2-969667b7998b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:59.972891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4842eda-77db-4919-bdf2-969667b7998b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:59.973658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4842eda-77db-4919-bdf2-969667b7998b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:59.974105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4842eda-77db-4919-bdf2-969667b7998b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:00.238703 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e4842eda-77db-4919-bdf2-969667b7998b tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "POST /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278988 Jul 28 04:17:00.239627 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3690/6140] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 04:16:59 2022] POST /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:17:00.333116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed749e26-501e-49e6-b43f-04f5282842a7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:00.333966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed749e26-501e-49e6-b43f-04f5282842a7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:00.336007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:17:00.342678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed749e26-501e-49e6-b43f-04f5282842a7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:00.343142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed749e26-501e-49e6-b43f-04f5282842a7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:00.343958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed749e26-501e-49e6-b43f-04f5282842a7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:00.344414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed749e26-501e-49e6-b43f-04f5282842a7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:00.485152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed749e26-501e-49e6-b43f-04f5282842a7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:00.494847 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed749e26-501e-49e6-b43f-04f5282842a7 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1678 microversion: 2.1 time: 0.167211 Jul 28 04:17:00.495910 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3691/6141] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:00 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:01.518294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fddbb576-2be5-4160-b577-13a1f75cb724 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:01.518876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fddbb576-2be5-4160-b577-13a1f75cb724 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:01.526137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fddbb576-2be5-4160-b577-13a1f75cb724 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:01.526582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fddbb576-2be5-4160-b577-13a1f75cb724 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:01.527339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fddbb576-2be5-4160-b577-13a1f75cb724 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:01.527787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fddbb576-2be5-4160-b577-13a1f75cb724 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:01.680109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fddbb576-2be5-4160-b577-13a1f75cb724 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:01.688705 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fddbb576-2be5-4160-b577-13a1f75cb724 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1655 microversion: 2.1 time: 0.175050 Jul 28 04:17:01.689641 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3692/6142] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:01 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1655 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:01.710215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-48627d14-8124-487f-8c28-53974a0970a4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:01.717532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48627d14-8124-487f-8c28-53974a0970a4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:01.718993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48627d14-8124-487f-8c28-53974a0970a4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:01.743834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-48627d14-8124-487f-8c28-53974a0970a4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Going to try to start instance {{(pid=126071) start /opt/stack/nova/nova/compute/api.py:2776}} Jul 28 04:17:01.804313 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-48627d14-8124-487f-8c28-53974a0970a4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "POST /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/action" status: 202 len: 0 microversion: 2.1 time: 0.097843 Jul 28 04:17:01.805314 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3693/6143] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:17:01 2022] POST /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:17:01.818604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-083fae90-e8dc-4f8c-8322-68bbc9b1a23d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:01.819600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-083fae90-e8dc-4f8c-8322-68bbc9b1a23d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:01.829024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-083fae90-e8dc-4f8c-8322-68bbc9b1a23d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:01.829604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-083fae90-e8dc-4f8c-8322-68bbc9b1a23d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:01.830942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-083fae90-e8dc-4f8c-8322-68bbc9b1a23d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:01.831385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-083fae90-e8dc-4f8c-8322-68bbc9b1a23d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:02.054409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-083fae90-e8dc-4f8c-8322-68bbc9b1a23d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:02.065548 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-083fae90-e8dc-4f8c-8322-68bbc9b1a23d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1664 microversion: 2.1 time: 0.254023 Jul 28 04:17:02.079375 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3694/6144] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:01 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1664 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:02.162872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3f4a1078-5161-4495-be93-65a65c3711d4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:02.165347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3f4a1078-5161-4495-be93-65a65c3711d4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:02.172571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f4a1078-5161-4495-be93-65a65c3711d4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:02.173096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f4a1078-5161-4495-be93-65a65c3711d4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:02.174338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f4a1078-5161-4495-be93-65a65c3711d4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:02.175099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f4a1078-5161-4495-be93-65a65c3711d4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:02.255773 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3f4a1078-5161-4495-be93-65a65c3711d4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0/action" status: 200 len: 63077 microversion: 2.1 time: 0.097574 Jul 28 04:17:02.257047 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3695/6145] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:17:02 2022] POST /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0/action => generated 63077 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:17:03.099501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2978f3c4-3d7f-4098-b168-ce1c23920495 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:03.101730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2978f3c4-3d7f-4098-b168-ce1c23920495 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:03.118135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2978f3c4-3d7f-4098-b168-ce1c23920495 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:03.118135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2978f3c4-3d7f-4098-b168-ce1c23920495 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:03.119360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2978f3c4-3d7f-4098-b168-ce1c23920495 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:03.119684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2978f3c4-3d7f-4098-b168-ce1c23920495 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:03.343711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2978f3c4-3d7f-4098-b168-ce1c23920495 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:03.366657 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2978f3c4-3d7f-4098-b168-ce1c23920495 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1664 microversion: 2.1 time: 0.280102 Jul 28 04:17:03.368464 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3696/6146] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:03 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1664 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:04.391799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c0655df4-a309-43ca-8193-5d60af291ff3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:04.393317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c0655df4-a309-43ca-8193-5d60af291ff3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:04.403990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c0655df4-a309-43ca-8193-5d60af291ff3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:04.404783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c0655df4-a309-43ca-8193-5d60af291ff3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:04.405854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c0655df4-a309-43ca-8193-5d60af291ff3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:04.406441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c0655df4-a309-43ca-8193-5d60af291ff3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:04.596678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c0655df4-a309-43ca-8193-5d60af291ff3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:04.605536 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c0655df4-a309-43ca-8193-5d60af291ff3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1668 microversion: 2.1 time: 0.219807 Jul 28 04:17:04.606137 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3697/6147] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:04 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1668 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:08.452656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b6815659-2ed8-41ba-8081-90f9dd4a0992 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:08.453310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b6815659-2ed8-41ba-8081-90f9dd4a0992 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:08.461403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6815659-2ed8-41ba-8081-90f9dd4a0992 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:08.461857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6815659-2ed8-41ba-8081-90f9dd4a0992 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:08.462710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6815659-2ed8-41ba-8081-90f9dd4a0992 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:08.463145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6815659-2ed8-41ba-8081-90f9dd4a0992 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:08.599535 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b6815659-2ed8-41ba-8081-90f9dd4a0992 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1830 microversion: 2.1 time: 0.150775 Jul 28 04:17:08.600255 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3698/6148] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:08 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1830 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:09.506721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c4ab434-bd8a-44b5-a6bd-7f3d0cfa4fc8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:09.507863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c4ab434-bd8a-44b5-a6bd-7f3d0cfa4fc8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:09.515641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c4ab434-bd8a-44b5-a6bd-7f3d0cfa4fc8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:09.516064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c4ab434-bd8a-44b5-a6bd-7f3d0cfa4fc8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:09.517162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c4ab434-bd8a-44b5-a6bd-7f3d0cfa4fc8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:09.517596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c4ab434-bd8a-44b5-a6bd-7f3d0cfa4fc8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:09.547393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c4ab434-bd8a-44b5-a6bd-7f3d0cfa4fc8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:17:09.640980 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c4ab434-bd8a-44b5-a6bd-7f3d0cfa4fc8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 204 len: 0 microversion: 2.1 time: 0.137759 Jul 28 04:17:09.645336 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3699/6149] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:17:09 2022] DELETE /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:17:09.651849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b225243e-674a-42c3-ad85-91cf5ab29e41 req-17ef8487-2423-4f31-a74e-cfadc75df2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ffc9184-9cca-41c1-9f1b-632b054335a0", "tag": "e7417f7a-8526-4fd3-8845-7740756e6cfe"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:09.662535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b225243e-674a-42c3-ad85-91cf5ab29e41 req-17ef8487-2423-4f31-a74e-cfadc75df2b6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:09.664434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b225243e-674a-42c3-ad85-91cf5ab29e41 req-17ef8487-2423-4f31-a74e-cfadc75df2b6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:09.675678 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b225243e-674a-42c3-ad85-91cf5ab29e41 req-17ef8487-2423-4f31-a74e-cfadc75df2b6 service nova] Creating event network-changed:e7417f7a-8526-4fd3-8845-7740756e6cfe for instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 on n-h1-826756-3 Jul 28 04:17:09.681081 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b225243e-674a-42c3-ad85-91cf5ab29e41 req-17ef8487-2423-4f31-a74e-cfadc75df2b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034062 Jul 28 04:17:09.681710 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3700/6150] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:17:09.687049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2d3615bf-6030-4da9-a6d8-60e8603799d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:09.687782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2d3615bf-6030-4da9-a6d8-60e8603799d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:09.694343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d3615bf-6030-4da9-a6d8-60e8603799d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:09.694797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d3615bf-6030-4da9-a6d8-60e8603799d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:09.695730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d3615bf-6030-4da9-a6d8-60e8603799d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:09.696167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d3615bf-6030-4da9-a6d8-60e8603799d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:09.713806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:17:09.856942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2d3615bf-6030-4da9-a6d8-60e8603799d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:09.866375 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2d3615bf-6030-4da9-a6d8-60e8603799d9 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1685 microversion: 2.1 time: 0.183262 Jul 28 04:17:09.867280 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3701/6151] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:09 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:10.888146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c70f291d-b8a8-452d-a7ee-e87719114bc4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:10.888829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c70f291d-b8a8-452d-a7ee-e87719114bc4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:10.896304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c70f291d-b8a8-452d-a7ee-e87719114bc4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:10.897050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c70f291d-b8a8-452d-a7ee-e87719114bc4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:10.898299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c70f291d-b8a8-452d-a7ee-e87719114bc4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:10.899191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c70f291d-b8a8-452d-a7ee-e87719114bc4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:11.056676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c70f291d-b8a8-452d-a7ee-e87719114bc4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:11.064872 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c70f291d-b8a8-452d-a7ee-e87719114bc4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1685 microversion: 2.1 time: 0.180706 Jul 28 04:17:11.065642 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3702/6152] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:10 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:12.088741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-49e4421f-8545-401d-ba7a-d48916b62c6b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:12.089232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-49e4421f-8545-401d-ba7a-d48916b62c6b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:12.098922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49e4421f-8545-401d-ba7a-d48916b62c6b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:12.099796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49e4421f-8545-401d-ba7a-d48916b62c6b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:12.100825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49e4421f-8545-401d-ba7a-d48916b62c6b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:12.101472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49e4421f-8545-401d-ba7a-d48916b62c6b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:12.288653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-49e4421f-8545-401d-ba7a-d48916b62c6b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:12.297802 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-49e4421f-8545-401d-ba7a-d48916b62c6b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 200 len: 1685 microversion: 2.1 time: 0.214327 Jul 28 04:17:12.303659 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3703/6153] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:12 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 1685 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:12.784756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-2ef6d550-ded3-49bf-bac6-b2ac542ea846 req-0e0cb55a-06aa-46e3-b1ac-dcd5f7945b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffc9184-9cca-41c1-9f1b-632b054335a0", "name": "network-vif-deleted", "tag": "e7417f7a-8526-4fd3-8845-7740756e6cfe"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:12.795461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2ef6d550-ded3-49bf-bac6-b2ac542ea846 req-0e0cb55a-06aa-46e3-b1ac-dcd5f7945b71 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:12.796196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2ef6d550-ded3-49bf-bac6-b2ac542ea846 req-0e0cb55a-06aa-46e3-b1ac-dcd5f7945b71 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:12.812310 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-2ef6d550-ded3-49bf-bac6-b2ac542ea846 req-0e0cb55a-06aa-46e3-b1ac-dcd5f7945b71 service nova] Creating event network-vif-deleted:e7417f7a-8526-4fd3-8845-7740756e6cfe for instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 on n-h1-826756-3 Jul 28 04:17:12.817872 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-2ef6d550-ded3-49bf-bac6-b2ac542ea846 req-0e0cb55a-06aa-46e3-b1ac-dcd5f7945b71 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036894 Jul 28 04:17:12.821694 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3704/6154] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:17:13.326698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb841860-14a8-4668-a388-ded9ccdfddde tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:13.327590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb841860-14a8-4668-a388-ded9ccdfddde tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 7ffc9184-9cca-41c1-9f1b-632b054335a0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:13.337173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb841860-14a8-4668-a388-ded9ccdfddde tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:13.338318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb841860-14a8-4668-a388-ded9ccdfddde tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:13.339501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb841860-14a8-4668-a388-ded9ccdfddde tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:13.340219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb841860-14a8-4668-a388-ded9ccdfddde tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:13.356905 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-fb841860-14a8-4668-a388-ded9ccdfddde tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] HTTP exception thrown: Instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 could not be found. Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb841860-14a8-4668-a388-ded9ccdfddde tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Request method failure captured: Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 HTTP/1.1 Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gy0wHx96BVxhyrDFvyRJsSuYIisOw-l-wszQ9XKSZbRRP5vlwalQKYK5hBNyy9WnKnKBmW3QuxEmH_3MqtnQ-B8fUcW5QF0OqJPqXMuA7juF0K-NDS0wf4uTw9P7GbriXF73fWwKh9phWFNUD6o7PkvGEVFYXU7L-2lzVhpHOKHQ8M Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7ea463b2785d46a08c278fa7041654e4 Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1842633679 Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7ea463b2785d46a08c278fa7041654e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ea463b2785d46a08c278fa7041654e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7ea463b2785d46a08c278fa7041654e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ea463b2785d46a08c278fa7041654e4"}]}] Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1842633679 Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7ea463b2785d46a08c278fa7041654e4 Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1842633679 Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestNetworkAdvancedServerOps-1842633679-project Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 63fc192385a7490aacce2d69bfc866ec Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1842633679-project Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 could not be found. Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '7ffc9184-9cca-41c1-9f1b-632b054335a0'} Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 could not be found. Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 could not be found. Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:13.360902 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:17:13.369571 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:13.369571 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:17:13.369571 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:17:13.369571 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:17:13.369571 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:17:13.369571 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:17:13.369571 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 could not be found. Jul 28 04:17:13.369571 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:13.372050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb841860-14a8-4668-a388-ded9ccdfddde tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Returning 404 to user: Instance 7ffc9184-9cca-41c1-9f1b-632b054335a0 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:17:13.373342 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fb841860-14a8-4668-a388-ded9ccdfddde tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0" status: 404 len: 111 microversion: 2.1 time: 0.054614 Jul 28 04:17:13.374682 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3705/6155] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:13 2022] GET /compute/v2.1/servers/7ffc9184-9cca-41c1-9f1b-632b054335a0 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:17:17.960370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f090432b-4289-4b7f-83bd-ded326d37bfb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '.version_select at 0x7ffa679f51f0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:17.983744 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f090432b-4289-4b7f-83bd-ded326d37bfb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-43982873" status: 202 len: 0 microversion: 2.1 time: 0.027944 Jul 28 04:17:17.999324 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3706/6156] 10.222.0.48 () {58 vars in 1278 bytes} [Thu Jul 28 04:17:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-43982873 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:17:18.027753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0fd721a8-0b79-4e25-8a94-5fde8c097298 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'create', calling method: .version_select at 0x7ffa74654dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-547048850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLx8hhn2FAzXHWSvNkQ1bjFKdkgF6J1qlAfc2yOrdl73+xvRC9EjuehaxOiOg/tCpTOrrqD705SW4RLPTaqCYbRr52GL3MdOT4VjmcfFkt3QxgIifDAA/b7UJw/Tt7RbxA=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:18.048463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-0fd721a8-0b79-4e25-8a94-5fde8c097298 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for project 7ea463b2785d46a08c278fa7041654e4. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:17:18.055209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-0fd721a8-0b79-4e25-8a94-5fde8c097298 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for user 63fc192385a7490aacce2d69bfc866ec and project 7ea463b2785d46a08c278fa7041654e4. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:17:18.092797 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0fd721a8-0b79-4e25-8a94-5fde8c097298 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.069504 Jul 28 04:17:18.093882 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3707/6157] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:17:18 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:17:24.252069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=19 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:17:24.266031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-95ecae5b-48ff-4636-8103-b0bebcd381ed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:24.267354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-95ecae5b-48ff-4636-8103-b0bebcd381ed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:24.285640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95ecae5b-48ff-4636-8103-b0bebcd381ed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:24.288046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95ecae5b-48ff-4636-8103-b0bebcd381ed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:24.289332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95ecae5b-48ff-4636-8103-b0bebcd381ed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:24.291063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95ecae5b-48ff-4636-8103-b0bebcd381ed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:24.417658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-95ecae5b-48ff-4636-8103-b0bebcd381ed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lazy-loading 'services' on Instance uuid 2eb994e6-a59c-4b9f-bd4a-f50944a19b68 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:17:24.539131 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-95ecae5b-48ff-4636-8103-b0bebcd381ed tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68/os-volume_attachments/0db2ee65-372f-4f81-942c-779d8f263e74" status: 202 len: 0 microversion: 2.1 time: 0.289084 Jul 28 04:17:24.540180 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3708/6158] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:17:24 2022] DELETE /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68/os-volume_attachments/0db2ee65-372f-4f81-942c-779d8f263e74 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:17:24.743726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-829145902", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "3030a728-7e12-4546-8e42-d5d7e63147a0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-547048850", "security_groups": [{"name": "tempest-secgroup-smoke-1881370505"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:24.894809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] validate_networks() for [('3030a728-7e12-4546-8e42-d5d7e63147a0', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:17:26.014849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:17:26.016093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:17:26.016603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:17:26.017150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:17:26.017439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:17:26.034151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:26.034619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:26.035431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:26.035877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:26.087732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for project 7ea463b2785d46a08c278fa7041654e4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:17:26.100301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for user 63fc192385a7490aacce2d69bfc866ec and project 7ea463b2785d46a08c278fa7041654e4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:17:26.120075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:17:26.122951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:17:26.194196 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6e3d4f7f-b082-49d9-a7c4-555854a4c249 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.455386 Jul 28 04:17:26.203253 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3709/6159] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:17:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:17:26.210377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0888dc36-be41-44c6-8dcb-7f85181c29c6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:26.211453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0888dc36-be41-44c6-8dcb-7f85181c29c6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:26.355090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0888dc36-be41-44c6-8dcb-7f85181c29c6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:26.364271 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0888dc36-be41-44c6-8dcb-7f85181c29c6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1265 microversion: 2.1 time: 0.158887 Jul 28 04:17:26.365138 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3710/6160] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:26 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:27.390755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ab06c45-dad1-4f26-99b2-1305465506eb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:27.391450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ab06c45-dad1-4f26-99b2-1305465506eb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:27.406730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ab06c45-dad1-4f26-99b2-1305465506eb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:27.407197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ab06c45-dad1-4f26-99b2-1305465506eb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:27.409371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ab06c45-dad1-4f26-99b2-1305465506eb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:27.409830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ab06c45-dad1-4f26-99b2-1305465506eb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:27.567683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ab06c45-dad1-4f26-99b2-1305465506eb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:27.580530 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ab06c45-dad1-4f26-99b2-1305465506eb tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1317 microversion: 2.1 time: 0.193945 Jul 28 04:17:27.593855 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3711/6161] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:27 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:28.607371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-728fd45a-b39e-429d-a483-f3aaa8bf6853 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:28.608121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-728fd45a-b39e-429d-a483-f3aaa8bf6853 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:28.615793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-728fd45a-b39e-429d-a483-f3aaa8bf6853 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:28.616854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-728fd45a-b39e-429d-a483-f3aaa8bf6853 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:28.617910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-728fd45a-b39e-429d-a483-f3aaa8bf6853 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:28.618620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-728fd45a-b39e-429d-a483-f3aaa8bf6853 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:28.781458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-728fd45a-b39e-429d-a483-f3aaa8bf6853 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:28.801597 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-728fd45a-b39e-429d-a483-f3aaa8bf6853 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1323 microversion: 2.1 time: 0.198326 Jul 28 04:17:28.816112 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3712/6162] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:28 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1323 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:29.825944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-81b7713e-c63c-412c-b422-1e224a7f911b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:29.826621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-81b7713e-c63c-412c-b422-1e224a7f911b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:29.849184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81b7713e-c63c-412c-b422-1e224a7f911b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:29.852873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81b7713e-c63c-412c-b422-1e224a7f911b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:29.854383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81b7713e-c63c-412c-b422-1e224a7f911b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:29.856213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81b7713e-c63c-412c-b422-1e224a7f911b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:30.117621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-81b7713e-c63c-412c-b422-1e224a7f911b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:30.127148 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-81b7713e-c63c-412c-b422-1e224a7f911b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1391 microversion: 2.1 time: 0.304932 Jul 28 04:17:30.128158 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3713/6163] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:29 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1391 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:30.345604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1fbac419-c2d0-4941-bbd6-b8a3bd8d7852 req-35f85810-495c-43a2-823b-611e173ff633 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd4963e-f6e3-499b-96d7-c86c44fed683", "tag": "e691a547-60c5-454e-a06e-44918e5be830"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:30.393429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1fbac419-c2d0-4941-bbd6-b8a3bd8d7852 req-35f85810-495c-43a2-823b-611e173ff633 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:30.394936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1fbac419-c2d0-4941-bbd6-b8a3bd8d7852 req-35f85810-495c-43a2-823b-611e173ff633 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:30.423997 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1fbac419-c2d0-4941-bbd6-b8a3bd8d7852 req-35f85810-495c-43a2-823b-611e173ff633 service nova] Creating event network-changed:e691a547-60c5-454e-a06e-44918e5be830 for instance cdd4963e-f6e3-499b-96d7-c86c44fed683 on n-h2-826756-3 Jul 28 04:17:30.437366 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1fbac419-c2d0-4941-bbd6-b8a3bd8d7852 req-35f85810-495c-43a2-823b-611e173ff633 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095062 Jul 28 04:17:30.438566 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3714/6164] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:17:31.151533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-779d72a1-b538-41ab-a778-2a8e01970df0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:31.153223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-779d72a1-b538-41ab-a778-2a8e01970df0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:31.158262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:17:31.167968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-779d72a1-b538-41ab-a778-2a8e01970df0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:31.169053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-779d72a1-b538-41ab-a778-2a8e01970df0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:31.169911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-779d72a1-b538-41ab-a778-2a8e01970df0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:31.171090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-779d72a1-b538-41ab-a778-2a8e01970df0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:31.366912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-779d72a1-b538-41ab-a778-2a8e01970df0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:31.377192 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-779d72a1-b538-41ab-a778-2a8e01970df0 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1391 microversion: 2.1 time: 0.231404 Jul 28 04:17:31.390162 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3715/6165] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:31 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1391 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:32.411705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ea7c3457-23d1-43d4-8e6c-ac7f5ee0ee13 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:32.412394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ea7c3457-23d1-43d4-8e6c-ac7f5ee0ee13 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:32.420116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea7c3457-23d1-43d4-8e6c-ac7f5ee0ee13 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:32.420671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea7c3457-23d1-43d4-8e6c-ac7f5ee0ee13 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:32.421434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea7c3457-23d1-43d4-8e6c-ac7f5ee0ee13 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:32.422056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea7c3457-23d1-43d4-8e6c-ac7f5ee0ee13 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:32.575439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ea7c3457-23d1-43d4-8e6c-ac7f5ee0ee13 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:32.584058 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ea7c3457-23d1-43d4-8e6c-ac7f5ee0ee13 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1391 microversion: 2.1 time: 0.176474 Jul 28 04:17:32.586505 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3716/6166] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:32 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:32.591376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e88a317-54aa-437c-b41c-911e9d073518 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:32.592114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e88a317-54aa-437c-b41c-911e9d073518 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:32.599756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e88a317-54aa-437c-b41c-911e9d073518 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:32.600410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e88a317-54aa-437c-b41c-911e9d073518 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:32.601372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e88a317-54aa-437c-b41c-911e9d073518 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:32.601807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e88a317-54aa-437c-b41c-911e9d073518 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:32.630213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e88a317-54aa-437c-b41c-911e9d073518 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:17:32.720781 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e88a317-54aa-437c-b41c-911e9d073518 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 204 len: 0 microversion: 2.1 time: 0.134181 Jul 28 04:17:32.723903 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3717/6167] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:17:32 2022] DELETE /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:17:32.733395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f98969a-b267-471a-b861-e757bdd88d75 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:32.734191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f98969a-b267-471a-b861-e757bdd88d75 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:32.740682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f98969a-b267-471a-b861-e757bdd88d75 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:32.741215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f98969a-b267-471a-b861-e757bdd88d75 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:32.742119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f98969a-b267-471a-b861-e757bdd88d75 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:32.742696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f98969a-b267-471a-b861-e757bdd88d75 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:32.895010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f98969a-b267-471a-b861-e757bdd88d75 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:32.903819 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f98969a-b267-471a-b861-e757bdd88d75 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 200 len: 1512 microversion: 2.1 time: 0.175127 Jul 28 04:17:32.904436 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3718/6168] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:32 2022] GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:33.607990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6b4900db-141f-4736-8694-9a95822939db tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:33.608834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6b4900db-141f-4736-8694-9a95822939db tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:33.615996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b4900db-141f-4736-8694-9a95822939db tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:33.616456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b4900db-141f-4736-8694-9a95822939db tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:33.617233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b4900db-141f-4736-8694-9a95822939db tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:33.617821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b4900db-141f-4736-8694-9a95822939db tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:33.765526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6b4900db-141f-4736-8694-9a95822939db tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:33.773736 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6b4900db-141f-4736-8694-9a95822939db tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1391 microversion: 2.1 time: 0.169764 Jul 28 04:17:33.774372 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3719/6169] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:33 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:33.926048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-78ae1d75-9bf3-487f-84e9-7ff9640478d2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:33.928160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-78ae1d75-9bf3-487f-84e9-7ff9640478d2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:33.933710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78ae1d75-9bf3-487f-84e9-7ff9640478d2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:33.934170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78ae1d75-9bf3-487f-84e9-7ff9640478d2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:33.934974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78ae1d75-9bf3-487f-84e9-7ff9640478d2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:33.935463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78ae1d75-9bf3-487f-84e9-7ff9640478d2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:34.125020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-78ae1d75-9bf3-487f-84e9-7ff9640478d2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:34.134531 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-78ae1d75-9bf3-487f-84e9-7ff9640478d2 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 200 len: 1512 microversion: 2.1 time: 0.212777 Jul 28 04:17:34.135297 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3720/6170] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:33 2022] GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:34.798828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ad424b95-aaf5-4222-856b-f4a737bc1c83 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:34.800236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ad424b95-aaf5-4222-856b-f4a737bc1c83 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:34.815261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad424b95-aaf5-4222-856b-f4a737bc1c83 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:34.815904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad424b95-aaf5-4222-856b-f4a737bc1c83 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:34.816786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad424b95-aaf5-4222-856b-f4a737bc1c83 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:34.817293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad424b95-aaf5-4222-856b-f4a737bc1c83 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:35.026362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ad424b95-aaf5-4222-856b-f4a737bc1c83 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:35.037209 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ad424b95-aaf5-4222-856b-f4a737bc1c83 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1391 microversion: 2.1 time: 0.244311 Jul 28 04:17:35.039352 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3721/6171] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:34 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1391 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:35.163265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4c86840-fdaa-4b7e-8a5c-697e91c7bd83 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:35.164048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4c86840-fdaa-4b7e-8a5c-697e91c7bd83 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:35.171620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c86840-fdaa-4b7e-8a5c-697e91c7bd83 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:35.172164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c86840-fdaa-4b7e-8a5c-697e91c7bd83 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:35.173059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c86840-fdaa-4b7e-8a5c-697e91c7bd83 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:35.173571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4c86840-fdaa-4b7e-8a5c-697e91c7bd83 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:35.248576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a4c86840-fdaa-4b7e-8a5c-697e91c7bd83 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae9d1b42c2e4525a18d7a1886346e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c33aaf3e6c6342528ceb7a615d2a7e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:35.257964 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4c86840-fdaa-4b7e-8a5c-697e91c7bd83 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 200 len: 1470 microversion: 2.1 time: 0.098664 Jul 28 04:17:35.258643 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3722/6172] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:35 2022] GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 1470 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:35.286916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-80d294f2-832f-4d4b-81ec-034edd6cfed5 req-278cad63-bab7-49b1-9822-bb65fdb3199c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb994e6-a59c-4b9f-bd4a-f50944a19b68", "name": "network-vif-deleted", "tag": "7f1c60d2-343d-4cec-adda-5a6cb1eeb0b8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:35.296759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-80d294f2-832f-4d4b-81ec-034edd6cfed5 req-278cad63-bab7-49b1-9822-bb65fdb3199c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:35.297201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-80d294f2-832f-4d4b-81ec-034edd6cfed5 req-278cad63-bab7-49b1-9822-bb65fdb3199c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:35.308798 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-80d294f2-832f-4d4b-81ec-034edd6cfed5 req-278cad63-bab7-49b1-9822-bb65fdb3199c service nova] Creating event network-vif-deleted:7f1c60d2-343d-4cec-adda-5a6cb1eeb0b8 for instance 2eb994e6-a59c-4b9f-bd4a-f50944a19b68 on n-h1-826756-3 Jul 28 04:17:35.314064 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-80d294f2-832f-4d4b-81ec-034edd6cfed5 req-278cad63-bab7-49b1-9822-bb65fdb3199c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030890 Jul 28 04:17:35.314816 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3723/6173] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:17:35.958621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-2993d1c8-1369-4bc8-9821-0f00e352cfa9 req-e5431c8d-e507-4210-848c-4d6a879dc9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd4963e-f6e3-499b-96d7-c86c44fed683", "name": "network-vif-plugged", "status": "completed", "tag": "e691a547-60c5-454e-a06e-44918e5be830"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:35.973287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2993d1c8-1369-4bc8-9821-0f00e352cfa9 req-e5431c8d-e507-4210-848c-4d6a879dc9c9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:35.974047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2993d1c8-1369-4bc8-9821-0f00e352cfa9 req-e5431c8d-e507-4210-848c-4d6a879dc9c9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:35.987820 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-2993d1c8-1369-4bc8-9821-0f00e352cfa9 req-e5431c8d-e507-4210-848c-4d6a879dc9c9 service nova] Creating event network-vif-plugged:e691a547-60c5-454e-a06e-44918e5be830 for instance cdd4963e-f6e3-499b-96d7-c86c44fed683 on n-h2-826756-3 Jul 28 04:17:35.993128 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-2993d1c8-1369-4bc8-9821-0f00e352cfa9 req-e5431c8d-e507-4210-848c-4d6a879dc9c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044472 Jul 28 04:17:35.993909 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3724/6174] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:17:36.061650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f44b2c5f-e19f-4d83-98c9-c0b88d2c837b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:36.062601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f44b2c5f-e19f-4d83-98c9-c0b88d2c837b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:36.071053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f44b2c5f-e19f-4d83-98c9-c0b88d2c837b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:36.073364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f44b2c5f-e19f-4d83-98c9-c0b88d2c837b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:36.073526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f44b2c5f-e19f-4d83-98c9-c0b88d2c837b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:36.073990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f44b2c5f-e19f-4d83-98c9-c0b88d2c837b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:36.074643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:17:36.225102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f44b2c5f-e19f-4d83-98c9-c0b88d2c837b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:36.228965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:17:36.234392 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f44b2c5f-e19f-4d83-98c9-c0b88d2c837b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1391 microversion: 2.1 time: 0.178702 Jul 28 04:17:36.235602 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3725/6175] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:36 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:36.279511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e1f76f2-02e2-4308-9717-fbf0dffa4ee8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:36.280163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0e1f76f2-02e2-4308-9717-fbf0dffa4ee8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] [instance: 2eb994e6-a59c-4b9f-bd4a-f50944a19b68] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:36.287784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e1f76f2-02e2-4308-9717-fbf0dffa4ee8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:36.288240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e1f76f2-02e2-4308-9717-fbf0dffa4ee8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:36.289055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e1f76f2-02e2-4308-9717-fbf0dffa4ee8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:36.289496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e1f76f2-02e2-4308-9717-fbf0dffa4ee8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:36.306212 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-0e1f76f2-02e2-4308-9717-fbf0dffa4ee8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] HTTP exception thrown: Instance 2eb994e6-a59c-4b9f-bd4a-f50944a19b68 could not be found. Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e1f76f2-02e2-4308-9717-fbf0dffa4ee8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Request method failure captured: Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 HTTP/1.1 Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g0dZSFDozqD_5zES-tB3Ke28Qmdwk5VDW_586GFylOL4XrGTpmcq2uairsSToBmNwx-UT_cICIKnWoYWaSjP3aqKqiw-VfRSBSGm-7M3wyt6iD6fCmkNWRxTIRle8AsvDShZIgmix93hHzqoVRsDJ-Y4RkGa9r_h-GMTq5JhCm3djM Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: c33aaf3e6c6342528ceb7a615d2a7e36 Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1944301969 Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c33aaf3e6c6342528ceb7a615d2a7e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c33aaf3e6c6342528ceb7a615d2a7e36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c33aaf3e6c6342528ceb7a615d2a7e36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c33aaf3e6c6342528ceb7a615d2a7e36"}]}] Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-VolumesSnapshotTestJSON-1944301969 Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: c33aaf3e6c6342528ceb7a615d2a7e36 Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1944301969 Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-VolumesSnapshotTestJSON-1944301969-project Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 7ae9d1b42c2e4525a18d7a1886346e71 Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-VolumesSnapshotTestJSON-1944301969-project Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2eb994e6-a59c-4b9f-bd4a-f50944a19b68 could not be found. Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2eb994e6-a59c-4b9f-bd4a-f50944a19b68'} Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb994e6-a59c-4b9f-bd4a-f50944a19b68 could not be found. Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb994e6-a59c-4b9f-bd4a-f50944a19b68 could not be found. Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:17:36.307828 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:36.316073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:17:36.316073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:17:36.316073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:17:36.316073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:17:36.316073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:17:36.316073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb994e6-a59c-4b9f-bd4a-f50944a19b68 could not be found. Jul 28 04:17:36.316073 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:36.316073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e1f76f2-02e2-4308-9717-fbf0dffa4ee8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] Returning 404 to user: Instance 2eb994e6-a59c-4b9f-bd4a-f50944a19b68 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:17:36.316073 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0e1f76f2-02e2-4308-9717-fbf0dffa4ee8 tempest-VolumesSnapshotTestJSON-1944301969 tempest-VolumesSnapshotTestJSON-1944301969-project] 10.222.0.48 "GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68" status: 404 len: 111 microversion: 2.1 time: 0.033962 Jul 28 04:17:36.316073 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3726/6176] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:36 2022] GET /compute/v2.1/servers/2eb994e6-a59c-4b9f-bd4a-f50944a19b68 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:17:37.255492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2c531a2e-c5a0-4689-a800-8e365370dc06 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:37.256185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2c531a2e-c5a0-4689-a800-8e365370dc06 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:37.258627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:17:37.266036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c531a2e-c5a0-4689-a800-8e365370dc06 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:37.266819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c531a2e-c5a0-4689-a800-8e365370dc06 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:37.267297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c531a2e-c5a0-4689-a800-8e365370dc06 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:37.270094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c531a2e-c5a0-4689-a800-8e365370dc06 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:37.512215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2c531a2e-c5a0-4689-a800-8e365370dc06 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:37.521776 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2c531a2e-c5a0-4689-a800-8e365370dc06 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1391 microversion: 2.1 time: 0.270096 Jul 28 04:17:37.522530 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3727/6177] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:37 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1391 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:38.480796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0fe18f87-dd30-4180-9711-802cc10b7c48 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:38.483182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0fe18f87-dd30-4180-9711-802cc10b7c48 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:38.491407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fe18f87-dd30-4180-9711-802cc10b7c48 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:38.491864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fe18f87-dd30-4180-9711-802cc10b7c48 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:38.492696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fe18f87-dd30-4180-9711-802cc10b7c48 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:38.493143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0fe18f87-dd30-4180-9711-802cc10b7c48 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:38.527887 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0fe18f87-dd30-4180-9711-802cc10b7c48 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051408 Jul 28 04:17:38.535130 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3728/6178] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:17:38 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 04:17:38.715290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-45593f47-38a2-4d6f-854d-787c3bb1a9b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:38.716248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-45593f47-38a2-4d6f-854d-787c3bb1a9b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:38.724895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45593f47-38a2-4d6f-854d-787c3bb1a9b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:38.725688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45593f47-38a2-4d6f-854d-787c3bb1a9b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:38.726658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45593f47-38a2-4d6f-854d-787c3bb1a9b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:38.727305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45593f47-38a2-4d6f-854d-787c3bb1a9b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:38.882006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-45593f47-38a2-4d6f-854d-787c3bb1a9b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:38.891700 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-45593f47-38a2-4d6f-854d-787c3bb1a9b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1562 microversion: 2.1 time: 0.344827 Jul 28 04:17:38.892672 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3729/6179] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:38 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1562 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:38.897674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0026d6a1-9b26-4a78-b8cb-6601dd3fac7b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:38.898458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0026d6a1-9b26-4a78-b8cb-6601dd3fac7b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:38.910549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0026d6a1-9b26-4a78-b8cb-6601dd3fac7b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:38.913589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0026d6a1-9b26-4a78-b8cb-6601dd3fac7b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:38.914669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0026d6a1-9b26-4a78-b8cb-6601dd3fac7b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:38.915337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0026d6a1-9b26-4a78-b8cb-6601dd3fac7b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:38.947494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0026d6a1-9b26-4a78-b8cb-6601dd3fac7b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:17:39.043277 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0026d6a1-9b26-4a78-b8cb-6601dd3fac7b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 204 len: 0 microversion: 2.1 time: 0.149057 Jul 28 04:17:39.044032 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3730/6180] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:17:38 2022] DELETE /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:17:39.056923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed58d0ab-686a-41d3-b6e5-d193aa299478 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:39.058138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed58d0ab-686a-41d3-b6e5-d193aa299478 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:39.065820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed58d0ab-686a-41d3-b6e5-d193aa299478 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:39.066563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed58d0ab-686a-41d3-b6e5-d193aa299478 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:39.067365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed58d0ab-686a-41d3-b6e5-d193aa299478 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:39.067842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed58d0ab-686a-41d3-b6e5-d193aa299478 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:39.248147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed58d0ab-686a-41d3-b6e5-d193aa299478 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:39.257968 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed58d0ab-686a-41d3-b6e5-d193aa299478 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1562 microversion: 2.1 time: 0.212615 Jul 28 04:17:39.258943 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3731/6181] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:39 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1562 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:39.264071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb6e5692-93cc-4242-b77c-5bbeac7fd63b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:39.264789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb6e5692-93cc-4242-b77c-5bbeac7fd63b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:39.272477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb6e5692-93cc-4242-b77c-5bbeac7fd63b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:39.273338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb6e5692-93cc-4242-b77c-5bbeac7fd63b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:39.274365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb6e5692-93cc-4242-b77c-5bbeac7fd63b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:39.277752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb6e5692-93cc-4242-b77c-5bbeac7fd63b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:39.576107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb6e5692-93cc-4242-b77c-5bbeac7fd63b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:39.603114 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb6e5692-93cc-4242-b77c-5bbeac7fd63b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1674 microversion: 2.1 time: 0.327094 Jul 28 04:17:39.604320 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3732/6182] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:39 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1674 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:40.627326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb6ed6f2-2ae5-4771-b86c-f0465962e880 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:40.628837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb6ed6f2-2ae5-4771-b86c-f0465962e880 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:40.636324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb6ed6f2-2ae5-4771-b86c-f0465962e880 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:40.637133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb6ed6f2-2ae5-4771-b86c-f0465962e880 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:40.638222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb6ed6f2-2ae5-4771-b86c-f0465962e880 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:40.638876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb6ed6f2-2ae5-4771-b86c-f0465962e880 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:40.802269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb6ed6f2-2ae5-4771-b86c-f0465962e880 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:40.812384 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb6ed6f2-2ae5-4771-b86c-f0465962e880 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1674 microversion: 2.1 time: 0.187645 Jul 28 04:17:40.829391 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3733/6183] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:40 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1674 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:41.526111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ba6ff38-a21e-4860-b020-9847402fb445 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:41.526863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ba6ff38-a21e-4860-b020-9847402fb445 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:41.536925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ba6ff38-a21e-4860-b020-9847402fb445 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:41.537555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ba6ff38-a21e-4860-b020-9847402fb445 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:41.538455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ba6ff38-a21e-4860-b020-9847402fb445 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:41.539052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ba6ff38-a21e-4860-b020-9847402fb445 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:41.692616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ba6ff38-a21e-4860-b020-9847402fb445 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:41.703738 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ba6ff38-a21e-4860-b020-9847402fb445 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1562 microversion: 2.1 time: 0.182255 Jul 28 04:17:41.704912 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3734/6184] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:41 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1562 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:41.710096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1703d298-4c73-4b33-b174-af2dcb26b3fc req-dcbf1eb8-c1ed-460a-8157-dcb5cc4827af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd4963e-f6e3-499b-96d7-c86c44fed683", "tag": "e691a547-60c5-454e-a06e-44918e5be830"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:41.736814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1703d298-4c73-4b33-b174-af2dcb26b3fc req-dcbf1eb8-c1ed-460a-8157-dcb5cc4827af service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:41.737261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1703d298-4c73-4b33-b174-af2dcb26b3fc req-dcbf1eb8-c1ed-460a-8157-dcb5cc4827af service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:41.773441 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1703d298-4c73-4b33-b174-af2dcb26b3fc req-dcbf1eb8-c1ed-460a-8157-dcb5cc4827af service nova] Creating event network-changed:e691a547-60c5-454e-a06e-44918e5be830 for instance cdd4963e-f6e3-499b-96d7-c86c44fed683 on n-h2-826756-3 Jul 28 04:17:41.781199 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1703d298-4c73-4b33-b174-af2dcb26b3fc req-dcbf1eb8-c1ed-460a-8157-dcb5cc4827af service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074754 Jul 28 04:17:41.790348 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3735/6185] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:17:41.837003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c97743a2-a7af-460c-95f2-fadbd127b39e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:41.838038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c97743a2-a7af-460c-95f2-fadbd127b39e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:41.854261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c97743a2-a7af-460c-95f2-fadbd127b39e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:41.854989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c97743a2-a7af-460c-95f2-fadbd127b39e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:41.855964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c97743a2-a7af-460c-95f2-fadbd127b39e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:41.856616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c97743a2-a7af-460c-95f2-fadbd127b39e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:42.018194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c97743a2-a7af-460c-95f2-fadbd127b39e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:42.027124 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c97743a2-a7af-460c-95f2-fadbd127b39e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1674 microversion: 2.1 time: 0.194877 Jul 28 04:17:42.028056 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3736/6186] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:41 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1674 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:43.049887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e048aaf8-0d26-4b65-95b2-604852292701 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:43.050551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e048aaf8-0d26-4b65-95b2-604852292701 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:43.065174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e048aaf8-0d26-4b65-95b2-604852292701 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:43.066337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e048aaf8-0d26-4b65-95b2-604852292701 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:43.068837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e048aaf8-0d26-4b65-95b2-604852292701 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:43.069460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e048aaf8-0d26-4b65-95b2-604852292701 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:43.237364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e048aaf8-0d26-4b65-95b2-604852292701 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:43.254669 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e048aaf8-0d26-4b65-95b2-604852292701 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 200 len: 1607 microversion: 2.1 time: 0.207694 Jul 28 04:17:43.255283 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3737/6187] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:43 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 1607 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:43.816860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-27a136e9-38d8-4e46-9735-66ee6683afa5 req-de17d30f-a50b-42cc-bff8-8773a83eb906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f60937-da1d-4d73-896f-2330f115f960", "name": "network-vif-deleted", "tag": "1a52fdfb-14c8-4d92-9b08-f6984c4d52b4"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:43.840507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-27a136e9-38d8-4e46-9735-66ee6683afa5 req-de17d30f-a50b-42cc-bff8-8773a83eb906 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:43.841795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-27a136e9-38d8-4e46-9735-66ee6683afa5 req-de17d30f-a50b-42cc-bff8-8773a83eb906 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:43.861801 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-27a136e9-38d8-4e46-9735-66ee6683afa5 req-de17d30f-a50b-42cc-bff8-8773a83eb906 service nova] Creating event network-vif-deleted:1a52fdfb-14c8-4d92-9b08-f6984c4d52b4 for instance d6f60937-da1d-4d73-896f-2330f115f960 on n-h2-826756-3 Jul 28 04:17:43.873314 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-27a136e9-38d8-4e46-9735-66ee6683afa5 req-de17d30f-a50b-42cc-bff8-8773a83eb906 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058250 Jul 28 04:17:43.873314 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3738/6188] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:17:44.283344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93ede32f-7ade-4a12-8f79-bba1e9189121 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:44.284060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93ede32f-7ade-4a12-8f79-bba1e9189121 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:44.291674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93ede32f-7ade-4a12-8f79-bba1e9189121 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:44.292190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93ede32f-7ade-4a12-8f79-bba1e9189121 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:44.293035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93ede32f-7ade-4a12-8f79-bba1e9189121 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:44.293479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93ede32f-7ade-4a12-8f79-bba1e9189121 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:44.317395 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-93ede32f-7ade-4a12-8f79-bba1e9189121 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] HTTP exception thrown: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93ede32f-7ade-4a12-8f79-bba1e9189121 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Request method failure captured: Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 HTTP/1.1 Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g0kMg1K5hpfmz-a8IUXOMReG1BbZUaF6pS6IFOkFvM5fRULTePEgqJ3w_e1yaxolCkL3isqF02IAM5llz2Az6h2MkC4wlTnG9AGAYRDfzYXkhSw3F08T6_rQW5VzFu6NkHXp1f8cet85WP0nkJwP8qo1tZj2R3H8bg5YeF0ONBw-4w Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 55b218635b214337bf26fb6aec7303d1 Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/55b218635b214337bf26fb6aec7303d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/55b218635b214337bf26fb6aec7303d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_55b218635b214337bf26fb6aec7303d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/55b218635b214337bf26fb6aec7303d1"}]}] Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 55b218635b214337bf26fb6aec7303d1 Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeTestJSON-223307208-project Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 60995164494047448eaccf6c93997d69 Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeTestJSON-223307208-project Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd6f60937-da1d-4d73-896f-2330f115f960'} Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:17:44.323986 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:44.328619 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:17:44.328619 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:17:44.328619 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:17:44.328619 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:17:44.328619 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:17:44.328619 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:17:44.328619 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:17:44.330360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93ede32f-7ade-4a12-8f79-bba1e9189121 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Returning 404 to user: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:17:44.331553 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93ede32f-7ade-4a12-8f79-bba1e9189121 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 404 len: 111 microversion: 2.1 time: 0.052994 Jul 28 04:17:44.332869 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3739/6189] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:44 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:17:44.342472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d69175c-83d6-49d7-b91c-db4a2289d878 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '.version_select at 0x7ffa67af1550>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:44.401904 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d69175c-83d6-49d7-b91c-db4a2289d878 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883564665" status: 202 len: 0 microversion: 2.1 time: 0.064219 Jul 28 04:17:44.403260 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3740/6190] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 04:17:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883564665 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:17:45.360242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c321128-f507-467b-8ad5-7fdd23a7ec33 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Action: 'create', calling method: .version_select at 0x7ffa740aa790>, body: {"keypair": {"name": "tempest-keypair-1822977653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWT4VCIFUxcIGr7Yk/8z28NEnyPoYc//MxN7BrXJLIxmTtSg4JJkrYeOn9uDFyvXStkXKzBUldzK6Z8f9cO/9Sj2n/MHxYvLFpYpxY+47DRGHnAB/mraSnEIhCzIlkuUg=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:45.380883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-9c321128-f507-467b-8ad5-7fdd23a7ec33 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Getting quotas for project 55b218635b214337bf26fb6aec7303d1. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:17:45.388610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-9c321128-f507-467b-8ad5-7fdd23a7ec33 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Getting quotas for user 60995164494047448eaccf6c93997d69 and project 55b218635b214337bf26fb6aec7303d1. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:17:45.429049 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c321128-f507-467b-8ad5-7fdd23a7ec33 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078783 Jul 28 04:17:45.432523 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3741/6191] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:17:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:17:47.228999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2017521603", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23fcc26a-4916-49f3-b9c9-8b34fb69bd78"}], "security_groups": [{"name": "tempest-securitygroup--8844825"}], "key_name": "tempest-keypair-1822977653", "user_data": "}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:47.356751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] validate_networks() for [('23fcc26a-4916-49f3-b9c9-8b34fb69bd78', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:17:48.145271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:17:48.146045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:17:48.146652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:17:48.147192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:17:48.147762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:17:48.158574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:48.159215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:48.160307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:48.161080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:48.196651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Getting quotas for project 55b218635b214337bf26fb6aec7303d1. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:17:48.219250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Getting quotas for user 60995164494047448eaccf6c93997d69 and project 55b218635b214337bf26fb6aec7303d1. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:17:48.255746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:17:48.258759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:17:48.312463 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-de2f363e-8202-4c9a-b565-cb959711167f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.089260 Jul 28 04:17:48.313686 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3742/6192] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:17:47 2022] POST /compute/v2.1/servers => generated 399 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:17:48.326837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43ba8e84-8333-42bb-8dba-b723e01518ab tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:48.327834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-43ba8e84-8333-42bb-8dba-b723e01518ab tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:48.426319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-43ba8e84-8333-42bb-8dba-b723e01518ab tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:48.452206 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43ba8e84-8333-42bb-8dba-b723e01518ab tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 200 len: 1238 microversion: 2.1 time: 0.131623 Jul 28 04:17:48.464544 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3743/6193] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:48 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 1238 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:49.502031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c570f115-93fd-4027-8bda-ffe8c8a28e52 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:49.510777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c570f115-93fd-4027-8bda-ffe8c8a28e52 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:49.514249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:17:49.522768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c570f115-93fd-4027-8bda-ffe8c8a28e52 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:49.523509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c570f115-93fd-4027-8bda-ffe8c8a28e52 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:49.524622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c570f115-93fd-4027-8bda-ffe8c8a28e52 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:49.525309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c570f115-93fd-4027-8bda-ffe8c8a28e52 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:49.637502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c570f115-93fd-4027-8bda-ffe8c8a28e52 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:49.649623 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c570f115-93fd-4027-8bda-ffe8c8a28e52 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 200 len: 1298 microversion: 2.1 time: 0.151424 Jul 28 04:17:49.651163 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3744/6194] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:49 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 1298 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:50.672531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b8547839-1f32-4076-9735-6c407ca2e1ce tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:50.674867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b8547839-1f32-4076-9735-6c407ca2e1ce tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:50.683443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8547839-1f32-4076-9735-6c407ca2e1ce tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:50.684111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8547839-1f32-4076-9735-6c407ca2e1ce tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:50.685273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8547839-1f32-4076-9735-6c407ca2e1ce tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:50.685881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8547839-1f32-4076-9735-6c407ca2e1ce tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:50.886616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8547839-1f32-4076-9735-6c407ca2e1ce tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:50.898245 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b8547839-1f32-4076-9735-6c407ca2e1ce tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 200 len: 1361 microversion: 2.1 time: 0.230767 Jul 28 04:17:50.899485 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3745/6195] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:50 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:51.196750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-ff4e20dc-a6d2-4330-bf5d-2b939ed1e375 req-7d6c1934-fd6b-4f89-9f96-f4362acebd8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4189aed4-6191-4909-900d-85a86bf44937", "tag": "b0b434e1-a32e-4421-bd80-16b30d54f1ed"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:51.224931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ff4e20dc-a6d2-4330-bf5d-2b939ed1e375 req-7d6c1934-fd6b-4f89-9f96-f4362acebd8a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:51.229060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ff4e20dc-a6d2-4330-bf5d-2b939ed1e375 req-7d6c1934-fd6b-4f89-9f96-f4362acebd8a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:51.248537 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-ff4e20dc-a6d2-4330-bf5d-2b939ed1e375 req-7d6c1934-fd6b-4f89-9f96-f4362acebd8a service nova] Creating event network-changed:b0b434e1-a32e-4421-bd80-16b30d54f1ed for instance 4189aed4-6191-4909-900d-85a86bf44937 on n-h1-826756-3 Jul 28 04:17:51.259243 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-ff4e20dc-a6d2-4330-bf5d-2b939ed1e375 req-7d6c1934-fd6b-4f89-9f96-f4362acebd8a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066718 Jul 28 04:17:51.260895 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3746/6196] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:17:51.926303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7411d7a2-8c55-4d75-8b91-06f56047e7c9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:51.927029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7411d7a2-8c55-4d75-8b91-06f56047e7c9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:51.934363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7411d7a2-8c55-4d75-8b91-06f56047e7c9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:51.934793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7411d7a2-8c55-4d75-8b91-06f56047e7c9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:51.935813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7411d7a2-8c55-4d75-8b91-06f56047e7c9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:51.936271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7411d7a2-8c55-4d75-8b91-06f56047e7c9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:52.089763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7411d7a2-8c55-4d75-8b91-06f56047e7c9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:52.093626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:17:52.105437 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7411d7a2-8c55-4d75-8b91-06f56047e7c9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 200 len: 1361 microversion: 2.1 time: 0.185078 Jul 28 04:17:52.106784 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3747/6197] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:51 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:53.127200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bd9ded3c-f773-4d92-86e6-e170575b6603 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:53.127849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bd9ded3c-f773-4d92-86e6-e170575b6603 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:53.136291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd9ded3c-f773-4d92-86e6-e170575b6603 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:53.136787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd9ded3c-f773-4d92-86e6-e170575b6603 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:53.137617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd9ded3c-f773-4d92-86e6-e170575b6603 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:53.138188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd9ded3c-f773-4d92-86e6-e170575b6603 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:53.285229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bd9ded3c-f773-4d92-86e6-e170575b6603 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:53.294187 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bd9ded3c-f773-4d92-86e6-e170575b6603 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 200 len: 1361 microversion: 2.1 time: 0.171144 Jul 28 04:17:53.295014 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3748/6198] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:53 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:54.315559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b78ab606-dbca-4b84-b7d9-38ea207ec03a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:54.316504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b78ab606-dbca-4b84-b7d9-38ea207ec03a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:54.324333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b78ab606-dbca-4b84-b7d9-38ea207ec03a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:54.324909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b78ab606-dbca-4b84-b7d9-38ea207ec03a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:54.325827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b78ab606-dbca-4b84-b7d9-38ea207ec03a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:54.326337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b78ab606-dbca-4b84-b7d9-38ea207ec03a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:54.497804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b78ab606-dbca-4b84-b7d9-38ea207ec03a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:54.507322 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b78ab606-dbca-4b84-b7d9-38ea207ec03a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 200 len: 1361 microversion: 2.1 time: 0.195734 Jul 28 04:17:54.508603 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3749/6199] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:54 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:55.531089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc53cc82-b3da-4c47-a844-9d2a6f552610 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:55.532063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dc53cc82-b3da-4c47-a844-9d2a6f552610 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:55.542003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc53cc82-b3da-4c47-a844-9d2a6f552610 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:55.542658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc53cc82-b3da-4c47-a844-9d2a6f552610 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:55.543413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc53cc82-b3da-4c47-a844-9d2a6f552610 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:55.543843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc53cc82-b3da-4c47-a844-9d2a6f552610 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:55.702509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dc53cc82-b3da-4c47-a844-9d2a6f552610 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:55.711043 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc53cc82-b3da-4c47-a844-9d2a6f552610 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 200 len: 1361 microversion: 2.1 time: 0.184516 Jul 28 04:17:55.711601 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3750/6200] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:55 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:56.281886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-5dea037f-b6a3-4ac2-b614-0f2079e0b987 req-923c702e-b7b5-4deb-a788-70d74d379e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4189aed4-6191-4909-900d-85a86bf44937", "name": "network-vif-plugged", "status": "completed", "tag": "b0b434e1-a32e-4421-bd80-16b30d54f1ed"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:56.300442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5dea037f-b6a3-4ac2-b614-0f2079e0b987 req-923c702e-b7b5-4deb-a788-70d74d379e1e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:56.301337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5dea037f-b6a3-4ac2-b614-0f2079e0b987 req-923c702e-b7b5-4deb-a788-70d74d379e1e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:56.313784 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5dea037f-b6a3-4ac2-b614-0f2079e0b987 req-923c702e-b7b5-4deb-a788-70d74d379e1e service nova] Creating event network-vif-plugged:b0b434e1-a32e-4421-bd80-16b30d54f1ed for instance 4189aed4-6191-4909-900d-85a86bf44937 on n-h1-826756-3 Jul 28 04:17:56.319133 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-5dea037f-b6a3-4ac2-b614-0f2079e0b987 req-923c702e-b7b5-4deb-a788-70d74d379e1e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131968 Jul 28 04:17:56.320036 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3751/6201] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:17:56.734623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-73efb337-b1a8-48a6-b811-40e76c3ffc0a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:56.735293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-73efb337-b1a8-48a6-b811-40e76c3ffc0a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:56.742518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73efb337-b1a8-48a6-b811-40e76c3ffc0a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:56.743381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73efb337-b1a8-48a6-b811-40e76c3ffc0a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:56.743799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73efb337-b1a8-48a6-b811-40e76c3ffc0a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:56.744224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73efb337-b1a8-48a6-b811-40e76c3ffc0a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:56.893594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-73efb337-b1a8-48a6-b811-40e76c3ffc0a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:56.902171 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-73efb337-b1a8-48a6-b811-40e76c3ffc0a tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 200 len: 1361 microversion: 2.1 time: 0.172992 Jul 28 04:17:56.902958 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3752/6202] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:56 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:17:57.928672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-791603e0-36c6-42e9-bbf8-dd7af72114b2 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:57.929455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-791603e0-36c6-42e9-bbf8-dd7af72114b2 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:57.937145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-791603e0-36c6-42e9-bbf8-dd7af72114b2 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:57.937750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-791603e0-36c6-42e9-bbf8-dd7af72114b2 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:57.938638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-791603e0-36c6-42e9-bbf8-dd7af72114b2 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:57.939169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-791603e0-36c6-42e9-bbf8-dd7af72114b2 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:58.094674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-791603e0-36c6-42e9-bbf8-dd7af72114b2 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:17:58.103577 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-791603e0-36c6-42e9-bbf8-dd7af72114b2 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 200 len: 1547 microversion: 2.1 time: 0.179010 Jul 28 04:17:58.108436 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3753/6203] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:17:57 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 1547 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:17:58.136498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0b183bda-5ad0-4d32-9081-c54181a9d72c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:17:58.137011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0b183bda-5ad0-4d32-9081-c54181a9d72c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:17:58.144136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b183bda-5ad0-4d32-9081-c54181a9d72c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:58.145107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b183bda-5ad0-4d32-9081-c54181a9d72c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:58.145900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b183bda-5ad0-4d32-9081-c54181a9d72c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:58.146398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b183bda-5ad0-4d32-9081-c54181a9d72c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:58.177031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:17:58.235589 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0b183bda-5ad0-4d32-9081-c54181a9d72c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105788 Jul 28 04:17:58.236891 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3754/6204] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 04:17:58 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:17:59.347802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:17:59.353379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-bcace5b7-ffea-4323-9841-a0a5cfa2465f req-0153c70d-ff7d-45b1-b3af-d3b9662f5546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4189aed4-6191-4909-900d-85a86bf44937", "tag": "b0b434e1-a32e-4421-bd80-16b30d54f1ed"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:17:59.364645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bcace5b7-ffea-4323-9841-a0a5cfa2465f req-0153c70d-ff7d-45b1-b3af-d3b9662f5546 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:17:59.365371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bcace5b7-ffea-4323-9841-a0a5cfa2465f req-0153c70d-ff7d-45b1-b3af-d3b9662f5546 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:17:59.381976 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-bcace5b7-ffea-4323-9841-a0a5cfa2465f req-0153c70d-ff7d-45b1-b3af-d3b9662f5546 service nova] Creating event network-changed:b0b434e1-a32e-4421-bd80-16b30d54f1ed for instance 4189aed4-6191-4909-900d-85a86bf44937 on n-h1-826756-3 Jul 28 04:17:59.387918 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-bcace5b7-ffea-4323-9841-a0a5cfa2465f req-0153c70d-ff7d-45b1-b3af-d3b9662f5546 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040654 Jul 28 04:17:59.393036 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3755/6205] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:18:06.186102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-83557665-8b29-4381-bc86-8c6fc909fca2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:06.188761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-83557665-8b29-4381-bc86-8c6fc909fca2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:06.197119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83557665-8b29-4381-bc86-8c6fc909fca2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:06.197870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83557665-8b29-4381-bc86-8c6fc909fca2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:06.198814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83557665-8b29-4381-bc86-8c6fc909fca2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:06.199323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-83557665-8b29-4381-bc86-8c6fc909fca2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:06.273414 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-83557665-8b29-4381-bc86-8c6fc909fca2 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683/action" status: 200 len: 24567 microversion: 2.1 time: 0.092059 Jul 28 04:18:06.280987 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3756/6206] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:18:06 2022] POST /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683/action => generated 24567 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:18:17.362290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90138e83-b44c-4581-962f-b5e466698f47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:17.362995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-90138e83-b44c-4581-962f-b5e466698f47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:17.365747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=25 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:18:17.366625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=42 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:18:17.372709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90138e83-b44c-4581-962f-b5e466698f47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:17.373433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90138e83-b44c-4581-962f-b5e466698f47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:17.374222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90138e83-b44c-4581-962f-b5e466698f47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:17.374664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90138e83-b44c-4581-962f-b5e466698f47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:17.537102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-90138e83-b44c-4581-962f-b5e466698f47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:17.546461 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90138e83-b44c-4581-962f-b5e466698f47 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1681 microversion: 2.1 time: 0.188598 Jul 28 04:18:17.549264 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3757/6207] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:17 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:18:17.656083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0b791928-442f-4a4a-bfbf-f3e510e4713e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:17.659000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0b791928-442f-4a4a-bfbf-f3e510e4713e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:17.667007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b791928-442f-4a4a-bfbf-f3e510e4713e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:17.667795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b791928-442f-4a4a-bfbf-f3e510e4713e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:17.668812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b791928-442f-4a4a-bfbf-f3e510e4713e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:17.669409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b791928-442f-4a4a-bfbf-f3e510e4713e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:17.752150 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0b791928-442f-4a4a-bfbf-f3e510e4713e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683/action" status: 200 len: 32644 microversion: 2.1 time: 0.100107 Jul 28 04:18:17.760546 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3758/6208] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:18:17 2022] POST /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683/action => generated 32644 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:18:18.109566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5a8af9f7-49f9-4b7f-b9e7-12d16b44074a tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:18.110598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5a8af9f7-49f9-4b7f-b9e7-12d16b44074a tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:18.124074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a8af9f7-49f9-4b7f-b9e7-12d16b44074a tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:18.124846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a8af9f7-49f9-4b7f-b9e7-12d16b44074a tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:18.125897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a8af9f7-49f9-4b7f-b9e7-12d16b44074a tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:18.126805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5a8af9f7-49f9-4b7f-b9e7-12d16b44074a tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:18.313500 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5a8af9f7-49f9-4b7f-b9e7-12d16b44074a tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1832 microversion: 2.1 time: 0.397748 Jul 28 04:18:18.314741 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3759/6209] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:17 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1832 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:18:18.346443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c3d46c59-a6c4-4eb7-814a-b886bc1fa2eb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:18.349308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c3d46c59-a6c4-4eb7-814a-b886bc1fa2eb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:18.364088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3d46c59-a6c4-4eb7-814a-b886bc1fa2eb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:18.365019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3d46c59-a6c4-4eb7-814a-b886bc1fa2eb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:18.366333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3d46c59-a6c4-4eb7-814a-b886bc1fa2eb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:18.367078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3d46c59-a6c4-4eb7-814a-b886bc1fa2eb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:18.414408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-c3d46c59-a6c4-4eb7-814a-b886bc1fa2eb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lazy-loading 'flavor' on Instance uuid cdd4963e-f6e3-499b-96d7-c86c44fed683 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:18:18.430713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c3d46c59-a6c4-4eb7-814a-b886bc1fa2eb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Going to try to live migrate instance to another host {{(pid=126071) live_migrate /opt/stack/nova/nova/compute/api.py:5474}} Jul 28 04:18:20.035118 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c3d46c59-a6c4-4eb7-814a-b886bc1fa2eb tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683/action" status: 202 len: 0 microversion: 2.1 time: 1.693912 Jul 28 04:18:20.035801 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3760/6210] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:18:18 2022] POST /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683/action => generated 0 bytes in 1696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:18:20.046071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4ca61df1-137d-4eb3-9dbb-6fb82657cb7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:20.046912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4ca61df1-137d-4eb3-9dbb-6fb82657cb7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:20.060035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ca61df1-137d-4eb3-9dbb-6fb82657cb7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:20.061036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ca61df1-137d-4eb3-9dbb-6fb82657cb7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:20.062737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ca61df1-137d-4eb3-9dbb-6fb82657cb7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:20.063507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ca61df1-137d-4eb3-9dbb-6fb82657cb7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:20.255099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4ca61df1-137d-4eb3-9dbb-6fb82657cb7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:20.264897 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4ca61df1-137d-4eb3-9dbb-6fb82657cb7f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1691 microversion: 2.1 time: 0.223512 Jul 28 04:18:20.266006 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3761/6211] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:20 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1691 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:18:21.290685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-48645e49-7449-4668-a18e-b01f130e05da tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:21.293169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-48645e49-7449-4668-a18e-b01f130e05da tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:21.303390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48645e49-7449-4668-a18e-b01f130e05da tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:21.304221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48645e49-7449-4668-a18e-b01f130e05da tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:21.305548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48645e49-7449-4668-a18e-b01f130e05da tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:21.306817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48645e49-7449-4668-a18e-b01f130e05da tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:21.529963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-48645e49-7449-4668-a18e-b01f130e05da tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:21.541275 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-48645e49-7449-4668-a18e-b01f130e05da tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1691 microversion: 2.1 time: 0.255267 Jul 28 04:18:21.542693 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3762/6212] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:21 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1691 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:18:21.893306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-687288ba-b23f-4dd8-aacc-e91aff3435c7 req-3d9b7986-b360-4346-89b0-d685a392c5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd4963e-f6e3-499b-96d7-c86c44fed683", "name": "network-vif-unplugged", "status": "completed", "tag": "e691a547-60c5-454e-a06e-44918e5be830"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:21.909059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-687288ba-b23f-4dd8-aacc-e91aff3435c7 req-3d9b7986-b360-4346-89b0-d685a392c5b1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:21.909773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-687288ba-b23f-4dd8-aacc-e91aff3435c7 req-3d9b7986-b360-4346-89b0-d685a392c5b1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:21.943528 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-687288ba-b23f-4dd8-aacc-e91aff3435c7 req-3d9b7986-b360-4346-89b0-d685a392c5b1 service nova] Creating event network-vif-unplugged:e691a547-60c5-454e-a06e-44918e5be830 for instance cdd4963e-f6e3-499b-96d7-c86c44fed683 on n-h2-826756-3 Jul 28 04:18:21.956223 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-687288ba-b23f-4dd8-aacc-e91aff3435c7 req-3d9b7986-b360-4346-89b0-d685a392c5b1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066637 Jul 28 04:18:21.958981 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3763/6213] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:18:22.573608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3316c5bf-34e1-4abb-b9fc-d20ad3238d39 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:22.574710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3316c5bf-34e1-4abb-b9fc-d20ad3238d39 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:22.591955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3316c5bf-34e1-4abb-b9fc-d20ad3238d39 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:22.592529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3316c5bf-34e1-4abb-b9fc-d20ad3238d39 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:22.593884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3316c5bf-34e1-4abb-b9fc-d20ad3238d39 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:22.594561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3316c5bf-34e1-4abb-b9fc-d20ad3238d39 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:22.822712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3316c5bf-34e1-4abb-b9fc-d20ad3238d39 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:22.832966 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3316c5bf-34e1-4abb-b9fc-d20ad3238d39 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1691 microversion: 2.1 time: 0.273207 Jul 28 04:18:22.834288 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3764/6214] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:22 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1691 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:18:23.855516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63892a4e-ba5c-4c74-a1e4-537810f41427 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:23.856142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63892a4e-ba5c-4c74-a1e4-537810f41427 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:23.864154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63892a4e-ba5c-4c74-a1e4-537810f41427 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:23.864605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63892a4e-ba5c-4c74-a1e4-537810f41427 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:23.865549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63892a4e-ba5c-4c74-a1e4-537810f41427 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:23.865992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63892a4e-ba5c-4c74-a1e4-537810f41427 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:24.011268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63892a4e-ba5c-4c74-a1e4-537810f41427 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:24.019566 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63892a4e-ba5c-4c74-a1e4-537810f41427 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1691 microversion: 2.1 time: 0.168316 Jul 28 04:18:24.020227 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3765/6215] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:23 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:18:24.025098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-17b1bf28-f025-4ec1-907d-a8d48b51f2e0 req-a15c6062-d2d1-4708-a3a8-053e6b2da461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd4963e-f6e3-499b-96d7-c86c44fed683", "tag": "e691a547-60c5-454e-a06e-44918e5be830"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:24.034739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-17b1bf28-f025-4ec1-907d-a8d48b51f2e0 req-a15c6062-d2d1-4708-a3a8-053e6b2da461 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:24.035447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-17b1bf28-f025-4ec1-907d-a8d48b51f2e0 req-a15c6062-d2d1-4708-a3a8-053e6b2da461 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:24.048657 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-17b1bf28-f025-4ec1-907d-a8d48b51f2e0 req-a15c6062-d2d1-4708-a3a8-053e6b2da461 service nova] Creating event network-changed:e691a547-60c5-454e-a06e-44918e5be830 for instance cdd4963e-f6e3-499b-96d7-c86c44fed683 on n-h2-826756-3 Jul 28 04:18:24.054057 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-17b1bf28-f025-4ec1-907d-a8d48b51f2e0 req-a15c6062-d2d1-4708-a3a8-053e6b2da461 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032262 Jul 28 04:18:24.058177 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3766/6216] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:18:25.044243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c557fb3d-c54a-4a4b-9806-a9bcac75ffcd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:25.045163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c557fb3d-c54a-4a4b-9806-a9bcac75ffcd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:25.055263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c557fb3d-c54a-4a4b-9806-a9bcac75ffcd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:25.055855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c557fb3d-c54a-4a4b-9806-a9bcac75ffcd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:25.056781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c557fb3d-c54a-4a4b-9806-a9bcac75ffcd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:25.057467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c557fb3d-c54a-4a4b-9806-a9bcac75ffcd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:25.253140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c557fb3d-c54a-4a4b-9806-a9bcac75ffcd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:25.262526 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c557fb3d-c54a-4a4b-9806-a9bcac75ffcd tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1691 microversion: 2.1 time: 0.223730 Jul 28 04:18:25.263467 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3767/6217] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:25 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1691 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:18:25.741384 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:18:25.742839 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:18:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:18:26.290442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3358ed4a-3b41-4b72-b188-107ea018090b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:26.292214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3358ed4a-3b41-4b72-b188-107ea018090b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:26.300196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3358ed4a-3b41-4b72-b188-107ea018090b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:26.300995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3358ed4a-3b41-4b72-b188-107ea018090b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:26.302155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3358ed4a-3b41-4b72-b188-107ea018090b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:26.302642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3358ed4a-3b41-4b72-b188-107ea018090b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:26.477148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3358ed4a-3b41-4b72-b188-107ea018090b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:26.489579 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3358ed4a-3b41-4b72-b188-107ea018090b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1691 microversion: 2.1 time: 0.203198 Jul 28 04:18:26.490761 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3768/6218] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:26 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1691 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:18:27.512808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f61a5a6b-4490-41b2-8ce0-30b1324e26a1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:27.514135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f61a5a6b-4490-41b2-8ce0-30b1324e26a1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:27.522443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f61a5a6b-4490-41b2-8ce0-30b1324e26a1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:27.523162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f61a5a6b-4490-41b2-8ce0-30b1324e26a1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:27.524124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f61a5a6b-4490-41b2-8ce0-30b1324e26a1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:27.524746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f61a5a6b-4490-41b2-8ce0-30b1324e26a1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:27.705165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f61a5a6b-4490-41b2-8ce0-30b1324e26a1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:27.716299 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f61a5a6b-4490-41b2-8ce0-30b1324e26a1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1691 microversion: 2.1 time: 0.208263 Jul 28 04:18:27.720415 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3769/6219] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:27 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1691 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:18:28.232693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-756c9105-45f2-4071-b410-63fbb6eece3c req-2bfeaf87-07c1-4ac0-b877-2487e5bc7797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd4963e-f6e3-499b-96d7-c86c44fed683", "name": "network-vif-unplugged", "status": "completed", "tag": "e691a547-60c5-454e-a06e-44918e5be830"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:28.243124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-756c9105-45f2-4071-b410-63fbb6eece3c req-2bfeaf87-07c1-4ac0-b877-2487e5bc7797 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:28.243727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-756c9105-45f2-4071-b410-63fbb6eece3c req-2bfeaf87-07c1-4ac0-b877-2487e5bc7797 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:28.255895 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-756c9105-45f2-4071-b410-63fbb6eece3c req-2bfeaf87-07c1-4ac0-b877-2487e5bc7797 service nova] Creating event network-vif-unplugged:e691a547-60c5-454e-a06e-44918e5be830 for instance cdd4963e-f6e3-499b-96d7-c86c44fed683 on n-h2-826756-3 Jul 28 04:18:28.261758 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-756c9105-45f2-4071-b410-63fbb6eece3c req-2bfeaf87-07c1-4ac0-b877-2487e5bc7797 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032871 Jul 28 04:18:28.262635 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3770/6220] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:18:28.743299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-75c707f1-d9ea-498d-9575-a5b805a53125 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:28.744344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-75c707f1-d9ea-498d-9575-a5b805a53125 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:28.756239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75c707f1-d9ea-498d-9575-a5b805a53125 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:28.756758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75c707f1-d9ea-498d-9575-a5b805a53125 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:28.757561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75c707f1-d9ea-498d-9575-a5b805a53125 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:28.757995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75c707f1-d9ea-498d-9575-a5b805a53125 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:28.979240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-75c707f1-d9ea-498d-9575-a5b805a53125 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:28.988729 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-75c707f1-d9ea-498d-9575-a5b805a53125 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1691 microversion: 2.1 time: 0.252568 Jul 28 04:18:28.989793 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3771/6221] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:28 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1691 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:18:30.010267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f393769b-7f7f-42cd-bf9d-2f68b0352e10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:30.011848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f393769b-7f7f-42cd-bf9d-2f68b0352e10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:30.019495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f393769b-7f7f-42cd-bf9d-2f68b0352e10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:30.020233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f393769b-7f7f-42cd-bf9d-2f68b0352e10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:30.021582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f393769b-7f7f-42cd-bf9d-2f68b0352e10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:30.022215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f393769b-7f7f-42cd-bf9d-2f68b0352e10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:30.214552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f393769b-7f7f-42cd-bf9d-2f68b0352e10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:30.223693 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f393769b-7f7f-42cd-bf9d-2f68b0352e10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1681 microversion: 2.1 time: 0.217576 Jul 28 04:18:30.224298 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3772/6222] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:30 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1681 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:18:30.246549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-78f34b4f-df99-4384-b810-3e46e45b96b6 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:30.247227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-78f34b4f-df99-4384-b810-3e46e45b96b6 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:30.254240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78f34b4f-df99-4384-b810-3e46e45b96b6 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:30.255324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78f34b4f-df99-4384-b810-3e46e45b96b6 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:30.255824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78f34b4f-df99-4384-b810-3e46e45b96b6 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:30.256181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78f34b4f-df99-4384-b810-3e46e45b96b6 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:30.444163 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-78f34b4f-df99-4384-b810-3e46e45b96b6 tempest-TestNetworkAdvancedServerOps-1387873517 tempest-TestNetworkAdvancedServerOps-1387873517-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1832 microversion: 2.1 time: 0.201729 Jul 28 04:18:30.459192 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3773/6223] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:30 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1832 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:18:30.467492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-82f4cb50-7b5a-41e1-9517-f4e5298e7a34 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:30.468109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-82f4cb50-7b5a-41e1-9517-f4e5298e7a34 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:30.475038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82f4cb50-7b5a-41e1-9517-f4e5298e7a34 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:30.475541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82f4cb50-7b5a-41e1-9517-f4e5298e7a34 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:30.476585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82f4cb50-7b5a-41e1-9517-f4e5298e7a34 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:30.477196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82f4cb50-7b5a-41e1-9517-f4e5298e7a34 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:30.482821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:18:30.651142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82f4cb50-7b5a-41e1-9517-f4e5298e7a34 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:30.661409 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-82f4cb50-7b5a-41e1-9517-f4e5298e7a34 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1681 microversion: 2.1 time: 0.198190 Jul 28 04:18:30.662298 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3774/6224] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:30 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:18:30.792707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c3deb04d-0f7d-4f5a-833b-db701e271420 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:30.794775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c3deb04d-0f7d-4f5a-833b-db701e271420 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:30.802035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3deb04d-0f7d-4f5a-833b-db701e271420 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:30.802483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3deb04d-0f7d-4f5a-833b-db701e271420 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:30.803263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3deb04d-0f7d-4f5a-833b-db701e271420 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:30.803731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3deb04d-0f7d-4f5a-833b-db701e271420 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:30.867065 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c3deb04d-0f7d-4f5a-833b-db701e271420 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683/action" status: 200 len: 38640 microversion: 2.1 time: 0.081640 Jul 28 04:18:30.868001 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3775/6225] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:18:30 2022] POST /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683/action => generated 38640 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:18:33.146785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2e9b8dba-8807-414e-b8f7-3d0b326f382b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:33.146785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2e9b8dba-8807-414e-b8f7-3d0b326f382b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:33.163118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e9b8dba-8807-414e-b8f7-3d0b326f382b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:33.163565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e9b8dba-8807-414e-b8f7-3d0b326f382b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:33.164378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e9b8dba-8807-414e-b8f7-3d0b326f382b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:33.164813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e9b8dba-8807-414e-b8f7-3d0b326f382b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:33.227539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2e9b8dba-8807-414e-b8f7-3d0b326f382b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:18:33.445596 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2e9b8dba-8807-414e-b8f7-3d0b326f382b tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 204 len: 0 microversion: 2.1 time: 0.305117 Jul 28 04:18:33.448775 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3776/6226] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:18:33 2022] DELETE /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:18:33.760218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-2895f58c-0ebe-40a3-a62a-7bb502803563 req-e9806cce-6317-4d98-911d-7a1b76521f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd4963e-f6e3-499b-96d7-c86c44fed683", "tag": "e691a547-60c5-454e-a06e-44918e5be830"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:33.781504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2895f58c-0ebe-40a3-a62a-7bb502803563 req-e9806cce-6317-4d98-911d-7a1b76521f63 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:33.781950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2895f58c-0ebe-40a3-a62a-7bb502803563 req-e9806cce-6317-4d98-911d-7a1b76521f63 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:33.806381 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-2895f58c-0ebe-40a3-a62a-7bb502803563 req-e9806cce-6317-4d98-911d-7a1b76521f63 service nova] Creating event network-changed:e691a547-60c5-454e-a06e-44918e5be830 for instance cdd4963e-f6e3-499b-96d7-c86c44fed683 on n-h1-826756-3 Jul 28 04:18:33.814771 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-2895f58c-0ebe-40a3-a62a-7bb502803563 req-e9806cce-6317-4d98-911d-7a1b76521f63 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.364530 Jul 28 04:18:33.816681 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3777/6227] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:18:33.824476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f0aaf258-d392-4718-a509-59a428e5df52 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:33.825189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f0aaf258-d392-4718-a509-59a428e5df52 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:33.835917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0aaf258-d392-4718-a509-59a428e5df52 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:33.839181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0aaf258-d392-4718-a509-59a428e5df52 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:33.839181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0aaf258-d392-4718-a509-59a428e5df52 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:33.839181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0aaf258-d392-4718-a509-59a428e5df52 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:34.200242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f0aaf258-d392-4718-a509-59a428e5df52 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:34.215547 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f0aaf258-d392-4718-a509-59a428e5df52 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1687 microversion: 2.1 time: 0.396970 Jul 28 04:18:34.231270 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3778/6228] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:33 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1687 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:18:34.820071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90545956-f258-4538-afa7-3f71af7a994d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:34.820601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-90545956-f258-4538-afa7-3f71af7a994d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:34.840468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90545956-f258-4538-afa7-3f71af7a994d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:34.840929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90545956-f258-4538-afa7-3f71af7a994d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:34.841712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90545956-f258-4538-afa7-3f71af7a994d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:34.842145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90545956-f258-4538-afa7-3f71af7a994d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:34.913798 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90545956-f258-4538-afa7-3f71af7a994d tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/ips" status: 200 len: 144 microversion: 2.1 time: 0.097662 Jul 28 04:18:34.914420 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3779/6229] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Jul 28 04:18:34 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/ips => generated 144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:18:35.239203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-207457be-8744-43dd-a05f-cf348472b57f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:35.240945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-207457be-8744-43dd-a05f-cf348472b57f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:35.275236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-207457be-8744-43dd-a05f-cf348472b57f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:35.277305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-207457be-8744-43dd-a05f-cf348472b57f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:35.278453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-207457be-8744-43dd-a05f-cf348472b57f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:35.280218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-207457be-8744-43dd-a05f-cf348472b57f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:35.546251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-207457be-8744-43dd-a05f-cf348472b57f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:35.563015 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-207457be-8744-43dd-a05f-cf348472b57f tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1619 microversion: 2.1 time: 0.328361 Jul 28 04:18:35.563621 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3780/6230] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:35 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1619 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:18:35.716051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-74efd52b-a740-4f07-b6b5-66a907a6cc0d req-bba8a478-936f-4a3b-b2c6-be2b8e7e8ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd4963e-f6e3-499b-96d7-c86c44fed683", "name": "network-vif-deleted", "tag": "e691a547-60c5-454e-a06e-44918e5be830"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:35.742858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-74efd52b-a740-4f07-b6b5-66a907a6cc0d req-bba8a478-936f-4a3b-b2c6-be2b8e7e8ae1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:35.743917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-74efd52b-a740-4f07-b6b5-66a907a6cc0d req-bba8a478-936f-4a3b-b2c6-be2b8e7e8ae1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:35.767167 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-74efd52b-a740-4f07-b6b5-66a907a6cc0d req-bba8a478-936f-4a3b-b2c6-be2b8e7e8ae1 service nova] Creating event network-vif-deleted:e691a547-60c5-454e-a06e-44918e5be830 for instance cdd4963e-f6e3-499b-96d7-c86c44fed683 on n-h1-826756-3 Jul 28 04:18:35.776161 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-74efd52b-a740-4f07-b6b5-66a907a6cc0d req-bba8a478-936f-4a3b-b2c6-be2b8e7e8ae1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062886 Jul 28 04:18:35.778340 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3781/6231] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:18:36.590921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6ae5faba-e80e-48f5-b44e-86cbf59d3e6a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:36.591746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6ae5faba-e80e-48f5-b44e-86cbf59d3e6a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:36.605403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ae5faba-e80e-48f5-b44e-86cbf59d3e6a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:36.610749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ae5faba-e80e-48f5-b44e-86cbf59d3e6a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:36.611907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ae5faba-e80e-48f5-b44e-86cbf59d3e6a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:36.615805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ae5faba-e80e-48f5-b44e-86cbf59d3e6a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:36.701303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ae5faba-e80e-48f5-b44e-86cbf59d3e6a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:36.706617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ae5faba-e80e-48f5-b44e-86cbf59d3e6a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:36.707221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-6ae5faba-e80e-48f5-b44e-86cbf59d3e6a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lazy-loading 'fault' on Instance uuid cdd4963e-f6e3-499b-96d7-c86c44fed683 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:18:36.799643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6ae5faba-e80e-48f5-b44e-86cbf59d3e6a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:36.818557 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6ae5faba-e80e-48f5-b44e-86cbf59d3e6a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 200 len: 1355 microversion: 2.1 time: 0.230992 Jul 28 04:18:36.826134 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3782/6232] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:36 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 1355 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:18:37.662175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e153aa34-fbad-4db4-a06e-f68992f4af32 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27bb68d7-3441-460d-97ad-8a6e098ff438"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:37.664968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e153aa34-fbad-4db4-a06e-f68992f4af32 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:37.673410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e153aa34-fbad-4db4-a06e-f68992f4af32 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:37.673974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e153aa34-fbad-4db4-a06e-f68992f4af32 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:37.674908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e153aa34-fbad-4db4-a06e-f68992f4af32 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:37.675422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e153aa34-fbad-4db4-a06e-f68992f4af32 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:38.057394 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e153aa34-fbad-4db4-a06e-f68992f4af32 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "POST /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399011 Jul 28 04:18:38.058054 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3783/6233] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 04:18:37 2022] POST /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:18:38.073631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0489f38-d032-4c99-bec1-53f090b74008 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:38.074594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e0489f38-d032-4c99-bec1-53f090b74008 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: cdd4963e-f6e3-499b-96d7-c86c44fed683] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:38.084858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0489f38-d032-4c99-bec1-53f090b74008 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:38.085985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0489f38-d032-4c99-bec1-53f090b74008 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:38.087223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0489f38-d032-4c99-bec1-53f090b74008 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:38.087904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0489f38-d032-4c99-bec1-53f090b74008 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:38.113091 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e0489f38-d032-4c99-bec1-53f090b74008 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] HTTP exception thrown: Instance cdd4963e-f6e3-499b-96d7-c86c44fed683 could not be found. Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0489f38-d032-4c99-bec1-53f090b74008 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Request method failure captured: Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 HTTP/1.1 Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gy0wHx96BVxhyrDFvyRJsSuYIisOw-l-wszQ9XKSZbRRP5vlwalQKYK5hBNyy9WnKnKBmW3QuxEmH_3MqtnQ-B8fUcW5QF0OqJPqXMuA7juF0K-NDS0wf4uTw9P7GbriXF73fWwKh9phWFNUD6o7PkvGEVFYXU7L-2lzVhpHOKHQ8M Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7ea463b2785d46a08c278fa7041654e4 Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1842633679 Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7ea463b2785d46a08c278fa7041654e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ea463b2785d46a08c278fa7041654e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7ea463b2785d46a08c278fa7041654e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ea463b2785d46a08c278fa7041654e4"}]}] Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1842633679 Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7ea463b2785d46a08c278fa7041654e4 Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1842633679 Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestNetworkAdvancedServerOps-1842633679-project Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 63fc192385a7490aacce2d69bfc866ec Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1842633679-project Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance cdd4963e-f6e3-499b-96d7-c86c44fed683 could not be found. Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'cdd4963e-f6e3-499b-96d7-c86c44fed683'} Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdd4963e-f6e3-499b-96d7-c86c44fed683 could not be found. Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdd4963e-f6e3-499b-96d7-c86c44fed683 could not be found. Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:18:38.115869 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:18:38.122263 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:18:38.122263 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:18:38.122263 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:18:38.122263 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:18:38.122263 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:18:38.122263 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:18:38.122263 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdd4963e-f6e3-499b-96d7-c86c44fed683 could not be found. Jul 28 04:18:38.122263 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:18:38.122263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0489f38-d032-4c99-bec1-53f090b74008 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Returning 404 to user: Instance cdd4963e-f6e3-499b-96d7-c86c44fed683 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:18:38.122263 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e0489f38-d032-4c99-bec1-53f090b74008 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683" status: 404 len: 111 microversion: 2.1 time: 0.058510 Jul 28 04:18:38.122263 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3784/6234] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:38 2022] GET /compute/v2.1/servers/cdd4963e-f6e3-499b-96d7-c86c44fed683 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:18:45.498261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3a85f02b-7e87-4a4d-a9f4-a8430c969bb8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '.version_select at 0x7ffa674c8040>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:45.603617 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3a85f02b-7e87-4a4d-a9f4-a8430c969bb8 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-547048850" status: 202 len: 0 microversion: 2.1 time: 0.121774 Jul 28 04:18:45.604798 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3785/6235] 10.222.0.48 () {58 vars in 1281 bytes} [Thu Jul 28 04:18:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-547048850 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:18:45.653515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a6a83d3-9b90-4074-9753-5a4bd0ba3ef4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'create', calling method: .version_select at 0x7ffa79957160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1310326389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgf+xMidYFgDsBD5TCPJ11e3DC4M4K3nD81B002bWNhwNo8wiU56scAcmd8kVuVzkEKM35LI8y/bo2BNAeR8rQSASkGCuwZJv1lAOA1/9Zqysf8XT779OLkP9JaLrjKUA=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:45.716640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-8a6a83d3-9b90-4074-9753-5a4bd0ba3ef4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for project 7ea463b2785d46a08c278fa7041654e4. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:18:45.743807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-8a6a83d3-9b90-4074-9753-5a4bd0ba3ef4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for user 63fc192385a7490aacce2d69bfc866ec and project 7ea463b2785d46a08c278fa7041654e4. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:18:45.815220 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a6a83d3-9b90-4074-9753-5a4bd0ba3ef4 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.171763 Jul 28 04:18:45.817133 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3786/6236] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:18:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:18:48.048736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f292e814-9033-4478-81d1-240aa5ac3d21 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Action: 'create', calling method: .version_select at 0x7ffa7994c040>, body: {"keypair": {"name": "tempest-TestServerBasicOps-2096745502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKF8wi3ktGJ9wR3L/nlW2pflo53QCGJlRt66tr+oYPHnMvHDAonFfas3QlCGP46QYJTP1m0RdrUJolQyQbM/9vdeQQpxW6ffppHOHmJvFvwUF17nLgVU5bdDGDNtjUGuaQ=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:48.059777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:18:48.098362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:18:48.102058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f292e814-9033-4478-81d1-240aa5ac3d21 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Getting quotas for project 7ae046f019ec40ff8d58411a07c1536b. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:18:48.110866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f292e814-9033-4478-81d1-240aa5ac3d21 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Getting quotas for user 0740413e14c4436193d1344079c7d063 and project 7ae046f019ec40ff8d58411a07c1536b. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:18:48.147061 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f292e814-9033-4478-81d1-240aa5ac3d21 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.443126 Jul 28 04:18:48.154101 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3787/6237] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:18:47 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:18:50.311623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-390540895", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-2096745502", "security_groups": [{"name": "tempest-secgroup-smoke-2051790171"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "5bdc56c1-3a58-4d81-8dfd-2c579f67a930"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:50.498686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] validate_networks() for [('5bdc56c1-3a58-4d81-8dfd-2c579f67a930', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:18:51.041164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Getting quotas for project 7ae046f019ec40ff8d58411a07c1536b. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:18:51.056125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Getting quotas for user 0740413e14c4436193d1344079c7d063 and project 7ae046f019ec40ff8d58411a07c1536b. Resources: dict_keys(['metadata_items']) {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:18:51.072695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:18:51.073855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:18:51.074351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:18:51.074771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:18:51.075188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:18:51.097114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:51.097828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:51.099387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:51.100660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:51.125124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Getting quotas for project 7ae046f019ec40ff8d58411a07c1536b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:18:51.131595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Getting quotas for user 0740413e14c4436193d1344079c7d063 and project 7ae046f019ec40ff8d58411a07c1536b. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:18:51.147868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:18:51.150968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:18:51.242372 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-275553a0-6aac-4ebb-91a0-338ecbef624d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.936106 Jul 28 04:18:51.247183 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3788/6238] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:18:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:18:51.263766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-013f6f20-fb2e-42dc-80fa-f32dce333125 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:51.264406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-013f6f20-fb2e-42dc-80fa-f32dce333125 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:51.361196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-013f6f20-fb2e-42dc-80fa-f32dce333125 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:51.376380 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-013f6f20-fb2e-42dc-80fa-f32dce333125 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1302 microversion: 2.1 time: 0.117617 Jul 28 04:18:51.377486 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3789/6239] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:51 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1302 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:18:52.398737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c38c073-e83c-41cb-bee4-a37f4435527e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:52.399603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c38c073-e83c-41cb-bee4-a37f4435527e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:52.411819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c38c073-e83c-41cb-bee4-a37f4435527e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:52.412595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c38c073-e83c-41cb-bee4-a37f4435527e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:52.418039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c38c073-e83c-41cb-bee4-a37f4435527e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:52.418705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c38c073-e83c-41cb-bee4-a37f4435527e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:52.580692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c38c073-e83c-41cb-bee4-a37f4435527e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:52.593489 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c38c073-e83c-41cb-bee4-a37f4435527e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1298 microversion: 2.1 time: 0.197019 Jul 28 04:18:52.595861 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3790/6240] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:52 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1298 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:18:53.618630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc9e7be6-1d59-4172-9dfa-ac7692b68ba7 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:53.620111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cc9e7be6-1d59-4172-9dfa-ac7692b68ba7 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:53.639456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc9e7be6-1d59-4172-9dfa-ac7692b68ba7 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:53.641475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc9e7be6-1d59-4172-9dfa-ac7692b68ba7 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:53.643099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc9e7be6-1d59-4172-9dfa-ac7692b68ba7 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:53.645204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc9e7be6-1d59-4172-9dfa-ac7692b68ba7 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:53.832497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cc9e7be6-1d59-4172-9dfa-ac7692b68ba7 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:53.860562 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cc9e7be6-1d59-4172-9dfa-ac7692b68ba7 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1362 microversion: 2.1 time: 0.232548 Jul 28 04:18:53.860562 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3791/6241] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:53 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:18:53.957713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a9007956-3e30-4913-adf5-e58cced56079 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:53.960446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a9007956-3e30-4913-adf5-e58cced56079 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:53.968401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9007956-3e30-4913-adf5-e58cced56079 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:53.969687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9007956-3e30-4913-adf5-e58cced56079 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:53.970789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9007956-3e30-4913-adf5-e58cced56079 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:53.971470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a9007956-3e30-4913-adf5-e58cced56079 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:54.011368 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a9007956-3e30-4913-adf5-e58cced56079 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058285 Jul 28 04:18:54.012441 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3792/6242] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:18:53 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:18:54.024193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4611a9f9-b4aa-4889-9a38-30cdfbbf52d9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:54.025104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4611a9f9-b4aa-4889-9a38-30cdfbbf52d9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:54.035550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4611a9f9-b4aa-4889-9a38-30cdfbbf52d9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:54.036430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4611a9f9-b4aa-4889-9a38-30cdfbbf52d9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:54.037658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4611a9f9-b4aa-4889-9a38-30cdfbbf52d9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:54.038505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4611a9f9-b4aa-4889-9a38-30cdfbbf52d9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:54.102532 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4611a9f9-b4aa-4889-9a38-30cdfbbf52d9 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments/27bb68d7-3441-460d-97ad-8a6e098ff438" status: 200 len: 194 microversion: 2.1 time: 0.082521 Jul 28 04:18:54.115929 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3793/6243] 10.222.0.48 () {58 vars in 1413 bytes} [Thu Jul 28 04:18:54 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments/27bb68d7-3441-460d-97ad-8a6e098ff438 => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:18:54.883551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b835e394-cdef-4512-90c1-71a03557e7d2 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:54.886004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b835e394-cdef-4512-90c1-71a03557e7d2 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:54.905861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b835e394-cdef-4512-90c1-71a03557e7d2 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:54.906840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b835e394-cdef-4512-90c1-71a03557e7d2 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:54.908154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b835e394-cdef-4512-90c1-71a03557e7d2 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:54.909460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b835e394-cdef-4512-90c1-71a03557e7d2 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:54.997576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b835e394-cdef-4512-90c1-71a03557e7d2 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:55.010208 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b835e394-cdef-4512-90c1-71a03557e7d2 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1360 microversion: 2.1 time: 0.132049 Jul 28 04:18:55.012165 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3794/6244] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:54 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1360 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:18:56.039198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d8f50eb3-f32d-44c5-8e16-bd91431e332d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:56.040731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d8f50eb3-f32d-44c5-8e16-bd91431e332d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:56.056791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8f50eb3-f32d-44c5-8e16-bd91431e332d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:56.057449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8f50eb3-f32d-44c5-8e16-bd91431e332d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:56.058942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8f50eb3-f32d-44c5-8e16-bd91431e332d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:56.059567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8f50eb3-f32d-44c5-8e16-bd91431e332d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:56.555397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d8f50eb3-f32d-44c5-8e16-bd91431e332d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:56.571186 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d8f50eb3-f32d-44c5-8e16-bd91431e332d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1428 microversion: 2.1 time: 0.536453 Jul 28 04:18:56.574246 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3795/6245] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:56 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1428 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:18:56.688824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-209220537", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "3253b80e-4636-41c9-9263-a968e793a41e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1310326389", "security_groups": [{"name": "tempest-secgroup-smoke-1093915493"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:56.908189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] validate_networks() for [('3253b80e-4636-41c9-9263-a968e793a41e', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:18:57.761765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:18:57.762368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:18:57.763796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:18:57.764321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:18:57.764901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:18:57.785623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:57.790620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:57.791667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:57.792261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:57.878753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for project 7ea463b2785d46a08c278fa7041654e4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:18:57.897695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Getting quotas for user 63fc192385a7490aacce2d69bfc866ec and project 7ea463b2785d46a08c278fa7041654e4. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:18:57.946938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:18:57.954855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:18:58.087625 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eeb623a1-3bbd-41ad-a5d7-16234a7a94e6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.406569 Jul 28 04:18:58.092481 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3796/6246] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:18:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:18:58.108592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-20847694-baba-4154-bb29-276a3c9c74af tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "121fc2bb-194e-496c-9b0b-fdda17c82476"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:58.111154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-20847694-baba-4154-bb29-276a3c9c74af tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:58.141358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20847694-baba-4154-bb29-276a3c9c74af tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:58.143308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20847694-baba-4154-bb29-276a3c9c74af tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:58.149533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20847694-baba-4154-bb29-276a3c9c74af tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:58.149999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20847694-baba-4154-bb29-276a3c9c74af tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:58.625716 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-20847694-baba-4154-bb29-276a3c9c74af tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "POST /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.531598 Jul 28 04:18:58.626475 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3797/6247] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 04:18:58 2022] POST /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:18:58.632645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-353645a2-e2dd-42c2-8ade-77903d32fa0b req-898a8971-0d0a-4170-9410-4b880fe93b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b42f04-e54f-4475-bcdb-2c4c3070543f", "tag": "59cce054-f1db-4d9c-b8aa-a71ad8bc67a2"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:18:58.649003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-353645a2-e2dd-42c2-8ade-77903d32fa0b req-898a8971-0d0a-4170-9410-4b880fe93b2b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:58.651902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-353645a2-e2dd-42c2-8ade-77903d32fa0b req-898a8971-0d0a-4170-9410-4b880fe93b2b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:58.667605 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-353645a2-e2dd-42c2-8ade-77903d32fa0b req-898a8971-0d0a-4170-9410-4b880fe93b2b service nova] Creating event network-changed:59cce054-f1db-4d9c-b8aa-a71ad8bc67a2 for instance 42b42f04-e54f-4475-bcdb-2c4c3070543f on n-h2-826756-3 Jul 28 04:18:58.674781 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-353645a2-e2dd-42c2-8ade-77903d32fa0b req-898a8971-0d0a-4170-9410-4b880fe93b2b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045870 Jul 28 04:18:58.676481 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3798/6248] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:18:58.686400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e7fa069e-7b13-4db4-aa59-b5781b17a2a0 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:58.687491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e7fa069e-7b13-4db4-aa59-b5781b17a2a0 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:58.696939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7fa069e-7b13-4db4-aa59-b5781b17a2a0 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:58.697692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7fa069e-7b13-4db4-aa59-b5781b17a2a0 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:58.698921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7fa069e-7b13-4db4-aa59-b5781b17a2a0 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:18:58.699540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7fa069e-7b13-4db4-aa59-b5781b17a2a0 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:18:59.031927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e7fa069e-7b13-4db4-aa59-b5781b17a2a0 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:59.042885 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e7fa069e-7b13-4db4-aa59-b5781b17a2a0 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1428 microversion: 2.1 time: 0.364650 Jul 28 04:18:59.043481 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3799/6249] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:58 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1428 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:18:59.061574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e3a31cef-4b35-4e41-b473-c8ada67a1293 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:18:59.063094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e3a31cef-4b35-4e41-b473-c8ada67a1293 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:18:59.161479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e3a31cef-4b35-4e41-b473-c8ada67a1293 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:18:59.170880 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e3a31cef-4b35-4e41-b473-c8ada67a1293 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1266 microversion: 2.1 time: 0.122099 Jul 28 04:18:59.174556 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3800/6250] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:18:59 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:00.075168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d08f4b1-1117-4a6f-8e91-5a7276fc486e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:00.077115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d08f4b1-1117-4a6f-8e91-5a7276fc486e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:00.107607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d08f4b1-1117-4a6f-8e91-5a7276fc486e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:00.108067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d08f4b1-1117-4a6f-8e91-5a7276fc486e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:00.108914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d08f4b1-1117-4a6f-8e91-5a7276fc486e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:00.109356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d08f4b1-1117-4a6f-8e91-5a7276fc486e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:00.425278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9d08f4b1-1117-4a6f-8e91-5a7276fc486e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:00.445570 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d08f4b1-1117-4a6f-8e91-5a7276fc486e tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1428 microversion: 2.1 time: 0.379076 Jul 28 04:19:00.446108 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3801/6251] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:00 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1428 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:00.457447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fd260c40-85d5-4b53-8e75-27f9e65100b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:00.459462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fd260c40-85d5-4b53-8e75-27f9e65100b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:00.484003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd260c40-85d5-4b53-8e75-27f9e65100b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:00.484776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd260c40-85d5-4b53-8e75-27f9e65100b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:00.485780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd260c40-85d5-4b53-8e75-27f9e65100b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:00.486419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd260c40-85d5-4b53-8e75-27f9e65100b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:00.583457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fd260c40-85d5-4b53-8e75-27f9e65100b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:00.595303 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fd260c40-85d5-4b53-8e75-27f9e65100b5 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1324 microversion: 2.1 time: 0.147911 Jul 28 04:19:00.596549 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3802/6252] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:00 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1324 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:01.470879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a693d32d-1a6a-4abb-a8e5-d691b8a813a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:01.471862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a693d32d-1a6a-4abb-a8e5-d691b8a813a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:01.482678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a693d32d-1a6a-4abb-a8e5-d691b8a813a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:01.483145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a693d32d-1a6a-4abb-a8e5-d691b8a813a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:01.484120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a693d32d-1a6a-4abb-a8e5-d691b8a813a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:01.484813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a693d32d-1a6a-4abb-a8e5-d691b8a813a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:01.746535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a693d32d-1a6a-4abb-a8e5-d691b8a813a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:01.755572 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a693d32d-1a6a-4abb-a8e5-d691b8a813a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1428 microversion: 2.1 time: 0.291084 Jul 28 04:19:01.756174 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3803/6253] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:01 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1428 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:01.777647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-afdc2a86-a6d9-4f5c-a7a1-ed250d871124 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:01.778173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-afdc2a86-a6d9-4f5c-a7a1-ed250d871124 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:01.784982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afdc2a86-a6d9-4f5c-a7a1-ed250d871124 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:01.785440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afdc2a86-a6d9-4f5c-a7a1-ed250d871124 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:01.786249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afdc2a86-a6d9-4f5c-a7a1-ed250d871124 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:01.786684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-afdc2a86-a6d9-4f5c-a7a1-ed250d871124 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:01.983638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-afdc2a86-a6d9-4f5c-a7a1-ed250d871124 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:01.991634 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-afdc2a86-a6d9-4f5c-a7a1-ed250d871124 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1392 microversion: 2.1 time: 0.221152 Jul 28 04:19:01.996430 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3804/6254] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:01 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1392 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:02.247383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62963888-acbd-468d-98e9-747afe8647cf tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Action: 'create', calling method: .version_select at 0x7ffa6786bf70>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-166545779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH14D+QZnsRwuP4wLkatPK1Hc5aoH3ns4ouyiX3CWXkA0UIhO+XzVQ9wzL9VcvIw4s5R3OWRUvGsKP5BOTknHDbo03Rw0vm+fFS3E9RCQWsDUXaTMQj6pMO7mwjrf+2LlA=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:02.266616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-62963888-acbd-468d-98e9-747afe8647cf tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Getting quotas for project d25ca0e5d5034d549601f45179178c8e. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:19:02.273035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-62963888-acbd-468d-98e9-747afe8647cf tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Getting quotas for user 02d3964e666e42aa867f9a56b646d2ea and project d25ca0e5d5034d549601f45179178c8e. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:19:02.296719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:19:02.313307 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-62963888-acbd-468d-98e9-747afe8647cf tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.070361 Jul 28 04:19:02.315623 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3805/6255] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:19:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:02.476808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1e30cf70-24a1-4b7b-b6bc-4eb44d66ccb9 req-f4c5c552-c0c2-480e-b964-c6fb617d3c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21fa492a-6661-4809-a0db-4a3b54d92f2c", "tag": "487caa46-9ce6-40af-abbb-0553c1bbce2e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:02.508500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1e30cf70-24a1-4b7b-b6bc-4eb44d66ccb9 req-f4c5c552-c0c2-480e-b964-c6fb617d3c60 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:02.509497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1e30cf70-24a1-4b7b-b6bc-4eb44d66ccb9 req-f4c5c552-c0c2-480e-b964-c6fb617d3c60 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:02.540311 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1e30cf70-24a1-4b7b-b6bc-4eb44d66ccb9 req-f4c5c552-c0c2-480e-b964-c6fb617d3c60 service nova] Creating event network-changed:487caa46-9ce6-40af-abbb-0553c1bbce2e for instance 21fa492a-6661-4809-a0db-4a3b54d92f2c on n-h1-826756-3 Jul 28 04:19:02.565754 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1e30cf70-24a1-4b7b-b6bc-4eb44d66ccb9 req-f4c5c552-c0c2-480e-b964-c6fb617d3c60 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087770 Jul 28 04:19:02.569366 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3806/6256] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:02.663961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-cf0c3099-f1bd-47b4-bab0-e3016f1c5999 req-a97e539a-b297-4c8e-b1e3-7cf3b4ca3aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b42f04-e54f-4475-bcdb-2c4c3070543f", "name": "network-vif-plugged", "status": "completed", "tag": "59cce054-f1db-4d9c-b8aa-a71ad8bc67a2"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:02.698534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cf0c3099-f1bd-47b4-bab0-e3016f1c5999 req-a97e539a-b297-4c8e-b1e3-7cf3b4ca3aa9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:02.699929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cf0c3099-f1bd-47b4-bab0-e3016f1c5999 req-a97e539a-b297-4c8e-b1e3-7cf3b4ca3aa9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:02.723716 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-cf0c3099-f1bd-47b4-bab0-e3016f1c5999 req-a97e539a-b297-4c8e-b1e3-7cf3b4ca3aa9 service nova] Creating event network-vif-plugged:59cce054-f1db-4d9c-b8aa-a71ad8bc67a2 for instance 42b42f04-e54f-4475-bcdb-2c4c3070543f on n-h2-826756-3 Jul 28 04:19:02.734357 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-cf0c3099-f1bd-47b4-bab0-e3016f1c5999 req-a97e539a-b297-4c8e-b1e3-7cf3b4ca3aa9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073359 Jul 28 04:19:02.736934 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3807/6257] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:02.791008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-72764afb-4124-4c84-b737-0c6786bb0efa tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:02.792048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-72764afb-4124-4c84-b737-0c6786bb0efa tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:02.799621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72764afb-4124-4c84-b737-0c6786bb0efa tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:02.800276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72764afb-4124-4c84-b737-0c6786bb0efa tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:02.801247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72764afb-4124-4c84-b737-0c6786bb0efa tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:02.801884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72764afb-4124-4c84-b737-0c6786bb0efa tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:02.960446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-72764afb-4124-4c84-b737-0c6786bb0efa tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:02.970681 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-72764afb-4124-4c84-b737-0c6786bb0efa tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1428 microversion: 2.1 time: 0.184558 Jul 28 04:19:02.971258 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3808/6258] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:02 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1428 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:03.017726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-95e16bbe-2cbe-485f-b79f-1e40a26ac58a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:03.019030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-95e16bbe-2cbe-485f-b79f-1e40a26ac58a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:03.027931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95e16bbe-2cbe-485f-b79f-1e40a26ac58a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:03.027931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95e16bbe-2cbe-485f-b79f-1e40a26ac58a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:03.029293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95e16bbe-2cbe-485f-b79f-1e40a26ac58a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:03.029832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95e16bbe-2cbe-485f-b79f-1e40a26ac58a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:03.059771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:19:03.212989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-95e16bbe-2cbe-485f-b79f-1e40a26ac58a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:03.219780 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-95e16bbe-2cbe-485f-b79f-1e40a26ac58a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1392 microversion: 2.1 time: 0.207070 Jul 28 04:19:03.231040 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3809/6259] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:03 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1392 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:03.992078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c3abd290-460c-4b9c-9ccf-e0a9be19522d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:03.993125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c3abd290-460c-4b9c-9ccf-e0a9be19522d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:04.019739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3abd290-460c-4b9c-9ccf-e0a9be19522d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:04.020420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3abd290-460c-4b9c-9ccf-e0a9be19522d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:04.021581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3abd290-460c-4b9c-9ccf-e0a9be19522d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:04.022296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3abd290-460c-4b9c-9ccf-e0a9be19522d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:04.227668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c3abd290-460c-4b9c-9ccf-e0a9be19522d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:04.236239 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c3abd290-460c-4b9c-9ccf-e0a9be19522d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1428 microversion: 2.1 time: 0.248539 Jul 28 04:19:04.250992 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3810/6260] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:03 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1428 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:04.250992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-478861385", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e4c65086-e8d4-48da-b9a2-7dc374eedcc8", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-166545779", "security_groups": [{"name": "tempest-secgroup-smoke-1818350871"}], "networks": [{"uuid": "cdb22b26-78ff-4f22-a403-1941ef74431c"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:04.392621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] validate_networks() for [('cdb22b26-78ff-4f22-a403-1941ef74431c', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:19:04.822924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:19:04.823393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:19:04.824026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:19:04.824458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:19:04.824869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:19:04.834134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:04.834589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:04.835388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:04.835827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:04.854408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Getting quotas for project d25ca0e5d5034d549601f45179178c8e. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:19:04.859763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Getting quotas for user 02d3964e666e42aa867f9a56b646d2ea and project d25ca0e5d5034d549601f45179178c8e. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:19:04.921957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:19:04.924276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e4c65086-e8d4-48da-b9a2-7dc374eedcc8',volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:19:05.059588 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-db8a5ee4-b3aa-4aed-8200-ad4428470057 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.821639 Jul 28 04:19:05.060479 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3811/6261] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:19:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:19:05.065574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19549ba1-75a4-4e2b-bd6c-f71033a3ac20 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:05.066193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-19549ba1-75a4-4e2b-bd6c-f71033a3ac20 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:05.073417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19549ba1-75a4-4e2b-bd6c-f71033a3ac20 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:05.073871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19549ba1-75a4-4e2b-bd6c-f71033a3ac20 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:05.075797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19549ba1-75a4-4e2b-bd6c-f71033a3ac20 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:05.076589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19549ba1-75a4-4e2b-bd6c-f71033a3ac20 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:05.247612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19549ba1-75a4-4e2b-bd6c-f71033a3ac20 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:05.260503 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-19549ba1-75a4-4e2b-bd6c-f71033a3ac20 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1392 microversion: 2.1 time: 0.198527 Jul 28 04:19:05.261298 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3812/6262] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:05 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1392 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:05.274526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d53c27b-5ee8-4221-a23a-ba439991024e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:05.275409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6d53c27b-5ee8-4221-a23a-ba439991024e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:05.333281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6d53c27b-5ee8-4221-a23a-ba439991024e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:05.341901 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d53c27b-5ee8-4221-a23a-ba439991024e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1097 microversion: 2.1 time: 0.076242 Jul 28 04:19:05.342522 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3813/6263] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:05 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1097 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:05.347477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf946282-4bc7-4ded-b86f-12ecb5dfa4ae tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:05.348091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cf946282-4bc7-4ded-b86f-12ecb5dfa4ae tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:05.355559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf946282-4bc7-4ded-b86f-12ecb5dfa4ae tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:05.356015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf946282-4bc7-4ded-b86f-12ecb5dfa4ae tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:05.357139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf946282-4bc7-4ded-b86f-12ecb5dfa4ae tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:05.357576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf946282-4bc7-4ded-b86f-12ecb5dfa4ae tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:05.515340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf946282-4bc7-4ded-b86f-12ecb5dfa4ae tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:05.525117 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf946282-4bc7-4ded-b86f-12ecb5dfa4ae tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1608 microversion: 2.1 time: 0.181511 Jul 28 04:19:05.526325 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3814/6264] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:05 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1608 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:05.546504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-331cec32-29d6-4cbe-bd42-bb35d0313033 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:05.547119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-331cec32-29d6-4cbe-bd42-bb35d0313033 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:05.553364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-331cec32-29d6-4cbe-bd42-bb35d0313033 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:05.553812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-331cec32-29d6-4cbe-bd42-bb35d0313033 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:05.554653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-331cec32-29d6-4cbe-bd42-bb35d0313033 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:05.554999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-331cec32-29d6-4cbe-bd42-bb35d0313033 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:05.701338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-331cec32-29d6-4cbe-bd42-bb35d0313033 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:05.711006 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-331cec32-29d6-4cbe-bd42-bb35d0313033 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1608 microversion: 2.1 time: 0.168254 Jul 28 04:19:05.712225 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3815/6265] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:05 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1608 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:05.732635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9374d40a-3f61-46bd-a4c3-05242113a647 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:05.733327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9374d40a-3f61-46bd-a4c3-05242113a647 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:05.739931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9374d40a-3f61-46bd-a4c3-05242113a647 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:05.740442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9374d40a-3f61-46bd-a4c3-05242113a647 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:05.741225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9374d40a-3f61-46bd-a4c3-05242113a647 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:05.741659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9374d40a-3f61-46bd-a4c3-05242113a647 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:05.891179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9374d40a-3f61-46bd-a4c3-05242113a647 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:05.899719 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9374d40a-3f61-46bd-a4c3-05242113a647 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1608 microversion: 2.1 time: 0.171498 Jul 28 04:19:05.900762 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3816/6266] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:05 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1608 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:06.282507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f437a0ea-6b41-472b-ba0f-268d7ee8ffcc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:06.284264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f437a0ea-6b41-472b-ba0f-268d7ee8ffcc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:06.297806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f437a0ea-6b41-472b-ba0f-268d7ee8ffcc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:06.298364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f437a0ea-6b41-472b-ba0f-268d7ee8ffcc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:06.299591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f437a0ea-6b41-472b-ba0f-268d7ee8ffcc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:06.300980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f437a0ea-6b41-472b-ba0f-268d7ee8ffcc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:06.555859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f437a0ea-6b41-472b-ba0f-268d7ee8ffcc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:06.564989 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f437a0ea-6b41-472b-ba0f-268d7ee8ffcc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1392 microversion: 2.1 time: 0.286836 Jul 28 04:19:06.574400 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3817/6267] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:06 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1392 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:06.576898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5612acea-a5b1-4991-a1ce-5ddc9538031b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:06.577523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5612acea-a5b1-4991-a1ce-5ddc9538031b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:06.587268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5612acea-a5b1-4991-a1ce-5ddc9538031b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:06.587723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5612acea-a5b1-4991-a1ce-5ddc9538031b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:06.589245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5612acea-a5b1-4991-a1ce-5ddc9538031b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:06.589541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5612acea-a5b1-4991-a1ce-5ddc9538031b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:06.677458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5612acea-a5b1-4991-a1ce-5ddc9538031b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:06.687035 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5612acea-a5b1-4991-a1ce-5ddc9538031b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1213 microversion: 2.1 time: 0.114252 Jul 28 04:19:06.688001 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3818/6268] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:06 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:07.588381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3a8389dc-0e95-41fc-b9ae-a3e4763d67e1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:07.589679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3a8389dc-0e95-41fc-b9ae-a3e4763d67e1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:07.597351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a8389dc-0e95-41fc-b9ae-a3e4763d67e1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:07.597777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a8389dc-0e95-41fc-b9ae-a3e4763d67e1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:07.598608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a8389dc-0e95-41fc-b9ae-a3e4763d67e1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:07.599044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a8389dc-0e95-41fc-b9ae-a3e4763d67e1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:07.756418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3a8389dc-0e95-41fc-b9ae-a3e4763d67e1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:07.765029 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3a8389dc-0e95-41fc-b9ae-a3e4763d67e1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1392 microversion: 2.1 time: 0.181114 Jul 28 04:19:07.765860 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3819/6269] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:07 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:07.774693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cd4c10de-96ff-46e8-b7c7-cba4380ce8c3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:07.776033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cd4c10de-96ff-46e8-b7c7-cba4380ce8c3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:07.786340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd4c10de-96ff-46e8-b7c7-cba4380ce8c3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:07.787975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd4c10de-96ff-46e8-b7c7-cba4380ce8c3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:07.789076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd4c10de-96ff-46e8-b7c7-cba4380ce8c3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:07.789746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd4c10de-96ff-46e8-b7c7-cba4380ce8c3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:07.943654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cd4c10de-96ff-46e8-b7c7-cba4380ce8c3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:07.954727 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cd4c10de-96ff-46e8-b7c7-cba4380ce8c3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1281 microversion: 2.1 time: 0.185040 Jul 28 04:19:07.956172 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3820/6270] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:07 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1281 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:08.504462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c2fa4ea8-e003-49bf-99e1-9d9c2b98c703 req-dc9ab9fb-a7d3-4ec8-bddf-2ddb244cfa27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21fa492a-6661-4809-a0db-4a3b54d92f2c", "name": "network-vif-plugged", "status": "completed", "tag": "487caa46-9ce6-40af-abbb-0553c1bbce2e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:08.531478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c2fa4ea8-e003-49bf-99e1-9d9c2b98c703 req-dc9ab9fb-a7d3-4ec8-bddf-2ddb244cfa27 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:08.533352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c2fa4ea8-e003-49bf-99e1-9d9c2b98c703 req-dc9ab9fb-a7d3-4ec8-bddf-2ddb244cfa27 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:08.565182 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c2fa4ea8-e003-49bf-99e1-9d9c2b98c703 req-dc9ab9fb-a7d3-4ec8-bddf-2ddb244cfa27 service nova] Creating event network-vif-plugged:487caa46-9ce6-40af-abbb-0553c1bbce2e for instance 21fa492a-6661-4809-a0db-4a3b54d92f2c on n-h1-826756-3 Jul 28 04:19:08.570993 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c2fa4ea8-e003-49bf-99e1-9d9c2b98c703 req-dc9ab9fb-a7d3-4ec8-bddf-2ddb244cfa27 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073612 Jul 28 04:19:08.572280 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3821/6271] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:19:08.786783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a91f64e7-f7e9-44ad-a8c1-d3fdd4d43e87 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:08.787426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a91f64e7-f7e9-44ad-a8c1-d3fdd4d43e87 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:08.796568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a91f64e7-f7e9-44ad-a8c1-d3fdd4d43e87 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:08.797029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a91f64e7-f7e9-44ad-a8c1-d3fdd4d43e87 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:08.797808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a91f64e7-f7e9-44ad-a8c1-d3fdd4d43e87 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:08.798236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a91f64e7-f7e9-44ad-a8c1-d3fdd4d43e87 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:08.954559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a91f64e7-f7e9-44ad-a8c1-d3fdd4d43e87 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:08.963151 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a91f64e7-f7e9-44ad-a8c1-d3fdd4d43e87 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1392 microversion: 2.1 time: 0.181047 Jul 28 04:19:08.963740 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3822/6272] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:08 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:08.978990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf9a9e9a-15b1-4c4e-8622-e22e39872ea6 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:08.980156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cf9a9e9a-15b1-4c4e-8622-e22e39872ea6 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:08.987140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf9a9e9a-15b1-4c4e-8622-e22e39872ea6 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:08.987898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf9a9e9a-15b1-4c4e-8622-e22e39872ea6 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:08.989056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf9a9e9a-15b1-4c4e-8622-e22e39872ea6 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:08.989491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf9a9e9a-15b1-4c4e-8622-e22e39872ea6 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:09.181107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf9a9e9a-15b1-4c4e-8622-e22e39872ea6 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:09.191533 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf9a9e9a-15b1-4c4e-8622-e22e39872ea6 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1281 microversion: 2.1 time: 0.218148 Jul 28 04:19:09.199802 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3823/6273] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:08 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1281 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:09.504871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9f72cda6-919d-4072-a030-be163f51e601 req-b4b65536-9f6a-434b-9081-af32ba082d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42b42f04-e54f-4475-bcdb-2c4c3070543f", "tag": "59cce054-f1db-4d9c-b8aa-a71ad8bc67a2"}, {"name": "network-changed", "server_uuid": "3f6d450a-8532-4cdf-8309-68c151e825ca", "tag": "a36e5144-1abc-486b-93ff-864d591726ec"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:09.521192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9f72cda6-919d-4072-a030-be163f51e601 req-b4b65536-9f6a-434b-9081-af32ba082d16 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:09.521811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9f72cda6-919d-4072-a030-be163f51e601 req-b4b65536-9f6a-434b-9081-af32ba082d16 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:09.542935 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9f72cda6-919d-4072-a030-be163f51e601 req-b4b65536-9f6a-434b-9081-af32ba082d16 service nova] Creating event network-changed:59cce054-f1db-4d9c-b8aa-a71ad8bc67a2 for instance 42b42f04-e54f-4475-bcdb-2c4c3070543f on n-h2-826756-3 Jul 28 04:19:09.543806 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9f72cda6-919d-4072-a030-be163f51e601 req-b4b65536-9f6a-434b-9081-af32ba082d16 service nova] Creating event network-changed:a36e5144-1abc-486b-93ff-864d591726ec for instance 3f6d450a-8532-4cdf-8309-68c151e825ca on n-h2-826756-3 Jul 28 04:19:09.552254 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9f72cda6-919d-4072-a030-be163f51e601 req-b4b65536-9f6a-434b-9081-af32ba082d16 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051290 Jul 28 04:19:09.553480 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3824/6274] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:09.990027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74ba755a-5f37-4445-8d8e-97a8cf184b79 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:09.991177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74ba755a-5f37-4445-8d8e-97a8cf184b79 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:10.002453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74ba755a-5f37-4445-8d8e-97a8cf184b79 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:10.003412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74ba755a-5f37-4445-8d8e-97a8cf184b79 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:10.004505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74ba755a-5f37-4445-8d8e-97a8cf184b79 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:10.005150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74ba755a-5f37-4445-8d8e-97a8cf184b79 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:10.214889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-74ba755a-5f37-4445-8d8e-97a8cf184b79 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:10.224582 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74ba755a-5f37-4445-8d8e-97a8cf184b79 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1565 microversion: 2.1 time: 0.239234 Jul 28 04:19:10.225389 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3825/6275] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:09 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1565 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:10.233279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9b035096-3b80-4c52-9aa7-d5d98306549e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:10.233845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9b035096-3b80-4c52-9aa7-d5d98306549e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:10.241118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b035096-3b80-4c52-9aa7-d5d98306549e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:10.241581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b035096-3b80-4c52-9aa7-d5d98306549e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:10.242370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b035096-3b80-4c52-9aa7-d5d98306549e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:10.242806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b035096-3b80-4c52-9aa7-d5d98306549e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:10.412722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9b035096-3b80-4c52-9aa7-d5d98306549e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:10.423995 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9b035096-3b80-4c52-9aa7-d5d98306549e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1281 microversion: 2.1 time: 0.195976 Jul 28 04:19:10.425081 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3826/6276] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:10 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1281 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:10.429920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-76d70ce9-3047-4d02-b349-222de20b2b63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:10.430529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-76d70ce9-3047-4d02-b349-222de20b2b63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:10.443014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76d70ce9-3047-4d02-b349-222de20b2b63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:10.443485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76d70ce9-3047-4d02-b349-222de20b2b63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:10.444904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76d70ce9-3047-4d02-b349-222de20b2b63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:10.445991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76d70ce9-3047-4d02-b349-222de20b2b63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:10.628141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-76d70ce9-3047-4d02-b349-222de20b2b63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:10.639806 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-76d70ce9-3047-4d02-b349-222de20b2b63 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1565 microversion: 2.1 time: 0.213376 Jul 28 04:19:10.656269 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3827/6277] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:10 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1565 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:11.447171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ae624006-ba22-470d-8cef-74565003e937 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:11.447835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ae624006-ba22-470d-8cef-74565003e937 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:11.455111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae624006-ba22-470d-8cef-74565003e937 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:11.455643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae624006-ba22-470d-8cef-74565003e937 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:11.456543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae624006-ba22-470d-8cef-74565003e937 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:11.457043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae624006-ba22-470d-8cef-74565003e937 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:11.691087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ae624006-ba22-470d-8cef-74565003e937 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:11.700112 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ae624006-ba22-470d-8cef-74565003e937 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1281 microversion: 2.1 time: 0.257019 Jul 28 04:19:11.715272 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3828/6278] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:11 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1281 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:12.724592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90e843d7-d96a-4913-b2d3-e76a6c80b50a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:12.725635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-90e843d7-d96a-4913-b2d3-e76a6c80b50a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:12.734361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90e843d7-d96a-4913-b2d3-e76a6c80b50a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:12.735367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90e843d7-d96a-4913-b2d3-e76a6c80b50a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:12.736719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90e843d7-d96a-4913-b2d3-e76a6c80b50a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:12.737419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90e843d7-d96a-4913-b2d3-e76a6c80b50a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:12.742302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:19:12.939437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-90e843d7-d96a-4913-b2d3-e76a6c80b50a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:12.956380 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90e843d7-d96a-4913-b2d3-e76a6c80b50a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1269 microversion: 2.1 time: 0.237133 Jul 28 04:19:12.957348 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3829/6279] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:12 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1269 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:12.963795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-067a5cd3-9083-4329-bc30-6047e967bbf4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:12.966891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-067a5cd3-9083-4329-bc30-6047e967bbf4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:12.973681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-067a5cd3-9083-4329-bc30-6047e967bbf4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:12.974219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-067a5cd3-9083-4329-bc30-6047e967bbf4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:12.975142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-067a5cd3-9083-4329-bc30-6047e967bbf4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:12.975603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-067a5cd3-9083-4329-bc30-6047e967bbf4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:13.010659 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-067a5cd3-9083-4329-bc30-6047e967bbf4 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052321 Jul 28 04:19:13.011415 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3830/6280] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:19:12 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:13.016452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d0d6a64-89fe-48a7-92d5-28476814860a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:13.017079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d0d6a64-89fe-48a7-92d5-28476814860a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:13.024105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d0d6a64-89fe-48a7-92d5-28476814860a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:13.025002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d0d6a64-89fe-48a7-92d5-28476814860a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:13.025385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d0d6a64-89fe-48a7-92d5-28476814860a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:13.025829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d0d6a64-89fe-48a7-92d5-28476814860a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:13.198146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7d0d6a64-89fe-48a7-92d5-28476814860a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:13.207111 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d0d6a64-89fe-48a7-92d5-28476814860a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1565 microversion: 2.1 time: 0.194678 Jul 28 04:19:13.207899 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3831/6281] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:13 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1565 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:13.212745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-15052d02-1afd-42da-8a25-d83d1a2d92fa req-8a9c6134-7ead-4974-8738-f2ffde3ae14a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21fa492a-6661-4809-a0db-4a3b54d92f2c", "tag": "487caa46-9ce6-40af-abbb-0553c1bbce2e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:13.226423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-15052d02-1afd-42da-8a25-d83d1a2d92fa req-8a9c6134-7ead-4974-8738-f2ffde3ae14a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:13.226769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-15052d02-1afd-42da-8a25-d83d1a2d92fa req-8a9c6134-7ead-4974-8738-f2ffde3ae14a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:13.239071 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-15052d02-1afd-42da-8a25-d83d1a2d92fa req-8a9c6134-7ead-4974-8738-f2ffde3ae14a service nova] Creating event network-changed:487caa46-9ce6-40af-abbb-0553c1bbce2e for instance 21fa492a-6661-4809-a0db-4a3b54d92f2c on n-h1-826756-3 Jul 28 04:19:13.244212 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-15052d02-1afd-42da-8a25-d83d1a2d92fa req-8a9c6134-7ead-4974-8738-f2ffde3ae14a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035299 Jul 28 04:19:13.245222 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3832/6282] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:13.252774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3181049-42e1-464e-a2e4-f0bfbe8dda56 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:13.261017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d3181049-42e1-464e-a2e4-f0bfbe8dda56 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:13.273563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3181049-42e1-464e-a2e4-f0bfbe8dda56 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:13.274024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3181049-42e1-464e-a2e4-f0bfbe8dda56 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:13.274819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3181049-42e1-464e-a2e4-f0bfbe8dda56 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:13.275258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3181049-42e1-464e-a2e4-f0bfbe8dda56 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:13.325472 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d3181049-42e1-464e-a2e4-f0bfbe8dda56 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments/27bb68d7-3441-460d-97ad-8a6e098ff438" status: 200 len: 194 microversion: 2.1 time: 0.078618 Jul 28 04:19:13.326221 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3833/6283] 10.222.0.48 () {58 vars in 1413 bytes} [Thu Jul 28 04:19:13 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments/27bb68d7-3441-460d-97ad-8a6e098ff438 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:13.337471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-163ead12-8c36-4279-b086-4e57245e6769 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:13.337980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-163ead12-8c36-4279-b086-4e57245e6769 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:13.344852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-163ead12-8c36-4279-b086-4e57245e6769 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:13.345315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-163ead12-8c36-4279-b086-4e57245e6769 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:13.346321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-163ead12-8c36-4279-b086-4e57245e6769 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:13.346876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-163ead12-8c36-4279-b086-4e57245e6769 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:13.431099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-163ead12-8c36-4279-b086-4e57245e6769 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lazy-loading 'services' on Instance uuid 4189aed4-6191-4909-900d-85a86bf44937 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:19:13.527857 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-163ead12-8c36-4279-b086-4e57245e6769 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments/27bb68d7-3441-460d-97ad-8a6e098ff438" status: 202 len: 0 microversion: 2.1 time: 0.194908 Jul 28 04:19:13.528713 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3834/6284] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:19:13 2022] DELETE /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments/27bb68d7-3441-460d-97ad-8a6e098ff438 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:19:13.980202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94e0bd02-df94-40f6-bf71-65c3a805038b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:13.980910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-94e0bd02-df94-40f6-bf71-65c3a805038b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:13.987700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94e0bd02-df94-40f6-bf71-65c3a805038b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:13.988119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94e0bd02-df94-40f6-bf71-65c3a805038b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:13.989297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94e0bd02-df94-40f6-bf71-65c3a805038b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:13.989704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94e0bd02-df94-40f6-bf71-65c3a805038b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:14.155910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-94e0bd02-df94-40f6-bf71-65c3a805038b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:14.165756 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-94e0bd02-df94-40f6-bf71-65c3a805038b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1269 microversion: 2.1 time: 0.191206 Jul 28 04:19:14.166341 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3835/6285] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:13 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1269 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:15.188734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e58684d4-39ea-4e99-8a05-1767919e2b91 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:15.189354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e58684d4-39ea-4e99-8a05-1767919e2b91 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:15.191481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:19:15.197894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e58684d4-39ea-4e99-8a05-1767919e2b91 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:15.198347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e58684d4-39ea-4e99-8a05-1767919e2b91 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:15.199163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e58684d4-39ea-4e99-8a05-1767919e2b91 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:15.199664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e58684d4-39ea-4e99-8a05-1767919e2b91 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:15.338108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e58684d4-39ea-4e99-8a05-1767919e2b91 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:15.340707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=40 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:19:15.347920 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e58684d4-39ea-4e99-8a05-1767919e2b91 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1269 microversion: 2.1 time: 0.163604 Jul 28 04:19:15.348547 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3836/6286] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:15 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:16.370542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bbe0e50f-3f36-4d4e-a2fa-c667d34e758f tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:16.371192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bbe0e50f-3f36-4d4e-a2fa-c667d34e758f tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:16.382338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbe0e50f-3f36-4d4e-a2fa-c667d34e758f tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:16.382792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbe0e50f-3f36-4d4e-a2fa-c667d34e758f tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:16.383599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbe0e50f-3f36-4d4e-a2fa-c667d34e758f tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:16.384029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbe0e50f-3f36-4d4e-a2fa-c667d34e758f tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:16.548501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bbe0e50f-3f36-4d4e-a2fa-c667d34e758f tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:16.557083 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bbe0e50f-3f36-4d4e-a2fa-c667d34e758f tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1269 microversion: 2.1 time: 0.190716 Jul 28 04:19:16.557687 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3837/6287] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:16 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1269 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:17.578558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44cce11b-7679-4858-97c2-e5748c43f41b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:17.579267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-44cce11b-7679-4858-97c2-e5748c43f41b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:17.587125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44cce11b-7679-4858-97c2-e5748c43f41b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:17.587580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44cce11b-7679-4858-97c2-e5748c43f41b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:17.588374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44cce11b-7679-4858-97c2-e5748c43f41b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:17.588852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44cce11b-7679-4858-97c2-e5748c43f41b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:17.727809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44cce11b-7679-4858-97c2-e5748c43f41b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:17.736478 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-44cce11b-7679-4858-97c2-e5748c43f41b tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1269 microversion: 2.1 time: 0.162004 Jul 28 04:19:17.737081 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3838/6288] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:17 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:18.756937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1f431e00-5860-43e3-949d-078abf4ce571 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:18.757653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1f431e00-5860-43e3-949d-078abf4ce571 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:18.765208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f431e00-5860-43e3-949d-078abf4ce571 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:18.765985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f431e00-5860-43e3-949d-078abf4ce571 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:18.766966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f431e00-5860-43e3-949d-078abf4ce571 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:18.767615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f431e00-5860-43e3-949d-078abf4ce571 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:18.906091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1f431e00-5860-43e3-949d-078abf4ce571 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:18.914336 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1f431e00-5860-43e3-949d-078abf4ce571 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1269 microversion: 2.1 time: 0.161496 Jul 28 04:19:18.914897 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3839/6289] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:18 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:18.929485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-101c39a8-e711-47c1-b385-600943db652f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:18.929989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-101c39a8-e711-47c1-b385-600943db652f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:18.936675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-101c39a8-e711-47c1-b385-600943db652f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:18.937133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-101c39a8-e711-47c1-b385-600943db652f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:18.937925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-101c39a8-e711-47c1-b385-600943db652f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:18.938342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-101c39a8-e711-47c1-b385-600943db652f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:18.971011 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-101c39a8-e711-47c1-b385-600943db652f tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments/121fc2bb-194e-496c-9b0b-fdda17c82476" status: 200 len: 194 microversion: 2.1 time: 0.045144 Jul 28 04:19:18.971723 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3840/6290] 10.222.0.48 () {58 vars in 1413 bytes} [Thu Jul 28 04:19:18 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments/121fc2bb-194e-496c-9b0b-fdda17c82476 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:19:18.986836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0d38eae1-a7c4-4e8a-8487-327490f8488c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:18.987454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0d38eae1-a7c4-4e8a-8487-327490f8488c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:18.995938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d38eae1-a7c4-4e8a-8487-327490f8488c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:18.996407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d38eae1-a7c4-4e8a-8487-327490f8488c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:18.997176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d38eae1-a7c4-4e8a-8487-327490f8488c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:18.997613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d38eae1-a7c4-4e8a-8487-327490f8488c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:19.085034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-0d38eae1-a7c4-4e8a-8487-327490f8488c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lazy-loading 'services' on Instance uuid 4189aed4-6191-4909-900d-85a86bf44937 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:19:19.167493 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0d38eae1-a7c4-4e8a-8487-327490f8488c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments/121fc2bb-194e-496c-9b0b-fdda17c82476" status: 202 len: 0 microversion: 2.1 time: 0.186197 Jul 28 04:19:19.168532 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3841/6291] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:19:18 2022] DELETE /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments/121fc2bb-194e-496c-9b0b-fdda17c82476 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:19:19.937065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f671e365-660b-4d4f-ac30-2976e4dd1aab tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:19.937831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f671e365-660b-4d4f-ac30-2976e4dd1aab tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:19.944566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f671e365-660b-4d4f-ac30-2976e4dd1aab tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:19.945161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f671e365-660b-4d4f-ac30-2976e4dd1aab tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:19.946075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f671e365-660b-4d4f-ac30-2976e4dd1aab tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:19.946512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f671e365-660b-4d4f-ac30-2976e4dd1aab tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:20.096104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f671e365-660b-4d4f-ac30-2976e4dd1aab tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:20.104395 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f671e365-660b-4d4f-ac30-2976e4dd1aab tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1269 microversion: 2.1 time: 0.172776 Jul 28 04:19:20.105137 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3842/6292] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:19 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:21.127569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-003e4f63-39ca-4715-b01f-bbe0f6fdb7f4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:21.128759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-003e4f63-39ca-4715-b01f-bbe0f6fdb7f4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:21.136789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-003e4f63-39ca-4715-b01f-bbe0f6fdb7f4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:21.137247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-003e4f63-39ca-4715-b01f-bbe0f6fdb7f4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:21.138059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-003e4f63-39ca-4715-b01f-bbe0f6fdb7f4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:21.138490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-003e4f63-39ca-4715-b01f-bbe0f6fdb7f4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:21.293361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-003e4f63-39ca-4715-b01f-bbe0f6fdb7f4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:21.302078 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-003e4f63-39ca-4715-b01f-bbe0f6fdb7f4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1269 microversion: 2.1 time: 0.180073 Jul 28 04:19:21.304399 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3843/6293] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:21 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1269 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:22.323695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a31aa4a7-4788-423c-9af9-1cbab7e926d1 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:22.325232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a31aa4a7-4788-423c-9af9-1cbab7e926d1 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:22.333147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a31aa4a7-4788-423c-9af9-1cbab7e926d1 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:22.333542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a31aa4a7-4788-423c-9af9-1cbab7e926d1 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:22.334532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a31aa4a7-4788-423c-9af9-1cbab7e926d1 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:22.335163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a31aa4a7-4788-423c-9af9-1cbab7e926d1 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:22.512761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a31aa4a7-4788-423c-9af9-1cbab7e926d1 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:22.522900 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a31aa4a7-4788-423c-9af9-1cbab7e926d1 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1269 microversion: 2.1 time: 0.203300 Jul 28 04:19:22.524111 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3844/6294] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:22 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1269 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:22.530458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-506e0c21-27b8-4184-b1cd-03da8747cee3 req-f10677e5-1ef2-4093-83c3-57a2c0fadb81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6d450a-8532-4cdf-8309-68c151e825ca", "name": "network-vif-plugged", "status": "completed", "tag": "a36e5144-1abc-486b-93ff-864d591726ec"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:22.542705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-506e0c21-27b8-4184-b1cd-03da8747cee3 req-f10677e5-1ef2-4093-83c3-57a2c0fadb81 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:22.543567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-506e0c21-27b8-4184-b1cd-03da8747cee3 req-f10677e5-1ef2-4093-83c3-57a2c0fadb81 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:22.550165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:19:22.560649 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-506e0c21-27b8-4184-b1cd-03da8747cee3 req-f10677e5-1ef2-4093-83c3-57a2c0fadb81 service nova] Creating event network-vif-plugged:a36e5144-1abc-486b-93ff-864d591726ec for instance 3f6d450a-8532-4cdf-8309-68c151e825ca on n-h2-826756-3 Jul 28 04:19:22.567599 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-506e0c21-27b8-4184-b1cd-03da8747cee3 req-f10677e5-1ef2-4093-83c3-57a2c0fadb81 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040933 Jul 28 04:19:22.568653 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3845/6295] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:23.547114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c738bf1e-9f12-43c9-ab75-418abdc9e6d3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:23.548908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c738bf1e-9f12-43c9-ab75-418abdc9e6d3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:23.552152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:19:23.559407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c738bf1e-9f12-43c9-ab75-418abdc9e6d3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:23.559860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c738bf1e-9f12-43c9-ab75-418abdc9e6d3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:23.560676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c738bf1e-9f12-43c9-ab75-418abdc9e6d3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:23.561116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c738bf1e-9f12-43c9-ab75-418abdc9e6d3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:23.720735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c738bf1e-9f12-43c9-ab75-418abdc9e6d3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:23.731790 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c738bf1e-9f12-43c9-ab75-418abdc9e6d3 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1269 microversion: 2.1 time: 0.189834 Jul 28 04:19:23.732909 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3846/6296] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:23 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1269 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:24.627737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b2ee194-fe10-4fac-bbd4-88506a40de89 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:24.630039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5b2ee194-fe10-4fac-bbd4-88506a40de89 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:24.637440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b2ee194-fe10-4fac-bbd4-88506a40de89 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:24.637916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b2ee194-fe10-4fac-bbd4-88506a40de89 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:24.638672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b2ee194-fe10-4fac-bbd4-88506a40de89 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:24.639108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b2ee194-fe10-4fac-bbd4-88506a40de89 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:24.673511 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5b2ee194-fe10-4fac-bbd4-88506a40de89 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049805 Jul 28 04:19:24.674108 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3847/6297] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:19:24 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 04:19:24.754607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a57dbf5f-43c8-44fa-b0f9-1d0135af0339 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:24.755213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a57dbf5f-43c8-44fa-b0f9-1d0135af0339 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:24.761441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a57dbf5f-43c8-44fa-b0f9-1d0135af0339 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:24.761893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a57dbf5f-43c8-44fa-b0f9-1d0135af0339 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:24.762655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a57dbf5f-43c8-44fa-b0f9-1d0135af0339 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:24.763110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a57dbf5f-43c8-44fa-b0f9-1d0135af0339 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:24.906913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a57dbf5f-43c8-44fa-b0f9-1d0135af0339 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:24.915345 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a57dbf5f-43c8-44fa-b0f9-1d0135af0339 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1457 microversion: 2.1 time: 0.165010 Jul 28 04:19:24.915913 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3848/6298] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:24 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1457 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:24.920567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4e08fd7-60d7-4176-8d4b-298b962693a0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:24.922724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4e08fd7-60d7-4176-8d4b-298b962693a0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:24.928824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4e08fd7-60d7-4176-8d4b-298b962693a0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:24.929266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4e08fd7-60d7-4176-8d4b-298b962693a0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:24.930031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4e08fd7-60d7-4176-8d4b-298b962693a0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:24.930460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4e08fd7-60d7-4176-8d4b-298b962693a0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:24.971537 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4e08fd7-60d7-4176-8d4b-298b962693a0 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054514 Jul 28 04:19:24.972106 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3849/6299] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:19:24 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:19:24.976642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b93057da-e230-4feb-ad10-19a96a8d649d tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:24.977257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b93057da-e230-4feb-ad10-19a96a8d649d tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:24.983446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b93057da-e230-4feb-ad10-19a96a8d649d tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:24.983897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b93057da-e230-4feb-ad10-19a96a8d649d tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:24.984693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b93057da-e230-4feb-ad10-19a96a8d649d tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:24.985128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b93057da-e230-4feb-ad10-19a96a8d649d tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:25.127533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b93057da-e230-4feb-ad10-19a96a8d649d tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:25.135520 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b93057da-e230-4feb-ad10-19a96a8d649d tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1457 microversion: 2.1 time: 0.162340 Jul 28 04:19:25.136242 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3850/6300] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:24 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1457 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:25.141771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d9e0410-8f2c-46f1-9a54-9403a58d5293 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:25.142297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d9e0410-8f2c-46f1-9a54-9403a58d5293 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:25.148681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d9e0410-8f2c-46f1-9a54-9403a58d5293 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:25.149130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d9e0410-8f2c-46f1-9a54-9403a58d5293 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:25.149912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d9e0410-8f2c-46f1-9a54-9403a58d5293 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:25.150421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d9e0410-8f2c-46f1-9a54-9403a58d5293 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:25.178573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d9e0410-8f2c-46f1-9a54-9403a58d5293 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:19:25.268439 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d9e0410-8f2c-46f1-9a54-9403a58d5293 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 204 len: 0 microversion: 2.1 time: 0.128719 Jul 28 04:19:25.268439 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3851/6301] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:19:25 2022] DELETE /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:19:25.277583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-810dcc7e-52a8-449d-bde8-04a818e89cf3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:25.278289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-810dcc7e-52a8-449d-bde8-04a818e89cf3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:25.287516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-810dcc7e-52a8-449d-bde8-04a818e89cf3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:25.288105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-810dcc7e-52a8-449d-bde8-04a818e89cf3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:25.289019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-810dcc7e-52a8-449d-bde8-04a818e89cf3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:25.289461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-810dcc7e-52a8-449d-bde8-04a818e89cf3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:25.503132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-810dcc7e-52a8-449d-bde8-04a818e89cf3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:25.511429 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-810dcc7e-52a8-449d-bde8-04a818e89cf3 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 200 len: 1670 microversion: 2.1 time: 0.238034 Jul 28 04:19:25.512023 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3852/6302] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:25 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 1670 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:26.537503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a0796786-9291-4e2c-b8c8-c1da1e44ffa5 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:26.538128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a0796786-9291-4e2c-b8c8-c1da1e44ffa5 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:26.547341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0796786-9291-4e2c-b8c8-c1da1e44ffa5 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:26.547859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0796786-9291-4e2c-b8c8-c1da1e44ffa5 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:26.548687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0796786-9291-4e2c-b8c8-c1da1e44ffa5 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:26.549383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0796786-9291-4e2c-b8c8-c1da1e44ffa5 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:26.813103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a0796786-9291-4e2c-b8c8-c1da1e44ffa5 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:26.823888 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a0796786-9291-4e2c-b8c8-c1da1e44ffa5 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 200 len: 1670 microversion: 2.1 time: 0.293594 Jul 28 04:19:26.824648 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3853/6303] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:26 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 1670 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:27.206741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b153a6e8-5e9d-44f5-9282-c56e5595e5f7 req-3f1a8622-b245-43c7-be7e-8f6a4f69262f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f6d450a-8532-4cdf-8309-68c151e825ca", "tag": "a36e5144-1abc-486b-93ff-864d591726ec"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:27.222935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b153a6e8-5e9d-44f5-9282-c56e5595e5f7 req-3f1a8622-b245-43c7-be7e-8f6a4f69262f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:27.224939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b153a6e8-5e9d-44f5-9282-c56e5595e5f7 req-3f1a8622-b245-43c7-be7e-8f6a4f69262f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:27.253367 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b153a6e8-5e9d-44f5-9282-c56e5595e5f7 req-3f1a8622-b245-43c7-be7e-8f6a4f69262f service nova] Creating event network-changed:a36e5144-1abc-486b-93ff-864d591726ec for instance 3f6d450a-8532-4cdf-8309-68c151e825ca on n-h2-826756-3 Jul 28 04:19:27.262643 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b153a6e8-5e9d-44f5-9282-c56e5595e5f7 req-3f1a8622-b245-43c7-be7e-8f6a4f69262f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063788 Jul 28 04:19:27.266918 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3854/6304] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:27.863651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c243e67-ff03-4f61-90b7-cfc8c01a690e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:27.866344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c243e67-ff03-4f61-90b7-cfc8c01a690e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:27.882433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c243e67-ff03-4f61-90b7-cfc8c01a690e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:27.882892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c243e67-ff03-4f61-90b7-cfc8c01a690e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:27.883683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c243e67-ff03-4f61-90b7-cfc8c01a690e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:27.884123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c243e67-ff03-4f61-90b7-cfc8c01a690e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:28.146782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1c243e67-ff03-4f61-90b7-cfc8c01a690e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:28.160184 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c243e67-ff03-4f61-90b7-cfc8c01a690e tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 200 len: 1670 microversion: 2.1 time: 0.316512 Jul 28 04:19:28.161435 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3855/6305] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:27 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 1670 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:28.880497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-32439a81-bef1-4e26-9df4-db8c5ff1a102 req-1e024e10-b541-46dc-8795-0f3591a35e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4189aed4-6191-4909-900d-85a86bf44937", "name": "network-vif-deleted", "tag": "b0b434e1-a32e-4421-bd80-16b30d54f1ed"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:28.901288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-32439a81-bef1-4e26-9df4-db8c5ff1a102 req-1e024e10-b541-46dc-8795-0f3591a35e91 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:28.902352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-32439a81-bef1-4e26-9df4-db8c5ff1a102 req-1e024e10-b541-46dc-8795-0f3591a35e91 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:28.921657 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-32439a81-bef1-4e26-9df4-db8c5ff1a102 req-1e024e10-b541-46dc-8795-0f3591a35e91 service nova] Creating event network-vif-deleted:b0b434e1-a32e-4421-bd80-16b30d54f1ed for instance 4189aed4-6191-4909-900d-85a86bf44937 on n-h1-826756-3 Jul 28 04:19:28.929178 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-32439a81-bef1-4e26-9df4-db8c5ff1a102 req-1e024e10-b541-46dc-8795-0f3591a35e91 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057202 Jul 28 04:19:28.930807 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3856/6306] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:29.358563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ea626cf5-11b4-418e-9ff0-917e19dd8082 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:29.359463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ea626cf5-11b4-418e-9ff0-917e19dd8082 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:29.366331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea626cf5-11b4-418e-9ff0-917e19dd8082 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:29.367067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea626cf5-11b4-418e-9ff0-917e19dd8082 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:29.368007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea626cf5-11b4-418e-9ff0-917e19dd8082 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:29.368829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea626cf5-11b4-418e-9ff0-917e19dd8082 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:29.418218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea626cf5-11b4-418e-9ff0-917e19dd8082 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:29.419065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea626cf5-11b4-418e-9ff0-917e19dd8082 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:29.419746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-ea626cf5-11b4-418e-9ff0-917e19dd8082 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lazy-loading 'fault' on Instance uuid 4189aed4-6191-4909-900d-85a86bf44937 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:19:29.471634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ea626cf5-11b4-418e-9ff0-917e19dd8082 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60995164494047448eaccf6c93997d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55b218635b214337bf26fb6aec7303d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:29.479418 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ea626cf5-11b4-418e-9ff0-917e19dd8082 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 200 len: 1328 microversion: 2.1 time: 0.301128 Jul 28 04:19:29.480120 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3857/6307] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:29 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 1328 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:29.485168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-26e417da-bf7d-43bd-95b1-3e4e13781360 req-3675c9c4-f02d-427c-86a0-32aada5e3066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f6d450a-8532-4cdf-8309-68c151e825ca", "tag": "a36e5144-1abc-486b-93ff-864d591726ec"}, {"name": "network-changed", "server_uuid": "3f6d450a-8532-4cdf-8309-68c151e825ca", "tag": "a36e5144-1abc-486b-93ff-864d591726ec"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:29.496268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-26e417da-bf7d-43bd-95b1-3e4e13781360 req-3675c9c4-f02d-427c-86a0-32aada5e3066 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:29.498176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-26e417da-bf7d-43bd-95b1-3e4e13781360 req-3675c9c4-f02d-427c-86a0-32aada5e3066 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:29.515668 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-26e417da-bf7d-43bd-95b1-3e4e13781360 req-3675c9c4-f02d-427c-86a0-32aada5e3066 service nova] Creating event network-changed:a36e5144-1abc-486b-93ff-864d591726ec for instance 3f6d450a-8532-4cdf-8309-68c151e825ca on n-h2-826756-3 Jul 28 04:19:29.516682 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-26e417da-bf7d-43bd-95b1-3e4e13781360 req-3675c9c4-f02d-427c-86a0-32aada5e3066 service nova] Creating event network-changed:a36e5144-1abc-486b-93ff-864d591726ec for instance 3f6d450a-8532-4cdf-8309-68c151e825ca on n-h2-826756-3 Jul 28 04:19:29.526276 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-26e417da-bf7d-43bd-95b1-3e4e13781360 req-3675c9c4-f02d-427c-86a0-32aada5e3066 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044368 Jul 28 04:19:29.527619 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3858/6308] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:30.509086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51c07a51-6724-490d-bcc4-9b0f07025101 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:30.510535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-51c07a51-6724-490d-bcc4-9b0f07025101 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:30.519529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51c07a51-6724-490d-bcc4-9b0f07025101 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:30.520061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51c07a51-6724-490d-bcc4-9b0f07025101 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:30.520989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51c07a51-6724-490d-bcc4-9b0f07025101 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:30.521436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51c07a51-6724-490d-bcc4-9b0f07025101 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:30.538323 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-51c07a51-6724-490d-bcc4-9b0f07025101 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] HTTP exception thrown: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51c07a51-6724-490d-bcc4-9b0f07025101 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Request method failure captured: Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 HTTP/1.1 Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g0kMg1K5hpfmz-a8IUXOMReG1BbZUaF6pS6IFOkFvM5fRULTePEgqJ3w_e1yaxolCkL3isqF02IAM5llz2Az6h2MkC4wlTnG9AGAYRDfzYXkhSw3F08T6_rQW5VzFu6NkHXp1f8cet85WP0nkJwP8qo1tZj2R3H8bg5YeF0ONBw-4w Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 55b218635b214337bf26fb6aec7303d1 Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/55b218635b214337bf26fb6aec7303d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/55b218635b214337bf26fb6aec7303d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_55b218635b214337bf26fb6aec7303d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/55b218635b214337bf26fb6aec7303d1"}]}] Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 55b218635b214337bf26fb6aec7303d1 Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeTestJSON-223307208-project Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 60995164494047448eaccf6c93997d69 Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeTestJSON-223307208-project Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '4189aed4-6191-4909-900d-85a86bf44937'} Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:19:30.538784 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:30.544480 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:30.544480 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:19:30.544480 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:19:30.544480 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:19:30.544480 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:19:30.544480 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:30.544480 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:30.544480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51c07a51-6724-490d-bcc4-9b0f07025101 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Returning 404 to user: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:19:30.544480 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51c07a51-6724-490d-bcc4-9b0f07025101 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 404 len: 111 microversion: 2.1 time: 0.036362 Jul 28 04:19:30.544480 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3859/6309] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:30 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:19:30.550685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-079e458a-8c74-4f0b-bea4-c2a8e6079109 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '.version_select at 0x7ffa66e651f0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:30.572773 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-079e458a-8c74-4f0b-bea4-c2a8e6079109 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822977653" status: 202 len: 0 microversion: 2.1 time: 0.026196 Jul 28 04:19:30.576734 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3860/6310] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 04:19:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1822977653 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:19:36.484795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-898f8235-4ef3-4a34-9cf5-a6179eca2f10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:36.487621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-898f8235-4ef3-4a34-9cf5-a6179eca2f10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:36.497971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-898f8235-4ef3-4a34-9cf5-a6179eca2f10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:36.498431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-898f8235-4ef3-4a34-9cf5-a6179eca2f10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:36.499228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-898f8235-4ef3-4a34-9cf5-a6179eca2f10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:36.499668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-898f8235-4ef3-4a34-9cf5-a6179eca2f10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:36.553320 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-898f8235-4ef3-4a34-9cf5-a6179eca2f10 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c/action" status: 200 len: 24570 microversion: 2.1 time: 0.076316 Jul 28 04:19:36.560673 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3861/6311] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:19:36 2022] POST /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c/action => generated 24570 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 04:19:37.770041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9f694f17-db76-4227-9cd5-84694108d99c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:37.770690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9f694f17-db76-4227-9cd5-84694108d99c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:37.778567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f694f17-db76-4227-9cd5-84694108d99c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:37.779017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f694f17-db76-4227-9cd5-84694108d99c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:37.779798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f694f17-db76-4227-9cd5-84694108d99c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:37.780234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f694f17-db76-4227-9cd5-84694108d99c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:37.795664 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-9f694f17-db76-4227-9cd5-84694108d99c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] HTTP exception thrown: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9f694f17-db76-4227-9cd5-84694108d99c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Request method failure captured: Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 HTTP/1.1 Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g0kMg1K5hpfmz-a8IUXOMReG1BbZUaF6pS6IFOkFvM5fRULTePEgqJ3w_e1yaxolCkL3isqF02IAM5llz2Az6h2MkC4wlTnG9AGAYRDfzYXkhSw3F08T6_rQW5VzFu6NkHXp1f8cet85WP0nkJwP8qo1tZj2R3H8bg5YeF0ONBw-4w Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 55b218635b214337bf26fb6aec7303d1 Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/55b218635b214337bf26fb6aec7303d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/55b218635b214337bf26fb6aec7303d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_55b218635b214337bf26fb6aec7303d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/55b218635b214337bf26fb6aec7303d1"}]}] Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 55b218635b214337bf26fb6aec7303d1 Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeTestJSON-223307208-project Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 60995164494047448eaccf6c93997d69 Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeTestJSON-223307208-project Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '4189aed4-6191-4909-900d-85a86bf44937'} Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:19:37.797428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:19:37.802002 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:37.802002 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:37.802002 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:19:37.802002 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:37.802002 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:37.802002 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:19:37.802002 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:19:37.802002 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:19:37.802002 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:19:37.802002 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:37.802002 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:37.802002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9f694f17-db76-4227-9cd5-84694108d99c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Returning 404 to user: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:19:37.802002 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9f694f17-db76-4227-9cd5-84694108d99c tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 404 len: 111 microversion: 2.1 time: 0.033213 Jul 28 04:19:37.802002 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3862/6312] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:19:37 2022] DELETE /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:19:37.807925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-85c101c8-9b5b-4e10-a86e-96e5986a5209 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:37.808566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-85c101c8-9b5b-4e10-a86e-96e5986a5209 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: 4189aed4-6191-4909-900d-85a86bf44937] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:37.816486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85c101c8-9b5b-4e10-a86e-96e5986a5209 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:37.816936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85c101c8-9b5b-4e10-a86e-96e5986a5209 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:37.817709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85c101c8-9b5b-4e10-a86e-96e5986a5209 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:37.818139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85c101c8-9b5b-4e10-a86e-96e5986a5209 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:37.832730 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-85c101c8-9b5b-4e10-a86e-96e5986a5209 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] HTTP exception thrown: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-85c101c8-9b5b-4e10-a86e-96e5986a5209 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Request method failure captured: Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 HTTP/1.1 Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g0kMg1K5hpfmz-a8IUXOMReG1BbZUaF6pS6IFOkFvM5fRULTePEgqJ3w_e1yaxolCkL3isqF02IAM5llz2Az6h2MkC4wlTnG9AGAYRDfzYXkhSw3F08T6_rQW5VzFu6NkHXp1f8cet85WP0nkJwP8qo1tZj2R3H8bg5YeF0ONBw-4w Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 55b218635b214337bf26fb6aec7303d1 Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/55b218635b214337bf26fb6aec7303d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/55b218635b214337bf26fb6aec7303d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_55b218635b214337bf26fb6aec7303d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/55b218635b214337bf26fb6aec7303d1"}]}] Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 55b218635b214337bf26fb6aec7303d1 Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeTestJSON-223307208-project Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 60995164494047448eaccf6c93997d69 Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeTestJSON-223307208-project Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '4189aed4-6191-4909-900d-85a86bf44937'} Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:19:37.834272 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:37.839891 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:37.839891 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:19:37.839891 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:19:37.839891 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:19:37.839891 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:19:37.839891 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. Jul 28 04:19:37.839891 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:37.839891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-85c101c8-9b5b-4e10-a86e-96e5986a5209 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Returning 404 to user: Instance 4189aed4-6191-4909-900d-85a86bf44937 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:19:37.839891 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-85c101c8-9b5b-4e10-a86e-96e5986a5209 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937" status: 404 len: 111 microversion: 2.1 time: 0.032221 Jul 28 04:19:37.839891 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3863/6313] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:37 2022] GET /compute/v2.1/servers/4189aed4-6191-4909-900d-85a86bf44937 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:19:41.123607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97472a57-0b8c-47f9-a990-b546856d169b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:41.124618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-97472a57-0b8c-47f9-a990-b546856d169b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:41.135488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97472a57-0b8c-47f9-a990-b546856d169b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:41.135828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97472a57-0b8c-47f9-a990-b546856d169b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:41.136640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97472a57-0b8c-47f9-a990-b546856d169b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:41.137102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97472a57-0b8c-47f9-a990-b546856d169b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:41.158584 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-97472a57-0b8c-47f9-a990-b546856d169b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] HTTP exception thrown: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97472a57-0b8c-47f9-a990-b546856d169b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Request method failure captured: Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 HTTP/1.1 Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g0kMg1K5hpfmz-a8IUXOMReG1BbZUaF6pS6IFOkFvM5fRULTePEgqJ3w_e1yaxolCkL3isqF02IAM5llz2Az6h2MkC4wlTnG9AGAYRDfzYXkhSw3F08T6_rQW5VzFu6NkHXp1f8cet85WP0nkJwP8qo1tZj2R3H8bg5YeF0ONBw-4w Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 55b218635b214337bf26fb6aec7303d1 Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/55b218635b214337bf26fb6aec7303d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/55b218635b214337bf26fb6aec7303d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_55b218635b214337bf26fb6aec7303d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/55b218635b214337bf26fb6aec7303d1"}]}] Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 55b218635b214337bf26fb6aec7303d1 Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeTestJSON-223307208-project Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 60995164494047448eaccf6c93997d69 Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeTestJSON-223307208-project Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd6f60937-da1d-4d73-896f-2330f115f960'} Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:19:41.160169 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:19:41.164721 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:19:41.164721 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:41.164721 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:19:41.164721 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:41.164721 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:41.164721 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:19:41.164721 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:19:41.164721 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:19:41.164721 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:19:41.164721 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:19:41.164721 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:41.164721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97472a57-0b8c-47f9-a990-b546856d169b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Returning 404 to user: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:19:41.164721 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-97472a57-0b8c-47f9-a990-b546856d169b tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 404 len: 111 microversion: 2.1 time: 0.045080 Jul 28 04:19:41.164721 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3864/6314] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:19:41 2022] DELETE /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:19:41.170340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e9ad820e-1121-49cb-951b-071def9e9b87 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:41.170922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e9ad820e-1121-49cb-951b-071def9e9b87 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] [instance: d6f60937-da1d-4d73-896f-2330f115f960] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:41.177491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9ad820e-1121-49cb-951b-071def9e9b87 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:41.177949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9ad820e-1121-49cb-951b-071def9e9b87 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:41.178707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9ad820e-1121-49cb-951b-071def9e9b87 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:41.179144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e9ad820e-1121-49cb-951b-071def9e9b87 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:41.194370 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e9ad820e-1121-49cb-951b-071def9e9b87 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] HTTP exception thrown: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e9ad820e-1121-49cb-951b-071def9e9b87 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Request method failure captured: Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 HTTP/1.1 Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g0kMg1K5hpfmz-a8IUXOMReG1BbZUaF6pS6IFOkFvM5fRULTePEgqJ3w_e1yaxolCkL3isqF02IAM5llz2Az6h2MkC4wlTnG9AGAYRDfzYXkhSw3F08T6_rQW5VzFu6NkHXp1f8cet85WP0nkJwP8qo1tZj2R3H8bg5YeF0ONBw-4w Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 55b218635b214337bf26fb6aec7303d1 Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/55b218635b214337bf26fb6aec7303d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/55b218635b214337bf26fb6aec7303d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_55b218635b214337bf26fb6aec7303d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/55b218635b214337bf26fb6aec7303d1"}]}] Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 55b218635b214337bf26fb6aec7303d1 Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-AttachVolumeTestJSON-223307208 Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-AttachVolumeTestJSON-223307208-project Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 60995164494047448eaccf6c93997d69 Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-AttachVolumeTestJSON-223307208-project Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd6f60937-da1d-4d73-896f-2330f115f960'} Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:19:41.195981 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:41.202964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:19:41.202964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:19:41.202964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:19:41.202964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:19:41.202964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:19:41.202964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. Jul 28 04:19:41.202964 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:19:41.202964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e9ad820e-1121-49cb-951b-071def9e9b87 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] Returning 404 to user: Instance d6f60937-da1d-4d73-896f-2330f115f960 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:19:41.202964 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e9ad820e-1121-49cb-951b-071def9e9b87 tempest-AttachVolumeTestJSON-223307208 tempest-AttachVolumeTestJSON-223307208-project] 10.222.0.48 "GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960" status: 404 len: 111 microversion: 2.1 time: 0.030986 Jul 28 04:19:41.202964 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3865/6315] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:41 2022] GET /compute/v2.1/servers/d6f60937-da1d-4d73-896f-2330f115f960 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:19:42.955353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:42.958739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:42.967809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:42.968396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:42.969237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:42.969827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:43.072786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:19:43.073392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:19:43.073682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:19:43.074157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:19:43.074633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:19:43.084538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:19:43.149150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:43.157079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:43.157790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:43.158698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:43.159281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:43.203615 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90f2c5cb-c8ad-4f4e-a552-b8e7330be909 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c/action" status: 202 len: 1137 microversion: 2.1 time: 0.252362 Jul 28 04:19:43.205409 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3866/6316] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:19:42 2022] POST /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c/action => generated 1137 bytes in 254 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 28 04:19:43.228178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a72828a-f791-4dab-a503-0f344d6d42d6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:43.229598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7a72828a-f791-4dab-a503-0f344d6d42d6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:43.239976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a72828a-f791-4dab-a503-0f344d6d42d6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:43.239976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a72828a-f791-4dab-a503-0f344d6d42d6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:43.241514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a72828a-f791-4dab-a503-0f344d6d42d6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:43.242615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a72828a-f791-4dab-a503-0f344d6d42d6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:43.440174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a72828a-f791-4dab-a503-0f344d6d42d6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:43.449479 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7a72828a-f791-4dab-a503-0f344d6d42d6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1692 microversion: 2.1 time: 0.227325 Jul 28 04:19:43.450976 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3867/6317] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:43 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1692 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:44.480621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f9053df5-8ea6-487f-bb98-f1ee4c7cf566 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:44.482741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f9053df5-8ea6-487f-bb98-f1ee4c7cf566 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:44.502791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9053df5-8ea6-487f-bb98-f1ee4c7cf566 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:44.503446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9053df5-8ea6-487f-bb98-f1ee4c7cf566 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:44.504647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9053df5-8ea6-487f-bb98-f1ee4c7cf566 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:44.505382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9053df5-8ea6-487f-bb98-f1ee4c7cf566 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:44.710036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f9053df5-8ea6-487f-bb98-f1ee4c7cf566 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:44.721941 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f9053df5-8ea6-487f-bb98-f1ee4c7cf566 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1692 microversion: 2.1 time: 0.247779 Jul 28 04:19:44.723137 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3868/6318] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:44 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1692 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:45.746866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f9bdf11-7f90-4c96-b77f-0374e2e99c54 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:45.747642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6f9bdf11-7f90-4c96-b77f-0374e2e99c54 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:45.755564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f9bdf11-7f90-4c96-b77f-0374e2e99c54 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:45.756029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f9bdf11-7f90-4c96-b77f-0374e2e99c54 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:45.756861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f9bdf11-7f90-4c96-b77f-0374e2e99c54 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:45.757302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f9bdf11-7f90-4c96-b77f-0374e2e99c54 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:45.911316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6f9bdf11-7f90-4c96-b77f-0374e2e99c54 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:45.921198 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6f9bdf11-7f90-4c96-b77f-0374e2e99c54 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1692 microversion: 2.1 time: 0.178372 Jul 28 04:19:45.921789 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3869/6319] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:45 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:46.525558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6540d993-7b1c-4747-bf14-7f27195c0480 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:46.526229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6540d993-7b1c-4747-bf14-7f27195c0480 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:46.533277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6540d993-7b1c-4747-bf14-7f27195c0480 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:46.533727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6540d993-7b1c-4747-bf14-7f27195c0480 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:46.534503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6540d993-7b1c-4747-bf14-7f27195c0480 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:46.534934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6540d993-7b1c-4747-bf14-7f27195c0480 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:46.567600 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6540d993-7b1c-4747-bf14-7f27195c0480 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.046061 Jul 28 04:19:46.572590 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3870/6320] 10.222.0.48 () {58 vars in 1293 bytes} [Thu Jul 28 04:19:46 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f/os-server-password => generated 116 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:19:46.943968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a6df1a25-d72a-4ebd-84e1-154fda470711 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:46.944966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a6df1a25-d72a-4ebd-84e1-154fda470711 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:46.954173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6df1a25-d72a-4ebd-84e1-154fda470711 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:46.954641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6df1a25-d72a-4ebd-84e1-154fda470711 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:46.955417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6df1a25-d72a-4ebd-84e1-154fda470711 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:46.955872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6df1a25-d72a-4ebd-84e1-154fda470711 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:47.108235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a6df1a25-d72a-4ebd-84e1-154fda470711 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:47.116896 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a6df1a25-d72a-4ebd-84e1-154fda470711 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1692 microversion: 2.1 time: 0.177552 Jul 28 04:19:47.117269 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3871/6321] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:46 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:48.138788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-04827869-291f-4e44-b250-a497292648c6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:48.139856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-04827869-291f-4e44-b250-a497292648c6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:48.146306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04827869-291f-4e44-b250-a497292648c6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:48.146757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04827869-291f-4e44-b250-a497292648c6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:48.147542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04827869-291f-4e44-b250-a497292648c6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:48.147983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04827869-291f-4e44-b250-a497292648c6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:48.688055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-04827869-291f-4e44-b250-a497292648c6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:48.696246 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-04827869-291f-4e44-b250-a497292648c6 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1692 microversion: 2.1 time: 0.561343 Jul 28 04:19:48.697373 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3872/6322] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:48 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1692 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:49.718588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1d3bdca6-3e1b-4422-8570-76fd51876475 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:49.719373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1d3bdca6-3e1b-4422-8570-76fd51876475 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:49.727835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d3bdca6-3e1b-4422-8570-76fd51876475 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:49.728583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d3bdca6-3e1b-4422-8570-76fd51876475 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:49.729645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d3bdca6-3e1b-4422-8570-76fd51876475 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:49.730098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d3bdca6-3e1b-4422-8570-76fd51876475 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:49.895550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1d3bdca6-3e1b-4422-8570-76fd51876475 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:49.905006 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1d3bdca6-3e1b-4422-8570-76fd51876475 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1692 microversion: 2.1 time: 0.190512 Jul 28 04:19:49.905788 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3873/6323] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:49 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1692 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:50.927384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3ed6451-16d9-4762-8e76-924e791fcf3e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:50.928030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3ed6451-16d9-4762-8e76-924e791fcf3e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:50.935754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3ed6451-16d9-4762-8e76-924e791fcf3e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:50.936206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3ed6451-16d9-4762-8e76-924e791fcf3e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:50.937036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3ed6451-16d9-4762-8e76-924e791fcf3e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:50.937473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3ed6451-16d9-4762-8e76-924e791fcf3e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:51.082310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3ed6451-16d9-4762-8e76-924e791fcf3e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:51.092372 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3ed6451-16d9-4762-8e76-924e791fcf3e tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1692 microversion: 2.1 time: 0.168889 Jul 28 04:19:51.092974 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3874/6324] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:50 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:52.114674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-21c74563-df1d-465a-94a3-38572f85c500 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:52.115325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-21c74563-df1d-465a-94a3-38572f85c500 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:52.123845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21c74563-df1d-465a-94a3-38572f85c500 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:52.124279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21c74563-df1d-465a-94a3-38572f85c500 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:52.125142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21c74563-df1d-465a-94a3-38572f85c500 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:52.125585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-21c74563-df1d-465a-94a3-38572f85c500 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:52.284551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-21c74563-df1d-465a-94a3-38572f85c500 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:52.293072 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-21c74563-df1d-465a-94a3-38572f85c500 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1692 microversion: 2.1 time: 0.182351 Jul 28 04:19:52.293767 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3875/6325] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:52 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1692 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:53.319662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6e31d651-7bfe-445d-8d61-8c0fb59135d1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:53.320753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6e31d651-7bfe-445d-8d61-8c0fb59135d1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:53.329709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e31d651-7bfe-445d-8d61-8c0fb59135d1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:53.330128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e31d651-7bfe-445d-8d61-8c0fb59135d1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:53.330897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e31d651-7bfe-445d-8d61-8c0fb59135d1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:53.331525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e31d651-7bfe-445d-8d61-8c0fb59135d1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:53.473208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6e31d651-7bfe-445d-8d61-8c0fb59135d1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:53.482608 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6e31d651-7bfe-445d-8d61-8c0fb59135d1 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1692 microversion: 2.1 time: 0.170754 Jul 28 04:19:53.483205 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3876/6326] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:53 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:54.505216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-61d876d7-cca9-4ba2-ab1d-8a2a6cfa1a53 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:54.505889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61d876d7-cca9-4ba2-ab1d-8a2a6cfa1a53 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:54.509825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:19:54.517668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61d876d7-cca9-4ba2-ab1d-8a2a6cfa1a53 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:54.518129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61d876d7-cca9-4ba2-ab1d-8a2a6cfa1a53 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:54.519490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61d876d7-cca9-4ba2-ab1d-8a2a6cfa1a53 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:54.520040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61d876d7-cca9-4ba2-ab1d-8a2a6cfa1a53 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:54.680122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-61d876d7-cca9-4ba2-ab1d-8a2a6cfa1a53 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:54.689762 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-61d876d7-cca9-4ba2-ab1d-8a2a6cfa1a53 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1692 microversion: 2.1 time: 0.189126 Jul 28 04:19:54.690468 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3877/6327] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:54 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1692 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:55.715286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66249161-f00d-46b8-8761-a306a5e001bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:55.716048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-66249161-f00d-46b8-8761-a306a5e001bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:55.723658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66249161-f00d-46b8-8761-a306a5e001bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:55.724158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66249161-f00d-46b8-8761-a306a5e001bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:55.724966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66249161-f00d-46b8-8761-a306a5e001bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:55.725438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66249161-f00d-46b8-8761-a306a5e001bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:55.890448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-66249161-f00d-46b8-8761-a306a5e001bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:55.900078 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-66249161-f00d-46b8-8761-a306a5e001bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1698 microversion: 2.1 time: 0.189764 Jul 28 04:19:55.900968 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3878/6328] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:55 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1698 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:19:56.924038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80b5163e-e2eb-409a-98e8-e33a8f374969 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:56.924807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-80b5163e-e2eb-409a-98e8-e33a8f374969 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:56.932746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80b5163e-e2eb-409a-98e8-e33a8f374969 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:56.933289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80b5163e-e2eb-409a-98e8-e33a8f374969 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:56.934044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80b5163e-e2eb-409a-98e8-e33a8f374969 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:56.934488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80b5163e-e2eb-409a-98e8-e33a8f374969 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:57.124425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-80b5163e-e2eb-409a-98e8-e33a8f374969 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:57.134202 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-80b5163e-e2eb-409a-98e8-e33a8f374969 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1698 microversion: 2.1 time: 0.215280 Jul 28 04:19:57.135568 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3879/6329] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:56 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1698 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:58.161263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6fb501a7-e453-4830-9357-f737a32d1759 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:19:58.161948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6fb501a7-e453-4830-9357-f737a32d1759 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:19:58.168981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fb501a7-e453-4830-9357-f737a32d1759 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:58.169438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fb501a7-e453-4830-9357-f737a32d1759 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:58.170211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fb501a7-e453-4830-9357-f737a32d1759 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:58.170809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fb501a7-e453-4830-9357-f737a32d1759 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:58.311689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6fb501a7-e453-4830-9357-f737a32d1759 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:19:58.320506 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6fb501a7-e453-4830-9357-f737a32d1759 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1683 microversion: 2.1 time: 0.163203 Jul 28 04:19:58.321233 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3880/6330] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:19:58 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:19:58.681153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-83b01c3d-0376-44f7-88a7-c37f8dc712da req-00bb9ed4-4cc3-48b7-ad6a-efb0f4bede13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21fa492a-6661-4809-a0db-4a3b54d92f2c", "name": "network-vif-unplugged", "status": "completed", "tag": "487caa46-9ce6-40af-abbb-0553c1bbce2e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:19:58.697002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-83b01c3d-0376-44f7-88a7-c37f8dc712da req-00bb9ed4-4cc3-48b7-ad6a-efb0f4bede13 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:19:58.697999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-83b01c3d-0376-44f7-88a7-c37f8dc712da req-00bb9ed4-4cc3-48b7-ad6a-efb0f4bede13 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:19:58.721622 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-83b01c3d-0376-44f7-88a7-c37f8dc712da req-00bb9ed4-4cc3-48b7-ad6a-efb0f4bede13 service nova] Creating event network-vif-unplugged:487caa46-9ce6-40af-abbb-0553c1bbce2e for instance 21fa492a-6661-4809-a0db-4a3b54d92f2c on n-h1-826756-3 Jul 28 04:19:58.737304 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-83b01c3d-0376-44f7-88a7-c37f8dc712da req-00bb9ed4-4cc3-48b7-ad6a-efb0f4bede13 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061783 Jul 28 04:19:58.738899 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3881/6331] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:20:00.754774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-db02b330-2bf5-4796-b3d3-931761525b73 req-6bf0c87d-cb21-477b-8336-dca661961235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21fa492a-6661-4809-a0db-4a3b54d92f2c", "name": "network-vif-plugged", "status": "completed", "tag": "487caa46-9ce6-40af-abbb-0553c1bbce2e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:20:00.765951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-db02b330-2bf5-4796-b3d3-931761525b73 req-6bf0c87d-cb21-477b-8336-dca661961235 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:00.768868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-db02b330-2bf5-4796-b3d3-931761525b73 req-6bf0c87d-cb21-477b-8336-dca661961235 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:00.783504 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-db02b330-2bf5-4796-b3d3-931761525b73 req-6bf0c87d-cb21-477b-8336-dca661961235 service nova] Creating event network-vif-plugged:487caa46-9ce6-40af-abbb-0553c1bbce2e for instance 21fa492a-6661-4809-a0db-4a3b54d92f2c on n-h1-826756-3 Jul 28 04:20:00.788698 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-db02b330-2bf5-4796-b3d3-931761525b73 req-6bf0c87d-cb21-477b-8336-dca661961235 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039051 Jul 28 04:20:00.789697 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3882/6332] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:20:06.685720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-426f74c3-7a87-4b5e-a14f-c70dfc86a0a4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:06.686884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-426f74c3-7a87-4b5e-a14f-c70dfc86a0a4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:20:06.696621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-426f74c3-7a87-4b5e-a14f-c70dfc86a0a4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:06.697681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-426f74c3-7a87-4b5e-a14f-c70dfc86a0a4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:06.698712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-426f74c3-7a87-4b5e-a14f-c70dfc86a0a4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:06.699443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-426f74c3-7a87-4b5e-a14f-c70dfc86a0a4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:06.729146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:20:06.739800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-426f74c3-7a87-4b5e-a14f-c70dfc86a0a4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:20:06.850905 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-426f74c3-7a87-4b5e-a14f-c70dfc86a0a4 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 204 len: 0 microversion: 2.1 time: 0.170346 Jul 28 04:20:06.851580 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3883/6333] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:20:06 2022] DELETE /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:20:06.858041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-032a47c7-4100-46a3-ae27-26cf7854728c req-affc7cc3-b1e4-45e2-a695-53f3fdef80dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f6d450a-8532-4cdf-8309-68c151e825ca", "tag": "a36e5144-1abc-486b-93ff-864d591726ec"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:20:06.868920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-032a47c7-4100-46a3-ae27-26cf7854728c req-affc7cc3-b1e4-45e2-a695-53f3fdef80dd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:06.869366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-032a47c7-4100-46a3-ae27-26cf7854728c req-affc7cc3-b1e4-45e2-a695-53f3fdef80dd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:06.883565 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-032a47c7-4100-46a3-ae27-26cf7854728c req-affc7cc3-b1e4-45e2-a695-53f3fdef80dd service nova] Creating event network-changed:a36e5144-1abc-486b-93ff-864d591726ec for instance 3f6d450a-8532-4cdf-8309-68c151e825ca on n-h2-826756-3 Jul 28 04:20:06.889221 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-032a47c7-4100-46a3-ae27-26cf7854728c req-affc7cc3-b1e4-45e2-a695-53f3fdef80dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035882 Jul 28 04:20:06.890117 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3884/6334] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:20:06.896000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-461b40b6-38d6-4098-b17d-7b78570ad41e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:06.896792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-461b40b6-38d6-4098-b17d-7b78570ad41e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:20:06.905955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-461b40b6-38d6-4098-b17d-7b78570ad41e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:06.906657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-461b40b6-38d6-4098-b17d-7b78570ad41e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:06.907766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-461b40b6-38d6-4098-b17d-7b78570ad41e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:06.908226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-461b40b6-38d6-4098-b17d-7b78570ad41e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:07.124968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-461b40b6-38d6-4098-b17d-7b78570ad41e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:20:07.139079 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-461b40b6-38d6-4098-b17d-7b78570ad41e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1582 microversion: 2.1 time: 0.244350 Jul 28 04:20:07.154824 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3885/6335] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:20:06 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1582 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:20:08.161787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c3ebc9b1-9b76-4074-953c-19815ea4acb0 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:08.162498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c3ebc9b1-9b76-4074-953c-19815ea4acb0 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:20:08.170136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3ebc9b1-9b76-4074-953c-19815ea4acb0 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:08.170626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3ebc9b1-9b76-4074-953c-19815ea4acb0 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:08.171464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3ebc9b1-9b76-4074-953c-19815ea4acb0 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:08.171900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3ebc9b1-9b76-4074-953c-19815ea4acb0 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:08.330028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c3ebc9b1-9b76-4074-953c-19815ea4acb0 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:20:08.340528 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c3ebc9b1-9b76-4074-953c-19815ea4acb0 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1582 microversion: 2.1 time: 0.182883 Jul 28 04:20:08.341961 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3886/6336] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:20:08 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1582 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:20:09.362617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86e940ca-35bf-4046-a19d-c2e1031c4f95 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:09.363217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-86e940ca-35bf-4046-a19d-c2e1031c4f95 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:20:09.370021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86e940ca-35bf-4046-a19d-c2e1031c4f95 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:09.370625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86e940ca-35bf-4046-a19d-c2e1031c4f95 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:09.371388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86e940ca-35bf-4046-a19d-c2e1031c4f95 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:09.372383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86e940ca-35bf-4046-a19d-c2e1031c4f95 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:09.550216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-86e940ca-35bf-4046-a19d-c2e1031c4f95 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:20:09.558734 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-86e940ca-35bf-4046-a19d-c2e1031c4f95 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1582 microversion: 2.1 time: 0.200205 Jul 28 04:20:09.559920 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3887/6337] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:20:09 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1582 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:20:09.966631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-7a4b19c0-daa7-43cb-b031-4010e12a958a req-11bfd99b-8b63-430c-a666-1437b8bb329e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f6d450a-8532-4cdf-8309-68c151e825ca", "name": "network-vif-deleted", "tag": "a36e5144-1abc-486b-93ff-864d591726ec"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:20:09.977268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7a4b19c0-daa7-43cb-b031-4010e12a958a req-11bfd99b-8b63-430c-a666-1437b8bb329e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:09.977710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7a4b19c0-daa7-43cb-b031-4010e12a958a req-11bfd99b-8b63-430c-a666-1437b8bb329e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:09.989578 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-7a4b19c0-daa7-43cb-b031-4010e12a958a req-11bfd99b-8b63-430c-a666-1437b8bb329e service nova] Creating event network-vif-deleted:a36e5144-1abc-486b-93ff-864d591726ec for instance 3f6d450a-8532-4cdf-8309-68c151e825ca on n-h2-826756-3 Jul 28 04:20:09.994862 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-7a4b19c0-daa7-43cb-b031-4010e12a958a req-11bfd99b-8b63-430c-a666-1437b8bb329e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032483 Jul 28 04:20:09.995640 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3888/6338] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:20:10.582872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f78997fa-5d5f-430f-b134-68e79fcb2e5e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:10.584149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f78997fa-5d5f-430f-b134-68e79fcb2e5e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:20:10.593969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78997fa-5d5f-430f-b134-68e79fcb2e5e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:10.594482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78997fa-5d5f-430f-b134-68e79fcb2e5e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:10.595265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78997fa-5d5f-430f-b134-68e79fcb2e5e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:10.595695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f78997fa-5d5f-430f-b134-68e79fcb2e5e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:10.667685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f78997fa-5d5f-430f-b134-68e79fcb2e5e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:20:10.676121 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f78997fa-5d5f-430f-b134-68e79fcb2e5e tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1228 microversion: 2.1 time: 0.098718 Jul 28 04:20:10.676954 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3889/6339] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:20:10 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1228 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:20:11.698431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c2c58da-ae6b-4cf2-be5a-3993b453e31a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:11.699122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c2c58da-ae6b-4cf2-be5a-3993b453e31a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:20:11.706658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c2c58da-ae6b-4cf2-be5a-3993b453e31a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:11.707218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c2c58da-ae6b-4cf2-be5a-3993b453e31a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:11.708074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c2c58da-ae6b-4cf2-be5a-3993b453e31a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:11.708591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c2c58da-ae6b-4cf2-be5a-3993b453e31a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:11.778410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c2c58da-ae6b-4cf2-be5a-3993b453e31a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:20:11.787432 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c2c58da-ae6b-4cf2-be5a-3993b453e31a tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1228 microversion: 2.1 time: 0.093273 Jul 28 04:20:11.788572 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3890/6340] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:20:11 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1228 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:20:12.811528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c7882faf-f47f-4505-b126-2eab134fc769 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:12.814023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c7882faf-f47f-4505-b126-2eab134fc769 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:20:12.822146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7882faf-f47f-4505-b126-2eab134fc769 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:12.822862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7882faf-f47f-4505-b126-2eab134fc769 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:12.823794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7882faf-f47f-4505-b126-2eab134fc769 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:12.824200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7882faf-f47f-4505-b126-2eab134fc769 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:12.891504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c7882faf-f47f-4505-b126-2eab134fc769 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:20:12.900671 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c7882faf-f47f-4505-b126-2eab134fc769 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1228 microversion: 2.1 time: 0.095080 Jul 28 04:20:12.901581 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3891/6341] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:20:12 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1228 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:20:13.922233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1f07ebe-8118-487c-9b28-1b0123aaff61 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:13.923528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1f07ebe-8118-487c-9b28-1b0123aaff61 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:20:13.930666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1f07ebe-8118-487c-9b28-1b0123aaff61 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:13.931108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1f07ebe-8118-487c-9b28-1b0123aaff61 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:13.931957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1f07ebe-8118-487c-9b28-1b0123aaff61 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:13.932289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1f07ebe-8118-487c-9b28-1b0123aaff61 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:13.999925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b1f07ebe-8118-487c-9b28-1b0123aaff61 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d3964e666e42aa867f9a56b646d2ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25ca0e5d5034d549601f45179178c8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:20:14.009857 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1f07ebe-8118-487c-9b28-1b0123aaff61 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 200 len: 1228 microversion: 2.1 time: 0.091367 Jul 28 04:20:14.010500 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3892/6342] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:20:13 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 1228 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:20:15.031471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c8460f7c-fd9a-403d-a3c3-e3ff26775245 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:15.033484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c8460f7c-fd9a-403d-a3c3-e3ff26775245 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] [instance: 3f6d450a-8532-4cdf-8309-68c151e825ca] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:20:15.040156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8460f7c-fd9a-403d-a3c3-e3ff26775245 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:15.040839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8460f7c-fd9a-403d-a3c3-e3ff26775245 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:15.041785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8460f7c-fd9a-403d-a3c3-e3ff26775245 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:15.042403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8460f7c-fd9a-403d-a3c3-e3ff26775245 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:15.056848 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-c8460f7c-fd9a-403d-a3c3-e3ff26775245 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] HTTP exception thrown: Instance 3f6d450a-8532-4cdf-8309-68c151e825ca could not be found. Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c8460f7c-fd9a-403d-a3c3-e3ff26775245 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Request method failure captured: Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca HTTP/1.1 Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g2ncP1qmnTf8JQ7EZA7zHjXLO6SXsBXOFtOLZhUoLNhpFsYkUy2_7RKUeT3QRV6praPJmKKMnoa8fezDfbz-pNL_H_Hfb-sp4PqS6V1TYtYQEqATDJTKRW2Q8HcTloFffgUL3toKwGfxDqrxHKbtcIqD8PLwwv_e10darv8MTVZttQ Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: d25ca0e5d5034d549601f45179178c8e Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBackupRestore-251963257 Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d25ca0e5d5034d549601f45179178c8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d25ca0e5d5034d549601f45179178c8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d25ca0e5d5034d549601f45179178c8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d25ca0e5d5034d549601f45179178c8e"}]}] Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBackupRestore-251963257 Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: d25ca0e5d5034d549601f45179178c8e Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBackupRestore-251963257 Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBackupRestore-251963257-project Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 02d3964e666e42aa867f9a56b646d2ea Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBackupRestore-251963257-project Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 3f6d450a-8532-4cdf-8309-68c151e825ca could not be found. Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '3f6d450a-8532-4cdf-8309-68c151e825ca'} Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f6d450a-8532-4cdf-8309-68c151e825ca could not be found. Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f6d450a-8532-4cdf-8309-68c151e825ca could not be found. Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:20:15.058562 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:20:15.062778 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:20:15.062778 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:20:15.062778 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:20:15.062778 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:20:15.062778 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:20:15.062778 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f6d450a-8532-4cdf-8309-68c151e825ca could not be found. Jul 28 04:20:15.062778 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:20:15.062778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c8460f7c-fd9a-403d-a3c3-e3ff26775245 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Returning 404 to user: Instance 3f6d450a-8532-4cdf-8309-68c151e825ca could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:20:15.062778 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c8460f7c-fd9a-403d-a3c3-e3ff26775245 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca" status: 404 len: 111 microversion: 2.1 time: 0.032659 Jul 28 04:20:15.064081 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3893/6343] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:20:15 2022] GET /compute/v2.1/servers/3f6d450a-8532-4cdf-8309-68c151e825ca => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:20:15.243098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2449092-f92e-487a-882a-b04aa95e40c9 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] Calling method '.version_select at 0x7ffa66e414c0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:15.269626 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d2449092-f92e-487a-882a-b04aa95e40c9 tempest-TestVolumeBackupRestore-251963257 tempest-TestVolumeBackupRestore-251963257-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-166545779" status: 202 len: 0 microversion: 2.1 time: 0.030401 Jul 28 04:20:15.270202 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3894/6344] 10.222.0.48 () {58 vars in 1266 bytes} [Thu Jul 28 04:20:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-166545779 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:20:17.324838 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:20:17.325326 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:20:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:20:22.525881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd712513-9fb4-4a85-9cd7-589d43c31663 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:20:22.528176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd712513-9fb4-4a85-9cd7-589d43c31663 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:20:22.536121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd712513-9fb4-4a85-9cd7-589d43c31663 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:22.536701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd712513-9fb4-4a85-9cd7-589d43c31663 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:22.537478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd712513-9fb4-4a85-9cd7-589d43c31663 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:22.538142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd712513-9fb4-4a85-9cd7-589d43c31663 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:22.593721 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd712513-9fb4-4a85-9cd7-589d43c31663 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "POST /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c/action" status: 200 len: 24573 microversion: 2.1 time: 0.073049 Jul 28 04:20:22.594488 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3895/6345] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:20:22 2022] POST /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c/action => generated 24573 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 04:20:35.016564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c95d70b5-04a7-4a26-a87c-219f067ab2bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:35.017930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c95d70b5-04a7-4a26-a87c-219f067ab2bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:20:35.022412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:20:35.024011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:20:35.039249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c95d70b5-04a7-4a26-a87c-219f067ab2bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:35.039809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c95d70b5-04a7-4a26-a87c-219f067ab2bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:35.040709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c95d70b5-04a7-4a26-a87c-219f067ab2bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:35.041211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c95d70b5-04a7-4a26-a87c-219f067ab2bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:35.079617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c95d70b5-04a7-4a26-a87c-219f067ab2bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:20:35.175292 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c95d70b5-04a7-4a26-a87c-219f067ab2bc tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "DELETE /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 204 len: 0 microversion: 2.1 time: 0.163022 Jul 28 04:20:35.176376 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3896/6346] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:20:35 2022] DELETE /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:20:35.185684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b7b5e64c-958a-4580-b763-a4ae24c11143 req-950848d3-e6f5-4712-af10-34e7e7f6d168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21fa492a-6661-4809-a0db-4a3b54d92f2c", "tag": "487caa46-9ce6-40af-abbb-0553c1bbce2e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:20:35.197012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b7b5e64c-958a-4580-b763-a4ae24c11143 req-950848d3-e6f5-4712-af10-34e7e7f6d168 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:35.197458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b7b5e64c-958a-4580-b763-a4ae24c11143 req-950848d3-e6f5-4712-af10-34e7e7f6d168 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:35.210230 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b7b5e64c-958a-4580-b763-a4ae24c11143 req-950848d3-e6f5-4712-af10-34e7e7f6d168 service nova] Creating event network-changed:487caa46-9ce6-40af-abbb-0553c1bbce2e for instance 21fa492a-6661-4809-a0db-4a3b54d92f2c on n-h1-826756-3 Jul 28 04:20:35.215814 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b7b5e64c-958a-4580-b763-a4ae24c11143 req-950848d3-e6f5-4712-af10-34e7e7f6d168 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037725 Jul 28 04:20:35.217595 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3897/6347] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:20:35.222889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-500b1878-983b-43a0-aef1-1088e7bb341c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:35.223603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-500b1878-983b-43a0-aef1-1088e7bb341c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:20:35.230487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-500b1878-983b-43a0-aef1-1088e7bb341c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:35.230947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-500b1878-983b-43a0-aef1-1088e7bb341c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:35.231779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-500b1878-983b-43a0-aef1-1088e7bb341c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:35.232216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-500b1878-983b-43a0-aef1-1088e7bb341c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:35.648327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-500b1878-983b-43a0-aef1-1088e7bb341c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:20:35.656600 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-500b1878-983b-43a0-aef1-1088e7bb341c tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1689 microversion: 2.1 time: 0.437975 Jul 28 04:20:35.657225 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3898/6348] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:20:35 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1689 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:20:36.679431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b34d1fc1-1b67-4a48-a05a-1c653911c462 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:36.680107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b34d1fc1-1b67-4a48-a05a-1c653911c462 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:20:36.689821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b34d1fc1-1b67-4a48-a05a-1c653911c462 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:36.690250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b34d1fc1-1b67-4a48-a05a-1c653911c462 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:36.691194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b34d1fc1-1b67-4a48-a05a-1c653911c462 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:36.691819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b34d1fc1-1b67-4a48-a05a-1c653911c462 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:36.855776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b34d1fc1-1b67-4a48-a05a-1c653911c462 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63fc192385a7490aacce2d69bfc866ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea463b2785d46a08c278fa7041654e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:20:36.864676 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b34d1fc1-1b67-4a48-a05a-1c653911c462 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 200 len: 1689 microversion: 2.1 time: 0.189323 Jul 28 04:20:36.877073 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3899/6349] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:20:36 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 1689 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:20:37.199131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e25c25b1-a4ab-4b61-a82b-fb421f5db2d2 req-06761ebd-d7e6-4398-824c-af7fada67216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21fa492a-6661-4809-a0db-4a3b54d92f2c", "name": "network-vif-deleted", "tag": "487caa46-9ce6-40af-abbb-0553c1bbce2e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:20:37.211718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e25c25b1-a4ab-4b61-a82b-fb421f5db2d2 req-06761ebd-d7e6-4398-824c-af7fada67216 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:37.212245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e25c25b1-a4ab-4b61-a82b-fb421f5db2d2 req-06761ebd-d7e6-4398-824c-af7fada67216 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:37.225201 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e25c25b1-a4ab-4b61-a82b-fb421f5db2d2 req-06761ebd-d7e6-4398-824c-af7fada67216 service nova] Creating event network-vif-deleted:487caa46-9ce6-40af-abbb-0553c1bbce2e for instance 21fa492a-6661-4809-a0db-4a3b54d92f2c on n-h1-826756-3 Jul 28 04:20:37.231509 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e25c25b1-a4ab-4b61-a82b-fb421f5db2d2 req-06761ebd-d7e6-4398-824c-af7fada67216 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036159 Jul 28 04:20:37.232413 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3900/6350] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:20:37.888314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bc267a22-b600-4892-ac4d-506656fea17a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:37.889133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bc267a22-b600-4892-ac4d-506656fea17a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] [instance: 21fa492a-6661-4809-a0db-4a3b54d92f2c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:20:37.897207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc267a22-b600-4892-ac4d-506656fea17a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:37.897803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc267a22-b600-4892-ac4d-506656fea17a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:37.898680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc267a22-b600-4892-ac4d-506656fea17a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:20:37.899119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc267a22-b600-4892-ac4d-506656fea17a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:20:37.915871 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-bc267a22-b600-4892-ac4d-506656fea17a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] HTTP exception thrown: Instance 21fa492a-6661-4809-a0db-4a3b54d92f2c could not be found. Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bc267a22-b600-4892-ac4d-506656fea17a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Request method failure captured: Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c HTTP/1.1 Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4gy0wHx96BVxhyrDFvyRJsSuYIisOw-l-wszQ9XKSZbRRP5vlwalQKYK5hBNyy9WnKnKBmW3QuxEmH_3MqtnQ-B8fUcW5QF0OqJPqXMuA7juF0K-NDS0wf4uTw9P7GbriXF73fWwKh9phWFNUD6o7PkvGEVFYXU7L-2lzVhpHOKHQ8M Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7ea463b2785d46a08c278fa7041654e4 Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1842633679 Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7ea463b2785d46a08c278fa7041654e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ea463b2785d46a08c278fa7041654e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7ea463b2785d46a08c278fa7041654e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ea463b2785d46a08c278fa7041654e4"}]}] Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1842633679 Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7ea463b2785d46a08c278fa7041654e4 Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1842633679 Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestNetworkAdvancedServerOps-1842633679-project Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 63fc192385a7490aacce2d69bfc866ec Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1842633679-project Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 21fa492a-6661-4809-a0db-4a3b54d92f2c could not be found. Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '21fa492a-6661-4809-a0db-4a3b54d92f2c'} Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21fa492a-6661-4809-a0db-4a3b54d92f2c could not be found. Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21fa492a-6661-4809-a0db-4a3b54d92f2c could not be found. Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:20:37.917582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:20:37.922138 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:20:37.922138 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:20:37.922138 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:20:37.922138 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:20:37.922138 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:20:37.922138 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:20:37.922138 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21fa492a-6661-4809-a0db-4a3b54d92f2c could not be found. Jul 28 04:20:37.922138 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:20:37.925808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bc267a22-b600-4892-ac4d-506656fea17a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Returning 404 to user: Instance 21fa492a-6661-4809-a0db-4a3b54d92f2c could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:20:37.927029 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bc267a22-b600-4892-ac4d-506656fea17a tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c" status: 404 len: 111 microversion: 2.1 time: 0.043262 Jul 28 04:20:37.927649 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3901/6351] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:20:37 2022] GET /compute/v2.1/servers/21fa492a-6661-4809-a0db-4a3b54d92f2c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:20:43.089760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5e3089c-281b-4453-8f90-1856dd640e88 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] Calling method '.version_select at 0x7ffa6702e9d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:20:43.127197 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5e3089c-281b-4453-8f90-1856dd640e88 tempest-TestNetworkAdvancedServerOps-1842633679 tempest-TestNetworkAdvancedServerOps-1842633679-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1310326389" status: 202 len: 0 microversion: 2.1 time: 0.042301 Jul 28 04:20:43.131204 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3902/6352] 10.222.0.48 () {58 vars in 1284 bytes} [Thu Jul 28 04:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1310326389 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:21:04.855900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1524852689", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0e5ceff5-0996-4eb0-a817-629cf0135824", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:21:04.869196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:21:04.870656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:21:04.930788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] validate_networks() for [('601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:21:05.763797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:21:05.769107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:21:05.771338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:21:05.771830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:21:05.772322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:21:05.793620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:05.795200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:05.796110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:05.796736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:05.818717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:21:05.831703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for user 98c95cccd8d547a5bd528a3a3ca9fb4f and project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:21:05.924983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:21:05.928466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e5ceff5-0996-4eb0-a817-629cf0135824',volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:21:06.143467 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aeecb25a-6b27-4fa2-b688-738edff09aa6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.293021 Jul 28 04:21:06.143963 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3903/6353] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:21:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:21:06.159414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4de7914-4233-48ab-8ac1-6a7fb3681f8c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:06.160050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4de7914-4233-48ab-8ac1-6a7fb3681f8c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:06.238320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a4de7914-4233-48ab-8ac1-6a7fb3681f8c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:06.249924 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4de7914-4233-48ab-8ac1-6a7fb3681f8c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1057 microversion: 2.1 time: 0.094767 Jul 28 04:21:06.250943 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3904/6354] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:06 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1057 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:07.272701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c7b5401-3593-4b75-8d41-62e4fd3e2f0c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:07.274175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c7b5401-3593-4b75-8d41-62e4fd3e2f0c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:07.288787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c7b5401-3593-4b75-8d41-62e4fd3e2f0c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:07.291195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c7b5401-3593-4b75-8d41-62e4fd3e2f0c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:07.292191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c7b5401-3593-4b75-8d41-62e4fd3e2f0c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:07.293312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c7b5401-3593-4b75-8d41-62e4fd3e2f0c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:07.629326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c7b5401-3593-4b75-8d41-62e4fd3e2f0c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:07.643235 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c7b5401-3593-4b75-8d41-62e4fd3e2f0c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1163 microversion: 2.1 time: 0.375133 Jul 28 04:21:07.645846 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3905/6355] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:07 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1163 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:08.665810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-11477aaa-9a15-4510-8a39-9f9ea5fd7af6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:08.666527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-11477aaa-9a15-4510-8a39-9f9ea5fd7af6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:08.680721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11477aaa-9a15-4510-8a39-9f9ea5fd7af6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:08.681290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11477aaa-9a15-4510-8a39-9f9ea5fd7af6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:08.683319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11477aaa-9a15-4510-8a39-9f9ea5fd7af6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:08.684886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11477aaa-9a15-4510-8a39-9f9ea5fd7af6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:08.881222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-11477aaa-9a15-4510-8a39-9f9ea5fd7af6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:08.892865 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-11477aaa-9a15-4510-8a39-9f9ea5fd7af6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1215 microversion: 2.1 time: 0.230489 Jul 28 04:21:08.894580 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3906/6356] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:08 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1215 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:09.066094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-adaf2e2f-1f35-49ba-9c0e-1316bf94a952 req-028c17c5-b010-46ef-8224-2194c502360d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db3e39f7-f577-4444-97c7-97dda7a686a4", "tag": "a431e744-4409-4ee2-bb33-c6d8e615bd7b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:21:09.085129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-adaf2e2f-1f35-49ba-9c0e-1316bf94a952 req-028c17c5-b010-46ef-8224-2194c502360d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:09.086057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-adaf2e2f-1f35-49ba-9c0e-1316bf94a952 req-028c17c5-b010-46ef-8224-2194c502360d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:09.099922 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-adaf2e2f-1f35-49ba-9c0e-1316bf94a952 req-028c17c5-b010-46ef-8224-2194c502360d service nova] Creating event network-changed:a431e744-4409-4ee2-bb33-c6d8e615bd7b for instance db3e39f7-f577-4444-97c7-97dda7a686a4 on n-h1-826756-3 Jul 28 04:21:09.107374 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-adaf2e2f-1f35-49ba-9c0e-1316bf94a952 req-028c17c5-b010-46ef-8224-2194c502360d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045986 Jul 28 04:21:09.126559 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3907/6357] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:21:09.916836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2d779a7c-c5dd-40a2-ab6d-76735bbdf1e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:09.919288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2d779a7c-c5dd-40a2-ab6d-76735bbdf1e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:09.926856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d779a7c-c5dd-40a2-ab6d-76735bbdf1e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:09.927599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d779a7c-c5dd-40a2-ab6d-76735bbdf1e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:09.928936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d779a7c-c5dd-40a2-ab6d-76735bbdf1e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:09.929585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d779a7c-c5dd-40a2-ab6d-76735bbdf1e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:10.111815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2d779a7c-c5dd-40a2-ab6d-76735bbdf1e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:10.120383 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2d779a7c-c5dd-40a2-ab6d-76735bbdf1e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1215 microversion: 2.1 time: 0.209041 Jul 28 04:21:10.121636 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3908/6358] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:09 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1215 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:11.151887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f7352b9b-e9df-4bb7-ac12-e2577de6bb6d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:11.152525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f7352b9b-e9df-4bb7-ac12-e2577de6bb6d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:11.166095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7352b9b-e9df-4bb7-ac12-e2577de6bb6d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:11.166946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7352b9b-e9df-4bb7-ac12-e2577de6bb6d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:11.168761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7352b9b-e9df-4bb7-ac12-e2577de6bb6d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:11.168761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7352b9b-e9df-4bb7-ac12-e2577de6bb6d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:11.344017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f7352b9b-e9df-4bb7-ac12-e2577de6bb6d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:11.352066 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f7352b9b-e9df-4bb7-ac12-e2577de6bb6d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1215 microversion: 2.1 time: 0.205529 Jul 28 04:21:11.352841 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3909/6359] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:11 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1215 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:12.378067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7cd53011-bad1-496a-a15f-e4ac658cd5ac tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:12.380675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7cd53011-bad1-496a-a15f-e4ac658cd5ac tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:12.396181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cd53011-bad1-496a-a15f-e4ac658cd5ac tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:12.407944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cd53011-bad1-496a-a15f-e4ac658cd5ac tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:12.409056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cd53011-bad1-496a-a15f-e4ac658cd5ac tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:12.409655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cd53011-bad1-496a-a15f-e4ac658cd5ac tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:12.638102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7cd53011-bad1-496a-a15f-e4ac658cd5ac tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:12.666988 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7cd53011-bad1-496a-a15f-e4ac658cd5ac tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1215 microversion: 2.1 time: 0.288169 Jul 28 04:21:12.669252 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3910/6360] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:12 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1215 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:13.692975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e5ad9252-8971-45ef-a876-39f2a0f1587f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:13.694339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e5ad9252-8971-45ef-a876-39f2a0f1587f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:13.702036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5ad9252-8971-45ef-a876-39f2a0f1587f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:13.702764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5ad9252-8971-45ef-a876-39f2a0f1587f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:13.703757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5ad9252-8971-45ef-a876-39f2a0f1587f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:13.704682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5ad9252-8971-45ef-a876-39f2a0f1587f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:13.923126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e5ad9252-8971-45ef-a876-39f2a0f1587f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:13.939533 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e5ad9252-8971-45ef-a876-39f2a0f1587f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1203 microversion: 2.1 time: 0.252723 Jul 28 04:21:13.940648 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3911/6361] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:13 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1203 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:14.968259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bab44585-03d2-44df-a2c2-64aeeb453102 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:14.969989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bab44585-03d2-44df-a2c2-64aeeb453102 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:14.978454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bab44585-03d2-44df-a2c2-64aeeb453102 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:14.979379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bab44585-03d2-44df-a2c2-64aeeb453102 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:14.980464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bab44585-03d2-44df-a2c2-64aeeb453102 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:14.981131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bab44585-03d2-44df-a2c2-64aeeb453102 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:15.173958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bab44585-03d2-44df-a2c2-64aeeb453102 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:15.182033 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bab44585-03d2-44df-a2c2-64aeeb453102 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1203 microversion: 2.1 time: 0.220418 Jul 28 04:21:15.195886 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3912/6362] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:14 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1203 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:21:16.203301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d33bd07-1531-4f8b-92d0-d1358337b22f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:16.203988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d33bd07-1531-4f8b-92d0-d1358337b22f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:16.211139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:21:16.213963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d33bd07-1531-4f8b-92d0-d1358337b22f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:16.214746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d33bd07-1531-4f8b-92d0-d1358337b22f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:16.216047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d33bd07-1531-4f8b-92d0-d1358337b22f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:16.216664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d33bd07-1531-4f8b-92d0-d1358337b22f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:16.243836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:21:16.454965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7d33bd07-1531-4f8b-92d0-d1358337b22f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:16.463922 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d33bd07-1531-4f8b-92d0-d1358337b22f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1203 microversion: 2.1 time: 0.264591 Jul 28 04:21:16.464548 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3913/6363] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:16 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1203 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:21:17.485907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6eec9e35-e1dd-40ed-9fd2-cdb955026725 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:17.486609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6eec9e35-e1dd-40ed-9fd2-cdb955026725 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:17.494395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6eec9e35-e1dd-40ed-9fd2-cdb955026725 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:17.494846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6eec9e35-e1dd-40ed-9fd2-cdb955026725 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:17.495776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6eec9e35-e1dd-40ed-9fd2-cdb955026725 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:17.496227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6eec9e35-e1dd-40ed-9fd2-cdb955026725 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:17.969107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6eec9e35-e1dd-40ed-9fd2-cdb955026725 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:17.977621 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6eec9e35-e1dd-40ed-9fd2-cdb955026725 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1203 microversion: 2.1 time: 0.495601 Jul 28 04:21:17.978643 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3914/6364] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:17 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1203 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:19.000482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-16992724-dc2b-4b38-ab34-76cec4e07647 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:19.001272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-16992724-dc2b-4b38-ab34-76cec4e07647 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:19.008712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16992724-dc2b-4b38-ab34-76cec4e07647 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:19.009172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16992724-dc2b-4b38-ab34-76cec4e07647 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:19.009956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16992724-dc2b-4b38-ab34-76cec4e07647 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:19.010398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16992724-dc2b-4b38-ab34-76cec4e07647 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:19.197740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-16992724-dc2b-4b38-ab34-76cec4e07647 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:19.212041 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-16992724-dc2b-4b38-ab34-76cec4e07647 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1203 microversion: 2.1 time: 0.215500 Jul 28 04:21:19.212765 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3915/6365] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:18 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1203 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:20.233888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d411019f-55da-40a5-8cdd-059eede52db4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:20.234583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d411019f-55da-40a5-8cdd-059eede52db4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:20.241654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d411019f-55da-40a5-8cdd-059eede52db4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:20.242131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d411019f-55da-40a5-8cdd-059eede52db4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:20.242911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d411019f-55da-40a5-8cdd-059eede52db4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:20.243350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d411019f-55da-40a5-8cdd-059eede52db4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:20.457064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d411019f-55da-40a5-8cdd-059eede52db4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:20.465797 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d411019f-55da-40a5-8cdd-059eede52db4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1203 microversion: 2.1 time: 0.235535 Jul 28 04:21:20.466382 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3916/6366] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:20 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1203 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:21:21.486805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ef08405c-7457-4876-8309-c627383e415e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:21.487749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ef08405c-7457-4876-8309-c627383e415e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:21.495299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef08405c-7457-4876-8309-c627383e415e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:21.495862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef08405c-7457-4876-8309-c627383e415e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:21.496901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef08405c-7457-4876-8309-c627383e415e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:21.497672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef08405c-7457-4876-8309-c627383e415e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:21.684410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ef08405c-7457-4876-8309-c627383e415e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:21.692913 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ef08405c-7457-4876-8309-c627383e415e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1203 microversion: 2.1 time: 0.210089 Jul 28 04:21:21.696399 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3917/6367] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:21 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1203 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:22.715433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d692f8d0-d11f-40b5-a08a-7e3429e8f5ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:22.716173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d692f8d0-d11f-40b5-a08a-7e3429e8f5ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:22.728757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d692f8d0-d11f-40b5-a08a-7e3429e8f5ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:22.729195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d692f8d0-d11f-40b5-a08a-7e3429e8f5ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:22.730191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d692f8d0-d11f-40b5-a08a-7e3429e8f5ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:22.730629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d692f8d0-d11f-40b5-a08a-7e3429e8f5ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:22.871496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d692f8d0-d11f-40b5-a08a-7e3429e8f5ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:22.882889 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d692f8d0-d11f-40b5-a08a-7e3429e8f5ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1203 microversion: 2.1 time: 0.171664 Jul 28 04:21:22.883726 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3918/6368] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:22 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:21:22.890164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-53b7e7ca-1c10-452f-97b7-5da625af0910 req-4ccaa21a-0f9e-4596-8b08-17eadf45526c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3e39f7-f577-4444-97c7-97dda7a686a4", "name": "network-vif-plugged", "status": "completed", "tag": "a431e744-4409-4ee2-bb33-c6d8e615bd7b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:21:22.902550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-53b7e7ca-1c10-452f-97b7-5da625af0910 req-4ccaa21a-0f9e-4596-8b08-17eadf45526c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:22.903105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-53b7e7ca-1c10-452f-97b7-5da625af0910 req-4ccaa21a-0f9e-4596-8b08-17eadf45526c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:22.916372 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-53b7e7ca-1c10-452f-97b7-5da625af0910 req-4ccaa21a-0f9e-4596-8b08-17eadf45526c service nova] Creating event network-vif-plugged:a431e744-4409-4ee2-bb33-c6d8e615bd7b for instance db3e39f7-f577-4444-97c7-97dda7a686a4 on n-h1-826756-3 Jul 28 04:21:22.921666 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-53b7e7ca-1c10-452f-97b7-5da625af0910 req-4ccaa21a-0f9e-4596-8b08-17eadf45526c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036283 Jul 28 04:21:22.922373 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3919/6369] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:21:23.904417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-45af458c-a00e-4a7c-b321-7cfadfd658e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:23.905080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-45af458c-a00e-4a7c-b321-7cfadfd658e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:23.912975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45af458c-a00e-4a7c-b321-7cfadfd658e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:23.913192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45af458c-a00e-4a7c-b321-7cfadfd658e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:23.913995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45af458c-a00e-4a7c-b321-7cfadfd658e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:23.914431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45af458c-a00e-4a7c-b321-7cfadfd658e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:24.069386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-45af458c-a00e-4a7c-b321-7cfadfd658e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:24.077988 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-45af458c-a00e-4a7c-b321-7cfadfd658e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1203 microversion: 2.1 time: 0.178008 Jul 28 04:21:24.078809 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3920/6370] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:23 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:25.099346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f951f84-3e26-4e95-94fe-511e4933a30f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:25.100005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2f951f84-3e26-4e95-94fe-511e4933a30f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:25.107328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f951f84-3e26-4e95-94fe-511e4933a30f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:25.107786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f951f84-3e26-4e95-94fe-511e4933a30f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:25.108599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f951f84-3e26-4e95-94fe-511e4933a30f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:25.109055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f951f84-3e26-4e95-94fe-511e4933a30f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:25.250369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2f951f84-3e26-4e95-94fe-511e4933a30f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:25.258366 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2f951f84-3e26-4e95-94fe-511e4933a30f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1390 microversion: 2.1 time: 0.163002 Jul 28 04:21:25.258959 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3921/6371] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:25 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:25.280656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6b276485-4f4a-40d6-b6b1-98dc4bc078c2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:25.281268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6b276485-4f4a-40d6-b6b1-98dc4bc078c2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:25.288215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b276485-4f4a-40d6-b6b1-98dc4bc078c2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:25.288690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b276485-4f4a-40d6-b6b1-98dc4bc078c2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:25.289457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b276485-4f4a-40d6-b6b1-98dc4bc078c2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:25.289888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b276485-4f4a-40d6-b6b1-98dc4bc078c2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:25.311049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:21:25.429324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6b276485-4f4a-40d6-b6b1-98dc4bc078c2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:25.437254 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6b276485-4f4a-40d6-b6b1-98dc4bc078c2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1390 microversion: 2.1 time: 0.160548 Jul 28 04:21:25.437885 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3922/6372] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:25 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:21:25.458496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dacb576d-92e8-462a-8150-4902d6e44d8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:25.459114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dacb576d-92e8-462a-8150-4902d6e44d8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:25.466229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dacb576d-92e8-462a-8150-4902d6e44d8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:25.466710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dacb576d-92e8-462a-8150-4902d6e44d8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:25.467501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dacb576d-92e8-462a-8150-4902d6e44d8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:25.467942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dacb576d-92e8-462a-8150-4902d6e44d8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:25.612475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dacb576d-92e8-462a-8150-4902d6e44d8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:25.621087 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dacb576d-92e8-462a-8150-4902d6e44d8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1390 microversion: 2.1 time: 0.166734 Jul 28 04:21:25.622131 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3923/6373] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:25 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:25.644207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc429b13-9b21-4d63-9a0c-0f7e1b2e3b3f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:25.645112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cc429b13-9b21-4d63-9a0c-0f7e1b2e3b3f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:25.660887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc429b13-9b21-4d63-9a0c-0f7e1b2e3b3f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:25.661339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc429b13-9b21-4d63-9a0c-0f7e1b2e3b3f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:25.662131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc429b13-9b21-4d63-9a0c-0f7e1b2e3b3f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:25.663039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc429b13-9b21-4d63-9a0c-0f7e1b2e3b3f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:25.689775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cc429b13-9b21-4d63-9a0c-0f7e1b2e3b3f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:21:25.778334 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cc429b13-9b21-4d63-9a0c-0f7e1b2e3b3f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "DELETE /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 204 len: 0 microversion: 2.1 time: 0.135755 Jul 28 04:21:25.778334 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3924/6374] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:21:25 2022] DELETE /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:21:25.786012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc89b7c9-420e-4614-b430-59d9a4f913a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:25.787616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dc89b7c9-420e-4614-b430-59d9a4f913a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:25.793899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc89b7c9-420e-4614-b430-59d9a4f913a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:25.794346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc89b7c9-420e-4614-b430-59d9a4f913a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:25.795120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc89b7c9-420e-4614-b430-59d9a4f913a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:25.795553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc89b7c9-420e-4614-b430-59d9a4f913a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:25.956672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dc89b7c9-420e-4614-b430-59d9a4f913a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:25.964691 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc89b7c9-420e-4614-b430-59d9a4f913a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1396 microversion: 2.1 time: 0.183015 Jul 28 04:21:25.965667 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3925/6375] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:25 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1396 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:26.987252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fbe133b1-41a0-4783-b5a8-a7cbbba99af7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:26.987865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fbe133b1-41a0-4783-b5a8-a7cbbba99af7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:26.996955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbe133b1-41a0-4783-b5a8-a7cbbba99af7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:26.998357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbe133b1-41a0-4783-b5a8-a7cbbba99af7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:26.999286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbe133b1-41a0-4783-b5a8-a7cbbba99af7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:26.999951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbe133b1-41a0-4783-b5a8-a7cbbba99af7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:27.201028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fbe133b1-41a0-4783-b5a8-a7cbbba99af7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:27.209671 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fbe133b1-41a0-4783-b5a8-a7cbbba99af7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1396 microversion: 2.1 time: 0.226671 Jul 28 04:21:27.210532 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3926/6376] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:26 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1396 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:28.085469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-74de6362-9838-497b-9e86-d56adacef22c req-d5dc1ef6-145e-4763-a4c5-fb13cf066758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db3e39f7-f577-4444-97c7-97dda7a686a4", "name": "network-vif-deleted", "tag": "a431e744-4409-4ee2-bb33-c6d8e615bd7b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:21:28.096142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-74de6362-9838-497b-9e86-d56adacef22c req-d5dc1ef6-145e-4763-a4c5-fb13cf066758 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:28.096902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-74de6362-9838-497b-9e86-d56adacef22c req-d5dc1ef6-145e-4763-a4c5-fb13cf066758 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:28.108329 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-74de6362-9838-497b-9e86-d56adacef22c req-d5dc1ef6-145e-4763-a4c5-fb13cf066758 service nova] Creating event network-vif-deleted:a431e744-4409-4ee2-bb33-c6d8e615bd7b for instance db3e39f7-f577-4444-97c7-97dda7a686a4 on n-h1-826756-3 Jul 28 04:21:28.113418 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-74de6362-9838-497b-9e86-d56adacef22c req-d5dc1ef6-145e-4763-a4c5-fb13cf066758 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236125 Jul 28 04:21:28.114047 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3927/6377] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:21:28.234687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fcd54b34-4294-46e2-b204-a6526ae24d47 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:28.235588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fcd54b34-4294-46e2-b204-a6526ae24d47 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:28.242635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcd54b34-4294-46e2-b204-a6526ae24d47 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:28.243088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcd54b34-4294-46e2-b204-a6526ae24d47 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:28.243867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcd54b34-4294-46e2-b204-a6526ae24d47 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:28.244721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcd54b34-4294-46e2-b204-a6526ae24d47 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:28.313169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fcd54b34-4294-46e2-b204-a6526ae24d47 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:28.321953 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fcd54b34-4294-46e2-b204-a6526ae24d47 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1188 microversion: 2.1 time: 0.091737 Jul 28 04:21:28.322772 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3928/6378] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:28 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:29.344798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d85d7efd-9840-4c62-a8f7-a82ec1e0265b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:29.346095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d85d7efd-9840-4c62-a8f7-a82ec1e0265b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:29.353812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d85d7efd-9840-4c62-a8f7-a82ec1e0265b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:29.354263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d85d7efd-9840-4c62-a8f7-a82ec1e0265b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:29.355235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d85d7efd-9840-4c62-a8f7-a82ec1e0265b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:29.355832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d85d7efd-9840-4c62-a8f7-a82ec1e0265b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:29.419902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d85d7efd-9840-4c62-a8f7-a82ec1e0265b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:29.441470 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d85d7efd-9840-4c62-a8f7-a82ec1e0265b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1188 microversion: 2.1 time: 0.100891 Jul 28 04:21:29.442467 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3929/6379] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:29 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1188 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:21:30.462372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a3181e68-99c7-46d3-a5d2-30067ced155b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:30.463105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a3181e68-99c7-46d3-a5d2-30067ced155b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:30.470582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3181e68-99c7-46d3-a5d2-30067ced155b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:30.471038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3181e68-99c7-46d3-a5d2-30067ced155b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:30.471822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3181e68-99c7-46d3-a5d2-30067ced155b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:30.472562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3181e68-99c7-46d3-a5d2-30067ced155b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:30.541649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a3181e68-99c7-46d3-a5d2-30067ced155b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:30.554285 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a3181e68-99c7-46d3-a5d2-30067ced155b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1188 microversion: 2.1 time: 0.095786 Jul 28 04:21:30.556125 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3930/6380] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:30 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:21:31.576190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51970365-4549-47a2-a138-7ca9be49d7aa tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:31.577170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-51970365-4549-47a2-a138-7ca9be49d7aa tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:31.584572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51970365-4549-47a2-a138-7ca9be49d7aa tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:31.585016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51970365-4549-47a2-a138-7ca9be49d7aa tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:31.585981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51970365-4549-47a2-a138-7ca9be49d7aa tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:31.586650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51970365-4549-47a2-a138-7ca9be49d7aa tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:31.659453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-51970365-4549-47a2-a138-7ca9be49d7aa tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:31.667781 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51970365-4549-47a2-a138-7ca9be49d7aa tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 200 len: 1188 microversion: 2.1 time: 0.096424 Jul 28 04:21:31.668398 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3931/6381] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:31 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 1188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:32.688955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca5300de-1de3-4c87-8add-e7f3af0f57a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:32.690244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca5300de-1de3-4c87-8add-e7f3af0f57a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: db3e39f7-f577-4444-97c7-97dda7a686a4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:32.697296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca5300de-1de3-4c87-8add-e7f3af0f57a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:32.697765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca5300de-1de3-4c87-8add-e7f3af0f57a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:32.698557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca5300de-1de3-4c87-8add-e7f3af0f57a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:32.698957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca5300de-1de3-4c87-8add-e7f3af0f57a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:32.712867 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-ca5300de-1de3-4c87-8add-e7f3af0f57a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance db3e39f7-f577-4444-97c7-97dda7a686a4 could not be found. Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca5300de-1de3-4c87-8add-e7f3af0f57a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 HTTP/1.1 Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance db3e39f7-f577-4444-97c7-97dda7a686a4 could not be found. Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'db3e39f7-f577-4444-97c7-97dda7a686a4'} Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db3e39f7-f577-4444-97c7-97dda7a686a4 could not be found. Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db3e39f7-f577-4444-97c7-97dda7a686a4 could not be found. Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:21:32.714548 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:21:32.721207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:21:32.721207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:21:32.721207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:21:32.721207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:21:32.721207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:21:32.721207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db3e39f7-f577-4444-97c7-97dda7a686a4 could not be found. Jul 28 04:21:32.721207 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:21:32.721207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca5300de-1de3-4c87-8add-e7f3af0f57a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance db3e39f7-f577-4444-97c7-97dda7a686a4 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:21:32.721207 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca5300de-1de3-4c87-8add-e7f3af0f57a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4" status: 404 len: 111 microversion: 2.1 time: 0.031486 Jul 28 04:21:32.721207 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3932/6382] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:32 2022] GET /compute/v2.1/servers/db3e39f7-f577-4444-97c7-97dda7a686a4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:21:37.815684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-682256187", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "20fd09c3-4c68-4669-9280-21c7e054a54a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:21:37.826816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:21:37.883870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] validate_networks() for [('601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:21:38.262807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:21:38.263375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:21:38.263973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:21:38.264521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:21:38.265036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:21:38.275442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:38.275928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:38.276758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:38.277198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:38.294811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:21:38.300242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for user 98c95cccd8d547a5bd528a3a3ca9fb4f and project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:21:38.366596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:21:38.368580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20fd09c3-4c68-4669-9280-21c7e054a54a',volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:21:38.512641 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aa6dbed0-3cc2-4a75-b4d5-e68ce122ced2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700523 Jul 28 04:21:38.513638 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3933/6383] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:21:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:21:38.524321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2b17bb43-74fe-4d78-8a02-16127f95e1da tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:38.524976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2b17bb43-74fe-4d78-8a02-16127f95e1da tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:38.585352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2b17bb43-74fe-4d78-8a02-16127f95e1da tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:38.593474 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2b17bb43-74fe-4d78-8a02-16127f95e1da tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1056 microversion: 2.1 time: 0.072872 Jul 28 04:21:38.594066 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3934/6384] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:38 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1056 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:21:39.614165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1dab5649-8424-4ee8-a24f-8d6d8404a4a5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:39.615254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1dab5649-8424-4ee8-a24f-8d6d8404a4a5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:39.675009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1dab5649-8424-4ee8-a24f-8d6d8404a4a5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:39.682450 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1dab5649-8424-4ee8-a24f-8d6d8404a4a5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1056 microversion: 2.1 time: 0.072278 Jul 28 04:21:39.683102 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3935/6385] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:39 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1056 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:21:40.703479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a9141d16-3717-41e0-a466-fdd66a0ca413 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:40.704069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a9141d16-3717-41e0-a466-fdd66a0ca413 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:40.758083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a9141d16-3717-41e0-a466-fdd66a0ca413 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:40.765368 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a9141d16-3717-41e0-a466-fdd66a0ca413 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1056 microversion: 2.1 time: 0.066104 Jul 28 04:21:40.766404 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3936/6386] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:40 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1056 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:41.787297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-92b85d41-5c1e-4f41-967d-045fd2c07ad0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:41.787953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-92b85d41-5c1e-4f41-967d-045fd2c07ad0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:41.843956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-92b85d41-5c1e-4f41-967d-045fd2c07ad0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:41.854920 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-92b85d41-5c1e-4f41-967d-045fd2c07ad0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1056 microversion: 2.1 time: 0.071493 Jul 28 04:21:41.855913 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3937/6387] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:41 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1056 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:42.882555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3fe8e8ca-3f7a-4787-a5cc-6b880088ae4b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:42.884944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3fe8e8ca-3f7a-4787-a5cc-6b880088ae4b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:42.896494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fe8e8ca-3f7a-4787-a5cc-6b880088ae4b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:42.897491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fe8e8ca-3f7a-4787-a5cc-6b880088ae4b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:42.898880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fe8e8ca-3f7a-4787-a5cc-6b880088ae4b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:42.899562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3fe8e8ca-3f7a-4787-a5cc-6b880088ae4b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:42.998926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3fe8e8ca-3f7a-4787-a5cc-6b880088ae4b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:43.009826 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3fe8e8ca-3f7a-4787-a5cc-6b880088ae4b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1172 microversion: 2.1 time: 0.135524 Jul 28 04:21:43.020444 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3938/6388] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:42 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1172 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:44.052951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-458313e8-e40f-4fd0-8d75-b33796d683ed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:44.053568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-458313e8-e40f-4fd0-8d75-b33796d683ed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:44.062444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-458313e8-e40f-4fd0-8d75-b33796d683ed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:44.062860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-458313e8-e40f-4fd0-8d75-b33796d683ed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:44.064026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-458313e8-e40f-4fd0-8d75-b33796d683ed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:44.064717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-458313e8-e40f-4fd0-8d75-b33796d683ed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:44.311784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-458313e8-e40f-4fd0-8d75-b33796d683ed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:44.330774 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-458313e8-e40f-4fd0-8d75-b33796d683ed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1214 microversion: 2.1 time: 0.301490 Jul 28 04:21:44.334107 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3939/6389] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:44 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1214 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:21:44.339833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-db5903f2-7825-4648-8c56-8b695c64ee85 req-f00c4b26-44ae-4675-b417-2c66c1734180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e61f69-fc13-4d2f-9900-53010dee84b7", "tag": "a48ca921-3539-4017-9fb6-2c95b1f20838"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:21:44.355169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-db5903f2-7825-4648-8c56-8b695c64ee85 req-f00c4b26-44ae-4675-b417-2c66c1734180 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:44.355621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-db5903f2-7825-4648-8c56-8b695c64ee85 req-f00c4b26-44ae-4675-b417-2c66c1734180 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:44.369185 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-db5903f2-7825-4648-8c56-8b695c64ee85 req-f00c4b26-44ae-4675-b417-2c66c1734180 service nova] Creating event network-changed:a48ca921-3539-4017-9fb6-2c95b1f20838 for instance a4e61f69-fc13-4d2f-9900-53010dee84b7 on n-h1-826756-3 Jul 28 04:21:44.376179 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-db5903f2-7825-4648-8c56-8b695c64ee85 req-f00c4b26-44ae-4675-b417-2c66c1734180 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040181 Jul 28 04:21:44.377501 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3940/6390] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:21:45.355596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-349c4e65-6469-45e3-847a-45cfa4dffd1e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:45.356280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-349c4e65-6469-45e3-847a-45cfa4dffd1e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:45.363490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-349c4e65-6469-45e3-847a-45cfa4dffd1e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:45.363943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-349c4e65-6469-45e3-847a-45cfa4dffd1e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:45.364738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-349c4e65-6469-45e3-847a-45cfa4dffd1e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:45.365172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-349c4e65-6469-45e3-847a-45cfa4dffd1e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:45.506218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-349c4e65-6469-45e3-847a-45cfa4dffd1e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:45.544495 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-349c4e65-6469-45e3-847a-45cfa4dffd1e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1214 microversion: 2.1 time: 0.193009 Jul 28 04:21:45.568639 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3941/6391] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:45 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:21:45.759961 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:21:45.760604 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:21:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:21:46.579451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f10c608-7d00-4a86-8f34-9f9eeb00622c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:46.580050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0f10c608-7d00-4a86-8f34-9f9eeb00622c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:46.587763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f10c608-7d00-4a86-8f34-9f9eeb00622c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:46.588207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f10c608-7d00-4a86-8f34-9f9eeb00622c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:46.589032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f10c608-7d00-4a86-8f34-9f9eeb00622c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:46.589469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f10c608-7d00-4a86-8f34-9f9eeb00622c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:46.729098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0f10c608-7d00-4a86-8f34-9f9eeb00622c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:46.738223 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0f10c608-7d00-4a86-8f34-9f9eeb00622c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1214 microversion: 2.1 time: 0.162776 Jul 28 04:21:46.738820 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3942/6392] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:46 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:47.761864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7161fdcc-005c-4f4e-ad78-b1f245d82c2d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:47.763043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7161fdcc-005c-4f4e-ad78-b1f245d82c2d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:47.772009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7161fdcc-005c-4f4e-ad78-b1f245d82c2d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:47.772726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7161fdcc-005c-4f4e-ad78-b1f245d82c2d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:47.773833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7161fdcc-005c-4f4e-ad78-b1f245d82c2d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:47.774533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7161fdcc-005c-4f4e-ad78-b1f245d82c2d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:47.918762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7161fdcc-005c-4f4e-ad78-b1f245d82c2d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:47.928793 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7161fdcc-005c-4f4e-ad78-b1f245d82c2d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1214 microversion: 2.1 time: 0.173347 Jul 28 04:21:47.929376 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3943/6393] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:47 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:48.951305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1174cc20-0781-4732-88dd-168d034b97d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:48.951981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1174cc20-0781-4732-88dd-168d034b97d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:48.953874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:21:48.962344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1174cc20-0781-4732-88dd-168d034b97d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:48.962762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1174cc20-0781-4732-88dd-168d034b97d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:48.963601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1174cc20-0781-4732-88dd-168d034b97d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:48.964036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1174cc20-0781-4732-88dd-168d034b97d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:48.969156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:21:49.117355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1174cc20-0781-4732-88dd-168d034b97d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:49.125463 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1174cc20-0781-4732-88dd-168d034b97d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1202 microversion: 2.1 time: 0.178309 Jul 28 04:21:49.126109 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3944/6394] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:48 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1202 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:50.150284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c2fccf0-3afc-4e9b-b1f8-0d83d7e06bfc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:50.150987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5c2fccf0-3afc-4e9b-b1f8-0d83d7e06bfc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:50.159141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c2fccf0-3afc-4e9b-b1f8-0d83d7e06bfc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:50.159680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c2fccf0-3afc-4e9b-b1f8-0d83d7e06bfc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:50.160887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c2fccf0-3afc-4e9b-b1f8-0d83d7e06bfc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:50.161164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c2fccf0-3afc-4e9b-b1f8-0d83d7e06bfc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:50.313424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5c2fccf0-3afc-4e9b-b1f8-0d83d7e06bfc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:50.323249 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5c2fccf0-3afc-4e9b-b1f8-0d83d7e06bfc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1202 microversion: 2.1 time: 0.176898 Jul 28 04:21:50.323849 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3945/6395] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:50 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1202 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:21:51.346029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d388ac4c-1d12-4833-bb2f-d3aa5f4d9e86 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:51.346842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d388ac4c-1d12-4833-bb2f-d3aa5f4d9e86 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:51.354520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d388ac4c-1d12-4833-bb2f-d3aa5f4d9e86 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:51.355721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d388ac4c-1d12-4833-bb2f-d3aa5f4d9e86 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:51.356650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d388ac4c-1d12-4833-bb2f-d3aa5f4d9e86 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:51.357203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d388ac4c-1d12-4833-bb2f-d3aa5f4d9e86 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:51.494860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d388ac4c-1d12-4833-bb2f-d3aa5f4d9e86 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:51.503408 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d388ac4c-1d12-4833-bb2f-d3aa5f4d9e86 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1202 microversion: 2.1 time: 0.161678 Jul 28 04:21:51.503992 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3946/6396] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:51 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:52.524957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dde877bf-3962-4e9e-a0d2-187c67ab5ef9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:52.525643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dde877bf-3962-4e9e-a0d2-187c67ab5ef9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:52.527521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=14 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:21:52.534137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dde877bf-3962-4e9e-a0d2-187c67ab5ef9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:52.534587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dde877bf-3962-4e9e-a0d2-187c67ab5ef9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:52.535358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dde877bf-3962-4e9e-a0d2-187c67ab5ef9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:52.535803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dde877bf-3962-4e9e-a0d2-187c67ab5ef9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:52.684168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dde877bf-3962-4e9e-a0d2-187c67ab5ef9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:52.693829 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dde877bf-3962-4e9e-a0d2-187c67ab5ef9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1202 microversion: 2.1 time: 0.172837 Jul 28 04:21:52.694430 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3947/6397] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:52 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1202 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:21:53.715291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e16a5683-1b42-4955-8ef3-9538951fc291 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:53.716335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e16a5683-1b42-4955-8ef3-9538951fc291 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:53.723641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e16a5683-1b42-4955-8ef3-9538951fc291 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:53.724110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e16a5683-1b42-4955-8ef3-9538951fc291 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:53.724892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e16a5683-1b42-4955-8ef3-9538951fc291 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:53.725325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e16a5683-1b42-4955-8ef3-9538951fc291 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:53.859013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e16a5683-1b42-4955-8ef3-9538951fc291 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:53.872102 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e16a5683-1b42-4955-8ef3-9538951fc291 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1202 microversion: 2.1 time: 0.160813 Jul 28 04:21:53.872948 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3948/6398] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:53 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:54.894577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-231d1b43-1fd4-4372-a972-42ec6f1f85dc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:54.895221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-231d1b43-1fd4-4372-a972-42ec6f1f85dc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:54.901742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-231d1b43-1fd4-4372-a972-42ec6f1f85dc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:54.902190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-231d1b43-1fd4-4372-a972-42ec6f1f85dc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:54.902953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-231d1b43-1fd4-4372-a972-42ec6f1f85dc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:54.903384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-231d1b43-1fd4-4372-a972-42ec6f1f85dc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:55.070588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-231d1b43-1fd4-4372-a972-42ec6f1f85dc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:55.079289 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-231d1b43-1fd4-4372-a972-42ec6f1f85dc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1202 microversion: 2.1 time: 0.189798 Jul 28 04:21:55.080092 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3949/6399] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:54 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1202 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:21:56.101859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d1fa9279-0165-4429-a4d3-b33be5af097e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:56.102506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d1fa9279-0165-4429-a4d3-b33be5af097e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:56.109430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1fa9279-0165-4429-a4d3-b33be5af097e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:56.109879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1fa9279-0165-4429-a4d3-b33be5af097e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:56.110856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1fa9279-0165-4429-a4d3-b33be5af097e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:56.111297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1fa9279-0165-4429-a4d3-b33be5af097e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:56.246652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d1fa9279-0165-4429-a4d3-b33be5af097e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:56.255414 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d1fa9279-0165-4429-a4d3-b33be5af097e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1202 microversion: 2.1 time: 0.157540 Jul 28 04:21:56.256005 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3950/6400] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:56 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:57.026864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b722ee3f-0e00-428c-8c0c-96b639ba89bc req-c84b205b-c6c7-4c42-b3e1-d0f479f97a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e61f69-fc13-4d2f-9900-53010dee84b7", "name": "network-vif-plugged", "status": "completed", "tag": "a48ca921-3539-4017-9fb6-2c95b1f20838"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:21:57.038146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b722ee3f-0e00-428c-8c0c-96b639ba89bc req-c84b205b-c6c7-4c42-b3e1-d0f479f97a7d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:57.038804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b722ee3f-0e00-428c-8c0c-96b639ba89bc req-c84b205b-c6c7-4c42-b3e1-d0f479f97a7d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:57.052511 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b722ee3f-0e00-428c-8c0c-96b639ba89bc req-c84b205b-c6c7-4c42-b3e1-d0f479f97a7d service nova] Creating event network-vif-plugged:a48ca921-3539-4017-9fb6-2c95b1f20838 for instance a4e61f69-fc13-4d2f-9900-53010dee84b7 on n-h1-826756-3 Jul 28 04:21:57.061298 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b722ee3f-0e00-428c-8c0c-96b639ba89bc req-c84b205b-c6c7-4c42-b3e1-d0f479f97a7d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038194 Jul 28 04:21:57.062383 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3951/6401] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:21:57.278386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9e2a5c4-a554-46c4-8156-9b46eca3dc60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:57.280064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9e2a5c4-a554-46c4-8156-9b46eca3dc60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:57.285549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9e2a5c4-a554-46c4-8156-9b46eca3dc60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:57.287267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9e2a5c4-a554-46c4-8156-9b46eca3dc60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:57.287267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9e2a5c4-a554-46c4-8156-9b46eca3dc60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:57.287267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9e2a5c4-a554-46c4-8156-9b46eca3dc60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:57.431186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b9e2a5c4-a554-46c4-8156-9b46eca3dc60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:57.439945 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9e2a5c4-a554-46c4-8156-9b46eca3dc60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1202 microversion: 2.1 time: 0.166688 Jul 28 04:21:57.444381 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3952/6402] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:57 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:58.462442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1ba91e33-3d9a-4066-89bb-095750d901b0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:58.463942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1ba91e33-3d9a-4066-89bb-095750d901b0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:58.471595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ba91e33-3d9a-4066-89bb-095750d901b0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:58.472048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ba91e33-3d9a-4066-89bb-095750d901b0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:58.472850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ba91e33-3d9a-4066-89bb-095750d901b0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:58.473287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ba91e33-3d9a-4066-89bb-095750d901b0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:58.618873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1ba91e33-3d9a-4066-89bb-095750d901b0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:58.627584 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1ba91e33-3d9a-4066-89bb-095750d901b0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1388 microversion: 2.1 time: 0.169294 Jul 28 04:21:58.642820 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3953/6403] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:58 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1388 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:58.647716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-752dfb25-c34b-449f-adbe-89e18943fcd5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:58.648334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-752dfb25-c34b-449f-adbe-89e18943fcd5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:58.654570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-752dfb25-c34b-449f-adbe-89e18943fcd5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:58.655045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-752dfb25-c34b-449f-adbe-89e18943fcd5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:58.655807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-752dfb25-c34b-449f-adbe-89e18943fcd5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:58.656344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-752dfb25-c34b-449f-adbe-89e18943fcd5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:58.818242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-752dfb25-c34b-449f-adbe-89e18943fcd5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:58.827238 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-752dfb25-c34b-449f-adbe-89e18943fcd5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1388 microversion: 2.1 time: 0.183243 Jul 28 04:21:58.827801 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3954/6404] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:58 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1388 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:58.848780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5cb763a7-69e6-4553-845b-d37b33fc7336 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:58.849392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5cb763a7-69e6-4553-845b-d37b33fc7336 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:58.855922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5cb763a7-69e6-4553-845b-d37b33fc7336 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:58.856335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5cb763a7-69e6-4553-845b-d37b33fc7336 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:58.857637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5cb763a7-69e6-4553-845b-d37b33fc7336 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:58.859108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5cb763a7-69e6-4553-845b-d37b33fc7336 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:58.999740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5cb763a7-69e6-4553-845b-d37b33fc7336 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:59.008152 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5cb763a7-69e6-4553-845b-d37b33fc7336 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1388 microversion: 2.1 time: 0.163454 Jul 28 04:21:59.009180 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3955/6405] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:58 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1388 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:21:59.027831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1d91c902-51a7-4b92-ad2a-f899977ab740 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:59.028328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1d91c902-51a7-4b92-ad2a-f899977ab740 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:59.037906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d91c902-51a7-4b92-ad2a-f899977ab740 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:59.037906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d91c902-51a7-4b92-ad2a-f899977ab740 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:59.037906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d91c902-51a7-4b92-ad2a-f899977ab740 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:59.037906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d91c902-51a7-4b92-ad2a-f899977ab740 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:59.064293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1d91c902-51a7-4b92-ad2a-f899977ab740 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:21:59.145784 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1d91c902-51a7-4b92-ad2a-f899977ab740 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 204 len: 0 microversion: 2.1 time: 0.120668 Jul 28 04:21:59.149970 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3956/6406] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:21:59 2022] DELETE /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:21:59.157861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-45454cc9-e8cb-4ade-bf20-1bcc83a203a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:21:59.158764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-45454cc9-e8cb-4ade-bf20-1bcc83a203a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:21:59.166083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45454cc9-e8cb-4ade-bf20-1bcc83a203a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:59.166532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45454cc9-e8cb-4ade-bf20-1bcc83a203a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:59.167292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45454cc9-e8cb-4ade-bf20-1bcc83a203a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:21:59.167840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45454cc9-e8cb-4ade-bf20-1bcc83a203a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:21:59.304581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-45454cc9-e8cb-4ade-bf20-1bcc83a203a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:21:59.319096 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-45454cc9-e8cb-4ade-bf20-1bcc83a203a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1394 microversion: 2.1 time: 0.165823 Jul 28 04:21:59.321267 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3957/6407] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:21:59 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1394 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:00.342446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bba144ba-2891-488d-b089-36ab22dbdcab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:00.343116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bba144ba-2891-488d-b089-36ab22dbdcab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:00.350478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bba144ba-2891-488d-b089-36ab22dbdcab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:00.350965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bba144ba-2891-488d-b089-36ab22dbdcab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:00.351753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bba144ba-2891-488d-b089-36ab22dbdcab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:00.352411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bba144ba-2891-488d-b089-36ab22dbdcab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:00.490646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bba144ba-2891-488d-b089-36ab22dbdcab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:00.499170 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bba144ba-2891-488d-b089-36ab22dbdcab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1394 microversion: 2.1 time: 0.161292 Jul 28 04:22:00.500101 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3958/6408] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:00 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1394 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:01.079087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-db6ad524-35f0-4764-a285-74a0c8a3053d req-66ad80e7-94d8-4da4-9d8e-7de41303d5cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e61f69-fc13-4d2f-9900-53010dee84b7", "name": "network-vif-deleted", "tag": "a48ca921-3539-4017-9fb6-2c95b1f20838"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:22:01.102590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-db6ad524-35f0-4764-a285-74a0c8a3053d req-66ad80e7-94d8-4da4-9d8e-7de41303d5cd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:01.103725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-db6ad524-35f0-4764-a285-74a0c8a3053d req-66ad80e7-94d8-4da4-9d8e-7de41303d5cd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:01.117583 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-db6ad524-35f0-4764-a285-74a0c8a3053d req-66ad80e7-94d8-4da4-9d8e-7de41303d5cd service nova] Creating event network-vif-deleted:a48ca921-3539-4017-9fb6-2c95b1f20838 for instance a4e61f69-fc13-4d2f-9900-53010dee84b7 on n-h1-826756-3 Jul 28 04:22:01.131024 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-db6ad524-35f0-4764-a285-74a0c8a3053d req-66ad80e7-94d8-4da4-9d8e-7de41303d5cd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056336 Jul 28 04:22:01.131976 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3959/6409] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:22:01.522384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d701f0eb-7b91-4400-aaab-624ad0e184bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:01.523259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d701f0eb-7b91-4400-aaab-624ad0e184bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:01.531023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d701f0eb-7b91-4400-aaab-624ad0e184bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:01.531619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d701f0eb-7b91-4400-aaab-624ad0e184bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:01.532653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d701f0eb-7b91-4400-aaab-624ad0e184bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:01.533200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d701f0eb-7b91-4400-aaab-624ad0e184bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:01.552950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:22:01.605038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d701f0eb-7b91-4400-aaab-624ad0e184bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:01.614630 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d701f0eb-7b91-4400-aaab-624ad0e184bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1187 microversion: 2.1 time: 0.097604 Jul 28 04:22:01.628922 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3960/6410] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:01 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1187 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:02.638783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6e2bd92d-1096-4254-8807-5fe3d2f7d30c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:02.639675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6e2bd92d-1096-4254-8807-5fe3d2f7d30c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:02.647664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e2bd92d-1096-4254-8807-5fe3d2f7d30c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:02.648193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e2bd92d-1096-4254-8807-5fe3d2f7d30c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:02.649252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e2bd92d-1096-4254-8807-5fe3d2f7d30c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:02.649882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6e2bd92d-1096-4254-8807-5fe3d2f7d30c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:02.718204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6e2bd92d-1096-4254-8807-5fe3d2f7d30c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:02.726598 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6e2bd92d-1096-4254-8807-5fe3d2f7d30c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1187 microversion: 2.1 time: 0.092743 Jul 28 04:22:02.727205 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3961/6411] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:02 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:03.749481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b247959-b051-4804-b7cc-2f8eaad5adbd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:03.750241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5b247959-b051-4804-b7cc-2f8eaad5adbd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:03.757717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b247959-b051-4804-b7cc-2f8eaad5adbd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:03.758277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b247959-b051-4804-b7cc-2f8eaad5adbd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:03.759168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b247959-b051-4804-b7cc-2f8eaad5adbd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:03.759702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b247959-b051-4804-b7cc-2f8eaad5adbd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:03.828157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5b247959-b051-4804-b7cc-2f8eaad5adbd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:03.836582 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5b247959-b051-4804-b7cc-2f8eaad5adbd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1187 microversion: 2.1 time: 0.092002 Jul 28 04:22:03.837177 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3962/6412] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:03 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:04.858568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63f5b5e6-9b8e-4550-ad1a-48e235799f81 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:04.859249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63f5b5e6-9b8e-4550-ad1a-48e235799f81 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:04.867844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63f5b5e6-9b8e-4550-ad1a-48e235799f81 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:04.868492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63f5b5e6-9b8e-4550-ad1a-48e235799f81 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:04.869355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63f5b5e6-9b8e-4550-ad1a-48e235799f81 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:04.870010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63f5b5e6-9b8e-4550-ad1a-48e235799f81 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:04.937903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63f5b5e6-9b8e-4550-ad1a-48e235799f81 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:04.946487 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63f5b5e6-9b8e-4550-ad1a-48e235799f81 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 200 len: 1187 microversion: 2.1 time: 0.092036 Jul 28 04:22:04.947131 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3963/6413] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:04 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:05.968154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5183a7e1-d40e-44d7-9eee-4930bc1ec022 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:05.968867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5183a7e1-d40e-44d7-9eee-4930bc1ec022 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a4e61f69-fc13-4d2f-9900-53010dee84b7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:05.976603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5183a7e1-d40e-44d7-9eee-4930bc1ec022 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:05.977145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5183a7e1-d40e-44d7-9eee-4930bc1ec022 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:05.978023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5183a7e1-d40e-44d7-9eee-4930bc1ec022 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:05.978517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5183a7e1-d40e-44d7-9eee-4930bc1ec022 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:05.993271 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-5183a7e1-d40e-44d7-9eee-4930bc1ec022 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance a4e61f69-fc13-4d2f-9900-53010dee84b7 could not be found. Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5183a7e1-d40e-44d7-9eee-4930bc1ec022 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 HTTP/1.1 Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance a4e61f69-fc13-4d2f-9900-53010dee84b7 could not be found. Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a4e61f69-fc13-4d2f-9900-53010dee84b7'} Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4e61f69-fc13-4d2f-9900-53010dee84b7 could not be found. Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4e61f69-fc13-4d2f-9900-53010dee84b7 could not be found. Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:22:05.994955 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:22:06.003582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:22:06.003582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:22:06.003582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:22:06.003582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:22:06.003582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:22:06.003582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4e61f69-fc13-4d2f-9900-53010dee84b7 could not be found. Jul 28 04:22:06.003582 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:22:06.003582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5183a7e1-d40e-44d7-9eee-4930bc1ec022 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance a4e61f69-fc13-4d2f-9900-53010dee84b7 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:22:06.003582 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5183a7e1-d40e-44d7-9eee-4930bc1ec022 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7" status: 404 len: 111 microversion: 2.1 time: 0.032900 Jul 28 04:22:06.003582 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3964/6414] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:05 2022] GET /compute/v2.1/servers/a4e61f69-fc13-4d2f-9900-53010dee84b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:22:23.302229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-41337a8c-87c4-4021-a32e-f7ddc5492782 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Action: 'create', calling method: .version_select at 0x7ffa74b623a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1579729168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSe1z3FNV6OU4YBdh/y9NSnio53IXlPdvkqCQvR26TFYDy56DT7vw6gc29vg43gAL23VMTBxMid9tevvLON6hVy7fiMEgUfzm92QfBqQPSAQjSLXOmoMJcKt+tIAz1giA=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:22:23.311009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:22:23.312156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=22 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:22:23.328040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-41337a8c-87c4-4021-a32e-f7ddc5492782 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Getting quotas for project 54ab72fd45f247298afde074fa9b4960. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:22:23.343137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-41337a8c-87c4-4021-a32e-f7ddc5492782 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Getting quotas for user 1fc8c51b4f84432ebdaa525c2d601487 and project 54ab72fd45f247298afde074fa9b4960. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:22:23.383255 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-41337a8c-87c4-4021-a32e-f7ddc5492782 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.085348 Jul 28 04:22:23.403110 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3965/6415] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:22:23 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:22:24.629965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1964852766", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "549b95c5-8687-4bb5-930a-5659f9279a6a"}], "key_name": "tempest-TestNetworkBasicOps-1579729168", "security_groups": [{"name": "tempest-secgroup-smoke-1761301683"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:22:24.791378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] validate_networks() for [('549b95c5-8687-4bb5-930a-5659f9279a6a', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:22:25.331577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:22:25.332087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:22:25.332890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:22:25.334056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:22:25.334723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:22:25.348494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:25.349091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:25.350504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:25.351303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:25.375432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Getting quotas for project 54ab72fd45f247298afde074fa9b4960. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:22:25.382776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Getting quotas for user 1fc8c51b4f84432ebdaa525c2d601487 and project 54ab72fd45f247298afde074fa9b4960. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:22:25.404079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:22:25.408487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:22:25.471488 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f6ca7fd0-5411-44b5-9180-e992d9dab37f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.847064 Jul 28 04:22:25.471739 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3966/6416] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:22:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:22:25.488464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2fa07eb1-80bf-4d21-8385-a1f04c83e3f6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:25.489095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2fa07eb1-80bf-4d21-8385-a1f04c83e3f6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:25.572308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2fa07eb1-80bf-4d21-8385-a1f04c83e3f6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:25.583910 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2fa07eb1-80bf-4d21-8385-a1f04c83e3f6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b" status: 200 len: 1249 microversion: 2.1 time: 0.101703 Jul 28 04:22:25.584837 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3967/6417] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:25 2022] GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b => generated 1249 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:26.609188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0cb17f3a-06de-4df6-800e-777a5ed8fd47 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:26.610996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0cb17f3a-06de-4df6-800e-777a5ed8fd47 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:26.621834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cb17f3a-06de-4df6-800e-777a5ed8fd47 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:26.622297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cb17f3a-06de-4df6-800e-777a5ed8fd47 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:26.623239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cb17f3a-06de-4df6-800e-777a5ed8fd47 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:26.623706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cb17f3a-06de-4df6-800e-777a5ed8fd47 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:26.701415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0cb17f3a-06de-4df6-800e-777a5ed8fd47 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:26.712567 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0cb17f3a-06de-4df6-800e-777a5ed8fd47 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b" status: 200 len: 1301 microversion: 2.1 time: 0.107593 Jul 28 04:22:26.713762 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3968/6418] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:26 2022] GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b => generated 1301 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:27.736273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74361e6b-087d-44c7-a3dc-c7b16274b781 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:27.737781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74361e6b-087d-44c7-a3dc-c7b16274b781 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:27.745861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74361e6b-087d-44c7-a3dc-c7b16274b781 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:27.746740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74361e6b-087d-44c7-a3dc-c7b16274b781 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:27.747757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74361e6b-087d-44c7-a3dc-c7b16274b781 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:27.748440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74361e6b-087d-44c7-a3dc-c7b16274b781 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:28.308840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-74361e6b-087d-44c7-a3dc-c7b16274b781 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:28.318940 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74361e6b-087d-44c7-a3dc-c7b16274b781 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b" status: 200 len: 1375 microversion: 2.1 time: 0.586574 Jul 28 04:22:28.319563 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3969/6419] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:27 2022] GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b => generated 1375 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:28.603549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f54804bb-4058-4f4d-9558-dd4620e5d2d4 req-e54eb4db-d1f0-4895-bf10-b863a5837de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bbbce8-3afb-495f-883a-cf0bf1d7981b", "tag": "df13086f-0fe0-4f5a-9b6b-c162bd9ab543"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:22:28.626973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f54804bb-4058-4f4d-9558-dd4620e5d2d4 req-e54eb4db-d1f0-4895-bf10-b863a5837de2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:28.627487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f54804bb-4058-4f4d-9558-dd4620e5d2d4 req-e54eb4db-d1f0-4895-bf10-b863a5837de2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:28.674913 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f54804bb-4058-4f4d-9558-dd4620e5d2d4 req-e54eb4db-d1f0-4895-bf10-b863a5837de2 service nova] Creating event network-changed:df13086f-0fe0-4f5a-9b6b-c162bd9ab543 for instance 33bbbce8-3afb-495f-883a-cf0bf1d7981b on n-h1-826756-3 Jul 28 04:22:28.698875 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f54804bb-4058-4f4d-9558-dd4620e5d2d4 req-e54eb4db-d1f0-4895-bf10-b863a5837de2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106095 Jul 28 04:22:28.700064 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3970/6420] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:22:29.344202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43012458-de11-457e-b410-7eb05ce6fcea tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:29.345150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-43012458-de11-457e-b410-7eb05ce6fcea tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:29.352314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43012458-de11-457e-b410-7eb05ce6fcea tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:29.352792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43012458-de11-457e-b410-7eb05ce6fcea tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:29.353554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43012458-de11-457e-b410-7eb05ce6fcea tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:29.353983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43012458-de11-457e-b410-7eb05ce6fcea tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:29.493911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-43012458-de11-457e-b410-7eb05ce6fcea tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:29.502128 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43012458-de11-457e-b410-7eb05ce6fcea tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b" status: 200 len: 1375 microversion: 2.1 time: 0.164208 Jul 28 04:22:29.502741 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3971/6421] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:29 2022] GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:29.546581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-67170315", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f1730cb1-3231-47a1-9b30-cc4dac3015ee", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:22:29.641640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] validate_networks() for [('601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:22:30.056041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:22:30.056491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:22:30.056962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:22:30.057368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:22:30.057805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:22:30.067118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:30.067562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:30.068338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:30.068789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:30.085867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:22:30.091963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for user 98c95cccd8d547a5bd528a3a3ca9fb4f and project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:22:30.105347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:22:30.107518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f1730cb1-3231-47a1-9b30-cc4dac3015ee',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:22:30.182734 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ccc8bcf-71fe-4bd1-ae6b-ea157763aead tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640097 Jul 28 04:22:30.183950 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3972/6422] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:22:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:22:30.200742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-853c488a-d3fc-4548-944c-55ab87206619 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:30.201424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-853c488a-d3fc-4548-944c-55ab87206619 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:30.264974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-853c488a-d3fc-4548-944c-55ab87206619 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:30.273140 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-853c488a-d3fc-4548-944c-55ab87206619 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1055 microversion: 2.1 time: 0.079566 Jul 28 04:22:30.273944 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3973/6423] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:30 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1055 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:30.523904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ae0832fe-ad59-4ffd-8e51-3d655fcf2a96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:30.524639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ae0832fe-ad59-4ffd-8e51-3d655fcf2a96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:30.532374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae0832fe-ad59-4ffd-8e51-3d655fcf2a96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:30.532952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae0832fe-ad59-4ffd-8e51-3d655fcf2a96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:30.533797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae0832fe-ad59-4ffd-8e51-3d655fcf2a96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:30.534349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae0832fe-ad59-4ffd-8e51-3d655fcf2a96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:30.676430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ae0832fe-ad59-4ffd-8e51-3d655fcf2a96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:30.684867 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ae0832fe-ad59-4ffd-8e51-3d655fcf2a96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b" status: 200 len: 1375 microversion: 2.1 time: 0.165044 Jul 28 04:22:30.685428 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3974/6424] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:30 2022] GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:31.295451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8433b3bd-018a-4a9d-b5f7-911a513f6fb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:31.296284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8433b3bd-018a-4a9d-b5f7-911a513f6fb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:31.303849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8433b3bd-018a-4a9d-b5f7-911a513f6fb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:31.304866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8433b3bd-018a-4a9d-b5f7-911a513f6fb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:31.305222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8433b3bd-018a-4a9d-b5f7-911a513f6fb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:31.305747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8433b3bd-018a-4a9d-b5f7-911a513f6fb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:31.389358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8433b3bd-018a-4a9d-b5f7-911a513f6fb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:31.398985 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8433b3bd-018a-4a9d-b5f7-911a513f6fb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1115 microversion: 2.1 time: 0.108577 Jul 28 04:22:31.400888 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3975/6425] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:31 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1115 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:31.706121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d7979cf-cc2f-48d7-979b-ab6a68311c1a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:31.707452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d7979cf-cc2f-48d7-979b-ab6a68311c1a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:31.714782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d7979cf-cc2f-48d7-979b-ab6a68311c1a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:31.715585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d7979cf-cc2f-48d7-979b-ab6a68311c1a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:31.716317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d7979cf-cc2f-48d7-979b-ab6a68311c1a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:31.717366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d7979cf-cc2f-48d7-979b-ab6a68311c1a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:31.876841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7d7979cf-cc2f-48d7-979b-ab6a68311c1a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:31.886720 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d7979cf-cc2f-48d7-979b-ab6a68311c1a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b" status: 200 len: 1375 microversion: 2.1 time: 0.184359 Jul 28 04:22:31.888238 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3976/6426] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:31 2022] GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b => generated 1375 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:32.425813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e26af624-e24f-4f41-9a8a-4ca8fd963333 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:32.427319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e26af624-e24f-4f41-9a8a-4ca8fd963333 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:32.435291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e26af624-e24f-4f41-9a8a-4ca8fd963333 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:32.435981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e26af624-e24f-4f41-9a8a-4ca8fd963333 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:32.437182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e26af624-e24f-4f41-9a8a-4ca8fd963333 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:32.437626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e26af624-e24f-4f41-9a8a-4ca8fd963333 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:32.589336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e26af624-e24f-4f41-9a8a-4ca8fd963333 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:32.599534 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e26af624-e24f-4f41-9a8a-4ca8fd963333 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1167 microversion: 2.1 time: 0.179676 Jul 28 04:22:32.600217 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3977/6427] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:32 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1167 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:32.909203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ba4d4952-4542-4851-b695-1a3bf1c32a2a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:32.909920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ba4d4952-4542-4851-b695-1a3bf1c32a2a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:32.918260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba4d4952-4542-4851-b695-1a3bf1c32a2a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:32.918887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba4d4952-4542-4851-b695-1a3bf1c32a2a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:32.919744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba4d4952-4542-4851-b695-1a3bf1c32a2a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:32.920287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba4d4952-4542-4851-b695-1a3bf1c32a2a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:33.111564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ba4d4952-4542-4851-b695-1a3bf1c32a2a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:33.120778 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ba4d4952-4542-4851-b695-1a3bf1c32a2a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b" status: 200 len: 1375 microversion: 2.1 time: 0.215548 Jul 28 04:22:33.121851 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3978/6428] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:32 2022] GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b => generated 1375 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:33.265695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6cdeafab-1ae2-4734-947a-9153f72b91b5 req-ce6480e8-1ed0-47d9-b35e-50f74b17fd26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7b1459f-e07e-42b2-9f3e-14fd5de41455", "tag": "9c5e8ad9-8966-4495-a66f-b8d2b982c36b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:22:33.298188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6cdeafab-1ae2-4734-947a-9153f72b91b5 req-ce6480e8-1ed0-47d9-b35e-50f74b17fd26 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:33.298735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6cdeafab-1ae2-4734-947a-9153f72b91b5 req-ce6480e8-1ed0-47d9-b35e-50f74b17fd26 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:33.318495 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6cdeafab-1ae2-4734-947a-9153f72b91b5 req-ce6480e8-1ed0-47d9-b35e-50f74b17fd26 service nova] Creating event network-changed:9c5e8ad9-8966-4495-a66f-b8d2b982c36b for instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 on n-h2-826756-3 Jul 28 04:22:33.325676 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6cdeafab-1ae2-4734-947a-9153f72b91b5 req-ce6480e8-1ed0-47d9-b35e-50f74b17fd26 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077000 Jul 28 04:22:33.326431 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3979/6429] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:22:33.337414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-43b370ce-ebbd-4654-b305-413d07a91105 req-ad96465c-7d7b-48be-a656-3ffd4ff80ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bbbce8-3afb-495f-883a-cf0bf1d7981b", "name": "network-vif-plugged", "status": "completed", "tag": "df13086f-0fe0-4f5a-9b6b-c162bd9ab543"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:22:33.357565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-43b370ce-ebbd-4654-b305-413d07a91105 req-ad96465c-7d7b-48be-a656-3ffd4ff80ae7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:33.358232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-43b370ce-ebbd-4654-b305-413d07a91105 req-ad96465c-7d7b-48be-a656-3ffd4ff80ae7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:33.378213 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-43b370ce-ebbd-4654-b305-413d07a91105 req-ad96465c-7d7b-48be-a656-3ffd4ff80ae7 service nova] Creating event network-vif-plugged:df13086f-0fe0-4f5a-9b6b-c162bd9ab543 for instance 33bbbce8-3afb-495f-883a-cf0bf1d7981b on n-h1-826756-3 Jul 28 04:22:33.388665 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-43b370ce-ebbd-4654-b305-413d07a91105 req-ad96465c-7d7b-48be-a656-3ffd4ff80ae7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053558 Jul 28 04:22:33.395641 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3980/6430] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:22:33.622424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d573d8d-e75f-40b0-9ba8-c4af6e9fd808 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:33.623223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5d573d8d-e75f-40b0-9ba8-c4af6e9fd808 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:33.630963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d573d8d-e75f-40b0-9ba8-c4af6e9fd808 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:33.632092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d573d8d-e75f-40b0-9ba8-c4af6e9fd808 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:33.632274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d573d8d-e75f-40b0-9ba8-c4af6e9fd808 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:33.632670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d573d8d-e75f-40b0-9ba8-c4af6e9fd808 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:33.776977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5d573d8d-e75f-40b0-9ba8-c4af6e9fd808 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:33.785553 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5d573d8d-e75f-40b0-9ba8-c4af6e9fd808 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1167 microversion: 2.1 time: 0.168262 Jul 28 04:22:33.786435 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3981/6431] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:33 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1167 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:34.143335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-973de4b1-d029-4716-8afb-0a2ba2617059 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:34.144014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-973de4b1-d029-4716-8afb-0a2ba2617059 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:34.151469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-973de4b1-d029-4716-8afb-0a2ba2617059 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:34.151993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-973de4b1-d029-4716-8afb-0a2ba2617059 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:34.152893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-973de4b1-d029-4716-8afb-0a2ba2617059 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:34.153430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-973de4b1-d029-4716-8afb-0a2ba2617059 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:34.303786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-973de4b1-d029-4716-8afb-0a2ba2617059 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:34.312192 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-973de4b1-d029-4716-8afb-0a2ba2617059 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b" status: 200 len: 1375 microversion: 2.1 time: 0.172854 Jul 28 04:22:34.325739 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3982/6432] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:34 2022] GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b => generated 1375 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:34.806856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d9d4862f-514d-4382-b5db-ddf57e098c64 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:34.807441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d9d4862f-514d-4382-b5db-ddf57e098c64 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:34.814264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9d4862f-514d-4382-b5db-ddf57e098c64 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:34.815025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9d4862f-514d-4382-b5db-ddf57e098c64 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:34.816015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9d4862f-514d-4382-b5db-ddf57e098c64 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:34.816494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9d4862f-514d-4382-b5db-ddf57e098c64 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:34.950213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d9d4862f-514d-4382-b5db-ddf57e098c64 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:34.961036 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d9d4862f-514d-4382-b5db-ddf57e098c64 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1167 microversion: 2.1 time: 0.158065 Jul 28 04:22:34.961589 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3983/6433] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:34 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1167 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:35.333820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f4e39d1-b70f-4a3d-86d8-fd1f796d48f7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:35.334536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2f4e39d1-b70f-4a3d-86d8-fd1f796d48f7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:35.343204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f4e39d1-b70f-4a3d-86d8-fd1f796d48f7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:35.343655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f4e39d1-b70f-4a3d-86d8-fd1f796d48f7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:35.345070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f4e39d1-b70f-4a3d-86d8-fd1f796d48f7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:35.345619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f4e39d1-b70f-4a3d-86d8-fd1f796d48f7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:35.569283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2f4e39d1-b70f-4a3d-86d8-fd1f796d48f7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:35.577715 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2f4e39d1-b70f-4a3d-86d8-fd1f796d48f7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b" status: 200 len: 1547 microversion: 2.1 time: 0.248319 Jul 28 04:22:35.578526 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3984/6434] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:35 2022] GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b => generated 1547 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:35.599546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7fd1a56a-88c3-47ac-90d6-68f3c9fecf66 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:35.600088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7fd1a56a-88c3-47ac-90d6-68f3c9fecf66 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:35.606543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fd1a56a-88c3-47ac-90d6-68f3c9fecf66 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:35.607027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fd1a56a-88c3-47ac-90d6-68f3c9fecf66 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:35.607781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fd1a56a-88c3-47ac-90d6-68f3c9fecf66 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:35.608207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fd1a56a-88c3-47ac-90d6-68f3c9fecf66 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:35.796668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7fd1a56a-88c3-47ac-90d6-68f3c9fecf66 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:35.812932 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7fd1a56a-88c3-47ac-90d6-68f3c9fecf66 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b" status: 200 len: 1547 microversion: 2.1 time: 0.217008 Jul 28 04:22:35.813692 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3985/6435] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:35 2022] GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b => generated 1547 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:35.985622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70efd55e-5221-459e-9840-bd3bea8e7f8c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:35.986482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-70efd55e-5221-459e-9840-bd3bea8e7f8c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:35.993126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70efd55e-5221-459e-9840-bd3bea8e7f8c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:35.993764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70efd55e-5221-459e-9840-bd3bea8e7f8c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:35.994718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70efd55e-5221-459e-9840-bd3bea8e7f8c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:35.995229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70efd55e-5221-459e-9840-bd3bea8e7f8c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:36.326406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-70efd55e-5221-459e-9840-bd3bea8e7f8c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:36.337649 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-70efd55e-5221-459e-9840-bd3bea8e7f8c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1167 microversion: 2.1 time: 0.358305 Jul 28 04:22:36.338720 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3986/6436] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:35 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1167 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:37.360746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-08cbc708-a42e-4f2d-8db6-1aab8247c257 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:37.362805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-08cbc708-a42e-4f2d-8db6-1aab8247c257 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:37.370940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08cbc708-a42e-4f2d-8db6-1aab8247c257 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:37.371913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08cbc708-a42e-4f2d-8db6-1aab8247c257 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:37.373159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08cbc708-a42e-4f2d-8db6-1aab8247c257 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:37.373495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08cbc708-a42e-4f2d-8db6-1aab8247c257 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:37.707053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-08cbc708-a42e-4f2d-8db6-1aab8247c257 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:37.713056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:22:37.716064 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-08cbc708-a42e-4f2d-8db6-1aab8247c257 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1167 microversion: 2.1 time: 0.360003 Jul 28 04:22:37.717717 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3987/6437] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:37 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1167 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:38.738679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2e5afad-5fab-445d-ba37-1091bf16ef2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:38.739549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2e5afad-5fab-445d-ba37-1091bf16ef2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:38.746858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2e5afad-5fab-445d-ba37-1091bf16ef2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:38.747306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2e5afad-5fab-445d-ba37-1091bf16ef2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:38.748074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2e5afad-5fab-445d-ba37-1091bf16ef2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:38.748548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2e5afad-5fab-445d-ba37-1091bf16ef2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:38.954790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b2e5afad-5fab-445d-ba37-1091bf16ef2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:38.964048 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b2e5afad-5fab-445d-ba37-1091bf16ef2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1167 microversion: 2.1 time: 0.228902 Jul 28 04:22:38.977244 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3988/6438] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:38 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1167 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:38.983210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d80c9adb-f073-42bf-8692-456e421c8575 req-d6dce633-e02f-4b3d-a8d0-dc417988d4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bbbce8-3afb-495f-883a-cf0bf1d7981b", "tag": "df13086f-0fe0-4f5a-9b6b-c162bd9ab543"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:22:38.994121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d80c9adb-f073-42bf-8692-456e421c8575 req-d6dce633-e02f-4b3d-a8d0-dc417988d4f6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:38.996439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d80c9adb-f073-42bf-8692-456e421c8575 req-d6dce633-e02f-4b3d-a8d0-dc417988d4f6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:39.006208 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-d80c9adb-f073-42bf-8692-456e421c8575 req-d6dce633-e02f-4b3d-a8d0-dc417988d4f6 service nova] Creating event network-changed:df13086f-0fe0-4f5a-9b6b-c162bd9ab543 for instance 33bbbce8-3afb-495f-883a-cf0bf1d7981b on n-h1-826756-3 Jul 28 04:22:39.013112 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d80c9adb-f073-42bf-8692-456e421c8575 req-d6dce633-e02f-4b3d-a8d0-dc417988d4f6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033565 Jul 28 04:22:39.013112 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3989/6439] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:22:39.995679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-41168eba-d435-408c-90e3-20c6599d2cca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:39.996458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-41168eba-d435-408c-90e3-20c6599d2cca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:40.013347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41168eba-d435-408c-90e3-20c6599d2cca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:40.013864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41168eba-d435-408c-90e3-20c6599d2cca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:40.014767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41168eba-d435-408c-90e3-20c6599d2cca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:40.015487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41168eba-d435-408c-90e3-20c6599d2cca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:40.077064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:22:40.169348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-41168eba-d435-408c-90e3-20c6599d2cca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:40.177490 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-41168eba-d435-408c-90e3-20c6599d2cca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1167 microversion: 2.1 time: 0.187410 Jul 28 04:22:40.178168 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3990/6440] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:39 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1167 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:41.198590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-01800757-0c14-4966-ad09-fada30f64c2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:41.199282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-01800757-0c14-4966-ad09-fada30f64c2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:41.202337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=20 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:22:41.207094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01800757-0c14-4966-ad09-fada30f64c2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:41.207547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01800757-0c14-4966-ad09-fada30f64c2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:41.208317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01800757-0c14-4966-ad09-fada30f64c2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:41.208782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-01800757-0c14-4966-ad09-fada30f64c2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:41.350511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-01800757-0c14-4966-ad09-fada30f64c2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:41.359779 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-01800757-0c14-4966-ad09-fada30f64c2e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1167 microversion: 2.1 time: 0.164997 Jul 28 04:22:41.360361 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3991/6441] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:41 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1167 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:42.381043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-859e082b-2250-4764-a887-3551c2aae6e6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:42.381682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-859e082b-2250-4764-a887-3551c2aae6e6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:42.385442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:22:42.389549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-859e082b-2250-4764-a887-3551c2aae6e6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:42.389997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-859e082b-2250-4764-a887-3551c2aae6e6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:42.390765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-859e082b-2250-4764-a887-3551c2aae6e6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:42.392391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-859e082b-2250-4764-a887-3551c2aae6e6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:42.532954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-859e082b-2250-4764-a887-3551c2aae6e6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:42.540747 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-859e082b-2250-4764-a887-3551c2aae6e6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1167 microversion: 2.1 time: 0.163863 Jul 28 04:22:42.541325 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3992/6442] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:42 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1167 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:43.563367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc119365-5aab-4e31-9ff2-3db21e485eed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:43.564082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dc119365-5aab-4e31-9ff2-3db21e485eed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:43.570767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc119365-5aab-4e31-9ff2-3db21e485eed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:43.571213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc119365-5aab-4e31-9ff2-3db21e485eed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:43.571985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc119365-5aab-4e31-9ff2-3db21e485eed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:43.572628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc119365-5aab-4e31-9ff2-3db21e485eed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:43.710922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dc119365-5aab-4e31-9ff2-3db21e485eed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:43.719738 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc119365-5aab-4e31-9ff2-3db21e485eed tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1167 microversion: 2.1 time: 0.161408 Jul 28 04:22:43.720336 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3993/6443] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:43 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1167 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:44.742876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f67126c8-418e-4d67-b9c4-30e5c8076427 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:44.743547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f67126c8-418e-4d67-b9c4-30e5c8076427 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:44.751024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f67126c8-418e-4d67-b9c4-30e5c8076427 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:44.751621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f67126c8-418e-4d67-b9c4-30e5c8076427 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:44.752412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f67126c8-418e-4d67-b9c4-30e5c8076427 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:44.752881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f67126c8-418e-4d67-b9c4-30e5c8076427 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:44.894770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f67126c8-418e-4d67-b9c4-30e5c8076427 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:44.902913 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f67126c8-418e-4d67-b9c4-30e5c8076427 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1167 microversion: 2.1 time: 0.164148 Jul 28 04:22:44.903507 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3994/6444] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:44 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1167 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:45.923615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7f290f8c-50a5-4b88-a957-6c95f1f6ec21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:45.924327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7f290f8c-50a5-4b88-a957-6c95f1f6ec21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:45.931885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f290f8c-50a5-4b88-a957-6c95f1f6ec21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:45.932370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f290f8c-50a5-4b88-a957-6c95f1f6ec21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:45.933206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f290f8c-50a5-4b88-a957-6c95f1f6ec21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:45.933639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7f290f8c-50a5-4b88-a957-6c95f1f6ec21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:46.078447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7f290f8c-50a5-4b88-a957-6c95f1f6ec21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:46.086606 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7f290f8c-50a5-4b88-a957-6c95f1f6ec21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1167 microversion: 2.1 time: 0.166983 Jul 28 04:22:46.087194 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3995/6445] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:45 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1167 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:47.109445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8014ef38-336d-4278-b684-4ceeb84d0eb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:47.110136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8014ef38-336d-4278-b684-4ceeb84d0eb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:47.117690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8014ef38-336d-4278-b684-4ceeb84d0eb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:47.118145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8014ef38-336d-4278-b684-4ceeb84d0eb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:47.118966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8014ef38-336d-4278-b684-4ceeb84d0eb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:47.119542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8014ef38-336d-4278-b684-4ceeb84d0eb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:47.260277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8014ef38-336d-4278-b684-4ceeb84d0eb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:47.268541 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8014ef38-336d-4278-b684-4ceeb84d0eb0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1201 microversion: 2.1 time: 0.163062 Jul 28 04:22:47.269128 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3996/6446] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:47 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1201 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:48.297539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1bf9ed18-d52c-49e0-827d-241981835fae tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:48.298318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1bf9ed18-d52c-49e0-827d-241981835fae tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:48.306130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1bf9ed18-d52c-49e0-827d-241981835fae tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:48.306511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1bf9ed18-d52c-49e0-827d-241981835fae tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:48.307269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1bf9ed18-d52c-49e0-827d-241981835fae tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:48.307701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1bf9ed18-d52c-49e0-827d-241981835fae tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:48.462049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1bf9ed18-d52c-49e0-827d-241981835fae tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:48.474712 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1bf9ed18-d52c-49e0-827d-241981835fae tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1201 microversion: 2.1 time: 0.181820 Jul 28 04:22:48.475455 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3997/6447] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:48 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1201 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:49.506539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4c3d997-c36c-43ad-8847-ba0d85323f15 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:49.507288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4c3d997-c36c-43ad-8847-ba0d85323f15 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:49.514817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4c3d997-c36c-43ad-8847-ba0d85323f15 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:49.515226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4c3d997-c36c-43ad-8847-ba0d85323f15 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:49.516008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4c3d997-c36c-43ad-8847-ba0d85323f15 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:49.516459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4c3d997-c36c-43ad-8847-ba0d85323f15 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:49.649470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f4c3d997-c36c-43ad-8847-ba0d85323f15 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:49.660803 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4c3d997-c36c-43ad-8847-ba0d85323f15 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1201 microversion: 2.1 time: 0.162156 Jul 28 04:22:49.661468 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3998/6448] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:49 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1201 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:50.688458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-144d6b65-6f18-4412-844e-7d23a890ab61 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:50.689290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-144d6b65-6f18-4412-844e-7d23a890ab61 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:50.696963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-144d6b65-6f18-4412-844e-7d23a890ab61 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:50.697507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-144d6b65-6f18-4412-844e-7d23a890ab61 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:50.698431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-144d6b65-6f18-4412-844e-7d23a890ab61 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:50.698969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-144d6b65-6f18-4412-844e-7d23a890ab61 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:50.842877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-144d6b65-6f18-4412-844e-7d23a890ab61 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:50.851343 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-144d6b65-6f18-4412-844e-7d23a890ab61 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1201 microversion: 2.1 time: 0.166910 Jul 28 04:22:50.851890 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 3999/6449] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:50 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1201 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:51.873571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f7aa88ee-efb1-4d6c-b4c2-37b7c4aef0ee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:51.874399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f7aa88ee-efb1-4d6c-b4c2-37b7c4aef0ee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:51.882115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7aa88ee-efb1-4d6c-b4c2-37b7c4aef0ee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:51.882585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7aa88ee-efb1-4d6c-b4c2-37b7c4aef0ee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:51.883362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7aa88ee-efb1-4d6c-b4c2-37b7c4aef0ee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:51.883800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7aa88ee-efb1-4d6c-b4c2-37b7c4aef0ee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:52.025575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f7aa88ee-efb1-4d6c-b4c2-37b7c4aef0ee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:52.034212 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f7aa88ee-efb1-4d6c-b4c2-37b7c4aef0ee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1201 microversion: 2.1 time: 0.165090 Jul 28 04:22:52.035160 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4000/6450] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:51 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1201 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:53.059021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5d31a49-cddf-40e6-ae37-4e9f3283f27c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:53.059847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b5d31a49-cddf-40e6-ae37-4e9f3283f27c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:53.069860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5d31a49-cddf-40e6-ae37-4e9f3283f27c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:53.070309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5d31a49-cddf-40e6-ae37-4e9f3283f27c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:53.071263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5d31a49-cddf-40e6-ae37-4e9f3283f27c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:53.071660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5d31a49-cddf-40e6-ae37-4e9f3283f27c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:53.214496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b5d31a49-cddf-40e6-ae37-4e9f3283f27c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:53.226234 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5d31a49-cddf-40e6-ae37-4e9f3283f27c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1201 microversion: 2.1 time: 0.172492 Jul 28 04:22:53.226817 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4001/6451] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:53 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1201 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:54.247624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ec144fcc-6b8e-4920-a868-12cad479a9c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:54.248326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ec144fcc-6b8e-4920-a868-12cad479a9c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:54.256042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec144fcc-6b8e-4920-a868-12cad479a9c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:54.256528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec144fcc-6b8e-4920-a868-12cad479a9c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:54.257298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec144fcc-6b8e-4920-a868-12cad479a9c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:54.257732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec144fcc-6b8e-4920-a868-12cad479a9c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:54.401372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ec144fcc-6b8e-4920-a868-12cad479a9c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:54.410848 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ec144fcc-6b8e-4920-a868-12cad479a9c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1201 microversion: 2.1 time: 0.167327 Jul 28 04:22:54.411418 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4002/6452] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:54 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1201 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:55.440670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05cb0e9a-7155-44ce-8b3d-195997f4f85c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:55.441648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-05cb0e9a-7155-44ce-8b3d-195997f4f85c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:55.450001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05cb0e9a-7155-44ce-8b3d-195997f4f85c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:55.450438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05cb0e9a-7155-44ce-8b3d-195997f4f85c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:55.451208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05cb0e9a-7155-44ce-8b3d-195997f4f85c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:55.451644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05cb0e9a-7155-44ce-8b3d-195997f4f85c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:55.585810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-05cb0e9a-7155-44ce-8b3d-195997f4f85c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:55.594439 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-05cb0e9a-7155-44ce-8b3d-195997f4f85c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1201 microversion: 2.1 time: 0.160479 Jul 28 04:22:55.595272 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4003/6453] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:55 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1201 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:55.609685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-991b4012-38ce-4a7f-94e4-febaa811d5fe req-3fc35860-17d6-4a9c-a580-701e5c5eb625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b1459f-e07e-42b2-9f3e-14fd5de41455", "name": "network-vif-plugged", "status": "completed", "tag": "9c5e8ad9-8966-4495-a66f-b8d2b982c36b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:22:55.621395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-991b4012-38ce-4a7f-94e4-febaa811d5fe req-3fc35860-17d6-4a9c-a580-701e5c5eb625 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:55.621847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-991b4012-38ce-4a7f-94e4-febaa811d5fe req-3fc35860-17d6-4a9c-a580-701e5c5eb625 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:55.633695 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-991b4012-38ce-4a7f-94e4-febaa811d5fe req-3fc35860-17d6-4a9c-a580-701e5c5eb625 service nova] Creating event network-vif-plugged:9c5e8ad9-8966-4495-a66f-b8d2b982c36b for instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 on n-h2-826756-3 Jul 28 04:22:55.639388 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-991b4012-38ce-4a7f-94e4-febaa811d5fe req-3fc35860-17d6-4a9c-a580-701e5c5eb625 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033371 Jul 28 04:22:55.640298 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4004/6454] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:22:56.617903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51f0675d-9a4f-411e-a9d7-4e2b7c6a5b60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:56.618726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-51f0675d-9a4f-411e-a9d7-4e2b7c6a5b60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:56.628385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51f0675d-9a4f-411e-a9d7-4e2b7c6a5b60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:56.628862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51f0675d-9a4f-411e-a9d7-4e2b7c6a5b60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:56.629662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51f0675d-9a4f-411e-a9d7-4e2b7c6a5b60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:56.630101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51f0675d-9a4f-411e-a9d7-4e2b7c6a5b60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:56.777733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-51f0675d-9a4f-411e-a9d7-4e2b7c6a5b60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:56.781605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:22:56.787509 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51f0675d-9a4f-411e-a9d7-4e2b7c6a5b60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1201 microversion: 2.1 time: 0.174650 Jul 28 04:22:56.788101 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4005/6455] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:56 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1201 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:57.809371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-76fbf2eb-ac6f-41ef-828f-8b9693e26a3e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:57.810100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-76fbf2eb-ac6f-41ef-828f-8b9693e26a3e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:57.817199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76fbf2eb-ac6f-41ef-828f-8b9693e26a3e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:57.817648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76fbf2eb-ac6f-41ef-828f-8b9693e26a3e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:57.818532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76fbf2eb-ac6f-41ef-828f-8b9693e26a3e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:57.818974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76fbf2eb-ac6f-41ef-828f-8b9693e26a3e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:57.957780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-76fbf2eb-ac6f-41ef-828f-8b9693e26a3e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:57.966576 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-76fbf2eb-ac6f-41ef-828f-8b9693e26a3e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1387 microversion: 2.1 time: 0.161518 Jul 28 04:22:57.967597 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4006/6456] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:57 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1387 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:57.987337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63aed28f-28d8-4de3-967a-d01b875af3e0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:57.988040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63aed28f-28d8-4de3-967a-d01b875af3e0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:57.995294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63aed28f-28d8-4de3-967a-d01b875af3e0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:57.995294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63aed28f-28d8-4de3-967a-d01b875af3e0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:57.996153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63aed28f-28d8-4de3-967a-d01b875af3e0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:57.996728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63aed28f-28d8-4de3-967a-d01b875af3e0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:58.140938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63aed28f-28d8-4de3-967a-d01b875af3e0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:58.150004 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63aed28f-28d8-4de3-967a-d01b875af3e0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1387 microversion: 2.1 time: 0.166485 Jul 28 04:22:58.150602 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4007/6457] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:57 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1387 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:22:58.171570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-253b85d0-ccd5-4e6a-b34a-b6135b8821b2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:58.172293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-253b85d0-ccd5-4e6a-b34a-b6135b8821b2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:58.179350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-253b85d0-ccd5-4e6a-b34a-b6135b8821b2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:58.179891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-253b85d0-ccd5-4e6a-b34a-b6135b8821b2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:58.180766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-253b85d0-ccd5-4e6a-b34a-b6135b8821b2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:58.181199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-253b85d0-ccd5-4e6a-b34a-b6135b8821b2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:58.314505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-253b85d0-ccd5-4e6a-b34a-b6135b8821b2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:58.322706 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-253b85d0-ccd5-4e6a-b34a-b6135b8821b2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1387 microversion: 2.1 time: 0.155107 Jul 28 04:22:58.323303 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4008/6458] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:58 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1387 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:58.401645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cd19507d-c912-4437-a656-031e8388a4a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:58.402256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cd19507d-c912-4437-a656-031e8388a4a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:58.408856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd19507d-c912-4437-a656-031e8388a4a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:58.409312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd19507d-c912-4437-a656-031e8388a4a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:58.410088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd19507d-c912-4437-a656-031e8388a4a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:58.410528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd19507d-c912-4437-a656-031e8388a4a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:58.436448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cd19507d-c912-4437-a656-031e8388a4a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:22:58.518921 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cd19507d-c912-4437-a656-031e8388a4a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 204 len: 0 microversion: 2.1 time: 0.120985 Jul 28 04:22:58.519534 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4009/6459] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:22:58 2022] DELETE /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:22:58.528209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f545cfd-cd67-4c66-929f-9a48e1e6f1ce tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:58.528953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0f545cfd-cd67-4c66-929f-9a48e1e6f1ce tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:58.535083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f545cfd-cd67-4c66-929f-9a48e1e6f1ce tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:58.535534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f545cfd-cd67-4c66-929f-9a48e1e6f1ce tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:58.536303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f545cfd-cd67-4c66-929f-9a48e1e6f1ce tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:58.536756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f545cfd-cd67-4c66-929f-9a48e1e6f1ce tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:58.682364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0f545cfd-cd67-4c66-929f-9a48e1e6f1ce tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:58.690537 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0f545cfd-cd67-4c66-929f-9a48e1e6f1ce tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1393 microversion: 2.1 time: 0.166500 Jul 28 04:22:58.691123 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4010/6460] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:58 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:22:59.172409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9e34cbbd-6ce8-4119-aeb4-746e07c1661d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:22:59.174657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9e34cbbd-6ce8-4119-aeb4-746e07c1661d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:59.182356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e34cbbd-6ce8-4119-aeb4-746e07c1661d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:59.182802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e34cbbd-6ce8-4119-aeb4-746e07c1661d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:59.183573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e34cbbd-6ce8-4119-aeb4-746e07c1661d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:59.183992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e34cbbd-6ce8-4119-aeb4-746e07c1661d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:59.237941 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9e34cbbd-6ce8-4119-aeb4-746e07c1661d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "POST /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b/action" status: 200 len: 24571 microversion: 2.1 time: 0.069839 Jul 28 04:22:59.238613 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4011/6461] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:22:59 2022] POST /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:22:59.712885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-913b3de1-5181-42f9-87d1-15d375bf956f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:22:59.713611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-913b3de1-5181-42f9-87d1-15d375bf956f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:22:59.721842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-913b3de1-5181-42f9-87d1-15d375bf956f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:59.722323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-913b3de1-5181-42f9-87d1-15d375bf956f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:59.723096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-913b3de1-5181-42f9-87d1-15d375bf956f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:22:59.723546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-913b3de1-5181-42f9-87d1-15d375bf956f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:22:59.872475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-913b3de1-5181-42f9-87d1-15d375bf956f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:22:59.880836 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-913b3de1-5181-42f9-87d1-15d375bf956f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1393 microversion: 2.1 time: 0.172566 Jul 28 04:22:59.881576 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4012/6462] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:22:59 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:00.880664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-5b4d51b1-99a7-4db9-8b3f-73f09a23ad9d req-8c711820-dec3-4b34-aabe-97c838afae8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b1459f-e07e-42b2-9f3e-14fd5de41455", "name": "network-vif-deleted", "tag": "9c5e8ad9-8966-4495-a66f-b8d2b982c36b"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:23:00.893226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5b4d51b1-99a7-4db9-8b3f-73f09a23ad9d req-8c711820-dec3-4b34-aabe-97c838afae8c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:00.893675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5b4d51b1-99a7-4db9-8b3f-73f09a23ad9d req-8c711820-dec3-4b34-aabe-97c838afae8c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:00.910300 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5b4d51b1-99a7-4db9-8b3f-73f09a23ad9d req-8c711820-dec3-4b34-aabe-97c838afae8c service nova] Creating event network-vif-deleted:9c5e8ad9-8966-4495-a66f-b8d2b982c36b for instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 on n-h2-826756-3 Jul 28 04:23:00.915987 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-5b4d51b1-99a7-4db9-8b3f-73f09a23ad9d req-8c711820-dec3-4b34-aabe-97c838afae8c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039043 Jul 28 04:23:00.920128 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4013/6463] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:23:00.926205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63dd82f9-79bf-4275-901a-514de98245a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:00.926956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63dd82f9-79bf-4275-901a-514de98245a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:00.934343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63dd82f9-79bf-4275-901a-514de98245a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:00.934789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63dd82f9-79bf-4275-901a-514de98245a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:00.935570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63dd82f9-79bf-4275-901a-514de98245a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:00.936006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63dd82f9-79bf-4275-901a-514de98245a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:01.013423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63dd82f9-79bf-4275-901a-514de98245a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:01.022585 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63dd82f9-79bf-4275-901a-514de98245a8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1186 microversion: 2.1 time: 0.100844 Jul 28 04:23:01.023540 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4014/6464] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:00 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1186 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:02.043262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4ae24c8e-fb47-4d76-801d-ddaea45cbedd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:02.043947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4ae24c8e-fb47-4d76-801d-ddaea45cbedd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:02.051597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ae24c8e-fb47-4d76-801d-ddaea45cbedd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:02.052045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ae24c8e-fb47-4d76-801d-ddaea45cbedd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:02.052927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ae24c8e-fb47-4d76-801d-ddaea45cbedd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:02.053366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ae24c8e-fb47-4d76-801d-ddaea45cbedd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:02.116104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4ae24c8e-fb47-4d76-801d-ddaea45cbedd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:02.124957 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4ae24c8e-fb47-4d76-801d-ddaea45cbedd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1186 microversion: 2.1 time: 0.085793 Jul 28 04:23:02.125514 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4015/6465] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:02 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1186 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:03.146032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-45b6a9f2-1a54-4e9e-9b16-149b17844357 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:03.146739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-45b6a9f2-1a54-4e9e-9b16-149b17844357 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:03.154378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45b6a9f2-1a54-4e9e-9b16-149b17844357 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:03.154833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45b6a9f2-1a54-4e9e-9b16-149b17844357 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:03.155675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45b6a9f2-1a54-4e9e-9b16-149b17844357 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:03.156116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45b6a9f2-1a54-4e9e-9b16-149b17844357 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:03.227679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-45b6a9f2-1a54-4e9e-9b16-149b17844357 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:03.235828 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-45b6a9f2-1a54-4e9e-9b16-149b17844357 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1186 microversion: 2.1 time: 0.093853 Jul 28 04:23:03.236465 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4016/6466] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:03 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1186 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:04.257734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-78d38bc0-ada6-4924-b19d-48fdf065fc9f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:04.258374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-78d38bc0-ada6-4924-b19d-48fdf065fc9f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:04.266704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78d38bc0-ada6-4924-b19d-48fdf065fc9f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:04.267139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78d38bc0-ada6-4924-b19d-48fdf065fc9f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:04.267931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78d38bc0-ada6-4924-b19d-48fdf065fc9f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:04.268395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78d38bc0-ada6-4924-b19d-48fdf065fc9f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:04.334481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-78d38bc0-ada6-4924-b19d-48fdf065fc9f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:04.343137 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-78d38bc0-ada6-4924-b19d-48fdf065fc9f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1186 microversion: 2.1 time: 0.089402 Jul 28 04:23:04.343726 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4017/6467] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:04 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:05.367881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d97ca5b1-a257-4fc5-845a-8b34af0f09a1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:05.368565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d97ca5b1-a257-4fc5-845a-8b34af0f09a1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:05.377291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d97ca5b1-a257-4fc5-845a-8b34af0f09a1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:05.377772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d97ca5b1-a257-4fc5-845a-8b34af0f09a1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:05.378562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d97ca5b1-a257-4fc5-845a-8b34af0f09a1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:05.379005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d97ca5b1-a257-4fc5-845a-8b34af0f09a1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:05.411759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d97ca5b1-a257-4fc5-845a-8b34af0f09a1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:05.412208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d97ca5b1-a257-4fc5-845a-8b34af0f09a1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:05.412696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-d97ca5b1-a257-4fc5-845a-8b34af0f09a1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lazy-loading 'fault' on Instance uuid f7b1459f-e07e-42b2-9f3e-14fd5de41455 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:23:05.468857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d97ca5b1-a257-4fc5-845a-8b34af0f09a1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:05.482217 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d97ca5b1-a257-4fc5-845a-8b34af0f09a1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 200 len: 1191 microversion: 2.1 time: 0.118526 Jul 28 04:23:05.482837 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4018/6468] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:05 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 1191 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:06.508027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59130794-67b7-4dd4-9a38-d5db5385cea4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:06.508818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59130794-67b7-4dd4-9a38-d5db5385cea4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:06.517023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59130794-67b7-4dd4-9a38-d5db5385cea4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:06.517520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59130794-67b7-4dd4-9a38-d5db5385cea4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:06.518300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59130794-67b7-4dd4-9a38-d5db5385cea4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:06.518763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59130794-67b7-4dd4-9a38-d5db5385cea4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:06.532280 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-59130794-67b7-4dd4-9a38-d5db5385cea4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59130794-67b7-4dd4-9a38-d5db5385cea4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 HTTP/1.1 Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'f7b1459f-e07e-42b2-9f3e-14fd5de41455'} Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:23:06.533978 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:06.539392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:06.539392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:23:06.539392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:23:06.539392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:23:06.539392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:23:06.539392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:06.539392 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:06.539392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59130794-67b7-4dd4-9a38-d5db5385cea4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:23:06.539392 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59130794-67b7-4dd4-9a38-d5db5385cea4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 404 len: 111 microversion: 2.1 time: 0.033662 Jul 28 04:23:06.539392 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4019/6469] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:06 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:23:08.680740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dfda9c02-491d-44dc-b08b-60b24c9412c4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:08.681404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dfda9c02-491d-44dc-b08b-60b24c9412c4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:08.689149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfda9c02-491d-44dc-b08b-60b24c9412c4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:08.689657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfda9c02-491d-44dc-b08b-60b24c9412c4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:08.690638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfda9c02-491d-44dc-b08b-60b24c9412c4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:08.691273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfda9c02-491d-44dc-b08b-60b24c9412c4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:08.705841 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-dfda9c02-491d-44dc-b08b-60b24c9412c4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dfda9c02-491d-44dc-b08b-60b24c9412c4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 HTTP/1.1 Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'f7b1459f-e07e-42b2-9f3e-14fd5de41455'} Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:23:08.707407 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:23:08.713332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:08.713332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:08.713332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:23:08.713332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:08.713332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:08.713332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:23:08.713332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:23:08.713332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:23:08.713332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:23:08.713332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:08.713332 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:08.713332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dfda9c02-491d-44dc-b08b-60b24c9412c4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:23:08.713332 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dfda9c02-491d-44dc-b08b-60b24c9412c4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 404 len: 111 microversion: 2.1 time: 0.032265 Jul 28 04:23:08.713332 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4020/6470] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:23:08 2022] DELETE /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:23:08.717796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b982a0c-a7aa-48c8-948f-be145df02787 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:08.718409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5b982a0c-a7aa-48c8-948f-be145df02787 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: f7b1459f-e07e-42b2-9f3e-14fd5de41455] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:08.725034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b982a0c-a7aa-48c8-948f-be145df02787 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:08.725569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b982a0c-a7aa-48c8-948f-be145df02787 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:08.726340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b982a0c-a7aa-48c8-948f-be145df02787 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:08.726775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b982a0c-a7aa-48c8-948f-be145df02787 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:08.741152 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-5b982a0c-a7aa-48c8-948f-be145df02787 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b982a0c-a7aa-48c8-948f-be145df02787 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 HTTP/1.1 Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'f7b1459f-e07e-42b2-9f3e-14fd5de41455'} Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:23:08.742683 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:08.748416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:08.748416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:23:08.748416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:23:08.748416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:23:08.748416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:23:08.748416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. Jul 28 04:23:08.748416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:08.748416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b982a0c-a7aa-48c8-948f-be145df02787 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance f7b1459f-e07e-42b2-9f3e-14fd5de41455 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:23:08.748416 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5b982a0c-a7aa-48c8-948f-be145df02787 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455" status: 404 len: 111 microversion: 2.1 time: 0.030405 Jul 28 04:23:08.748416 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4021/6471] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:08 2022] GET /compute/v2.1/servers/f7b1459f-e07e-42b2-9f3e-14fd5de41455 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:23:13.893144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ac175d3d-1fc1-47ef-b673-d7262a19c39a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Action: 'create', calling method: .version_select at 0x7ffa66e2bdc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-343106017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLQ6w/SxA0IvtZZz8gJBKbN2uf3EtLtA05eQvWoHCNnR2/+e4J9IWrVElZtAd4Y3rBfXkr+j8gdIxQXGxPtV1/PP0TIgU8mSakM+RuPvgz3+bEvBvODubl0Q9zJoPae8A=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:23:13.899616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:23:13.942288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ac175d3d-1fc1-47ef-b673-d7262a19c39a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Getting quotas for project 54ab72fd45f247298afde074fa9b4960. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:23:13.952300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ac175d3d-1fc1-47ef-b673-d7262a19c39a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Getting quotas for user 1fc8c51b4f84432ebdaa525c2d601487 and project 54ab72fd45f247298afde074fa9b4960. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:23:13.989187 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ac175d3d-1fc1-47ef-b673-d7262a19c39a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.099794 Jul 28 04:23:13.989877 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4022/6472] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:23:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:23:15.251223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-323913608", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "a195c2a9-5151-4152-811f-63c0940fc95b"}], "key_name": "tempest-TestNetworkBasicOps-343106017", "security_groups": [{"name": "tempest-secgroup-smoke-900644343"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:23:15.368590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] validate_networks() for [('a195c2a9-5151-4152-811f-63c0940fc95b', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:23:15.787901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:23:15.788657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:23:15.789523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:23:15.789927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:23:15.790536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:23:15.799775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:15.800221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:15.801231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:15.801854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:15.821190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Getting quotas for project 54ab72fd45f247298afde074fa9b4960. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:23:15.826779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Getting quotas for user 1fc8c51b4f84432ebdaa525c2d601487 and project 54ab72fd45f247298afde074fa9b4960. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:23:15.840309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:23:15.843284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:23:15.895468 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d5e987bb-4c93-4526-b653-46428fb05c39 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.648379 Jul 28 04:23:15.896388 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4023/6473] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:23:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:23:15.908141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e283bb2-abe9-4726-bc35-e685b30e2f81 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:15.909570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0e283bb2-abe9-4726-bc35-e685b30e2f81 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:15.968042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0e283bb2-abe9-4726-bc35-e685b30e2f81 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:15.975899 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0e283bb2-abe9-4726-bc35-e685b30e2f81 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41" status: 200 len: 1247 microversion: 2.1 time: 0.072447 Jul 28 04:23:15.985308 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4024/6474] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:15 2022] GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 => generated 1247 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:16.998488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d31f2f2-da45-4c4a-bac6-8076fd638e22 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:17.000101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d31f2f2-da45-4c4a-bac6-8076fd638e22 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:17.008754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d31f2f2-da45-4c4a-bac6-8076fd638e22 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:17.009572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d31f2f2-da45-4c4a-bac6-8076fd638e22 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:17.011277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d31f2f2-da45-4c4a-bac6-8076fd638e22 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:17.012187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d31f2f2-da45-4c4a-bac6-8076fd638e22 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:17.093600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9d31f2f2-da45-4c4a-bac6-8076fd638e22 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:17.102960 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d31f2f2-da45-4c4a-bac6-8076fd638e22 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41" status: 200 len: 1307 microversion: 2.1 time: 0.109759 Jul 28 04:23:17.105969 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4025/6475] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:16 2022] GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 => generated 1307 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:18.127362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c6d92037-bb15-4bdb-98ae-bcff7b957e44 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:18.128982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c6d92037-bb15-4bdb-98ae-bcff7b957e44 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:18.136190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6d92037-bb15-4bdb-98ae-bcff7b957e44 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:18.136753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6d92037-bb15-4bdb-98ae-bcff7b957e44 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:18.137808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6d92037-bb15-4bdb-98ae-bcff7b957e44 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:18.138729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6d92037-bb15-4bdb-98ae-bcff7b957e44 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:18.143228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:23:18.311172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c6d92037-bb15-4bdb-98ae-bcff7b957e44 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:18.322627 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c6d92037-bb15-4bdb-98ae-bcff7b957e44 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41" status: 200 len: 1372 microversion: 2.1 time: 0.199452 Jul 28 04:23:18.323927 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4026/6476] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:18 2022] GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:18.478423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-ddf6a0f0-e6d7-40d9-a50b-a8a0840974c1 req-6907b3dc-f217-44ad-b818-e00b651cb5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e2bc2c-91f6-45f6-832b-d8a187474d41", "tag": "d506d356-7e8c-447d-b548-86e0e1470bf7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:23:18.503928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ddf6a0f0-e6d7-40d9-a50b-a8a0840974c1 req-6907b3dc-f217-44ad-b818-e00b651cb5f0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:18.504412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ddf6a0f0-e6d7-40d9-a50b-a8a0840974c1 req-6907b3dc-f217-44ad-b818-e00b651cb5f0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:18.518179 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-ddf6a0f0-e6d7-40d9-a50b-a8a0840974c1 req-6907b3dc-f217-44ad-b818-e00b651cb5f0 service nova] Creating event network-changed:d506d356-7e8c-447d-b548-86e0e1470bf7 for instance 96e2bc2c-91f6-45f6-832b-d8a187474d41 on n-h1-826756-3 Jul 28 04:23:18.523585 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-ddf6a0f0-e6d7-40d9-a50b-a8a0840974c1 req-6907b3dc-f217-44ad-b818-e00b651cb5f0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049725 Jul 28 04:23:18.524898 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4027/6477] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:23:19.347182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f0b57b1-898a-4f31-8bdd-abb8316e84da tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:19.347820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6f0b57b1-898a-4f31-8bdd-abb8316e84da tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:19.354093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f0b57b1-898a-4f31-8bdd-abb8316e84da tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:19.354602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f0b57b1-898a-4f31-8bdd-abb8316e84da tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:19.355361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f0b57b1-898a-4f31-8bdd-abb8316e84da tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:19.355793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6f0b57b1-898a-4f31-8bdd-abb8316e84da tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:19.498918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6f0b57b1-898a-4f31-8bdd-abb8316e84da tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:19.507012 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6f0b57b1-898a-4f31-8bdd-abb8316e84da tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41" status: 200 len: 1372 microversion: 2.1 time: 0.165353 Jul 28 04:23:19.507608 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4028/6478] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:19 2022] GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:20.529074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f79f5a8b-1de3-4c02-af38-43aa3fc5bb2d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:20.529813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f79f5a8b-1de3-4c02-af38-43aa3fc5bb2d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:20.537130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f79f5a8b-1de3-4c02-af38-43aa3fc5bb2d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:20.537572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f79f5a8b-1de3-4c02-af38-43aa3fc5bb2d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:20.538336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f79f5a8b-1de3-4c02-af38-43aa3fc5bb2d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:20.538764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f79f5a8b-1de3-4c02-af38-43aa3fc5bb2d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:20.675835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f79f5a8b-1de3-4c02-af38-43aa3fc5bb2d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:20.683912 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f79f5a8b-1de3-4c02-af38-43aa3fc5bb2d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41" status: 200 len: 1372 microversion: 2.1 time: 0.159165 Jul 28 04:23:20.684581 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4029/6479] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:20 2022] GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:21.707006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-11ea767c-e268-4832-aa0f-f6e4a06bff96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:21.707717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-11ea767c-e268-4832-aa0f-f6e4a06bff96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:21.715434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11ea767c-e268-4832-aa0f-f6e4a06bff96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:21.715892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11ea767c-e268-4832-aa0f-f6e4a06bff96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:21.716942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11ea767c-e268-4832-aa0f-f6e4a06bff96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:21.717402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11ea767c-e268-4832-aa0f-f6e4a06bff96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:21.868698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-11ea767c-e268-4832-aa0f-f6e4a06bff96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:21.876930 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-11ea767c-e268-4832-aa0f-f6e4a06bff96 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41" status: 200 len: 1372 microversion: 2.1 time: 0.173834 Jul 28 04:23:21.877533 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4030/6480] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:21 2022] GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:22.900225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aa224cdc-1835-4be2-96ff-ab58978a814d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:22.901259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aa224cdc-1835-4be2-96ff-ab58978a814d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:22.911970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa224cdc-1835-4be2-96ff-ab58978a814d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:22.912577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa224cdc-1835-4be2-96ff-ab58978a814d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:22.914307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa224cdc-1835-4be2-96ff-ab58978a814d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:22.914307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa224cdc-1835-4be2-96ff-ab58978a814d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:23.355822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aa224cdc-1835-4be2-96ff-ab58978a814d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:23.365885 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aa224cdc-1835-4be2-96ff-ab58978a814d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41" status: 200 len: 1372 microversion: 2.1 time: 0.471046 Jul 28 04:23:23.366860 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4031/6481] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:22 2022] GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 => generated 1372 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:23.685000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f6555bb1-4737-43eb-a1ff-fcca6781385e req-c8ff7f6c-d9a0-492b-8033-53577e91b0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e2bc2c-91f6-45f6-832b-d8a187474d41", "name": "network-vif-plugged", "status": "completed", "tag": "d506d356-7e8c-447d-b548-86e0e1470bf7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:23:23.694944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f6555bb1-4737-43eb-a1ff-fcca6781385e req-c8ff7f6c-d9a0-492b-8033-53577e91b0d8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:23.695404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f6555bb1-4737-43eb-a1ff-fcca6781385e req-c8ff7f6c-d9a0-492b-8033-53577e91b0d8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:23.708973 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f6555bb1-4737-43eb-a1ff-fcca6781385e req-c8ff7f6c-d9a0-492b-8033-53577e91b0d8 service nova] Creating event network-vif-plugged:d506d356-7e8c-447d-b548-86e0e1470bf7 for instance 96e2bc2c-91f6-45f6-832b-d8a187474d41 on n-h1-826756-3 Jul 28 04:23:23.714061 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f6555bb1-4737-43eb-a1ff-fcca6781385e req-c8ff7f6c-d9a0-492b-8033-53577e91b0d8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242409 Jul 28 04:23:23.714690 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4032/6482] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:23:24.389445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f4c109a-4096-4da8-877d-0f0504b74bf9 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:24.390155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f4c109a-4096-4da8-877d-0f0504b74bf9 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:24.396922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f4c109a-4096-4da8-877d-0f0504b74bf9 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:24.397378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f4c109a-4096-4da8-877d-0f0504b74bf9 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:24.398663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f4c109a-4096-4da8-877d-0f0504b74bf9 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:24.398663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f4c109a-4096-4da8-877d-0f0504b74bf9 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:24.536173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f4c109a-4096-4da8-877d-0f0504b74bf9 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:24.544377 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f4c109a-4096-4da8-877d-0f0504b74bf9 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41" status: 200 len: 1372 microversion: 2.1 time: 0.160332 Jul 28 04:23:24.544972 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4033/6483] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:24 2022] GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:25.566875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-842c0743-5f58-4748-9160-0d0e890b62a7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:25.567728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-842c0743-5f58-4748-9160-0d0e890b62a7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:25.576336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-842c0743-5f58-4748-9160-0d0e890b62a7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:25.576853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-842c0743-5f58-4748-9160-0d0e890b62a7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:25.577783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-842c0743-5f58-4748-9160-0d0e890b62a7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:25.578224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-842c0743-5f58-4748-9160-0d0e890b62a7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:25.718766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-842c0743-5f58-4748-9160-0d0e890b62a7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:25.727032 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-842c0743-5f58-4748-9160-0d0e890b62a7 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41" status: 200 len: 1544 microversion: 2.1 time: 0.164790 Jul 28 04:23:25.727709 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4034/6484] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:25 2022] GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 => generated 1544 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:25.748122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4844109c-eb2c-4fa0-8ac2-e020e5ae8ca1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:25.748786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4844109c-eb2c-4fa0-8ac2-e020e5ae8ca1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:25.755708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4844109c-eb2c-4fa0-8ac2-e020e5ae8ca1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:25.756200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4844109c-eb2c-4fa0-8ac2-e020e5ae8ca1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:25.757037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4844109c-eb2c-4fa0-8ac2-e020e5ae8ca1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:25.757651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4844109c-eb2c-4fa0-8ac2-e020e5ae8ca1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:25.813171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:23:25.894097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4844109c-eb2c-4fa0-8ac2-e020e5ae8ca1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:25.902428 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4844109c-eb2c-4fa0-8ac2-e020e5ae8ca1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41" status: 200 len: 1544 microversion: 2.1 time: 0.158297 Jul 28 04:23:25.903098 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4035/6485] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:25 2022] GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 => generated 1544 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:30.651048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-188594922", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4813f4d9-2eee-48ab-b944-532dfb746969", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:23:30.661912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:23:30.732981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] validate_networks() for [('601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:23:31.150615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:23:31.151297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:23:31.151987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:23:31.152913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:23:31.154465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:23:31.172638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:31.173606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:31.174659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:31.175338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:31.203710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:23:31.209043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for user 98c95cccd8d547a5bd528a3a3ca9fb4f and project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:23:31.272264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:23:31.274529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4813f4d9-2eee-48ab-b944-532dfb746969',volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:23:31.414586 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4ada9a3-c4ea-4a55-a1c2-1396138f2356 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769728 Jul 28 04:23:31.415223 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4036/6486] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:23:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:23:31.426846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f24da76-e981-4a07-a402-b4af6edecdda tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:31.427457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0f24da76-e981-4a07-a402-b4af6edecdda tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:31.488863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0f24da76-e981-4a07-a402-b4af6edecdda tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:31.496781 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0f24da76-e981-4a07-a402-b4af6edecdda tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1070 microversion: 2.1 time: 0.074015 Jul 28 04:23:31.500410 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4037/6487] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:31 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1070 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:32.518245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5105f278-1116-4468-a88d-67078a823936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:32.519052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5105f278-1116-4468-a88d-67078a823936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:32.529302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5105f278-1116-4468-a88d-67078a823936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:32.529849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5105f278-1116-4468-a88d-67078a823936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:32.530637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5105f278-1116-4468-a88d-67078a823936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:32.531050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5105f278-1116-4468-a88d-67078a823936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:32.599732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5105f278-1116-4468-a88d-67078a823936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:32.609332 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5105f278-1116-4468-a88d-67078a823936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1176 microversion: 2.1 time: 0.095087 Jul 28 04:23:32.624380 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4038/6488] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:32 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1176 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:33.631205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-73680c8d-73bb-42be-886c-bd125ba2de25 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:33.631861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-73680c8d-73bb-42be-886c-bd125ba2de25 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:33.639389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73680c8d-73bb-42be-886c-bd125ba2de25 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:33.639868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73680c8d-73bb-42be-886c-bd125ba2de25 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:33.640663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73680c8d-73bb-42be-886c-bd125ba2de25 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:33.641104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73680c8d-73bb-42be-886c-bd125ba2de25 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:33.803099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-73680c8d-73bb-42be-886c-bd125ba2de25 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:33.814125 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-73680c8d-73bb-42be-886c-bd125ba2de25 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1228 microversion: 2.1 time: 0.186469 Jul 28 04:23:33.815312 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4039/6489] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:33 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1228 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:34.004432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-375106cb-24bc-45ec-80e3-5478f2fe4a8e req-b36ed073-df8e-431f-9d25-3b5e01baf46f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a087b56c-b63b-4266-890f-20cc4f0cbcd7", "tag": "17382a72-9910-4ee0-862f-59221a963e66"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:23:34.016163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-375106cb-24bc-45ec-80e3-5478f2fe4a8e req-b36ed073-df8e-431f-9d25-3b5e01baf46f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:34.017005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-375106cb-24bc-45ec-80e3-5478f2fe4a8e req-b36ed073-df8e-431f-9d25-3b5e01baf46f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:34.030186 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-375106cb-24bc-45ec-80e3-5478f2fe4a8e req-b36ed073-df8e-431f-9d25-3b5e01baf46f service nova] Creating event network-changed:17382a72-9910-4ee0-862f-59221a963e66 for instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 on n-h2-826756-3 Jul 28 04:23:34.036509 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-375106cb-24bc-45ec-80e3-5478f2fe4a8e req-b36ed073-df8e-431f-9d25-3b5e01baf46f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036191 Jul 28 04:23:34.037712 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4040/6490] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:23:34.836676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40e13a7d-0822-4489-b50e-23173fdfee63 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:34.837415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40e13a7d-0822-4489-b50e-23173fdfee63 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:34.845163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40e13a7d-0822-4489-b50e-23173fdfee63 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:34.845720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40e13a7d-0822-4489-b50e-23173fdfee63 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:34.846561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40e13a7d-0822-4489-b50e-23173fdfee63 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:34.847060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40e13a7d-0822-4489-b50e-23173fdfee63 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:34.997311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40e13a7d-0822-4489-b50e-23173fdfee63 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:35.009382 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40e13a7d-0822-4489-b50e-23173fdfee63 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1228 microversion: 2.1 time: 0.177646 Jul 28 04:23:35.010751 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4041/6491] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:34 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1228 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:36.030999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9f1ff959-fd77-4640-a742-3fe1153aaa8e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:36.031626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9f1ff959-fd77-4640-a742-3fe1153aaa8e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:36.045378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f1ff959-fd77-4640-a742-3fe1153aaa8e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:36.045867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f1ff959-fd77-4640-a742-3fe1153aaa8e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:36.046626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f1ff959-fd77-4640-a742-3fe1153aaa8e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:36.047274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f1ff959-fd77-4640-a742-3fe1153aaa8e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:36.190653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9f1ff959-fd77-4640-a742-3fe1153aaa8e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:36.199001 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9f1ff959-fd77-4640-a742-3fe1153aaa8e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1228 microversion: 2.1 time: 0.171845 Jul 28 04:23:36.201613 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4042/6492] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:36 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1228 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:37.227091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4ee53127-b72d-48aa-96ec-dd2f28c895d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:37.228166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4ee53127-b72d-48aa-96ec-dd2f28c895d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:37.236670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ee53127-b72d-48aa-96ec-dd2f28c895d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:37.237127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ee53127-b72d-48aa-96ec-dd2f28c895d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:37.237933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ee53127-b72d-48aa-96ec-dd2f28c895d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:37.238352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ee53127-b72d-48aa-96ec-dd2f28c895d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:37.335382 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:23:37.335992 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:23:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:23:37.371075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4ee53127-b72d-48aa-96ec-dd2f28c895d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:37.379653 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4ee53127-b72d-48aa-96ec-dd2f28c895d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1228 microversion: 2.1 time: 0.159238 Jul 28 04:23:37.380229 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4043/6493] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:37 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1228 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:38.401166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66acb534-0cff-4f94-b708-f7403536061b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:38.402063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-66acb534-0cff-4f94-b708-f7403536061b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:38.409359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66acb534-0cff-4f94-b708-f7403536061b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:38.409713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66acb534-0cff-4f94-b708-f7403536061b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:38.410544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66acb534-0cff-4f94-b708-f7403536061b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:38.410980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66acb534-0cff-4f94-b708-f7403536061b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:38.562024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-66acb534-0cff-4f94-b708-f7403536061b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:38.571038 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-66acb534-0cff-4f94-b708-f7403536061b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1216 microversion: 2.1 time: 0.173759 Jul 28 04:23:38.571528 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4044/6494] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:38 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1216 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:39.592135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59e75393-ea11-4693-9e07-16cd13c0d936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:39.593287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59e75393-ea11-4693-9e07-16cd13c0d936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:39.600678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59e75393-ea11-4693-9e07-16cd13c0d936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:39.601455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59e75393-ea11-4693-9e07-16cd13c0d936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:39.602269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59e75393-ea11-4693-9e07-16cd13c0d936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:39.602732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59e75393-ea11-4693-9e07-16cd13c0d936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:39.761550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-59e75393-ea11-4693-9e07-16cd13c0d936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:39.769624 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59e75393-ea11-4693-9e07-16cd13c0d936 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1216 microversion: 2.1 time: 0.181710 Jul 28 04:23:39.770196 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4045/6495] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:39 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1216 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:40.793699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b4d63153-2e99-4a7f-bf99-04250ecf1a30 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:40.794606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4d63153-2e99-4a7f-bf99-04250ecf1a30 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:40.804453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4d63153-2e99-4a7f-bf99-04250ecf1a30 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:40.805106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4d63153-2e99-4a7f-bf99-04250ecf1a30 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:40.806201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4d63153-2e99-4a7f-bf99-04250ecf1a30 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:40.806906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4d63153-2e99-4a7f-bf99-04250ecf1a30 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:40.826700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:23:40.954433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b4d63153-2e99-4a7f-bf99-04250ecf1a30 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:40.962840 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b4d63153-2e99-4a7f-bf99-04250ecf1a30 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1216 microversion: 2.1 time: 0.174974 Jul 28 04:23:40.963673 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4046/6496] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:40 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1216 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:41.990841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0bae5b04-4f42-48d4-9b63-10b92e36268b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:41.991552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0bae5b04-4f42-48d4-9b63-10b92e36268b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:41.993450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:23:41.994154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:23:42.002638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0bae5b04-4f42-48d4-9b63-10b92e36268b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:42.003087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0bae5b04-4f42-48d4-9b63-10b92e36268b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:42.003856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0bae5b04-4f42-48d4-9b63-10b92e36268b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:42.004306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0bae5b04-4f42-48d4-9b63-10b92e36268b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:42.152100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0bae5b04-4f42-48d4-9b63-10b92e36268b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:42.161468 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0bae5b04-4f42-48d4-9b63-10b92e36268b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1216 microversion: 2.1 time: 0.174698 Jul 28 04:23:42.162050 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4047/6497] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:41 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1216 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:43.183675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51cda601-1e4c-4d6e-b4ff-5bc8b39835c0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:43.184390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-51cda601-1e4c-4d6e-b4ff-5bc8b39835c0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:43.192039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51cda601-1e4c-4d6e-b4ff-5bc8b39835c0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:43.192536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51cda601-1e4c-4d6e-b4ff-5bc8b39835c0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:43.193343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51cda601-1e4c-4d6e-b4ff-5bc8b39835c0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:43.193792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51cda601-1e4c-4d6e-b4ff-5bc8b39835c0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:43.331978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-51cda601-1e4c-4d6e-b4ff-5bc8b39835c0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:43.342295 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51cda601-1e4c-4d6e-b4ff-5bc8b39835c0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1216 microversion: 2.1 time: 0.162647 Jul 28 04:23:43.342748 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4048/6498] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:43 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1216 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:44.363697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a8b94da-855c-44b8-961c-4b8b48c73d14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:44.364372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4a8b94da-855c-44b8-961c-4b8b48c73d14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:44.367017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:23:44.373128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a8b94da-855c-44b8-961c-4b8b48c73d14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:44.373584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a8b94da-855c-44b8-961c-4b8b48c73d14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:44.374479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a8b94da-855c-44b8-961c-4b8b48c73d14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:44.374922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a8b94da-855c-44b8-961c-4b8b48c73d14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:44.522569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a8b94da-855c-44b8-961c-4b8b48c73d14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:44.531071 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4a8b94da-855c-44b8-961c-4b8b48c73d14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1216 microversion: 2.1 time: 0.171527 Jul 28 04:23:44.531675 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4049/6499] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:44 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1216 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:45.553447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c05d2d3a-abcc-4831-80c6-f69e2b7c56d9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:45.554041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c05d2d3a-abcc-4831-80c6-f69e2b7c56d9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:45.561127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c05d2d3a-abcc-4831-80c6-f69e2b7c56d9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:45.561604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c05d2d3a-abcc-4831-80c6-f69e2b7c56d9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:45.562597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c05d2d3a-abcc-4831-80c6-f69e2b7c56d9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:45.563047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c05d2d3a-abcc-4831-80c6-f69e2b7c56d9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:45.704291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c05d2d3a-abcc-4831-80c6-f69e2b7c56d9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:45.712871 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c05d2d3a-abcc-4831-80c6-f69e2b7c56d9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1216 microversion: 2.1 time: 0.163627 Jul 28 04:23:45.713452 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4050/6500] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:45 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1216 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:46.738262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ea2c214-8392-4335-8485-d92fc26e5bc8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:46.739015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5ea2c214-8392-4335-8485-d92fc26e5bc8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:46.746422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ea2c214-8392-4335-8485-d92fc26e5bc8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:46.746865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ea2c214-8392-4335-8485-d92fc26e5bc8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:46.747758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ea2c214-8392-4335-8485-d92fc26e5bc8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:46.748302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ea2c214-8392-4335-8485-d92fc26e5bc8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:46.899043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ea2c214-8392-4335-8485-d92fc26e5bc8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:46.907491 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ea2c214-8392-4335-8485-d92fc26e5bc8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1216 microversion: 2.1 time: 0.174448 Jul 28 04:23:46.908122 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4051/6501] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:46 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1216 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:47.889365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c1cbedee-349e-4e9c-b084-62479773ea26 req-6d090c92-f0d9-406f-be28-9c973be07424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a087b56c-b63b-4266-890f-20cc4f0cbcd7", "name": "network-vif-plugged", "status": "completed", "tag": "17382a72-9910-4ee0-862f-59221a963e66"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:23:47.900512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c1cbedee-349e-4e9c-b084-62479773ea26 req-6d090c92-f0d9-406f-be28-9c973be07424 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:47.900965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c1cbedee-349e-4e9c-b084-62479773ea26 req-6d090c92-f0d9-406f-be28-9c973be07424 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:47.914696 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c1cbedee-349e-4e9c-b084-62479773ea26 req-6d090c92-f0d9-406f-be28-9c973be07424 service nova] Creating event network-vif-plugged:17382a72-9910-4ee0-862f-59221a963e66 for instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 on n-h2-826756-3 Jul 28 04:23:47.920469 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c1cbedee-349e-4e9c-b084-62479773ea26 req-6d090c92-f0d9-406f-be28-9c973be07424 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034916 Jul 28 04:23:47.921147 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4052/6502] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:23:47.931479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a787279e-1369-4dbc-ad2a-86091c9e1bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:47.932086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a787279e-1369-4dbc-ad2a-86091c9e1bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:47.939144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a787279e-1369-4dbc-ad2a-86091c9e1bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:47.939610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a787279e-1369-4dbc-ad2a-86091c9e1bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:47.940444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a787279e-1369-4dbc-ad2a-86091c9e1bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:47.940864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a787279e-1369-4dbc-ad2a-86091c9e1bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:48.087312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a787279e-1369-4dbc-ad2a-86091c9e1bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:48.095807 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a787279e-1369-4dbc-ad2a-86091c9e1bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1216 microversion: 2.1 time: 0.169612 Jul 28 04:23:48.096531 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4053/6503] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:47 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:49.117576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-52f7ce7e-a4f1-492b-a04f-723bb40809f3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:49.118410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-52f7ce7e-a4f1-492b-a04f-723bb40809f3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:49.126307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52f7ce7e-a4f1-492b-a04f-723bb40809f3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:49.127707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52f7ce7e-a4f1-492b-a04f-723bb40809f3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:49.127707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52f7ce7e-a4f1-492b-a04f-723bb40809f3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:49.128012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52f7ce7e-a4f1-492b-a04f-723bb40809f3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:49.287155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-52f7ce7e-a4f1-492b-a04f-723bb40809f3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:49.295564 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-52f7ce7e-a4f1-492b-a04f-723bb40809f3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1216 microversion: 2.1 time: 0.182183 Jul 28 04:23:49.296259 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4054/6504] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:49 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1216 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:50.342682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1b68a06b-20be-4524-b638-1a5bf4a942a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:50.343745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1b68a06b-20be-4524-b638-1a5bf4a942a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:50.350209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b68a06b-20be-4524-b638-1a5bf4a942a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:50.350868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b68a06b-20be-4524-b638-1a5bf4a942a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:50.351653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b68a06b-20be-4524-b638-1a5bf4a942a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:50.352087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b68a06b-20be-4524-b638-1a5bf4a942a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:50.379453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1b68a06b-20be-4524-b638-1a5bf4a942a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:23:50.464092 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1b68a06b-20be-4524-b638-1a5bf4a942a6 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 204 len: 0 microversion: 2.1 time: 0.259085 Jul 28 04:23:50.464840 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4055/6505] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:23:50 2022] DELETE /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:23:50.470725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7232aa50-2486-46fd-8413-64a5cbd3c3ba tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:50.471430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7232aa50-2486-46fd-8413-64a5cbd3c3ba tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:50.477747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7232aa50-2486-46fd-8413-64a5cbd3c3ba tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:50.478195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7232aa50-2486-46fd-8413-64a5cbd3c3ba tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:50.478984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7232aa50-2486-46fd-8413-64a5cbd3c3ba tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:50.479416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7232aa50-2486-46fd-8413-64a5cbd3c3ba tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:50.632319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7232aa50-2486-46fd-8413-64a5cbd3c3ba tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:50.640902 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7232aa50-2486-46fd-8413-64a5cbd3c3ba tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1402 microversion: 2.1 time: 0.174999 Jul 28 04:23:50.641493 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4056/6506] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:50 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1402 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:50.646430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-58f7203e-0071-44e8-a596-a4b23d744a4b tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:50.647049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-58f7203e-0071-44e8-a596-a4b23d744a4b tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:50.653779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58f7203e-0071-44e8-a596-a4b23d744a4b tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:50.654291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58f7203e-0071-44e8-a596-a4b23d744a4b tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:50.655350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58f7203e-0071-44e8-a596-a4b23d744a4b tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:50.655886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58f7203e-0071-44e8-a596-a4b23d744a4b tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:50.799124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-58f7203e-0071-44e8-a596-a4b23d744a4b tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:50.807638 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-58f7203e-0071-44e8-a596-a4b23d744a4b tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1733 microversion: 2.1 time: 0.165048 Jul 28 04:23:50.808232 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4057/6507] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:50 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:50.813095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ad6c30d-cb7b-4096-9d43-7e01ec064f00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:50.813684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5ad6c30d-cb7b-4096-9d43-7e01ec064f00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:50.820569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ad6c30d-cb7b-4096-9d43-7e01ec064f00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:50.821034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ad6c30d-cb7b-4096-9d43-7e01ec064f00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:50.821823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ad6c30d-cb7b-4096-9d43-7e01ec064f00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:50.822257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ad6c30d-cb7b-4096-9d43-7e01ec064f00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:50.975217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ad6c30d-cb7b-4096-9d43-7e01ec064f00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:50.983883 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ad6c30d-cb7b-4096-9d43-7e01ec064f00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1402 microversion: 2.1 time: 0.174449 Jul 28 04:23:50.984507 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4058/6508] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:50 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1402 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:51.006969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e6fc44b5-927c-4e6d-9377-a3021371cc6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1252929773"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:23:51.009591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e6fc44b5-927c-4e6d-9377-a3021371cc6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:51.016259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6fc44b5-927c-4e6d-9377-a3021371cc6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:51.016734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6fc44b5-927c-4e6d-9377-a3021371cc6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:51.017651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6fc44b5-927c-4e6d-9377-a3021371cc6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:51.017973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6fc44b5-927c-4e6d-9377-a3021371cc6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:51.126438 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.compute.api [None req-e6fc44b5-927c-4e6d-9377-a3021371cc6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Attempting to quiesce instance before volume snapshot. Jul 28 04:23:51.784666 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.compute.api [None req-e6fc44b5-927c-4e6d-9377-a3021371cc6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 28 04:23:51.885012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e6fc44b5-927c-4e6d-9377-a3021371cc6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Creating snapshot from volume 4813f4d9-2eee-48ab-b944-532dfb746969. {{(pid=126071) snapshot_instance /opt/stack/nova/nova/compute/api.py:3500}} Jul 28 04:23:53.003709 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e6fc44b5-927c-4e6d-9377-a3021371cc6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "POST /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7/action" status: 202 len: 0 microversion: 2.1 time: 2.002522 Jul 28 04:23:53.011578 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4059/6509] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:23:50 2022] POST /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7/action => generated 0 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 04:23:53.033174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d81d5392-cce6-4537-ad0c-289154d8d329 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:53.037102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d81d5392-cce6-4537-ad0c-289154d8d329 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:53.058430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d81d5392-cce6-4537-ad0c-289154d8d329 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:53.059386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d81d5392-cce6-4537-ad0c-289154d8d329 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:53.060584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d81d5392-cce6-4537-ad0c-289154d8d329 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:53.061212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d81d5392-cce6-4537-ad0c-289154d8d329 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:53.093949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:23:53.178310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d81d5392-cce6-4537-ad0c-289154d8d329 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:53.189720 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d81d5392-cce6-4537-ad0c-289154d8d329 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1665 microversion: 2.1 time: 0.176588 Jul 28 04:23:53.191424 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4060/6510] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:53 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1665 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:53.199481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-994524f9-5921-4464-a1be-181de5af1510 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:53.200682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-994524f9-5921-4464-a1be-181de5af1510 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:53.208392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-994524f9-5921-4464-a1be-181de5af1510 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:53.208977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-994524f9-5921-4464-a1be-181de5af1510 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:53.209848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-994524f9-5921-4464-a1be-181de5af1510 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:53.210381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-994524f9-5921-4464-a1be-181de5af1510 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:53.241147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-994524f9-5921-4464-a1be-181de5af1510 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:23:53.366750 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-994524f9-5921-4464-a1be-181de5af1510 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "DELETE /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41" status: 204 len: 0 microversion: 2.1 time: 0.173633 Jul 28 04:23:53.370915 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4061/6511] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:23:53 2022] DELETE /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:23:53.397069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-92899176-ebca-4369-b43c-8f65887819a6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:53.398068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-92899176-ebca-4369-b43c-8f65887819a6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:53.407826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92899176-ebca-4369-b43c-8f65887819a6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:53.408438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92899176-ebca-4369-b43c-8f65887819a6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:53.409409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92899176-ebca-4369-b43c-8f65887819a6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:53.409966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92899176-ebca-4369-b43c-8f65887819a6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:53.732791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-92899176-ebca-4369-b43c-8f65887819a6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:53.765163 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-92899176-ebca-4369-b43c-8f65887819a6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41" status: 200 len: 1550 microversion: 2.1 time: 0.391536 Jul 28 04:23:53.781632 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4062/6512] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:53 2022] GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 => generated 1550 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:53.787228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-23977f64-ffbd-42bc-97b9-6db892b2d122 req-fc9b7263-41d2-4aa6-9c3f-ff886e557fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42b42f04-e54f-4475-bcdb-2c4c3070543f", "name": "network-vif-deleted", "tag": "59cce054-f1db-4d9c-b8aa-a71ad8bc67a2"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:23:53.802679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-23977f64-ffbd-42bc-97b9-6db892b2d122 req-fc9b7263-41d2-4aa6-9c3f-ff886e557fdd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:53.803156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-23977f64-ffbd-42bc-97b9-6db892b2d122 req-fc9b7263-41d2-4aa6-9c3f-ff886e557fdd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:53.821684 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-23977f64-ffbd-42bc-97b9-6db892b2d122 req-fc9b7263-41d2-4aa6-9c3f-ff886e557fdd service nova] Creating event network-vif-deleted:59cce054-f1db-4d9c-b8aa-a71ad8bc67a2 for instance 42b42f04-e54f-4475-bcdb-2c4c3070543f on n-h2-826756-3 Jul 28 04:23:53.836285 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-23977f64-ffbd-42bc-97b9-6db892b2d122 req-fc9b7263-41d2-4aa6-9c3f-ff886e557fdd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053890 Jul 28 04:23:53.838670 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4063/6513] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:23:54.211721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2d9dbed-5f9a-4504-ba9f-5f5c28808c69 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:54.212775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d2d9dbed-5f9a-4504-ba9f-5f5c28808c69 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:54.223148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2d9dbed-5f9a-4504-ba9f-5f5c28808c69 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:54.223890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2d9dbed-5f9a-4504-ba9f-5f5c28808c69 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:54.225068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2d9dbed-5f9a-4504-ba9f-5f5c28808c69 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:54.225855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2d9dbed-5f9a-4504-ba9f-5f5c28808c69 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:54.262462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2d9dbed-5f9a-4504-ba9f-5f5c28808c69 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:54.262933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2d9dbed-5f9a-4504-ba9f-5f5c28808c69 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:54.263502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-d2d9dbed-5f9a-4504-ba9f-5f5c28808c69 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lazy-loading 'fault' on Instance uuid 42b42f04-e54f-4475-bcdb-2c4c3070543f {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:23:54.326412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d2d9dbed-5f9a-4504-ba9f-5f5c28808c69 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0740413e14c4436193d1344079c7d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae046f019ec40ff8d58411a07c1536b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:54.340712 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d2d9dbed-5f9a-4504-ba9f-5f5c28808c69 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 200 len: 1388 microversion: 2.1 time: 0.133156 Jul 28 04:23:54.341327 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4064/6514] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:54 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 1388 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:23:54.346742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1069035747", "imageRef": "001872a7-2d07-42c1-b2d4-072086daafc7", "flavorRef": "452", "networks": [{"uuid": "601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:23:54.405903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] validate_networks() for [('601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:23:54.864272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:23:54.864886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:23:54.865437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:23:54.865860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:23:54.866282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:23:54.887777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:54.888424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:54.889390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:54.890099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:54.912187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:23:54.927086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for user 98c95cccd8d547a5bd528a3a3ca9fb4f and project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:23:54.944511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:23:54.948004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='275a6679-5416-4874-912a-5990dde03e68',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:23:55.039499 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0daae99c-64b1-44cf-87f1-13201b448dc6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697064 Jul 28 04:23:55.040969 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4065/6515] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:23:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:23:55.051606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3d9c01bd-fd48-4a04-a5c4-bae0bacc7697 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:55.051606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3d9c01bd-fd48-4a04-a5c4-bae0bacc7697 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:55.067648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d9c01bd-fd48-4a04-a5c4-bae0bacc7697 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:55.069010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d9c01bd-fd48-4a04-a5c4-bae0bacc7697 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:55.069852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d9c01bd-fd48-4a04-a5c4-bae0bacc7697 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:55.070308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d9c01bd-fd48-4a04-a5c4-bae0bacc7697 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:55.245708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3d9c01bd-fd48-4a04-a5c4-bae0bacc7697 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:55.254529 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3d9c01bd-fd48-4a04-a5c4-bae0bacc7697 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41" status: 200 len: 1550 microversion: 2.1 time: 0.212115 Jul 28 04:23:55.255506 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4066/6516] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:55 2022] GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 => generated 1550 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:55.260749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f4ab12c-ba44-4d2a-9ae8-18b1ca73438c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:55.261380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f4ab12c-ba44-4d2a-9ae8-18b1ca73438c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:55.322077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f4ab12c-ba44-4d2a-9ae8-18b1ca73438c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:55.332998 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f4ab12c-ba44-4d2a-9ae8-18b1ca73438c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1230 microversion: 2.1 time: 0.075766 Jul 28 04:23:55.348866 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4067/6517] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:55 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:55.374137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce2d5f08-060d-49d4-b5fd-7054103f7427 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:55.374804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ce2d5f08-060d-49d4-b5fd-7054103f7427 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:55.381941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce2d5f08-060d-49d4-b5fd-7054103f7427 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:55.382896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce2d5f08-060d-49d4-b5fd-7054103f7427 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:55.384029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce2d5f08-060d-49d4-b5fd-7054103f7427 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:55.385009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce2d5f08-060d-49d4-b5fd-7054103f7427 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:55.401566 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-ce2d5f08-060d-49d4-b5fd-7054103f7427 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] HTTP exception thrown: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce2d5f08-060d-49d4-b5fd-7054103f7427 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Request method failure captured: Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f HTTP/1.1 Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g4dnXkT_ices0ZwoHT9mNFkFgd7HCU4boT2T5bHp2C_qisOi3QzgZvFInxsbu3ZTquY5mfACilJBxewkoUnLSTuH6mkWuGkzOn5uElk6wL4WsPPZHWxuw92AltnQpmuASrYk67BffVs2z236AiiFV772vfvTI5p7jIZ3dpCiHUZwUw Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7ae046f019ec40ff8d58411a07c1536b Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestServerBasicOps-2110541680 Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7ae046f019ec40ff8d58411a07c1536b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ae046f019ec40ff8d58411a07c1536b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7ae046f019ec40ff8d58411a07c1536b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ae046f019ec40ff8d58411a07c1536b"}]}] Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestServerBasicOps-2110541680 Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7ae046f019ec40ff8d58411a07c1536b Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestServerBasicOps-2110541680 Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestServerBasicOps-2110541680-project Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0740413e14c4436193d1344079c7d063 Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestServerBasicOps-2110541680-project Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '42b42f04-e54f-4475-bcdb-2c4c3070543f'} Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:23:55.403384 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.409906 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:55.409906 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:23:55.409906 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:23:55.409906 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:23:55.409906 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:23:55.409906 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.409906 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.409906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce2d5f08-060d-49d4-b5fd-7054103f7427 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Returning 404 to user: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:23:55.409906 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce2d5f08-060d-49d4-b5fd-7054103f7427 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 404 len: 111 microversion: 2.1 time: 0.035018 Jul 28 04:23:55.409906 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4068/6518] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:55 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:23:55.864923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-871ebd30-73c2-4a09-b820-72b194622e56 req-f51b75f7-d357-4742-b3b1-a044cffa4d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e2bc2c-91f6-45f6-832b-d8a187474d41", "name": "network-vif-deleted", "tag": "d506d356-7e8c-447d-b548-86e0e1470bf7"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:23:55.877452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-871ebd30-73c2-4a09-b820-72b194622e56 req-f51b75f7-d357-4742-b3b1-a044cffa4d53 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:55.878037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-871ebd30-73c2-4a09-b820-72b194622e56 req-f51b75f7-d357-4742-b3b1-a044cffa4d53 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:55.890444 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-871ebd30-73c2-4a09-b820-72b194622e56 req-f51b75f7-d357-4742-b3b1-a044cffa4d53 service nova] Creating event network-vif-deleted:d506d356-7e8c-447d-b548-86e0e1470bf7 for instance 96e2bc2c-91f6-45f6-832b-d8a187474d41 on n-h1-826756-3 Jul 28 04:23:55.895655 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-871ebd30-73c2-4a09-b820-72b194622e56 req-f51b75f7-d357-4742-b3b1-a044cffa4d53 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035450 Jul 28 04:23:55.896463 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4069/6519] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:23:55.929489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8cb068cf-ddba-415c-8373-70693be6bf3d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:55.930098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8cb068cf-ddba-415c-8373-70693be6bf3d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:55.936850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cb068cf-ddba-415c-8373-70693be6bf3d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:55.937318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cb068cf-ddba-415c-8373-70693be6bf3d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:55.938130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cb068cf-ddba-415c-8373-70693be6bf3d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:55.938655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8cb068cf-ddba-415c-8373-70693be6bf3d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:55.952771 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-8cb068cf-ddba-415c-8373-70693be6bf3d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] HTTP exception thrown: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8cb068cf-ddba-415c-8373-70693be6bf3d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Request method failure captured: Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f HTTP/1.1 Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g4dnXkT_ices0ZwoHT9mNFkFgd7HCU4boT2T5bHp2C_qisOi3QzgZvFInxsbu3ZTquY5mfACilJBxewkoUnLSTuH6mkWuGkzOn5uElk6wL4WsPPZHWxuw92AltnQpmuASrYk67BffVs2z236AiiFV772vfvTI5p7jIZ3dpCiHUZwUw Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7ae046f019ec40ff8d58411a07c1536b Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestServerBasicOps-2110541680 Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7ae046f019ec40ff8d58411a07c1536b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ae046f019ec40ff8d58411a07c1536b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7ae046f019ec40ff8d58411a07c1536b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ae046f019ec40ff8d58411a07c1536b"}]}] Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestServerBasicOps-2110541680 Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7ae046f019ec40ff8d58411a07c1536b Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestServerBasicOps-2110541680 Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestServerBasicOps-2110541680-project Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0740413e14c4436193d1344079c7d063 Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestServerBasicOps-2110541680-project Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '42b42f04-e54f-4475-bcdb-2c4c3070543f'} Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:23:55.954488 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.959887 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.959887 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:23:55.959887 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.959887 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:55.959887 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:23:55.959887 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:23:55.959887 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:23:55.959887 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:23:55.959887 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.959887 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.959887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8cb068cf-ddba-415c-8373-70693be6bf3d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Returning 404 to user: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:23:55.959887 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8cb068cf-ddba-415c-8373-70693be6bf3d tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "DELETE /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 404 len: 111 microversion: 2.1 time: 0.031206 Jul 28 04:23:55.959887 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4070/6520] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:23:55 2022] DELETE /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:23:55.964533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06a04415-7b32-4d2f-9bde-3244e9015125 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:55.965164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-06a04415-7b32-4d2f-9bde-3244e9015125 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] [instance: 42b42f04-e54f-4475-bcdb-2c4c3070543f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:55.971633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06a04415-7b32-4d2f-9bde-3244e9015125 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:55.972100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06a04415-7b32-4d2f-9bde-3244e9015125 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:55.972910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06a04415-7b32-4d2f-9bde-3244e9015125 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:55.973366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06a04415-7b32-4d2f-9bde-3244e9015125 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:55.989439 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-06a04415-7b32-4d2f-9bde-3244e9015125 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] HTTP exception thrown: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06a04415-7b32-4d2f-9bde-3244e9015125 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Request method failure captured: Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f HTTP/1.1 Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g4dnXkT_ices0ZwoHT9mNFkFgd7HCU4boT2T5bHp2C_qisOi3QzgZvFInxsbu3ZTquY5mfACilJBxewkoUnLSTuH6mkWuGkzOn5uElk6wL4WsPPZHWxuw92AltnQpmuASrYk67BffVs2z236AiiFV772vfvTI5p7jIZ3dpCiHUZwUw Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7ae046f019ec40ff8d58411a07c1536b Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestServerBasicOps-2110541680 Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7ae046f019ec40ff8d58411a07c1536b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ae046f019ec40ff8d58411a07c1536b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7ae046f019ec40ff8d58411a07c1536b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7ae046f019ec40ff8d58411a07c1536b"}]}] Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestServerBasicOps-2110541680 Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7ae046f019ec40ff8d58411a07c1536b Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestServerBasicOps-2110541680 Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestServerBasicOps-2110541680-project Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 0740413e14c4436193d1344079c7d063 Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestServerBasicOps-2110541680-project Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '42b42f04-e54f-4475-bcdb-2c4c3070543f'} Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:23:55.990993 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.999943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:55.999943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:23:55.999943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:23:55.999943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:23:55.999943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:23:55.999943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. Jul 28 04:23:55.999943 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:55.999943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06a04415-7b32-4d2f-9bde-3244e9015125 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Returning 404 to user: Instance 42b42f04-e54f-4475-bcdb-2c4c3070543f could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:23:55.999943 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-06a04415-7b32-4d2f-9bde-3244e9015125 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f" status: 404 len: 111 microversion: 2.1 time: 0.031552 Jul 28 04:23:55.999943 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4071/6521] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:55 2022] GET /compute/v2.1/servers/42b42f04-e54f-4475-bcdb-2c4c3070543f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:23:56.170843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf4e0a4d-d136-4405-9e3e-90da4266caf2 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] Calling method '.version_select at 0x7ffa67761430>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:56.194745 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf4e0a4d-d136-4405-9e3e-90da4266caf2 tempest-TestServerBasicOps-2110541680 tempest-TestServerBasicOps-2110541680-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2096745502" status: 202 len: 0 microversion: 2.1 time: 0.028424 Jul 28 04:23:56.195778 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4072/6522] 10.222.0.48 () {58 vars in 1254 bytes} [Thu Jul 28 04:23:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2096745502 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:23:56.277600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b691c03b-ea35-4a19-a7e6-d23e7afc435a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:56.278308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b691c03b-ea35-4a19-a7e6-d23e7afc435a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 96e2bc2c-91f6-45f6-832b-d8a187474d41] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:56.291303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b691c03b-ea35-4a19-a7e6-d23e7afc435a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:56.292270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b691c03b-ea35-4a19-a7e6-d23e7afc435a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:56.293398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b691c03b-ea35-4a19-a7e6-d23e7afc435a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:56.294287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b691c03b-ea35-4a19-a7e6-d23e7afc435a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:56.317690 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-b691c03b-ea35-4a19-a7e6-d23e7afc435a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] HTTP exception thrown: Instance 96e2bc2c-91f6-45f6-832b-d8a187474d41 could not be found. Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b691c03b-ea35-4a19-a7e6-d23e7afc435a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Request method failure captured: Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 HTTP/1.1 Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g74z8tso9myfnG8JK7jikXH-7369SOXR9q5UnWoDB1jLiZ_jKw3b178pGHLOShMq3AJtVKhHxMqn1EfTP0un3XcUYaTlDDRnr-SX6ODtLUxKM32QkQk6fgb0VFp_QLRFZXOMtwNKhkx6lX44loE7fZWTMTS9wk30ZaYTQtfEcydeyc Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 54ab72fd45f247298afde074fa9b4960 Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestNetworkBasicOps-632794303 Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54ab72fd45f247298afde074fa9b4960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54ab72fd45f247298afde074fa9b4960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54ab72fd45f247298afde074fa9b4960"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54ab72fd45f247298afde074fa9b4960"}]}] Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestNetworkBasicOps-632794303 Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 54ab72fd45f247298afde074fa9b4960 Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestNetworkBasicOps-632794303 Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestNetworkBasicOps-632794303-project Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 1fc8c51b4f84432ebdaa525c2d601487 Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestNetworkBasicOps-632794303-project Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 96e2bc2c-91f6-45f6-832b-d8a187474d41 could not be found. Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '96e2bc2c-91f6-45f6-832b-d8a187474d41'} Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96e2bc2c-91f6-45f6-832b-d8a187474d41 could not be found. Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96e2bc2c-91f6-45f6-832b-d8a187474d41 could not be found. Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:23:56.319194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:56.326522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:23:56.326522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:23:56.326522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:23:56.326522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:23:56.326522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:23:56.326522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96e2bc2c-91f6-45f6-832b-d8a187474d41 could not be found. Jul 28 04:23:56.326522 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:23:56.326522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b691c03b-ea35-4a19-a7e6-d23e7afc435a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Returning 404 to user: Instance 96e2bc2c-91f6-45f6-832b-d8a187474d41 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:23:56.326522 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b691c03b-ea35-4a19-a7e6-d23e7afc435a tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41" status: 404 len: 111 microversion: 2.1 time: 0.048369 Jul 28 04:23:56.326522 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4073/6523] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:56 2022] GET /compute/v2.1/servers/96e2bc2c-91f6-45f6-832b-d8a187474d41 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:23:56.362737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7325a352-65d1-43f1-9292-f8c4a293ddd7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:56.364053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7325a352-65d1-43f1-9292-f8c4a293ddd7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:56.375459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7325a352-65d1-43f1-9292-f8c4a293ddd7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:56.375924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7325a352-65d1-43f1-9292-f8c4a293ddd7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:56.380811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7325a352-65d1-43f1-9292-f8c4a293ddd7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:56.382777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7325a352-65d1-43f1-9292-f8c4a293ddd7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:56.545010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7325a352-65d1-43f1-9292-f8c4a293ddd7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:56.554133 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7325a352-65d1-43f1-9292-f8c4a293ddd7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1300 microversion: 2.1 time: 0.197814 Jul 28 04:23:56.559105 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4074/6524] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:56 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1300 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:56.719658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af098c0b-71da-44e8-97fb-3b3fa52c67c9 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '.version_select at 0x7ffa66e8e8b0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:56.747556 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-af098c0b-71da-44e8-97fb-3b3fa52c67c9 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-343106017" status: 202 len: 0 microversion: 2.1 time: 0.036248 Jul 28 04:23:56.752515 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4075/6525] 10.222.0.48 () {58 vars in 1254 bytes} [Thu Jul 28 04:23:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-343106017 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:23:57.577411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2bf1576d-f455-4e6a-bf6f-033b42ea7c59 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:57.579209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2bf1576d-f455-4e6a-bf6f-033b42ea7c59 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:57.601220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2bf1576d-f455-4e6a-bf6f-033b42ea7c59 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:57.602384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2bf1576d-f455-4e6a-bf6f-033b42ea7c59 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:57.604934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2bf1576d-f455-4e6a-bf6f-033b42ea7c59 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:57.609032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2bf1576d-f455-4e6a-bf6f-033b42ea7c59 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:58.820587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2bf1576d-f455-4e6a-bf6f-033b42ea7c59 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:23:58.836384 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2bf1576d-f455-4e6a-bf6f-033b42ea7c59 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1342 microversion: 2.1 time: 1.260971 Jul 28 04:23:58.848828 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4076/6526] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:57 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1342 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:23:58.907530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-081dfc75-e142-4de8-ad83-db71c74fb3f4 req-417755d9-c3f1-4bfd-a090-b03827989dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0365865-6c40-4c54-b04b-775dff73ca20", "tag": "d1f6a9e9-e2e0-4cb0-b548-7029c2712834"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:23:58.936590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-081dfc75-e142-4de8-ad83-db71c74fb3f4 req-417755d9-c3f1-4bfd-a090-b03827989dcb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:58.937722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-081dfc75-e142-4de8-ad83-db71c74fb3f4 req-417755d9-c3f1-4bfd-a090-b03827989dcb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:58.971512 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-081dfc75-e142-4de8-ad83-db71c74fb3f4 req-417755d9-c3f1-4bfd-a090-b03827989dcb service nova] Creating event network-changed:d1f6a9e9-e2e0-4cb0-b548-7029c2712834 for instance a0365865-6c40-4c54-b04b-775dff73ca20 on n-h1-826756-3 Jul 28 04:23:58.980887 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-081dfc75-e142-4de8-ad83-db71c74fb3f4 req-417755d9-c3f1-4bfd-a090-b03827989dcb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079499 Jul 28 04:23:58.982447 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4077/6527] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:23:59.868200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b861c890-bc94-48f1-a910-0b6d8ba00a00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:23:59.868939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b861c890-bc94-48f1-a910-0b6d8ba00a00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:23:59.887663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b861c890-bc94-48f1-a910-0b6d8ba00a00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:59.889067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b861c890-bc94-48f1-a910-0b6d8ba00a00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:23:59.890175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b861c890-bc94-48f1-a910-0b6d8ba00a00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:23:59.896422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b861c890-bc94-48f1-a910-0b6d8ba00a00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:00.109851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b861c890-bc94-48f1-a910-0b6d8ba00a00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:00.122356 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b861c890-bc94-48f1-a910-0b6d8ba00a00 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1342 microversion: 2.1 time: 0.260636 Jul 28 04:24:00.123005 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4078/6528] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:23:59 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1342 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:01.001180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-69e9c518-ba38-4935-a0bb-bdca5aeff3d5 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:01.002503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-69e9c518-ba38-4935-a0bb-bdca5aeff3d5 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:01.013253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69e9c518-ba38-4935-a0bb-bdca5aeff3d5 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:01.017409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69e9c518-ba38-4935-a0bb-bdca5aeff3d5 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:01.018447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69e9c518-ba38-4935-a0bb-bdca5aeff3d5 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:01.019002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-69e9c518-ba38-4935-a0bb-bdca5aeff3d5 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:01.071166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-69e9c518-ba38-4935-a0bb-bdca5aeff3d5 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:24:01.205304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:01.233481 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-69e9c518-ba38-4935-a0bb-bdca5aeff3d5 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "DELETE /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b" status: 204 len: 0 microversion: 2.1 time: 0.233529 Jul 28 04:24:01.237616 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4079/6529] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:24:00 2022] DELETE /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:24:01.402665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-bc0c000d-cda4-498a-ac7f-1ba0b4d9f6d6 req-58c39331-9f5b-4b64-8f5a-45e824e3db30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33bbbce8-3afb-495f-883a-cf0bf1d7981b", "tag": "df13086f-0fe0-4f5a-9b6b-c162bd9ab543"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:01.418576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bc0c000d-cda4-498a-ac7f-1ba0b4d9f6d6 req-58c39331-9f5b-4b64-8f5a-45e824e3db30 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:01.419815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bc0c000d-cda4-498a-ac7f-1ba0b4d9f6d6 req-58c39331-9f5b-4b64-8f5a-45e824e3db30 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:01.437307 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-bc0c000d-cda4-498a-ac7f-1ba0b4d9f6d6 req-58c39331-9f5b-4b64-8f5a-45e824e3db30 service nova] Creating event network-changed:df13086f-0fe0-4f5a-9b6b-c162bd9ab543 for instance 33bbbce8-3afb-495f-883a-cf0bf1d7981b on n-h1-826756-3 Jul 28 04:24:01.445007 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-bc0c000d-cda4-498a-ac7f-1ba0b4d9f6d6 req-58c39331-9f5b-4b64-8f5a-45e824e3db30 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205422 Jul 28 04:24:01.447734 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4080/6530] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:24:01.455541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-509c7284-0ff8-45b7-971b-67371fbba5e3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:01.456818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-509c7284-0ff8-45b7-971b-67371fbba5e3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:01.464689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-509c7284-0ff8-45b7-971b-67371fbba5e3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:01.465515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-509c7284-0ff8-45b7-971b-67371fbba5e3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:01.466949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-509c7284-0ff8-45b7-971b-67371fbba5e3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:01.467463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-509c7284-0ff8-45b7-971b-67371fbba5e3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:01.791075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-509c7284-0ff8-45b7-971b-67371fbba5e3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:01.802891 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-509c7284-0ff8-45b7-971b-67371fbba5e3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1342 microversion: 2.1 time: 0.353537 Jul 28 04:24:01.803597 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4081/6531] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:01 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1342 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:01.812084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d0df1ed-cb9c-49fe-a498-e2a9fa922ebd tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:01.812933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d0df1ed-cb9c-49fe-a498-e2a9fa922ebd tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:01.825857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d0df1ed-cb9c-49fe-a498-e2a9fa922ebd tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:01.826357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d0df1ed-cb9c-49fe-a498-e2a9fa922ebd tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:01.827284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d0df1ed-cb9c-49fe-a498-e2a9fa922ebd tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:01.827734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d0df1ed-cb9c-49fe-a498-e2a9fa922ebd tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:01.858773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:02.110696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9d0df1ed-cb9c-49fe-a498-e2a9fa922ebd tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:02.126573 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d0df1ed-cb9c-49fe-a498-e2a9fa922ebd tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b" status: 200 len: 1671 microversion: 2.1 time: 0.318803 Jul 28 04:24:02.127472 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4082/6532] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:01 2022] GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b => generated 1671 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:02.828192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c016597a-d559-4680-be4d-c11af2be6a32 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:02.828899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c016597a-d559-4680-be4d-c11af2be6a32 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:02.838838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c016597a-d559-4680-be4d-c11af2be6a32 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:02.839308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c016597a-d559-4680-be4d-c11af2be6a32 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:02.846155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c016597a-d559-4680-be4d-c11af2be6a32 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:02.847411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c016597a-d559-4680-be4d-c11af2be6a32 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:03.207443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c016597a-d559-4680-be4d-c11af2be6a32 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:03.227569 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c016597a-d559-4680-be4d-c11af2be6a32 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1342 microversion: 2.1 time: 0.404100 Jul 28 04:24:03.229610 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4083/6533] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:02 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1342 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:03.240501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e5bac979-f9d5-4178-92e0-953d5aa4cdcf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:03.241616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e5bac979-f9d5-4178-92e0-953d5aa4cdcf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:03.254641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5bac979-f9d5-4178-92e0-953d5aa4cdcf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:03.255402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5bac979-f9d5-4178-92e0-953d5aa4cdcf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:03.256404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5bac979-f9d5-4178-92e0-953d5aa4cdcf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:03.257015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5bac979-f9d5-4178-92e0-953d5aa4cdcf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:04.000779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e5bac979-f9d5-4178-92e0-953d5aa4cdcf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:04.010685 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e5bac979-f9d5-4178-92e0-953d5aa4cdcf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b" status: 200 len: 1671 microversion: 2.1 time: 0.777395 Jul 28 04:24:04.011634 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4084/6534] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:03 2022] GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b => generated 1671 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:04.018818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-5a7c860e-e317-4655-9f45-fd45761b8145 req-9c0e1b6c-68a8-4ca3-bac5-2d26e4ec4cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33bbbce8-3afb-495f-883a-cf0bf1d7981b", "name": "network-vif-deleted", "tag": "df13086f-0fe0-4f5a-9b6b-c162bd9ab543"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:04.033613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5a7c860e-e317-4655-9f45-fd45761b8145 req-9c0e1b6c-68a8-4ca3-bac5-2d26e4ec4cbc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:04.034418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5a7c860e-e317-4655-9f45-fd45761b8145 req-9c0e1b6c-68a8-4ca3-bac5-2d26e4ec4cbc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:04.057839 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5a7c860e-e317-4655-9f45-fd45761b8145 req-9c0e1b6c-68a8-4ca3-bac5-2d26e4ec4cbc service nova] Creating event network-vif-deleted:df13086f-0fe0-4f5a-9b6b-c162bd9ab543 for instance 33bbbce8-3afb-495f-883a-cf0bf1d7981b on n-h1-826756-3 Jul 28 04:24:04.063513 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-5a7c860e-e317-4655-9f45-fd45761b8145 req-9c0e1b6c-68a8-4ca3-bac5-2d26e4ec4cbc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049562 Jul 28 04:24:04.067410 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4085/6535] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:24:04.264242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94b24af1-5e60-4239-9ff0-b41bc103c106 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:04.265147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-94b24af1-5e60-4239-9ff0-b41bc103c106 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:04.274367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94b24af1-5e60-4239-9ff0-b41bc103c106 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:04.275641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94b24af1-5e60-4239-9ff0-b41bc103c106 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:04.278849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94b24af1-5e60-4239-9ff0-b41bc103c106 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:04.279773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94b24af1-5e60-4239-9ff0-b41bc103c106 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:04.707159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-94b24af1-5e60-4239-9ff0-b41bc103c106 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:04.723372 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-94b24af1-5e60-4239-9ff0-b41bc103c106 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1342 microversion: 2.1 time: 0.470463 Jul 28 04:24:04.725271 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4086/6536] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:04 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1342 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:05.044874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-09d4738a-fa40-4187-b62c-899244ca0d0f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:05.056696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-09d4738a-fa40-4187-b62c-899244ca0d0f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 33bbbce8-3afb-495f-883a-cf0bf1d7981b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:05.059506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:05.067967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09d4738a-fa40-4187-b62c-899244ca0d0f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:05.068467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09d4738a-fa40-4187-b62c-899244ca0d0f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:05.069272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09d4738a-fa40-4187-b62c-899244ca0d0f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:05.069737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09d4738a-fa40-4187-b62c-899244ca0d0f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:05.114774 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-09d4738a-fa40-4187-b62c-899244ca0d0f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] HTTP exception thrown: Instance 33bbbce8-3afb-495f-883a-cf0bf1d7981b could not be found. Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-09d4738a-fa40-4187-b62c-899244ca0d0f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Request method failure captured: Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b HTTP/1.1 Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g74z8tso9myfnG8JK7jikXH-7369SOXR9q5UnWoDB1jLiZ_jKw3b178pGHLOShMq3AJtVKhHxMqn1EfTP0un3XcUYaTlDDRnr-SX6ODtLUxKM32QkQk6fgb0VFp_QLRFZXOMtwNKhkx6lX44loE7fZWTMTS9wk30ZaYTQtfEcydeyc Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 54ab72fd45f247298afde074fa9b4960 Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestNetworkBasicOps-632794303 Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54ab72fd45f247298afde074fa9b4960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54ab72fd45f247298afde074fa9b4960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54ab72fd45f247298afde074fa9b4960"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54ab72fd45f247298afde074fa9b4960"}]}] Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestNetworkBasicOps-632794303 Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 54ab72fd45f247298afde074fa9b4960 Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestNetworkBasicOps-632794303 Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestNetworkBasicOps-632794303-project Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 1fc8c51b4f84432ebdaa525c2d601487 Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestNetworkBasicOps-632794303-project Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 33bbbce8-3afb-495f-883a-cf0bf1d7981b could not be found. Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '33bbbce8-3afb-495f-883a-cf0bf1d7981b'} Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33bbbce8-3afb-495f-883a-cf0bf1d7981b could not be found. Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33bbbce8-3afb-495f-883a-cf0bf1d7981b could not be found. Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:05.120651 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:05.128228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:05.128228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:05.128228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:05.128228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:24:05.128228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:24:05.128228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33bbbce8-3afb-495f-883a-cf0bf1d7981b could not be found. Jul 28 04:24:05.128228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:05.128228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-09d4738a-fa40-4187-b62c-899244ca0d0f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Returning 404 to user: Instance 33bbbce8-3afb-495f-883a-cf0bf1d7981b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:24:05.129308 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-09d4738a-fa40-4187-b62c-899244ca0d0f tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b" status: 404 len: 111 microversion: 2.1 time: 0.098773 Jul 28 04:24:05.134161 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4087/6537] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:05 2022] GET /compute/v2.1/servers/33bbbce8-3afb-495f-883a-cf0bf1d7981b => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:24:05.406425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f6530af9-b757-42aa-a510-acd8f08d5867 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '.version_select at 0x7ffa66fea280>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:05.421524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:05.458293 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f6530af9-b757-42aa-a510-acd8f08d5867 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1579729168" status: 202 len: 0 microversion: 2.1 time: 0.072588 Jul 28 04:24:05.464126 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4088/6538] 10.222.0.48 () {58 vars in 1257 bytes} [Thu Jul 28 04:24:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1579729168 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:24:05.749337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-534a36db-b832-48ce-84b7-f5ab6bddf26d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:05.751131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-534a36db-b832-48ce-84b7-f5ab6bddf26d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:05.770300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-534a36db-b832-48ce-84b7-f5ab6bddf26d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:05.771983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-534a36db-b832-48ce-84b7-f5ab6bddf26d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:05.773067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-534a36db-b832-48ce-84b7-f5ab6bddf26d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:05.778038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-534a36db-b832-48ce-84b7-f5ab6bddf26d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:06.120644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-534a36db-b832-48ce-84b7-f5ab6bddf26d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:06.158394 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-534a36db-b832-48ce-84b7-f5ab6bddf26d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1342 microversion: 2.1 time: 0.411948 Jul 28 04:24:06.160200 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4089/6539] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:05 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1342 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:07.180116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-989f5981-5855-4780-bb43-e453d733d351 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:07.182060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-989f5981-5855-4780-bb43-e453d733d351 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:07.195759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-989f5981-5855-4780-bb43-e453d733d351 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:07.199050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-989f5981-5855-4780-bb43-e453d733d351 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:07.199921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-989f5981-5855-4780-bb43-e453d733d351 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:07.200405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-989f5981-5855-4780-bb43-e453d733d351 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:07.442555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-989f5981-5855-4780-bb43-e453d733d351 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:07.452287 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-989f5981-5855-4780-bb43-e453d733d351 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1342 microversion: 2.1 time: 0.276328 Jul 28 04:24:07.457308 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4090/6540] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:07 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1342 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:08.483157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63e80f06-aa17-4918-9a27-8f3ab22196f5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:08.484623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63e80f06-aa17-4918-9a27-8f3ab22196f5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:08.529185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63e80f06-aa17-4918-9a27-8f3ab22196f5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:08.530227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63e80f06-aa17-4918-9a27-8f3ab22196f5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:08.531862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63e80f06-aa17-4918-9a27-8f3ab22196f5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:08.538226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63e80f06-aa17-4918-9a27-8f3ab22196f5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:08.893664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63e80f06-aa17-4918-9a27-8f3ab22196f5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:08.905100 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63e80f06-aa17-4918-9a27-8f3ab22196f5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1342 microversion: 2.1 time: 0.425906 Jul 28 04:24:08.906293 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4091/6541] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:08 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1342 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:09.926367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed8d0d1b-7169-4fae-8993-0c383034f06a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:09.927157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed8d0d1b-7169-4fae-8993-0c383034f06a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:09.934523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed8d0d1b-7169-4fae-8993-0c383034f06a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:09.935284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed8d0d1b-7169-4fae-8993-0c383034f06a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:09.936323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed8d0d1b-7169-4fae-8993-0c383034f06a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:09.936993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed8d0d1b-7169-4fae-8993-0c383034f06a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:10.145665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed8d0d1b-7169-4fae-8993-0c383034f06a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:10.165645 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed8d0d1b-7169-4fae-8993-0c383034f06a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1342 microversion: 2.1 time: 0.236553 Jul 28 04:24:10.166677 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4092/6542] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:09 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1342 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:11.197195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a01e83a7-f5f2-4de4-bc0d-ef88ec606d66 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:11.201166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a01e83a7-f5f2-4de4-bc0d-ef88ec606d66 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:11.211632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a01e83a7-f5f2-4de4-bc0d-ef88ec606d66 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:11.212443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a01e83a7-f5f2-4de4-bc0d-ef88ec606d66 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:11.213482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a01e83a7-f5f2-4de4-bc0d-ef88ec606d66 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:11.214431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a01e83a7-f5f2-4de4-bc0d-ef88ec606d66 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:11.441857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a01e83a7-f5f2-4de4-bc0d-ef88ec606d66 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:11.470199 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a01e83a7-f5f2-4de4-bc0d-ef88ec606d66 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1342 microversion: 2.1 time: 0.279898 Jul 28 04:24:11.481106 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4093/6543] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:11 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1342 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:12.500788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1f8cf50-3400-4bb1-a605-9b5d74970ec1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:12.501505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1f8cf50-3400-4bb1-a605-9b5d74970ec1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:12.516180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1f8cf50-3400-4bb1-a605-9b5d74970ec1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:12.516675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1f8cf50-3400-4bb1-a605-9b5d74970ec1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:12.517483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1f8cf50-3400-4bb1-a605-9b5d74970ec1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:12.517957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1f8cf50-3400-4bb1-a605-9b5d74970ec1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:12.798383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b1f8cf50-3400-4bb1-a605-9b5d74970ec1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:12.808287 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1f8cf50-3400-4bb1-a605-9b5d74970ec1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1342 microversion: 2.1 time: 0.312945 Jul 28 04:24:12.812880 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4094/6544] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:12 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1342 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:13.833961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4dad0ea-9cb4-467f-a226-03a21fa6eba6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:13.834743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4dad0ea-9cb4-467f-a226-03a21fa6eba6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:13.850259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4dad0ea-9cb4-467f-a226-03a21fa6eba6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:13.850821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4dad0ea-9cb4-467f-a226-03a21fa6eba6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:13.851743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4dad0ea-9cb4-467f-a226-03a21fa6eba6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:13.852483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4dad0ea-9cb4-467f-a226-03a21fa6eba6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:14.260219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f4dad0ea-9cb4-467f-a226-03a21fa6eba6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:14.279571 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4dad0ea-9cb4-467f-a226-03a21fa6eba6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1342 microversion: 2.1 time: 0.442620 Jul 28 04:24:14.298188 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4095/6545] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:13 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1342 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:15.306743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6fa51d2a-8520-4536-ac42-414c9d1a13a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:15.307623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6fa51d2a-8520-4536-ac42-414c9d1a13a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:15.325837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fa51d2a-8520-4536-ac42-414c9d1a13a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:15.326369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fa51d2a-8520-4536-ac42-414c9d1a13a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:15.329778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fa51d2a-8520-4536-ac42-414c9d1a13a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:15.331393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fa51d2a-8520-4536-ac42-414c9d1a13a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:15.692618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6fa51d2a-8520-4536-ac42-414c9d1a13a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:15.703606 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6fa51d2a-8520-4536-ac42-414c9d1a13a7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1342 microversion: 2.1 time: 0.402219 Jul 28 04:24:15.704852 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4096/6546] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:15 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1342 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:16.733295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cdb855e4-c446-4f81-a8f0-7df399959d54 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:16.735911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cdb855e4-c446-4f81-a8f0-7df399959d54 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:16.748877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cdb855e4-c446-4f81-a8f0-7df399959d54 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:16.750018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cdb855e4-c446-4f81-a8f0-7df399959d54 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:16.751150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cdb855e4-c446-4f81-a8f0-7df399959d54 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:16.751789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cdb855e4-c446-4f81-a8f0-7df399959d54 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:17.327122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cdb855e4-c446-4f81-a8f0-7df399959d54 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:17.337072 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cdb855e4-c446-4f81-a8f0-7df399959d54 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1376 microversion: 2.1 time: 0.614841 Jul 28 04:24:17.338573 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4097/6547] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:16 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1376 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:18.363567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a6b04e90-042e-4cfa-89a5-86dc73a81c14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:18.364222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a6b04e90-042e-4cfa-89a5-86dc73a81c14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:18.383071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6b04e90-042e-4cfa-89a5-86dc73a81c14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:18.383611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6b04e90-042e-4cfa-89a5-86dc73a81c14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:18.384604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6b04e90-042e-4cfa-89a5-86dc73a81c14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:18.385086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6b04e90-042e-4cfa-89a5-86dc73a81c14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:18.753182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a6b04e90-042e-4cfa-89a5-86dc73a81c14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:18.770714 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a6b04e90-042e-4cfa-89a5-86dc73a81c14 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1376 microversion: 2.1 time: 0.411965 Jul 28 04:24:18.772428 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4098/6548] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:18 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1376 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:19.377657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6f5d28d5-66b2-4088-b44e-89c1f27878e4 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Action: 'create', calling method: .version_select at 0x7ffa746fae50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-792848566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBf0npaXQHSNatS1ZxlnI4v4YDwpnxy2J+TN2ZQ+Qyp/1ICnlanVulw5NbfNDWpCuA6wbDPXKG95ieK3CDSar65jqiL/t8kwvcs+NXflDsnpIdgap3m891N8gn35FtbJ7w=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:19.400670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-6f5d28d5-66b2-4088-b44e-89c1f27878e4 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Getting quotas for project 54ab72fd45f247298afde074fa9b4960. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:24:19.409517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-6f5d28d5-66b2-4088-b44e-89c1f27878e4 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Getting quotas for user 1fc8c51b4f84432ebdaa525c2d601487 and project 54ab72fd45f247298afde074fa9b4960. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:24:19.446081 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6f5d28d5-66b2-4088-b44e-89c1f27878e4 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.072362 Jul 28 04:24:19.449946 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4099/6549] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:24:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:24:19.796704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-773fbeca-cb1c-4c03-88f3-46f6d24693c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:19.797391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-773fbeca-cb1c-4c03-88f3-46f6d24693c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:19.805426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-773fbeca-cb1c-4c03-88f3-46f6d24693c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:19.805937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-773fbeca-cb1c-4c03-88f3-46f6d24693c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:19.807063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-773fbeca-cb1c-4c03-88f3-46f6d24693c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:19.807525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-773fbeca-cb1c-4c03-88f3-46f6d24693c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:20.197016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-773fbeca-cb1c-4c03-88f3-46f6d24693c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:20.205736 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-773fbeca-cb1c-4c03-88f3-46f6d24693c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1376 microversion: 2.1 time: 0.414086 Jul 28 04:24:20.206498 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4100/6550] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:19 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1376 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:21.240442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bfeabf83-f90e-4c86-87c2-bd9d08d6e94c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:21.241154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bfeabf83-f90e-4c86-87c2-bd9d08d6e94c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:21.255768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfeabf83-f90e-4c86-87c2-bd9d08d6e94c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:21.257960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfeabf83-f90e-4c86-87c2-bd9d08d6e94c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:21.259200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfeabf83-f90e-4c86-87c2-bd9d08d6e94c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:21.260113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfeabf83-f90e-4c86-87c2-bd9d08d6e94c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:21.490038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bfeabf83-f90e-4c86-87c2-bd9d08d6e94c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:21.510129 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bfeabf83-f90e-4c86-87c2-bd9d08d6e94c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1376 microversion: 2.1 time: 0.271975 Jul 28 04:24:21.511069 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4101/6551] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:21 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1376 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:21.817983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1353133758", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "4cb6f107-07c6-4263-acb1-a40aac729979"}], "key_name": "tempest-TestNetworkBasicOps-792848566", "security_groups": [{"name": "tempest-secgroup-smoke-1739004114"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:21.987572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] validate_networks() for [('4cb6f107-07c6-4263-acb1-a40aac729979', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:24:22.700399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:24:22.701797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:24:22.702412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:24:22.703137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:24:22.703665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:24:22.726645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:22.732287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:22.734578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:22.737362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:22.753513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:22.769929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Getting quotas for project 54ab72fd45f247298afde074fa9b4960. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:24:22.779168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Getting quotas for user 1fc8c51b4f84432ebdaa525c2d601487 and project 54ab72fd45f247298afde074fa9b4960. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:24:22.800032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:24:22.809250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:24:22.876594 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f413869-07ef-4204-adfb-85bb71fc7246 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.063509 Jul 28 04:24:22.878364 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4102/6552] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:24:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:24:22.884718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b127c1c-f061-4722-9e90-bb12282e48bf tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:22.886094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5b127c1c-f061-4722-9e90-bb12282e48bf tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:22.895954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b127c1c-f061-4722-9e90-bb12282e48bf tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:22.897005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b127c1c-f061-4722-9e90-bb12282e48bf tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:22.898149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b127c1c-f061-4722-9e90-bb12282e48bf tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:22.898896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b127c1c-f061-4722-9e90-bb12282e48bf tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:23.193605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5b127c1c-f061-4722-9e90-bb12282e48bf tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:23.213004 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5b127c1c-f061-4722-9e90-bb12282e48bf tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1376 microversion: 2.1 time: 0.332800 Jul 28 04:24:23.214640 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4103/6553] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:22 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1376 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:23.221745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ee8ec56-6d84-4c07-bef8-945d8ee1faa6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:23.223025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ee8ec56-6d84-4c07-bef8-945d8ee1faa6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:23.307295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ee8ec56-6d84-4c07-bef8-945d8ee1faa6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:23.316239 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ee8ec56-6d84-4c07-bef8-945d8ee1faa6 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1248 microversion: 2.1 time: 0.100090 Jul 28 04:24:23.318651 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4104/6554] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:23 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1248 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:24.241916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5662ba55-2e40-4dde-8dbd-c6d3a41d1efe tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:24.242618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5662ba55-2e40-4dde-8dbd-c6d3a41d1efe tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:24.250775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5662ba55-2e40-4dde-8dbd-c6d3a41d1efe tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:24.251241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5662ba55-2e40-4dde-8dbd-c6d3a41d1efe tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:24.252049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5662ba55-2e40-4dde-8dbd-c6d3a41d1efe tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:24.252539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5662ba55-2e40-4dde-8dbd-c6d3a41d1efe tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:24.504864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5662ba55-2e40-4dde-8dbd-c6d3a41d1efe tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:24.523916 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5662ba55-2e40-4dde-8dbd-c6d3a41d1efe tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1376 microversion: 2.1 time: 0.287506 Jul 28 04:24:24.524808 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4105/6555] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:24 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1376 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:24.541886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80033f4e-e1b9-4144-ad0f-e4597280e223 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:24.542392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-80033f4e-e1b9-4144-ad0f-e4597280e223 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:24.550782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80033f4e-e1b9-4144-ad0f-e4597280e223 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:24.551658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80033f4e-e1b9-4144-ad0f-e4597280e223 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:24.552716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80033f4e-e1b9-4144-ad0f-e4597280e223 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:24.553537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80033f4e-e1b9-4144-ad0f-e4597280e223 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:24.649274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-80033f4e-e1b9-4144-ad0f-e4597280e223 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:24.663615 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-80033f4e-e1b9-4144-ad0f-e4597280e223 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1244 microversion: 2.1 time: 0.132071 Jul 28 04:24:24.664703 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4106/6556] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:24 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1244 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:25.546082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3f6950a-0bb6-4fde-878f-968913bfe497 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:25.547149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d3f6950a-0bb6-4fde-878f-968913bfe497 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:25.561502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3f6950a-0bb6-4fde-878f-968913bfe497 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:25.563343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3f6950a-0bb6-4fde-878f-968913bfe497 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:25.564863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3f6950a-0bb6-4fde-878f-968913bfe497 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:25.565952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3f6950a-0bb6-4fde-878f-968913bfe497 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:25.826470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d3f6950a-0bb6-4fde-878f-968913bfe497 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:25.842093 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d3f6950a-0bb6-4fde-878f-968913bfe497 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1376 microversion: 2.1 time: 0.300224 Jul 28 04:24:25.843249 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4107/6557] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:25 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1376 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:25.849085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ffda8268-4d0e-42ca-9627-a73689b6e46c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:25.850290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ffda8268-4d0e-42ca-9627-a73689b6e46c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:25.857930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffda8268-4d0e-42ca-9627-a73689b6e46c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:25.858826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffda8268-4d0e-42ca-9627-a73689b6e46c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:25.860083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffda8268-4d0e-42ca-9627-a73689b6e46c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:25.860758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffda8268-4d0e-42ca-9627-a73689b6e46c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:25.954870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ffda8268-4d0e-42ca-9627-a73689b6e46c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:25.971435 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ffda8268-4d0e-42ca-9627-a73689b6e46c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1306 microversion: 2.1 time: 0.125742 Jul 28 04:24:25.972127 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4108/6558] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:25 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1306 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:26.893975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c2f4067-5b53-47f2-92d6-f5c047ade3c3 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:26.897996 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:24:26.897996 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:24:26.900137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c2f4067-5b53-47f2-92d6-f5c047ade3c3 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:26.901405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c2f4067-5b53-47f2-92d6-f5c047ade3c3 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:26.902552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c2f4067-5b53-47f2-92d6-f5c047ade3c3 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:26.903263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c2f4067-5b53-47f2-92d6-f5c047ade3c3 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:26.949639 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5c2f4067-5b53-47f2-92d6-f5c047ade3c3 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.323232 Jul 28 04:24:26.951891 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4109/6559] 10.222.0.48 () {58 vars in 1185 bytes} [Thu Jul 28 04:24:26 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:24:26.959276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b153f07a-7966-42a5-b3a9-0118745053a9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:26.960211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b153f07a-7966-42a5-b3a9-0118745053a9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:26.969939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b153f07a-7966-42a5-b3a9-0118745053a9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:26.969939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b153f07a-7966-42a5-b3a9-0118745053a9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:26.971048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b153f07a-7966-42a5-b3a9-0118745053a9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:26.972716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b153f07a-7966-42a5-b3a9-0118745053a9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:27.217036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b153f07a-7966-42a5-b3a9-0118745053a9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:27.227325 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b153f07a-7966-42a5-b3a9-0118745053a9 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1376 microversion: 2.1 time: 0.273926 Jul 28 04:24:27.228643 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4110/6560] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:26 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1376 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:27.234710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-85f9ad7f-ce6e-44ee-8c76-ef3ae524464c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:27.235709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-85f9ad7f-ce6e-44ee-8c76-ef3ae524464c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:27.243390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85f9ad7f-ce6e-44ee-8c76-ef3ae524464c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:27.244209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85f9ad7f-ce6e-44ee-8c76-ef3ae524464c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:27.245370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85f9ad7f-ce6e-44ee-8c76-ef3ae524464c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:27.245825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-85f9ad7f-ce6e-44ee-8c76-ef3ae524464c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:27.405505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-85f9ad7f-ce6e-44ee-8c76-ef3ae524464c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:27.417855 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-85f9ad7f-ce6e-44ee-8c76-ef3ae524464c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1374 microversion: 2.1 time: 0.187495 Jul 28 04:24:27.418764 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4111/6561] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:27 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:27.438495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1122413031", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "availability_zone": "nova:n-h1-826756-3", "networks": [{"uuid": "93dc4333-4791-44b6-8933-2bbf1e706bc8"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:27.464933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:27.548986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] validate_networks() for [('93dc4333-4791-44b6-8933-2bbf1e706bc8', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:24:28.354470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:24:28.356232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:24:28.356960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:24:28.357828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:24:28.358713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:24:28.370350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:28.371567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:28.372817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:28.373541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:28.404893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Getting quotas for project 413fd2a38e3c47c5aadc05775f787882. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:24:28.414196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Getting quotas for user 67d7264663a54cd48884b3f44b9ad3ce and project 413fd2a38e3c47c5aadc05775f787882. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:24:28.433914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:24:28.438794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:24:28.509031 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9f611a68-4a4f-4110-931a-16a51d9bf330 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.074949 Jul 28 04:24:28.510089 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4112/6562] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:24:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:24:28.516840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-67684484-0cbf-41fc-91bf-9c5ebc4fec9e req-cf3fd6cb-c7bb-4f57-a1cf-ecf190eb5677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ad9f106-4966-4eee-ba60-92d762a91c60", "tag": "a8b03acb-7ec0-4b1b-b06c-f79c2bf8c19e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:28.529856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-67684484-0cbf-41fc-91bf-9c5ebc4fec9e req-cf3fd6cb-c7bb-4f57-a1cf-ecf190eb5677 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:28.530866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-67684484-0cbf-41fc-91bf-9c5ebc4fec9e req-cf3fd6cb-c7bb-4f57-a1cf-ecf190eb5677 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:28.551132 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-67684484-0cbf-41fc-91bf-9c5ebc4fec9e req-cf3fd6cb-c7bb-4f57-a1cf-ecf190eb5677 service nova] Creating event network-changed:a8b03acb-7ec0-4b1b-b06c-f79c2bf8c19e for instance 5ad9f106-4966-4eee-ba60-92d762a91c60 on n-h2-826756-3 Jul 28 04:24:28.557791 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-67684484-0cbf-41fc-91bf-9c5ebc4fec9e req-cf3fd6cb-c7bb-4f57-a1cf-ecf190eb5677 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045834 Jul 28 04:24:28.558730 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4113/6563] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:24:28.566144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-81ce0cd4-abf4-4888-b47c-527d29674e8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:28.567662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-81ce0cd4-abf4-4888-b47c-527d29674e8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:28.576245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81ce0cd4-abf4-4888-b47c-527d29674e8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:28.576804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81ce0cd4-abf4-4888-b47c-527d29674e8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:28.577586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81ce0cd4-abf4-4888-b47c-527d29674e8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:28.578068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81ce0cd4-abf4-4888-b47c-527d29674e8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:28.801128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-81ce0cd4-abf4-4888-b47c-527d29674e8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:28.814621 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-81ce0cd4-abf4-4888-b47c-527d29674e8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1376 microversion: 2.1 time: 0.254374 Jul 28 04:24:28.815583 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4114/6564] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:28 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1376 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:28.821773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0e974187-603c-43af-afa8-481b82ea6697 req-32680146-e236-4926-a8bb-c6f2fe15fde6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0365865-6c40-4c54-b04b-775dff73ca20", "name": "network-vif-plugged", "status": "completed", "tag": "d1f6a9e9-e2e0-4cb0-b548-7029c2712834"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:28.838018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0e974187-603c-43af-afa8-481b82ea6697 req-32680146-e236-4926-a8bb-c6f2fe15fde6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:28.838723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0e974187-603c-43af-afa8-481b82ea6697 req-32680146-e236-4926-a8bb-c6f2fe15fde6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:28.859123 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0e974187-603c-43af-afa8-481b82ea6697 req-32680146-e236-4926-a8bb-c6f2fe15fde6 service nova] Creating event network-vif-plugged:d1f6a9e9-e2e0-4cb0-b548-7029c2712834 for instance a0365865-6c40-4c54-b04b-775dff73ca20 on n-h1-826756-3 Jul 28 04:24:28.867366 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0e974187-603c-43af-afa8-481b82ea6697 req-32680146-e236-4926-a8bb-c6f2fe15fde6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050063 Jul 28 04:24:28.868257 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4115/6565] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:24:28.876467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-376d71d7-05cc-4d69-a2b9-690ed8a18cdc tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:28.877593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-376d71d7-05cc-4d69-a2b9-690ed8a18cdc tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:28.889093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-376d71d7-05cc-4d69-a2b9-690ed8a18cdc tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:28.889907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-376d71d7-05cc-4d69-a2b9-690ed8a18cdc tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:28.891308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-376d71d7-05cc-4d69-a2b9-690ed8a18cdc tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:28.892425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-376d71d7-05cc-4d69-a2b9-690ed8a18cdc tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:29.151098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-376d71d7-05cc-4d69-a2b9-690ed8a18cdc tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:29.165524 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-376d71d7-05cc-4d69-a2b9-690ed8a18cdc tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1374 microversion: 2.1 time: 0.295413 Jul 28 04:24:29.166896 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4116/6566] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:28 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1374 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:29.197438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aee5f59a-9e7a-4709-b285-f60ebe4a7a02 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:29.198756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aee5f59a-9e7a-4709-b285-f60ebe4a7a02 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:29.303770 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aee5f59a-9e7a-4709-b285-f60ebe4a7a02 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1329 microversion: 2.1 time: 0.134560 Jul 28 04:24:29.304596 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4117/6567] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:29 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1329 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:29.859826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ae497e0b-490f-42cc-9da8-0b2fba4fec95 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:29.864318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ae497e0b-490f-42cc-9da8-0b2fba4fec95 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:29.890767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae497e0b-490f-42cc-9da8-0b2fba4fec95 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:29.891217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae497e0b-490f-42cc-9da8-0b2fba4fec95 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:29.892046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae497e0b-490f-42cc-9da8-0b2fba4fec95 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:29.892542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae497e0b-490f-42cc-9da8-0b2fba4fec95 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:30.116405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ae497e0b-490f-42cc-9da8-0b2fba4fec95 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:30.126450 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ae497e0b-490f-42cc-9da8-0b2fba4fec95 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1376 microversion: 2.1 time: 0.283044 Jul 28 04:24:30.128180 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4118/6568] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:29 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1376 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:30.191489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-11624762-dbcf-4655-93bf-46e1df722a65 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:30.192129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-11624762-dbcf-4655-93bf-46e1df722a65 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:30.199089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11624762-dbcf-4655-93bf-46e1df722a65 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:30.199731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11624762-dbcf-4655-93bf-46e1df722a65 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:30.201231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11624762-dbcf-4655-93bf-46e1df722a65 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:30.201816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11624762-dbcf-4655-93bf-46e1df722a65 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:30.439329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-11624762-dbcf-4655-93bf-46e1df722a65 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:30.449135 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-11624762-dbcf-4655-93bf-46e1df722a65 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1374 microversion: 2.1 time: 0.262099 Jul 28 04:24:30.463115 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4119/6569] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:30 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1374 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:30.470259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3ea97fbc-1827-4470-b63b-5d02c6bb54a7 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:30.470640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3ea97fbc-1827-4470-b63b-5d02c6bb54a7 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:30.478410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ea97fbc-1827-4470-b63b-5d02c6bb54a7 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:30.479053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ea97fbc-1827-4470-b63b-5d02c6bb54a7 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:30.479699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ea97fbc-1827-4470-b63b-5d02c6bb54a7 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:30.480159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ea97fbc-1827-4470-b63b-5d02c6bb54a7 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:30.574696 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3ea97fbc-1827-4470-b63b-5d02c6bb54a7 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1424 microversion: 2.1 time: 0.110092 Jul 28 04:24:30.575438 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4120/6570] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:30 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1424 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:31.150137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2822e334-4f80-44fd-b2a9-d213e27dcc4d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:31.151078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2822e334-4f80-44fd-b2a9-d213e27dcc4d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:31.163314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2822e334-4f80-44fd-b2a9-d213e27dcc4d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:31.164185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2822e334-4f80-44fd-b2a9-d213e27dcc4d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:31.165164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2822e334-4f80-44fd-b2a9-d213e27dcc4d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:31.165910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2822e334-4f80-44fd-b2a9-d213e27dcc4d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:31.337571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2822e334-4f80-44fd-b2a9-d213e27dcc4d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:31.347320 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2822e334-4f80-44fd-b2a9-d213e27dcc4d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1563 microversion: 2.1 time: 0.201555 Jul 28 04:24:31.348254 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4121/6571] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:31 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1563 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:31.369980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b6d61872-99e7-4637-b892-de208016aff5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:31.370636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b6d61872-99e7-4637-b892-de208016aff5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:31.377780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6d61872-99e7-4637-b892-de208016aff5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:31.378270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6d61872-99e7-4637-b892-de208016aff5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:31.379133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6d61872-99e7-4637-b892-de208016aff5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:31.379548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6d61872-99e7-4637-b892-de208016aff5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:31.526385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b6d61872-99e7-4637-b892-de208016aff5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:31.537256 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b6d61872-99e7-4637-b892-de208016aff5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1563 microversion: 2.1 time: 0.171054 Jul 28 04:24:31.538297 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4122/6572] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:31 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:31.543207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-828f3e6b-df32-4a5c-8ff9-d39eebd7f9d4 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:31.543832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-828f3e6b-df32-4a5c-8ff9-d39eebd7f9d4 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:31.550886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-828f3e6b-df32-4a5c-8ff9-d39eebd7f9d4 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:31.551350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-828f3e6b-df32-4a5c-8ff9-d39eebd7f9d4 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:31.553158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-828f3e6b-df32-4a5c-8ff9-d39eebd7f9d4 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:31.553478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-828f3e6b-df32-4a5c-8ff9-d39eebd7f9d4 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:31.750143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-828f3e6b-df32-4a5c-8ff9-d39eebd7f9d4 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:31.759014 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-828f3e6b-df32-4a5c-8ff9-d39eebd7f9d4 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1374 microversion: 2.1 time: 0.219680 Jul 28 04:24:31.760404 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4123/6573] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:31 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1374 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:31.765106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aaab7955-a2db-4897-ab46-dea140b2f880 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:31.765740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aaab7955-a2db-4897-ab46-dea140b2f880 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:31.772928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaab7955-a2db-4897-ab46-dea140b2f880 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:31.773372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaab7955-a2db-4897-ab46-dea140b2f880 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:31.774176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaab7955-a2db-4897-ab46-dea140b2f880 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:31.774819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaab7955-a2db-4897-ab46-dea140b2f880 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:31.780391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:31.962228 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aaab7955-a2db-4897-ab46-dea140b2f880 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1464 microversion: 2.1 time: 0.201422 Jul 28 04:24:31.963163 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4124/6574] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:31 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1464 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:31.968117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-10d61199-9602-484f-b107-8f0ce290f764 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:31.969029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-10d61199-9602-484f-b107-8f0ce290f764 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:31.975658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10d61199-9602-484f-b107-8f0ce290f764 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:31.975926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10d61199-9602-484f-b107-8f0ce290f764 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:31.976751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10d61199-9602-484f-b107-8f0ce290f764 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:31.977210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10d61199-9602-484f-b107-8f0ce290f764 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:32.015942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-10d61199-9602-484f-b107-8f0ce290f764 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:24:32.174120 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-10d61199-9602-484f-b107-8f0ce290f764 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 204 len: 0 microversion: 2.1 time: 0.209430 Jul 28 04:24:32.175074 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4125/6575] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:24:31 2022] DELETE /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:24:32.184673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a38e0f99-4152-4a4d-83f6-012f0b7fd1cf req-38baafb3-9eb7-4731-a570-c9b75c8962c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f4c746-7721-49d3-8f0c-7d0dd906f846", "tag": "5ea3b956-4741-4471-9cca-0482c169709f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:32.195845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a38e0f99-4152-4a4d-83f6-012f0b7fd1cf req-38baafb3-9eb7-4731-a570-c9b75c8962c9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:32.196714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a38e0f99-4152-4a4d-83f6-012f0b7fd1cf req-38baafb3-9eb7-4731-a570-c9b75c8962c9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:32.210036 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a38e0f99-4152-4a4d-83f6-012f0b7fd1cf req-38baafb3-9eb7-4731-a570-c9b75c8962c9 service nova] Creating event network-changed:5ea3b956-4741-4471-9cca-0482c169709f for instance c8f4c746-7721-49d3-8f0c-7d0dd906f846 on n-h1-826756-3 Jul 28 04:24:32.216591 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a38e0f99-4152-4a4d-83f6-012f0b7fd1cf req-38baafb3-9eb7-4731-a570-c9b75c8962c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038723 Jul 28 04:24:32.217222 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4126/6576] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:24:32.223958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-133382f3-901b-443f-9871-8436c617874e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:32.224893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-133382f3-901b-443f-9871-8436c617874e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:32.240419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-133382f3-901b-443f-9871-8436c617874e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:32.240940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-133382f3-901b-443f-9871-8436c617874e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:32.241811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-133382f3-901b-443f-9871-8436c617874e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:32.242267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-133382f3-901b-443f-9871-8436c617874e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:32.409602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-133382f3-901b-443f-9871-8436c617874e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:32.419979 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-133382f3-901b-443f-9871-8436c617874e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1569 microversion: 2.1 time: 0.200488 Jul 28 04:24:32.421153 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4127/6577] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:32 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:32.785815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-945467c8-6e2f-4f39-9f81-3f59de73dac1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:32.787165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-945467c8-6e2f-4f39-9f81-3f59de73dac1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:32.795825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-945467c8-6e2f-4f39-9f81-3f59de73dac1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:32.796427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-945467c8-6e2f-4f39-9f81-3f59de73dac1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:32.797460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-945467c8-6e2f-4f39-9f81-3f59de73dac1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:32.797979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-945467c8-6e2f-4f39-9f81-3f59de73dac1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:32.957893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-945467c8-6e2f-4f39-9f81-3f59de73dac1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:32.967530 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-945467c8-6e2f-4f39-9f81-3f59de73dac1 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1374 microversion: 2.1 time: 0.187475 Jul 28 04:24:32.968415 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4128/6578] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:32 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:32.988865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f6a1ae6e-d74c-43b3-b258-19be9c323ce7 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:32.989764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f6a1ae6e-d74c-43b3-b258-19be9c323ce7 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:32.998123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6a1ae6e-d74c-43b3-b258-19be9c323ce7 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:32.998678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6a1ae6e-d74c-43b3-b258-19be9c323ce7 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:32.999602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6a1ae6e-d74c-43b3-b258-19be9c323ce7 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:33.000092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6a1ae6e-d74c-43b3-b258-19be9c323ce7 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:33.150352 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f6a1ae6e-d74c-43b3-b258-19be9c323ce7 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1464 microversion: 2.1 time: 0.166652 Jul 28 04:24:33.152417 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4129/6579] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:32 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:33.445715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8b799b1c-0f30-4627-89e4-d43b543a8458 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:33.447219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8b799b1c-0f30-4627-89e4-d43b543a8458 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:33.457302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b799b1c-0f30-4627-89e4-d43b543a8458 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:33.458377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b799b1c-0f30-4627-89e4-d43b543a8458 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:33.459546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b799b1c-0f30-4627-89e4-d43b543a8458 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:33.460231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b799b1c-0f30-4627-89e4-d43b543a8458 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:33.654457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8b799b1c-0f30-4627-89e4-d43b543a8458 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:33.665170 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8b799b1c-0f30-4627-89e4-d43b543a8458 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1569 microversion: 2.1 time: 0.224431 Jul 28 04:24:33.667239 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4130/6580] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:33 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:33.995382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6ac54a80-e8ee-4102-b16f-896942ed1785 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:33.997005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6ac54a80-e8ee-4102-b16f-896942ed1785 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:34.010132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ac54a80-e8ee-4102-b16f-896942ed1785 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:34.010922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ac54a80-e8ee-4102-b16f-896942ed1785 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:34.012617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ac54a80-e8ee-4102-b16f-896942ed1785 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:34.013245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ac54a80-e8ee-4102-b16f-896942ed1785 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:34.199324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6ac54a80-e8ee-4102-b16f-896942ed1785 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:34.210664 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6ac54a80-e8ee-4102-b16f-896942ed1785 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1374 microversion: 2.1 time: 0.224100 Jul 28 04:24:34.211299 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4131/6581] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:33 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1374 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:34.219504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e87e4b41-caf6-4680-9ff4-f107de28bdb8 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:34.223725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e87e4b41-caf6-4680-9ff4-f107de28bdb8 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:34.235930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e87e4b41-caf6-4680-9ff4-f107de28bdb8 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:34.239810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e87e4b41-caf6-4680-9ff4-f107de28bdb8 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:34.241545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e87e4b41-caf6-4680-9ff4-f107de28bdb8 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:34.242267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e87e4b41-caf6-4680-9ff4-f107de28bdb8 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:34.471974 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e87e4b41-caf6-4680-9ff4-f107de28bdb8 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1464 microversion: 2.1 time: 0.256692 Jul 28 04:24:34.475146 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4132/6582] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:34 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1464 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:34.482617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-57563c67-22fc-49b4-934c-0172d9af5a3f req-0e31e8c1-f22a-4e08-a039-b4617f9bf04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad9f106-4966-4eee-ba60-92d762a91c60", "name": "network-vif-plugged", "status": "completed", "tag": "a8b03acb-7ec0-4b1b-b06c-f79c2bf8c19e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:34.495029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-57563c67-22fc-49b4-934c-0172d9af5a3f req-0e31e8c1-f22a-4e08-a039-b4617f9bf04a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:34.495683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-57563c67-22fc-49b4-934c-0172d9af5a3f req-0e31e8c1-f22a-4e08-a039-b4617f9bf04a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:34.512844 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-57563c67-22fc-49b4-934c-0172d9af5a3f req-0e31e8c1-f22a-4e08-a039-b4617f9bf04a service nova] Creating event network-vif-plugged:a8b03acb-7ec0-4b1b-b06c-f79c2bf8c19e for instance 5ad9f106-4966-4eee-ba60-92d762a91c60 on n-h2-826756-3 Jul 28 04:24:34.518918 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-57563c67-22fc-49b4-934c-0172d9af5a3f req-0e31e8c1-f22a-4e08-a039-b4617f9bf04a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042139 Jul 28 04:24:34.520197 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4133/6583] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:24:34.528733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4d57d2e5-3ad6-46b5-8785-29c1015121ba req-e93a4f39-b0f6-42c3-bce7-5cbea442f532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0365865-6c40-4c54-b04b-775dff73ca20", "name": "network-vif-deleted", "tag": "d1f6a9e9-e2e0-4cb0-b548-7029c2712834"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:34.545989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4d57d2e5-3ad6-46b5-8785-29c1015121ba req-e93a4f39-b0f6-42c3-bce7-5cbea442f532 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:34.547204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4d57d2e5-3ad6-46b5-8785-29c1015121ba req-e93a4f39-b0f6-42c3-bce7-5cbea442f532 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:34.562315 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4d57d2e5-3ad6-46b5-8785-29c1015121ba req-e93a4f39-b0f6-42c3-bce7-5cbea442f532 service nova] Creating event network-vif-deleted:d1f6a9e9-e2e0-4cb0-b548-7029c2712834 for instance a0365865-6c40-4c54-b04b-775dff73ca20 on n-h1-826756-3 Jul 28 04:24:34.575157 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4d57d2e5-3ad6-46b5-8785-29c1015121ba req-e93a4f39-b0f6-42c3-bce7-5cbea442f532 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052743 Jul 28 04:24:34.575814 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4134/6584] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:24:34.694054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ff34206-8ca0-4bf3-b961-ce43340d2d7d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:34.696118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ff34206-8ca0-4bf3-b961-ce43340d2d7d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:34.720153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ff34206-8ca0-4bf3-b961-ce43340d2d7d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:34.722204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ff34206-8ca0-4bf3-b961-ce43340d2d7d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:34.723198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ff34206-8ca0-4bf3-b961-ce43340d2d7d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:34.723907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ff34206-8ca0-4bf3-b961-ce43340d2d7d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:34.837586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ff34206-8ca0-4bf3-b961-ce43340d2d7d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:34.856523 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ff34206-8ca0-4bf3-b961-ce43340d2d7d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1361 microversion: 2.1 time: 0.169538 Jul 28 04:24:34.870875 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4135/6585] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:34 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:35.237817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93af9ae1-ae72-4817-9033-8ad161707297 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:35.238538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93af9ae1-ae72-4817-9033-8ad161707297 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:35.245331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93af9ae1-ae72-4817-9033-8ad161707297 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:35.245903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93af9ae1-ae72-4817-9033-8ad161707297 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:35.246784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93af9ae1-ae72-4817-9033-8ad161707297 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:35.247287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93af9ae1-ae72-4817-9033-8ad161707297 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:35.417817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-93af9ae1-ae72-4817-9033-8ad161707297 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:35.426610 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93af9ae1-ae72-4817-9033-8ad161707297 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1374 microversion: 2.1 time: 0.192650 Jul 28 04:24:35.427312 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4136/6586] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:35 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:35.495474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9fee5d35-08da-4468-ab39-4d56cc6a4dd3 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:35.496216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9fee5d35-08da-4468-ab39-4d56cc6a4dd3 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:35.504057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fee5d35-08da-4468-ab39-4d56cc6a4dd3 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:35.504567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fee5d35-08da-4468-ab39-4d56cc6a4dd3 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:35.505385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fee5d35-08da-4468-ab39-4d56cc6a4dd3 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:35.505846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9fee5d35-08da-4468-ab39-4d56cc6a4dd3 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:35.681116 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9fee5d35-08da-4468-ab39-4d56cc6a4dd3 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1464 microversion: 2.1 time: 0.189432 Jul 28 04:24:35.682497 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4137/6587] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:35 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1464 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:35.878617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7702e15b-4cf0-4db3-8bd6-9d4f3f7a5059 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:35.879710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7702e15b-4cf0-4db3-8bd6-9d4f3f7a5059 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:35.887162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7702e15b-4cf0-4db3-8bd6-9d4f3f7a5059 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:35.887904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7702e15b-4cf0-4db3-8bd6-9d4f3f7a5059 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:35.889002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7702e15b-4cf0-4db3-8bd6-9d4f3f7a5059 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:35.889579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7702e15b-4cf0-4db3-8bd6-9d4f3f7a5059 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:35.997284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7702e15b-4cf0-4db3-8bd6-9d4f3f7a5059 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:36.010571 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7702e15b-4cf0-4db3-8bd6-9d4f3f7a5059 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1361 microversion: 2.1 time: 0.136017 Jul 28 04:24:36.011503 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4138/6588] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:35 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1361 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:36.450499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8198a3d0-f0ff-4777-9382-8567b353f27d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:36.451151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8198a3d0-f0ff-4777-9382-8567b353f27d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:36.458278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8198a3d0-f0ff-4777-9382-8567b353f27d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:36.458453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8198a3d0-f0ff-4777-9382-8567b353f27d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:36.459197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8198a3d0-f0ff-4777-9382-8567b353f27d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:36.459641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8198a3d0-f0ff-4777-9382-8567b353f27d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:36.595747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8198a3d0-f0ff-4777-9382-8567b353f27d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:36.604297 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8198a3d0-f0ff-4777-9382-8567b353f27d tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1546 microversion: 2.1 time: 0.157943 Jul 28 04:24:36.616866 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4139/6589] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:36 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1546 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:36.627552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e7d80c05-7b2e-45fb-86d7-1d9473fa68cf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:36.628579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e7d80c05-7b2e-45fb-86d7-1d9473fa68cf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:36.638749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7d80c05-7b2e-45fb-86d7-1d9473fa68cf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:36.639693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7d80c05-7b2e-45fb-86d7-1d9473fa68cf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:36.644828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7d80c05-7b2e-45fb-86d7-1d9473fa68cf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:36.645402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e7d80c05-7b2e-45fb-86d7-1d9473fa68cf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:36.792385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e7d80c05-7b2e-45fb-86d7-1d9473fa68cf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:36.800679 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e7d80c05-7b2e-45fb-86d7-1d9473fa68cf tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1546 microversion: 2.1 time: 0.178960 Jul 28 04:24:36.801284 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4140/6590] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:36 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1546 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:36.805771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c07faf6d-d1e8-4fe4-b444-1786f9f34cc1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:36.806434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c07faf6d-d1e8-4fe4-b444-1786f9f34cc1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:36.812946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c07faf6d-d1e8-4fe4-b444-1786f9f34cc1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:36.813413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c07faf6d-d1e8-4fe4-b444-1786f9f34cc1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:36.814223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c07faf6d-d1e8-4fe4-b444-1786f9f34cc1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:36.814714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c07faf6d-d1e8-4fe4-b444-1786f9f34cc1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:36.818030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:36.957632 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c07faf6d-d1e8-4fe4-b444-1786f9f34cc1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1464 microversion: 2.1 time: 0.155182 Jul 28 04:24:36.959298 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4141/6591] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:36 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1464 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:37.054217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c623995b-c22a-4c4c-b45d-31a8f426f2de tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:37.054859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c623995b-c22a-4c4c-b45d-31a8f426f2de tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:37.062538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c623995b-c22a-4c4c-b45d-31a8f426f2de tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:37.063125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c623995b-c22a-4c4c-b45d-31a8f426f2de tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:37.064073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c623995b-c22a-4c4c-b45d-31a8f426f2de tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:37.064779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c623995b-c22a-4c4c-b45d-31a8f426f2de tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:37.141536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c623995b-c22a-4c4c-b45d-31a8f426f2de tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:37.149639 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c623995b-c22a-4c4c-b45d-31a8f426f2de tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1361 microversion: 2.1 time: 0.103211 Jul 28 04:24:37.158603 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4142/6592] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:37 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1361 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:37.869291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f8b0beff-0386-48fa-a83c-8bf887de4c50 req-d82effff-c187-42cc-bb68-fa31abc2f3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f4c746-7721-49d3-8f0c-7d0dd906f846", "name": "network-vif-plugged", "status": "completed", "tag": "5ea3b956-4741-4471-9cca-0482c169709f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:37.880900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f8b0beff-0386-48fa-a83c-8bf887de4c50 req-d82effff-c187-42cc-bb68-fa31abc2f3e8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:37.881561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f8b0beff-0386-48fa-a83c-8bf887de4c50 req-d82effff-c187-42cc-bb68-fa31abc2f3e8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:37.894749 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f8b0beff-0386-48fa-a83c-8bf887de4c50 req-d82effff-c187-42cc-bb68-fa31abc2f3e8 service nova] Creating event network-vif-plugged:5ea3b956-4741-4471-9cca-0482c169709f for instance c8f4c746-7721-49d3-8f0c-7d0dd906f846 on n-h1-826756-3 Jul 28 04:24:37.900551 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f8b0beff-0386-48fa-a83c-8bf887de4c50 req-d82effff-c187-42cc-bb68-fa31abc2f3e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034798 Jul 28 04:24:37.901442 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4143/6593] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:24:37.982951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c5612be-4e48-4c3a-8720-840bf24d537f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:37.984004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5c5612be-4e48-4c3a-8720-840bf24d537f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:37.990833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c5612be-4e48-4c3a-8720-840bf24d537f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:37.991298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c5612be-4e48-4c3a-8720-840bf24d537f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:37.992202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c5612be-4e48-4c3a-8720-840bf24d537f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:37.992683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c5612be-4e48-4c3a-8720-840bf24d537f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:38.152975 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5c5612be-4e48-4c3a-8720-840bf24d537f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1464 microversion: 2.1 time: 0.177310 Jul 28 04:24:38.165960 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4144/6594] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:37 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1464 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:38.171764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-08d4be7f-09b1-496c-a756-d82dff59ab65 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:38.172420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-08d4be7f-09b1-496c-a756-d82dff59ab65 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:38.179510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08d4be7f-09b1-496c-a756-d82dff59ab65 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:38.180000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08d4be7f-09b1-496c-a756-d82dff59ab65 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:38.180821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08d4be7f-09b1-496c-a756-d82dff59ab65 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:38.181951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08d4be7f-09b1-496c-a756-d82dff59ab65 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:38.258382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-08d4be7f-09b1-496c-a756-d82dff59ab65 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:38.272394 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-08d4be7f-09b1-496c-a756-d82dff59ab65 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1361 microversion: 2.1 time: 0.104089 Jul 28 04:24:38.273822 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4145/6595] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:38 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1361 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:38.933992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-ad2ff1a2-6c56-495d-89e2-01664d8bc0bd req-1cfabd44-d8d6-4625-b3f1-91e14ece60b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ad9f106-4966-4eee-ba60-92d762a91c60", "tag": "a8b03acb-7ec0-4b1b-b06c-f79c2bf8c19e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:38.946178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:38.951731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ad2ff1a2-6c56-495d-89e2-01664d8bc0bd req-1cfabd44-d8d6-4625-b3f1-91e14ece60b8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:38.953991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ad2ff1a2-6c56-495d-89e2-01664d8bc0bd req-1cfabd44-d8d6-4625-b3f1-91e14ece60b8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:38.972993 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-ad2ff1a2-6c56-495d-89e2-01664d8bc0bd req-1cfabd44-d8d6-4625-b3f1-91e14ece60b8 service nova] Creating event network-changed:a8b03acb-7ec0-4b1b-b06c-f79c2bf8c19e for instance 5ad9f106-4966-4eee-ba60-92d762a91c60 on n-h2-826756-3 Jul 28 04:24:38.978890 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-ad2ff1a2-6c56-495d-89e2-01664d8bc0bd req-1cfabd44-d8d6-4625-b3f1-91e14ece60b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048891 Jul 28 04:24:38.984713 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4146/6596] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:24:39.175428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce005248-1921-41c8-95af-8a3ead745b52 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:39.176875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ce005248-1921-41c8-95af-8a3ead745b52 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:39.193738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce005248-1921-41c8-95af-8a3ead745b52 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:39.199387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce005248-1921-41c8-95af-8a3ead745b52 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:39.200790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce005248-1921-41c8-95af-8a3ead745b52 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:39.201497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce005248-1921-41c8-95af-8a3ead745b52 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:39.297568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=20 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:39.562239 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce005248-1921-41c8-95af-8a3ead745b52 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1464 microversion: 2.1 time: 0.390867 Jul 28 04:24:39.577276 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4147/6597] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:39 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1464 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:39.582858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-12c0c3a5-a554-4e96-be14-3a46121d5cd2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:39.583694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-12c0c3a5-a554-4e96-be14-3a46121d5cd2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:39.591182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12c0c3a5-a554-4e96-be14-3a46121d5cd2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:39.591795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12c0c3a5-a554-4e96-be14-3a46121d5cd2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:39.592803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12c0c3a5-a554-4e96-be14-3a46121d5cd2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:39.593364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12c0c3a5-a554-4e96-be14-3a46121d5cd2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:39.681765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-12c0c3a5-a554-4e96-be14-3a46121d5cd2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:39.690514 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-12c0c3a5-a554-4e96-be14-3a46121d5cd2 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 200 len: 1361 microversion: 2.1 time: 0.111874 Jul 28 04:24:39.692111 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4148/6598] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:39 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 1361 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:40.586052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d9fd17d9-b520-4382-8c6f-cb4fa336260f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:40.587513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d9fd17d9-b520-4382-8c6f-cb4fa336260f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:40.596301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9fd17d9-b520-4382-8c6f-cb4fa336260f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:40.596846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9fd17d9-b520-4382-8c6f-cb4fa336260f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:40.597642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9fd17d9-b520-4382-8c6f-cb4fa336260f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:40.598095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9fd17d9-b520-4382-8c6f-cb4fa336260f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:40.733969 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d9fd17d9-b520-4382-8c6f-cb4fa336260f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1649 microversion: 2.1 time: 0.152979 Jul 28 04:24:40.734585 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4149/6599] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:40 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1649 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:40.739181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b18018bf-dc3f-4f8a-bfbe-02b246c9408f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:40.739810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b18018bf-dc3f-4f8a-bfbe-02b246c9408f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:40.746092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b18018bf-dc3f-4f8a-bfbe-02b246c9408f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:40.746608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b18018bf-dc3f-4f8a-bfbe-02b246c9408f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:40.747340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b18018bf-dc3f-4f8a-bfbe-02b246c9408f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:40.747787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b18018bf-dc3f-4f8a-bfbe-02b246c9408f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:40.763599 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-b18018bf-dc3f-4f8a-bfbe-02b246c9408f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b18018bf-dc3f-4f8a-bfbe-02b246c9408f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 HTTP/1.1 Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a0365865-6c40-4c54-b04b-775dff73ca20'} Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:40.765360 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:40.773040 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:40.773040 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:40.773040 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:40.773040 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:24:40.773040 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:24:40.773040 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:40.773040 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:40.773040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b18018bf-dc3f-4f8a-bfbe-02b246c9408f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:24:40.773040 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b18018bf-dc3f-4f8a-bfbe-02b246c9408f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 404 len: 111 microversion: 2.1 time: 0.031291 Jul 28 04:24:40.773040 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4150/6600] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:40 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:24:40.773040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ffa79173-abfd-4a3d-aa79-ec463424d0ee tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:40.773040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ffa79173-abfd-4a3d-aa79-ec463424d0ee tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:40.777935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:40.779769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffa79173-abfd-4a3d-aa79-ec463424d0ee tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:40.780546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffa79173-abfd-4a3d-aa79-ec463424d0ee tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:40.781164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffa79173-abfd-4a3d-aa79-ec463424d0ee tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:40.781499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ffa79173-abfd-4a3d-aa79-ec463424d0ee tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:40.930193 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ffa79173-abfd-4a3d-aa79-ec463424d0ee tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1649 microversion: 2.1 time: 0.161764 Jul 28 04:24:40.930794 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4151/6601] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:40 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1649 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:40.950564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0cb967e4-9625-4d2b-8d3d-8c55d65bd9fc tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:40.951191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0cb967e4-9625-4d2b-8d3d-8c55d65bd9fc tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:40.957835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cb967e4-9625-4d2b-8d3d-8c55d65bd9fc tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:40.958302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cb967e4-9625-4d2b-8d3d-8c55d65bd9fc tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:40.959096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cb967e4-9625-4d2b-8d3d-8c55d65bd9fc tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:40.959581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0cb967e4-9625-4d2b-8d3d-8c55d65bd9fc tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:41.105637 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0cb967e4-9625-4d2b-8d3d-8c55d65bd9fc tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1649 microversion: 2.1 time: 0.158912 Jul 28 04:24:41.106466 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4152/6602] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:40 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1649 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:41.185741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1140276854", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "availability_zone": "nova:n-h2-826756-3", "networks": [{"uuid": "93dc4333-4791-44b6-8933-2bbf1e706bc8"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:41.245799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] validate_networks() for [('93dc4333-4791-44b6-8933-2bbf1e706bc8', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:24:41.640243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:24:41.644897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:24:41.644897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:24:41.644897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:24:41.644897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:24:41.657514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:41.658226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:41.659132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:41.659639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:41.680276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Getting quotas for project 413fd2a38e3c47c5aadc05775f787882. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:24:41.686164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Getting quotas for user 67d7264663a54cd48884b3f44b9ad3ce and project 413fd2a38e3c47c5aadc05775f787882. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:24:41.703024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:24:41.705480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:24:41.751158 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-540f88ed-c788-47f4-82d4-8d3af2f4b513 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569220 Jul 28 04:24:41.751819 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4153/6603] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:24:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:24:41.762350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5b7d4a6-9399-4034-bba4-db43c7578854 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:41.762993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b5b7d4a6-9399-4034-bba4-db43c7578854 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:41.847737 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5b7d4a6-9399-4034-bba4-db43c7578854 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1329 microversion: 2.1 time: 0.088912 Jul 28 04:24:41.848696 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4154/6604] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:41 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1329 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:42.870006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f17ff25f-1137-4633-b60b-f0ccad6e8a8f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:42.870740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f17ff25f-1137-4633-b60b-f0ccad6e8a8f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:42.879099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f17ff25f-1137-4633-b60b-f0ccad6e8a8f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:42.879566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f17ff25f-1137-4633-b60b-f0ccad6e8a8f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:42.880659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f17ff25f-1137-4633-b60b-f0ccad6e8a8f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:42.881119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f17ff25f-1137-4633-b60b-f0ccad6e8a8f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:43.009800 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f17ff25f-1137-4633-b60b-f0ccad6e8a8f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1416 microversion: 2.1 time: 0.144273 Jul 28 04:24:43.024051 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4155/6605] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:42 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1416 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:44.040167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6da56290-1384-420b-a3f6-cc6ab425003c tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:44.042347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6da56290-1384-420b-a3f6-cc6ab425003c tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:44.069321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da56290-1384-420b-a3f6-cc6ab425003c tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:44.069983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da56290-1384-420b-a3f6-cc6ab425003c tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:44.071707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da56290-1384-420b-a3f6-cc6ab425003c tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:44.072383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6da56290-1384-420b-a3f6-cc6ab425003c tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:44.240735 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6da56290-1384-420b-a3f6-cc6ab425003c tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1464 microversion: 2.1 time: 0.212694 Jul 28 04:24:44.254335 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4156/6606] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:44 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1464 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:44.748314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-69ed6deb-03eb-4869-ad07-d24c288a8138 req-eeaf4a5e-1857-4468-aa5d-cd6a34b35b74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be2c605c-ea45-4498-a0bb-dee88c6538ae", "tag": "c44ed4a0-972d-4d7a-abdc-9df2857672ce"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:44.772861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-69ed6deb-03eb-4869-ad07-d24c288a8138 req-eeaf4a5e-1857-4468-aa5d-cd6a34b35b74 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:44.774110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-69ed6deb-03eb-4869-ad07-d24c288a8138 req-eeaf4a5e-1857-4468-aa5d-cd6a34b35b74 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:44.804591 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-69ed6deb-03eb-4869-ad07-d24c288a8138 req-eeaf4a5e-1857-4468-aa5d-cd6a34b35b74 service nova] Creating event network-changed:c44ed4a0-972d-4d7a-abdc-9df2857672ce for instance be2c605c-ea45-4498-a0bb-dee88c6538ae on n-h2-826756-3 Jul 28 04:24:44.824575 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-69ed6deb-03eb-4869-ad07-d24c288a8138 req-eeaf4a5e-1857-4468-aa5d-cd6a34b35b74 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089803 Jul 28 04:24:44.825270 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4157/6607] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:24:45.222239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb7264f9-0f88-47b2-929d-75c0bb3a75d0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:45.223037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb7264f9-0f88-47b2-929d-75c0bb3a75d0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:45.229332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb7264f9-0f88-47b2-929d-75c0bb3a75d0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:45.229789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb7264f9-0f88-47b2-929d-75c0bb3a75d0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:45.230589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb7264f9-0f88-47b2-929d-75c0bb3a75d0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:45.230993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb7264f9-0f88-47b2-929d-75c0bb3a75d0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:45.260057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb7264f9-0f88-47b2-929d-75c0bb3a75d0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:24:45.354450 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb7264f9-0f88-47b2-929d-75c0bb3a75d0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 204 len: 0 microversion: 2.1 time: 0.137355 Jul 28 04:24:45.355135 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4158/6608] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:24:45 2022] DELETE /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:24:45.360268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd4d8cca-acd4-400a-b05b-c93a360aba2c tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:45.361013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd4d8cca-acd4-400a-b05b-c93a360aba2c tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:45.367316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd4d8cca-acd4-400a-b05b-c93a360aba2c tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:45.367961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd4d8cca-acd4-400a-b05b-c93a360aba2c tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:45.368653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd4d8cca-acd4-400a-b05b-c93a360aba2c tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:45.369102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd4d8cca-acd4-400a-b05b-c93a360aba2c tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:45.512142 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd4d8cca-acd4-400a-b05b-c93a360aba2c tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1464 microversion: 2.1 time: 0.155604 Jul 28 04:24:45.513088 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4159/6609] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:45 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1464 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:45.518556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d852665f-4093-47c7-a779-f1d6549cf791 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:45.519182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d852665f-4093-47c7-a779-f1d6549cf791 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:45.526635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d852665f-4093-47c7-a779-f1d6549cf791 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:45.527111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d852665f-4093-47c7-a779-f1d6549cf791 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:45.527993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d852665f-4093-47c7-a779-f1d6549cf791 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:45.528552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d852665f-4093-47c7-a779-f1d6549cf791 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:45.547075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:45.693917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d852665f-4093-47c7-a779-f1d6549cf791 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:45.702773 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d852665f-4093-47c7-a779-f1d6549cf791 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1408 microversion: 2.1 time: 0.188449 Jul 28 04:24:45.703295 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4160/6610] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:45 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:46.536645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c447c067-3ddd-45fb-b5b0-af5931488098 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:46.537359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c447c067-3ddd-45fb-b5b0-af5931488098 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:46.544672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c447c067-3ddd-45fb-b5b0-af5931488098 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:46.545192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c447c067-3ddd-45fb-b5b0-af5931488098 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:46.546067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c447c067-3ddd-45fb-b5b0-af5931488098 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:46.546549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c447c067-3ddd-45fb-b5b0-af5931488098 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:46.711791 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c447c067-3ddd-45fb-b5b0-af5931488098 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1464 microversion: 2.1 time: 0.180274 Jul 28 04:24:46.712462 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4161/6611] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:46 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1464 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:46.725340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-659b955e-408c-4492-983e-9c71edd63308 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:46.726211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-659b955e-408c-4492-983e-9c71edd63308 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:46.736224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-659b955e-408c-4492-983e-9c71edd63308 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:46.736784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-659b955e-408c-4492-983e-9c71edd63308 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:46.737596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-659b955e-408c-4492-983e-9c71edd63308 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:46.738138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-659b955e-408c-4492-983e-9c71edd63308 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:46.892128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-659b955e-408c-4492-983e-9c71edd63308 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:46.900932 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-659b955e-408c-4492-983e-9c71edd63308 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1408 microversion: 2.1 time: 0.179624 Jul 28 04:24:46.901543 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4162/6612] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:46 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:47.734990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9e0f46f2-12b1-4243-afa7-8737d1186e9f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:47.735909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9e0f46f2-12b1-4243-afa7-8737d1186e9f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:47.743845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e0f46f2-12b1-4243-afa7-8737d1186e9f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:47.744315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e0f46f2-12b1-4243-afa7-8737d1186e9f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:47.745145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e0f46f2-12b1-4243-afa7-8737d1186e9f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:47.745620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e0f46f2-12b1-4243-afa7-8737d1186e9f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:47.907497 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9e0f46f2-12b1-4243-afa7-8737d1186e9f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1464 microversion: 2.1 time: 0.176991 Jul 28 04:24:47.908373 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4163/6613] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:47 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1464 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:47.923586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3a560700-71db-4989-8161-ad120d72be8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:47.924296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3a560700-71db-4989-8161-ad120d72be8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:47.933267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a560700-71db-4989-8161-ad120d72be8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:47.934027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a560700-71db-4989-8161-ad120d72be8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:47.935373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a560700-71db-4989-8161-ad120d72be8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:47.936181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a560700-71db-4989-8161-ad120d72be8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:48.104608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3a560700-71db-4989-8161-ad120d72be8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:48.114703 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3a560700-71db-4989-8161-ad120d72be8a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1408 microversion: 2.1 time: 0.195177 Jul 28 04:24:48.115645 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4164/6614] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:47 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:48.931467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bf4b5c93-80a7-4db8-ba6f-b4d8adce4f52 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:48.932644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bf4b5c93-80a7-4db8-ba6f-b4d8adce4f52 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:48.939696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf4b5c93-80a7-4db8-ba6f-b4d8adce4f52 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:48.940162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf4b5c93-80a7-4db8-ba6f-b4d8adce4f52 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:48.940985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf4b5c93-80a7-4db8-ba6f-b4d8adce4f52 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:48.941469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf4b5c93-80a7-4db8-ba6f-b4d8adce4f52 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:49.124061 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bf4b5c93-80a7-4db8-ba6f-b4d8adce4f52 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1464 microversion: 2.1 time: 0.196493 Jul 28 04:24:49.124728 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4165/6615] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:48 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1464 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:49.129561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d9b2d908-ce69-4b67-b114-2a46e2e024da req-7ebaa469-b936-4c39-a916-21d996c3edfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a087b56c-b63b-4266-890f-20cc4f0cbcd7", "name": "network-vif-deleted", "tag": "17382a72-9910-4ee0-862f-59221a963e66"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:49.142304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d9b2d908-ce69-4b67-b114-2a46e2e024da req-7ebaa469-b936-4c39-a916-21d996c3edfc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:49.142764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d9b2d908-ce69-4b67-b114-2a46e2e024da req-7ebaa469-b936-4c39-a916-21d996c3edfc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:49.161939 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-d9b2d908-ce69-4b67-b114-2a46e2e024da req-7ebaa469-b936-4c39-a916-21d996c3edfc service nova] Creating event network-vif-deleted:17382a72-9910-4ee0-862f-59221a963e66 for instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 on n-h2-826756-3 Jul 28 04:24:49.167667 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d9b2d908-ce69-4b67-b114-2a46e2e024da req-7ebaa469-b936-4c39-a916-21d996c3edfc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041355 Jul 28 04:24:49.168945 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4166/6616] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:24:49.177882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90ec3837-da72-4bcc-8ac9-1643391dad73 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:49.178717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-90ec3837-da72-4bcc-8ac9-1643391dad73 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:49.186273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90ec3837-da72-4bcc-8ac9-1643391dad73 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:49.186889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90ec3837-da72-4bcc-8ac9-1643391dad73 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:49.187681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90ec3837-da72-4bcc-8ac9-1643391dad73 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:49.188127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90ec3837-da72-4bcc-8ac9-1643391dad73 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:49.276140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-90ec3837-da72-4bcc-8ac9-1643391dad73 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:49.286024 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90ec3837-da72-4bcc-8ac9-1643391dad73 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1201 microversion: 2.1 time: 0.115247 Jul 28 04:24:49.286597 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4167/6617] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:49 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1201 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:50.148991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cd944813-3fa7-4eb1-8be9-832193b9b201 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:50.150037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cd944813-3fa7-4eb1-8be9-832193b9b201 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:50.159657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd944813-3fa7-4eb1-8be9-832193b9b201 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:50.160552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd944813-3fa7-4eb1-8be9-832193b9b201 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:50.161366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd944813-3fa7-4eb1-8be9-832193b9b201 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:50.162008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd944813-3fa7-4eb1-8be9-832193b9b201 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:50.314104 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cd944813-3fa7-4eb1-8be9-832193b9b201 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1464 microversion: 2.1 time: 0.169883 Jul 28 04:24:50.315006 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4168/6618] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:50 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1464 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:50.320023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4b3ba617-7eac-4cff-b30d-2dd57d639037 req-ee43bd88-43ad-4433-ac98-95f59d81fb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be2c605c-ea45-4498-a0bb-dee88c6538ae", "name": "network-vif-plugged", "status": "completed", "tag": "c44ed4a0-972d-4d7a-abdc-9df2857672ce"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:50.330750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4b3ba617-7eac-4cff-b30d-2dd57d639037 req-ee43bd88-43ad-4433-ac98-95f59d81fb84 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:50.331642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4b3ba617-7eac-4cff-b30d-2dd57d639037 req-ee43bd88-43ad-4433-ac98-95f59d81fb84 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:50.346970 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4b3ba617-7eac-4cff-b30d-2dd57d639037 req-ee43bd88-43ad-4433-ac98-95f59d81fb84 service nova] Creating event network-vif-plugged:c44ed4a0-972d-4d7a-abdc-9df2857672ce for instance be2c605c-ea45-4498-a0bb-dee88c6538ae on n-h2-826756-3 Jul 28 04:24:50.352316 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4b3ba617-7eac-4cff-b30d-2dd57d639037 req-ee43bd88-43ad-4433-ac98-95f59d81fb84 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035696 Jul 28 04:24:50.353407 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4169/6619] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:24:50.361060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7687e343-d2ea-4877-b2d7-f51cd945c821 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:50.361060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7687e343-d2ea-4877-b2d7-f51cd945c821 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:50.367680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7687e343-d2ea-4877-b2d7-f51cd945c821 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:50.368149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7687e343-d2ea-4877-b2d7-f51cd945c821 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:50.369003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7687e343-d2ea-4877-b2d7-f51cd945c821 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:50.369490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7687e343-d2ea-4877-b2d7-f51cd945c821 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:50.441576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7687e343-d2ea-4877-b2d7-f51cd945c821 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:50.452066 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7687e343-d2ea-4877-b2d7-f51cd945c821 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1201 microversion: 2.1 time: 0.096937 Jul 28 04:24:50.453167 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4170/6620] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:50 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1201 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:51.338823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-221c058a-c475-4897-a69d-d63d1c0e4ed2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:51.339717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-221c058a-c475-4897-a69d-d63d1c0e4ed2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:51.349420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-221c058a-c475-4897-a69d-d63d1c0e4ed2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:51.349889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-221c058a-c475-4897-a69d-d63d1c0e4ed2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:51.350688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-221c058a-c475-4897-a69d-d63d1c0e4ed2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:51.351140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-221c058a-c475-4897-a69d-d63d1c0e4ed2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:51.508435 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-221c058a-c475-4897-a69d-d63d1c0e4ed2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1464 microversion: 2.1 time: 0.175803 Jul 28 04:24:51.509061 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4171/6621] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:51 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1464 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:51.514075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc062638-3d91-4163-aeb9-015543bf8095 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:51.514678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cc062638-3d91-4163-aeb9-015543bf8095 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:51.522354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc062638-3d91-4163-aeb9-015543bf8095 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:51.522354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc062638-3d91-4163-aeb9-015543bf8095 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:51.522768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc062638-3d91-4163-aeb9-015543bf8095 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:51.523508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc062638-3d91-4163-aeb9-015543bf8095 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:51.607066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cc062638-3d91-4163-aeb9-015543bf8095 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:51.616666 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cc062638-3d91-4163-aeb9-015543bf8095 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1201 microversion: 2.1 time: 0.106422 Jul 28 04:24:51.617995 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4172/6622] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:51 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1201 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:52.533913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7406d5a1-1ddd-4d65-8a11-e2a25b433320 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:52.534643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7406d5a1-1ddd-4d65-8a11-e2a25b433320 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:52.536692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:52.537417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:52.547202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7406d5a1-1ddd-4d65-8a11-e2a25b433320 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:52.547662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7406d5a1-1ddd-4d65-8a11-e2a25b433320 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:52.548473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7406d5a1-1ddd-4d65-8a11-e2a25b433320 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:52.548920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7406d5a1-1ddd-4d65-8a11-e2a25b433320 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:52.679537 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7406d5a1-1ddd-4d65-8a11-e2a25b433320 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1649 microversion: 2.1 time: 0.149522 Jul 28 04:24:52.680124 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4173/6623] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:52 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1649 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:52.684686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e5c7b9e-eb5a-416a-82f1-3b6987d5538a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:52.685309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e5c7b9e-eb5a-416a-82f1-3b6987d5538a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:52.691310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e5c7b9e-eb5a-416a-82f1-3b6987d5538a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:52.691774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e5c7b9e-eb5a-416a-82f1-3b6987d5538a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:52.692585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e5c7b9e-eb5a-416a-82f1-3b6987d5538a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:52.693038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e5c7b9e-eb5a-416a-82f1-3b6987d5538a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:52.758622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e5c7b9e-eb5a-416a-82f1-3b6987d5538a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:52.766580 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e5c7b9e-eb5a-416a-82f1-3b6987d5538a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1201 microversion: 2.1 time: 0.085457 Jul 28 04:24:52.767311 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4174/6624] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:52 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1201 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:52.771750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6baa6a04-03be-431e-81a5-322f9738d045 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:52.772497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6baa6a04-03be-431e-81a5-322f9738d045 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:52.778634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6baa6a04-03be-431e-81a5-322f9738d045 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:52.779094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6baa6a04-03be-431e-81a5-322f9738d045 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:52.779864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6baa6a04-03be-431e-81a5-322f9738d045 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:52.780310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6baa6a04-03be-431e-81a5-322f9738d045 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:52.915091 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6baa6a04-03be-431e-81a5-322f9738d045 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1649 microversion: 2.1 time: 0.146713 Jul 28 04:24:52.915683 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4175/6625] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:52 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1649 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:52.934617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8883c4b3-d43c-4964-9d14-725b5909150f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:52.935241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8883c4b3-d43c-4964-9d14-725b5909150f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:52.941469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8883c4b3-d43c-4964-9d14-725b5909150f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:52.941935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8883c4b3-d43c-4964-9d14-725b5909150f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:52.942713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8883c4b3-d43c-4964-9d14-725b5909150f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:52.943158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8883c4b3-d43c-4964-9d14-725b5909150f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:53.092078 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8883c4b3-d43c-4964-9d14-725b5909150f tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1649 microversion: 2.1 time: 0.161032 Jul 28 04:24:53.092712 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4176/6626] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:52 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1649 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:53.113813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-655ad9f7-e10b-4b9e-a07a-20a8bc7165b1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:53.114448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-655ad9f7-e10b-4b9e-a07a-20a8bc7165b1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:53.121227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-655ad9f7-e10b-4b9e-a07a-20a8bc7165b1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:53.121919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-655ad9f7-e10b-4b9e-a07a-20a8bc7165b1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:53.122791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-655ad9f7-e10b-4b9e-a07a-20a8bc7165b1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:53.123310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-655ad9f7-e10b-4b9e-a07a-20a8bc7165b1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:53.151340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-655ad9f7-e10b-4b9e-a07a-20a8bc7165b1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:24:53.179179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:53.246587 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-655ad9f7-e10b-4b9e-a07a-20a8bc7165b1 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 204 len: 0 microversion: 2.1 time: 0.136672 Jul 28 04:24:53.247198 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4177/6627] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:24:53 2022] DELETE /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:24:53.259595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aca313c7-dca7-432a-b75d-bdb0d112810b tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:53.260316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aca313c7-dca7-432a-b75d-bdb0d112810b tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:53.266737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aca313c7-dca7-432a-b75d-bdb0d112810b tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:53.267197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aca313c7-dca7-432a-b75d-bdb0d112810b tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:53.267988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aca313c7-dca7-432a-b75d-bdb0d112810b tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:53.270199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aca313c7-dca7-432a-b75d-bdb0d112810b tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:53.423287 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aca313c7-dca7-432a-b75d-bdb0d112810b tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1655 microversion: 2.1 time: 0.167750 Jul 28 04:24:53.423895 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4178/6628] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:53 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1655 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:53.789205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80b585ba-c571-4cef-9f5e-58bafc143953 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:53.789947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-80b585ba-c571-4cef-9f5e-58bafc143953 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:53.797289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80b585ba-c571-4cef-9f5e-58bafc143953 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:53.797758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80b585ba-c571-4cef-9f5e-58bafc143953 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:53.798683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80b585ba-c571-4cef-9f5e-58bafc143953 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:53.799126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80b585ba-c571-4cef-9f5e-58bafc143953 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:53.864377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-80b585ba-c571-4cef-9f5e-58bafc143953 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:53.873055 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-80b585ba-c571-4cef-9f5e-58bafc143953 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1201 microversion: 2.1 time: 0.087850 Jul 28 04:24:53.873651 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4179/6629] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:53 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1201 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:54.445736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-18c4b340-cb80-4f91-a97f-2219d0bbfab2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:54.446317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-18c4b340-cb80-4f91-a97f-2219d0bbfab2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:54.453044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18c4b340-cb80-4f91-a97f-2219d0bbfab2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:54.453509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18c4b340-cb80-4f91-a97f-2219d0bbfab2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:54.454486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18c4b340-cb80-4f91-a97f-2219d0bbfab2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:54.454828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18c4b340-cb80-4f91-a97f-2219d0bbfab2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:54.602013 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-18c4b340-cb80-4f91-a97f-2219d0bbfab2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1655 microversion: 2.1 time: 0.160278 Jul 28 04:24:54.602617 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4180/6630] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:54 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1655 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:54.898086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e9f2009-4bc9-4042-8a59-519bb5178613 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:54.898814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0e9f2009-4bc9-4042-8a59-519bb5178613 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:54.906413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e9f2009-4bc9-4042-8a59-519bb5178613 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:54.906881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e9f2009-4bc9-4042-8a59-519bb5178613 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:54.907730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e9f2009-4bc9-4042-8a59-519bb5178613 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:54.908185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e9f2009-4bc9-4042-8a59-519bb5178613 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:54.944846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e9f2009-4bc9-4042-8a59-519bb5178613 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:54.945317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e9f2009-4bc9-4042-8a59-519bb5178613 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:54.945785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-0e9f2009-4bc9-4042-8a59-519bb5178613 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lazy-loading 'fault' on Instance uuid a087b56c-b63b-4266-890f-20cc4f0cbcd7 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:24:54.995976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0e9f2009-4bc9-4042-8a59-519bb5178613 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:24:55.009594 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0e9f2009-4bc9-4042-8a59-519bb5178613 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 200 len: 1206 microversion: 2.1 time: 0.115912 Jul 28 04:24:55.010818 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4181/6631] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:54 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 1206 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:24:55.630536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ec4ade52-3c23-44f0-8117-e80bab3d309d tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:55.631177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ec4ade52-3c23-44f0-8117-e80bab3d309d tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:55.637582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec4ade52-3c23-44f0-8117-e80bab3d309d tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:55.638214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec4ade52-3c23-44f0-8117-e80bab3d309d tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:55.639034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec4ade52-3c23-44f0-8117-e80bab3d309d tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:55.639492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec4ade52-3c23-44f0-8117-e80bab3d309d tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:55.789783 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ec4ade52-3c23-44f0-8117-e80bab3d309d tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 200 len: 1655 microversion: 2.1 time: 0.164672 Jul 28 04:24:55.790822 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4182/6632] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:55 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 1655 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:55.998290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a59dad7e-a7cb-428c-b990-ac1a617de1a2 req-3ae3b112-1679-4a73-ad5b-f150b29f408e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be2c605c-ea45-4498-a0bb-dee88c6538ae", "name": "network-vif-deleted", "tag": "c44ed4a0-972d-4d7a-abdc-9df2857672ce"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:56.047358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a59dad7e-a7cb-428c-b990-ac1a617de1a2 req-3ae3b112-1679-4a73-ad5b-f150b29f408e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:56.048275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a59dad7e-a7cb-428c-b990-ac1a617de1a2 req-3ae3b112-1679-4a73-ad5b-f150b29f408e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:56.087482 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a59dad7e-a7cb-428c-b990-ac1a617de1a2 req-3ae3b112-1679-4a73-ad5b-f150b29f408e service nova] Creating event network-vif-deleted:c44ed4a0-972d-4d7a-abdc-9df2857672ce for instance be2c605c-ea45-4498-a0bb-dee88c6538ae on n-h2-826756-3 Jul 28 04:24:56.094644 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a59dad7e-a7cb-428c-b990-ac1a617de1a2 req-3ae3b112-1679-4a73-ad5b-f150b29f408e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099530 Jul 28 04:24:56.096098 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4183/6633] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:24:56.105813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66e6d6ea-4a91-435b-b5da-7df86206a64d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:56.107563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-66e6d6ea-4a91-435b-b5da-7df86206a64d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:56.117685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66e6d6ea-4a91-435b-b5da-7df86206a64d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:56.118468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66e6d6ea-4a91-435b-b5da-7df86206a64d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:56.120019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66e6d6ea-4a91-435b-b5da-7df86206a64d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:56.120694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66e6d6ea-4a91-435b-b5da-7df86206a64d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:56.145011 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-66e6d6ea-4a91-435b-b5da-7df86206a64d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66e6d6ea-4a91-435b-b5da-7df86206a64d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 HTTP/1.1 Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a087b56c-b63b-4266-890f-20cc4f0cbcd7'} Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:56.147194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:56.153496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:56.153496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:56.153496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:56.153496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:24:56.153496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:24:56.153496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:56.153496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:56.153496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66e6d6ea-4a91-435b-b5da-7df86206a64d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:24:56.154684 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-66e6d6ea-4a91-435b-b5da-7df86206a64d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 404 len: 111 microversion: 2.1 time: 0.056522 Jul 28 04:24:56.156717 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4184/6634] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:56 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:24:56.811437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-42428619-2d44-4bbe-937e-03227134d621 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:56.812073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-42428619-2d44-4bbe-937e-03227134d621 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: be2c605c-ea45-4498-a0bb-dee88c6538ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:56.814326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:24:56.820301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42428619-2d44-4bbe-937e-03227134d621 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:56.820838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42428619-2d44-4bbe-937e-03227134d621 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:56.821575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42428619-2d44-4bbe-937e-03227134d621 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:56.822029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-42428619-2d44-4bbe-937e-03227134d621 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:56.837007 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-42428619-2d44-4bbe-937e-03227134d621 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] HTTP exception thrown: Instance be2c605c-ea45-4498-a0bb-dee88c6538ae could not be found. Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-42428619-2d44-4bbe-937e-03227134d621 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Request method failure captured: Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae HTTP/1.1 Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g96UJukST3fIDx3KpUQB0NMAzrYBzyfe4alvrrXnAu356HirlTgmsopcgkb7_u5c4qp3di1iYVHDlv4OYvVG27k4sNeM54OLH7JaiZIeSLanqWOibV4h_iRYYvG2QjV3YocJcd7c8P8q88lOJC2Os7y3j33GK0xL3eLZIBfXh-jfSc Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 413fd2a38e3c47c5aadc05775f787882 Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestServerMultinode-1155742263 Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/413fd2a38e3c47c5aadc05775f787882"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/413fd2a38e3c47c5aadc05775f787882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_413fd2a38e3c47c5aadc05775f787882"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/413fd2a38e3c47c5aadc05775f787882"}]}] Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestServerMultinode-1155742263 Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 413fd2a38e3c47c5aadc05775f787882 Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestServerMultinode-1155742263 Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestServerMultinode-1155742263-project-admin Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 67d7264663a54cd48884b3f44b9ad3ce Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestServerMultinode-1155742263-project-admin Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance be2c605c-ea45-4498-a0bb-dee88c6538ae could not be found. Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'be2c605c-ea45-4498-a0bb-dee88c6538ae'} Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be2c605c-ea45-4498-a0bb-dee88c6538ae could not be found. Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be2c605c-ea45-4498-a0bb-dee88c6538ae could not be found. Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:56.838631 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:56.845199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:56.845199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:56.845199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:56.845199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:24:56.845199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:24:56.845199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be2c605c-ea45-4498-a0bb-dee88c6538ae could not be found. Jul 28 04:24:56.845199 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:56.845199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-42428619-2d44-4bbe-937e-03227134d621 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Returning 404 to user: Instance be2c605c-ea45-4498-a0bb-dee88c6538ae could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:24:56.845199 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-42428619-2d44-4bbe-937e-03227134d621 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae" status: 404 len: 111 microversion: 2.1 time: 0.032631 Jul 28 04:24:56.845199 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4185/6635] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:56 2022] GET /compute/v2.1/servers/be2c605c-ea45-4498-a0bb-dee88c6538ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:24:56.850664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-45ec55af-32cf-4ae4-bcc3-a45e137ae804 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:56.851194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-45ec55af-32cf-4ae4-bcc3-a45e137ae804 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:56.859144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45ec55af-32cf-4ae4-bcc3-a45e137ae804 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:56.859730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45ec55af-32cf-4ae4-bcc3-a45e137ae804 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:56.860333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45ec55af-32cf-4ae4-bcc3-a45e137ae804 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:56.860843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45ec55af-32cf-4ae4-bcc3-a45e137ae804 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:56.891944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-45ec55af-32cf-4ae4-bcc3-a45e137ae804 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:24:56.977273 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-45ec55af-32cf-4ae4-bcc3-a45e137ae804 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "DELETE /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 204 len: 0 microversion: 2.1 time: 0.130786 Jul 28 04:24:56.981472 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4186/6636] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:24:56 2022] DELETE /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:24:56.987131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a18bb4c9-611e-499c-98c3-5c0b7fb55e51 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:56.988065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a18bb4c9-611e-499c-98c3-5c0b7fb55e51 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:56.994551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a18bb4c9-611e-499c-98c3-5c0b7fb55e51 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:56.995021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a18bb4c9-611e-499c-98c3-5c0b7fb55e51 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:56.995815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a18bb4c9-611e-499c-98c3-5c0b7fb55e51 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:56.996266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a18bb4c9-611e-499c-98c3-5c0b7fb55e51 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:57.137784 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a18bb4c9-611e-499c-98c3-5c0b7fb55e51 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1655 microversion: 2.1 time: 0.154890 Jul 28 04:24:57.138488 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4187/6637] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:56 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1655 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:58.159521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-53c58159-0947-4d19-a6fd-3301a2242a23 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:58.160493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-53c58159-0947-4d19-a6fd-3301a2242a23 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:58.169069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53c58159-0947-4d19-a6fd-3301a2242a23 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:58.169638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53c58159-0947-4d19-a6fd-3301a2242a23 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:58.170424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53c58159-0947-4d19-a6fd-3301a2242a23 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:58.170926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53c58159-0947-4d19-a6fd-3301a2242a23 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:58.315695 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-53c58159-0947-4d19-a6fd-3301a2242a23 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1655 microversion: 2.1 time: 0.160875 Jul 28 04:24:58.316430 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4188/6638] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:58 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1655 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:58.502564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d6c7f29-e83b-45c7-953a-451a07eb8853 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:58.503158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4d6c7f29-e83b-45c7-953a-451a07eb8853 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:58.510718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d6c7f29-e83b-45c7-953a-451a07eb8853 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:58.511250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d6c7f29-e83b-45c7-953a-451a07eb8853 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:58.512119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d6c7f29-e83b-45c7-953a-451a07eb8853 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:58.512709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d6c7f29-e83b-45c7-953a-451a07eb8853 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:58.528391 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-4d6c7f29-e83b-45c7-953a-451a07eb8853 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d6c7f29-e83b-45c7-953a-451a07eb8853 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 HTTP/1.1 Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a0365865-6c40-4c54-b04b-775dff73ca20'} Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:24:58.530212 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:24:58.538584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:58.538584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:58.538584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:58.538584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:58.538584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:58.538584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:58.538584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:58.538584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:24:58.538584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:24:58.538584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:58.538584 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:58.538584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d6c7f29-e83b-45c7-953a-451a07eb8853 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:24:58.538584 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d6c7f29-e83b-45c7-953a-451a07eb8853 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 404 len: 111 microversion: 2.1 time: 0.034485 Jul 28 04:24:58.538584 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4189/6639] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:24:58 2022] DELETE /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:24:58.543925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb320828-74e2-49f9-9efd-617b0df702c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:58.544692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb320828-74e2-49f9-9efd-617b0df702c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a0365865-6c40-4c54-b04b-775dff73ca20] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:58.551525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb320828-74e2-49f9-9efd-617b0df702c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:58.552141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb320828-74e2-49f9-9efd-617b0df702c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:58.553065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb320828-74e2-49f9-9efd-617b0df702c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:58.553638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb320828-74e2-49f9-9efd-617b0df702c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:58.569301 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-bb320828-74e2-49f9-9efd-617b0df702c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb320828-74e2-49f9-9efd-617b0df702c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 HTTP/1.1 Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a0365865-6c40-4c54-b04b-775dff73ca20'} Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:58.570983 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:58.576028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:58.576028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:58.576028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:58.576028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:24:58.576028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:24:58.576028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. Jul 28 04:24:58.576028 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:58.576028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb320828-74e2-49f9-9efd-617b0df702c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance a0365865-6c40-4c54-b04b-775dff73ca20 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:24:58.576028 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb320828-74e2-49f9-9efd-617b0df702c1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20" status: 404 len: 111 microversion: 2.1 time: 0.033671 Jul 28 04:24:58.576028 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4190/6640] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:58 2022] GET /compute/v2.1/servers/a0365865-6c40-4c54-b04b-775dff73ca20 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:24:58.880952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f7dcccae-6d2d-4aeb-a6ac-b2fafbb99389 req-a34538df-4a0a-4d9e-aee2-47b315d9799d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f4c746-7721-49d3-8f0c-7d0dd906f846", "name": "network-vif-deleted", "tag": "5ea3b956-4741-4471-9cca-0482c169709f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:58.899897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f7dcccae-6d2d-4aeb-a6ac-b2fafbb99389 req-a34538df-4a0a-4d9e-aee2-47b315d9799d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:58.900880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f7dcccae-6d2d-4aeb-a6ac-b2fafbb99389 req-a34538df-4a0a-4d9e-aee2-47b315d9799d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:58.918222 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f7dcccae-6d2d-4aeb-a6ac-b2fafbb99389 req-a34538df-4a0a-4d9e-aee2-47b315d9799d service nova] Creating event network-vif-deleted:5ea3b956-4741-4471-9cca-0482c169709f for instance c8f4c746-7721-49d3-8f0c-7d0dd906f846 on n-h1-826756-3 Jul 28 04:24:58.926336 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f7dcccae-6d2d-4aeb-a6ac-b2fafbb99389 req-a34538df-4a0a-4d9e-aee2-47b315d9799d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050808 Jul 28 04:24:58.927802 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4191/6641] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:24:59.347469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-036ab088-6a4d-4e5d-b765-32bff3f3fcb2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:59.350151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-036ab088-6a4d-4e5d-b765-32bff3f3fcb2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:59.362607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-036ab088-6a4d-4e5d-b765-32bff3f3fcb2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:59.363165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-036ab088-6a4d-4e5d-b765-32bff3f3fcb2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:59.364194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-036ab088-6a4d-4e5d-b765-32bff3f3fcb2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:59.364923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-036ab088-6a4d-4e5d-b765-32bff3f3fcb2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:59.412099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-036ab088-6a4d-4e5d-b765-32bff3f3fcb2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:59.412528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-036ab088-6a4d-4e5d-b765-32bff3f3fcb2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:59.413005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-036ab088-6a4d-4e5d-b765-32bff3f3fcb2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lazy-loading 'fault' on Instance uuid c8f4c746-7721-49d3-8f0c-7d0dd906f846 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:24:59.467891 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-036ab088-6a4d-4e5d-b765-32bff3f3fcb2 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 200 len: 1454 microversion: 2.1 time: 0.129164 Jul 28 04:24:59.468899 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4192/6642] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:59 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:24:59.479318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a01f8e7a-64ee-4b79-a50f-52babf0cb6ad tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:59.480013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a01f8e7a-64ee-4b79-a50f-52babf0cb6ad tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:59.492546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a01f8e7a-64ee-4b79-a50f-52babf0cb6ad tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:59.493017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a01f8e7a-64ee-4b79-a50f-52babf0cb6ad tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:59.493828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a01f8e7a-64ee-4b79-a50f-52babf0cb6ad tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:59.494284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a01f8e7a-64ee-4b79-a50f-52babf0cb6ad tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:59.509926 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-a01f8e7a-64ee-4b79-a50f-52babf0cb6ad tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a01f8e7a-64ee-4b79-a50f-52babf0cb6ad tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 HTTP/1.1 Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a087b56c-b63b-4266-890f-20cc4f0cbcd7'} Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:24:59.512134 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:24:59.518198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:59.518198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:59.518198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:59.518198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:59.518198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:59.518198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:59.518198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:59.518198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:24:59.518198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:24:59.518198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:59.518198 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:59.518198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a01f8e7a-64ee-4b79-a50f-52babf0cb6ad tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:24:59.518198 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a01f8e7a-64ee-4b79-a50f-52babf0cb6ad tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 404 len: 111 microversion: 2.1 time: 0.039157 Jul 28 04:24:59.518198 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4193/6643] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:24:59 2022] DELETE /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:24:59.526397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f8ca2230-95cc-4723-ae63-1b6e75752afb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:24:59.527041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f8ca2230-95cc-4723-ae63-1b6e75752afb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: a087b56c-b63b-4266-890f-20cc4f0cbcd7] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:24:59.533667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8ca2230-95cc-4723-ae63-1b6e75752afb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:59.534129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8ca2230-95cc-4723-ae63-1b6e75752afb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:59.534928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8ca2230-95cc-4723-ae63-1b6e75752afb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:24:59.535380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8ca2230-95cc-4723-ae63-1b6e75752afb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:24:59.553869 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-f8ca2230-95cc-4723-ae63-1b6e75752afb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f8ca2230-95cc-4723-ae63-1b6e75752afb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 HTTP/1.1 Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'a087b56c-b63b-4266-890f-20cc4f0cbcd7'} Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:24:59.555470 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:59.561075 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:24:59.561075 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:24:59.561075 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:24:59.561075 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:24:59.561075 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:24:59.561075 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. Jul 28 04:24:59.561075 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:24:59.561075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f8ca2230-95cc-4723-ae63-1b6e75752afb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance a087b56c-b63b-4266-890f-20cc4f0cbcd7 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:24:59.561075 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f8ca2230-95cc-4723-ae63-1b6e75752afb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7" status: 404 len: 111 microversion: 2.1 time: 0.037407 Jul 28 04:24:59.561075 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4194/6644] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:24:59 2022] GET /compute/v2.1/servers/a087b56c-b63b-4266-890f-20cc4f0cbcd7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:24:59.650183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2786778a-c9ca-48cf-8e66-e6469022437f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Action: 'create', calling method: .version_select at 0x7ffa74aee670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1297440191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMyPQVXLYJxfW7IgwY5Js1s7PkIx6O4RtLaCvBwsHLx6neXP7PrFQba7HPCIzd3F3jYHTX6/Ow4nj8JtMd3Yx72uhgGicBcLITB4q9sWHeVHGei/qjiz742hDVZlorXTA=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:24:59.667286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2786778a-c9ca-48cf-8e66-e6469022437f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for project f9ff9720813441d39130d608a9e15945. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:24:59.674374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2786778a-c9ca-48cf-8e66-e6469022437f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for user 98c95cccd8d547a5bd528a3a3ca9fb4f and project f9ff9720813441d39130d608a9e15945. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:24:59.701173 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2786778a-c9ca-48cf-8e66-e6469022437f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.055003 Jul 28 04:24:59.701788 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4195/6645] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:24:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:25:00.491374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ea6d7611-cf60-4710-8fe7-c0c66f0f3701 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:00.492125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ea6d7611-cf60-4710-8fe7-c0c66f0f3701 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] [instance: c8f4c746-7721-49d3-8f0c-7d0dd906f846] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:00.501849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea6d7611-cf60-4710-8fe7-c0c66f0f3701 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:00.502406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea6d7611-cf60-4710-8fe7-c0c66f0f3701 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:00.503439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea6d7611-cf60-4710-8fe7-c0c66f0f3701 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:00.504021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea6d7611-cf60-4710-8fe7-c0c66f0f3701 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:00.518100 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-ea6d7611-cf60-4710-8fe7-c0c66f0f3701 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] HTTP exception thrown: Instance c8f4c746-7721-49d3-8f0c-7d0dd906f846 could not be found. Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ea6d7611-cf60-4710-8fe7-c0c66f0f3701 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Request method failure captured: Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 HTTP/1.1 Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g96UJukST3fIDx3KpUQB0NMAzrYBzyfe4alvrrXnAu356HirlTgmsopcgkb7_u5c4qp3di1iYVHDlv4OYvVG27k4sNeM54OLH7JaiZIeSLanqWOibV4h_iRYYvG2QjV3YocJcd7c8P8q88lOJC2Os7y3j33GK0xL3eLZIBfXh-jfSc Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 413fd2a38e3c47c5aadc05775f787882 Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestServerMultinode-1155742263 Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/413fd2a38e3c47c5aadc05775f787882"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/413fd2a38e3c47c5aadc05775f787882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_413fd2a38e3c47c5aadc05775f787882"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/413fd2a38e3c47c5aadc05775f787882"}]}] Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestServerMultinode-1155742263 Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 413fd2a38e3c47c5aadc05775f787882 Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestServerMultinode-1155742263 Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestServerMultinode-1155742263-project-admin Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 67d7264663a54cd48884b3f44b9ad3ce Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestServerMultinode-1155742263-project-admin Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c8f4c746-7721-49d3-8f0c-7d0dd906f846 could not be found. Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c8f4c746-7721-49d3-8f0c-7d0dd906f846'} Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8f4c746-7721-49d3-8f0c-7d0dd906f846 could not be found. Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8f4c746-7721-49d3-8f0c-7d0dd906f846 could not be found. Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:25:00.519898 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:25:00.525727 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:25:00.525727 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:25:00.525727 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:25:00.525727 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:25:00.525727 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:25:00.525727 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8f4c746-7721-49d3-8f0c-7d0dd906f846 could not be found. Jul 28 04:25:00.525727 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:25:00.525727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ea6d7611-cf60-4710-8fe7-c0c66f0f3701 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] Returning 404 to user: Instance c8f4c746-7721-49d3-8f0c-7d0dd906f846 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:25:00.525727 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ea6d7611-cf60-4710-8fe7-c0c66f0f3701 tempest-TestServerMultinode-1155742263 tempest-TestServerMultinode-1155742263-project-admin] 10.222.0.48 "GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846" status: 404 len: 111 microversion: 2.1 time: 0.034002 Jul 28 04:25:00.525727 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4196/6646] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:00 2022] GET /compute/v2.1/servers/c8f4c746-7721-49d3-8f0c-7d0dd906f846 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:25:05.774408 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:25:05.775073 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:25:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:25:05.781032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5469d8b2-bd3d-4115-9ed5-0f5d339af9e2 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:25:05.783464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5469d8b2-bd3d-4115-9ed5-0f5d339af9e2 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:05.792947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5469d8b2-bd3d-4115-9ed5-0f5d339af9e2 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:05.793677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5469d8b2-bd3d-4115-9ed5-0f5d339af9e2 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:05.794605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5469d8b2-bd3d-4115-9ed5-0f5d339af9e2 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:05.795313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5469d8b2-bd3d-4115-9ed5-0f5d339af9e2 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:05.887412 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5469d8b2-bd3d-4115-9ed5-0f5d339af9e2 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "POST /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60/action" status: 200 len: 24565 microversion: 2.1 time: 0.112066 Jul 28 04:25:05.889435 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4197/6647] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:25:05 2022] POST /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60/action => generated 24565 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 04:25:17.132247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e6b51e55-0007-4a35-95d6-2183eb98c707 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:25:17.135184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e6b51e55-0007-4a35-95d6-2183eb98c707 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:17.137995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:25:17.139170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:25:17.139829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:25:17.148648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6b51e55-0007-4a35-95d6-2183eb98c707 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:17.149157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6b51e55-0007-4a35-95d6-2183eb98c707 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:17.150016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6b51e55-0007-4a35-95d6-2183eb98c707 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:17.150460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6b51e55-0007-4a35-95d6-2183eb98c707 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:17.223456 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e6b51e55-0007-4a35-95d6-2183eb98c707 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "POST /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60/action" status: 200 len: 32642 microversion: 2.1 time: 0.095627 Jul 28 04:25:17.232437 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4198/6648] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:25:17 2022] POST /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60/action => generated 32642 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:25:18.413217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-260194834", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1297440191", "security_groups": [{"name": "tempest-secgroup-smoke-901372724"}], "block_device_mapping_v2": [{"uuid": "f487dd79-448d-49f7-a16b-da1a1160d0b9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:25:18.537366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] validate_networks() for [('601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:25:18.945771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:25:18.946206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:25:18.946722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:25:18.947174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:25:18.947606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:25:18.958218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:18.958715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:18.959776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:18.960500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:18.980829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:25:18.986910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for user 98c95cccd8d547a5bd528a3a3ca9fb4f and project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:25:19.055074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:25:19.056916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f487dd79-448d-49f7-a16b-da1a1160d0b9',volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:25:19.192933 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-17c2638b-97ce-475b-a403-9e5b4979541b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.784061 Jul 28 04:25:19.200628 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4199/6649] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:25:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:25:19.200628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-04e3bb6a-9539-4b03-9af9-0c93a0ca3c63 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:19.200628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-04e3bb6a-9539-4b03-9af9-0c93a0ca3c63 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:19.208854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04e3bb6a-9539-4b03-9af9-0c93a0ca3c63 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:19.208854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04e3bb6a-9539-4b03-9af9-0c93a0ca3c63 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:19.209597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04e3bb6a-9539-4b03-9af9-0c93a0ca3c63 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:19.210029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04e3bb6a-9539-4b03-9af9-0c93a0ca3c63 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:19.241375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-04e3bb6a-9539-4b03-9af9-0c93a0ca3c63 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:25:19.331132 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-04e3bb6a-9539-4b03-9af9-0c93a0ca3c63 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 204 len: 0 microversion: 2.1 time: 0.134482 Jul 28 04:25:19.335218 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4200/6650] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:25:19 2022] DELETE /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:25:19.338322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-725f760a-b4d3-43e5-ba6f-73cc61e09902 req-2adb4521-9783-495f-b85f-3004ebc5d8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ad9f106-4966-4eee-ba60-92d762a91c60", "tag": "a8b03acb-7ec0-4b1b-b06c-f79c2bf8c19e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:25:19.349861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-725f760a-b4d3-43e5-ba6f-73cc61e09902 req-2adb4521-9783-495f-b85f-3004ebc5d8e8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:19.350333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-725f760a-b4d3-43e5-ba6f-73cc61e09902 req-2adb4521-9783-495f-b85f-3004ebc5d8e8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:19.363408 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-725f760a-b4d3-43e5-ba6f-73cc61e09902 req-2adb4521-9783-495f-b85f-3004ebc5d8e8 service nova] Creating event network-changed:a8b03acb-7ec0-4b1b-b06c-f79c2bf8c19e for instance 5ad9f106-4966-4eee-ba60-92d762a91c60 on n-h2-826756-3 Jul 28 04:25:19.368842 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-725f760a-b4d3-43e5-ba6f-73cc61e09902 req-2adb4521-9783-495f-b85f-3004ebc5d8e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035218 Jul 28 04:25:19.369949 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4201/6651] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:25:19.375452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2bfaf07e-9174-4e85-b669-17f4e8d57690 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:19.376408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2bfaf07e-9174-4e85-b669-17f4e8d57690 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:19.782840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2bfaf07e-9174-4e85-b669-17f4e8d57690 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:19.790309 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2bfaf07e-9174-4e85-b669-17f4e8d57690 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1094 microversion: 2.1 time: 0.419077 Jul 28 04:25:19.790943 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4202/6652] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:19 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1094 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:25:19.795685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-46ef04ad-e6e4-4108-ba8a-51dcbde0d74c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:19.796574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-46ef04ad-e6e4-4108-ba8a-51dcbde0d74c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:19.806864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46ef04ad-e6e4-4108-ba8a-51dcbde0d74c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:19.807363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46ef04ad-e6e4-4108-ba8a-51dcbde0d74c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:19.808131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46ef04ad-e6e4-4108-ba8a-51dcbde0d74c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:19.808605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46ef04ad-e6e4-4108-ba8a-51dcbde0d74c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:19.952732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-46ef04ad-e6e4-4108-ba8a-51dcbde0d74c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:19.962036 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-46ef04ad-e6e4-4108-ba8a-51dcbde0d74c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1670 microversion: 2.1 time: 0.169905 Jul 28 04:25:19.962634 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4203/6653] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:19 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:25:20.812246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-88202c02-89fa-4db9-a128-b83c75724822 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:20.813345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-88202c02-89fa-4db9-a128-b83c75724822 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:20.821884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88202c02-89fa-4db9-a128-b83c75724822 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:20.822832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88202c02-89fa-4db9-a128-b83c75724822 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:20.823675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88202c02-89fa-4db9-a128-b83c75724822 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:20.824239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88202c02-89fa-4db9-a128-b83c75724822 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:20.895107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-88202c02-89fa-4db9-a128-b83c75724822 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:20.906472 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-88202c02-89fa-4db9-a128-b83c75724822 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1210 microversion: 2.1 time: 0.098422 Jul 28 04:25:20.912670 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4204/6654] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:20 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:25:20.985130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c4277242-a6e8-4e15-b51a-c56596a6866c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:20.985790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c4277242-a6e8-4e15-b51a-c56596a6866c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:20.992974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4277242-a6e8-4e15-b51a-c56596a6866c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:20.993439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4277242-a6e8-4e15-b51a-c56596a6866c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:20.994240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4277242-a6e8-4e15-b51a-c56596a6866c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:20.994693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4277242-a6e8-4e15-b51a-c56596a6866c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:21.152336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c4277242-a6e8-4e15-b51a-c56596a6866c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:21.162018 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c4277242-a6e8-4e15-b51a-c56596a6866c tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1670 microversion: 2.1 time: 0.181169 Jul 28 04:25:21.168416 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4205/6655] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:20 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1670 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:25:21.928416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fecb60f0-6be0-4f1e-8524-f2d7fb9e88f8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:21.929163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fecb60f0-6be0-4f1e-8524-f2d7fb9e88f8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:21.936884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fecb60f0-6be0-4f1e-8524-f2d7fb9e88f8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:21.937498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fecb60f0-6be0-4f1e-8524-f2d7fb9e88f8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:21.938304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fecb60f0-6be0-4f1e-8524-f2d7fb9e88f8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:21.939148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fecb60f0-6be0-4f1e-8524-f2d7fb9e88f8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:22.103761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fecb60f0-6be0-4f1e-8524-f2d7fb9e88f8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:22.113445 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fecb60f0-6be0-4f1e-8524-f2d7fb9e88f8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1277 microversion: 2.1 time: 0.189557 Jul 28 04:25:22.114207 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4206/6656] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:21 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:25:22.119284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1f5d3322-b304-4025-b19e-02fef2f59da2 req-07135f37-bc04-4478-964d-629220a337ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ad9f106-4966-4eee-ba60-92d762a91c60", "name": "network-vif-deleted", "tag": "a8b03acb-7ec0-4b1b-b06c-f79c2bf8c19e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:25:22.134362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1f5d3322-b304-4025-b19e-02fef2f59da2 req-07135f37-bc04-4478-964d-629220a337ae service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:22.135280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1f5d3322-b304-4025-b19e-02fef2f59da2 req-07135f37-bc04-4478-964d-629220a337ae service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:22.148743 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1f5d3322-b304-4025-b19e-02fef2f59da2 req-07135f37-bc04-4478-964d-629220a337ae service nova] Creating event network-vif-deleted:a8b03acb-7ec0-4b1b-b06c-f79c2bf8c19e for instance 5ad9f106-4966-4eee-ba60-92d762a91c60 on n-h2-826756-3 Jul 28 04:25:22.154649 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1f5d3322-b304-4025-b19e-02fef2f59da2 req-07135f37-bc04-4478-964d-629220a337ae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038904 Jul 28 04:25:22.155694 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4207/6657] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:25:22.200510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1d48aa2c-205b-477a-a07b-41e15f5ed5a8 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:22.205408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1d48aa2c-205b-477a-a07b-41e15f5ed5a8 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:22.213482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d48aa2c-205b-477a-a07b-41e15f5ed5a8 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:22.214250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d48aa2c-205b-477a-a07b-41e15f5ed5a8 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:22.215255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d48aa2c-205b-477a-a07b-41e15f5ed5a8 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:22.215702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d48aa2c-205b-477a-a07b-41e15f5ed5a8 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:22.305261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1d48aa2c-205b-477a-a07b-41e15f5ed5a8 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fc8c51b4f84432ebdaa525c2d601487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ab72fd45f247298afde074fa9b4960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:22.322900 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1d48aa2c-205b-477a-a07b-41e15f5ed5a8 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 200 len: 1333 microversion: 2.1 time: 0.130322 Jul 28 04:25:22.330295 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4208/6658] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:22 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 1333 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:25:23.137093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aaeff4b8-2970-45bc-983d-f5c6f3c22fcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:23.137757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aaeff4b8-2970-45bc-983d-f5c6f3c22fcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:23.144834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaeff4b8-2970-45bc-983d-f5c6f3c22fcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:23.145299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaeff4b8-2970-45bc-983d-f5c6f3c22fcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:23.146085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaeff4b8-2970-45bc-983d-f5c6f3c22fcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:23.146569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaeff4b8-2970-45bc-983d-f5c6f3c22fcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:23.284233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aaeff4b8-2970-45bc-983d-f5c6f3c22fcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:23.292363 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aaeff4b8-2970-45bc-983d-f5c6f3c22fcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1277 microversion: 2.1 time: 0.159296 Jul 28 04:25:23.293076 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4209/6659] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:23 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:25:23.351541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e27d4b63-35f6-4650-9a7c-161c13b204be tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:23.352164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e27d4b63-35f6-4650-9a7c-161c13b204be tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] [instance: 5ad9f106-4966-4eee-ba60-92d762a91c60] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:23.358702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e27d4b63-35f6-4650-9a7c-161c13b204be tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:23.359068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e27d4b63-35f6-4650-9a7c-161c13b204be tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:23.359838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e27d4b63-35f6-4650-9a7c-161c13b204be tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:23.360310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e27d4b63-35f6-4650-9a7c-161c13b204be tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:23.376594 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e27d4b63-35f6-4650-9a7c-161c13b204be tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] HTTP exception thrown: Instance 5ad9f106-4966-4eee-ba60-92d762a91c60 could not be found. Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e27d4b63-35f6-4650-9a7c-161c13b204be tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Request method failure captured: Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 HTTP/1.1 Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g74z8tso9myfnG8JK7jikXH-7369SOXR9q5UnWoDB1jLiZ_jKw3b178pGHLOShMq3AJtVKhHxMqn1EfTP0un3XcUYaTlDDRnr-SX6ODtLUxKM32QkQk6fgb0VFp_QLRFZXOMtwNKhkx6lX44loE7fZWTMTS9wk30ZaYTQtfEcydeyc Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 54ab72fd45f247298afde074fa9b4960 Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestNetworkBasicOps-632794303 Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/54ab72fd45f247298afde074fa9b4960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54ab72fd45f247298afde074fa9b4960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_54ab72fd45f247298afde074fa9b4960"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/54ab72fd45f247298afde074fa9b4960"}]}] Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestNetworkBasicOps-632794303 Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 54ab72fd45f247298afde074fa9b4960 Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestNetworkBasicOps-632794303 Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestNetworkBasicOps-632794303-project Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 1fc8c51b4f84432ebdaa525c2d601487 Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestNetworkBasicOps-632794303-project Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 5ad9f106-4966-4eee-ba60-92d762a91c60 could not be found. Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '5ad9f106-4966-4eee-ba60-92d762a91c60'} Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ad9f106-4966-4eee-ba60-92d762a91c60 could not be found. Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ad9f106-4966-4eee-ba60-92d762a91c60 could not be found. Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:25:23.378312 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:25:23.384537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:25:23.384537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:25:23.384537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:25:23.384537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:25:23.384537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:25:23.384537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ad9f106-4966-4eee-ba60-92d762a91c60 could not be found. Jul 28 04:25:23.384537 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:25:23.384537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e27d4b63-35f6-4650-9a7c-161c13b204be tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Returning 404 to user: Instance 5ad9f106-4966-4eee-ba60-92d762a91c60 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:25:23.384537 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e27d4b63-35f6-4650-9a7c-161c13b204be tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60" status: 404 len: 111 microversion: 2.1 time: 0.032215 Jul 28 04:25:23.384537 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4210/6660] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:23 2022] GET /compute/v2.1/servers/5ad9f106-4966-4eee-ba60-92d762a91c60 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:25:23.546564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6acbc523-958c-4bab-87db-458ebb315d52 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] Calling method '.version_select at 0x7ffa741b6a60>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:23.569426 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6acbc523-958c-4bab-87db-458ebb315d52 tempest-TestNetworkBasicOps-632794303 tempest-TestNetworkBasicOps-632794303-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-792848566" status: 202 len: 0 microversion: 2.1 time: 0.026057 Jul 28 04:25:23.570094 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4211/6661] 10.222.0.48 () {58 vars in 1254 bytes} [Thu Jul 28 04:25:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-792848566 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:25:24.176032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9c4ac881-5efc-488b-839b-4e4335eb6bf4 req-5fb38202-6e42-4208-a37e-2064f037f35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f387ef4-d769-4480-b217-9fc61da70746", "tag": "07951e85-95cf-4460-abe1-5dfc68f92c6f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:25:24.190916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9c4ac881-5efc-488b-839b-4e4335eb6bf4 req-5fb38202-6e42-4208-a37e-2064f037f35d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:24.191681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9c4ac881-5efc-488b-839b-4e4335eb6bf4 req-5fb38202-6e42-4208-a37e-2064f037f35d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:24.207545 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9c4ac881-5efc-488b-839b-4e4335eb6bf4 req-5fb38202-6e42-4208-a37e-2064f037f35d service nova] Creating event network-changed:07951e85-95cf-4460-abe1-5dfc68f92c6f for instance 1f387ef4-d769-4480-b217-9fc61da70746 on n-h1-826756-3 Jul 28 04:25:24.214003 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9c4ac881-5efc-488b-839b-4e4335eb6bf4 req-5fb38202-6e42-4208-a37e-2064f037f35d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043429 Jul 28 04:25:24.215852 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4212/6662] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:25:24.315144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-636d3b2d-916a-40e3-94d4-bae1cee41678 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:24.316181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-636d3b2d-916a-40e3-94d4-bae1cee41678 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:24.323265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-636d3b2d-916a-40e3-94d4-bae1cee41678 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:24.323993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-636d3b2d-916a-40e3-94d4-bae1cee41678 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:24.325132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-636d3b2d-916a-40e3-94d4-bae1cee41678 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:24.325759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-636d3b2d-916a-40e3-94d4-bae1cee41678 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:24.559423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-636d3b2d-916a-40e3-94d4-bae1cee41678 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:24.567661 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-636d3b2d-916a-40e3-94d4-bae1cee41678 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1277 microversion: 2.1 time: 0.257801 Jul 28 04:25:24.581152 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4213/6663] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:24 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1277 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:25:25.589209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb3c04d9-51bf-4f5b-9f75-3e521f894bd1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:25.590546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eb3c04d9-51bf-4f5b-9f75-3e521f894bd1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:25.600630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb3c04d9-51bf-4f5b-9f75-3e521f894bd1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:25.606469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb3c04d9-51bf-4f5b-9f75-3e521f894bd1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:25.607481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb3c04d9-51bf-4f5b-9f75-3e521f894bd1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:25.607914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb3c04d9-51bf-4f5b-9f75-3e521f894bd1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:25.845581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eb3c04d9-51bf-4f5b-9f75-3e521f894bd1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:25.854404 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb3c04d9-51bf-4f5b-9f75-3e521f894bd1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1277 microversion: 2.1 time: 0.269290 Jul 28 04:25:25.855148 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4214/6664] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:25 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1277 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:25:26.878670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d5b01f49-38d5-42ac-9e23-1e0bdd2f40a5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:26.879314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d5b01f49-38d5-42ac-9e23-1e0bdd2f40a5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:26.887001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5b01f49-38d5-42ac-9e23-1e0bdd2f40a5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:26.887462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5b01f49-38d5-42ac-9e23-1e0bdd2f40a5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:26.888268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5b01f49-38d5-42ac-9e23-1e0bdd2f40a5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:26.888747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5b01f49-38d5-42ac-9e23-1e0bdd2f40a5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:27.063539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d5b01f49-38d5-42ac-9e23-1e0bdd2f40a5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:27.073026 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d5b01f49-38d5-42ac-9e23-1e0bdd2f40a5 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1265 microversion: 2.1 time: 0.198737 Jul 28 04:25:27.073638 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4215/6665] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:26 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:25:28.094113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5fc916c2-725d-4350-a211-c8ddb046f3bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:28.095328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5fc916c2-725d-4350-a211-c8ddb046f3bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:28.104388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fc916c2-725d-4350-a211-c8ddb046f3bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:28.104862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fc916c2-725d-4350-a211-c8ddb046f3bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:28.105693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fc916c2-725d-4350-a211-c8ddb046f3bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:28.106148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fc916c2-725d-4350-a211-c8ddb046f3bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:28.241280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5fc916c2-725d-4350-a211-c8ddb046f3bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:28.249822 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5fc916c2-725d-4350-a211-c8ddb046f3bc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1265 microversion: 2.1 time: 0.159580 Jul 28 04:25:28.250756 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4216/6666] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:28 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:25:29.276671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4538bb0e-2f70-487f-9d34-786b280610ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:29.277814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4538bb0e-2f70-487f-9d34-786b280610ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:29.281202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:25:29.288440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4538bb0e-2f70-487f-9d34-786b280610ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:29.288905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4538bb0e-2f70-487f-9d34-786b280610ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:29.289688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4538bb0e-2f70-487f-9d34-786b280610ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:29.290145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4538bb0e-2f70-487f-9d34-786b280610ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:29.446582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4538bb0e-2f70-487f-9d34-786b280610ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:29.459643 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4538bb0e-2f70-487f-9d34-786b280610ab tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1265 microversion: 2.1 time: 0.189609 Jul 28 04:25:29.460591 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4217/6667] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:29 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:25:30.489400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fd852ca4-e8e6-4bab-b09d-4ed6935e1f16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:30.489915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fd852ca4-e8e6-4bab-b09d-4ed6935e1f16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:30.491668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:25:30.499181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd852ca4-e8e6-4bab-b09d-4ed6935e1f16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:30.499642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd852ca4-e8e6-4bab-b09d-4ed6935e1f16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:30.500436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd852ca4-e8e6-4bab-b09d-4ed6935e1f16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:30.500897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd852ca4-e8e6-4bab-b09d-4ed6935e1f16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:30.519224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:25:30.655027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fd852ca4-e8e6-4bab-b09d-4ed6935e1f16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:30.664706 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fd852ca4-e8e6-4bab-b09d-4ed6935e1f16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1265 microversion: 2.1 time: 0.180858 Jul 28 04:25:30.665267 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4218/6668] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:30 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:25:31.689647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-32d8008d-0331-4d95-86c7-5d7a496cb619 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:31.690445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-32d8008d-0331-4d95-86c7-5d7a496cb619 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:31.697898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32d8008d-0331-4d95-86c7-5d7a496cb619 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:31.698358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32d8008d-0331-4d95-86c7-5d7a496cb619 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:31.699137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32d8008d-0331-4d95-86c7-5d7a496cb619 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:31.699583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32d8008d-0331-4d95-86c7-5d7a496cb619 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:31.849634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-32d8008d-0331-4d95-86c7-5d7a496cb619 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:31.858479 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-32d8008d-0331-4d95-86c7-5d7a496cb619 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1265 microversion: 2.1 time: 0.174988 Jul 28 04:25:31.859195 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4219/6669] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:31 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:25:32.889894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1ac26175-a142-4816-9d66-64ee0c0ba607 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:32.890957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1ac26175-a142-4816-9d66-64ee0c0ba607 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:32.907545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ac26175-a142-4816-9d66-64ee0c0ba607 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:32.908333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ac26175-a142-4816-9d66-64ee0c0ba607 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:32.909677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ac26175-a142-4816-9d66-64ee0c0ba607 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:32.910221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ac26175-a142-4816-9d66-64ee0c0ba607 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:33.057639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1ac26175-a142-4816-9d66-64ee0c0ba607 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:33.069037 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1ac26175-a142-4816-9d66-64ee0c0ba607 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1265 microversion: 2.1 time: 0.187169 Jul 28 04:25:33.069619 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4220/6670] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:32 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:25:34.090739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6694a2a3-abda-4ed6-b855-85c7a52137b8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:34.091352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6694a2a3-abda-4ed6-b855-85c7a52137b8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:34.099754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6694a2a3-abda-4ed6-b855-85c7a52137b8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:34.100256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6694a2a3-abda-4ed6-b855-85c7a52137b8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:34.101117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6694a2a3-abda-4ed6-b855-85c7a52137b8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:34.101562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6694a2a3-abda-4ed6-b855-85c7a52137b8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:34.238406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6694a2a3-abda-4ed6-b855-85c7a52137b8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:34.246551 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6694a2a3-abda-4ed6-b855-85c7a52137b8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1265 microversion: 2.1 time: 0.159835 Jul 28 04:25:34.247151 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4221/6671] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:34 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:25:35.271942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-72412df5-eeeb-4481-bc16-510e740b3c21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:35.273106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-72412df5-eeeb-4481-bc16-510e740b3c21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:35.284996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72412df5-eeeb-4481-bc16-510e740b3c21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:35.285464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72412df5-eeeb-4481-bc16-510e740b3c21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:35.286241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72412df5-eeeb-4481-bc16-510e740b3c21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:35.286685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72412df5-eeeb-4481-bc16-510e740b3c21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:35.666446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-72412df5-eeeb-4481-bc16-510e740b3c21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:35.678449 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-72412df5-eeeb-4481-bc16-510e740b3c21 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1265 microversion: 2.1 time: 0.413183 Jul 28 04:25:35.679058 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4222/6672] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:35 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:25:36.007404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4bdaf4f0-83db-4905-8f4e-18862311d915 req-45162f01-0d3f-457a-8c78-b5e92c7037c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f387ef4-d769-4480-b217-9fc61da70746", "name": "network-vif-plugged", "status": "completed", "tag": "07951e85-95cf-4460-abe1-5dfc68f92c6f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:25:36.017528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4bdaf4f0-83db-4905-8f4e-18862311d915 req-45162f01-0d3f-457a-8c78-b5e92c7037c1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:36.018030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4bdaf4f0-83db-4905-8f4e-18862311d915 req-45162f01-0d3f-457a-8c78-b5e92c7037c1 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:36.030349 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4bdaf4f0-83db-4905-8f4e-18862311d915 req-45162f01-0d3f-457a-8c78-b5e92c7037c1 service nova] Creating event network-vif-plugged:07951e85-95cf-4460-abe1-5dfc68f92c6f for instance 1f387ef4-d769-4480-b217-9fc61da70746 on n-h1-826756-3 Jul 28 04:25:36.036166 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4bdaf4f0-83db-4905-8f4e-18862311d915 req-45162f01-0d3f-457a-8c78-b5e92c7037c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032526 Jul 28 04:25:36.037089 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4223/6673] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:25:36.711054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-75b717f7-fcba-4e71-a8b0-d296b8aaf216 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:36.712014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-75b717f7-fcba-4e71-a8b0-d296b8aaf216 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:36.722877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75b717f7-fcba-4e71-a8b0-d296b8aaf216 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:36.723680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75b717f7-fcba-4e71-a8b0-d296b8aaf216 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:36.724501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75b717f7-fcba-4e71-a8b0-d296b8aaf216 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:36.724958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75b717f7-fcba-4e71-a8b0-d296b8aaf216 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:36.861557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-75b717f7-fcba-4e71-a8b0-d296b8aaf216 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:36.869698 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-75b717f7-fcba-4e71-a8b0-d296b8aaf216 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1265 microversion: 2.1 time: 0.166240 Jul 28 04:25:36.870271 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4224/6674] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:36 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:25:37.891225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1705eb7b-c56b-4560-a7fe-dcee5b7b267a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:37.891964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1705eb7b-c56b-4560-a7fe-dcee5b7b267a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:37.899470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1705eb7b-c56b-4560-a7fe-dcee5b7b267a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:37.899935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1705eb7b-c56b-4560-a7fe-dcee5b7b267a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:37.900757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1705eb7b-c56b-4560-a7fe-dcee5b7b267a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:37.901214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1705eb7b-c56b-4560-a7fe-dcee5b7b267a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:38.050495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1705eb7b-c56b-4560-a7fe-dcee5b7b267a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:38.058646 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1705eb7b-c56b-4560-a7fe-dcee5b7b267a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1452 microversion: 2.1 time: 0.171435 Jul 28 04:25:38.059219 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4225/6675] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:37 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:25:38.082066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d21aa47b-9918-4efb-a218-e42e18f013da tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:25:38.082693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d21aa47b-9918-4efb-a218-e42e18f013da tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:25:38.089379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d21aa47b-9918-4efb-a218-e42e18f013da tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:38.089852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d21aa47b-9918-4efb-a218-e42e18f013da tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:38.090639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d21aa47b-9918-4efb-a218-e42e18f013da tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:38.091098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d21aa47b-9918-4efb-a218-e42e18f013da tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:38.235682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d21aa47b-9918-4efb-a218-e42e18f013da tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:25:38.243813 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d21aa47b-9918-4efb-a218-e42e18f013da tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1452 microversion: 2.1 time: 0.165632 Jul 28 04:25:38.244401 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4226/6676] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:25:38 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:25:40.262527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c70eb8a5-be24-4047-8865-51a928d4207c req-6027d702-f79c-4889-82c0-d7504e69752c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f387ef4-d769-4480-b217-9fc61da70746", "tag": "07951e85-95cf-4460-abe1-5dfc68f92c6f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:25:40.274139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c70eb8a5-be24-4047-8865-51a928d4207c req-6027d702-f79c-4889-82c0-d7504e69752c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:25:40.274606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c70eb8a5-be24-4047-8865-51a928d4207c req-6027d702-f79c-4889-82c0-d7504e69752c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:25:40.287860 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c70eb8a5-be24-4047-8865-51a928d4207c req-6027d702-f79c-4889-82c0-d7504e69752c service nova] Creating event network-changed:07951e85-95cf-4460-abe1-5dfc68f92c6f for instance 1f387ef4-d769-4480-b217-9fc61da70746 on n-h1-826756-3 Jul 28 04:25:40.293698 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c70eb8a5-be24-4047-8865-51a928d4207c req-6027d702-f79c-4889-82c0-d7504e69752c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035766 Jul 28 04:25:40.294304 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4227/6677] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:26:57.348266 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:26:57.349265 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:26:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:27:24.018870 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:27:24.019696 n-d-826756-3 devstack@n-api.service[126071]: Thu Jul 28 04:27:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:27:37.678217 n-d-826756-3 devstack@n-api.service[126071]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3383c6d1-bf1b-4640-b860-3d2b5f70fe2b] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 04:27:37.679141 n-d-826756-3 devstack@n-api.service[126071]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58ec63bc-5462-40de-8ca8-e5ce0d7dbc1c] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 28 04:27:37.679869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:27:37.680664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=48 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:27:37.810595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-92f6224a-c8e9-40d7-918b-75eab821331e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:37.811342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-92f6224a-c8e9-40d7-918b-75eab821331e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:37.818678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92f6224a-c8e9-40d7-918b-75eab821331e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:37.819150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92f6224a-c8e9-40d7-918b-75eab821331e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:37.819940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92f6224a-c8e9-40d7-918b-75eab821331e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:37.820425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92f6224a-c8e9-40d7-918b-75eab821331e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:37.847392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-92f6224a-c8e9-40d7-918b-75eab821331e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:27:37.932372 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-92f6224a-c8e9-40d7-918b-75eab821331e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 204 len: 0 microversion: 2.1 time: 0.256249 Jul 28 04:27:37.933244 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4228/6678] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:27:37 2022] DELETE /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:27:37.941642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a2640f8-f420-4094-bb40-b3cc6195b744 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:37.942349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1a2640f8-f420-4094-bb40-b3cc6195b744 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:37.948736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a2640f8-f420-4094-bb40-b3cc6195b744 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:37.949201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a2640f8-f420-4094-bb40-b3cc6195b744 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:37.950012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a2640f8-f420-4094-bb40-b3cc6195b744 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:37.950457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a2640f8-f420-4094-bb40-b3cc6195b744 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:38.092678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1a2640f8-f420-4094-bb40-b3cc6195b744 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:38.101373 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1a2640f8-f420-4094-bb40-b3cc6195b744 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1577 microversion: 2.1 time: 0.163840 Jul 28 04:27:38.101939 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4229/6679] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:37 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:27:39.126243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a2eacf3-0ace-43d4-8db5-5951602ea3c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:39.127009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9a2eacf3-0ace-43d4-8db5-5951602ea3c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:39.141563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a2eacf3-0ace-43d4-8db5-5951602ea3c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:39.142243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a2eacf3-0ace-43d4-8db5-5951602ea3c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:39.143457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a2eacf3-0ace-43d4-8db5-5951602ea3c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:39.144058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a2eacf3-0ace-43d4-8db5-5951602ea3c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:39.150823 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] [58ec63bc-5462-40de-8ca8-e5ce0d7dbc1c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 36526. Jul 28 04:27:39.154267 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] [3383c6d1-bf1b-4640-b860-3d2b5f70fe2b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 36524. Jul 28 04:27:39.290749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9a2eacf3-0ace-43d4-8db5-5951602ea3c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:39.299390 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9a2eacf3-0ace-43d4-8db5-5951602ea3c3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1577 microversion: 2.1 time: 0.178870 Jul 28 04:27:39.299969 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4230/6680] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:39 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:27:40.327431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c33fc3db-e709-4666-b346-6ec598eff2a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:40.328149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c33fc3db-e709-4666-b346-6ec598eff2a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:40.336135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c33fc3db-e709-4666-b346-6ec598eff2a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:40.336699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c33fc3db-e709-4666-b346-6ec598eff2a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:40.337655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c33fc3db-e709-4666-b346-6ec598eff2a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:40.338210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c33fc3db-e709-4666-b346-6ec598eff2a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:40.437543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c33fc3db-e709-4666-b346-6ec598eff2a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:40.448304 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c33fc3db-e709-4666-b346-6ec598eff2a6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1510 microversion: 2.1 time: 0.124667 Jul 28 04:27:40.449081 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4231/6681] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:40 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1510 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:27:40.533853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-12f02217-c2a6-4af0-857a-748d916cd900 req-c096bc88-7fe7-494b-bcd4-9a07ab07a996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f387ef4-d769-4480-b217-9fc61da70746", "name": "network-vif-deleted", "tag": "07951e85-95cf-4460-abe1-5dfc68f92c6f"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:27:40.544391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-12f02217-c2a6-4af0-857a-748d916cd900 req-c096bc88-7fe7-494b-bcd4-9a07ab07a996 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:40.545179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-12f02217-c2a6-4af0-857a-748d916cd900 req-c096bc88-7fe7-494b-bcd4-9a07ab07a996 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:40.560572 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-12f02217-c2a6-4af0-857a-748d916cd900 req-c096bc88-7fe7-494b-bcd4-9a07ab07a996 service nova] Creating event network-vif-deleted:07951e85-95cf-4460-abe1-5dfc68f92c6f for instance 1f387ef4-d769-4480-b217-9fc61da70746 on n-h1-826756-3 Jul 28 04:27:40.568735 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-12f02217-c2a6-4af0-857a-748d916cd900 req-c096bc88-7fe7-494b-bcd4-9a07ab07a996 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118498 Jul 28 04:27:40.569454 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4232/6682] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:27:41.474451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-da817ed1-19b1-440c-9fa6-cf70c5461e33 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:41.475303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-da817ed1-19b1-440c-9fa6-cf70c5461e33 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:41.483517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da817ed1-19b1-440c-9fa6-cf70c5461e33 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:41.483996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da817ed1-19b1-440c-9fa6-cf70c5461e33 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:41.484903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da817ed1-19b1-440c-9fa6-cf70c5461e33 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:41.485363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da817ed1-19b1-440c-9fa6-cf70c5461e33 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:41.549354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-da817ed1-19b1-440c-9fa6-cf70c5461e33 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:41.557854 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-da817ed1-19b1-440c-9fa6-cf70c5461e33 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1225 microversion: 2.1 time: 0.088992 Jul 28 04:27:41.558416 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4233/6683] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:41 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:27:42.580132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4bac1e0-2f40-4aa2-8cbb-85bb81087b6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:42.580860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4bac1e0-2f40-4aa2-8cbb-85bb81087b6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:42.589239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4bac1e0-2f40-4aa2-8cbb-85bb81087b6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:42.589795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4bac1e0-2f40-4aa2-8cbb-85bb81087b6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:42.590611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4bac1e0-2f40-4aa2-8cbb-85bb81087b6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:42.591078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4bac1e0-2f40-4aa2-8cbb-85bb81087b6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:42.656817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f4bac1e0-2f40-4aa2-8cbb-85bb81087b6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:42.665281 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4bac1e0-2f40-4aa2-8cbb-85bb81087b6e tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1225 microversion: 2.1 time: 0.089503 Jul 28 04:27:42.665870 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4234/6684] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:42 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:27:43.692737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-693ecdae-e28a-49b2-9ffb-75850251504c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:43.693497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-693ecdae-e28a-49b2-9ffb-75850251504c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:43.701484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-693ecdae-e28a-49b2-9ffb-75850251504c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:43.701895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-693ecdae-e28a-49b2-9ffb-75850251504c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:43.702938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-693ecdae-e28a-49b2-9ffb-75850251504c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:43.703381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-693ecdae-e28a-49b2-9ffb-75850251504c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:43.772231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-693ecdae-e28a-49b2-9ffb-75850251504c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:43.780764 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-693ecdae-e28a-49b2-9ffb-75850251504c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1225 microversion: 2.1 time: 0.092025 Jul 28 04:27:43.781356 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4235/6685] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:43 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:27:44.806658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-95934865-ed43-4604-a3cd-411549d1483b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:44.807427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-95934865-ed43-4604-a3cd-411549d1483b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:44.814624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95934865-ed43-4604-a3cd-411549d1483b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:44.815095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95934865-ed43-4604-a3cd-411549d1483b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:44.815872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95934865-ed43-4604-a3cd-411549d1483b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:44.816342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95934865-ed43-4604-a3cd-411549d1483b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:44.849745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95934865-ed43-4604-a3cd-411549d1483b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:44.850262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95934865-ed43-4604-a3cd-411549d1483b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:44.850729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-95934865-ed43-4604-a3cd-411549d1483b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lazy-loading 'fault' on Instance uuid 1f387ef4-d769-4480-b217-9fc61da70746 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:27:44.896199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-95934865-ed43-4604-a3cd-411549d1483b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:44.904851 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-95934865-ed43-4604-a3cd-411549d1483b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 200 len: 1230 microversion: 2.1 time: 0.103010 Jul 28 04:27:44.905418 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4236/6686] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:44 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:27:45.926933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f81c0012-af7c-42cd-a425-8a21fb188977 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:45.927663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f81c0012-af7c-42cd-a425-8a21fb188977 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:45.935211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f81c0012-af7c-42cd-a425-8a21fb188977 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:45.935677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f81c0012-af7c-42cd-a425-8a21fb188977 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:45.936497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f81c0012-af7c-42cd-a425-8a21fb188977 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:45.936957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f81c0012-af7c-42cd-a425-8a21fb188977 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:45.950634 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-f81c0012-af7c-42cd-a425-8a21fb188977 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f81c0012-af7c-42cd-a425-8a21fb188977 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 HTTP/1.1 Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1f387ef4-d769-4480-b217-9fc61da70746'} Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:27:45.952325 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:27:45.957705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:27:45.957705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:27:45.957705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:27:45.957705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:27:45.957705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:27:45.957705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:27:45.957705 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:27:45.957705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f81c0012-af7c-42cd-a425-8a21fb188977 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:27:45.957705 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f81c0012-af7c-42cd-a425-8a21fb188977 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 404 len: 111 microversion: 2.1 time: 0.031107 Jul 28 04:27:45.957705 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4237/6687] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:45 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:27:46.005484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1147745696", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1297440191", "security_groups": [{"name": "tempest-secgroup-smoke-901372724"}], "block_device_mapping_v2": [{"uuid": "f487dd79-448d-49f7-a16b-da1a1160d0b9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:27:46.123711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] validate_networks() for [('601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:27:46.580030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:27:46.580503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:27:46.581004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:27:46.581434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:27:46.581866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:27:46.592112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:46.592623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:46.593689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:46.593959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:46.612525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:27:46.618467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for user 98c95cccd8d547a5bd528a3a3ca9fb4f and project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:27:46.680227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:27:46.682438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f487dd79-448d-49f7-a16b-da1a1160d0b9',volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:27:46.830117 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b081e92b-e1f4-478e-990d-0ccfec2a7e3d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.828526 Jul 28 04:27:46.830688 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4238/6688] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:27:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:27:46.841393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06c401b1-4521-4fc4-a7ba-8d6417d90326 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:46.842020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-06c401b1-4521-4fc4-a7ba-8d6417d90326 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:46.898564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-06c401b1-4521-4fc4-a7ba-8d6417d90326 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:46.906076 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-06c401b1-4521-4fc4-a7ba-8d6417d90326 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1095 microversion: 2.1 time: 0.068452 Jul 28 04:27:46.906648 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4239/6689] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:46 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:27:47.927218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d670aab-9bb5-4630-82d9-0fdfb7a06f60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:47.928100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d670aab-9bb5-4630-82d9-0fdfb7a06f60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:47.939012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d670aab-9bb5-4630-82d9-0fdfb7a06f60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:47.939472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d670aab-9bb5-4630-82d9-0fdfb7a06f60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:47.940283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d670aab-9bb5-4630-82d9-0fdfb7a06f60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:47.940761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d670aab-9bb5-4630-82d9-0fdfb7a06f60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:48.015687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9d670aab-9bb5-4630-82d9-0fdfb7a06f60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:48.023975 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d670aab-9bb5-4630-82d9-0fdfb7a06f60 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1201 microversion: 2.1 time: 0.100677 Jul 28 04:27:48.024611 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4240/6690] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:47 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1201 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:27:49.046888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-53422c42-749b-459d-a741-21ae19c71b7f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:49.048508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-53422c42-749b-459d-a741-21ae19c71b7f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:49.057066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53422c42-749b-459d-a741-21ae19c71b7f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:49.057655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53422c42-749b-459d-a741-21ae19c71b7f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:49.058568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53422c42-749b-459d-a741-21ae19c71b7f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:49.059108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-53422c42-749b-459d-a741-21ae19c71b7f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:49.200050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-53422c42-749b-459d-a741-21ae19c71b7f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:49.208395 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-53422c42-749b-459d-a741-21ae19c71b7f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1278 microversion: 2.1 time: 0.166461 Jul 28 04:27:49.209432 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4241/6691] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:49 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:27:49.519628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-74fe143d-2193-4b2d-8c64-5ed5fddb79a2 req-692204bb-286e-43ac-aa70-43e8dd0180c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3af05f2-75bb-481b-b53c-31bdc8cbd5ad", "tag": "6589885d-0e29-4d08-8bb1-08077dd3f79c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:27:49.543793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-74fe143d-2193-4b2d-8c64-5ed5fddb79a2 req-692204bb-286e-43ac-aa70-43e8dd0180c6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:49.544601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-74fe143d-2193-4b2d-8c64-5ed5fddb79a2 req-692204bb-286e-43ac-aa70-43e8dd0180c6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:49.557685 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-74fe143d-2193-4b2d-8c64-5ed5fddb79a2 req-692204bb-286e-43ac-aa70-43e8dd0180c6 service nova] Creating event network-changed:6589885d-0e29-4d08-8bb1-08077dd3f79c for instance c3af05f2-75bb-481b-b53c-31bdc8cbd5ad on n-h2-826756-3 Jul 28 04:27:49.562723 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-74fe143d-2193-4b2d-8c64-5ed5fddb79a2 req-692204bb-286e-43ac-aa70-43e8dd0180c6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049138 Jul 28 04:27:49.563343 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4242/6692] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:27:50.235150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-843ad58a-04d3-4bf2-934a-cb29f7efcd56 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:50.236749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-843ad58a-04d3-4bf2-934a-cb29f7efcd56 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:50.245598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-843ad58a-04d3-4bf2-934a-cb29f7efcd56 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:50.246111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-843ad58a-04d3-4bf2-934a-cb29f7efcd56 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:50.247009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-843ad58a-04d3-4bf2-934a-cb29f7efcd56 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:50.247527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-843ad58a-04d3-4bf2-934a-cb29f7efcd56 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:50.394592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-843ad58a-04d3-4bf2-934a-cb29f7efcd56 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:50.403360 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-843ad58a-04d3-4bf2-934a-cb29f7efcd56 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1278 microversion: 2.1 time: 0.173567 Jul 28 04:27:50.404032 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4243/6693] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:50 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:27:51.424941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a62ff74-be1e-4908-9233-d34c94d2c643 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:51.425905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8a62ff74-be1e-4908-9233-d34c94d2c643 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:51.433831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a62ff74-be1e-4908-9233-d34c94d2c643 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:51.434300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a62ff74-be1e-4908-9233-d34c94d2c643 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:51.435101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a62ff74-be1e-4908-9233-d34c94d2c643 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:51.435580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a62ff74-be1e-4908-9233-d34c94d2c643 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:51.590276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a62ff74-be1e-4908-9233-d34c94d2c643 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:51.599399 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a62ff74-be1e-4908-9233-d34c94d2c643 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1278 microversion: 2.1 time: 0.178514 Jul 28 04:27:51.600064 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4244/6694] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:51 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:27:52.620840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c54f2a9-a5a2-47be-839b-17343cfec40c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:52.621528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c54f2a9-a5a2-47be-839b-17343cfec40c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:52.628891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c54f2a9-a5a2-47be-839b-17343cfec40c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:52.629353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c54f2a9-a5a2-47be-839b-17343cfec40c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:52.630137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c54f2a9-a5a2-47be-839b-17343cfec40c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:52.630583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c54f2a9-a5a2-47be-839b-17343cfec40c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:52.778799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1c54f2a9-a5a2-47be-839b-17343cfec40c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:52.787100 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c54f2a9-a5a2-47be-839b-17343cfec40c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1278 microversion: 2.1 time: 0.170232 Jul 28 04:27:52.787737 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4245/6695] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:52 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:27:53.809465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-952e397e-bcbd-478c-ace5-ffc47b49f8bd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:53.810195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-952e397e-bcbd-478c-ace5-ffc47b49f8bd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:53.817658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-952e397e-bcbd-478c-ace5-ffc47b49f8bd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:53.818108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-952e397e-bcbd-478c-ace5-ffc47b49f8bd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:53.818914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-952e397e-bcbd-478c-ace5-ffc47b49f8bd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:53.819361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-952e397e-bcbd-478c-ace5-ffc47b49f8bd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:53.823534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:27:53.976301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-952e397e-bcbd-478c-ace5-ffc47b49f8bd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:53.984532 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-952e397e-bcbd-478c-ace5-ffc47b49f8bd tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1266 microversion: 2.1 time: 0.179173 Jul 28 04:27:53.985118 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4246/6696] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:53 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:27:55.009359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6545968e-98c1-487e-b231-fba65e2b45b1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:55.010081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6545968e-98c1-487e-b231-fba65e2b45b1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:55.017674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6545968e-98c1-487e-b231-fba65e2b45b1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:55.018141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6545968e-98c1-487e-b231-fba65e2b45b1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:55.018933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6545968e-98c1-487e-b231-fba65e2b45b1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:55.019381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6545968e-98c1-487e-b231-fba65e2b45b1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:55.158213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6545968e-98c1-487e-b231-fba65e2b45b1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:55.166293 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6545968e-98c1-487e-b231-fba65e2b45b1 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1266 microversion: 2.1 time: 0.162666 Jul 28 04:27:55.166882 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4247/6697] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:55 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:27:56.187545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-66655497-ede9-41ef-b367-f238c3d31641 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:56.188262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-66655497-ede9-41ef-b367-f238c3d31641 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:56.195870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66655497-ede9-41ef-b367-f238c3d31641 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:56.196334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66655497-ede9-41ef-b367-f238c3d31641 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:56.197157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66655497-ede9-41ef-b367-f238c3d31641 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:56.197598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-66655497-ede9-41ef-b367-f238c3d31641 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:56.331778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-66655497-ede9-41ef-b367-f238c3d31641 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:56.341060 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-66655497-ede9-41ef-b367-f238c3d31641 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1266 microversion: 2.1 time: 0.157545 Jul 28 04:27:56.341638 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4248/6698] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:56 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:27:57.364332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-abf869bc-a978-4a3b-b4e0-29102382b699 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:57.365093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-abf869bc-a978-4a3b-b4e0-29102382b699 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:57.367164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:27:57.367960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:27:57.375801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abf869bc-a978-4a3b-b4e0-29102382b699 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:57.376319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abf869bc-a978-4a3b-b4e0-29102382b699 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:57.377214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abf869bc-a978-4a3b-b4e0-29102382b699 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:57.377712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-abf869bc-a978-4a3b-b4e0-29102382b699 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:57.530061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-abf869bc-a978-4a3b-b4e0-29102382b699 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:57.538090 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-abf869bc-a978-4a3b-b4e0-29102382b699 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1266 microversion: 2.1 time: 0.178217 Jul 28 04:27:57.538955 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4249/6699] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:57 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:27:58.560302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b151c5d9-fadd-4cc5-a51f-0f58d569c5cc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:58.561183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b151c5d9-fadd-4cc5-a51f-0f58d569c5cc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:58.569721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b151c5d9-fadd-4cc5-a51f-0f58d569c5cc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:58.570242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b151c5d9-fadd-4cc5-a51f-0f58d569c5cc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:58.571156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b151c5d9-fadd-4cc5-a51f-0f58d569c5cc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:58.571686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b151c5d9-fadd-4cc5-a51f-0f58d569c5cc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:58.711945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b151c5d9-fadd-4cc5-a51f-0f58d569c5cc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:58.725422 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b151c5d9-fadd-4cc5-a51f-0f58d569c5cc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1266 microversion: 2.1 time: 0.169569 Jul 28 04:27:58.726497 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4250/6700] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:58 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:27:59.757798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb14bcf3-3588-4f1d-a0e1-a3b94fb2bce3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:27:59.758993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb14bcf3-3588-4f1d-a0e1-a3b94fb2bce3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:27:59.770616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb14bcf3-3588-4f1d-a0e1-a3b94fb2bce3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:59.771387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb14bcf3-3588-4f1d-a0e1-a3b94fb2bce3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:59.772737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb14bcf3-3588-4f1d-a0e1-a3b94fb2bce3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:27:59.774042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb14bcf3-3588-4f1d-a0e1-a3b94fb2bce3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:27:59.936197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fb14bcf3-3588-4f1d-a0e1-a3b94fb2bce3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:27:59.945252 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fb14bcf3-3588-4f1d-a0e1-a3b94fb2bce3 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1266 microversion: 2.1 time: 0.194445 Jul 28 04:27:59.945834 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4251/6701] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:27:59 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:28:00.966866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-618c3fe7-c8fd-4535-b3c0-626cb30d7486 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:28:00.967658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-618c3fe7-c8fd-4535-b3c0-626cb30d7486 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:28:00.975829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-618c3fe7-c8fd-4535-b3c0-626cb30d7486 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:28:00.976304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-618c3fe7-c8fd-4535-b3c0-626cb30d7486 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:28:00.977133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-618c3fe7-c8fd-4535-b3c0-626cb30d7486 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:28:00.977687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-618c3fe7-c8fd-4535-b3c0-626cb30d7486 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:28:01.130853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-618c3fe7-c8fd-4535-b3c0-626cb30d7486 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:28:01.139662 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-618c3fe7-c8fd-4535-b3c0-626cb30d7486 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1266 microversion: 2.1 time: 0.176857 Jul 28 04:28:01.140543 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4252/6702] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:28:00 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:28:02.161858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-054f8b50-b9e8-4f11-a013-f2d1cac06447 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:28:02.162589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-054f8b50-b9e8-4f11-a013-f2d1cac06447 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:28:02.171970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-054f8b50-b9e8-4f11-a013-f2d1cac06447 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:28:02.172464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-054f8b50-b9e8-4f11-a013-f2d1cac06447 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:28:02.173509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-054f8b50-b9e8-4f11-a013-f2d1cac06447 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:28:02.174103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-054f8b50-b9e8-4f11-a013-f2d1cac06447 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:28:02.332742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-054f8b50-b9e8-4f11-a013-f2d1cac06447 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:28:02.341130 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-054f8b50-b9e8-4f11-a013-f2d1cac06447 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1266 microversion: 2.1 time: 0.183568 Jul 28 04:28:02.341724 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4253/6703] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:28:02 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:28:03.100305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c9fab652-1ba6-4a8d-b903-5b855dc9e602 req-f43ceea6-4474-4af1-a6e6-f5a4ef0f6507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3af05f2-75bb-481b-b53c-31bdc8cbd5ad", "name": "network-vif-plugged", "status": "completed", "tag": "6589885d-0e29-4d08-8bb1-08077dd3f79c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:28:03.110470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c9fab652-1ba6-4a8d-b903-5b855dc9e602 req-f43ceea6-4474-4af1-a6e6-f5a4ef0f6507 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:28:03.110956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c9fab652-1ba6-4a8d-b903-5b855dc9e602 req-f43ceea6-4474-4af1-a6e6-f5a4ef0f6507 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:28:03.123378 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c9fab652-1ba6-4a8d-b903-5b855dc9e602 req-f43ceea6-4474-4af1-a6e6-f5a4ef0f6507 service nova] Creating event network-vif-plugged:6589885d-0e29-4d08-8bb1-08077dd3f79c for instance c3af05f2-75bb-481b-b53c-31bdc8cbd5ad on n-h2-826756-3 Jul 28 04:28:03.129028 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c9fab652-1ba6-4a8d-b903-5b855dc9e602 req-f43ceea6-4474-4af1-a6e6-f5a4ef0f6507 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033121 Jul 28 04:28:03.129652 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4254/6704] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:28:03.367542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-493c639a-53f9-4750-8db6-160ab03d289d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:28:03.368361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-493c639a-53f9-4750-8db6-160ab03d289d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:28:03.377180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-493c639a-53f9-4750-8db6-160ab03d289d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:28:03.377636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-493c639a-53f9-4750-8db6-160ab03d289d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:28:03.378422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-493c639a-53f9-4750-8db6-160ab03d289d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:28:03.378866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-493c639a-53f9-4750-8db6-160ab03d289d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:28:03.520796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-493c639a-53f9-4750-8db6-160ab03d289d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:28:03.529077 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-493c639a-53f9-4750-8db6-160ab03d289d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1266 microversion: 2.1 time: 0.169329 Jul 28 04:28:03.529851 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4255/6705] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:28:03 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:28:04.551561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a72cd001-d251-4383-87c6-b3fe665fe65d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:28:04.553203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a72cd001-d251-4383-87c6-b3fe665fe65d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:28:04.560399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a72cd001-d251-4383-87c6-b3fe665fe65d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:28:04.561131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a72cd001-d251-4383-87c6-b3fe665fe65d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:28:04.561937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a72cd001-d251-4383-87c6-b3fe665fe65d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:28:04.562923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a72cd001-d251-4383-87c6-b3fe665fe65d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:28:04.711151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a72cd001-d251-4383-87c6-b3fe665fe65d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:28:04.719549 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a72cd001-d251-4383-87c6-b3fe665fe65d tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1452 microversion: 2.1 time: 0.172527 Jul 28 04:28:04.720158 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4256/6706] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:28:04 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:28:04.740256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b48da15c-2f81-4d58-82d8-901b0b39a38c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:28:04.740915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b48da15c-2f81-4d58-82d8-901b0b39a38c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:28:04.747012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b48da15c-2f81-4d58-82d8-901b0b39a38c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:28:04.747485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b48da15c-2f81-4d58-82d8-901b0b39a38c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:28:04.748267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b48da15c-2f81-4d58-82d8-901b0b39a38c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:28:04.748747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b48da15c-2f81-4d58-82d8-901b0b39a38c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:28:04.885454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b48da15c-2f81-4d58-82d8-901b0b39a38c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:28:04.893525 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b48da15c-2f81-4d58-82d8-901b0b39a38c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1452 microversion: 2.1 time: 0.157014 Jul 28 04:28:04.894113 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4257/6707] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:28:04 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:28:06.912784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c07c0c84-2428-4f2d-93d9-0ef4319e013c req-4372e2eb-9fc0-4377-8107-a21ad7481368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3af05f2-75bb-481b-b53c-31bdc8cbd5ad", "tag": "6589885d-0e29-4d08-8bb1-08077dd3f79c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:28:06.923505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c07c0c84-2428-4f2d-93d9-0ef4319e013c req-4372e2eb-9fc0-4377-8107-a21ad7481368 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:28:06.924087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c07c0c84-2428-4f2d-93d9-0ef4319e013c req-4372e2eb-9fc0-4377-8107-a21ad7481368 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:28:06.935699 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c07c0c84-2428-4f2d-93d9-0ef4319e013c req-4372e2eb-9fc0-4377-8107-a21ad7481368 service nova] Creating event network-changed:6589885d-0e29-4d08-8bb1-08077dd3f79c for instance c3af05f2-75bb-481b-b53c-31bdc8cbd5ad on n-h2-826756-3 Jul 28 04:28:06.940757 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c07c0c84-2428-4f2d-93d9-0ef4319e013c req-4372e2eb-9fc0-4377-8107-a21ad7481368 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031825 Jul 28 04:28:06.941369 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4258/6708] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:28:25.787067 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:28:25.788036 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:28:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:29:53.972621 n-d-826756-3 devstack@n-api.service[126071]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58ec63bc-5462-40de-8ca8-e5ce0d7dbc1c] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 28 04:29:53.973670 n-d-826756-3 devstack@n-api.service[126071]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3383c6d1-bf1b-4640-b860-3d2b5f70fe2b] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 28 04:29:53.974326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:29:53.975113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=68 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:29:53.979978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-38014219", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1297440191", "security_groups": [{"name": "tempest-secgroup-smoke-901372724"}], "block_device_mapping_v2": [{"uuid": "889b84c5-dc48-4753-87e5-8bddca80e7dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:29:54.099710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] validate_networks() for [('601ffd4a-9ecb-4e81-b7bf-cb9f4eba3499', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:29:54.502483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:29:54.502940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:29:54.503429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:29:54.503844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:29:54.504287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:29:54.513568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:29:54.514031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:29:54.514830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:29:54.515272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:29:54.532213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:29:54.537565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Getting quotas for user 98c95cccd8d547a5bd528a3a3ca9fb4f and project f9ff9720813441d39130d608a9e15945. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:29:54.604288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:29:54.606822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='889b84c5-dc48-4753-87e5-8bddca80e7dd',volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:29:54.743528 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6793671f-dc89-4f58-9722-290a2586a0d8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.773284 Jul 28 04:29:54.748844 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4259/6709] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:29:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:29:54.758200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d92bec09-790e-4345-8473-93cb384695d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:29:54.758907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d92bec09-790e-4345-8473-93cb384695d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:29:54.816647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d92bec09-790e-4345-8473-93cb384695d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:29:54.824296 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d92bec09-790e-4345-8473-93cb384695d7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1093 microversion: 2.1 time: 0.070207 Jul 28 04:29:54.824915 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4260/6710] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:29:54 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:29:55.846354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aab6c70b-2830-4749-a494-565c5bf81457 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:29:55.847477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aab6c70b-2830-4749-a494-565c5bf81457 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:29:55.863803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aab6c70b-2830-4749-a494-565c5bf81457 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:29:55.864270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aab6c70b-2830-4749-a494-565c5bf81457 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:29:55.865083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aab6c70b-2830-4749-a494-565c5bf81457 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:29:55.865530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aab6c70b-2830-4749-a494-565c5bf81457 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:29:55.874388 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] [3383c6d1-bf1b-4640-b860-3d2b5f70fe2b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 36728. Jul 28 04:29:55.877705 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] [58ec63bc-5462-40de-8ca8-e5ce0d7dbc1c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 36726. Jul 28 04:29:55.938008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aab6c70b-2830-4749-a494-565c5bf81457 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:29:55.946168 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aab6c70b-2830-4749-a494-565c5bf81457 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1209 microversion: 2.1 time: 0.104390 Jul 28 04:29:55.946995 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4261/6711] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:29:55 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:29:56.970898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f0c073ae-2224-48af-af6c-081543b3aff0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:29:56.971549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f0c073ae-2224-48af-af6c-081543b3aff0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:29:56.989388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0c073ae-2224-48af-af6c-081543b3aff0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:29:56.990270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0c073ae-2224-48af-af6c-081543b3aff0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:29:56.990656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0c073ae-2224-48af-af6c-081543b3aff0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:29:56.991292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f0c073ae-2224-48af-af6c-081543b3aff0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:29:57.167343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f0c073ae-2224-48af-af6c-081543b3aff0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:29:57.175847 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f0c073ae-2224-48af-af6c-081543b3aff0 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1276 microversion: 2.1 time: 0.210956 Jul 28 04:29:57.177026 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4262/6712] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:29:56 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1276 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:29:57.743464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-76fb2b05-2019-461d-82ac-609161659272 req-b818230a-a8ce-4bf2-bffa-bb5c881e086b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3516a9b2-00cb-44ec-afe0-df3c9e613410", "tag": "757da917-c465-4c2a-8a1b-defd1fb605ca"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:29:57.767705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-76fb2b05-2019-461d-82ac-609161659272 req-b818230a-a8ce-4bf2-bffa-bb5c881e086b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:29:57.768459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-76fb2b05-2019-461d-82ac-609161659272 req-b818230a-a8ce-4bf2-bffa-bb5c881e086b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:29:57.784818 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-76fb2b05-2019-461d-82ac-609161659272 req-b818230a-a8ce-4bf2-bffa-bb5c881e086b service nova] Creating event network-changed:757da917-c465-4c2a-8a1b-defd1fb605ca for instance 3516a9b2-00cb-44ec-afe0-df3c9e613410 on n-h1-826756-3 Jul 28 04:29:57.797483 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-76fb2b05-2019-461d-82ac-609161659272 req-b818230a-a8ce-4bf2-bffa-bb5c881e086b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059436 Jul 28 04:29:57.800451 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4263/6713] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:29:58.198924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43f8bf80-7aab-41ff-adef-d21a130cdbb6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:29:58.199656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-43f8bf80-7aab-41ff-adef-d21a130cdbb6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:29:58.206586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43f8bf80-7aab-41ff-adef-d21a130cdbb6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:29:58.207029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43f8bf80-7aab-41ff-adef-d21a130cdbb6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:29:58.208060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43f8bf80-7aab-41ff-adef-d21a130cdbb6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:29:58.208545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43f8bf80-7aab-41ff-adef-d21a130cdbb6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:29:58.365973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-43f8bf80-7aab-41ff-adef-d21a130cdbb6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:29:58.374935 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43f8bf80-7aab-41ff-adef-d21a130cdbb6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1276 microversion: 2.1 time: 0.181211 Jul 28 04:29:58.375679 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4264/6714] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:29:58 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:29:59.397066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-383620e9-1405-4410-b2d5-19e50636e95c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:29:59.397711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-383620e9-1405-4410-b2d5-19e50636e95c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:29:59.405455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-383620e9-1405-4410-b2d5-19e50636e95c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:29:59.405951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-383620e9-1405-4410-b2d5-19e50636e95c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:29:59.406903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-383620e9-1405-4410-b2d5-19e50636e95c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:29:59.407350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-383620e9-1405-4410-b2d5-19e50636e95c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:29:59.544158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-383620e9-1405-4410-b2d5-19e50636e95c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:29:59.552416 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-383620e9-1405-4410-b2d5-19e50636e95c tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1276 microversion: 2.1 time: 0.159698 Jul 28 04:29:59.553310 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4265/6715] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:29:59 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:30:00.575111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-310f53fd-9f60-414a-99a1-b6b067baac76 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:30:00.575853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-310f53fd-9f60-414a-99a1-b6b067baac76 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:30:00.583929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-310f53fd-9f60-414a-99a1-b6b067baac76 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:00.584512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-310f53fd-9f60-414a-99a1-b6b067baac76 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:00.585437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-310f53fd-9f60-414a-99a1-b6b067baac76 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:00.585919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-310f53fd-9f60-414a-99a1-b6b067baac76 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:00.738557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-310f53fd-9f60-414a-99a1-b6b067baac76 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:30:00.747020 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-310f53fd-9f60-414a-99a1-b6b067baac76 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1276 microversion: 2.1 time: 0.176749 Jul 28 04:30:00.747661 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4266/6716] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:30:00 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:30:01.769821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4f433a85-0209-48ef-b6ef-bd444294ff9a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:30:01.770552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4f433a85-0209-48ef-b6ef-bd444294ff9a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:30:01.778323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f433a85-0209-48ef-b6ef-bd444294ff9a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:01.778824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f433a85-0209-48ef-b6ef-bd444294ff9a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:01.779603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f433a85-0209-48ef-b6ef-bd444294ff9a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:01.780047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f433a85-0209-48ef-b6ef-bd444294ff9a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:01.938569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4f433a85-0209-48ef-b6ef-bd444294ff9a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:30:01.948543 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4f433a85-0209-48ef-b6ef-bd444294ff9a tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1264 microversion: 2.1 time: 0.182471 Jul 28 04:30:01.960374 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4267/6717] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:30:01 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:30:02.971508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4ae3ba6e-eabb-4676-af80-1cdf30f63c90 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:30:02.972654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4ae3ba6e-eabb-4676-af80-1cdf30f63c90 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:30:02.980020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ae3ba6e-eabb-4676-af80-1cdf30f63c90 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:02.980538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ae3ba6e-eabb-4676-af80-1cdf30f63c90 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:02.981319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ae3ba6e-eabb-4676-af80-1cdf30f63c90 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:02.981850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ae3ba6e-eabb-4676-af80-1cdf30f63c90 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:03.134460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4ae3ba6e-eabb-4676-af80-1cdf30f63c90 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:30:03.144152 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4ae3ba6e-eabb-4676-af80-1cdf30f63c90 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1264 microversion: 2.1 time: 0.176677 Jul 28 04:30:03.144772 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4268/6718] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:30:02 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:30:04.169214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2a0cf0c3-fb9b-413e-b683-e68161e49c17 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:30:04.170260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2a0cf0c3-fb9b-413e-b683-e68161e49c17 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:30:04.177963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a0cf0c3-fb9b-413e-b683-e68161e49c17 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:04.178429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a0cf0c3-fb9b-413e-b683-e68161e49c17 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:04.179190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a0cf0c3-fb9b-413e-b683-e68161e49c17 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:04.179639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a0cf0c3-fb9b-413e-b683-e68161e49c17 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:04.331461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2a0cf0c3-fb9b-413e-b683-e68161e49c17 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:30:04.339497 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2a0cf0c3-fb9b-413e-b683-e68161e49c17 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1264 microversion: 2.1 time: 0.176446 Jul 28 04:30:04.340071 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4269/6719] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:30:04 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:30:05.370590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-89b2e03f-f4c7-417c-85af-2b79ae1680b6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:30:05.371582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-89b2e03f-f4c7-417c-85af-2b79ae1680b6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:30:05.374536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:30:05.375288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:30:05.382033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89b2e03f-f4c7-417c-85af-2b79ae1680b6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:05.382496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89b2e03f-f4c7-417c-85af-2b79ae1680b6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:05.383276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89b2e03f-f4c7-417c-85af-2b79ae1680b6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:05.383725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89b2e03f-f4c7-417c-85af-2b79ae1680b6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:05.528958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-89b2e03f-f4c7-417c-85af-2b79ae1680b6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:30:05.537260 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-89b2e03f-f4c7-417c-85af-2b79ae1680b6 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1264 microversion: 2.1 time: 0.173017 Jul 28 04:30:05.537810 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4270/6720] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:30:05 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:30:06.561165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4dc2786b-df4d-4ed4-8c51-30053e76df26 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:30:06.561882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4dc2786b-df4d-4ed4-8c51-30053e76df26 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:30:06.572874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4dc2786b-df4d-4ed4-8c51-30053e76df26 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:06.573552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4dc2786b-df4d-4ed4-8c51-30053e76df26 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:06.574748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4dc2786b-df4d-4ed4-8c51-30053e76df26 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:06.575404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4dc2786b-df4d-4ed4-8c51-30053e76df26 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:06.714566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4dc2786b-df4d-4ed4-8c51-30053e76df26 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:30:06.723530 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4dc2786b-df4d-4ed4-8c51-30053e76df26 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1264 microversion: 2.1 time: 0.168896 Jul 28 04:30:06.724114 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4271/6721] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:30:06 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:30:07.748279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ad4fbdf9-95ed-4263-b4d7-338cedff9750 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:30:07.749333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ad4fbdf9-95ed-4263-b4d7-338cedff9750 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:30:07.756740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad4fbdf9-95ed-4263-b4d7-338cedff9750 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:07.757187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad4fbdf9-95ed-4263-b4d7-338cedff9750 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:07.757971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad4fbdf9-95ed-4263-b4d7-338cedff9750 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:07.758423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad4fbdf9-95ed-4263-b4d7-338cedff9750 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:07.900107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ad4fbdf9-95ed-4263-b4d7-338cedff9750 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:30:07.912167 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ad4fbdf9-95ed-4263-b4d7-338cedff9750 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1264 microversion: 2.1 time: 0.170178 Jul 28 04:30:07.913041 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4272/6722] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:30:07 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:30:08.940998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f39d7605-5751-4833-a0aa-440bbf6507e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:30:08.942095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f39d7605-5751-4833-a0aa-440bbf6507e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:30:08.953291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f39d7605-5751-4833-a0aa-440bbf6507e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:08.953751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f39d7605-5751-4833-a0aa-440bbf6507e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:08.954538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f39d7605-5751-4833-a0aa-440bbf6507e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:08.954974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f39d7605-5751-4833-a0aa-440bbf6507e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:09.107686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f39d7605-5751-4833-a0aa-440bbf6507e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:30:09.119662 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f39d7605-5751-4833-a0aa-440bbf6507e7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1264 microversion: 2.1 time: 0.185261 Jul 28 04:30:09.120481 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4273/6723] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:30:08 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:30:10.145140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d9c4c550-6e90-4a52-9f83-4a7397040bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:30:10.145874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d9c4c550-6e90-4a52-9f83-4a7397040bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:30:10.154851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9c4c550-6e90-4a52-9f83-4a7397040bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:10.155431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9c4c550-6e90-4a52-9f83-4a7397040bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:10.156443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9c4c550-6e90-4a52-9f83-4a7397040bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:10.156965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9c4c550-6e90-4a52-9f83-4a7397040bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:10.300067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d9c4c550-6e90-4a52-9f83-4a7397040bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:30:10.308173 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d9c4c550-6e90-4a52-9f83-4a7397040bef tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1264 microversion: 2.1 time: 0.168075 Jul 28 04:30:10.308752 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4274/6724] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:30:10 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:30:11.379364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-68570c22-333f-4511-9cce-1556defa0f8d req-ddd60ea1-f395-4b2f-a20c-e1828df64059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3516a9b2-00cb-44ec-afe0-df3c9e613410", "name": "network-vif-plugged", "status": "completed", "tag": "757da917-c465-4c2a-8a1b-defd1fb605ca"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:30:11.389440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-68570c22-333f-4511-9cce-1556defa0f8d req-ddd60ea1-f395-4b2f-a20c-e1828df64059 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:11.389988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-68570c22-333f-4511-9cce-1556defa0f8d req-ddd60ea1-f395-4b2f-a20c-e1828df64059 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:11.401098 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-68570c22-333f-4511-9cce-1556defa0f8d req-ddd60ea1-f395-4b2f-a20c-e1828df64059 service nova] Creating event network-vif-plugged:757da917-c465-4c2a-8a1b-defd1fb605ca for instance 3516a9b2-00cb-44ec-afe0-df3c9e613410 on n-h1-826756-3 Jul 28 04:30:11.406284 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-68570c22-333f-4511-9cce-1556defa0f8d req-ddd60ea1-f395-4b2f-a20c-e1828df64059 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098667 Jul 28 04:30:11.406875 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4275/6725] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:30:11.412044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4e9425d-9fd6-43d1-ae0a-616153dd35a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:30:11.412790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d4e9425d-9fd6-43d1-ae0a-616153dd35a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:30:11.419023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4e9425d-9fd6-43d1-ae0a-616153dd35a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:11.419491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4e9425d-9fd6-43d1-ae0a-616153dd35a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:11.420278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4e9425d-9fd6-43d1-ae0a-616153dd35a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:11.420763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4e9425d-9fd6-43d1-ae0a-616153dd35a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:11.557376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d4e9425d-9fd6-43d1-ae0a-616153dd35a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:30:11.565686 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d4e9425d-9fd6-43d1-ae0a-616153dd35a4 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1264 microversion: 2.1 time: 0.157623 Jul 28 04:30:11.566281 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4276/6726] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:30:11 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:30:12.587180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-16ddbf26-d110-46fe-85cd-6927fd0b618b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:30:12.587939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-16ddbf26-d110-46fe-85cd-6927fd0b618b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:30:12.595224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16ddbf26-d110-46fe-85cd-6927fd0b618b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:12.595713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16ddbf26-d110-46fe-85cd-6927fd0b618b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:12.596516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16ddbf26-d110-46fe-85cd-6927fd0b618b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:12.597322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16ddbf26-d110-46fe-85cd-6927fd0b618b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:12.743815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-16ddbf26-d110-46fe-85cd-6927fd0b618b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:30:12.752500 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-16ddbf26-d110-46fe-85cd-6927fd0b618b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1264 microversion: 2.1 time: 0.169314 Jul 28 04:30:12.753077 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4277/6727] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:30:12 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:30:13.774751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4c4bd114-e37e-4221-8ce3-2a81758c8bcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:30:13.775488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4c4bd114-e37e-4221-8ce3-2a81758c8bcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:30:13.783209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c4bd114-e37e-4221-8ce3-2a81758c8bcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:13.783685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c4bd114-e37e-4221-8ce3-2a81758c8bcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:13.784531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c4bd114-e37e-4221-8ce3-2a81758c8bcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:13.784985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c4bd114-e37e-4221-8ce3-2a81758c8bcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:13.803788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:30:13.935515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4c4bd114-e37e-4221-8ce3-2a81758c8bcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:30:13.947613 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4c4bd114-e37e-4221-8ce3-2a81758c8bcc tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1450 microversion: 2.1 time: 0.177096 Jul 28 04:30:13.948208 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4278/6728] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:30:13 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:30:13.968457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8b6e892c-1ba8-472b-8df2-0e22a1e0ee8f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:30:13.969100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8b6e892c-1ba8-472b-8df2-0e22a1e0ee8f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:30:13.975805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b6e892c-1ba8-472b-8df2-0e22a1e0ee8f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:13.976270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b6e892c-1ba8-472b-8df2-0e22a1e0ee8f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:13.977085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b6e892c-1ba8-472b-8df2-0e22a1e0ee8f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:13.977537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8b6e892c-1ba8-472b-8df2-0e22a1e0ee8f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:14.127718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8b6e892c-1ba8-472b-8df2-0e22a1e0ee8f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:30:14.139437 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8b6e892c-1ba8-472b-8df2-0e22a1e0ee8f tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1450 microversion: 2.1 time: 0.174685 Jul 28 04:30:14.140032 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4279/6729] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:30:13 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:30:15.865239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9e0a13da-393f-4418-9df8-dd48d7a9dadd req-c912462b-6a46-4562-8d6b-2a480180fc64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3516a9b2-00cb-44ec-afe0-df3c9e613410", "tag": "757da917-c465-4c2a-8a1b-defd1fb605ca"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:30:15.876318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9e0a13da-393f-4418-9df8-dd48d7a9dadd req-c912462b-6a46-4562-8d6b-2a480180fc64 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:30:15.876805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9e0a13da-393f-4418-9df8-dd48d7a9dadd req-c912462b-6a46-4562-8d6b-2a480180fc64 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:30:15.890907 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9e0a13da-393f-4418-9df8-dd48d7a9dadd req-c912462b-6a46-4562-8d6b-2a480180fc64 service nova] Creating event network-changed:757da917-c465-4c2a-8a1b-defd1fb605ca for instance 3516a9b2-00cb-44ec-afe0-df3c9e613410 on n-h1-826756-3 Jul 28 04:30:15.896072 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9e0a13da-393f-4418-9df8-dd48d7a9dadd req-c912462b-6a46-4562-8d6b-2a480180fc64 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034750 Jul 28 04:30:15.896729 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4280/6730] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:30:17.359174 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:30:17.360151 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:30:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:30:44.030196 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:30:44.030991 n-d-826756-3 devstack@n-api.service[126071]: Thu Jul 28 04:30:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:31:45.372247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:31:45.373035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=10 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:31:45.377808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-743acc2c-cec3-4e74-9e37-997906a27998 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:31:45.378420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-743acc2c-cec3-4e74-9e37-997906a27998 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:31:45.395024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-743acc2c-cec3-4e74-9e37-997906a27998 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:45.395285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-743acc2c-cec3-4e74-9e37-997906a27998 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:45.395893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-743acc2c-cec3-4e74-9e37-997906a27998 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:45.396402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-743acc2c-cec3-4e74-9e37-997906a27998 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:45.423176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-743acc2c-cec3-4e74-9e37-997906a27998 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:31:45.519813 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-743acc2c-cec3-4e74-9e37-997906a27998 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 204 len: 0 microversion: 2.1 time: 0.150040 Jul 28 04:31:45.520449 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4281/6731] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:31:45 2022] DELETE /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:31:45.528044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-7e820159-b08c-4a67-a0c0-4214ef621456 req-bc19e85d-a251-4c3f-8ec8-b75754aca318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3516a9b2-00cb-44ec-afe0-df3c9e613410", "tag": "757da917-c465-4c2a-8a1b-defd1fb605ca"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:31:45.538900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7e820159-b08c-4a67-a0c0-4214ef621456 req-bc19e85d-a251-4c3f-8ec8-b75754aca318 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:45.539375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7e820159-b08c-4a67-a0c0-4214ef621456 req-bc19e85d-a251-4c3f-8ec8-b75754aca318 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:45.551927 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-7e820159-b08c-4a67-a0c0-4214ef621456 req-bc19e85d-a251-4c3f-8ec8-b75754aca318 service nova] Creating event network-changed:757da917-c465-4c2a-8a1b-defd1fb605ca for instance 3516a9b2-00cb-44ec-afe0-df3c9e613410 on n-h1-826756-3 Jul 28 04:31:45.558980 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-7e820159-b08c-4a67-a0c0-4214ef621456 req-bc19e85d-a251-4c3f-8ec8-b75754aca318 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037043 Jul 28 04:31:45.559896 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4282/6732] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:31:45.566605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d1d6730-17dc-4f37-a5f5-fc0e74d71d79 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:31:45.567625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6d1d6730-17dc-4f37-a5f5-fc0e74d71d79 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:31:45.574977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d1d6730-17dc-4f37-a5f5-fc0e74d71d79 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:45.575307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d1d6730-17dc-4f37-a5f5-fc0e74d71d79 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:45.576086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d1d6730-17dc-4f37-a5f5-fc0e74d71d79 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:45.576583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d1d6730-17dc-4f37-a5f5-fc0e74d71d79 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:45.790415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6d1d6730-17dc-4f37-a5f5-fc0e74d71d79 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:31:45.796673 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:31:45.797236 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:31:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:31:45.799655 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d1d6730-17dc-4f37-a5f5-fc0e74d71d79 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1575 microversion: 2.1 time: 0.237616 Jul 28 04:31:45.800754 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4283/6733] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:31:45 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:31:46.820945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d1dd975-b788-4e7c-ad3c-1750bce00e50 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:31:46.821614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d1dd975-b788-4e7c-ad3c-1750bce00e50 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:31:46.829175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d1dd975-b788-4e7c-ad3c-1750bce00e50 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:46.829640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d1dd975-b788-4e7c-ad3c-1750bce00e50 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:46.830565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d1dd975-b788-4e7c-ad3c-1750bce00e50 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:46.831012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d1dd975-b788-4e7c-ad3c-1750bce00e50 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:46.981670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9d1dd975-b788-4e7c-ad3c-1750bce00e50 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:31:46.991261 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d1dd975-b788-4e7c-ad3c-1750bce00e50 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1456 microversion: 2.1 time: 0.174266 Jul 28 04:31:46.992098 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4284/6734] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:31:46 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1456 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:31:47.668698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-074ebbe8-1fd9-4fc6-96ff-ae0406714434 req-1233cfd0-a850-4800-940e-431f5cfa630c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3516a9b2-00cb-44ec-afe0-df3c9e613410", "name": "network-vif-deleted", "tag": "757da917-c465-4c2a-8a1b-defd1fb605ca"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:31:47.679333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-074ebbe8-1fd9-4fc6-96ff-ae0406714434 req-1233cfd0-a850-4800-940e-431f5cfa630c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:47.680031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-074ebbe8-1fd9-4fc6-96ff-ae0406714434 req-1233cfd0-a850-4800-940e-431f5cfa630c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:47.692232 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-074ebbe8-1fd9-4fc6-96ff-ae0406714434 req-1233cfd0-a850-4800-940e-431f5cfa630c service nova] Creating event network-vif-deleted:757da917-c465-4c2a-8a1b-defd1fb605ca for instance 3516a9b2-00cb-44ec-afe0-df3c9e613410 on n-h1-826756-3 Jul 28 04:31:47.697874 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-074ebbe8-1fd9-4fc6-96ff-ae0406714434 req-1233cfd0-a850-4800-940e-431f5cfa630c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034195 Jul 28 04:31:47.698481 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4285/6735] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:31:48.014234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c098fc2e-37ca-42ec-bfb0-54b379034ce8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:31:48.015145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c098fc2e-37ca-42ec-bfb0-54b379034ce8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:31:48.023236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c098fc2e-37ca-42ec-bfb0-54b379034ce8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:48.023707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c098fc2e-37ca-42ec-bfb0-54b379034ce8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:48.024538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c098fc2e-37ca-42ec-bfb0-54b379034ce8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:48.024999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c098fc2e-37ca-42ec-bfb0-54b379034ce8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:48.110822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c098fc2e-37ca-42ec-bfb0-54b379034ce8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:31:48.119036 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c098fc2e-37ca-42ec-bfb0-54b379034ce8 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1224 microversion: 2.1 time: 0.110077 Jul 28 04:31:48.119629 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4286/6736] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:31:48 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1224 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:31:49.140628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4f144de-0a8e-4982-8b1a-a1fc95d87259 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:31:49.141347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d4f144de-0a8e-4982-8b1a-a1fc95d87259 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:31:49.148811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4f144de-0a8e-4982-8b1a-a1fc95d87259 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:49.149283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4f144de-0a8e-4982-8b1a-a1fc95d87259 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:49.150077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4f144de-0a8e-4982-8b1a-a1fc95d87259 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:49.150524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4f144de-0a8e-4982-8b1a-a1fc95d87259 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:49.216850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d4f144de-0a8e-4982-8b1a-a1fc95d87259 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:31:49.225458 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d4f144de-0a8e-4982-8b1a-a1fc95d87259 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1224 microversion: 2.1 time: 0.088950 Jul 28 04:31:49.226019 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4287/6737] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:31:49 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:31:50.246983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4f6698d-3b16-4b99-a3a5-0c0a2c385a94 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:31:50.247673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4f6698d-3b16-4b99-a3a5-0c0a2c385a94 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:31:50.255134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4f6698d-3b16-4b99-a3a5-0c0a2c385a94 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:50.255601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4f6698d-3b16-4b99-a3a5-0c0a2c385a94 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:50.256380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4f6698d-3b16-4b99-a3a5-0c0a2c385a94 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:50.256862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4f6698d-3b16-4b99-a3a5-0c0a2c385a94 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:50.323116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a4f6698d-3b16-4b99-a3a5-0c0a2c385a94 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:31:50.333297 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4f6698d-3b16-4b99-a3a5-0c0a2c385a94 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1224 microversion: 2.1 time: 0.090323 Jul 28 04:31:50.334748 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4288/6738] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:31:50 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:31:51.358859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51ad72f9-3415-400c-b578-fd1cf53aac46 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:31:51.359575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-51ad72f9-3415-400c-b578-fd1cf53aac46 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:31:51.367226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51ad72f9-3415-400c-b578-fd1cf53aac46 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:51.367690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51ad72f9-3415-400c-b578-fd1cf53aac46 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:51.368506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51ad72f9-3415-400c-b578-fd1cf53aac46 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:51.368949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51ad72f9-3415-400c-b578-fd1cf53aac46 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:51.436402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-51ad72f9-3415-400c-b578-fd1cf53aac46 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:31:51.445419 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51ad72f9-3415-400c-b578-fd1cf53aac46 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 200 len: 1224 microversion: 2.1 time: 0.090688 Jul 28 04:31:51.446113 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4289/6739] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:31:51 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:31:52.470318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2908cfaf-9b63-45af-a4b2-84d11a0f3c84 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:31:52.471197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2908cfaf-9b63-45af-a4b2-84d11a0f3c84 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 3516a9b2-00cb-44ec-afe0-df3c9e613410] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:31:52.482322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2908cfaf-9b63-45af-a4b2-84d11a0f3c84 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:52.482915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2908cfaf-9b63-45af-a4b2-84d11a0f3c84 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:52.484040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2908cfaf-9b63-45af-a4b2-84d11a0f3c84 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:52.484706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2908cfaf-9b63-45af-a4b2-84d11a0f3c84 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:52.501030 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-2908cfaf-9b63-45af-a4b2-84d11a0f3c84 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance 3516a9b2-00cb-44ec-afe0-df3c9e613410 could not be found. Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2908cfaf-9b63-45af-a4b2-84d11a0f3c84 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 HTTP/1.1 Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 3516a9b2-00cb-44ec-afe0-df3c9e613410 could not be found. Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '3516a9b2-00cb-44ec-afe0-df3c9e613410'} Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3516a9b2-00cb-44ec-afe0-df3c9e613410 could not be found. Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3516a9b2-00cb-44ec-afe0-df3c9e613410 could not be found. Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:31:52.502743 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:31:52.508226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:31:52.508226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:31:52.508226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:31:52.508226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:31:52.508226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:31:52.508226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3516a9b2-00cb-44ec-afe0-df3c9e613410 could not be found. Jul 28 04:31:52.508226 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:31:52.508226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2908cfaf-9b63-45af-a4b2-84d11a0f3c84 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance 3516a9b2-00cb-44ec-afe0-df3c9e613410 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:31:52.508226 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2908cfaf-9b63-45af-a4b2-84d11a0f3c84 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410" status: 404 len: 111 microversion: 2.1 time: 0.041158 Jul 28 04:31:52.508226 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4290/6740] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:31:52 2022] GET /compute/v2.1/servers/3516a9b2-00cb-44ec-afe0-df3c9e613410 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:31:59.136123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e5640a14-005a-4f5e-9bf2-d888e6a23e16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:31:59.136810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e5640a14-005a-4f5e-9bf2-d888e6a23e16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:31:59.143664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5640a14-005a-4f5e-9bf2-d888e6a23e16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:59.144230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5640a14-005a-4f5e-9bf2-d888e6a23e16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:59.145055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5640a14-005a-4f5e-9bf2-d888e6a23e16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:59.145508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5640a14-005a-4f5e-9bf2-d888e6a23e16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:59.171617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e5640a14-005a-4f5e-9bf2-d888e6a23e16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:31:59.258722 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e5640a14-005a-4f5e-9bf2-d888e6a23e16 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 204 len: 0 microversion: 2.1 time: 0.126702 Jul 28 04:31:59.259410 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4291/6741] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:31:59 2022] DELETE /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:31:59.336364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-09c4fec3-2885-4a73-9f9b-5da94e9bd86b req-5553da09-6ae1-4da7-9a42-8bac9b0a39d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3af05f2-75bb-481b-b53c-31bdc8cbd5ad", "tag": "6589885d-0e29-4d08-8bb1-08077dd3f79c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:31:59.346219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-09c4fec3-2885-4a73-9f9b-5da94e9bd86b req-5553da09-6ae1-4da7-9a42-8bac9b0a39d3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:59.346684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-09c4fec3-2885-4a73-9f9b-5da94e9bd86b req-5553da09-6ae1-4da7-9a42-8bac9b0a39d3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:59.359148 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-09c4fec3-2885-4a73-9f9b-5da94e9bd86b req-5553da09-6ae1-4da7-9a42-8bac9b0a39d3 service nova] Creating event network-changed:6589885d-0e29-4d08-8bb1-08077dd3f79c for instance c3af05f2-75bb-481b-b53c-31bdc8cbd5ad on n-h2-826756-3 Jul 28 04:31:59.364316 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-09c4fec3-2885-4a73-9f9b-5da94e9bd86b req-5553da09-6ae1-4da7-9a42-8bac9b0a39d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103014 Jul 28 04:31:59.364966 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4292/6742] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:31:59.370308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3c49d826-5240-4f12-97c8-087ddd1daf78 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:31:59.371634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3c49d826-5240-4f12-97c8-087ddd1daf78 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:31:59.377942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c49d826-5240-4f12-97c8-087ddd1daf78 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:59.378407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c49d826-5240-4f12-97c8-087ddd1daf78 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:59.379213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c49d826-5240-4f12-97c8-087ddd1daf78 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:31:59.379650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c49d826-5240-4f12-97c8-087ddd1daf78 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:31:59.527837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3c49d826-5240-4f12-97c8-087ddd1daf78 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:31:59.536226 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3c49d826-5240-4f12-97c8-087ddd1daf78 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1576 microversion: 2.1 time: 0.170033 Jul 28 04:31:59.548580 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4293/6743] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:31:59 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:00.559013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-feb6f902-66d8-447c-b7ec-f7a9921be36b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:00.559760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-feb6f902-66d8-447c-b7ec-f7a9921be36b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:00.568555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb6f902-66d8-447c-b7ec-f7a9921be36b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:00.569023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb6f902-66d8-447c-b7ec-f7a9921be36b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:00.569831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb6f902-66d8-447c-b7ec-f7a9921be36b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:00.570285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-feb6f902-66d8-447c-b7ec-f7a9921be36b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:00.717778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-feb6f902-66d8-447c-b7ec-f7a9921be36b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:00.726793 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-feb6f902-66d8-447c-b7ec-f7a9921be36b tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1576 microversion: 2.1 time: 0.171676 Jul 28 04:32:00.727416 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4294/6744] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:00 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:32:01.748994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05673bf7-70b3-4117-82aa-3500235f5418 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:01.749683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-05673bf7-70b3-4117-82aa-3500235f5418 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:01.757380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05673bf7-70b3-4117-82aa-3500235f5418 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:01.757855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05673bf7-70b3-4117-82aa-3500235f5418 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:01.758658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05673bf7-70b3-4117-82aa-3500235f5418 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:01.759108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05673bf7-70b3-4117-82aa-3500235f5418 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:01.905741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-05673bf7-70b3-4117-82aa-3500235f5418 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:01.914274 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-05673bf7-70b3-4117-82aa-3500235f5418 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1576 microversion: 2.1 time: 0.169476 Jul 28 04:32:01.914977 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4295/6745] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:01 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:02.177445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-720b9cd7-83a1-43f8-8707-8519ebb688a9 req-2d149943-6c3e-4d09-b3d3-ac66a4ae074a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3af05f2-75bb-481b-b53c-31bdc8cbd5ad", "name": "network-vif-deleted", "tag": "6589885d-0e29-4d08-8bb1-08077dd3f79c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:32:02.189514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-720b9cd7-83a1-43f8-8707-8519ebb688a9 req-2d149943-6c3e-4d09-b3d3-ac66a4ae074a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:02.190027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-720b9cd7-83a1-43f8-8707-8519ebb688a9 req-2d149943-6c3e-4d09-b3d3-ac66a4ae074a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:02.203586 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-720b9cd7-83a1-43f8-8707-8519ebb688a9 req-2d149943-6c3e-4d09-b3d3-ac66a4ae074a service nova] Creating event network-vif-deleted:6589885d-0e29-4d08-8bb1-08077dd3f79c for instance c3af05f2-75bb-481b-b53c-31bdc8cbd5ad on n-h2-826756-3 Jul 28 04:32:02.210136 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-720b9cd7-83a1-43f8-8707-8519ebb688a9 req-2d149943-6c3e-4d09-b3d3-ac66a4ae074a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036616 Jul 28 04:32:02.211346 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4296/6746] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:32:02.939859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d8486eb0-b7d6-482b-9d11-19dbc71700be tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:02.940642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d8486eb0-b7d6-482b-9d11-19dbc71700be tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:02.948444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8486eb0-b7d6-482b-9d11-19dbc71700be tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:02.948908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8486eb0-b7d6-482b-9d11-19dbc71700be tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:02.949710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8486eb0-b7d6-482b-9d11-19dbc71700be tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:02.950156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8486eb0-b7d6-482b-9d11-19dbc71700be tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:02.969830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:32:03.017230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d8486eb0-b7d6-482b-9d11-19dbc71700be tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:03.026232 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d8486eb0-b7d6-482b-9d11-19dbc71700be tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1226 microversion: 2.1 time: 0.090841 Jul 28 04:32:03.026837 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4297/6747] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:02 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:32:04.048277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-636a317e-2241-4476-9e95-b6fb2c8ab270 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:04.049024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-636a317e-2241-4476-9e95-b6fb2c8ab270 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:04.057614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-636a317e-2241-4476-9e95-b6fb2c8ab270 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:04.058091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-636a317e-2241-4476-9e95-b6fb2c8ab270 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:04.058907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-636a317e-2241-4476-9e95-b6fb2c8ab270 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:04.059364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-636a317e-2241-4476-9e95-b6fb2c8ab270 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:04.135932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-636a317e-2241-4476-9e95-b6fb2c8ab270 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:04.145652 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-636a317e-2241-4476-9e95-b6fb2c8ab270 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1226 microversion: 2.1 time: 0.101293 Jul 28 04:32:04.146497 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4298/6748] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:04 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:05.167590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-225a2610-7dd6-463a-ace9-6eb5f232a527 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:05.168265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-225a2610-7dd6-463a-ace9-6eb5f232a527 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:05.175595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-225a2610-7dd6-463a-ace9-6eb5f232a527 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:05.176067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-225a2610-7dd6-463a-ace9-6eb5f232a527 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:05.176888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-225a2610-7dd6-463a-ace9-6eb5f232a527 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:05.177348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-225a2610-7dd6-463a-ace9-6eb5f232a527 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:05.240720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-225a2610-7dd6-463a-ace9-6eb5f232a527 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:05.249229 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-225a2610-7dd6-463a-ace9-6eb5f232a527 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1226 microversion: 2.1 time: 0.086222 Jul 28 04:32:05.250009 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4299/6749] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:05 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:06.271075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a01bcf9-bc79-42d3-8bc1-7bab460fcef7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:06.272739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1a01bcf9-bc79-42d3-8bc1-7bab460fcef7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:06.279658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a01bcf9-bc79-42d3-8bc1-7bab460fcef7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:06.280123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a01bcf9-bc79-42d3-8bc1-7bab460fcef7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:06.280981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a01bcf9-bc79-42d3-8bc1-7bab460fcef7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:06.281452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a01bcf9-bc79-42d3-8bc1-7bab460fcef7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:06.359176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1a01bcf9-bc79-42d3-8bc1-7bab460fcef7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98c95cccd8d547a5bd528a3a3ca9fb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ff9720813441d39130d608a9e15945', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:06.367898 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1a01bcf9-bc79-42d3-8bc1-7bab460fcef7 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 200 len: 1226 microversion: 2.1 time: 0.101212 Jul 28 04:32:06.368569 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4300/6750] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:06 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:07.394224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f84cd4f-2802-49bb-9d36-61a0c180adee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:07.395422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8f84cd4f-2802-49bb-9d36-61a0c180adee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: c3af05f2-75bb-481b-b53c-31bdc8cbd5ad] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:07.403367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f84cd4f-2802-49bb-9d36-61a0c180adee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:07.403832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f84cd4f-2802-49bb-9d36-61a0c180adee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:07.404654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f84cd4f-2802-49bb-9d36-61a0c180adee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:07.405105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f84cd4f-2802-49bb-9d36-61a0c180adee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:07.419487 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-8f84cd4f-2802-49bb-9d36-61a0c180adee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance c3af05f2-75bb-481b-b53c-31bdc8cbd5ad could not be found. Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f84cd4f-2802-49bb-9d36-61a0c180adee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad HTTP/1.1 Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c3af05f2-75bb-481b-b53c-31bdc8cbd5ad could not be found. Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c3af05f2-75bb-481b-b53c-31bdc8cbd5ad'} Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3af05f2-75bb-481b-b53c-31bdc8cbd5ad could not be found. Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3af05f2-75bb-481b-b53c-31bdc8cbd5ad could not be found. Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:32:07.421244 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.426194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:07.426194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:32:07.426194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:32:07.426194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:32:07.426194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:32:07.426194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3af05f2-75bb-481b-b53c-31bdc8cbd5ad could not be found. Jul 28 04:32:07.426194 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.426194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f84cd4f-2802-49bb-9d36-61a0c180adee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance c3af05f2-75bb-481b-b53c-31bdc8cbd5ad could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:32:07.426194 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8f84cd4f-2802-49bb-9d36-61a0c180adee tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad" status: 404 len: 111 microversion: 2.1 time: 0.035135 Jul 28 04:32:07.426194 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4301/6751] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:07 2022] GET /compute/v2.1/servers/c3af05f2-75bb-481b-b53c-31bdc8cbd5ad => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:32:07.897706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19ecd658-bd9a-4270-85e2-4de14d9afeca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:07.898353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-19ecd658-bd9a-4270-85e2-4de14d9afeca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:07.907476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19ecd658-bd9a-4270-85e2-4de14d9afeca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:07.908096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19ecd658-bd9a-4270-85e2-4de14d9afeca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:07.909229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19ecd658-bd9a-4270-85e2-4de14d9afeca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:07.909824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19ecd658-bd9a-4270-85e2-4de14d9afeca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:07.925016 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-19ecd658-bd9a-4270-85e2-4de14d9afeca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19ecd658-bd9a-4270-85e2-4de14d9afeca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 HTTP/1.1 Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1f387ef4-d769-4480-b217-9fc61da70746'} Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:32:07.926604 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:32:07.932045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:32:07.932045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.932045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:32:07.932045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.932045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:07.932045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:32:07.932045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:32:07.932045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:32:07.932045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:32:07.932045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:32:07.932045 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.932045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19ecd658-bd9a-4270-85e2-4de14d9afeca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:32:07.932045 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-19ecd658-bd9a-4270-85e2-4de14d9afeca tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 404 len: 111 microversion: 2.1 time: 0.036537 Jul 28 04:32:07.932045 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4302/6752] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:32:07 2022] DELETE /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:32:07.938913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2b86f142-e1fc-4b9e-a4d5-a0b10fb65bfb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:07.939575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2b86f142-e1fc-4b9e-a4d5-a0b10fb65bfb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] [instance: 1f387ef4-d769-4480-b217-9fc61da70746] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:07.946134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b86f142-e1fc-4b9e-a4d5-a0b10fb65bfb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:07.946606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b86f142-e1fc-4b9e-a4d5-a0b10fb65bfb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:07.947390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b86f142-e1fc-4b9e-a4d5-a0b10fb65bfb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:07.947849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b86f142-e1fc-4b9e-a4d5-a0b10fb65bfb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:07.961932 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-2b86f142-e1fc-4b9e-a4d5-a0b10fb65bfb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] HTTP exception thrown: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2b86f142-e1fc-4b9e-a4d5-a0b10fb65bfb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Request method failure captured: Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 HTTP/1.1 Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4g6mg4VM9_tEnaH4ZUmTKzJKo_M0-oWOGiHvazzKBebRaMcPI35B20z82pL_YqfnTVmn1qP610l42uTF1sYuaaDxIus8dDIals_SBlUUNgSltjXcPBkuZc7aDKH3BKeHYVmuOt4vMUufI5E4SSdQasGN3B12NKjn1QwjtaSQu2xg-f8 Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f9ff9720813441d39130d608a9e15945"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f9ff9720813441d39130d608a9e15945"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f9ff9720813441d39130d608a9e15945"}]}] Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestVolumeBootPattern-833452273 Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: f9ff9720813441d39130d608a9e15945 Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestVolumeBootPattern-833452273 Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 98c95cccd8d547a5bd528a3a3ca9fb4f Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestVolumeBootPattern-833452273-project Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1f387ef4-d769-4480-b217-9fc61da70746'} Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:32:07.963496 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.968804 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:07.968804 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:32:07.968804 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:32:07.968804 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:32:07.968804 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:32:07.968804 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. Jul 28 04:32:07.968804 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:07.968804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2b86f142-e1fc-4b9e-a4d5-a0b10fb65bfb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Returning 404 to user: Instance 1f387ef4-d769-4480-b217-9fc61da70746 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:32:07.968804 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2b86f142-e1fc-4b9e-a4d5-a0b10fb65bfb tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746" status: 404 len: 111 microversion: 2.1 time: 0.029864 Jul 28 04:32:07.968804 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4303/6753] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:07 2022] GET /compute/v2.1/servers/1f387ef4-d769-4480-b217-9fc61da70746 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:32:11.405855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d0d562e2-4852-48b2-a065-9e50c1a63225 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] Calling method '.version_select at 0x7ffa7453b3a0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:11.437453 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d0d562e2-4852-48b2-a065-9e50c1a63225 tempest-TestVolumeBootPattern-833452273 tempest-TestVolumeBootPattern-833452273-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1297440191" status: 202 len: 0 microversion: 2.1 time: 0.037265 Jul 28 04:32:11.437986 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4304/6754] 10.222.0.48 () {58 vars in 1263 bytes} [Thu Jul 28 04:32:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1297440191 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:32:30.338958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=26 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:32:30.339954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:32:30.461088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1178606455", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:32:30.527950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] validate_networks() for None {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:32:30.830080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:32:30.830532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:32:30.830991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:32:30.831409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:32:30.831838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:32:30.841808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:30.842264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:30.843066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:30.843512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:30.862253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Getting quotas for project a0a561e3bf7c474e877dfc4ac460b020. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:32:30.868250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Getting quotas for user 2ea17334154648a986dc1afcbcf6f468 and project a0a561e3bf7c474e877dfc4ac460b020. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:32:30.884061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:32:30.886988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:32:30.934070 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b9fb2516-0bab-4184-958c-39d633939da9 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596855 Jul 28 04:32:30.934749 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4305/6755] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:32:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:32:30.949380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63537a20-f348-4497-bc5d-27d4c3b86c4e tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:30.950064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63537a20-f348-4497-bc5d-27d4c3b86c4e tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:31.007479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63537a20-f348-4497-bc5d-27d4c3b86c4e tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea17334154648a986dc1afcbcf6f468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a561e3bf7c474e877dfc4ac460b020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:31.014635 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63537a20-f348-4497-bc5d-27d4c3b86c4e tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 200 len: 1222 microversion: 2.1 time: 0.069358 Jul 28 04:32:31.015210 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4306/6756] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:30 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 1222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:32.035988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f88d66e3-c9ed-49fb-862e-36b49b0b3ca3 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:32.037045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f88d66e3-c9ed-49fb-862e-36b49b0b3ca3 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:32.046943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f88d66e3-c9ed-49fb-862e-36b49b0b3ca3 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:32.047390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f88d66e3-c9ed-49fb-862e-36b49b0b3ca3 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:32.048563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f88d66e3-c9ed-49fb-862e-36b49b0b3ca3 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:32.049046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f88d66e3-c9ed-49fb-862e-36b49b0b3ca3 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:32.114932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f88d66e3-c9ed-49fb-862e-36b49b0b3ca3 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea17334154648a986dc1afcbcf6f468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a561e3bf7c474e877dfc4ac460b020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:32.123387 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f88d66e3-c9ed-49fb-862e-36b49b0b3ca3 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 200 len: 1274 microversion: 2.1 time: 0.091776 Jul 28 04:32:32.123977 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4307/6757] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:32 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:33.151944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d964d109-3747-42d5-9193-fe7ea6caee24 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:33.152699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d964d109-3747-42d5-9193-fe7ea6caee24 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:33.160382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d964d109-3747-42d5-9193-fe7ea6caee24 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:33.160840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d964d109-3747-42d5-9193-fe7ea6caee24 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:33.161632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d964d109-3747-42d5-9193-fe7ea6caee24 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:33.162078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d964d109-3747-42d5-9193-fe7ea6caee24 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:33.237599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d964d109-3747-42d5-9193-fe7ea6caee24 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea17334154648a986dc1afcbcf6f468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a561e3bf7c474e877dfc4ac460b020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:33.246156 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d964d109-3747-42d5-9193-fe7ea6caee24 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 200 len: 1280 microversion: 2.1 time: 0.098303 Jul 28 04:32:33.246735 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4308/6758] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:33 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 1280 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:34.131235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-59d2b59f-0e75-430f-9c09-461863d9d788 req-a7759168-5f64-450f-9496-f917e5a7d4df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e0bf00c-e86d-40f2-af97-a54173f1a379", "tag": "6d9e536e-9421-4b40-9e06-3ae6c2045afc"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:32:34.142690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-59d2b59f-0e75-430f-9c09-461863d9d788 req-a7759168-5f64-450f-9496-f917e5a7d4df service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:34.143128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-59d2b59f-0e75-430f-9c09-461863d9d788 req-a7759168-5f64-450f-9496-f917e5a7d4df service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:34.159813 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-59d2b59f-0e75-430f-9c09-461863d9d788 req-a7759168-5f64-450f-9496-f917e5a7d4df service nova] Creating event network-changed:6d9e536e-9421-4b40-9e06-3ae6c2045afc for instance 1e0bf00c-e86d-40f2-af97-a54173f1a379 on n-h2-826756-3 Jul 28 04:32:34.166360 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-59d2b59f-0e75-430f-9c09-461863d9d788 req-a7759168-5f64-450f-9496-f917e5a7d4df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039575 Jul 28 04:32:34.167311 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4309/6759] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:32:34.267949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9eb3bec4-5f9d-4e8a-91c6-2502aface1d0 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:34.268791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9eb3bec4-5f9d-4e8a-91c6-2502aface1d0 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:34.275710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9eb3bec4-5f9d-4e8a-91c6-2502aface1d0 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:34.276998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9eb3bec4-5f9d-4e8a-91c6-2502aface1d0 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:34.277920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9eb3bec4-5f9d-4e8a-91c6-2502aface1d0 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:34.278381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9eb3bec4-5f9d-4e8a-91c6-2502aface1d0 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:34.428912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9eb3bec4-5f9d-4e8a-91c6-2502aface1d0 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea17334154648a986dc1afcbcf6f468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a561e3bf7c474e877dfc4ac460b020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:34.436802 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9eb3bec4-5f9d-4e8a-91c6-2502aface1d0 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 200 len: 1322 microversion: 2.1 time: 0.173178 Jul 28 04:32:34.437553 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4310/6760] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:34 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:32:35.458093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed3a9a48-3a01-4440-89f6-5e5dede62dab tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:35.458767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed3a9a48-3a01-4440-89f6-5e5dede62dab tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:35.466463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed3a9a48-3a01-4440-89f6-5e5dede62dab tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:35.466924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed3a9a48-3a01-4440-89f6-5e5dede62dab tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:35.467716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed3a9a48-3a01-4440-89f6-5e5dede62dab tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:35.468343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed3a9a48-3a01-4440-89f6-5e5dede62dab tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:35.608567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed3a9a48-3a01-4440-89f6-5e5dede62dab tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea17334154648a986dc1afcbcf6f468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a561e3bf7c474e877dfc4ac460b020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:35.617268 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed3a9a48-3a01-4440-89f6-5e5dede62dab tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 200 len: 1322 microversion: 2.1 time: 0.163196 Jul 28 04:32:35.617863 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4311/6761] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:35 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:36.641472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-584b0500-3b52-4791-9339-42d68cb53736 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:36.642203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-584b0500-3b52-4791-9339-42d68cb53736 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:36.649566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-584b0500-3b52-4791-9339-42d68cb53736 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:36.650036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-584b0500-3b52-4791-9339-42d68cb53736 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:36.650928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-584b0500-3b52-4791-9339-42d68cb53736 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:36.651374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-584b0500-3b52-4791-9339-42d68cb53736 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:36.797358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-584b0500-3b52-4791-9339-42d68cb53736 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea17334154648a986dc1afcbcf6f468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a561e3bf7c474e877dfc4ac460b020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:36.805761 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-584b0500-3b52-4791-9339-42d68cb53736 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 200 len: 1322 microversion: 2.1 time: 0.168463 Jul 28 04:32:36.806356 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4312/6762] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:36 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:37.831258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd09f4b6-7140-47b5-93ae-b43bf6440fbf tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:37.832420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd09f4b6-7140-47b5-93ae-b43bf6440fbf tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:37.841972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd09f4b6-7140-47b5-93ae-b43bf6440fbf tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:37.842433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd09f4b6-7140-47b5-93ae-b43bf6440fbf tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:37.843211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd09f4b6-7140-47b5-93ae-b43bf6440fbf tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:37.843653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd09f4b6-7140-47b5-93ae-b43bf6440fbf tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:37.990223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dd09f4b6-7140-47b5-93ae-b43bf6440fbf tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea17334154648a986dc1afcbcf6f468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a561e3bf7c474e877dfc4ac460b020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:38.003079 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd09f4b6-7140-47b5-93ae-b43bf6440fbf tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 200 len: 1322 microversion: 2.1 time: 0.178089 Jul 28 04:32:38.004005 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4313/6763] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:37 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:39.027326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3945d428-6a1f-4bbb-b2cf-274f5d48a42f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:39.028073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3945d428-6a1f-4bbb-b2cf-274f5d48a42f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:39.035751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3945d428-6a1f-4bbb-b2cf-274f5d48a42f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:39.036229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3945d428-6a1f-4bbb-b2cf-274f5d48a42f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:39.037069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3945d428-6a1f-4bbb-b2cf-274f5d48a42f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:39.037523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3945d428-6a1f-4bbb-b2cf-274f5d48a42f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:39.176633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3945d428-6a1f-4bbb-b2cf-274f5d48a42f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea17334154648a986dc1afcbcf6f468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a561e3bf7c474e877dfc4ac460b020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:39.185167 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3945d428-6a1f-4bbb-b2cf-274f5d48a42f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 200 len: 1322 microversion: 2.1 time: 0.161733 Jul 28 04:32:39.185759 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4314/6764] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:39 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:40.216883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b453aa8a-5801-4c3d-b655-95984264351a tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:40.217958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b453aa8a-5801-4c3d-b655-95984264351a tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:40.229769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b453aa8a-5801-4c3d-b655-95984264351a tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:40.230239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b453aa8a-5801-4c3d-b655-95984264351a tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:40.231038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b453aa8a-5801-4c3d-b655-95984264351a tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:40.231546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b453aa8a-5801-4c3d-b655-95984264351a tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:40.375656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b453aa8a-5801-4c3d-b655-95984264351a tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea17334154648a986dc1afcbcf6f468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a561e3bf7c474e877dfc4ac460b020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:40.384648 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b453aa8a-5801-4c3d-b655-95984264351a tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 200 len: 1322 microversion: 2.1 time: 0.174397 Jul 28 04:32:40.385431 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4315/6765] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:40 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:40.453168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d9e2c98d-1d3f-43f2-a410-1bc90c23ec3e req-e4d6c949-c80d-4b3e-8abc-e8249b4de8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0bf00c-e86d-40f2-af97-a54173f1a379", "name": "network-vif-plugged", "status": "completed", "tag": "6d9e536e-9421-4b40-9e06-3ae6c2045afc"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:32:40.463585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d9e2c98d-1d3f-43f2-a410-1bc90c23ec3e req-e4d6c949-c80d-4b3e-8abc-e8249b4de8f3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:40.464106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d9e2c98d-1d3f-43f2-a410-1bc90c23ec3e req-e4d6c949-c80d-4b3e-8abc-e8249b4de8f3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:40.477581 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-d9e2c98d-1d3f-43f2-a410-1bc90c23ec3e req-e4d6c949-c80d-4b3e-8abc-e8249b4de8f3 service nova] Creating event network-vif-plugged:6d9e536e-9421-4b40-9e06-3ae6c2045afc for instance 1e0bf00c-e86d-40f2-af97-a54173f1a379 on n-h2-826756-3 Jul 28 04:32:40.482928 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d9e2c98d-1d3f-43f2-a410-1bc90c23ec3e req-e4d6c949-c80d-4b3e-8abc-e8249b4de8f3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033582 Jul 28 04:32:40.483696 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4316/6766] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:32:41.406720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2e974241-e38e-4369-8461-09f64d2204ce tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:41.407458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2e974241-e38e-4369-8461-09f64d2204ce tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:41.409639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:32:41.410434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:32:41.419644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e974241-e38e-4369-8461-09f64d2204ce tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:41.420116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e974241-e38e-4369-8461-09f64d2204ce tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:41.420959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e974241-e38e-4369-8461-09f64d2204ce tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:41.421415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2e974241-e38e-4369-8461-09f64d2204ce tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:41.572602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2e974241-e38e-4369-8461-09f64d2204ce tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea17334154648a986dc1afcbcf6f468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a561e3bf7c474e877dfc4ac460b020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:41.580530 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2e974241-e38e-4369-8461-09f64d2204ce tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 200 len: 1322 microversion: 2.1 time: 0.178210 Jul 28 04:32:41.581128 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4317/6767] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:41 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:32:42.601349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d3f35b32-8d93-42a3-880b-14f23331a351 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:42.602068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d3f35b32-8d93-42a3-880b-14f23331a351 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:42.609597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3f35b32-8d93-42a3-880b-14f23331a351 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:42.610066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3f35b32-8d93-42a3-880b-14f23331a351 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:42.610848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3f35b32-8d93-42a3-880b-14f23331a351 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:42.611300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d3f35b32-8d93-42a3-880b-14f23331a351 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:42.746928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d3f35b32-8d93-42a3-880b-14f23331a351 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea17334154648a986dc1afcbcf6f468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a561e3bf7c474e877dfc4ac460b020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:42.755103 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d3f35b32-8d93-42a3-880b-14f23331a351 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 200 len: 1471 microversion: 2.1 time: 0.158157 Jul 28 04:32:42.756016 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4318/6768] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:42 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:42.827954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2c866f7c-3360-439e-971b-c19283d1bcd4 tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Calling method '.version_select at 0x7ffa67925a60>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:42.899243 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2c866f7c-3360-439e-971b-c19283d1bcd4 tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/60d89d9ffe8f46e5a7c7d690a0d5ff23" status: 200 len: 371 microversion: 2.1 time: 0.124859 Jul 28 04:32:42.899814 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4319/6769] 10.222.0.48 () {58 vars in 1242 bytes} [Thu Jul 28 04:32:42 2022] GET /compute/v2.1/os-quota-sets/60d89d9ffe8f46e5a7c7d690a0d5ff23 => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:32:42.911428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-082e1b3d-0214-4b52-8de1-a746bc1665a8 tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-93408691", "id": 617602462, "os-flavor-access:is_public": "True"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:32:42.914410 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:32:42.914410 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:32:42.931183 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-082e1b3d-0214-4b52-8de1-a746bc1665a8 tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.023493 Jul 28 04:32:42.931759 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4320/6770] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:32:42 2022] POST /compute/v2.1/flavors => generated 433 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:32:42.943496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "617602462"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:32:42.945761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:42.951998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:42.952486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:42.953264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:42.953714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:43.038297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '824e607f99d3409b8c7ba0efba76faae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d89d9ffe8f46e5a7c7d690a0d5ff23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:43.045315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-93408691 {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 04:32:43.052555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:43.053337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:43.053811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:43.054261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:43.074309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Getting quotas for project a0a561e3bf7c474e877dfc4ac460b020. Resources: {'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:32:43.079539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Getting quotas for user 2ea17334154648a986dc1afcbcf6f468 and project a0a561e3bf7c474e877dfc4ac460b020. Resources: {'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:32:43.091715 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.compute.api [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] ram quota exceeded for 60d89d9ffe8f46e5a7c7d690a0d5ff23, tried to resize instance. Jul 28 04:32:43.092269 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Request method failure captured: Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379/action HTTP/1.1 Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 38 Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hFeogda-NONq0HLreT-bp5LLXB4YJlaFiET05EdIHrWRoKt6eX247qyOq_CO8TqkXzxiR5dYREUcN7L5P2rYGJctg6ztfl07BWLIBQCIpReCXDD_tLdxwGa5GXkUop6sA8MCICKn-8Pi7UgkPDbH2jkL3M8xWQDcI5XEq6jKrvMews Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 60d89d9ffe8f46e5a7c7d690a0d5ff23 Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-383168609 Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/60d89d9ffe8f46e5a7c7d690a0d5ff23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60d89d9ffe8f46e5a7c7d690a0d5ff23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_60d89d9ffe8f46e5a7c7d690a0d5ff23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60d89d9ffe8f46e5a7c7d690a0d5ff23"}]}] Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersAdminNegativeTestJSON-383168609 Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 60d89d9ffe8f46e5a7c7d690a0d5ff23 Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-383168609 Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersAdminNegativeTestJSON-383168609-project-admin Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 824e607f99d3409b8c7ba0efba76faae Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersAdminNegativeTestJSON-383168609-project-admin Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: {"resize": {"flavorRef": "617602462"}} Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1e0bf00c-e86d-40f2-af97-a54173f1a379', 'body': {'resize': {'flavorRef': '617602462'}}} Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3867, in _check_quota_for_upsize Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 376, in inner Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:32:43.094401 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4236, in resize Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3885, in _check_quota_for_upsize Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-79673556-6b74-4569-b0aa-65e95253db9f tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379/action" status: 403 len: 118 microversion: 2.1 time: 0.155978 Jul 28 04:32:43.099918 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4321/6771] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:32:42 2022] POST /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379/action => generated 118 bytes in 157 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:32:43.104988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4858f84-1c64-4271-adbd-42b0dd1bc58d tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:43.105747 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:32:43.105747 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:32:43.123288 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4858f84-1c64-4271-adbd-42b0dd1bc58d tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/617602462" status: 202 len: 0 microversion: 2.1 time: 0.021580 Jul 28 04:32:43.123828 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4322/6772] 10.222.0.48 () {58 vars in 1158 bytes} [Thu Jul 28 04:32:43 2022] DELETE /compute/v2.1/flavors/617602462 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:32:43.131378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e882736b-83aa-4322-8d98-a7ab35137c8d tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:43.151356 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e882736b-83aa-4322-8d98-a7ab35137c8d tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023321 Jul 28 04:32:43.151888 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4323/6773] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 04:32:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:32:43.170599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e858f2c2-b811-4c89-8518-71054e996c82 tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Calling method '.version_select at 0x7ffa745b18b0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:43.238289 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e858f2c2-b811-4c89-8518-71054e996c82 tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] 10.222.0.48 "GET /compute/v2.1/os-quota-sets/60d89d9ffe8f46e5a7c7d690a0d5ff23" status: 200 len: 371 microversion: 2.1 time: 0.071132 Jul 28 04:32:43.238875 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4324/6774] 10.222.0.48 () {58 vars in 1242 bytes} [Thu Jul 28 04:32:43 2022] GET /compute/v2.1/os-quota-sets/60d89d9ffe8f46e5a7c7d690a0d5ff23 => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:32:43.249928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7ceb7eef-e9ed-4e43-9b48-00665e7c86b6 tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-656997950", "id": 989661427, "os-flavor-access:is_public": "True"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:32:43.252929 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:32:43.252929 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:32:43.269355 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7ceb7eef-e9ed-4e43-9b48-00665e7c86b6 tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.022918 Jul 28 04:32:43.269941 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4325/6775] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:32:43 2022] POST /compute/v2.1/flavors => generated 433 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:32:43.281222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "989661427"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:32:43.283561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:43.290475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:43.290936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:43.291717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:43.292174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:43.319953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '824e607f99d3409b8c7ba0efba76faae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60d89d9ffe8f46e5a7c7d690a0d5ff23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:43.326156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-656997950 {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 04:32:43.333032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:43.333499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:43.334333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:43.334780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:43.356366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Getting quotas for project a0a561e3bf7c474e877dfc4ac460b020. Resources: {'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:32:43.361802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Getting quotas for user 2ea17334154648a986dc1afcbcf6f468 and project a0a561e3bf7c474e877dfc4ac460b020. Resources: {'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:32:43.374637 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.compute.api [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] cores quota exceeded for 60d89d9ffe8f46e5a7c7d690a0d5ff23, tried to resize instance. Jul 28 04:32:43.375134 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Request method failure captured: Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379/action HTTP/1.1 Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 38 Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hFeogda-NONq0HLreT-bp5LLXB4YJlaFiET05EdIHrWRoKt6eX247qyOq_CO8TqkXzxiR5dYREUcN7L5P2rYGJctg6ztfl07BWLIBQCIpReCXDD_tLdxwGa5GXkUop6sA8MCICKn-8Pi7UgkPDbH2jkL3M8xWQDcI5XEq6jKrvMews Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 60d89d9ffe8f46e5a7c7d690a0d5ff23 Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-383168609 Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,admin,member Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,admin,member Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/60d89d9ffe8f46e5a7c7d690a0d5ff23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60d89d9ffe8f46e5a7c7d690a0d5ff23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_60d89d9ffe8f46e5a7c7d690a0d5ff23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60d89d9ffe8f46e5a7c7d690a0d5ff23"}]}] Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersAdminNegativeTestJSON-383168609 Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 60d89d9ffe8f46e5a7c7d690a0d5ff23 Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-383168609 Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersAdminNegativeTestJSON-383168609-project-admin Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 824e607f99d3409b8c7ba0efba76faae Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersAdminNegativeTestJSON-383168609-project-admin Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: {"resize": {"flavorRef": "989661427"}} Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1e0bf00c-e86d-40f2-af97-a54173f1a379', 'body': {'resize': {'flavorRef': '989661427'}}} Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3867, in _check_quota_for_upsize Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 376, in inner Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:32:43.377167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4236, in resize Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3885, in _check_quota_for_upsize Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aa16617d-a72a-4b52-98bc-35c2ce44625a tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] 10.222.0.48 "POST /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379/action" status: 403 len: 113 microversion: 2.1 time: 0.101015 Jul 28 04:32:43.382779 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4326/6776] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:32:43 2022] POST /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379/action => generated 113 bytes in 102 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:32:43.387330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2052e58-c1b3-4ae4-bfc5-3e4cb163a29c tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:43.388094 n-d-826756-3 devstack@n-api.service[126071]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 04:32:43.388094 n-d-826756-3 devstack@n-api.service[126071]: warnings.warn(msg) Jul 28 04:32:43.398874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:32:43.406319 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d2052e58-c1b3-4ae4-bfc5-3e4cb163a29c tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] 10.222.0.48 "DELETE /compute/v2.1/flavors/989661427" status: 202 len: 0 microversion: 2.1 time: 0.022622 Jul 28 04:32:43.406913 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4327/6777] 10.222.0.48 () {58 vars in 1158 bytes} [Thu Jul 28 04:32:43 2022] DELETE /compute/v2.1/flavors/989661427 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:32:43.415032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e9b998d1-6624-4f6e-bf88-51542d1c6d13 tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:43.438135 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e9b998d1-6624-4f6e-bf88-51542d1c6d13 tempest-ServersAdminNegativeTestJSON-383168609 tempest-ServersAdminNegativeTestJSON-383168609-project-admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026725 Jul 28 04:32:43.438742 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4328/6778] 10.222.0.48 () {58 vars in 1146 bytes} [Thu Jul 28 04:32:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:32:43.459189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5cb2b5ea-8b67-4b3b-ab2b-16f8727701be tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:43.459698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5cb2b5ea-8b67-4b3b-ab2b-16f8727701be tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:43.468545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5cb2b5ea-8b67-4b3b-ab2b-16f8727701be tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:43.468926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5cb2b5ea-8b67-4b3b-ab2b-16f8727701be tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:43.469682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5cb2b5ea-8b67-4b3b-ab2b-16f8727701be tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:43.470136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5cb2b5ea-8b67-4b3b-ab2b-16f8727701be tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:43.495465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5cb2b5ea-8b67-4b3b-ab2b-16f8727701be tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:32:43.509475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:32:43.570805 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5cb2b5ea-8b67-4b3b-ab2b-16f8727701be tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 204 len: 0 microversion: 2.1 time: 0.115123 Jul 28 04:32:43.571504 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4329/6779] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:32:43 2022] DELETE /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:32:43.580587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7519189c-a804-45bf-8123-dcc774f8b1fb tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:43.581290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7519189c-a804-45bf-8123-dcc774f8b1fb tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:43.588124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7519189c-a804-45bf-8123-dcc774f8b1fb tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:43.588677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7519189c-a804-45bf-8123-dcc774f8b1fb tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:43.589450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7519189c-a804-45bf-8123-dcc774f8b1fb tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:43.589977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7519189c-a804-45bf-8123-dcc774f8b1fb tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:43.733125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7519189c-a804-45bf-8123-dcc774f8b1fb tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea17334154648a986dc1afcbcf6f468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a561e3bf7c474e877dfc4ac460b020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:43.741800 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7519189c-a804-45bf-8123-dcc774f8b1fb tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 200 len: 1477 microversion: 2.1 time: 0.165668 Jul 28 04:32:43.742397 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4330/6780] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:43 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 1477 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:32:44.764896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-265ece72-c6bb-4e8f-ae6a-c9ee2468f0ee tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:44.765612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-265ece72-c6bb-4e8f-ae6a-c9ee2468f0ee tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:44.774123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-265ece72-c6bb-4e8f-ae6a-c9ee2468f0ee tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:44.774637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-265ece72-c6bb-4e8f-ae6a-c9ee2468f0ee tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:44.775533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-265ece72-c6bb-4e8f-ae6a-c9ee2468f0ee tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:44.776073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-265ece72-c6bb-4e8f-ae6a-c9ee2468f0ee tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:44.924724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-265ece72-c6bb-4e8f-ae6a-c9ee2468f0ee tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea17334154648a986dc1afcbcf6f468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a561e3bf7c474e877dfc4ac460b020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:44.934548 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-265ece72-c6bb-4e8f-ae6a-c9ee2468f0ee tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 200 len: 1477 microversion: 2.1 time: 0.174585 Jul 28 04:32:44.935155 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4331/6781] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:44 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 1477 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:32:45.735353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3191d47e-0737-4739-a526-118a3a99a8a1 req-45188cce-0e70-4ff6-8dad-3e1eb685afcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e0bf00c-e86d-40f2-af97-a54173f1a379", "name": "network-vif-deleted", "tag": "6d9e536e-9421-4b40-9e06-3ae6c2045afc"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:32:45.746306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3191d47e-0737-4739-a526-118a3a99a8a1 req-45188cce-0e70-4ff6-8dad-3e1eb685afcc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:45.746762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3191d47e-0737-4739-a526-118a3a99a8a1 req-45188cce-0e70-4ff6-8dad-3e1eb685afcc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:45.759180 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3191d47e-0737-4739-a526-118a3a99a8a1 req-45188cce-0e70-4ff6-8dad-3e1eb685afcc service nova] Creating event network-vif-deleted:6d9e536e-9421-4b40-9e06-3ae6c2045afc for instance 1e0bf00c-e86d-40f2-af97-a54173f1a379 on n-h2-826756-3 Jul 28 04:32:45.764494 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3191d47e-0737-4739-a526-118a3a99a8a1 req-45188cce-0e70-4ff6-8dad-3e1eb685afcc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122478 Jul 28 04:32:45.765372 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4332/6782] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:32:45.958692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a1f22532-7999-42da-b057-2d67ca59e09f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:45.959288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a1f22532-7999-42da-b057-2d67ca59e09f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:45.966491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1f22532-7999-42da-b057-2d67ca59e09f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:45.968570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1f22532-7999-42da-b057-2d67ca59e09f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:45.968570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1f22532-7999-42da-b057-2d67ca59e09f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:45.968570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1f22532-7999-42da-b057-2d67ca59e09f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:46.005862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1f22532-7999-42da-b057-2d67ca59e09f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:46.006327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1f22532-7999-42da-b057-2d67ca59e09f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:46.006802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-a1f22532-7999-42da-b057-2d67ca59e09f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lazy-loading 'fault' on Instance uuid 1e0bf00c-e86d-40f2-af97-a54173f1a379 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:32:46.056194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a1f22532-7999-42da-b057-2d67ca59e09f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea17334154648a986dc1afcbcf6f468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0a561e3bf7c474e877dfc4ac460b020', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:46.065093 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a1f22532-7999-42da-b057-2d67ca59e09f tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 200 len: 1312 microversion: 2.1 time: 0.111677 Jul 28 04:32:46.065622 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4333/6783] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:45 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:47.086799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-31722ec0-7c23-4fa9-8b13-e72817242423 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:47.087497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-31722ec0-7c23-4fa9-8b13-e72817242423 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] [instance: 1e0bf00c-e86d-40f2-af97-a54173f1a379] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:47.095045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31722ec0-7c23-4fa9-8b13-e72817242423 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:47.095504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31722ec0-7c23-4fa9-8b13-e72817242423 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:47.096287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31722ec0-7c23-4fa9-8b13-e72817242423 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:47.096769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31722ec0-7c23-4fa9-8b13-e72817242423 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:47.110873 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-31722ec0-7c23-4fa9-8b13-e72817242423 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] HTTP exception thrown: Instance 1e0bf00c-e86d-40f2-af97-a54173f1a379 could not be found. Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-31722ec0-7c23-4fa9-8b13-e72817242423 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Request method failure captured: Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 HTTP/1.1 Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hFduFKFgQ50gOugp3X6ChutnyqFcsPaDti-6OCYeuVdMtfNpkdKU0lW6FyFebThmZOw6ZZFJj9hYn3sTQjKJMktbta1DeA8bXR8ugw3uXSb6Y_VN6lQh7qWU7T5Ojo-v1qauk5mpI1bTmsFpbz0UlggT3aXsuxihj3hViC_zCEoevI Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a0a561e3bf7c474e877dfc4ac460b020 Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1492770466 Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a0a561e3bf7c474e877dfc4ac460b020"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a0a561e3bf7c474e877dfc4ac460b020"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a0a561e3bf7c474e877dfc4ac460b020"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a0a561e3bf7c474e877dfc4ac460b020"}]}] Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1492770466 Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a0a561e3bf7c474e877dfc4ac460b020 Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1492770466 Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersAdminNegativeTestJSON-1492770466-project Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 2ea17334154648a986dc1afcbcf6f468 Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1492770466-project Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 1e0bf00c-e86d-40f2-af97-a54173f1a379 could not be found. Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '1e0bf00c-e86d-40f2-af97-a54173f1a379'} Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e0bf00c-e86d-40f2-af97-a54173f1a379 could not be found. Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e0bf00c-e86d-40f2-af97-a54173f1a379 could not be found. Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:47.112587 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:32:47.118378 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:47.118378 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:32:47.118378 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:32:47.118378 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:32:47.118378 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:32:47.118378 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:32:47.118378 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e0bf00c-e86d-40f2-af97-a54173f1a379 could not be found. Jul 28 04:32:47.118378 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:32:47.118378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-31722ec0-7c23-4fa9-8b13-e72817242423 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] Returning 404 to user: Instance 1e0bf00c-e86d-40f2-af97-a54173f1a379 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:32:47.118378 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-31722ec0-7c23-4fa9-8b13-e72817242423 tempest-ServersAdminNegativeTestJSON-1492770466 tempest-ServersAdminNegativeTestJSON-1492770466-project] 10.222.0.48 "GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379" status: 404 len: 111 microversion: 2.1 time: 0.031362 Jul 28 04:32:47.118378 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4334/6784] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:47 2022] GET /compute/v2.1/servers/1e0bf00c-e86d-40f2-af97-a54173f1a379 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:32:53.388643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:32:53.389926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:32:53.510120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1180332912", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "18f16e22-d2cf-4eeb-9f9d-6ffcba182d8c"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:32:53.566666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] validate_networks() for [('18f16e22-d2cf-4eeb-9f9d-6ffcba182d8c', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:32:54.020031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:32:54.020408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:32:54.020934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:32:54.021362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:32:54.021795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:32:54.031637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:54.032078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:54.032974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:54.033428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:54.051365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Getting quotas for project ff416a55fa51499381c263987bb60f80. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:32:54.057235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Getting quotas for user ac413111712e4c1ba17bce4eb57d5f36 and project ff416a55fa51499381c263987bb60f80. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:32:54.070522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:32:54.072921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:32:54.126336 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c5e75816-8f47-4d13-bf8a-71a61b728dfa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743406 Jul 28 04:32:54.127194 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4335/6785] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:32:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:32:54.138724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e1cbee6f-027b-4c01-bad9-0d68b54fba8b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:54.139346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e1cbee6f-027b-4c01-bad9-0d68b54fba8b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:54.203232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e1cbee6f-027b-4c01-bad9-0d68b54fba8b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:54.210630 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e1cbee6f-027b-4c01-bad9-0d68b54fba8b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1215 microversion: 2.1 time: 0.076187 Jul 28 04:32:54.211477 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4336/6786] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:54 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:32:55.237069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-09a2c974-3ea7-4025-91a1-386968ffe13d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:55.237788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-09a2c974-3ea7-4025-91a1-386968ffe13d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:55.245677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09a2c974-3ea7-4025-91a1-386968ffe13d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:55.246159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09a2c974-3ea7-4025-91a1-386968ffe13d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:55.247124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09a2c974-3ea7-4025-91a1-386968ffe13d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:55.247484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-09a2c974-3ea7-4025-91a1-386968ffe13d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:55.352280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-09a2c974-3ea7-4025-91a1-386968ffe13d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:55.361439 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-09a2c974-3ea7-4025-91a1-386968ffe13d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1275 microversion: 2.1 time: 0.128350 Jul 28 04:32:55.362254 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4337/6787] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:55 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1275 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:56.386535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-934c8fa6-04bb-4b11-8753-e0cf9a6b79fe tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:56.388120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-934c8fa6-04bb-4b11-8753-e0cf9a6b79fe tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:56.399305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-934c8fa6-04bb-4b11-8753-e0cf9a6b79fe tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:56.399968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-934c8fa6-04bb-4b11-8753-e0cf9a6b79fe tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:56.400968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-934c8fa6-04bb-4b11-8753-e0cf9a6b79fe tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:56.402231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-934c8fa6-04bb-4b11-8753-e0cf9a6b79fe tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:56.585001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-934c8fa6-04bb-4b11-8753-e0cf9a6b79fe tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:56.603203 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-934c8fa6-04bb-4b11-8753-e0cf9a6b79fe tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1315 microversion: 2.1 time: 0.221073 Jul 28 04:32:56.615678 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4338/6788] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:56 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:56.867406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e151f1dc-770f-4baf-8ac5-09c2f90e16b6 req-4dc9da30-ccbd-4ed7-bcb4-146c11f78e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f15a679c-3871-476d-ad34-79495a3b44ce", "tag": "e095fca8-0a7e-434c-b010-216a2fd7f544"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:32:56.886155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e151f1dc-770f-4baf-8ac5-09c2f90e16b6 req-4dc9da30-ccbd-4ed7-bcb4-146c11f78e96 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:56.887614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e151f1dc-770f-4baf-8ac5-09c2f90e16b6 req-4dc9da30-ccbd-4ed7-bcb4-146c11f78e96 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:56.913747 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e151f1dc-770f-4baf-8ac5-09c2f90e16b6 req-4dc9da30-ccbd-4ed7-bcb4-146c11f78e96 service nova] Creating event network-changed:e095fca8-0a7e-434c-b010-216a2fd7f544 for instance f15a679c-3871-476d-ad34-79495a3b44ce on n-h2-826756-3 Jul 28 04:32:56.927235 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e151f1dc-770f-4baf-8ac5-09c2f90e16b6 req-4dc9da30-ccbd-4ed7-bcb4-146c11f78e96 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069144 Jul 28 04:32:56.928460 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4339/6789] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:32:57.634337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-67f7a941-8a75-47f3-a423-ea83ec54f640 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:57.635799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-67f7a941-8a75-47f3-a423-ea83ec54f640 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:57.643291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67f7a941-8a75-47f3-a423-ea83ec54f640 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:57.643774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67f7a941-8a75-47f3-a423-ea83ec54f640 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:57.644583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67f7a941-8a75-47f3-a423-ea83ec54f640 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:57.645032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-67f7a941-8a75-47f3-a423-ea83ec54f640 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:57.787098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-67f7a941-8a75-47f3-a423-ea83ec54f640 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:57.795890 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-67f7a941-8a75-47f3-a423-ea83ec54f640 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1315 microversion: 2.1 time: 0.170203 Jul 28 04:32:57.796535 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4340/6790] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:57 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:32:58.817623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b7b62bd3-2adf-4132-b6ef-b7a4843c077e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:32:58.818234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b7b62bd3-2adf-4132-b6ef-b7a4843c077e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:32:58.825370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7b62bd3-2adf-4132-b6ef-b7a4843c077e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:58.825838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7b62bd3-2adf-4132-b6ef-b7a4843c077e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:58.826617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7b62bd3-2adf-4132-b6ef-b7a4843c077e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:32:58.827110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7b62bd3-2adf-4132-b6ef-b7a4843c077e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:32:58.972873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b7b62bd3-2adf-4132-b6ef-b7a4843c077e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:32:58.983686 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b7b62bd3-2adf-4132-b6ef-b7a4843c077e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1315 microversion: 2.1 time: 0.170169 Jul 28 04:32:58.984272 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4341/6791] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:32:58 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:33:00.008954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ee3951d7-f141-46e8-bd58-aeff580885e1 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:00.010034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ee3951d7-f141-46e8-bd58-aeff580885e1 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:00.018301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee3951d7-f141-46e8-bd58-aeff580885e1 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:00.018770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee3951d7-f141-46e8-bd58-aeff580885e1 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:00.019550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee3951d7-f141-46e8-bd58-aeff580885e1 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:00.020003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee3951d7-f141-46e8-bd58-aeff580885e1 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:00.156978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ee3951d7-f141-46e8-bd58-aeff580885e1 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:00.165374 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ee3951d7-f141-46e8-bd58-aeff580885e1 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1315 microversion: 2.1 time: 0.163113 Jul 28 04:33:00.165955 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4342/6792] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:00 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:01.188210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7daac4d4-31be-4353-a428-2393c56a4e56 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:01.188846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7daac4d4-31be-4353-a428-2393c56a4e56 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:01.197063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7daac4d4-31be-4353-a428-2393c56a4e56 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:01.197507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7daac4d4-31be-4353-a428-2393c56a4e56 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:01.198339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7daac4d4-31be-4353-a428-2393c56a4e56 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:01.198796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7daac4d4-31be-4353-a428-2393c56a4e56 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:01.345749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7daac4d4-31be-4353-a428-2393c56a4e56 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:01.356621 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7daac4d4-31be-4353-a428-2393c56a4e56 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1315 microversion: 2.1 time: 0.172602 Jul 28 04:33:01.357447 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4343/6793] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:01 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:02.377210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d84d2880-c670-40c3-902f-631a557dc4ff tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:02.377891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d84d2880-c670-40c3-902f-631a557dc4ff tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:02.385596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d84d2880-c670-40c3-902f-631a557dc4ff tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:02.386068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d84d2880-c670-40c3-902f-631a557dc4ff tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:02.386865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d84d2880-c670-40c3-902f-631a557dc4ff tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:02.387596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d84d2880-c670-40c3-902f-631a557dc4ff tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:02.525907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d84d2880-c670-40c3-902f-631a557dc4ff tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:02.533933 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d84d2880-c670-40c3-902f-631a557dc4ff tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1315 microversion: 2.1 time: 0.160689 Jul 28 04:33:02.534560 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4344/6794] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:02 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:02.539689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-72195351-a4d0-4910-a823-665de7529f08 req-9815c1fa-420a-44d0-87f0-4b21879c8b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f15a679c-3871-476d-ad34-79495a3b44ce", "name": "network-vif-plugged", "status": "completed", "tag": "e095fca8-0a7e-434c-b010-216a2fd7f544"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:33:02.551646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-72195351-a4d0-4910-a823-665de7529f08 req-9815c1fa-420a-44d0-87f0-4b21879c8b28 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:02.552096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-72195351-a4d0-4910-a823-665de7529f08 req-9815c1fa-420a-44d0-87f0-4b21879c8b28 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:02.564375 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-72195351-a4d0-4910-a823-665de7529f08 req-9815c1fa-420a-44d0-87f0-4b21879c8b28 service nova] Creating event network-vif-plugged:e095fca8-0a7e-434c-b010-216a2fd7f544 for instance f15a679c-3871-476d-ad34-79495a3b44ce on n-h2-826756-3 Jul 28 04:33:02.570340 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-72195351-a4d0-4910-a823-665de7529f08 req-9815c1fa-420a-44d0-87f0-4b21879c8b28 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034516 Jul 28 04:33:02.571400 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4345/6795] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:33:03.557516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a1a1f9aa-0734-45c3-811f-25e43ab39f47 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:03.558269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a1a1f9aa-0734-45c3-811f-25e43ab39f47 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:03.566447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1a1f9aa-0734-45c3-811f-25e43ab39f47 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:03.566935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1a1f9aa-0734-45c3-811f-25e43ab39f47 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:03.567899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1a1f9aa-0734-45c3-811f-25e43ab39f47 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:03.568405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1a1f9aa-0734-45c3-811f-25e43ab39f47 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:03.771806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a1a1f9aa-0734-45c3-811f-25e43ab39f47 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:03.781060 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a1a1f9aa-0734-45c3-811f-25e43ab39f47 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1315 microversion: 2.1 time: 0.227849 Jul 28 04:33:03.781666 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4346/6796] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:03 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:04.803101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dcd7acc2-d26c-4208-b65e-28d96ff909dd tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:04.803756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dcd7acc2-d26c-4208-b65e-28d96ff909dd tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:04.805771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:33:04.806531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:33:04.813378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcd7acc2-d26c-4208-b65e-28d96ff909dd tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:04.813846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcd7acc2-d26c-4208-b65e-28d96ff909dd tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:04.814633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcd7acc2-d26c-4208-b65e-28d96ff909dd tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:04.815095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcd7acc2-d26c-4208-b65e-28d96ff909dd tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:04.961912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dcd7acc2-d26c-4208-b65e-28d96ff909dd tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:04.970094 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dcd7acc2-d26c-4208-b65e-28d96ff909dd tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1502 microversion: 2.1 time: 0.171201 Jul 28 04:33:04.970652 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4347/6797] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:04 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:04.991628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ef08de8-fd9f-4b46-8f9f-47bd1405b4bf tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:33:04.993954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ef08de8-fd9f-4b46-8f9f-47bd1405b4bf tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:05.000789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ef08de8-fd9f-4b46-8f9f-47bd1405b4bf tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:05.001240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ef08de8-fd9f-4b46-8f9f-47bd1405b4bf tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:05.002033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ef08de8-fd9f-4b46-8f9f-47bd1405b4bf tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:05.002484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ef08de8-fd9f-4b46-8f9f-47bd1405b4bf tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:05.032047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ef08de8-fd9f-4b46-8f9f-47bd1405b4bf tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:05.040052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ef08de8-fd9f-4b46-8f9f-47bd1405b4bf tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Old instance type m1.heat2, new instance type m1.heat {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 04:33:05.050734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-8ef08de8-fd9f-4b46-8f9f-47bd1405b4bf tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:33:05.051193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-8ef08de8-fd9f-4b46-8f9f-47bd1405b4bf tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:33:05.053081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-8ef08de8-fd9f-4b46-8f9f-47bd1405b4bf tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:33:05.053081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-8ef08de8-fd9f-4b46-8f9f-47bd1405b4bf tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:33:05.053081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-8ef08de8-fd9f-4b46-8f9f-47bd1405b4bf tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:33:05.069254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:33:05.123377 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ef08de8-fd9f-4b46-8f9f-47bd1405b4bf tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "POST /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce/action" status: 202 len: 0 microversion: 2.1 time: 0.135546 Jul 28 04:33:05.127328 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4348/6798] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:33:04 2022] POST /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:33:05.134964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-70fee3c5-5901-4348-b130-4d0d438f0c49 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:05.136111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-70fee3c5-5901-4348-b130-4d0d438f0c49 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:05.146476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70fee3c5-5901-4348-b130-4d0d438f0c49 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:05.147286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70fee3c5-5901-4348-b130-4d0d438f0c49 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:05.148587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70fee3c5-5901-4348-b130-4d0d438f0c49 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:05.149098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-70fee3c5-5901-4348-b130-4d0d438f0c49 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:05.313015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-70fee3c5-5901-4348-b130-4d0d438f0c49 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:05.322964 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-70fee3c5-5901-4348-b130-4d0d438f0c49 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1511 microversion: 2.1 time: 0.193945 Jul 28 04:33:05.323589 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4349/6799] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:05 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:06.346084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d9731624-d610-462d-b32f-0f303b9e0bc9 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:06.346692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d9731624-d610-462d-b32f-0f303b9e0bc9 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:06.354560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9731624-d610-462d-b32f-0f303b9e0bc9 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:06.355034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9731624-d610-462d-b32f-0f303b9e0bc9 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:06.355916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9731624-d610-462d-b32f-0f303b9e0bc9 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:06.356380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9731624-d610-462d-b32f-0f303b9e0bc9 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:06.495205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d9731624-d610-462d-b32f-0f303b9e0bc9 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:06.503480 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d9731624-d610-462d-b32f-0f303b9e0bc9 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1511 microversion: 2.1 time: 0.161504 Jul 28 04:33:06.504098 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4350/6800] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:06 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:07.525011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce6d6b6c-efd1-43e5-bc19-c9d7b041cdc6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:07.525953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ce6d6b6c-efd1-43e5-bc19-c9d7b041cdc6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:07.533417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce6d6b6c-efd1-43e5-bc19-c9d7b041cdc6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:07.533886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce6d6b6c-efd1-43e5-bc19-c9d7b041cdc6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:07.534665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce6d6b6c-efd1-43e5-bc19-c9d7b041cdc6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:07.535131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce6d6b6c-efd1-43e5-bc19-c9d7b041cdc6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:07.673238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ce6d6b6c-efd1-43e5-bc19-c9d7b041cdc6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:07.681412 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce6d6b6c-efd1-43e5-bc19-c9d7b041cdc6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.160576 Jul 28 04:33:07.681990 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4351/6801] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:07 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:08.704958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb5a3288-d7a2-4737-a17b-a7541e701fb6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:08.705603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb5a3288-d7a2-4737-a17b-a7541e701fb6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:08.713216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb5a3288-d7a2-4737-a17b-a7541e701fb6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:08.713723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb5a3288-d7a2-4737-a17b-a7541e701fb6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:08.714508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb5a3288-d7a2-4737-a17b-a7541e701fb6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:08.714950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb5a3288-d7a2-4737-a17b-a7541e701fb6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:08.862364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fb5a3288-d7a2-4737-a17b-a7541e701fb6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:08.870670 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fb5a3288-d7a2-4737-a17b-a7541e701fb6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.169793 Jul 28 04:33:08.871248 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4352/6802] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:08 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:09.893461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6452147f-772b-460d-82a8-b87ce69153f6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:09.894096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6452147f-772b-460d-82a8-b87ce69153f6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:09.901399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6452147f-772b-460d-82a8-b87ce69153f6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:09.901861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6452147f-772b-460d-82a8-b87ce69153f6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:09.902669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6452147f-772b-460d-82a8-b87ce69153f6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:09.903108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6452147f-772b-460d-82a8-b87ce69153f6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:10.035514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6452147f-772b-460d-82a8-b87ce69153f6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:10.043806 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6452147f-772b-460d-82a8-b87ce69153f6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.154227 Jul 28 04:33:10.044379 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4353/6803] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:09 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:11.065751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa9233ac-db2a-4c37-a4ef-e60488aa4885 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:11.066355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fa9233ac-db2a-4c37-a4ef-e60488aa4885 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:11.073935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa9233ac-db2a-4c37-a4ef-e60488aa4885 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:11.074401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa9233ac-db2a-4c37-a4ef-e60488aa4885 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:11.075180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa9233ac-db2a-4c37-a4ef-e60488aa4885 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:11.075632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa9233ac-db2a-4c37-a4ef-e60488aa4885 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:11.207123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa9233ac-db2a-4c37-a4ef-e60488aa4885 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:11.215371 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fa9233ac-db2a-4c37-a4ef-e60488aa4885 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.153547 Jul 28 04:33:11.215945 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4354/6804] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:11 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:12.237626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6fc1496c-ddac-4cff-88f1-056782619f58 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:12.238243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6fc1496c-ddac-4cff-88f1-056782619f58 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:12.245805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fc1496c-ddac-4cff-88f1-056782619f58 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:12.246277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fc1496c-ddac-4cff-88f1-056782619f58 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:12.247064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fc1496c-ddac-4cff-88f1-056782619f58 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:12.247515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fc1496c-ddac-4cff-88f1-056782619f58 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:12.398319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6fc1496c-ddac-4cff-88f1-056782619f58 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:12.411326 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6fc1496c-ddac-4cff-88f1-056782619f58 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.177485 Jul 28 04:33:12.412384 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4355/6805] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:12 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:13.435218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-57ee0c75-b8d7-44b4-9694-771482b54ad6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:13.435828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-57ee0c75-b8d7-44b4-9694-771482b54ad6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:13.443099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57ee0c75-b8d7-44b4-9694-771482b54ad6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:13.443575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57ee0c75-b8d7-44b4-9694-771482b54ad6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:13.444391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57ee0c75-b8d7-44b4-9694-771482b54ad6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:13.444824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57ee0c75-b8d7-44b4-9694-771482b54ad6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:13.673588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-57ee0c75-b8d7-44b4-9694-771482b54ad6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:13.681624 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-57ee0c75-b8d7-44b4-9694-771482b54ad6 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.250640 Jul 28 04:33:13.682205 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4356/6806] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:13 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:14.703465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9a5cbac8-3836-4e73-973f-19313797eadc tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:14.704112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9a5cbac8-3836-4e73-973f-19313797eadc tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:14.707053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:33:14.715290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a5cbac8-3836-4e73-973f-19313797eadc tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:14.715876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a5cbac8-3836-4e73-973f-19313797eadc tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:14.716739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a5cbac8-3836-4e73-973f-19313797eadc tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:14.717348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9a5cbac8-3836-4e73-973f-19313797eadc tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:14.869503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9a5cbac8-3836-4e73-973f-19313797eadc tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:14.878428 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9a5cbac8-3836-4e73-973f-19313797eadc tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.178501 Jul 28 04:33:14.878612 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4357/6807] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:14 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:15.900847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a23f6a2-833d-45b3-b1a1-44ed9d0afece tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:15.901523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4a23f6a2-833d-45b3-b1a1-44ed9d0afece tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:15.909057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a23f6a2-833d-45b3-b1a1-44ed9d0afece tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:15.909513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a23f6a2-833d-45b3-b1a1-44ed9d0afece tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:15.910284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a23f6a2-833d-45b3-b1a1-44ed9d0afece tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:15.910730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a23f6a2-833d-45b3-b1a1-44ed9d0afece tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:16.053711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a23f6a2-833d-45b3-b1a1-44ed9d0afece tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:16.062132 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4a23f6a2-833d-45b3-b1a1-44ed9d0afece tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.165223 Jul 28 04:33:16.062916 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4358/6808] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:15 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:17.083586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b0beb044-0716-4780-9d7c-4d9b26afe22b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:17.084252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b0beb044-0716-4780-9d7c-4d9b26afe22b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:17.091754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0beb044-0716-4780-9d7c-4d9b26afe22b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:17.092223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0beb044-0716-4780-9d7c-4d9b26afe22b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:17.093027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0beb044-0716-4780-9d7c-4d9b26afe22b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:17.093592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0beb044-0716-4780-9d7c-4d9b26afe22b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:17.253105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b0beb044-0716-4780-9d7c-4d9b26afe22b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:17.266227 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b0beb044-0716-4780-9d7c-4d9b26afe22b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.186688 Jul 28 04:33:17.266799 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4359/6809] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:17 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:18.289396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8853a237-bce3-4822-b599-8672ded4490b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:18.290421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8853a237-bce3-4822-b599-8672ded4490b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:18.298234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8853a237-bce3-4822-b599-8672ded4490b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:18.298702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8853a237-bce3-4822-b599-8672ded4490b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:18.299503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8853a237-bce3-4822-b599-8672ded4490b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:18.299950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8853a237-bce3-4822-b599-8672ded4490b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:18.452312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8853a237-bce3-4822-b599-8672ded4490b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:18.460899 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8853a237-bce3-4822-b599-8672ded4490b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.175753 Jul 28 04:33:18.461500 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4360/6810] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:18 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:33:19.482437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9463251c-1255-43ed-a3f3-fe495c09c25c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:19.483047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9463251c-1255-43ed-a3f3-fe495c09c25c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:19.490574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9463251c-1255-43ed-a3f3-fe495c09c25c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:19.491033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9463251c-1255-43ed-a3f3-fe495c09c25c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:19.491817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9463251c-1255-43ed-a3f3-fe495c09c25c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:19.492257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9463251c-1255-43ed-a3f3-fe495c09c25c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:19.630297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9463251c-1255-43ed-a3f3-fe495c09c25c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:19.639762 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9463251c-1255-43ed-a3f3-fe495c09c25c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.161430 Jul 28 04:33:19.640496 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4361/6811] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:19 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:20.663123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c797ad1b-04ae-4303-a1b8-ecb653e2d91d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:20.663804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c797ad1b-04ae-4303-a1b8-ecb653e2d91d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:20.671463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c797ad1b-04ae-4303-a1b8-ecb653e2d91d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:20.671928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c797ad1b-04ae-4303-a1b8-ecb653e2d91d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:20.673727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c797ad1b-04ae-4303-a1b8-ecb653e2d91d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:20.673727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c797ad1b-04ae-4303-a1b8-ecb653e2d91d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:20.822706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c797ad1b-04ae-4303-a1b8-ecb653e2d91d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:20.833201 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c797ad1b-04ae-4303-a1b8-ecb653e2d91d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.175227 Jul 28 04:33:20.833781 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4362/6812] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:20 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:21.854799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43f65c55-f662-477c-abd6-1e8c9e70c173 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:21.855470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-43f65c55-f662-477c-abd6-1e8c9e70c173 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:21.862833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43f65c55-f662-477c-abd6-1e8c9e70c173 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:21.863319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43f65c55-f662-477c-abd6-1e8c9e70c173 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:21.864069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43f65c55-f662-477c-abd6-1e8c9e70c173 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:21.864555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43f65c55-f662-477c-abd6-1e8c9e70c173 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:21.999041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-43f65c55-f662-477c-abd6-1e8c9e70c173 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:22.007337 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43f65c55-f662-477c-abd6-1e8c9e70c173 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.156517 Jul 28 04:33:22.007931 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4363/6813] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:21 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:23.030421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f13a6e2f-3017-419d-87b2-0b5e83eb75ef tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:23.031320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f13a6e2f-3017-419d-87b2-0b5e83eb75ef tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:23.039579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f13a6e2f-3017-419d-87b2-0b5e83eb75ef tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:23.040097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f13a6e2f-3017-419d-87b2-0b5e83eb75ef tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:23.040946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f13a6e2f-3017-419d-87b2-0b5e83eb75ef tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:23.041440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f13a6e2f-3017-419d-87b2-0b5e83eb75ef tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:23.061999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:33:23.180952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f13a6e2f-3017-419d-87b2-0b5e83eb75ef tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:23.190476 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f13a6e2f-3017-419d-87b2-0b5e83eb75ef tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.165520 Jul 28 04:33:23.191099 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4364/6814] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:23 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:24.213587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15e1b254-ff61-4a0b-a360-72ee4890205e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:24.214233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15e1b254-ff61-4a0b-a360-72ee4890205e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:24.222063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e1b254-ff61-4a0b-a360-72ee4890205e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:24.222895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e1b254-ff61-4a0b-a360-72ee4890205e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:24.223680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e1b254-ff61-4a0b-a360-72ee4890205e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:24.224124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15e1b254-ff61-4a0b-a360-72ee4890205e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:24.369644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-15e1b254-ff61-4a0b-a360-72ee4890205e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:24.382051 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15e1b254-ff61-4a0b-a360-72ee4890205e tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.172153 Jul 28 04:33:24.382933 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4365/6815] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:24 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:25.409899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9809faf0-70f5-428f-ab09-ebb2ccfa7bc3 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:25.410562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9809faf0-70f5-428f-ab09-ebb2ccfa7bc3 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:25.419688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9809faf0-70f5-428f-ab09-ebb2ccfa7bc3 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:25.420154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9809faf0-70f5-428f-ab09-ebb2ccfa7bc3 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:25.421244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9809faf0-70f5-428f-ab09-ebb2ccfa7bc3 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:25.421703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9809faf0-70f5-428f-ab09-ebb2ccfa7bc3 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:25.572898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9809faf0-70f5-428f-ab09-ebb2ccfa7bc3 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:25.582721 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9809faf0-70f5-428f-ab09-ebb2ccfa7bc3 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.178711 Jul 28 04:33:25.583384 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4366/6816] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:25 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:26.608240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1b8e5953-d4ca-476a-8e19-8a46b190920c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:26.609055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1b8e5953-d4ca-476a-8e19-8a46b190920c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:26.615843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b8e5953-d4ca-476a-8e19-8a46b190920c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:26.616310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b8e5953-d4ca-476a-8e19-8a46b190920c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:26.617126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b8e5953-d4ca-476a-8e19-8a46b190920c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:26.617608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b8e5953-d4ca-476a-8e19-8a46b190920c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:26.758814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1b8e5953-d4ca-476a-8e19-8a46b190920c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:26.767467 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1b8e5953-d4ca-476a-8e19-8a46b190920c tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.163684 Jul 28 04:33:26.768174 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4367/6817] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:26 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:27.791119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fe87f0c6-da1a-4776-a8c6-2364b828cc70 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:27.793221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fe87f0c6-da1a-4776-a8c6-2364b828cc70 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:27.799345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe87f0c6-da1a-4776-a8c6-2364b828cc70 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:27.799817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe87f0c6-da1a-4776-a8c6-2364b828cc70 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:27.800710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe87f0c6-da1a-4776-a8c6-2364b828cc70 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:27.801095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe87f0c6-da1a-4776-a8c6-2364b828cc70 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:27.938669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fe87f0c6-da1a-4776-a8c6-2364b828cc70 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:27.946984 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fe87f0c6-da1a-4776-a8c6-2364b828cc70 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.161224 Jul 28 04:33:27.949396 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4368/6818] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:27 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:33:28.968801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-969e4bd5-c454-4bb5-90d4-79e75d5bb806 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:28.969562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-969e4bd5-c454-4bb5-90d4-79e75d5bb806 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:28.977874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-969e4bd5-c454-4bb5-90d4-79e75d5bb806 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:28.978345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-969e4bd5-c454-4bb5-90d4-79e75d5bb806 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:28.979182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-969e4bd5-c454-4bb5-90d4-79e75d5bb806 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:28.979637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-969e4bd5-c454-4bb5-90d4-79e75d5bb806 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:29.120024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-969e4bd5-c454-4bb5-90d4-79e75d5bb806 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:29.128012 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-969e4bd5-c454-4bb5-90d4-79e75d5bb806 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.163656 Jul 28 04:33:29.128616 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4369/6819] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:28 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:33:30.150295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ee15406-8f62-4b9f-8a34-2f40aec21e35 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:30.151010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ee15406-8f62-4b9f-8a34-2f40aec21e35 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:30.158695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ee15406-8f62-4b9f-8a34-2f40aec21e35 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:30.159135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ee15406-8f62-4b9f-8a34-2f40aec21e35 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:30.159938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ee15406-8f62-4b9f-8a34-2f40aec21e35 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:30.160403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ee15406-8f62-4b9f-8a34-2f40aec21e35 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:30.300865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ee15406-8f62-4b9f-8a34-2f40aec21e35 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:30.309509 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ee15406-8f62-4b9f-8a34-2f40aec21e35 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.163178 Jul 28 04:33:30.310043 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4370/6820] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:30 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:31.334788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9b2c9e7c-52ae-453d-b3ea-bf43c890e438 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:31.335418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9b2c9e7c-52ae-453d-b3ea-bf43c890e438 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:31.343107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b2c9e7c-52ae-453d-b3ea-bf43c890e438 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:31.343572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b2c9e7c-52ae-453d-b3ea-bf43c890e438 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:31.344388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b2c9e7c-52ae-453d-b3ea-bf43c890e438 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:31.344838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b2c9e7c-52ae-453d-b3ea-bf43c890e438 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:31.480359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9b2c9e7c-52ae-453d-b3ea-bf43c890e438 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:31.488509 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9b2c9e7c-52ae-453d-b3ea-bf43c890e438 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.160002 Jul 28 04:33:31.488971 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4371/6821] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:31 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:32.513770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3eb5d553-52fb-4ac7-9eb5-acba32f2be07 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:32.514433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3eb5d553-52fb-4ac7-9eb5-acba32f2be07 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:32.524386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3eb5d553-52fb-4ac7-9eb5-acba32f2be07 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:32.524854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3eb5d553-52fb-4ac7-9eb5-acba32f2be07 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:32.525631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3eb5d553-52fb-4ac7-9eb5-acba32f2be07 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:32.526110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3eb5d553-52fb-4ac7-9eb5-acba32f2be07 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:32.678901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3eb5d553-52fb-4ac7-9eb5-acba32f2be07 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:32.687320 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3eb5d553-52fb-4ac7-9eb5-acba32f2be07 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.180229 Jul 28 04:33:32.687915 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4372/6822] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:32 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:33.709275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a537db47-8838-445b-9213-04692bf2dd1d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:33.710012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a537db47-8838-445b-9213-04692bf2dd1d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:33.718841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a537db47-8838-445b-9213-04692bf2dd1d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:33.719305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a537db47-8838-445b-9213-04692bf2dd1d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:33.720074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a537db47-8838-445b-9213-04692bf2dd1d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:33.720555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a537db47-8838-445b-9213-04692bf2dd1d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:33.860763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a537db47-8838-445b-9213-04692bf2dd1d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:33.869082 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a537db47-8838-445b-9213-04692bf2dd1d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1516 microversion: 2.1 time: 0.164019 Jul 28 04:33:33.869660 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4373/6823] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:33 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:34.890273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e31e076d-b7ad-4264-976e-a63df00f90c2 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:34.890952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e31e076d-b7ad-4264-976e-a63df00f90c2 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:34.900052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e31e076d-b7ad-4264-976e-a63df00f90c2 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:34.900555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e31e076d-b7ad-4264-976e-a63df00f90c2 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:34.901475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e31e076d-b7ad-4264-976e-a63df00f90c2 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:34.901789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e31e076d-b7ad-4264-976e-a63df00f90c2 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:35.044613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e31e076d-b7ad-4264-976e-a63df00f90c2 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:35.056029 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e31e076d-b7ad-4264-976e-a63df00f90c2 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1515 microversion: 2.1 time: 0.169847 Jul 28 04:33:35.056672 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4374/6824] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:34 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:35.405121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-620642df-e018-4ddd-9bc7-739d6ccea953 req-e926520c-2c3b-42f9-9715-dadf30fca767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f15a679c-3871-476d-ad34-79495a3b44ce", "name": "network-vif-unplugged", "status": "completed", "tag": "e095fca8-0a7e-434c-b010-216a2fd7f544"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:33:35.416162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-620642df-e018-4ddd-9bc7-739d6ccea953 req-e926520c-2c3b-42f9-9715-dadf30fca767 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:35.416685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-620642df-e018-4ddd-9bc7-739d6ccea953 req-e926520c-2c3b-42f9-9715-dadf30fca767 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:35.429284 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-620642df-e018-4ddd-9bc7-739d6ccea953 req-e926520c-2c3b-42f9-9715-dadf30fca767 service nova] Creating event network-vif-unplugged:e095fca8-0a7e-434c-b010-216a2fd7f544 for instance f15a679c-3871-476d-ad34-79495a3b44ce on n-h1-826756-3 Jul 28 04:33:35.435172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-620642df-e018-4ddd-9bc7-739d6ccea953 req-e926520c-2c3b-42f9-9715-dadf30fca767 service nova] Instance f15a679c-3871-476d-ad34-79495a3b44ce is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:33:35.446519 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-620642df-e018-4ddd-9bc7-739d6ccea953 req-e926520c-2c3b-42f9-9715-dadf30fca767 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106515 Jul 28 04:33:35.447473 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4375/6825] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:33:36.080307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d8e7fda3-f314-4202-826a-e15b6bee0fa8 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:36.080975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d8e7fda3-f314-4202-826a-e15b6bee0fa8 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:36.088033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8e7fda3-f314-4202-826a-e15b6bee0fa8 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:36.088543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8e7fda3-f314-4202-826a-e15b6bee0fa8 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:36.089448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8e7fda3-f314-4202-826a-e15b6bee0fa8 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:36.089902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8e7fda3-f314-4202-826a-e15b6bee0fa8 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:36.232580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d8e7fda3-f314-4202-826a-e15b6bee0fa8 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:36.241470 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d8e7fda3-f314-4202-826a-e15b6bee0fa8 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1515 microversion: 2.1 time: 0.166262 Jul 28 04:33:36.242046 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4376/6826] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:36 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:37.266135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-28d8e152-d61f-4ecd-bc3f-5db1eff1f7fa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:37.266924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-28d8e152-d61f-4ecd-bc3f-5db1eff1f7fa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:37.276560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28d8e152-d61f-4ecd-bc3f-5db1eff1f7fa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:37.277025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28d8e152-d61f-4ecd-bc3f-5db1eff1f7fa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:37.277805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28d8e152-d61f-4ecd-bc3f-5db1eff1f7fa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:37.278252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28d8e152-d61f-4ecd-bc3f-5db1eff1f7fa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:37.371844 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:33:37.372382 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:33:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:33:37.420194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-28d8e152-d61f-4ecd-bc3f-5db1eff1f7fa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:37.432953 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-28d8e152-d61f-4ecd-bc3f-5db1eff1f7fa tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1513 microversion: 2.1 time: 0.171996 Jul 28 04:33:37.433773 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4377/6827] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:37 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:37.477384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-67c26c54-e8c2-4fa8-9ac8-8b3e98397ace req-88698d4c-9b93-498f-8097-e57be0263977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f15a679c-3871-476d-ad34-79495a3b44ce", "tag": "e095fca8-0a7e-434c-b010-216a2fd7f544"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:33:37.487268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-67c26c54-e8c2-4fa8-9ac8-8b3e98397ace req-88698d4c-9b93-498f-8097-e57be0263977 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:37.487724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-67c26c54-e8c2-4fa8-9ac8-8b3e98397ace req-88698d4c-9b93-498f-8097-e57be0263977 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:37.499461 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-67c26c54-e8c2-4fa8-9ac8-8b3e98397ace req-88698d4c-9b93-498f-8097-e57be0263977 service nova] Creating event network-changed:e095fca8-0a7e-434c-b010-216a2fd7f544 for instance f15a679c-3871-476d-ad34-79495a3b44ce on n-h1-826756-3 Jul 28 04:33:37.505312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-67c26c54-e8c2-4fa8-9ac8-8b3e98397ace req-88698d4c-9b93-498f-8097-e57be0263977 service nova] Instance f15a679c-3871-476d-ad34-79495a3b44ce is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:33:37.516034 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-67c26c54-e8c2-4fa8-9ac8-8b3e98397ace req-88698d4c-9b93-498f-8097-e57be0263977 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044369 Jul 28 04:33:37.516680 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4378/6828] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:33:38.462304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-03db38c3-22db-497a-a6f9-080ffd348e2b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:38.463000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-03db38c3-22db-497a-a6f9-080ffd348e2b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:38.469893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03db38c3-22db-497a-a6f9-080ffd348e2b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:38.470359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03db38c3-22db-497a-a6f9-080ffd348e2b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:38.471185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03db38c3-22db-497a-a6f9-080ffd348e2b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:38.471637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03db38c3-22db-497a-a6f9-080ffd348e2b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:38.612793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-03db38c3-22db-497a-a6f9-080ffd348e2b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:38.620824 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-03db38c3-22db-497a-a6f9-080ffd348e2b tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1510 microversion: 2.1 time: 0.165495 Jul 28 04:33:38.621442 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4379/6829] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:38 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:38.641679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-544c44f4-d180-4304-bf5b-7d8214a29702 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:38.642197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-544c44f4-d180-4304-bf5b-7d8214a29702 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:38.648665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-544c44f4-d180-4304-bf5b-7d8214a29702 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:38.649128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-544c44f4-d180-4304-bf5b-7d8214a29702 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:38.649910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-544c44f4-d180-4304-bf5b-7d8214a29702 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:38.650362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-544c44f4-d180-4304-bf5b-7d8214a29702 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:38.679255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-544c44f4-d180-4304-bf5b-7d8214a29702 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:33:38.716040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:33:38.735523 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.compute.api [None req-544c44f4-d180-4304-bf5b-7d8214a29702 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Found an unconfirmed migration during delete, id: 16, status: finished Jul 28 04:33:40.406344 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-544c44f4-d180-4304-bf5b-7d8214a29702 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 204 len: 0 microversion: 2.1 time: 1.768264 Jul 28 04:33:40.407007 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4380/6830] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:33:38 2022] DELETE /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 0 bytes in 1770 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:33:40.420332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a6bc44dd-2297-40eb-8d62-71c171f4e219 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:40.421104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a6bc44dd-2297-40eb-8d62-71c171f4e219 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:40.427766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6bc44dd-2297-40eb-8d62-71c171f4e219 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:40.428235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6bc44dd-2297-40eb-8d62-71c171f4e219 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:40.429070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6bc44dd-2297-40eb-8d62-71c171f4e219 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:40.429524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a6bc44dd-2297-40eb-8d62-71c171f4e219 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:40.569852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a6bc44dd-2297-40eb-8d62-71c171f4e219 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:40.577961 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a6bc44dd-2297-40eb-8d62-71c171f4e219 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1502 microversion: 2.1 time: 0.166039 Jul 28 04:33:40.583405 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4381/6831] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:40 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:41.603932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d9ac7db1-a833-4663-a7a7-8a5b456ab30f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:41.605031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d9ac7db1-a833-4663-a7a7-8a5b456ab30f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:41.616860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9ac7db1-a833-4663-a7a7-8a5b456ab30f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:41.617322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9ac7db1-a833-4663-a7a7-8a5b456ab30f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:41.618118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9ac7db1-a833-4663-a7a7-8a5b456ab30f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:41.618570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9ac7db1-a833-4663-a7a7-8a5b456ab30f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:41.757145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d9ac7db1-a833-4663-a7a7-8a5b456ab30f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac413111712e4c1ba17bce4eb57d5f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff416a55fa51499381c263987bb60f80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:41.765852 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d9ac7db1-a833-4663-a7a7-8a5b456ab30f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 200 len: 1502 microversion: 2.1 time: 0.169048 Jul 28 04:33:41.766443 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4382/6832] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:41 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:42.188282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-cb5479ee-c79d-4134-8e79-d5080e4decac req-6f2a3ca6-d7d0-4aa6-8504-55e4c3117884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f15a679c-3871-476d-ad34-79495a3b44ce", "name": "network-vif-deleted", "tag": "e095fca8-0a7e-434c-b010-216a2fd7f544"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:33:42.199397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cb5479ee-c79d-4134-8e79-d5080e4decac req-6f2a3ca6-d7d0-4aa6-8504-55e4c3117884 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:42.209748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cb5479ee-c79d-4134-8e79-d5080e4decac req-6f2a3ca6-d7d0-4aa6-8504-55e4c3117884 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:42.228448 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-cb5479ee-c79d-4134-8e79-d5080e4decac req-6f2a3ca6-d7d0-4aa6-8504-55e4c3117884 service nova] Creating event network-vif-deleted:e095fca8-0a7e-434c-b010-216a2fd7f544 for instance f15a679c-3871-476d-ad34-79495a3b44ce on n-h1-826756-3 Jul 28 04:33:42.233479 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-cb5479ee-c79d-4134-8e79-d5080e4decac req-6f2a3ca6-d7d0-4aa6-8504-55e4c3117884 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049252 Jul 28 04:33:42.234569 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4383/6833] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:33:42.791683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c3ffa41-c729-416e-a17e-be59fb33a71f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:42.792385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c3ffa41-c729-416e-a17e-be59fb33a71f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:42.799383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c3ffa41-c729-416e-a17e-be59fb33a71f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:42.799846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c3ffa41-c729-416e-a17e-be59fb33a71f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:42.800671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c3ffa41-c729-416e-a17e-be59fb33a71f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:42.801123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c3ffa41-c729-416e-a17e-be59fb33a71f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:42.815728 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-1c3ffa41-c729-416e-a17e-be59fb33a71f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] HTTP exception thrown: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c3ffa41-c729-416e-a17e-be59fb33a71f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Request method failure captured: Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce HTTP/1.1 Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hF14HkTBM_ZRExa_EUVXE41YnhhXT3tzYjJ1R36ABo27gVsnjgE13RxRpfWjK323c1vKcvq-w3nTxiQ46jUlIj9EyMUtQJciq_BtLityYo-uoPM0Nh-POg7TsNvVYAl_WqeyQIb1_Ham43Hq4B_2zBb23oV0PGpdSSRY9b97nRdP_Q Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ff416a55fa51499381c263987bb60f80 Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-DeleteServersTestJSON-1023392347 Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ff416a55fa51499381c263987bb60f80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ff416a55fa51499381c263987bb60f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ff416a55fa51499381c263987bb60f80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ff416a55fa51499381c263987bb60f80"}]}] Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-DeleteServersTestJSON-1023392347 Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ff416a55fa51499381c263987bb60f80 Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-DeleteServersTestJSON-1023392347 Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-DeleteServersTestJSON-1023392347-project Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ac413111712e4c1ba17bce4eb57d5f36 Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-DeleteServersTestJSON-1023392347-project Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'f15a679c-3871-476d-ad34-79495a3b44ce'} Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:33:42.817471 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.821808 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:33:42.821808 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:33:42.821808 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:33:42.821808 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:33:42.821808 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:33:42.821808 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.821808 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.821808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c3ffa41-c729-416e-a17e-be59fb33a71f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Returning 404 to user: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:33:42.821808 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c3ffa41-c729-416e-a17e-be59fb33a71f tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 404 len: 111 microversion: 2.1 time: 0.033919 Jul 28 04:33:42.821808 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4384/6834] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:42 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:33:42.831478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-736b6873-0f88-4630-bbd6-1ab38dc41b7d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:42.831996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-736b6873-0f88-4630-bbd6-1ab38dc41b7d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:42.838618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-736b6873-0f88-4630-bbd6-1ab38dc41b7d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:42.839084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-736b6873-0f88-4630-bbd6-1ab38dc41b7d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:42.839862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-736b6873-0f88-4630-bbd6-1ab38dc41b7d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:42.840309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-736b6873-0f88-4630-bbd6-1ab38dc41b7d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:42.855036 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-736b6873-0f88-4630-bbd6-1ab38dc41b7d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] HTTP exception thrown: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-736b6873-0f88-4630-bbd6-1ab38dc41b7d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Request method failure captured: Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce HTTP/1.1 Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hF14HkTBM_ZRExa_EUVXE41YnhhXT3tzYjJ1R36ABo27gVsnjgE13RxRpfWjK323c1vKcvq-w3nTxiQ46jUlIj9EyMUtQJciq_BtLityYo-uoPM0Nh-POg7TsNvVYAl_WqeyQIb1_Ham43Hq4B_2zBb23oV0PGpdSSRY9b97nRdP_Q Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ff416a55fa51499381c263987bb60f80 Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-DeleteServersTestJSON-1023392347 Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ff416a55fa51499381c263987bb60f80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ff416a55fa51499381c263987bb60f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ff416a55fa51499381c263987bb60f80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ff416a55fa51499381c263987bb60f80"}]}] Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-DeleteServersTestJSON-1023392347 Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ff416a55fa51499381c263987bb60f80 Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-DeleteServersTestJSON-1023392347 Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-DeleteServersTestJSON-1023392347-project Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ac413111712e4c1ba17bce4eb57d5f36 Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-DeleteServersTestJSON-1023392347-project Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'f15a679c-3871-476d-ad34-79495a3b44ce'} Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:33:42.856655 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:33:42.860151 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.860151 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.860151 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:33:42.860151 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.860151 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:33:42.860151 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:33:42.860151 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:33:42.860151 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:33:42.860151 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:33:42.860151 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.860151 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.860151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-736b6873-0f88-4630-bbd6-1ab38dc41b7d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Returning 404 to user: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:33:42.860151 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-736b6873-0f88-4630-bbd6-1ab38dc41b7d tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 404 len: 111 microversion: 2.1 time: 0.030372 Jul 28 04:33:42.860151 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4385/6835] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:33:42 2022] DELETE /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:33:42.866599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-89c34a1f-444d-4886-a6db-a8b22f198500 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:42.867246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-89c34a1f-444d-4886-a6db-a8b22f198500 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] [instance: f15a679c-3871-476d-ad34-79495a3b44ce] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:42.873439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89c34a1f-444d-4886-a6db-a8b22f198500 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:42.873898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89c34a1f-444d-4886-a6db-a8b22f198500 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:42.874677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89c34a1f-444d-4886-a6db-a8b22f198500 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:42.875120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89c34a1f-444d-4886-a6db-a8b22f198500 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:42.891533 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-89c34a1f-444d-4886-a6db-a8b22f198500 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] HTTP exception thrown: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-89c34a1f-444d-4886-a6db-a8b22f198500 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Request method failure captured: Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce HTTP/1.1 Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hF14HkTBM_ZRExa_EUVXE41YnhhXT3tzYjJ1R36ABo27gVsnjgE13RxRpfWjK323c1vKcvq-w3nTxiQ46jUlIj9EyMUtQJciq_BtLityYo-uoPM0Nh-POg7TsNvVYAl_WqeyQIb1_Ham43Hq4B_2zBb23oV0PGpdSSRY9b97nRdP_Q Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: ff416a55fa51499381c263987bb60f80 Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-DeleteServersTestJSON-1023392347 Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ff416a55fa51499381c263987bb60f80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ff416a55fa51499381c263987bb60f80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ff416a55fa51499381c263987bb60f80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ff416a55fa51499381c263987bb60f80"}]}] Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-DeleteServersTestJSON-1023392347 Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: ff416a55fa51499381c263987bb60f80 Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-DeleteServersTestJSON-1023392347 Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-DeleteServersTestJSON-1023392347-project Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ac413111712e4c1ba17bce4eb57d5f36 Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-DeleteServersTestJSON-1023392347-project Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'f15a679c-3871-476d-ad34-79495a3b44ce'} Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:33:42.893110 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.896598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:33:42.896598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:33:42.896598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:33:42.896598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:33:42.896598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:33:42.896598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. Jul 28 04:33:42.896598 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:33:42.896598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-89c34a1f-444d-4886-a6db-a8b22f198500 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] Returning 404 to user: Instance f15a679c-3871-476d-ad34-79495a3b44ce could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:33:42.896598 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-89c34a1f-444d-4886-a6db-a8b22f198500 tempest-DeleteServersTestJSON-1023392347 tempest-DeleteServersTestJSON-1023392347-project] 10.222.0.48 "GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce" status: 404 len: 111 microversion: 2.1 time: 0.031681 Jul 28 04:33:42.896598 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4386/6836] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:42 2022] GET /compute/v2.1/servers/f15a679c-3871-476d-ad34-79495a3b44ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:33:51.771991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1662946174", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "4c643524-038b-4789-82a3-fb6755df5285"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:33:51.780614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:33:51.836753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] validate_networks() for [('4c643524-038b-4789-82a3-fb6755df5285', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:33:52.251165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:33:52.251793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:33:52.252330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:33:52.252893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:33:52.253433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:33:52.263477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:52.264065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:52.265155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:52.265844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:52.286092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Getting quotas for project 2c82cb536f094fd3a35b71d21ec6c519. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:33:52.291970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Getting quotas for user b8a6d116e47446cd828b6e3954ba41ce and project 2c82cb536f094fd3a35b71d21ec6c519. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:33:52.305720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:33:52.308102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:33:52.356115 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aaaec4cb-9eec-4ff5-b159-b38dc8729f46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727960 Jul 28 04:33:52.356827 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4387/6837] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:33:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:33:52.368539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fd9a1ba1-d776-45d4-8e73-2842a0db51fa tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:52.369157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fd9a1ba1-d776-45d4-8e73-2842a0db51fa tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:52.429297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fd9a1ba1-d776-45d4-8e73-2842a0db51fa tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:52.438775 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fd9a1ba1-d776-45d4-8e73-2842a0db51fa tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1218 microversion: 2.1 time: 0.074263 Jul 28 04:33:52.439185 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4388/6838] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:52 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:53.459684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c8e5d9b1-3b0b-4d0a-9061-0c4876e9bc27 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:53.460338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c8e5d9b1-3b0b-4d0a-9061-0c4876e9bc27 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:53.468675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8e5d9b1-3b0b-4d0a-9061-0c4876e9bc27 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:53.469139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8e5d9b1-3b0b-4d0a-9061-0c4876e9bc27 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:53.469923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8e5d9b1-3b0b-4d0a-9061-0c4876e9bc27 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:53.470365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8e5d9b1-3b0b-4d0a-9061-0c4876e9bc27 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:53.549702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c8e5d9b1-3b0b-4d0a-9061-0c4876e9bc27 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:53.557950 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c8e5d9b1-3b0b-4d0a-9061-0c4876e9bc27 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1288 microversion: 2.1 time: 0.102179 Jul 28 04:33:53.558830 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4389/6839] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:53 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1288 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:54.580043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e8d6ea64-211f-4d2e-9281-8e59d3d0f08d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:54.580719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e8d6ea64-211f-4d2e-9281-8e59d3d0f08d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:54.596677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8d6ea64-211f-4d2e-9281-8e59d3d0f08d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:54.598049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8d6ea64-211f-4d2e-9281-8e59d3d0f08d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:54.599059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8d6ea64-211f-4d2e-9281-8e59d3d0f08d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:54.599802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8d6ea64-211f-4d2e-9281-8e59d3d0f08d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:54.889228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e8d6ea64-211f-4d2e-9281-8e59d3d0f08d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:54.915261 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e8d6ea64-211f-4d2e-9281-8e59d3d0f08d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1318 microversion: 2.1 time: 0.339059 Jul 28 04:33:54.935620 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4390/6840] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:54 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:33:55.027813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a353e0c0-c0d2-459f-890d-eb50edc9aeb0 req-05c46e15-de92-4faa-80e0-0c5395ebf100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c", "tag": "ab1ebcb1-c8e0-4ff7-b58a-744782ac5b80"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:33:55.050476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a353e0c0-c0d2-459f-890d-eb50edc9aeb0 req-05c46e15-de92-4faa-80e0-0c5395ebf100 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:55.068092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a353e0c0-c0d2-459f-890d-eb50edc9aeb0 req-05c46e15-de92-4faa-80e0-0c5395ebf100 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:55.091014 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a353e0c0-c0d2-459f-890d-eb50edc9aeb0 req-05c46e15-de92-4faa-80e0-0c5395ebf100 service nova] Creating event network-changed:ab1ebcb1-c8e0-4ff7-b58a-744782ac5b80 for instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c on n-h1-826756-3 Jul 28 04:33:55.098488 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a353e0c0-c0d2-459f-890d-eb50edc9aeb0 req-05c46e15-de92-4faa-80e0-0c5395ebf100 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080812 Jul 28 04:33:55.099709 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4391/6841] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:33:55.945940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ba37ecad-264c-45ef-8bf3-f27fdc9257f7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:55.947014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ba37ecad-264c-45ef-8bf3-f27fdc9257f7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:55.958885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba37ecad-264c-45ef-8bf3-f27fdc9257f7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:55.959700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba37ecad-264c-45ef-8bf3-f27fdc9257f7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:55.961147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba37ecad-264c-45ef-8bf3-f27fdc9257f7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:55.961599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba37ecad-264c-45ef-8bf3-f27fdc9257f7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:56.096689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ba37ecad-264c-45ef-8bf3-f27fdc9257f7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:56.107764 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ba37ecad-264c-45ef-8bf3-f27fdc9257f7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1318 microversion: 2.1 time: 0.170580 Jul 28 04:33:56.108622 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4392/6842] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:55 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:57.133329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eac7b35f-c5f4-4396-81c1-561e22f9e55c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:57.133955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eac7b35f-c5f4-4396-81c1-561e22f9e55c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:57.141448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eac7b35f-c5f4-4396-81c1-561e22f9e55c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:57.141876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eac7b35f-c5f4-4396-81c1-561e22f9e55c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:57.142686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eac7b35f-c5f4-4396-81c1-561e22f9e55c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:57.143130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eac7b35f-c5f4-4396-81c1-561e22f9e55c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:57.281003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eac7b35f-c5f4-4396-81c1-561e22f9e55c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:57.288888 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eac7b35f-c5f4-4396-81c1-561e22f9e55c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1318 microversion: 2.1 time: 0.162229 Jul 28 04:33:57.289462 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4393/6843] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:57 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:58.310216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-68cbf0d4-c2bb-4b26-91e6-c28705e9fccb tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:58.310858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-68cbf0d4-c2bb-4b26-91e6-c28705e9fccb tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:58.317932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68cbf0d4-c2bb-4b26-91e6-c28705e9fccb tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:58.318394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68cbf0d4-c2bb-4b26-91e6-c28705e9fccb tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:58.319177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68cbf0d4-c2bb-4b26-91e6-c28705e9fccb tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:58.319617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68cbf0d4-c2bb-4b26-91e6-c28705e9fccb tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:58.451584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-68cbf0d4-c2bb-4b26-91e6-c28705e9fccb tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:58.459898 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-68cbf0d4-c2bb-4b26-91e6-c28705e9fccb tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1318 microversion: 2.1 time: 0.153889 Jul 28 04:33:58.460497 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4394/6844] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:58 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:33:59.482458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-32cc9d27-458e-4d2e-971f-9fd9215a5795 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:33:59.483169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-32cc9d27-458e-4d2e-971f-9fd9215a5795 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:33:59.490958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32cc9d27-458e-4d2e-971f-9fd9215a5795 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:59.491420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32cc9d27-458e-4d2e-971f-9fd9215a5795 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:59.492202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32cc9d27-458e-4d2e-971f-9fd9215a5795 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:33:59.492679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32cc9d27-458e-4d2e-971f-9fd9215a5795 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:33:59.642302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-32cc9d27-458e-4d2e-971f-9fd9215a5795 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:33:59.650272 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-32cc9d27-458e-4d2e-971f-9fd9215a5795 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1318 microversion: 2.1 time: 0.171944 Jul 28 04:33:59.650861 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4395/6845] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:33:59 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:00.501180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-7d9f3e61-8ca9-4164-96af-d802c7071489 req-c5ef1042-2462-45cb-ac38-a28e7c019e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c", "name": "network-vif-plugged", "status": "completed", "tag": "ab1ebcb1-c8e0-4ff7-b58a-744782ac5b80"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:34:00.510962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7d9f3e61-8ca9-4164-96af-d802c7071489 req-c5ef1042-2462-45cb-ac38-a28e7c019e9a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:00.511423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7d9f3e61-8ca9-4164-96af-d802c7071489 req-c5ef1042-2462-45cb-ac38-a28e7c019e9a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:00.522279 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-7d9f3e61-8ca9-4164-96af-d802c7071489 req-c5ef1042-2462-45cb-ac38-a28e7c019e9a service nova] Creating event network-vif-plugged:ab1ebcb1-c8e0-4ff7-b58a-744782ac5b80 for instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c on n-h1-826756-3 Jul 28 04:34:00.527628 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-7d9f3e61-8ca9-4164-96af-d802c7071489 req-c5ef1042-2462-45cb-ac38-a28e7c019e9a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080768 Jul 28 04:34:00.528214 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4396/6846] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:34:00.672034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-65130ea9-4fd8-4d36-9207-26c9845d393e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:00.672783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-65130ea9-4fd8-4d36-9207-26c9845d393e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:00.680079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65130ea9-4fd8-4d36-9207-26c9845d393e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:00.680768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65130ea9-4fd8-4d36-9207-26c9845d393e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:00.681961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65130ea9-4fd8-4d36-9207-26c9845d393e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:00.682686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65130ea9-4fd8-4d36-9207-26c9845d393e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:00.822345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-65130ea9-4fd8-4d36-9207-26c9845d393e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:00.830454 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-65130ea9-4fd8-4d36-9207-26c9845d393e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1318 microversion: 2.1 time: 0.162843 Jul 28 04:34:00.831037 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4397/6847] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:00 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:01.854716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4ebccb95-8921-49a3-8327-d076dbed252c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:01.855341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4ebccb95-8921-49a3-8327-d076dbed252c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:01.862868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ebccb95-8921-49a3-8327-d076dbed252c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:01.863334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ebccb95-8921-49a3-8327-d076dbed252c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:01.864115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ebccb95-8921-49a3-8327-d076dbed252c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:01.864603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ebccb95-8921-49a3-8327-d076dbed252c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:01.997383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4ebccb95-8921-49a3-8327-d076dbed252c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:02.006174 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4ebccb95-8921-49a3-8327-d076dbed252c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1509 microversion: 2.1 time: 0.157714 Jul 28 04:34:02.006729 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4398/6848] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:01 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:02.026335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dcec0936-aa9f-4a48-a74f-771072ed11b8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:02.026968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dcec0936-aa9f-4a48-a74f-771072ed11b8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:02.033726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcec0936-aa9f-4a48-a74f-771072ed11b8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:02.034196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcec0936-aa9f-4a48-a74f-771072ed11b8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:02.034980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcec0936-aa9f-4a48-a74f-771072ed11b8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:02.035440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dcec0936-aa9f-4a48-a74f-771072ed11b8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:02.184587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dcec0936-aa9f-4a48-a74f-771072ed11b8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:02.197028 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dcec0936-aa9f-4a48-a74f-771072ed11b8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1509 microversion: 2.1 time: 0.174204 Jul 28 04:34:02.197885 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4399/6849] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:02 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:02.223929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-597ee02d-17be-431d-b677-edf5b0c20789 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:34:02.226497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-597ee02d-17be-431d-b677-edf5b0c20789 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:02.232921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-597ee02d-17be-431d-b677-edf5b0c20789 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:02.233398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-597ee02d-17be-431d-b677-edf5b0c20789 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:02.234172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-597ee02d-17be-431d-b677-edf5b0c20789 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:02.234629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-597ee02d-17be-431d-b677-edf5b0c20789 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:02.278534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:34:02.301791 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-597ee02d-17be-431d-b677-edf5b0c20789 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "PUT /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1081 microversion: 2.1 time: 0.080994 Jul 28 04:34:02.302824 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4400/6850] 10.222.0.48 () {60 vars in 1256 bytes} [Thu Jul 28 04:34:02 2022] PUT /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1081 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:02.321225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ec228c56-409d-47db-956d-526ded48673b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:02.321843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ec228c56-409d-47db-956d-526ded48673b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:02.328421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec228c56-409d-47db-956d-526ded48673b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:02.329093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec228c56-409d-47db-956d-526ded48673b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:02.329653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec228c56-409d-47db-956d-526ded48673b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:02.330095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ec228c56-409d-47db-956d-526ded48673b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:02.334030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:34:02.437291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:34:02.466377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ec228c56-409d-47db-956d-526ded48673b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:02.475049 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ec228c56-409d-47db-956d-526ded48673b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1507 microversion: 2.1 time: 0.157456 Jul 28 04:34:02.475632 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4401/6851] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:02 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:02.495195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-768e05f1-7308-4f32-8d92-4e20b2807644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:02.495826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-768e05f1-7308-4f32-8d92-4e20b2807644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:02.502547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-768e05f1-7308-4f32-8d92-4e20b2807644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:02.503017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-768e05f1-7308-4f32-8d92-4e20b2807644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:02.503808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-768e05f1-7308-4f32-8d92-4e20b2807644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:02.504263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-768e05f1-7308-4f32-8d92-4e20b2807644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:02.638780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-768e05f1-7308-4f32-8d92-4e20b2807644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:02.646881 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-768e05f1-7308-4f32-8d92-4e20b2807644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1507 microversion: 2.1 time: 0.155634 Jul 28 04:34:02.647456 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4402/6852] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:02 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:02.666539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c6be868f-67ff-43d8-bedc-02e732e1b98d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:34:02.668942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c6be868f-67ff-43d8-bedc-02e732e1b98d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:02.675398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6be868f-67ff-43d8-bedc-02e732e1b98d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:02.675852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6be868f-67ff-43d8-bedc-02e732e1b98d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:02.676653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6be868f-67ff-43d8-bedc-02e732e1b98d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:02.677093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6be868f-67ff-43d8-bedc-02e732e1b98d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:02.709057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c6be868f-67ff-43d8-bedc-02e732e1b98d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:02.715547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c6be868f-67ff-43d8-bedc-02e732e1b98d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Old instance type m1.heat2, new instance type m1.heat {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 04:34:02.723174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c6be868f-67ff-43d8-bedc-02e732e1b98d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:34:02.723598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c6be868f-67ff-43d8-bedc-02e732e1b98d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:34:02.724075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c6be868f-67ff-43d8-bedc-02e732e1b98d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:34:02.724511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c6be868f-67ff-43d8-bedc-02e732e1b98d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:34:02.724926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-c6be868f-67ff-43d8-bedc-02e732e1b98d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:34:02.799125 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c6be868f-67ff-43d8-bedc-02e732e1b98d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "POST /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c/action" status: 202 len: 0 microversion: 2.1 time: 0.136187 Jul 28 04:34:02.800077 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4403/6853] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:34:02 2022] POST /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:34:02.808107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b0ea184-8b40-43ec-a1bf-0f2469d16739 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:02.808793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b0ea184-8b40-43ec-a1bf-0f2469d16739 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:02.815062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b0ea184-8b40-43ec-a1bf-0f2469d16739 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:02.815538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b0ea184-8b40-43ec-a1bf-0f2469d16739 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:02.816316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b0ea184-8b40-43ec-a1bf-0f2469d16739 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:02.816797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b0ea184-8b40-43ec-a1bf-0f2469d16739 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:02.951372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7b0ea184-8b40-43ec-a1bf-0f2469d16739 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:02.960146 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b0ea184-8b40-43ec-a1bf-0f2469d16739 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1518 microversion: 2.1 time: 0.156012 Jul 28 04:34:02.960768 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4404/6854] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:02 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:03.982026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3850598f-0715-4d5b-adfc-61287f6d4217 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:03.982795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3850598f-0715-4d5b-adfc-61287f6d4217 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:03.990207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3850598f-0715-4d5b-adfc-61287f6d4217 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:03.990667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3850598f-0715-4d5b-adfc-61287f6d4217 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:03.991543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3850598f-0715-4d5b-adfc-61287f6d4217 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:03.992138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3850598f-0715-4d5b-adfc-61287f6d4217 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:04.138873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3850598f-0715-4d5b-adfc-61287f6d4217 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:04.148640 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3850598f-0715-4d5b-adfc-61287f6d4217 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1518 microversion: 2.1 time: 0.170734 Jul 28 04:34:04.149413 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4405/6855] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:03 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:05.170512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3579ca77-327b-4bc2-a006-d05e6eeccef9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:05.171138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3579ca77-327b-4bc2-a006-d05e6eeccef9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:05.178657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3579ca77-327b-4bc2-a006-d05e6eeccef9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:05.179125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3579ca77-327b-4bc2-a006-d05e6eeccef9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:05.179910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3579ca77-327b-4bc2-a006-d05e6eeccef9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:05.180419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3579ca77-327b-4bc2-a006-d05e6eeccef9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:05.330397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3579ca77-327b-4bc2-a006-d05e6eeccef9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:05.339069 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3579ca77-327b-4bc2-a006-d05e6eeccef9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.173024 Jul 28 04:34:05.339658 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4406/6856] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:05 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:06.361216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-461b0ba8-cef7-452d-a53d-50f2ba18e743 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:06.362067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-461b0ba8-cef7-452d-a53d-50f2ba18e743 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:06.369649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-461b0ba8-cef7-452d-a53d-50f2ba18e743 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:06.370112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-461b0ba8-cef7-452d-a53d-50f2ba18e743 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:06.370895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-461b0ba8-cef7-452d-a53d-50f2ba18e743 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:06.371344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-461b0ba8-cef7-452d-a53d-50f2ba18e743 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:06.520304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-461b0ba8-cef7-452d-a53d-50f2ba18e743 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:06.528657 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-461b0ba8-cef7-452d-a53d-50f2ba18e743 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.171465 Jul 28 04:34:06.529245 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4407/6857] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:06 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:07.551030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-55b72e36-b5de-497c-9a0c-ebcfb4005208 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:07.551806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-55b72e36-b5de-497c-9a0c-ebcfb4005208 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:07.560028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55b72e36-b5de-497c-9a0c-ebcfb4005208 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:07.560529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55b72e36-b5de-497c-9a0c-ebcfb4005208 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:07.561306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55b72e36-b5de-497c-9a0c-ebcfb4005208 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:07.561759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55b72e36-b5de-497c-9a0c-ebcfb4005208 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:07.704559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-55b72e36-b5de-497c-9a0c-ebcfb4005208 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:07.712627 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-55b72e36-b5de-497c-9a0c-ebcfb4005208 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.166127 Jul 28 04:34:07.713215 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4408/6858] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:07 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:08.737445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d731fcf5-096f-4d97-b1f6-10af900eecf8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:08.738167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d731fcf5-096f-4d97-b1f6-10af900eecf8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:08.747692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d731fcf5-096f-4d97-b1f6-10af900eecf8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:08.748161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d731fcf5-096f-4d97-b1f6-10af900eecf8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:08.749004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d731fcf5-096f-4d97-b1f6-10af900eecf8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:08.749457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d731fcf5-096f-4d97-b1f6-10af900eecf8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:08.885228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d731fcf5-096f-4d97-b1f6-10af900eecf8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:08.893486 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d731fcf5-096f-4d97-b1f6-10af900eecf8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.162436 Jul 28 04:34:08.894079 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4409/6859] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:08 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:09.923875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-55843c8f-292f-4eab-b6ac-86289708e960 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:09.925028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-55843c8f-292f-4eab-b6ac-86289708e960 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:09.937042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55843c8f-292f-4eab-b6ac-86289708e960 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:09.937821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55843c8f-292f-4eab-b6ac-86289708e960 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:09.939105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55843c8f-292f-4eab-b6ac-86289708e960 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:09.939854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55843c8f-292f-4eab-b6ac-86289708e960 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:10.086014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-55843c8f-292f-4eab-b6ac-86289708e960 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:10.099160 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-55843c8f-292f-4eab-b6ac-86289708e960 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.181587 Jul 28 04:34:10.099992 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4410/6860] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:09 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:11.124251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d41ef562-ced1-427d-8c5a-8d3247f25bba tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:11.124912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d41ef562-ced1-427d-8c5a-8d3247f25bba tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:11.132839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d41ef562-ced1-427d-8c5a-8d3247f25bba tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:11.133306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d41ef562-ced1-427d-8c5a-8d3247f25bba tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:11.134080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d41ef562-ced1-427d-8c5a-8d3247f25bba tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:11.134524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d41ef562-ced1-427d-8c5a-8d3247f25bba tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:11.292885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d41ef562-ced1-427d-8c5a-8d3247f25bba tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:11.305612 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d41ef562-ced1-427d-8c5a-8d3247f25bba tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.185269 Jul 28 04:34:11.306484 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4411/6861] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:11 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:12.328570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cd055012-00d8-4601-b572-de12f8eb1e90 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:12.329225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cd055012-00d8-4601-b572-de12f8eb1e90 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:12.337040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd055012-00d8-4601-b572-de12f8eb1e90 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:12.337517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd055012-00d8-4601-b572-de12f8eb1e90 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:12.338404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd055012-00d8-4601-b572-de12f8eb1e90 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:12.338854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd055012-00d8-4601-b572-de12f8eb1e90 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:12.493847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cd055012-00d8-4601-b572-de12f8eb1e90 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:12.502500 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cd055012-00d8-4601-b572-de12f8eb1e90 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.178115 Jul 28 04:34:12.503076 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4412/6862] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:12 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:13.535631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af4785d5-8165-432f-8e71-4900305b9dc3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:13.536687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-af4785d5-8165-432f-8e71-4900305b9dc3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:13.548653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af4785d5-8165-432f-8e71-4900305b9dc3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:13.549430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af4785d5-8165-432f-8e71-4900305b9dc3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:13.550716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af4785d5-8165-432f-8e71-4900305b9dc3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:13.551467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af4785d5-8165-432f-8e71-4900305b9dc3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:13.704871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-af4785d5-8165-432f-8e71-4900305b9dc3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:13.713139 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-af4785d5-8165-432f-8e71-4900305b9dc3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.184130 Jul 28 04:34:13.713734 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4413/6863] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:13 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:14.737457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-52b1a86c-d8ce-411f-9185-cb5029cd0d4f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:14.737457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-52b1a86c-d8ce-411f-9185-cb5029cd0d4f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:14.743740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52b1a86c-d8ce-411f-9185-cb5029cd0d4f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:14.744199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52b1a86c-d8ce-411f-9185-cb5029cd0d4f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:14.745113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52b1a86c-d8ce-411f-9185-cb5029cd0d4f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:14.745555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-52b1a86c-d8ce-411f-9185-cb5029cd0d4f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:14.881482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-52b1a86c-d8ce-411f-9185-cb5029cd0d4f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:14.891844 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-52b1a86c-d8ce-411f-9185-cb5029cd0d4f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.159925 Jul 28 04:34:14.892766 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4414/6864] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:14 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:15.913358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ea50da9a-7a56-4ce4-9af5-a4d9c3fc88a6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:15.914093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ea50da9a-7a56-4ce4-9af5-a4d9c3fc88a6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:15.921626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea50da9a-7a56-4ce4-9af5-a4d9c3fc88a6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:15.922079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea50da9a-7a56-4ce4-9af5-a4d9c3fc88a6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:15.922850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea50da9a-7a56-4ce4-9af5-a4d9c3fc88a6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:15.923298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea50da9a-7a56-4ce4-9af5-a4d9c3fc88a6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:16.058496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ea50da9a-7a56-4ce4-9af5-a4d9c3fc88a6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:16.067024 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ea50da9a-7a56-4ce4-9af5-a4d9c3fc88a6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.157665 Jul 28 04:34:16.067764 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4415/6865] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:15 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:17.089071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-48fa3a43-6a36-4caa-a4dd-f44002e28a06 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:17.089657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-48fa3a43-6a36-4caa-a4dd-f44002e28a06 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:17.097971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48fa3a43-6a36-4caa-a4dd-f44002e28a06 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:17.098476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48fa3a43-6a36-4caa-a4dd-f44002e28a06 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:17.099249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48fa3a43-6a36-4caa-a4dd-f44002e28a06 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:17.099694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48fa3a43-6a36-4caa-a4dd-f44002e28a06 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:17.117874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:34:17.241315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-48fa3a43-6a36-4caa-a4dd-f44002e28a06 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:17.249370 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-48fa3a43-6a36-4caa-a4dd-f44002e28a06 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.164471 Jul 28 04:34:17.250138 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4416/6866] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:17 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:18.275457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ed3d69e-a9ab-4c78-8165-815d316e2f5f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:18.276547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ed3d69e-a9ab-4c78-8165-815d316e2f5f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:18.288710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ed3d69e-a9ab-4c78-8165-815d316e2f5f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:18.289493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ed3d69e-a9ab-4c78-8165-815d316e2f5f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:18.290790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ed3d69e-a9ab-4c78-8165-815d316e2f5f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:18.291552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ed3d69e-a9ab-4c78-8165-815d316e2f5f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:18.432936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2ed3d69e-a9ab-4c78-8165-815d316e2f5f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:18.441034 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ed3d69e-a9ab-4c78-8165-815d316e2f5f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.172425 Jul 28 04:34:18.441589 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4417/6867] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:18 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:19.467656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5e2815bc-b16b-4ea9-bdde-ce7f1f7154bc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:19.468306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5e2815bc-b16b-4ea9-bdde-ce7f1f7154bc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:19.485303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e2815bc-b16b-4ea9-bdde-ce7f1f7154bc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:19.486098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e2815bc-b16b-4ea9-bdde-ce7f1f7154bc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:19.487408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e2815bc-b16b-4ea9-bdde-ce7f1f7154bc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:19.488220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e2815bc-b16b-4ea9-bdde-ce7f1f7154bc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:19.641638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5e2815bc-b16b-4ea9-bdde-ce7f1f7154bc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:19.654826 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5e2815bc-b16b-4ea9-bdde-ce7f1f7154bc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.192676 Jul 28 04:34:19.655628 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4418/6868] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:19 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:34:20.681105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-23277b35-57c7-4d66-9633-61b56c356212 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:20.682048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-23277b35-57c7-4d66-9633-61b56c356212 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:20.691454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23277b35-57c7-4d66-9633-61b56c356212 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:20.692032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23277b35-57c7-4d66-9633-61b56c356212 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:20.693046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23277b35-57c7-4d66-9633-61b56c356212 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:20.693600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23277b35-57c7-4d66-9633-61b56c356212 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:20.842820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-23277b35-57c7-4d66-9633-61b56c356212 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:20.851271 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-23277b35-57c7-4d66-9633-61b56c356212 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.175277 Jul 28 04:34:20.851875 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4419/6869] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:20 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:21.883467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62155a46-179f-4309-9f75-5565b82bf604 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:21.884546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-62155a46-179f-4309-9f75-5565b82bf604 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:21.888080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:34:21.893881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62155a46-179f-4309-9f75-5565b82bf604 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:21.894352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62155a46-179f-4309-9f75-5565b82bf604 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:21.895139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62155a46-179f-4309-9f75-5565b82bf604 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:21.895589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62155a46-179f-4309-9f75-5565b82bf604 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:22.348929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62155a46-179f-4309-9f75-5565b82bf604 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:22.360939 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-62155a46-179f-4309-9f75-5565b82bf604 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.483834 Jul 28 04:34:22.361739 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4420/6870] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:21 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:23.388814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-583465ec-8642-4b39-bdbe-f9c4c2be9e1b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:23.389450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-583465ec-8642-4b39-bdbe-f9c4c2be9e1b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:23.396842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-583465ec-8642-4b39-bdbe-f9c4c2be9e1b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:23.397299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-583465ec-8642-4b39-bdbe-f9c4c2be9e1b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:23.398075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-583465ec-8642-4b39-bdbe-f9c4c2be9e1b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:23.398518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-583465ec-8642-4b39-bdbe-f9c4c2be9e1b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:23.540894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-583465ec-8642-4b39-bdbe-f9c4c2be9e1b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:23.549885 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-583465ec-8642-4b39-bdbe-f9c4c2be9e1b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.166757 Jul 28 04:34:23.550498 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4421/6871] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:23 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:24.571577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4cdc8f51-6aff-4626-800b-d5f97d47ccef tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:24.572267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4cdc8f51-6aff-4626-800b-d5f97d47ccef tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:24.579587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cdc8f51-6aff-4626-800b-d5f97d47ccef tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:24.580075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cdc8f51-6aff-4626-800b-d5f97d47ccef tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:24.580882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cdc8f51-6aff-4626-800b-d5f97d47ccef tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:24.581326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4cdc8f51-6aff-4626-800b-d5f97d47ccef tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:24.724215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4cdc8f51-6aff-4626-800b-d5f97d47ccef tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:24.732749 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4cdc8f51-6aff-4626-800b-d5f97d47ccef tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.165196 Jul 28 04:34:24.733314 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4422/6872] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:24 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:25.755511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c5dc46cf-d4d5-4f93-bce4-adfadae88628 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:25.756207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c5dc46cf-d4d5-4f93-bce4-adfadae88628 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:25.763137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5dc46cf-d4d5-4f93-bce4-adfadae88628 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:25.763596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5dc46cf-d4d5-4f93-bce4-adfadae88628 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:25.764397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5dc46cf-d4d5-4f93-bce4-adfadae88628 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:25.764845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5dc46cf-d4d5-4f93-bce4-adfadae88628 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:25.901173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c5dc46cf-d4d5-4f93-bce4-adfadae88628 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:25.913442 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c5dc46cf-d4d5-4f93-bce4-adfadae88628 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.162572 Jul 28 04:34:25.914221 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4423/6873] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:25 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:26.937385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-49ae0561-decd-4e66-bff1-2e7c416b16e0 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:26.938079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-49ae0561-decd-4e66-bff1-2e7c416b16e0 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:26.946039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49ae0561-decd-4e66-bff1-2e7c416b16e0 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:26.947201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49ae0561-decd-4e66-bff1-2e7c416b16e0 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:26.948293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49ae0561-decd-4e66-bff1-2e7c416b16e0 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:26.948752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-49ae0561-decd-4e66-bff1-2e7c416b16e0 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:27.095412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-49ae0561-decd-4e66-bff1-2e7c416b16e0 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:27.103988 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-49ae0561-decd-4e66-bff1-2e7c416b16e0 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.171025 Jul 28 04:34:27.104697 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4424/6874] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:26 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:28.128522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2a2c92bc-22c3-4382-a4ef-28b011592477 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:28.129200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2a2c92bc-22c3-4382-a4ef-28b011592477 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:28.138795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a2c92bc-22c3-4382-a4ef-28b011592477 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:28.139292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a2c92bc-22c3-4382-a4ef-28b011592477 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:28.140054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a2c92bc-22c3-4382-a4ef-28b011592477 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:28.140540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a2c92bc-22c3-4382-a4ef-28b011592477 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:28.282308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2a2c92bc-22c3-4382-a4ef-28b011592477 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:28.290511 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2a2c92bc-22c3-4382-a4ef-28b011592477 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.168149 Jul 28 04:34:28.291086 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4425/6875] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:28 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:29.311761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc796725-2c62-48c3-9003-987f784f150c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:29.312534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dc796725-2c62-48c3-9003-987f784f150c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:29.319713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc796725-2c62-48c3-9003-987f784f150c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:29.320186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc796725-2c62-48c3-9003-987f784f150c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:29.321000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc796725-2c62-48c3-9003-987f784f150c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:29.321438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc796725-2c62-48c3-9003-987f784f150c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:29.464979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dc796725-2c62-48c3-9003-987f784f150c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:29.473415 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc796725-2c62-48c3-9003-987f784f150c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.165890 Jul 28 04:34:29.474030 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4426/6876] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:29 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:30.495205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47c0ec44-8b28-42bf-9e84-34736fde9365 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:30.495929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-47c0ec44-8b28-42bf-9e84-34736fde9365 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:30.503438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47c0ec44-8b28-42bf-9e84-34736fde9365 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:30.503889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47c0ec44-8b28-42bf-9e84-34736fde9365 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:30.504737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47c0ec44-8b28-42bf-9e84-34736fde9365 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:30.505178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47c0ec44-8b28-42bf-9e84-34736fde9365 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:30.654930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-47c0ec44-8b28-42bf-9e84-34736fde9365 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:30.663237 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-47c0ec44-8b28-42bf-9e84-34736fde9365 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.172091 Jul 28 04:34:30.663829 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4427/6877] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:30 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:31.686071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-845b3be8-26fd-4c77-be4f-286744e02ef2 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:31.686760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-845b3be8-26fd-4c77-be4f-286744e02ef2 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:31.694624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-845b3be8-26fd-4c77-be4f-286744e02ef2 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:31.695149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-845b3be8-26fd-4c77-be4f-286744e02ef2 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:31.695992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-845b3be8-26fd-4c77-be4f-286744e02ef2 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:31.696551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-845b3be8-26fd-4c77-be4f-286744e02ef2 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:31.842067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-845b3be8-26fd-4c77-be4f-286744e02ef2 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:31.855562 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-845b3be8-26fd-4c77-be4f-286744e02ef2 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.173768 Jul 28 04:34:31.856297 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4428/6878] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:31 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:32.881637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-677cc700-cbf7-4a0f-9b65-acba5e92c474 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:32.882647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-677cc700-cbf7-4a0f-9b65-acba5e92c474 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:32.894462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-677cc700-cbf7-4a0f-9b65-acba5e92c474 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:32.895239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-677cc700-cbf7-4a0f-9b65-acba5e92c474 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:32.896574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-677cc700-cbf7-4a0f-9b65-acba5e92c474 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:32.897330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-677cc700-cbf7-4a0f-9b65-acba5e92c474 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:33.037565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-677cc700-cbf7-4a0f-9b65-acba5e92c474 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:33.045673 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-677cc700-cbf7-4a0f-9b65-acba5e92c474 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.170693 Jul 28 04:34:33.046233 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4429/6879] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:32 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:34.070480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b00e5dd0-ac8f-4b31-b0ff-f741126e7aa7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:34.071085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b00e5dd0-ac8f-4b31-b0ff-f741126e7aa7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:34.078680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b00e5dd0-ac8f-4b31-b0ff-f741126e7aa7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:34.079153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b00e5dd0-ac8f-4b31-b0ff-f741126e7aa7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:34.079930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b00e5dd0-ac8f-4b31-b0ff-f741126e7aa7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:34.080391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b00e5dd0-ac8f-4b31-b0ff-f741126e7aa7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:34.228664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b00e5dd0-ac8f-4b31-b0ff-f741126e7aa7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:34.236814 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b00e5dd0-ac8f-4b31-b0ff-f741126e7aa7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.170274 Jul 28 04:34:34.237394 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4430/6880] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:34 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:35.260625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-28d36a52-362c-4956-912f-f3cf5d44563a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:35.261492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-28d36a52-362c-4956-912f-f3cf5d44563a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:35.271744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28d36a52-362c-4956-912f-f3cf5d44563a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:35.272407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28d36a52-362c-4956-912f-f3cf5d44563a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:35.273524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28d36a52-362c-4956-912f-f3cf5d44563a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:35.274152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28d36a52-362c-4956-912f-f3cf5d44563a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:35.428694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-28d36a52-362c-4956-912f-f3cf5d44563a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:35.437299 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-28d36a52-362c-4956-912f-f3cf5d44563a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.182137 Jul 28 04:34:35.437891 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4431/6881] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:35 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:36.463429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3ed995f-d488-4451-81c2-f9b80bced9ed tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:36.464488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3ed995f-d488-4451-81c2-f9b80bced9ed tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:36.472839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3ed995f-d488-4451-81c2-f9b80bced9ed tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:36.473344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3ed995f-d488-4451-81c2-f9b80bced9ed tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:36.474136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3ed995f-d488-4451-81c2-f9b80bced9ed tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:36.474588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3ed995f-d488-4451-81c2-f9b80bced9ed tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:36.611102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3ed995f-d488-4451-81c2-f9b80bced9ed tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:36.619585 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3ed995f-d488-4451-81c2-f9b80bced9ed tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1523 microversion: 2.1 time: 0.163069 Jul 28 04:34:36.620163 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4432/6882] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:36 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:37.557496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-93111933-3da9-481b-b6df-17cd1712325b req-33d6fcc9-d304-4e36-82bd-7b8992fcfac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c", "name": "network-vif-unplugged", "status": "completed", "tag": "ab1ebcb1-c8e0-4ff7-b58a-744782ac5b80"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:34:37.568908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-93111933-3da9-481b-b6df-17cd1712325b req-33d6fcc9-d304-4e36-82bd-7b8992fcfac3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:37.569473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-93111933-3da9-481b-b6df-17cd1712325b req-33d6fcc9-d304-4e36-82bd-7b8992fcfac3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:37.573548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:34:37.582682 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-93111933-3da9-481b-b6df-17cd1712325b req-33d6fcc9-d304-4e36-82bd-7b8992fcfac3 service nova] Creating event network-vif-unplugged:ab1ebcb1-c8e0-4ff7-b58a-744782ac5b80 for instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c on n-h2-826756-3 Jul 28 04:34:37.588284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-93111933-3da9-481b-b6df-17cd1712325b req-33d6fcc9-d304-4e36-82bd-7b8992fcfac3 service nova] Instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:34:37.600038 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-93111933-3da9-481b-b6df-17cd1712325b req-33d6fcc9-d304-4e36-82bd-7b8992fcfac3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046318 Jul 28 04:34:37.600928 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4433/6883] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:34:37.642261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6429288b-3abd-4d03-861f-1b34d963ad92 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:37.643261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6429288b-3abd-4d03-861f-1b34d963ad92 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:37.651854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6429288b-3abd-4d03-861f-1b34d963ad92 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:37.652911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6429288b-3abd-4d03-861f-1b34d963ad92 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:37.653721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6429288b-3abd-4d03-861f-1b34d963ad92 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:37.654302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6429288b-3abd-4d03-861f-1b34d963ad92 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:37.799782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6429288b-3abd-4d03-861f-1b34d963ad92 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:37.809178 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6429288b-3abd-4d03-861f-1b34d963ad92 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1522 microversion: 2.1 time: 0.171294 Jul 28 04:34:37.810749 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4434/6884] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:37 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:38.832864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-848cc35a-88d3-435e-88d8-9eb8bd8c7a2b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:38.833589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-848cc35a-88d3-435e-88d8-9eb8bd8c7a2b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:38.840767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-848cc35a-88d3-435e-88d8-9eb8bd8c7a2b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:38.841224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-848cc35a-88d3-435e-88d8-9eb8bd8c7a2b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:38.841993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-848cc35a-88d3-435e-88d8-9eb8bd8c7a2b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:38.842443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-848cc35a-88d3-435e-88d8-9eb8bd8c7a2b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:38.988660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-848cc35a-88d3-435e-88d8-9eb8bd8c7a2b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:38.997338 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-848cc35a-88d3-435e-88d8-9eb8bd8c7a2b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1520 microversion: 2.1 time: 0.169181 Jul 28 04:34:38.998332 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4435/6885] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:38 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:39.616729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-054c8c2a-743c-4b66-8217-fb55fcd4a436 req-1dd2b746-741d-4c8f-a688-7501599792ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c", "tag": "ab1ebcb1-c8e0-4ff7-b58a-744782ac5b80"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:34:39.628338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-054c8c2a-743c-4b66-8217-fb55fcd4a436 req-1dd2b746-741d-4c8f-a688-7501599792ad service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:39.628829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-054c8c2a-743c-4b66-8217-fb55fcd4a436 req-1dd2b746-741d-4c8f-a688-7501599792ad service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:39.641299 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-054c8c2a-743c-4b66-8217-fb55fcd4a436 req-1dd2b746-741d-4c8f-a688-7501599792ad service nova] Creating event network-changed:ab1ebcb1-c8e0-4ff7-b58a-744782ac5b80 for instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c on n-h2-826756-3 Jul 28 04:34:39.647150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-054c8c2a-743c-4b66-8217-fb55fcd4a436 req-1dd2b746-741d-4c8f-a688-7501599792ad service nova] Instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:34:39.659435 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-054c8c2a-743c-4b66-8217-fb55fcd4a436 req-1dd2b746-741d-4c8f-a688-7501599792ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047134 Jul 28 04:34:39.660062 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4436/6886] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:34:40.023645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8058e181-7556-4345-8638-90d4de42a7fe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:40.024375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8058e181-7556-4345-8638-90d4de42a7fe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:40.031214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8058e181-7556-4345-8638-90d4de42a7fe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:40.031659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8058e181-7556-4345-8638-90d4de42a7fe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:40.032491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8058e181-7556-4345-8638-90d4de42a7fe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:40.032946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8058e181-7556-4345-8638-90d4de42a7fe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:40.192185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8058e181-7556-4345-8638-90d4de42a7fe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:40.201196 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8058e181-7556-4345-8638-90d4de42a7fe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1520 microversion: 2.1 time: 0.183031 Jul 28 04:34:40.201795 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4437/6887] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:40 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:34:41.224924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9012cb18-f3ac-4c16-be26-5c3e25147d46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:41.225572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9012cb18-f3ac-4c16-be26-5c3e25147d46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:41.233792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9012cb18-f3ac-4c16-be26-5c3e25147d46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:41.234276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9012cb18-f3ac-4c16-be26-5c3e25147d46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:41.235087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9012cb18-f3ac-4c16-be26-5c3e25147d46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:41.235511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9012cb18-f3ac-4c16-be26-5c3e25147d46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:41.384561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9012cb18-f3ac-4c16-be26-5c3e25147d46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:41.392969 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9012cb18-f3ac-4c16-be26-5c3e25147d46 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1517 microversion: 2.1 time: 0.172549 Jul 28 04:34:41.393542 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4438/6888] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:41 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:41.413632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-08fc3ed5-b032-4a1e-b7b1-b73c22040dbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:34:41.414217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-08fc3ed5-b032-4a1e-b7b1-b73c22040dbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:41.420678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08fc3ed5-b032-4a1e-b7b1-b73c22040dbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:41.421147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08fc3ed5-b032-4a1e-b7b1-b73c22040dbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:41.422131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08fc3ed5-b032-4a1e-b7b1-b73c22040dbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:41.422588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08fc3ed5-b032-4a1e-b7b1-b73c22040dbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:41.485151 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-08fc3ed5-b032-4a1e-b7b1-b73c22040dbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "POST /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c/action" status: 204 len: 0 microversion: 2.1 time: 0.074409 Jul 28 04:34:41.485705 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4439/6889] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:34:41 2022] POST /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:34:41.495186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d19bcd13-6965-402e-a9cb-a63da9f48b13 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:41.495915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d19bcd13-6965-402e-a9cb-a63da9f48b13 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:41.502745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d19bcd13-6965-402e-a9cb-a63da9f48b13 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:41.503417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d19bcd13-6965-402e-a9cb-a63da9f48b13 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:41.504380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d19bcd13-6965-402e-a9cb-a63da9f48b13 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:41.504953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d19bcd13-6965-402e-a9cb-a63da9f48b13 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:41.649224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d19bcd13-6965-402e-a9cb-a63da9f48b13 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:41.658302 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d19bcd13-6965-402e-a9cb-a63da9f48b13 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1517 microversion: 2.1 time: 0.167218 Jul 28 04:34:41.658917 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4440/6890] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:41 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:34:42.679749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-41f94ef2-b7da-44a7-b00d-5d4533b08f05 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:42.680511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-41f94ef2-b7da-44a7-b00d-5d4533b08f05 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:42.687616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41f94ef2-b7da-44a7-b00d-5d4533b08f05 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:42.688087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41f94ef2-b7da-44a7-b00d-5d4533b08f05 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:42.688916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41f94ef2-b7da-44a7-b00d-5d4533b08f05 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:42.689374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41f94ef2-b7da-44a7-b00d-5d4533b08f05 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:42.826218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-41f94ef2-b7da-44a7-b00d-5d4533b08f05 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:42.834348 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-41f94ef2-b7da-44a7-b00d-5d4533b08f05 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1509 microversion: 2.1 time: 0.158766 Jul 28 04:34:42.834931 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4441/6891] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:42 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:34:42.855319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6dc05e51-2e4f-4a61-a3db-bc0037f83b35 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:42.855956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6dc05e51-2e4f-4a61-a3db-bc0037f83b35 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:42.862283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dc05e51-2e4f-4a61-a3db-bc0037f83b35 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:42.862748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dc05e51-2e4f-4a61-a3db-bc0037f83b35 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:42.863531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dc05e51-2e4f-4a61-a3db-bc0037f83b35 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:42.863982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dc05e51-2e4f-4a61-a3db-bc0037f83b35 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:43.000708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6dc05e51-2e4f-4a61-a3db-bc0037f83b35 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:43.009052 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6dc05e51-2e4f-4a61-a3db-bc0037f83b35 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1509 microversion: 2.1 time: 0.157649 Jul 28 04:34:43.009946 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4442/6892] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:42 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:34:43.027573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-2232a9d8-6f53-4172-9269-0042d1c5f0ca req-157b9305-7985-4b92-9419-05af757198f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c", "name": "network-vif-plugged", "status": "completed", "tag": "ab1ebcb1-c8e0-4ff7-b58a-744782ac5b80"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:34:43.039974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2232a9d8-6f53-4172-9269-0042d1c5f0ca req-157b9305-7985-4b92-9419-05af757198f8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:43.040470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2232a9d8-6f53-4172-9269-0042d1c5f0ca req-157b9305-7985-4b92-9419-05af757198f8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:43.055436 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-2232a9d8-6f53-4172-9269-0042d1c5f0ca req-157b9305-7985-4b92-9419-05af757198f8 service nova] Creating event network-vif-plugged:ab1ebcb1-c8e0-4ff7-b58a-744782ac5b80 for instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c on n-h2-826756-3 Jul 28 04:34:43.062472 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-2232a9d8-6f53-4172-9269-0042d1c5f0ca req-157b9305-7985-4b92-9419-05af757198f8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046048 Jul 28 04:34:43.063125 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4443/6893] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:34:43.068995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40cc1d34-8447-470d-8a9e-14efea3dba25 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Action: 'create', calling method: .version_select at 0x7ffa67444940>, body: {"keypair": {"name": "tempest-keypair-1515216468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb9Q0PCREythYwOLc8VlpbTazAQ0tv7gKUp5U7hBQCBCcfFL91Sxon4ftRJa+qmKMcVVCwj0jV3oAVUFSMnNuMZv3TDj2qvyR+/1piQdMvjFGYhxu4THhg5BnU3fVpzCw=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:34:43.091532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-40cc1d34-8447-470d-8a9e-14efea3dba25 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Getting quotas for project 2c82cb536f094fd3a35b71d21ec6c519. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:34:43.098326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-40cc1d34-8447-470d-8a9e-14efea3dba25 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Getting quotas for user b8a6d116e47446cd828b6e3954ba41ce and project 2c82cb536f094fd3a35b71d21ec6c519. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:34:43.125032 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40cc1d34-8447-470d-8a9e-14efea3dba25 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060315 Jul 28 04:34:43.125599 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4444/6894] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:34:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:34:44.364245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ce141ca-06a5-4726-bf26-ab76fe0127af tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:44.365111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ce141ca-06a5-4726-bf26-ab76fe0127af tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:44.372048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ce141ca-06a5-4726-bf26-ab76fe0127af tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:44.372528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ce141ca-06a5-4726-bf26-ab76fe0127af tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:44.373310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ce141ca-06a5-4726-bf26-ab76fe0127af tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:44.373755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ce141ca-06a5-4726-bf26-ab76fe0127af tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:44.510963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2ce141ca-06a5-4726-bf26-ab76fe0127af tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:44.519213 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ce141ca-06a5-4726-bf26-ab76fe0127af tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 200 len: 1509 microversion: 2.1 time: 0.160163 Jul 28 04:34:44.519793 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4445/6895] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:44 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:44.539501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-918d63d1-a49f-4b13-9918-648d72571582 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:44.540040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-918d63d1-a49f-4b13-9918-648d72571582 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:44.546234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-918d63d1-a49f-4b13-9918-648d72571582 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:44.546747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-918d63d1-a49f-4b13-9918-648d72571582 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:44.547533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-918d63d1-a49f-4b13-9918-648d72571582 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:44.547984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-918d63d1-a49f-4b13-9918-648d72571582 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:44.572956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-918d63d1-a49f-4b13-9918-648d72571582 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:34:44.650228 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-918d63d1-a49f-4b13-9918-648d72571582 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 204 len: 0 microversion: 2.1 time: 0.114542 Jul 28 04:34:44.650881 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4446/6896] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:34:44 2022] DELETE /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:34:44.711570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1481499530", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "4c643524-038b-4789-82a3-fb6755df5285"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:34:44.772715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] validate_networks() for [('4c643524-038b-4789-82a3-fb6755df5285', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:34:45.174842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:34:45.175276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:34:45.175758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:34:45.176177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:34:45.176642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:34:45.186258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:45.186723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:45.187669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:45.187988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:45.208321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Getting quotas for project 2c82cb536f094fd3a35b71d21ec6c519. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:34:45.213841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Getting quotas for user b8a6d116e47446cd828b6e3954ba41ce and project 2c82cb536f094fd3a35b71d21ec6c519. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:34:45.227870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:34:45.230404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:34:45.278187 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-36ce2c3a-f85e-4222-9220-940cf2119669 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570901 Jul 28 04:34:45.278867 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4447/6897] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:34:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:34:45.290015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3868842b-1e51-4997-a6a4-327bf1e10094 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:45.290649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3868842b-1e51-4997-a6a4-327bf1e10094 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:45.355329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3868842b-1e51-4997-a6a4-327bf1e10094 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:45.364018 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3868842b-1e51-4997-a6a4-327bf1e10094 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1218 microversion: 2.1 time: 0.077900 Jul 28 04:34:45.364670 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4448/6898] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:45 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:46.388326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-af687ece-e45f-47f5-9291-b1cbb9348cbd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:46.389082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-af687ece-e45f-47f5-9291-b1cbb9348cbd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:46.398984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af687ece-e45f-47f5-9291-b1cbb9348cbd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:46.399446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af687ece-e45f-47f5-9291-b1cbb9348cbd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:46.400345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af687ece-e45f-47f5-9291-b1cbb9348cbd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:46.400834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-af687ece-e45f-47f5-9291-b1cbb9348cbd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:46.471057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-af687ece-e45f-47f5-9291-b1cbb9348cbd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:46.479623 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-af687ece-e45f-47f5-9291-b1cbb9348cbd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1270 microversion: 2.1 time: 0.096928 Jul 28 04:34:46.480432 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4449/6899] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:46 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:47.280274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-92231d70-adfd-430b-aaa1-8a6e9ad9381b req-124eb24c-2b53-416f-afa4-98882373865a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c", "name": "network-vif-deleted", "tag": "ab1ebcb1-c8e0-4ff7-b58a-744782ac5b80"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:34:47.290360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-92231d70-adfd-430b-aaa1-8a6e9ad9381b req-124eb24c-2b53-416f-afa4-98882373865a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:47.290903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-92231d70-adfd-430b-aaa1-8a6e9ad9381b req-124eb24c-2b53-416f-afa4-98882373865a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:47.308254 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-92231d70-adfd-430b-aaa1-8a6e9ad9381b req-124eb24c-2b53-416f-afa4-98882373865a service nova] Creating event network-vif-deleted:ab1ebcb1-c8e0-4ff7-b58a-744782ac5b80 for instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c on n-h2-826756-3 Jul 28 04:34:47.313370 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-92231d70-adfd-430b-aaa1-8a6e9ad9381b req-124eb24c-2b53-416f-afa4-98882373865a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036694 Jul 28 04:34:47.314597 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4450/6900] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:34:47.505683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8515aa51-d241-42d0-bbf0-af5c15847afc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:47.507222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8515aa51-d241-42d0-bbf0-af5c15847afc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:47.514532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8515aa51-d241-42d0-bbf0-af5c15847afc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:47.515137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8515aa51-d241-42d0-bbf0-af5c15847afc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:47.516204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8515aa51-d241-42d0-bbf0-af5c15847afc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:47.516760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8515aa51-d241-42d0-bbf0-af5c15847afc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:47.587192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8515aa51-d241-42d0-bbf0-af5c15847afc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:47.590815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:34:47.599585 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8515aa51-d241-42d0-bbf0-af5c15847afc tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1276 microversion: 2.1 time: 0.099934 Jul 28 04:34:47.600200 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4451/6901] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:47 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1276 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:48.626940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f692f980-c4d4-4afe-9e88-99b675d1be39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:48.627561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f692f980-c4d4-4afe-9e88-99b675d1be39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:48.634709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f692f980-c4d4-4afe-9e88-99b675d1be39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:48.635186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f692f980-c4d4-4afe-9e88-99b675d1be39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:48.635968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f692f980-c4d4-4afe-9e88-99b675d1be39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:48.636440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f692f980-c4d4-4afe-9e88-99b675d1be39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:48.774071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f692f980-c4d4-4afe-9e88-99b675d1be39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:48.782281 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f692f980-c4d4-4afe-9e88-99b675d1be39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1318 microversion: 2.1 time: 0.161764 Jul 28 04:34:48.782858 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4452/6902] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:48 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:49.334628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-fa3d7103-48f2-493e-baec-25bb43914f86 req-15ef9c7b-4b76-481d-9867-382ccd893a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26a55f29-0f25-4617-9fed-1711382bd754", "tag": "0a61d634-c75f-4db4-b0cc-0a966be85c63"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:34:49.345101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fa3d7103-48f2-493e-baec-25bb43914f86 req-15ef9c7b-4b76-481d-9867-382ccd893a44 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:49.345559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fa3d7103-48f2-493e-baec-25bb43914f86 req-15ef9c7b-4b76-481d-9867-382ccd893a44 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:49.357629 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-fa3d7103-48f2-493e-baec-25bb43914f86 req-15ef9c7b-4b76-481d-9867-382ccd893a44 service nova] Creating event network-changed:0a61d634-c75f-4db4-b0cc-0a966be85c63 for instance 26a55f29-0f25-4617-9fed-1711382bd754 on n-h2-826756-3 Jul 28 04:34:49.362708 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-fa3d7103-48f2-493e-baec-25bb43914f86 req-15ef9c7b-4b76-481d-9867-382ccd893a44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031883 Jul 28 04:34:49.363316 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4453/6903] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:34:49.809673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-368de01f-3a90-41a1-b980-4a17b326f579 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:49.810429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-368de01f-3a90-41a1-b980-4a17b326f579 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:49.813262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:34:49.819673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-368de01f-3a90-41a1-b980-4a17b326f579 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:49.820198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-368de01f-3a90-41a1-b980-4a17b326f579 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:49.821483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-368de01f-3a90-41a1-b980-4a17b326f579 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:49.822085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-368de01f-3a90-41a1-b980-4a17b326f579 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:49.973943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-368de01f-3a90-41a1-b980-4a17b326f579 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:49.981844 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-368de01f-3a90-41a1-b980-4a17b326f579 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1318 microversion: 2.1 time: 0.180483 Jul 28 04:34:49.982466 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4454/6904] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:49 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:34:51.003244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3132a613-6651-459d-8a55-d38c770fd84d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:51.003863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3132a613-6651-459d-8a55-d38c770fd84d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:51.011180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3132a613-6651-459d-8a55-d38c770fd84d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:51.011682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3132a613-6651-459d-8a55-d38c770fd84d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:51.012519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3132a613-6651-459d-8a55-d38c770fd84d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:51.012969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3132a613-6651-459d-8a55-d38c770fd84d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:51.161985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3132a613-6651-459d-8a55-d38c770fd84d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:51.170625 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3132a613-6651-459d-8a55-d38c770fd84d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1318 microversion: 2.1 time: 0.171365 Jul 28 04:34:51.171224 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4455/6905] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:50 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:52.194652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa02a120-77d7-4f29-8c67-958552208643 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:52.195553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fa02a120-77d7-4f29-8c67-958552208643 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:52.205098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa02a120-77d7-4f29-8c67-958552208643 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:52.205700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa02a120-77d7-4f29-8c67-958552208643 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:52.206719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa02a120-77d7-4f29-8c67-958552208643 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:52.207312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa02a120-77d7-4f29-8c67-958552208643 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:52.358754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa02a120-77d7-4f29-8c67-958552208643 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:52.371085 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fa02a120-77d7-4f29-8c67-958552208643 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1318 microversion: 2.1 time: 0.181851 Jul 28 04:34:52.371907 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4456/6906] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:52 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:34:53.024136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c00aa18c-fc49-4c4c-96e8-06441df94fbb req-9aa59dcb-c9b9-4422-aa38-939054503dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a55f29-0f25-4617-9fed-1711382bd754", "name": "network-vif-plugged", "status": "completed", "tag": "0a61d634-c75f-4db4-b0cc-0a966be85c63"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:34:53.034901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c00aa18c-fc49-4c4c-96e8-06441df94fbb req-9aa59dcb-c9b9-4422-aa38-939054503dd9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:53.035424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c00aa18c-fc49-4c4c-96e8-06441df94fbb req-9aa59dcb-c9b9-4422-aa38-939054503dd9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:53.053354 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c00aa18c-fc49-4c4c-96e8-06441df94fbb req-9aa59dcb-c9b9-4422-aa38-939054503dd9 service nova] Creating event network-vif-plugged:0a61d634-c75f-4db4-b0cc-0a966be85c63 for instance 26a55f29-0f25-4617-9fed-1711382bd754 on n-h2-826756-3 Jul 28 04:34:53.058585 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c00aa18c-fc49-4c4c-96e8-06441df94fbb req-9aa59dcb-c9b9-4422-aa38-939054503dd9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038695 Jul 28 04:34:53.059452 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4457/6907] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:34:53.395082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-370c991f-c629-425c-b6a9-90cfdcc1d07a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:53.395739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-370c991f-c629-425c-b6a9-90cfdcc1d07a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:53.402831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-370c991f-c629-425c-b6a9-90cfdcc1d07a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:53.404408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-370c991f-c629-425c-b6a9-90cfdcc1d07a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:53.404408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-370c991f-c629-425c-b6a9-90cfdcc1d07a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:53.404762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-370c991f-c629-425c-b6a9-90cfdcc1d07a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:53.540470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-370c991f-c629-425c-b6a9-90cfdcc1d07a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:53.548632 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-370c991f-c629-425c-b6a9-90cfdcc1d07a tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1318 microversion: 2.1 time: 0.159256 Jul 28 04:34:53.549219 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4458/6908] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:53 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:34:54.569621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-763d8dd9-e9a9-4a41-8633-c7ac7afed1b9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:54.570307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-763d8dd9-e9a9-4a41-8633-c7ac7afed1b9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:54.577583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-763d8dd9-e9a9-4a41-8633-c7ac7afed1b9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:54.578097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-763d8dd9-e9a9-4a41-8633-c7ac7afed1b9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:54.578890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-763d8dd9-e9a9-4a41-8633-c7ac7afed1b9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:54.579374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-763d8dd9-e9a9-4a41-8633-c7ac7afed1b9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:54.721444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-763d8dd9-e9a9-4a41-8633-c7ac7afed1b9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:54.729917 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-763d8dd9-e9a9-4a41-8633-c7ac7afed1b9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1509 microversion: 2.1 time: 0.164341 Jul 28 04:34:54.730487 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4459/6909] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:54 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:54.750383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9513013a-e612-44e2-9f1c-2b10fc1903e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:54.751019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9513013a-e612-44e2-9f1c-2b10fc1903e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:54.757115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9513013a-e612-44e2-9f1c-2b10fc1903e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:54.757584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9513013a-e612-44e2-9f1c-2b10fc1903e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:54.758357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9513013a-e612-44e2-9f1c-2b10fc1903e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:54.758789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9513013a-e612-44e2-9f1c-2b10fc1903e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:54.891159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9513013a-e612-44e2-9f1c-2b10fc1903e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:54.899275 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9513013a-e612-44e2-9f1c-2b10fc1903e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1509 microversion: 2.1 time: 0.152853 Jul 28 04:34:54.899874 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4460/6910] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:54 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:54.919644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ec01169-0c9b-4c46-bfa4-4061d43d5a39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:34:54.922071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ec01169-0c9b-4c46-bfa4-4061d43d5a39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:54.928057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ec01169-0c9b-4c46-bfa4-4061d43d5a39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:54.928568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ec01169-0c9b-4c46-bfa4-4061d43d5a39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:54.929353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ec01169-0c9b-4c46-bfa4-4061d43d5a39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:54.929801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ec01169-0c9b-4c46-bfa4-4061d43d5a39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:54.958574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ec01169-0c9b-4c46-bfa4-4061d43d5a39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:54.964787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ec01169-0c9b-4c46-bfa4-4061d43d5a39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Old instance type m1.heat2, new instance type m1.heat {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 04:34:54.971740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0ec01169-0c9b-4c46-bfa4-4061d43d5a39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:34:54.972175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0ec01169-0c9b-4c46-bfa4-4061d43d5a39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:34:54.973091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0ec01169-0c9b-4c46-bfa4-4061d43d5a39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:34:54.973517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0ec01169-0c9b-4c46-bfa4-4061d43d5a39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:34:54.973939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0ec01169-0c9b-4c46-bfa4-4061d43d5a39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:34:55.041763 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ec01169-0c9b-4c46-bfa4-4061d43d5a39 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "POST /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754/action" status: 202 len: 0 microversion: 2.1 time: 0.125705 Jul 28 04:34:55.045753 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4461/6911] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:34:54 2022] POST /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:34:55.054836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a548563b-8bdb-4ced-ab23-82807793f368 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:55.054917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a548563b-8bdb-4ced-ab23-82807793f368 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:55.061892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a548563b-8bdb-4ced-ab23-82807793f368 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:55.062355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a548563b-8bdb-4ced-ab23-82807793f368 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:55.063216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a548563b-8bdb-4ced-ab23-82807793f368 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:55.063695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a548563b-8bdb-4ced-ab23-82807793f368 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:55.199331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:34:55.209257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a548563b-8bdb-4ced-ab23-82807793f368 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:55.217746 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a548563b-8bdb-4ced-ab23-82807793f368 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1516 microversion: 2.1 time: 0.167723 Jul 28 04:34:55.218572 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4462/6912] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:55 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:56.240626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b6ae1bce-f553-4d30-a0ef-26f53714248c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:56.241266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b6ae1bce-f553-4d30-a0ef-26f53714248c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:56.243925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:34:56.250466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6ae1bce-f553-4d30-a0ef-26f53714248c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:56.250936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6ae1bce-f553-4d30-a0ef-26f53714248c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:56.251724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6ae1bce-f553-4d30-a0ef-26f53714248c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:56.252181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6ae1bce-f553-4d30-a0ef-26f53714248c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:56.392076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b6ae1bce-f553-4d30-a0ef-26f53714248c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:56.400049 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b6ae1bce-f553-4d30-a0ef-26f53714248c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1516 microversion: 2.1 time: 0.163912 Jul 28 04:34:56.400682 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4463/6913] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:56 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:57.421516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-24d31375-b544-4d09-ad1b-c7951128f0e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:57.422202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-24d31375-b544-4d09-ad1b-c7951128f0e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:57.429768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24d31375-b544-4d09-ad1b-c7951128f0e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:57.430226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24d31375-b544-4d09-ad1b-c7951128f0e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:57.430995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24d31375-b544-4d09-ad1b-c7951128f0e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:57.431441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-24d31375-b544-4d09-ad1b-c7951128f0e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:57.566018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-24d31375-b544-4d09-ad1b-c7951128f0e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:57.574543 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-24d31375-b544-4d09-ad1b-c7951128f0e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.157076 Jul 28 04:34:57.575131 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4464/6914] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:57 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:58.596632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0498e328-455f-4150-9214-c55d7179b7e6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:58.597291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0498e328-455f-4150-9214-c55d7179b7e6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:58.605148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0498e328-455f-4150-9214-c55d7179b7e6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:58.605606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0498e328-455f-4150-9214-c55d7179b7e6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:58.606378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0498e328-455f-4150-9214-c55d7179b7e6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:58.607053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0498e328-455f-4150-9214-c55d7179b7e6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:58.752609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0498e328-455f-4150-9214-c55d7179b7e6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:58.763214 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0498e328-455f-4150-9214-c55d7179b7e6 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.170587 Jul 28 04:34:58.766132 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4465/6915] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:58 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:34:59.785448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-23893bb1-b9e2-40c9-b150-1f375154be5c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:34:59.786130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-23893bb1-b9e2-40c9-b150-1f375154be5c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:34:59.793706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23893bb1-b9e2-40c9-b150-1f375154be5c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:59.794177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23893bb1-b9e2-40c9-b150-1f375154be5c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:59.794970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23893bb1-b9e2-40c9-b150-1f375154be5c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:34:59.795422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23893bb1-b9e2-40c9-b150-1f375154be5c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:34:59.929828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-23893bb1-b9e2-40c9-b150-1f375154be5c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:34:59.938225 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-23893bb1-b9e2-40c9-b150-1f375154be5c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.156792 Jul 28 04:34:59.938810 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4466/6916] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:34:59 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:00.960082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f6f4ea47-f781-4a83-9f50-6888d46e4cae tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:00.960830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f6f4ea47-f781-4a83-9f50-6888d46e4cae tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:00.968204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6f4ea47-f781-4a83-9f50-6888d46e4cae tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:00.968690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6f4ea47-f781-4a83-9f50-6888d46e4cae tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:00.969452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6f4ea47-f781-4a83-9f50-6888d46e4cae tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:00.969912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6f4ea47-f781-4a83-9f50-6888d46e4cae tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:01.108520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f6f4ea47-f781-4a83-9f50-6888d46e4cae tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:01.116542 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f6f4ea47-f781-4a83-9f50-6888d46e4cae tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.160655 Jul 28 04:35:01.117121 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4467/6917] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:00 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:02.138338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b523fbef-5ad5-4d38-abe6-dd069fca0a3c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:02.139025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b523fbef-5ad5-4d38-abe6-dd069fca0a3c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:02.146613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b523fbef-5ad5-4d38-abe6-dd069fca0a3c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:02.147196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b523fbef-5ad5-4d38-abe6-dd069fca0a3c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:02.147976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b523fbef-5ad5-4d38-abe6-dd069fca0a3c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:02.148452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b523fbef-5ad5-4d38-abe6-dd069fca0a3c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:02.166067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:35:02.288694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b523fbef-5ad5-4d38-abe6-dd069fca0a3c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:02.296993 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b523fbef-5ad5-4d38-abe6-dd069fca0a3c tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.162697 Jul 28 04:35:02.297618 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4468/6918] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:02 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:03.322482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-361910a0-d57f-46bf-92ca-a5804183a9ce tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:03.323462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-361910a0-d57f-46bf-92ca-a5804183a9ce tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:03.332171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-361910a0-d57f-46bf-92ca-a5804183a9ce tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:03.332672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-361910a0-d57f-46bf-92ca-a5804183a9ce tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:03.333450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-361910a0-d57f-46bf-92ca-a5804183a9ce tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:03.333899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-361910a0-d57f-46bf-92ca-a5804183a9ce tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:03.473113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-361910a0-d57f-46bf-92ca-a5804183a9ce tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:03.481371 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-361910a0-d57f-46bf-92ca-a5804183a9ce tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.165454 Jul 28 04:35:03.481984 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4469/6919] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:03 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:04.503081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5619e3fc-c88f-4887-9c90-8f3556c4ac25 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:04.503753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5619e3fc-c88f-4887-9c90-8f3556c4ac25 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:04.511395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5619e3fc-c88f-4887-9c90-8f3556c4ac25 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:04.511868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5619e3fc-c88f-4887-9c90-8f3556c4ac25 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:04.512668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5619e3fc-c88f-4887-9c90-8f3556c4ac25 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:04.513125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5619e3fc-c88f-4887-9c90-8f3556c4ac25 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:04.655469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5619e3fc-c88f-4887-9c90-8f3556c4ac25 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:04.663896 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5619e3fc-c88f-4887-9c90-8f3556c4ac25 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.164850 Jul 28 04:35:04.664519 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4470/6920] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:04 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:05.686436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b7fa2c8-6f5d-4f12-a454-2e335e8dc77e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:05.687143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3b7fa2c8-6f5d-4f12-a454-2e335e8dc77e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:05.695846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b7fa2c8-6f5d-4f12-a454-2e335e8dc77e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:05.696435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b7fa2c8-6f5d-4f12-a454-2e335e8dc77e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:05.697197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b7fa2c8-6f5d-4f12-a454-2e335e8dc77e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:05.697652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b7fa2c8-6f5d-4f12-a454-2e335e8dc77e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:05.817424 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:35:05.817977 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:35:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:35:05.845399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3b7fa2c8-6f5d-4f12-a454-2e335e8dc77e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:05.853879 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3b7fa2c8-6f5d-4f12-a454-2e335e8dc77e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.171510 Jul 28 04:35:05.854454 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4471/6921] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:05 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:35:06.877908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-060bc92f-2693-4894-9290-5bcfc99ab607 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:06.878873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-060bc92f-2693-4894-9290-5bcfc99ab607 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:06.887717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-060bc92f-2693-4894-9290-5bcfc99ab607 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:06.888230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-060bc92f-2693-4894-9290-5bcfc99ab607 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:06.889043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-060bc92f-2693-4894-9290-5bcfc99ab607 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:06.889508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-060bc92f-2693-4894-9290-5bcfc99ab607 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:07.035079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-060bc92f-2693-4894-9290-5bcfc99ab607 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:07.044888 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-060bc92f-2693-4894-9290-5bcfc99ab607 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.171952 Jul 28 04:35:07.045593 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4472/6922] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:06 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:08.067005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5f60ee3-207f-489c-a65f-a5cb1172b348 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:08.067817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b5f60ee3-207f-489c-a65f-a5cb1172b348 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:08.079896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5f60ee3-207f-489c-a65f-a5cb1172b348 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:08.080660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5f60ee3-207f-489c-a65f-a5cb1172b348 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:08.081971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5f60ee3-207f-489c-a65f-a5cb1172b348 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:08.082484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5f60ee3-207f-489c-a65f-a5cb1172b348 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:08.223219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b5f60ee3-207f-489c-a65f-a5cb1172b348 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:08.231130 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5f60ee3-207f-489c-a65f-a5cb1172b348 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.168307 Jul 28 04:35:08.231721 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4473/6923] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:08 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:09.255730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ebb8f361-7e73-4492-8dbe-007bdc68f76d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:09.258557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ebb8f361-7e73-4492-8dbe-007bdc68f76d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:09.270499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebb8f361-7e73-4492-8dbe-007bdc68f76d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:09.271270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebb8f361-7e73-4492-8dbe-007bdc68f76d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:09.272538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebb8f361-7e73-4492-8dbe-007bdc68f76d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:09.273197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebb8f361-7e73-4492-8dbe-007bdc68f76d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:09.414201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ebb8f361-7e73-4492-8dbe-007bdc68f76d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:09.422535 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ebb8f361-7e73-4492-8dbe-007bdc68f76d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.172953 Jul 28 04:35:09.423202 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4474/6924] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:09 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:35:10.446339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b43534c6-6e5a-459c-ac16-cebf1ec2437d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:10.446985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b43534c6-6e5a-459c-ac16-cebf1ec2437d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:10.454368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b43534c6-6e5a-459c-ac16-cebf1ec2437d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:10.454852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b43534c6-6e5a-459c-ac16-cebf1ec2437d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:10.455618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b43534c6-6e5a-459c-ac16-cebf1ec2437d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:10.456084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b43534c6-6e5a-459c-ac16-cebf1ec2437d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:10.592082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b43534c6-6e5a-459c-ac16-cebf1ec2437d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:10.601386 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b43534c6-6e5a-459c-ac16-cebf1ec2437d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.159175 Jul 28 04:35:10.601977 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4475/6925] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:10 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:11.623175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c8cbc64b-efe2-40e8-b349-8ee6a4a3dd54 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:11.623894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c8cbc64b-efe2-40e8-b349-8ee6a4a3dd54 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:11.631830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8cbc64b-efe2-40e8-b349-8ee6a4a3dd54 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:11.632295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8cbc64b-efe2-40e8-b349-8ee6a4a3dd54 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:11.633120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8cbc64b-efe2-40e8-b349-8ee6a4a3dd54 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:11.633571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8cbc64b-efe2-40e8-b349-8ee6a4a3dd54 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:11.782791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c8cbc64b-efe2-40e8-b349-8ee6a4a3dd54 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:11.792178 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c8cbc64b-efe2-40e8-b349-8ee6a4a3dd54 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.173017 Jul 28 04:35:11.792808 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4476/6926] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:11 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:12.814573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0218fa28-0d9a-419a-bcb5-af67d97720a8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:12.815270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0218fa28-0d9a-419a-bcb5-af67d97720a8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:12.822821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0218fa28-0d9a-419a-bcb5-af67d97720a8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:12.823290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0218fa28-0d9a-419a-bcb5-af67d97720a8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:12.824085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0218fa28-0d9a-419a-bcb5-af67d97720a8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:12.824597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0218fa28-0d9a-419a-bcb5-af67d97720a8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:12.962219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0218fa28-0d9a-419a-bcb5-af67d97720a8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:12.971327 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0218fa28-0d9a-419a-bcb5-af67d97720a8 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.160898 Jul 28 04:35:12.971910 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4477/6927] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:12 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:13.993724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-72a7cbce-da5f-4603-8fec-0e79cee042e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:13.994507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-72a7cbce-da5f-4603-8fec-0e79cee042e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:14.002221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72a7cbce-da5f-4603-8fec-0e79cee042e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:14.002692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72a7cbce-da5f-4603-8fec-0e79cee042e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:14.003455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72a7cbce-da5f-4603-8fec-0e79cee042e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:14.003904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72a7cbce-da5f-4603-8fec-0e79cee042e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:14.150453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-72a7cbce-da5f-4603-8fec-0e79cee042e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:14.160984 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-72a7cbce-da5f-4603-8fec-0e79cee042e3 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.171200 Jul 28 04:35:14.161600 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4478/6928] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:13 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:35:15.185308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2116d9f6-5694-433b-b9d9-0489bdffc27e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:15.185953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2116d9f6-5694-433b-b9d9-0489bdffc27e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:15.193575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2116d9f6-5694-433b-b9d9-0489bdffc27e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:15.194051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2116d9f6-5694-433b-b9d9-0489bdffc27e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:15.194987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2116d9f6-5694-433b-b9d9-0489bdffc27e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:15.195339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2116d9f6-5694-433b-b9d9-0489bdffc27e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:15.351799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2116d9f6-5694-433b-b9d9-0489bdffc27e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:15.360425 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2116d9f6-5694-433b-b9d9-0489bdffc27e tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.179178 Jul 28 04:35:15.361037 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4479/6929] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:15 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:16.383604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-81d4c425-5a71-42a3-b647-80ea0cac707f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:16.384265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-81d4c425-5a71-42a3-b647-80ea0cac707f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:16.394203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81d4c425-5a71-42a3-b647-80ea0cac707f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:16.394665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81d4c425-5a71-42a3-b647-80ea0cac707f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:16.395453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81d4c425-5a71-42a3-b647-80ea0cac707f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:16.395906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-81d4c425-5a71-42a3-b647-80ea0cac707f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:16.535057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-81d4c425-5a71-42a3-b647-80ea0cac707f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:16.543350 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-81d4c425-5a71-42a3-b647-80ea0cac707f tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.164659 Jul 28 04:35:16.543998 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4480/6930] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:16 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:35:17.564771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43525f6d-4b3b-41dc-9176-fd0321b4ee09 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:17.565485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-43525f6d-4b3b-41dc-9176-fd0321b4ee09 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:17.576102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43525f6d-4b3b-41dc-9176-fd0321b4ee09 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:17.576841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43525f6d-4b3b-41dc-9176-fd0321b4ee09 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:17.578070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43525f6d-4b3b-41dc-9176-fd0321b4ee09 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:17.578564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43525f6d-4b3b-41dc-9176-fd0321b4ee09 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:17.715149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-43525f6d-4b3b-41dc-9176-fd0321b4ee09 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:17.725114 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43525f6d-4b3b-41dc-9176-fd0321b4ee09 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.164200 Jul 28 04:35:17.725987 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4481/6931] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:17 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:18.748102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a3b381e0-341a-44a5-8ada-14c6f6424b4b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:18.748849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a3b381e0-341a-44a5-8ada-14c6f6424b4b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:18.756474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3b381e0-341a-44a5-8ada-14c6f6424b4b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:18.756942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3b381e0-341a-44a5-8ada-14c6f6424b4b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:18.757734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3b381e0-341a-44a5-8ada-14c6f6424b4b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:18.758184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3b381e0-341a-44a5-8ada-14c6f6424b4b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:18.895771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a3b381e0-341a-44a5-8ada-14c6f6424b4b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:18.905107 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a3b381e0-341a-44a5-8ada-14c6f6424b4b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.161055 Jul 28 04:35:18.905661 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4482/6932] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:18 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:19.928032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-88a18f5b-7d57-4c3c-a446-14f0ffc69b98 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:19.928739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-88a18f5b-7d57-4c3c-a446-14f0ffc69b98 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:19.931626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=62 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:35:19.938165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88a18f5b-7d57-4c3c-a446-14f0ffc69b98 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:19.938654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88a18f5b-7d57-4c3c-a446-14f0ffc69b98 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:19.939435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88a18f5b-7d57-4c3c-a446-14f0ffc69b98 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:19.939880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88a18f5b-7d57-4c3c-a446-14f0ffc69b98 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:20.098296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-88a18f5b-7d57-4c3c-a446-14f0ffc69b98 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:20.110988 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-88a18f5b-7d57-4c3c-a446-14f0ffc69b98 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.187562 Jul 28 04:35:20.111916 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4483/6933] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:19 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:21.135892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-33cdde1a-c771-44a3-84c8-bc0a532c5c51 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:21.136622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-33cdde1a-c771-44a3-84c8-bc0a532c5c51 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:21.144605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33cdde1a-c771-44a3-84c8-bc0a532c5c51 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:21.145070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33cdde1a-c771-44a3-84c8-bc0a532c5c51 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:21.145846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33cdde1a-c771-44a3-84c8-bc0a532c5c51 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:21.146471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33cdde1a-c771-44a3-84c8-bc0a532c5c51 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:21.287354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-33cdde1a-c771-44a3-84c8-bc0a532c5c51 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:21.295472 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-33cdde1a-c771-44a3-84c8-bc0a532c5c51 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.164128 Jul 28 04:35:21.296052 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4484/6934] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:21 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:22.317345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9b7ec59e-d984-4c20-b4d4-a484819cb479 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:22.318004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9b7ec59e-d984-4c20-b4d4-a484819cb479 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:22.325439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b7ec59e-d984-4c20-b4d4-a484819cb479 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:22.325891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b7ec59e-d984-4c20-b4d4-a484819cb479 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:22.326674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b7ec59e-d984-4c20-b4d4-a484819cb479 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:22.327118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9b7ec59e-d984-4c20-b4d4-a484819cb479 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:22.329769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:35:22.479774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9b7ec59e-d984-4c20-b4d4-a484819cb479 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:22.491783 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9b7ec59e-d984-4c20-b4d4-a484819cb479 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.178222 Jul 28 04:35:22.492632 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4485/6935] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:22 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:23.517824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b4075966-20ba-4a08-9b36-6373f4595125 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:23.518541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4075966-20ba-4a08-9b36-6373f4595125 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:23.526180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4075966-20ba-4a08-9b36-6373f4595125 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:23.526552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4075966-20ba-4a08-9b36-6373f4595125 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:23.527338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4075966-20ba-4a08-9b36-6373f4595125 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:23.527775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4075966-20ba-4a08-9b36-6373f4595125 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:23.676932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b4075966-20ba-4a08-9b36-6373f4595125 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:23.686239 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b4075966-20ba-4a08-9b36-6373f4595125 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1521 microversion: 2.1 time: 0.172380 Jul 28 04:35:23.686896 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4486/6936] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:23 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:24.708696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa7e2063-677d-4158-89c2-86ba7e0dd514 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:24.709376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fa7e2063-677d-4158-89c2-86ba7e0dd514 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:24.716842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa7e2063-677d-4158-89c2-86ba7e0dd514 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:24.717200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa7e2063-677d-4158-89c2-86ba7e0dd514 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:24.717959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa7e2063-677d-4158-89c2-86ba7e0dd514 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:24.718467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa7e2063-677d-4158-89c2-86ba7e0dd514 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:24.867115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa7e2063-677d-4158-89c2-86ba7e0dd514 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:24.875352 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fa7e2063-677d-4158-89c2-86ba7e0dd514 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1520 microversion: 2.1 time: 0.171693 Jul 28 04:35:24.876405 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4487/6937] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:24 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:24.881540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4ccab6b0-f307-4bf3-b9fe-9f98c3302850 req-57b6dc9f-9450-4bd4-a049-0abec4c477fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a55f29-0f25-4617-9fed-1711382bd754", "name": "network-vif-unplugged", "status": "completed", "tag": "0a61d634-c75f-4db4-b0cc-0a966be85c63"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:35:24.895667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4ccab6b0-f307-4bf3-b9fe-9f98c3302850 req-57b6dc9f-9450-4bd4-a049-0abec4c477fd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:24.896135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4ccab6b0-f307-4bf3-b9fe-9f98c3302850 req-57b6dc9f-9450-4bd4-a049-0abec4c477fd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:24.908529 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4ccab6b0-f307-4bf3-b9fe-9f98c3302850 req-57b6dc9f-9450-4bd4-a049-0abec4c477fd service nova] Creating event network-vif-unplugged:0a61d634-c75f-4db4-b0cc-0a966be85c63 for instance 26a55f29-0f25-4617-9fed-1711382bd754 on n-h1-826756-3 Jul 28 04:35:24.915519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-4ccab6b0-f307-4bf3-b9fe-9f98c3302850 req-57b6dc9f-9450-4bd4-a049-0abec4c477fd service nova] Instance 26a55f29-0f25-4617-9fed-1711382bd754 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:35:24.927419 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4ccab6b0-f307-4bf3-b9fe-9f98c3302850 req-57b6dc9f-9450-4bd4-a049-0abec4c477fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049421 Jul 28 04:35:24.929004 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4488/6938] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:35:25.900081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4088934e-eacd-42c8-8547-bc2c0b5d574d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:25.900820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4088934e-eacd-42c8-8547-bc2c0b5d574d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:25.909865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4088934e-eacd-42c8-8547-bc2c0b5d574d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:25.910341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4088934e-eacd-42c8-8547-bc2c0b5d574d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:25.911162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4088934e-eacd-42c8-8547-bc2c0b5d574d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:25.911755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4088934e-eacd-42c8-8547-bc2c0b5d574d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:26.054828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4088934e-eacd-42c8-8547-bc2c0b5d574d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:26.063097 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4088934e-eacd-42c8-8547-bc2c0b5d574d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1520 microversion: 2.1 time: 0.167408 Jul 28 04:35:26.063674 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4489/6939] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:25 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:26.948220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0fbab6df-706f-483d-9f6d-cf0292f2e842 req-2d27f02d-b1d4-4827-8876-19c01a265778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26a55f29-0f25-4617-9fed-1711382bd754", "tag": "0a61d634-c75f-4db4-b0cc-0a966be85c63"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:35:26.959185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0fbab6df-706f-483d-9f6d-cf0292f2e842 req-2d27f02d-b1d4-4827-8876-19c01a265778 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:26.959638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0fbab6df-706f-483d-9f6d-cf0292f2e842 req-2d27f02d-b1d4-4827-8876-19c01a265778 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:26.971808 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0fbab6df-706f-483d-9f6d-cf0292f2e842 req-2d27f02d-b1d4-4827-8876-19c01a265778 service nova] Creating event network-changed:0a61d634-c75f-4db4-b0cc-0a966be85c63 for instance 26a55f29-0f25-4617-9fed-1711382bd754 on n-h1-826756-3 Jul 28 04:35:26.978148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-0fbab6df-706f-483d-9f6d-cf0292f2e842 req-2d27f02d-b1d4-4827-8876-19c01a265778 service nova] Instance 26a55f29-0f25-4617-9fed-1711382bd754 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:35:26.989242 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0fbab6df-706f-483d-9f6d-cf0292f2e842 req-2d27f02d-b1d4-4827-8876-19c01a265778 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044742 Jul 28 04:35:26.990232 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4490/6940] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:35:27.086028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd145751-5414-46c9-ab7c-4bc31937f745 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:27.086968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd145751-5414-46c9-ab7c-4bc31937f745 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:27.093627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd145751-5414-46c9-ab7c-4bc31937f745 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:27.094112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd145751-5414-46c9-ab7c-4bc31937f745 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:27.094888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd145751-5414-46c9-ab7c-4bc31937f745 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:27.095335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd145751-5414-46c9-ab7c-4bc31937f745 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:27.239521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dd145751-5414-46c9-ab7c-4bc31937f745 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:27.252115 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd145751-5414-46c9-ab7c-4bc31937f745 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1518 microversion: 2.1 time: 0.171067 Jul 28 04:35:27.264618 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4491/6941] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:27 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:35:28.277779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bfd8b0ab-7747-426c-953c-a19f5486cb2d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:28.278833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bfd8b0ab-7747-426c-953c-a19f5486cb2d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:28.290603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfd8b0ab-7747-426c-953c-a19f5486cb2d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:28.291379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfd8b0ab-7747-426c-953c-a19f5486cb2d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:28.292697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfd8b0ab-7747-426c-953c-a19f5486cb2d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:28.293440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfd8b0ab-7747-426c-953c-a19f5486cb2d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:28.435061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bfd8b0ab-7747-426c-953c-a19f5486cb2d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:28.445360 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bfd8b0ab-7747-426c-953c-a19f5486cb2d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1515 microversion: 2.1 time: 0.174172 Jul 28 04:35:28.445936 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4492/6942] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:28 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:28.465598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ad71218-f04f-4f5f-b16b-9cf9aef963aa tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:35:28.466138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ad71218-f04f-4f5f-b16b-9cf9aef963aa tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:28.472486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ad71218-f04f-4f5f-b16b-9cf9aef963aa tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:28.473326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ad71218-f04f-4f5f-b16b-9cf9aef963aa tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:28.474099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ad71218-f04f-4f5f-b16b-9cf9aef963aa tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:28.474542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ad71218-f04f-4f5f-b16b-9cf9aef963aa tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:28.539209 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ad71218-f04f-4f5f-b16b-9cf9aef963aa tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "POST /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754/action" status: 204 len: 0 microversion: 2.1 time: 0.076400 Jul 28 04:35:28.539209 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4493/6943] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:35:28 2022] POST /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:35:28.547601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6584d3ae-7e45-498f-b2e7-58d8a76dfcbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:28.548300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6584d3ae-7e45-498f-b2e7-58d8a76dfcbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:28.554652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6584d3ae-7e45-498f-b2e7-58d8a76dfcbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:28.555108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6584d3ae-7e45-498f-b2e7-58d8a76dfcbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:28.555879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6584d3ae-7e45-498f-b2e7-58d8a76dfcbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:28.556324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6584d3ae-7e45-498f-b2e7-58d8a76dfcbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:28.711864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6584d3ae-7e45-498f-b2e7-58d8a76dfcbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:28.720703 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6584d3ae-7e45-498f-b2e7-58d8a76dfcbe tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1515 microversion: 2.1 time: 0.177039 Jul 28 04:35:28.721620 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4494/6944] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:28 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:35:29.743245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e16dd56-1d22-4679-b9df-a8b6f46ae17d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:29.743909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0e16dd56-1d22-4679-b9df-a8b6f46ae17d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:29.751342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e16dd56-1d22-4679-b9df-a8b6f46ae17d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:29.751814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e16dd56-1d22-4679-b9df-a8b6f46ae17d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:29.752647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e16dd56-1d22-4679-b9df-a8b6f46ae17d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:29.753103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e16dd56-1d22-4679-b9df-a8b6f46ae17d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:29.892427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0e16dd56-1d22-4679-b9df-a8b6f46ae17d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:29.900854 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0e16dd56-1d22-4679-b9df-a8b6f46ae17d tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1515 microversion: 2.1 time: 0.161743 Jul 28 04:35:29.902344 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4495/6945] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:29 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:30.925061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-610e1f27-17ad-4105-8886-f55402161d3b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:30.925850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-610e1f27-17ad-4105-8886-f55402161d3b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:30.935112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-610e1f27-17ad-4105-8886-f55402161d3b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:30.935576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-610e1f27-17ad-4105-8886-f55402161d3b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:30.936789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-610e1f27-17ad-4105-8886-f55402161d3b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:30.937362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-610e1f27-17ad-4105-8886-f55402161d3b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:31.080493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-610e1f27-17ad-4105-8886-f55402161d3b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:31.088464 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-610e1f27-17ad-4105-8886-f55402161d3b tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1507 microversion: 2.1 time: 0.169097 Jul 28 04:35:31.089047 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4496/6946] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:30 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:31.093419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0e09a4dc-203a-40aa-8d1b-53b198a17367 req-f2b3fad1-042d-492c-9c6a-22cd91fd6e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a55f29-0f25-4617-9fed-1711382bd754", "name": "network-vif-plugged", "status": "completed", "tag": "0a61d634-c75f-4db4-b0cc-0a966be85c63"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:35:31.103429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0e09a4dc-203a-40aa-8d1b-53b198a17367 req-f2b3fad1-042d-492c-9c6a-22cd91fd6e22 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:31.103882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0e09a4dc-203a-40aa-8d1b-53b198a17367 req-f2b3fad1-042d-492c-9c6a-22cd91fd6e22 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:31.114857 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0e09a4dc-203a-40aa-8d1b-53b198a17367 req-f2b3fad1-042d-492c-9c6a-22cd91fd6e22 service nova] Creating event network-vif-plugged:0a61d634-c75f-4db4-b0cc-0a966be85c63 for instance 26a55f29-0f25-4617-9fed-1711382bd754 on n-h1-826756-3 Jul 28 04:35:31.119921 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0e09a4dc-203a-40aa-8d1b-53b198a17367 req-f2b3fad1-042d-492c-9c6a-22cd91fd6e22 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029709 Jul 28 04:35:31.120555 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4497/6947] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:35:31.125644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a80aa493-9b3e-48f1-978f-c43043e0f4fd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:31.126354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a80aa493-9b3e-48f1-978f-c43043e0f4fd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:31.132541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a80aa493-9b3e-48f1-978f-c43043e0f4fd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:31.133029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a80aa493-9b3e-48f1-978f-c43043e0f4fd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:31.133800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a80aa493-9b3e-48f1-978f-c43043e0f4fd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:31.134243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a80aa493-9b3e-48f1-978f-c43043e0f4fd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:31.269495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a80aa493-9b3e-48f1-978f-c43043e0f4fd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:31.279522 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a80aa493-9b3e-48f1-978f-c43043e0f4fd tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1507 microversion: 2.1 time: 0.157795 Jul 28 04:35:31.280539 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4498/6948] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:31 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:31.302656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2c3e0bb3-d057-42d0-916e-ce4d01542181 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:31.303660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2c3e0bb3-d057-42d0-916e-ce4d01542181 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:31.313384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c3e0bb3-d057-42d0-916e-ce4d01542181 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:31.314120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c3e0bb3-d057-42d0-916e-ce4d01542181 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:31.315324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c3e0bb3-d057-42d0-916e-ce4d01542181 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:31.316090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c3e0bb3-d057-42d0-916e-ce4d01542181 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:31.456546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2c3e0bb3-d057-42d0-916e-ce4d01542181 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:31.464883 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2c3e0bb3-d057-42d0-916e-ce4d01542181 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1507 microversion: 2.1 time: 0.168686 Jul 28 04:35:31.465462 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4499/6949] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:31 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:31.485490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e5d12600-8121-4e53-b94b-7474973dfd30 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:31.485915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e5d12600-8121-4e53-b94b-7474973dfd30 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:31.492117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5d12600-8121-4e53-b94b-7474973dfd30 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:31.492623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5d12600-8121-4e53-b94b-7474973dfd30 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:31.493419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5d12600-8121-4e53-b94b-7474973dfd30 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:31.493839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5d12600-8121-4e53-b94b-7474973dfd30 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:31.519756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e5d12600-8121-4e53-b94b-7474973dfd30 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:35:31.557632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:35:31.614067 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e5d12600-8121-4e53-b94b-7474973dfd30 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "DELETE /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 204 len: 0 microversion: 2.1 time: 0.131917 Jul 28 04:35:31.615016 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4500/6950] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:35:31 2022] DELETE /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:35:31.631486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ab5aaaac-b41c-4549-9016-2542a0cc35a7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:31.632090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ab5aaaac-b41c-4549-9016-2542a0cc35a7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:31.638402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab5aaaac-b41c-4549-9016-2542a0cc35a7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:31.638907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab5aaaac-b41c-4549-9016-2542a0cc35a7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:31.639818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab5aaaac-b41c-4549-9016-2542a0cc35a7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:31.640544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab5aaaac-b41c-4549-9016-2542a0cc35a7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:31.951066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ab5aaaac-b41c-4549-9016-2542a0cc35a7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:35:31.998138 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.compute.api [None req-ab5aaaac-b41c-4549-9016-2542a0cc35a7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Instance is already in deleting state, ignoring this request Jul 28 04:35:31.998987 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ab5aaaac-b41c-4549-9016-2542a0cc35a7 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "DELETE /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 204 len: 0 microversion: 2.1 time: 0.371767 Jul 28 04:35:31.999556 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4501/6951] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:35:31 2022] DELETE /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:35:32.007872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f612ff0d-f5f9-45cb-986c-6374b4ee3644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:32.008527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f612ff0d-f5f9-45cb-986c-6374b4ee3644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:32.014717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f612ff0d-f5f9-45cb-986c-6374b4ee3644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:32.015217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f612ff0d-f5f9-45cb-986c-6374b4ee3644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:32.016018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f612ff0d-f5f9-45cb-986c-6374b4ee3644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:32.016507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f612ff0d-f5f9-45cb-986c-6374b4ee3644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:32.156131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f612ff0d-f5f9-45cb-986c-6374b4ee3644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:32.165224 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f612ff0d-f5f9-45cb-986c-6374b4ee3644 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1513 microversion: 2.1 time: 0.160945 Jul 28 04:35:32.165795 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4502/6952] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:32 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:35:33.186569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2a2b5779-24ed-452e-a7cb-d347a53d92f9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:33.187275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2a2b5779-24ed-452e-a7cb-d347a53d92f9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:33.194459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a2b5779-24ed-452e-a7cb-d347a53d92f9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:33.194927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a2b5779-24ed-452e-a7cb-d347a53d92f9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:33.195708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a2b5779-24ed-452e-a7cb-d347a53d92f9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:33.196164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2a2b5779-24ed-452e-a7cb-d347a53d92f9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:33.326800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2a2b5779-24ed-452e-a7cb-d347a53d92f9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a6d116e47446cd828b6e3954ba41ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82cb536f094fd3a35b71d21ec6c519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:33.334986 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2a2b5779-24ed-452e-a7cb-d347a53d92f9 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 200 len: 1513 microversion: 2.1 time: 0.152545 Jul 28 04:35:33.335861 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4503/6953] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:33 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:33.446236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-bd83c780-3b53-494d-8b3e-8566e306bffd req-2247b6af-3a91-48d6-9006-90f4d167b221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26a55f29-0f25-4617-9fed-1711382bd754", "name": "network-vif-deleted", "tag": "0a61d634-c75f-4db4-b0cc-0a966be85c63"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:35:33.458323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bd83c780-3b53-494d-8b3e-8566e306bffd req-2247b6af-3a91-48d6-9006-90f4d167b221 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:33.458877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bd83c780-3b53-494d-8b3e-8566e306bffd req-2247b6af-3a91-48d6-9006-90f4d167b221 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:33.471409 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-bd83c780-3b53-494d-8b3e-8566e306bffd req-2247b6af-3a91-48d6-9006-90f4d167b221 service nova] Creating event network-vif-deleted:0a61d634-c75f-4db4-b0cc-0a966be85c63 for instance 26a55f29-0f25-4617-9fed-1711382bd754 on n-h1-826756-3 Jul 28 04:35:33.477459 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-bd83c780-3b53-494d-8b3e-8566e306bffd req-2247b6af-3a91-48d6-9006-90f4d167b221 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034720 Jul 28 04:35:33.478500 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4504/6954] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:35:34.367114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ed95241-2eb3-4285-b88a-5f0f8f2c9eab tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:34.367796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ed95241-2eb3-4285-b88a-5f0f8f2c9eab tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: 26a55f29-0f25-4617-9fed-1711382bd754] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:34.374505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ed95241-2eb3-4285-b88a-5f0f8f2c9eab tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:34.375000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ed95241-2eb3-4285-b88a-5f0f8f2c9eab tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:34.375767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ed95241-2eb3-4285-b88a-5f0f8f2c9eab tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:34.376208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ed95241-2eb3-4285-b88a-5f0f8f2c9eab tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:34.389750 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-2ed95241-2eb3-4285-b88a-5f0f8f2c9eab tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] HTTP exception thrown: Instance 26a55f29-0f25-4617-9fed-1711382bd754 could not be found. Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ed95241-2eb3-4285-b88a-5f0f8f2c9eab tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Request method failure captured: Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 HTTP/1.1 Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hGvI9YbbgRQjbAoW4pgEcW0csSCt0DKzioenBHDvJWQx2d5lQKyNz7zlHqPAQ-0gbtuQbNR3Jmx4gKv5bPJPtkiMy5L38djUvYwrZhZoz4YaPEegvscyS7UxBcQ9-6Z6CnGAhWijKWrdj4zJrVaeGOlF9gYVe719Xh4N1sCpA-E1go Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 2c82cb536f094fd3a35b71d21ec6c519 Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerDiskConfigTestJSON-630879397 Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2c82cb536f094fd3a35b71d21ec6c519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c82cb536f094fd3a35b71d21ec6c519"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2c82cb536f094fd3a35b71d21ec6c519"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c82cb536f094fd3a35b71d21ec6c519"}]}] Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerDiskConfigTestJSON-630879397 Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 2c82cb536f094fd3a35b71d21ec6c519 Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-630879397 Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerDiskConfigTestJSON-630879397-project Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: b8a6d116e47446cd828b6e3954ba41ce Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerDiskConfigTestJSON-630879397-project Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 26a55f29-0f25-4617-9fed-1711382bd754 could not be found. Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '26a55f29-0f25-4617-9fed-1711382bd754'} Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26a55f29-0f25-4617-9fed-1711382bd754 could not be found. Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26a55f29-0f25-4617-9fed-1711382bd754 could not be found. Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:35:34.391400 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:34.395466 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:35:34.395466 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:35:34.395466 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:35:34.395466 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:35:34.395466 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:35:34.395466 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26a55f29-0f25-4617-9fed-1711382bd754 could not be found. Jul 28 04:35:34.395466 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:34.395466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ed95241-2eb3-4285-b88a-5f0f8f2c9eab tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Returning 404 to user: Instance 26a55f29-0f25-4617-9fed-1711382bd754 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:35:34.395466 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ed95241-2eb3-4285-b88a-5f0f8f2c9eab tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754" status: 404 len: 111 microversion: 2.1 time: 0.033232 Jul 28 04:35:34.395466 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4505/6955] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:34 2022] GET /compute/v2.1/servers/26a55f29-0f25-4617-9fed-1711382bd754 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:35:34.401801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dca2789c-b5b7-450b-8440-d1b415174199 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '.version_select at 0x7ffa66e1cb80>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:34.425892 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dca2789c-b5b7-450b-8440-d1b415174199 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515216468" status: 202 len: 0 microversion: 2.1 time: 0.027715 Jul 28 04:35:34.426460 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4506/6956] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 04:35:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515216468 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:35:35.053780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0a000a7d-70c9-4639-81a6-6e2f5d30b599 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:35.054308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0a000a7d-70c9-4639-81a6-6e2f5d30b599 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:35.061975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a000a7d-70c9-4639-81a6-6e2f5d30b599 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:35.062370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a000a7d-70c9-4639-81a6-6e2f5d30b599 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:35.063155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a000a7d-70c9-4639-81a6-6e2f5d30b599 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:35.063631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0a000a7d-70c9-4639-81a6-6e2f5d30b599 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:35.077852 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-0a000a7d-70c9-4639-81a6-6e2f5d30b599 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] HTTP exception thrown: Instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c could not be found. Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0a000a7d-70c9-4639-81a6-6e2f5d30b599 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Request method failure captured: Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c HTTP/1.1 Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hGvI9YbbgRQjbAoW4pgEcW0csSCt0DKzioenBHDvJWQx2d5lQKyNz7zlHqPAQ-0gbtuQbNR3Jmx4gKv5bPJPtkiMy5L38djUvYwrZhZoz4YaPEegvscyS7UxBcQ9-6Z6CnGAhWijKWrdj4zJrVaeGOlF9gYVe719Xh4N1sCpA-E1go Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 2c82cb536f094fd3a35b71d21ec6c519 Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerDiskConfigTestJSON-630879397 Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2c82cb536f094fd3a35b71d21ec6c519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c82cb536f094fd3a35b71d21ec6c519"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2c82cb536f094fd3a35b71d21ec6c519"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c82cb536f094fd3a35b71d21ec6c519"}]}] Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerDiskConfigTestJSON-630879397 Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 2c82cb536f094fd3a35b71d21ec6c519 Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-630879397 Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerDiskConfigTestJSON-630879397-project Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: b8a6d116e47446cd828b6e3954ba41ce Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerDiskConfigTestJSON-630879397-project Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c could not be found. Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c'} Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c could not be found. Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:35:35.079477 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:35:35.083641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c could not be found. Jul 28 04:35:35.083641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:35.083641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:35:35.083641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:35.083641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:35:35.083641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:35:35.083641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:35:35.083641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:35:35.083641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:35:35.083641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c could not be found. Jul 28 04:35:35.083641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:35.083641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0a000a7d-70c9-4639-81a6-6e2f5d30b599 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Returning 404 to user: Instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:35:35.083641 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0a000a7d-70c9-4639-81a6-6e2f5d30b599 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 404 len: 111 microversion: 2.1 time: 0.038212 Jul 28 04:35:35.083641 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4507/6957] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:35:35 2022] DELETE /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:35:35.089346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b687236a-2c41-4a16-bf86-5114ee8dc637 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:35.089971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b687236a-2c41-4a16-bf86-5114ee8dc637 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] [instance: bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:35.096256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b687236a-2c41-4a16-bf86-5114ee8dc637 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:35.096784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b687236a-2c41-4a16-bf86-5114ee8dc637 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:35.097908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b687236a-2c41-4a16-bf86-5114ee8dc637 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:35.098359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b687236a-2c41-4a16-bf86-5114ee8dc637 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:35.114043 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-b687236a-2c41-4a16-bf86-5114ee8dc637 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] HTTP exception thrown: Instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c could not be found. Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b687236a-2c41-4a16-bf86-5114ee8dc637 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Request method failure captured: Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c HTTP/1.1 Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hGvI9YbbgRQjbAoW4pgEcW0csSCt0DKzioenBHDvJWQx2d5lQKyNz7zlHqPAQ-0gbtuQbNR3Jmx4gKv5bPJPtkiMy5L38djUvYwrZhZoz4YaPEegvscyS7UxBcQ9-6Z6CnGAhWijKWrdj4zJrVaeGOlF9gYVe719Xh4N1sCpA-E1go Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 2c82cb536f094fd3a35b71d21ec6c519 Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerDiskConfigTestJSON-630879397 Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2c82cb536f094fd3a35b71d21ec6c519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c82cb536f094fd3a35b71d21ec6c519"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2c82cb536f094fd3a35b71d21ec6c519"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2c82cb536f094fd3a35b71d21ec6c519"}]}] Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerDiskConfigTestJSON-630879397 Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 2c82cb536f094fd3a35b71d21ec6c519 Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-630879397 Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerDiskConfigTestJSON-630879397-project Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: b8a6d116e47446cd828b6e3954ba41ce Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerDiskConfigTestJSON-630879397-project Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c could not be found. Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c'} Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c could not be found. Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c could not be found. Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:35:35.115590 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:35.119692 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:35:35.119692 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:35:35.119692 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:35:35.119692 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:35:35.119692 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:35:35.119692 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c could not be found. Jul 28 04:35:35.119692 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:35:35.119692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b687236a-2c41-4a16-bf86-5114ee8dc637 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] Returning 404 to user: Instance bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:35:35.119692 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b687236a-2c41-4a16-bf86-5114ee8dc637 tempest-ServerDiskConfigTestJSON-630879397 tempest-ServerDiskConfigTestJSON-630879397-project] 10.222.0.48 "GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c" status: 404 len: 111 microversion: 2.1 time: 0.031295 Jul 28 04:35:35.119692 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4508/6958] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:35 2022] GET /compute/v2.1/servers/bd2ecf10-d4f8-4c28-b65f-9f5be93dc55c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:35:44.090755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8406ee30-8b49-4c77-83e8-46ca85148adf tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'create', calling method: .version_select at 0x7ffa6455b790>, body: {"keypair": {"name": "tempest-keypair-1754507874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHv1MRz68NirgwS+BlcrloqK0/Y+vSNBJPSyDIBgtF9CengLFNQk88hC0E5ebkC2nIxcqEIdOQLQrqHT6aE3PuCzK2K4c0XahZZECa+uHivQQVObzEfzTa2/m09iYRtSJg=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:35:44.107623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-8406ee30-8b49-4c77-83e8-46ca85148adf tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Getting quotas for project a519852ab6f045779941ca2ed3e4f4bd. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:35:44.113224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-8406ee30-8b49-4c77-83e8-46ca85148adf tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Getting quotas for user da44c0d51e7a4b1aabf1b73597301cd1 and project a519852ab6f045779941ca2ed3e4f4bd. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:35:44.145875 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8406ee30-8b49-4c77-83e8-46ca85148adf tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.206013 Jul 28 04:35:44.146652 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4509/6959] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:35:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:35:45.486951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:35:45.491842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2109204945", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8f2e3d3-2fb2-4562-92db-6678cb2b2773"}], "security_groups": [{"name": "tempest-securitygroup--2127946259"}], "key_name": "tempest-keypair-1754507874", "user_data": "}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:35:45.612967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] validate_networks() for [('f8f2e3d3-2fb2-4562-92db-6678cb2b2773', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:35:46.105024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:35:46.105585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:35:46.106336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:35:46.106841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:35:46.108142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:35:46.123416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:46.124019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:46.125124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:46.125671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:46.148160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Getting quotas for project a519852ab6f045779941ca2ed3e4f4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:35:46.156305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Getting quotas for user da44c0d51e7a4b1aabf1b73597301cd1 and project a519852ab6f045779941ca2ed3e4f4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:35:46.170958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:35:46.173408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:35:46.230398 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b6385fb3-f756-469b-ba52-eaa3b6ecc147 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.745090 Jul 28 04:35:46.236814 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4510/6960] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:35:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:35:46.242866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c10c361e-b1c9-4ade-ac6c-56bea48cfeb3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:46.243635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c10c361e-b1c9-4ade-ac6c-56bea48cfeb3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:46.319016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c10c361e-b1c9-4ade-ac6c-56bea48cfeb3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:46.328439 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c10c361e-b1c9-4ade-ac6c-56bea48cfeb3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1239 microversion: 2.1 time: 0.090142 Jul 28 04:35:46.342464 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4511/6961] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:46 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1239 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:35:47.353519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19f9f15f-41bb-4f2f-a348-dc98196e752d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:47.354193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-19f9f15f-41bb-4f2f-a348-dc98196e752d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:47.361929 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19f9f15f-41bb-4f2f-a348-dc98196e752d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:47.362402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19f9f15f-41bb-4f2f-a348-dc98196e752d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:47.363198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19f9f15f-41bb-4f2f-a348-dc98196e752d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:47.363653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19f9f15f-41bb-4f2f-a348-dc98196e752d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:47.431231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19f9f15f-41bb-4f2f-a348-dc98196e752d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:47.440156 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-19f9f15f-41bb-4f2f-a348-dc98196e752d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1291 microversion: 2.1 time: 0.090949 Jul 28 04:35:47.440767 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4512/6962] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:47 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1291 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:48.462047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8c40b65f-e967-4362-81a8-f47c8849e42d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:48.463526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8c40b65f-e967-4362-81a8-f47c8849e42d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:48.471194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c40b65f-e967-4362-81a8-f47c8849e42d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:48.471867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c40b65f-e967-4362-81a8-f47c8849e42d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:48.473918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c40b65f-e967-4362-81a8-f47c8849e42d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:48.474396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c40b65f-e967-4362-81a8-f47c8849e42d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:48.613386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8c40b65f-e967-4362-81a8-f47c8849e42d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:48.622089 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8c40b65f-e967-4362-81a8-f47c8849e42d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1365 microversion: 2.1 time: 0.164086 Jul 28 04:35:48.622792 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4513/6963] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:48 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:35:48.899727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-40120a48-8957-449d-be56-638a1d461117 req-81be8e73-1825-48b8-ac04-cb91a6c5ff49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e27551-9e3d-4bea-8f27-1f55f81146ae", "tag": "36738da1-a007-4f95-81ca-1b797a550d3c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:35:48.918235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-40120a48-8957-449d-be56-638a1d461117 req-81be8e73-1825-48b8-ac04-cb91a6c5ff49 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:48.921749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-40120a48-8957-449d-be56-638a1d461117 req-81be8e73-1825-48b8-ac04-cb91a6c5ff49 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:48.933834 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-40120a48-8957-449d-be56-638a1d461117 req-81be8e73-1825-48b8-ac04-cb91a6c5ff49 service nova] Creating event network-changed:36738da1-a007-4f95-81ca-1b797a550d3c for instance 45e27551-9e3d-4bea-8f27-1f55f81146ae on n-h1-826756-3 Jul 28 04:35:48.939593 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-40120a48-8957-449d-be56-638a1d461117 req-81be8e73-1825-48b8-ac04-cb91a6c5ff49 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043648 Jul 28 04:35:48.940630 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4514/6964] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:35:49.651086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-def62b1b-1bfb-46ee-8c64-1deeda45da36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:49.652232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-def62b1b-1bfb-46ee-8c64-1deeda45da36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:49.655408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:35:49.663778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-def62b1b-1bfb-46ee-8c64-1deeda45da36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:49.664241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-def62b1b-1bfb-46ee-8c64-1deeda45da36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:49.665063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-def62b1b-1bfb-46ee-8c64-1deeda45da36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:49.665520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-def62b1b-1bfb-46ee-8c64-1deeda45da36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:49.801558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-def62b1b-1bfb-46ee-8c64-1deeda45da36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:49.812589 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-def62b1b-1bfb-46ee-8c64-1deeda45da36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1365 microversion: 2.1 time: 0.170064 Jul 28 04:35:49.813558 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4515/6965] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:49 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:50.837145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-554727b7-badc-4652-8238-756f8ec119fe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:50.838057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-554727b7-badc-4652-8238-756f8ec119fe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:50.848756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-554727b7-badc-4652-8238-756f8ec119fe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:50.849410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-554727b7-badc-4652-8238-756f8ec119fe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:50.850512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-554727b7-badc-4652-8238-756f8ec119fe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:50.851152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-554727b7-badc-4652-8238-756f8ec119fe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:50.984859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-554727b7-badc-4652-8238-756f8ec119fe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:50.992764 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-554727b7-badc-4652-8238-756f8ec119fe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1365 microversion: 2.1 time: 0.161312 Jul 28 04:35:50.993338 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4516/6966] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:50 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:52.024332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-92269a0c-cf31-435e-ba0a-5638df31602d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:52.025458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-92269a0c-cf31-435e-ba0a-5638df31602d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:52.033689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92269a0c-cf31-435e-ba0a-5638df31602d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:52.034151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92269a0c-cf31-435e-ba0a-5638df31602d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:52.034942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92269a0c-cf31-435e-ba0a-5638df31602d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:52.035389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92269a0c-cf31-435e-ba0a-5638df31602d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:52.183785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-92269a0c-cf31-435e-ba0a-5638df31602d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:52.191983 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-92269a0c-cf31-435e-ba0a-5638df31602d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1365 microversion: 2.1 time: 0.174350 Jul 28 04:35:52.192597 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4517/6967] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:52 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:53.213010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40d54cd3-98a1-4a8b-b5c2-cb367803d800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:53.213650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40d54cd3-98a1-4a8b-b5c2-cb367803d800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:53.220960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40d54cd3-98a1-4a8b-b5c2-cb367803d800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:53.221435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40d54cd3-98a1-4a8b-b5c2-cb367803d800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:53.222208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40d54cd3-98a1-4a8b-b5c2-cb367803d800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:53.223033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40d54cd3-98a1-4a8b-b5c2-cb367803d800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:53.370118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40d54cd3-98a1-4a8b-b5c2-cb367803d800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:53.379311 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40d54cd3-98a1-4a8b-b5c2-cb367803d800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1365 microversion: 2.1 time: 0.170217 Jul 28 04:35:53.379933 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4518/6968] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:53 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:35:54.402915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b8e9b5bf-845b-4770-8070-064237f351ac tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:54.403525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b8e9b5bf-845b-4770-8070-064237f351ac tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:54.411041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8e9b5bf-845b-4770-8070-064237f351ac tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:54.411505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8e9b5bf-845b-4770-8070-064237f351ac tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:54.412327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8e9b5bf-845b-4770-8070-064237f351ac tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:54.412809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8e9b5bf-845b-4770-8070-064237f351ac tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:54.548986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8e9b5bf-845b-4770-8070-064237f351ac tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:54.557409 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b8e9b5bf-845b-4770-8070-064237f351ac tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1365 microversion: 2.1 time: 0.159704 Jul 28 04:35:54.558004 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4519/6969] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:54 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:55.078570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-8ed98bac-e0fb-478e-9964-09f9f860afbb req-62dd7831-3cca-456c-99c2-eba0fe460117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e27551-9e3d-4bea-8f27-1f55f81146ae", "name": "network-vif-plugged", "status": "completed", "tag": "36738da1-a007-4f95-81ca-1b797a550d3c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:35:55.088527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8ed98bac-e0fb-478e-9964-09f9f860afbb req-62dd7831-3cca-456c-99c2-eba0fe460117 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:55.088965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8ed98bac-e0fb-478e-9964-09f9f860afbb req-62dd7831-3cca-456c-99c2-eba0fe460117 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:55.101007 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-8ed98bac-e0fb-478e-9964-09f9f860afbb req-62dd7831-3cca-456c-99c2-eba0fe460117 service nova] Creating event network-vif-plugged:36738da1-a007-4f95-81ca-1b797a550d3c for instance 45e27551-9e3d-4bea-8f27-1f55f81146ae on n-h1-826756-3 Jul 28 04:35:55.106050 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-8ed98bac-e0fb-478e-9964-09f9f860afbb req-62dd7831-3cca-456c-99c2-eba0fe460117 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031276 Jul 28 04:35:55.106613 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4520/6970] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:35:55.585735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-46bb8250-a9da-4f6e-a7e5-051d51874f66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:55.586856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-46bb8250-a9da-4f6e-a7e5-051d51874f66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:55.597869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46bb8250-a9da-4f6e-a7e5-051d51874f66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:55.598661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46bb8250-a9da-4f6e-a7e5-051d51874f66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:55.599936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46bb8250-a9da-4f6e-a7e5-051d51874f66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:55.600736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-46bb8250-a9da-4f6e-a7e5-051d51874f66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:55.738625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-46bb8250-a9da-4f6e-a7e5-051d51874f66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:55.747199 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-46bb8250-a9da-4f6e-a7e5-051d51874f66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1365 microversion: 2.1 time: 0.170971 Jul 28 04:35:55.747774 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4521/6971] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:55 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:56.772318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eae892fe-615e-45a2-9f41-b3ae7d930a3e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:56.773382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eae892fe-615e-45a2-9f41-b3ae7d930a3e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:56.777015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:35:56.778213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:35:56.785004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eae892fe-615e-45a2-9f41-b3ae7d930a3e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:56.785464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eae892fe-615e-45a2-9f41-b3ae7d930a3e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:56.786249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eae892fe-615e-45a2-9f41-b3ae7d930a3e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:56.786700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eae892fe-615e-45a2-9f41-b3ae7d930a3e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:56.925901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eae892fe-615e-45a2-9f41-b3ae7d930a3e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:35:56.934365 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eae892fe-615e-45a2-9f41-b3ae7d930a3e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1552 microversion: 2.1 time: 0.168590 Jul 28 04:35:56.934937 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4522/6972] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:35:56 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:35:56.954681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ff78e1bc-1588-41cc-8550-4b9fefd5e297 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:35:56.955186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ff78e1bc-1588-41cc-8550-4b9fefd5e297 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:35:56.961172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff78e1bc-1588-41cc-8550-4b9fefd5e297 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:56.961622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff78e1bc-1588-41cc-8550-4b9fefd5e297 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:56.962383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff78e1bc-1588-41cc-8550-4b9fefd5e297 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:56.962824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff78e1bc-1588-41cc-8550-4b9fefd5e297 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:57.051827 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ff78e1bc-1588-41cc-8550-4b9fefd5e297 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100772 Jul 28 04:35:57.052434 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4523/6973] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 04:35:56 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:35:58.043894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-870d6ed7-2f66-4aee-879a-8342abd2d1f8 req-85aff3b9-24d2-4da3-9c95-5257da866726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e27551-9e3d-4bea-8f27-1f55f81146ae", "tag": "36738da1-a007-4f95-81ca-1b797a550d3c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:35:58.054186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-870d6ed7-2f66-4aee-879a-8342abd2d1f8 req-85aff3b9-24d2-4da3-9c95-5257da866726 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:35:58.054654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-870d6ed7-2f66-4aee-879a-8342abd2d1f8 req-85aff3b9-24d2-4da3-9c95-5257da866726 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:35:58.068542 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-870d6ed7-2f66-4aee-879a-8342abd2d1f8 req-85aff3b9-24d2-4da3-9c95-5257da866726 service nova] Creating event network-changed:36738da1-a007-4f95-81ca-1b797a550d3c for instance 45e27551-9e3d-4bea-8f27-1f55f81146ae on n-h1-826756-3 Jul 28 04:35:58.073575 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-870d6ed7-2f66-4aee-879a-8342abd2d1f8 req-85aff3b9-24d2-4da3-9c95-5257da866726 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034474 Jul 28 04:35:58.074185 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4524/6974] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:36:32.862512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=19 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:36:32.863655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=66 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:36:32.868605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e32786d-a7d3-4c36-b91a-1a966577d03c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:32.869319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e32786d-a7d3-4c36-b91a-1a966577d03c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:32.879314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e32786d-a7d3-4c36-b91a-1a966577d03c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:32.879769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e32786d-a7d3-4c36-b91a-1a966577d03c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:32.880575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e32786d-a7d3-4c36-b91a-1a966577d03c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:32.881019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e32786d-a7d3-4c36-b91a-1a966577d03c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:33.026091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e32786d-a7d3-4c36-b91a-1a966577d03c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:33.034586 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e32786d-a7d3-4c36-b91a-1a966577d03c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1671 microversion: 2.1 time: 0.175748 Jul 28 04:36:33.035163 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4525/6975] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:32 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1671 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:33.057720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-27fa1610-dc4c-483c-97c6-a92d85dd0b5a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:33.058350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-27fa1610-dc4c-483c-97c6-a92d85dd0b5a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:33.064962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27fa1610-dc4c-483c-97c6-a92d85dd0b5a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:33.065428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27fa1610-dc4c-483c-97c6-a92d85dd0b5a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:33.066213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27fa1610-dc4c-483c-97c6-a92d85dd0b5a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:33.066664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-27fa1610-dc4c-483c-97c6-a92d85dd0b5a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:33.213766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-27fa1610-dc4c-483c-97c6-a92d85dd0b5a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:33.221892 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-27fa1610-dc4c-483c-97c6-a92d85dd0b5a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1671 microversion: 2.1 time: 0.168052 Jul 28 04:36:33.222468 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4526/6976] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:33 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:33.242266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f163325c-508b-4bdb-9ab4-6c0b4e553008 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:33.242880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f163325c-508b-4bdb-9ab4-6c0b4e553008 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:33.248915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f163325c-508b-4bdb-9ab4-6c0b4e553008 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:33.249380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f163325c-508b-4bdb-9ab4-6c0b4e553008 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:33.250157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f163325c-508b-4bdb-9ab4-6c0b4e553008 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:33.250603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f163325c-508b-4bdb-9ab4-6c0b4e553008 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:33.384962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f163325c-508b-4bdb-9ab4-6c0b4e553008 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:33.397404 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f163325c-508b-4bdb-9ab4-6c0b4e553008 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1671 microversion: 2.1 time: 0.158444 Jul 28 04:36:33.398331 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4527/6977] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:33 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:36:33.425272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ad6e5c6-1c93-4298-9687-9e46df391deb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:36:33.428728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ad6e5c6-1c93-4298-9687-9e46df391deb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:33.438788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ad6e5c6-1c93-4298-9687-9e46df391deb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:33.439418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ad6e5c6-1c93-4298-9687-9e46df391deb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:33.440794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ad6e5c6-1c93-4298-9687-9e46df391deb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:33.441253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ad6e5c6-1c93-4298-9687-9e46df391deb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:33.470947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2ad6e5c6-1c93-4298-9687-9e46df391deb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:33.477616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ad6e5c6-1c93-4298-9687-9e46df391deb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Old instance type m1.heat2, new instance type m1.heat {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 04:36:33.484317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2ad6e5c6-1c93-4298-9687-9e46df391deb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:36:33.484779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2ad6e5c6-1c93-4298-9687-9e46df391deb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:36:33.485271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2ad6e5c6-1c93-4298-9687-9e46df391deb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:36:33.485694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2ad6e5c6-1c93-4298-9687-9e46df391deb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:36:33.486126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2ad6e5c6-1c93-4298-9687-9e46df391deb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:36:33.555455 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ad6e5c6-1c93-4298-9687-9e46df391deb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae/action" status: 202 len: 0 microversion: 2.1 time: 0.136432 Jul 28 04:36:33.559283 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4528/6978] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:36:33 2022] POST /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:36:33.564156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c8b0feb0-2e9c-4bba-aaaf-f5dc3efd99c5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:33.564815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c8b0feb0-2e9c-4bba-aaaf-f5dc3efd99c5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:33.571120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8b0feb0-2e9c-4bba-aaaf-f5dc3efd99c5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:33.571590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8b0feb0-2e9c-4bba-aaaf-f5dc3efd99c5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:33.572601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8b0feb0-2e9c-4bba-aaaf-f5dc3efd99c5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:33.572840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8b0feb0-2e9c-4bba-aaaf-f5dc3efd99c5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:33.705824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c8b0feb0-2e9c-4bba-aaaf-f5dc3efd99c5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:33.713919 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c8b0feb0-2e9c-4bba-aaaf-f5dc3efd99c5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1680 microversion: 2.1 time: 0.153453 Jul 28 04:36:33.714528 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4529/6979] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:33 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:34.741104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f7bc156e-8c5d-460e-9c8c-958dfbdc20ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:34.742147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f7bc156e-8c5d-460e-9c8c-958dfbdc20ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:34.750608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7bc156e-8c5d-460e-9c8c-958dfbdc20ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:34.751079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7bc156e-8c5d-460e-9c8c-958dfbdc20ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:34.751873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7bc156e-8c5d-460e-9c8c-958dfbdc20ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:34.752323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7bc156e-8c5d-460e-9c8c-958dfbdc20ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:34.895425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f7bc156e-8c5d-460e-9c8c-958dfbdc20ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:34.904000 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f7bc156e-8c5d-460e-9c8c-958dfbdc20ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1680 microversion: 2.1 time: 0.172025 Jul 28 04:36:34.904625 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4530/6980] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:34 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:35.926745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a5a97fbc-6110-46b7-b7c2-7bb360b61b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:35.927428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a5a97fbc-6110-46b7-b7c2-7bb360b61b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:35.934855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5a97fbc-6110-46b7-b7c2-7bb360b61b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:35.935399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5a97fbc-6110-46b7-b7c2-7bb360b61b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:35.936115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5a97fbc-6110-46b7-b7c2-7bb360b61b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:35.936606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5a97fbc-6110-46b7-b7c2-7bb360b61b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:36.079752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a5a97fbc-6110-46b7-b7c2-7bb360b61b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:36.087860 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a5a97fbc-6110-46b7-b7c2-7bb360b61b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1685 microversion: 2.1 time: 0.165946 Jul 28 04:36:36.088454 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4531/6981] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:35 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:37.113244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-08cd9617-a3ae-4a1c-bdf1-fb2cbf71563e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:37.114163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-08cd9617-a3ae-4a1c-bdf1-fb2cbf71563e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:37.123783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08cd9617-a3ae-4a1c-bdf1-fb2cbf71563e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:37.124381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08cd9617-a3ae-4a1c-bdf1-fb2cbf71563e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:37.125416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08cd9617-a3ae-4a1c-bdf1-fb2cbf71563e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:37.126013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08cd9617-a3ae-4a1c-bdf1-fb2cbf71563e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:37.276978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-08cd9617-a3ae-4a1c-bdf1-fb2cbf71563e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:37.285527 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-08cd9617-a3ae-4a1c-bdf1-fb2cbf71563e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1685 microversion: 2.1 time: 0.177536 Jul 28 04:36:37.286129 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4532/6982] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:37 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:38.311744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed59bf22-fe05-4834-9e06-5e720a79428e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:38.313120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed59bf22-fe05-4834-9e06-5e720a79428e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:38.324532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed59bf22-fe05-4834-9e06-5e720a79428e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:38.325296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed59bf22-fe05-4834-9e06-5e720a79428e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:38.326691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed59bf22-fe05-4834-9e06-5e720a79428e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:38.327431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed59bf22-fe05-4834-9e06-5e720a79428e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:38.464089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed59bf22-fe05-4834-9e06-5e720a79428e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:38.472071 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed59bf22-fe05-4834-9e06-5e720a79428e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1685 microversion: 2.1 time: 0.167027 Jul 28 04:36:38.473086 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4533/6983] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:38 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:39.493924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e1178eaa-1cc8-41d7-86a1-88c4aa04a8c2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:39.494605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e1178eaa-1cc8-41d7-86a1-88c4aa04a8c2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:39.502031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1178eaa-1cc8-41d7-86a1-88c4aa04a8c2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:39.502480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1178eaa-1cc8-41d7-86a1-88c4aa04a8c2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:39.503390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1178eaa-1cc8-41d7-86a1-88c4aa04a8c2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:39.503831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1178eaa-1cc8-41d7-86a1-88c4aa04a8c2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:39.656813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e1178eaa-1cc8-41d7-86a1-88c4aa04a8c2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:39.667052 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e1178eaa-1cc8-41d7-86a1-88c4aa04a8c2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1685 microversion: 2.1 time: 0.177365 Jul 28 04:36:39.667644 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4534/6984] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:39 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:36:40.693016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bc442a65-d4f8-4d83-8101-ce16f748ad2f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:40.693716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bc442a65-d4f8-4d83-8101-ce16f748ad2f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:40.703981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc442a65-d4f8-4d83-8101-ce16f748ad2f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:40.704708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc442a65-d4f8-4d83-8101-ce16f748ad2f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:40.705895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc442a65-d4f8-4d83-8101-ce16f748ad2f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:40.706484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc442a65-d4f8-4d83-8101-ce16f748ad2f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:40.838460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bc442a65-d4f8-4d83-8101-ce16f748ad2f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:40.849995 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bc442a65-d4f8-4d83-8101-ce16f748ad2f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1685 microversion: 2.1 time: 0.163618 Jul 28 04:36:40.850601 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4535/6985] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:40 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:41.875862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a070dbe-1309-41c7-a7a0-362f2f967a9f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:41.876926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8a070dbe-1309-41c7-a7a0-362f2f967a9f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:41.885399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a070dbe-1309-41c7-a7a0-362f2f967a9f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:41.885866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a070dbe-1309-41c7-a7a0-362f2f967a9f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:41.886645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a070dbe-1309-41c7-a7a0-362f2f967a9f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:41.887092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a070dbe-1309-41c7-a7a0-362f2f967a9f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:42.031211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a070dbe-1309-41c7-a7a0-362f2f967a9f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:42.040754 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a070dbe-1309-41c7-a7a0-362f2f967a9f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1685 microversion: 2.1 time: 0.171083 Jul 28 04:36:42.041573 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4536/6986] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:41 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:43.066303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e11c4476-53b2-4008-8027-c12404d172fb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:43.066897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e11c4476-53b2-4008-8027-c12404d172fb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:43.074509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e11c4476-53b2-4008-8027-c12404d172fb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:43.074974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e11c4476-53b2-4008-8027-c12404d172fb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:43.075777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e11c4476-53b2-4008-8027-c12404d172fb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:43.076225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e11c4476-53b2-4008-8027-c12404d172fb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:43.223845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e11c4476-53b2-4008-8027-c12404d172fb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:43.231873 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e11c4476-53b2-4008-8027-c12404d172fb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1685 microversion: 2.1 time: 0.171634 Jul 28 04:36:43.232465 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4537/6987] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:43 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:44.258141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2f067746-e414-4ce6-bfe2-6d991127b8ff tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:44.259243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2f067746-e414-4ce6-bfe2-6d991127b8ff tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:44.270600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f067746-e414-4ce6-bfe2-6d991127b8ff tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:44.271062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f067746-e414-4ce6-bfe2-6d991127b8ff tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:44.271839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f067746-e414-4ce6-bfe2-6d991127b8ff tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:44.272287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2f067746-e414-4ce6-bfe2-6d991127b8ff tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:44.413751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2f067746-e414-4ce6-bfe2-6d991127b8ff tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:44.423043 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2f067746-e414-4ce6-bfe2-6d991127b8ff tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1685 microversion: 2.1 time: 0.171595 Jul 28 04:36:44.423705 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4538/6988] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:44 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:45.446139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-78216806-e924-4236-b0ed-27d24f83a609 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:45.446848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-78216806-e924-4236-b0ed-27d24f83a609 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:45.454138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78216806-e924-4236-b0ed-27d24f83a609 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:45.454598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78216806-e924-4236-b0ed-27d24f83a609 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:45.455386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78216806-e924-4236-b0ed-27d24f83a609 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:45.455828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78216806-e924-4236-b0ed-27d24f83a609 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:45.595058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-78216806-e924-4236-b0ed-27d24f83a609 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:45.603488 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-78216806-e924-4236-b0ed-27d24f83a609 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1685 microversion: 2.1 time: 0.161907 Jul 28 04:36:45.604055 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4539/6989] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:45 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:46.628052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0247a4c-ee09-45f3-9ced-e4367d26ea86 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:46.629216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e0247a4c-ee09-45f3-9ced-e4367d26ea86 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:46.639957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0247a4c-ee09-45f3-9ced-e4367d26ea86 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:46.640706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0247a4c-ee09-45f3-9ced-e4367d26ea86 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:46.641851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0247a4c-ee09-45f3-9ced-e4367d26ea86 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:46.642507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0247a4c-ee09-45f3-9ced-e4367d26ea86 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:46.648294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:36:46.796288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e0247a4c-ee09-45f3-9ced-e4367d26ea86 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:46.808768 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e0247a4c-ee09-45f3-9ced-e4367d26ea86 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1685 microversion: 2.1 time: 0.186455 Jul 28 04:36:46.809585 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4540/6990] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:46 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1685 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:47.832129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7fb3fcd2-c319-4f12-babf-7d2f66edf225 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:47.832942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7fb3fcd2-c319-4f12-babf-7d2f66edf225 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:47.840511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fb3fcd2-c319-4f12-babf-7d2f66edf225 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:47.840995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fb3fcd2-c319-4f12-babf-7d2f66edf225 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:47.842338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fb3fcd2-c319-4f12-babf-7d2f66edf225 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:47.842338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7fb3fcd2-c319-4f12-babf-7d2f66edf225 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:47.983101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7fb3fcd2-c319-4f12-babf-7d2f66edf225 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:47.991257 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7fb3fcd2-c319-4f12-babf-7d2f66edf225 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1684 microversion: 2.1 time: 0.163093 Jul 28 04:36:47.991843 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4541/6991] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:47 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:48.203873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a90dc854-e258-4e18-a18e-f181c145b9be req-43ea42c0-f767-4ba5-8b39-611221bb6aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e27551-9e3d-4bea-8f27-1f55f81146ae", "name": "network-vif-unplugged", "status": "completed", "tag": "36738da1-a007-4f95-81ca-1b797a550d3c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:36:48.214199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a90dc854-e258-4e18-a18e-f181c145b9be req-43ea42c0-f767-4ba5-8b39-611221bb6aea service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:48.214666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a90dc854-e258-4e18-a18e-f181c145b9be req-43ea42c0-f767-4ba5-8b39-611221bb6aea service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:48.227340 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a90dc854-e258-4e18-a18e-f181c145b9be req-43ea42c0-f767-4ba5-8b39-611221bb6aea service nova] Creating event network-vif-unplugged:36738da1-a007-4f95-81ca-1b797a550d3c for instance 45e27551-9e3d-4bea-8f27-1f55f81146ae on n-h2-826756-3 Jul 28 04:36:48.234265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-a90dc854-e258-4e18-a18e-f181c145b9be req-43ea42c0-f767-4ba5-8b39-611221bb6aea service nova] Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:36:48.246032 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a90dc854-e258-4e18-a18e-f181c145b9be req-43ea42c0-f767-4ba5-8b39-611221bb6aea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046259 Jul 28 04:36:48.246704 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4542/6992] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:36:49.019669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a86e95dd-0edb-4d99-b349-72c99508b052 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:49.020415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a86e95dd-0edb-4d99-b349-72c99508b052 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:49.033767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a86e95dd-0edb-4d99-b349-72c99508b052 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:49.034816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a86e95dd-0edb-4d99-b349-72c99508b052 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:49.036512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a86e95dd-0edb-4d99-b349-72c99508b052 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:49.037886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a86e95dd-0edb-4d99-b349-72c99508b052 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:49.186665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a86e95dd-0edb-4d99-b349-72c99508b052 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:49.195370 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a86e95dd-0edb-4d99-b349-72c99508b052 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1684 microversion: 2.1 time: 0.185086 Jul 28 04:36:49.195703 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4543/6993] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:49 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1684 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:36:50.217607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a2232b84-787a-4be0-8bb1-6c5849c3ee2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:50.218306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a2232b84-787a-4be0-8bb1-6c5849c3ee2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:50.226188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2232b84-787a-4be0-8bb1-6c5849c3ee2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:50.226647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2232b84-787a-4be0-8bb1-6c5849c3ee2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:50.227431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2232b84-787a-4be0-8bb1-6c5849c3ee2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:50.227431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2232b84-787a-4be0-8bb1-6c5849c3ee2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:50.375978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a2232b84-787a-4be0-8bb1-6c5849c3ee2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:50.384045 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a2232b84-787a-4be0-8bb1-6c5849c3ee2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1682 microversion: 2.1 time: 0.170693 Jul 28 04:36:50.384704 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4544/6994] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:50 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:50.571958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9f0669e9-971b-4509-9ba1-0b1a08192449 req-c3257807-9206-4d3f-8a2c-d84e84e68514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e27551-9e3d-4bea-8f27-1f55f81146ae", "tag": "36738da1-a007-4f95-81ca-1b797a550d3c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:36:50.582019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9f0669e9-971b-4509-9ba1-0b1a08192449 req-c3257807-9206-4d3f-8a2c-d84e84e68514 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:50.582476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9f0669e9-971b-4509-9ba1-0b1a08192449 req-c3257807-9206-4d3f-8a2c-d84e84e68514 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:50.595207 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9f0669e9-971b-4509-9ba1-0b1a08192449 req-c3257807-9206-4d3f-8a2c-d84e84e68514 service nova] Creating event network-changed:36738da1-a007-4f95-81ca-1b797a550d3c for instance 45e27551-9e3d-4bea-8f27-1f55f81146ae on n-h2-826756-3 Jul 28 04:36:50.601990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-9f0669e9-971b-4509-9ba1-0b1a08192449 req-c3257807-9206-4d3f-8a2c-d84e84e68514 service nova] Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:36:50.613426 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9f0669e9-971b-4509-9ba1-0b1a08192449 req-c3257807-9206-4d3f-8a2c-d84e84e68514 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046230 Jul 28 04:36:50.614073 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4545/6995] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:36:51.407188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-90bcf4dc-9f44-471b-8442-76e997af4ded tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:51.408070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-90bcf4dc-9f44-471b-8442-76e997af4ded tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:51.416703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90bcf4dc-9f44-471b-8442-76e997af4ded tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:51.417102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90bcf4dc-9f44-471b-8442-76e997af4ded tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:51.417969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90bcf4dc-9f44-471b-8442-76e997af4ded tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:51.418370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-90bcf4dc-9f44-471b-8442-76e997af4ded tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:51.888580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-90bcf4dc-9f44-471b-8442-76e997af4ded tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:51.896598 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-90bcf4dc-9f44-471b-8442-76e997af4ded tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1682 microversion: 2.1 time: 0.494759 Jul 28 04:36:51.897164 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4546/6996] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:51 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1682 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:52.919310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ae63aaa1-b945-475a-8af8-86c10f619370 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:52.919925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ae63aaa1-b945-475a-8af8-86c10f619370 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:52.927339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae63aaa1-b945-475a-8af8-86c10f619370 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:52.927801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae63aaa1-b945-475a-8af8-86c10f619370 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:52.928613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae63aaa1-b945-475a-8af8-86c10f619370 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:52.929060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ae63aaa1-b945-475a-8af8-86c10f619370 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:53.063337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ae63aaa1-b945-475a-8af8-86c10f619370 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:53.072700 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ae63aaa1-b945-475a-8af8-86c10f619370 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1679 microversion: 2.1 time: 0.157578 Jul 28 04:36:53.073287 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4547/6997] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:52 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:53.093518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f2daeeb0-a890-4cc2-a3fd-5d5ad1885638 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:36:53.094102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f2daeeb0-a890-4cc2-a3fd-5d5ad1885638 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:53.100652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2daeeb0-a890-4cc2-a3fd-5d5ad1885638 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:53.101106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2daeeb0-a890-4cc2-a3fd-5d5ad1885638 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:53.101905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2daeeb0-a890-4cc2-a3fd-5d5ad1885638 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:53.102334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f2daeeb0-a890-4cc2-a3fd-5d5ad1885638 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:53.166345 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f2daeeb0-a890-4cc2-a3fd-5d5ad1885638 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae/action" status: 204 len: 0 microversion: 2.1 time: 0.076097 Jul 28 04:36:53.167071 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4548/6998] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:36:53 2022] POST /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:36:53.180675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8bbf99cb-ad58-48e0-ac58-98b2baf83c02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:53.181887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8bbf99cb-ad58-48e0-ac58-98b2baf83c02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:53.193342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bbf99cb-ad58-48e0-ac58-98b2baf83c02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:53.194158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bbf99cb-ad58-48e0-ac58-98b2baf83c02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:53.195812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bbf99cb-ad58-48e0-ac58-98b2baf83c02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:53.196528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bbf99cb-ad58-48e0-ac58-98b2baf83c02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:53.370112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8bbf99cb-ad58-48e0-ac58-98b2baf83c02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:53.379278 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8bbf99cb-ad58-48e0-ac58-98b2baf83c02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1679 microversion: 2.1 time: 0.206598 Jul 28 04:36:53.380380 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4549/6999] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:53 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:36:54.401880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a8e52e5-a8be-4343-8a21-9d5a9c1ff05e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:54.402532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1a8e52e5-a8be-4343-8a21-9d5a9c1ff05e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:54.410221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a8e52e5-a8be-4343-8a21-9d5a9c1ff05e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:54.410690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a8e52e5-a8be-4343-8a21-9d5a9c1ff05e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:54.411491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a8e52e5-a8be-4343-8a21-9d5a9c1ff05e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:54.411946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a8e52e5-a8be-4343-8a21-9d5a9c1ff05e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:54.552375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1a8e52e5-a8be-4343-8a21-9d5a9c1ff05e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:54.560708 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1a8e52e5-a8be-4343-8a21-9d5a9c1ff05e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1679 microversion: 2.1 time: 0.162977 Jul 28 04:36:54.561285 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4550/7000] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:54 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:55.530542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0c552130-b0ff-470b-b248-c96a1ed721c8 req-68073eee-84fa-40ac-bfda-0c76c68a09c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e27551-9e3d-4bea-8f27-1f55f81146ae", "name": "network-vif-plugged", "status": "completed", "tag": "36738da1-a007-4f95-81ca-1b797a550d3c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:36:55.542874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0c552130-b0ff-470b-b248-c96a1ed721c8 req-68073eee-84fa-40ac-bfda-0c76c68a09c7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:55.543330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0c552130-b0ff-470b-b248-c96a1ed721c8 req-68073eee-84fa-40ac-bfda-0c76c68a09c7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:55.558874 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0c552130-b0ff-470b-b248-c96a1ed721c8 req-68073eee-84fa-40ac-bfda-0c76c68a09c7 service nova] Creating event network-vif-plugged:36738da1-a007-4f95-81ca-1b797a550d3c for instance 45e27551-9e3d-4bea-8f27-1f55f81146ae on n-h2-826756-3 Jul 28 04:36:55.564036 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0c552130-b0ff-470b-b248-c96a1ed721c8 req-68073eee-84fa-40ac-bfda-0c76c68a09c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037924 Jul 28 04:36:55.564687 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4551/7001] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:36:55.584289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-533b89a4-df00-420c-84e7-a3be26ae7a3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:55.585068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-533b89a4-df00-420c-84e7-a3be26ae7a3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:55.591880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-533b89a4-df00-420c-84e7-a3be26ae7a3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:55.592340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-533b89a4-df00-420c-84e7-a3be26ae7a3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:55.593149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-533b89a4-df00-420c-84e7-a3be26ae7a3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:55.593593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-533b89a4-df00-420c-84e7-a3be26ae7a3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:55.734389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-533b89a4-df00-420c-84e7-a3be26ae7a3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:55.742384 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-533b89a4-df00-420c-84e7-a3be26ae7a3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1671 microversion: 2.1 time: 0.163256 Jul 28 04:36:55.742992 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4552/7002] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:55 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:36:55.763937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-231e5a6b-6f89-4a63-8117-fd6a4779c777 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:55.764596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-231e5a6b-6f89-4a63-8117-fd6a4779c777 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:55.770661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-231e5a6b-6f89-4a63-8117-fd6a4779c777 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:55.771127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-231e5a6b-6f89-4a63-8117-fd6a4779c777 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:55.771898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-231e5a6b-6f89-4a63-8117-fd6a4779c777 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:55.772369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-231e5a6b-6f89-4a63-8117-fd6a4779c777 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:55.909348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-231e5a6b-6f89-4a63-8117-fd6a4779c777 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:55.919873 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-231e5a6b-6f89-4a63-8117-fd6a4779c777 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1671 microversion: 2.1 time: 0.160031 Jul 28 04:36:55.920450 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4553/7003] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:55 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:55.939825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-35fea6f1-4bec-4f2b-a2be-606d3db5971c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:55.940475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-35fea6f1-4bec-4f2b-a2be-606d3db5971c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:55.946597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35fea6f1-4bec-4f2b-a2be-606d3db5971c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:55.947060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35fea6f1-4bec-4f2b-a2be-606d3db5971c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:55.947841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35fea6f1-4bec-4f2b-a2be-606d3db5971c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:55.948292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35fea6f1-4bec-4f2b-a2be-606d3db5971c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:56.092839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-35fea6f1-4bec-4f2b-a2be-606d3db5971c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:56.101244 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-35fea6f1-4bec-4f2b-a2be-606d3db5971c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1671 microversion: 2.1 time: 0.165058 Jul 28 04:36:56.101806 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4554/7004] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:55 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:36:56.121352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a0a524b-a449-4bb7-ae84-b5a75867fff9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:56.121865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4a0a524b-a449-4bb7-ae84-b5a75867fff9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:56.128295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a0a524b-a449-4bb7-ae84-b5a75867fff9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:56.128798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a0a524b-a449-4bb7-ae84-b5a75867fff9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:56.129595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a0a524b-a449-4bb7-ae84-b5a75867fff9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:56.130047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a0a524b-a449-4bb7-ae84-b5a75867fff9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:56.155723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4a0a524b-a449-4bb7-ae84-b5a75867fff9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:36:56.204265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:36:56.243736 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4a0a524b-a449-4bb7-ae84-b5a75867fff9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "DELETE /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 204 len: 0 microversion: 2.1 time: 0.125732 Jul 28 04:36:56.244342 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4555/7005] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:36:56 2022] DELETE /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:36:56.253432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-87f5a37e-efc6-419e-af5a-abe87e005100 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:56.254151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-87f5a37e-efc6-419e-af5a-abe87e005100 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:56.260800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87f5a37e-efc6-419e-af5a-abe87e005100 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:56.261267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87f5a37e-efc6-419e-af5a-abe87e005100 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:56.262037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87f5a37e-efc6-419e-af5a-abe87e005100 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:56.262492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-87f5a37e-efc6-419e-af5a-abe87e005100 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:56.412267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-87f5a37e-efc6-419e-af5a-abe87e005100 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:56.420888 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-87f5a37e-efc6-419e-af5a-abe87e005100 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1677 microversion: 2.1 time: 0.171618 Jul 28 04:36:56.421490 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4556/7006] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:56 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:36:57.380995 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:36:57.381706 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:36:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:36:57.443055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44a43621-f741-49c4-b1b2-4a593b67d60d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:57.443702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-44a43621-f741-49c4-b1b2-4a593b67d60d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:57.451165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44a43621-f741-49c4-b1b2-4a593b67d60d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:57.451629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44a43621-f741-49c4-b1b2-4a593b67d60d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:57.452455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44a43621-f741-49c4-b1b2-4a593b67d60d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:57.452915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44a43621-f741-49c4-b1b2-4a593b67d60d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:57.595698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44a43621-f741-49c4-b1b2-4a593b67d60d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:57.608788 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-44a43621-f741-49c4-b1b2-4a593b67d60d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1677 microversion: 2.1 time: 0.169349 Jul 28 04:36:57.609604 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4557/7007] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:57 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:36:58.631090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce1adaef-4b9b-4d62-92d3-196876d30b45 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:58.631715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ce1adaef-4b9b-4d62-92d3-196876d30b45 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:58.639187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce1adaef-4b9b-4d62-92d3-196876d30b45 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:58.639642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce1adaef-4b9b-4d62-92d3-196876d30b45 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:58.640477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce1adaef-4b9b-4d62-92d3-196876d30b45 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:58.640934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce1adaef-4b9b-4d62-92d3-196876d30b45 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:58.705720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ce1adaef-4b9b-4d62-92d3-196876d30b45 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:36:58.714177 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce1adaef-4b9b-4d62-92d3-196876d30b45 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 200 len: 1609 microversion: 2.1 time: 0.087039 Jul 28 04:36:58.714974 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4558/7008] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:58 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 1609 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:36:58.740649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-8224efab-fde9-4db0-ad26-b8528c26c67f req-ee8e0a1a-4c64-4e65-ab5c-eb56c1884493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e27551-9e3d-4bea-8f27-1f55f81146ae", "name": "network-vif-deleted", "tag": "36738da1-a007-4f95-81ca-1b797a550d3c"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:36:58.750744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8224efab-fde9-4db0-ad26-b8528c26c67f req-ee8e0a1a-4c64-4e65-ab5c-eb56c1884493 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:58.751221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8224efab-fde9-4db0-ad26-b8528c26c67f req-ee8e0a1a-4c64-4e65-ab5c-eb56c1884493 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:58.765190 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-8224efab-fde9-4db0-ad26-b8528c26c67f req-ee8e0a1a-4c64-4e65-ab5c-eb56c1884493 service nova] Creating event network-vif-deleted:36738da1-a007-4f95-81ca-1b797a550d3c for instance 45e27551-9e3d-4bea-8f27-1f55f81146ae on n-h2-826756-3 Jul 28 04:36:58.770666 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-8224efab-fde9-4db0-ad26-b8528c26c67f req-ee8e0a1a-4c64-4e65-ab5c-eb56c1884493 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033727 Jul 28 04:36:58.771949 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4559/7009] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:36:59.737140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fff4fcf4-e322-431c-a187-4e3e7b0f42d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:59.737803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fff4fcf4-e322-431c-a187-4e3e7b0f42d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:59.745224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fff4fcf4-e322-431c-a187-4e3e7b0f42d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:59.745691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fff4fcf4-e322-431c-a187-4e3e7b0f42d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:59.746478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fff4fcf4-e322-431c-a187-4e3e7b0f42d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:59.746944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fff4fcf4-e322-431c-a187-4e3e7b0f42d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:59.761204 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-fff4fcf4-e322-431c-a187-4e3e7b0f42d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fff4fcf4-e322-431c-a187-4e3e7b0f42d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae HTTP/1.1 Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '45e27551-9e3d-4bea-8f27-1f55f81146ae'} Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:36:59.763023 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:36:59.766738 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:36:59.766738 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:36:59.766738 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:36:59.766738 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:36:59.766738 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:36:59.766738 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:36:59.766738 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:36:59.766738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fff4fcf4-e322-431c-a187-4e3e7b0f42d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:36:59.766738 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fff4fcf4-e322-431c-a187-4e3e7b0f42d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 404 len: 111 microversion: 2.1 time: 0.031773 Jul 28 04:36:59.766738 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4560/7010] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:59 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:36:59.778287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-25d49162-7710-4771-9bde-afbc66850b5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:36:59.778914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-25d49162-7710-4771-9bde-afbc66850b5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:36:59.785180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25d49162-7710-4771-9bde-afbc66850b5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:59.785649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25d49162-7710-4771-9bde-afbc66850b5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:59.786441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25d49162-7710-4771-9bde-afbc66850b5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:36:59.786884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25d49162-7710-4771-9bde-afbc66850b5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:36:59.801014 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-25d49162-7710-4771-9bde-afbc66850b5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-25d49162-7710-4771-9bde-afbc66850b5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae HTTP/1.1 Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '45e27551-9e3d-4bea-8f27-1f55f81146ae'} Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:36:59.802608 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:36:59.806228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:36:59.806228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:36:59.806228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:36:59.806228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:36:59.806228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:36:59.806228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:36:59.806228 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:36:59.806228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-25d49162-7710-4771-9bde-afbc66850b5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:36:59.806228 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-25d49162-7710-4771-9bde-afbc66850b5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 404 len: 111 microversion: 2.1 time: 0.030792 Jul 28 04:36:59.806228 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4561/7011] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:36:59 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:36:59.853941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2025290205", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f8f2e3d3-2fb2-4562-92db-6678cb2b2773"}], "security_groups": [{"name": "tempest-securitygroup--2127946259"}], "key_name": "tempest-keypair-1754507874", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:36:59.975172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] validate_networks() for [('f8f2e3d3-2fb2-4562-92db-6678cb2b2773', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:37:00.381132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:37:00.381574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:37:00.382067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:37:00.382523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:37:00.382984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:37:00.392589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:00.393059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:00.393875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:00.394329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:00.412225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Getting quotas for project a519852ab6f045779941ca2ed3e4f4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:37:00.418110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Getting quotas for user da44c0d51e7a4b1aabf1b73597301cd1 and project a519852ab6f045779941ca2ed3e4f4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:37:00.432085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:37:00.434473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:37:00.445772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:37:00.486933 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f9868a51-4dcf-45a6-b6e0-c11d6e091048 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.637055 Jul 28 04:37:00.487996 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4562/7012] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:36:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:37:00.499366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-edf22080-550b-4c23-892b-1cb2d84ded2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:00.500003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-edf22080-550b-4c23-892b-1cb2d84ded2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:00.555831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-edf22080-550b-4c23-892b-1cb2d84ded2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:00.563872 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-edf22080-550b-4c23-892b-1cb2d84ded2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1239 microversion: 2.1 time: 0.068833 Jul 28 04:37:00.564478 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4563/7013] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:00 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:37:01.586046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc66b807-1a05-4907-ba9b-b409d3274e8b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:01.586828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cc66b807-1a05-4907-ba9b-b409d3274e8b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:01.594300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc66b807-1a05-4907-ba9b-b409d3274e8b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:01.594773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc66b807-1a05-4907-ba9b-b409d3274e8b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:01.595577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc66b807-1a05-4907-ba9b-b409d3274e8b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:01.596497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc66b807-1a05-4907-ba9b-b409d3274e8b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:01.659183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cc66b807-1a05-4907-ba9b-b409d3274e8b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:01.667331 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cc66b807-1a05-4907-ba9b-b409d3274e8b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1297 microversion: 2.1 time: 0.085334 Jul 28 04:37:01.668048 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4564/7014] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:01 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:02.690207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ac843ff9-151d-4e77-8811-5f484a45c16d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:02.691057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ac843ff9-151d-4e77-8811-5f484a45c16d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:02.698696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac843ff9-151d-4e77-8811-5f484a45c16d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:02.699160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac843ff9-151d-4e77-8811-5f484a45c16d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:02.700229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac843ff9-151d-4e77-8811-5f484a45c16d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:02.701156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac843ff9-151d-4e77-8811-5f484a45c16d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:02.890973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ac843ff9-151d-4e77-8811-5f484a45c16d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:02.900531 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ac843ff9-151d-4e77-8811-5f484a45c16d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1365 microversion: 2.1 time: 0.215448 Jul 28 04:37:02.901148 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4565/7015] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:02 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:02.918570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-fdd03d65-8797-4f4e-b083-827661a16a79 req-7a2717fb-9640-41be-b40c-1614861376b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8aba63a-7017-43a5-a957-c0d45fa309b0", "tag": "a29df084-ccf2-4525-8103-77e1d5213bbc"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:37:02.930308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fdd03d65-8797-4f4e-b083-827661a16a79 req-7a2717fb-9640-41be-b40c-1614861376b3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:02.930921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fdd03d65-8797-4f4e-b083-827661a16a79 req-7a2717fb-9640-41be-b40c-1614861376b3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:02.943541 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-fdd03d65-8797-4f4e-b083-827661a16a79 req-7a2717fb-9640-41be-b40c-1614861376b3 service nova] Creating event network-changed:a29df084-ccf2-4525-8103-77e1d5213bbc for instance c8aba63a-7017-43a5-a957-c0d45fa309b0 on n-h1-826756-3 Jul 28 04:37:02.950373 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-fdd03d65-8797-4f4e-b083-827661a16a79 req-7a2717fb-9640-41be-b40c-1614861376b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044200 Jul 28 04:37:02.950746 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4566/7016] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:37:03.929624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8403bca6-3bb8-429d-bd4a-6880237a83ea tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:03.930736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8403bca6-3bb8-429d-bd4a-6880237a83ea tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:03.941995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8403bca6-3bb8-429d-bd4a-6880237a83ea tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:03.942761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8403bca6-3bb8-429d-bd4a-6880237a83ea tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:03.944048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8403bca6-3bb8-429d-bd4a-6880237a83ea tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:03.944827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8403bca6-3bb8-429d-bd4a-6880237a83ea tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:04.104179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8403bca6-3bb8-429d-bd4a-6880237a83ea tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:04.112178 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8403bca6-3bb8-429d-bd4a-6880237a83ea tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1365 microversion: 2.1 time: 0.191212 Jul 28 04:37:04.112753 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4567/7017] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:03 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:05.137463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f1cfdab5-b780-4544-8a4d-0f5ede1d8c2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:05.138130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f1cfdab5-b780-4544-8a4d-0f5ede1d8c2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:05.149469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1cfdab5-b780-4544-8a4d-0f5ede1d8c2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:05.150141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1cfdab5-b780-4544-8a4d-0f5ede1d8c2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:05.150990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1cfdab5-b780-4544-8a4d-0f5ede1d8c2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:05.151430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1cfdab5-b780-4544-8a4d-0f5ede1d8c2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:05.304306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f1cfdab5-b780-4544-8a4d-0f5ede1d8c2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:05.313017 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f1cfdab5-b780-4544-8a4d-0f5ede1d8c2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1365 microversion: 2.1 time: 0.181805 Jul 28 04:37:05.313531 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4568/7018] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:05 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:06.339206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9565b6ea-da09-47a8-9a7b-ae9f55cfb29a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:06.340249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9565b6ea-da09-47a8-9a7b-ae9f55cfb29a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:06.352543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9565b6ea-da09-47a8-9a7b-ae9f55cfb29a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:06.353464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9565b6ea-da09-47a8-9a7b-ae9f55cfb29a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:06.354752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9565b6ea-da09-47a8-9a7b-ae9f55cfb29a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:06.355539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9565b6ea-da09-47a8-9a7b-ae9f55cfb29a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:06.504599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9565b6ea-da09-47a8-9a7b-ae9f55cfb29a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:06.513348 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9565b6ea-da09-47a8-9a7b-ae9f55cfb29a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1365 microversion: 2.1 time: 0.180952 Jul 28 04:37:06.514129 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4569/7019] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:06 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:07.540588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ab438451-09e2-4fbb-8d19-5afea3c0c52a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:07.541640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ab438451-09e2-4fbb-8d19-5afea3c0c52a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:07.553215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab438451-09e2-4fbb-8d19-5afea3c0c52a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:07.553960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab438451-09e2-4fbb-8d19-5afea3c0c52a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:07.555136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab438451-09e2-4fbb-8d19-5afea3c0c52a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:07.555858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab438451-09e2-4fbb-8d19-5afea3c0c52a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:07.705181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ab438451-09e2-4fbb-8d19-5afea3c0c52a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:07.718165 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ab438451-09e2-4fbb-8d19-5afea3c0c52a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1365 microversion: 2.1 time: 0.183610 Jul 28 04:37:07.718988 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4570/7020] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:07 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:37:08.745344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c51f9078-fac3-4adc-a31d-a4d5591a3d02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:08.746012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c51f9078-fac3-4adc-a31d-a4d5591a3d02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:08.754068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c51f9078-fac3-4adc-a31d-a4d5591a3d02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:08.754543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c51f9078-fac3-4adc-a31d-a4d5591a3d02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:08.755342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c51f9078-fac3-4adc-a31d-a4d5591a3d02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:08.755801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c51f9078-fac3-4adc-a31d-a4d5591a3d02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:08.906451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c51f9078-fac3-4adc-a31d-a4d5591a3d02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:08.915077 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c51f9078-fac3-4adc-a31d-a4d5591a3d02 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1365 microversion: 2.1 time: 0.174805 Jul 28 04:37:08.915663 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4571/7021] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:08 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:09.140806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-cd3ab3bb-17d5-4390-801f-d3b1f46cba25 req-c320c905-ab37-4f78-b0c0-806346dee81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8aba63a-7017-43a5-a957-c0d45fa309b0", "name": "network-vif-plugged", "status": "completed", "tag": "a29df084-ccf2-4525-8103-77e1d5213bbc"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:37:09.151633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cd3ab3bb-17d5-4390-801f-d3b1f46cba25 req-c320c905-ab37-4f78-b0c0-806346dee81a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:09.152159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cd3ab3bb-17d5-4390-801f-d3b1f46cba25 req-c320c905-ab37-4f78-b0c0-806346dee81a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:09.164050 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-cd3ab3bb-17d5-4390-801f-d3b1f46cba25 req-c320c905-ab37-4f78-b0c0-806346dee81a service nova] Creating event network-vif-plugged:a29df084-ccf2-4525-8103-77e1d5213bbc for instance c8aba63a-7017-43a5-a957-c0d45fa309b0 on n-h1-826756-3 Jul 28 04:37:09.169374 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-cd3ab3bb-17d5-4390-801f-d3b1f46cba25 req-c320c905-ab37-4f78-b0c0-806346dee81a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032819 Jul 28 04:37:09.169962 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4572/7022] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:37:09.938490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e671b736-9b9a-4f54-ba10-2e0c685de68f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:09.939184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e671b736-9b9a-4f54-ba10-2e0c685de68f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:09.945754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e671b736-9b9a-4f54-ba10-2e0c685de68f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:09.946232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e671b736-9b9a-4f54-ba10-2e0c685de68f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:09.947146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e671b736-9b9a-4f54-ba10-2e0c685de68f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:09.947615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e671b736-9b9a-4f54-ba10-2e0c685de68f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:10.085457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e671b736-9b9a-4f54-ba10-2e0c685de68f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:10.093697 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e671b736-9b9a-4f54-ba10-2e0c685de68f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1365 microversion: 2.1 time: 0.160495 Jul 28 04:37:10.094281 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4573/7023] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:09 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:11.118861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8dcea536-6a98-4386-b7a0-f0362a795fcd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:11.119548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8dcea536-6a98-4386-b7a0-f0362a795fcd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:11.121584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:37:11.122541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:37:11.129255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dcea536-6a98-4386-b7a0-f0362a795fcd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:11.129702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dcea536-6a98-4386-b7a0-f0362a795fcd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:11.130531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dcea536-6a98-4386-b7a0-f0362a795fcd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:11.130982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8dcea536-6a98-4386-b7a0-f0362a795fcd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:11.275885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8dcea536-6a98-4386-b7a0-f0362a795fcd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:11.284275 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8dcea536-6a98-4386-b7a0-f0362a795fcd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1552 microversion: 2.1 time: 0.171615 Jul 28 04:37:11.284899 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4574/7024] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:11 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1552 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:11.305441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7e413403-7064-4e35-86a2-e9fc356cd2e4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:11.306108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7e413403-7064-4e35-86a2-e9fc356cd2e4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:11.315395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e413403-7064-4e35-86a2-e9fc356cd2e4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:11.315977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e413403-7064-4e35-86a2-e9fc356cd2e4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:11.316864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e413403-7064-4e35-86a2-e9fc356cd2e4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:11.317383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e413403-7064-4e35-86a2-e9fc356cd2e4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:11.401531 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7e413403-7064-4e35-86a2-e9fc356cd2e4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099789 Jul 28 04:37:11.402126 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4575/7025] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 04:37:11 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:37:12.386998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e7c9f3b1-dc6e-4652-88cb-8ae80bec554b req-050a0ffd-0b08-4b64-a6b1-e91a383fee3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8aba63a-7017-43a5-a957-c0d45fa309b0", "tag": "a29df084-ccf2-4525-8103-77e1d5213bbc"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:37:12.397023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e7c9f3b1-dc6e-4652-88cb-8ae80bec554b req-050a0ffd-0b08-4b64-a6b1-e91a383fee3c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:12.397484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e7c9f3b1-dc6e-4652-88cb-8ae80bec554b req-050a0ffd-0b08-4b64-a6b1-e91a383fee3c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:12.412394 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e7c9f3b1-dc6e-4652-88cb-8ae80bec554b req-050a0ffd-0b08-4b64-a6b1-e91a383fee3c service nova] Creating event network-changed:a29df084-ccf2-4525-8103-77e1d5213bbc for instance c8aba63a-7017-43a5-a957-c0d45fa309b0 on n-h1-826756-3 Jul 28 04:37:12.417624 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e7c9f3b1-dc6e-4652-88cb-8ae80bec554b req-050a0ffd-0b08-4b64-a6b1-e91a383fee3c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035530 Jul 28 04:37:12.418257 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4576/7026] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:37:45.291475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=30 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:37:45.292653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:37:45.297148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7063e6a8-af56-4e3c-82e8-8f005cd99e5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:37:45.305268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7063e6a8-af56-4e3c-82e8-8f005cd99e5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:45.305718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7063e6a8-af56-4e3c-82e8-8f005cd99e5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:45.328586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7063e6a8-af56-4e3c-82e8-8f005cd99e5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Going to try to stop instance {{(pid=126071) force_stop /opt/stack/nova/nova/compute/api.py:2753}} Jul 28 04:37:45.376411 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7063e6a8-af56-4e3c-82e8-8f005cd99e5e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0/action" status: 202 len: 0 microversion: 2.1 time: 0.086864 Jul 28 04:37:45.377022 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4577/7027] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:37:45 2022] POST /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:37:45.385559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-38527b32-e431-4a5c-b01f-2138ccdbd8ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:45.386267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-38527b32-e431-4a5c-b01f-2138ccdbd8ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:45.393263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-38527b32-e431-4a5c-b01f-2138ccdbd8ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:45.393776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-38527b32-e431-4a5c-b01f-2138ccdbd8ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:45.394653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-38527b32-e431-4a5c-b01f-2138ccdbd8ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:45.395135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-38527b32-e431-4a5c-b01f-2138ccdbd8ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:45.530990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-38527b32-e431-4a5c-b01f-2138ccdbd8ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:45.539555 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-38527b32-e431-4a5c-b01f-2138ccdbd8ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1681 microversion: 2.1 time: 0.158106 Jul 28 04:37:45.540106 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4578/7028] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:45 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:37:46.561502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e342159e-a7f2-41a3-8c6e-da777712aac4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:46.562192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e342159e-a7f2-41a3-8c6e-da777712aac4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:46.569638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e342159e-a7f2-41a3-8c6e-da777712aac4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:46.570113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e342159e-a7f2-41a3-8c6e-da777712aac4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:46.570883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e342159e-a7f2-41a3-8c6e-da777712aac4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:46.571326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e342159e-a7f2-41a3-8c6e-da777712aac4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:46.721303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e342159e-a7f2-41a3-8c6e-da777712aac4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:46.729775 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e342159e-a7f2-41a3-8c6e-da777712aac4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1681 microversion: 2.1 time: 0.172305 Jul 28 04:37:46.730355 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4579/7029] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:46 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:37:47.756607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-150473c4-0c98-45cd-90c8-c30074090031 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:47.757658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-150473c4-0c98-45cd-90c8-c30074090031 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:47.768908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150473c4-0c98-45cd-90c8-c30074090031 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:47.769376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150473c4-0c98-45cd-90c8-c30074090031 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:47.770157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150473c4-0c98-45cd-90c8-c30074090031 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:47.770612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150473c4-0c98-45cd-90c8-c30074090031 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:47.921835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-150473c4-0c98-45cd-90c8-c30074090031 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:47.932010 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-150473c4-0c98-45cd-90c8-c30074090031 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1681 microversion: 2.1 time: 0.181780 Jul 28 04:37:47.932976 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4580/7030] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:47 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:48.960543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d072462f-1bce-4df8-a467-4d086fdd958e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:48.961142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d072462f-1bce-4df8-a467-4d086fdd958e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:48.971386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d072462f-1bce-4df8-a467-4d086fdd958e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:48.971956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d072462f-1bce-4df8-a467-4d086fdd958e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:48.973126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d072462f-1bce-4df8-a467-4d086fdd958e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:48.973579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d072462f-1bce-4df8-a467-4d086fdd958e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:49.111351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d072462f-1bce-4df8-a467-4d086fdd958e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:49.120179 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d072462f-1bce-4df8-a467-4d086fdd958e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1681 microversion: 2.1 time: 0.166106 Jul 28 04:37:49.121176 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4581/7031] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:48 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:50.145484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5961553f-829e-40ce-b27c-24bc55ff7e43 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:50.146106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5961553f-829e-40ce-b27c-24bc55ff7e43 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:50.154130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5961553f-829e-40ce-b27c-24bc55ff7e43 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:50.154592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5961553f-829e-40ce-b27c-24bc55ff7e43 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:50.155367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5961553f-829e-40ce-b27c-24bc55ff7e43 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:50.155814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5961553f-829e-40ce-b27c-24bc55ff7e43 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:50.309605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5961553f-829e-40ce-b27c-24bc55ff7e43 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:50.320113 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5961553f-829e-40ce-b27c-24bc55ff7e43 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1681 microversion: 2.1 time: 0.180344 Jul 28 04:37:50.320767 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4582/7032] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:50 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:51.342969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2d36b5a-878e-4a63-bd1e-db4a00eec95f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:51.343650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d2d36b5a-878e-4a63-bd1e-db4a00eec95f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:51.351610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2d36b5a-878e-4a63-bd1e-db4a00eec95f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:51.352075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2d36b5a-878e-4a63-bd1e-db4a00eec95f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:51.352874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2d36b5a-878e-4a63-bd1e-db4a00eec95f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:51.353321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2d36b5a-878e-4a63-bd1e-db4a00eec95f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:51.506165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d2d36b5a-878e-4a63-bd1e-db4a00eec95f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:51.519059 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d2d36b5a-878e-4a63-bd1e-db4a00eec95f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1681 microversion: 2.1 time: 0.180427 Jul 28 04:37:51.519649 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4583/7033] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:51 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:52.543067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b73094f6-8f48-41a9-a30d-e072000384d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:52.543981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b73094f6-8f48-41a9-a30d-e072000384d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:52.553659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b73094f6-8f48-41a9-a30d-e072000384d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:52.554284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b73094f6-8f48-41a9-a30d-e072000384d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:52.555332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b73094f6-8f48-41a9-a30d-e072000384d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:52.556103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b73094f6-8f48-41a9-a30d-e072000384d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:52.701259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b73094f6-8f48-41a9-a30d-e072000384d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:52.709420 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b73094f6-8f48-41a9-a30d-e072000384d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1681 microversion: 2.1 time: 0.171650 Jul 28 04:37:52.710000 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4584/7034] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:52 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:53.735631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5565a870-e454-4c98-9bad-c0fceb414833 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:53.736683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5565a870-e454-4c98-9bad-c0fceb414833 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:53.744624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5565a870-e454-4c98-9bad-c0fceb414833 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:53.745089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5565a870-e454-4c98-9bad-c0fceb414833 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:53.746036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5565a870-e454-4c98-9bad-c0fceb414833 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:53.746314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5565a870-e454-4c98-9bad-c0fceb414833 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:53.890639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5565a870-e454-4c98-9bad-c0fceb414833 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:53.898947 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5565a870-e454-4c98-9bad-c0fceb414833 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1681 microversion: 2.1 time: 0.170148 Jul 28 04:37:53.899542 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4585/7035] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:53 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:54.925106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8bde6e32-a8bb-4014-9dd4-9d9c22072f77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:54.926234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8bde6e32-a8bb-4014-9dd4-9d9c22072f77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:54.938075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bde6e32-a8bb-4014-9dd4-9d9c22072f77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:54.938845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bde6e32-a8bb-4014-9dd4-9d9c22072f77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:54.940151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bde6e32-a8bb-4014-9dd4-9d9c22072f77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:54.941062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bde6e32-a8bb-4014-9dd4-9d9c22072f77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:55.085479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8bde6e32-a8bb-4014-9dd4-9d9c22072f77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:55.093683 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8bde6e32-a8bb-4014-9dd4-9d9c22072f77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1681 microversion: 2.1 time: 0.175518 Jul 28 04:37:55.094267 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4586/7036] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:54 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:56.115836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d5691a4-11d8-4b41-b2cf-7ad485a9f9fd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:56.116492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5d5691a4-11d8-4b41-b2cf-7ad485a9f9fd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:56.123178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d5691a4-11d8-4b41-b2cf-7ad485a9f9fd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:56.123639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d5691a4-11d8-4b41-b2cf-7ad485a9f9fd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:56.124427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d5691a4-11d8-4b41-b2cf-7ad485a9f9fd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:56.124873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d5691a4-11d8-4b41-b2cf-7ad485a9f9fd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:56.261762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5d5691a4-11d8-4b41-b2cf-7ad485a9f9fd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:56.270018 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5d5691a4-11d8-4b41-b2cf-7ad485a9f9fd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1658 microversion: 2.1 time: 0.158669 Jul 28 04:37:56.270594 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4587/7037] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:56 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1658 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:56.290413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9cbfcc01-3236-4f85-85dd-77e641762cec tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:37:56.292739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9cbfcc01-3236-4f85-85dd-77e641762cec tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:56.298714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cbfcc01-3236-4f85-85dd-77e641762cec tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:56.299184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cbfcc01-3236-4f85-85dd-77e641762cec tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:56.299967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cbfcc01-3236-4f85-85dd-77e641762cec tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:56.300443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cbfcc01-3236-4f85-85dd-77e641762cec tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:56.329108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9cbfcc01-3236-4f85-85dd-77e641762cec tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:56.335950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9cbfcc01-3236-4f85-85dd-77e641762cec tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Old instance type m1.heat2, new instance type m1.heat {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 04:37:56.342357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9cbfcc01-3236-4f85-85dd-77e641762cec tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:37:56.342791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9cbfcc01-3236-4f85-85dd-77e641762cec tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:37:56.343279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9cbfcc01-3236-4f85-85dd-77e641762cec tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:37:56.343703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9cbfcc01-3236-4f85-85dd-77e641762cec tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:37:56.344129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9cbfcc01-3236-4f85-85dd-77e641762cec tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:37:56.412228 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9cbfcc01-3236-4f85-85dd-77e641762cec tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0/action" status: 202 len: 0 microversion: 2.1 time: 0.125560 Jul 28 04:37:56.412884 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4588/7038] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:37:56 2022] POST /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:37:56.420888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-965a6e03-718d-4f07-b99a-2d73e076f041 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:56.421503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-965a6e03-718d-4f07-b99a-2d73e076f041 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:56.428753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-965a6e03-718d-4f07-b99a-2d73e076f041 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:56.429219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-965a6e03-718d-4f07-b99a-2d73e076f041 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:56.430042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-965a6e03-718d-4f07-b99a-2d73e076f041 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:56.430490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-965a6e03-718d-4f07-b99a-2d73e076f041 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:56.564956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-965a6e03-718d-4f07-b99a-2d73e076f041 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:56.573031 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-965a6e03-718d-4f07-b99a-2d73e076f041 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1681 microversion: 2.1 time: 0.155851 Jul 28 04:37:56.573845 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4589/7039] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:56 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:57.595579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9e860ba0-fd1e-4879-b505-13eb377beb65 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:57.596294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9e860ba0-fd1e-4879-b505-13eb377beb65 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:57.604849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e860ba0-fd1e-4879-b505-13eb377beb65 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:57.605349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e860ba0-fd1e-4879-b505-13eb377beb65 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:57.606143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e860ba0-fd1e-4879-b505-13eb377beb65 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:57.606601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e860ba0-fd1e-4879-b505-13eb377beb65 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:57.759025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9e860ba0-fd1e-4879-b505-13eb377beb65 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:57.768879 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9e860ba0-fd1e-4879-b505-13eb377beb65 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1681 microversion: 2.1 time: 0.177398 Jul 28 04:37:57.769593 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4590/7040] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:57 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:58.791603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eab57b17-3415-47b7-a101-9e0d7524ea11 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:58.792339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eab57b17-3415-47b7-a101-9e0d7524ea11 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:58.800839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eab57b17-3415-47b7-a101-9e0d7524ea11 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:58.801355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eab57b17-3415-47b7-a101-9e0d7524ea11 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:58.802205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eab57b17-3415-47b7-a101-9e0d7524ea11 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:37:58.802897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eab57b17-3415-47b7-a101-9e0d7524ea11 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:37:58.807119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:37:58.951831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eab57b17-3415-47b7-a101-9e0d7524ea11 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:37:58.961223 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eab57b17-3415-47b7-a101-9e0d7524ea11 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1686 microversion: 2.1 time: 0.174161 Jul 28 04:37:58.961822 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4591/7041] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:58 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1686 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:37:59.987182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7242e910-f1b2-4472-91f3-4e2a3f6c4039 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:37:59.988193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7242e910-f1b2-4472-91f3-4e2a3f6c4039 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:37:59.999825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7242e910-f1b2-4472-91f3-4e2a3f6c4039 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:00.000637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7242e910-f1b2-4472-91f3-4e2a3f6c4039 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:00.001911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7242e910-f1b2-4472-91f3-4e2a3f6c4039 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:00.002653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7242e910-f1b2-4472-91f3-4e2a3f6c4039 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:00.140862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7242e910-f1b2-4472-91f3-4e2a3f6c4039 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:00.148742 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7242e910-f1b2-4472-91f3-4e2a3f6c4039 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1686 microversion: 2.1 time: 0.168293 Jul 28 04:38:00.149325 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4592/7042] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:37:59 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:01.026380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f656af2c-c6a3-48dc-af93-f045c6df9d7a req-3e7a555f-165e-4c09-b673-4a7460c5d2ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8aba63a-7017-43a5-a957-c0d45fa309b0", "name": "network-vif-unplugged", "status": "completed", "tag": "a29df084-ccf2-4525-8103-77e1d5213bbc"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:38:01.045423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f656af2c-c6a3-48dc-af93-f045c6df9d7a req-3e7a555f-165e-4c09-b673-4a7460c5d2ad service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:01.045906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f656af2c-c6a3-48dc-af93-f045c6df9d7a req-3e7a555f-165e-4c09-b673-4a7460c5d2ad service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:01.060832 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f656af2c-c6a3-48dc-af93-f045c6df9d7a req-3e7a555f-165e-4c09-b673-4a7460c5d2ad service nova] Creating event network-vif-unplugged:a29df084-ccf2-4525-8103-77e1d5213bbc for instance c8aba63a-7017-43a5-a957-c0d45fa309b0 on n-h2-826756-3 Jul 28 04:38:01.066770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-f656af2c-c6a3-48dc-af93-f045c6df9d7a req-3e7a555f-165e-4c09-b673-4a7460c5d2ad service nova] Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:38:01.077932 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f656af2c-c6a3-48dc-af93-f045c6df9d7a req-3e7a555f-165e-4c09-b673-4a7460c5d2ad service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055569 Jul 28 04:38:01.078556 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4593/7043] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:38:01.170944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fd0fb382-0afb-4c7f-81e1-95afd40f7a5f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:01.171665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fd0fb382-0afb-4c7f-81e1-95afd40f7a5f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:01.179125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd0fb382-0afb-4c7f-81e1-95afd40f7a5f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:01.179598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd0fb382-0afb-4c7f-81e1-95afd40f7a5f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:01.180419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd0fb382-0afb-4c7f-81e1-95afd40f7a5f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:01.180881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd0fb382-0afb-4c7f-81e1-95afd40f7a5f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:01.330722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fd0fb382-0afb-4c7f-81e1-95afd40f7a5f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:01.339516 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fd0fb382-0afb-4c7f-81e1-95afd40f7a5f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1685 microversion: 2.1 time: 0.173443 Jul 28 04:38:01.340107 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4594/7044] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:01 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:02.362727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7325c442-57a7-46c2-b1c6-bc877d08b0ca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:02.363460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7325c442-57a7-46c2-b1c6-bc877d08b0ca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:02.371174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7325c442-57a7-46c2-b1c6-bc877d08b0ca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:02.371820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7325c442-57a7-46c2-b1c6-bc877d08b0ca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:02.372641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7325c442-57a7-46c2-b1c6-bc877d08b0ca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:02.373095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7325c442-57a7-46c2-b1c6-bc877d08b0ca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:02.511079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7325c442-57a7-46c2-b1c6-bc877d08b0ca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:02.519968 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7325c442-57a7-46c2-b1c6-bc877d08b0ca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1685 microversion: 2.1 time: 0.161388 Jul 28 04:38:02.520897 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4595/7045] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:02 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:03.099208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-48697810-7803-44b8-8806-dd0a3b42c494 req-5f8dc358-14fa-4a7c-ba26-56eb1f6331a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8aba63a-7017-43a5-a957-c0d45fa309b0", "tag": "a29df084-ccf2-4525-8103-77e1d5213bbc"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:38:03.109291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-48697810-7803-44b8-8806-dd0a3b42c494 req-5f8dc358-14fa-4a7c-ba26-56eb1f6331a3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:03.109747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-48697810-7803-44b8-8806-dd0a3b42c494 req-5f8dc358-14fa-4a7c-ba26-56eb1f6331a3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:03.123068 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-48697810-7803-44b8-8806-dd0a3b42c494 req-5f8dc358-14fa-4a7c-ba26-56eb1f6331a3 service nova] Creating event network-changed:a29df084-ccf2-4525-8103-77e1d5213bbc for instance c8aba63a-7017-43a5-a957-c0d45fa309b0 on n-h2-826756-3 Jul 28 04:38:03.128728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-48697810-7803-44b8-8806-dd0a3b42c494 req-5f8dc358-14fa-4a7c-ba26-56eb1f6331a3 service nova] Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:38:03.139948 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-48697810-7803-44b8-8806-dd0a3b42c494 req-5f8dc358-14fa-4a7c-ba26-56eb1f6331a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044938 Jul 28 04:38:03.140618 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4596/7046] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:38:03.543695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-84451998-2901-46f2-930c-eb088575a840 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:03.544578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-84451998-2901-46f2-930c-eb088575a840 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:03.551355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84451998-2901-46f2-930c-eb088575a840 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:03.551831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84451998-2901-46f2-930c-eb088575a840 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:03.552730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84451998-2901-46f2-930c-eb088575a840 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:03.553182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84451998-2901-46f2-930c-eb088575a840 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:03.700959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-84451998-2901-46f2-930c-eb088575a840 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:03.711795 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-84451998-2901-46f2-930c-eb088575a840 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1683 microversion: 2.1 time: 0.173288 Jul 28 04:38:03.712405 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4597/7047] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:03 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:04.735219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f8435889-ab28-4234-aa7d-412c870b5a7a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:04.735932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f8435889-ab28-4234-aa7d-412c870b5a7a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:04.744503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8435889-ab28-4234-aa7d-412c870b5a7a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:04.744968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8435889-ab28-4234-aa7d-412c870b5a7a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:04.745936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8435889-ab28-4234-aa7d-412c870b5a7a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:04.746383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f8435889-ab28-4234-aa7d-412c870b5a7a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:04.883778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f8435889-ab28-4234-aa7d-412c870b5a7a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:04.892399 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f8435889-ab28-4234-aa7d-412c870b5a7a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1679 microversion: 2.1 time: 0.161464 Jul 28 04:38:04.892927 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4598/7048] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:04 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:04.913476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8e4c518f-81da-46ff-96cb-af4dfec8319b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:38:04.914027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8e4c518f-81da-46ff-96cb-af4dfec8319b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:04.920526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e4c518f-81da-46ff-96cb-af4dfec8319b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:04.921005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e4c518f-81da-46ff-96cb-af4dfec8319b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:04.921784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e4c518f-81da-46ff-96cb-af4dfec8319b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:04.922235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e4c518f-81da-46ff-96cb-af4dfec8319b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:04.993397 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8e4c518f-81da-46ff-96cb-af4dfec8319b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0/action" status: 204 len: 0 microversion: 2.1 time: 0.083688 Jul 28 04:38:04.994047 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4599/7049] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:38:04 2022] POST /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:38:05.002937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c6b850b2-cfe0-446f-96e3-b0b9a8d0e74e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:05.003647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c6b850b2-cfe0-446f-96e3-b0b9a8d0e74e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:05.013085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6b850b2-cfe0-446f-96e3-b0b9a8d0e74e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:05.013085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6b850b2-cfe0-446f-96e3-b0b9a8d0e74e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:05.013085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6b850b2-cfe0-446f-96e3-b0b9a8d0e74e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:05.013085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c6b850b2-cfe0-446f-96e3-b0b9a8d0e74e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:05.154983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c6b850b2-cfe0-446f-96e3-b0b9a8d0e74e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:05.163220 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c6b850b2-cfe0-446f-96e3-b0b9a8d0e74e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1679 microversion: 2.1 time: 0.164566 Jul 28 04:38:05.163871 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4600/7050] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:04 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:38:06.186429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6eb2f0f5-6921-4f0f-88cf-f00eabfd119f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:06.187069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6eb2f0f5-6921-4f0f-88cf-f00eabfd119f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:06.194587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6eb2f0f5-6921-4f0f-88cf-f00eabfd119f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:06.195067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6eb2f0f5-6921-4f0f-88cf-f00eabfd119f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:06.195834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6eb2f0f5-6921-4f0f-88cf-f00eabfd119f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:06.196489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6eb2f0f5-6921-4f0f-88cf-f00eabfd119f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:06.350981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6eb2f0f5-6921-4f0f-88cf-f00eabfd119f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:06.359708 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6eb2f0f5-6921-4f0f-88cf-f00eabfd119f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1658 microversion: 2.1 time: 0.177225 Jul 28 04:38:06.360307 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4601/7051] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:06 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1658 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:06.380316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3d56789e-3fb0-4817-b219-7d26c32b1bbc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:06.381190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3d56789e-3fb0-4817-b219-7d26c32b1bbc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:06.387810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d56789e-3fb0-4817-b219-7d26c32b1bbc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:06.388277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d56789e-3fb0-4817-b219-7d26c32b1bbc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:06.389102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d56789e-3fb0-4817-b219-7d26c32b1bbc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:06.389553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d56789e-3fb0-4817-b219-7d26c32b1bbc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:06.535860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3d56789e-3fb0-4817-b219-7d26c32b1bbc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:06.544242 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3d56789e-3fb0-4817-b219-7d26c32b1bbc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1658 microversion: 2.1 time: 0.167886 Jul 28 04:38:06.544881 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4602/7052] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:06 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1658 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:06.566921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-48fe05ff-62f9-4d1d-a446-381a43819737 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:38:06.575078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48fe05ff-62f9-4d1d-a446-381a43819737 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:06.575552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-48fe05ff-62f9-4d1d-a446-381a43819737 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:06.605672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-48fe05ff-62f9-4d1d-a446-381a43819737 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Going to try to start instance {{(pid=126071) start /opt/stack/nova/nova/compute/api.py:2776}} Jul 28 04:38:06.653202 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-48fe05ff-62f9-4d1d-a446-381a43819737 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0/action" status: 202 len: 0 microversion: 2.1 time: 0.090371 Jul 28 04:38:06.653850 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4603/7053] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:38:06 2022] POST /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:38:06.670808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-be774538-188d-4915-8368-2357e3ed8222 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:06.672093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-be774538-188d-4915-8368-2357e3ed8222 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:06.680529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be774538-188d-4915-8368-2357e3ed8222 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:06.681031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be774538-188d-4915-8368-2357e3ed8222 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:06.682312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be774538-188d-4915-8368-2357e3ed8222 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:06.683025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be774538-188d-4915-8368-2357e3ed8222 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:06.832824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be774538-188d-4915-8368-2357e3ed8222 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:06.841685 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-be774538-188d-4915-8368-2357e3ed8222 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1667 microversion: 2.1 time: 0.178722 Jul 28 04:38:06.842324 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4604/7054] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:06 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1667 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:07.840226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e2df360a-bb25-4dce-ba9a-f483ece2c8f7 req-895d10f8-196e-46b6-b0be-56a5c29e2b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8aba63a-7017-43a5-a957-c0d45fa309b0", "name": "network-vif-plugged", "status": "completed", "tag": "a29df084-ccf2-4525-8103-77e1d5213bbc"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:38:07.852315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e2df360a-bb25-4dce-ba9a-f483ece2c8f7 req-895d10f8-196e-46b6-b0be-56a5c29e2b61 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:07.852883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e2df360a-bb25-4dce-ba9a-f483ece2c8f7 req-895d10f8-196e-46b6-b0be-56a5c29e2b61 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:07.865701 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e2df360a-bb25-4dce-ba9a-f483ece2c8f7 req-895d10f8-196e-46b6-b0be-56a5c29e2b61 service nova] Creating event network-vif-plugged:a29df084-ccf2-4525-8103-77e1d5213bbc for instance c8aba63a-7017-43a5-a957-c0d45fa309b0 on n-h2-826756-3 Jul 28 04:38:07.871106 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e2df360a-bb25-4dce-ba9a-f483ece2c8f7 req-895d10f8-196e-46b6-b0be-56a5c29e2b61 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034719 Jul 28 04:38:07.871897 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4605/7055] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:38:07.877085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cccdd98a-707d-496d-a058-0284636881df tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:07.877811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cccdd98a-707d-496d-a058-0284636881df tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:07.884477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cccdd98a-707d-496d-a058-0284636881df tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:07.884953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cccdd98a-707d-496d-a058-0284636881df tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:07.885777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cccdd98a-707d-496d-a058-0284636881df tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:07.886222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cccdd98a-707d-496d-a058-0284636881df tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:08.042191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cccdd98a-707d-496d-a058-0284636881df tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:08.050642 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cccdd98a-707d-496d-a058-0284636881df tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1667 microversion: 2.1 time: 0.177560 Jul 28 04:38:08.051535 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4606/7056] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:07 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1667 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:09.072673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0badb647-4b3e-4eb7-b58e-2ce7f9128e5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:09.073292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0badb647-4b3e-4eb7-b58e-2ce7f9128e5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:09.080787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0badb647-4b3e-4eb7-b58e-2ce7f9128e5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:09.081234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0badb647-4b3e-4eb7-b58e-2ce7f9128e5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:09.082036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0badb647-4b3e-4eb7-b58e-2ce7f9128e5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:09.082488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0badb647-4b3e-4eb7-b58e-2ce7f9128e5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:09.085311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:38:09.223318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0badb647-4b3e-4eb7-b58e-2ce7f9128e5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:09.231686 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0badb647-4b3e-4eb7-b58e-2ce7f9128e5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1671 microversion: 2.1 time: 0.163117 Jul 28 04:38:09.232232 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4607/7057] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:09 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:09.252396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b18b4e7d-3d64-46cd-b023-1070cf38453a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:09.252913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b18b4e7d-3d64-46cd-b023-1070cf38453a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:09.259471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b18b4e7d-3d64-46cd-b023-1070cf38453a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:09.259940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b18b4e7d-3d64-46cd-b023-1070cf38453a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:09.260870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b18b4e7d-3d64-46cd-b023-1070cf38453a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:09.261328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b18b4e7d-3d64-46cd-b023-1070cf38453a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:09.286859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b18b4e7d-3d64-46cd-b023-1070cf38453a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:38:09.367177 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b18b4e7d-3d64-46cd-b023-1070cf38453a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 204 len: 0 microversion: 2.1 time: 0.118321 Jul 28 04:38:09.367780 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4608/7058] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:38:09 2022] DELETE /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:38:09.376893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d07794a-70d1-4671-b480-7606b60f768f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:09.377578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d07794a-70d1-4671-b480-7606b60f768f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:09.384480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d07794a-70d1-4671-b480-7606b60f768f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:09.384937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d07794a-70d1-4671-b480-7606b60f768f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:09.385722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d07794a-70d1-4671-b480-7606b60f768f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:09.386165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d07794a-70d1-4671-b480-7606b60f768f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:09.533466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9d07794a-70d1-4671-b480-7606b60f768f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:09.541869 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d07794a-70d1-4671-b480-7606b60f768f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1677 microversion: 2.1 time: 0.169369 Jul 28 04:38:09.542467 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4609/7059] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:09 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:10.563640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-087ec07d-8476-49fa-b082-7f759cbeddcc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:10.564380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-087ec07d-8476-49fa-b082-7f759cbeddcc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:10.571794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-087ec07d-8476-49fa-b082-7f759cbeddcc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:10.572260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-087ec07d-8476-49fa-b082-7f759cbeddcc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:10.573068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-087ec07d-8476-49fa-b082-7f759cbeddcc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:10.573518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-087ec07d-8476-49fa-b082-7f759cbeddcc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:10.729299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-087ec07d-8476-49fa-b082-7f759cbeddcc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:10.737615 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-087ec07d-8476-49fa-b082-7f759cbeddcc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1677 microversion: 2.1 time: 0.177950 Jul 28 04:38:10.738219 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4610/7060] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:10 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:11.761439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-085b732e-c224-4d70-8017-3f0f96903d80 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:11.762087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-085b732e-c224-4d70-8017-3f0f96903d80 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:11.770074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-085b732e-c224-4d70-8017-3f0f96903d80 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:11.770544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-085b732e-c224-4d70-8017-3f0f96903d80 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:11.771335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-085b732e-c224-4d70-8017-3f0f96903d80 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:11.771786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-085b732e-c224-4d70-8017-3f0f96903d80 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:11.845959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-085b732e-c224-4d70-8017-3f0f96903d80 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:11.855734 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-085b732e-c224-4d70-8017-3f0f96903d80 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1609 microversion: 2.1 time: 0.099184 Jul 28 04:38:11.856653 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4611/7061] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:11 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1609 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:11.861788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-8bcb9bc6-bf71-4639-9e5b-60e3003e721a req-541b57d7-3866-4b30-8620-0320aaf35459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8aba63a-7017-43a5-a957-c0d45fa309b0", "name": "network-vif-deleted", "tag": "a29df084-ccf2-4525-8103-77e1d5213bbc"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:38:11.872557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8bcb9bc6-bf71-4639-9e5b-60e3003e721a req-541b57d7-3866-4b30-8620-0320aaf35459 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:11.873033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8bcb9bc6-bf71-4639-9e5b-60e3003e721a req-541b57d7-3866-4b30-8620-0320aaf35459 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:11.884833 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-8bcb9bc6-bf71-4639-9e5b-60e3003e721a req-541b57d7-3866-4b30-8620-0320aaf35459 service nova] Creating event network-vif-deleted:a29df084-ccf2-4525-8103-77e1d5213bbc for instance c8aba63a-7017-43a5-a957-c0d45fa309b0 on n-h2-826756-3 Jul 28 04:38:11.889886 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-8bcb9bc6-bf71-4639-9e5b-60e3003e721a req-541b57d7-3866-4b30-8620-0320aaf35459 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031841 Jul 28 04:38:11.890703 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4612/7062] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:38:12.880706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-302d0a02-c8ea-4e78-9a34-526b1a33a3bc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:12.881445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-302d0a02-c8ea-4e78-9a34-526b1a33a3bc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:12.888533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-302d0a02-c8ea-4e78-9a34-526b1a33a3bc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:12.889003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-302d0a02-c8ea-4e78-9a34-526b1a33a3bc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:12.889798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-302d0a02-c8ea-4e78-9a34-526b1a33a3bc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:12.890250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-302d0a02-c8ea-4e78-9a34-526b1a33a3bc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:12.924800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-302d0a02-c8ea-4e78-9a34-526b1a33a3bc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:12.925322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-302d0a02-c8ea-4e78-9a34-526b1a33a3bc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:12.925828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-302d0a02-c8ea-4e78-9a34-526b1a33a3bc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lazy-loading 'fault' on Instance uuid c8aba63a-7017-43a5-a957-c0d45fa309b0 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:38:12.980932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-302d0a02-c8ea-4e78-9a34-526b1a33a3bc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:12.988754 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-302d0a02-c8ea-4e78-9a34-526b1a33a3bc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 200 len: 1329 microversion: 2.1 time: 0.113316 Jul 28 04:38:12.989338 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4613/7063] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:12 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 1329 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:14.015314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1ff7a048-5385-4844-a1fb-bf797f5065e2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:14.016265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1ff7a048-5385-4844-a1fb-bf797f5065e2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:14.026177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ff7a048-5385-4844-a1fb-bf797f5065e2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:14.026617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ff7a048-5385-4844-a1fb-bf797f5065e2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:14.027404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ff7a048-5385-4844-a1fb-bf797f5065e2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:14.027883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ff7a048-5385-4844-a1fb-bf797f5065e2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:14.043063 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-1ff7a048-5385-4844-a1fb-bf797f5065e2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1ff7a048-5385-4844-a1fb-bf797f5065e2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 HTTP/1.1 Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c8aba63a-7017-43a5-a957-c0d45fa309b0'} Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:38:14.045633 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:38:14.050568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:38:14.050568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:38:14.050568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:38:14.050568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:38:14.050568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:38:14.050568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:38:14.050568 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:38:14.050568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1ff7a048-5385-4844-a1fb-bf797f5065e2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:38:14.050568 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1ff7a048-5385-4844-a1fb-bf797f5065e2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 404 len: 111 microversion: 2.1 time: 0.039124 Jul 28 04:38:14.050568 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4614/7064] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:14 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:38:14.062728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9539e3b4-ace7-4d3c-90be-63062eeee7ef tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:14.063348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9539e3b4-ace7-4d3c-90be-63062eeee7ef tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:14.069963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9539e3b4-ace7-4d3c-90be-63062eeee7ef tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:14.070421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9539e3b4-ace7-4d3c-90be-63062eeee7ef tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:14.071193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9539e3b4-ace7-4d3c-90be-63062eeee7ef tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:14.071638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9539e3b4-ace7-4d3c-90be-63062eeee7ef tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:14.085978 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-9539e3b4-ace7-4d3c-90be-63062eeee7ef tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9539e3b4-ace7-4d3c-90be-63062eeee7ef tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 HTTP/1.1 Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c8aba63a-7017-43a5-a957-c0d45fa309b0'} Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:38:14.087535 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:38:14.091861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:38:14.091861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:38:14.091861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:38:14.091861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:38:14.091861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:38:14.091861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:38:14.091861 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:38:14.091861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9539e3b4-ace7-4d3c-90be-63062eeee7ef tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:38:14.091861 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9539e3b4-ace7-4d3c-90be-63062eeee7ef tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 404 len: 111 microversion: 2.1 time: 0.030170 Jul 28 04:38:14.091861 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4615/7065] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:14 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:38:14.140299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-648494029", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f8f2e3d3-2fb2-4562-92db-6678cb2b2773"}], "security_groups": [{"name": "tempest-securitygroup--2127946259"}], "key_name": "tempest-keypair-1754507874", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:38:14.447650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] validate_networks() for [('f8f2e3d3-2fb2-4562-92db-6678cb2b2773', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:38:14.854726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:38:14.855335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:38:14.856033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:38:14.856489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:38:14.857004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:38:14.869911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:14.870475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:14.871730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:14.872398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:14.894107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Getting quotas for project a519852ab6f045779941ca2ed3e4f4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:38:14.896419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:38:14.900743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Getting quotas for user da44c0d51e7a4b1aabf1b73597301cd1 and project a519852ab6f045779941ca2ed3e4f4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:38:14.915401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:38:14.917796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:38:14.970881 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-036fce26-650d-4dc2-aafe-eb13b40fe70c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.834491 Jul 28 04:38:14.971571 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4616/7066] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:38:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:38:14.983091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a7b111f6-5f18-4a35-bfe6-84649382d683 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:14.983721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a7b111f6-5f18-4a35-bfe6-84649382d683 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:15.043319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a7b111f6-5f18-4a35-bfe6-84649382d683 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:15.051480 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a7b111f6-5f18-4a35-bfe6-84649382d683 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1238 microversion: 2.1 time: 0.072289 Jul 28 04:38:15.052129 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4617/7067] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:14 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:16.073948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-26b5bc6e-831f-4756-86df-c60f4792aabe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:16.074621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-26b5bc6e-831f-4756-86df-c60f4792aabe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:16.082174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26b5bc6e-831f-4756-86df-c60f4792aabe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:16.082615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26b5bc6e-831f-4756-86df-c60f4792aabe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:16.083403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26b5bc6e-831f-4756-86df-c60f4792aabe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:16.085880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26b5bc6e-831f-4756-86df-c60f4792aabe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:16.156596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-26b5bc6e-831f-4756-86df-c60f4792aabe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:16.166105 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-26b5bc6e-831f-4756-86df-c60f4792aabe tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1298 microversion: 2.1 time: 0.096251 Jul 28 04:38:16.166105 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4618/7068] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:16 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:17.188764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f6d1121-3e82-4839-a6dc-8fd4334c156a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:17.189408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f6d1121-3e82-4839-a6dc-8fd4334c156a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:17.197868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f6d1121-3e82-4839-a6dc-8fd4334c156a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:17.198448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f6d1121-3e82-4839-a6dc-8fd4334c156a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:17.199315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f6d1121-3e82-4839-a6dc-8fd4334c156a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:17.199863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f6d1121-3e82-4839-a6dc-8fd4334c156a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:17.335486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f6d1121-3e82-4839-a6dc-8fd4334c156a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:17.343457 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f6d1121-3e82-4839-a6dc-8fd4334c156a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1364 microversion: 2.1 time: 0.159809 Jul 28 04:38:17.344287 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4619/7069] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:17 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:17.592549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-330eedf3-8666-42ce-99d9-82c1c0f6820c req-f90e7a65-01bc-4495-88dc-01f81838f6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "223d3ca6-5426-43c7-913d-44a352f16a3b", "tag": "20018b3f-ba38-49fb-933f-d81496231658"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:38:17.608708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-330eedf3-8666-42ce-99d9-82c1c0f6820c req-f90e7a65-01bc-4495-88dc-01f81838f6f7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:17.611246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-330eedf3-8666-42ce-99d9-82c1c0f6820c req-f90e7a65-01bc-4495-88dc-01f81838f6f7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:17.636202 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-330eedf3-8666-42ce-99d9-82c1c0f6820c req-f90e7a65-01bc-4495-88dc-01f81838f6f7 service nova] Creating event network-changed:20018b3f-ba38-49fb-933f-d81496231658 for instance 223d3ca6-5426-43c7-913d-44a352f16a3b on n-h2-826756-3 Jul 28 04:38:17.642071 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-330eedf3-8666-42ce-99d9-82c1c0f6820c req-f90e7a65-01bc-4495-88dc-01f81838f6f7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059430 Jul 28 04:38:17.642879 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4620/7070] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:38:18.366718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca6dd863-3ada-411f-a666-f7b48f87a9ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:18.367412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca6dd863-3ada-411f-a666-f7b48f87a9ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:18.375124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca6dd863-3ada-411f-a666-f7b48f87a9ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:18.375585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca6dd863-3ada-411f-a666-f7b48f87a9ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:18.376384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca6dd863-3ada-411f-a666-f7b48f87a9ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:18.376831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca6dd863-3ada-411f-a666-f7b48f87a9ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:18.515955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca6dd863-3ada-411f-a666-f7b48f87a9ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:18.524276 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca6dd863-3ada-411f-a666-f7b48f87a9ed tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1364 microversion: 2.1 time: 0.161865 Jul 28 04:38:18.524885 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4621/7071] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:18 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:19.546380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e583be2b-9f80-4af5-8ca0-451133ae8e97 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:19.547060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e583be2b-9f80-4af5-8ca0-451133ae8e97 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:19.554373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e583be2b-9f80-4af5-8ca0-451133ae8e97 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:19.554825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e583be2b-9f80-4af5-8ca0-451133ae8e97 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:19.555599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e583be2b-9f80-4af5-8ca0-451133ae8e97 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:19.556043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e583be2b-9f80-4af5-8ca0-451133ae8e97 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:19.705293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e583be2b-9f80-4af5-8ca0-451133ae8e97 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:19.713543 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e583be2b-9f80-4af5-8ca0-451133ae8e97 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1364 microversion: 2.1 time: 0.171279 Jul 28 04:38:19.714291 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4622/7072] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:19 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:20.736238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-20896346-d7c2-4a1b-8671-9fcae7ffd967 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:20.736952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-20896346-d7c2-4a1b-8671-9fcae7ffd967 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:20.744454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20896346-d7c2-4a1b-8671-9fcae7ffd967 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:20.744924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20896346-d7c2-4a1b-8671-9fcae7ffd967 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:20.745733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20896346-d7c2-4a1b-8671-9fcae7ffd967 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:20.746163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20896346-d7c2-4a1b-8671-9fcae7ffd967 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:20.894804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-20896346-d7c2-4a1b-8671-9fcae7ffd967 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:20.903264 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-20896346-d7c2-4a1b-8671-9fcae7ffd967 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1364 microversion: 2.1 time: 0.171193 Jul 28 04:38:20.903880 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4623/7073] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:20 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:21.925270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-039913aa-c644-42f5-9b0a-b884a3af8751 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:21.925910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-039913aa-c644-42f5-9b0a-b884a3af8751 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:21.933651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-039913aa-c644-42f5-9b0a-b884a3af8751 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:21.934120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-039913aa-c644-42f5-9b0a-b884a3af8751 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:21.934922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-039913aa-c644-42f5-9b0a-b884a3af8751 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:21.935381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-039913aa-c644-42f5-9b0a-b884a3af8751 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:22.085437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-039913aa-c644-42f5-9b0a-b884a3af8751 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:22.094508 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-039913aa-c644-42f5-9b0a-b884a3af8751 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1364 microversion: 2.1 time: 0.173143 Jul 28 04:38:22.095090 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4624/7074] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:21 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:23.116853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-88522ec1-b301-4462-a946-9d90c7a2c101 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:23.117487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-88522ec1-b301-4462-a946-9d90c7a2c101 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:23.127319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88522ec1-b301-4462-a946-9d90c7a2c101 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:23.127785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88522ec1-b301-4462-a946-9d90c7a2c101 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:23.128619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88522ec1-b301-4462-a946-9d90c7a2c101 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:23.129084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-88522ec1-b301-4462-a946-9d90c7a2c101 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:23.277636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-88522ec1-b301-4462-a946-9d90c7a2c101 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:23.288599 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-88522ec1-b301-4462-a946-9d90c7a2c101 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1364 microversion: 2.1 time: 0.175592 Jul 28 04:38:23.289267 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4625/7075] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:23 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:23.966378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-571c3136-fcd5-407f-a3ed-5372ece387f0 req-49bb795b-b16d-4da0-adf4-0688683a3bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223d3ca6-5426-43c7-913d-44a352f16a3b", "name": "network-vif-plugged", "status": "completed", "tag": "20018b3f-ba38-49fb-933f-d81496231658"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:38:23.978645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-571c3136-fcd5-407f-a3ed-5372ece387f0 req-49bb795b-b16d-4da0-adf4-0688683a3bbd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:23.979298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-571c3136-fcd5-407f-a3ed-5372ece387f0 req-49bb795b-b16d-4da0-adf4-0688683a3bbd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:23.983684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:38:23.993444 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-571c3136-fcd5-407f-a3ed-5372ece387f0 req-49bb795b-b16d-4da0-adf4-0688683a3bbd service nova] Creating event network-vif-plugged:20018b3f-ba38-49fb-933f-d81496231658 for instance 223d3ca6-5426-43c7-913d-44a352f16a3b on n-h2-826756-3 Jul 28 04:38:23.998738 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-571c3136-fcd5-407f-a3ed-5372ece387f0 req-49bb795b-b16d-4da0-adf4-0688683a3bbd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036347 Jul 28 04:38:23.999633 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4626/7076] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:38:24.319008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-23e57a49-5862-4f46-adec-e4aa70b994e1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:24.319725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-23e57a49-5862-4f46-adec-e4aa70b994e1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:24.328213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23e57a49-5862-4f46-adec-e4aa70b994e1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:24.328704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23e57a49-5862-4f46-adec-e4aa70b994e1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:24.329486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23e57a49-5862-4f46-adec-e4aa70b994e1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:24.329934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23e57a49-5862-4f46-adec-e4aa70b994e1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:24.471616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-23e57a49-5862-4f46-adec-e4aa70b994e1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:24.480378 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-23e57a49-5862-4f46-adec-e4aa70b994e1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1364 microversion: 2.1 time: 0.166641 Jul 28 04:38:24.480986 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4627/7077] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:24 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:25.504781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-84238d94-0313-452f-8e3b-cab554636788 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:25.505470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-84238d94-0313-452f-8e3b-cab554636788 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:25.508479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:38:25.509461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:38:25.517721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84238d94-0313-452f-8e3b-cab554636788 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:25.518194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84238d94-0313-452f-8e3b-cab554636788 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:25.518995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84238d94-0313-452f-8e3b-cab554636788 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:25.519438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84238d94-0313-452f-8e3b-cab554636788 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:25.655272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-84238d94-0313-452f-8e3b-cab554636788 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:38:25.663619 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-84238d94-0313-452f-8e3b-cab554636788 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1552 microversion: 2.1 time: 0.164612 Jul 28 04:38:25.664190 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4628/7078] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:38:25 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:38:25.684510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-554f1a33-24c2-4f98-b68b-7908af9af81c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:38:25.685010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-554f1a33-24c2-4f98-b68b-7908af9af81c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:38:25.691548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-554f1a33-24c2-4f98-b68b-7908af9af81c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:25.692123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-554f1a33-24c2-4f98-b68b-7908af9af81c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:25.692736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-554f1a33-24c2-4f98-b68b-7908af9af81c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:25.693181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-554f1a33-24c2-4f98-b68b-7908af9af81c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:25.773676 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-554f1a33-24c2-4f98-b68b-7908af9af81c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092963 Jul 28 04:38:25.774346 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4629/7079] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 04:38:25 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:38:25.827616 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:38:25.828148 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:38:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:38:26.720946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-09b98cce-a4a0-4295-bdee-e8efe07c9c21 req-6a69d598-77c4-45ec-9de9-952a748d6f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "223d3ca6-5426-43c7-913d-44a352f16a3b", "tag": "20018b3f-ba38-49fb-933f-d81496231658"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:38:26.743323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-09b98cce-a4a0-4295-bdee-e8efe07c9c21 req-6a69d598-77c4-45ec-9de9-952a748d6f02 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:38:26.743781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-09b98cce-a4a0-4295-bdee-e8efe07c9c21 req-6a69d598-77c4-45ec-9de9-952a748d6f02 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:38:26.756270 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-09b98cce-a4a0-4295-bdee-e8efe07c9c21 req-6a69d598-77c4-45ec-9de9-952a748d6f02 service nova] Creating event network-changed:20018b3f-ba38-49fb-933f-d81496231658 for instance 223d3ca6-5426-43c7-913d-44a352f16a3b on n-h2-826756-3 Jul 28 04:38:26.761492 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-09b98cce-a4a0-4295-bdee-e8efe07c9c21 req-6a69d598-77c4-45ec-9de9-952a748d6f02 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045274 Jul 28 04:38:26.762430 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4630/7080] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:39:01.877230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:39:01.878265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=19 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:39:01.883552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-65a56df3-1b32-4f85-af15-1d25292f068c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:39:01.885974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-65a56df3-1b32-4f85-af15-1d25292f068c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:01.893962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65a56df3-1b32-4f85-af15-1d25292f068c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:01.894429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65a56df3-1b32-4f85-af15-1d25292f068c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:01.895233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65a56df3-1b32-4f85-af15-1d25292f068c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:01.895677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65a56df3-1b32-4f85-af15-1d25292f068c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:01.927023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-65a56df3-1b32-4f85-af15-1d25292f068c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:01.933570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-65a56df3-1b32-4f85-af15-1d25292f068c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Old instance type m1.heat2, new instance type m1.heat {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 04:39:01.940478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-65a56df3-1b32-4f85-af15-1d25292f068c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:39:01.940917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-65a56df3-1b32-4f85-af15-1d25292f068c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:39:01.941407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-65a56df3-1b32-4f85-af15-1d25292f068c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:39:01.941836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-65a56df3-1b32-4f85-af15-1d25292f068c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:39:01.942264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-65a56df3-1b32-4f85-af15-1d25292f068c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:39:02.012996 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-65a56df3-1b32-4f85-af15-1d25292f068c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b/action" status: 202 len: 0 microversion: 2.1 time: 0.138299 Jul 28 04:39:02.013599 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4631/7081] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:39:01 2022] POST /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:39:02.021589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a50df4b3-ed6d-45ff-a763-f759966991dc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:02.022226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a50df4b3-ed6d-45ff-a763-f759966991dc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:02.029042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a50df4b3-ed6d-45ff-a763-f759966991dc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:02.029237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a50df4b3-ed6d-45ff-a763-f759966991dc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:02.029926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a50df4b3-ed6d-45ff-a763-f759966991dc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:02.030375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a50df4b3-ed6d-45ff-a763-f759966991dc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:02.183918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a50df4b3-ed6d-45ff-a763-f759966991dc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:02.198267 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a50df4b3-ed6d-45ff-a763-f759966991dc tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1680 microversion: 2.1 time: 0.179914 Jul 28 04:39:02.199395 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4632/7082] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:02 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:39:03.223905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ea4158c5-ea6d-4cc0-bb38-31e273bc72f0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:03.225035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ea4158c5-ea6d-4cc0-bb38-31e273bc72f0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:03.231648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea4158c5-ea6d-4cc0-bb38-31e273bc72f0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:03.232114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea4158c5-ea6d-4cc0-bb38-31e273bc72f0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:03.232936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea4158c5-ea6d-4cc0-bb38-31e273bc72f0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:03.233372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ea4158c5-ea6d-4cc0-bb38-31e273bc72f0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:03.379217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ea4158c5-ea6d-4cc0-bb38-31e273bc72f0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:03.388414 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ea4158c5-ea6d-4cc0-bb38-31e273bc72f0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1680 microversion: 2.1 time: 0.168974 Jul 28 04:39:03.389568 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4633/7083] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:03 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:04.047468 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:39:04.047802 n-d-826756-3 devstack@n-api.service[126071]: Thu Jul 28 04:39:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:39:04.412058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c9257b54-79f8-41cd-8352-49f9bc5e56b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:04.412909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c9257b54-79f8-41cd-8352-49f9bc5e56b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:04.420495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9257b54-79f8-41cd-8352-49f9bc5e56b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:04.420960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9257b54-79f8-41cd-8352-49f9bc5e56b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:04.421738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9257b54-79f8-41cd-8352-49f9bc5e56b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:04.422188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c9257b54-79f8-41cd-8352-49f9bc5e56b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:04.570078 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c9257b54-79f8-41cd-8352-49f9bc5e56b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:04.579605 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c9257b54-79f8-41cd-8352-49f9bc5e56b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1685 microversion: 2.1 time: 0.172271 Jul 28 04:39:04.580194 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4634/7084] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:04 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:05.605570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3dfa06a6-1b89-4353-b4dd-f52d1333f4c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:05.608772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3dfa06a6-1b89-4353-b4dd-f52d1333f4c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:05.614702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3dfa06a6-1b89-4353-b4dd-f52d1333f4c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:05.615164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3dfa06a6-1b89-4353-b4dd-f52d1333f4c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:05.615961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3dfa06a6-1b89-4353-b4dd-f52d1333f4c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:05.616435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3dfa06a6-1b89-4353-b4dd-f52d1333f4c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:05.761642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3dfa06a6-1b89-4353-b4dd-f52d1333f4c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:05.769679 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3dfa06a6-1b89-4353-b4dd-f52d1333f4c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1685 microversion: 2.1 time: 0.168185 Jul 28 04:39:05.770263 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4635/7085] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:05 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:06.792110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b543498c-7fe6-41d6-97a4-4f7f028fdd20 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:06.792826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b543498c-7fe6-41d6-97a4-4f7f028fdd20 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:06.800182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b543498c-7fe6-41d6-97a4-4f7f028fdd20 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:06.800661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b543498c-7fe6-41d6-97a4-4f7f028fdd20 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:06.801435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b543498c-7fe6-41d6-97a4-4f7f028fdd20 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:06.801875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b543498c-7fe6-41d6-97a4-4f7f028fdd20 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:06.934592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b543498c-7fe6-41d6-97a4-4f7f028fdd20 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:06.942597 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b543498c-7fe6-41d6-97a4-4f7f028fdd20 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1685 microversion: 2.1 time: 0.154653 Jul 28 04:39:06.943176 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4636/7086] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:06 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:07.964868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-906f5edf-f03c-44f8-bc5b-771cb500df93 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:07.965585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-906f5edf-f03c-44f8-bc5b-771cb500df93 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:07.973261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-906f5edf-f03c-44f8-bc5b-771cb500df93 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:07.973730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-906f5edf-f03c-44f8-bc5b-771cb500df93 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:07.974498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-906f5edf-f03c-44f8-bc5b-771cb500df93 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:07.975003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-906f5edf-f03c-44f8-bc5b-771cb500df93 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:08.116580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-906f5edf-f03c-44f8-bc5b-771cb500df93 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:08.126378 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-906f5edf-f03c-44f8-bc5b-771cb500df93 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1685 microversion: 2.1 time: 0.165466 Jul 28 04:39:08.127229 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4637/7087] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:07 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:09.151271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b01ae246-b5aa-4809-bd5c-eb1fa367684e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:09.151900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b01ae246-b5aa-4809-bd5c-eb1fa367684e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:09.159513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b01ae246-b5aa-4809-bd5c-eb1fa367684e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:09.159991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b01ae246-b5aa-4809-bd5c-eb1fa367684e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:09.160813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b01ae246-b5aa-4809-bd5c-eb1fa367684e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:09.161272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b01ae246-b5aa-4809-bd5c-eb1fa367684e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:09.297684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b01ae246-b5aa-4809-bd5c-eb1fa367684e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:09.305964 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b01ae246-b5aa-4809-bd5c-eb1fa367684e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1685 microversion: 2.1 time: 0.159077 Jul 28 04:39:09.306541 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4638/7088] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:09 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:39:10.327706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d11ed33-aaad-44a9-8e93-3eebc0f57a62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:10.328443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8d11ed33-aaad-44a9-8e93-3eebc0f57a62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:10.337121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d11ed33-aaad-44a9-8e93-3eebc0f57a62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:10.338005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d11ed33-aaad-44a9-8e93-3eebc0f57a62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:10.338376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d11ed33-aaad-44a9-8e93-3eebc0f57a62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:10.338832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d11ed33-aaad-44a9-8e93-3eebc0f57a62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:10.496504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8d11ed33-aaad-44a9-8e93-3eebc0f57a62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:10.504594 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8d11ed33-aaad-44a9-8e93-3eebc0f57a62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1685 microversion: 2.1 time: 0.180912 Jul 28 04:39:10.505188 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4639/7089] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:10 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:11.526411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb2686cd-d5ca-45cb-9ce9-12e84e5ccf77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:11.527150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eb2686cd-d5ca-45cb-9ce9-12e84e5ccf77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:11.534611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb2686cd-d5ca-45cb-9ce9-12e84e5ccf77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:11.535076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb2686cd-d5ca-45cb-9ce9-12e84e5ccf77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:11.535867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb2686cd-d5ca-45cb-9ce9-12e84e5ccf77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:11.536311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb2686cd-d5ca-45cb-9ce9-12e84e5ccf77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:11.682287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eb2686cd-d5ca-45cb-9ce9-12e84e5ccf77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:11.691355 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb2686cd-d5ca-45cb-9ce9-12e84e5ccf77 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1685 microversion: 2.1 time: 0.169037 Jul 28 04:39:11.691944 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4640/7090] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:11 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:12.714040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5191c44-8c2d-445e-9ca3-ffacc193af05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:12.714633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b5191c44-8c2d-445e-9ca3-ffacc193af05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:12.722706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5191c44-8c2d-445e-9ca3-ffacc193af05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:12.723188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5191c44-8c2d-445e-9ca3-ffacc193af05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:12.723975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5191c44-8c2d-445e-9ca3-ffacc193af05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:12.724456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5191c44-8c2d-445e-9ca3-ffacc193af05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:12.869056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b5191c44-8c2d-445e-9ca3-ffacc193af05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:12.876942 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5191c44-8c2d-445e-9ca3-ffacc193af05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1685 microversion: 2.1 time: 0.167459 Jul 28 04:39:12.877520 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4641/7091] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:12 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:13.898809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-13a2d979-2909-4f3d-9f03-ce3674ccda99 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:13.899617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-13a2d979-2909-4f3d-9f03-ce3674ccda99 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:13.907075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-13a2d979-2909-4f3d-9f03-ce3674ccda99 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:13.907530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-13a2d979-2909-4f3d-9f03-ce3674ccda99 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:13.908343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-13a2d979-2909-4f3d-9f03-ce3674ccda99 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:13.908867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-13a2d979-2909-4f3d-9f03-ce3674ccda99 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:14.057340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-13a2d979-2909-4f3d-9f03-ce3674ccda99 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:14.065396 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-13a2d979-2909-4f3d-9f03-ce3674ccda99 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1685 microversion: 2.1 time: 0.170523 Jul 28 04:39:14.066302 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4642/7092] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:13 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:15.087806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43b521e3-65bd-45b1-94c7-23573a4cb67e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:15.088605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-43b521e3-65bd-45b1-94c7-23573a4cb67e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:15.095934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43b521e3-65bd-45b1-94c7-23573a4cb67e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:15.096392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43b521e3-65bd-45b1-94c7-23573a4cb67e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:15.097209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43b521e3-65bd-45b1-94c7-23573a4cb67e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:15.098020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43b521e3-65bd-45b1-94c7-23573a4cb67e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:15.236165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-43b521e3-65bd-45b1-94c7-23573a4cb67e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:15.246967 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43b521e3-65bd-45b1-94c7-23573a4cb67e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1685 microversion: 2.1 time: 0.162952 Jul 28 04:39:15.247579 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4643/7093] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:15 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:16.272191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8129b282-10f9-4ffd-bd0e-947b311f07bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:16.272927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8129b282-10f9-4ffd-bd0e-947b311f07bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:16.281272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8129b282-10f9-4ffd-bd0e-947b311f07bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:16.281732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8129b282-10f9-4ffd-bd0e-947b311f07bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:16.282521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8129b282-10f9-4ffd-bd0e-947b311f07bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:16.282968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8129b282-10f9-4ffd-bd0e-947b311f07bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:16.436073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8129b282-10f9-4ffd-bd0e-947b311f07bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:16.445953 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8129b282-10f9-4ffd-bd0e-947b311f07bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1685 microversion: 2.1 time: 0.178280 Jul 28 04:39:16.446540 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4644/7094] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:16 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:17.308707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-57ed749c-2f12-4fc5-811e-2fbf23f8382d req-8b89a3a4-27d3-4d1b-870a-eb675cc98862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223d3ca6-5426-43c7-913d-44a352f16a3b", "name": "network-vif-unplugged", "status": "completed", "tag": "20018b3f-ba38-49fb-933f-d81496231658"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:39:17.329057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-57ed749c-2f12-4fc5-811e-2fbf23f8382d req-8b89a3a4-27d3-4d1b-870a-eb675cc98862 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:17.329511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-57ed749c-2f12-4fc5-811e-2fbf23f8382d req-8b89a3a4-27d3-4d1b-870a-eb675cc98862 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:17.342531 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-57ed749c-2f12-4fc5-811e-2fbf23f8382d req-8b89a3a4-27d3-4d1b-870a-eb675cc98862 service nova] Creating event network-vif-unplugged:20018b3f-ba38-49fb-933f-d81496231658 for instance 223d3ca6-5426-43c7-913d-44a352f16a3b on n-h1-826756-3 Jul 28 04:39:17.350016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-57ed749c-2f12-4fc5-811e-2fbf23f8382d req-8b89a3a4-27d3-4d1b-870a-eb675cc98862 service nova] Instance 223d3ca6-5426-43c7-913d-44a352f16a3b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:39:17.367039 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-57ed749c-2f12-4fc5-811e-2fbf23f8382d req-8b89a3a4-27d3-4d1b-870a-eb675cc98862 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119818 Jul 28 04:39:17.367835 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4645/7095] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:39:17.469116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a854c512-f9bd-4c67-bcd3-5c380cce89d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:17.469875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a854c512-f9bd-4c67-bcd3-5c380cce89d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:17.477076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a854c512-f9bd-4c67-bcd3-5c380cce89d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:17.477498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a854c512-f9bd-4c67-bcd3-5c380cce89d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:17.478640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a854c512-f9bd-4c67-bcd3-5c380cce89d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:17.479164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a854c512-f9bd-4c67-bcd3-5c380cce89d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:17.500995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:39:17.619867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a854c512-f9bd-4c67-bcd3-5c380cce89d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:17.628474 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a854c512-f9bd-4c67-bcd3-5c380cce89d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1684 microversion: 2.1 time: 0.164762 Jul 28 04:39:17.629102 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4646/7096] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:17 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:39:18.652744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-37ba764f-e45f-4da1-8617-3950af640b3b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:18.653650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-37ba764f-e45f-4da1-8617-3950af640b3b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:18.661389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37ba764f-e45f-4da1-8617-3950af640b3b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:18.661870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37ba764f-e45f-4da1-8617-3950af640b3b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:18.662715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37ba764f-e45f-4da1-8617-3950af640b3b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:18.663187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37ba764f-e45f-4da1-8617-3950af640b3b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:18.805906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-37ba764f-e45f-4da1-8617-3950af640b3b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:18.814634 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-37ba764f-e45f-4da1-8617-3950af640b3b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1682 microversion: 2.1 time: 0.167236 Jul 28 04:39:18.815213 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4647/7097] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:18 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:19.389648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d3413192-fedd-4a48-8f3b-6add2f74d77d req-c0620985-97fd-4bfc-a2ae-aae8f2178718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "223d3ca6-5426-43c7-913d-44a352f16a3b", "tag": "20018b3f-ba38-49fb-933f-d81496231658"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:39:19.405088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d3413192-fedd-4a48-8f3b-6add2f74d77d req-c0620985-97fd-4bfc-a2ae-aae8f2178718 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:19.405552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d3413192-fedd-4a48-8f3b-6add2f74d77d req-c0620985-97fd-4bfc-a2ae-aae8f2178718 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:19.418118 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-d3413192-fedd-4a48-8f3b-6add2f74d77d req-c0620985-97fd-4bfc-a2ae-aae8f2178718 service nova] Creating event network-changed:20018b3f-ba38-49fb-933f-d81496231658 for instance 223d3ca6-5426-43c7-913d-44a352f16a3b on n-h1-826756-3 Jul 28 04:39:19.424075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-d3413192-fedd-4a48-8f3b-6add2f74d77d req-c0620985-97fd-4bfc-a2ae-aae8f2178718 service nova] Instance 223d3ca6-5426-43c7-913d-44a352f16a3b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:39:19.435265 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d3413192-fedd-4a48-8f3b-6add2f74d77d req-c0620985-97fd-4bfc-a2ae-aae8f2178718 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052160 Jul 28 04:39:19.435914 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4648/7098] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:39:19.837864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bccb356d-5845-49e7-90c7-c3d8e5585fc9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:19.838589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bccb356d-5845-49e7-90c7-c3d8e5585fc9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:19.845408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bccb356d-5845-49e7-90c7-c3d8e5585fc9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:19.845869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bccb356d-5845-49e7-90c7-c3d8e5585fc9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:19.846666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bccb356d-5845-49e7-90c7-c3d8e5585fc9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:19.847111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bccb356d-5845-49e7-90c7-c3d8e5585fc9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:19.990774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bccb356d-5845-49e7-90c7-c3d8e5585fc9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:19.999508 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bccb356d-5845-49e7-90c7-c3d8e5585fc9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1679 microversion: 2.1 time: 0.167046 Jul 28 04:39:20.000465 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4649/7099] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:19 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:20.022080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-875e1ed6-4106-42fb-b5a6-5f38852d3075 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:39:20.022788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-875e1ed6-4106-42fb-b5a6-5f38852d3075 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:20.030251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-875e1ed6-4106-42fb-b5a6-5f38852d3075 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:20.030721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-875e1ed6-4106-42fb-b5a6-5f38852d3075 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:20.031523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-875e1ed6-4106-42fb-b5a6-5f38852d3075 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:20.032016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-875e1ed6-4106-42fb-b5a6-5f38852d3075 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:20.078054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-875e1ed6-4106-42fb-b5a6-5f38852d3075 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:20.078492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-875e1ed6-4106-42fb-b5a6-5f38852d3075 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:20.079333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-875e1ed6-4106-42fb-b5a6-5f38852d3075 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:20.079779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-875e1ed6-4106-42fb-b5a6-5f38852d3075 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:20.103255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-875e1ed6-4106-42fb-b5a6-5f38852d3075 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Getting quotas for project a519852ab6f045779941ca2ed3e4f4bd. Resources: {'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:39:20.108959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-875e1ed6-4106-42fb-b5a6-5f38852d3075 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Getting quotas for user da44c0d51e7a4b1aabf1b73597301cd1 and project a519852ab6f045779941ca2ed3e4f4bd. Resources: {'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:39:20.218276 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-875e1ed6-4106-42fb-b5a6-5f38852d3075 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b/action" status: 202 len: 0 microversion: 2.1 time: 0.200650 Jul 28 04:39:20.219255 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4650/7100] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:39:20 2022] POST /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:39:20.229182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ee33b4d-0083-4c04-bfbb-f24e232193d2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:20.230236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ee33b4d-0083-4c04-bfbb-f24e232193d2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:20.238910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ee33b4d-0083-4c04-bfbb-f24e232193d2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:20.239503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ee33b4d-0083-4c04-bfbb-f24e232193d2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:20.240375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ee33b4d-0083-4c04-bfbb-f24e232193d2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:20.240817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ee33b4d-0083-4c04-bfbb-f24e232193d2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:20.380834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ee33b4d-0083-4c04-bfbb-f24e232193d2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:20.390104 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ee33b4d-0083-4c04-bfbb-f24e232193d2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1678 microversion: 2.1 time: 0.166046 Jul 28 04:39:20.390696 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4651/7101] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:20 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:21.417340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b125fa24-485c-4afd-a40f-aed6c4e2a2f9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:21.418817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b125fa24-485c-4afd-a40f-aed6c4e2a2f9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:21.429982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b125fa24-485c-4afd-a40f-aed6c4e2a2f9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:21.430598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b125fa24-485c-4afd-a40f-aed6c4e2a2f9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:21.431673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b125fa24-485c-4afd-a40f-aed6c4e2a2f9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:21.432253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b125fa24-485c-4afd-a40f-aed6c4e2a2f9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:21.587788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b125fa24-485c-4afd-a40f-aed6c4e2a2f9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:21.596646 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b125fa24-485c-4afd-a40f-aed6c4e2a2f9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1678 microversion: 2.1 time: 0.187326 Jul 28 04:39:21.597213 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4652/7102] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:21 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:22.617904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-71c0ed3e-126d-4267-a79f-8997e9a6d6e0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:22.618594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-71c0ed3e-126d-4267-a79f-8997e9a6d6e0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:22.625931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71c0ed3e-126d-4267-a79f-8997e9a6d6e0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:22.626391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71c0ed3e-126d-4267-a79f-8997e9a6d6e0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:22.627168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71c0ed3e-126d-4267-a79f-8997e9a6d6e0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:22.627612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-71c0ed3e-126d-4267-a79f-8997e9a6d6e0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:22.775278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-71c0ed3e-126d-4267-a79f-8997e9a6d6e0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:22.783577 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-71c0ed3e-126d-4267-a79f-8997e9a6d6e0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1678 microversion: 2.1 time: 0.169761 Jul 28 04:39:22.784156 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4653/7103] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:22 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:39:23.805880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-61f0b25f-a2a0-4ac1-876c-fdf0de03a3d5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:23.806617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61f0b25f-a2a0-4ac1-876c-fdf0de03a3d5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:23.814300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61f0b25f-a2a0-4ac1-876c-fdf0de03a3d5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:23.814858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61f0b25f-a2a0-4ac1-876c-fdf0de03a3d5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:23.815785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61f0b25f-a2a0-4ac1-876c-fdf0de03a3d5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:23.816307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61f0b25f-a2a0-4ac1-876c-fdf0de03a3d5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:23.964474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-61f0b25f-a2a0-4ac1-876c-fdf0de03a3d5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:23.974360 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-61f0b25f-a2a0-4ac1-876c-fdf0de03a3d5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1678 microversion: 2.1 time: 0.172465 Jul 28 04:39:23.974964 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4654/7104] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:23 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:24.109683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-575a79f7-5763-42a1-8e1a-9eab3ba8208c req-4bdcdb7e-8c78-4cd7-a146-5e1068dd36a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "223d3ca6-5426-43c7-913d-44a352f16a3b", "tag": "20018b3f-ba38-49fb-933f-d81496231658"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:39:24.121494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-575a79f7-5763-42a1-8e1a-9eab3ba8208c req-4bdcdb7e-8c78-4cd7-a146-5e1068dd36a5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:24.122400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-575a79f7-5763-42a1-8e1a-9eab3ba8208c req-4bdcdb7e-8c78-4cd7-a146-5e1068dd36a5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:24.138776 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-575a79f7-5763-42a1-8e1a-9eab3ba8208c req-4bdcdb7e-8c78-4cd7-a146-5e1068dd36a5 service nova] Creating event network-changed:20018b3f-ba38-49fb-933f-d81496231658 for instance 223d3ca6-5426-43c7-913d-44a352f16a3b on n-h2-826756-3 Jul 28 04:39:24.145315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-575a79f7-5763-42a1-8e1a-9eab3ba8208c req-4bdcdb7e-8c78-4cd7-a146-5e1068dd36a5 service nova] Instance 223d3ca6-5426-43c7-913d-44a352f16a3b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:39:24.157629 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-575a79f7-5763-42a1-8e1a-9eab3ba8208c req-4bdcdb7e-8c78-4cd7-a146-5e1068dd36a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053008 Jul 28 04:39:24.158554 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4655/7105] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:39:24.374045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-102a58e7-62a7-4279-93b7-0cf45acda544 req-d716ef71-a0f3-434f-b7f0-822ed3071e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223d3ca6-5426-43c7-913d-44a352f16a3b", "name": "network-vif-plugged", "status": "completed", "tag": "20018b3f-ba38-49fb-933f-d81496231658"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:39:24.386512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-102a58e7-62a7-4279-93b7-0cf45acda544 req-d716ef71-a0f3-434f-b7f0-822ed3071e1b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:24.387128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-102a58e7-62a7-4279-93b7-0cf45acda544 req-d716ef71-a0f3-434f-b7f0-822ed3071e1b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:24.404004 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-102a58e7-62a7-4279-93b7-0cf45acda544 req-d716ef71-a0f3-434f-b7f0-822ed3071e1b service nova] Creating event network-vif-plugged:20018b3f-ba38-49fb-933f-d81496231658 for instance 223d3ca6-5426-43c7-913d-44a352f16a3b on n-h2-826756-3 Jul 28 04:39:24.411438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-102a58e7-62a7-4279-93b7-0cf45acda544 req-d716ef71-a0f3-434f-b7f0-822ed3071e1b service nova] Instance 223d3ca6-5426-43c7-913d-44a352f16a3b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:39:24.426543 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-102a58e7-62a7-4279-93b7-0cf45acda544 req-d716ef71-a0f3-434f-b7f0-822ed3071e1b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127567 Jul 28 04:39:24.426543 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4656/7106] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:39:24.997092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-519bd48b-0fb6-4036-9e90-c61315f52e3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:24.998286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-519bd48b-0fb6-4036-9e90-c61315f52e3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:25.005177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-519bd48b-0fb6-4036-9e90-c61315f52e3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:25.005729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-519bd48b-0fb6-4036-9e90-c61315f52e3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:25.006604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-519bd48b-0fb6-4036-9e90-c61315f52e3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:25.007125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-519bd48b-0fb6-4036-9e90-c61315f52e3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:25.148770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-519bd48b-0fb6-4036-9e90-c61315f52e3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:25.157002 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-519bd48b-0fb6-4036-9e90-c61315f52e3d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1678 microversion: 2.1 time: 0.165422 Jul 28 04:39:25.157589 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4657/7107] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:24 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:26.179358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-946f3bc2-87e9-429f-9281-df31c5695e49 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:26.180101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-946f3bc2-87e9-429f-9281-df31c5695e49 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:26.186891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-946f3bc2-87e9-429f-9281-df31c5695e49 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:26.187350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-946f3bc2-87e9-429f-9281-df31c5695e49 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:26.188137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-946f3bc2-87e9-429f-9281-df31c5695e49 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:26.188643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-946f3bc2-87e9-429f-9281-df31c5695e49 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:26.339722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-946f3bc2-87e9-429f-9281-df31c5695e49 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:26.349119 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-946f3bc2-87e9-429f-9281-df31c5695e49 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1678 microversion: 2.1 time: 0.173875 Jul 28 04:39:26.349718 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4658/7108] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:26 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:27.380795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-20d83468-74c5-4d05-984c-9a0b9af4e1b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:27.381440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-20d83468-74c5-4d05-984c-9a0b9af4e1b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:27.389407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20d83468-74c5-4d05-984c-9a0b9af4e1b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:27.389882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20d83468-74c5-4d05-984c-9a0b9af4e1b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:27.390720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20d83468-74c5-4d05-984c-9a0b9af4e1b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:27.391352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-20d83468-74c5-4d05-984c-9a0b9af4e1b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:27.532533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-20d83468-74c5-4d05-984c-9a0b9af4e1b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:27.540797 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-20d83468-74c5-4d05-984c-9a0b9af4e1b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1671 microversion: 2.1 time: 0.164135 Jul 28 04:39:27.541378 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4659/7109] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:27 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:27.561125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5e52bdef-16e1-4fb8-a211-211cbe3fcaba tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:27.561661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5e52bdef-16e1-4fb8-a211-211cbe3fcaba tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:27.567913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e52bdef-16e1-4fb8-a211-211cbe3fcaba tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:27.568370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e52bdef-16e1-4fb8-a211-211cbe3fcaba tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:27.569171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e52bdef-16e1-4fb8-a211-211cbe3fcaba tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:27.569618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5e52bdef-16e1-4fb8-a211-211cbe3fcaba tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:27.717051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5e52bdef-16e1-4fb8-a211-211cbe3fcaba tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:27.725786 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5e52bdef-16e1-4fb8-a211-211cbe3fcaba tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1671 microversion: 2.1 time: 0.168365 Jul 28 04:39:27.726611 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4660/7110] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:27 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:27.746728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-12a4ee75-67ed-404c-bb18-5f1272fc0202 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:27.747432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-12a4ee75-67ed-404c-bb18-5f1272fc0202 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:27.753656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12a4ee75-67ed-404c-bb18-5f1272fc0202 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:27.754136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12a4ee75-67ed-404c-bb18-5f1272fc0202 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:27.754913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12a4ee75-67ed-404c-bb18-5f1272fc0202 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:27.757214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12a4ee75-67ed-404c-bb18-5f1272fc0202 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:27.761514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:39:27.899488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-12a4ee75-67ed-404c-bb18-5f1272fc0202 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:27.907628 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-12a4ee75-67ed-404c-bb18-5f1272fc0202 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1671 microversion: 2.1 time: 0.164800 Jul 28 04:39:27.908346 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4661/7111] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:27 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:39:27.933655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-12f6f480-ca99-4ecf-9ae5-6ae071e97c95 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:27.934167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-12f6f480-ca99-4ecf-9ae5-6ae071e97c95 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:27.940855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12f6f480-ca99-4ecf-9ae5-6ae071e97c95 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:27.941316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12f6f480-ca99-4ecf-9ae5-6ae071e97c95 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:27.942086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12f6f480-ca99-4ecf-9ae5-6ae071e97c95 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:27.942514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12f6f480-ca99-4ecf-9ae5-6ae071e97c95 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:27.968012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-12f6f480-ca99-4ecf-9ae5-6ae071e97c95 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:39:28.054870 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-12f6f480-ca99-4ecf-9ae5-6ae071e97c95 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "DELETE /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 204 len: 0 microversion: 2.1 time: 0.124581 Jul 28 04:39:28.055879 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4662/7112] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:39:27 2022] DELETE /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:39:28.066388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-08aac4dc-8169-45af-9572-4cf38a179d16 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:28.067167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-08aac4dc-8169-45af-9572-4cf38a179d16 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:28.073999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08aac4dc-8169-45af-9572-4cf38a179d16 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:28.074466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08aac4dc-8169-45af-9572-4cf38a179d16 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:28.075250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08aac4dc-8169-45af-9572-4cf38a179d16 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:28.075686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-08aac4dc-8169-45af-9572-4cf38a179d16 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:28.239270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-08aac4dc-8169-45af-9572-4cf38a179d16 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:28.245386 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-08aac4dc-8169-45af-9572-4cf38a179d16 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1677 microversion: 2.1 time: 0.183852 Jul 28 04:39:28.246016 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4663/7113] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:28 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:39:29.267905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d90b4f3-e646-49c7-a85a-83c0c32b1e5d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:29.268667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d90b4f3-e646-49c7-a85a-83c0c32b1e5d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:29.276337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d90b4f3-e646-49c7-a85a-83c0c32b1e5d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:29.276823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d90b4f3-e646-49c7-a85a-83c0c32b1e5d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:29.277613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d90b4f3-e646-49c7-a85a-83c0c32b1e5d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:29.278065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d90b4f3-e646-49c7-a85a-83c0c32b1e5d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:29.433614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7d90b4f3-e646-49c7-a85a-83c0c32b1e5d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:29.442852 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d90b4f3-e646-49c7-a85a-83c0c32b1e5d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1677 microversion: 2.1 time: 0.179021 Jul 28 04:39:29.443500 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4664/7114] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:29 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:39:30.465654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-60f841d9-ef7f-47ac-807d-52962ffac317 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:30.466308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-60f841d9-ef7f-47ac-807d-52962ffac317 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:30.468647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:39:30.475875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60f841d9-ef7f-47ac-807d-52962ffac317 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:30.477108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60f841d9-ef7f-47ac-807d-52962ffac317 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:30.478338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60f841d9-ef7f-47ac-807d-52962ffac317 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:30.485668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60f841d9-ef7f-47ac-807d-52962ffac317 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:30.560697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-60f841d9-ef7f-47ac-807d-52962ffac317 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:30.569772 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-60f841d9-ef7f-47ac-807d-52962ffac317 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 200 len: 1609 microversion: 2.1 time: 0.108531 Jul 28 04:39:30.570419 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4665/7115] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:30 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 1609 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:39:30.588752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-99cd6ec2-4382-4b6b-864a-55cad863b664 req-e96b9142-06b6-44be-a3a2-574bccc882fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223d3ca6-5426-43c7-913d-44a352f16a3b", "name": "network-vif-deleted", "tag": "20018b3f-ba38-49fb-933f-d81496231658"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:39:30.597956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-99cd6ec2-4382-4b6b-864a-55cad863b664 req-e96b9142-06b6-44be-a3a2-574bccc882fa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:30.598408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-99cd6ec2-4382-4b6b-864a-55cad863b664 req-e96b9142-06b6-44be-a3a2-574bccc882fa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:30.611170 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-99cd6ec2-4382-4b6b-864a-55cad863b664 req-e96b9142-06b6-44be-a3a2-574bccc882fa service nova] Creating event network-vif-deleted:20018b3f-ba38-49fb-933f-d81496231658 for instance 223d3ca6-5426-43c7-913d-44a352f16a3b on n-h2-826756-3 Jul 28 04:39:30.617190 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-99cd6ec2-4382-4b6b-864a-55cad863b664 req-e96b9142-06b6-44be-a3a2-574bccc882fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045599 Jul 28 04:39:30.617817 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4666/7116] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:39:31.593176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df0c4c17-d720-4be2-864f-63b0ae8c20d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:31.593886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-df0c4c17-d720-4be2-864f-63b0ae8c20d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:31.601713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df0c4c17-d720-4be2-864f-63b0ae8c20d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:31.602192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df0c4c17-d720-4be2-864f-63b0ae8c20d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:31.602956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df0c4c17-d720-4be2-864f-63b0ae8c20d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:31.603400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df0c4c17-d720-4be2-864f-63b0ae8c20d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:31.617040 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-df0c4c17-d720-4be2-864f-63b0ae8c20d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df0c4c17-d720-4be2-864f-63b0ae8c20d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b HTTP/1.1 Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '223d3ca6-5426-43c7-913d-44a352f16a3b'} Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:39:31.618701 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:39:31.623195 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:39:31.623195 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:39:31.623195 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:39:31.623195 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:39:31.623195 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:39:31.623195 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:39:31.623195 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:39:31.623195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df0c4c17-d720-4be2-864f-63b0ae8c20d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:39:31.623195 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-df0c4c17-d720-4be2-864f-63b0ae8c20d4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 404 len: 111 microversion: 2.1 time: 0.031462 Jul 28 04:39:31.623195 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4667/7117] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:31 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:39:31.635322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43788e8d-7902-4904-bdeb-792b281d9108 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:31.635935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-43788e8d-7902-4904-bdeb-792b281d9108 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:31.637910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:39:31.643490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43788e8d-7902-4904-bdeb-792b281d9108 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:31.644161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43788e8d-7902-4904-bdeb-792b281d9108 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:31.644970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43788e8d-7902-4904-bdeb-792b281d9108 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:31.645414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-43788e8d-7902-4904-bdeb-792b281d9108 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:31.660027 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-43788e8d-7902-4904-bdeb-792b281d9108 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43788e8d-7902-4904-bdeb-792b281d9108 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b HTTP/1.1 Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '223d3ca6-5426-43c7-913d-44a352f16a3b'} Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:39:31.661597 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:39:31.665771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:39:31.665771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:39:31.665771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:39:31.665771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:39:31.665771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:39:31.665771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:39:31.665771 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:39:31.665771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-43788e8d-7902-4904-bdeb-792b281d9108 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:39:31.665771 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-43788e8d-7902-4904-bdeb-792b281d9108 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 404 len: 111 microversion: 2.1 time: 0.031924 Jul 28 04:39:31.665771 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4668/7118] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:31 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:39:31.779497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-532883745", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f8f2e3d3-2fb2-4562-92db-6678cb2b2773"}], "security_groups": [{"name": "tempest-securitygroup--2127946259"}], "key_name": "tempest-keypair-1754507874", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:39:31.899427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] validate_networks() for [('f8f2e3d3-2fb2-4562-92db-6678cb2b2773', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:39:32.296835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:39:32.297272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:39:32.297759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:39:32.298179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:39:32.298607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:39:32.307800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:32.308260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:32.309093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:32.309540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:32.326393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Getting quotas for project a519852ab6f045779941ca2ed3e4f4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:39:32.331990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Getting quotas for user da44c0d51e7a4b1aabf1b73597301cd1 and project a519852ab6f045779941ca2ed3e4f4bd. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:39:32.345657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:39:32.348455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:39:32.397087 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-25d9931e-dc9b-49df-ae85-b2e1fa469899 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.623539 Jul 28 04:39:32.397746 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4669/7119] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:39:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:39:32.408878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4550a86-6924-49f6-a163-044137ce44b6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:32.409678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4550a86-6924-49f6-a163-044137ce44b6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:32.464627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f4550a86-6924-49f6-a163-044137ce44b6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:32.473280 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4550a86-6924-49f6-a163-044137ce44b6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1238 microversion: 2.1 time: 0.068309 Jul 28 04:39:32.473883 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4670/7120] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:32 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:33.495167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1f92b5d2-62bc-4a3a-96b1-fb2515a0f24e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:33.495934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1f92b5d2-62bc-4a3a-96b1-fb2515a0f24e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:33.503534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f92b5d2-62bc-4a3a-96b1-fb2515a0f24e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:33.503999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f92b5d2-62bc-4a3a-96b1-fb2515a0f24e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:33.504841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f92b5d2-62bc-4a3a-96b1-fb2515a0f24e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:33.505292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f92b5d2-62bc-4a3a-96b1-fb2515a0f24e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:33.574890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1f92b5d2-62bc-4a3a-96b1-fb2515a0f24e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:33.583245 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1f92b5d2-62bc-4a3a-96b1-fb2515a0f24e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1290 microversion: 2.1 time: 0.092144 Jul 28 04:39:33.583980 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4671/7121] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:33 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1290 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:34.606008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-41f9d436-fe15-4142-bf37-b62d1a5c4cc0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:34.607413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-41f9d436-fe15-4142-bf37-b62d1a5c4cc0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:34.615351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41f9d436-fe15-4142-bf37-b62d1a5c4cc0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:34.615814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41f9d436-fe15-4142-bf37-b62d1a5c4cc0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:34.616781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41f9d436-fe15-4142-bf37-b62d1a5c4cc0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:34.617257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-41f9d436-fe15-4142-bf37-b62d1a5c4cc0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:34.785554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-41f9d436-fe15-4142-bf37-b62d1a5c4cc0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:34.796457 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-41f9d436-fe15-4142-bf37-b62d1a5c4cc0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1364 microversion: 2.1 time: 0.194321 Jul 28 04:39:34.797291 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4672/7122] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:34 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:39:35.361361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a09ded35-47f2-477f-b6eb-409e0f0bd507 req-375f0a1d-6ea0-433f-a483-ad1e7880dd72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2754651c-9f1b-4357-a83b-f0b10a2e4929", "tag": "a5165b48-c2d0-41e9-abdd-4e211e8fb390"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:39:35.372321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a09ded35-47f2-477f-b6eb-409e0f0bd507 req-375f0a1d-6ea0-433f-a483-ad1e7880dd72 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:35.378603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a09ded35-47f2-477f-b6eb-409e0f0bd507 req-375f0a1d-6ea0-433f-a483-ad1e7880dd72 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:35.392250 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a09ded35-47f2-477f-b6eb-409e0f0bd507 req-375f0a1d-6ea0-433f-a483-ad1e7880dd72 service nova] Creating event network-changed:a5165b48-c2d0-41e9-abdd-4e211e8fb390 for instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 on n-h2-826756-3 Jul 28 04:39:35.398225 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a09ded35-47f2-477f-b6eb-409e0f0bd507 req-375f0a1d-6ea0-433f-a483-ad1e7880dd72 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040974 Jul 28 04:39:35.399433 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4673/7123] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:39:35.821252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f3c284ae-5c28-4f92-be4b-21a44df7c51b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:35.821997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f3c284ae-5c28-4f92-be4b-21a44df7c51b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:35.829351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3c284ae-5c28-4f92-be4b-21a44df7c51b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:35.829887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3c284ae-5c28-4f92-be4b-21a44df7c51b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:35.830967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3c284ae-5c28-4f92-be4b-21a44df7c51b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:35.831584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f3c284ae-5c28-4f92-be4b-21a44df7c51b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:35.973912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f3c284ae-5c28-4f92-be4b-21a44df7c51b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:35.982713 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f3c284ae-5c28-4f92-be4b-21a44df7c51b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1364 microversion: 2.1 time: 0.167086 Jul 28 04:39:35.983214 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4674/7124] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:35 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:37.004769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f3f0583-0324-40a0-84bf-fd3a312d6b3f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:37.005468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f3f0583-0324-40a0-84bf-fd3a312d6b3f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:37.013262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f3f0583-0324-40a0-84bf-fd3a312d6b3f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:37.013720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f3f0583-0324-40a0-84bf-fd3a312d6b3f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:37.014504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f3f0583-0324-40a0-84bf-fd3a312d6b3f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:37.014949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f3f0583-0324-40a0-84bf-fd3a312d6b3f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:37.151219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f3f0583-0324-40a0-84bf-fd3a312d6b3f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:37.159240 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f3f0583-0324-40a0-84bf-fd3a312d6b3f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1364 microversion: 2.1 time: 0.158552 Jul 28 04:39:37.159834 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4675/7125] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:36 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:38.180682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6623503e-b290-488a-a00d-d5449965a9c6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:38.181294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6623503e-b290-488a-a00d-d5449965a9c6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:38.188832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6623503e-b290-488a-a00d-d5449965a9c6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:38.189295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6623503e-b290-488a-a00d-d5449965a9c6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:38.190109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6623503e-b290-488a-a00d-d5449965a9c6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:38.190560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6623503e-b290-488a-a00d-d5449965a9c6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:38.329805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6623503e-b290-488a-a00d-d5449965a9c6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:38.338155 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6623503e-b290-488a-a00d-d5449965a9c6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1364 microversion: 2.1 time: 0.161595 Jul 28 04:39:38.338964 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4676/7126] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:38 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:39.364789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bd2d6381-30ec-4a64-83ce-a8c2b34940e7 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:39.365777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bd2d6381-30ec-4a64-83ce-a8c2b34940e7 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:39.375959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd2d6381-30ec-4a64-83ce-a8c2b34940e7 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:39.376457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd2d6381-30ec-4a64-83ce-a8c2b34940e7 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:39.377248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd2d6381-30ec-4a64-83ce-a8c2b34940e7 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:39.377696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd2d6381-30ec-4a64-83ce-a8c2b34940e7 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:39.528053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bd2d6381-30ec-4a64-83ce-a8c2b34940e7 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:39.536686 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bd2d6381-30ec-4a64-83ce-a8c2b34940e7 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1364 microversion: 2.1 time: 0.178135 Jul 28 04:39:39.537357 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4677/7127] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:39 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:40.344760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-638f57cb-a1fc-4dbe-a3d3-308af41e8c43 req-86c220b0-fd5c-4b70-b704-1588d8a6c235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2754651c-9f1b-4357-a83b-f0b10a2e4929", "name": "network-vif-plugged", "status": "completed", "tag": "a5165b48-c2d0-41e9-abdd-4e211e8fb390"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:39:40.355358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-638f57cb-a1fc-4dbe-a3d3-308af41e8c43 req-86c220b0-fd5c-4b70-b704-1588d8a6c235 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:40.355968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-638f57cb-a1fc-4dbe-a3d3-308af41e8c43 req-86c220b0-fd5c-4b70-b704-1588d8a6c235 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:40.369428 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-638f57cb-a1fc-4dbe-a3d3-308af41e8c43 req-86c220b0-fd5c-4b70-b704-1588d8a6c235 service nova] Creating event network-vif-plugged:a5165b48-c2d0-41e9-abdd-4e211e8fb390 for instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 on n-h2-826756-3 Jul 28 04:39:40.374702 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-638f57cb-a1fc-4dbe-a3d3-308af41e8c43 req-86c220b0-fd5c-4b70-b704-1588d8a6c235 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034088 Jul 28 04:39:40.375378 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4678/7128] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:39:40.566654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-68852614-842e-4145-9369-a8630510c33f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:40.567286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-68852614-842e-4145-9369-a8630510c33f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:40.575084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68852614-842e-4145-9369-a8630510c33f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:40.575552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68852614-842e-4145-9369-a8630510c33f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:40.576368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68852614-842e-4145-9369-a8630510c33f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:40.576830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68852614-842e-4145-9369-a8630510c33f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:40.727114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-68852614-842e-4145-9369-a8630510c33f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:40.737420 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-68852614-842e-4145-9369-a8630510c33f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1364 microversion: 2.1 time: 0.175229 Jul 28 04:39:40.738105 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4679/7129] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:40 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:41.760314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3d1d610-b310-4863-8490-470de5e04a66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:41.761027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3d1d610-b310-4863-8490-470de5e04a66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:41.768725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3d1d610-b310-4863-8490-470de5e04a66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:41.769189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3d1d610-b310-4863-8490-470de5e04a66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:41.769979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3d1d610-b310-4863-8490-470de5e04a66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:41.770430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3d1d610-b310-4863-8490-470de5e04a66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:41.911692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3d1d610-b310-4863-8490-470de5e04a66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:41.920951 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3d1d610-b310-4863-8490-470de5e04a66 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1364 microversion: 2.1 time: 0.165002 Jul 28 04:39:41.921523 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4680/7130] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:41 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:39:42.944517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9ce84801-4d84-478d-8804-09d7e35f6d41 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:42.945212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9ce84801-4d84-478d-8804-09d7e35f6d41 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:42.947350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:39:42.948209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:39:42.955362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ce84801-4d84-478d-8804-09d7e35f6d41 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:42.955833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ce84801-4d84-478d-8804-09d7e35f6d41 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:42.957347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ce84801-4d84-478d-8804-09d7e35f6d41 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:42.957347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9ce84801-4d84-478d-8804-09d7e35f6d41 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:42.961658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:39:43.097678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9ce84801-4d84-478d-8804-09d7e35f6d41 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:39:43.105969 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9ce84801-4d84-478d-8804-09d7e35f6d41 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1551 microversion: 2.1 time: 0.165586 Jul 28 04:39:43.106554 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4681/7131] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:39:42 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1551 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:39:43.127024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d76b54ec-9836-4e16-af62-4dba95a2913b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:39:43.127531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d76b54ec-9836-4e16-af62-4dba95a2913b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:39:43.133842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d76b54ec-9836-4e16-af62-4dba95a2913b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:43.134306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d76b54ec-9836-4e16-af62-4dba95a2913b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:43.135086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d76b54ec-9836-4e16-af62-4dba95a2913b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:43.135540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d76b54ec-9836-4e16-af62-4dba95a2913b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:43.213435 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d76b54ec-9836-4e16-af62-4dba95a2913b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090100 Jul 28 04:39:43.214421 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4682/7132] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 04:39:43 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:39:44.157607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a353307a-bc23-4b23-ae43-424cfec4024a req-f0df3285-0331-429d-bd1e-71aaabc41627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2754651c-9f1b-4357-a83b-f0b10a2e4929", "tag": "a5165b48-c2d0-41e9-abdd-4e211e8fb390"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:39:44.167962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a353307a-bc23-4b23-ae43-424cfec4024a req-f0df3285-0331-429d-bd1e-71aaabc41627 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:39:44.168584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a353307a-bc23-4b23-ae43-424cfec4024a req-f0df3285-0331-429d-bd1e-71aaabc41627 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:39:44.180253 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a353307a-bc23-4b23-ae43-424cfec4024a req-f0df3285-0331-429d-bd1e-71aaabc41627 service nova] Creating event network-changed:a5165b48-c2d0-41e9-abdd-4e211e8fb390 for instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 on n-h2-826756-3 Jul 28 04:39:44.185367 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a353307a-bc23-4b23-ae43-424cfec4024a req-f0df3285-0331-429d-bd1e-71aaabc41627 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032654 Jul 28 04:39:44.186242 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4683/7133] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:40:17.390046 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:40:17.390655 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:40:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:40:18.678424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7776a4b7-ee09-410a-9c8a-cbef8d2a7faf tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:18.679317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7776a4b7-ee09-410a-9c8a-cbef8d2a7faf tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:18.682491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:40:18.683114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=10 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:40:18.691066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7776a4b7-ee09-410a-9c8a-cbef8d2a7faf tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:18.691526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7776a4b7-ee09-410a-9c8a-cbef8d2a7faf tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:18.692313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7776a4b7-ee09-410a-9c8a-cbef8d2a7faf tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:18.692781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7776a4b7-ee09-410a-9c8a-cbef8d2a7faf tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:18.836234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7776a4b7-ee09-410a-9c8a-cbef8d2a7faf tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:18.844529 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7776a4b7-ee09-410a-9c8a-cbef8d2a7faf tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1670 microversion: 2.1 time: 0.170960 Jul 28 04:40:18.845234 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4684/7134] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:18 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:40:18.867691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c0158e27-a587-4ee3-b475-bd1aa2c756d3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbf95721-4ac1-4037-a03e-be4e43e9689a"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:40:18.870346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c0158e27-a587-4ee3-b475-bd1aa2c756d3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:18.877152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c0158e27-a587-4ee3-b475-bd1aa2c756d3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:18.877733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c0158e27-a587-4ee3-b475-bd1aa2c756d3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:18.878599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c0158e27-a587-4ee3-b475-bd1aa2c756d3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:18.879061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c0158e27-a587-4ee3-b475-bd1aa2c756d3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:19.177419 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c0158e27-a587-4ee3-b475-bd1aa2c756d3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314591 Jul 28 04:40:19.178047 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4685/7135] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 04:40:18 2022] POST /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:40:29.940774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:40:29.941622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:40:29.946517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ac98b341-2dd6-4a2d-812e-235a79940497 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:40:29.949812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ac98b341-2dd6-4a2d-812e-235a79940497 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:29.960064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac98b341-2dd6-4a2d-812e-235a79940497 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:29.960650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac98b341-2dd6-4a2d-812e-235a79940497 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:29.961360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac98b341-2dd6-4a2d-812e-235a79940497 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:29.961818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ac98b341-2dd6-4a2d-812e-235a79940497 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:29.992776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ac98b341-2dd6-4a2d-812e-235a79940497 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:29.999217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ac98b341-2dd6-4a2d-812e-235a79940497 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Old instance type m1.heat2, new instance type m1.heat {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 04:40:30.006786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ac98b341-2dd6-4a2d-812e-235a79940497 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:40:30.007219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ac98b341-2dd6-4a2d-812e-235a79940497 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:40:30.007704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ac98b341-2dd6-4a2d-812e-235a79940497 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:40:30.008142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ac98b341-2dd6-4a2d-812e-235a79940497 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:40:30.008595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-ac98b341-2dd6-4a2d-812e-235a79940497 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:40:30.079596 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ac98b341-2dd6-4a2d-812e-235a79940497 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929/action" status: 202 len: 0 microversion: 2.1 time: 0.142241 Jul 28 04:40:30.080447 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4686/7136] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:40:29 2022] POST /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:40:30.088715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-242719f8-d21e-4d3b-8473-94960bde8997 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:30.089378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-242719f8-d21e-4d3b-8473-94960bde8997 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:30.095613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-242719f8-d21e-4d3b-8473-94960bde8997 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:30.096087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-242719f8-d21e-4d3b-8473-94960bde8997 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:30.096912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-242719f8-d21e-4d3b-8473-94960bde8997 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:30.097720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-242719f8-d21e-4d3b-8473-94960bde8997 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:30.233436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-242719f8-d21e-4d3b-8473-94960bde8997 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:30.242337 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-242719f8-d21e-4d3b-8473-94960bde8997 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1725 microversion: 2.1 time: 0.157783 Jul 28 04:40:30.242918 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4687/7137] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:30 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:31.265025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8c8dae49-c92d-478d-9320-265413b30f36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:31.265746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8c8dae49-c92d-478d-9320-265413b30f36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:31.273516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c8dae49-c92d-478d-9320-265413b30f36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:31.274008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c8dae49-c92d-478d-9320-265413b30f36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:31.274827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c8dae49-c92d-478d-9320-265413b30f36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:31.275298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8c8dae49-c92d-478d-9320-265413b30f36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:31.415261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8c8dae49-c92d-478d-9320-265413b30f36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:31.423827 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8c8dae49-c92d-478d-9320-265413b30f36 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1725 microversion: 2.1 time: 0.163182 Jul 28 04:40:31.424456 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4688/7138] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:31 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:32.446255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3c3d3a15-24cf-4bd1-92c9-3f3a4fd4d2d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:32.446916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3c3d3a15-24cf-4bd1-92c9-3f3a4fd4d2d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:32.454458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c3d3a15-24cf-4bd1-92c9-3f3a4fd4d2d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:32.454930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c3d3a15-24cf-4bd1-92c9-3f3a4fd4d2d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:32.455726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c3d3a15-24cf-4bd1-92c9-3f3a4fd4d2d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:32.456178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c3d3a15-24cf-4bd1-92c9-3f3a4fd4d2d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:32.598737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3c3d3a15-24cf-4bd1-92c9-3f3a4fd4d2d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:32.607756 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3c3d3a15-24cf-4bd1-92c9-3f3a4fd4d2d8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.165530 Jul 28 04:40:32.608376 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4689/7139] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:32 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:33.634359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5dbc56d8-e0b8-4a9d-9b52-fde1ad8f9157 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:33.635100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5dbc56d8-e0b8-4a9d-9b52-fde1ad8f9157 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:33.646093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dbc56d8-e0b8-4a9d-9b52-fde1ad8f9157 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:33.647132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dbc56d8-e0b8-4a9d-9b52-fde1ad8f9157 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:33.647955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dbc56d8-e0b8-4a9d-9b52-fde1ad8f9157 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:33.648435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5dbc56d8-e0b8-4a9d-9b52-fde1ad8f9157 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:33.784547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5dbc56d8-e0b8-4a9d-9b52-fde1ad8f9157 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:33.793749 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5dbc56d8-e0b8-4a9d-9b52-fde1ad8f9157 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.164592 Jul 28 04:40:33.794352 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4690/7140] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:33 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:34.815510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a613e115-d0d7-4823-8578-a578b49657a2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:34.816201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a613e115-d0d7-4823-8578-a578b49657a2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:34.823633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a613e115-d0d7-4823-8578-a578b49657a2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:34.824091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a613e115-d0d7-4823-8578-a578b49657a2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:34.824912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a613e115-d0d7-4823-8578-a578b49657a2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:34.825370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a613e115-d0d7-4823-8578-a578b49657a2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:34.975350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a613e115-d0d7-4823-8578-a578b49657a2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:34.984317 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a613e115-d0d7-4823-8578-a578b49657a2 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.172862 Jul 28 04:40:34.984938 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4691/7141] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:34 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:40:36.012250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2e64201-a9ea-4003-a8ef-9f3bf409fdfb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:36.013424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d2e64201-a9ea-4003-a8ef-9f3bf409fdfb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:36.024617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2e64201-a9ea-4003-a8ef-9f3bf409fdfb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:36.025101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2e64201-a9ea-4003-a8ef-9f3bf409fdfb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:36.025876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2e64201-a9ea-4003-a8ef-9f3bf409fdfb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:36.026345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2e64201-a9ea-4003-a8ef-9f3bf409fdfb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:36.183025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d2e64201-a9ea-4003-a8ef-9f3bf409fdfb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:36.191917 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d2e64201-a9ea-4003-a8ef-9f3bf409fdfb tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.188031 Jul 28 04:40:36.192533 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4692/7142] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:36 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:37.219230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c74a941a-abfa-4166-b0f1-0e5a0aec9957 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:37.220296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c74a941a-abfa-4166-b0f1-0e5a0aec9957 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:37.231482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c74a941a-abfa-4166-b0f1-0e5a0aec9957 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:37.231948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c74a941a-abfa-4166-b0f1-0e5a0aec9957 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:37.232777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c74a941a-abfa-4166-b0f1-0e5a0aec9957 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:37.233227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c74a941a-abfa-4166-b0f1-0e5a0aec9957 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:37.367551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c74a941a-abfa-4166-b0f1-0e5a0aec9957 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:37.378900 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c74a941a-abfa-4166-b0f1-0e5a0aec9957 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.166369 Jul 28 04:40:37.379476 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4693/7143] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:37 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:38.408461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-23c6860b-92ab-4281-929f-8196f9939d89 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:38.409161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-23c6860b-92ab-4281-929f-8196f9939d89 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:38.416375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23c6860b-92ab-4281-929f-8196f9939d89 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:38.416980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23c6860b-92ab-4281-929f-8196f9939d89 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:38.417755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23c6860b-92ab-4281-929f-8196f9939d89 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:38.418201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-23c6860b-92ab-4281-929f-8196f9939d89 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:38.564731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-23c6860b-92ab-4281-929f-8196f9939d89 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:38.573476 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-23c6860b-92ab-4281-929f-8196f9939d89 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.169212 Jul 28 04:40:38.574073 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4694/7144] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:38 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:39.600064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-182e3af6-b9c5-46e1-b4da-b6638b1a933c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:39.601214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-182e3af6-b9c5-46e1-b4da-b6638b1a933c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:39.613422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-182e3af6-b9c5-46e1-b4da-b6638b1a933c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:39.614209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-182e3af6-b9c5-46e1-b4da-b6638b1a933c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:39.615503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-182e3af6-b9c5-46e1-b4da-b6638b1a933c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:39.616295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-182e3af6-b9c5-46e1-b4da-b6638b1a933c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:39.758342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-182e3af6-b9c5-46e1-b4da-b6638b1a933c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:39.772495 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-182e3af6-b9c5-46e1-b4da-b6638b1a933c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.179090 Jul 28 04:40:39.773313 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4695/7145] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:39 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:40.799395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b96394a-b2b3-4bfe-9adf-4272c7b2d149 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:40.800015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b96394a-b2b3-4bfe-9adf-4272c7b2d149 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:40.807444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b96394a-b2b3-4bfe-9adf-4272c7b2d149 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:40.807914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b96394a-b2b3-4bfe-9adf-4272c7b2d149 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:40.808718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b96394a-b2b3-4bfe-9adf-4272c7b2d149 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:40.809171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b96394a-b2b3-4bfe-9adf-4272c7b2d149 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:41.270723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b96394a-b2b3-4bfe-9adf-4272c7b2d149 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:41.280991 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b96394a-b2b3-4bfe-9adf-4272c7b2d149 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.485915 Jul 28 04:40:41.281583 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4696/7146] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:40 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:42.302762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1ae5a60-ccee-4060-95f2-b7770c64cd05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:42.303449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1ae5a60-ccee-4060-95f2-b7770c64cd05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:42.310875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1ae5a60-ccee-4060-95f2-b7770c64cd05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:42.311340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1ae5a60-ccee-4060-95f2-b7770c64cd05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:42.312123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1ae5a60-ccee-4060-95f2-b7770c64cd05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:42.312607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1ae5a60-ccee-4060-95f2-b7770c64cd05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:42.451667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b1ae5a60-ccee-4060-95f2-b7770c64cd05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:42.460344 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1ae5a60-ccee-4060-95f2-b7770c64cd05 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.161685 Jul 28 04:40:42.460999 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4697/7147] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:42 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:43.486305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40a103ba-691d-4791-a5ee-efec2bef9a82 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:43.487060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-40a103ba-691d-4791-a5ee-efec2bef9a82 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:43.497695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40a103ba-691d-4791-a5ee-efec2bef9a82 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:43.498161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40a103ba-691d-4791-a5ee-efec2bef9a82 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:43.498941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40a103ba-691d-4791-a5ee-efec2bef9a82 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:43.499395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-40a103ba-691d-4791-a5ee-efec2bef9a82 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:43.654387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-40a103ba-691d-4791-a5ee-efec2bef9a82 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:43.662871 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40a103ba-691d-4791-a5ee-efec2bef9a82 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.182802 Jul 28 04:40:43.663495 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4698/7148] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:43 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:44.733229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1215da2f-c62f-4a11-8515-d116919516db tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:44.733858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1215da2f-c62f-4a11-8515-d116919516db tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:44.740261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1215da2f-c62f-4a11-8515-d116919516db tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:44.740772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1215da2f-c62f-4a11-8515-d116919516db tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:44.741553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1215da2f-c62f-4a11-8515-d116919516db tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:44.742003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1215da2f-c62f-4a11-8515-d116919516db tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:44.877696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1215da2f-c62f-4a11-8515-d116919516db tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:44.886166 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1215da2f-c62f-4a11-8515-d116919516db tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.204981 Jul 28 04:40:44.886743 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4699/7149] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:44 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:45.912779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7bc34161-e5f8-487f-b1de-cf3383ba84e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:45.914325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7bc34161-e5f8-487f-b1de-cf3383ba84e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:45.923958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bc34161-e5f8-487f-b1de-cf3383ba84e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:45.924460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bc34161-e5f8-487f-b1de-cf3383ba84e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:45.925251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bc34161-e5f8-487f-b1de-cf3383ba84e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:45.925706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bc34161-e5f8-487f-b1de-cf3383ba84e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:46.076513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7bc34161-e5f8-487f-b1de-cf3383ba84e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:46.085598 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7bc34161-e5f8-487f-b1de-cf3383ba84e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.179382 Jul 28 04:40:46.085753 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4700/7150] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:45 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:47.110468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ad7cc65c-d989-41c6-b0a4-aeec6eaa1d9a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:47.111482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ad7cc65c-d989-41c6-b0a4-aeec6eaa1d9a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:47.122119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad7cc65c-d989-41c6-b0a4-aeec6eaa1d9a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:47.122805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad7cc65c-d989-41c6-b0a4-aeec6eaa1d9a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:47.123957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad7cc65c-d989-41c6-b0a4-aeec6eaa1d9a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:47.124446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad7cc65c-d989-41c6-b0a4-aeec6eaa1d9a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:47.128528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:40:47.261849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ad7cc65c-d989-41c6-b0a4-aeec6eaa1d9a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:47.270739 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ad7cc65c-d989-41c6-b0a4-aeec6eaa1d9a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.166783 Jul 28 04:40:47.271274 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4701/7151] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:47 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:48.299533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-532e7081-4329-45b9-8b45-5972ea45137d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:48.300654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-532e7081-4329-45b9-8b45-5972ea45137d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:48.312661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-532e7081-4329-45b9-8b45-5972ea45137d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:48.313321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-532e7081-4329-45b9-8b45-5972ea45137d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:48.314632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-532e7081-4329-45b9-8b45-5972ea45137d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:48.315462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-532e7081-4329-45b9-8b45-5972ea45137d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:48.472638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-532e7081-4329-45b9-8b45-5972ea45137d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:48.481462 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-532e7081-4329-45b9-8b45-5972ea45137d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.188684 Jul 28 04:40:48.482051 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4702/7152] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:48 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:49.504636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed3b87d9-c198-4573-b414-5fa237b39262 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:49.505355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed3b87d9-c198-4573-b414-5fa237b39262 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:49.513464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed3b87d9-c198-4573-b414-5fa237b39262 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:49.513896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed3b87d9-c198-4573-b414-5fa237b39262 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:49.514723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed3b87d9-c198-4573-b414-5fa237b39262 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:49.515169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed3b87d9-c198-4573-b414-5fa237b39262 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:49.665200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed3b87d9-c198-4573-b414-5fa237b39262 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:49.674766 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed3b87d9-c198-4573-b414-5fa237b39262 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.174175 Jul 28 04:40:49.675520 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4703/7153] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:49 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:50.700155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-038d08f4-716a-43a1-bd9c-f20766ecaea0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:50.700857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-038d08f4-716a-43a1-bd9c-f20766ecaea0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:50.711318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-038d08f4-716a-43a1-bd9c-f20766ecaea0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:50.712091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-038d08f4-716a-43a1-bd9c-f20766ecaea0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:50.713411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-038d08f4-716a-43a1-bd9c-f20766ecaea0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:50.714165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-038d08f4-716a-43a1-bd9c-f20766ecaea0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:50.862433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-038d08f4-716a-43a1-bd9c-f20766ecaea0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:50.871167 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-038d08f4-716a-43a1-bd9c-f20766ecaea0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.177144 Jul 28 04:40:50.871766 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4704/7154] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:50 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:51.897468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62bb532b-6573-4c6d-9660-beca22c80779 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:51.898556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-62bb532b-6573-4c6d-9660-beca22c80779 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:51.913113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62bb532b-6573-4c6d-9660-beca22c80779 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:51.913884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62bb532b-6573-4c6d-9660-beca22c80779 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:51.915163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62bb532b-6573-4c6d-9660-beca22c80779 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:51.915899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62bb532b-6573-4c6d-9660-beca22c80779 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:52.057443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62bb532b-6573-4c6d-9660-beca22c80779 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:52.066091 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-62bb532b-6573-4c6d-9660-beca22c80779 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.175489 Jul 28 04:40:52.066671 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4705/7155] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:51 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:53.088750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2b43e725-ec09-4d45-8cf1-faba8af3658a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:53.089423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2b43e725-ec09-4d45-8cf1-faba8af3658a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:53.097083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b43e725-ec09-4d45-8cf1-faba8af3658a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:53.097911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b43e725-ec09-4d45-8cf1-faba8af3658a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:53.098700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b43e725-ec09-4d45-8cf1-faba8af3658a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:53.099150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b43e725-ec09-4d45-8cf1-faba8af3658a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:53.238601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2b43e725-ec09-4d45-8cf1-faba8af3658a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:53.247523 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2b43e725-ec09-4d45-8cf1-faba8af3658a tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.163095 Jul 28 04:40:53.248113 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4706/7156] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:53 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:54.269658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-12f1f396-abfe-4cdc-b15e-43bded796761 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:54.270325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-12f1f396-abfe-4cdc-b15e-43bded796761 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:54.277819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12f1f396-abfe-4cdc-b15e-43bded796761 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:54.278281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12f1f396-abfe-4cdc-b15e-43bded796761 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:54.279063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12f1f396-abfe-4cdc-b15e-43bded796761 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:54.279504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12f1f396-abfe-4cdc-b15e-43bded796761 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:54.422100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-12f1f396-abfe-4cdc-b15e-43bded796761 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:54.430643 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-12f1f396-abfe-4cdc-b15e-43bded796761 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.165044 Jul 28 04:40:54.431217 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4707/7157] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:54 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:55.455232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-db543bb0-23ea-402e-b610-d5005743d65f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:55.455855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-db543bb0-23ea-402e-b610-d5005743d65f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:55.463172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db543bb0-23ea-402e-b610-d5005743d65f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:55.463646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db543bb0-23ea-402e-b610-d5005743d65f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:55.464460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db543bb0-23ea-402e-b610-d5005743d65f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:55.464916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-db543bb0-23ea-402e-b610-d5005743d65f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:55.606106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-db543bb0-23ea-402e-b610-d5005743d65f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:55.614715 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-db543bb0-23ea-402e-b610-d5005743d65f tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.163710 Jul 28 04:40:55.615330 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4708/7158] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:55 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:56.636047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a2dae37e-ad21-4bbb-bb12-77f15104631e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:56.637476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a2dae37e-ad21-4bbb-bb12-77f15104631e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:56.643905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2dae37e-ad21-4bbb-bb12-77f15104631e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:56.644377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2dae37e-ad21-4bbb-bb12-77f15104631e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:56.645154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2dae37e-ad21-4bbb-bb12-77f15104631e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:56.645598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2dae37e-ad21-4bbb-bb12-77f15104631e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:56.787757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a2dae37e-ad21-4bbb-bb12-77f15104631e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:56.796968 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a2dae37e-ad21-4bbb-bb12-77f15104631e tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1730 microversion: 2.1 time: 0.165124 Jul 28 04:40:56.797572 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4709/7159] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:56 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:57.605345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d43ee93a-b361-4b69-a96f-a795c7f583c2 req-9b67a778-7033-4391-8850-d4ef933e67bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2754651c-9f1b-4357-a83b-f0b10a2e4929", "name": "network-vif-unplugged", "status": "completed", "tag": "a5165b48-c2d0-41e9-abdd-4e211e8fb390"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:40:57.615495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d43ee93a-b361-4b69-a96f-a795c7f583c2 req-9b67a778-7033-4391-8850-d4ef933e67bd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:57.616009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d43ee93a-b361-4b69-a96f-a795c7f583c2 req-9b67a778-7033-4391-8850-d4ef933e67bd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:57.628627 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-d43ee93a-b361-4b69-a96f-a795c7f583c2 req-9b67a778-7033-4391-8850-d4ef933e67bd service nova] Creating event network-vif-unplugged:a5165b48-c2d0-41e9-abdd-4e211e8fb390 for instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 on n-h1-826756-3 Jul 28 04:40:57.635155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-d43ee93a-b361-4b69-a96f-a795c7f583c2 req-9b67a778-7033-4391-8850-d4ef933e67bd service nova] Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:40:57.646477 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d43ee93a-b361-4b69-a96f-a795c7f583c2 req-9b67a778-7033-4391-8850-d4ef933e67bd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045040 Jul 28 04:40:57.647100 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4710/7160] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:40:57.819972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-502b81cc-0b46-4fb6-aa7e-386d0a8aced5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:57.820719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-502b81cc-0b46-4fb6-aa7e-386d0a8aced5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:57.827904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-502b81cc-0b46-4fb6-aa7e-386d0a8aced5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:57.828383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-502b81cc-0b46-4fb6-aa7e-386d0a8aced5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:57.829447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-502b81cc-0b46-4fb6-aa7e-386d0a8aced5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:57.829892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-502b81cc-0b46-4fb6-aa7e-386d0a8aced5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:57.978202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-502b81cc-0b46-4fb6-aa7e-386d0a8aced5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:57.987471 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-502b81cc-0b46-4fb6-aa7e-386d0a8aced5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1729 microversion: 2.1 time: 0.171941 Jul 28 04:40:57.988532 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4711/7161] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:57 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:59.013503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ab93bc4b-2629-44a3-9381-b50e04919d2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:40:59.014150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ab93bc4b-2629-44a3-9381-b50e04919d2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:40:59.021736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab93bc4b-2629-44a3-9381-b50e04919d2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:59.022441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab93bc4b-2629-44a3-9381-b50e04919d2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:59.023198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab93bc4b-2629-44a3-9381-b50e04919d2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:59.023822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab93bc4b-2629-44a3-9381-b50e04919d2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:59.156245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ab93bc4b-2629-44a3-9381-b50e04919d2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:40:59.165064 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ab93bc4b-2629-44a3-9381-b50e04919d2c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1727 microversion: 2.1 time: 0.155682 Jul 28 04:40:59.165640 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4712/7162] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:40:59 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:40:59.661324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-58a6d6af-48d9-41de-a257-c2e64deafb41 req-ae202d91-7eaf-4b79-bc57-a79d5a5a0636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2754651c-9f1b-4357-a83b-f0b10a2e4929", "tag": "a5165b48-c2d0-41e9-abdd-4e211e8fb390"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:40:59.671530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-58a6d6af-48d9-41de-a257-c2e64deafb41 req-ae202d91-7eaf-4b79-bc57-a79d5a5a0636 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:40:59.671992 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-58a6d6af-48d9-41de-a257-c2e64deafb41 req-ae202d91-7eaf-4b79-bc57-a79d5a5a0636 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:40:59.685041 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-58a6d6af-48d9-41de-a257-c2e64deafb41 req-ae202d91-7eaf-4b79-bc57-a79d5a5a0636 service nova] Creating event network-changed:a5165b48-c2d0-41e9-abdd-4e211e8fb390 for instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 on n-h1-826756-3 Jul 28 04:40:59.693226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-58a6d6af-48d9-41de-a257-c2e64deafb41 req-ae202d91-7eaf-4b79-bc57-a79d5a5a0636 service nova] Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:40:59.706412 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-58a6d6af-48d9-41de-a257-c2e64deafb41 req-ae202d91-7eaf-4b79-bc57-a79d5a5a0636 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049059 Jul 28 04:40:59.707309 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4713/7163] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:41:00.187921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-925c7b2b-98b4-407d-8bd5-cb3fbfc0d8e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:00.188779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-925c7b2b-98b4-407d-8bd5-cb3fbfc0d8e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:00.191521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=61 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:41:00.199469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-925c7b2b-98b4-407d-8bd5-cb3fbfc0d8e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:00.200215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-925c7b2b-98b4-407d-8bd5-cb3fbfc0d8e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:00.201476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-925c7b2b-98b4-407d-8bd5-cb3fbfc0d8e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:00.201970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-925c7b2b-98b4-407d-8bd5-cb3fbfc0d8e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:00.346952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-925c7b2b-98b4-407d-8bd5-cb3fbfc0d8e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:00.357583 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-925c7b2b-98b4-407d-8bd5-cb3fbfc0d8e9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1727 microversion: 2.1 time: 0.174100 Jul 28 04:41:00.358382 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4714/7164] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:00 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:01.380617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bedcd5ac-6f71-480d-8e1b-bbe4b6f7e7b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:01.381252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bedcd5ac-6f71-480d-8e1b-bbe4b6f7e7b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:01.389195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bedcd5ac-6f71-480d-8e1b-bbe4b6f7e7b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:01.389666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bedcd5ac-6f71-480d-8e1b-bbe4b6f7e7b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:01.390459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bedcd5ac-6f71-480d-8e1b-bbe4b6f7e7b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:01.390912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bedcd5ac-6f71-480d-8e1b-bbe4b6f7e7b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:01.526007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bedcd5ac-6f71-480d-8e1b-bbe4b6f7e7b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:01.534580 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bedcd5ac-6f71-480d-8e1b-bbe4b6f7e7b0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1727 microversion: 2.1 time: 0.159316 Jul 28 04:41:01.535154 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4715/7165] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:01 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:02.556994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bd9e57d6-5604-4ee1-b72d-aa9fbdbee936 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:02.557625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bd9e57d6-5604-4ee1-b72d-aa9fbdbee936 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:02.565386 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd9e57d6-5604-4ee1-b72d-aa9fbdbee936 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:02.565848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd9e57d6-5604-4ee1-b72d-aa9fbdbee936 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:02.566657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd9e57d6-5604-4ee1-b72d-aa9fbdbee936 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:02.567216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd9e57d6-5604-4ee1-b72d-aa9fbdbee936 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:02.702999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bd9e57d6-5604-4ee1-b72d-aa9fbdbee936 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:02.711585 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bd9e57d6-5604-4ee1-b72d-aa9fbdbee936 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1727 microversion: 2.1 time: 0.158588 Jul 28 04:41:02.712175 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4716/7166] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:02 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:03.734062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-774bdcce-cb24-430d-a2be-e675471b9d13 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:03.734712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-774bdcce-cb24-430d-a2be-e675471b9d13 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:03.742228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-774bdcce-cb24-430d-a2be-e675471b9d13 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:03.742702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-774bdcce-cb24-430d-a2be-e675471b9d13 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:03.743481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-774bdcce-cb24-430d-a2be-e675471b9d13 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:03.743930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-774bdcce-cb24-430d-a2be-e675471b9d13 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:03.893790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-774bdcce-cb24-430d-a2be-e675471b9d13 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:03.902453 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-774bdcce-cb24-430d-a2be-e675471b9d13 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1727 microversion: 2.1 time: 0.172635 Jul 28 04:41:03.903035 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4717/7167] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:03 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:04.928271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d23bc227-4a22-432a-832a-fd4145e663b4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:04.929429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d23bc227-4a22-432a-832a-fd4145e663b4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:04.941083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d23bc227-4a22-432a-832a-fd4145e663b4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:04.941547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d23bc227-4a22-432a-832a-fd4145e663b4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:04.942327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d23bc227-4a22-432a-832a-fd4145e663b4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:04.942783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d23bc227-4a22-432a-832a-fd4145e663b4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:04.961224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:41:05.089583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d23bc227-4a22-432a-832a-fd4145e663b4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:05.099058 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d23bc227-4a22-432a-832a-fd4145e663b4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1727 microversion: 2.1 time: 0.177653 Jul 28 04:41:05.099687 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4718/7168] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:04 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:06.123594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-33d3733e-a77f-49c0-9838-a0bf2acf55b3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:06.124491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-33d3733e-a77f-49c0-9838-a0bf2acf55b3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:06.134477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33d3733e-a77f-49c0-9838-a0bf2acf55b3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:06.135116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33d3733e-a77f-49c0-9838-a0bf2acf55b3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:06.136171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33d3733e-a77f-49c0-9838-a0bf2acf55b3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:06.136823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33d3733e-a77f-49c0-9838-a0bf2acf55b3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:06.291806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-33d3733e-a77f-49c0-9838-a0bf2acf55b3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:06.300906 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-33d3733e-a77f-49c0-9838-a0bf2acf55b3 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1727 microversion: 2.1 time: 0.182682 Jul 28 04:41:06.301501 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4719/7169] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:06 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:07.327177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-559562f6-9ffd-4805-b907-b37a7d8bb933 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:07.328108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-559562f6-9ffd-4805-b907-b37a7d8bb933 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:07.340217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-559562f6-9ffd-4805-b907-b37a7d8bb933 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:07.341053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-559562f6-9ffd-4805-b907-b37a7d8bb933 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:07.342362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-559562f6-9ffd-4805-b907-b37a7d8bb933 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:07.343123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-559562f6-9ffd-4805-b907-b37a7d8bb933 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:07.486347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-559562f6-9ffd-4805-b907-b37a7d8bb933 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:07.495978 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-559562f6-9ffd-4805-b907-b37a7d8bb933 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1727 microversion: 2.1 time: 0.175782 Jul 28 04:41:07.496592 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4720/7170] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:07 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:08.519296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f6a7c856-ff20-4e7f-ac59-577a2923a163 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:08.519985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f6a7c856-ff20-4e7f-ac59-577a2923a163 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:08.527956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6a7c856-ff20-4e7f-ac59-577a2923a163 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:08.528453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6a7c856-ff20-4e7f-ac59-577a2923a163 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:08.529258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6a7c856-ff20-4e7f-ac59-577a2923a163 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:08.529714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6a7c856-ff20-4e7f-ac59-577a2923a163 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:08.674030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f6a7c856-ff20-4e7f-ac59-577a2923a163 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:08.682506 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f6a7c856-ff20-4e7f-ac59-577a2923a163 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1727 microversion: 2.1 time: 0.168097 Jul 28 04:41:08.683094 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4721/7171] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:08 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:09.705946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63f5ad3c-3933-47c0-9c3b-5524fb1668d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:09.706671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63f5ad3c-3933-47c0-9c3b-5524fb1668d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:09.714155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63f5ad3c-3933-47c0-9c3b-5524fb1668d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:09.714620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63f5ad3c-3933-47c0-9c3b-5524fb1668d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:09.715407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63f5ad3c-3933-47c0-9c3b-5524fb1668d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:09.715865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63f5ad3c-3933-47c0-9c3b-5524fb1668d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:09.853388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63f5ad3c-3933-47c0-9c3b-5524fb1668d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:09.862107 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63f5ad3c-3933-47c0-9c3b-5524fb1668d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1727 microversion: 2.1 time: 0.160157 Jul 28 04:41:09.862954 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4722/7172] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:09 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:10.888708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0634dc94-d785-4222-b4f7-d677366d03e6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:10.889703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0634dc94-d785-4222-b4f7-d677366d03e6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:10.901792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0634dc94-d785-4222-b4f7-d677366d03e6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:10.902526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0634dc94-d785-4222-b4f7-d677366d03e6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:10.903834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0634dc94-d785-4222-b4f7-d677366d03e6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:10.904666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0634dc94-d785-4222-b4f7-d677366d03e6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:11.050229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0634dc94-d785-4222-b4f7-d677366d03e6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:11.062881 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0634dc94-d785-4222-b4f7-d677366d03e6 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1724 microversion: 2.1 time: 0.180773 Jul 28 04:41:11.063709 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4723/7173] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:10 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:11.084135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-22fd26e5-8c9c-499b-bf49-adae7c751d94 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:41:11.084788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-22fd26e5-8c9c-499b-bf49-adae7c751d94 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:11.091116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22fd26e5-8c9c-499b-bf49-adae7c751d94 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:11.091575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22fd26e5-8c9c-499b-bf49-adae7c751d94 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:11.092375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22fd26e5-8c9c-499b-bf49-adae7c751d94 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:11.092828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22fd26e5-8c9c-499b-bf49-adae7c751d94 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:11.131334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22fd26e5-8c9c-499b-bf49-adae7c751d94 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:11.131829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22fd26e5-8c9c-499b-bf49-adae7c751d94 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:11.132649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22fd26e5-8c9c-499b-bf49-adae7c751d94 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:11.133096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22fd26e5-8c9c-499b-bf49-adae7c751d94 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:11.153754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-22fd26e5-8c9c-499b-bf49-adae7c751d94 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Getting quotas for project a519852ab6f045779941ca2ed3e4f4bd. Resources: {'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:41:11.159148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-22fd26e5-8c9c-499b-bf49-adae7c751d94 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Getting quotas for user da44c0d51e7a4b1aabf1b73597301cd1 and project a519852ab6f045779941ca2ed3e4f4bd. Resources: {'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:41:11.288311 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-22fd26e5-8c9c-499b-bf49-adae7c751d94 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "POST /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929/action" status: 202 len: 0 microversion: 2.1 time: 0.207017 Jul 28 04:41:11.288597 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4724/7174] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:41:11 2022] POST /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:41:11.297264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-757b5852-deca-456a-bc6b-52c99e9872ab tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:11.297968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-757b5852-deca-456a-bc6b-52c99e9872ab tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:11.304646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-757b5852-deca-456a-bc6b-52c99e9872ab tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:11.305109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-757b5852-deca-456a-bc6b-52c99e9872ab tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:11.305886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-757b5852-deca-456a-bc6b-52c99e9872ab tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:11.306316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-757b5852-deca-456a-bc6b-52c99e9872ab tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:11.445694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-757b5852-deca-456a-bc6b-52c99e9872ab tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:11.454571 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-757b5852-deca-456a-bc6b-52c99e9872ab tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.161453 Jul 28 04:41:11.455355 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4725/7175] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:11 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:12.477505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cde4cb8c-9113-4ca3-a37e-cadbac04b6b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:12.478201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cde4cb8c-9113-4ca3-a37e-cadbac04b6b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:12.485960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cde4cb8c-9113-4ca3-a37e-cadbac04b6b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:12.486431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cde4cb8c-9113-4ca3-a37e-cadbac04b6b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:12.487222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cde4cb8c-9113-4ca3-a37e-cadbac04b6b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:12.487673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cde4cb8c-9113-4ca3-a37e-cadbac04b6b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:12.628729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cde4cb8c-9113-4ca3-a37e-cadbac04b6b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:12.638239 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cde4cb8c-9113-4ca3-a37e-cadbac04b6b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.164775 Jul 28 04:41:12.638830 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4726/7176] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:12 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:41:13.660748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b5261ba2-a794-4111-bb26-cb4930a43fd9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:13.661418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b5261ba2-a794-4111-bb26-cb4930a43fd9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:13.668844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5261ba2-a794-4111-bb26-cb4930a43fd9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:13.669309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5261ba2-a794-4111-bb26-cb4930a43fd9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:13.670134 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5261ba2-a794-4111-bb26-cb4930a43fd9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:13.670716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b5261ba2-a794-4111-bb26-cb4930a43fd9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:13.819368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b5261ba2-a794-4111-bb26-cb4930a43fd9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:13.828437 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b5261ba2-a794-4111-bb26-cb4930a43fd9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.171668 Jul 28 04:41:13.829023 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4727/7177] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:13 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:14.851432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b489cfa4-bb5d-42fd-b028-fddc001cb0bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:14.852072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b489cfa4-bb5d-42fd-b028-fddc001cb0bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:14.859569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b489cfa4-bb5d-42fd-b028-fddc001cb0bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:14.860093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b489cfa4-bb5d-42fd-b028-fddc001cb0bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:14.860918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b489cfa4-bb5d-42fd-b028-fddc001cb0bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:14.861361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b489cfa4-bb5d-42fd-b028-fddc001cb0bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:15.001297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b489cfa4-bb5d-42fd-b028-fddc001cb0bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:15.010524 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b489cfa4-bb5d-42fd-b028-fddc001cb0bd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.163697 Jul 28 04:41:15.011140 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4728/7178] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:14 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:16.032336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-103047c3-9977-4409-861e-2fd00c93baa8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:16.033662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-103047c3-9977-4409-861e-2fd00c93baa8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:16.041024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-103047c3-9977-4409-861e-2fd00c93baa8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:16.041487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-103047c3-9977-4409-861e-2fd00c93baa8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:16.042268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-103047c3-9977-4409-861e-2fd00c93baa8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:16.042716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-103047c3-9977-4409-861e-2fd00c93baa8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:16.182491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-103047c3-9977-4409-861e-2fd00c93baa8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:16.191231 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-103047c3-9977-4409-861e-2fd00c93baa8 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.162825 Jul 28 04:41:16.191852 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4729/7179] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:16 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:16.952924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6000b06d-f919-4f93-a615-ad5b412ab6b7 req-1ec6cadb-d04a-41c1-a50c-ac97b2b372e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2754651c-9f1b-4357-a83b-f0b10a2e4929", "tag": "a5165b48-c2d0-41e9-abdd-4e211e8fb390"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:41:16.966863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6000b06d-f919-4f93-a615-ad5b412ab6b7 req-1ec6cadb-d04a-41c1-a50c-ac97b2b372e2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:16.974087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6000b06d-f919-4f93-a615-ad5b412ab6b7 req-1ec6cadb-d04a-41c1-a50c-ac97b2b372e2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:16.995961 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6000b06d-f919-4f93-a615-ad5b412ab6b7 req-1ec6cadb-d04a-41c1-a50c-ac97b2b372e2 service nova] Creating event network-changed:a5165b48-c2d0-41e9-abdd-4e211e8fb390 for instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 on n-h2-826756-3 Jul 28 04:41:17.002162 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-6000b06d-f919-4f93-a615-ad5b412ab6b7 req-1ec6cadb-d04a-41c1-a50c-ac97b2b372e2 service nova] Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-826756-3', 'n-h1-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:41:17.014617 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6000b06d-f919-4f93-a615-ad5b412ab6b7 req-1ec6cadb-d04a-41c1-a50c-ac97b2b372e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066033 Jul 28 04:41:17.015205 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4730/7180] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:41:17.217117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7bcbe1f5-d8b2-45c1-a4d2-8a16364356f1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:17.218059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7bcbe1f5-d8b2-45c1-a4d2-8a16364356f1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:17.225556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bcbe1f5-d8b2-45c1-a4d2-8a16364356f1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:17.226030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bcbe1f5-d8b2-45c1-a4d2-8a16364356f1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:17.226837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bcbe1f5-d8b2-45c1-a4d2-8a16364356f1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:17.227589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7bcbe1f5-d8b2-45c1-a4d2-8a16364356f1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:17.378871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7bcbe1f5-d8b2-45c1-a4d2-8a16364356f1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:17.390373 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7bcbe1f5-d8b2-45c1-a4d2-8a16364356f1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.179627 Jul 28 04:41:17.391032 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4731/7181] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:17 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:41:18.411284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1d34aa09-5f01-40b3-9600-fa5505ca08a5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:18.412890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1d34aa09-5f01-40b3-9600-fa5505ca08a5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:18.420423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d34aa09-5f01-40b3-9600-fa5505ca08a5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:18.421376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d34aa09-5f01-40b3-9600-fa5505ca08a5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:18.421687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d34aa09-5f01-40b3-9600-fa5505ca08a5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:18.422326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1d34aa09-5f01-40b3-9600-fa5505ca08a5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:18.443967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:41:18.563948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1d34aa09-5f01-40b3-9600-fa5505ca08a5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:18.573195 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1d34aa09-5f01-40b3-9600-fa5505ca08a5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.165766 Jul 28 04:41:18.574050 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4732/7182] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:18 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:19.595615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1911e09b-09e5-4239-ac0e-38698b8829e5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:19.596326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1911e09b-09e5-4239-ac0e-38698b8829e5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:19.604287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1911e09b-09e5-4239-ac0e-38698b8829e5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:19.604773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1911e09b-09e5-4239-ac0e-38698b8829e5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:19.605563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1911e09b-09e5-4239-ac0e-38698b8829e5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:19.606007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1911e09b-09e5-4239-ac0e-38698b8829e5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:19.746046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1911e09b-09e5-4239-ac0e-38698b8829e5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:19.754823 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1911e09b-09e5-4239-ac0e-38698b8829e5 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.163307 Jul 28 04:41:19.755669 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4733/7183] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:19 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:20.777006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-874364b3-542d-4392-a775-40d327a50162 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:20.777690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-874364b3-542d-4392-a775-40d327a50162 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:20.785242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-874364b3-542d-4392-a775-40d327a50162 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:20.785711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-874364b3-542d-4392-a775-40d327a50162 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:20.786640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-874364b3-542d-4392-a775-40d327a50162 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:20.787115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-874364b3-542d-4392-a775-40d327a50162 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:20.920243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-874364b3-542d-4392-a775-40d327a50162 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:20.929156 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-874364b3-542d-4392-a775-40d327a50162 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.156188 Jul 28 04:41:20.929772 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4734/7184] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:20 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:21.951306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7377b2ba-fed3-4f69-8037-f100158720b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:21.951987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7377b2ba-fed3-4f69-8037-f100158720b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:21.953912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:41:21.961114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7377b2ba-fed3-4f69-8037-f100158720b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:21.961587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7377b2ba-fed3-4f69-8037-f100158720b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:21.962373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7377b2ba-fed3-4f69-8037-f100158720b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:21.962825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7377b2ba-fed3-4f69-8037-f100158720b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:22.103628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7377b2ba-fed3-4f69-8037-f100158720b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:22.112508 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7377b2ba-fed3-4f69-8037-f100158720b1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.165234 Jul 28 04:41:22.113092 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4735/7185] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:21 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:23.136825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ff6a0b68-e79f-410f-bf0f-7f93fed22194 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:23.137475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ff6a0b68-e79f-410f-bf0f-7f93fed22194 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:23.144839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff6a0b68-e79f-410f-bf0f-7f93fed22194 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:23.145284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff6a0b68-e79f-410f-bf0f-7f93fed22194 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:23.146102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff6a0b68-e79f-410f-bf0f-7f93fed22194 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:23.146542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff6a0b68-e79f-410f-bf0f-7f93fed22194 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:23.292253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ff6a0b68-e79f-410f-bf0f-7f93fed22194 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:23.303383 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ff6a0b68-e79f-410f-bf0f-7f93fed22194 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.172370 Jul 28 04:41:23.303972 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4736/7186] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:23 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:24.337007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d60b23fb-0342-4665-8e7a-899211491a40 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:24.337944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d60b23fb-0342-4665-8e7a-899211491a40 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:24.352409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d60b23fb-0342-4665-8e7a-899211491a40 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:24.353219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d60b23fb-0342-4665-8e7a-899211491a40 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:24.354213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d60b23fb-0342-4665-8e7a-899211491a40 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:24.354664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d60b23fb-0342-4665-8e7a-899211491a40 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:24.506311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d60b23fb-0342-4665-8e7a-899211491a40 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:24.515208 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d60b23fb-0342-4665-8e7a-899211491a40 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.185086 Jul 28 04:41:24.515766 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4737/7187] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:24 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:25.541663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1cb9ad05-e794-48e3-b691-80f255680dca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:25.542754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1cb9ad05-e794-48e3-b691-80f255680dca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:25.553762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cb9ad05-e794-48e3-b691-80f255680dca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:25.554238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cb9ad05-e794-48e3-b691-80f255680dca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:25.555020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cb9ad05-e794-48e3-b691-80f255680dca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:25.555470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cb9ad05-e794-48e3-b691-80f255680dca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:25.705835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1cb9ad05-e794-48e3-b691-80f255680dca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:25.717382 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1cb9ad05-e794-48e3-b691-80f255680dca tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.182373 Jul 28 04:41:25.718018 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4738/7188] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:25 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:26.742282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d5f3893e-7024-4c4c-9118-7d1182869c4c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:26.742916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d5f3893e-7024-4c4c-9118-7d1182869c4c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:26.749618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5f3893e-7024-4c4c-9118-7d1182869c4c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:26.750092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5f3893e-7024-4c4c-9118-7d1182869c4c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:26.750882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5f3893e-7024-4c4c-9118-7d1182869c4c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:26.751339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d5f3893e-7024-4c4c-9118-7d1182869c4c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:26.884484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d5f3893e-7024-4c4c-9118-7d1182869c4c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:26.893128 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d5f3893e-7024-4c4c-9118-7d1182869c4c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.155463 Jul 28 04:41:26.893715 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4739/7189] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:26 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:27.920014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0d452acd-8629-467d-af1f-61053a667082 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:27.921121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0d452acd-8629-467d-af1f-61053a667082 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:27.930684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d452acd-8629-467d-af1f-61053a667082 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:27.931151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d452acd-8629-467d-af1f-61053a667082 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:27.931936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d452acd-8629-467d-af1f-61053a667082 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:27.932388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0d452acd-8629-467d-af1f-61053a667082 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:28.082050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0d452acd-8629-467d-af1f-61053a667082 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:28.090833 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0d452acd-8629-467d-af1f-61053a667082 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.177866 Jul 28 04:41:28.091417 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4740/7190] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:27 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:41:29.113141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d6d2b90c-53db-46f2-82e8-44b5e3fd2012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:29.113925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d6d2b90c-53db-46f2-82e8-44b5e3fd2012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:29.121544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6d2b90c-53db-46f2-82e8-44b5e3fd2012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:29.122003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6d2b90c-53db-46f2-82e8-44b5e3fd2012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:29.122794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6d2b90c-53db-46f2-82e8-44b5e3fd2012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:29.123237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6d2b90c-53db-46f2-82e8-44b5e3fd2012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:29.269807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d6d2b90c-53db-46f2-82e8-44b5e3fd2012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:29.279895 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d6d2b90c-53db-46f2-82e8-44b5e3fd2012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.170488 Jul 28 04:41:29.280652 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4741/7191] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:29 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:30.307270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ec889ee-8598-46df-8e4d-628914208a7b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:30.307971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5ec889ee-8598-46df-8e4d-628914208a7b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:30.310664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:41:30.316851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ec889ee-8598-46df-8e4d-628914208a7b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:30.317343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ec889ee-8598-46df-8e4d-628914208a7b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:30.318143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ec889ee-8598-46df-8e4d-628914208a7b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:30.318587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5ec889ee-8598-46df-8e4d-628914208a7b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:30.469463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5ec889ee-8598-46df-8e4d-628914208a7b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:30.478840 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ec889ee-8598-46df-8e4d-628914208a7b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1723 microversion: 2.1 time: 0.175604 Jul 28 04:41:30.479553 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4742/7192] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:30 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:41:31.501224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b8a21a29-2eb2-41dd-8556-0ab79fd4f7b9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:31.501878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b8a21a29-2eb2-41dd-8556-0ab79fd4f7b9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:31.509568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8a21a29-2eb2-41dd-8556-0ab79fd4f7b9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:31.510035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8a21a29-2eb2-41dd-8556-0ab79fd4f7b9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:31.510802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8a21a29-2eb2-41dd-8556-0ab79fd4f7b9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:31.511279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8a21a29-2eb2-41dd-8556-0ab79fd4f7b9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:31.655368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8a21a29-2eb2-41dd-8556-0ab79fd4f7b9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:31.664176 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b8a21a29-2eb2-41dd-8556-0ab79fd4f7b9 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1716 microversion: 2.1 time: 0.167137 Jul 28 04:41:31.664777 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4743/7193] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:31 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:31.687753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-872669e1-c32b-4715-98e9-0ce4f46cbb67 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:31.688377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-872669e1-c32b-4715-98e9-0ce4f46cbb67 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:31.697516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-872669e1-c32b-4715-98e9-0ce4f46cbb67 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:31.698209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-872669e1-c32b-4715-98e9-0ce4f46cbb67 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:31.699507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-872669e1-c32b-4715-98e9-0ce4f46cbb67 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:31.700030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-872669e1-c32b-4715-98e9-0ce4f46cbb67 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:31.834725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-872669e1-c32b-4715-98e9-0ce4f46cbb67 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:31.844188 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-872669e1-c32b-4715-98e9-0ce4f46cbb67 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1716 microversion: 2.1 time: 0.161125 Jul 28 04:41:31.844804 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4744/7194] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:31 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1716 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:41:31.865004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63432eb1-549e-4f66-81dd-ba5e2b797d3c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:31.865623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63432eb1-549e-4f66-81dd-ba5e2b797d3c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:31.872202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63432eb1-549e-4f66-81dd-ba5e2b797d3c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:31.872693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63432eb1-549e-4f66-81dd-ba5e2b797d3c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:31.873470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63432eb1-549e-4f66-81dd-ba5e2b797d3c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:31.873922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63432eb1-549e-4f66-81dd-ba5e2b797d3c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:32.009826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63432eb1-549e-4f66-81dd-ba5e2b797d3c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:32.018610 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63432eb1-549e-4f66-81dd-ba5e2b797d3c tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1716 microversion: 2.1 time: 0.157233 Jul 28 04:41:32.019227 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4745/7195] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:31 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:32.039639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bdd825c6-606e-4012-9e4c-7217b3c7f1f4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:32.040034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bdd825c6-606e-4012-9e4c-7217b3c7f1f4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:32.046781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bdd825c6-606e-4012-9e4c-7217b3c7f1f4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:32.047245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bdd825c6-606e-4012-9e4c-7217b3c7f1f4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:32.048009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bdd825c6-606e-4012-9e4c-7217b3c7f1f4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:32.048502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bdd825c6-606e-4012-9e4c-7217b3c7f1f4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:32.074852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bdd825c6-606e-4012-9e4c-7217b3c7f1f4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:41:32.155495 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bdd825c6-606e-4012-9e4c-7217b3c7f1f4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 204 len: 0 microversion: 2.1 time: 0.119519 Jul 28 04:41:32.156209 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4746/7196] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:41:32 2022] DELETE /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:41:32.166520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05912157-bd7d-44a2-9650-3ace601c94d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:32.167260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-05912157-bd7d-44a2-9650-3ace601c94d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:32.174228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05912157-bd7d-44a2-9650-3ace601c94d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:32.175515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05912157-bd7d-44a2-9650-3ace601c94d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:32.175515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05912157-bd7d-44a2-9650-3ace601c94d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:32.175919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05912157-bd7d-44a2-9650-3ace601c94d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:32.198557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:41:32.318642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-05912157-bd7d-44a2-9650-3ace601c94d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:32.327847 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-05912157-bd7d-44a2-9650-3ace601c94d1 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1722 microversion: 2.1 time: 0.165506 Jul 28 04:41:32.328468 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4747/7197] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:32 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:32.897329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-8138970c-73fd-4f0d-813f-627e3542b740 req-50e950f6-7716-4a49-8298-ffedbce15bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2754651c-9f1b-4357-a83b-f0b10a2e4929", "name": "network-vif-plugged", "status": "completed", "tag": "a5165b48-c2d0-41e9-abdd-4e211e8fb390"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:41:32.910093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8138970c-73fd-4f0d-813f-627e3542b740 req-50e950f6-7716-4a49-8298-ffedbce15bd7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:32.910541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8138970c-73fd-4f0d-813f-627e3542b740 req-50e950f6-7716-4a49-8298-ffedbce15bd7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:32.926926 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-8138970c-73fd-4f0d-813f-627e3542b740 req-50e950f6-7716-4a49-8298-ffedbce15bd7 service nova] Creating event network-vif-plugged:a5165b48-c2d0-41e9-abdd-4e211e8fb390 for instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 on n-h2-826756-3 Jul 28 04:41:32.932343 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-8138970c-73fd-4f0d-813f-627e3542b740 req-50e950f6-7716-4a49-8298-ffedbce15bd7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038722 Jul 28 04:41:32.933082 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4748/7198] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:41:33.351225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7783089c-69bc-4bca-a57e-48e39428efbd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:33.351838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7783089c-69bc-4bca-a57e-48e39428efbd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:33.359176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7783089c-69bc-4bca-a57e-48e39428efbd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:33.359639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7783089c-69bc-4bca-a57e-48e39428efbd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:33.360607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7783089c-69bc-4bca-a57e-48e39428efbd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:33.361060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7783089c-69bc-4bca-a57e-48e39428efbd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:33.503523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7783089c-69bc-4bca-a57e-48e39428efbd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:33.514411 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7783089c-69bc-4bca-a57e-48e39428efbd tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1722 microversion: 2.1 time: 0.167725 Jul 28 04:41:33.515414 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4749/7199] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:33 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:34.547176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ddc3f050-8f2b-4043-bc5b-fe734b5d0e78 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:34.547731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ddc3f050-8f2b-4043-bc5b-fe734b5d0e78 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:34.555214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ddc3f050-8f2b-4043-bc5b-fe734b5d0e78 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:34.555683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ddc3f050-8f2b-4043-bc5b-fe734b5d0e78 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:34.556514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ddc3f050-8f2b-4043-bc5b-fe734b5d0e78 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:34.556949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ddc3f050-8f2b-4043-bc5b-fe734b5d0e78 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:34.714220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ddc3f050-8f2b-4043-bc5b-fe734b5d0e78 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:34.729746 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ddc3f050-8f2b-4043-bc5b-fe734b5d0e78 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1722 microversion: 2.1 time: 0.186684 Jul 28 04:41:34.742458 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4750/7200] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:34 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:35.010697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-16b6fa54-4f16-4717-8366-1dd5aa0c725f req-7b3fa773-4515-4e13-9635-d375154396a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2754651c-9f1b-4357-a83b-f0b10a2e4929", "name": "network-vif-deleted", "tag": "a5165b48-c2d0-41e9-abdd-4e211e8fb390"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:41:35.021027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-16b6fa54-4f16-4717-8366-1dd5aa0c725f req-7b3fa773-4515-4e13-9635-d375154396a9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:35.021457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-16b6fa54-4f16-4717-8366-1dd5aa0c725f req-7b3fa773-4515-4e13-9635-d375154396a9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:35.034467 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-16b6fa54-4f16-4717-8366-1dd5aa0c725f req-7b3fa773-4515-4e13-9635-d375154396a9 service nova] Creating event network-vif-deleted:a5165b48-c2d0-41e9-abdd-4e211e8fb390 for instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 on n-h2-826756-3 Jul 28 04:41:35.040267 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-16b6fa54-4f16-4717-8366-1dd5aa0c725f req-7b3fa773-4515-4e13-9635-d375154396a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033314 Jul 28 04:41:35.041279 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4751/7201] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:41:35.752981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e074fa05-f05d-4b1d-97d0-30c14cc35474 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:35.753669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e074fa05-f05d-4b1d-97d0-30c14cc35474 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:35.761120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e074fa05-f05d-4b1d-97d0-30c14cc35474 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:35.761613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e074fa05-f05d-4b1d-97d0-30c14cc35474 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:35.762402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e074fa05-f05d-4b1d-97d0-30c14cc35474 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:35.762849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e074fa05-f05d-4b1d-97d0-30c14cc35474 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:35.829633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e074fa05-f05d-4b1d-97d0-30c14cc35474 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:35.838241 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e074fa05-f05d-4b1d-97d0-30c14cc35474 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1369 microversion: 2.1 time: 0.090593 Jul 28 04:41:35.838835 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4752/7202] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:35 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:41:36.859533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-099ed30e-6593-4f85-ae11-d0c3b44b4800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:36.860244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-099ed30e-6593-4f85-ae11-d0c3b44b4800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:36.867529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-099ed30e-6593-4f85-ae11-d0c3b44b4800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:36.868000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-099ed30e-6593-4f85-ae11-d0c3b44b4800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:36.868809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-099ed30e-6593-4f85-ae11-d0c3b44b4800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:36.869262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-099ed30e-6593-4f85-ae11-d0c3b44b4800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:36.936161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-099ed30e-6593-4f85-ae11-d0c3b44b4800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:36.945217 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-099ed30e-6593-4f85-ae11-d0c3b44b4800 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1369 microversion: 2.1 time: 0.089684 Jul 28 04:41:36.945826 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4753/7203] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:36 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:37.967028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-911e3b2b-e276-4b0c-ab31-c03c46ba9b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:37.967769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-911e3b2b-e276-4b0c-ab31-c03c46ba9b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:37.975607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-911e3b2b-e276-4b0c-ab31-c03c46ba9b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:37.976072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-911e3b2b-e276-4b0c-ab31-c03c46ba9b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:37.976893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-911e3b2b-e276-4b0c-ab31-c03c46ba9b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:37.977345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-911e3b2b-e276-4b0c-ab31-c03c46ba9b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:38.048978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-911e3b2b-e276-4b0c-ab31-c03c46ba9b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:38.057956 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-911e3b2b-e276-4b0c-ab31-c03c46ba9b52 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1369 microversion: 2.1 time: 0.095261 Jul 28 04:41:38.058751 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4754/7204] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:37 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:39.079691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-150940f5-ed11-441e-bf87-b3af4a53615d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:39.080406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-150940f5-ed11-441e-bf87-b3af4a53615d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:39.087914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150940f5-ed11-441e-bf87-b3af4a53615d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:39.088394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150940f5-ed11-441e-bf87-b3af4a53615d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:39.089190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150940f5-ed11-441e-bf87-b3af4a53615d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:39.089696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-150940f5-ed11-441e-bf87-b3af4a53615d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:39.164444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-150940f5-ed11-441e-bf87-b3af4a53615d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da44c0d51e7a4b1aabf1b73597301cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a519852ab6f045779941ca2ed3e4f4bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:39.173077 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-150940f5-ed11-441e-bf87-b3af4a53615d tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 200 len: 1369 microversion: 2.1 time: 0.097513 Jul 28 04:41:39.173651 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4755/7205] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:39 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:40.197131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a92cbac-1ac3-4a7d-8ab8-c6d3fd033012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:40.198079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4a92cbac-1ac3-4a7d-8ab8-c6d3fd033012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:40.205669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a92cbac-1ac3-4a7d-8ab8-c6d3fd033012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:40.206131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a92cbac-1ac3-4a7d-8ab8-c6d3fd033012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:40.206909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a92cbac-1ac3-4a7d-8ab8-c6d3fd033012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:40.207384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a92cbac-1ac3-4a7d-8ab8-c6d3fd033012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:40.221343 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-4a92cbac-1ac3-4a7d-8ab8-c6d3fd033012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a92cbac-1ac3-4a7d-8ab8-c6d3fd033012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 HTTP/1.1 Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2754651c-9f1b-4357-a83b-f0b10a2e4929'} Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:40.223389 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:40.227309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:40.227309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:40.227309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:40.227309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:41:40.227309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:41:40.227309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:40.227309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:40.227309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a92cbac-1ac3-4a7d-8ab8-c6d3fd033012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:41:40.227309 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4a92cbac-1ac3-4a7d-8ab8-c6d3fd033012 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 404 len: 111 microversion: 2.1 time: 0.032892 Jul 28 04:41:40.227309 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4756/7206] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:40 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:41:40.286482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-16a5c757-546f-42ba-89f2-6cb15c168b62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:40.288761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-16a5c757-546f-42ba-89f2-6cb15c168b62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:40.295737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16a5c757-546f-42ba-89f2-6cb15c168b62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:40.296207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16a5c757-546f-42ba-89f2-6cb15c168b62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:40.297009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16a5c757-546f-42ba-89f2-6cb15c168b62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:40.297490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-16a5c757-546f-42ba-89f2-6cb15c168b62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:40.311599 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-16a5c757-546f-42ba-89f2-6cb15c168b62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-16a5c757-546f-42ba-89f2-6cb15c168b62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929/os-volume_attachments HTTP/1.1 Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': '2754651c-9f1b-4357-a83b-f0b10a2e4929'} Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:41:40.313150 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:40.317121 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:40.317121 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:40.317121 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:40.317121 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:40.317121 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:40.317121 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:40.317121 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:41:40.317121 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:41:40.317121 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:40.317121 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:40.317121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-16a5c757-546f-42ba-89f2-6cb15c168b62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:41:40.317121 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-16a5c757-546f-42ba-89f2-6cb15c168b62 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032221 Jul 28 04:41:40.317121 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4757/7207] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:41:40 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:41:43.649913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05cb9f9f-3fba-484f-8240-20fc4ef4a692 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:43.650580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-05cb9f9f-3fba-484f-8240-20fc4ef4a692 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:43.658370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05cb9f9f-3fba-484f-8240-20fc4ef4a692 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.658823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05cb9f9f-3fba-484f-8240-20fc4ef4a692 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.659635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05cb9f9f-3fba-484f-8240-20fc4ef4a692 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.660088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-05cb9f9f-3fba-484f-8240-20fc4ef4a692 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.675655 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-05cb9f9f-3fba-484f-8240-20fc4ef4a692 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05cb9f9f-3fba-484f-8240-20fc4ef4a692 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 HTTP/1.1 Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2754651c-9f1b-4357-a83b-f0b10a2e4929'} Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:41:43.677309 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:43.681310 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.681310 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.681310 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.681310 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.681310 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.681310 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.681310 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:41:43.681310 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:41:43.681310 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:43.681310 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.681310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-05cb9f9f-3fba-484f-8240-20fc4ef4a692 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:41:43.681310 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-05cb9f9f-3fba-484f-8240-20fc4ef4a692 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 404 len: 111 microversion: 2.1 time: 0.032912 Jul 28 04:41:43.681310 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4758/7208] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:41:43 2022] DELETE /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:41:43.687479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9cf00b2c-5c32-4a80-a523-5924bd2b0f5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:43.688110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9cf00b2c-5c32-4a80-a523-5924bd2b0f5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 2754651c-9f1b-4357-a83b-f0b10a2e4929] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:43.695549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cf00b2c-5c32-4a80-a523-5924bd2b0f5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.696016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cf00b2c-5c32-4a80-a523-5924bd2b0f5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.696950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cf00b2c-5c32-4a80-a523-5924bd2b0f5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.697304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cf00b2c-5c32-4a80-a523-5924bd2b0f5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.711765 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-9cf00b2c-5c32-4a80-a523-5924bd2b0f5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9cf00b2c-5c32-4a80-a523-5924bd2b0f5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 HTTP/1.1 Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '2754651c-9f1b-4357-a83b-f0b10a2e4929'} Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.713416 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.718005 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.718005 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.718005 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.718005 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:41:43.718005 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:41:43.718005 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. Jul 28 04:41:43.718005 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.718005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9cf00b2c-5c32-4a80-a523-5924bd2b0f5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance 2754651c-9f1b-4357-a83b-f0b10a2e4929 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:41:43.718005 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9cf00b2c-5c32-4a80-a523-5924bd2b0f5b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929" status: 404 len: 111 microversion: 2.1 time: 0.031244 Jul 28 04:41:43.718005 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4759/7209] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:43 2022] GET /compute/v2.1/servers/2754651c-9f1b-4357-a83b-f0b10a2e4929 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:41:43.725119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b445ce14-e5e7-4f34-9a30-741b48057ae4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:43.725639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b445ce14-e5e7-4f34-9a30-741b48057ae4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:43.732276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b445ce14-e5e7-4f34-9a30-741b48057ae4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.732756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b445ce14-e5e7-4f34-9a30-741b48057ae4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.733541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b445ce14-e5e7-4f34-9a30-741b48057ae4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.733989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b445ce14-e5e7-4f34-9a30-741b48057ae4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.748902 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-b445ce14-e5e7-4f34-9a30-741b48057ae4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b445ce14-e5e7-4f34-9a30-741b48057ae4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b HTTP/1.1 Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '223d3ca6-5426-43c7-913d-44a352f16a3b'} Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:41:43.750641 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:41:43.754448 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.754448 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.754448 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.754448 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.754448 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.754448 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.754448 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:41:43.754448 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:41:43.754448 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:41:43.754448 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.754448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b445ce14-e5e7-4f34-9a30-741b48057ae4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:41:43.754448 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b445ce14-e5e7-4f34-9a30-741b48057ae4 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "DELETE /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 404 len: 111 microversion: 2.1 time: 0.031823 Jul 28 04:41:43.754448 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4760/7210] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:41:43 2022] DELETE /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:41:43.760728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d0a97391-cc6a-4b29-a12a-cb8f61c37a2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:43.761462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d0a97391-cc6a-4b29-a12a-cb8f61c37a2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 223d3ca6-5426-43c7-913d-44a352f16a3b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:43.767947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0a97391-cc6a-4b29-a12a-cb8f61c37a2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.768436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0a97391-cc6a-4b29-a12a-cb8f61c37a2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.769412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0a97391-cc6a-4b29-a12a-cb8f61c37a2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.769862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0a97391-cc6a-4b29-a12a-cb8f61c37a2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.784192 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-d0a97391-cc6a-4b29-a12a-cb8f61c37a2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d0a97391-cc6a-4b29-a12a-cb8f61c37a2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b HTTP/1.1 Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '223d3ca6-5426-43c7-913d-44a352f16a3b'} Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.785820 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.789846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.789846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.789846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.789846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:41:43.789846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:41:43.789846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. Jul 28 04:41:43.789846 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.789846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d0a97391-cc6a-4b29-a12a-cb8f61c37a2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance 223d3ca6-5426-43c7-913d-44a352f16a3b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:41:43.789846 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d0a97391-cc6a-4b29-a12a-cb8f61c37a2b tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b" status: 404 len: 111 microversion: 2.1 time: 0.030369 Jul 28 04:41:43.789846 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4761/7211] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:43 2022] GET /compute/v2.1/servers/223d3ca6-5426-43c7-913d-44a352f16a3b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:41:43.796374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d7c7c7b-90cd-491b-90f9-af3f3295f182 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:43.796896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d7c7c7b-90cd-491b-90f9-af3f3295f182 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:43.803301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d7c7c7b-90cd-491b-90f9-af3f3295f182 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.803764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d7c7c7b-90cd-491b-90f9-af3f3295f182 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.804583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d7c7c7b-90cd-491b-90f9-af3f3295f182 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.805042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d7c7c7b-90cd-491b-90f9-af3f3295f182 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.820549 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-9d7c7c7b-90cd-491b-90f9-af3f3295f182 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d7c7c7b-90cd-491b-90f9-af3f3295f182 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 HTTP/1.1 Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c8aba63a-7017-43a5-a957-c0d45fa309b0'} Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:41:43.822188 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:41:43.826679 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.826679 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.826679 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.826679 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.826679 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.826679 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.826679 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:41:43.826679 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:41:43.826679 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:41:43.826679 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.826679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d7c7c7b-90cd-491b-90f9-af3f3295f182 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:41:43.826679 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d7c7c7b-90cd-491b-90f9-af3f3295f182 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 404 len: 111 microversion: 2.1 time: 0.031203 Jul 28 04:41:43.826679 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4762/7212] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:41:43 2022] DELETE /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:41:43.832438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0c0a6f75-ee5b-4133-ac59-70be018476c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:43.833083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0c0a6f75-ee5b-4133-ac59-70be018476c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: c8aba63a-7017-43a5-a957-c0d45fa309b0] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:43.840082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c0a6f75-ee5b-4133-ac59-70be018476c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.840572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c0a6f75-ee5b-4133-ac59-70be018476c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.841392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c0a6f75-ee5b-4133-ac59-70be018476c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.841833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c0a6f75-ee5b-4133-ac59-70be018476c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.857508 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-0c0a6f75-ee5b-4133-ac59-70be018476c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0c0a6f75-ee5b-4133-ac59-70be018476c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 HTTP/1.1 Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c8aba63a-7017-43a5-a957-c0d45fa309b0'} Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.859104 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.862847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.862847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.862847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.862847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:41:43.862847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:41:43.862847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. Jul 28 04:41:43.862847 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.862847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0c0a6f75-ee5b-4133-ac59-70be018476c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance c8aba63a-7017-43a5-a957-c0d45fa309b0 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:41:43.862847 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0c0a6f75-ee5b-4133-ac59-70be018476c0 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0" status: 404 len: 111 microversion: 2.1 time: 0.032081 Jul 28 04:41:43.862847 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4763/7213] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:43 2022] GET /compute/v2.1/servers/c8aba63a-7017-43a5-a957-c0d45fa309b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:41:43.869750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ee992fed-fa2a-4f48-b484-b4f4ebe3c318 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:43.870271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ee992fed-fa2a-4f48-b484-b4f4ebe3c318 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:43.876998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee992fed-fa2a-4f48-b484-b4f4ebe3c318 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.877465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee992fed-fa2a-4f48-b484-b4f4ebe3c318 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.878259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee992fed-fa2a-4f48-b484-b4f4ebe3c318 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.878716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee992fed-fa2a-4f48-b484-b4f4ebe3c318 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.893985 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-ee992fed-fa2a-4f48-b484-b4f4ebe3c318 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ee992fed-fa2a-4f48-b484-b4f4ebe3c318 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae HTTP/1.1 Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '45e27551-9e3d-4bea-8f27-1f55f81146ae'} Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:41:43.895708 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:41:43.899211 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.899211 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.899211 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.899211 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.899211 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.899211 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.899211 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:41:43.899211 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:41:43.899211 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:41:43.899211 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.899211 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ee992fed-fa2a-4f48-b484-b4f4ebe3c318 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:41:43.899211 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ee992fed-fa2a-4f48-b484-b4f4ebe3c318 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "DELETE /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 404 len: 111 microversion: 2.1 time: 0.031647 Jul 28 04:41:43.899211 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4764/7214] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:41:43 2022] DELETE /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:41:43.905799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fed48210-fa47-4542-bcdb-b8ee4d1a4349 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:43.906505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fed48210-fa47-4542-bcdb-b8ee4d1a4349 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] [instance: 45e27551-9e3d-4bea-8f27-1f55f81146ae] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:43.913017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fed48210-fa47-4542-bcdb-b8ee4d1a4349 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.913526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fed48210-fa47-4542-bcdb-b8ee4d1a4349 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.914324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fed48210-fa47-4542-bcdb-b8ee4d1a4349 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:43.914766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fed48210-fa47-4542-bcdb-b8ee4d1a4349 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:43.930240 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-fed48210-fa47-4542-bcdb-b8ee4d1a4349 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] HTTP exception thrown: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fed48210-fa47-4542-bcdb-b8ee4d1a4349 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Request method failure captured: Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae HTTP/1.1 Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hIfA7hEDufp58eZJarJiWVaMD3diZQzWUs38DC_GWPrIJOWi5yQA0wt6emh_m1yGSZH6ieTkh5v8_yS5cpRG2uTnkwVRJNF9UVe8_7CnNaiE-wmKuGQ8RjNcfw1yoNO5noW8LAeYYpnY2NtOgPiivWHdS8Asuingcg8jVzkYdRcn8Y Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a519852ab6f045779941ca2ed3e4f4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a519852ab6f045779941ca2ed3e4f4bd"}]}] Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a519852ab6f045779941ca2ed3e4f4bd Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServerActionsTestJSON-579022 Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: da44c0d51e7a4b1aabf1b73597301cd1 Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServerActionsTestJSON-579022-project Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '45e27551-9e3d-4bea-8f27-1f55f81146ae'} Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:41:43.931848 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.935702 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:41:43.935702 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:41:43.935702 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:41:43.935702 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:41:43.935702 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:41:43.935702 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. Jul 28 04:41:43.935702 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:41:43.935702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fed48210-fa47-4542-bcdb-b8ee4d1a4349 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Returning 404 to user: Instance 45e27551-9e3d-4bea-8f27-1f55f81146ae could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:41:43.935702 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fed48210-fa47-4542-bcdb-b8ee4d1a4349 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae" status: 404 len: 111 microversion: 2.1 time: 0.031276 Jul 28 04:41:43.935702 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4765/7215] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:43 2022] GET /compute/v2.1/servers/45e27551-9e3d-4bea-8f27-1f55f81146ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:41:43.941776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e3dea39e-a041-45c0-b67e-62f320a26461 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] Calling method '.version_select at 0x7ffa67af1790>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:43.966429 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e3dea39e-a041-45c0-b67e-62f320a26461 tempest-ServerActionsTestJSON-579022 tempest-ServerActionsTestJSON-579022-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754507874" status: 202 len: 0 microversion: 2.1 time: 0.028133 Jul 28 04:41:43.967023 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4766/7216] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Jul 28 04:41:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754507874 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:41:45.837017 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:41:45.837564 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:41:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:41:53.602336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-274269327", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "1916075e-6c65-4e87-a7c0-8237cb2853e3"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:41:53.671566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] validate_networks() for [('1916075e-6c65-4e87-a7c0-8237cb2853e3', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:41:53.919759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=62 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:41:54.128832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:41:54.129433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:41:54.129987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:41:54.130701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:41:54.130972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:41:54.141451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:54.141888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:54.143003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:54.143566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:54.165333 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Getting quotas for project 7d448a98140a4f42adf161374aa9a3d9. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:41:54.173118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Getting quotas for user ab99c3d5f7f64869abbaaaed385020f7 and project 7d448a98140a4f42adf161374aa9a3d9. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:41:54.188328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:41:54.190721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:41:54.237797 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15df2086-5b0d-4cba-90a6-39e813a954b6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771496 Jul 28 04:41:54.238668 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4767/7217] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:41:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:41:54.249249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9e884ab9-bf0e-4702-8804-ae71a31bdc20 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:54.249869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9e884ab9-bf0e-4702-8804-ae71a31bdc20 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:54.308242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9e884ab9-bf0e-4702-8804-ae71a31bdc20 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:54.318262 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9e884ab9-bf0e-4702-8804-ae71a31bdc20 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1216 microversion: 2.1 time: 0.072670 Jul 28 04:41:54.318856 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4768/7218] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:54 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:55.339782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ddfb306-d135-4c0d-8087-2d7d6a157906 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:55.341124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ddfb306-d135-4c0d-8087-2d7d6a157906 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:55.348867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ddfb306-d135-4c0d-8087-2d7d6a157906 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:55.349329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ddfb306-d135-4c0d-8087-2d7d6a157906 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:55.350125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ddfb306-d135-4c0d-8087-2d7d6a157906 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:55.350566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ddfb306-d135-4c0d-8087-2d7d6a157906 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:55.424694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ddfb306-d135-4c0d-8087-2d7d6a157906 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:55.433060 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ddfb306-d135-4c0d-8087-2d7d6a157906 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1268 microversion: 2.1 time: 0.097555 Jul 28 04:41:55.433659 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4769/7219] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:55 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1268 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:41:56.454184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-28f6c51f-7735-4687-8808-9d0f947609f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:56.455660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-28f6c51f-7735-4687-8808-9d0f947609f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:56.467104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28f6c51f-7735-4687-8808-9d0f947609f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:56.467574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28f6c51f-7735-4687-8808-9d0f947609f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:56.468576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28f6c51f-7735-4687-8808-9d0f947609f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:56.469197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28f6c51f-7735-4687-8808-9d0f947609f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:56.626002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-28f6c51f-7735-4687-8808-9d0f947609f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:56.634242 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-28f6c51f-7735-4687-8808-9d0f947609f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1316 microversion: 2.1 time: 0.183926 Jul 28 04:41:56.634852 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4770/7220] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:56 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:41:57.021266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-810a7719-6ca1-404c-953c-64de70030363 req-9e58e1b7-6df7-4874-bab7-ae1ceb8d2170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5153d8b4-8d10-4981-b215-21604a5970f2", "tag": "66aa5dd6-748c-4634-aab0-4f5fab04a43d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:41:57.038695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-810a7719-6ca1-404c-953c-64de70030363 req-9e58e1b7-6df7-4874-bab7-ae1ceb8d2170 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:57.039752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-810a7719-6ca1-404c-953c-64de70030363 req-9e58e1b7-6df7-4874-bab7-ae1ceb8d2170 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:57.085228 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-810a7719-6ca1-404c-953c-64de70030363 req-9e58e1b7-6df7-4874-bab7-ae1ceb8d2170 service nova] Creating event network-changed:66aa5dd6-748c-4634-aab0-4f5fab04a43d for instance 5153d8b4-8d10-4981-b215-21604a5970f2 on n-h2-826756-3 Jul 28 04:41:57.098430 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-810a7719-6ca1-404c-953c-64de70030363 req-9e58e1b7-6df7-4874-bab7-ae1ceb8d2170 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080893 Jul 28 04:41:57.103735 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4771/7221] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:41:57.658505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2fc216e9-f86a-43c6-a5cd-24ae2a0bfabe tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:57.659143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2fc216e9-f86a-43c6-a5cd-24ae2a0bfabe tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:57.666076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2fc216e9-f86a-43c6-a5cd-24ae2a0bfabe tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:57.666544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2fc216e9-f86a-43c6-a5cd-24ae2a0bfabe tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:57.667330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2fc216e9-f86a-43c6-a5cd-24ae2a0bfabe tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:57.667777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2fc216e9-f86a-43c6-a5cd-24ae2a0bfabe tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:57.803954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2fc216e9-f86a-43c6-a5cd-24ae2a0bfabe tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:57.814017 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2fc216e9-f86a-43c6-a5cd-24ae2a0bfabe tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1316 microversion: 2.1 time: 0.160941 Jul 28 04:41:57.814606 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4772/7222] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:57 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:41:58.835337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc50f51d-ab3d-4950-90c7-fdf1d00dc330 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:41:58.835978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dc50f51d-ab3d-4950-90c7-fdf1d00dc330 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:41:58.843570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc50f51d-ab3d-4950-90c7-fdf1d00dc330 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:58.844049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc50f51d-ab3d-4950-90c7-fdf1d00dc330 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:58.844888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc50f51d-ab3d-4950-90c7-fdf1d00dc330 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:41:58.845343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc50f51d-ab3d-4950-90c7-fdf1d00dc330 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:41:58.986888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dc50f51d-ab3d-4950-90c7-fdf1d00dc330 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:41:58.995500 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc50f51d-ab3d-4950-90c7-fdf1d00dc330 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1316 microversion: 2.1 time: 0.164169 Jul 28 04:41:59.002048 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4773/7223] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:41:58 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:00.016945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4605439e-27bd-4ad8-93e9-541f73af17c3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:00.017648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4605439e-27bd-4ad8-93e9-541f73af17c3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:00.025001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4605439e-27bd-4ad8-93e9-541f73af17c3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:00.025469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4605439e-27bd-4ad8-93e9-541f73af17c3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:00.026250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4605439e-27bd-4ad8-93e9-541f73af17c3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:00.026754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4605439e-27bd-4ad8-93e9-541f73af17c3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:00.176272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4605439e-27bd-4ad8-93e9-541f73af17c3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:00.187964 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4605439e-27bd-4ad8-93e9-541f73af17c3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1316 microversion: 2.1 time: 0.174999 Jul 28 04:42:00.188821 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4774/7224] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:00 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:01.074448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-01a20a71-448b-47dc-84b8-2e27574c7987 req-58cbe054-79d2-4f2b-9599-dbde0d7562dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5153d8b4-8d10-4981-b215-21604a5970f2", "name": "network-vif-plugged", "status": "completed", "tag": "66aa5dd6-748c-4634-aab0-4f5fab04a43d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:42:01.080930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:42:01.087916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-01a20a71-448b-47dc-84b8-2e27574c7987 req-58cbe054-79d2-4f2b-9599-dbde0d7562dc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:01.088585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-01a20a71-448b-47dc-84b8-2e27574c7987 req-58cbe054-79d2-4f2b-9599-dbde0d7562dc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:01.102158 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-01a20a71-448b-47dc-84b8-2e27574c7987 req-58cbe054-79d2-4f2b-9599-dbde0d7562dc service nova] Creating event network-vif-plugged:66aa5dd6-748c-4634-aab0-4f5fab04a43d for instance 5153d8b4-8d10-4981-b215-21604a5970f2 on n-h2-826756-3 Jul 28 04:42:01.108030 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-01a20a71-448b-47dc-84b8-2e27574c7987 req-58cbe054-79d2-4f2b-9599-dbde0d7562dc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037400 Jul 28 04:42:01.109117 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4775/7225] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:42:01.213063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-216835bc-8864-4a60-92a7-e9eb56cedf43 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:01.213882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-216835bc-8864-4a60-92a7-e9eb56cedf43 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:01.221675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-216835bc-8864-4a60-92a7-e9eb56cedf43 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:01.222515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-216835bc-8864-4a60-92a7-e9eb56cedf43 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:01.223318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-216835bc-8864-4a60-92a7-e9eb56cedf43 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:01.223774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-216835bc-8864-4a60-92a7-e9eb56cedf43 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:01.376813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-216835bc-8864-4a60-92a7-e9eb56cedf43 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:01.390665 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-216835bc-8864-4a60-92a7-e9eb56cedf43 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1316 microversion: 2.1 time: 0.181847 Jul 28 04:42:01.391607 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4776/7226] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:01 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:02.414221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2d28b052-efc2-4908-b1e5-9a6a42ea79ae tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:02.414861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2d28b052-efc2-4908-b1e5-9a6a42ea79ae tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:02.422403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d28b052-efc2-4908-b1e5-9a6a42ea79ae tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:02.422944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d28b052-efc2-4908-b1e5-9a6a42ea79ae tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:02.423739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d28b052-efc2-4908-b1e5-9a6a42ea79ae tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:02.424185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2d28b052-efc2-4908-b1e5-9a6a42ea79ae tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:02.580655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2d28b052-efc2-4908-b1e5-9a6a42ea79ae tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:02.596865 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2d28b052-efc2-4908-b1e5-9a6a42ea79ae tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1316 microversion: 2.1 time: 0.186599 Jul 28 04:42:02.597838 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4777/7227] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:02 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:03.630505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c5a1b525-8c99-4dff-bd46-bbfbe9f14aa5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:03.631183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c5a1b525-8c99-4dff-bd46-bbfbe9f14aa5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:03.638777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5a1b525-8c99-4dff-bd46-bbfbe9f14aa5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:03.639248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5a1b525-8c99-4dff-bd46-bbfbe9f14aa5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:03.640466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5a1b525-8c99-4dff-bd46-bbfbe9f14aa5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:03.640466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5a1b525-8c99-4dff-bd46-bbfbe9f14aa5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:03.773445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c5a1b525-8c99-4dff-bd46-bbfbe9f14aa5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:03.781525 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c5a1b525-8c99-4dff-bd46-bbfbe9f14aa5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1505 microversion: 2.1 time: 0.155140 Jul 28 04:42:03.782112 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4778/7228] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:03 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:03.843671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1627193711", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "1916075e-6c65-4e87-a7c0-8237cb2853e3"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:42:03.898515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] validate_networks() for [('1916075e-6c65-4e87-a7c0-8237cb2853e3', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:42:04.153472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:42:04.285709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:42:04.286170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:42:04.286661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:42:04.287086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:42:04.287545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:42:04.297372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:04.297876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:04.298689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:04.299145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:04.317416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Getting quotas for project 7d448a98140a4f42adf161374aa9a3d9. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:42:04.322856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Getting quotas for user ab99c3d5f7f64869abbaaaed385020f7 and project 7d448a98140a4f42adf161374aa9a3d9. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:42:04.336579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:42:04.338913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:42:04.385480 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fb9979d6-e853-49e8-b8bf-3fd09ce214e6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545836 Jul 28 04:42:04.386198 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4779/7229] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:42:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:42:04.396822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15be4255-a6c7-4b82-8d9a-96ef7caeeb69 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:04.397462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15be4255-a6c7-4b82-8d9a-96ef7caeeb69 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:04.453325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-15be4255-a6c7-4b82-8d9a-96ef7caeeb69 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:04.461344 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15be4255-a6c7-4b82-8d9a-96ef7caeeb69 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 200 len: 1217 microversion: 2.1 time: 0.068313 Jul 28 04:42:04.461905 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4780/7230] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:04 2022] GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:42:05.482541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-82340c9b-4202-4ae1-952c-ffe795c004f8 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:05.483266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-82340c9b-4202-4ae1-952c-ffe795c004f8 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:05.491066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82340c9b-4202-4ae1-952c-ffe795c004f8 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:05.491534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82340c9b-4202-4ae1-952c-ffe795c004f8 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:05.492395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82340c9b-4202-4ae1-952c-ffe795c004f8 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:05.492846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82340c9b-4202-4ae1-952c-ffe795c004f8 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:05.556868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82340c9b-4202-4ae1-952c-ffe795c004f8 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:05.565071 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-82340c9b-4202-4ae1-952c-ffe795c004f8 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 200 len: 1275 microversion: 2.1 time: 0.086755 Jul 28 04:42:05.565892 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4781/7231] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:05 2022] GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:06.586791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a93e0283-72f7-49a5-b24b-de5d05267515 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:06.587522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a93e0283-72f7-49a5-b24b-de5d05267515 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:06.594635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a93e0283-72f7-49a5-b24b-de5d05267515 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:06.595094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a93e0283-72f7-49a5-b24b-de5d05267515 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:06.595899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a93e0283-72f7-49a5-b24b-de5d05267515 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:06.596343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a93e0283-72f7-49a5-b24b-de5d05267515 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:06.734762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a93e0283-72f7-49a5-b24b-de5d05267515 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:06.743252 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a93e0283-72f7-49a5-b24b-de5d05267515 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 200 len: 1317 microversion: 2.1 time: 0.160719 Jul 28 04:42:06.743964 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4782/7232] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:06 2022] GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:07.396672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-8dd760cf-dfc8-47e1-9558-b148aa83cbfa req-8f821b99-22cd-4220-8155-ebf17fbe5f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb89f82-4af5-4913-bf2b-ffec9f967f45", "tag": "3a452cc2-51b1-4f1f-aec4-feac80d7ece5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:42:07.416914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8dd760cf-dfc8-47e1-9558-b148aa83cbfa req-8f821b99-22cd-4220-8155-ebf17fbe5f72 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:07.417988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8dd760cf-dfc8-47e1-9558-b148aa83cbfa req-8f821b99-22cd-4220-8155-ebf17fbe5f72 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:07.434868 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-8dd760cf-dfc8-47e1-9558-b148aa83cbfa req-8f821b99-22cd-4220-8155-ebf17fbe5f72 service nova] Creating event network-changed:3a452cc2-51b1-4f1f-aec4-feac80d7ece5 for instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 on n-h1-826756-3 Jul 28 04:42:07.440619 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-8dd760cf-dfc8-47e1-9558-b148aa83cbfa req-8f821b99-22cd-4220-8155-ebf17fbe5f72 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053136 Jul 28 04:42:07.442086 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4783/7233] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:42:07.765970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-568aadbb-eec2-48f5-b18d-24f08eabcf53 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:07.766655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-568aadbb-eec2-48f5-b18d-24f08eabcf53 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:07.774665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-568aadbb-eec2-48f5-b18d-24f08eabcf53 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:07.775124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-568aadbb-eec2-48f5-b18d-24f08eabcf53 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:07.775892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-568aadbb-eec2-48f5-b18d-24f08eabcf53 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:07.776344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-568aadbb-eec2-48f5-b18d-24f08eabcf53 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:07.912563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-568aadbb-eec2-48f5-b18d-24f08eabcf53 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:07.920871 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-568aadbb-eec2-48f5-b18d-24f08eabcf53 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 200 len: 1317 microversion: 2.1 time: 0.159386 Jul 28 04:42:07.921468 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4784/7234] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:07 2022] GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:08.942381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e6446756-01b3-4a13-b9a0-6675ec712478 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:08.943010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e6446756-01b3-4a13-b9a0-6675ec712478 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:08.950396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6446756-01b3-4a13-b9a0-6675ec712478 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:08.950864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6446756-01b3-4a13-b9a0-6675ec712478 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:08.951655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6446756-01b3-4a13-b9a0-6675ec712478 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:08.952876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6446756-01b3-4a13-b9a0-6675ec712478 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:09.090399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e6446756-01b3-4a13-b9a0-6675ec712478 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:09.099605 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e6446756-01b3-4a13-b9a0-6675ec712478 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 200 len: 1317 microversion: 2.1 time: 0.161350 Jul 28 04:42:09.100408 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4785/7235] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:08 2022] GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:42:10.121734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c85b57f-de21-4af0-aa26-a2b7289ac153 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:10.122411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1c85b57f-de21-4af0-aa26-a2b7289ac153 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:10.130104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c85b57f-de21-4af0-aa26-a2b7289ac153 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:10.130572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c85b57f-de21-4af0-aa26-a2b7289ac153 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:10.131366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c85b57f-de21-4af0-aa26-a2b7289ac153 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:10.131817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1c85b57f-de21-4af0-aa26-a2b7289ac153 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:10.273025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1c85b57f-de21-4af0-aa26-a2b7289ac153 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:10.281063 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c85b57f-de21-4af0-aa26-a2b7289ac153 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 200 len: 1317 microversion: 2.1 time: 0.163581 Jul 28 04:42:10.281647 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4786/7236] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:10 2022] GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:11.302527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-092eba94-99c1-4440-953e-2d84566bf045 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:11.303196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-092eba94-99c1-4440-953e-2d84566bf045 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:11.311870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-092eba94-99c1-4440-953e-2d84566bf045 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:11.312335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-092eba94-99c1-4440-953e-2d84566bf045 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:11.313436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-092eba94-99c1-4440-953e-2d84566bf045 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:11.313914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-092eba94-99c1-4440-953e-2d84566bf045 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:11.447413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-092eba94-99c1-4440-953e-2d84566bf045 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:11.455781 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-092eba94-99c1-4440-953e-2d84566bf045 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 200 len: 1317 microversion: 2.1 time: 0.157453 Jul 28 04:42:11.456407 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4787/7237] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:11 2022] GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:12.425501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6bc1f3b3-1a8e-433d-926a-ca4b4ad0647f req-c24b5d8a-7673-41e3-833f-b17be479b7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb89f82-4af5-4913-bf2b-ffec9f967f45", "name": "network-vif-plugged", "status": "completed", "tag": "3a452cc2-51b1-4f1f-aec4-feac80d7ece5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:42:12.437110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6bc1f3b3-1a8e-433d-926a-ca4b4ad0647f req-c24b5d8a-7673-41e3-833f-b17be479b7c7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:12.437570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6bc1f3b3-1a8e-433d-926a-ca4b4ad0647f req-c24b5d8a-7673-41e3-833f-b17be479b7c7 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:12.449740 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6bc1f3b3-1a8e-433d-926a-ca4b4ad0647f req-c24b5d8a-7673-41e3-833f-b17be479b7c7 service nova] Creating event network-vif-plugged:3a452cc2-51b1-4f1f-aec4-feac80d7ece5 for instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 on n-h1-826756-3 Jul 28 04:42:12.455215 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6bc1f3b3-1a8e-433d-926a-ca4b4ad0647f req-c24b5d8a-7673-41e3-833f-b17be479b7c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033589 Jul 28 04:42:12.455880 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4788/7238] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:42:12.479155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-934cd772-2f3d-489e-b3be-132f6d4008d2 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:12.479905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-934cd772-2f3d-489e-b3be-132f6d4008d2 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:12.487093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-934cd772-2f3d-489e-b3be-132f6d4008d2 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:12.487551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-934cd772-2f3d-489e-b3be-132f6d4008d2 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:12.488366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-934cd772-2f3d-489e-b3be-132f6d4008d2 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:12.488858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-934cd772-2f3d-489e-b3be-132f6d4008d2 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:12.510829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:42:12.634909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-934cd772-2f3d-489e-b3be-132f6d4008d2 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:12.644809 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-934cd772-2f3d-489e-b3be-132f6d4008d2 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 200 len: 1317 microversion: 2.1 time: 0.169873 Jul 28 04:42:12.645429 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4789/7239] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:12 2022] GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:42:13.668152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-759e6317-4c57-4046-9563-7dfc01557e9f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:13.668896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-759e6317-4c57-4046-9563-7dfc01557e9f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:13.676546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-759e6317-4c57-4046-9563-7dfc01557e9f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:13.677009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-759e6317-4c57-4046-9563-7dfc01557e9f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:13.677787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-759e6317-4c57-4046-9563-7dfc01557e9f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:13.678232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-759e6317-4c57-4046-9563-7dfc01557e9f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:13.818429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-759e6317-4c57-4046-9563-7dfc01557e9f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:13.826993 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-759e6317-4c57-4046-9563-7dfc01557e9f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 200 len: 1317 microversion: 2.1 time: 0.163297 Jul 28 04:42:13.827584 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4790/7240] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:13 2022] GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:14.851083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-196a8b5d-7746-4c7a-9ba6-1f2500291c84 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:14.851774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-196a8b5d-7746-4c7a-9ba6-1f2500291c84 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:14.853639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:42:14.854350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=16 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:42:14.861591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-196a8b5d-7746-4c7a-9ba6-1f2500291c84 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:14.862051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-196a8b5d-7746-4c7a-9ba6-1f2500291c84 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:14.862826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-196a8b5d-7746-4c7a-9ba6-1f2500291c84 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:14.863271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-196a8b5d-7746-4c7a-9ba6-1f2500291c84 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:15.002401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-196a8b5d-7746-4c7a-9ba6-1f2500291c84 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:15.012482 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-196a8b5d-7746-4c7a-9ba6-1f2500291c84 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 200 len: 1506 microversion: 2.1 time: 0.166561 Jul 28 04:42:15.013050 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4791/7241] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:14 2022] GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:15.034908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dfe3b596-53e1-4332-b3c4-c6e9645a4bf6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:15.035344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dfe3b596-53e1-4332-b3c4-c6e9645a4bf6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:15.041764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfe3b596-53e1-4332-b3c4-c6e9645a4bf6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:15.042328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfe3b596-53e1-4332-b3c4-c6e9645a4bf6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:15.043133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfe3b596-53e1-4332-b3c4-c6e9645a4bf6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:15.043586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfe3b596-53e1-4332-b3c4-c6e9645a4bf6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:15.071101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dfe3b596-53e1-4332-b3c4-c6e9645a4bf6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:42:15.160618 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dfe3b596-53e1-4332-b3c4-c6e9645a4bf6 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 204 len: 0 microversion: 2.1 time: 0.128961 Jul 28 04:42:15.161483 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4792/7242] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:42:15 2022] DELETE /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:42:15.171360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0ef94e0d-1c82-4d91-937d-fd2197d1d573 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:15.172091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0ef94e0d-1c82-4d91-937d-fd2197d1d573 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:15.179168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ef94e0d-1c82-4d91-937d-fd2197d1d573 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:15.179628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ef94e0d-1c82-4d91-937d-fd2197d1d573 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:15.180478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ef94e0d-1c82-4d91-937d-fd2197d1d573 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:15.180928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0ef94e0d-1c82-4d91-937d-fd2197d1d573 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:15.322359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0ef94e0d-1c82-4d91-937d-fd2197d1d573 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:15.330860 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0ef94e0d-1c82-4d91-937d-fd2197d1d573 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 200 len: 1512 microversion: 2.1 time: 0.163748 Jul 28 04:42:15.331485 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4793/7243] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:15 2022] GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:16.354635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-60ea8dd6-70a7-4095-aefe-4192a1bf29a0 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:16.355290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-60ea8dd6-70a7-4095-aefe-4192a1bf29a0 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:16.363404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60ea8dd6-70a7-4095-aefe-4192a1bf29a0 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:16.363893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60ea8dd6-70a7-4095-aefe-4192a1bf29a0 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:16.364713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60ea8dd6-70a7-4095-aefe-4192a1bf29a0 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:16.365212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-60ea8dd6-70a7-4095-aefe-4192a1bf29a0 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:16.499227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-60ea8dd6-70a7-4095-aefe-4192a1bf29a0 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:16.507722 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-60ea8dd6-70a7-4095-aefe-4192a1bf29a0 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 200 len: 1512 microversion: 2.1 time: 0.157243 Jul 28 04:42:16.508341 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4794/7244] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:16 2022] GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:16.943341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-72f8a2b9-fdde-4860-aa3b-55a4e2b74e13 req-05a243d3-8e7b-4fff-932d-d18fd73fcdef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb89f82-4af5-4913-bf2b-ffec9f967f45", "name": "network-vif-deleted", "tag": "3a452cc2-51b1-4f1f-aec4-feac80d7ece5"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:42:16.963953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-72f8a2b9-fdde-4860-aa3b-55a4e2b74e13 req-05a243d3-8e7b-4fff-932d-d18fd73fcdef service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:16.964574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-72f8a2b9-fdde-4860-aa3b-55a4e2b74e13 req-05a243d3-8e7b-4fff-932d-d18fd73fcdef service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:16.980156 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-72f8a2b9-fdde-4860-aa3b-55a4e2b74e13 req-05a243d3-8e7b-4fff-932d-d18fd73fcdef service nova] Creating event network-vif-deleted:3a452cc2-51b1-4f1f-aec4-feac80d7ece5 for instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 on n-h1-826756-3 Jul 28 04:42:16.990916 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-72f8a2b9-fdde-4860-aa3b-55a4e2b74e13 req-05a243d3-8e7b-4fff-932d-d18fd73fcdef service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055523 Jul 28 04:42:16.998625 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4795/7245] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:42:17.532469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f77c560-4856-48dc-ada7-790d3a5b30fc tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:17.533438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f77c560-4856-48dc-ada7-790d3a5b30fc tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:17.542675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f77c560-4856-48dc-ada7-790d3a5b30fc tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:17.543142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f77c560-4856-48dc-ada7-790d3a5b30fc tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:17.543926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f77c560-4856-48dc-ada7-790d3a5b30fc tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:17.544389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f77c560-4856-48dc-ada7-790d3a5b30fc tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:17.558224 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-5f77c560-4856-48dc-ada7-790d3a5b30fc tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] HTTP exception thrown: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f77c560-4856-48dc-ada7-790d3a5b30fc tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Request method failure captured: Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 HTTP/1.1 Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hOROgw8_ojgOJtkvy7bCtSROx9di688yJb4GbxlFNTJBbSKHw9kwQPlaDm1TihtTc2KN1VOA-dR1sKy5llIfYkGmjHxIq3fbhsk_lE_8HdXdsQFsrRLFCtHORd_R1C4iBI01AuLpJwnl14elaa-tWZRC_6oHIZyqBZMzHF_mnPqTa8 Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7d448a98140a4f42adf161374aa9a3d9 Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d448a98140a4f42adf161374aa9a3d9"}]}] Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7d448a98140a4f42adf161374aa9a3d9 Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-598828943-project Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ab99c3d5f7f64869abbaaaed385020f7 Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-598828943-project Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '5bb89f82-4af5-4913-bf2b-ffec9f967f45'} Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:42:17.559920 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:17.564373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:17.564373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:42:17.564373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:42:17.564373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:42:17.564373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:42:17.564373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:17.564373 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:17.564373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f77c560-4856-48dc-ada7-790d3a5b30fc tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Returning 404 to user: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:42:17.564373 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f77c560-4856-48dc-ada7-790d3a5b30fc tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 404 len: 111 microversion: 2.1 time: 0.035470 Jul 28 04:42:17.564373 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4796/7246] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:17 2022] GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:42:17.570225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ccee1871-804e-4406-8eb5-381d242ee175 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:17.570851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ccee1871-804e-4406-8eb5-381d242ee175 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:17.576803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccee1871-804e-4406-8eb5-381d242ee175 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:17.577260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccee1871-804e-4406-8eb5-381d242ee175 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:17.578027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccee1871-804e-4406-8eb5-381d242ee175 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:17.578474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ccee1871-804e-4406-8eb5-381d242ee175 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:17.732052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ccee1871-804e-4406-8eb5-381d242ee175 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:17.740027 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ccee1871-804e-4406-8eb5-381d242ee175 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1505 microversion: 2.1 time: 0.173433 Jul 28 04:42:17.740642 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4797/7247] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:17 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:42:17.763797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf49f237-40ab-4552-911e-5b59070c0f41 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:42:17.766142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cf49f237-40ab-4552-911e-5b59070c0f41 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 075b8330-f8c9-4c9d-bddd-f470622ee085] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:17.771831 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-cf49f237-40ab-4552-911e-5b59070c0f41 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] HTTP exception thrown: Instance 075b8330-f8c9-4c9d-bddd-f470622ee085 could not be found. Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf49f237-40ab-4552-911e-5b59070c0f41 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Request method failure captured: Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/075b8330-f8c9-4c9d-bddd-f470622ee085/action HTTP/1.1 Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 32 Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hOROgw8_ojgOJtkvy7bCtSROx9di688yJb4GbxlFNTJBbSKHw9kwQPlaDm1TihtTc2KN1VOA-dR1sKy5llIfYkGmjHxIq3fbhsk_lE_8HdXdsQFsrRLFCtHORd_R1C4iBI01AuLpJwnl14elaa-tWZRC_6oHIZyqBZMzHF_mnPqTa8 Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7d448a98140a4f42adf161374aa9a3d9 Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d448a98140a4f42adf161374aa9a3d9"}]}] Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7d448a98140a4f42adf161374aa9a3d9 Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-598828943-project Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ab99c3d5f7f64869abbaaaed385020f7 Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-598828943-project Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: {"resize": {"flavorRef": "452"}} Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 075b8330-f8c9-4c9d-bddd-f470622ee085 could not be found. Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '075b8330-f8c9-4c9d-bddd-f470622ee085', 'body': {'resize': {'flavorRef': '452'}}} Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 075b8330-f8c9-4c9d-bddd-f470622ee085 could not be found. Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:42:17.773438 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:42:17.778167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 075b8330-f8c9-4c9d-bddd-f470622ee085 could not be found. Jul 28 04:42:17.778167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:17.778167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:42:17.778167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:17.778167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:17.778167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:42:17.778167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:42:17.778167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:42:17.778167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:42:17.778167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 075b8330-f8c9-4c9d-bddd-f470622ee085 could not be found. Jul 28 04:42:17.778167 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:17.778167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf49f237-40ab-4552-911e-5b59070c0f41 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Returning 404 to user: Instance 075b8330-f8c9-4c9d-bddd-f470622ee085 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:42:17.778167 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf49f237-40ab-4552-911e-5b59070c0f41 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "POST /compute/v2.1/servers/075b8330-f8c9-4c9d-bddd-f470622ee085/action" status: 404 len: 111 microversion: 2.1 time: 0.014870 Jul 28 04:42:17.778167 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4798/7248] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:42:17 2022] POST /compute/v2.1/servers/075b8330-f8c9-4c9d-bddd-f470622ee085/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:42:17.783574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5093d7d3-ece3-425b-8a87-6376da932c1f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:17.784937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5093d7d3-ece3-425b-8a87-6376da932c1f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:17.793305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5093d7d3-ece3-425b-8a87-6376da932c1f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:17.793798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5093d7d3-ece3-425b-8a87-6376da932c1f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:17.794582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5093d7d3-ece3-425b-8a87-6376da932c1f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:17.795035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5093d7d3-ece3-425b-8a87-6376da932c1f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:17.931786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5093d7d3-ece3-425b-8a87-6376da932c1f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:17.940189 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5093d7d3-ece3-425b-8a87-6376da932c1f tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1505 microversion: 2.1 time: 0.160294 Jul 28 04:42:17.940779 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4799/7249] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:17 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:42:17.973876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a8201616-c35f-46d5-83b6-33f35c6232ca tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:17.974956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a8201616-c35f-46d5-83b6-33f35c6232ca tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:17.981261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8201616-c35f-46d5-83b6-33f35c6232ca tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:17.981830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8201616-c35f-46d5-83b6-33f35c6232ca tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:17.982556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8201616-c35f-46d5-83b6-33f35c6232ca tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:17.982924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8201616-c35f-46d5-83b6-33f35c6232ca tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.117506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a8201616-c35f-46d5-83b6-33f35c6232ca tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:18.125187 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a8201616-c35f-46d5-83b6-33f35c6232ca tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1505 microversion: 2.1 time: 0.160936 Jul 28 04:42:18.125792 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4800/7250] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:17 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:42:18.146789 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94e1dbfa-4dcf-4849-92e1-82c770623f7b tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "72cc4325-e7fd-47d0-97f7-166c53d48cc7"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:42:18.149253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-94e1dbfa-4dcf-4849-92e1-82c770623f7b tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:18.155716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94e1dbfa-4dcf-4849-92e1-82c770623f7b tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.156192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94e1dbfa-4dcf-4849-92e1-82c770623f7b tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.157101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94e1dbfa-4dcf-4849-92e1-82c770623f7b tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.157567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94e1dbfa-4dcf-4849-92e1-82c770623f7b tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.186650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-94e1dbfa-4dcf-4849-92e1-82c770623f7b tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:18.192558 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-94e1dbfa-4dcf-4849-92e1-82c770623f7b tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] HTTP exception thrown: Flavor 72cc4325-e7fd-47d0-97f7-166c53d48cc7 could not be found. Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94e1dbfa-4dcf-4849-92e1-82c770623f7b tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Request method failure captured: Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2/action HTTP/1.1 Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 65 Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hOROgw8_ojgOJtkvy7bCtSROx9di688yJb4GbxlFNTJBbSKHw9kwQPlaDm1TihtTc2KN1VOA-dR1sKy5llIfYkGmjHxIq3fbhsk_lE_8HdXdsQFsrRLFCtHORd_R1C4iBI01AuLpJwnl14elaa-tWZRC_6oHIZyqBZMzHF_mnPqTa8 Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7d448a98140a4f42adf161374aa9a3d9 Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d448a98140a4f42adf161374aa9a3d9"}]}] Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7d448a98140a4f42adf161374aa9a3d9 Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-598828943-project Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ab99c3d5f7f64869abbaaaed385020f7 Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-598828943-project Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: {"resize": {"flavorRef": "72cc4325-e7fd-47d0-97f7-166c53d48cc7"}} Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: exception: Flavor 72cc4325-e7fd-47d0-97f7-166c53d48cc7 could not be found. Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '5153d8b4-8d10-4981-b215-21604a5970f2', 'body': {'resize': {'flavorRef': '72cc4325-e7fd-47d0-97f7-166c53d48cc7'}}} Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 376, in inner Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 361, in wrapper Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 297, in inner Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 344, in wrapper Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 229, in wrapped Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 04:42:18.194446 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 72cc4325-e7fd-47d0-97f7-166c53d48cc7 could not be found. Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 72cc4325-e7fd-47d0-97f7-166c53d48cc7 could not be found. Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 72cc4325-e7fd-47d0-97f7-166c53d48cc7 could not be found. Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94e1dbfa-4dcf-4849-92e1-82c770623f7b tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Returning 400 to user: Flavor 72cc4325-e7fd-47d0-97f7-166c53d48cc7 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-94e1dbfa-4dcf-4849-92e1-82c770623f7b tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "POST /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2/action" status: 400 len: 107 microversion: 2.1 time: 0.053116 Jul 28 04:42:18.198149 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4801/7251] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:42:18 2022] POST /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:42:18.204648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-162f6107-3f5a-4f76-855d-1ad7d08e87c9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:18.205279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-162f6107-3f5a-4f76-855d-1ad7d08e87c9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:18.213019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-162f6107-3f5a-4f76-855d-1ad7d08e87c9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.213489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-162f6107-3f5a-4f76-855d-1ad7d08e87c9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.214271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-162f6107-3f5a-4f76-855d-1ad7d08e87c9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.214723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-162f6107-3f5a-4f76-855d-1ad7d08e87c9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.352790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-162f6107-3f5a-4f76-855d-1ad7d08e87c9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:18.361089 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-162f6107-3f5a-4f76-855d-1ad7d08e87c9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1505 microversion: 2.1 time: 0.160048 Jul 28 04:42:18.361662 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4802/7252] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:18 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:42:18.382811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-65ed6fe3-fd67-4ee4-829c-b642593d8253 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:18.383467 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-65ed6fe3-fd67-4ee4-829c-b642593d8253 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:18.389916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65ed6fe3-fd67-4ee4-829c-b642593d8253 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.390382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65ed6fe3-fd67-4ee4-829c-b642593d8253 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.391170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65ed6fe3-fd67-4ee4-829c-b642593d8253 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.391627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65ed6fe3-fd67-4ee4-829c-b642593d8253 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.530687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-65ed6fe3-fd67-4ee4-829c-b642593d8253 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:18.539730 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-65ed6fe3-fd67-4ee4-829c-b642593d8253 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1505 microversion: 2.1 time: 0.161048 Jul 28 04:42:18.540332 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4803/7253] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:18 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:18.560891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df9f39c1-27c1-4b67-9e3d-6ef4d0a31d49 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df9f39c1-27c1-4b67-9e3d-6ef4d0a31d49 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Request method failure captured: Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: request: POST /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2/action HTTP/1.1 Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 29 Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hOROgw8_ojgOJtkvy7bCtSROx9di688yJb4GbxlFNTJBbSKHw9kwQPlaDm1TihtTc2KN1VOA-dR1sKy5llIfYkGmjHxIq3fbhsk_lE_8HdXdsQFsrRLFCtHORd_R1C4iBI01AuLpJwnl14elaa-tWZRC_6oHIZyqBZMzHF_mnPqTa8 Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7d448a98140a4f42adf161374aa9a3d9 Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d448a98140a4f42adf161374aa9a3d9"}]}] Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7d448a98140a4f42adf161374aa9a3d9 Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-598828943-project Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ab99c3d5f7f64869abbaaaed385020f7 Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-598828943-project Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: {"resize": {"flavorRef": ""}} Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '5153d8b4-8d10-4981-b215-21604a5970f2', 'body': {'resize': {'flavorRef': ''}}} Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise error Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi '' Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.570307 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:42:18.574918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.574918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:18.574918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:42:18.574918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:42:18.574918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 04:42:18.574918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 04:42:18.574918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 28 04:42:18.574918 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.574918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df9f39c1-27c1-4b67-9e3d-6ef4d0a31d49 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:42:18.574918 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-df9f39c1-27c1-4b67-9e3d-6ef4d0a31d49 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "POST /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2/action" status: 400 len: 113 microversion: 2.1 time: 0.015029 Jul 28 04:42:18.574918 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4804/7254] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:42:18 2022] POST /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2/action => generated 113 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:42:18.579870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-181ef7ad-773f-441a-b89d-f9ac904604d1 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:18.580534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-181ef7ad-773f-441a-b89d-f9ac904604d1 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:18.590178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-181ef7ad-773f-441a-b89d-f9ac904604d1 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.590646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-181ef7ad-773f-441a-b89d-f9ac904604d1 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.591428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-181ef7ad-773f-441a-b89d-f9ac904604d1 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.591877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-181ef7ad-773f-441a-b89d-f9ac904604d1 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.736523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-181ef7ad-773f-441a-b89d-f9ac904604d1 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:18.744598 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-181ef7ad-773f-441a-b89d-f9ac904604d1 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1505 microversion: 2.1 time: 0.168155 Jul 28 04:42:18.745230 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4805/7255] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:18 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:18.768373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-accbd617-476d-402c-b67c-84726e1dbb99 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:18.768895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-accbd617-476d-402c-b67c-84726e1dbb99 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:18.775728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-accbd617-476d-402c-b67c-84726e1dbb99 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.776192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-accbd617-476d-402c-b67c-84726e1dbb99 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.777086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-accbd617-476d-402c-b67c-84726e1dbb99 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.777532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-accbd617-476d-402c-b67c-84726e1dbb99 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.791360 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-accbd617-476d-402c-b67c-84726e1dbb99 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] HTTP exception thrown: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-accbd617-476d-402c-b67c-84726e1dbb99 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Request method failure captured: Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 HTTP/1.1 Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hOROgw8_ojgOJtkvy7bCtSROx9di688yJb4GbxlFNTJBbSKHw9kwQPlaDm1TihtTc2KN1VOA-dR1sKy5llIfYkGmjHxIq3fbhsk_lE_8HdXdsQFsrRLFCtHORd_R1C4iBI01AuLpJwnl14elaa-tWZRC_6oHIZyqBZMzHF_mnPqTa8 Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7d448a98140a4f42adf161374aa9a3d9 Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d448a98140a4f42adf161374aa9a3d9"}]}] Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7d448a98140a4f42adf161374aa9a3d9 Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-598828943-project Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ab99c3d5f7f64869abbaaaed385020f7 Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-598828943-project Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '5bb89f82-4af5-4913-bf2b-ffec9f967f45'} Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:42:18.793054 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:42:18.796479 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:18.796479 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.796479 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:42:18.796479 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.796479 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:18.796479 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:42:18.796479 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:42:18.796479 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:42:18.796479 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:42:18.796479 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:18.796479 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.796479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-accbd617-476d-402c-b67c-84726e1dbb99 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Returning 404 to user: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:42:18.796479 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-accbd617-476d-402c-b67c-84726e1dbb99 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 404 len: 111 microversion: 2.1 time: 0.030024 Jul 28 04:42:18.796479 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4806/7256] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:42:18 2022] DELETE /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:42:18.802711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3f610511-14e3-48e6-9ada-d12198337bd4 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:18.803770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3f610511-14e3-48e6-9ada-d12198337bd4 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5bb89f82-4af5-4913-bf2b-ffec9f967f45] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:18.810461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f610511-14e3-48e6-9ada-d12198337bd4 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.810921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f610511-14e3-48e6-9ada-d12198337bd4 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.811692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f610511-14e3-48e6-9ada-d12198337bd4 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.812136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3f610511-14e3-48e6-9ada-d12198337bd4 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.825894 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-3f610511-14e3-48e6-9ada-d12198337bd4 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] HTTP exception thrown: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3f610511-14e3-48e6-9ada-d12198337bd4 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Request method failure captured: Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 HTTP/1.1 Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hOROgw8_ojgOJtkvy7bCtSROx9di688yJb4GbxlFNTJBbSKHw9kwQPlaDm1TihtTc2KN1VOA-dR1sKy5llIfYkGmjHxIq3fbhsk_lE_8HdXdsQFsrRLFCtHORd_R1C4iBI01AuLpJwnl14elaa-tWZRC_6oHIZyqBZMzHF_mnPqTa8 Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7d448a98140a4f42adf161374aa9a3d9 Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d448a98140a4f42adf161374aa9a3d9"}]}] Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7d448a98140a4f42adf161374aa9a3d9 Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-598828943-project Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ab99c3d5f7f64869abbaaaed385020f7 Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-598828943-project Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '5bb89f82-4af5-4913-bf2b-ffec9f967f45'} Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:42:18.827452 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.831260 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:18.831260 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:42:18.831260 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:42:18.831260 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:42:18.831260 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:42:18.831260 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. Jul 28 04:42:18.831260 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:18.831260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3f610511-14e3-48e6-9ada-d12198337bd4 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Returning 404 to user: Instance 5bb89f82-4af5-4913-bf2b-ffec9f967f45 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:42:18.831260 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3f610511-14e3-48e6-9ada-d12198337bd4 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45" status: 404 len: 111 microversion: 2.1 time: 0.029736 Jul 28 04:42:18.831260 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4807/7257] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:18 2022] GET /compute/v2.1/servers/5bb89f82-4af5-4913-bf2b-ffec9f967f45 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:42:18.837516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-39a82823-a804-41b1-9d17-f62247f042e5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:18.838019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-39a82823-a804-41b1-9d17-f62247f042e5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:18.844752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39a82823-a804-41b1-9d17-f62247f042e5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.845206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39a82823-a804-41b1-9d17-f62247f042e5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.845966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39a82823-a804-41b1-9d17-f62247f042e5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.846422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39a82823-a804-41b1-9d17-f62247f042e5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.873534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-39a82823-a804-41b1-9d17-f62247f042e5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:42:18.903787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:42:18.958755 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-39a82823-a804-41b1-9d17-f62247f042e5 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 204 len: 0 microversion: 2.1 time: 0.124608 Jul 28 04:42:18.959250 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4808/7258] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:42:18 2022] DELETE /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:42:18.967811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ff8a97eb-eb78-4970-904c-b11472190ec3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:18.968524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ff8a97eb-eb78-4970-904c-b11472190ec3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:18.975160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff8a97eb-eb78-4970-904c-b11472190ec3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.975605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff8a97eb-eb78-4970-904c-b11472190ec3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:18.976409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff8a97eb-eb78-4970-904c-b11472190ec3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:18.976855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ff8a97eb-eb78-4970-904c-b11472190ec3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:19.123668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ff8a97eb-eb78-4970-904c-b11472190ec3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:19.132287 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ff8a97eb-eb78-4970-904c-b11472190ec3 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1511 microversion: 2.1 time: 0.168568 Jul 28 04:42:19.132909 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4809/7259] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:18 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:42:20.154303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7e18a4ed-8eda-461e-aa08-3fe929a3b7f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:20.154988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7e18a4ed-8eda-461e-aa08-3fe929a3b7f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:20.162600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e18a4ed-8eda-461e-aa08-3fe929a3b7f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:20.163041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e18a4ed-8eda-461e-aa08-3fe929a3b7f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:20.163846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e18a4ed-8eda-461e-aa08-3fe929a3b7f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:20.164300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e18a4ed-8eda-461e-aa08-3fe929a3b7f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:20.328820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7e18a4ed-8eda-461e-aa08-3fe929a3b7f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:20.337389 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7e18a4ed-8eda-461e-aa08-3fe929a3b7f9 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1511 microversion: 2.1 time: 0.187150 Jul 28 04:42:20.337991 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4810/7260] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:20 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:21.359172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bbc81a3a-be68-489d-9f7e-8427621c398c tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:21.359825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bbc81a3a-be68-489d-9f7e-8427621c398c tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:21.363072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:42:21.369431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbc81a3a-be68-489d-9f7e-8427621c398c tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:21.369904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbc81a3a-be68-489d-9f7e-8427621c398c tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:21.370776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbc81a3a-be68-489d-9f7e-8427621c398c tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:21.371233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bbc81a3a-be68-489d-9f7e-8427621c398c tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:21.510934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bbc81a3a-be68-489d-9f7e-8427621c398c tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab99c3d5f7f64869abbaaaed385020f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d448a98140a4f42adf161374aa9a3d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:21.519789 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bbc81a3a-be68-489d-9f7e-8427621c398c tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 200 len: 1511 microversion: 2.1 time: 0.164822 Jul 28 04:42:21.520764 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4811/7261] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:21 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:21.630422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-ab1255d4-e453-49fb-a94a-497d8446b1b4 req-4e833d2c-ff7b-4bae-af8d-6647029dfeee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5153d8b4-8d10-4981-b215-21604a5970f2", "name": "network-vif-deleted", "tag": "66aa5dd6-748c-4634-aab0-4f5fab04a43d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:42:21.640820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ab1255d4-e453-49fb-a94a-497d8446b1b4 req-4e833d2c-ff7b-4bae-af8d-6647029dfeee service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:21.641288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ab1255d4-e453-49fb-a94a-497d8446b1b4 req-4e833d2c-ff7b-4bae-af8d-6647029dfeee service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:21.654649 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-ab1255d4-e453-49fb-a94a-497d8446b1b4 req-4e833d2c-ff7b-4bae-af8d-6647029dfeee service nova] Creating event network-vif-deleted:66aa5dd6-748c-4634-aab0-4f5fab04a43d for instance 5153d8b4-8d10-4981-b215-21604a5970f2 on n-h2-826756-3 Jul 28 04:42:21.659574 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-ab1255d4-e453-49fb-a94a-497d8446b1b4 req-4e833d2c-ff7b-4bae-af8d-6647029dfeee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033104 Jul 28 04:42:21.660598 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4812/7262] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:42:22.548237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6a2a033f-b664-40c2-981a-c1e545db5a22 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:22.549407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6a2a033f-b664-40c2-981a-c1e545db5a22 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] [instance: 5153d8b4-8d10-4981-b215-21604a5970f2] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:22.559494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a2a033f-b664-40c2-981a-c1e545db5a22 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:22.559950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a2a033f-b664-40c2-981a-c1e545db5a22 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:22.560755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a2a033f-b664-40c2-981a-c1e545db5a22 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:22.561205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a2a033f-b664-40c2-981a-c1e545db5a22 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:22.575147 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-6a2a033f-b664-40c2-981a-c1e545db5a22 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] HTTP exception thrown: Instance 5153d8b4-8d10-4981-b215-21604a5970f2 could not be found. Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6a2a033f-b664-40c2-981a-c1e545db5a22 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Request method failure captured: Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 HTTP/1.1 Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hOROgw8_ojgOJtkvy7bCtSROx9di688yJb4GbxlFNTJBbSKHw9kwQPlaDm1TihtTc2KN1VOA-dR1sKy5llIfYkGmjHxIq3fbhsk_lE_8HdXdsQFsrRLFCtHORd_R1C4iBI01AuLpJwnl14elaa-tWZRC_6oHIZyqBZMzHF_mnPqTa8 Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7d448a98140a4f42adf161374aa9a3d9 Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7d448a98140a4f42adf161374aa9a3d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7d448a98140a4f42adf161374aa9a3d9"}]}] Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7d448a98140a4f42adf161374aa9a3d9 Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-ServersNegativeTestJSON-598828943 Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-ServersNegativeTestJSON-598828943-project Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: ab99c3d5f7f64869abbaaaed385020f7 Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-ServersNegativeTestJSON-598828943-project Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 5153d8b4-8d10-4981-b215-21604a5970f2 could not be found. Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '5153d8b4-8d10-4981-b215-21604a5970f2'} Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5153d8b4-8d10-4981-b215-21604a5970f2 could not be found. Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5153d8b4-8d10-4981-b215-21604a5970f2 could not be found. Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:42:22.576838 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:22.580754 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:42:22.580754 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:42:22.580754 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:42:22.580754 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:42:22.580754 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:42:22.580754 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5153d8b4-8d10-4981-b215-21604a5970f2 could not be found. Jul 28 04:42:22.580754 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:42:22.580754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6a2a033f-b664-40c2-981a-c1e545db5a22 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] Returning 404 to user: Instance 5153d8b4-8d10-4981-b215-21604a5970f2 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:42:22.580754 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6a2a033f-b664-40c2-981a-c1e545db5a22 tempest-ServersNegativeTestJSON-598828943 tempest-ServersNegativeTestJSON-598828943-project] 10.222.0.48 "GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2" status: 404 len: 111 microversion: 2.1 time: 0.038960 Jul 28 04:42:22.580754 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4813/7263] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:22 2022] GET /compute/v2.1/servers/5153d8b4-8d10-4981-b215-21604a5970f2 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:42:54.027955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=5 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:42:54.029268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:42:54.206108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7ff2e349-2c3f-468c-aadf-e8705155e324 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Action: 'create', calling method: .version_select at 0x7ffa66e44af0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-432606668", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbGEVQqtgkaaMDWGtAKaDi7FRfIUQ0Wlfjl/u1IZCXvhtTbAn2zMmM4xNejQTTvnC1/FHsYv87DAgmB5jF3A5NM3IhIE8HbAjWk6hjoWu2XEuIPtVHH5tXRyQ1F6kq0Gg=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:42:54.222679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7ff2e349-2c3f-468c-aadf-e8705155e324 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Getting quotas for project e2f8cdeb2de043118a8e5d5eb06dc092. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:42:54.228212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-7ff2e349-2c3f-468c-aadf-e8705155e324 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Getting quotas for user 30cf2e3582d640679467e0430b46a749 and project e2f8cdeb2de043118a8e5d5eb06dc092. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:42:54.254168 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7ff2e349-2c3f-468c-aadf-e8705155e324 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.232026 Jul 28 04:42:54.254655 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4814/7264] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:42:54 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:42:54.306393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1787091875", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-432606668", "networks": [{"uuid": "4d888961-bfac-4bc8-8f5b-e43d5a9daefe"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:42:54.363140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] validate_networks() for [('4d888961-bfac-4bc8-8f5b-e43d5a9daefe', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:42:54.761079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:42:54.761513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:42:54.761995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:42:54.762411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:42:54.762831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:42:54.773189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:54.773659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:54.774473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:54.775107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:54.792201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Getting quotas for project e2f8cdeb2de043118a8e5d5eb06dc092. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:42:54.797882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Getting quotas for user 30cf2e3582d640679467e0430b46a749 and project e2f8cdeb2de043118a8e5d5eb06dc092. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:42:54.810265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:42:54.812810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:42:54.862706 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b4ea229c-cc70-4726-9e3d-5fe140a7998d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560402 Jul 28 04:42:54.863602 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4815/7265] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:42:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:42:54.874043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d7bbaaad-0e26-4f38-aa54-740032e85eab tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:54.874680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d7bbaaad-0e26-4f38-aa54-740032e85eab tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:54.932651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d7bbaaad-0e26-4f38-aa54-740032e85eab tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:54.939923 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d7bbaaad-0e26-4f38-aa54-740032e85eab tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 200 len: 1262 microversion: 2.1 time: 0.069670 Jul 28 04:42:54.940488 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4816/7266] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:54 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:42:55.961269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd875f8e-4876-4e41-be0c-d2a48f43d713 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:55.961909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dd875f8e-4876-4e41-be0c-d2a48f43d713 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:55.971548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd875f8e-4876-4e41-be0c-d2a48f43d713 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:55.972687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd875f8e-4876-4e41-be0c-d2a48f43d713 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:55.973687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd875f8e-4876-4e41-be0c-d2a48f43d713 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:55.974327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dd875f8e-4876-4e41-be0c-d2a48f43d713 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:56.055018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dd875f8e-4876-4e41-be0c-d2a48f43d713 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:56.063450 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd875f8e-4876-4e41-be0c-d2a48f43d713 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 200 len: 1332 microversion: 2.1 time: 0.106040 Jul 28 04:42:56.064710 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4817/7267] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:55 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:42:57.089619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c068f12-24c7-4e14-a392-855b7555ca78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:57.093141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c068f12-24c7-4e14-a392-855b7555ca78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:57.115628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c068f12-24c7-4e14-a392-855b7555ca78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:57.116456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c068f12-24c7-4e14-a392-855b7555ca78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:57.117519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c068f12-24c7-4e14-a392-855b7555ca78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:57.118238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c068f12-24c7-4e14-a392-855b7555ca78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:57.353553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c068f12-24c7-4e14-a392-855b7555ca78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:57.369796 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c068f12-24c7-4e14-a392-855b7555ca78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 200 len: 1362 microversion: 2.1 time: 0.288146 Jul 28 04:42:57.370837 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4818/7268] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:57 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:57.422005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-fdc49feb-3d40-4d2c-b732-9eece56ba273 req-1a0b1ff1-8297-4201-a766-9690f8fd92c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92", "tag": "aa07f0cf-abc5-45b6-adba-523a81feaf26"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:42:57.438741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fdc49feb-3d40-4d2c-b732-9eece56ba273 req-1a0b1ff1-8297-4201-a766-9690f8fd92c6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:57.439417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fdc49feb-3d40-4d2c-b732-9eece56ba273 req-1a0b1ff1-8297-4201-a766-9690f8fd92c6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:57.461143 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-fdc49feb-3d40-4d2c-b732-9eece56ba273 req-1a0b1ff1-8297-4201-a766-9690f8fd92c6 service nova] Creating event network-changed:aa07f0cf-abc5-45b6-adba-523a81feaf26 for instance d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 on n-h1-826756-3 Jul 28 04:42:57.478509 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-fdc49feb-3d40-4d2c-b732-9eece56ba273 req-1a0b1ff1-8297-4201-a766-9690f8fd92c6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061833 Jul 28 04:42:57.479656 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4819/7269] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:42:58.401510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b925019-4e99-4334-94cc-a1e30cffeb2a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:58.402536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3b925019-4e99-4334-94cc-a1e30cffeb2a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:58.410420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b925019-4e99-4334-94cc-a1e30cffeb2a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:58.410881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b925019-4e99-4334-94cc-a1e30cffeb2a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:58.411666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b925019-4e99-4334-94cc-a1e30cffeb2a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:58.412117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b925019-4e99-4334-94cc-a1e30cffeb2a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:58.561630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3b925019-4e99-4334-94cc-a1e30cffeb2a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:58.573853 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3b925019-4e99-4334-94cc-a1e30cffeb2a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 200 len: 1362 microversion: 2.1 time: 0.180927 Jul 28 04:42:58.574702 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4820/7270] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:58 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:42:59.596540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6cbba46b-8490-4e75-9e54-ad57e3217d2b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:42:59.597549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6cbba46b-8490-4e75-9e54-ad57e3217d2b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:42:59.605079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cbba46b-8490-4e75-9e54-ad57e3217d2b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:59.605586 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cbba46b-8490-4e75-9e54-ad57e3217d2b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:59.606365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cbba46b-8490-4e75-9e54-ad57e3217d2b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:42:59.606849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cbba46b-8490-4e75-9e54-ad57e3217d2b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:42:59.751811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6cbba46b-8490-4e75-9e54-ad57e3217d2b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:42:59.760928 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6cbba46b-8490-4e75-9e54-ad57e3217d2b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 200 len: 1362 microversion: 2.1 time: 0.168139 Jul 28 04:42:59.761631 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4821/7271] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:42:59 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:00.782723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a2c1327e-07dc-4adf-b9c0-cf87a1510250 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:00.783422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a2c1327e-07dc-4adf-b9c0-cf87a1510250 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:00.790899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2c1327e-07dc-4adf-b9c0-cf87a1510250 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:00.791353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2c1327e-07dc-4adf-b9c0-cf87a1510250 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:00.792140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2c1327e-07dc-4adf-b9c0-cf87a1510250 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:00.792631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2c1327e-07dc-4adf-b9c0-cf87a1510250 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:00.933329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a2c1327e-07dc-4adf-b9c0-cf87a1510250 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:00.942659 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a2c1327e-07dc-4adf-b9c0-cf87a1510250 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 200 len: 1362 microversion: 2.1 time: 0.163881 Jul 28 04:43:00.943376 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4822/7272] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:00 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:01.964047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-62248358-a00b-456a-9ecf-208f16e1995b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:01.964758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-62248358-a00b-456a-9ecf-208f16e1995b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:01.972582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62248358-a00b-456a-9ecf-208f16e1995b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:01.973041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62248358-a00b-456a-9ecf-208f16e1995b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:01.973821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62248358-a00b-456a-9ecf-208f16e1995b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:01.974267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-62248358-a00b-456a-9ecf-208f16e1995b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:02.122212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-62248358-a00b-456a-9ecf-208f16e1995b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:02.130490 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-62248358-a00b-456a-9ecf-208f16e1995b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 200 len: 1362 microversion: 2.1 time: 0.170484 Jul 28 04:43:02.131038 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4823/7273] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:01 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:02.666941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f85e57eb-1fa9-4d1f-8007-fb83b148746e req-3ead0e35-fb61-4b3d-891d-97b6a27f7a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92", "name": "network-vif-plugged", "status": "completed", "tag": "aa07f0cf-abc5-45b6-adba-523a81feaf26"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:43:02.677465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f85e57eb-1fa9-4d1f-8007-fb83b148746e req-3ead0e35-fb61-4b3d-891d-97b6a27f7a5a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:02.677993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f85e57eb-1fa9-4d1f-8007-fb83b148746e req-3ead0e35-fb61-4b3d-891d-97b6a27f7a5a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:02.690385 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f85e57eb-1fa9-4d1f-8007-fb83b148746e req-3ead0e35-fb61-4b3d-891d-97b6a27f7a5a service nova] Creating event network-vif-plugged:aa07f0cf-abc5-45b6-adba-523a81feaf26 for instance d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 on n-h1-826756-3 Jul 28 04:43:02.696131 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f85e57eb-1fa9-4d1f-8007-fb83b148746e req-3ead0e35-fb61-4b3d-891d-97b6a27f7a5a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032930 Jul 28 04:43:02.696981 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4824/7274] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:43:03.153377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e1649db0-597a-4304-822d-bc4847a8d81c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:03.154091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e1649db0-597a-4304-822d-bc4847a8d81c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:03.161164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1649db0-597a-4304-822d-bc4847a8d81c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:03.161633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1649db0-597a-4304-822d-bc4847a8d81c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:03.162727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1649db0-597a-4304-822d-bc4847a8d81c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:03.162880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1649db0-597a-4304-822d-bc4847a8d81c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:03.297392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e1649db0-597a-4304-822d-bc4847a8d81c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:03.305655 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e1649db0-597a-4304-822d-bc4847a8d81c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 200 len: 1362 microversion: 2.1 time: 0.157513 Jul 28 04:43:03.306217 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4825/7275] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:03 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:04.329569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-902156a4-0ac1-47cf-a682-0e83d2a6e26d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:04.330554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-902156a4-0ac1-47cf-a682-0e83d2a6e26d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:04.341329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-902156a4-0ac1-47cf-a682-0e83d2a6e26d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:04.341963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-902156a4-0ac1-47cf-a682-0e83d2a6e26d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:04.343576 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-902156a4-0ac1-47cf-a682-0e83d2a6e26d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:04.343774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-902156a4-0ac1-47cf-a682-0e83d2a6e26d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:04.488674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-902156a4-0ac1-47cf-a682-0e83d2a6e26d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:04.497199 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-902156a4-0ac1-47cf-a682-0e83d2a6e26d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 200 len: 1555 microversion: 2.1 time: 0.174123 Jul 28 04:43:04.497883 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4826/7276] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:04 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:04.523553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4de7fa4-1abb-44a7-8f96-d425b39afa08 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:04.524200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d4de7fa4-1abb-44a7-8f96-d425b39afa08 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:04.530429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4de7fa4-1abb-44a7-8f96-d425b39afa08 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:04.530900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4de7fa4-1abb-44a7-8f96-d425b39afa08 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:04.531677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4de7fa4-1abb-44a7-8f96-d425b39afa08 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:04.532155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4de7fa4-1abb-44a7-8f96-d425b39afa08 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:04.673420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d4de7fa4-1abb-44a7-8f96-d425b39afa08 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:04.681524 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d4de7fa4-1abb-44a7-8f96-d425b39afa08 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 200 len: 1555 microversion: 2.1 time: 0.161845 Jul 28 04:43:04.682136 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4827/7277] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:04 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:06.426750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d9d51c57-b194-4fef-884d-ece2ee452178 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2ec708f-0701-4ba8-8d6a-a8b86ac710cd"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:43:06.430075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d9d51c57-b194-4fef-884d-ece2ee452178 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:06.432962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:43:06.433800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:43:06.441633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9d51c57-b194-4fef-884d-ece2ee452178 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:06.442100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9d51c57-b194-4fef-884d-ece2ee452178 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:06.442887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9d51c57-b194-4fef-884d-ece2ee452178 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:06.443340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9d51c57-b194-4fef-884d-ece2ee452178 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:06.715784 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d9d51c57-b194-4fef-884d-ece2ee452178 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "POST /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295401 Jul 28 04:43:06.716479 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4828/7278] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 04:43:06 2022] POST /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:43:17.469791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:43:17.470792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:43:17.476313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8eb76448-9eef-4fce-a6f3-b99c0f9b4280 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:17.476933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8eb76448-9eef-4fce-a6f3-b99c0f9b4280 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:17.486244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8eb76448-9eef-4fce-a6f3-b99c0f9b4280 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:17.486722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8eb76448-9eef-4fce-a6f3-b99c0f9b4280 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:17.487494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8eb76448-9eef-4fce-a6f3-b99c0f9b4280 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:17.487938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8eb76448-9eef-4fce-a6f3-b99c0f9b4280 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:17.684871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-8eb76448-9eef-4fce-a6f3-b99c0f9b4280 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lazy-loading 'services' on Instance uuid d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:43:17.763498 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8eb76448-9eef-4fce-a6f3-b99c0f9b4280 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments/d2ec708f-0701-4ba8-8d6a-a8b86ac710cd" status: 202 len: 0 microversion: 2.1 time: 0.295416 Jul 28 04:43:17.764167 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4829/7279] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:43:17 2022] DELETE /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments/d2ec708f-0701-4ba8-8d6a-a8b86ac710cd => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:43:17.772874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-55c3446a-1d40-4e2e-b193-78af47b0f087 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:17.775266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-55c3446a-1d40-4e2e-b193-78af47b0f087 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:17.782294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55c3446a-1d40-4e2e-b193-78af47b0f087 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:17.782808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55c3446a-1d40-4e2e-b193-78af47b0f087 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:17.783580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55c3446a-1d40-4e2e-b193-78af47b0f087 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:17.784067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-55c3446a-1d40-4e2e-b193-78af47b0f087 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:17.815439 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-55c3446a-1d40-4e2e-b193-78af47b0f087 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046633 Jul 28 04:43:17.815986 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4830/7280] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:43:17 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:43:18.828779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-36c405f4-cb5b-4b43-84af-86e0274141be tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:18.831036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-36c405f4-cb5b-4b43-84af-86e0274141be tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:18.837877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36c405f4-cb5b-4b43-84af-86e0274141be tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:18.838372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36c405f4-cb5b-4b43-84af-86e0274141be tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:18.839145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36c405f4-cb5b-4b43-84af-86e0274141be tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:18.839596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-36c405f4-cb5b-4b43-84af-86e0274141be tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:18.874439 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-36c405f4-cb5b-4b43-84af-86e0274141be tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050732 Jul 28 04:43:18.875070 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4831/7281] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:43:18 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:43:19.887152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-947aceb8-ebf8-460b-a289-ed355075c832 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:19.890176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-947aceb8-ebf8-460b-a289-ed355075c832 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:19.901221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-947aceb8-ebf8-460b-a289-ed355075c832 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:19.901896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-947aceb8-ebf8-460b-a289-ed355075c832 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:19.903048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-947aceb8-ebf8-460b-a289-ed355075c832 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:19.903709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-947aceb8-ebf8-460b-a289-ed355075c832 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:19.937728 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-947aceb8-ebf8-460b-a289-ed355075c832 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054692 Jul 28 04:43:19.938418 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4832/7282] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:43:19 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:43:20.950242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a582c0fc-2e2b-4e4b-a7b3-3653c580d608 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:20.952385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a582c0fc-2e2b-4e4b-a7b3-3653c580d608 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:20.960245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a582c0fc-2e2b-4e4b-a7b3-3653c580d608 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:20.960769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a582c0fc-2e2b-4e4b-a7b3-3653c580d608 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:20.961566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a582c0fc-2e2b-4e4b-a7b3-3653c580d608 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:20.962031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a582c0fc-2e2b-4e4b-a7b3-3653c580d608 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:20.994252 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a582c0fc-2e2b-4e4b-a7b3-3653c580d608 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048258 Jul 28 04:43:20.994833 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4833/7283] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:43:20 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:43:22.007216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3d7977c6-a689-4ab3-9d90-c8efab942652 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:22.009779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3d7977c6-a689-4ab3-9d90-c8efab942652 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:22.017355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d7977c6-a689-4ab3-9d90-c8efab942652 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:22.017946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d7977c6-a689-4ab3-9d90-c8efab942652 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:22.018755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d7977c6-a689-4ab3-9d90-c8efab942652 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:22.019212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d7977c6-a689-4ab3-9d90-c8efab942652 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:22.053542 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3d7977c6-a689-4ab3-9d90-c8efab942652 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050422 Jul 28 04:43:22.054061 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4834/7284] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:43:22 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:43:23.066119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-65189c22-dc7f-4784-b24e-6ae3fa9bfc18 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:23.068445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-65189c22-dc7f-4784-b24e-6ae3fa9bfc18 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:23.075778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65189c22-dc7f-4784-b24e-6ae3fa9bfc18 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:23.076248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65189c22-dc7f-4784-b24e-6ae3fa9bfc18 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:23.077075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65189c22-dc7f-4784-b24e-6ae3fa9bfc18 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:23.077519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-65189c22-dc7f-4784-b24e-6ae3fa9bfc18 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:23.108126 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-65189c22-dc7f-4784-b24e-6ae3fa9bfc18 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046136 Jul 28 04:43:23.108731 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4835/7285] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:43:23 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:43:23.119342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47e2d443-5373-4d61-a139-c063224a7d05 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:23.119845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-47e2d443-5373-4d61-a139-c063224a7d05 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:23.125846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47e2d443-5373-4d61-a139-c063224a7d05 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:23.126299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47e2d443-5373-4d61-a139-c063224a7d05 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:23.127058 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47e2d443-5373-4d61-a139-c063224a7d05 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:23.127588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47e2d443-5373-4d61-a139-c063224a7d05 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:23.203924 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-47e2d443-5373-4d61-a139-c063224a7d05 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] HTTP exception thrown: Instance d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 is not attached to volume d2ec708f-0701-4ba8-8d6a-a8b86ac710cd Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47e2d443-5373-4d61-a139-c063224a7d05 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Request method failure captured: Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments/d2ec708f-0701-4ba8-8d6a-a8b86ac710cd HTTP/1.1 Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hPI8JXbktDtXaL8bxCbbHNASO-DAJy1bo5OtRJ67jTHj-0oavYWnQ3_YhCehjVGLLSadcZ5njJ0oNEgVZwB4QTXjvzyluf4LUhQDkL3AufEuqBAHo03UNlsG7bWjmUnMbmHp2b0yKmQox-vY_JM1HVrgizfkP-rprvBdOFvFIDiWWo Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: e2f8cdeb2de043118a8e5d5eb06dc092 Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f8cdeb2de043118a8e5d5eb06dc092"}]}] Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: e2f8cdeb2de043118a8e5d5eb06dc092 Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestEncryptedCinderVolumes-1212740026-project Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 30cf2e3582d640679467e0430b46a749 Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestEncryptedCinderVolumes-1212740026-project Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 is not attached to volume d2ec708f-0701-4ba8-8d6a-a8b86ac710cd Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': 'd04db60c-6af8-4f8d-89d7-2ea7ae1a0c92', 'id': 'd2ec708f-0701-4ba8-8d6a-a8b86ac710cd'} Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d2ec708f-0701-4ba8-8d6a-a8b86ac710cd. Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 is not attached to volume d2ec708f-0701-4ba8-8d6a-a8b86ac710cd Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:43:23.215818 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:43:23.219812 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:43:23.219812 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:43:23.219812 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 is not attached to volume d2ec708f-0701-4ba8-8d6a-a8b86ac710cd Jul 28 04:43:23.219812 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:23.219812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47e2d443-5373-4d61-a139-c063224a7d05 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Returning 404 to user: Instance d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 is not attached to volume d2ec708f-0701-4ba8-8d6a-a8b86ac710cd {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:43:23.219812 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-47e2d443-5373-4d61-a139-c063224a7d05 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments/d2ec708f-0701-4ba8-8d6a-a8b86ac710cd" status: 404 len: 154 microversion: 2.1 time: 0.101839 Jul 28 04:43:23.219812 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4836/7286] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:43:23 2022] DELETE /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92/os-volume_attachments/d2ec708f-0701-4ba8-8d6a-a8b86ac710cd => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:43:26.592634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-459fc9bc-4e17-49bf-80ea-ee047c73840d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:26.593268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-459fc9bc-4e17-49bf-80ea-ee047c73840d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:26.602017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-459fc9bc-4e17-49bf-80ea-ee047c73840d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:26.602486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-459fc9bc-4e17-49bf-80ea-ee047c73840d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:26.603285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-459fc9bc-4e17-49bf-80ea-ee047c73840d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:26.603741 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-459fc9bc-4e17-49bf-80ea-ee047c73840d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:26.631350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-459fc9bc-4e17-49bf-80ea-ee047c73840d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:43:26.727387 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-459fc9bc-4e17-49bf-80ea-ee047c73840d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 204 len: 0 microversion: 2.1 time: 0.139917 Jul 28 04:43:26.728047 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4837/7287] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:43:26 2022] DELETE /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:43:26.737248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-34290c26-cf5d-4633-9b0c-9516c504e9d0 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:26.737959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-34290c26-cf5d-4633-9b0c-9516c504e9d0 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:26.744713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34290c26-cf5d-4633-9b0c-9516c504e9d0 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:26.745231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34290c26-cf5d-4633-9b0c-9516c504e9d0 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:26.746013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34290c26-cf5d-4633-9b0c-9516c504e9d0 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:26.746457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-34290c26-cf5d-4633-9b0c-9516c504e9d0 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:26.887052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-34290c26-cf5d-4633-9b0c-9516c504e9d0 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:26.896121 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-34290c26-cf5d-4633-9b0c-9516c504e9d0 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 200 len: 1561 microversion: 2.1 time: 0.163482 Jul 28 04:43:26.900404 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4838/7288] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:26 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:27.926918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b90eead9-6f0c-4fc8-b95b-13769112e77a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:27.928011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b90eead9-6f0c-4fc8-b95b-13769112e77a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:27.942308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b90eead9-6f0c-4fc8-b95b-13769112e77a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:27.942967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b90eead9-6f0c-4fc8-b95b-13769112e77a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:27.944072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b90eead9-6f0c-4fc8-b95b-13769112e77a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:27.944559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b90eead9-6f0c-4fc8-b95b-13769112e77a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:28.091933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b90eead9-6f0c-4fc8-b95b-13769112e77a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:28.100422 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b90eead9-6f0c-4fc8-b95b-13769112e77a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 200 len: 1561 microversion: 2.1 time: 0.183103 Jul 28 04:43:28.100989 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4839/7289] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:27 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:28.796960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-43b7328c-8f9e-49d6-8bb9-bcbe4310a246 req-2ab12d4c-593e-426c-9ede-c916bcedb036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92", "name": "network-vif-deleted", "tag": "aa07f0cf-abc5-45b6-adba-523a81feaf26"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:43:28.809426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-43b7328c-8f9e-49d6-8bb9-bcbe4310a246 req-2ab12d4c-593e-426c-9ede-c916bcedb036 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:28.809886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-43b7328c-8f9e-49d6-8bb9-bcbe4310a246 req-2ab12d4c-593e-426c-9ede-c916bcedb036 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:28.823227 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-43b7328c-8f9e-49d6-8bb9-bcbe4310a246 req-2ab12d4c-593e-426c-9ede-c916bcedb036 service nova] Creating event network-vif-deleted:aa07f0cf-abc5-45b6-adba-523a81feaf26 for instance d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 on n-h1-826756-3 Jul 28 04:43:28.830464 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-43b7328c-8f9e-49d6-8bb9-bcbe4310a246 req-2ab12d4c-593e-426c-9ede-c916bcedb036 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037209 Jul 28 04:43:28.831428 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4840/7290] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:43:29.123118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb6af8e7-0c1f-4b1f-946f-34b1b495a643 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:29.123921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb6af8e7-0c1f-4b1f-946f-34b1b495a643 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:29.131526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb6af8e7-0c1f-4b1f-946f-34b1b495a643 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:29.131996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb6af8e7-0c1f-4b1f-946f-34b1b495a643 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:29.132827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb6af8e7-0c1f-4b1f-946f-34b1b495a643 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:29.133250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb6af8e7-0c1f-4b1f-946f-34b1b495a643 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:29.169020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb6af8e7-0c1f-4b1f-946f-34b1b495a643 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:29.169492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb6af8e7-0c1f-4b1f-946f-34b1b495a643 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:29.170012 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-bb6af8e7-0c1f-4b1f-946f-34b1b495a643 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lazy-loading 'fault' on Instance uuid d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:43:29.216200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb6af8e7-0c1f-4b1f-946f-34b1b495a643 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:29.224737 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb6af8e7-0c1f-4b1f-946f-34b1b495a643 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 200 len: 1352 microversion: 2.1 time: 0.106245 Jul 28 04:43:29.225333 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4841/7291] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:29 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:30.250786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-746eb6cd-37c3-46ec-81ad-fa65d04ea7f6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:30.251825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-746eb6cd-37c3-46ec-81ad-fa65d04ea7f6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:30.260897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-746eb6cd-37c3-46ec-81ad-fa65d04ea7f6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:30.261362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-746eb6cd-37c3-46ec-81ad-fa65d04ea7f6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:30.262150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-746eb6cd-37c3-46ec-81ad-fa65d04ea7f6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:30.262601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-746eb6cd-37c3-46ec-81ad-fa65d04ea7f6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:30.276510 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-746eb6cd-37c3-46ec-81ad-fa65d04ea7f6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] HTTP exception thrown: Instance d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 could not be found. Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-746eb6cd-37c3-46ec-81ad-fa65d04ea7f6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Request method failure captured: Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 HTTP/1.1 Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hPI8JXbktDtXaL8bxCbbHNASO-DAJy1bo5OtRJ67jTHj-0oavYWnQ3_YhCehjVGLLSadcZ5njJ0oNEgVZwB4QTXjvzyluf4LUhQDkL3AufEuqBAHo03UNlsG7bWjmUnMbmHp2b0yKmQox-vY_JM1HVrgizfkP-rprvBdOFvFIDiWWo Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: e2f8cdeb2de043118a8e5d5eb06dc092 Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f8cdeb2de043118a8e5d5eb06dc092"}]}] Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: e2f8cdeb2de043118a8e5d5eb06dc092 Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestEncryptedCinderVolumes-1212740026-project Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 30cf2e3582d640679467e0430b46a749 Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestEncryptedCinderVolumes-1212740026-project Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 could not be found. Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'd04db60c-6af8-4f8d-89d7-2ea7ae1a0c92'} Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 could not be found. Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 could not be found. Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:43:30.278185 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:30.282428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:43:30.282428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:43:30.282428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:43:30.282428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:43:30.282428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:43:30.282428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 could not be found. Jul 28 04:43:30.282428 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:30.282428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-746eb6cd-37c3-46ec-81ad-fa65d04ea7f6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Returning 404 to user: Instance d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:43:30.282428 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-746eb6cd-37c3-46ec-81ad-fa65d04ea7f6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92" status: 404 len: 111 microversion: 2.1 time: 0.035577 Jul 28 04:43:30.282428 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4842/7292] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:30 2022] GET /compute/v2.1/servers/d04db60c-6af8-4f8d-89d7-2ea7ae1a0c92 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:43:30.288300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dd756068-c495-4135-8d46-9a3ae7f2c372 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '.version_select at 0x7ffa66e65700>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:30.312509 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dd756068-c495-4135-8d46-9a3ae7f2c372 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-432606668" status: 202 len: 0 microversion: 2.1 time: 0.027810 Jul 28 04:43:30.313248 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4843/7293] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 04:43:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-432606668 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:43:30.330747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-854c8a67-4ab8-4441-9358-91baae3db0ea tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Action: 'create', calling method: .version_select at 0x7ffa675e8700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1350383894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHlcd0zp6EYgcRdlpsvH0Z2GIDQ8u2wGwAMQ/4N6nJpcVBsUVVTGePm+IIvqri+dHvNr3nuYjGJ8K1+PpjoMjWQRNQkIgvjsCeltB0B/pVaQItJOY8xeJxyBWuGYxDBWQ=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:43:30.347669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-854c8a67-4ab8-4441-9358-91baae3db0ea tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Getting quotas for project e2f8cdeb2de043118a8e5d5eb06dc092. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:43:30.355350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-854c8a67-4ab8-4441-9358-91baae3db0ea tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Getting quotas for user 30cf2e3582d640679467e0430b46a749 and project e2f8cdeb2de043118a8e5d5eb06dc092. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:43:30.380853 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-854c8a67-4ab8-4441-9358-91baae3db0ea tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.053710 Jul 28 04:43:30.381461 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4844/7294] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:43:30 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:43:30.438803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-246129800", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1350383894", "networks": [{"uuid": "4d888961-bfac-4bc8-8f5b-e43d5a9daefe"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:43:30.493217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] validate_networks() for [('4d888961-bfac-4bc8-8f5b-e43d5a9daefe', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:43:30.921995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:43:30.922434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:43:30.922921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:43:30.923359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:43:30.923821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:43:30.934340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:30.934795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:30.935593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:30.936056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:30.953587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Getting quotas for project e2f8cdeb2de043118a8e5d5eb06dc092. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:43:30.958943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Getting quotas for user 30cf2e3582d640679467e0430b46a749 and project e2f8cdeb2de043118a8e5d5eb06dc092. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:43:30.972400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:43:30.974925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:43:31.023798 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cbaa742c-836b-4b9f-a1c7-d70ad5285006 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591362 Jul 28 04:43:31.024682 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4845/7295] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:43:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:43:31.035549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6fda4b43-5a68-46bf-bb3d-a0fa70e72ac2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:31.036179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6fda4b43-5a68-46bf-bb3d-a0fa70e72ac2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:31.090063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6fda4b43-5a68-46bf-bb3d-a0fa70e72ac2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:31.097414 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6fda4b43-5a68-46bf-bb3d-a0fa70e72ac2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b" status: 200 len: 1262 microversion: 2.1 time: 0.065419 Jul 28 04:43:31.097994 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4846/7296] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:31 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b => generated 1262 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:32.119627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb881fa8-eb96-4bab-8a5f-1617a023aadf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:32.120320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb881fa8-eb96-4bab-8a5f-1617a023aadf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:32.128783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb881fa8-eb96-4bab-8a5f-1617a023aadf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:32.129249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb881fa8-eb96-4bab-8a5f-1617a023aadf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:32.130049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb881fa8-eb96-4bab-8a5f-1617a023aadf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:32.130505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb881fa8-eb96-4bab-8a5f-1617a023aadf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:32.207844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fb881fa8-eb96-4bab-8a5f-1617a023aadf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:32.211675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:43:32.216658 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fb881fa8-eb96-4bab-8a5f-1617a023aadf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b" status: 200 len: 1314 microversion: 2.1 time: 0.101436 Jul 28 04:43:32.217247 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4847/7297] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:32 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b => generated 1314 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:33.239446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7e909960-d8fe-4843-ae6d-c961d9e0e658 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:33.240139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7e909960-d8fe-4843-ae6d-c961d9e0e658 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:33.248092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e909960-d8fe-4843-ae6d-c961d9e0e658 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:33.248596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e909960-d8fe-4843-ae6d-c961d9e0e658 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:33.249426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e909960-d8fe-4843-ae6d-c961d9e0e658 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:33.250055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7e909960-d8fe-4843-ae6d-c961d9e0e658 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:33.387193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7e909960-d8fe-4843-ae6d-c961d9e0e658 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:33.399562 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7e909960-d8fe-4843-ae6d-c961d9e0e658 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b" status: 200 len: 1362 microversion: 2.1 time: 0.163533 Jul 28 04:43:33.400588 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4848/7298] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:33 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:43:33.661130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-74c4aace-82fb-447c-ac55-84c119741327 req-32976197-9f5d-449e-aa78-fb17e403972a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2870cf0-1115-49b7-9ed5-ac2e9446337b", "tag": "de23e522-8707-46bf-a9a2-3a8e35f52f66"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:43:33.673331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-74c4aace-82fb-447c-ac55-84c119741327 req-32976197-9f5d-449e-aa78-fb17e403972a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:33.674109 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-74c4aace-82fb-447c-ac55-84c119741327 req-32976197-9f5d-449e-aa78-fb17e403972a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:33.687048 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-74c4aace-82fb-447c-ac55-84c119741327 req-32976197-9f5d-449e-aa78-fb17e403972a service nova] Creating event network-changed:de23e522-8707-46bf-a9a2-3a8e35f52f66 for instance f2870cf0-1115-49b7-9ed5-ac2e9446337b on n-h2-826756-3 Jul 28 04:43:33.692119 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-74c4aace-82fb-447c-ac55-84c119741327 req-32976197-9f5d-449e-aa78-fb17e403972a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035057 Jul 28 04:43:33.693260 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4849/7299] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:43:34.427276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6dcf5845-da4c-4a2d-94c4-54cefdb5862b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:34.428031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6dcf5845-da4c-4a2d-94c4-54cefdb5862b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:34.435549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dcf5845-da4c-4a2d-94c4-54cefdb5862b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:34.436007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dcf5845-da4c-4a2d-94c4-54cefdb5862b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:34.436797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dcf5845-da4c-4a2d-94c4-54cefdb5862b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:34.437273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dcf5845-da4c-4a2d-94c4-54cefdb5862b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:34.578151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6dcf5845-da4c-4a2d-94c4-54cefdb5862b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:34.586369 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6dcf5845-da4c-4a2d-94c4-54cefdb5862b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b" status: 200 len: 1362 microversion: 2.1 time: 0.164425 Jul 28 04:43:34.586971 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4850/7300] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:34 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:35.608730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-03f1d817-f8f1-4a8d-bfa2-9cac629da7e2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:35.609532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-03f1d817-f8f1-4a8d-bfa2-9cac629da7e2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:35.619824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03f1d817-f8f1-4a8d-bfa2-9cac629da7e2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:35.620595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03f1d817-f8f1-4a8d-bfa2-9cac629da7e2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:35.621758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03f1d817-f8f1-4a8d-bfa2-9cac629da7e2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:35.622345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03f1d817-f8f1-4a8d-bfa2-9cac629da7e2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:35.781515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-03f1d817-f8f1-4a8d-bfa2-9cac629da7e2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:35.790903 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-03f1d817-f8f1-4a8d-bfa2-9cac629da7e2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b" status: 200 len: 1362 microversion: 2.1 time: 0.186153 Jul 28 04:43:35.791499 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4851/7301] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:35 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:43:36.817494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-933c70d5-3f67-4bf3-bad6-b79f89447f78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:36.818379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-933c70d5-3f67-4bf3-bad6-b79f89447f78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:36.828204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-933c70d5-3f67-4bf3-bad6-b79f89447f78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:36.828854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-933c70d5-3f67-4bf3-bad6-b79f89447f78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:36.829918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-933c70d5-3f67-4bf3-bad6-b79f89447f78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:36.830511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-933c70d5-3f67-4bf3-bad6-b79f89447f78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:36.982024 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-933c70d5-3f67-4bf3-bad6-b79f89447f78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:36.992525 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-933c70d5-3f67-4bf3-bad6-b79f89447f78 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b" status: 200 len: 1362 microversion: 2.1 time: 0.180152 Jul 28 04:43:36.993375 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4852/7302] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:36 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:37.399391 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:43:37.399918 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:43:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:43:37.494737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9c6eb336-ab62-4bb1-82a0-93759d845e57 req-81c9d739-ad04-4abe-9db2-19b82bde640b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2870cf0-1115-49b7-9ed5-ac2e9446337b", "name": "network-vif-plugged", "status": "completed", "tag": "de23e522-8707-46bf-a9a2-3a8e35f52f66"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:43:37.504753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9c6eb336-ab62-4bb1-82a0-93759d845e57 req-81c9d739-ad04-4abe-9db2-19b82bde640b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:37.505218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9c6eb336-ab62-4bb1-82a0-93759d845e57 req-81c9d739-ad04-4abe-9db2-19b82bde640b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:37.517288 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9c6eb336-ab62-4bb1-82a0-93759d845e57 req-81c9d739-ad04-4abe-9db2-19b82bde640b service nova] Creating event network-vif-plugged:de23e522-8707-46bf-a9a2-3a8e35f52f66 for instance f2870cf0-1115-49b7-9ed5-ac2e9446337b on n-h2-826756-3 Jul 28 04:43:37.522471 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9c6eb336-ab62-4bb1-82a0-93759d845e57 req-81c9d739-ad04-4abe-9db2-19b82bde640b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031658 Jul 28 04:43:37.523074 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4853/7303] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:43:38.018969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-686af5e1-7b2d-4bfe-a597-466513febb75 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:38.019668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-686af5e1-7b2d-4bfe-a597-466513febb75 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:38.026774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-686af5e1-7b2d-4bfe-a597-466513febb75 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:38.027229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-686af5e1-7b2d-4bfe-a597-466513febb75 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:38.028011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-686af5e1-7b2d-4bfe-a597-466513febb75 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:38.028480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-686af5e1-7b2d-4bfe-a597-466513febb75 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:38.183644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-686af5e1-7b2d-4bfe-a597-466513febb75 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:38.193144 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-686af5e1-7b2d-4bfe-a597-466513febb75 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b" status: 200 len: 1362 microversion: 2.1 time: 0.179235 Jul 28 04:43:38.193745 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4854/7304] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:38 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:39.214603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9494aaf5-95f1-4b2e-87bb-e9efe40a278d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:39.215284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9494aaf5-95f1-4b2e-87bb-e9efe40a278d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:39.223220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9494aaf5-95f1-4b2e-87bb-e9efe40a278d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:39.223677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9494aaf5-95f1-4b2e-87bb-e9efe40a278d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:39.224519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9494aaf5-95f1-4b2e-87bb-e9efe40a278d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:39.224965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9494aaf5-95f1-4b2e-87bb-e9efe40a278d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:39.356515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9494aaf5-95f1-4b2e-87bb-e9efe40a278d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:39.364630 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9494aaf5-95f1-4b2e-87bb-e9efe40a278d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b" status: 200 len: 1555 microversion: 2.1 time: 0.154092 Jul 28 04:43:39.365297 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4855/7305] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:39 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:39.384939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8695adc0-8cb2-47a3-89d5-64fee6b8ce35 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:39.385671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8695adc0-8cb2-47a3-89d5-64fee6b8ce35 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:39.392137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8695adc0-8cb2-47a3-89d5-64fee6b8ce35 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:39.392654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8695adc0-8cb2-47a3-89d5-64fee6b8ce35 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:39.393446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8695adc0-8cb2-47a3-89d5-64fee6b8ce35 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:39.393904 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8695adc0-8cb2-47a3-89d5-64fee6b8ce35 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:39.524391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8695adc0-8cb2-47a3-89d5-64fee6b8ce35 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:43:39.533200 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8695adc0-8cb2-47a3-89d5-64fee6b8ce35 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b" status: 200 len: 1555 microversion: 2.1 time: 0.152077 Jul 28 04:43:39.534268 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4856/7306] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:43:39 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:43:41.042425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3ad69417-ebb8-4803-826e-65b2b970d21e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2554048-44a6-48ff-bd33-f8987a4c54f0"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:43:41.044982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3ad69417-ebb8-4803-826e-65b2b970d21e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:41.047915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:43:41.053905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ad69417-ebb8-4803-826e-65b2b970d21e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:41.054371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ad69417-ebb8-4803-826e-65b2b970d21e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:41.055242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ad69417-ebb8-4803-826e-65b2b970d21e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:41.055692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ad69417-ebb8-4803-826e-65b2b970d21e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:41.094464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:43:41.338034 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3ad69417-ebb8-4803-826e-65b2b970d21e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "POST /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299420 Jul 28 04:43:41.338680 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4857/7307] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 04:43:41 2022] POST /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:43:52.107990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:43:52.109010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:43:52.113615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0b3170ea-5994-4873-b5b8-1189c2bc8c5b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:52.114222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0b3170ea-5994-4873-b5b8-1189c2bc8c5b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:52.121975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b3170ea-5994-4873-b5b8-1189c2bc8c5b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:52.122474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b3170ea-5994-4873-b5b8-1189c2bc8c5b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:52.123258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b3170ea-5994-4873-b5b8-1189c2bc8c5b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:52.123706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b3170ea-5994-4873-b5b8-1189c2bc8c5b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:52.211982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-0b3170ea-5994-4873-b5b8-1189c2bc8c5b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lazy-loading 'services' on Instance uuid f2870cf0-1115-49b7-9ed5-ac2e9446337b {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:43:52.307911 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0b3170ea-5994-4873-b5b8-1189c2bc8c5b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments/c2554048-44a6-48ff-bd33-f8987a4c54f0" status: 202 len: 0 microversion: 2.1 time: 0.201113 Jul 28 04:43:52.309131 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4858/7308] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:43:52 2022] DELETE /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments/c2554048-44a6-48ff-bd33-f8987a4c54f0 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:43:52.318354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-75c312f6-4e76-4eae-8df3-ee629abf02b6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:52.321478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-75c312f6-4e76-4eae-8df3-ee629abf02b6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:52.329155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75c312f6-4e76-4eae-8df3-ee629abf02b6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:52.329592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75c312f6-4e76-4eae-8df3-ee629abf02b6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:52.330444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75c312f6-4e76-4eae-8df3-ee629abf02b6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:52.330964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-75c312f6-4e76-4eae-8df3-ee629abf02b6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:52.366252 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-75c312f6-4e76-4eae-8df3-ee629abf02b6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052382 Jul 28 04:43:52.367068 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4859/7309] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:43:52 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:43:53.381511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8e40d9cb-b9a9-4e47-9b11-90b588cab485 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:53.385684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8e40d9cb-b9a9-4e47-9b11-90b588cab485 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:53.392824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e40d9cb-b9a9-4e47-9b11-90b588cab485 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:53.393290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e40d9cb-b9a9-4e47-9b11-90b588cab485 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:53.394237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e40d9cb-b9a9-4e47-9b11-90b588cab485 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:53.394702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e40d9cb-b9a9-4e47-9b11-90b588cab485 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:53.428166 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8e40d9cb-b9a9-4e47-9b11-90b588cab485 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052097 Jul 28 04:43:53.428784 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4860/7310] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:43:53 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:43:54.441306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-301747d3-2953-4389-ba73-1dd4560a01e7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:54.443540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-301747d3-2953-4389-ba73-1dd4560a01e7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:54.451485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-301747d3-2953-4389-ba73-1dd4560a01e7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:54.451955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-301747d3-2953-4389-ba73-1dd4560a01e7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:54.452781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-301747d3-2953-4389-ba73-1dd4560a01e7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:54.453231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-301747d3-2953-4389-ba73-1dd4560a01e7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:54.489883 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-301747d3-2953-4389-ba73-1dd4560a01e7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052748 Jul 28 04:43:54.490487 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4861/7311] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:43:54 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:43:55.502477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c8745b4b-612a-4917-8c84-96def003fd73 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:55.504722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c8745b4b-612a-4917-8c84-96def003fd73 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:55.512232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8745b4b-612a-4917-8c84-96def003fd73 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:55.512754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8745b4b-612a-4917-8c84-96def003fd73 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:55.513547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8745b4b-612a-4917-8c84-96def003fd73 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:55.514001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8745b4b-612a-4917-8c84-96def003fd73 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:55.545824 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c8745b4b-612a-4917-8c84-96def003fd73 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047456 Jul 28 04:43:55.546309 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4862/7312] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:43:55 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:43:56.559165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-58a1bc9a-e7e3-4a53-85fd-917f701381ad tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:56.561495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-58a1bc9a-e7e3-4a53-85fd-917f701381ad tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:56.569361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58a1bc9a-e7e3-4a53-85fd-917f701381ad tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:56.572506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58a1bc9a-e7e3-4a53-85fd-917f701381ad tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:56.572506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58a1bc9a-e7e3-4a53-85fd-917f701381ad tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:56.572506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58a1bc9a-e7e3-4a53-85fd-917f701381ad tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:56.603236 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-58a1bc9a-e7e3-4a53-85fd-917f701381ad tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048514 Jul 28 04:43:56.607898 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4863/7313] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:43:56 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:43:57.616256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7294b9cb-166d-4065-9c2c-20cf2bb941d2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:57.618574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7294b9cb-166d-4065-9c2c-20cf2bb941d2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:57.626075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7294b9cb-166d-4065-9c2c-20cf2bb941d2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:57.626536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7294b9cb-166d-4065-9c2c-20cf2bb941d2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:57.627329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7294b9cb-166d-4065-9c2c-20cf2bb941d2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:57.627777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7294b9cb-166d-4065-9c2c-20cf2bb941d2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:57.674258 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7294b9cb-166d-4065-9c2c-20cf2bb941d2 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062082 Jul 28 04:43:57.674885 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4864/7314] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:43:57 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:43:57.685735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b4ccb04-33b4-4a78-a01d-48b37bd2d687 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:43:57.686271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b4ccb04-33b4-4a78-a01d-48b37bd2d687 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:43:57.692702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b4ccb04-33b4-4a78-a01d-48b37bd2d687 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:57.693167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b4ccb04-33b4-4a78-a01d-48b37bd2d687 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:57.693947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b4ccb04-33b4-4a78-a01d-48b37bd2d687 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:43:57.694399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b4ccb04-33b4-4a78-a01d-48b37bd2d687 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:43:57.773489 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-4b4ccb04-33b4-4a78-a01d-48b37bd2d687 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] HTTP exception thrown: Instance f2870cf0-1115-49b7-9ed5-ac2e9446337b is not attached to volume c2554048-44a6-48ff-bd33-f8987a4c54f0 Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b4ccb04-33b4-4a78-a01d-48b37bd2d687 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Request method failure captured: Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments/c2554048-44a6-48ff-bd33-f8987a4c54f0 HTTP/1.1 Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hPI8JXbktDtXaL8bxCbbHNASO-DAJy1bo5OtRJ67jTHj-0oavYWnQ3_YhCehjVGLLSadcZ5njJ0oNEgVZwB4QTXjvzyluf4LUhQDkL3AufEuqBAHo03UNlsG7bWjmUnMbmHp2b0yKmQox-vY_JM1HVrgizfkP-rprvBdOFvFIDiWWo Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: e2f8cdeb2de043118a8e5d5eb06dc092 Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f8cdeb2de043118a8e5d5eb06dc092"}]}] Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: e2f8cdeb2de043118a8e5d5eb06dc092 Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestEncryptedCinderVolumes-1212740026-project Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 30cf2e3582d640679467e0430b46a749 Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestEncryptedCinderVolumes-1212740026-project Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance f2870cf0-1115-49b7-9ed5-ac2e9446337b is not attached to volume c2554048-44a6-48ff-bd33-f8987a4c54f0 Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': 'f2870cf0-1115-49b7-9ed5-ac2e9446337b', 'id': 'c2554048-44a6-48ff-bd33-f8987a4c54f0'} Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c2554048-44a6-48ff-bd33-f8987a4c54f0. Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2870cf0-1115-49b7-9ed5-ac2e9446337b is not attached to volume c2554048-44a6-48ff-bd33-f8987a4c54f0 Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:43:57.775191 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:43:57.780000 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:43:57.780000 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:43:57.780000 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2870cf0-1115-49b7-9ed5-ac2e9446337b is not attached to volume c2554048-44a6-48ff-bd33-f8987a4c54f0 Jul 28 04:43:57.780000 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:43:57.780000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b4ccb04-33b4-4a78-a01d-48b37bd2d687 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Returning 404 to user: Instance f2870cf0-1115-49b7-9ed5-ac2e9446337b is not attached to volume c2554048-44a6-48ff-bd33-f8987a4c54f0 {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:43:57.780000 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b4ccb04-33b4-4a78-a01d-48b37bd2d687 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments/c2554048-44a6-48ff-bd33-f8987a4c54f0" status: 404 len: 154 microversion: 2.1 time: 0.094973 Jul 28 04:43:57.780000 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4865/7315] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:43:57 2022] DELETE /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b/os-volume_attachments/c2554048-44a6-48ff-bd33-f8987a4c54f0 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:44:01.128307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1050571f-201e-42aa-a4eb-08152b2234df tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:01.128947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1050571f-201e-42aa-a4eb-08152b2234df tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:01.136305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1050571f-201e-42aa-a4eb-08152b2234df tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:01.136803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1050571f-201e-42aa-a4eb-08152b2234df tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:01.137589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1050571f-201e-42aa-a4eb-08152b2234df tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:01.138042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1050571f-201e-42aa-a4eb-08152b2234df tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:01.165405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1050571f-201e-42aa-a4eb-08152b2234df tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:44:01.259725 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1050571f-201e-42aa-a4eb-08152b2234df tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b" status: 204 len: 0 microversion: 2.1 time: 0.134995 Jul 28 04:44:01.260444 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4866/7316] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:44:01 2022] DELETE /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:44:01.269624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-326691a5-52b4-4e81-9e63-3a9054a72c8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:01.270360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-326691a5-52b4-4e81-9e63-3a9054a72c8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:01.277193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-326691a5-52b4-4e81-9e63-3a9054a72c8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:01.277656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-326691a5-52b4-4e81-9e63-3a9054a72c8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:01.278462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-326691a5-52b4-4e81-9e63-3a9054a72c8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:01.278918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-326691a5-52b4-4e81-9e63-3a9054a72c8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:01.430567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-326691a5-52b4-4e81-9e63-3a9054a72c8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:01.439159 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-326691a5-52b4-4e81-9e63-3a9054a72c8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b" status: 200 len: 1561 microversion: 2.1 time: 0.173837 Jul 28 04:44:01.439795 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4867/7317] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:01 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:44:02.461882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8df7ea1a-456f-4e98-be71-125483f1a47b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:02.463055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8df7ea1a-456f-4e98-be71-125483f1a47b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:02.472896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8df7ea1a-456f-4e98-be71-125483f1a47b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:02.473352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8df7ea1a-456f-4e98-be71-125483f1a47b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:02.474476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8df7ea1a-456f-4e98-be71-125483f1a47b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:02.475282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8df7ea1a-456f-4e98-be71-125483f1a47b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:02.626228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8df7ea1a-456f-4e98-be71-125483f1a47b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:02.636468 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8df7ea1a-456f-4e98-be71-125483f1a47b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b" status: 200 len: 1561 microversion: 2.1 time: 0.179030 Jul 28 04:44:02.637113 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4868/7318] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:02 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:44:03.659473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5173b660-484b-4b08-9af5-10993c6c2030 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:03.660154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5173b660-484b-4b08-9af5-10993c6c2030 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:03.667317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5173b660-484b-4b08-9af5-10993c6c2030 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:03.667785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5173b660-484b-4b08-9af5-10993c6c2030 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:03.668610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5173b660-484b-4b08-9af5-10993c6c2030 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:03.669092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5173b660-484b-4b08-9af5-10993c6c2030 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:03.808846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5173b660-484b-4b08-9af5-10993c6c2030 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:03.817512 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5173b660-484b-4b08-9af5-10993c6c2030 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b" status: 200 len: 1561 microversion: 2.1 time: 0.162068 Jul 28 04:44:03.818129 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4869/7319] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:03 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:44:03.969750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f793916f-8b0f-48d8-aba1-f96694426262 req-2e0be383-239a-4a20-a43e-1f0e753a3030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2870cf0-1115-49b7-9ed5-ac2e9446337b", "name": "network-vif-deleted", "tag": "de23e522-8707-46bf-a9a2-3a8e35f52f66"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:44:03.983151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f793916f-8b0f-48d8-aba1-f96694426262 req-2e0be383-239a-4a20-a43e-1f0e753a3030 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:03.983667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f793916f-8b0f-48d8-aba1-f96694426262 req-2e0be383-239a-4a20-a43e-1f0e753a3030 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:04.000413 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f793916f-8b0f-48d8-aba1-f96694426262 req-2e0be383-239a-4a20-a43e-1f0e753a3030 service nova] Creating event network-vif-deleted:de23e522-8707-46bf-a9a2-3a8e35f52f66 for instance f2870cf0-1115-49b7-9ed5-ac2e9446337b on n-h2-826756-3 Jul 28 04:44:04.007305 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f793916f-8b0f-48d8-aba1-f96694426262 req-2e0be383-239a-4a20-a43e-1f0e753a3030 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042589 Jul 28 04:44:04.008435 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4870/7320] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:44:04.840821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb704a35-2e24-4244-b718-3251d438c44f tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:04.841543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fb704a35-2e24-4244-b718-3251d438c44f tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: f2870cf0-1115-49b7-9ed5-ac2e9446337b] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:04.848681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb704a35-2e24-4244-b718-3251d438c44f tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:04.849148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb704a35-2e24-4244-b718-3251d438c44f tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:04.849934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb704a35-2e24-4244-b718-3251d438c44f tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:04.850380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fb704a35-2e24-4244-b718-3251d438c44f tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:04.864393 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-fb704a35-2e24-4244-b718-3251d438c44f tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] HTTP exception thrown: Instance f2870cf0-1115-49b7-9ed5-ac2e9446337b could not be found. Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb704a35-2e24-4244-b718-3251d438c44f tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Request method failure captured: Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b HTTP/1.1 Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hPI8JXbktDtXaL8bxCbbHNASO-DAJy1bo5OtRJ67jTHj-0oavYWnQ3_YhCehjVGLLSadcZ5njJ0oNEgVZwB4QTXjvzyluf4LUhQDkL3AufEuqBAHo03UNlsG7bWjmUnMbmHp2b0yKmQox-vY_JM1HVrgizfkP-rprvBdOFvFIDiWWo Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: e2f8cdeb2de043118a8e5d5eb06dc092 Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f8cdeb2de043118a8e5d5eb06dc092"}]}] Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: e2f8cdeb2de043118a8e5d5eb06dc092 Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestEncryptedCinderVolumes-1212740026-project Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 30cf2e3582d640679467e0430b46a749 Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestEncryptedCinderVolumes-1212740026-project Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance f2870cf0-1115-49b7-9ed5-ac2e9446337b could not be found. Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'f2870cf0-1115-49b7-9ed5-ac2e9446337b'} Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2870cf0-1115-49b7-9ed5-ac2e9446337b could not be found. Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2870cf0-1115-49b7-9ed5-ac2e9446337b could not be found. Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:44:04.866043 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:04.869935 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:44:04.869935 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:44:04.869935 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:44:04.869935 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:44:04.869935 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:44:04.869935 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2870cf0-1115-49b7-9ed5-ac2e9446337b could not be found. Jul 28 04:44:04.869935 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:04.869935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fb704a35-2e24-4244-b718-3251d438c44f tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Returning 404 to user: Instance f2870cf0-1115-49b7-9ed5-ac2e9446337b could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:44:04.869935 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fb704a35-2e24-4244-b718-3251d438c44f tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b" status: 404 len: 111 microversion: 2.1 time: 0.032176 Jul 28 04:44:04.869935 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4871/7321] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:04 2022] GET /compute/v2.1/servers/f2870cf0-1115-49b7-9ed5-ac2e9446337b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:44:04.876095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6c21e1a8-8ada-4926-be9a-dc4792fc7bb6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '.version_select at 0x7ffa74b720d0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:04.904226 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6c21e1a8-8ada-4926-be9a-dc4792fc7bb6 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1350383894" status: 202 len: 0 microversion: 2.1 time: 0.031624 Jul 28 04:44:04.904892 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4872/7322] 10.222.0.48 () {58 vars in 1278 bytes} [Thu Jul 28 04:44:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1350383894 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:44:04.921675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-854b1869-1688-4c7d-9a7d-5d7dc20e75c7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Action: 'create', calling method: .version_select at 0x7ffa6789d160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-166130315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5WxHe3PM4QGsyUSDx5SAa4mvuTEkR/znmM6PDXvI6zvPi0oeK5/9MPdEbNjfbkqjfiVvVM86vmzOfw86ihaIE2XNLpS/RUwAM+xpJPLcBkOiGp84geQ24bDUDaWa0V9w=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:44:04.938952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-854b1869-1688-4c7d-9a7d-5d7dc20e75c7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Getting quotas for project e2f8cdeb2de043118a8e5d5eb06dc092. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:44:04.944685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-854b1869-1688-4c7d-9a7d-5d7dc20e75c7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Getting quotas for user 30cf2e3582d640679467e0430b46a749 and project e2f8cdeb2de043118a8e5d5eb06dc092. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:44:04.972903 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-854b1869-1688-4c7d-9a7d-5d7dc20e75c7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.054981 Jul 28 04:44:04.973520 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4873/7323] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:44:04 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:44:05.059182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-38656141", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-166130315", "networks": [{"uuid": "4d888961-bfac-4bc8-8f5b-e43d5a9daefe"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:44:05.113973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] validate_networks() for [('4d888961-bfac-4bc8-8f5b-e43d5a9daefe', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:44:05.837566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:44:05.838085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:44:05.838726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:44:05.839246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:44:05.840007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:44:05.855666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:05.856294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:05.856936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:05.857375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:05.874369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Getting quotas for project e2f8cdeb2de043118a8e5d5eb06dc092. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:44:05.879894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Getting quotas for user 30cf2e3582d640679467e0430b46a749 and project e2f8cdeb2de043118a8e5d5eb06dc092. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:44:05.893395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:44:05.895747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:44:05.946919 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-edbc3fc7-953d-4c85-acb5-c188fd0df1d8 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.891623 Jul 28 04:44:05.947577 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4874/7324] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:44:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:44:05.958733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-815ed9d0-975f-4cb3-8a8f-72baf16302af tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:05.959430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-815ed9d0-975f-4cb3-8a8f-72baf16302af tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:06.019699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-815ed9d0-975f-4cb3-8a8f-72baf16302af tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:06.028267 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-815ed9d0-975f-4cb3-8a8f-72baf16302af tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 200 len: 1260 microversion: 2.1 time: 0.073885 Jul 28 04:44:06.029064 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4875/7325] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:05 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 1260 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:44:07.049537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4990e283-49c4-4182-b137-863ffe9110da tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:07.050264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4990e283-49c4-4182-b137-863ffe9110da tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:07.058185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4990e283-49c4-4182-b137-863ffe9110da tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:07.058652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4990e283-49c4-4182-b137-863ffe9110da tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:07.059451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4990e283-49c4-4182-b137-863ffe9110da tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:07.059897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4990e283-49c4-4182-b137-863ffe9110da tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:07.129168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4990e283-49c4-4182-b137-863ffe9110da tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:07.139198 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4990e283-49c4-4182-b137-863ffe9110da tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 200 len: 1320 microversion: 2.1 time: 0.093062 Jul 28 04:44:07.140037 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4876/7326] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:07 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 1320 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:44:08.163278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-80c8ac75-7ffa-42b7-bd18-f6e74ae3a25c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:08.163974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-80c8ac75-7ffa-42b7-bd18-f6e74ae3a25c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:08.171411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80c8ac75-7ffa-42b7-bd18-f6e74ae3a25c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:08.171876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80c8ac75-7ffa-42b7-bd18-f6e74ae3a25c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:08.172673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80c8ac75-7ffa-42b7-bd18-f6e74ae3a25c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:08.173150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-80c8ac75-7ffa-42b7-bd18-f6e74ae3a25c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:08.177577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:44:08.307932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-80c8ac75-7ffa-42b7-bd18-f6e74ae3a25c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:08.317778 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-80c8ac75-7ffa-42b7-bd18-f6e74ae3a25c tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 200 len: 1360 microversion: 2.1 time: 0.158641 Jul 28 04:44:08.318372 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4877/7327] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:08 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:44:08.686282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-bd98ffe4-76a7-42f6-a3b6-2cc693728eac req-410cfdf5-ef24-4de6-837e-844b99270c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c306d549-8a03-482b-967a-aa80f1a0a8d4", "tag": "f0f0a9c3-1f66-4634-b02c-321b7446c375"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:44:08.710896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bd98ffe4-76a7-42f6-a3b6-2cc693728eac req-410cfdf5-ef24-4de6-837e-844b99270c5e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:08.711486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bd98ffe4-76a7-42f6-a3b6-2cc693728eac req-410cfdf5-ef24-4de6-837e-844b99270c5e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:08.725551 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-bd98ffe4-76a7-42f6-a3b6-2cc693728eac req-410cfdf5-ef24-4de6-837e-844b99270c5e service nova] Creating event network-changed:f0f0a9c3-1f66-4634-b02c-321b7446c375 for instance c306d549-8a03-482b-967a-aa80f1a0a8d4 on n-h2-826756-3 Jul 28 04:44:08.730767 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-bd98ffe4-76a7-42f6-a3b6-2cc693728eac req-410cfdf5-ef24-4de6-837e-844b99270c5e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052031 Jul 28 04:44:08.731393 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4878/7328] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:44:09.340976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-73daeda0-3afe-49cb-be39-f4698e0d7b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:09.341671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-73daeda0-3afe-49cb-be39-f4698e0d7b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:09.349076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73daeda0-3afe-49cb-be39-f4698e0d7b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:09.349549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73daeda0-3afe-49cb-be39-f4698e0d7b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:09.350331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73daeda0-3afe-49cb-be39-f4698e0d7b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:09.350930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-73daeda0-3afe-49cb-be39-f4698e0d7b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:09.483468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-73daeda0-3afe-49cb-be39-f4698e0d7b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:09.492134 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-73daeda0-3afe-49cb-be39-f4698e0d7b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 200 len: 1360 microversion: 2.1 time: 0.156376 Jul 28 04:44:09.492762 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4879/7329] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:09 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:44:10.513402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d282c3c2-7ceb-450b-8dbe-10618fa1297d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:10.514093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d282c3c2-7ceb-450b-8dbe-10618fa1297d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:10.521321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d282c3c2-7ceb-450b-8dbe-10618fa1297d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:10.521792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d282c3c2-7ceb-450b-8dbe-10618fa1297d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:10.522635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d282c3c2-7ceb-450b-8dbe-10618fa1297d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:10.523086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d282c3c2-7ceb-450b-8dbe-10618fa1297d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:10.663365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d282c3c2-7ceb-450b-8dbe-10618fa1297d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:10.671378 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d282c3c2-7ceb-450b-8dbe-10618fa1297d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 200 len: 1360 microversion: 2.1 time: 0.161990 Jul 28 04:44:10.672258 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4880/7330] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:10 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:44:11.693187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f68b8c5a-a92a-4881-bb46-d4d5b29f684d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:11.693882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f68b8c5a-a92a-4881-bb46-d4d5b29f684d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:11.701461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f68b8c5a-a92a-4881-bb46-d4d5b29f684d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:11.701935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f68b8c5a-a92a-4881-bb46-d4d5b29f684d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:11.702739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f68b8c5a-a92a-4881-bb46-d4d5b29f684d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:11.703202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f68b8c5a-a92a-4881-bb46-d4d5b29f684d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:11.843686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f68b8c5a-a92a-4881-bb46-d4d5b29f684d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:11.853059 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f68b8c5a-a92a-4881-bb46-d4d5b29f684d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 200 len: 1360 microversion: 2.1 time: 0.164037 Jul 28 04:44:11.853650 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4881/7331] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:11 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 1360 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:44:12.877209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4070447b-5796-4fd4-9e1c-245d9e47b8c3 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:12.878028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4070447b-5796-4fd4-9e1c-245d9e47b8c3 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:12.887350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4070447b-5796-4fd4-9e1c-245d9e47b8c3 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:12.887810 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4070447b-5796-4fd4-9e1c-245d9e47b8c3 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:12.888620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4070447b-5796-4fd4-9e1c-245d9e47b8c3 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:12.889067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4070447b-5796-4fd4-9e1c-245d9e47b8c3 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:13.031575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4070447b-5796-4fd4-9e1c-245d9e47b8c3 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:13.039886 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4070447b-5796-4fd4-9e1c-245d9e47b8c3 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 200 len: 1360 microversion: 2.1 time: 0.168332 Jul 28 04:44:13.040532 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4882/7332] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:12 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 1360 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:44:13.647092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4bb0bf10-c320-4afb-aabd-cea88b851106 req-86f6db71-5412-4d06-9219-60fc9b9d7b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c306d549-8a03-482b-967a-aa80f1a0a8d4", "name": "network-vif-plugged", "status": "completed", "tag": "f0f0a9c3-1f66-4634-b02c-321b7446c375"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:44:13.657527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4bb0bf10-c320-4afb-aabd-cea88b851106 req-86f6db71-5412-4d06-9219-60fc9b9d7b03 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:13.657983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4bb0bf10-c320-4afb-aabd-cea88b851106 req-86f6db71-5412-4d06-9219-60fc9b9d7b03 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:13.670056 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4bb0bf10-c320-4afb-aabd-cea88b851106 req-86f6db71-5412-4d06-9219-60fc9b9d7b03 service nova] Creating event network-vif-plugged:f0f0a9c3-1f66-4634-b02c-321b7446c375 for instance c306d549-8a03-482b-967a-aa80f1a0a8d4 on n-h2-826756-3 Jul 28 04:44:13.675004 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4bb0bf10-c320-4afb-aabd-cea88b851106 req-86f6db71-5412-4d06-9219-60fc9b9d7b03 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031730 Jul 28 04:44:13.675627 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4883/7333] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:44:14.068150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cde91ee6-0c9e-41b1-8c73-766ac57d081e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:14.068873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cde91ee6-0c9e-41b1-8c73-766ac57d081e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:14.078542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cde91ee6-0c9e-41b1-8c73-766ac57d081e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:14.079256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cde91ee6-0c9e-41b1-8c73-766ac57d081e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:14.080127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cde91ee6-0c9e-41b1-8c73-766ac57d081e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:14.080714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cde91ee6-0c9e-41b1-8c73-766ac57d081e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:14.228149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cde91ee6-0c9e-41b1-8c73-766ac57d081e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:14.236617 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cde91ee6-0c9e-41b1-8c73-766ac57d081e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 200 len: 1360 microversion: 2.1 time: 0.178452 Jul 28 04:44:14.237205 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4884/7334] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:14 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 1360 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:44:15.257721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc58980f-a435-419e-b45f-1c874a60188a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:15.258578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dc58980f-a435-419e-b45f-1c874a60188a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:15.265698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc58980f-a435-419e-b45f-1c874a60188a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:15.266159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc58980f-a435-419e-b45f-1c874a60188a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:15.266943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc58980f-a435-419e-b45f-1c874a60188a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:15.267373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc58980f-a435-419e-b45f-1c874a60188a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:15.398276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dc58980f-a435-419e-b45f-1c874a60188a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:15.406628 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc58980f-a435-419e-b45f-1c874a60188a tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 200 len: 1552 microversion: 2.1 time: 0.152922 Jul 28 04:44:15.407206 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4885/7335] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:15 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:44:15.427823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-32b9d489-d876-47b9-ba86-3eea4c283882 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:15.428484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-32b9d489-d876-47b9-ba86-3eea4c283882 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:15.434742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32b9d489-d876-47b9-ba86-3eea4c283882 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:15.435199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32b9d489-d876-47b9-ba86-3eea4c283882 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:15.435974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32b9d489-d876-47b9-ba86-3eea4c283882 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:15.436464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32b9d489-d876-47b9-ba86-3eea4c283882 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:15.580174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-32b9d489-d876-47b9-ba86-3eea4c283882 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:15.588580 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-32b9d489-d876-47b9-ba86-3eea4c283882 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 200 len: 1552 microversion: 2.1 time: 0.164399 Jul 28 04:44:15.589142 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4886/7336] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:15 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:44:17.093065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e95e415-ab8b-40e3-acad-75d7c9f04b67 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f81b5616-8f2d-439f-b960-07383d27f71b"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:44:17.095484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0e95e415-ab8b-40e3-acad-75d7c9f04b67 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:17.097878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:44:17.098517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:44:17.105466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e95e415-ab8b-40e3-acad-75d7c9f04b67 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:17.105921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e95e415-ab8b-40e3-acad-75d7c9f04b67 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:17.106694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e95e415-ab8b-40e3-acad-75d7c9f04b67 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:17.107139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e95e415-ab8b-40e3-acad-75d7c9f04b67 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:17.377493 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0e95e415-ab8b-40e3-acad-75d7c9f04b67 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "POST /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288444 Jul 28 04:44:17.378140 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4887/7337] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 04:44:17 2022] POST /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:44:28.150463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:44:28.151475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:44:28.155841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc042f11-e673-4c1d-8c43-850bf0b893b7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:28.156459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cc042f11-e673-4c1d-8c43-850bf0b893b7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:28.165434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc042f11-e673-4c1d-8c43-850bf0b893b7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:28.165891 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc042f11-e673-4c1d-8c43-850bf0b893b7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:28.166648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc042f11-e673-4c1d-8c43-850bf0b893b7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:28.167092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc042f11-e673-4c1d-8c43-850bf0b893b7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:28.256937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-cc042f11-e673-4c1d-8c43-850bf0b893b7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lazy-loading 'services' on Instance uuid c306d549-8a03-482b-967a-aa80f1a0a8d4 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:44:28.335315 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cc042f11-e673-4c1d-8c43-850bf0b893b7 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments/f81b5616-8f2d-439f-b960-07383d27f71b" status: 202 len: 0 microversion: 2.1 time: 0.186696 Jul 28 04:44:28.336200 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4888/7338] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:44:28 2022] DELETE /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments/f81b5616-8f2d-439f-b960-07383d27f71b => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:44:28.345428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4e3c7b0-2b8f-4a01-bf54-cc3cd7c933ae tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:28.348252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d4e3c7b0-2b8f-4a01-bf54-cc3cd7c933ae tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:28.354990 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4e3c7b0-2b8f-4a01-bf54-cc3cd7c933ae tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:28.355452 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4e3c7b0-2b8f-4a01-bf54-cc3cd7c933ae tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:28.356241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4e3c7b0-2b8f-4a01-bf54-cc3cd7c933ae tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:28.356715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4e3c7b0-2b8f-4a01-bf54-cc3cd7c933ae tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:28.388236 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d4e3c7b0-2b8f-4a01-bf54-cc3cd7c933ae tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046984 Jul 28 04:44:28.388870 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4889/7339] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:44:28 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:44:29.401309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a96645e9-07eb-4e27-b81d-3691c9d9a2b1 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:29.403481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a96645e9-07eb-4e27-b81d-3691c9d9a2b1 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:29.410952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a96645e9-07eb-4e27-b81d-3691c9d9a2b1 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:29.411415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a96645e9-07eb-4e27-b81d-3691c9d9a2b1 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:29.412201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a96645e9-07eb-4e27-b81d-3691c9d9a2b1 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:29.412713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a96645e9-07eb-4e27-b81d-3691c9d9a2b1 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:29.444543 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a96645e9-07eb-4e27-b81d-3691c9d9a2b1 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047307 Jul 28 04:44:29.445111 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4890/7340] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:44:29 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:44:30.457743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-131fbd45-62ac-4ae3-806c-f27a127a8b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:30.460027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-131fbd45-62ac-4ae3-806c-f27a127a8b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:30.467429 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-131fbd45-62ac-4ae3-806c-f27a127a8b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:30.467933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-131fbd45-62ac-4ae3-806c-f27a127a8b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:30.468791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-131fbd45-62ac-4ae3-806c-f27a127a8b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:30.469283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-131fbd45-62ac-4ae3-806c-f27a127a8b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:30.503900 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-131fbd45-62ac-4ae3-806c-f27a127a8b0d tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050446 Jul 28 04:44:30.504540 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4891/7341] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:44:30 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:44:31.517100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4801871-5b58-4aef-8818-f48bd5003e2e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:31.519407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4801871-5b58-4aef-8818-f48bd5003e2e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:31.526961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4801871-5b58-4aef-8818-f48bd5003e2e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:31.527432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4801871-5b58-4aef-8818-f48bd5003e2e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:31.528235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4801871-5b58-4aef-8818-f48bd5003e2e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:31.528713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4801871-5b58-4aef-8818-f48bd5003e2e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:31.564587 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4801871-5b58-4aef-8818-f48bd5003e2e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051418 Jul 28 04:44:31.565340 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4892/7342] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:44:31 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:44:32.577394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-31ec9e3d-6857-4d26-b678-2044e47852b1 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:32.579783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-31ec9e3d-6857-4d26-b678-2044e47852b1 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:32.587155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31ec9e3d-6857-4d26-b678-2044e47852b1 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:32.587624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31ec9e3d-6857-4d26-b678-2044e47852b1 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:32.588427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31ec9e3d-6857-4d26-b678-2044e47852b1 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:32.588901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-31ec9e3d-6857-4d26-b678-2044e47852b1 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:32.623784 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-31ec9e3d-6857-4d26-b678-2044e47852b1 tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050404 Jul 28 04:44:32.624384 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4893/7343] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:44:32 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:44:33.637503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5763fa64-1a73-4078-949e-a348b8a060cf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:33.640882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5763fa64-1a73-4078-949e-a348b8a060cf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:33.650884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5763fa64-1a73-4078-949e-a348b8a060cf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:33.651353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5763fa64-1a73-4078-949e-a348b8a060cf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:33.652212 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5763fa64-1a73-4078-949e-a348b8a060cf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:33.652701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5763fa64-1a73-4078-949e-a348b8a060cf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:33.682907 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5763fa64-1a73-4078-949e-a348b8a060cf tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049922 Jul 28 04:44:33.683480 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4894/7344] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:44:33 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:44:33.693804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-56f027fb-b829-40ff-bc1b-324a8b78ae8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:33.694314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-56f027fb-b829-40ff-bc1b-324a8b78ae8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:33.700692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56f027fb-b829-40ff-bc1b-324a8b78ae8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:33.701154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56f027fb-b829-40ff-bc1b-324a8b78ae8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:33.701935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56f027fb-b829-40ff-bc1b-324a8b78ae8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:33.702384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56f027fb-b829-40ff-bc1b-324a8b78ae8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:33.783796 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-56f027fb-b829-40ff-bc1b-324a8b78ae8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] HTTP exception thrown: Instance c306d549-8a03-482b-967a-aa80f1a0a8d4 is not attached to volume f81b5616-8f2d-439f-b960-07383d27f71b Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-56f027fb-b829-40ff-bc1b-324a8b78ae8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Request method failure captured: Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments/f81b5616-8f2d-439f-b960-07383d27f71b HTTP/1.1 Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hPI8JXbktDtXaL8bxCbbHNASO-DAJy1bo5OtRJ67jTHj-0oavYWnQ3_YhCehjVGLLSadcZ5njJ0oNEgVZwB4QTXjvzyluf4LUhQDkL3AufEuqBAHo03UNlsG7bWjmUnMbmHp2b0yKmQox-vY_JM1HVrgizfkP-rprvBdOFvFIDiWWo Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: e2f8cdeb2de043118a8e5d5eb06dc092 Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f8cdeb2de043118a8e5d5eb06dc092"}]}] Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: e2f8cdeb2de043118a8e5d5eb06dc092 Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestEncryptedCinderVolumes-1212740026-project Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 30cf2e3582d640679467e0430b46a749 Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestEncryptedCinderVolumes-1212740026-project Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c306d549-8a03-482b-967a-aa80f1a0a8d4 is not attached to volume f81b5616-8f2d-439f-b960-07383d27f71b Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': 'c306d549-8a03-482b-967a-aa80f1a0a8d4', 'id': 'f81b5616-8f2d-439f-b960-07383d27f71b'} Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f81b5616-8f2d-439f-b960-07383d27f71b. Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c306d549-8a03-482b-967a-aa80f1a0a8d4 is not attached to volume f81b5616-8f2d-439f-b960-07383d27f71b Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:44:33.785473 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:44:33.789980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:44:33.789980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:44:33.789980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c306d549-8a03-482b-967a-aa80f1a0a8d4 is not attached to volume f81b5616-8f2d-439f-b960-07383d27f71b Jul 28 04:44:33.789980 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:33.789980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-56f027fb-b829-40ff-bc1b-324a8b78ae8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Returning 404 to user: Instance c306d549-8a03-482b-967a-aa80f1a0a8d4 is not attached to volume f81b5616-8f2d-439f-b960-07383d27f71b {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:44:33.789980 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-56f027fb-b829-40ff-bc1b-324a8b78ae8b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments/f81b5616-8f2d-439f-b960-07383d27f71b" status: 404 len: 154 microversion: 2.1 time: 0.096965 Jul 28 04:44:33.789980 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4895/7345] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:44:33 2022] DELETE /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4/os-volume_attachments/f81b5616-8f2d-439f-b960-07383d27f71b => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:44:37.150931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4efec916-79d3-4fa6-afd3-e66a9864150e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:37.151590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4efec916-79d3-4fa6-afd3-e66a9864150e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:37.160341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4efec916-79d3-4fa6-afd3-e66a9864150e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:37.160886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4efec916-79d3-4fa6-afd3-e66a9864150e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:37.161755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4efec916-79d3-4fa6-afd3-e66a9864150e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:37.162602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4efec916-79d3-4fa6-afd3-e66a9864150e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:37.187704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4efec916-79d3-4fa6-afd3-e66a9864150e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:44:37.275625 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4efec916-79d3-4fa6-afd3-e66a9864150e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 204 len: 0 microversion: 2.1 time: 0.127846 Jul 28 04:44:37.279479 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4896/7346] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:44:37 2022] DELETE /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:44:37.285958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e83d8fe3-e331-4b80-89af-d212c1feb5cd tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:37.287219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e83d8fe3-e331-4b80-89af-d212c1feb5cd tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:37.294945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e83d8fe3-e331-4b80-89af-d212c1feb5cd tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:37.295405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e83d8fe3-e331-4b80-89af-d212c1feb5cd tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:37.296941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e83d8fe3-e331-4b80-89af-d212c1feb5cd tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:37.297395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e83d8fe3-e331-4b80-89af-d212c1feb5cd tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:37.453811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e83d8fe3-e331-4b80-89af-d212c1feb5cd tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:37.463031 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e83d8fe3-e331-4b80-89af-d212c1feb5cd tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 200 len: 1558 microversion: 2.1 time: 0.181976 Jul 28 04:44:37.463644 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4897/7347] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:37 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:44:38.486001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f34afe81-2fd1-4064-a983-d9d697f4628e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:38.486732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f34afe81-2fd1-4064-a983-d9d697f4628e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:38.494684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f34afe81-2fd1-4064-a983-d9d697f4628e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:38.495135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f34afe81-2fd1-4064-a983-d9d697f4628e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:38.495931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f34afe81-2fd1-4064-a983-d9d697f4628e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:38.496403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f34afe81-2fd1-4064-a983-d9d697f4628e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:38.644771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f34afe81-2fd1-4064-a983-d9d697f4628e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:38.653401 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f34afe81-2fd1-4064-a983-d9d697f4628e tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 200 len: 1558 microversion: 2.1 time: 0.171487 Jul 28 04:44:38.654013 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4898/7348] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:38 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:44:39.675142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1432263a-25c9-47a1-9ef6-436f5f0463eb tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:39.675851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1432263a-25c9-47a1-9ef6-436f5f0463eb tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:39.685689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1432263a-25c9-47a1-9ef6-436f5f0463eb tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:39.686148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1432263a-25c9-47a1-9ef6-436f5f0463eb tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:39.686968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1432263a-25c9-47a1-9ef6-436f5f0463eb tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:39.687409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1432263a-25c9-47a1-9ef6-436f5f0463eb tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:39.769483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1432263a-25c9-47a1-9ef6-436f5f0463eb tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cf2e3582d640679467e0430b46a749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f8cdeb2de043118a8e5d5eb06dc092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:44:39.779638 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1432263a-25c9-47a1-9ef6-436f5f0463eb tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 200 len: 1516 microversion: 2.1 time: 0.108429 Jul 28 04:44:39.780245 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4899/7349] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:39 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 1516 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:44:39.868281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4435bc18-4c11-41cb-bcad-20b8a6e6f5b4 req-9546ee75-481d-44e2-bc07-5113c20599a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c306d549-8a03-482b-967a-aa80f1a0a8d4", "name": "network-vif-deleted", "tag": "f0f0a9c3-1f66-4634-b02c-321b7446c375"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:44:39.881959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4435bc18-4c11-41cb-bcad-20b8a6e6f5b4 req-9546ee75-481d-44e2-bc07-5113c20599a8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:39.882436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4435bc18-4c11-41cb-bcad-20b8a6e6f5b4 req-9546ee75-481d-44e2-bc07-5113c20599a8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:39.896988 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4435bc18-4c11-41cb-bcad-20b8a6e6f5b4 req-9546ee75-481d-44e2-bc07-5113c20599a8 service nova] Creating event network-vif-deleted:f0f0a9c3-1f66-4634-b02c-321b7446c375 for instance c306d549-8a03-482b-967a-aa80f1a0a8d4 on n-h2-826756-3 Jul 28 04:44:39.902454 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4435bc18-4c11-41cb-bcad-20b8a6e6f5b4 req-9546ee75-481d-44e2-bc07-5113c20599a8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120880 Jul 28 04:44:39.903076 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4900/7350] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:44:40.808247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c3e896e-8707-48cb-8df0-c6f03a94188b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:40.809397 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5c3e896e-8707-48cb-8df0-c6f03a94188b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] [instance: c306d549-8a03-482b-967a-aa80f1a0a8d4] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:44:40.816899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c3e896e-8707-48cb-8df0-c6f03a94188b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:40.817366 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c3e896e-8707-48cb-8df0-c6f03a94188b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:40.818153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c3e896e-8707-48cb-8df0-c6f03a94188b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:44:40.818604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5c3e896e-8707-48cb-8df0-c6f03a94188b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:44:40.833650 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-5c3e896e-8707-48cb-8df0-c6f03a94188b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] HTTP exception thrown: Instance c306d549-8a03-482b-967a-aa80f1a0a8d4 could not be found. Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c3e896e-8707-48cb-8df0-c6f03a94188b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Request method failure captured: Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 HTTP/1.1 Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hPI8JXbktDtXaL8bxCbbHNASO-DAJy1bo5OtRJ67jTHj-0oavYWnQ3_YhCehjVGLLSadcZ5njJ0oNEgVZwB4QTXjvzyluf4LUhQDkL3AufEuqBAHo03UNlsG7bWjmUnMbmHp2b0yKmQox-vY_JM1HVrgizfkP-rprvBdOFvFIDiWWo Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: e2f8cdeb2de043118a8e5d5eb06dc092 Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e2f8cdeb2de043118a8e5d5eb06dc092"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e2f8cdeb2de043118a8e5d5eb06dc092"}]}] Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: e2f8cdeb2de043118a8e5d5eb06dc092 Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1212740026 Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestEncryptedCinderVolumes-1212740026-project Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 30cf2e3582d640679467e0430b46a749 Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestEncryptedCinderVolumes-1212740026-project Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance c306d549-8a03-482b-967a-aa80f1a0a8d4 could not be found. Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'c306d549-8a03-482b-967a-aa80f1a0a8d4'} Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c306d549-8a03-482b-967a-aa80f1a0a8d4 could not be found. Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c306d549-8a03-482b-967a-aa80f1a0a8d4 could not be found. Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:44:40.835581 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:40.840213 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:44:40.840213 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:44:40.840213 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:44:40.840213 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:44:40.840213 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:44:40.840213 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c306d549-8a03-482b-967a-aa80f1a0a8d4 could not be found. Jul 28 04:44:40.840213 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:44:40.840213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5c3e896e-8707-48cb-8df0-c6f03a94188b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Returning 404 to user: Instance c306d549-8a03-482b-967a-aa80f1a0a8d4 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:44:40.840213 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5c3e896e-8707-48cb-8df0-c6f03a94188b tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4" status: 404 len: 111 microversion: 2.1 time: 0.036940 Jul 28 04:44:40.841404 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4901/7351] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:44:40 2022] GET /compute/v2.1/servers/c306d549-8a03-482b-967a-aa80f1a0a8d4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:44:40.847001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86cabf34-ef09-4136-b803-bdac211cbbef tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] Calling method '.version_select at 0x7ffa66ea2280>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:44:40.868490 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-86cabf34-ef09-4136-b803-bdac211cbbef tempest-TestEncryptedCinderVolumes-1212740026 tempest-TestEncryptedCinderVolumes-1212740026-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-166130315" status: 202 len: 0 microversion: 2.1 time: 0.025904 Jul 28 04:44:40.869282 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4902/7352] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Jul 28 04:44:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-166130315 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:45:05.845993 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:45:05.846990 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:45:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:45:07.703352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:45:07.704118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:45:07.708113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c5f2a72-de86-4971-bc53-2f7af21e2e9a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Action: 'create', calling method: .version_select at 0x7ffa66de7670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-929685283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6KXWsKwipg6KPTU8YPaZf8lhbOHuBMRWODXMcegxFj2xspq2xsAz70Qmx9gXbmENA9kSFk1rPrC6XwfXNb44A/y8uNgrEs09EZ2+qC1or6R6gqZaLAfVlePrF/KxnsmQ=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:45:07.728674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1c5f2a72-de86-4971-bc53-2f7af21e2e9a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Getting quotas for project a4752b99f8f54e409455a796474e5c89. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:45:07.733787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1c5f2a72-de86-4971-bc53-2f7af21e2e9a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Getting quotas for user 8451e4954caa4f909ff6719d08e69b50 and project a4752b99f8f54e409455a796474e5c89. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:45:07.760850 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c5f2a72-de86-4971-bc53-2f7af21e2e9a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.059250 Jul 28 04:45:07.761678 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4903/7353] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:45:07 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:45:07.822176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2003872921", "imageRef": "3a548c9f-d308-431e-88da-3b30920fcf2c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-929685283", "networks": [{"uuid": "c86b197e-caa1-453a-ad37-7ab54585bfe7"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:45:07.878595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] validate_networks() for [('c86b197e-caa1-453a-ad37-7ab54585bfe7', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:45:08.293473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:45:08.294219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:45:08.294877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:45:08.295295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:45:08.295908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:45:08.307580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:08.308038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:08.308979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:08.309318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:08.328690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Getting quotas for project a4752b99f8f54e409455a796474e5c89. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:45:08.335097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Getting quotas for user 8451e4954caa4f909ff6719d08e69b50 and project a4752b99f8f54e409455a796474e5c89. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:45:08.349910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:45:08.352197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a548c9f-d308-431e-88da-3b30920fcf2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:45:08.398992 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-198e8e17-49e6-4864-b331-a0f90d8b7264 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580916 Jul 28 04:45:08.399629 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4904/7354] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:45:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:45:08.410264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-886c31d0-7932-4b20-8da8-0799a4ddd325 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:08.410968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-886c31d0-7932-4b20-8da8-0799a4ddd325 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:08.470617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-886c31d0-7932-4b20-8da8-0799a4ddd325 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:08.479629 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-886c31d0-7932-4b20-8da8-0799a4ddd325 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1258 microversion: 2.1 time: 0.073107 Jul 28 04:45:08.480440 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4905/7355] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:08 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:45:09.502185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-694c8ea8-ea80-4027-9813-355d9f0dce3d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:09.502875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-694c8ea8-ea80-4027-9813-355d9f0dce3d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:09.511327 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-694c8ea8-ea80-4027-9813-355d9f0dce3d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:09.511799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-694c8ea8-ea80-4027-9813-355d9f0dce3d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:09.512604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-694c8ea8-ea80-4027-9813-355d9f0dce3d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:09.513097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-694c8ea8-ea80-4027-9813-355d9f0dce3d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:09.581472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-694c8ea8-ea80-4027-9813-355d9f0dce3d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:09.591283 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-694c8ea8-ea80-4027-9813-355d9f0dce3d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1316 microversion: 2.1 time: 0.093693 Jul 28 04:45:09.592394 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4906/7356] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:09 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1316 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:45:10.614398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e942c596-146a-492f-a349-313037acf968 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:10.615095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e942c596-146a-492f-a349-313037acf968 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:10.622868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e942c596-146a-492f-a349-313037acf968 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:10.623335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e942c596-146a-492f-a349-313037acf968 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:10.624131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e942c596-146a-492f-a349-313037acf968 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:10.624600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e942c596-146a-492f-a349-313037acf968 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:10.767073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e942c596-146a-492f-a349-313037acf968 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:10.775641 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e942c596-146a-492f-a349-313037acf968 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1358 microversion: 2.1 time: 0.166001 Jul 28 04:45:10.776339 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4907/7357] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:10 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:45:11.798152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-95cf7b5a-2b31-41bb-908f-8e6672580b45 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:11.798895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-95cf7b5a-2b31-41bb-908f-8e6672580b45 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:11.807900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95cf7b5a-2b31-41bb-908f-8e6672580b45 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:11.808378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95cf7b5a-2b31-41bb-908f-8e6672580b45 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:11.809193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95cf7b5a-2b31-41bb-908f-8e6672580b45 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:11.809708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-95cf7b5a-2b31-41bb-908f-8e6672580b45 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:11.952314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-95cf7b5a-2b31-41bb-908f-8e6672580b45 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:11.967334 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-95cf7b5a-2b31-41bb-908f-8e6672580b45 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1358 microversion: 2.1 time: 0.173536 Jul 28 04:45:11.968197 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4908/7358] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:11 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:45:12.989226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b226790b-e231-4ef4-914a-cf37e2b16a38 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:12.989882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b226790b-e231-4ef4-914a-cf37e2b16a38 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:12.997715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b226790b-e231-4ef4-914a-cf37e2b16a38 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:12.998304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b226790b-e231-4ef4-914a-cf37e2b16a38 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:12.999185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b226790b-e231-4ef4-914a-cf37e2b16a38 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:12.999711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b226790b-e231-4ef4-914a-cf37e2b16a38 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:13.153273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b226790b-e231-4ef4-914a-cf37e2b16a38 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:13.161438 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b226790b-e231-4ef4-914a-cf37e2b16a38 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1358 microversion: 2.1 time: 0.176142 Jul 28 04:45:13.175271 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4909/7359] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:12 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:45:14.183890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce4fef20-5dc7-4901-8eff-1f8d1dafb2e5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:14.184953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ce4fef20-5dc7-4901-8eff-1f8d1dafb2e5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:14.194456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce4fef20-5dc7-4901-8eff-1f8d1dafb2e5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:14.194456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce4fef20-5dc7-4901-8eff-1f8d1dafb2e5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:14.195921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce4fef20-5dc7-4901-8eff-1f8d1dafb2e5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:14.196390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce4fef20-5dc7-4901-8eff-1f8d1dafb2e5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:14.350055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ce4fef20-5dc7-4901-8eff-1f8d1dafb2e5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:14.381090 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce4fef20-5dc7-4901-8eff-1f8d1dafb2e5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1358 microversion: 2.1 time: 0.201892 Jul 28 04:45:14.382116 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4910/7360] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:14 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:45:15.403026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-07bf8bca-3a00-4839-9968-d106acbdb8d9 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:15.403682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-07bf8bca-3a00-4839-9968-d106acbdb8d9 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:15.411050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07bf8bca-3a00-4839-9968-d106acbdb8d9 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:15.411521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07bf8bca-3a00-4839-9968-d106acbdb8d9 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:15.412324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07bf8bca-3a00-4839-9968-d106acbdb8d9 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:15.412806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-07bf8bca-3a00-4839-9968-d106acbdb8d9 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:15.555214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-07bf8bca-3a00-4839-9968-d106acbdb8d9 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:15.564321 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-07bf8bca-3a00-4839-9968-d106acbdb8d9 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1358 microversion: 2.1 time: 0.165308 Jul 28 04:45:15.564980 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4911/7361] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:15 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:45:16.585657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b97d3f50-69bc-4220-8ddd-1c6052536ef0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:16.586565 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b97d3f50-69bc-4220-8ddd-1c6052536ef0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:16.594607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b97d3f50-69bc-4220-8ddd-1c6052536ef0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:16.595138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b97d3f50-69bc-4220-8ddd-1c6052536ef0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:16.595970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b97d3f50-69bc-4220-8ddd-1c6052536ef0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:16.596928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b97d3f50-69bc-4220-8ddd-1c6052536ef0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:16.740664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b97d3f50-69bc-4220-8ddd-1c6052536ef0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:16.750176 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b97d3f50-69bc-4220-8ddd-1c6052536ef0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1358 microversion: 2.1 time: 0.168365 Jul 28 04:45:16.751502 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4912/7362] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:16 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:45:17.771536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-84cbcf16-04ce-4712-ac81-ad110266f7d1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:17.772235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-84cbcf16-04ce-4712-ac81-ad110266f7d1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:17.779850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84cbcf16-04ce-4712-ac81-ad110266f7d1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:17.780320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84cbcf16-04ce-4712-ac81-ad110266f7d1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:17.781146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84cbcf16-04ce-4712-ac81-ad110266f7d1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:17.781685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84cbcf16-04ce-4712-ac81-ad110266f7d1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:17.917987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-84cbcf16-04ce-4712-ac81-ad110266f7d1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:17.926478 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-84cbcf16-04ce-4712-ac81-ad110266f7d1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1358 microversion: 2.1 time: 0.158936 Jul 28 04:45:17.927138 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4913/7363] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:17 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:45:18.344900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-8163fbec-3428-49f7-acba-add1f2b126d8 req-3d706818-75e5-42cd-933e-c32be5228ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5727109a-f58d-48a6-8fac-6a72a52953f5", "tag": "4c5b0279-580f-4d02-960e-1378fb408828"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:45:18.352861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:45:18.362599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8163fbec-3428-49f7-acba-add1f2b126d8 req-3d706818-75e5-42cd-933e-c32be5228ca4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:18.366849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8163fbec-3428-49f7-acba-add1f2b126d8 req-3d706818-75e5-42cd-933e-c32be5228ca4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:18.378733 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-8163fbec-3428-49f7-acba-add1f2b126d8 req-3d706818-75e5-42cd-933e-c32be5228ca4 service nova] Creating event network-changed:4c5b0279-580f-4d02-960e-1378fb408828 for instance 5727109a-f58d-48a6-8fac-6a72a52953f5 on n-h1-826756-3 Jul 28 04:45:18.384442 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-8163fbec-3428-49f7-acba-add1f2b126d8 req-3d706818-75e5-42cd-933e-c32be5228ca4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043813 Jul 28 04:45:18.386024 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4914/7364] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:45:18.950074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:45:18.957834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4025b220-05ef-41cc-b898-2997510a5b26 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:18.959081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4025b220-05ef-41cc-b898-2997510a5b26 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:18.966033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4025b220-05ef-41cc-b898-2997510a5b26 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:18.966502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4025b220-05ef-41cc-b898-2997510a5b26 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:18.967290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4025b220-05ef-41cc-b898-2997510a5b26 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:18.967738 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4025b220-05ef-41cc-b898-2997510a5b26 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:19.427093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4025b220-05ef-41cc-b898-2997510a5b26 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:19.435524 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4025b220-05ef-41cc-b898-2997510a5b26 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1358 microversion: 2.1 time: 0.486498 Jul 28 04:45:19.436109 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4915/7365] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:18 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1358 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:45:20.457004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c007ea66-db61-4512-af8c-feb5f5afed96 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:20.457715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c007ea66-db61-4512-af8c-feb5f5afed96 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:20.465106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c007ea66-db61-4512-af8c-feb5f5afed96 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:20.465575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c007ea66-db61-4512-af8c-feb5f5afed96 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:20.466360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c007ea66-db61-4512-af8c-feb5f5afed96 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:20.466846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c007ea66-db61-4512-af8c-feb5f5afed96 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:20.604972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c007ea66-db61-4512-af8c-feb5f5afed96 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:20.617416 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c007ea66-db61-4512-af8c-feb5f5afed96 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1358 microversion: 2.1 time: 0.164385 Jul 28 04:45:20.618142 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4916/7366] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:20 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:45:21.642249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1658b261-e8fa-4c89-8f21-4efe63482036 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:21.642920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1658b261-e8fa-4c89-8f21-4efe63482036 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:21.649748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1658b261-e8fa-4c89-8f21-4efe63482036 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:21.650313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1658b261-e8fa-4c89-8f21-4efe63482036 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:21.651117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1658b261-e8fa-4c89-8f21-4efe63482036 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:21.651571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1658b261-e8fa-4c89-8f21-4efe63482036 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:21.790210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1658b261-e8fa-4c89-8f21-4efe63482036 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:21.798761 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1658b261-e8fa-4c89-8f21-4efe63482036 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1358 microversion: 2.1 time: 0.160738 Jul 28 04:45:21.799348 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4917/7367] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:21 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:45:22.823663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f8b2864-9729-48ef-8627-9518c591ab5e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:22.824796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f8b2864-9729-48ef-8627-9518c591ab5e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:22.836620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f8b2864-9729-48ef-8627-9518c591ab5e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:22.837383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f8b2864-9729-48ef-8627-9518c591ab5e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:22.838654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f8b2864-9729-48ef-8627-9518c591ab5e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:22.839405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f8b2864-9729-48ef-8627-9518c591ab5e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:22.978716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f8b2864-9729-48ef-8627-9518c591ab5e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:22.986769 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f8b2864-9729-48ef-8627-9518c591ab5e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1358 microversion: 2.1 time: 0.169676 Jul 28 04:45:22.987362 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4918/7368] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:22 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:45:23.359554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-8ece1c7b-c47f-4e58-88ca-b7fecb530ad1 req-f1abb952-a9f0-4a4d-a81c-9a280c4ddc2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5727109a-f58d-48a6-8fac-6a72a52953f5", "name": "network-vif-plugged", "status": "completed", "tag": "4c5b0279-580f-4d02-960e-1378fb408828"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:45:23.369437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8ece1c7b-c47f-4e58-88ca-b7fecb530ad1 req-f1abb952-a9f0-4a4d-a81c-9a280c4ddc2b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:23.369850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8ece1c7b-c47f-4e58-88ca-b7fecb530ad1 req-f1abb952-a9f0-4a4d-a81c-9a280c4ddc2b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:23.381139 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-8ece1c7b-c47f-4e58-88ca-b7fecb530ad1 req-f1abb952-a9f0-4a4d-a81c-9a280c4ddc2b service nova] Creating event network-vif-plugged:4c5b0279-580f-4d02-960e-1378fb408828 for instance 5727109a-f58d-48a6-8fac-6a72a52953f5 on n-h1-826756-3 Jul 28 04:45:23.385954 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-8ece1c7b-c47f-4e58-88ca-b7fecb530ad1 req-f1abb952-a9f0-4a4d-a81c-9a280c4ddc2b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156977 Jul 28 04:45:23.386554 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4919/7369] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:45:24.013448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1e6746ec-b7af-4c00-b15e-0e79102f21ad tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:24.014346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1e6746ec-b7af-4c00-b15e-0e79102f21ad tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:24.022215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e6746ec-b7af-4c00-b15e-0e79102f21ad tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:24.022691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e6746ec-b7af-4c00-b15e-0e79102f21ad tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:24.023482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e6746ec-b7af-4c00-b15e-0e79102f21ad tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:24.023939 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1e6746ec-b7af-4c00-b15e-0e79102f21ad tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:24.187451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1e6746ec-b7af-4c00-b15e-0e79102f21ad tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:24.195411 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1e6746ec-b7af-4c00-b15e-0e79102f21ad tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1358 microversion: 2.1 time: 0.190717 Jul 28 04:45:24.196007 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4920/7370] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:24 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:45:25.220544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ab35685-6d81-4676-9351-1c376f905e32 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:25.221160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ab35685-6d81-4676-9351-1c376f905e32 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:25.228943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ab35685-6d81-4676-9351-1c376f905e32 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:25.229398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ab35685-6d81-4676-9351-1c376f905e32 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:25.230172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ab35685-6d81-4676-9351-1c376f905e32 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:25.230625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ab35685-6d81-4676-9351-1c376f905e32 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:25.373936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ab35685-6d81-4676-9351-1c376f905e32 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:25.385787 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ab35685-6d81-4676-9351-1c376f905e32 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1549 microversion: 2.1 time: 0.170776 Jul 28 04:45:25.386583 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4921/7371] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:25 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:45:25.406372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f075556d-d5e2-4eee-81e1-6d0189e3fcdb tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:25.407004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f075556d-d5e2-4eee-81e1-6d0189e3fcdb tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:25.413393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f075556d-d5e2-4eee-81e1-6d0189e3fcdb tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:25.413865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f075556d-d5e2-4eee-81e1-6d0189e3fcdb tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:25.414648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f075556d-d5e2-4eee-81e1-6d0189e3fcdb tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:25.415100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f075556d-d5e2-4eee-81e1-6d0189e3fcdb tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:25.575363 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f075556d-d5e2-4eee-81e1-6d0189e3fcdb tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:25.583870 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f075556d-d5e2-4eee-81e1-6d0189e3fcdb tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1549 microversion: 2.1 time: 0.181328 Jul 28 04:45:25.584478 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4922/7372] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:25 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1549 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:45:25.603835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6aeb0db9-0da9-48fb-ada6-4355feb094ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:25.608382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6aeb0db9-0da9-48fb-ada6-4355feb094ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:25.609252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6aeb0db9-0da9-48fb-ada6-4355feb094ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Searching by: {'deleted': False, 'project_id': 'a4752b99f8f54e409455a796474e5c89'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 04:45:25.614839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6aeb0db9-0da9-48fb-ada6-4355feb094ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:25.615300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6aeb0db9-0da9-48fb-ada6-4355feb094ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:25.616095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6aeb0db9-0da9-48fb-ada6-4355feb094ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:25.616602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6aeb0db9-0da9-48fb-ada6-4355feb094ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:25.641137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-6aeb0db9-0da9-48fb-ada6-4355feb094ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 04:45:25.643754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:45:25.669464 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6aeb0db9-0da9-48fb-ada6-4355feb094ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069066 Jul 28 04:45:25.670054 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4923/7373] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 04:45:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:45:25.681197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6dd58739-2c82-4e08-ac83-f4d45e1aa952 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:25.681812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6dd58739-2c82-4e08-ac83-f4d45e1aa952 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:25.687784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dd58739-2c82-4e08-ac83-f4d45e1aa952 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:25.688231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dd58739-2c82-4e08-ac83-f4d45e1aa952 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:25.689027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dd58739-2c82-4e08-ac83-f4d45e1aa952 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:25.689501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6dd58739-2c82-4e08-ac83-f4d45e1aa952 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:25.843729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6dd58739-2c82-4e08-ac83-f4d45e1aa952 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:25.852435 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6dd58739-2c82-4e08-ac83-f4d45e1aa952 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1549 microversion: 2.1 time: 0.174807 Jul 28 04:45:25.853014 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4924/7374] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:25 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:45:27.436130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a2fb7f6a-9e78-4b3a-9d92-f9844bbb45bd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c35d83be-831e-4b5b-879f-b1e64893bab1"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:45:27.438805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a2fb7f6a-9e78-4b3a-9d92-f9844bbb45bd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:27.445839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2fb7f6a-9e78-4b3a-9d92-f9844bbb45bd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:27.446384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2fb7f6a-9e78-4b3a-9d92-f9844bbb45bd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:27.447239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2fb7f6a-9e78-4b3a-9d92-f9844bbb45bd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:27.447745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a2fb7f6a-9e78-4b3a-9d92-f9844bbb45bd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:27.706262 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a2fb7f6a-9e78-4b3a-9d92-f9844bbb45bd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "POST /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274207 Jul 28 04:45:27.707038 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4925/7375] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 04:45:27 2022] POST /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:45:40.803647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:45:40.804554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:45:40.805253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:45:40.809578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cd42ddbe-dda7-4386-b0a3-c435ea16421e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:40.810312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cd42ddbe-dda7-4386-b0a3-c435ea16421e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:40.819364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd42ddbe-dda7-4386-b0a3-c435ea16421e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:40.819831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd42ddbe-dda7-4386-b0a3-c435ea16421e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:40.820634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd42ddbe-dda7-4386-b0a3-c435ea16421e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:40.821086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd42ddbe-dda7-4386-b0a3-c435ea16421e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:40.962997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cd42ddbe-dda7-4386-b0a3-c435ea16421e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:40.972054 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cd42ddbe-dda7-4386-b0a3-c435ea16421e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1595 microversion: 2.1 time: 0.170194 Jul 28 04:45:40.972667 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4926/7376] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:40 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1595 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:45:42.695214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c194965d-7084-492c-9a59-02ed9e0412a2 req-bc649662-c957-4f7d-82d3-5b02536e91fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5727109a-f58d-48a6-8fac-6a72a52953f5", "tag": "4c5b0279-580f-4d02-960e-1378fb408828"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:45:42.708635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c194965d-7084-492c-9a59-02ed9e0412a2 req-bc649662-c957-4f7d-82d3-5b02536e91fb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:42.709398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c194965d-7084-492c-9a59-02ed9e0412a2 req-bc649662-c957-4f7d-82d3-5b02536e91fb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:42.725545 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c194965d-7084-492c-9a59-02ed9e0412a2 req-bc649662-c957-4f7d-82d3-5b02536e91fb service nova] Creating event network-changed:4c5b0279-580f-4d02-960e-1378fb408828 for instance 5727109a-f58d-48a6-8fac-6a72a52953f5 on n-h1-826756-3 Jul 28 04:45:42.731183 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c194965d-7084-492c-9a59-02ed9e0412a2 req-bc649662-c957-4f7d-82d3-5b02536e91fb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040555 Jul 28 04:45:42.732340 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4927/7377] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:45:43.911312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d57e7ed1-2803-45d7-a3c7-528e86f39cac tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1523322713"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:45:43.911979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d57e7ed1-2803-45d7-a3c7-528e86f39cac tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:43.919056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d57e7ed1-2803-45d7-a3c7-528e86f39cac tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:43.919525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d57e7ed1-2803-45d7-a3c7-528e86f39cac tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:43.920308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d57e7ed1-2803-45d7-a3c7-528e86f39cac tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:43.920791 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d57e7ed1-2803-45d7-a3c7-528e86f39cac tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:44.067554 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.network.security_group_api [None req-d57e7ed1-2803-45d7-a3c7-528e86f39cac tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Adding security group 6cfc14b0-b21d-40bf-a2a5-3bcb8a3b02d4 to port 4c5b0279-580f-4d02-960e-1378fb408828 Jul 28 04:45:44.463529 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d57e7ed1-2803-45d7-a3c7-528e86f39cac tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "POST /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/action" status: 202 len: 0 microversion: 2.1 time: 0.558343 Jul 28 04:45:44.464165 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4928/7378] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:45:43 2022] POST /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:45:44.482973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f201a50a-6d18-4dc1-b745-aa6b22030553 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:45:44.484650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f201a50a-6d18-4dc1-b745-aa6b22030553 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:45:44.494645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f201a50a-6d18-4dc1-b745-aa6b22030553 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:44.495747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f201a50a-6d18-4dc1-b745-aa6b22030553 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:44.497357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f201a50a-6d18-4dc1-b745-aa6b22030553 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:44.499454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f201a50a-6d18-4dc1-b745-aa6b22030553 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:44.680605 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f201a50a-6d18-4dc1-b745-aa6b22030553 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:45:44.691816 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f201a50a-6d18-4dc1-b745-aa6b22030553 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1760 microversion: 2.1 time: 0.220935 Jul 28 04:45:44.692699 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4929/7379] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:45:44 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1760 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:45:44.752202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0990c21b-58db-42cc-a560-abb474f04e5b req-de78a762-b72c-4071-8ff7-90bac56e9e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5727109a-f58d-48a6-8fac-6a72a52953f5", "tag": "4c5b0279-580f-4d02-960e-1378fb408828"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:45:44.762927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0990c21b-58db-42cc-a560-abb474f04e5b req-de78a762-b72c-4071-8ff7-90bac56e9e7b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:45:44.763390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0990c21b-58db-42cc-a560-abb474f04e5b req-de78a762-b72c-4071-8ff7-90bac56e9e7b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:45:44.778580 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0990c21b-58db-42cc-a560-abb474f04e5b req-de78a762-b72c-4071-8ff7-90bac56e9e7b service nova] Creating event network-changed:4c5b0279-580f-4d02-960e-1378fb408828 for instance 5727109a-f58d-48a6-8fac-6a72a52953f5 on n-h1-826756-3 Jul 28 04:45:44.785881 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0990c21b-58db-42cc-a560-abb474f04e5b req-de78a762-b72c-4071-8ff7-90bac56e9e7b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091429 Jul 28 04:45:44.786624 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4930/7380] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:46:57.409694 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:46:57.410708 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:46:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:47:22.300108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=10 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:47:22.301070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=20 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:47:22.306570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15b62533-6252-484a-b173-bd79ca928de3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:47:22.309151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15b62533-6252-484a-b173-bd79ca928de3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:47:22.318056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15b62533-6252-484a-b173-bd79ca928de3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:47:22.318527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15b62533-6252-484a-b173-bd79ca928de3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:47:22.319321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15b62533-6252-484a-b173-bd79ca928de3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:47:22.319752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15b62533-6252-484a-b173-bd79ca928de3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:47:22.411963 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15b62533-6252-484a-b173-bd79ca928de3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "POST /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/action" status: 202 len: 0 microversion: 2.1 time: 0.114272 Jul 28 04:47:22.412638 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4931/7381] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:47:22 2022] POST /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:47:22.421569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c9221d4-3c3d-48c5-964f-8d16cfef4ef8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:47:22.422087 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c9221d4-3c3d-48c5-964f-8d16cfef4ef8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:47:22.429496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c9221d4-3c3d-48c5-964f-8d16cfef4ef8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:47:22.430015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c9221d4-3c3d-48c5-964f-8d16cfef4ef8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:47:22.430898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c9221d4-3c3d-48c5-964f-8d16cfef4ef8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:47:22.431354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c9221d4-3c3d-48c5-964f-8d16cfef4ef8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:47:22.596522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7c9221d4-3c3d-48c5-964f-8d16cfef4ef8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:47:22.606480 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7c9221d4-3c3d-48c5-964f-8d16cfef4ef8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1762 microversion: 2.1 time: 0.189170 Jul 28 04:47:22.607468 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4932/7382] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:47:22 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1762 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:47:23.629140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d74b7df3-781b-4326-b866-04a69e564095 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:47:23.629817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d74b7df3-781b-4326-b866-04a69e564095 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:47:23.638094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d74b7df3-781b-4326-b866-04a69e564095 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:47:23.638556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d74b7df3-781b-4326-b866-04a69e564095 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:47:23.639345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d74b7df3-781b-4326-b866-04a69e564095 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:47:23.639804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d74b7df3-781b-4326-b866-04a69e564095 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:47:23.791951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d74b7df3-781b-4326-b866-04a69e564095 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:47:23.800378 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d74b7df3-781b-4326-b866-04a69e564095 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1767 microversion: 2.1 time: 0.175388 Jul 28 04:47:23.800980 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4933/7383] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:47:23 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1767 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:47:24.822740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4b6ee0d6-f577-49c7-a1dc-c0142f0401c1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:47:24.823465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4b6ee0d6-f577-49c7-a1dc-c0142f0401c1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:47:24.830863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b6ee0d6-f577-49c7-a1dc-c0142f0401c1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:47:24.831331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b6ee0d6-f577-49c7-a1dc-c0142f0401c1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:47:24.832180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b6ee0d6-f577-49c7-a1dc-c0142f0401c1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:47:24.832670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4b6ee0d6-f577-49c7-a1dc-c0142f0401c1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:47:24.979959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4b6ee0d6-f577-49c7-a1dc-c0142f0401c1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:47:24.989140 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4b6ee0d6-f577-49c7-a1dc-c0142f0401c1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1760 microversion: 2.1 time: 0.170499 Jul 28 04:47:24.989700 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4934/7384] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:47:24 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1760 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:48:25.856990 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:48:25.857872 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:48:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:48:38.656979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:48:38.657874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:48:38.662242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e5674c67-e4a7-461a-b7ae-b821ff75011d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1523322713"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:48:38.662797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e5674c67-e4a7-461a-b7ae-b821ff75011d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:48:38.670072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5674c67-e4a7-461a-b7ae-b821ff75011d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:38.670531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5674c67-e4a7-461a-b7ae-b821ff75011d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:38.671337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5674c67-e4a7-461a-b7ae-b821ff75011d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:38.671788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e5674c67-e4a7-461a-b7ae-b821ff75011d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:38.869035 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.network.security_group_api [None req-e5674c67-e4a7-461a-b7ae-b821ff75011d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Removing security group 6cfc14b0-b21d-40bf-a2a5-3bcb8a3b02d4 from port 4c5b0279-580f-4d02-960e-1378fb408828 Jul 28 04:48:39.250455 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e5674c67-e4a7-461a-b7ae-b821ff75011d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "POST /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/action" status: 202 len: 0 microversion: 2.1 time: 0.594128 Jul 28 04:48:39.253719 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4935/7385] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:48:38 2022] POST /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:48:39.262016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-bde943ba-24de-436b-a2ae-6b0714ae106d req-c28b1651-90e1-4ba9-b84d-1c7c69b480a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5727109a-f58d-48a6-8fac-6a72a52953f5", "tag": "4c5b0279-580f-4d02-960e-1378fb408828"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:48:39.282020 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bde943ba-24de-436b-a2ae-6b0714ae106d req-c28b1651-90e1-4ba9-b84d-1c7c69b480a0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:39.283149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-bde943ba-24de-436b-a2ae-6b0714ae106d req-c28b1651-90e1-4ba9-b84d-1c7c69b480a0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:39.311502 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-bde943ba-24de-436b-a2ae-6b0714ae106d req-c28b1651-90e1-4ba9-b84d-1c7c69b480a0 service nova] Creating event network-changed:4c5b0279-580f-4d02-960e-1378fb408828 for instance 5727109a-f58d-48a6-8fac-6a72a52953f5 on n-h1-826756-3 Jul 28 04:48:39.321480 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-bde943ba-24de-436b-a2ae-6b0714ae106d req-c28b1651-90e1-4ba9-b84d-1c7c69b480a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065841 Jul 28 04:48:39.322350 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4936/7386] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:48:40.449624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-131b1667-dcc0-49a7-8d96-edb4a3ec8d7b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:48:40.450303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-131b1667-dcc0-49a7-8d96-edb4a3ec8d7b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:48:40.458029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-131b1667-dcc0-49a7-8d96-edb4a3ec8d7b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:40.458531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-131b1667-dcc0-49a7-8d96-edb4a3ec8d7b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:40.459330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-131b1667-dcc0-49a7-8d96-edb4a3ec8d7b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:40.459772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-131b1667-dcc0-49a7-8d96-edb4a3ec8d7b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:40.545456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-131b1667-dcc0-49a7-8d96-edb4a3ec8d7b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lazy-loading 'services' on Instance uuid 5727109a-f58d-48a6-8fac-6a72a52953f5 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:48:40.622481 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-131b1667-dcc0-49a7-8d96-edb4a3ec8d7b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments/c35d83be-831e-4b5b-879f-b1e64893bab1" status: 202 len: 0 microversion: 2.1 time: 0.177172 Jul 28 04:48:40.623106 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4937/7387] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:48:40 2022] DELETE /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments/c35d83be-831e-4b5b-879f-b1e64893bab1 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:48:40.632546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4110e932-f9aa-4626-9d70-9e5c36afef9f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:48:40.635039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4110e932-f9aa-4626-9d70-9e5c36afef9f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:48:40.641825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4110e932-f9aa-4626-9d70-9e5c36afef9f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:40.642240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4110e932-f9aa-4626-9d70-9e5c36afef9f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:40.643461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4110e932-f9aa-4626-9d70-9e5c36afef9f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:40.644014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4110e932-f9aa-4626-9d70-9e5c36afef9f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:40.676168 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4110e932-f9aa-4626-9d70-9e5c36afef9f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048236 Jul 28 04:48:40.676951 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4938/7388] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:48:40 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:48:41.336896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-fb04732a-1b64-4513-98cd-6829b1c22493 req-8c829580-30ca-4687-9ea4-6ca8b66b7d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5727109a-f58d-48a6-8fac-6a72a52953f5", "tag": "4c5b0279-580f-4d02-960e-1378fb408828"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:48:41.347956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fb04732a-1b64-4513-98cd-6829b1c22493 req-8c829580-30ca-4687-9ea4-6ca8b66b7d64 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:41.348336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fb04732a-1b64-4513-98cd-6829b1c22493 req-8c829580-30ca-4687-9ea4-6ca8b66b7d64 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:41.362409 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-fb04732a-1b64-4513-98cd-6829b1c22493 req-8c829580-30ca-4687-9ea4-6ca8b66b7d64 service nova] Creating event network-changed:4c5b0279-580f-4d02-960e-1378fb408828 for instance 5727109a-f58d-48a6-8fac-6a72a52953f5 on n-h1-826756-3 Jul 28 04:48:41.368698 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-fb04732a-1b64-4513-98cd-6829b1c22493 req-8c829580-30ca-4687-9ea4-6ca8b66b7d64 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035561 Jul 28 04:48:41.369915 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4939/7389] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:48:41.689267 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ba8f2dc0-90e5-4874-86e0-fc51e9e9c308 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:48:41.691823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ba8f2dc0-90e5-4874-86e0-fc51e9e9c308 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:48:41.699451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba8f2dc0-90e5-4874-86e0-fc51e9e9c308 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:41.699988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba8f2dc0-90e5-4874-86e0-fc51e9e9c308 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:41.700930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba8f2dc0-90e5-4874-86e0-fc51e9e9c308 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:41.701438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba8f2dc0-90e5-4874-86e0-fc51e9e9c308 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:41.733377 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ba8f2dc0-90e5-4874-86e0-fc51e9e9c308 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048515 Jul 28 04:48:41.734485 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4940/7390] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:48:41 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:48:42.746004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f5120a81-a5fd-43ea-8ddb-5d61be40e019 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:48:42.748279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f5120a81-a5fd-43ea-8ddb-5d61be40e019 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:48:42.755659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5120a81-a5fd-43ea-8ddb-5d61be40e019 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:42.756136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5120a81-a5fd-43ea-8ddb-5d61be40e019 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:42.756970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5120a81-a5fd-43ea-8ddb-5d61be40e019 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:42.757426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5120a81-a5fd-43ea-8ddb-5d61be40e019 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:42.788511 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f5120a81-a5fd-43ea-8ddb-5d61be40e019 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046571 Jul 28 04:48:42.789324 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4941/7391] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:48:42 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:48:43.801357 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4c48445e-b219-47ea-8053-6b3a8b0bcd4a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:48:43.803582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4c48445e-b219-47ea-8053-6b3a8b0bcd4a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:48:43.811158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c48445e-b219-47ea-8053-6b3a8b0bcd4a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:43.811613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c48445e-b219-47ea-8053-6b3a8b0bcd4a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:43.812396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c48445e-b219-47ea-8053-6b3a8b0bcd4a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:43.812915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c48445e-b219-47ea-8053-6b3a8b0bcd4a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:43.843125 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4c48445e-b219-47ea-8053-6b3a8b0bcd4a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045807 Jul 28 04:48:43.843688 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4942/7392] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:48:43 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:48:44.855557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e18fb06-33c9-414a-8746-f5315b87d1ca tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:48:44.857958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0e18fb06-33c9-414a-8746-f5315b87d1ca tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:48:44.865569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e18fb06-33c9-414a-8746-f5315b87d1ca tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:44.866001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e18fb06-33c9-414a-8746-f5315b87d1ca tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:44.866785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e18fb06-33c9-414a-8746-f5315b87d1ca tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:44.867228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e18fb06-33c9-414a-8746-f5315b87d1ca tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:44.897831 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0e18fb06-33c9-414a-8746-f5315b87d1ca tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046351 Jul 28 04:48:44.898416 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4943/7393] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:48:44 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:48:45.914859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d25ad3f0-6c45-4644-854d-6ee41dd4ca65 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:48:45.918418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d25ad3f0-6c45-4644-854d-6ee41dd4ca65 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:48:45.927839 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d25ad3f0-6c45-4644-854d-6ee41dd4ca65 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:45.928302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d25ad3f0-6c45-4644-854d-6ee41dd4ca65 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:45.929103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d25ad3f0-6c45-4644-854d-6ee41dd4ca65 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:45.929551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d25ad3f0-6c45-4644-854d-6ee41dd4ca65 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:45.961531 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d25ad3f0-6c45-4644-854d-6ee41dd4ca65 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053524 Jul 28 04:48:45.962087 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4944/7394] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:48:45 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:48:45.973008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d93985c-69a0-4008-9f95-2c530ca915dd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:48:45.973511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5d93985c-69a0-4008-9f95-2c530ca915dd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:48:45.979572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d93985c-69a0-4008-9f95-2c530ca915dd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:45.980034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d93985c-69a0-4008-9f95-2c530ca915dd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:45.980846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d93985c-69a0-4008-9f95-2c530ca915dd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:45.981292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d93985c-69a0-4008-9f95-2c530ca915dd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:46.058463 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-5d93985c-69a0-4008-9f95-2c530ca915dd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] HTTP exception thrown: Instance 5727109a-f58d-48a6-8fac-6a72a52953f5 is not attached to volume c35d83be-831e-4b5b-879f-b1e64893bab1 Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d93985c-69a0-4008-9f95-2c530ca915dd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Request method failure captured: Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments/c35d83be-831e-4b5b-879f-b1e64893bab1 HTTP/1.1 Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hREKO8a3Lpg11uB8EbHIVmYv29dWJb9hiYrTO2-aFtXsuoLuTIDv0HrOE2vXsDsOhfLonw6PHdjpOnMcPtBJhx0tBStf0tJtzzmwY_slZggbK4gILb5_LquYe5GqsTcx1N21pXwOsD4wHDYtOGHEco6Xmrnu8548vG-GP-hlpUucUw Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a4752b99f8f54e409455a796474e5c89 Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestMinimumBasicScenario-1769738806 Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4752b99f8f54e409455a796474e5c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4752b99f8f54e409455a796474e5c89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4752b99f8f54e409455a796474e5c89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4752b99f8f54e409455a796474e5c89"}]}] Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestMinimumBasicScenario-1769738806 Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a4752b99f8f54e409455a796474e5c89 Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1769738806 Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestMinimumBasicScenario-1769738806-project Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 8451e4954caa4f909ff6719d08e69b50 Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestMinimumBasicScenario-1769738806-project Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 5727109a-f58d-48a6-8fac-6a72a52953f5 is not attached to volume c35d83be-831e-4b5b-879f-b1e64893bab1 Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': '5727109a-f58d-48a6-8fac-6a72a52953f5', 'id': 'c35d83be-831e-4b5b-879f-b1e64893bab1'} Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c35d83be-831e-4b5b-879f-b1e64893bab1. Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5727109a-f58d-48a6-8fac-6a72a52953f5 is not attached to volume c35d83be-831e-4b5b-879f-b1e64893bab1 Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:48:46.060136 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:48:46.064769 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:48:46.064769 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:48:46.064769 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5727109a-f58d-48a6-8fac-6a72a52953f5 is not attached to volume c35d83be-831e-4b5b-879f-b1e64893bab1 Jul 28 04:48:46.064769 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:48:46.064769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d93985c-69a0-4008-9f95-2c530ca915dd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Returning 404 to user: Instance 5727109a-f58d-48a6-8fac-6a72a52953f5 is not attached to volume c35d83be-831e-4b5b-879f-b1e64893bab1 {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:48:46.064769 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5d93985c-69a0-4008-9f95-2c530ca915dd tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments/c35d83be-831e-4b5b-879f-b1e64893bab1" status: 404 len: 154 microversion: 2.1 time: 0.092919 Jul 28 04:48:46.064769 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4945/7395] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:48:45 2022] DELETE /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5/os-volume_attachments/c35d83be-831e-4b5b-879f-b1e64893bab1 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:48:49.322197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ebaca165-8a68-4071-a265-26890110c432 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:48:49.322796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ebaca165-8a68-4071-a265-26890110c432 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:48:49.333194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebaca165-8a68-4071-a265-26890110c432 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:49.333663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebaca165-8a68-4071-a265-26890110c432 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:49.334449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebaca165-8a68-4071-a265-26890110c432 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:49.334920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebaca165-8a68-4071-a265-26890110c432 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:49.361006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ebaca165-8a68-4071-a265-26890110c432 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:48:49.443481 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ebaca165-8a68-4071-a265-26890110c432 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 204 len: 0 microversion: 2.1 time: 0.126913 Jul 28 04:48:49.444296 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4946/7396] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:48:49 2022] DELETE /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:48:49.453688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d071078e-26c4-474f-9882-1b9cc05bbfd4 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:48:49.454399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d071078e-26c4-474f-9882-1b9cc05bbfd4 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:48:49.461799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d071078e-26c4-474f-9882-1b9cc05bbfd4 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:49.462259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d071078e-26c4-474f-9882-1b9cc05bbfd4 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:49.463059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d071078e-26c4-474f-9882-1b9cc05bbfd4 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:49.463505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d071078e-26c4-474f-9882-1b9cc05bbfd4 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:49.605351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d071078e-26c4-474f-9882-1b9cc05bbfd4 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:48:49.613709 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d071078e-26c4-474f-9882-1b9cc05bbfd4 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1555 microversion: 2.1 time: 0.164635 Jul 28 04:48:49.614262 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4947/7397] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:48:49 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:48:50.636792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e1e51544-4f1b-4a3b-a0ae-b22f5b61fc0e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:48:50.637500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e1e51544-4f1b-4a3b-a0ae-b22f5b61fc0e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:48:50.645001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1e51544-4f1b-4a3b-a0ae-b22f5b61fc0e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:50.645465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1e51544-4f1b-4a3b-a0ae-b22f5b61fc0e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:50.646243 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1e51544-4f1b-4a3b-a0ae-b22f5b61fc0e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:50.646683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e1e51544-4f1b-4a3b-a0ae-b22f5b61fc0e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:50.788979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e1e51544-4f1b-4a3b-a0ae-b22f5b61fc0e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:48:50.797065 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e1e51544-4f1b-4a3b-a0ae-b22f5b61fc0e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1555 microversion: 2.1 time: 0.164661 Jul 28 04:48:50.797651 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4948/7398] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:48:50 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:48:51.493560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-be200862-c727-4800-bfe7-1b089b78317b req-93fa0585-bfc7-4ee1-8f0b-82b7fb5e27d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5727109a-f58d-48a6-8fac-6a72a52953f5", "name": "network-vif-deleted", "tag": "4c5b0279-580f-4d02-960e-1378fb408828"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:48:51.502925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-be200862-c727-4800-bfe7-1b089b78317b req-93fa0585-bfc7-4ee1-8f0b-82b7fb5e27d3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:51.503388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-be200862-c727-4800-bfe7-1b089b78317b req-93fa0585-bfc7-4ee1-8f0b-82b7fb5e27d3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:51.515266 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-be200862-c727-4800-bfe7-1b089b78317b req-93fa0585-bfc7-4ee1-8f0b-82b7fb5e27d3 service nova] Creating event network-vif-deleted:4c5b0279-580f-4d02-960e-1378fb408828 for instance 5727109a-f58d-48a6-8fac-6a72a52953f5 on n-h1-826756-3 Jul 28 04:48:51.520680 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-be200862-c727-4800-bfe7-1b089b78317b req-93fa0585-bfc7-4ee1-8f0b-82b7fb5e27d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031537 Jul 28 04:48:51.521312 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4949/7399] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:48:51.819987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8aada773-35ad-4082-8e53-1f53f716bdb2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:48:51.821434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8aada773-35ad-4082-8e53-1f53f716bdb2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:48:51.828720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8aada773-35ad-4082-8e53-1f53f716bdb2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:51.829858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8aada773-35ad-4082-8e53-1f53f716bdb2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:51.830266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8aada773-35ad-4082-8e53-1f53f716bdb2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:51.830720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8aada773-35ad-4082-8e53-1f53f716bdb2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:51.866799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8aada773-35ad-4082-8e53-1f53f716bdb2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:51.867440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8aada773-35ad-4082-8e53-1f53f716bdb2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:51.867966 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-8aada773-35ad-4082-8e53-1f53f716bdb2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lazy-loading 'fault' on Instance uuid 5727109a-f58d-48a6-8fac-6a72a52953f5 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:48:51.914114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8aada773-35ad-4082-8e53-1f53f716bdb2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:48:51.922597 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8aada773-35ad-4082-8e53-1f53f716bdb2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 200 len: 1348 microversion: 2.1 time: 0.107754 Jul 28 04:48:51.923209 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4950/7400] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:48:51 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 1348 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:48:52.949485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-293461e0-bed0-40a1-a7d9-eb50c217f0ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:48:52.950557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-293461e0-bed0-40a1-a7d9-eb50c217f0ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 5727109a-f58d-48a6-8fac-6a72a52953f5] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:48:52.962335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-293461e0-bed0-40a1-a7d9-eb50c217f0ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:52.963103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-293461e0-bed0-40a1-a7d9-eb50c217f0ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:52.964513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-293461e0-bed0-40a1-a7d9-eb50c217f0ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:48:52.965262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-293461e0-bed0-40a1-a7d9-eb50c217f0ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:48:52.972984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:48:52.986110 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-293461e0-bed0-40a1-a7d9-eb50c217f0ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] HTTP exception thrown: Instance 5727109a-f58d-48a6-8fac-6a72a52953f5 could not be found. Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-293461e0-bed0-40a1-a7d9-eb50c217f0ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Request method failure captured: Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 HTTP/1.1 Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hREKO8a3Lpg11uB8EbHIVmYv29dWJb9hiYrTO2-aFtXsuoLuTIDv0HrOE2vXsDsOhfLonw6PHdjpOnMcPtBJhx0tBStf0tJtzzmwY_slZggbK4gILb5_LquYe5GqsTcx1N21pXwOsD4wHDYtOGHEco6Xmrnu8548vG-GP-hlpUucUw Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a4752b99f8f54e409455a796474e5c89 Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestMinimumBasicScenario-1769738806 Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4752b99f8f54e409455a796474e5c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4752b99f8f54e409455a796474e5c89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4752b99f8f54e409455a796474e5c89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4752b99f8f54e409455a796474e5c89"}]}] Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestMinimumBasicScenario-1769738806 Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a4752b99f8f54e409455a796474e5c89 Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1769738806 Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestMinimumBasicScenario-1769738806-project Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 8451e4954caa4f909ff6719d08e69b50 Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestMinimumBasicScenario-1769738806-project Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 5727109a-f58d-48a6-8fac-6a72a52953f5 could not be found. Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '5727109a-f58d-48a6-8fac-6a72a52953f5'} Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5727109a-f58d-48a6-8fac-6a72a52953f5 could not be found. Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5727109a-f58d-48a6-8fac-6a72a52953f5 could not be found. Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:48:52.987773 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:48:52.992299 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:48:52.992299 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:48:52.992299 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:48:52.992299 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:48:52.992299 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:48:52.992299 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5727109a-f58d-48a6-8fac-6a72a52953f5 could not be found. Jul 28 04:48:52.992299 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:48:52.992299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-293461e0-bed0-40a1-a7d9-eb50c217f0ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Returning 404 to user: Instance 5727109a-f58d-48a6-8fac-6a72a52953f5 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:48:52.992299 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-293461e0-bed0-40a1-a7d9-eb50c217f0ba tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5" status: 404 len: 111 microversion: 2.1 time: 0.046660 Jul 28 04:48:52.992299 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4951/7401] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:48:52 2022] GET /compute/v2.1/servers/5727109a-f58d-48a6-8fac-6a72a52953f5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:48:52.997925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b537d567-a305-486b-8fbc-a43e7fe6ff34 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '.version_select at 0x7ffa6456ab80>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:48:53.021994 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b537d567-a305-486b-8fbc-a43e7fe6ff34 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-929685283" status: 202 len: 0 microversion: 2.1 time: 0.027864 Jul 28 04:48:53.022576 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4952/7402] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 04:48:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-929685283 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:49:01.913403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ec21ba41-afc1-41f2-b81f-1ed5feea9382 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Action: 'create', calling method: .version_select at 0x7ffa66df71f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-696326470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBexC8UkcMNf5fJul2PkYiMQ4bh8lspgroL8uBSn80zQDI9xZdiOrWGcTBf4qKdtFL7DBeJqxwYInJtGsixbdPndwldWjhw0xIVhajIw08kycdAzsGW+EuTPL9hLsvtV5A=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:49:01.930463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ec21ba41-afc1-41f2-b81f-1ed5feea9382 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Getting quotas for project a4752b99f8f54e409455a796474e5c89. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:49:01.935817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-ec21ba41-afc1-41f2-b81f-1ed5feea9382 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Getting quotas for user 8451e4954caa4f909ff6719d08e69b50 and project a4752b99f8f54e409455a796474e5c89. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:49:01.963226 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ec21ba41-afc1-41f2-b81f-1ed5feea9382 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.053906 Jul 28 04:49:01.963840 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4953/7403] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:49:01 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:49:02.019005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1799014401", "imageRef": "42946b6f-cc8d-4909-bb84-61896941201f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-696326470", "networks": [{"uuid": "c86b197e-caa1-453a-ad37-7ab54585bfe7"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:49:02.072184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] validate_networks() for [('c86b197e-caa1-453a-ad37-7ab54585bfe7', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:49:02.533504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:49:02.533940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:49:02.534420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:49:02.534866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:49:02.535351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:49:02.545303 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:02.545879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:02.546712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:02.547158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:02.564226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Getting quotas for project a4752b99f8f54e409455a796474e5c89. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:49:02.570022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Getting quotas for user 8451e4954caa4f909ff6719d08e69b50 and project a4752b99f8f54e409455a796474e5c89. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:49:02.583368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:49:02.585647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='42946b6f-cc8d-4909-bb84-61896941201f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:49:02.644058 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-93db5565-1b3e-4621-a1e9-fb45029e7486 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628982 Jul 28 04:49:02.644746 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4954/7404] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:49:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:49:02.655783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d2f9143-1ce3-4243-bc64-54276e610fbb tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:02.656438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6d2f9143-1ce3-4243-bc64-54276e610fbb tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:02.710238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6d2f9143-1ce3-4243-bc64-54276e610fbb tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:02.718359 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d2f9143-1ce3-4243-bc64-54276e610fbb tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1258 microversion: 2.1 time: 0.066359 Jul 28 04:49:02.719155 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4955/7405] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:02 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:49:03.741857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d0d2d6b9-27e7-474c-a15c-c8951454222e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:03.742674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d0d2d6b9-27e7-474c-a15c-c8951454222e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:03.750030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0d2d6b9-27e7-474c-a15c-c8951454222e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:03.750513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0d2d6b9-27e7-474c-a15c-c8951454222e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:03.751401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0d2d6b9-27e7-474c-a15c-c8951454222e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:03.751859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d0d2d6b9-27e7-474c-a15c-c8951454222e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:03.827005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d0d2d6b9-27e7-474c-a15c-c8951454222e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:03.835706 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d0d2d6b9-27e7-474c-a15c-c8951454222e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1310 microversion: 2.1 time: 0.099130 Jul 28 04:49:03.836745 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4956/7406] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:03 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1310 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:49:04.858266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8753cd5b-09a8-4d4f-a656-32a2c17827c3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:04.859606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8753cd5b-09a8-4d4f-a656-32a2c17827c3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:04.867945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8753cd5b-09a8-4d4f-a656-32a2c17827c3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:04.868756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8753cd5b-09a8-4d4f-a656-32a2c17827c3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:04.870172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8753cd5b-09a8-4d4f-a656-32a2c17827c3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:04.871027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8753cd5b-09a8-4d4f-a656-32a2c17827c3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:05.030304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8753cd5b-09a8-4d4f-a656-32a2c17827c3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:05.042494 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8753cd5b-09a8-4d4f-a656-32a2c17827c3 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1358 microversion: 2.1 time: 0.188103 Jul 28 04:49:05.043101 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4957/7407] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:04 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:49:06.067684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-63299500-77e5-4da1-8a74-31365514722e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:06.068484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-63299500-77e5-4da1-8a74-31365514722e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:06.076098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63299500-77e5-4da1-8a74-31365514722e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:06.076895 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63299500-77e5-4da1-8a74-31365514722e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:06.077869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63299500-77e5-4da1-8a74-31365514722e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:06.078474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-63299500-77e5-4da1-8a74-31365514722e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:06.229515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-63299500-77e5-4da1-8a74-31365514722e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:06.238333 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-63299500-77e5-4da1-8a74-31365514722e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1358 microversion: 2.1 time: 0.174713 Jul 28 04:49:06.238926 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4958/7408] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:06 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:49:07.262909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-649d3bd0-204a-44ed-9533-209e5167f02d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:07.264279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-649d3bd0-204a-44ed-9533-209e5167f02d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:07.272286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-649d3bd0-204a-44ed-9533-209e5167f02d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:07.272790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-649d3bd0-204a-44ed-9533-209e5167f02d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:07.273592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-649d3bd0-204a-44ed-9533-209e5167f02d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:07.274045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-649d3bd0-204a-44ed-9533-209e5167f02d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:07.435832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-649d3bd0-204a-44ed-9533-209e5167f02d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:07.444446 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-649d3bd0-204a-44ed-9533-209e5167f02d tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1358 microversion: 2.1 time: 0.185904 Jul 28 04:49:07.445055 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4959/7409] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:07 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:49:08.467837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ad947f07-d3e7-4ae5-8f35-fafe98e95f69 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:08.469529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ad947f07-d3e7-4ae5-8f35-fafe98e95f69 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:08.477370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad947f07-d3e7-4ae5-8f35-fafe98e95f69 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:08.477843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad947f07-d3e7-4ae5-8f35-fafe98e95f69 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:08.478647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad947f07-d3e7-4ae5-8f35-fafe98e95f69 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:08.479101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ad947f07-d3e7-4ae5-8f35-fafe98e95f69 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:08.628443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ad947f07-d3e7-4ae5-8f35-fafe98e95f69 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:08.637192 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ad947f07-d3e7-4ae5-8f35-fafe98e95f69 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1358 microversion: 2.1 time: 0.173664 Jul 28 04:49:08.637780 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4960/7410] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:08 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:49:09.658896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ba438022-fbee-4f10-94c0-0f4212c0847a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:09.659535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ba438022-fbee-4f10-94c0-0f4212c0847a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:09.662235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:49:09.667960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba438022-fbee-4f10-94c0-0f4212c0847a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:09.668431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba438022-fbee-4f10-94c0-0f4212c0847a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:09.669230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba438022-fbee-4f10-94c0-0f4212c0847a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:09.669728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ba438022-fbee-4f10-94c0-0f4212c0847a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:09.817075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ba438022-fbee-4f10-94c0-0f4212c0847a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:09.825327 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ba438022-fbee-4f10-94c0-0f4212c0847a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1358 microversion: 2.1 time: 0.170370 Jul 28 04:49:09.825944 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4961/7411] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:09 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:49:10.847442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d96f39d6-9bc2-48a2-8a3d-9dc5876ec4f7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:10.848258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d96f39d6-9bc2-48a2-8a3d-9dc5876ec4f7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:10.858521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d96f39d6-9bc2-48a2-8a3d-9dc5876ec4f7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:10.858980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d96f39d6-9bc2-48a2-8a3d-9dc5876ec4f7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:10.859792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d96f39d6-9bc2-48a2-8a3d-9dc5876ec4f7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:10.860246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d96f39d6-9bc2-48a2-8a3d-9dc5876ec4f7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:11.005715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d96f39d6-9bc2-48a2-8a3d-9dc5876ec4f7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:11.014182 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d96f39d6-9bc2-48a2-8a3d-9dc5876ec4f7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1358 microversion: 2.1 time: 0.171044 Jul 28 04:49:11.014827 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4962/7412] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:10 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:49:12.035534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f7dfa265-f109-4847-94ea-d8430232e4d6 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:12.036253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f7dfa265-f109-4847-94ea-d8430232e4d6 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:12.044331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7dfa265-f109-4847-94ea-d8430232e4d6 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:12.044890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7dfa265-f109-4847-94ea-d8430232e4d6 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:12.045797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7dfa265-f109-4847-94ea-d8430232e4d6 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:12.046263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f7dfa265-f109-4847-94ea-d8430232e4d6 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:12.191558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f7dfa265-f109-4847-94ea-d8430232e4d6 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:12.199667 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f7dfa265-f109-4847-94ea-d8430232e4d6 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1358 microversion: 2.1 time: 0.168289 Jul 28 04:49:12.200254 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4963/7413] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:12 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:49:13.170041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:49:13.173133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:49:13.183385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-10059ab5-e6c0-473b-a920-1b76c5e9650f req-9fb4df7a-f67c-4606-9312-ef8884301143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7400e2d6-5aa9-41a4-9366-958f33b01ff8", "tag": "f439873e-6fdd-4cfb-8d74-11ede9c68f7e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:49:13.208776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-10059ab5-e6c0-473b-a920-1b76c5e9650f req-9fb4df7a-f67c-4606-9312-ef8884301143 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:13.210522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-10059ab5-e6c0-473b-a920-1b76c5e9650f req-9fb4df7a-f67c-4606-9312-ef8884301143 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:13.224242 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-10059ab5-e6c0-473b-a920-1b76c5e9650f req-9fb4df7a-f67c-4606-9312-ef8884301143 service nova] Creating event network-changed:f439873e-6fdd-4cfb-8d74-11ede9c68f7e for instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 on n-h2-826756-3 Jul 28 04:49:13.229580 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-10059ab5-e6c0-473b-a920-1b76c5e9650f req-9fb4df7a-f67c-4606-9312-ef8884301143 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060049 Jul 28 04:49:13.230413 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4964/7414] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:49:13.236855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e4dea492-884b-485f-ab32-61b1d94b7c7f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:13.237697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e4dea492-884b-485f-ab32-61b1d94b7c7f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:13.244849 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4dea492-884b-485f-ab32-61b1d94b7c7f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:13.245309 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4dea492-884b-485f-ab32-61b1d94b7c7f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:13.246099 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4dea492-884b-485f-ab32-61b1d94b7c7f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:13.246543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e4dea492-884b-485f-ab32-61b1d94b7c7f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:13.396548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e4dea492-884b-485f-ab32-61b1d94b7c7f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:13.404744 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e4dea492-884b-485f-ab32-61b1d94b7c7f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1358 microversion: 2.1 time: 0.173028 Jul 28 04:49:13.405340 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4965/7415] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:13 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:49:14.430227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1de43ced-8aa9-4ef2-8977-2428a6d5e3c0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:14.431315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1de43ced-8aa9-4ef2-8977-2428a6d5e3c0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:14.442229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1de43ced-8aa9-4ef2-8977-2428a6d5e3c0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:14.442658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1de43ced-8aa9-4ef2-8977-2428a6d5e3c0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:14.443441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1de43ced-8aa9-4ef2-8977-2428a6d5e3c0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:14.443882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1de43ced-8aa9-4ef2-8977-2428a6d5e3c0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:14.586972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1de43ced-8aa9-4ef2-8977-2428a6d5e3c0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:14.597735 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1de43ced-8aa9-4ef2-8977-2428a6d5e3c0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1358 microversion: 2.1 time: 0.173729 Jul 28 04:49:14.597936 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4966/7416] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:14 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:49:15.626593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed31efe1-e5d3-495e-a5b9-8635d8bdb8df tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:15.627307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed31efe1-e5d3-495e-a5b9-8635d8bdb8df tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:15.637272 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed31efe1-e5d3-495e-a5b9-8635d8bdb8df tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:15.637769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed31efe1-e5d3-495e-a5b9-8635d8bdb8df tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:15.639313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed31efe1-e5d3-495e-a5b9-8635d8bdb8df tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:15.639777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed31efe1-e5d3-495e-a5b9-8635d8bdb8df tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:15.791242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed31efe1-e5d3-495e-a5b9-8635d8bdb8df tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:15.800106 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed31efe1-e5d3-495e-a5b9-8635d8bdb8df tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1358 microversion: 2.1 time: 0.179494 Jul 28 04:49:15.800832 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4967/7417] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:15 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:49:16.822664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d8912d6a-8387-42fc-ae14-cb6978682973 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:16.823370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d8912d6a-8387-42fc-ae14-cb6978682973 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:16.830622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8912d6a-8387-42fc-ae14-cb6978682973 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:16.831001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8912d6a-8387-42fc-ae14-cb6978682973 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:16.831868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8912d6a-8387-42fc-ae14-cb6978682973 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:16.832294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8912d6a-8387-42fc-ae14-cb6978682973 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:16.978711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d8912d6a-8387-42fc-ae14-cb6978682973 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:16.991141 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d8912d6a-8387-42fc-ae14-cb6978682973 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1358 microversion: 2.1 time: 0.172086 Jul 28 04:49:16.992242 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4968/7418] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:16 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:49:18.017489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-497e482c-b6d5-4446-842a-d2b43fb8f319 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:18.018635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-497e482c-b6d5-4446-842a-d2b43fb8f319 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:18.027685 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-497e482c-b6d5-4446-842a-d2b43fb8f319 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:18.028153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-497e482c-b6d5-4446-842a-d2b43fb8f319 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:18.028975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-497e482c-b6d5-4446-842a-d2b43fb8f319 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:18.029430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-497e482c-b6d5-4446-842a-d2b43fb8f319 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:18.164700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-497e482c-b6d5-4446-842a-d2b43fb8f319 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:18.172995 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-497e482c-b6d5-4446-842a-d2b43fb8f319 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1358 microversion: 2.1 time: 0.162170 Jul 28 04:49:18.173576 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4969/7419] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:18 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:49:18.786630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-5f3e9380-d1a8-49cb-9e45-46b32d32f8a9 req-22a82034-d883-4fd9-9b88-b9ad9793fbdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7400e2d6-5aa9-41a4-9366-958f33b01ff8", "name": "network-vif-plugged", "status": "completed", "tag": "f439873e-6fdd-4cfb-8d74-11ede9c68f7e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:49:18.798186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5f3e9380-d1a8-49cb-9e45-46b32d32f8a9 req-22a82034-d883-4fd9-9b88-b9ad9793fbdc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:18.798633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-5f3e9380-d1a8-49cb-9e45-46b32d32f8a9 req-22a82034-d883-4fd9-9b88-b9ad9793fbdc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:18.810652 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-5f3e9380-d1a8-49cb-9e45-46b32d32f8a9 req-22a82034-d883-4fd9-9b88-b9ad9793fbdc service nova] Creating event network-vif-plugged:f439873e-6fdd-4cfb-8d74-11ede9c68f7e for instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 on n-h2-826756-3 Jul 28 04:49:18.815870 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-5f3e9380-d1a8-49cb-9e45-46b32d32f8a9 req-22a82034-d883-4fd9-9b88-b9ad9793fbdc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033142 Jul 28 04:49:18.816740 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4970/7420] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:49:19.197794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1ad7ce8-1339-480b-94b3-67c677ebb9c5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:19.198468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1ad7ce8-1339-480b-94b3-67c677ebb9c5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:19.206280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1ad7ce8-1339-480b-94b3-67c677ebb9c5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:19.206777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1ad7ce8-1339-480b-94b3-67c677ebb9c5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:19.207570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1ad7ce8-1339-480b-94b3-67c677ebb9c5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:19.208018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1ad7ce8-1339-480b-94b3-67c677ebb9c5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:19.346821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b1ad7ce8-1339-480b-94b3-67c677ebb9c5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:19.359273 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1ad7ce8-1339-480b-94b3-67c677ebb9c5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1358 microversion: 2.1 time: 0.167367 Jul 28 04:49:19.360096 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4971/7421] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:19 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:49:20.381037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b47ab328-8dd5-428a-b90b-d73d357b2bf2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:20.381705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b47ab328-8dd5-428a-b90b-d73d357b2bf2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:20.389086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b47ab328-8dd5-428a-b90b-d73d357b2bf2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:20.389556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b47ab328-8dd5-428a-b90b-d73d357b2bf2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:20.390344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b47ab328-8dd5-428a-b90b-d73d357b2bf2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:20.390805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b47ab328-8dd5-428a-b90b-d73d357b2bf2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:20.527149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b47ab328-8dd5-428a-b90b-d73d357b2bf2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:20.535060 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b47ab328-8dd5-428a-b90b-d73d357b2bf2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1549 microversion: 2.1 time: 0.158190 Jul 28 04:49:20.535649 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4972/7422] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:20 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:49:20.555173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a0605f0e-b421-403f-93c0-8cf1fbb5ebb7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:20.555796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a0605f0e-b421-403f-93c0-8cf1fbb5ebb7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:20.562068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0605f0e-b421-403f-93c0-8cf1fbb5ebb7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:20.562532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0605f0e-b421-403f-93c0-8cf1fbb5ebb7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:20.563310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0605f0e-b421-403f-93c0-8cf1fbb5ebb7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:20.563756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0605f0e-b421-403f-93c0-8cf1fbb5ebb7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:20.582315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:49:20.702794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a0605f0e-b421-403f-93c0-8cf1fbb5ebb7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:20.710864 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a0605f0e-b421-403f-93c0-8cf1fbb5ebb7 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1549 microversion: 2.1 time: 0.159333 Jul 28 04:49:20.711525 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4973/7423] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:20 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:49:20.731525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b077a10e-74ee-4611-94b6-e58a5582eab2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:20.736130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b077a10e-74ee-4611-94b6-e58a5582eab2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:20.736938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b077a10e-74ee-4611-94b6-e58a5582eab2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Searching by: {'deleted': False, 'project_id': 'a4752b99f8f54e409455a796474e5c89'} {{(pid=126071) get_all /opt/stack/nova/nova/compute/api.py:3008}} Jul 28 04:49:20.743305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b077a10e-74ee-4611-94b6-e58a5582eab2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:20.743771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b077a10e-74ee-4611-94b6-e58a5582eab2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:20.744637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b077a10e-74ee-4611-94b6-e58a5582eab2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:20.745112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b077a10e-74ee-4611-94b6-e58a5582eab2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:20.769574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.multi_cell_list [None req-b077a10e-74ee-4611-94b6-e58a5582eab2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126071) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 04:49:20.796229 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b077a10e-74ee-4611-94b6-e58a5582eab2 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068736 Jul 28 04:49:20.796869 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4974/7424] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Jul 28 04:49:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:49:20.808301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c28e0e0a-8178-4a26-a5ec-a8a65d0a430c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:20.808970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c28e0e0a-8178-4a26-a5ec-a8a65d0a430c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:20.815194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c28e0e0a-8178-4a26-a5ec-a8a65d0a430c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:20.815660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c28e0e0a-8178-4a26-a5ec-a8a65d0a430c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:20.816477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c28e0e0a-8178-4a26-a5ec-a8a65d0a430c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:20.816933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c28e0e0a-8178-4a26-a5ec-a8a65d0a430c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:20.951023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c28e0e0a-8178-4a26-a5ec-a8a65d0a430c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:20.959236 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c28e0e0a-8178-4a26-a5ec-a8a65d0a430c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1549 microversion: 2.1 time: 0.154742 Jul 28 04:49:20.959827 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4975/7425] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:20 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:49:22.477423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df7ea43e-c1e7-4ba2-9142-055676f03db5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eaec011d-8d49-4f6f-a2b2-a31969af6a94"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:49:22.479763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-df7ea43e-c1e7-4ba2-9142-055676f03db5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:22.486876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df7ea43e-c1e7-4ba2-9142-055676f03db5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:22.487335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df7ea43e-c1e7-4ba2-9142-055676f03db5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:22.488106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df7ea43e-c1e7-4ba2-9142-055676f03db5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:22.488581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-df7ea43e-c1e7-4ba2-9142-055676f03db5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:22.758220 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-df7ea43e-c1e7-4ba2-9142-055676f03db5 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "POST /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284663 Jul 28 04:49:22.758888 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4976/7426] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Jul 28 04:49:22 2022] POST /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:49:33.770321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:49:33.771169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=31 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:49:33.771970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:49:33.776234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f2c58bd-fddd-4ad5-9a10-429e19c7f747 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:33.776988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0f2c58bd-fddd-4ad5-9a10-429e19c7f747 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:33.785079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f2c58bd-fddd-4ad5-9a10-429e19c7f747 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:33.785542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f2c58bd-fddd-4ad5-9a10-429e19c7f747 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:33.786326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f2c58bd-fddd-4ad5-9a10-429e19c7f747 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:33.786771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f2c58bd-fddd-4ad5-9a10-429e19c7f747 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:33.931130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0f2c58bd-fddd-4ad5-9a10-429e19c7f747 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:33.940011 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0f2c58bd-fddd-4ad5-9a10-429e19c7f747 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1595 microversion: 2.1 time: 0.171811 Jul 28 04:49:33.940615 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4977/7427] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:33 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1595 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:49:35.917608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-76beb760-21df-4883-b7e8-dc735743eb0e req-2f4e7ed9-18a4-4678-ad6c-61f6f659e8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7400e2d6-5aa9-41a4-9366-958f33b01ff8", "tag": "f439873e-6fdd-4cfb-8d74-11ede9c68f7e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:49:35.928251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-76beb760-21df-4883-b7e8-dc735743eb0e req-2f4e7ed9-18a4-4678-ad6c-61f6f659e8aa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:35.928822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-76beb760-21df-4883-b7e8-dc735743eb0e req-2f4e7ed9-18a4-4678-ad6c-61f6f659e8aa service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:35.942729 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-76beb760-21df-4883-b7e8-dc735743eb0e req-2f4e7ed9-18a4-4678-ad6c-61f6f659e8aa service nova] Creating event network-changed:f439873e-6fdd-4cfb-8d74-11ede9c68f7e for instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 on n-h2-826756-3 Jul 28 04:49:35.947556 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-76beb760-21df-4883-b7e8-dc735743eb0e req-2f4e7ed9-18a4-4678-ad6c-61f6f659e8aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033905 Jul 28 04:49:35.948506 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4978/7428] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:49:37.210831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-56209e70-fc41-4529-b04c-7be774ff6855 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1459518555"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:49:37.211600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-56209e70-fc41-4529-b04c-7be774ff6855 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:37.219060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56209e70-fc41-4529-b04c-7be774ff6855 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:37.219519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56209e70-fc41-4529-b04c-7be774ff6855 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:37.220300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56209e70-fc41-4529-b04c-7be774ff6855 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:37.221168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56209e70-fc41-4529-b04c-7be774ff6855 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:37.358252 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.network.security_group_api [None req-56209e70-fc41-4529-b04c-7be774ff6855 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Adding security group 86795b5f-c7e7-4fe1-8409-afade0776ef4 to port f439873e-6fdd-4cfb-8d74-11ede9c68f7e Jul 28 04:49:37.731629 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-56209e70-fc41-4529-b04c-7be774ff6855 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "POST /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/action" status: 202 len: 0 microversion: 2.1 time: 0.528131 Jul 28 04:49:37.733389 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4979/7429] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:49:37 2022] POST /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:49:37.747472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-219dd291-03d7-4a3d-9411-63e09ead2199 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:49:37.749723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-219dd291-03d7-4a3d-9411-63e09ead2199 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:49:37.756832 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-219dd291-03d7-4a3d-9411-63e09ead2199 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:37.757619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-219dd291-03d7-4a3d-9411-63e09ead2199 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:37.758504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-219dd291-03d7-4a3d-9411-63e09ead2199 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:37.758994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-219dd291-03d7-4a3d-9411-63e09ead2199 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:37.976614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-219dd291-03d7-4a3d-9411-63e09ead2199 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:49:37.985421 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-219dd291-03d7-4a3d-9411-63e09ead2199 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1760 microversion: 2.1 time: 0.244547 Jul 28 04:49:37.986039 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4980/7430] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:49:37 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1760 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:49:38.004523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1b6b4404-180a-4282-88b7-a13fb0e6ff06 req-1d3ea5b6-f369-45f3-a857-bf657b7f23bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7400e2d6-5aa9-41a4-9366-958f33b01ff8", "tag": "f439873e-6fdd-4cfb-8d74-11ede9c68f7e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:49:38.018956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1b6b4404-180a-4282-88b7-a13fb0e6ff06 req-1d3ea5b6-f369-45f3-a857-bf657b7f23bd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:49:38.019599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1b6b4404-180a-4282-88b7-a13fb0e6ff06 req-1d3ea5b6-f369-45f3-a857-bf657b7f23bd service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:49:38.034773 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1b6b4404-180a-4282-88b7-a13fb0e6ff06 req-1d3ea5b6-f369-45f3-a857-bf657b7f23bd service nova] Creating event network-changed:f439873e-6fdd-4cfb-8d74-11ede9c68f7e for instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 on n-h2-826756-3 Jul 28 04:49:38.039875 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1b6b4404-180a-4282-88b7-a13fb0e6ff06 req-1d3ea5b6-f369-45f3-a857-bf657b7f23bd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041620 Jul 28 04:49:38.040527 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4981/7431] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:50:00.790130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=10 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:50:00.790868 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=20 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:50:00.850362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-de5bd32a-a3a7-4d2f-a295-d563c636be85 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:50:00.852823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-de5bd32a-a3a7-4d2f-a295-d563c636be85 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:00.859440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de5bd32a-a3a7-4d2f-a295-d563c636be85 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:00.859902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de5bd32a-a3a7-4d2f-a295-d563c636be85 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:00.860730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de5bd32a-a3a7-4d2f-a295-d563c636be85 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:00.861180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de5bd32a-a3a7-4d2f-a295-d563c636be85 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:00.941843 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-de5bd32a-a3a7-4d2f-a295-d563c636be85 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "POST /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/action" status: 202 len: 0 microversion: 2.1 time: 0.153499 Jul 28 04:50:00.942462 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4982/7432] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:50:00 2022] POST /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:50:00.951347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1331f186-ff55-45f1-9691-b33dc0e4392f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:00.952156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1331f186-ff55-45f1-9691-b33dc0e4392f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:00.958838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1331f186-ff55-45f1-9691-b33dc0e4392f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:00.959301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1331f186-ff55-45f1-9691-b33dc0e4392f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:00.960084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1331f186-ff55-45f1-9691-b33dc0e4392f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:00.960570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1331f186-ff55-45f1-9691-b33dc0e4392f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:01.117063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1331f186-ff55-45f1-9691-b33dc0e4392f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:01.125842 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1331f186-ff55-45f1-9691-b33dc0e4392f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1752 microversion: 2.1 time: 0.178619 Jul 28 04:50:01.126447 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4983/7433] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:00 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:50:02.148336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-96921536-ce82-430d-a2d8-0340e86eb220 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:02.149049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-96921536-ce82-430d-a2d8-0340e86eb220 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:02.156969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96921536-ce82-430d-a2d8-0340e86eb220 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:02.157413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96921536-ce82-430d-a2d8-0340e86eb220 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:02.158226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96921536-ce82-430d-a2d8-0340e86eb220 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:02.158675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96921536-ce82-430d-a2d8-0340e86eb220 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:02.308101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-96921536-ce82-430d-a2d8-0340e86eb220 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:02.318274 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-96921536-ce82-430d-a2d8-0340e86eb220 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1757 microversion: 2.1 time: 0.173985 Jul 28 04:50:02.319111 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4984/7434] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:02 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:50:03.342427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ed18934-0572-4537-9ac1-d37a7710af98 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:03.343487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ed18934-0572-4537-9ac1-d37a7710af98 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:03.352769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ed18934-0572-4537-9ac1-d37a7710af98 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:03.353416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ed18934-0572-4537-9ac1-d37a7710af98 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:03.354480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ed18934-0572-4537-9ac1-d37a7710af98 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:03.355094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ed18934-0572-4537-9ac1-d37a7710af98 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:03.506545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ed18934-0572-4537-9ac1-d37a7710af98 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:03.515753 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ed18934-0572-4537-9ac1-d37a7710af98 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1757 microversion: 2.1 time: 0.178756 Jul 28 04:50:03.516375 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4985/7435] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:03 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:50:04.537900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d31d41a-3741-488e-92bf-db9446b2320f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:04.538597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4d31d41a-3741-488e-92bf-db9446b2320f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:04.546031 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d31d41a-3741-488e-92bf-db9446b2320f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:04.546494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d31d41a-3741-488e-92bf-db9446b2320f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:04.547306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d31d41a-3741-488e-92bf-db9446b2320f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:04.547728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d31d41a-3741-488e-92bf-db9446b2320f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:04.704487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d31d41a-3741-488e-92bf-db9446b2320f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:04.712552 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d31d41a-3741-488e-92bf-db9446b2320f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1757 microversion: 2.1 time: 0.178719 Jul 28 04:50:04.713145 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4986/7436] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:04 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:50:05.738581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6ff8f592-a906-4ea0-9a07-93d1d8a38777 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:05.739293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6ff8f592-a906-4ea0-9a07-93d1d8a38777 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:05.747851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ff8f592-a906-4ea0-9a07-93d1d8a38777 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:05.748478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ff8f592-a906-4ea0-9a07-93d1d8a38777 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:05.749632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ff8f592-a906-4ea0-9a07-93d1d8a38777 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:05.750527 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6ff8f592-a906-4ea0-9a07-93d1d8a38777 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:05.910710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6ff8f592-a906-4ea0-9a07-93d1d8a38777 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:05.920086 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6ff8f592-a906-4ea0-9a07-93d1d8a38777 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1757 microversion: 2.1 time: 0.188275 Jul 28 04:50:05.920689 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4987/7437] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:05 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:50:06.947957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ce450ae9-5a53-45bc-9798-5473b02a7196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:06.948708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ce450ae9-5a53-45bc-9798-5473b02a7196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:06.956311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce450ae9-5a53-45bc-9798-5473b02a7196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:06.956930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce450ae9-5a53-45bc-9798-5473b02a7196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:06.957690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce450ae9-5a53-45bc-9798-5473b02a7196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:06.958166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ce450ae9-5a53-45bc-9798-5473b02a7196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:07.119863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ce450ae9-5a53-45bc-9798-5473b02a7196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:07.133102 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ce450ae9-5a53-45bc-9798-5473b02a7196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1757 microversion: 2.1 time: 0.189010 Jul 28 04:50:07.133798 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4988/7438] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:06 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:50:08.161273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1cc7ea9d-23b7-415c-8cb9-3d917712e472 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:08.162235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1cc7ea9d-23b7-415c-8cb9-3d917712e472 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:08.171124 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cc7ea9d-23b7-415c-8cb9-3d917712e472 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:08.171698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cc7ea9d-23b7-415c-8cb9-3d917712e472 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:08.172696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cc7ea9d-23b7-415c-8cb9-3d917712e472 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:08.173249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cc7ea9d-23b7-415c-8cb9-3d917712e472 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:08.330016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1cc7ea9d-23b7-415c-8cb9-3d917712e472 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:08.339075 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1cc7ea9d-23b7-415c-8cb9-3d917712e472 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1757 microversion: 2.1 time: 0.183060 Jul 28 04:50:08.339627 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4989/7439] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:08 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:50:09.373280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d069406c-fe5b-47b5-aebf-693b05cf9e46 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:09.374329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d069406c-fe5b-47b5-aebf-693b05cf9e46 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:09.383901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d069406c-fe5b-47b5-aebf-693b05cf9e46 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:09.384379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d069406c-fe5b-47b5-aebf-693b05cf9e46 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:09.385223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d069406c-fe5b-47b5-aebf-693b05cf9e46 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:09.385671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d069406c-fe5b-47b5-aebf-693b05cf9e46 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:09.547052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d069406c-fe5b-47b5-aebf-693b05cf9e46 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:09.559743 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d069406c-fe5b-47b5-aebf-693b05cf9e46 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1757 microversion: 2.1 time: 0.193024 Jul 28 04:50:09.560548 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4990/7440] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:09 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:50:10.584836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-84f81718-df5c-41aa-9216-793954c1b091 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:10.587114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-84f81718-df5c-41aa-9216-793954c1b091 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:10.593081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84f81718-df5c-41aa-9216-793954c1b091 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:10.593583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84f81718-df5c-41aa-9216-793954c1b091 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:10.594376 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84f81718-df5c-41aa-9216-793954c1b091 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:10.594830 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84f81718-df5c-41aa-9216-793954c1b091 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:10.753918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-84f81718-df5c-41aa-9216-793954c1b091 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:10.762964 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-84f81718-df5c-41aa-9216-793954c1b091 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1757 microversion: 2.1 time: 0.182259 Jul 28 04:50:10.763556 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4991/7441] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:10 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:50:11.785241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-534ddda1-d39a-4c17-afac-12c308e12a5a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:11.785977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-534ddda1-d39a-4c17-afac-12c308e12a5a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:11.793764 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-534ddda1-d39a-4c17-afac-12c308e12a5a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:11.794239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-534ddda1-d39a-4c17-afac-12c308e12a5a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:11.795033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-534ddda1-d39a-4c17-afac-12c308e12a5a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:11.795489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-534ddda1-d39a-4c17-afac-12c308e12a5a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:11.952604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-534ddda1-d39a-4c17-afac-12c308e12a5a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:11.961514 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-534ddda1-d39a-4c17-afac-12c308e12a5a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1757 microversion: 2.1 time: 0.180248 Jul 28 04:50:11.962105 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4992/7442] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:11 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:50:12.983600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6fc83c7b-04f8-4aa1-8b26-844b094fc587 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:12.984302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6fc83c7b-04f8-4aa1-8b26-844b094fc587 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:12.991664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fc83c7b-04f8-4aa1-8b26-844b094fc587 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:12.992152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fc83c7b-04f8-4aa1-8b26-844b094fc587 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:12.992950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fc83c7b-04f8-4aa1-8b26-844b094fc587 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:12.993416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fc83c7b-04f8-4aa1-8b26-844b094fc587 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:13.151185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6fc83c7b-04f8-4aa1-8b26-844b094fc587 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:13.162791 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6fc83c7b-04f8-4aa1-8b26-844b094fc587 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1757 microversion: 2.1 time: 0.183295 Jul 28 04:50:13.163415 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4993/7443] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:12 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:50:14.184784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-11c8f869-4f8b-4610-b2a5-7039d562655b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:14.185548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-11c8f869-4f8b-4610-b2a5-7039d562655b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:14.193394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11c8f869-4f8b-4610-b2a5-7039d562655b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:14.193856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11c8f869-4f8b-4610-b2a5-7039d562655b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:14.194644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11c8f869-4f8b-4610-b2a5-7039d562655b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:14.195090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11c8f869-4f8b-4610-b2a5-7039d562655b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:14.350159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-11c8f869-4f8b-4610-b2a5-7039d562655b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:14.365611 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-11c8f869-4f8b-4610-b2a5-7039d562655b tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1757 microversion: 2.1 time: 0.184732 Jul 28 04:50:14.366488 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4994/7444] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:14 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:50:15.388034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1de12f97-b6cb-4e81-8449-ebd75c06526e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:15.388722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1de12f97-b6cb-4e81-8449-ebd75c06526e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:15.396282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1de12f97-b6cb-4e81-8449-ebd75c06526e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:15.396997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1de12f97-b6cb-4e81-8449-ebd75c06526e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:15.397796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1de12f97-b6cb-4e81-8449-ebd75c06526e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:15.398242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1de12f97-b6cb-4e81-8449-ebd75c06526e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:15.546355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1de12f97-b6cb-4e81-8449-ebd75c06526e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:15.554870 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1de12f97-b6cb-4e81-8449-ebd75c06526e tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1757 microversion: 2.1 time: 0.170882 Jul 28 04:50:15.555494 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4995/7445] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:15 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:50:16.577257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2990334d-2db0-44c6-be9c-2725fc743489 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:16.577843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2990334d-2db0-44c6-be9c-2725fc743489 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:16.585226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2990334d-2db0-44c6-be9c-2725fc743489 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:16.585696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2990334d-2db0-44c6-be9c-2725fc743489 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:16.586510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2990334d-2db0-44c6-be9c-2725fc743489 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:16.587115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2990334d-2db0-44c6-be9c-2725fc743489 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:16.742336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2990334d-2db0-44c6-be9c-2725fc743489 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:16.753375 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2990334d-2db0-44c6-be9c-2725fc743489 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1757 microversion: 2.1 time: 0.180269 Jul 28 04:50:16.753956 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4996/7446] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:16 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:50:17.422800 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:50:17.423560 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:50:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:50:17.777532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e0ab2520-075b-4fb4-a312-2c2591a88595 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:17.778153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e0ab2520-075b-4fb4-a312-2c2591a88595 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:17.785445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0ab2520-075b-4fb4-a312-2c2591a88595 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:17.785911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0ab2520-075b-4fb4-a312-2c2591a88595 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:17.786691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0ab2520-075b-4fb4-a312-2c2591a88595 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:17.787140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e0ab2520-075b-4fb4-a312-2c2591a88595 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:17.805763 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:50:17.934580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e0ab2520-075b-4fb4-a312-2c2591a88595 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:50:17.943342 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e0ab2520-075b-4fb4-a312-2c2591a88595 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1760 microversion: 2.1 time: 0.170025 Jul 28 04:50:17.943926 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4997/7447] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:50:17 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:50:52.957488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-59c7a263-8ec5-4096-8d07-8df02b3da08a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1459518555"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:50:52.958262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-59c7a263-8ec5-4096-8d07-8df02b3da08a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:52.961104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=32 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:50:52.961774 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:50:52.969552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59c7a263-8ec5-4096-8d07-8df02b3da08a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:52.970047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59c7a263-8ec5-4096-8d07-8df02b3da08a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:52.970837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59c7a263-8ec5-4096-8d07-8df02b3da08a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:52.971288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-59c7a263-8ec5-4096-8d07-8df02b3da08a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:53.108980 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.network.security_group_api [None req-59c7a263-8ec5-4096-8d07-8df02b3da08a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Removing security group 86795b5f-c7e7-4fe1-8409-afade0776ef4 from port f439873e-6fdd-4cfb-8d74-11ede9c68f7e Jul 28 04:50:53.790780 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-59c7a263-8ec5-4096-8d07-8df02b3da08a tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "POST /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/action" status: 202 len: 0 microversion: 2.1 time: 0.838773 Jul 28 04:50:53.791739 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4998/7448] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:50:52 2022] POST /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/action => generated 0 bytes in 840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:50:53.887820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3f27afed-d11a-4f5a-839b-1ff356e3f9f5 req-2c40bc59-d435-4fde-a2c8-5a75235a1257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7400e2d6-5aa9-41a4-9366-958f33b01ff8", "tag": "f439873e-6fdd-4cfb-8d74-11ede9c68f7e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:50:53.907995 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3f27afed-d11a-4f5a-839b-1ff356e3f9f5 req-2c40bc59-d435-4fde-a2c8-5a75235a1257 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:53.912106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3f27afed-d11a-4f5a-839b-1ff356e3f9f5 req-2c40bc59-d435-4fde-a2c8-5a75235a1257 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:53.930845 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3f27afed-d11a-4f5a-839b-1ff356e3f9f5 req-2c40bc59-d435-4fde-a2c8-5a75235a1257 service nova] Creating event network-changed:f439873e-6fdd-4cfb-8d74-11ede9c68f7e for instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 on n-h2-826756-3 Jul 28 04:50:53.937171 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3f27afed-d11a-4f5a-839b-1ff356e3f9f5 req-2c40bc59-d435-4fde-a2c8-5a75235a1257 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132823 Jul 28 04:50:53.938633 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 4999/7449] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:50:55.004934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-29bc3c2c-1564-4d65-b3bd-0b3568587705 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:55.005557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-29bc3c2c-1564-4d65-b3bd-0b3568587705 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:55.013968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29bc3c2c-1564-4d65-b3bd-0b3568587705 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:55.014994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29bc3c2c-1564-4d65-b3bd-0b3568587705 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:55.015757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29bc3c2c-1564-4d65-b3bd-0b3568587705 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:55.016417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29bc3c2c-1564-4d65-b3bd-0b3568587705 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:55.108394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-29bc3c2c-1564-4d65-b3bd-0b3568587705 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lazy-loading 'services' on Instance uuid 7400e2d6-5aa9-41a4-9366-958f33b01ff8 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:50:55.185611 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-29bc3c2c-1564-4d65-b3bd-0b3568587705 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments/eaec011d-8d49-4f6f-a2b2-a31969af6a94" status: 202 len: 0 microversion: 2.1 time: 0.184870 Jul 28 04:50:55.186235 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5000/7450] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:50:54 2022] DELETE /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments/eaec011d-8d49-4f6f-a2b2-a31969af6a94 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:50:55.195976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2bfe88e8-636d-4665-8829-a281c5877081 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:55.199090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2bfe88e8-636d-4665-8829-a281c5877081 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:55.206345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2bfe88e8-636d-4665-8829-a281c5877081 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:55.207427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2bfe88e8-636d-4665-8829-a281c5877081 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:55.208425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2bfe88e8-636d-4665-8829-a281c5877081 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:55.209063 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2bfe88e8-636d-4665-8829-a281c5877081 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:55.242364 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2bfe88e8-636d-4665-8829-a281c5877081 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051124 Jul 28 04:50:55.243748 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5001/7451] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:50:55 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:50:55.952182 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-55aa67f1-0cee-480a-b2e2-a5e7d2de26bb req-5f0f0e38-b278-4851-abdc-4aafa2d52dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7400e2d6-5aa9-41a4-9366-958f33b01ff8", "tag": "f439873e-6fdd-4cfb-8d74-11ede9c68f7e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:50:55.963234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-55aa67f1-0cee-480a-b2e2-a5e7d2de26bb req-5f0f0e38-b278-4851-abdc-4aafa2d52dcb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:55.963999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-55aa67f1-0cee-480a-b2e2-a5e7d2de26bb req-5f0f0e38-b278-4851-abdc-4aafa2d52dcb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:55.976810 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-55aa67f1-0cee-480a-b2e2-a5e7d2de26bb req-5f0f0e38-b278-4851-abdc-4aafa2d52dcb service nova] Creating event network-changed:f439873e-6fdd-4cfb-8d74-11ede9c68f7e for instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 on n-h2-826756-3 Jul 28 04:50:55.981791 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-55aa67f1-0cee-480a-b2e2-a5e7d2de26bb req-5f0f0e38-b278-4851-abdc-4aafa2d52dcb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033437 Jul 28 04:50:55.982741 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5002/7452] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:50:56.256117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-665e6d76-e019-424f-88c7-bbf00d6c55f0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:56.259360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-665e6d76-e019-424f-88c7-bbf00d6c55f0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:56.266369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-665e6d76-e019-424f-88c7-bbf00d6c55f0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:56.266913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-665e6d76-e019-424f-88c7-bbf00d6c55f0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:56.267902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-665e6d76-e019-424f-88c7-bbf00d6c55f0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:56.268450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-665e6d76-e019-424f-88c7-bbf00d6c55f0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:56.300802 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-665e6d76-e019-424f-88c7-bbf00d6c55f0 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048938 Jul 28 04:50:56.301714 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5003/7453] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:50:56 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:50:57.315660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fbceb92c-541e-480c-b62a-8b59388227bc tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:57.318689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fbceb92c-541e-480c-b62a-8b59388227bc tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:57.326768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbceb92c-541e-480c-b62a-8b59388227bc tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:57.327270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbceb92c-541e-480c-b62a-8b59388227bc tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:57.328071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbceb92c-541e-480c-b62a-8b59388227bc tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:57.328551 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fbceb92c-541e-480c-b62a-8b59388227bc tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:57.361258 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fbceb92c-541e-480c-b62a-8b59388227bc tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051496 Jul 28 04:50:57.361900 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5004/7454] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:50:57 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:50:58.374646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6b379944-17a1-4249-808f-281b6ec9355f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:58.376828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6b379944-17a1-4249-808f-281b6ec9355f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:58.384185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b379944-17a1-4249-808f-281b6ec9355f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:58.384663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b379944-17a1-4249-808f-281b6ec9355f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:58.385503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b379944-17a1-4249-808f-281b6ec9355f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:58.385937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6b379944-17a1-4249-808f-281b6ec9355f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:58.417206 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6b379944-17a1-4249-808f-281b6ec9355f tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046700 Jul 28 04:50:58.417665 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5005/7455] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:50:58 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:50:59.429996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-50cf19f0-15fc-41b1-bb5c-1cb562fbc77c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:50:59.432273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-50cf19f0-15fc-41b1-bb5c-1cb562fbc77c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:50:59.439733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50cf19f0-15fc-41b1-bb5c-1cb562fbc77c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:59.440193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50cf19f0-15fc-41b1-bb5c-1cb562fbc77c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:59.441143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50cf19f0-15fc-41b1-bb5c-1cb562fbc77c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:50:59.441600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50cf19f0-15fc-41b1-bb5c-1cb562fbc77c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:50:59.472437 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-50cf19f0-15fc-41b1-bb5c-1cb562fbc77c tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046081 Jul 28 04:50:59.473009 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5006/7456] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:50:59 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:51:00.486744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0353fa60-774e-418b-824c-f1ae5af9d1a8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:00.488936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0353fa60-774e-418b-824c-f1ae5af9d1a8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:00.496237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0353fa60-774e-418b-824c-f1ae5af9d1a8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:00.496755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0353fa60-774e-418b-824c-f1ae5af9d1a8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:00.497541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0353fa60-774e-418b-824c-f1ae5af9d1a8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:00.498183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0353fa60-774e-418b-824c-f1ae5af9d1a8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:00.528814 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0353fa60-774e-418b-824c-f1ae5af9d1a8 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046565 Jul 28 04:51:00.529396 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5007/7457] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Jul 28 04:51:00 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:51:00.539649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-862a8e2b-fc2f-4f07-8b44-0a099eaa0196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:00.540147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-862a8e2b-fc2f-4f07-8b44-0a099eaa0196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:00.546400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-862a8e2b-fc2f-4f07-8b44-0a099eaa0196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:00.546859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-862a8e2b-fc2f-4f07-8b44-0a099eaa0196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:00.547631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-862a8e2b-fc2f-4f07-8b44-0a099eaa0196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:00.548093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-862a8e2b-fc2f-4f07-8b44-0a099eaa0196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:00.631700 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-862a8e2b-fc2f-4f07-8b44-0a099eaa0196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] HTTP exception thrown: Instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 is not attached to volume eaec011d-8d49-4f6f-a2b2-a31969af6a94 Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-862a8e2b-fc2f-4f07-8b44-0a099eaa0196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Request method failure captured: Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: request: DELETE /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments/eaec011d-8d49-4f6f-a2b2-a31969af6a94 HTTP/1.1 Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hREKO8a3Lpg11uB8EbHIVmYv29dWJb9hiYrTO2-aFtXsuoLuTIDv0HrOE2vXsDsOhfLonw6PHdjpOnMcPtBJhx0tBStf0tJtzzmwY_slZggbK4gILb5_LquYe5GqsTcx1N21pXwOsD4wHDYtOGHEco6Xmrnu8548vG-GP-hlpUucUw Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a4752b99f8f54e409455a796474e5c89 Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestMinimumBasicScenario-1769738806 Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4752b99f8f54e409455a796474e5c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4752b99f8f54e409455a796474e5c89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4752b99f8f54e409455a796474e5c89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4752b99f8f54e409455a796474e5c89"}]}] Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestMinimumBasicScenario-1769738806 Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a4752b99f8f54e409455a796474e5c89 Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1769738806 Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestMinimumBasicScenario-1769738806-project Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 8451e4954caa4f909ff6719d08e69b50 Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestMinimumBasicScenario-1769738806-project Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 is not attached to volume eaec011d-8d49-4f6f-a2b2-a31969af6a94 Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'server_id': '7400e2d6-5aa9-41a4-9366-958f33b01ff8', 'id': 'eaec011d-8d49-4f6f-a2b2-a31969af6a94'} Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eaec011d-8d49-4f6f-a2b2-a31969af6a94. Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 is not attached to volume eaec011d-8d49-4f6f-a2b2-a31969af6a94 Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:51:00.633374 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:51:00.637797 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:51:00.637797 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:51:00.637797 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 is not attached to volume eaec011d-8d49-4f6f-a2b2-a31969af6a94 Jul 28 04:51:00.637797 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:51:00.637797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-862a8e2b-fc2f-4f07-8b44-0a099eaa0196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Returning 404 to user: Instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 is not attached to volume eaec011d-8d49-4f6f-a2b2-a31969af6a94 {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:51:00.637797 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-862a8e2b-fc2f-4f07-8b44-0a099eaa0196 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments/eaec011d-8d49-4f6f-a2b2-a31969af6a94" status: 404 len: 154 microversion: 2.1 time: 0.099009 Jul 28 04:51:00.637797 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5008/7458] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Jul 28 04:51:00 2022] DELETE /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8/os-volume_attachments/eaec011d-8d49-4f6f-a2b2-a31969af6a94 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:51:03.891419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b3f3058-e2df-4e56-aaa9-d25325557811 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:03.892055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b3f3058-e2df-4e56-aaa9-d25325557811 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:03.900579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b3f3058-e2df-4e56-aaa9-d25325557811 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:03.901055 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b3f3058-e2df-4e56-aaa9-d25325557811 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:03.901842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b3f3058-e2df-4e56-aaa9-d25325557811 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:03.902287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b3f3058-e2df-4e56-aaa9-d25325557811 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:03.927804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b3f3058-e2df-4e56-aaa9-d25325557811 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:51:04.296835 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b3f3058-e2df-4e56-aaa9-d25325557811 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 204 len: 0 microversion: 2.1 time: 0.409294 Jul 28 04:51:04.297371 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5009/7459] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:51:03 2022] DELETE /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:51:04.306258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2473b0e5-a1ec-45d3-b3d0-0b5e9ddf3810 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:04.306922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2473b0e5-a1ec-45d3-b3d0-0b5e9ddf3810 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:04.314071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2473b0e5-a1ec-45d3-b3d0-0b5e9ddf3810 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:04.314071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2473b0e5-a1ec-45d3-b3d0-0b5e9ddf3810 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:04.314464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2473b0e5-a1ec-45d3-b3d0-0b5e9ddf3810 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:04.314914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2473b0e5-a1ec-45d3-b3d0-0b5e9ddf3810 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:04.454554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2473b0e5-a1ec-45d3-b3d0-0b5e9ddf3810 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:04.462971 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2473b0e5-a1ec-45d3-b3d0-0b5e9ddf3810 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1555 microversion: 2.1 time: 0.161007 Jul 28 04:51:04.464594 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5010/7460] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:04 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:51:05.485711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1b441441-e99e-4376-bcd0-b6723d9431ee tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:05.486450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1b441441-e99e-4376-bcd0-b6723d9431ee tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:05.494145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b441441-e99e-4376-bcd0-b6723d9431ee tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:05.494612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b441441-e99e-4376-bcd0-b6723d9431ee tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:05.495399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b441441-e99e-4376-bcd0-b6723d9431ee tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:05.495860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b441441-e99e-4376-bcd0-b6723d9431ee tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:05.636286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1b441441-e99e-4376-bcd0-b6723d9431ee tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:05.644403 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1b441441-e99e-4376-bcd0-b6723d9431ee tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1555 microversion: 2.1 time: 0.163104 Jul 28 04:51:05.644946 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5011/7461] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:05 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:51:06.666086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-de528fdf-caf2-4951-8555-1fbdf2f2f1e1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:06.666749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-de528fdf-caf2-4951-8555-1fbdf2f2f1e1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:06.674404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de528fdf-caf2-4951-8555-1fbdf2f2f1e1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:06.674864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de528fdf-caf2-4951-8555-1fbdf2f2f1e1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:06.675627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de528fdf-caf2-4951-8555-1fbdf2f2f1e1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:06.676075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de528fdf-caf2-4951-8555-1fbdf2f2f1e1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:06.814373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-de528fdf-caf2-4951-8555-1fbdf2f2f1e1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8451e4954caa4f909ff6719d08e69b50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4752b99f8f54e409455a796474e5c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:06.822921 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-de528fdf-caf2-4951-8555-1fbdf2f2f1e1 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 200 len: 1555 microversion: 2.1 time: 0.160960 Jul 28 04:51:06.823547 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5012/7462] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:06 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:51:07.009601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c5673b22-2e2e-4dbe-b227-e9c440f5007d req-9428b9bd-6950-4bdf-92d5-db36a1bc4b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7400e2d6-5aa9-41a4-9366-958f33b01ff8", "name": "network-vif-deleted", "tag": "f439873e-6fdd-4cfb-8d74-11ede9c68f7e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:51:07.019623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c5673b22-2e2e-4dbe-b227-e9c440f5007d req-9428b9bd-6950-4bdf-92d5-db36a1bc4b9e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:07.020080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c5673b22-2e2e-4dbe-b227-e9c440f5007d req-9428b9bd-6950-4bdf-92d5-db36a1bc4b9e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:07.032482 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c5673b22-2e2e-4dbe-b227-e9c440f5007d req-9428b9bd-6950-4bdf-92d5-db36a1bc4b9e service nova] Creating event network-vif-deleted:f439873e-6fdd-4cfb-8d74-11ede9c68f7e for instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 on n-h2-826756-3 Jul 28 04:51:07.037866 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c5673b22-2e2e-4dbe-b227-e9c440f5007d req-9428b9bd-6950-4bdf-92d5-db36a1bc4b9e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092316 Jul 28 04:51:07.038675 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5013/7463] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:51:07.848772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-de82c09c-3e10-46e0-a2ea-190e46c16679 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:07.849488 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-de82c09c-3e10-46e0-a2ea-190e46c16679 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] [instance: 7400e2d6-5aa9-41a4-9366-958f33b01ff8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:07.857352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de82c09c-3e10-46e0-a2ea-190e46c16679 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:07.858029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de82c09c-3e10-46e0-a2ea-190e46c16679 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:07.858835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de82c09c-3e10-46e0-a2ea-190e46c16679 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:07.859274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-de82c09c-3e10-46e0-a2ea-190e46c16679 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:07.872942 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-de82c09c-3e10-46e0-a2ea-190e46c16679 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] HTTP exception thrown: Instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 could not be found. Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-de82c09c-3e10-46e0-a2ea-190e46c16679 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Request method failure captured: Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 HTTP/1.1 Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hREKO8a3Lpg11uB8EbHIVmYv29dWJb9hiYrTO2-aFtXsuoLuTIDv0HrOE2vXsDsOhfLonw6PHdjpOnMcPtBJhx0tBStf0tJtzzmwY_slZggbK4gILb5_LquYe5GqsTcx1N21pXwOsD4wHDYtOGHEco6Xmrnu8548vG-GP-hlpUucUw Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: a4752b99f8f54e409455a796474e5c89 Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestMinimumBasicScenario-1769738806 Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a4752b99f8f54e409455a796474e5c89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4752b99f8f54e409455a796474e5c89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a4752b99f8f54e409455a796474e5c89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a4752b99f8f54e409455a796474e5c89"}]}] Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestMinimumBasicScenario-1769738806 Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: a4752b99f8f54e409455a796474e5c89 Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1769738806 Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestMinimumBasicScenario-1769738806-project Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 8451e4954caa4f909ff6719d08e69b50 Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestMinimumBasicScenario-1769738806-project Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 could not be found. Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '7400e2d6-5aa9-41a4-9366-958f33b01ff8'} Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 could not be found. Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 could not be found. Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:51:07.874596 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:51:07.879274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:51:07.879274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:51:07.879274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:51:07.879274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:51:07.879274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:51:07.879274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 could not be found. Jul 28 04:51:07.879274 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:51:07.879274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-de82c09c-3e10-46e0-a2ea-190e46c16679 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Returning 404 to user: Instance 7400e2d6-5aa9-41a4-9366-958f33b01ff8 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:51:07.879274 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-de82c09c-3e10-46e0-a2ea-190e46c16679 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8" status: 404 len: 111 microversion: 2.1 time: 0.034318 Jul 28 04:51:07.879274 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5014/7464] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:07 2022] GET /compute/v2.1/servers/7400e2d6-5aa9-41a4-9366-958f33b01ff8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:51:07.884928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9ed19b16-057e-49cf-82f1-b95094735a82 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] Calling method '.version_select at 0x7ffa66e95ee0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:07.908997 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9ed19b16-057e-49cf-82f1-b95094735a82 tempest-TestMinimumBasicScenario-1769738806 tempest-TestMinimumBasicScenario-1769738806-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-696326470" status: 202 len: 0 microversion: 2.1 time: 0.027447 Jul 28 04:51:07.909573 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5015/7465] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Jul 28 04:51:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-696326470 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:51:17.670735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2992ae90-ad5e-4ae9-acab-1e2ce9d6c9e3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'create', calling method: .version_select at 0x7ffa674be940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-184657985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8Sl/azpLspxs8JIcTaJYzUg9EEwxrA2W0FhLzwi7HBc9dGEosvpGoXgfJoDhNe8rfDlqCoymxYUA6rPXyBr5ZNzLVyoDsNMUJFr5LuFXqCezTueIHiTibogzS6EffmeA=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:51:17.687663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2992ae90-ad5e-4ae9-acab-1e2ce9d6c9e3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for project 8e18d061762841dab3882493fbb4f835. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:51:17.692994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2992ae90-ad5e-4ae9-acab-1e2ce9d6c9e3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for user 3f0cd417487147bc9bc925fa0ad1f7a1 and project 8e18d061762841dab3882493fbb4f835. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:51:17.724574 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2992ae90-ad5e-4ae9-acab-1e2ce9d6c9e3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.232553 Jul 28 04:51:17.725464 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5016/7466] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:51:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:51:23.606217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:51:23.613091 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-952950708", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "f1495d67-908b-4a49-a5be-dc7206406b79"}], "key_name": "tempest-TestNetworkAdvancedServerOps-184657985", "security_groups": [{"name": "tempest-secgroup-smoke-453170051"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:51:23.628324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:51:23.748734 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] validate_networks() for [('f1495d67-908b-4a49-a5be-dc7206406b79', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:51:24.171344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:51:24.171856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:51:24.172444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:51:24.173016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:51:24.173698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:51:24.183178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:24.183867 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:24.184860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:24.185361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:24.203360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for project 8e18d061762841dab3882493fbb4f835. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:51:24.209045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for user 3f0cd417487147bc9bc925fa0ad1f7a1 and project 8e18d061762841dab3882493fbb4f835. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:51:24.223537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:51:24.225349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:51:24.276745 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-18eba76f-7664-4dbb-9dc9-e57bc7f8ad30 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.671234 Jul 28 04:51:24.277942 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5017/7467] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:51:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:51:24.288694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-941ea38c-94f1-4f91-a2ac-0a9ce6faf3a7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:24.289461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-941ea38c-94f1-4f91-a2ac-0a9ce6faf3a7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:24.346532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-941ea38c-94f1-4f91-a2ac-0a9ce6faf3a7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:24.358598 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-941ea38c-94f1-4f91-a2ac-0a9ce6faf3a7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1265 microversion: 2.1 time: 0.073795 Jul 28 04:51:24.359209 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5018/7468] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:24 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1265 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:51:25.379619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1ca0cd29-4397-4303-acd1-60271cadd627 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:25.380733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1ca0cd29-4397-4303-acd1-60271cadd627 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:25.389137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ca0cd29-4397-4303-acd1-60271cadd627 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:25.390413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ca0cd29-4397-4303-acd1-60271cadd627 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:25.390860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ca0cd29-4397-4303-acd1-60271cadd627 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:25.391554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1ca0cd29-4397-4303-acd1-60271cadd627 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:25.466228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1ca0cd29-4397-4303-acd1-60271cadd627 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:25.474822 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1ca0cd29-4397-4303-acd1-60271cadd627 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1317 microversion: 2.1 time: 0.099188 Jul 28 04:51:25.475407 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5019/7469] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:25 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1317 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:51:26.500293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5fa532f3-086c-435f-be15-4f48fd7b4d3b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:26.501660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5fa532f3-086c-435f-be15-4f48fd7b4d3b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:26.509072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fa532f3-086c-435f-be15-4f48fd7b4d3b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:26.509786 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fa532f3-086c-435f-be15-4f48fd7b4d3b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:26.510752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fa532f3-086c-435f-be15-4f48fd7b4d3b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:26.511361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5fa532f3-086c-435f-be15-4f48fd7b4d3b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:26.688544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5fa532f3-086c-435f-be15-4f48fd7b4d3b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:26.698433 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5fa532f3-086c-435f-be15-4f48fd7b4d3b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1390 microversion: 2.1 time: 0.203294 Jul 28 04:51:26.704785 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5020/7470] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:26 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1390 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:51:27.358050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b01b3989-9529-414a-9205-8813935c8dd5 req-6f73f8e6-44e5-4cbd-8bc7-8007ed22a4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa474266-38cf-40a3-a099-ca48ceba4b5e", "tag": "5acf708c-e381-4a42-959c-5b17191e51a2"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:51:27.375415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b01b3989-9529-414a-9205-8813935c8dd5 req-6f73f8e6-44e5-4cbd-8bc7-8007ed22a4b0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:27.375794 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b01b3989-9529-414a-9205-8813935c8dd5 req-6f73f8e6-44e5-4cbd-8bc7-8007ed22a4b0 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:27.392318 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b01b3989-9529-414a-9205-8813935c8dd5 req-6f73f8e6-44e5-4cbd-8bc7-8007ed22a4b0 service nova] Creating event network-changed:5acf708c-e381-4a42-959c-5b17191e51a2 for instance aa474266-38cf-40a3-a099-ca48ceba4b5e on n-h2-826756-3 Jul 28 04:51:27.397881 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b01b3989-9529-414a-9205-8813935c8dd5 req-6f73f8e6-44e5-4cbd-8bc7-8007ed22a4b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050863 Jul 28 04:51:27.399078 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5021/7471] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:51:27.720074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2b7f6f41-f920-4cda-a8ee-830682eff224 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:27.720822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2b7f6f41-f920-4cda-a8ee-830682eff224 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:27.728999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b7f6f41-f920-4cda-a8ee-830682eff224 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:27.729466 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b7f6f41-f920-4cda-a8ee-830682eff224 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:27.730233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b7f6f41-f920-4cda-a8ee-830682eff224 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:27.730675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2b7f6f41-f920-4cda-a8ee-830682eff224 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:27.883827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2b7f6f41-f920-4cda-a8ee-830682eff224 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:27.891993 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2b7f6f41-f920-4cda-a8ee-830682eff224 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1390 microversion: 2.1 time: 0.176295 Jul 28 04:51:27.892584 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5022/7472] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:27 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:51:28.913581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c34f222a-453f-4384-95f1-894b4162b287 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:28.914316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c34f222a-453f-4384-95f1-894b4162b287 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:28.921745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c34f222a-453f-4384-95f1-894b4162b287 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:28.922338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c34f222a-453f-4384-95f1-894b4162b287 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:28.923106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c34f222a-453f-4384-95f1-894b4162b287 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:28.923567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c34f222a-453f-4384-95f1-894b4162b287 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:29.065835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c34f222a-453f-4384-95f1-894b4162b287 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:29.074542 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c34f222a-453f-4384-95f1-894b4162b287 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1390 microversion: 2.1 time: 0.164938 Jul 28 04:51:29.075126 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5023/7473] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:28 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:51:30.099313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-addd35ed-1793-4fbe-afdd-d69be4cc06ac tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:30.100213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-addd35ed-1793-4fbe-afdd-d69be4cc06ac tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:30.111123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-addd35ed-1793-4fbe-afdd-d69be4cc06ac tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:30.111836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-addd35ed-1793-4fbe-afdd-d69be4cc06ac tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:30.113071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-addd35ed-1793-4fbe-afdd-d69be4cc06ac tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:30.113760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-addd35ed-1793-4fbe-afdd-d69be4cc06ac tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:30.261310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-addd35ed-1793-4fbe-afdd-d69be4cc06ac tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:30.269377 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-addd35ed-1793-4fbe-afdd-d69be4cc06ac tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1390 microversion: 2.1 time: 0.176721 Jul 28 04:51:30.269969 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5024/7474] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:30 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:51:31.291318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5652cb26-2879-4965-8b5a-7788f6997054 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:31.291976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5652cb26-2879-4965-8b5a-7788f6997054 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:31.299433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5652cb26-2879-4965-8b5a-7788f6997054 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:31.299893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5652cb26-2879-4965-8b5a-7788f6997054 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:31.300707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5652cb26-2879-4965-8b5a-7788f6997054 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:31.301152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5652cb26-2879-4965-8b5a-7788f6997054 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:31.438208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5652cb26-2879-4965-8b5a-7788f6997054 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:31.447080 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5652cb26-2879-4965-8b5a-7788f6997054 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1390 microversion: 2.1 time: 0.159930 Jul 28 04:51:31.447902 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5025/7475] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:31 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:51:32.468766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9e5520f5-0186-4d56-af6f-016f8caeb4aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:32.471784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9e5520f5-0186-4d56-af6f-016f8caeb4aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:32.480420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e5520f5-0186-4d56-af6f-016f8caeb4aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:32.480893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e5520f5-0186-4d56-af6f-016f8caeb4aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:32.481864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e5520f5-0186-4d56-af6f-016f8caeb4aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:32.482445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e5520f5-0186-4d56-af6f-016f8caeb4aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:32.631378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9e5520f5-0186-4d56-af6f-016f8caeb4aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:32.643214 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9e5520f5-0186-4d56-af6f-016f8caeb4aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1390 microversion: 2.1 time: 0.178340 Jul 28 04:51:32.643926 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5026/7476] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:32 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:51:33.483017 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-2648d7ae-8b09-4ecd-b14c-5c17f48baada req-81ec9053-40f9-4071-ba4f-13581bc2d7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa474266-38cf-40a3-a099-ca48ceba4b5e", "name": "network-vif-plugged", "status": "completed", "tag": "5acf708c-e381-4a42-959c-5b17191e51a2"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:51:33.494202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2648d7ae-8b09-4ecd-b14c-5c17f48baada req-81ec9053-40f9-4071-ba4f-13581bc2d7ed service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:33.494633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-2648d7ae-8b09-4ecd-b14c-5c17f48baada req-81ec9053-40f9-4071-ba4f-13581bc2d7ed service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:33.505748 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-2648d7ae-8b09-4ecd-b14c-5c17f48baada req-81ec9053-40f9-4071-ba4f-13581bc2d7ed service nova] Creating event network-vif-plugged:5acf708c-e381-4a42-959c-5b17191e51a2 for instance aa474266-38cf-40a3-a099-ca48ceba4b5e on n-h2-826756-3 Jul 28 04:51:33.510810 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-2648d7ae-8b09-4ecd-b14c-5c17f48baada req-81ec9053-40f9-4071-ba4f-13581bc2d7ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095438 Jul 28 04:51:33.511444 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5027/7477] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:51:33.665744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-96f1b41d-b30c-48a1-a250-c5da6f5ca98e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:33.666311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-96f1b41d-b30c-48a1-a250-c5da6f5ca98e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:33.673227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96f1b41d-b30c-48a1-a250-c5da6f5ca98e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:33.673672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96f1b41d-b30c-48a1-a250-c5da6f5ca98e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:33.674463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96f1b41d-b30c-48a1-a250-c5da6f5ca98e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:33.674918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-96f1b41d-b30c-48a1-a250-c5da6f5ca98e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:33.827894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-96f1b41d-b30c-48a1-a250-c5da6f5ca98e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:33.836310 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-96f1b41d-b30c-48a1-a250-c5da6f5ca98e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1390 microversion: 2.1 time: 0.175021 Jul 28 04:51:33.836958 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5028/7478] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:33 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:51:34.858189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a0e942a-e60c-4b47-97ca-b58d30d6899d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:34.859324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4a0e942a-e60c-4b47-97ca-b58d30d6899d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:34.862369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:51:34.863296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:51:34.871988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a0e942a-e60c-4b47-97ca-b58d30d6899d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:34.872753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a0e942a-e60c-4b47-97ca-b58d30d6899d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:34.873563 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a0e942a-e60c-4b47-97ca-b58d30d6899d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:34.874015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a0e942a-e60c-4b47-97ca-b58d30d6899d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:35.020988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a0e942a-e60c-4b47-97ca-b58d30d6899d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:35.029260 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4a0e942a-e60c-4b47-97ca-b58d30d6899d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1390 microversion: 2.1 time: 0.175179 Jul 28 04:51:35.029892 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5029/7479] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:34 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:51:36.051146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1654b11-24ac-4473-a674-54d175ee8d28 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:36.051772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1654b11-24ac-4473-a674-54d175ee8d28 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:36.059500 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1654b11-24ac-4473-a674-54d175ee8d28 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:36.059969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1654b11-24ac-4473-a674-54d175ee8d28 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:36.060821 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1654b11-24ac-4473-a674-54d175ee8d28 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:36.061251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1654b11-24ac-4473-a674-54d175ee8d28 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:36.199866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b1654b11-24ac-4473-a674-54d175ee8d28 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:36.208009 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1654b11-24ac-4473-a674-54d175ee8d28 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1562 microversion: 2.1 time: 0.161088 Jul 28 04:51:36.208646 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5030/7480] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:36 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:51:36.228770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b58addb2-20a4-445c-a3a9-36520b6d8158 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:36.229398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b58addb2-20a4-445c-a3a9-36520b6d8158 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:36.235943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b58addb2-20a4-445c-a3a9-36520b6d8158 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:36.236422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b58addb2-20a4-445c-a3a9-36520b6d8158 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:36.237238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b58addb2-20a4-445c-a3a9-36520b6d8158 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:36.237706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b58addb2-20a4-445c-a3a9-36520b6d8158 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:36.373720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b58addb2-20a4-445c-a3a9-36520b6d8158 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:36.382048 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b58addb2-20a4-445c-a3a9-36520b6d8158 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1562 microversion: 2.1 time: 0.157019 Jul 28 04:51:36.382629 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5031/7481] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:36 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:51:38.317218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-97df6026-c766-4a53-97f2-63853c0676be tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:51:38.317862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-97df6026-c766-4a53-97f2-63853c0676be tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:51:38.325317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97df6026-c766-4a53-97f2-63853c0676be tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:38.325792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97df6026-c766-4a53-97f2-63853c0676be tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:38.326717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97df6026-c766-4a53-97f2-63853c0676be tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:38.327172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-97df6026-c766-4a53-97f2-63853c0676be tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:38.467259 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-97df6026-c766-4a53-97f2-63853c0676be tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:51:38.475697 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-97df6026-c766-4a53-97f2-63853c0676be tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1562 microversion: 2.1 time: 0.162602 Jul 28 04:51:38.476312 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5032/7482] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:51:38 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:51:38.481571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-3cdd7d84-6acc-4a30-b9b4-15c97e62eeaf req-bb5bbf3c-8665-4123-a2c4-fb7d1e727cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa474266-38cf-40a3-a099-ca48ceba4b5e", "tag": "5acf708c-e381-4a42-959c-5b17191e51a2"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:51:38.491421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3cdd7d84-6acc-4a30-b9b4-15c97e62eeaf req-bb5bbf3c-8665-4123-a2c4-fb7d1e727cb5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:51:38.492283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-3cdd7d84-6acc-4a30-b9b4-15c97e62eeaf req-bb5bbf3c-8665-4123-a2c4-fb7d1e727cb5 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:51:38.511117 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-3cdd7d84-6acc-4a30-b9b4-15c97e62eeaf req-bb5bbf3c-8665-4123-a2c4-fb7d1e727cb5 service nova] Creating event network-changed:5acf708c-e381-4a42-959c-5b17191e51a2 for instance aa474266-38cf-40a3-a099-ca48ceba4b5e on n-h2-826756-3 Jul 28 04:51:38.516784 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-3cdd7d84-6acc-4a30-b9b4-15c97e62eeaf req-bb5bbf3c-8665-4123-a2c4-fb7d1e727cb5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038945 Jul 28 04:51:38.518182 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5033/7483] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:51:45.869775 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:51:45.870409 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:51:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:52:01.794687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3ea418f7-3722-41ed-86ab-c7b47a693f63 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:52:01.797205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3ea418f7-3722-41ed-86ab-c7b47a693f63 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:01.799620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:52:01.800279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=80 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:52:01.806606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ea418f7-3722-41ed-86ab-c7b47a693f63 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:01.807114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ea418f7-3722-41ed-86ab-c7b47a693f63 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:01.807899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ea418f7-3722-41ed-86ab-c7b47a693f63 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:01.808367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3ea418f7-3722-41ed-86ab-c7b47a693f63 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:01.876127 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3ea418f7-3722-41ed-86ab-c7b47a693f63 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e/action" status: 200 len: 24564 microversion: 2.1 time: 0.085993 Jul 28 04:52:01.876853 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5034/7484] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:52:01 2022] POST /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e/action => generated 24564 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:52:12.805970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1df7da06-efdf-4d89-b883-d57a8a021f80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:52:12.806714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1df7da06-efdf-4d89-b883-d57a8a021f80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:12.809799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:52:12.810457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:52:12.816811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1df7da06-efdf-4d89-b883-d57a8a021f80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:12.817270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1df7da06-efdf-4d89-b883-d57a8a021f80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:12.818120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1df7da06-efdf-4d89-b883-d57a8a021f80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:12.818562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1df7da06-efdf-4d89-b883-d57a8a021f80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:12.902527 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1df7da06-efdf-4d89-b883-d57a8a021f80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e/action" status: 202 len: 0 microversion: 2.1 time: 0.100917 Jul 28 04:52:12.903198 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5035/7485] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:52:12 2022] POST /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:52:12.917644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0385da78-6aaf-49a3-9945-a129ecbcc513 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:12.917644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0385da78-6aaf-49a3-9945-a129ecbcc513 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:12.920967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0385da78-6aaf-49a3-9945-a129ecbcc513 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:12.921428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0385da78-6aaf-49a3-9945-a129ecbcc513 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:12.922186 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0385da78-6aaf-49a3-9945-a129ecbcc513 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:12.922680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0385da78-6aaf-49a3-9945-a129ecbcc513 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:13.070556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0385da78-6aaf-49a3-9945-a129ecbcc513 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:13.078818 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0385da78-6aaf-49a3-9945-a129ecbcc513 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1685 microversion: 2.1 time: 0.169873 Jul 28 04:52:13.079420 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5036/7486] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:12 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:52:14.106392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5806915a-c361-44b7-8bb5-657469306882 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:14.107402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5806915a-c361-44b7-8bb5-657469306882 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:14.118274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5806915a-c361-44b7-8bb5-657469306882 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:14.118749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5806915a-c361-44b7-8bb5-657469306882 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:14.119525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5806915a-c361-44b7-8bb5-657469306882 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:14.120029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5806915a-c361-44b7-8bb5-657469306882 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:14.265658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5806915a-c361-44b7-8bb5-657469306882 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:14.274516 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5806915a-c361-44b7-8bb5-657469306882 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1665 microversion: 2.1 time: 0.174656 Jul 28 04:52:14.275066 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5037/7487] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:14 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1665 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:52:15.385387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c98925b6-f3a5-4994-8f21-b7ed2a3a6292 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:52:15.387568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c98925b6-f3a5-4994-8f21-b7ed2a3a6292 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:15.394937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c98925b6-f3a5-4994-8f21-b7ed2a3a6292 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:15.395434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c98925b6-f3a5-4994-8f21-b7ed2a3a6292 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:15.396208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c98925b6-f3a5-4994-8f21-b7ed2a3a6292 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:15.396680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c98925b6-f3a5-4994-8f21-b7ed2a3a6292 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:15.469097 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c98925b6-f3a5-4994-8f21-b7ed2a3a6292 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e/action" status: 200 len: 32630 microversion: 2.1 time: 0.088168 Jul 28 04:52:15.469773 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5038/7488] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:52:15 2022] POST /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e/action => generated 32630 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:52:15.487100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b1b2537b-8f64-479c-a70f-13b5b4b46992 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:52:15.488002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b1b2537b-8f64-479c-a70f-13b5b4b46992 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:15.498610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1b2537b-8f64-479c-a70f-13b5b4b46992 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:15.499261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1b2537b-8f64-479c-a70f-13b5b4b46992 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:15.500489 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1b2537b-8f64-479c-a70f-13b5b4b46992 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:15.501193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b1b2537b-8f64-479c-a70f-13b5b4b46992 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:15.574059 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b1b2537b-8f64-479c-a70f-13b5b4b46992 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e/action" status: 202 len: 0 microversion: 2.1 time: 0.092955 Jul 28 04:52:15.574748 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5039/7489] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:52:15 2022] POST /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:52:15.583936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a5eef4e1-dc10-4d32-afb7-b762e35b06df tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:15.584827 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a5eef4e1-dc10-4d32-afb7-b762e35b06df tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:15.591805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5eef4e1-dc10-4d32-afb7-b762e35b06df tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:15.592322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5eef4e1-dc10-4d32-afb7-b762e35b06df tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:15.593213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5eef4e1-dc10-4d32-afb7-b762e35b06df tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:15.593671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a5eef4e1-dc10-4d32-afb7-b762e35b06df tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:15.744093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a5eef4e1-dc10-4d32-afb7-b762e35b06df tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:15.753250 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a5eef4e1-dc10-4d32-afb7-b762e35b06df tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1672 microversion: 2.1 time: 0.173880 Jul 28 04:52:15.754051 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5040/7490] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:15 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:52:16.781152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a3c1cc1-4e9a-47e2-a93a-57b3fe0eb5a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:16.781854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1a3c1cc1-4e9a-47e2-a93a-57b3fe0eb5a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:16.789451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a3c1cc1-4e9a-47e2-a93a-57b3fe0eb5a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:16.789916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a3c1cc1-4e9a-47e2-a93a-57b3fe0eb5a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:16.790704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a3c1cc1-4e9a-47e2-a93a-57b3fe0eb5a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:16.791154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a3c1cc1-4e9a-47e2-a93a-57b3fe0eb5a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:16.941302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1a3c1cc1-4e9a-47e2-a93a-57b3fe0eb5a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:16.950049 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1a3c1cc1-4e9a-47e2-a93a-57b3fe0eb5a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1680 microversion: 2.1 time: 0.173046 Jul 28 04:52:16.951138 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5041/7491] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:16 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:52:17.056140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a0a34a21-9c86-41c6-8483-df68490709b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:52:17.058411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a0a34a21-9c86-41c6-8483-df68490709b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:17.065569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0a34a21-9c86-41c6-8483-df68490709b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:17.066029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0a34a21-9c86-41c6-8483-df68490709b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:17.066817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0a34a21-9c86-41c6-8483-df68490709b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:17.067263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0a34a21-9c86-41c6-8483-df68490709b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:17.129523 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a0a34a21-9c86-41c6-8483-df68490709b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e/action" status: 200 len: 38093 microversion: 2.1 time: 0.077219 Jul 28 04:52:17.130222 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5042/7492] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:52:17 2022] POST /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e/action => generated 38093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 04:52:18.232328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bfa581cc-24e1-48d8-a261-7494eddbe190 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:18.232968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bfa581cc-24e1-48d8-a261-7494eddbe190 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:18.240893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfa581cc-24e1-48d8-a261-7494eddbe190 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:18.241361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfa581cc-24e1-48d8-a261-7494eddbe190 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:18.242601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfa581cc-24e1-48d8-a261-7494eddbe190 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:18.242601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bfa581cc-24e1-48d8-a261-7494eddbe190 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:18.270949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bfa581cc-24e1-48d8-a261-7494eddbe190 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:52:18.353169 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bfa581cc-24e1-48d8-a261-7494eddbe190 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 204 len: 0 microversion: 2.1 time: 0.124822 Jul 28 04:52:18.357095 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5043/7493] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:52:18 2022] DELETE /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:52:18.363340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-24ef3a02-af8c-46df-b783-5214ffcbc8eb req-06023747-0824-4c74-a2f4-7d64c6246256 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa474266-38cf-40a3-a099-ca48ceba4b5e", "tag": "5acf708c-e381-4a42-959c-5b17191e51a2"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:52:18.377925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-24ef3a02-af8c-46df-b783-5214ffcbc8eb req-06023747-0824-4c74-a2f4-7d64c6246256 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:18.378381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-24ef3a02-af8c-46df-b783-5214ffcbc8eb req-06023747-0824-4c74-a2f4-7d64c6246256 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:18.389993 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-24ef3a02-af8c-46df-b783-5214ffcbc8eb req-06023747-0824-4c74-a2f4-7d64c6246256 service nova] Creating event network-changed:5acf708c-e381-4a42-959c-5b17191e51a2 for instance aa474266-38cf-40a3-a099-ca48ceba4b5e on n-h2-826756-3 Jul 28 04:52:18.395084 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-24ef3a02-af8c-46df-b783-5214ffcbc8eb req-06023747-0824-4c74-a2f4-7d64c6246256 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036566 Jul 28 04:52:18.395704 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5044/7494] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:52:18.400958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-32b89b56-9f49-4c13-93cf-0e3bf37f3c44 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:18.401682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-32b89b56-9f49-4c13-93cf-0e3bf37f3c44 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:18.408318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32b89b56-9f49-4c13-93cf-0e3bf37f3c44 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:18.408823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32b89b56-9f49-4c13-93cf-0e3bf37f3c44 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:18.409644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32b89b56-9f49-4c13-93cf-0e3bf37f3c44 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:18.410070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-32b89b56-9f49-4c13-93cf-0e3bf37f3c44 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:18.557803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-32b89b56-9f49-4c13-93cf-0e3bf37f3c44 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:18.565907 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-32b89b56-9f49-4c13-93cf-0e3bf37f3c44 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1686 microversion: 2.1 time: 0.168979 Jul 28 04:52:18.566505 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5045/7495] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:18 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:52:19.591871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2211b3e4-f3e0-47be-8335-c7a19f060037 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:19.592633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2211b3e4-f3e0-47be-8335-c7a19f060037 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:19.600524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2211b3e4-f3e0-47be-8335-c7a19f060037 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:19.601766 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2211b3e4-f3e0-47be-8335-c7a19f060037 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:19.601931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2211b3e4-f3e0-47be-8335-c7a19f060037 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:19.602745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2211b3e4-f3e0-47be-8335-c7a19f060037 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:19.754863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2211b3e4-f3e0-47be-8335-c7a19f060037 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:19.767345 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2211b3e4-f3e0-47be-8335-c7a19f060037 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1686 microversion: 2.1 time: 0.179419 Jul 28 04:52:19.768276 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5046/7496] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:19 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:52:20.797783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b3b3eb24-0695-4332-8d00-8516e3338ac5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:20.798478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b3b3eb24-0695-4332-8d00-8516e3338ac5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:20.806151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3b3eb24-0695-4332-8d00-8516e3338ac5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:20.806621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3b3eb24-0695-4332-8d00-8516e3338ac5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:20.807410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3b3eb24-0695-4332-8d00-8516e3338ac5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:20.807860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b3b3eb24-0695-4332-8d00-8516e3338ac5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:20.947318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b3b3eb24-0695-4332-8d00-8516e3338ac5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:20.955632 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b3b3eb24-0695-4332-8d00-8516e3338ac5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 200 len: 1686 microversion: 2.1 time: 0.162794 Jul 28 04:52:20.956220 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5047/7497] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:20 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:52:21.247164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0318972f-133e-4a76-9f5b-16e52690fa54 req-d27e78c8-42d7-496e-8117-a6ff5850bbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa474266-38cf-40a3-a099-ca48ceba4b5e", "name": "network-vif-deleted", "tag": "5acf708c-e381-4a42-959c-5b17191e51a2"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:52:21.256859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0318972f-133e-4a76-9f5b-16e52690fa54 req-d27e78c8-42d7-496e-8117-a6ff5850bbc8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:21.257314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0318972f-133e-4a76-9f5b-16e52690fa54 req-d27e78c8-42d7-496e-8117-a6ff5850bbc8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:21.269180 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0318972f-133e-4a76-9f5b-16e52690fa54 req-d27e78c8-42d7-496e-8117-a6ff5850bbc8 service nova] Creating event network-vif-deleted:5acf708c-e381-4a42-959c-5b17191e51a2 for instance aa474266-38cf-40a3-a099-ca48ceba4b5e on n-h2-826756-3 Jul 28 04:52:21.274012 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0318972f-133e-4a76-9f5b-16e52690fa54 req-d27e78c8-42d7-496e-8117-a6ff5850bbc8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030633 Jul 28 04:52:21.274851 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5048/7498] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:52:21.980580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e008a886-2512-4ee6-827d-13301b18425c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:21.981289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e008a886-2512-4ee6-827d-13301b18425c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: aa474266-38cf-40a3-a099-ca48ceba4b5e] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:21.988167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e008a886-2512-4ee6-827d-13301b18425c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:21.988669 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e008a886-2512-4ee6-827d-13301b18425c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:21.989456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e008a886-2512-4ee6-827d-13301b18425c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:21.989912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e008a886-2512-4ee6-827d-13301b18425c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:22.004403 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-e008a886-2512-4ee6-827d-13301b18425c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] HTTP exception thrown: Instance aa474266-38cf-40a3-a099-ca48ceba4b5e could not be found. Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e008a886-2512-4ee6-827d-13301b18425c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Request method failure captured: Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e HTTP/1.1 Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hXEF03edD8kE1p9C-lBzba2-TBT-P09IEXC-KaYssZmf3zDYGobJ1wkNRNL0yuEJszcMprmJm_M5Y2l7km8k6DP4a2ZaJ05IvUPJ_-eo39mYWvdzzpHU8Ht9JZ0_fcQ0rXdTRHQbHxlOe45cP_XKau8t68GHv5oVuAYJ7pDwCW2vWs Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 8e18d061762841dab3882493fbb4f835 Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8e18d061762841dab3882493fbb4f835"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e18d061762841dab3882493fbb4f835"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8e18d061762841dab3882493fbb4f835"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e18d061762841dab3882493fbb4f835"}]}] Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 8e18d061762841dab3882493fbb4f835 Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestNetworkAdvancedServerOps-2112986599-project Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 3f0cd417487147bc9bc925fa0ad1f7a1 Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2112986599-project Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance aa474266-38cf-40a3-a099-ca48ceba4b5e could not be found. Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'aa474266-38cf-40a3-a099-ca48ceba4b5e'} Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa474266-38cf-40a3-a099-ca48ceba4b5e could not be found. Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa474266-38cf-40a3-a099-ca48ceba4b5e could not be found. Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:52:22.006090 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:52:22.011443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:52:22.011443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:52:22.011443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:52:22.011443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:52:22.011443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:52:22.011443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:52:22.011443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa474266-38cf-40a3-a099-ca48ceba4b5e could not be found. Jul 28 04:52:22.011443 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:52:22.011443 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e008a886-2512-4ee6-827d-13301b18425c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Returning 404 to user: Instance aa474266-38cf-40a3-a099-ca48ceba4b5e could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:52:22.011443 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e008a886-2512-4ee6-827d-13301b18425c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e" status: 404 len: 111 microversion: 2.1 time: 0.032888 Jul 28 04:52:22.011443 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5049/7499] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:21 2022] GET /compute/v2.1/servers/aa474266-38cf-40a3-a099-ca48ceba4b5e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:52:25.393708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b0ceac08-473e-4376-b45f-2034564806b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '.version_select at 0x7ffa66e95280>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:25.418486 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b0ceac08-473e-4376-b45f-2034564806b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-184657985" status: 202 len: 0 microversion: 2.1 time: 0.028669 Jul 28 04:52:25.419676 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5050/7500] 10.222.0.48 () {58 vars in 1281 bytes} [Thu Jul 28 04:52:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-184657985 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:52:25.444133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e3bafde0-bca5-4476-92ca-54ca3e9c9039 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'create', calling method: .version_select at 0x7ffa6766b310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1207569895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwCPEBwekeDMcOBPYwkuJf2vJVndOpTd6QFMHfQFTvamae8ZVNPBj7UQl+0n0v25Liowz4xO+dlHtgczKtISAPnhswxVLSXyEE0ZGIqEkpHAWnhEiTj3lJfUu3FJr3QbA=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:52:25.463754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e3bafde0-bca5-4476-92ca-54ca3e9c9039 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for project 8e18d061762841dab3882493fbb4f835. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:52:25.469928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-e3bafde0-bca5-4476-92ca-54ca3e9c9039 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for user 3f0cd417487147bc9bc925fa0ad1f7a1 and project 8e18d061762841dab3882493fbb4f835. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:52:25.496447 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e3bafde0-bca5-4476-92ca-54ca3e9c9039 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056355 Jul 28 04:52:25.497130 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5051/7501] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:52:25 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:52:31.343815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-322410745", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "02b66236-8b92-4c85-b117-fae1122087dd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1207569895", "security_groups": [{"name": "tempest-secgroup-smoke-1600155341"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:52:31.462470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] validate_networks() for [('02b66236-8b92-4c85-b117-fae1122087dd', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:52:31.955117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:52:31.955808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:52:31.956300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:52:31.956717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:52:31.957156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:52:31.969335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:31.969935 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:31.971185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:31.971746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:32.002654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for project 8e18d061762841dab3882493fbb4f835. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:52:32.009143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for user 3f0cd417487147bc9bc925fa0ad1f7a1 and project 8e18d061762841dab3882493fbb4f835. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:52:32.026691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:52:32.029107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:52:32.085370 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bcc3418a-4a50-4a47-aef2-cd7876a7f8ce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.746711 Jul 28 04:52:32.092599 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5052/7502] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:52:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:52:32.098645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0c205676-7b79-4c94-8177-61a824e7046c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:32.099742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0c205676-7b79-4c94-8177-61a824e7046c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:32.162947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0c205676-7b79-4c94-8177-61a824e7046c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:32.171747 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0c205676-7b79-4c94-8177-61a824e7046c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1266 microversion: 2.1 time: 0.077753 Jul 28 04:52:32.172534 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5053/7503] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:32 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:52:33.194189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ebb562c6-64b0-41e9-8b97-f4287a72dc43 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:33.194941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ebb562c6-64b0-41e9-8b97-f4287a72dc43 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:33.210554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebb562c6-64b0-41e9-8b97-f4287a72dc43 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:33.211281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebb562c6-64b0-41e9-8b97-f4287a72dc43 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:33.212258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebb562c6-64b0-41e9-8b97-f4287a72dc43 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:33.213975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ebb562c6-64b0-41e9-8b97-f4287a72dc43 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:33.223019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:52:33.729525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ebb562c6-64b0-41e9-8b97-f4287a72dc43 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:33.738441 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ebb562c6-64b0-41e9-8b97-f4287a72dc43 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1326 microversion: 2.1 time: 0.548175 Jul 28 04:52:33.739503 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5054/7504] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:33 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1326 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:52:34.762110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7981769f-65e4-43e1-b1b1-8a72ab375652 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:34.763550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7981769f-65e4-43e1-b1b1-8a72ab375652 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:34.771013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7981769f-65e4-43e1-b1b1-8a72ab375652 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:34.771569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7981769f-65e4-43e1-b1b1-8a72ab375652 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:34.772825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7981769f-65e4-43e1-b1b1-8a72ab375652 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:34.773571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7981769f-65e4-43e1-b1b1-8a72ab375652 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:34.925736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7981769f-65e4-43e1-b1b1-8a72ab375652 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:34.940339 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7981769f-65e4-43e1-b1b1-8a72ab375652 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1392 microversion: 2.1 time: 0.182212 Jul 28 04:52:34.940940 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5055/7505] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:34 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:52:34.962276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-cf7119ee-f2ca-4a07-b1f7-da29129f9d75 req-289d32af-566a-454c-b7d2-00d78a1115af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea", "tag": "6760a9b7-63a9-4888-9085-573e54a966c4"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:52:34.973691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cf7119ee-f2ca-4a07-b1f7-da29129f9d75 req-289d32af-566a-454c-b7d2-00d78a1115af service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:34.974155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cf7119ee-f2ca-4a07-b1f7-da29129f9d75 req-289d32af-566a-454c-b7d2-00d78a1115af service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:34.988225 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-cf7119ee-f2ca-4a07-b1f7-da29129f9d75 req-289d32af-566a-454c-b7d2-00d78a1115af service nova] Creating event network-changed:6760a9b7-63a9-4888-9085-573e54a966c4 for instance 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea on n-h2-826756-3 Jul 28 04:52:34.993725 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-cf7119ee-f2ca-4a07-b1f7-da29129f9d75 req-289d32af-566a-454c-b7d2-00d78a1115af service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039090 Jul 28 04:52:34.994720 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5056/7506] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:52:35.967168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cbefb1f6-51c0-45ef-bfa0-180557e5a916 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:35.967903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cbefb1f6-51c0-45ef-bfa0-180557e5a916 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:35.976714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbefb1f6-51c0-45ef-bfa0-180557e5a916 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:35.977188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbefb1f6-51c0-45ef-bfa0-180557e5a916 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:35.978003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbefb1f6-51c0-45ef-bfa0-180557e5a916 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:35.978462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbefb1f6-51c0-45ef-bfa0-180557e5a916 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:36.139293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cbefb1f6-51c0-45ef-bfa0-180557e5a916 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:36.147830 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cbefb1f6-51c0-45ef-bfa0-180557e5a916 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1392 microversion: 2.1 time: 0.185202 Jul 28 04:52:36.148483 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5057/7507] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:35 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:52:37.172836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b2b578b-d400-4610-8212-4ea7d7fca930 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:37.173878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5b2b578b-d400-4610-8212-4ea7d7fca930 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:37.187165 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b2b578b-d400-4610-8212-4ea7d7fca930 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:37.187942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b2b578b-d400-4610-8212-4ea7d7fca930 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:37.189975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b2b578b-d400-4610-8212-4ea7d7fca930 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:37.190724 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b2b578b-d400-4610-8212-4ea7d7fca930 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:37.356105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5b2b578b-d400-4610-8212-4ea7d7fca930 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:37.368045 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5b2b578b-d400-4610-8212-4ea7d7fca930 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1392 microversion: 2.1 time: 0.201896 Jul 28 04:52:37.368654 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5058/7508] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:37 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:52:38.390409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-11f5154e-4be2-4c0b-b270-01e7d2e07d86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:38.391107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-11f5154e-4be2-4c0b-b270-01e7d2e07d86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:38.400004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11f5154e-4be2-4c0b-b270-01e7d2e07d86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:38.400509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11f5154e-4be2-4c0b-b270-01e7d2e07d86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:38.401316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11f5154e-4be2-4c0b-b270-01e7d2e07d86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:38.401778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-11f5154e-4be2-4c0b-b270-01e7d2e07d86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:38.561057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-11f5154e-4be2-4c0b-b270-01e7d2e07d86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:38.576027 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-11f5154e-4be2-4c0b-b270-01e7d2e07d86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1392 microversion: 2.1 time: 0.189954 Jul 28 04:52:38.577021 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5059/7509] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:38 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1392 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:52:39.606631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-28a90b11-f33e-480b-aa1e-772a8232433e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:39.608183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-28a90b11-f33e-480b-aa1e-772a8232433e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:39.619531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28a90b11-f33e-480b-aa1e-772a8232433e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:39.619531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28a90b11-f33e-480b-aa1e-772a8232433e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:39.620339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28a90b11-f33e-480b-aa1e-772a8232433e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:39.620856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28a90b11-f33e-480b-aa1e-772a8232433e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:39.757790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-28a90b11-f33e-480b-aa1e-772a8232433e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:39.765467 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-28a90b11-f33e-480b-aa1e-772a8232433e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1392 microversion: 2.1 time: 0.168669 Jul 28 04:52:39.766281 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5060/7510] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:39 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:52:39.786777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-ded9064e-5f09-4b08-8465-4dfa2c25d524 req-bff47722-e340-4ce1-ac77-e782ba47186e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea", "name": "network-vif-plugged", "status": "completed", "tag": "6760a9b7-63a9-4888-9085-573e54a966c4"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:52:39.798517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ded9064e-5f09-4b08-8465-4dfa2c25d524 req-bff47722-e340-4ce1-ac77-e782ba47186e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:39.798974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ded9064e-5f09-4b08-8465-4dfa2c25d524 req-bff47722-e340-4ce1-ac77-e782ba47186e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:39.813829 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-ded9064e-5f09-4b08-8465-4dfa2c25d524 req-bff47722-e340-4ce1-ac77-e782ba47186e service nova] Creating event network-vif-plugged:6760a9b7-63a9-4888-9085-573e54a966c4 for instance 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea on n-h2-826756-3 Jul 28 04:52:39.819016 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-ded9064e-5f09-4b08-8465-4dfa2c25d524 req-bff47722-e340-4ce1-ac77-e782ba47186e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038759 Jul 28 04:52:39.820460 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5061/7511] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:52:40.793968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fcb325b6-0b6b-4415-9099-4ce01ad1cbc3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:40.794666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fcb325b6-0b6b-4415-9099-4ce01ad1cbc3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:40.802569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcb325b6-0b6b-4415-9099-4ce01ad1cbc3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:40.803021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcb325b6-0b6b-4415-9099-4ce01ad1cbc3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:40.803824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcb325b6-0b6b-4415-9099-4ce01ad1cbc3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:40.804258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fcb325b6-0b6b-4415-9099-4ce01ad1cbc3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:40.952798 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fcb325b6-0b6b-4415-9099-4ce01ad1cbc3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:40.962177 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fcb325b6-0b6b-4415-9099-4ce01ad1cbc3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1392 microversion: 2.1 time: 0.172648 Jul 28 04:52:40.962769 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5062/7512] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:40 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:52:41.984028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e02d8ccb-731d-48d8-b9bd-e742ca4782aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:41.984746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e02d8ccb-731d-48d8-b9bd-e742ca4782aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:41.988634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:52:41.992620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e02d8ccb-731d-48d8-b9bd-e742ca4782aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:41.993084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e02d8ccb-731d-48d8-b9bd-e742ca4782aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:41.993943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e02d8ccb-731d-48d8-b9bd-e742ca4782aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:41.994388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e02d8ccb-731d-48d8-b9bd-e742ca4782aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:42.134248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e02d8ccb-731d-48d8-b9bd-e742ca4782aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:42.142191 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e02d8ccb-731d-48d8-b9bd-e742ca4782aa tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1564 microversion: 2.1 time: 0.162304 Jul 28 04:52:42.142760 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5063/7513] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:41 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:52:42.246360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ab441f1c-e233-4546-966d-a1bd32ae43c8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:42.246880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ab441f1c-e233-4546-966d-a1bd32ae43c8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:42.248783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:52:42.254777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab441f1c-e233-4546-966d-a1bd32ae43c8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:42.255234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab441f1c-e233-4546-966d-a1bd32ae43c8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:42.256014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab441f1c-e233-4546-966d-a1bd32ae43c8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:42.256542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab441f1c-e233-4546-966d-a1bd32ae43c8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:42.388878 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ab441f1c-e233-4546-966d-a1bd32ae43c8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:42.397198 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ab441f1c-e233-4546-966d-a1bd32ae43c8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1564 microversion: 2.1 time: 0.154980 Jul 28 04:52:42.397783 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5064/7514] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:42 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:52:44.033964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2696117b-77ce-47da-b4c7-cf32f1e8a660 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:52:44.034598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2696117b-77ce-47da-b4c7-cf32f1e8a660 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:52:44.037364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:52:44.043754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2696117b-77ce-47da-b4c7-cf32f1e8a660 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:44.044249 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2696117b-77ce-47da-b4c7-cf32f1e8a660 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:44.045080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2696117b-77ce-47da-b4c7-cf32f1e8a660 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:44.045705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2696117b-77ce-47da-b4c7-cf32f1e8a660 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:44.185972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2696117b-77ce-47da-b4c7-cf32f1e8a660 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:52:44.193955 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2696117b-77ce-47da-b4c7-cf32f1e8a660 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1564 microversion: 2.1 time: 0.164090 Jul 28 04:52:44.194539 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5065/7515] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:52:44 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:52:44.199149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-40b9a996-3d43-44ba-b7cc-9ace23360762 req-4ce79301-c395-43b9-96e5-f8d95a7c4ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea", "tag": "6760a9b7-63a9-4888-9085-573e54a966c4"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:52:44.214490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-40b9a996-3d43-44ba-b7cc-9ace23360762 req-4ce79301-c395-43b9-96e5-f8d95a7c4ada service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:52:44.215035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-40b9a996-3d43-44ba-b7cc-9ace23360762 req-4ce79301-c395-43b9-96e5-f8d95a7c4ada service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:52:44.228091 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-40b9a996-3d43-44ba-b7cc-9ace23360762 req-4ce79301-c395-43b9-96e5-f8d95a7c4ada service nova] Creating event network-changed:6760a9b7-63a9-4888-9085-573e54a966c4 for instance 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea on n-h2-826756-3 Jul 28 04:52:44.233664 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-40b9a996-3d43-44ba-b7cc-9ace23360762 req-4ce79301-c395-43b9-96e5-f8d95a7c4ada service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037926 Jul 28 04:52:44.234896 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5066/7516] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:53:07.465518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:53:07.466187 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=64 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:53:07.470986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f95afe4b-8e75-49bf-b86a-c020d3f9596f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:53:07.474045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f95afe4b-8e75-49bf-b86a-c020d3f9596f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:53:07.481825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f95afe4b-8e75-49bf-b86a-c020d3f9596f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:07.482296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f95afe4b-8e75-49bf-b86a-c020d3f9596f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:07.483092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f95afe4b-8e75-49bf-b86a-c020d3f9596f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:07.483542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f95afe4b-8e75-49bf-b86a-c020d3f9596f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:07.548232 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f95afe4b-8e75-49bf-b86a-c020d3f9596f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea/action" status: 200 len: 24553 microversion: 2.1 time: 0.084734 Jul 28 04:53:07.549187 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5067/7517] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:53:07 2022] POST /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea/action => generated 24553 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:53:18.475823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d1b1f6ed-4197-4c7e-b425-02410d81dda4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:53:18.478449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d1b1f6ed-4197-4c7e-b425-02410d81dda4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:53:18.481973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:53:18.482836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:53:18.491626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1b1f6ed-4197-4c7e-b425-02410d81dda4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:18.492026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1b1f6ed-4197-4c7e-b425-02410d81dda4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:18.492986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1b1f6ed-4197-4c7e-b425-02410d81dda4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:18.493463 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d1b1f6ed-4197-4c7e-b425-02410d81dda4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:18.576323 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d1b1f6ed-4197-4c7e-b425-02410d81dda4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea/action" status: 202 len: 0 microversion: 2.1 time: 0.105196 Jul 28 04:53:18.577061 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5068/7518] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:53:18 2022] POST /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:53:18.585811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d505d698-bf74-4350-a246-96de40ee8c9a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:53:18.586635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d505d698-bf74-4350-a246-96de40ee8c9a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:53:18.593349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d505d698-bf74-4350-a246-96de40ee8c9a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:18.593817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d505d698-bf74-4350-a246-96de40ee8c9a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:18.595703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d505d698-bf74-4350-a246-96de40ee8c9a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:18.595703 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d505d698-bf74-4350-a246-96de40ee8c9a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:18.759548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d505d698-bf74-4350-a246-96de40ee8c9a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:53:18.768132 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d505d698-bf74-4350-a246-96de40ee8c9a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1675 microversion: 2.1 time: 0.186489 Jul 28 04:53:18.768873 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5069/7519] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:53:18 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1675 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:53:19.795401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f6c7b181-9f19-4957-9ce0-3a5d5d5f5a29 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:53:19.796126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f6c7b181-9f19-4957-9ce0-3a5d5d5f5a29 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:53:19.804730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6c7b181-9f19-4957-9ce0-3a5d5d5f5a29 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:19.805200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6c7b181-9f19-4957-9ce0-3a5d5d5f5a29 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:19.805953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6c7b181-9f19-4957-9ce0-3a5d5d5f5a29 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:19.806412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f6c7b181-9f19-4957-9ce0-3a5d5d5f5a29 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:19.962596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f6c7b181-9f19-4957-9ce0-3a5d5d5f5a29 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:53:19.970999 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f6c7b181-9f19-4957-9ce0-3a5d5d5f5a29 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1680 microversion: 2.1 time: 0.182323 Jul 28 04:53:19.971563 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5070/7520] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:53:19 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:53:20.995288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e6cce7bc-9e7b-4d3c-a51b-6abe3a3cbb0c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:53:20.996503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e6cce7bc-9e7b-4d3c-a51b-6abe3a3cbb0c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:53:21.005882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6cce7bc-9e7b-4d3c-a51b-6abe3a3cbb0c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:21.006348 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6cce7bc-9e7b-4d3c-a51b-6abe3a3cbb0c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:21.007143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6cce7bc-9e7b-4d3c-a51b-6abe3a3cbb0c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:21.007596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6cce7bc-9e7b-4d3c-a51b-6abe3a3cbb0c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:21.155403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e6cce7bc-9e7b-4d3c-a51b-6abe3a3cbb0c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:53:21.164326 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e6cce7bc-9e7b-4d3c-a51b-6abe3a3cbb0c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1680 microversion: 2.1 time: 0.174178 Jul 28 04:53:21.164963 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5071/7521] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:53:20 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:53:22.187545 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b7380fa-1f1e-45bc-aa6c-96aadd19e2fc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:53:22.188256 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b7380fa-1f1e-45bc-aa6c-96aadd19e2fc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:53:22.196521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b7380fa-1f1e-45bc-aa6c-96aadd19e2fc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:22.197039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b7380fa-1f1e-45bc-aa6c-96aadd19e2fc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:22.197938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b7380fa-1f1e-45bc-aa6c-96aadd19e2fc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:22.198480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b7380fa-1f1e-45bc-aa6c-96aadd19e2fc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:22.336079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7b7380fa-1f1e-45bc-aa6c-96aadd19e2fc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:53:22.349793 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b7380fa-1f1e-45bc-aa6c-96aadd19e2fc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1680 microversion: 2.1 time: 0.167018 Jul 28 04:53:22.350546 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5072/7522] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:53:22 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:53:23.376210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-91d6cb30-2f55-43db-b0f5-e43d523c62b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:53:23.377000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-91d6cb30-2f55-43db-b0f5-e43d523c62b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:53:23.384292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91d6cb30-2f55-43db-b0f5-e43d523c62b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:23.384799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91d6cb30-2f55-43db-b0f5-e43d523c62b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:23.385581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91d6cb30-2f55-43db-b0f5-e43d523c62b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:23.386035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91d6cb30-2f55-43db-b0f5-e43d523c62b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:23.530855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-91d6cb30-2f55-43db-b0f5-e43d523c62b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:53:23.540594 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-91d6cb30-2f55-43db-b0f5-e43d523c62b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1680 microversion: 2.1 time: 0.168168 Jul 28 04:53:23.541190 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5073/7523] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:53:23 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:53:24.567765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-adbf9338-1aeb-40bc-87ea-954ee696953a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:53:24.568822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-adbf9338-1aeb-40bc-87ea-954ee696953a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:53:24.580281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-adbf9338-1aeb-40bc-87ea-954ee696953a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:24.580756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-adbf9338-1aeb-40bc-87ea-954ee696953a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:24.581543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-adbf9338-1aeb-40bc-87ea-954ee696953a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:24.581996 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-adbf9338-1aeb-40bc-87ea-954ee696953a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:24.738059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-adbf9338-1aeb-40bc-87ea-954ee696953a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:53:24.746457 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-adbf9338-1aeb-40bc-87ea-954ee696953a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1680 microversion: 2.1 time: 0.185440 Jul 28 04:53:24.747063 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5074/7524] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:53:24 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1680 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:53:25.769216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c5bc3889-b1d2-4eaa-a31b-9a834993e6b8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:53:25.769910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c5bc3889-b1d2-4eaa-a31b-9a834993e6b8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:53:25.777427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5bc3889-b1d2-4eaa-a31b-9a834993e6b8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:25.777944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5bc3889-b1d2-4eaa-a31b-9a834993e6b8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:25.778771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5bc3889-b1d2-4eaa-a31b-9a834993e6b8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:25.779232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5bc3889-b1d2-4eaa-a31b-9a834993e6b8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:25.924373 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c5bc3889-b1d2-4eaa-a31b-9a834993e6b8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:53:25.932568 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c5bc3889-b1d2-4eaa-a31b-9a834993e6b8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1680 microversion: 2.1 time: 0.167437 Jul 28 04:53:25.933157 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5075/7525] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:53:25 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:53:26.955082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0af1a683-849e-4711-9f7a-6922fbd93718 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:53:26.955944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0af1a683-849e-4711-9f7a-6922fbd93718 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:53:26.964683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0af1a683-849e-4711-9f7a-6922fbd93718 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:26.965223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0af1a683-849e-4711-9f7a-6922fbd93718 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:26.966156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0af1a683-849e-4711-9f7a-6922fbd93718 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:26.966748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0af1a683-849e-4711-9f7a-6922fbd93718 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:27.133686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0af1a683-849e-4711-9f7a-6922fbd93718 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:53:27.144265 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0af1a683-849e-4711-9f7a-6922fbd93718 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1680 microversion: 2.1 time: 0.193468 Jul 28 04:53:27.144940 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5076/7526] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:53:26 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:53:28.173754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-64df1b65-175c-4386-a8af-83751309104f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:53:28.174403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-64df1b65-175c-4386-a8af-83751309104f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:53:28.181828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64df1b65-175c-4386-a8af-83751309104f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:28.182304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64df1b65-175c-4386-a8af-83751309104f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:28.183101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64df1b65-175c-4386-a8af-83751309104f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:28.183559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-64df1b65-175c-4386-a8af-83751309104f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:28.330941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-64df1b65-175c-4386-a8af-83751309104f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:53:28.340266 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-64df1b65-175c-4386-a8af-83751309104f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1680 microversion: 2.1 time: 0.173490 Jul 28 04:53:28.340901 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5077/7527] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:53:28 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:53:29.366997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f06a6a42-cc0c-4369-9e0e-32bca1f37f02 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:53:29.368052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f06a6a42-cc0c-4369-9e0e-32bca1f37f02 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:53:29.378973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f06a6a42-cc0c-4369-9e0e-32bca1f37f02 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:29.379447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f06a6a42-cc0c-4369-9e0e-32bca1f37f02 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:29.380230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f06a6a42-cc0c-4369-9e0e-32bca1f37f02 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:29.380725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f06a6a42-cc0c-4369-9e0e-32bca1f37f02 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:29.529335 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f06a6a42-cc0c-4369-9e0e-32bca1f37f02 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:53:29.537871 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f06a6a42-cc0c-4369-9e0e-32bca1f37f02 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1680 microversion: 2.1 time: 0.177361 Jul 28 04:53:29.538478 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5078/7528] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:53:29 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:53:30.559817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9d47c124-d8d5-49f6-aec6-4ffb6a661414 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:53:30.560579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9d47c124-d8d5-49f6-aec6-4ffb6a661414 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:53:30.568062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d47c124-d8d5-49f6-aec6-4ffb6a661414 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:30.568569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d47c124-d8d5-49f6-aec6-4ffb6a661414 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:30.569378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d47c124-d8d5-49f6-aec6-4ffb6a661414 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:30.569836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9d47c124-d8d5-49f6-aec6-4ffb6a661414 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:30.706355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9d47c124-d8d5-49f6-aec6-4ffb6a661414 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:53:30.714712 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9d47c124-d8d5-49f6-aec6-4ffb6a661414 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1683 microversion: 2.1 time: 0.158966 Jul 28 04:53:30.715303 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5079/7529] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:53:30 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:53:37.433530 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:53:37.434094 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:53:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:53:56.941497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d313e5f-5962-40f1-b751-97529feb5454 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:53:56.943902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6d313e5f-5962-40f1-b751-97529feb5454 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:53:56.946542 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=24 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:53:56.947221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:53:56.954167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d313e5f-5962-40f1-b751-97529feb5454 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:56.954635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d313e5f-5962-40f1-b751-97529feb5454 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:56.955451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d313e5f-5962-40f1-b751-97529feb5454 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:53:56.956076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d313e5f-5962-40f1-b751-97529feb5454 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:53:57.036593 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d313e5f-5962-40f1-b751-97529feb5454 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea/action" status: 200 len: 69058 microversion: 2.1 time: 0.100380 Jul 28 04:53:57.037420 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5080/7530] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:53:56 2022] POST /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea/action => generated 69058 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:54:04.147874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8f76eef4-e8ff-4adb-b131-b300df1a2ba1 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:04.148569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8f76eef4-e8ff-4adb-b131-b300df1a2ba1 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:04.156658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f76eef4-e8ff-4adb-b131-b300df1a2ba1 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:04.157139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f76eef4-e8ff-4adb-b131-b300df1a2ba1 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:04.157918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f76eef4-e8ff-4adb-b131-b300df1a2ba1 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:04.158367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8f76eef4-e8ff-4adb-b131-b300df1a2ba1 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:04.185034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8f76eef4-e8ff-4adb-b131-b300df1a2ba1 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:54:04.266268 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8f76eef4-e8ff-4adb-b131-b300df1a2ba1 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 204 len: 0 microversion: 2.1 time: 0.122605 Jul 28 04:54:04.267087 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5081/7531] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:54:04 2022] DELETE /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:54:04.275760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-cf8437fd-120f-4127-8b77-98224ce09a36 req-cf19bda7-0ffe-44b7-a54a-99ec6879fb3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea", "tag": "6760a9b7-63a9-4888-9085-573e54a966c4"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:54:04.286130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cf8437fd-120f-4127-8b77-98224ce09a36 req-cf19bda7-0ffe-44b7-a54a-99ec6879fb3d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:04.286616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cf8437fd-120f-4127-8b77-98224ce09a36 req-cf19bda7-0ffe-44b7-a54a-99ec6879fb3d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:04.299891 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-cf8437fd-120f-4127-8b77-98224ce09a36 req-cf19bda7-0ffe-44b7-a54a-99ec6879fb3d service nova] Creating event network-changed:6760a9b7-63a9-4888-9085-573e54a966c4 for instance 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea on n-h2-826756-3 Jul 28 04:54:04.305868 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-cf8437fd-120f-4127-8b77-98224ce09a36 req-cf19bda7-0ffe-44b7-a54a-99ec6879fb3d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034255 Jul 28 04:54:04.306542 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5082/7532] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:54:04.311930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf8a7f14-2d55-48a9-8f13-ee9709208a39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:04.312690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cf8a7f14-2d55-48a9-8f13-ee9709208a39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:04.319811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf8a7f14-2d55-48a9-8f13-ee9709208a39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:04.320275 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf8a7f14-2d55-48a9-8f13-ee9709208a39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:04.321095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf8a7f14-2d55-48a9-8f13-ee9709208a39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:04.321952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf8a7f14-2d55-48a9-8f13-ee9709208a39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:04.542225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf8a7f14-2d55-48a9-8f13-ee9709208a39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:04.551248 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf8a7f14-2d55-48a9-8f13-ee9709208a39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1689 microversion: 2.1 time: 0.243468 Jul 28 04:54:04.551852 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5083/7533] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:04 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1689 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:54:05.574444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-15527f62-f4ac-4e89-ac23-f21dba6b41f7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:05.575150 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-15527f62-f4ac-4e89-ac23-f21dba6b41f7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:05.582777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15527f62-f4ac-4e89-ac23-f21dba6b41f7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:05.583246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15527f62-f4ac-4e89-ac23-f21dba6b41f7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:05.584193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15527f62-f4ac-4e89-ac23-f21dba6b41f7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:05.584675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-15527f62-f4ac-4e89-ac23-f21dba6b41f7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:05.741060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-15527f62-f4ac-4e89-ac23-f21dba6b41f7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:05.751194 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-15527f62-f4ac-4e89-ac23-f21dba6b41f7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1689 microversion: 2.1 time: 0.180730 Jul 28 04:54:05.751994 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5084/7534] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:05 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:54:06.779636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b452d45f-7a7f-42bd-bd4d-9dfa9beb7b1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:06.780419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b452d45f-7a7f-42bd-bd4d-9dfa9beb7b1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:06.789198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b452d45f-7a7f-42bd-bd4d-9dfa9beb7b1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:06.789709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b452d45f-7a7f-42bd-bd4d-9dfa9beb7b1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:06.790573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b452d45f-7a7f-42bd-bd4d-9dfa9beb7b1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:06.791034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b452d45f-7a7f-42bd-bd4d-9dfa9beb7b1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:06.934036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b452d45f-7a7f-42bd-bd4d-9dfa9beb7b1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:06.942614 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b452d45f-7a7f-42bd-bd4d-9dfa9beb7b1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 200 len: 1689 microversion: 2.1 time: 0.167067 Jul 28 04:54:06.943202 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5085/7535] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:06 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:54:07.167646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-accdbfbc-6802-4fc2-b3e2-7a97e2e924e4 req-d53f06c8-e598-4f2d-9ec6-a6e057d5ee30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea", "name": "network-vif-deleted", "tag": "6760a9b7-63a9-4888-9085-573e54a966c4"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:54:07.179163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-accdbfbc-6802-4fc2-b3e2-7a97e2e924e4 req-d53f06c8-e598-4f2d-9ec6-a6e057d5ee30 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:07.179702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-accdbfbc-6802-4fc2-b3e2-7a97e2e924e4 req-d53f06c8-e598-4f2d-9ec6-a6e057d5ee30 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:07.192696 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-accdbfbc-6802-4fc2-b3e2-7a97e2e924e4 req-d53f06c8-e598-4f2d-9ec6-a6e057d5ee30 service nova] Creating event network-vif-deleted:6760a9b7-63a9-4888-9085-573e54a966c4 for instance 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea on n-h2-826756-3 Jul 28 04:54:07.197810 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-accdbfbc-6802-4fc2-b3e2-7a97e2e924e4 req-d53f06c8-e598-4f2d-9ec6-a6e057d5ee30 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034106 Jul 28 04:54:07.198720 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5086/7536] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:54:07.966198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-50402175-c887-4527-ad53-e965394faf94 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:07.966879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-50402175-c887-4527-ad53-e965394faf94 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:07.974735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50402175-c887-4527-ad53-e965394faf94 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:07.975203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50402175-c887-4527-ad53-e965394faf94 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:07.975987 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50402175-c887-4527-ad53-e965394faf94 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:07.976478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50402175-c887-4527-ad53-e965394faf94 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:07.996071 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-50402175-c887-4527-ad53-e965394faf94 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] HTTP exception thrown: Instance 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea could not be found. Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-50402175-c887-4527-ad53-e965394faf94 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Request method failure captured: Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea HTTP/1.1 Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hXEF03edD8kE1p9C-lBzba2-TBT-P09IEXC-KaYssZmf3zDYGobJ1wkNRNL0yuEJszcMprmJm_M5Y2l7km8k6DP4a2ZaJ05IvUPJ_-eo39mYWvdzzpHU8Ht9JZ0_fcQ0rXdTRHQbHxlOe45cP_XKau8t68GHv5oVuAYJ7pDwCW2vWs Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 8e18d061762841dab3882493fbb4f835 Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8e18d061762841dab3882493fbb4f835"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e18d061762841dab3882493fbb4f835"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8e18d061762841dab3882493fbb4f835"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e18d061762841dab3882493fbb4f835"}]}] Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 8e18d061762841dab3882493fbb4f835 Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestNetworkAdvancedServerOps-2112986599-project Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 3f0cd417487147bc9bc925fa0ad1f7a1 Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2112986599-project Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea could not be found. Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea'} Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea could not be found. Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea could not be found. Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:54:07.997825 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:54:08.004958 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:54:08.004958 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:54:08.004958 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:54:08.004958 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:54:08.004958 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:54:08.004958 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:54:08.004958 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea could not be found. Jul 28 04:54:08.004958 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:54:08.004958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-50402175-c887-4527-ad53-e965394faf94 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Returning 404 to user: Instance 8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:54:08.004958 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-50402175-c887-4527-ad53-e965394faf94 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea" status: 404 len: 111 microversion: 2.1 time: 0.037934 Jul 28 04:54:08.004958 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5087/7537] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:07 2022] GET /compute/v2.1/servers/8b96f0f4-4bba-47a1-88b7-e4dcb97dfeea => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:54:11.426094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-40ce7c6f-b1cf-4ce5-8b41-18fad9f6de72 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '.version_select at 0x7ffa66e50790>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:11.449178 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-40ce7c6f-b1cf-4ce5-8b41-18fad9f6de72 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1207569895" status: 202 len: 0 microversion: 2.1 time: 0.027020 Jul 28 04:54:11.450159 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5088/7538] 10.222.0.48 () {58 vars in 1284 bytes} [Thu Jul 28 04:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1207569895 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:54:11.477338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2598c9fc-0916-4da4-bc09-99966e44e173 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'create', calling method: .version_select at 0x7ffa67761940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-51524748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhZY5P/5u+ZlIJaoiRNsvHDKNPa2wtBre+1kxIlqKf5FC04/wVixndxlpCZIQ/BhhqhsKZiuHItgs9eOPGkgrIH5NqfoWcoy3ZH5ZCnLq+3sWX6b2uxRdx58ydFY7C35g=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:54:11.494608 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2598c9fc-0916-4da4-bc09-99966e44e173 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for project 8e18d061762841dab3882493fbb4f835. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:54:11.500224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2598c9fc-0916-4da4-bc09-99966e44e173 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for user 3f0cd417487147bc9bc925fa0ad1f7a1 and project 8e18d061762841dab3882493fbb4f835. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:54:11.536544 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2598c9fc-0916-4da4-bc09-99966e44e173 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.063678 Jul 28 04:54:11.537558 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5089/7539] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:54:11 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:54:17.221972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2110946506", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "7e2b7e8e-0e9c-4297-a395-f10f05e03d87"}], "key_name": "tempest-TestNetworkAdvancedServerOps-51524748", "security_groups": [{"name": "tempest-secgroup-smoke-1231608334"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:54:17.342956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] validate_networks() for [('7e2b7e8e-0e9c-4297-a395-f10f05e03d87', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:54:17.840242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:54:17.840688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:54:17.841346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:54:17.842317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:54:17.843392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:54:17.854687 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:17.855163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:17.855978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:17.856431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:17.875802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for project 8e18d061762841dab3882493fbb4f835. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:54:17.885590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for user 3f0cd417487147bc9bc925fa0ad1f7a1 and project 8e18d061762841dab3882493fbb4f835. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:54:17.901503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:54:17.903879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:54:17.953808 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74c02c7e-f758-4f17-9da0-474d077b943e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.736092 Jul 28 04:54:17.957126 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5090/7540] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:54:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:54:17.967343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2425978-4097-4732-a564-8f43a020d578 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:17.967984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2425978-4097-4732-a564-8f43a020d578 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:18.029168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b2425978-4097-4732-a564-8f43a020d578 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:18.036605 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b2425978-4097-4732-a564-8f43a020d578 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1265 microversion: 2.1 time: 0.073359 Jul 28 04:54:18.037459 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5091/7541] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:17 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1265 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:54:19.058554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3c10c57d-9030-40ff-9580-b2d327c32a7b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:19.060291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3c10c57d-9030-40ff-9580-b2d327c32a7b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:19.069168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c10c57d-9030-40ff-9580-b2d327c32a7b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:19.070379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c10c57d-9030-40ff-9580-b2d327c32a7b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:19.071483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c10c57d-9030-40ff-9580-b2d327c32a7b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:19.072046 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c10c57d-9030-40ff-9580-b2d327c32a7b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:19.147314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3c10c57d-9030-40ff-9580-b2d327c32a7b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:19.172273 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3c10c57d-9030-40ff-9580-b2d327c32a7b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1325 microversion: 2.1 time: 0.117335 Jul 28 04:54:19.173776 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5092/7542] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:19 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1325 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:54:20.194482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d6adb33e-5a0c-41f7-8edb-c93f0bc0aa18 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:20.195207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d6adb33e-5a0c-41f7-8edb-c93f0bc0aa18 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:20.213757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6adb33e-5a0c-41f7-8edb-c93f0bc0aa18 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:20.214307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6adb33e-5a0c-41f7-8edb-c93f0bc0aa18 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:20.215181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6adb33e-5a0c-41f7-8edb-c93f0bc0aa18 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:20.215844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d6adb33e-5a0c-41f7-8edb-c93f0bc0aa18 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:20.382616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d6adb33e-5a0c-41f7-8edb-c93f0bc0aa18 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:20.394293 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d6adb33e-5a0c-41f7-8edb-c93f0bc0aa18 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1391 microversion: 2.1 time: 0.202496 Jul 28 04:54:20.395438 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5093/7543] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:20 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1391 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:54:20.859457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-dbab30df-5b32-43ce-833b-420034df3b90 req-ebc0d8e4-fabc-407d-8749-f1fad0dbfa15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807fb5a1-f08f-44e3-b602-0b54167cd91a", "tag": "190a9a30-8e03-4a32-a36c-6a97e94cb798"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:54:20.871492 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-dbab30df-5b32-43ce-833b-420034df3b90 req-ebc0d8e4-fabc-407d-8749-f1fad0dbfa15 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:20.872117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-dbab30df-5b32-43ce-833b-420034df3b90 req-ebc0d8e4-fabc-407d-8749-f1fad0dbfa15 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:20.898625 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-dbab30df-5b32-43ce-833b-420034df3b90 req-ebc0d8e4-fabc-407d-8749-f1fad0dbfa15 service nova] Creating event network-changed:190a9a30-8e03-4a32-a36c-6a97e94cb798 for instance 807fb5a1-f08f-44e3-b602-0b54167cd91a on n-h2-826756-3 Jul 28 04:54:20.903945 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-dbab30df-5b32-43ce-833b-420034df3b90 req-ebc0d8e4-fabc-407d-8749-f1fad0dbfa15 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056169 Jul 28 04:54:20.904688 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5094/7544] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:54:21.416937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4d7847e4-1cd4-4b64-a7a3-d2e6444380af tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:21.417651 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4d7847e4-1cd4-4b64-a7a3-d2e6444380af tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:21.424334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d7847e4-1cd4-4b64-a7a3-d2e6444380af tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:21.424837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d7847e4-1cd4-4b64-a7a3-d2e6444380af tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:21.425607 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d7847e4-1cd4-4b64-a7a3-d2e6444380af tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:21.426051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4d7847e4-1cd4-4b64-a7a3-d2e6444380af tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:21.567681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4d7847e4-1cd4-4b64-a7a3-d2e6444380af tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:21.576733 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4d7847e4-1cd4-4b64-a7a3-d2e6444380af tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1391 microversion: 2.1 time: 0.165007 Jul 28 04:54:21.577382 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5095/7545] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:21 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:54:22.601969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b24d12e7-66fa-43af-8c38-4008df456f56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:22.602691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b24d12e7-66fa-43af-8c38-4008df456f56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:22.610125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b24d12e7-66fa-43af-8c38-4008df456f56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:22.610602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b24d12e7-66fa-43af-8c38-4008df456f56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:22.611433 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b24d12e7-66fa-43af-8c38-4008df456f56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:22.611893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b24d12e7-66fa-43af-8c38-4008df456f56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:22.748097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b24d12e7-66fa-43af-8c38-4008df456f56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:22.756686 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b24d12e7-66fa-43af-8c38-4008df456f56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1391 microversion: 2.1 time: 0.159240 Jul 28 04:54:22.757253 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5096/7546] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:22 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:54:23.782614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-39528146-a134-42cc-94dc-4ef6c917b97d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:23.784835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-39528146-a134-42cc-94dc-4ef6c917b97d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:23.793389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39528146-a134-42cc-94dc-4ef6c917b97d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:23.793863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39528146-a134-42cc-94dc-4ef6c917b97d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:23.794650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39528146-a134-42cc-94dc-4ef6c917b97d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:23.795105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39528146-a134-42cc-94dc-4ef6c917b97d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:23.943334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-39528146-a134-42cc-94dc-4ef6c917b97d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:23.951778 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-39528146-a134-42cc-94dc-4ef6c917b97d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1391 microversion: 2.1 time: 0.175891 Jul 28 04:54:23.952385 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5097/7547] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:23 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:54:24.973362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0da8d1c6-243d-4a8a-bf03-dfdeb01dff57 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:24.974465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0da8d1c6-243d-4a8a-bf03-dfdeb01dff57 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:24.982547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0da8d1c6-243d-4a8a-bf03-dfdeb01dff57 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:24.983027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0da8d1c6-243d-4a8a-bf03-dfdeb01dff57 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:24.983809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0da8d1c6-243d-4a8a-bf03-dfdeb01dff57 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:24.984280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0da8d1c6-243d-4a8a-bf03-dfdeb01dff57 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:25.135969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0da8d1c6-243d-4a8a-bf03-dfdeb01dff57 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:25.152605 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0da8d1c6-243d-4a8a-bf03-dfdeb01dff57 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1391 microversion: 2.1 time: 0.175184 Jul 28 04:54:25.152605 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5098/7548] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:24 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:54:26.166890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-950e622b-04cd-4bd2-81f7-ae14e28beb9f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:26.167945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-950e622b-04cd-4bd2-81f7-ae14e28beb9f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:26.175073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-950e622b-04cd-4bd2-81f7-ae14e28beb9f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:26.175546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-950e622b-04cd-4bd2-81f7-ae14e28beb9f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:26.176460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-950e622b-04cd-4bd2-81f7-ae14e28beb9f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:26.176793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-950e622b-04cd-4bd2-81f7-ae14e28beb9f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:26.312118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-950e622b-04cd-4bd2-81f7-ae14e28beb9f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:26.320503 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-950e622b-04cd-4bd2-81f7-ae14e28beb9f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1391 microversion: 2.1 time: 0.157800 Jul 28 04:54:26.321088 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5099/7549] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:26 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:54:26.325680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0cddde19-0805-47f9-9719-558be534d3a0 req-068d8e73-3787-456e-bd52-a931e1a5f65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807fb5a1-f08f-44e3-b602-0b54167cd91a", "name": "network-vif-plugged", "status": "completed", "tag": "190a9a30-8e03-4a32-a36c-6a97e94cb798"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:54:26.335297 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0cddde19-0805-47f9-9719-558be534d3a0 req-068d8e73-3787-456e-bd52-a931e1a5f65b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:26.335739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0cddde19-0805-47f9-9719-558be534d3a0 req-068d8e73-3787-456e-bd52-a931e1a5f65b service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:26.347026 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0cddde19-0805-47f9-9719-558be534d3a0 req-068d8e73-3787-456e-bd52-a931e1a5f65b service nova] Creating event network-vif-plugged:190a9a30-8e03-4a32-a36c-6a97e94cb798 for instance 807fb5a1-f08f-44e3-b602-0b54167cd91a on n-h2-826756-3 Jul 28 04:54:26.355111 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0cddde19-0805-47f9-9719-558be534d3a0 req-068d8e73-3787-456e-bd52-a931e1a5f65b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032756 Jul 28 04:54:26.355712 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5100/7550] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:54:27.343239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f70bbcab-acb5-435c-9c69-ca7895ae5f81 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:27.343919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f70bbcab-acb5-435c-9c69-ca7895ae5f81 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:27.346283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:54:27.352903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f70bbcab-acb5-435c-9c69-ca7895ae5f81 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:27.353370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f70bbcab-acb5-435c-9c69-ca7895ae5f81 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:27.354174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f70bbcab-acb5-435c-9c69-ca7895ae5f81 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:27.354629 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f70bbcab-acb5-435c-9c69-ca7895ae5f81 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:27.358841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:54:27.508925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f70bbcab-acb5-435c-9c69-ca7895ae5f81 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:27.520821 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f70bbcab-acb5-435c-9c69-ca7895ae5f81 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1391 microversion: 2.1 time: 0.183265 Jul 28 04:54:27.521817 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5101/7551] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:27 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:54:28.543067 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-020942e4-0c1d-4398-8ee7-6d8175fbc640 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:28.543729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-020942e4-0c1d-4398-8ee7-6d8175fbc640 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:28.545698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:54:28.546417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:54:28.553701 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-020942e4-0c1d-4398-8ee7-6d8175fbc640 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:28.554176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-020942e4-0c1d-4398-8ee7-6d8175fbc640 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:28.554959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-020942e4-0c1d-4398-8ee7-6d8175fbc640 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:28.555411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-020942e4-0c1d-4398-8ee7-6d8175fbc640 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:28.690621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-020942e4-0c1d-4398-8ee7-6d8175fbc640 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:28.699329 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-020942e4-0c1d-4398-8ee7-6d8175fbc640 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1562 microversion: 2.1 time: 0.160400 Jul 28 04:54:28.699913 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5102/7552] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:28 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:54:28.719716 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-03eae62e-7cf0-4214-b011-4559db09aa20 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:28.720337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-03eae62e-7cf0-4214-b011-4559db09aa20 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:28.727009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03eae62e-7cf0-4214-b011-4559db09aa20 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:28.727456 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03eae62e-7cf0-4214-b011-4559db09aa20 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:28.728241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03eae62e-7cf0-4214-b011-4559db09aa20 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:28.728721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-03eae62e-7cf0-4214-b011-4559db09aa20 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:28.876034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-03eae62e-7cf0-4214-b011-4559db09aa20 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:28.883942 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-03eae62e-7cf0-4214-b011-4559db09aa20 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1562 microversion: 2.1 time: 0.167845 Jul 28 04:54:28.884597 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5103/7553] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:28 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:54:30.548796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c38c3b7-3422-46a8-83b8-82f96de8d245 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:54:30.551197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c38c3b7-3422-46a8-83b8-82f96de8d245 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:30.564269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c38c3b7-3422-46a8-83b8-82f96de8d245 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:30.564981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c38c3b7-3422-46a8-83b8-82f96de8d245 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:30.565877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c38c3b7-3422-46a8-83b8-82f96de8d245 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:30.566402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c38c3b7-3422-46a8-83b8-82f96de8d245 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:30.706196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c38c3b7-3422-46a8-83b8-82f96de8d245 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:54:30.715236 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c38c3b7-3422-46a8-83b8-82f96de8d245 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1562 microversion: 2.1 time: 0.172657 Jul 28 04:54:30.715866 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5104/7554] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:54:30 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1562 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:54:30.720535 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e5864779-e0bb-482d-ba21-cad81732f962 req-1bc4b0bc-acc8-4b71-8fa8-b859aa6cae32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807fb5a1-f08f-44e3-b602-0b54167cd91a", "tag": "190a9a30-8e03-4a32-a36c-6a97e94cb798"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:54:30.730788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e5864779-e0bb-482d-ba21-cad81732f962 req-1bc4b0bc-acc8-4b71-8fa8-b859aa6cae32 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:30.731242 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e5864779-e0bb-482d-ba21-cad81732f962 req-1bc4b0bc-acc8-4b71-8fa8-b859aa6cae32 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:30.743078 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e5864779-e0bb-482d-ba21-cad81732f962 req-1bc4b0bc-acc8-4b71-8fa8-b859aa6cae32 service nova] Creating event network-changed:190a9a30-8e03-4a32-a36c-6a97e94cb798 for instance 807fb5a1-f08f-44e3-b602-0b54167cd91a on n-h2-826756-3 Jul 28 04:54:30.748638 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e5864779-e0bb-482d-ba21-cad81732f962 req-1bc4b0bc-acc8-4b71-8fa8-b859aa6cae32 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031255 Jul 28 04:54:30.749306 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5105/7555] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:54:55.050369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=9 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:54:55.051600 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=25 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:54:55.055920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b7262c0-a6bd-4d9a-a168-e930c0c71020 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:54:55.058322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b7262c0-a6bd-4d9a-a168-e930c0c71020 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:54:55.065624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b7262c0-a6bd-4d9a-a168-e930c0c71020 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:55.066086 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b7262c0-a6bd-4d9a-a168-e930c0c71020 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:55.066866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b7262c0-a6bd-4d9a-a168-e930c0c71020 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:54:55.067304 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b7262c0-a6bd-4d9a-a168-e930c0c71020 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:54:55.139697 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b7262c0-a6bd-4d9a-a168-e930c0c71020 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a/action" status: 200 len: 24557 microversion: 2.1 time: 0.091204 Jul 28 04:54:55.140382 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5106/7556] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:54:55 2022] POST /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a/action => generated 24557 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:55:05.879448 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:55:05.880095 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:55:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:55:06.068036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f3dfa7e-a7b2-41d4-a103-66dacdc9e486 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:55:06.070613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f3dfa7e-a7b2-41d4-a103-66dacdc9e486 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:06.073401 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:55:06.074084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:55:06.080643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f3dfa7e-a7b2-41d4-a103-66dacdc9e486 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:06.081105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f3dfa7e-a7b2-41d4-a103-66dacdc9e486 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:06.081937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f3dfa7e-a7b2-41d4-a103-66dacdc9e486 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:06.082382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f3dfa7e-a7b2-41d4-a103-66dacdc9e486 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:06.126118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f3dfa7e-a7b2-41d4-a103-66dacdc9e486 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:06.133465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f3dfa7e-a7b2-41d4-a103-66dacdc9e486 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Old instance type m1.heat2, new instance type m1.heat {{(pid=126071) resize /opt/stack/nova/nova/compute/api.py:4212}} Jul 28 04:55:06.140592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5f3dfa7e-a7b2-41d4-a103-66dacdc9e486 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:55:06.141029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5f3dfa7e-a7b2-41d4-a103-66dacdc9e486 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:55:06.141520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5f3dfa7e-a7b2-41d4-a103-66dacdc9e486 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:55:06.141947 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5f3dfa7e-a7b2-41d4-a103-66dacdc9e486 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:55:06.142380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-5f3dfa7e-a7b2-41d4-a103-66dacdc9e486 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:55:06.220745 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f3dfa7e-a7b2-41d4-a103-66dacdc9e486 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a/action" status: 202 len: 0 microversion: 2.1 time: 0.157216 Jul 28 04:55:06.221387 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5107/7557] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:55:06 2022] POST /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:55:06.230730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-10fb6ab4-f62f-4edb-8fb9-6912fd4015ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:06.231369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-10fb6ab4-f62f-4edb-8fb9-6912fd4015ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:06.239215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10fb6ab4-f62f-4edb-8fb9-6912fd4015ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:06.239680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10fb6ab4-f62f-4edb-8fb9-6912fd4015ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:06.240884 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10fb6ab4-f62f-4edb-8fb9-6912fd4015ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:06.241355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-10fb6ab4-f62f-4edb-8fb9-6912fd4015ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:06.384769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-10fb6ab4-f62f-4edb-8fb9-6912fd4015ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:06.393443 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-10fb6ab4-f62f-4edb-8fb9-6912fd4015ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1689 microversion: 2.1 time: 0.167219 Jul 28 04:55:06.394158 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5108/7558] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:06 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:55:07.418428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-58882cf7-eab0-4663-b7be-cb6f979554ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:07.419322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-58882cf7-eab0-4663-b7be-cb6f979554ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:07.427156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58882cf7-eab0-4663-b7be-cb6f979554ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:07.427618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58882cf7-eab0-4663-b7be-cb6f979554ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:07.428402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58882cf7-eab0-4663-b7be-cb6f979554ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:07.428881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-58882cf7-eab0-4663-b7be-cb6f979554ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:07.582934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-58882cf7-eab0-4663-b7be-cb6f979554ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:07.591272 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-58882cf7-eab0-4663-b7be-cb6f979554ed tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1689 microversion: 2.1 time: 0.178249 Jul 28 04:55:07.591856 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5109/7559] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:07 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1689 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:55:08.616981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7c2c7827-e801-45a1-8b83-1e64d9d663d2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:08.618013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7c2c7827-e801-45a1-8b83-1e64d9d663d2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:08.629960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c2c7827-e801-45a1-8b83-1e64d9d663d2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:08.630797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c2c7827-e801-45a1-8b83-1e64d9d663d2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:08.631590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c2c7827-e801-45a1-8b83-1e64d9d663d2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:08.632044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7c2c7827-e801-45a1-8b83-1e64d9d663d2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:08.786571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7c2c7827-e801-45a1-8b83-1e64d9d663d2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:08.796034 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7c2c7827-e801-45a1-8b83-1e64d9d663d2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1689 microversion: 2.1 time: 0.185852 Jul 28 04:55:08.796664 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5110/7560] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:08 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:09.819537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-157e31db-84ee-4607-95a7-d2582aa133d7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:09.820424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-157e31db-84ee-4607-95a7-d2582aa133d7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:09.828116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-157e31db-84ee-4607-95a7-d2582aa133d7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:09.828626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-157e31db-84ee-4607-95a7-d2582aa133d7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:09.829409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-157e31db-84ee-4607-95a7-d2582aa133d7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:09.829889 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-157e31db-84ee-4607-95a7-d2582aa133d7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:09.976822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-157e31db-84ee-4607-95a7-d2582aa133d7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:09.985500 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-157e31db-84ee-4607-95a7-d2582aa133d7 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1689 microversion: 2.1 time: 0.169875 Jul 28 04:55:09.986083 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5111/7561] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:09 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:11.014445 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c8e9b874-947e-4ced-9dc1-2a8c59842806 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:11.015171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c8e9b874-947e-4ced-9dc1-2a8c59842806 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:11.022474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8e9b874-947e-4ced-9dc1-2a8c59842806 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:11.022968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8e9b874-947e-4ced-9dc1-2a8c59842806 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:11.023765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8e9b874-947e-4ced-9dc1-2a8c59842806 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:11.024213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c8e9b874-947e-4ced-9dc1-2a8c59842806 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:11.164650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c8e9b874-947e-4ced-9dc1-2a8c59842806 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:11.172710 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c8e9b874-947e-4ced-9dc1-2a8c59842806 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1689 microversion: 2.1 time: 0.162353 Jul 28 04:55:11.173306 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5112/7562] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:11 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:12.195135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e3dec7df-e975-4b7d-a10e-0b3c960e00d0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:12.195876 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e3dec7df-e975-4b7d-a10e-0b3c960e00d0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:12.204457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3dec7df-e975-4b7d-a10e-0b3c960e00d0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:12.204998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3dec7df-e975-4b7d-a10e-0b3c960e00d0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:12.205854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3dec7df-e975-4b7d-a10e-0b3c960e00d0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:12.206311 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e3dec7df-e975-4b7d-a10e-0b3c960e00d0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:12.355925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e3dec7df-e975-4b7d-a10e-0b3c960e00d0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:12.364393 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e3dec7df-e975-4b7d-a10e-0b3c960e00d0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1694 microversion: 2.1 time: 0.173674 Jul 28 04:55:12.364987 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5113/7563] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:12 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:13.387589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d52dcbda-2e9e-49c6-87c9-3c92cad6d3b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:13.388483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d52dcbda-2e9e-49c6-87c9-3c92cad6d3b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:13.397118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d52dcbda-2e9e-49c6-87c9-3c92cad6d3b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:13.397770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d52dcbda-2e9e-49c6-87c9-3c92cad6d3b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:13.398558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d52dcbda-2e9e-49c6-87c9-3c92cad6d3b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:13.399010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d52dcbda-2e9e-49c6-87c9-3c92cad6d3b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:13.540268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d52dcbda-2e9e-49c6-87c9-3c92cad6d3b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:13.549361 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d52dcbda-2e9e-49c6-87c9-3c92cad6d3b0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1694 microversion: 2.1 time: 0.166954 Jul 28 04:55:13.550403 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5114/7564] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:13 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:14.573852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9027d130-4621-4c82-b911-22fdd2a1f7a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:14.574958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9027d130-4621-4c82-b911-22fdd2a1f7a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:14.586447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9027d130-4621-4c82-b911-22fdd2a1f7a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:14.587325 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9027d130-4621-4c82-b911-22fdd2a1f7a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:14.588772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9027d130-4621-4c82-b911-22fdd2a1f7a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:14.589599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9027d130-4621-4c82-b911-22fdd2a1f7a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:14.741006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9027d130-4621-4c82-b911-22fdd2a1f7a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:14.750146 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9027d130-4621-4c82-b911-22fdd2a1f7a0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1694 microversion: 2.1 time: 0.181421 Jul 28 04:55:14.750470 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5115/7565] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:14 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:55:15.773486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-29ac4f2b-e681-4c6c-8f30-bd7dbb197a1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:15.774143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-29ac4f2b-e681-4c6c-8f30-bd7dbb197a1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:15.781758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ac4f2b-e681-4c6c-8f30-bd7dbb197a1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:15.782222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ac4f2b-e681-4c6c-8f30-bd7dbb197a1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:15.783007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ac4f2b-e681-4c6c-8f30-bd7dbb197a1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:15.783459 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-29ac4f2b-e681-4c6c-8f30-bd7dbb197a1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:15.957137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-29ac4f2b-e681-4c6c-8f30-bd7dbb197a1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:15.967288 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-29ac4f2b-e681-4c6c-8f30-bd7dbb197a1c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1694 microversion: 2.1 time: 0.198690 Jul 28 04:55:15.968307 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5116/7566] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:15 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1694 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:16.993482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a1c424b7-c8e6-4469-9e68-e31a1155d28f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:16.994229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a1c424b7-c8e6-4469-9e68-e31a1155d28f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:17.001761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1c424b7-c8e6-4469-9e68-e31a1155d28f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:17.002223 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1c424b7-c8e6-4469-9e68-e31a1155d28f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:17.003004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1c424b7-c8e6-4469-9e68-e31a1155d28f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:17.003454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a1c424b7-c8e6-4469-9e68-e31a1155d28f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:17.156372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a1c424b7-c8e6-4469-9e68-e31a1155d28f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:17.166157 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a1c424b7-c8e6-4469-9e68-e31a1155d28f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1694 microversion: 2.1 time: 0.177629 Jul 28 04:55:17.166750 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5117/7567] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:16 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:18.187775 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9cadc41a-0dcf-4776-aaa1-c9bcae7f98f6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:18.188520 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9cadc41a-0dcf-4776-aaa1-c9bcae7f98f6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:18.196392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cadc41a-0dcf-4776-aaa1-c9bcae7f98f6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:18.196805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cadc41a-0dcf-4776-aaa1-c9bcae7f98f6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:18.197568 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cadc41a-0dcf-4776-aaa1-c9bcae7f98f6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:18.198027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9cadc41a-0dcf-4776-aaa1-c9bcae7f98f6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:18.346120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9cadc41a-0dcf-4776-aaa1-c9bcae7f98f6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:18.354620 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9cadc41a-0dcf-4776-aaa1-c9bcae7f98f6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1694 microversion: 2.1 time: 0.171121 Jul 28 04:55:18.355241 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5118/7568] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:18 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:19.377334 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b0d11de2-50e1-4f7c-a373-4d49af2ea03b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:19.378042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b0d11de2-50e1-4f7c-a373-4d49af2ea03b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:19.385398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0d11de2-50e1-4f7c-a373-4d49af2ea03b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:19.385855 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0d11de2-50e1-4f7c-a373-4d49af2ea03b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:19.386648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0d11de2-50e1-4f7c-a373-4d49af2ea03b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:19.387106 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0d11de2-50e1-4f7c-a373-4d49af2ea03b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:19.522921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b0d11de2-50e1-4f7c-a373-4d49af2ea03b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:19.531173 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b0d11de2-50e1-4f7c-a373-4d49af2ea03b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1694 microversion: 2.1 time: 0.157889 Jul 28 04:55:19.531999 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5119/7569] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:19 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:20.553409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5f2d1d52-d904-4204-b61b-95c1fb4d5db9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:20.554069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5f2d1d52-d904-4204-b61b-95c1fb4d5db9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:20.561705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f2d1d52-d904-4204-b61b-95c1fb4d5db9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:20.562174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f2d1d52-d904-4204-b61b-95c1fb4d5db9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:20.562971 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f2d1d52-d904-4204-b61b-95c1fb4d5db9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:20.563425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5f2d1d52-d904-4204-b61b-95c1fb4d5db9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:20.699840 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5f2d1d52-d904-4204-b61b-95c1fb4d5db9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:20.711861 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5f2d1d52-d904-4204-b61b-95c1fb4d5db9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1694 microversion: 2.1 time: 0.162298 Jul 28 04:55:20.712881 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5120/7570] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:20 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:21.735268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8299549b-17b5-4034-bd42-58bea28e8a56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:21.736044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8299549b-17b5-4034-bd42-58bea28e8a56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:21.744972 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8299549b-17b5-4034-bd42-58bea28e8a56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:21.745449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8299549b-17b5-4034-bd42-58bea28e8a56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:21.746260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8299549b-17b5-4034-bd42-58bea28e8a56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:21.746722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8299549b-17b5-4034-bd42-58bea28e8a56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:21.903110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8299549b-17b5-4034-bd42-58bea28e8a56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:21.912418 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8299549b-17b5-4034-bd42-58bea28e8a56 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1694 microversion: 2.1 time: 0.181277 Jul 28 04:55:21.913053 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5121/7571] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:21 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1694 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:22.939095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a85a9ab4-8e08-41cf-88ec-83a56d32d827 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:22.940203 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a85a9ab4-8e08-41cf-88ec-83a56d32d827 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:22.951959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a85a9ab4-8e08-41cf-88ec-83a56d32d827 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:22.952800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a85a9ab4-8e08-41cf-88ec-83a56d32d827 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:22.954153 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a85a9ab4-8e08-41cf-88ec-83a56d32d827 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:22.954913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a85a9ab4-8e08-41cf-88ec-83a56d32d827 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:22.961694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:55:23.100095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a85a9ab4-8e08-41cf-88ec-83a56d32d827 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:23.109743 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a85a9ab4-8e08-41cf-88ec-83a56d32d827 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1694 microversion: 2.1 time: 0.177488 Jul 28 04:55:23.110364 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5122/7572] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:22 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:24.131658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-99762f74-25c0-40d9-93a7-1d227ef9171c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:24.132479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-99762f74-25c0-40d9-93a7-1d227ef9171c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:24.139829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-99762f74-25c0-40d9-93a7-1d227ef9171c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:24.140298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-99762f74-25c0-40d9-93a7-1d227ef9171c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:24.141115 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-99762f74-25c0-40d9-93a7-1d227ef9171c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:24.141569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-99762f74-25c0-40d9-93a7-1d227ef9171c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:24.293025 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-99762f74-25c0-40d9-93a7-1d227ef9171c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:24.305086 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-99762f74-25c0-40d9-93a7-1d227ef9171c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1694 microversion: 2.1 time: 0.177032 Jul 28 04:55:24.305766 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5123/7573] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:24 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:25.330431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-92b4e29d-6e9f-4708-871e-c5583da83e60 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:25.331184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-92b4e29d-6e9f-4708-871e-c5583da83e60 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:25.339953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92b4e29d-6e9f-4708-871e-c5583da83e60 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:25.340559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92b4e29d-6e9f-4708-871e-c5583da83e60 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:25.341493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92b4e29d-6e9f-4708-871e-c5583da83e60 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:25.342060 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-92b4e29d-6e9f-4708-871e-c5583da83e60 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:25.483768 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-92b4e29d-6e9f-4708-871e-c5583da83e60 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:25.492320 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-92b4e29d-6e9f-4708-871e-c5583da83e60 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1694 microversion: 2.1 time: 0.167488 Jul 28 04:55:25.492939 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5124/7574] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:25 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:26.521441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-12a1c822-7294-4edf-9ecb-709f99ed20c3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:26.522142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-12a1c822-7294-4edf-9ecb-709f99ed20c3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:26.528844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12a1c822-7294-4edf-9ecb-709f99ed20c3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:26.529406 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12a1c822-7294-4edf-9ecb-709f99ed20c3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:26.530198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12a1c822-7294-4edf-9ecb-709f99ed20c3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:26.530638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-12a1c822-7294-4edf-9ecb-709f99ed20c3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:26.667952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-12a1c822-7294-4edf-9ecb-709f99ed20c3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:26.676134 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-12a1c822-7294-4edf-9ecb-709f99ed20c3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1694 microversion: 2.1 time: 0.158962 Jul 28 04:55:26.677286 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5125/7575] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:26 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:27.698462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-aac69046-6388-498d-be94-52759f9ec361 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:27.699202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-aac69046-6388-498d-be94-52759f9ec361 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:27.712217 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aac69046-6388-498d-be94-52759f9ec361 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:27.712711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aac69046-6388-498d-be94-52759f9ec361 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:27.713509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aac69046-6388-498d-be94-52759f9ec361 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:27.713978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-aac69046-6388-498d-be94-52759f9ec361 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:27.862349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-aac69046-6388-498d-be94-52759f9ec361 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:27.873082 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-aac69046-6388-498d-be94-52759f9ec361 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1694 microversion: 2.1 time: 0.178638 Jul 28 04:55:27.873728 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5126/7576] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:27 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:55:28.896679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-39884cbd-6fd9-4954-bf6e-75c5d2ab0420 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:28.897510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-39884cbd-6fd9-4954-bf6e-75c5d2ab0420 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:28.906064 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39884cbd-6fd9-4954-bf6e-75c5d2ab0420 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:28.906537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39884cbd-6fd9-4954-bf6e-75c5d2ab0420 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:28.907494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39884cbd-6fd9-4954-bf6e-75c5d2ab0420 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:28.907930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-39884cbd-6fd9-4954-bf6e-75c5d2ab0420 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:29.058166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-39884cbd-6fd9-4954-bf6e-75c5d2ab0420 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:29.067604 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-39884cbd-6fd9-4954-bf6e-75c5d2ab0420 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1693 microversion: 2.1 time: 0.174989 Jul 28 04:55:29.068196 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5127/7577] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:28 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:29.716084 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-565f64a2-ea8d-4a12-916a-1b52441572e9 req-1c0be061-46af-42d4-a019-50b58c7832cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807fb5a1-f08f-44e3-b602-0b54167cd91a", "name": "network-vif-unplugged", "status": "completed", "tag": "190a9a30-8e03-4a32-a36c-6a97e94cb798"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:55:29.726683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-565f64a2-ea8d-4a12-916a-1b52441572e9 req-1c0be061-46af-42d4-a019-50b58c7832cc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:29.727144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-565f64a2-ea8d-4a12-916a-1b52441572e9 req-1c0be061-46af-42d4-a019-50b58c7832cc service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:29.739442 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-565f64a2-ea8d-4a12-916a-1b52441572e9 req-1c0be061-46af-42d4-a019-50b58c7832cc service nova] Creating event network-vif-unplugged:190a9a30-8e03-4a32-a36c-6a97e94cb798 for instance 807fb5a1-f08f-44e3-b602-0b54167cd91a on n-h1-826756-3 Jul 28 04:55:29.745464 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-565f64a2-ea8d-4a12-916a-1b52441572e9 req-1c0be061-46af-42d4-a019-50b58c7832cc service nova] Instance 807fb5a1-f08f-44e3-b602-0b54167cd91a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:55:29.756821 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-565f64a2-ea8d-4a12-916a-1b52441572e9 req-1c0be061-46af-42d4-a019-50b58c7832cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045299 Jul 28 04:55:29.757515 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5128/7578] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:55:30.095110 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-45db52b0-58e9-4f93-b451-159485e14390 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:30.095905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-45db52b0-58e9-4f93-b451-159485e14390 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:30.104112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45db52b0-58e9-4f93-b451-159485e14390 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:30.104609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45db52b0-58e9-4f93-b451-159485e14390 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:30.105408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45db52b0-58e9-4f93-b451-159485e14390 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:30.105854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45db52b0-58e9-4f93-b451-159485e14390 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:30.284507 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-45db52b0-58e9-4f93-b451-159485e14390 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:30.293149 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-45db52b0-58e9-4f93-b451-159485e14390 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1693 microversion: 2.1 time: 0.205494 Jul 28 04:55:30.294025 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5129/7579] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:30 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1693 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:31.319779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ef1c0289-38e9-4a1e-a166-94de0fe37019 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:31.320986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ef1c0289-38e9-4a1e-a166-94de0fe37019 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:31.332691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef1c0289-38e9-4a1e-a166-94de0fe37019 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:31.333470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef1c0289-38e9-4a1e-a166-94de0fe37019 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:31.334747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef1c0289-38e9-4a1e-a166-94de0fe37019 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:31.335495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef1c0289-38e9-4a1e-a166-94de0fe37019 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:31.483306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ef1c0289-38e9-4a1e-a166-94de0fe37019 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:31.492149 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ef1c0289-38e9-4a1e-a166-94de0fe37019 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1691 microversion: 2.1 time: 0.178999 Jul 28 04:55:31.492785 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5130/7580] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:31 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:31.773454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-98cb145f-ae05-4531-aebb-202e47907df9 req-e816706a-8eaf-4b95-85ef-2451ad493fcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807fb5a1-f08f-44e3-b602-0b54167cd91a", "tag": "190a9a30-8e03-4a32-a36c-6a97e94cb798"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:55:31.784668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-98cb145f-ae05-4531-aebb-202e47907df9 req-e816706a-8eaf-4b95-85ef-2451ad493fcb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:31.785155 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-98cb145f-ae05-4531-aebb-202e47907df9 req-e816706a-8eaf-4b95-85ef-2451ad493fcb service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:31.797611 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-98cb145f-ae05-4531-aebb-202e47907df9 req-e816706a-8eaf-4b95-85ef-2451ad493fcb service nova] Creating event network-changed:190a9a30-8e03-4a32-a36c-6a97e94cb798 for instance 807fb5a1-f08f-44e3-b602-0b54167cd91a on n-h1-826756-3 Jul 28 04:55:31.804269 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [req-98cb145f-ae05-4531-aebb-202e47907df9 req-e816706a-8eaf-4b95-85ef-2451ad493fcb service nova] Instance 807fb5a1-f08f-44e3-b602-0b54167cd91a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-826756-3', 'n-h2-826756-3'} {{(pid=126071) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5932}} Jul 28 04:55:31.816131 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-98cb145f-ae05-4531-aebb-202e47907df9 req-e816706a-8eaf-4b95-85ef-2451ad493fcb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046539 Jul 28 04:55:31.818079 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5131/7581] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:55:32.518200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cac79f8f-02f0-4d45-aeb7-2440e367abd3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:32.519011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cac79f8f-02f0-4d45-aeb7-2440e367abd3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:32.526227 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cac79f8f-02f0-4d45-aeb7-2440e367abd3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:32.526697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cac79f8f-02f0-4d45-aeb7-2440e367abd3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:32.527518 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cac79f8f-02f0-4d45-aeb7-2440e367abd3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:32.527970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cac79f8f-02f0-4d45-aeb7-2440e367abd3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:32.678573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cac79f8f-02f0-4d45-aeb7-2440e367abd3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:32.686587 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cac79f8f-02f0-4d45-aeb7-2440e367abd3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1688 microversion: 2.1 time: 0.173835 Jul 28 04:55:32.687208 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5132/7582] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:32 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:32.708157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e088bed-c85e-4a5e-9e3b-8448e971c82f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:55:32.708753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0e088bed-c85e-4a5e-9e3b-8448e971c82f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:32.715460 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e088bed-c85e-4a5e-9e3b-8448e971c82f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:32.715940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e088bed-c85e-4a5e-9e3b-8448e971c82f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:32.716784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e088bed-c85e-4a5e-9e3b-8448e971c82f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:32.717299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e088bed-c85e-4a5e-9e3b-8448e971c82f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:32.785253 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0e088bed-c85e-4a5e-9e3b-8448e971c82f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a/action" status: 204 len: 0 microversion: 2.1 time: 0.081207 Jul 28 04:55:32.786148 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5133/7583] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:55:32 2022] POST /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:55:32.796534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a5b06b6-997d-4f6c-bc28-82743c63f9c9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:32.797481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4a5b06b6-997d-4f6c-bc28-82743c63f9c9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:32.805033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a5b06b6-997d-4f6c-bc28-82743c63f9c9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:32.805530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a5b06b6-997d-4f6c-bc28-82743c63f9c9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:32.806566 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a5b06b6-997d-4f6c-bc28-82743c63f9c9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:32.807066 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a5b06b6-997d-4f6c-bc28-82743c63f9c9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:32.954232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a5b06b6-997d-4f6c-bc28-82743c63f9c9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:32.966253 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4a5b06b6-997d-4f6c-bc28-82743c63f9c9 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1688 microversion: 2.1 time: 0.175262 Jul 28 04:55:32.967063 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5134/7584] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:32 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:55:32.987653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-178219a0-027d-4d83-9282-dd960e199ce2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:32.988292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-178219a0-027d-4d83-9282-dd960e199ce2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:32.995534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-178219a0-027d-4d83-9282-dd960e199ce2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:32.996007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-178219a0-027d-4d83-9282-dd960e199ce2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:32.996846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-178219a0-027d-4d83-9282-dd960e199ce2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:32.997487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-178219a0-027d-4d83-9282-dd960e199ce2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:33.138041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-178219a0-027d-4d83-9282-dd960e199ce2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:33.146280 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-178219a0-027d-4d83-9282-dd960e199ce2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1688 microversion: 2.1 time: 0.162634 Jul 28 04:55:33.146899 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5135/7585] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:32 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:55:34.169073 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7b2d96b6-86a0-4309-96b8-ee2822cbb4f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:55:34.169797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7b2d96b6-86a0-4309-96b8-ee2822cbb4f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:34.177151 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2d96b6-86a0-4309-96b8-ee2822cbb4f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:34.178159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2d96b6-86a0-4309-96b8-ee2822cbb4f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:34.179059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2d96b6-86a0-4309-96b8-ee2822cbb4f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:34.179596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7b2d96b6-86a0-4309-96b8-ee2822cbb4f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:34.335833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7b2d96b6-86a0-4309-96b8-ee2822cbb4f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:55:34.343936 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7b2d96b6-86a0-4309-96b8-ee2822cbb4f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1680 microversion: 2.1 time: 0.179265 Jul 28 04:55:34.344572 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5136/7586] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:55:34 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:55:35.850152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-d53030e4-d7fe-4271-9053-294c6bc9a404 req-2cc7487a-b5f0-4466-ad75-5b838c4937ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807fb5a1-f08f-44e3-b602-0b54167cd91a", "name": "network-vif-plugged", "status": "completed", "tag": "190a9a30-8e03-4a32-a36c-6a97e94cb798"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:55:35.862593 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d53030e4-d7fe-4271-9053-294c6bc9a404 req-2cc7487a-b5f0-4466-ad75-5b838c4937ea service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:35.863074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-d53030e4-d7fe-4271-9053-294c6bc9a404 req-2cc7487a-b5f0-4466-ad75-5b838c4937ea service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:35.874759 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-d53030e4-d7fe-4271-9053-294c6bc9a404 req-2cc7487a-b5f0-4466-ad75-5b838c4937ea service nova] Creating event network-vif-plugged:190a9a30-8e03-4a32-a36c-6a97e94cb798 for instance 807fb5a1-f08f-44e3-b602-0b54167cd91a on n-h1-826756-3 Jul 28 04:55:35.880163 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-d53030e4-d7fe-4271-9053-294c6bc9a404 req-2cc7487a-b5f0-4466-ad75-5b838c4937ea service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034512 Jul 28 04:55:35.880527 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5137/7587] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:55:56.570905 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fe5bb9c9-ab2d-402f-aa35-841de4ccb4ab tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:55:56.573298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fe5bb9c9-ab2d-402f-aa35-841de4ccb4ab tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:55:56.575938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=66 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:55:56.576649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:55:56.582674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe5bb9c9-ab2d-402f-aa35-841de4ccb4ab tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:56.583126 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe5bb9c9-ab2d-402f-aa35-841de4ccb4ab tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:56.583926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe5bb9c9-ab2d-402f-aa35-841de4ccb4ab tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:55:56.584378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fe5bb9c9-ab2d-402f-aa35-841de4ccb4ab tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:55:56.678949 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fe5bb9c9-ab2d-402f-aa35-841de4ccb4ab tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a/action" status: 200 len: 24576 microversion: 2.1 time: 0.112955 Jul 28 04:55:56.679904 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5138/7588] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:55:56 2022] POST /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a/action => generated 24576 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 04:56:03.964592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c3357498-3988-4e30-957a-0d5bb3183acc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:03.965462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c3357498-3988-4e30-957a-0d5bb3183acc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:03.972961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3357498-3988-4e30-957a-0d5bb3183acc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:03.973430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3357498-3988-4e30-957a-0d5bb3183acc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:03.974574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3357498-3988-4e30-957a-0d5bb3183acc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:03.975083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c3357498-3988-4e30-957a-0d5bb3183acc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:04.001589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c3357498-3988-4e30-957a-0d5bb3183acc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:56:04.088634 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c3357498-3988-4e30-957a-0d5bb3183acc tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "DELETE /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 204 len: 0 microversion: 2.1 time: 0.128425 Jul 28 04:56:04.089332 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5139/7589] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:56:03 2022] DELETE /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:56:04.171340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-701580c3-1687-4480-9b5c-19f50762143a req-bc2f9cb1-2421-4783-bf38-1d7387e20c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807fb5a1-f08f-44e3-b602-0b54167cd91a", "tag": "190a9a30-8e03-4a32-a36c-6a97e94cb798"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:56:04.182079 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-701580c3-1687-4480-9b5c-19f50762143a req-bc2f9cb1-2421-4783-bf38-1d7387e20c3f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:04.182540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-701580c3-1687-4480-9b5c-19f50762143a req-bc2f9cb1-2421-4783-bf38-1d7387e20c3f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:04.193347 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-701580c3-1687-4480-9b5c-19f50762143a req-bc2f9cb1-2421-4783-bf38-1d7387e20c3f service nova] Creating event network-changed:190a9a30-8e03-4a32-a36c-6a97e94cb798 for instance 807fb5a1-f08f-44e3-b602-0b54167cd91a on n-h1-826756-3 Jul 28 04:56:04.198485 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-701580c3-1687-4480-9b5c-19f50762143a req-bc2f9cb1-2421-4783-bf38-1d7387e20c3f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107818 Jul 28 04:56:04.199099 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5140/7590] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:56:04.204440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a0fc7f0e-33ea-43a3-8bb3-a13da60b3a52 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:04.205156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a0fc7f0e-33ea-43a3-8bb3-a13da60b3a52 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:04.211797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0fc7f0e-33ea-43a3-8bb3-a13da60b3a52 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:04.212263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0fc7f0e-33ea-43a3-8bb3-a13da60b3a52 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:04.213075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0fc7f0e-33ea-43a3-8bb3-a13da60b3a52 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:04.213532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0fc7f0e-33ea-43a3-8bb3-a13da60b3a52 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:04.355809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a0fc7f0e-33ea-43a3-8bb3-a13da60b3a52 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:04.363989 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a0fc7f0e-33ea-43a3-8bb3-a13da60b3a52 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1686 microversion: 2.1 time: 0.163656 Jul 28 04:56:04.364583 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5141/7591] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:04 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:56:05.387114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a361b61-2d10-4767-a639-8f3afcc2da9d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:05.387799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4a361b61-2d10-4767-a639-8f3afcc2da9d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:05.396411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a361b61-2d10-4767-a639-8f3afcc2da9d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:05.397142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a361b61-2d10-4767-a639-8f3afcc2da9d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:05.397969 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a361b61-2d10-4767-a639-8f3afcc2da9d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:05.398420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a361b61-2d10-4767-a639-8f3afcc2da9d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:05.542792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a361b61-2d10-4767-a639-8f3afcc2da9d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:05.551614 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4a361b61-2d10-4767-a639-8f3afcc2da9d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 200 len: 1686 microversion: 2.1 time: 0.168078 Jul 28 04:56:05.556572 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5142/7592] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:05 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:56:06.135894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-365f9fde-301b-4e11-9b4f-7f527efa3a90 req-b507483a-99c8-47da-af0a-f160c44ecea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807fb5a1-f08f-44e3-b602-0b54167cd91a", "name": "network-vif-deleted", "tag": "190a9a30-8e03-4a32-a36c-6a97e94cb798"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:56:06.149903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-365f9fde-301b-4e11-9b4f-7f527efa3a90 req-b507483a-99c8-47da-af0a-f160c44ecea4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:06.150367 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-365f9fde-301b-4e11-9b4f-7f527efa3a90 req-b507483a-99c8-47da-af0a-f160c44ecea4 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:06.162201 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-365f9fde-301b-4e11-9b4f-7f527efa3a90 req-b507483a-99c8-47da-af0a-f160c44ecea4 service nova] Creating event network-vif-deleted:190a9a30-8e03-4a32-a36c-6a97e94cb798 for instance 807fb5a1-f08f-44e3-b602-0b54167cd91a on n-h1-826756-3 Jul 28 04:56:06.167658 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-365f9fde-301b-4e11-9b4f-7f527efa3a90 req-b507483a-99c8-47da-af0a-f160c44ecea4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037119 Jul 28 04:56:06.168282 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5143/7593] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:56:06.574977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-edd787c7-b8bc-48d0-857e-377acd847455 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:06.575697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-edd787c7-b8bc-48d0-857e-377acd847455 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 807fb5a1-f08f-44e3-b602-0b54167cd91a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:06.582662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edd787c7-b8bc-48d0-857e-377acd847455 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:06.583120 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edd787c7-b8bc-48d0-857e-377acd847455 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:06.583899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edd787c7-b8bc-48d0-857e-377acd847455 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:06.584411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-edd787c7-b8bc-48d0-857e-377acd847455 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:06.601463 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-edd787c7-b8bc-48d0-857e-377acd847455 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] HTTP exception thrown: Instance 807fb5a1-f08f-44e3-b602-0b54167cd91a could not be found. Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-edd787c7-b8bc-48d0-857e-377acd847455 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Request method failure captured: Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a HTTP/1.1 Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hXEF03edD8kE1p9C-lBzba2-TBT-P09IEXC-KaYssZmf3zDYGobJ1wkNRNL0yuEJszcMprmJm_M5Y2l7km8k6DP4a2ZaJ05IvUPJ_-eo39mYWvdzzpHU8Ht9JZ0_fcQ0rXdTRHQbHxlOe45cP_XKau8t68GHv5oVuAYJ7pDwCW2vWs Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 8e18d061762841dab3882493fbb4f835 Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8e18d061762841dab3882493fbb4f835"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e18d061762841dab3882493fbb4f835"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8e18d061762841dab3882493fbb4f835"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e18d061762841dab3882493fbb4f835"}]}] Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 8e18d061762841dab3882493fbb4f835 Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestNetworkAdvancedServerOps-2112986599-project Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 3f0cd417487147bc9bc925fa0ad1f7a1 Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2112986599-project Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 807fb5a1-f08f-44e3-b602-0b54167cd91a could not be found. Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '807fb5a1-f08f-44e3-b602-0b54167cd91a'} Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807fb5a1-f08f-44e3-b602-0b54167cd91a could not be found. Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807fb5a1-f08f-44e3-b602-0b54167cd91a could not be found. Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:56:06.603175 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:56:06.607961 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:56:06.607961 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:56:06.607961 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:56:06.607961 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:56:06.607961 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:56:06.607961 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:56:06.607961 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807fb5a1-f08f-44e3-b602-0b54167cd91a could not be found. Jul 28 04:56:06.607961 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:56:06.607961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-edd787c7-b8bc-48d0-857e-377acd847455 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Returning 404 to user: Instance 807fb5a1-f08f-44e3-b602-0b54167cd91a could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:56:06.607961 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-edd787c7-b8bc-48d0-857e-377acd847455 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a" status: 404 len: 111 microversion: 2.1 time: 0.034598 Jul 28 04:56:06.607961 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5144/7594] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:06 2022] GET /compute/v2.1/servers/807fb5a1-f08f-44e3-b602-0b54167cd91a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:56:09.986554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5372fcbe-1491-4999-a7a0-ebf0b09e6e8c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '.version_select at 0x7ffa7995c940>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:10.010486 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5372fcbe-1491-4999-a7a0-ebf0b09e6e8c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-51524748" status: 202 len: 0 microversion: 2.1 time: 0.027760 Jul 28 04:56:10.011137 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5145/7595] 10.222.0.48 () {58 vars in 1278 bytes} [Thu Jul 28 04:56:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-51524748 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:56:10.040614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ad2347a-b157-4a13-a2e7-1d5d85f2419c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'create', calling method: .version_select at 0x7ffa740aa550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-750689836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcrAOcErdB64xILeBJhlH0zUgMYEtaDnMqDq9+ortwvzrd46vCOHy92U8D56K5wsE6tvQM8U4Mkl76GpJIXMtqau6KBlJgtOodrq5+pzTtfNHRqEKc1VPeM0yMqYuancg=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:56:10.057799 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2ad2347a-b157-4a13-a2e7-1d5d85f2419c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for project 8e18d061762841dab3882493fbb4f835. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:56:10.063062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2ad2347a-b157-4a13-a2e7-1d5d85f2419c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for user 3f0cd417487147bc9bc925fa0ad1f7a1 and project 8e18d061762841dab3882493fbb4f835. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:56:10.087212 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ad2347a-b157-4a13-a2e7-1d5d85f2419c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050923 Jul 28 04:56:10.087822 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5146/7596] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:56:10 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:56:16.041001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1069630865", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "7b0b9ac7-92cd-4286-a4e0-affc9593ec3f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-750689836", "security_groups": [{"name": "tempest-secgroup-smoke-235345720"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:56:16.175499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] validate_networks() for [('7b0b9ac7-92cd-4286-a4e0-affc9593ec3f', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:56:16.589584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:56:16.609476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:56:16.610107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:56:16.610610 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:56:16.611043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:56:16.611480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:56:16.629321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:16.629793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:16.630820 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:16.632317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:16.655626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for project 8e18d061762841dab3882493fbb4f835. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:56:16.663592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for user 3f0cd417487147bc9bc925fa0ad1f7a1 and project 8e18d061762841dab3882493fbb4f835. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:56:16.684644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:56:16.687392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:56:16.751661 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0f7f5ec0-af3e-4594-abce-42123359296f tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.716017 Jul 28 04:56:16.752337 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5147/7597] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:56:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:56:16.765231 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-07cfabfb-e718-4f89-b35d-052c371efe0b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:16.766218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-07cfabfb-e718-4f89-b35d-052c371efe0b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:16.831569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-07cfabfb-e718-4f89-b35d-052c371efe0b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:16.841554 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-07cfabfb-e718-4f89-b35d-052c371efe0b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1266 microversion: 2.1 time: 0.081270 Jul 28 04:56:16.843267 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5148/7598] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:16 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:56:17.939437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4f473f00-abab-4eea-8149-2f59b5ba7277 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:17.940156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4f473f00-abab-4eea-8149-2f59b5ba7277 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:17.950254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f473f00-abab-4eea-8149-2f59b5ba7277 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:17.950720 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f473f00-abab-4eea-8149-2f59b5ba7277 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:17.951533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f473f00-abab-4eea-8149-2f59b5ba7277 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:17.951997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4f473f00-abab-4eea-8149-2f59b5ba7277 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:18.060342 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4f473f00-abab-4eea-8149-2f59b5ba7277 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:18.069468 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4f473f00-abab-4eea-8149-2f59b5ba7277 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1326 microversion: 2.1 time: 0.209890 Jul 28 04:56:18.070078 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5149/7599] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:17 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1326 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:56:19.091702 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-191149c5-16bb-41f9-aa02-897f4b866c97 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:19.092499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-191149c5-16bb-41f9-aa02-897f4b866c97 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:19.101276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-191149c5-16bb-41f9-aa02-897f4b866c97 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:19.102039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-191149c5-16bb-41f9-aa02-897f4b866c97 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:19.102940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-191149c5-16bb-41f9-aa02-897f4b866c97 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:19.103391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-191149c5-16bb-41f9-aa02-897f4b866c97 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:19.581525 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-191149c5-16bb-41f9-aa02-897f4b866c97 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:19.589830 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-191149c5-16bb-41f9-aa02-897f4b866c97 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1391 microversion: 2.1 time: 0.502740 Jul 28 04:56:19.590746 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5150/7600] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:19 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1391 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:56:19.737268 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1f93e380-833e-4263-8f8c-f5c1c81aabfb req-5d8bc011-d292-40c0-acb6-d80bbf760c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c551129-1d23-4825-9f94-3073b11c539a", "tag": "c30ad264-95c9-4d75-8305-8aa5975fca7e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:56:19.754530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1f93e380-833e-4263-8f8c-f5c1c81aabfb req-5d8bc011-d292-40c0-acb6-d80bbf760c5a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:19.755655 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1f93e380-833e-4263-8f8c-f5c1c81aabfb req-5d8bc011-d292-40c0-acb6-d80bbf760c5a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:19.776741 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1f93e380-833e-4263-8f8c-f5c1c81aabfb req-5d8bc011-d292-40c0-acb6-d80bbf760c5a service nova] Creating event network-changed:c30ad264-95c9-4d75-8305-8aa5975fca7e for instance 9c551129-1d23-4825-9f94-3073b11c539a on n-h2-826756-3 Jul 28 04:56:19.782626 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1f93e380-833e-4263-8f8c-f5c1c81aabfb req-5d8bc011-d292-40c0-acb6-d80bbf760c5a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153545 Jul 28 04:56:19.783630 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5151/7601] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:56:20.614617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4a825137-9f9d-400e-8345-b6a7c3673b68 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:20.615345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4a825137-9f9d-400e-8345-b6a7c3673b68 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:20.623413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a825137-9f9d-400e-8345-b6a7c3673b68 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:20.624390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a825137-9f9d-400e-8345-b6a7c3673b68 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:20.625224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a825137-9f9d-400e-8345-b6a7c3673b68 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:20.625671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4a825137-9f9d-400e-8345-b6a7c3673b68 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:20.776178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4a825137-9f9d-400e-8345-b6a7c3673b68 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:20.784512 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4a825137-9f9d-400e-8345-b6a7c3673b68 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1391 microversion: 2.1 time: 0.175129 Jul 28 04:56:20.785269 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5152/7602] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:20 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:56:21.807943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6fcdd6a6-9849-4589-ad09-5ece9c6d9ecb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:21.808718 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6fcdd6a6-9849-4589-ad09-5ece9c6d9ecb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:21.815980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fcdd6a6-9849-4589-ad09-5ece9c6d9ecb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:21.816491 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fcdd6a6-9849-4589-ad09-5ece9c6d9ecb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:21.817416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fcdd6a6-9849-4589-ad09-5ece9c6d9ecb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:21.817871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6fcdd6a6-9849-4589-ad09-5ece9c6d9ecb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:21.980942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6fcdd6a6-9849-4589-ad09-5ece9c6d9ecb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:21.993035 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6fcdd6a6-9849-4589-ad09-5ece9c6d9ecb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1391 microversion: 2.1 time: 0.188920 Jul 28 04:56:21.993934 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5153/7603] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:21 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:56:23.024170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0b7537d5-55ef-4ac8-bbab-b0cc9976ac08 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:23.025329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0b7537d5-55ef-4ac8-bbab-b0cc9976ac08 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:23.039289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b7537d5-55ef-4ac8-bbab-b0cc9976ac08 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:23.039753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b7537d5-55ef-4ac8-bbab-b0cc9976ac08 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:23.040618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b7537d5-55ef-4ac8-bbab-b0cc9976ac08 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:23.041061 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0b7537d5-55ef-4ac8-bbab-b0cc9976ac08 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:23.191389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0b7537d5-55ef-4ac8-bbab-b0cc9976ac08 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:23.202867 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0b7537d5-55ef-4ac8-bbab-b0cc9976ac08 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1391 microversion: 2.1 time: 0.185175 Jul 28 04:56:23.203652 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5154/7604] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:23 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:56:24.228919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-78065f0d-f040-41ac-869d-c41530ca5ebb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:24.229710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-78065f0d-f040-41ac-869d-c41530ca5ebb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:24.239209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78065f0d-f040-41ac-869d-c41530ca5ebb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:24.239803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78065f0d-f040-41ac-869d-c41530ca5ebb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:24.240898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78065f0d-f040-41ac-869d-c41530ca5ebb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:24.241485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-78065f0d-f040-41ac-869d-c41530ca5ebb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:24.391735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-78065f0d-f040-41ac-869d-c41530ca5ebb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:24.400298 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-78065f0d-f040-41ac-869d-c41530ca5ebb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1391 microversion: 2.1 time: 0.177311 Jul 28 04:56:24.400916 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5155/7605] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:24 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:56:25.424890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b2e92dcc-c338-4f5f-9f8b-82cfc33ac7e0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:25.425817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b2e92dcc-c338-4f5f-9f8b-82cfc33ac7e0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:25.436104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2e92dcc-c338-4f5f-9f8b-82cfc33ac7e0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:25.436721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2e92dcc-c338-4f5f-9f8b-82cfc33ac7e0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:25.437516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2e92dcc-c338-4f5f-9f8b-82cfc33ac7e0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:25.437964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b2e92dcc-c338-4f5f-9f8b-82cfc33ac7e0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:25.588413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b2e92dcc-c338-4f5f-9f8b-82cfc33ac7e0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:25.595870 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b2e92dcc-c338-4f5f-9f8b-82cfc33ac7e0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1391 microversion: 2.1 time: 0.177035 Jul 28 04:56:25.596475 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5156/7606] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:25 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:56:26.616673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-27410976-98fa-4aab-bb05-706d73f73411 req-02817550-de84-4f7b-beb7-cc344e2d1e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c551129-1d23-4825-9f94-3073b11c539a", "name": "network-vif-plugged", "status": "completed", "tag": "c30ad264-95c9-4d75-8305-8aa5975fca7e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:56:26.626548 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:56:26.628682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-27410976-98fa-4aab-bb05-706d73f73411 req-02817550-de84-4f7b-beb7-cc344e2d1e16 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:26.629405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-27410976-98fa-4aab-bb05-706d73f73411 req-02817550-de84-4f7b-beb7-cc344e2d1e16 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:26.642885 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-27410976-98fa-4aab-bb05-706d73f73411 req-02817550-de84-4f7b-beb7-cc344e2d1e16 service nova] Creating event network-vif-plugged:c30ad264-95c9-4d75-8305-8aa5975fca7e for instance 9c551129-1d23-4825-9f94-3073b11c539a on n-h2-826756-3 Jul 28 04:56:26.646960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:56:26.649447 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-27410976-98fa-4aab-bb05-706d73f73411 req-02817550-de84-4f7b-beb7-cc344e2d1e16 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037487 Jul 28 04:56:26.650323 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5157/7607] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:56:26.655915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2747e885-b04c-4ab7-9968-00cc6a9f8e96 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:26.656665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2747e885-b04c-4ab7-9968-00cc6a9f8e96 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:26.665800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2747e885-b04c-4ab7-9968-00cc6a9f8e96 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:26.666955 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2747e885-b04c-4ab7-9968-00cc6a9f8e96 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:26.668053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2747e885-b04c-4ab7-9968-00cc6a9f8e96 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:26.668547 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2747e885-b04c-4ab7-9968-00cc6a9f8e96 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:26.819048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2747e885-b04c-4ab7-9968-00cc6a9f8e96 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:26.827589 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2747e885-b04c-4ab7-9968-00cc6a9f8e96 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1391 microversion: 2.1 time: 0.175892 Jul 28 04:56:26.828462 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5158/7608] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:26 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:56:27.851753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ee263cc5-3129-4dc3-b30a-37496412ff45 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:27.852495 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ee263cc5-3129-4dc3-b30a-37496412ff45 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:27.854379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:56:27.861056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee263cc5-3129-4dc3-b30a-37496412ff45 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:27.861513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee263cc5-3129-4dc3-b30a-37496412ff45 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:27.862298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee263cc5-3129-4dc3-b30a-37496412ff45 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:27.862746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee263cc5-3129-4dc3-b30a-37496412ff45 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:28.008682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ee263cc5-3129-4dc3-b30a-37496412ff45 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:28.016877 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ee263cc5-3129-4dc3-b30a-37496412ff45 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1391 microversion: 2.1 time: 0.169572 Jul 28 04:56:28.017512 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5159/7609] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:27 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:56:29.038375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d9f96272-c433-43ec-a390-b73ff536352b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:29.039279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d9f96272-c433-43ec-a390-b73ff536352b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:29.047104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9f96272-c433-43ec-a390-b73ff536352b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:29.047765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9f96272-c433-43ec-a390-b73ff536352b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:29.048597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9f96272-c433-43ec-a390-b73ff536352b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:29.049818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d9f96272-c433-43ec-a390-b73ff536352b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:29.203504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d9f96272-c433-43ec-a390-b73ff536352b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:29.211875 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d9f96272-c433-43ec-a390-b73ff536352b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1562 microversion: 2.1 time: 0.178140 Jul 28 04:56:29.212531 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5160/7610] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:29 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:56:29.233044 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b35d5765-f3be-4057-98d2-8ce3316cf778 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:29.233679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b35d5765-f3be-4057-98d2-8ce3316cf778 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:29.240645 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b35d5765-f3be-4057-98d2-8ce3316cf778 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:29.241122 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b35d5765-f3be-4057-98d2-8ce3316cf778 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:29.241924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b35d5765-f3be-4057-98d2-8ce3316cf778 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:29.242474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b35d5765-f3be-4057-98d2-8ce3316cf778 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:29.392544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b35d5765-f3be-4057-98d2-8ce3316cf778 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:29.401334 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b35d5765-f3be-4057-98d2-8ce3316cf778 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1562 microversion: 2.1 time: 0.172227 Jul 28 04:56:29.401933 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5161/7611] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:29 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1562 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:56:31.405383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-35e91d82-7874-4f53-b14f-abe20f0fee8a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:56:31.406039 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-35e91d82-7874-4f53-b14f-abe20f0fee8a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:31.413292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35e91d82-7874-4f53-b14f-abe20f0fee8a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:31.413778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35e91d82-7874-4f53-b14f-abe20f0fee8a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:31.414624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35e91d82-7874-4f53-b14f-abe20f0fee8a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:31.415082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-35e91d82-7874-4f53-b14f-abe20f0fee8a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:31.552866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-35e91d82-7874-4f53-b14f-abe20f0fee8a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:56:31.561530 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-35e91d82-7874-4f53-b14f-abe20f0fee8a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1562 microversion: 2.1 time: 0.160350 Jul 28 04:56:31.564448 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5162/7612] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:56:31 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:56:31.567558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e9d24844-5bbc-49f0-b5b5-d54769366692 req-92ff4731-3bef-4518-9c29-5cf09f4d5c8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c551129-1d23-4825-9f94-3073b11c539a", "tag": "c30ad264-95c9-4d75-8305-8aa5975fca7e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:56:31.578069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e9d24844-5bbc-49f0-b5b5-d54769366692 req-92ff4731-3bef-4518-9c29-5cf09f4d5c8a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:31.578305 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e9d24844-5bbc-49f0-b5b5-d54769366692 req-92ff4731-3bef-4518-9c29-5cf09f4d5c8a service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:31.590464 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e9d24844-5bbc-49f0-b5b5-d54769366692 req-92ff4731-3bef-4518-9c29-5cf09f4d5c8a service nova] Creating event network-changed:c30ad264-95c9-4d75-8305-8aa5975fca7e for instance 9c551129-1d23-4825-9f94-3073b11c539a on n-h2-826756-3 Jul 28 04:56:31.595772 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e9d24844-5bbc-49f0-b5b5-d54769366692 req-92ff4731-3bef-4518-9c29-5cf09f4d5c8a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032145 Jul 28 04:56:31.597094 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5163/7613] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:56:54.826385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4af3399c-90a7-43c4-a23b-22cf3e1f3d39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:56:54.828675 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4af3399c-90a7-43c4-a23b-22cf3e1f3d39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:56:54.831805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=13 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:56:54.833075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=80 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:56:54.839338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4af3399c-90a7-43c4-a23b-22cf3e1f3d39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:54.839796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4af3399c-90a7-43c4-a23b-22cf3e1f3d39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:54.840602 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4af3399c-90a7-43c4-a23b-22cf3e1f3d39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:56:54.841053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4af3399c-90a7-43c4-a23b-22cf3e1f3d39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:56:54.910809 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4af3399c-90a7-43c4-a23b-22cf3e1f3d39 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a/action" status: 200 len: 24564 microversion: 2.1 time: 0.088696 Jul 28 04:56:54.911485 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5164/7614] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:56:54 2022] POST /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a/action => generated 24564 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 04:56:57.443164 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:56:57.443742 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:56:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:57:05.938345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6cc1c943-dba2-4ffd-888d-25b75bbd0be2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:57:05.941308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:57:05.941999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:57:05.948785 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cc1c943-dba2-4ffd-888d-25b75bbd0be2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:05.949225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6cc1c943-dba2-4ffd-888d-25b75bbd0be2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:05.978042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6cc1c943-dba2-4ffd-888d-25b75bbd0be2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Going to try to stop instance {{(pid=126071) force_stop /opt/stack/nova/nova/compute/api.py:2753}} Jul 28 04:57:06.021966 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6cc1c943-dba2-4ffd-888d-25b75bbd0be2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a/action" status: 202 len: 0 microversion: 2.1 time: 0.088657 Jul 28 04:57:06.023319 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5165/7615] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:57:05 2022] POST /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:57:06.036858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3b02e38e-c387-471b-8c3f-2b67638bf14e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:06.036858 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3b02e38e-c387-471b-8c3f-2b67638bf14e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:06.041667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b02e38e-c387-471b-8c3f-2b67638bf14e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:06.042190 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b02e38e-c387-471b-8c3f-2b67638bf14e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:06.043321 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b02e38e-c387-471b-8c3f-2b67638bf14e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:06.044270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3b02e38e-c387-471b-8c3f-2b67638bf14e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:06.199795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3b02e38e-c387-471b-8c3f-2b67638bf14e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:06.208115 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3b02e38e-c387-471b-8c3f-2b67638bf14e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1691 microversion: 2.1 time: 0.179507 Jul 28 04:57:06.208736 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5166/7616] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:06 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:57:07.233931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-28b3654d-d0fa-4858-ba1e-fc730d6a89c2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:07.234643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-28b3654d-d0fa-4858-ba1e-fc730d6a89c2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:07.242077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28b3654d-d0fa-4858-ba1e-fc730d6a89c2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:07.242540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28b3654d-d0fa-4858-ba1e-fc730d6a89c2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:07.243352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28b3654d-d0fa-4858-ba1e-fc730d6a89c2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:07.243888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-28b3654d-d0fa-4858-ba1e-fc730d6a89c2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:07.395509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-28b3654d-d0fa-4858-ba1e-fc730d6a89c2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:07.404220 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-28b3654d-d0fa-4858-ba1e-fc730d6a89c2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1691 microversion: 2.1 time: 0.174306 Jul 28 04:57:07.404835 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5167/7617] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:07 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:57:08.428650 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c016c72-e18e-4f70-b11b-5cd0b74e23a4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:08.430100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c016c72-e18e-4f70-b11b-5cd0b74e23a4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:08.436462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c016c72-e18e-4f70-b11b-5cd0b74e23a4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:08.437010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c016c72-e18e-4f70-b11b-5cd0b74e23a4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:08.437941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c016c72-e18e-4f70-b11b-5cd0b74e23a4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:08.438345 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c016c72-e18e-4f70-b11b-5cd0b74e23a4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:08.584215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c016c72-e18e-4f70-b11b-5cd0b74e23a4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:08.593197 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c016c72-e18e-4f70-b11b-5cd0b74e23a4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1691 microversion: 2.1 time: 0.169667 Jul 28 04:57:08.593904 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5168/7618] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:08 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:57:09.619515 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-61e457f0-8ee5-4756-beda-d7afd269ff80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:09.620136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61e457f0-8ee5-4756-beda-d7afd269ff80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:09.627637 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61e457f0-8ee5-4756-beda-d7afd269ff80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:09.628095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61e457f0-8ee5-4756-beda-d7afd269ff80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:09.628911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61e457f0-8ee5-4756-beda-d7afd269ff80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:09.629362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61e457f0-8ee5-4756-beda-d7afd269ff80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:09.775986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-61e457f0-8ee5-4756-beda-d7afd269ff80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:09.784299 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-61e457f0-8ee5-4756-beda-d7afd269ff80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1691 microversion: 2.1 time: 0.169414 Jul 28 04:57:09.784914 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5169/7619] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:09 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:57:10.810871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4e86432a-c9db-4845-9217-123f2842b840 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:10.811938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4e86432a-c9db-4845-9217-123f2842b840 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:10.822708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e86432a-c9db-4845-9217-123f2842b840 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:10.823139 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e86432a-c9db-4845-9217-123f2842b840 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:10.823960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e86432a-c9db-4845-9217-123f2842b840 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:10.824444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4e86432a-c9db-4845-9217-123f2842b840 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:10.963472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4e86432a-c9db-4845-9217-123f2842b840 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:10.971997 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4e86432a-c9db-4845-9217-123f2842b840 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1691 microversion: 2.1 time: 0.168436 Jul 28 04:57:10.972612 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5170/7620] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:10 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:57:11.996733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e22a987e-2da5-4da0-b9f0-1bd7245a4a38 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:11.997394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e22a987e-2da5-4da0-b9f0-1bd7245a4a38 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:12.004783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e22a987e-2da5-4da0-b9f0-1bd7245a4a38 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:12.005247 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e22a987e-2da5-4da0-b9f0-1bd7245a4a38 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:12.006029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e22a987e-2da5-4da0-b9f0-1bd7245a4a38 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:12.006477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e22a987e-2da5-4da0-b9f0-1bd7245a4a38 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:12.148072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e22a987e-2da5-4da0-b9f0-1bd7245a4a38 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:12.156242 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e22a987e-2da5-4da0-b9f0-1bd7245a4a38 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1691 microversion: 2.1 time: 0.163666 Jul 28 04:57:12.156858 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5171/7621] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:11 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:57:13.178717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8a527da6-90b1-4323-837a-f1cb64b30fa4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:13.179519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8a527da6-90b1-4323-837a-f1cb64b30fa4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:13.186609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a527da6-90b1-4323-837a-f1cb64b30fa4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:13.187085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a527da6-90b1-4323-837a-f1cb64b30fa4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:13.187866 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a527da6-90b1-4323-837a-f1cb64b30fa4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:13.188315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8a527da6-90b1-4323-837a-f1cb64b30fa4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:13.332670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8a527da6-90b1-4323-837a-f1cb64b30fa4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:13.343427 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8a527da6-90b1-4323-837a-f1cb64b30fa4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1691 microversion: 2.1 time: 0.168936 Jul 28 04:57:13.344516 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5172/7622] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:13 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:57:14.375294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3e9f81da-4e85-4a2a-9bcd-ed0170f135fd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:14.376323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3e9f81da-4e85-4a2a-9bcd-ed0170f135fd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:14.387924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e9f81da-4e85-4a2a-9bcd-ed0170f135fd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:14.388399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e9f81da-4e85-4a2a-9bcd-ed0170f135fd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:14.389220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e9f81da-4e85-4a2a-9bcd-ed0170f135fd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:14.389677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3e9f81da-4e85-4a2a-9bcd-ed0170f135fd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:14.535403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3e9f81da-4e85-4a2a-9bcd-ed0170f135fd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:14.543776 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3e9f81da-4e85-4a2a-9bcd-ed0170f135fd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1691 microversion: 2.1 time: 0.175474 Jul 28 04:57:14.544404 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5173/7623] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:14 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:57:15.569817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c4bfb0cb-a691-4d02-b6b6-1573d1132cbd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:15.570881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c4bfb0cb-a691-4d02-b6b6-1573d1132cbd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:15.582776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4bfb0cb-a691-4d02-b6b6-1573d1132cbd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:15.583544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4bfb0cb-a691-4d02-b6b6-1573d1132cbd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:15.584871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4bfb0cb-a691-4d02-b6b6-1573d1132cbd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:15.585625 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c4bfb0cb-a691-4d02-b6b6-1573d1132cbd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:15.732056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c4bfb0cb-a691-4d02-b6b6-1573d1132cbd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:15.744779 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c4bfb0cb-a691-4d02-b6b6-1573d1132cbd tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1691 microversion: 2.1 time: 0.181375 Jul 28 04:57:15.745463 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5174/7624] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:15 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:57:16.778657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d155a162-0ca9-469b-bc86-0f6349760713 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:16.779665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d155a162-0ca9-469b-bc86-0f6349760713 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:16.791310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d155a162-0ca9-469b-bc86-0f6349760713 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:16.792057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d155a162-0ca9-469b-bc86-0f6349760713 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:16.793382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d155a162-0ca9-469b-bc86-0f6349760713 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:16.794004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d155a162-0ca9-469b-bc86-0f6349760713 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:16.958458 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d155a162-0ca9-469b-bc86-0f6349760713 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:16.970406 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d155a162-0ca9-469b-bc86-0f6349760713 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1668 microversion: 2.1 time: 0.198245 Jul 28 04:57:16.971260 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5175/7625] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:16 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1668 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:57:18.090679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f5ce3357-92a8-4a54-a49e-ec4f806ac5cf tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:57:18.093343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f5ce3357-92a8-4a54-a49e-ec4f806ac5cf tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:18.101717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5ce3357-92a8-4a54-a49e-ec4f806ac5cf tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:18.102270 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5ce3357-92a8-4a54-a49e-ec4f806ac5cf tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:18.103074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5ce3357-92a8-4a54-a49e-ec4f806ac5cf tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:18.103654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5ce3357-92a8-4a54-a49e-ec4f806ac5cf tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:18.167404 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f5ce3357-92a8-4a54-a49e-ec4f806ac5cf tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a/action" status: 200 len: 38357 microversion: 2.1 time: 0.081950 Jul 28 04:57:18.168459 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5176/7626] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:57:18 2022] POST /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a/action => generated 38357 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:57:18.181114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a4b8edeb-8453-4436-aefb-b6e364ce686a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:57:18.189098 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4b8edeb-8453-4436-aefb-b6e364ce686a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:18.189569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a4b8edeb-8453-4436-aefb-b6e364ce686a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:18.213942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a4b8edeb-8453-4436-aefb-b6e364ce686a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Going to try to start instance {{(pid=126071) start /opt/stack/nova/nova/compute/api.py:2776}} Jul 28 04:57:18.263613 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a4b8edeb-8453-4436-aefb-b6e364ce686a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a/action" status: 202 len: 0 microversion: 2.1 time: 0.086307 Jul 28 04:57:18.264236 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5177/7627] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:57:18 2022] POST /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:57:18.276850 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d4826c14-0ce6-446b-b565-708000131257 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:18.278080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d4826c14-0ce6-446b-b565-708000131257 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:18.289299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4826c14-0ce6-446b-b565-708000131257 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:18.290185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4826c14-0ce6-446b-b565-708000131257 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:18.291516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4826c14-0ce6-446b-b565-708000131257 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:18.292388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d4826c14-0ce6-446b-b565-708000131257 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:18.435606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d4826c14-0ce6-446b-b565-708000131257 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:18.445637 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d4826c14-0ce6-446b-b565-708000131257 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1677 microversion: 2.1 time: 0.175442 Jul 28 04:57:18.446217 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5178/7628] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:18 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:57:19.467696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca72ec83-b846-4858-a45c-7736c5cccff6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:19.468432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca72ec83-b846-4858-a45c-7736c5cccff6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:19.476915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca72ec83-b846-4858-a45c-7736c5cccff6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:19.477384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca72ec83-b846-4858-a45c-7736c5cccff6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:19.478176 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca72ec83-b846-4858-a45c-7736c5cccff6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:19.478623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca72ec83-b846-4858-a45c-7736c5cccff6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:19.619210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca72ec83-b846-4858-a45c-7736c5cccff6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:19.622863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:57:19.629836 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca72ec83-b846-4858-a45c-7736c5cccff6 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1677 microversion: 2.1 time: 0.166269 Jul 28 04:57:19.630741 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5179/7629] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:19 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:57:20.652479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fd68617a-a4ca-4649-939a-d72a9a5f24f4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:20.653201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fd68617a-a4ca-4649-939a-d72a9a5f24f4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:20.660631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd68617a-a4ca-4649-939a-d72a9a5f24f4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:20.661069 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd68617a-a4ca-4649-939a-d72a9a5f24f4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:20.661862 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd68617a-a4ca-4649-939a-d72a9a5f24f4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:20.662315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd68617a-a4ca-4649-939a-d72a9a5f24f4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:20.800085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fd68617a-a4ca-4649-939a-d72a9a5f24f4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:20.809370 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fd68617a-a4ca-4649-939a-d72a9a5f24f4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1681 microversion: 2.1 time: 0.161328 Jul 28 04:57:20.809962 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5180/7630] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:20 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:57:45.017959 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8494624d-9007-422d-848b-866559a3ce9c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:57:45.020294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8494624d-9007-422d-848b-866559a3ce9c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:45.023101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=32 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:57:45.023781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:57:45.029705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8494624d-9007-422d-848b-866559a3ce9c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:45.030171 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8494624d-9007-422d-848b-866559a3ce9c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:45.030975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8494624d-9007-422d-848b-866559a3ce9c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:45.031462 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8494624d-9007-422d-848b-866559a3ce9c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:45.117496 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8494624d-9007-422d-848b-866559a3ce9c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a/action" status: 200 len: 62873 microversion: 2.1 time: 0.103685 Jul 28 04:57:45.118185 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5181/7631] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:57:45 2022] POST /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a/action => generated 62873 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:57:52.505222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bd6a4877-2796-4d6b-910b-6e650cb4e5f3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:52.505925 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bd6a4877-2796-4d6b-910b-6e650cb4e5f3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:52.515436 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd6a4877-2796-4d6b-910b-6e650cb4e5f3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:52.516026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd6a4877-2796-4d6b-910b-6e650cb4e5f3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:52.516842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd6a4877-2796-4d6b-910b-6e650cb4e5f3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:52.517307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bd6a4877-2796-4d6b-910b-6e650cb4e5f3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:52.544473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bd6a4877-2796-4d6b-910b-6e650cb4e5f3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:57:52.631081 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bd6a4877-2796-4d6b-910b-6e650cb4e5f3 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 204 len: 0 microversion: 2.1 time: 0.129928 Jul 28 04:57:52.633103 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5182/7632] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:57:52 2022] DELETE /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:57:52.646262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0f4ec394-23b2-437c-aac5-04f30fc60fab req-da9b283a-9ed3-4a5b-a96c-fc33b5569c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c551129-1d23-4825-9f94-3073b11c539a", "tag": "c30ad264-95c9-4d75-8305-8aa5975fca7e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:57:52.660413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0f4ec394-23b2-437c-aac5-04f30fc60fab req-da9b283a-9ed3-4a5b-a96c-fc33b5569c11 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:52.660894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0f4ec394-23b2-437c-aac5-04f30fc60fab req-da9b283a-9ed3-4a5b-a96c-fc33b5569c11 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:52.674433 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0f4ec394-23b2-437c-aac5-04f30fc60fab req-da9b283a-9ed3-4a5b-a96c-fc33b5569c11 service nova] Creating event network-changed:c30ad264-95c9-4d75-8305-8aa5975fca7e for instance 9c551129-1d23-4825-9f94-3073b11c539a on n-h2-826756-3 Jul 28 04:57:52.679927 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0f4ec394-23b2-437c-aac5-04f30fc60fab req-da9b283a-9ed3-4a5b-a96c-fc33b5569c11 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045023 Jul 28 04:57:52.680585 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5183/7633] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:57:52.686339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-89eb1175-2e34-4602-9c9a-f08f55615ac8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:52.687089 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-89eb1175-2e34-4602-9c9a-f08f55615ac8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:52.693874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89eb1175-2e34-4602-9c9a-f08f55615ac8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:52.694472 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89eb1175-2e34-4602-9c9a-f08f55615ac8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:52.695278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89eb1175-2e34-4602-9c9a-f08f55615ac8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:52.695750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-89eb1175-2e34-4602-9c9a-f08f55615ac8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:52.852048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-89eb1175-2e34-4602-9c9a-f08f55615ac8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:52.862703 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-89eb1175-2e34-4602-9c9a-f08f55615ac8 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1687 microversion: 2.1 time: 0.180757 Jul 28 04:57:52.863320 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5184/7634] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:52 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:57:53.886960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2b20c23-8312-46c1-a7df-8a7b02c05ea5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:53.887665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d2b20c23-8312-46c1-a7df-8a7b02c05ea5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:53.895248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2b20c23-8312-46c1-a7df-8a7b02c05ea5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:53.895706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2b20c23-8312-46c1-a7df-8a7b02c05ea5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:53.896531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2b20c23-8312-46c1-a7df-8a7b02c05ea5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:53.896977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2b20c23-8312-46c1-a7df-8a7b02c05ea5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:54.039744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d2b20c23-8312-46c1-a7df-8a7b02c05ea5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:54.048480 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d2b20c23-8312-46c1-a7df-8a7b02c05ea5 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1687 microversion: 2.1 time: 0.165529 Jul 28 04:57:54.049086 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5185/7635] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:53 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:57:55.071537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b83cb121-61de-40cb-b465-0b1aebfe51da tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:55.072274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b83cb121-61de-40cb-b465-0b1aebfe51da tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:55.080180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b83cb121-61de-40cb-b465-0b1aebfe51da tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:55.080842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b83cb121-61de-40cb-b465-0b1aebfe51da tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:55.082825 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b83cb121-61de-40cb-b465-0b1aebfe51da tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:55.083477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b83cb121-61de-40cb-b465-0b1aebfe51da tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:55.164808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b83cb121-61de-40cb-b465-0b1aebfe51da tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:57:55.173786 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b83cb121-61de-40cb-b465-0b1aebfe51da tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 200 len: 1501 microversion: 2.1 time: 0.107483 Jul 28 04:57:55.183341 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5186/7636] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:55 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 1501 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:57:55.220621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-fdd8dbf9-8e38-4e57-9496-513eb5cbaad4 req-e0a5be03-322f-43c3-b9aa-20ba1e38762d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c551129-1d23-4825-9f94-3073b11c539a", "name": "network-vif-deleted", "tag": "c30ad264-95c9-4d75-8305-8aa5975fca7e"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:57:55.230974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fdd8dbf9-8e38-4e57-9496-513eb5cbaad4 req-e0a5be03-322f-43c3-b9aa-20ba1e38762d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:55.231439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fdd8dbf9-8e38-4e57-9496-513eb5cbaad4 req-e0a5be03-322f-43c3-b9aa-20ba1e38762d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:55.244032 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-fdd8dbf9-8e38-4e57-9496-513eb5cbaad4 req-e0a5be03-322f-43c3-b9aa-20ba1e38762d service nova] Creating event network-vif-deleted:c30ad264-95c9-4d75-8305-8aa5975fca7e for instance 9c551129-1d23-4825-9f94-3073b11c539a on n-h2-826756-3 Jul 28 04:57:55.249246 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-fdd8dbf9-8e38-4e57-9496-513eb5cbaad4 req-e0a5be03-322f-43c3-b9aa-20ba1e38762d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032515 Jul 28 04:57:55.250060 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5187/7637] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:57:56.197554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d2034cb-437d-4e23-b477-b209ef369e5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:56.198255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8d2034cb-437d-4e23-b477-b209ef369e5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 9c551129-1d23-4825-9f94-3073b11c539a] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:57:56.207033 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d2034cb-437d-4e23-b477-b209ef369e5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:56.207501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d2034cb-437d-4e23-b477-b209ef369e5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:56.208317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d2034cb-437d-4e23-b477-b209ef369e5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:57:56.208802 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8d2034cb-437d-4e23-b477-b209ef369e5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:57:56.222666 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-8d2034cb-437d-4e23-b477-b209ef369e5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] HTTP exception thrown: Instance 9c551129-1d23-4825-9f94-3073b11c539a could not be found. Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d2034cb-437d-4e23-b477-b209ef369e5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Request method failure captured: Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a HTTP/1.1 Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hXEF03edD8kE1p9C-lBzba2-TBT-P09IEXC-KaYssZmf3zDYGobJ1wkNRNL0yuEJszcMprmJm_M5Y2l7km8k6DP4a2ZaJ05IvUPJ_-eo39mYWvdzzpHU8Ht9JZ0_fcQ0rXdTRHQbHxlOe45cP_XKau8t68GHv5oVuAYJ7pDwCW2vWs Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 8e18d061762841dab3882493fbb4f835 Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8e18d061762841dab3882493fbb4f835"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e18d061762841dab3882493fbb4f835"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8e18d061762841dab3882493fbb4f835"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e18d061762841dab3882493fbb4f835"}]}] Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 8e18d061762841dab3882493fbb4f835 Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestNetworkAdvancedServerOps-2112986599-project Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 3f0cd417487147bc9bc925fa0ad1f7a1 Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2112986599-project Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 9c551129-1d23-4825-9f94-3073b11c539a could not be found. Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9c551129-1d23-4825-9f94-3073b11c539a'} Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c551129-1d23-4825-9f94-3073b11c539a could not be found. Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c551129-1d23-4825-9f94-3073b11c539a could not be found. Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:57:56.224319 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:57:56.229388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:57:56.229388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:57:56.229388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:57:56.229388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:57:56.229388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:57:56.229388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:57:56.229388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c551129-1d23-4825-9f94-3073b11c539a could not be found. Jul 28 04:57:56.229388 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:57:56.229388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8d2034cb-437d-4e23-b477-b209ef369e5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Returning 404 to user: Instance 9c551129-1d23-4825-9f94-3073b11c539a could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:57:56.229388 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8d2034cb-437d-4e23-b477-b209ef369e5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a" status: 404 len: 111 microversion: 2.1 time: 0.033890 Jul 28 04:57:56.229388 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5188/7638] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:57:56 2022] GET /compute/v2.1/servers/9c551129-1d23-4825-9f94-3073b11c539a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:57:59.573950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-11d31d2f-31dc-40d9-b775-82c4d70ba41e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '.version_select at 0x7ffa6789daf0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:57:59.601600 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-11d31d2f-31dc-40d9-b775-82c4d70ba41e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-750689836" status: 202 len: 0 microversion: 2.1 time: 0.031545 Jul 28 04:57:59.606618 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5189/7639] 10.222.0.48 () {58 vars in 1281 bytes} [Thu Jul 28 04:57:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-750689836 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:57:59.635761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1c5b7d89-a291-4da8-8ecf-7c0ef63677fb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'create', calling method: .version_select at 0x7ffa674b8b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-463533814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9EZ+1o8h9Ygu0LZSSEPVIgOj8S+JxRRifN5lcyFfIRhFPXlCNIj4JuUs9zA0rGNdE+SLzQDEcZKLRDDaKX+WVEl5Wq3TtNVkEifNyOSEJBU4KsjR0vxb20qmquaw0Ing=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:57:59.653346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1c5b7d89-a291-4da8-8ecf-7c0ef63677fb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for project 8e18d061762841dab3882493fbb4f835. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:57:59.659437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-1c5b7d89-a291-4da8-8ecf-7c0ef63677fb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for user 3f0cd417487147bc9bc925fa0ad1f7a1 and project 8e18d061762841dab3882493fbb4f835. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:57:59.685601 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1c5b7d89-a291-4da8-8ecf-7c0ef63677fb tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054049 Jul 28 04:57:59.686340 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5190/7640] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:57:59 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:58:05.369933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-760591517", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "networks": [{"uuid": "2b4cdf0d-4055-4200-8f58-ec8c34a5fe0d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-463533814", "security_groups": [{"name": "tempest-secgroup-smoke-957161762"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:58:05.494927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] validate_networks() for [('2b4cdf0d-4055-4200-8f58-ec8c34a5fe0d', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:58:05.920753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:58:05.921484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:58:05.921964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:58:05.922350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:58:05.922968 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:58:05.933523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:05.933999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:05.934796 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:05.935241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:05.952697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for project 8e18d061762841dab3882493fbb4f835. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:58:05.958252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Getting quotas for user 3f0cd417487147bc9bc925fa0ad1f7a1 and project 8e18d061762841dab3882493fbb4f835. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:58:05.971372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:58:05.973760 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:58:06.024164 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d8fe15fc-c921-4c2e-90df-4436bd5de6e4 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.657345 Jul 28 04:58:06.025112 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5191/7641] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:58:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:58:06.039108 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6812678e-f2a7-4dfe-843a-ddd9dce61d7b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:06.039784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6812678e-f2a7-4dfe-843a-ddd9dce61d7b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:06.101444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6812678e-f2a7-4dfe-843a-ddd9dce61d7b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:06.109396 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6812678e-f2a7-4dfe-843a-ddd9dce61d7b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1265 microversion: 2.1 time: 0.076928 Jul 28 04:58:06.110585 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5192/7642] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:06 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1265 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:58:07.131339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-04041bdd-e2a8-408e-9bd3-cbb4e4b1e90d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:07.132103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-04041bdd-e2a8-408e-9bd3-cbb4e4b1e90d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:07.140441 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04041bdd-e2a8-408e-9bd3-cbb4e4b1e90d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:07.140857 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04041bdd-e2a8-408e-9bd3-cbb4e4b1e90d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:07.141676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04041bdd-e2a8-408e-9bd3-cbb4e4b1e90d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:07.142310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-04041bdd-e2a8-408e-9bd3-cbb4e4b1e90d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:07.222938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-04041bdd-e2a8-408e-9bd3-cbb4e4b1e90d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:07.237253 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-04041bdd-e2a8-408e-9bd3-cbb4e4b1e90d tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1325 microversion: 2.1 time: 0.105603 Jul 28 04:58:07.239285 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5193/7643] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:07 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1325 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:58:08.260941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f4efe911-d82e-4e7d-a3ab-31eef375b213 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:08.261782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f4efe911-d82e-4e7d-a3ab-31eef375b213 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:08.269497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4efe911-d82e-4e7d-a3ab-31eef375b213 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:08.270043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4efe911-d82e-4e7d-a3ab-31eef375b213 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:08.271075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4efe911-d82e-4e7d-a3ab-31eef375b213 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:08.271555 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f4efe911-d82e-4e7d-a3ab-31eef375b213 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:08.414975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f4efe911-d82e-4e7d-a3ab-31eef375b213 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:08.423097 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f4efe911-d82e-4e7d-a3ab-31eef375b213 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1390 microversion: 2.1 time: 0.167480 Jul 28 04:58:08.424110 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5194/7644] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:08 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:58:08.740394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-97f7da8a-461e-4d5f-8a93-83e7e4548f1f req-0db7da35-d0ca-46e0-8fe8-a15ce76f02d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62fd4e86-feb8-42e1-ac48-fcdf1d80b70d", "tag": "a2387b3d-8a71-4a20-acea-fad9e3fe6f39"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:58:08.756654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-97f7da8a-461e-4d5f-8a93-83e7e4548f1f req-0db7da35-d0ca-46e0-8fe8-a15ce76f02d9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:08.757399 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-97f7da8a-461e-4d5f-8a93-83e7e4548f1f req-0db7da35-d0ca-46e0-8fe8-a15ce76f02d9 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:08.779920 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-97f7da8a-461e-4d5f-8a93-83e7e4548f1f req-0db7da35-d0ca-46e0-8fe8-a15ce76f02d9 service nova] Creating event network-changed:a2387b3d-8a71-4a20-acea-fad9e3fe6f39 for instance 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d on n-h2-826756-3 Jul 28 04:58:08.790773 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-97f7da8a-461e-4d5f-8a93-83e7e4548f1f req-0db7da35-d0ca-46e0-8fe8-a15ce76f02d9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061248 Jul 28 04:58:08.791561 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5195/7645] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:58:09.452166 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e378320f-5960-4d21-90cf-1b92fa57dc33 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:09.453532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e378320f-5960-4d21-90cf-1b92fa57dc33 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:09.464392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e378320f-5960-4d21-90cf-1b92fa57dc33 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:09.465177 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e378320f-5960-4d21-90cf-1b92fa57dc33 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:09.466483 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e378320f-5960-4d21-90cf-1b92fa57dc33 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:09.467233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e378320f-5960-4d21-90cf-1b92fa57dc33 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:09.620790 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e378320f-5960-4d21-90cf-1b92fa57dc33 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:09.629953 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e378320f-5960-4d21-90cf-1b92fa57dc33 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1390 microversion: 2.1 time: 0.186971 Jul 28 04:58:09.630564 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5196/7646] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:09 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1390 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:58:10.652372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d96c29ae-1971-4677-bb35-207ce365e349 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:10.653011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d96c29ae-1971-4677-bb35-207ce365e349 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:10.660646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d96c29ae-1971-4677-bb35-207ce365e349 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:10.661116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d96c29ae-1971-4677-bb35-207ce365e349 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:10.661915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d96c29ae-1971-4677-bb35-207ce365e349 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:10.662372 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d96c29ae-1971-4677-bb35-207ce365e349 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:10.804927 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d96c29ae-1971-4677-bb35-207ce365e349 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:10.815863 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d96c29ae-1971-4677-bb35-207ce365e349 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1390 microversion: 2.1 time: 0.167541 Jul 28 04:58:10.816449 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5197/7647] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:10 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:58:11.837481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eb8a9396-8c25-4823-9cab-cda00a8d963e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:11.838216 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eb8a9396-8c25-4823-9cab-cda00a8d963e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:11.847237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb8a9396-8c25-4823-9cab-cda00a8d963e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:11.847714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb8a9396-8c25-4823-9cab-cda00a8d963e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:11.848540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb8a9396-8c25-4823-9cab-cda00a8d963e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:11.849002 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eb8a9396-8c25-4823-9cab-cda00a8d963e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:11.998499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-eb8a9396-8c25-4823-9cab-cda00a8d963e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:12.006592 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eb8a9396-8c25-4823-9cab-cda00a8d963e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1390 microversion: 2.1 time: 0.173165 Jul 28 04:58:12.007149 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5198/7648] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:11 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1390 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:58:13.027659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1b406272-50f7-419e-b706-fe34b4e33b07 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:13.028314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1b406272-50f7-419e-b706-fe34b4e33b07 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:13.035659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b406272-50f7-419e-b706-fe34b4e33b07 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:13.036121 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b406272-50f7-419e-b706-fe34b4e33b07 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:13.036961 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b406272-50f7-419e-b706-fe34b4e33b07 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:13.037431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1b406272-50f7-419e-b706-fe34b4e33b07 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:13.172706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1b406272-50f7-419e-b706-fe34b4e33b07 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:13.181160 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1b406272-50f7-419e-b706-fe34b4e33b07 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1390 microversion: 2.1 time: 0.157399 Jul 28 04:58:13.181719 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5199/7649] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:13 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:58:14.201963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fa3728fd-6fb4-49bf-856e-3a05a1f1b15e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:14.202638 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fa3728fd-6fb4-49bf-856e-3a05a1f1b15e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:14.210470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa3728fd-6fb4-49bf-856e-3a05a1f1b15e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:14.210963 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa3728fd-6fb4-49bf-856e-3a05a1f1b15e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:14.211753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa3728fd-6fb4-49bf-856e-3a05a1f1b15e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:14.212210 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fa3728fd-6fb4-49bf-856e-3a05a1f1b15e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:14.362136 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fa3728fd-6fb4-49bf-856e-3a05a1f1b15e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:14.370080 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fa3728fd-6fb4-49bf-856e-3a05a1f1b15e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1390 microversion: 2.1 time: 0.172210 Jul 28 04:58:14.370667 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5200/7650] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:14 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:58:15.239469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a306ec9f-9ad5-480a-8875-11df8bfc6040 req-3e46cd14-ee4a-4093-93e6-6d5c6aec4859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62fd4e86-feb8-42e1-ac48-fcdf1d80b70d", "name": "network-vif-plugged", "status": "completed", "tag": "a2387b3d-8a71-4a20-acea-fad9e3fe6f39"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:58:15.244792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:58:15.251807 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a306ec9f-9ad5-480a-8875-11df8bfc6040 req-3e46cd14-ee4a-4093-93e6-6d5c6aec4859 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:15.252263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a306ec9f-9ad5-480a-8875-11df8bfc6040 req-3e46cd14-ee4a-4093-93e6-6d5c6aec4859 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:15.255603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:58:15.265887 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-a306ec9f-9ad5-480a-8875-11df8bfc6040 req-3e46cd14-ee4a-4093-93e6-6d5c6aec4859 service nova] Creating event network-vif-plugged:a2387b3d-8a71-4a20-acea-fad9e3fe6f39 for instance 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d on n-h2-826756-3 Jul 28 04:58:15.271308 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a306ec9f-9ad5-480a-8875-11df8bfc6040 req-3e46cd14-ee4a-4093-93e6-6d5c6aec4859 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095071 Jul 28 04:58:15.271959 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5201/7651] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:58:15.392549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f308c0e3-66cd-464a-8af2-fbc7d05c7f5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:15.393254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f308c0e3-66cd-464a-8af2-fbc7d05c7f5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:15.401251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f308c0e3-66cd-464a-8af2-fbc7d05c7f5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:15.401710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f308c0e3-66cd-464a-8af2-fbc7d05c7f5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:15.402505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f308c0e3-66cd-464a-8af2-fbc7d05c7f5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:15.402948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f308c0e3-66cd-464a-8af2-fbc7d05c7f5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:15.554812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f308c0e3-66cd-464a-8af2-fbc7d05c7f5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:15.566764 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f308c0e3-66cd-464a-8af2-fbc7d05c7f5e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1390 microversion: 2.1 time: 0.179122 Jul 28 04:58:15.567349 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5202/7652] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:15 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1390 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:58:16.590699 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0afe013a-cb53-4c38-9c81-0583f539941b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:16.591419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0afe013a-cb53-4c38-9c81-0583f539941b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:16.593389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:58:16.594319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:58:16.601747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0afe013a-cb53-4c38-9c81-0583f539941b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:16.602200 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0afe013a-cb53-4c38-9c81-0583f539941b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:16.602989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0afe013a-cb53-4c38-9c81-0583f539941b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:16.603444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0afe013a-cb53-4c38-9c81-0583f539941b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:16.750521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0afe013a-cb53-4c38-9c81-0583f539941b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:16.758710 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0afe013a-cb53-4c38-9c81-0583f539941b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1390 microversion: 2.1 time: 0.172115 Jul 28 04:58:16.759317 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5203/7653] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:16 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:58:17.780541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8473efe1-ee93-4ba4-b910-a177c06b8bce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:17.781205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8473efe1-ee93-4ba4-b910-a177c06b8bce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:17.788732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8473efe1-ee93-4ba4-b910-a177c06b8bce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:17.789196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8473efe1-ee93-4ba4-b910-a177c06b8bce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:17.789977 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8473efe1-ee93-4ba4-b910-a177c06b8bce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:17.790428 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8473efe1-ee93-4ba4-b910-a177c06b8bce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:17.928048 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8473efe1-ee93-4ba4-b910-a177c06b8bce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:17.936386 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8473efe1-ee93-4ba4-b910-a177c06b8bce tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1562 microversion: 2.1 time: 0.159911 Jul 28 04:58:17.937109 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5204/7654] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:17 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:58:17.956823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2731c227-dbe7-4f05-901d-020ebbd09786 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:17.957442 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2731c227-dbe7-4f05-901d-020ebbd09786 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:17.963690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2731c227-dbe7-4f05-901d-020ebbd09786 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:17.964159 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2731c227-dbe7-4f05-901d-020ebbd09786 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:17.964973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2731c227-dbe7-4f05-901d-020ebbd09786 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:17.965426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2731c227-dbe7-4f05-901d-020ebbd09786 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:18.109392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2731c227-dbe7-4f05-901d-020ebbd09786 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:18.118811 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2731c227-dbe7-4f05-901d-020ebbd09786 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1562 microversion: 2.1 time: 0.165727 Jul 28 04:58:18.119488 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5205/7655] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:17 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:58:20.073975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a06bee4d-badc-4937-81d8-923ce163a4c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:20.074596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a06bee4d-badc-4937-81d8-923ce163a4c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:20.081834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a06bee4d-badc-4937-81d8-923ce163a4c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:20.082301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a06bee4d-badc-4937-81d8-923ce163a4c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:20.083085 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a06bee4d-badc-4937-81d8-923ce163a4c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:20.083505 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a06bee4d-badc-4937-81d8-923ce163a4c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:20.218294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a06bee4d-badc-4937-81d8-923ce163a4c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:20.226960 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a06bee4d-badc-4937-81d8-923ce163a4c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1562 microversion: 2.1 time: 0.157648 Jul 28 04:58:20.227587 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5206/7656] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:20 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:58:20.232235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-de822225-f932-41c2-a8d0-a27ca93a5c40 req-8cd60814-6e21-4532-91d8-9e1f2e86745e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62fd4e86-feb8-42e1-ac48-fcdf1d80b70d", "tag": "a2387b3d-8a71-4a20-acea-fad9e3fe6f39"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:58:20.242264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-de822225-f932-41c2-a8d0-a27ca93a5c40 req-8cd60814-6e21-4532-91d8-9e1f2e86745e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:20.242727 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-de822225-f932-41c2-a8d0-a27ca93a5c40 req-8cd60814-6e21-4532-91d8-9e1f2e86745e service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:20.254502 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-de822225-f932-41c2-a8d0-a27ca93a5c40 req-8cd60814-6e21-4532-91d8-9e1f2e86745e service nova] Creating event network-changed:a2387b3d-8a71-4a20-acea-fad9e3fe6f39 for instance 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d on n-h2-826756-3 Jul 28 04:58:20.262887 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-de822225-f932-41c2-a8d0-a27ca93a5c40 req-8cd60814-6e21-4532-91d8-9e1f2e86745e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030921 Jul 28 04:58:20.262887 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5207/7657] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:58:25.890424 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:58:25.891048 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 04:58:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 04:58:43.489278 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=13 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:58:43.490123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=33 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:58:43.495149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-501e9371-9878-4db4-a0bd-6c5c5205e561 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:58:43.497578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-501e9371-9878-4db4-a0bd-6c5c5205e561 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:43.505603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-501e9371-9878-4db4-a0bd-6c5c5205e561 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:43.506072 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-501e9371-9878-4db4-a0bd-6c5c5205e561 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:43.506941 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-501e9371-9878-4db4-a0bd-6c5c5205e561 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:43.507435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-501e9371-9878-4db4-a0bd-6c5c5205e561 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:43.578408 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-501e9371-9878-4db4-a0bd-6c5c5205e561 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d/action" status: 200 len: 24569 microversion: 2.1 time: 0.092042 Jul 28 04:58:43.579090 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5208/7658] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:58:43 2022] POST /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d/action => generated 24569 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:58:54.723755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1a95211c-806f-4e54-b02e-ff78dd50a0ad tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:58:54.724983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1a95211c-806f-4e54-b02e-ff78dd50a0ad tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:54.728281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:58:54.728979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:58:54.735421 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a95211c-806f-4e54-b02e-ff78dd50a0ad tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:54.735906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a95211c-806f-4e54-b02e-ff78dd50a0ad tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:54.736725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a95211c-806f-4e54-b02e-ff78dd50a0ad tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:54.737179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1a95211c-806f-4e54-b02e-ff78dd50a0ad tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:54.776976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-1a95211c-806f-4e54-b02e-ff78dd50a0ad tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lazy-loading 'flavor' on Instance uuid 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:58:54.857905 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1a95211c-806f-4e54-b02e-ff78dd50a0ad tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d/action" status: 202 len: 0 microversion: 2.1 time: 0.138392 Jul 28 04:58:54.858710 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5209/7659] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:58:54 2022] POST /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:58:54.869481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8bc8220c-5d48-4140-acdb-312560682a86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:54.870201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8bc8220c-5d48-4140-acdb-312560682a86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:54.876906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bc8220c-5d48-4140-acdb-312560682a86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:54.877368 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bc8220c-5d48-4140-acdb-312560682a86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:54.878163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bc8220c-5d48-4140-acdb-312560682a86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:54.878619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8bc8220c-5d48-4140-acdb-312560682a86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:55.082666 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8bc8220c-5d48-4140-acdb-312560682a86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:55.094274 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8bc8220c-5d48-4140-acdb-312560682a86 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1688 microversion: 2.1 time: 0.229436 Jul 28 04:58:55.094930 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5210/7660] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:54 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1688 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:58:56.125056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4c544074-c547-469a-98b9-76ec05674d80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:56.125731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4c544074-c547-469a-98b9-76ec05674d80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:56.132749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c544074-c547-469a-98b9-76ec05674d80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:56.133208 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c544074-c547-469a-98b9-76ec05674d80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:56.133989 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c544074-c547-469a-98b9-76ec05674d80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:56.134437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4c544074-c547-469a-98b9-76ec05674d80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:56.294776 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4c544074-c547-469a-98b9-76ec05674d80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:56.303058 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4c544074-c547-469a-98b9-76ec05674d80 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1671 microversion: 2.1 time: 0.186251 Jul 28 04:58:56.303619 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5211/7661] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:56 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1671 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:58:57.404710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74845539-6377-4c7d-aa10-e536d04a5092 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:58:57.408179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74845539-6377-4c7d-aa10-e536d04a5092 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:57.419614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74845539-6377-4c7d-aa10-e536d04a5092 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:57.420082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74845539-6377-4c7d-aa10-e536d04a5092 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:57.420907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74845539-6377-4c7d-aa10-e536d04a5092 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:57.421361 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74845539-6377-4c7d-aa10-e536d04a5092 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:57.486458 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74845539-6377-4c7d-aa10-e536d04a5092 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d/action" status: 200 len: 38396 microversion: 2.1 time: 0.088475 Jul 28 04:58:57.487142 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5212/7662] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:58:57 2022] POST /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d/action => generated 38396 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:58:57.500964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8fd0df04-d716-46a1-9a14-fc3d3e68162b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:58:57.501601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8fd0df04-d716-46a1-9a14-fc3d3e68162b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:57.509204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fd0df04-d716-46a1-9a14-fc3d3e68162b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:57.509668 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fd0df04-d716-46a1-9a14-fc3d3e68162b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:57.510453 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fd0df04-d716-46a1-9a14-fc3d3e68162b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:57.510897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8fd0df04-d716-46a1-9a14-fc3d3e68162b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:57.589178 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8fd0df04-d716-46a1-9a14-fc3d3e68162b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d/action" status: 202 len: 0 microversion: 2.1 time: 0.093620 Jul 28 04:58:57.589834 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5213/7663] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:58:57 2022] POST /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:58:57.598781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b579eee6-82f1-447b-ae31-e8cea96a1d1b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:57.599486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b579eee6-82f1-447b-ae31-e8cea96a1d1b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:57.606375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b579eee6-82f1-447b-ae31-e8cea96a1d1b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:57.606945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b579eee6-82f1-447b-ae31-e8cea96a1d1b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:57.607975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b579eee6-82f1-447b-ae31-e8cea96a1d1b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:57.608457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b579eee6-82f1-447b-ae31-e8cea96a1d1b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:57.750795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b579eee6-82f1-447b-ae31-e8cea96a1d1b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:57.758966 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b579eee6-82f1-447b-ae31-e8cea96a1d1b tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1677 microversion: 2.1 time: 0.164343 Jul 28 04:58:57.763189 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5214/7664] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:57 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:58:58.783888 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f1dc2157-9882-4b0c-bac2-ede3003f3d06 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:58.784892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f1dc2157-9882-4b0c-bac2-ede3003f3d06 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:58.792047 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1dc2157-9882-4b0c-bac2-ede3003f3d06 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:58.792541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1dc2157-9882-4b0c-bac2-ede3003f3d06 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:58.793350 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1dc2157-9882-4b0c-bac2-ede3003f3d06 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:58.793873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1dc2157-9882-4b0c-bac2-ede3003f3d06 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:58.940336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f1dc2157-9882-4b0c-bac2-ede3003f3d06 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:58:58.949200 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f1dc2157-9882-4b0c-bac2-ede3003f3d06 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1677 microversion: 2.1 time: 0.171469 Jul 28 04:58:58.949823 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5215/7665] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:58 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:58:59.971984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47f542e5-cc86-403e-ab61-f2e750f976c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:58:59.972729 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-47f542e5-cc86-403e-ab61-f2e750f976c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:58:59.980475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47f542e5-cc86-403e-ab61-f2e750f976c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:59.981298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47f542e5-cc86-403e-ab61-f2e750f976c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:58:59.981964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47f542e5-cc86-403e-ab61-f2e750f976c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:58:59.982425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47f542e5-cc86-403e-ab61-f2e750f976c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:00.129232 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-47f542e5-cc86-403e-ab61-f2e750f976c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:00.138919 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-47f542e5-cc86-403e-ab61-f2e750f976c0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1680 microversion: 2.1 time: 0.171110 Jul 28 04:59:00.139484 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5216/7666] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:58:59 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:59:00.251723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-84720185-0dce-4e1c-9d7c-528e3ff92352 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:59:00.254123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-84720185-0dce-4e1c-9d7c-528e3ff92352 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:00.261071 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84720185-0dce-4e1c-9d7c-528e3ff92352 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:00.261496 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84720185-0dce-4e1c-9d7c-528e3ff92352 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:00.262431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84720185-0dce-4e1c-9d7c-528e3ff92352 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:00.262948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-84720185-0dce-4e1c-9d7c-528e3ff92352 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:00.326138 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-84720185-0dce-4e1c-9d7c-528e3ff92352 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "POST /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d/action" status: 200 len: 38396 microversion: 2.1 time: 0.080331 Jul 28 04:59:00.326832 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5217/7667] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 04:59:00 2022] POST /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d/action => generated 38396 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 04:59:01.712023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3c895168-6975-431f-9285-12fa8c8f326c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:01.712696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3c895168-6975-431f-9285-12fa8c8f326c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:01.721075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c895168-6975-431f-9285-12fa8c8f326c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:01.721649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c895168-6975-431f-9285-12fa8c8f326c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:01.722522 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c895168-6975-431f-9285-12fa8c8f326c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:01.723076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c895168-6975-431f-9285-12fa8c8f326c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:01.750795 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3c895168-6975-431f-9285-12fa8c8f326c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:59:01.839099 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3c895168-6975-431f-9285-12fa8c8f326c tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "DELETE /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 204 len: 0 microversion: 2.1 time: 0.131185 Jul 28 04:59:01.839610 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5218/7668] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 04:59:01 2022] DELETE /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:59:01.845294 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b3d35342-83fe-4b39-ada5-4b26217cb6c9 req-4e2a5edb-1d67-445c-ba43-2e5ac7b36964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62fd4e86-feb8-42e1-ac48-fcdf1d80b70d", "tag": "a2387b3d-8a71-4a20-acea-fad9e3fe6f39"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:59:01.855382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b3d35342-83fe-4b39-ada5-4b26217cb6c9 req-4e2a5edb-1d67-445c-ba43-2e5ac7b36964 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:01.855836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b3d35342-83fe-4b39-ada5-4b26217cb6c9 req-4e2a5edb-1d67-445c-ba43-2e5ac7b36964 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:01.868787 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b3d35342-83fe-4b39-ada5-4b26217cb6c9 req-4e2a5edb-1d67-445c-ba43-2e5ac7b36964 service nova] Creating event network-changed:a2387b3d-8a71-4a20-acea-fad9e3fe6f39 for instance 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d on n-h2-826756-3 Jul 28 04:59:01.874233 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b3d35342-83fe-4b39-ada5-4b26217cb6c9 req-4e2a5edb-1d67-445c-ba43-2e5ac7b36964 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033236 Jul 28 04:59:01.874898 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5219/7669] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:59:01.882263 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5755785e-c95f-4d6d-b1ee-dc13ec441f2a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:01.883140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5755785e-c95f-4d6d-b1ee-dc13ec441f2a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:01.890169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5755785e-c95f-4d6d-b1ee-dc13ec441f2a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:01.890628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5755785e-c95f-4d6d-b1ee-dc13ec441f2a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:01.891427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5755785e-c95f-4d6d-b1ee-dc13ec441f2a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:01.891883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5755785e-c95f-4d6d-b1ee-dc13ec441f2a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:02.046310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5755785e-c95f-4d6d-b1ee-dc13ec441f2a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:02.054879 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5755785e-c95f-4d6d-b1ee-dc13ec441f2a tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1686 microversion: 2.1 time: 0.178721 Jul 28 04:59:02.055639 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5220/7670] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:01 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:59:03.077851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-faf563ef-bcc8-4ba4-aac6-06e7397c460e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:03.078554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-faf563ef-bcc8-4ba4-aac6-06e7397c460e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:03.085861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faf563ef-bcc8-4ba4-aac6-06e7397c460e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:03.086351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faf563ef-bcc8-4ba4-aac6-06e7397c460e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:03.087130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faf563ef-bcc8-4ba4-aac6-06e7397c460e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:03.087589 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-faf563ef-bcc8-4ba4-aac6-06e7397c460e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:03.292094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-faf563ef-bcc8-4ba4-aac6-06e7397c460e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:03.301630 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-faf563ef-bcc8-4ba4-aac6-06e7397c460e tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1686 microversion: 2.1 time: 0.228485 Jul 28 04:59:03.302236 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5221/7671] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:03 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1686 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:59:04.323029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3a98d9e2-e24b-4823-98ab-1b794face8f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:04.323713 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3a98d9e2-e24b-4823-98ab-1b794face8f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:04.331934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a98d9e2-e24b-4823-98ab-1b794face8f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:04.332425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a98d9e2-e24b-4823-98ab-1b794face8f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:04.333228 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a98d9e2-e24b-4823-98ab-1b794face8f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:04.333679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3a98d9e2-e24b-4823-98ab-1b794face8f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:04.354552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:59:04.491000 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3a98d9e2-e24b-4823-98ab-1b794face8f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f0cd417487147bc9bc925fa0ad1f7a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e18d061762841dab3882493fbb4f835', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:04.499753 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3a98d9e2-e24b-4823-98ab-1b794face8f0 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 200 len: 1686 microversion: 2.1 time: 0.180793 Jul 28 04:59:04.500382 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5222/7672] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:04 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:59:04.505312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c4b13187-7a73-4c81-b8f6-8a21aaae1bc4 req-d5c999e9-1a25-4bb5-ba4b-e0aeac6dfa8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62fd4e86-feb8-42e1-ac48-fcdf1d80b70d", "name": "network-vif-deleted", "tag": "a2387b3d-8a71-4a20-acea-fad9e3fe6f39"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:59:04.515936 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c4b13187-7a73-4c81-b8f6-8a21aaae1bc4 req-d5c999e9-1a25-4bb5-ba4b-e0aeac6dfa8f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:04.516425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c4b13187-7a73-4c81-b8f6-8a21aaae1bc4 req-d5c999e9-1a25-4bb5-ba4b-e0aeac6dfa8f service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:04.528931 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c4b13187-7a73-4c81-b8f6-8a21aaae1bc4 req-d5c999e9-1a25-4bb5-ba4b-e0aeac6dfa8f service nova] Creating event network-vif-deleted:a2387b3d-8a71-4a20-acea-fad9e3fe6f39 for instance 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d on n-h2-826756-3 Jul 28 04:59:04.534417 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c4b13187-7a73-4c81-b8f6-8a21aaae1bc4 req-d5c999e9-1a25-4bb5-ba4b-e0aeac6dfa8f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032847 Jul 28 04:59:04.535099 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5223/7673] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:59:05.526742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06fa1e94-ce35-4298-aac6-9a5db5d078b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:05.527745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-06fa1e94-ce35-4298-aac6-9a5db5d078b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] [instance: 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:05.537951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06fa1e94-ce35-4298-aac6-9a5db5d078b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:05.538614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06fa1e94-ce35-4298-aac6-9a5db5d078b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:05.539841 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06fa1e94-ce35-4298-aac6-9a5db5d078b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:05.540582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-06fa1e94-ce35-4298-aac6-9a5db5d078b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:05.559139 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-06fa1e94-ce35-4298-aac6-9a5db5d078b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] HTTP exception thrown: Instance 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d could not be found. Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06fa1e94-ce35-4298-aac6-9a5db5d078b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Request method failure captured: Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d HTTP/1.1 Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hXEF03edD8kE1p9C-lBzba2-TBT-P09IEXC-KaYssZmf3zDYGobJ1wkNRNL0yuEJszcMprmJm_M5Y2l7km8k6DP4a2ZaJ05IvUPJ_-eo39mYWvdzzpHU8Ht9JZ0_fcQ0rXdTRHQbHxlOe45cP_XKau8t68GHv5oVuAYJ7pDwCW2vWs Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 8e18d061762841dab3882493fbb4f835 Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8e18d061762841dab3882493fbb4f835"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e18d061762841dab3882493fbb4f835"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8e18d061762841dab3882493fbb4f835"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8e18d061762841dab3882493fbb4f835"}]}] Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 8e18d061762841dab3882493fbb4f835 Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2112986599 Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestNetworkAdvancedServerOps-2112986599-project Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 3f0cd417487147bc9bc925fa0ad1f7a1 Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2112986599-project Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d could not be found. Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '62fd4e86-feb8-42e1-ac48-fcdf1d80b70d'} Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d could not be found. Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d could not be found. Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:59:05.561684 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:59:05.566149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:59:05.566149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:59:05.566149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:59:05.566149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:59:05.566149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:59:05.566149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:59:05.566149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d could not be found. Jul 28 04:59:05.566149 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 04:59:05.566149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-06fa1e94-ce35-4298-aac6-9a5db5d078b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Returning 404 to user: Instance 62fd4e86-feb8-42e1-ac48-fcdf1d80b70d could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:59:05.566149 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-06fa1e94-ce35-4298-aac6-9a5db5d078b2 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d" status: 404 len: 111 microversion: 2.1 time: 0.044870 Jul 28 04:59:05.566149 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5224/7674] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:05 2022] GET /compute/v2.1/servers/62fd4e86-feb8-42e1-ac48-fcdf1d80b70d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:59:08.649880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e37870f4-be39-4d28-8e29-58c1921e4c74 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] Calling method '.version_select at 0x7ffa6454e430>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:08.674890 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e37870f4-be39-4d28-8e29-58c1921e4c74 tempest-TestNetworkAdvancedServerOps-2112986599 tempest-TestNetworkAdvancedServerOps-2112986599-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-463533814" status: 202 len: 0 microversion: 2.1 time: 0.028957 Jul 28 04:59:08.675837 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5225/7675] 10.222.0.48 () {58 vars in 1281 bytes} [Thu Jul 28 04:59:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-463533814 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:59:19.843541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=6 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:59:19.844285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:59:20.048289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4fdac539-2649-4108-a85e-4720964baa9a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Action: 'create', calling method: .version_select at 0x7ffa79997670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1752476361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTFvLHiNbDxIQNHKqOcOGGsUrbXGNzSwmze0gP44ZhRtutKgUtpg106NM5Xs++1zwxsng2cWSOIn2RTUyqsy6C6mbcs2BhEw4vw+jBW92Up8sX+hrerhncQFsKkRB0Eig=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:59:20.065962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-4fdac539-2649-4108-a85e-4720964baa9a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Getting quotas for project 6e64d19a30d2478380930f9a28dff537. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:59:20.071260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-4fdac539-2649-4108-a85e-4720964baa9a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Getting quotas for user 02ff7645527c4da6ade041db6d0024b0 and project 6e64d19a30d2478380930f9a28dff537. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:59:20.097247 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4fdac539-2649-4108-a85e-4720964baa9a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.255735 Jul 28 04:59:20.097776 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5226/7676] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 04:59:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:59:21.261291 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1544166072", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1752476361", "security_groups": [{"name": "tempest-secgroup-smoke-1941233455"}], "networks": [{"uuid": "72241c34-8705-42f4-80ea-781a167b6838"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:59:21.374201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] validate_networks() for [('72241c34-8705-42f4-80ea-781a167b6838', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:59:21.881037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:59:21.881473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:59:21.881988 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:59:21.882409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:59:21.882833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:59:21.892511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:21.893054 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:21.893731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:21.894271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:21.912114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Getting quotas for project 6e64d19a30d2478380930f9a28dff537. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:59:21.917861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Getting quotas for user 02ff7645527c4da6ade041db6d0024b0 and project 6e64d19a30d2478380930f9a28dff537. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:59:21.933370 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:59:21.935823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 04:59:21.986133 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-102d25aa-c684-439f-ad7c-c855f590fb3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.729907 Jul 28 04:59:21.987216 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5227/7677] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 04:59:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:59:21.998184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5bc18f2e-0918-4390-9d63-575659f4a753 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:21.998872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5bc18f2e-0918-4390-9d63-575659f4a753 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:22.067408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5bc18f2e-0918-4390-9d63-575659f4a753 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:22.076495 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5bc18f2e-0918-4390-9d63-575659f4a753 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1247 microversion: 2.1 time: 0.082294 Jul 28 04:59:22.077421 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5228/7678] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:21 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1247 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:59:23.098375 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1fa9dc54-1827-452d-b05e-db6e7938b721 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:23.099156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1fa9dc54-1827-452d-b05e-db6e7938b721 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:23.108731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fa9dc54-1827-452d-b05e-db6e7938b721 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:23.109934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fa9dc54-1827-452d-b05e-db6e7938b721 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:23.111057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fa9dc54-1827-452d-b05e-db6e7938b721 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:23.111478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1fa9dc54-1827-452d-b05e-db6e7938b721 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:23.207396 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1fa9dc54-1827-452d-b05e-db6e7938b721 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:23.216532 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1fa9dc54-1827-452d-b05e-db6e7938b721 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1299 microversion: 2.1 time: 0.122169 Jul 28 04:59:23.218564 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5229/7679] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:23 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:59:24.239812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-476f4a69-4ced-4b4e-83c4-3bc1082238a6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:24.241214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-476f4a69-4ced-4b4e-83c4-3bc1082238a6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:24.249306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-476f4a69-4ced-4b4e-83c4-3bc1082238a6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:24.250735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-476f4a69-4ced-4b4e-83c4-3bc1082238a6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:24.252743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-476f4a69-4ced-4b4e-83c4-3bc1082238a6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:24.257097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-476f4a69-4ced-4b4e-83c4-3bc1082238a6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:24.435486 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-476f4a69-4ced-4b4e-83c4-3bc1082238a6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:24.445612 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-476f4a69-4ced-4b4e-83c4-3bc1082238a6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1373 microversion: 2.1 time: 0.208711 Jul 28 04:59:24.446322 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5230/7680] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:24 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1373 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:59:25.030680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6b7793a9-a7ba-4448-84d0-681397083c16 req-5fe45511-5dd7-42bb-85f5-7f013a0af340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa725ad1-e549-4c72-800f-fbe622dfcbd8", "tag": "40f077ac-b614-43da-b8e0-d9db2eaf9c3d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:59:25.051042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6b7793a9-a7ba-4448-84d0-681397083c16 req-5fe45511-5dd7-42bb-85f5-7f013a0af340 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:25.052021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6b7793a9-a7ba-4448-84d0-681397083c16 req-5fe45511-5dd7-42bb-85f5-7f013a0af340 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:25.072057 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6b7793a9-a7ba-4448-84d0-681397083c16 req-5fe45511-5dd7-42bb-85f5-7f013a0af340 service nova] Creating event network-changed:40f077ac-b614-43da-b8e0-d9db2eaf9c3d for instance aa725ad1-e549-4c72-800f-fbe622dfcbd8 on n-h2-826756-3 Jul 28 04:59:25.078071 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6b7793a9-a7ba-4448-84d0-681397083c16 req-5fe45511-5dd7-42bb-85f5-7f013a0af340 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051338 Jul 28 04:59:25.078462 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5231/7681] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:59:25.469482 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8e47d51b-66bd-4d5a-b63b-48187995b1d1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:25.470181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8e47d51b-66bd-4d5a-b63b-48187995b1d1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:25.477751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e47d51b-66bd-4d5a-b63b-48187995b1d1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:25.478215 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e47d51b-66bd-4d5a-b63b-48187995b1d1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:25.479021 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e47d51b-66bd-4d5a-b63b-48187995b1d1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:25.479476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e47d51b-66bd-4d5a-b63b-48187995b1d1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:25.622276 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8e47d51b-66bd-4d5a-b63b-48187995b1d1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:25.631188 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8e47d51b-66bd-4d5a-b63b-48187995b1d1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1373 microversion: 2.1 time: 0.167414 Jul 28 04:59:25.644849 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5232/7682] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:25 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:59:26.653942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-440680b8-80a8-4709-b6de-e62ad60b9059 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:26.654643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-440680b8-80a8-4709-b6de-e62ad60b9059 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:26.662050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-440680b8-80a8-4709-b6de-e62ad60b9059 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:26.665360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-440680b8-80a8-4709-b6de-e62ad60b9059 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:26.665360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-440680b8-80a8-4709-b6de-e62ad60b9059 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:26.665360 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-440680b8-80a8-4709-b6de-e62ad60b9059 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:26.819287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-440680b8-80a8-4709-b6de-e62ad60b9059 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:26.827936 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-440680b8-80a8-4709-b6de-e62ad60b9059 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1373 microversion: 2.1 time: 0.178241 Jul 28 04:59:26.828589 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5233/7683] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:26 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1373 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:59:27.854179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-221d34c8-33e5-48b2-9be8-80e72abc8bdb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:27.854882 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-221d34c8-33e5-48b2-9be8-80e72abc8bdb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:27.863918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-221d34c8-33e5-48b2-9be8-80e72abc8bdb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:27.864387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-221d34c8-33e5-48b2-9be8-80e72abc8bdb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:27.865209 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-221d34c8-33e5-48b2-9be8-80e72abc8bdb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:27.865660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-221d34c8-33e5-48b2-9be8-80e72abc8bdb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:28.016425 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-221d34c8-33e5-48b2-9be8-80e72abc8bdb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:28.028815 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-221d34c8-33e5-48b2-9be8-80e72abc8bdb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1373 microversion: 2.1 time: 0.181272 Jul 28 04:59:28.029678 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5234/7684] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:27 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:59:29.057674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e8c0a67a-2fd0-4cdc-a291-830afd5cbe9a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:29.058582 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e8c0a67a-2fd0-4cdc-a291-830afd5cbe9a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:29.066946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c0a67a-2fd0-4cdc-a291-830afd5cbe9a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:29.067414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c0a67a-2fd0-4cdc-a291-830afd5cbe9a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:29.068197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c0a67a-2fd0-4cdc-a291-830afd5cbe9a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:29.068673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c0a67a-2fd0-4cdc-a291-830afd5cbe9a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:29.209856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e8c0a67a-2fd0-4cdc-a291-830afd5cbe9a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:29.217940 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e8c0a67a-2fd0-4cdc-a291-830afd5cbe9a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1373 microversion: 2.1 time: 0.165745 Jul 28 04:59:29.218616 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5235/7685] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:29 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:59:30.240407 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0f8ba0de-aede-4ae0-ac2b-d358d9abf846 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:30.241377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0f8ba0de-aede-4ae0-ac2b-d358d9abf846 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:30.251742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f8ba0de-aede-4ae0-ac2b-d358d9abf846 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:30.252561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f8ba0de-aede-4ae0-ac2b-d358d9abf846 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:30.253771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f8ba0de-aede-4ae0-ac2b-d358d9abf846 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:30.254450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0f8ba0de-aede-4ae0-ac2b-d358d9abf846 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:30.405013 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0f8ba0de-aede-4ae0-ac2b-d358d9abf846 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:30.413497 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0f8ba0de-aede-4ae0-ac2b-d358d9abf846 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1373 microversion: 2.1 time: 0.177667 Jul 28 04:59:30.414117 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5236/7686] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:30 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:59:31.434836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c5507a89-f870-45d9-957f-23350d792679 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:31.435571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c5507a89-f870-45d9-957f-23350d792679 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:31.442691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5507a89-f870-45d9-957f-23350d792679 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:31.443142 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5507a89-f870-45d9-957f-23350d792679 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:31.443933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5507a89-f870-45d9-957f-23350d792679 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:31.444391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c5507a89-f870-45d9-957f-23350d792679 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:31.592793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c5507a89-f870-45d9-957f-23350d792679 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:31.602422 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c5507a89-f870-45d9-957f-23350d792679 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1373 microversion: 2.1 time: 0.171426 Jul 28 04:59:31.603329 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5237/7687] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:31 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:59:31.617018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b0d85788-8408-4776-bd60-6a6dee3b34a7 req-842b0dc3-e083-43e0-ada5-5eec1d520832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa725ad1-e549-4c72-800f-fbe622dfcbd8", "name": "network-vif-plugged", "status": "completed", "tag": "40f077ac-b614-43da-b8e0-d9db2eaf9c3d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:59:31.626908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b0d85788-8408-4776-bd60-6a6dee3b34a7 req-842b0dc3-e083-43e0-ada5-5eec1d520832 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:31.627369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b0d85788-8408-4776-bd60-6a6dee3b34a7 req-842b0dc3-e083-43e0-ada5-5eec1d520832 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:31.640981 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b0d85788-8408-4776-bd60-6a6dee3b34a7 req-842b0dc3-e083-43e0-ada5-5eec1d520832 service nova] Creating event network-vif-plugged:40f077ac-b614-43da-b8e0-d9db2eaf9c3d for instance aa725ad1-e549-4c72-800f-fbe622dfcbd8 on n-h2-826756-3 Jul 28 04:59:31.644781 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b0d85788-8408-4776-bd60-6a6dee3b34a7 req-842b0dc3-e083-43e0-ada5-5eec1d520832 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040382 Jul 28 04:59:31.645494 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5238/7688] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:59:32.624240 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:59:32.625154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:59:32.631382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0e694ea5-e478-452c-942d-04cbb4331dff tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:32.632283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0e694ea5-e478-452c-942d-04cbb4331dff tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:32.640803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e694ea5-e478-452c-942d-04cbb4331dff tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:32.641264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e694ea5-e478-452c-942d-04cbb4331dff tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:32.642040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e694ea5-e478-452c-942d-04cbb4331dff tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:32.642494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0e694ea5-e478-452c-942d-04cbb4331dff tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:32.801148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0e694ea5-e478-452c-942d-04cbb4331dff tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:32.810693 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0e694ea5-e478-452c-942d-04cbb4331dff tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1373 microversion: 2.1 time: 0.187469 Jul 28 04:59:32.811553 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5239/7689] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:32 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1373 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:59:33.832264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-340adfed-35d0-4c0b-bbe6-a165a521d629 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:33.832999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-340adfed-35d0-4c0b-bbe6-a165a521d629 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:33.840317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-340adfed-35d0-4c0b-bbe6-a165a521d629 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:33.840837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-340adfed-35d0-4c0b-bbe6-a165a521d629 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:33.841624 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-340adfed-35d0-4c0b-bbe6-a165a521d629 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:33.842083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-340adfed-35d0-4c0b-bbe6-a165a521d629 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:33.975219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-340adfed-35d0-4c0b-bbe6-a165a521d629 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:33.983639 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-340adfed-35d0-4c0b-bbe6-a165a521d629 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1557 microversion: 2.1 time: 0.155409 Jul 28 04:59:33.984202 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5240/7690] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:33 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:59:34.003819 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-118f0f6e-32f7-45e4-9b4f-aa20991f74ce tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:59:34.004514 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-118f0f6e-32f7-45e4-9b4f-aa20991f74ce tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 04:59:34.010932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-118f0f6e-32f7-45e4-9b4f-aa20991f74ce tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:34.011403 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-118f0f6e-32f7-45e4-9b4f-aa20991f74ce tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:34.012205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-118f0f6e-32f7-45e4-9b4f-aa20991f74ce tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:34.012696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-118f0f6e-32f7-45e4-9b4f-aa20991f74ce tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:34.155914 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-118f0f6e-32f7-45e4-9b4f-aa20991f74ce tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:59:34.164896 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-118f0f6e-32f7-45e4-9b4f-aa20991f74ce tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1557 microversion: 2.1 time: 0.164636 Jul 28 04:59:34.165526 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5241/7691] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 04:59:33 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:59:35.821494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e128d8ae-22eb-4e9c-b551-5695dfdb739c req-259ac816-ba78-455a-a9fa-f5e02ddbf04d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa725ad1-e549-4c72-800f-fbe622dfcbd8", "tag": "40f077ac-b614-43da-b8e0-d9db2eaf9c3d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:59:35.832639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e128d8ae-22eb-4e9c-b551-5695dfdb739c req-259ac816-ba78-455a-a9fa-f5e02ddbf04d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:59:35.833096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e128d8ae-22eb-4e9c-b551-5695dfdb739c req-259ac816-ba78-455a-a9fa-f5e02ddbf04d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:59:35.844462 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e128d8ae-22eb-4e9c-b551-5695dfdb739c req-259ac816-ba78-455a-a9fa-f5e02ddbf04d service nova] Creating event network-changed:40f077ac-b614-43da-b8e0-d9db2eaf9c3d for instance aa725ad1-e549-4c72-800f-fbe622dfcbd8 on n-h2-826756-3 Jul 28 04:59:35.850016 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e128d8ae-22eb-4e9c-b551-5695dfdb739c req-259ac816-ba78-455a-a9fa-f5e02ddbf04d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033148 Jul 28 04:59:35.850892 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5242/7692] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 04:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:00:17.452665 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:00:17.454265 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 05:00:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 05:01:33.300491 n-d-826756-3 devstack@n-api.service[126071]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3383c6d1-bf1b-4640-b860-3d2b5f70fe2b] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 28 05:01:33.301384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:01:33.302206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=74 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:01:33.307337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f5b28380-dfbb-4cb9-ac17-ac7e6d327b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:01:33.307910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f5b28380-dfbb-4cb9-ac17-ac7e6d327b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:33.317762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5b28380-dfbb-4cb9-ac17-ac7e6d327b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:33.318346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5b28380-dfbb-4cb9-ac17-ac7e6d327b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:33.319158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5b28380-dfbb-4cb9-ac17-ac7e6d327b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:33.319622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f5b28380-dfbb-4cb9-ac17-ac7e6d327b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:33.346606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-f5b28380-dfbb-4cb9-ac17-ac7e6d327b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lazy-loading 'flavor' on Instance uuid aa725ad1-e549-4c72-800f-fbe622dfcbd8 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:01:33.543621 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f5b28380-dfbb-4cb9-ac17-ac7e6d327b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "POST /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8/action" status: 202 len: 0 microversion: 2.1 time: 0.245277 Jul 28 05:01:33.544425 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5243/7693] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 05:01:33 2022] POST /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:01:33.554897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-688946f1-6436-414a-8c97-29f1c6ffbe3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:33.555615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-688946f1-6436-414a-8c97-29f1c6ffbe3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:33.563784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-688946f1-6436-414a-8c97-29f1c6ffbe3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:33.564262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-688946f1-6436-414a-8c97-29f1c6ffbe3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:33.565180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-688946f1-6436-414a-8c97-29f1c6ffbe3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:33.565632 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-688946f1-6436-414a-8c97-29f1c6ffbe3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:33.717621 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-688946f1-6436-414a-8c97-29f1c6ffbe3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:33.726146 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-688946f1-6436-414a-8c97-29f1c6ffbe3d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1682 microversion: 2.1 time: 0.175712 Jul 28 05:01:33.726722 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5244/7694] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:33 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:01:34.750179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-782a8f61-9061-4a0c-ae16-7dfb213d9590 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:34.750903 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-782a8f61-9061-4a0c-ae16-7dfb213d9590 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:34.759559 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-782a8f61-9061-4a0c-ae16-7dfb213d9590 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:34.760001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-782a8f61-9061-4a0c-ae16-7dfb213d9590 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:34.760863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-782a8f61-9061-4a0c-ae16-7dfb213d9590 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:34.761302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-782a8f61-9061-4a0c-ae16-7dfb213d9590 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:34.778465 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] [3383c6d1-bf1b-4640-b860-3d2b5f70fe2b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 41806. Jul 28 05:01:34.907490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-782a8f61-9061-4a0c-ae16-7dfb213d9590 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:34.918588 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-782a8f61-9061-4a0c-ae16-7dfb213d9590 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1682 microversion: 2.1 time: 0.172655 Jul 28 05:01:34.919172 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5245/7695] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:34 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:35.944829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bc11133a-676c-4e94-a22c-ddf4d7570618 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:35.945931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bc11133a-676c-4e94-a22c-ddf4d7570618 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:35.956811 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc11133a-676c-4e94-a22c-ddf4d7570618 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:35.957580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc11133a-676c-4e94-a22c-ddf4d7570618 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:35.958950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc11133a-676c-4e94-a22c-ddf4d7570618 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:35.959767 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bc11133a-676c-4e94-a22c-ddf4d7570618 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:36.109719 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bc11133a-676c-4e94-a22c-ddf4d7570618 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:36.118648 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bc11133a-676c-4e94-a22c-ddf4d7570618 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1682 microversion: 2.1 time: 0.181507 Jul 28 05:01:36.119264 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5246/7696] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:35 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:37.142118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-74a90557-a923-49b9-b43c-1e925d367e23 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:37.142812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-74a90557-a923-49b9-b43c-1e925d367e23 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:37.149873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74a90557-a923-49b9-b43c-1e925d367e23 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:37.150339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74a90557-a923-49b9-b43c-1e925d367e23 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:37.151509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74a90557-a923-49b9-b43c-1e925d367e23 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:37.152204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-74a90557-a923-49b9-b43c-1e925d367e23 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:37.306630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-74a90557-a923-49b9-b43c-1e925d367e23 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:37.314949 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-74a90557-a923-49b9-b43c-1e925d367e23 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1682 microversion: 2.1 time: 0.176863 Jul 28 05:01:37.315509 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5247/7697] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:37 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:38.339948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f9ae3112-69e9-4a25-9ef4-7d49c3d16926 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:38.340695 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f9ae3112-69e9-4a25-9ef4-7d49c3d16926 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:38.348001 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9ae3112-69e9-4a25-9ef4-7d49c3d16926 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:38.348814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9ae3112-69e9-4a25-9ef4-7d49c3d16926 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:38.353244 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9ae3112-69e9-4a25-9ef4-7d49c3d16926 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:38.353711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f9ae3112-69e9-4a25-9ef4-7d49c3d16926 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:38.499552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f9ae3112-69e9-4a25-9ef4-7d49c3d16926 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:38.507643 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f9ae3112-69e9-4a25-9ef4-7d49c3d16926 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1682 microversion: 2.1 time: 0.173353 Jul 28 05:01:38.508228 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5248/7698] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:38 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:39.532938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-723c5272-cbcb-49f9-9361-6cccbd20e1f4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:39.533656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-723c5272-cbcb-49f9-9361-6cccbd20e1f4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:39.544917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-723c5272-cbcb-49f9-9361-6cccbd20e1f4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:39.545623 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-723c5272-cbcb-49f9-9361-6cccbd20e1f4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:39.546922 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-723c5272-cbcb-49f9-9361-6cccbd20e1f4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:39.547484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-723c5272-cbcb-49f9-9361-6cccbd20e1f4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:39.691417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-723c5272-cbcb-49f9-9361-6cccbd20e1f4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:39.703211 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-723c5272-cbcb-49f9-9361-6cccbd20e1f4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1682 microversion: 2.1 time: 0.176667 Jul 28 05:01:39.704015 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5249/7699] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:39 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:01:40.734985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ee292028-b9f6-496f-8631-f55d1ca47ea3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:40.736144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ee292028-b9f6-496f-8631-f55d1ca47ea3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:40.748910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee292028-b9f6-496f-8631-f55d1ca47ea3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:40.749132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee292028-b9f6-496f-8631-f55d1ca47ea3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:40.750543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee292028-b9f6-496f-8631-f55d1ca47ea3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:40.751314 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ee292028-b9f6-496f-8631-f55d1ca47ea3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:40.898750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ee292028-b9f6-496f-8631-f55d1ca47ea3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:40.911426 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ee292028-b9f6-496f-8631-f55d1ca47ea3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1682 microversion: 2.1 time: 0.184793 Jul 28 05:01:40.912274 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5250/7700] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:40 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:01:41.939549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca769fdb-de46-43ae-8f04-8d19ebdf7169 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:41.940692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca769fdb-de46-43ae-8f04-8d19ebdf7169 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:41.952562 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca769fdb-de46-43ae-8f04-8d19ebdf7169 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:41.953346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca769fdb-de46-43ae-8f04-8d19ebdf7169 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:41.954633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca769fdb-de46-43ae-8f04-8d19ebdf7169 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:41.955427 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca769fdb-de46-43ae-8f04-8d19ebdf7169 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:42.092933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca769fdb-de46-43ae-8f04-8d19ebdf7169 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:42.101353 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca769fdb-de46-43ae-8f04-8d19ebdf7169 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1682 microversion: 2.1 time: 0.168749 Jul 28 05:01:42.101944 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5251/7701] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:41 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:43.124038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b7131da8-c32b-479b-8556-a2be4a817608 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:43.124782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b7131da8-c32b-479b-8556-a2be4a817608 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:43.132283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7131da8-c32b-479b-8556-a2be4a817608 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:43.132770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7131da8-c32b-479b-8556-a2be4a817608 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:43.133533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7131da8-c32b-479b-8556-a2be4a817608 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:43.133979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b7131da8-c32b-479b-8556-a2be4a817608 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:43.283295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b7131da8-c32b-479b-8556-a2be4a817608 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:43.295339 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b7131da8-c32b-479b-8556-a2be4a817608 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1682 microversion: 2.1 time: 0.175260 Jul 28 05:01:43.296160 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5252/7702] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:43 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:44.321921 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-17dcf11e-06c3-45e6-9f66-0aa0e882052f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:44.322642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-17dcf11e-06c3-45e6-9f66-0aa0e882052f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:44.330378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17dcf11e-06c3-45e6-9f66-0aa0e882052f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:44.330944 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17dcf11e-06c3-45e6-9f66-0aa0e882052f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:44.331661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17dcf11e-06c3-45e6-9f66-0aa0e882052f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:44.332145 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-17dcf11e-06c3-45e6-9f66-0aa0e882052f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:44.480306 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-17dcf11e-06c3-45e6-9f66-0aa0e882052f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:44.488690 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-17dcf11e-06c3-45e6-9f66-0aa0e882052f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1703 microversion: 2.1 time: 0.170959 Jul 28 05:01:44.489263 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5253/7703] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:44 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1703 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:45.515183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bf890f59-d89f-43ba-9626-5178ec3db7c6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:45.516239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bf890f59-d89f-43ba-9626-5178ec3db7c6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:45.528951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf890f59-d89f-43ba-9626-5178ec3db7c6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:45.529502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf890f59-d89f-43ba-9626-5178ec3db7c6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:45.530389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf890f59-d89f-43ba-9626-5178ec3db7c6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:45.530824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf890f59-d89f-43ba-9626-5178ec3db7c6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:45.681371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bf890f59-d89f-43ba-9626-5178ec3db7c6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:45.689782 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bf890f59-d89f-43ba-9626-5178ec3db7c6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1703 microversion: 2.1 time: 0.181203 Jul 28 05:01:45.690395 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5254/7704] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:45 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1703 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:45.902473 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:01:45.902473 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 05:01:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 05:01:46.712886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-18a9f30b-cbcb-40f4-9325-92f805e1d6c3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:46.714133 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-18a9f30b-cbcb-40f4-9325-92f805e1d6c3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:46.726167 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18a9f30b-cbcb-40f4-9325-92f805e1d6c3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:46.727191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18a9f30b-cbcb-40f4-9325-92f805e1d6c3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:46.728490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18a9f30b-cbcb-40f4-9325-92f805e1d6c3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:46.728490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-18a9f30b-cbcb-40f4-9325-92f805e1d6c3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:46.899341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-18a9f30b-cbcb-40f4-9325-92f805e1d6c3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:46.907832 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-18a9f30b-cbcb-40f4-9325-92f805e1d6c3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1698 microversion: 2.1 time: 0.199235 Jul 28 05:01:46.908506 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5255/7705] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:46 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1698 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:01:47.930233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1f7b1e24-c1a2-487a-bdaa-946a56261f0d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:47.930930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1f7b1e24-c1a2-487a-bdaa-946a56261f0d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:47.939694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f7b1e24-c1a2-487a-bdaa-946a56261f0d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:47.940156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f7b1e24-c1a2-487a-bdaa-946a56261f0d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:47.940994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f7b1e24-c1a2-487a-bdaa-946a56261f0d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:47.941439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1f7b1e24-c1a2-487a-bdaa-946a56261f0d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:48.130697 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1f7b1e24-c1a2-487a-bdaa-946a56261f0d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:48.143803 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1f7b1e24-c1a2-487a-bdaa-946a56261f0d tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1698 microversion: 2.1 time: 0.217440 Jul 28 05:01:48.145448 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5256/7706] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:47 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1698 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:48.246585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-e71783ae-f6ea-467f-a73f-271aabf30be2 req-ab3939fb-b505-4b5f-80a5-c8882dff4b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa725ad1-e549-4c72-800f-fbe622dfcbd8", "name": "network-vif-plugged", "status": "completed", "tag": "40f077ac-b614-43da-b8e0-d9db2eaf9c3d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:01:48.261310 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e71783ae-f6ea-467f-a73f-271aabf30be2 req-ab3939fb-b505-4b5f-80a5-c8882dff4b04 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:48.261917 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-e71783ae-f6ea-467f-a73f-271aabf30be2 req-ab3939fb-b505-4b5f-80a5-c8882dff4b04 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:48.275011 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-e71783ae-f6ea-467f-a73f-271aabf30be2 req-ab3939fb-b505-4b5f-80a5-c8882dff4b04 service nova] Creating event network-vif-plugged:40f077ac-b614-43da-b8e0-d9db2eaf9c3d for instance aa725ad1-e549-4c72-800f-fbe622dfcbd8 on n-h2-826756-3 Jul 28 05:01:48.284959 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-e71783ae-f6ea-467f-a73f-271aabf30be2 req-ab3939fb-b505-4b5f-80a5-c8882dff4b04 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042445 Jul 28 05:01:48.286179 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5257/7707] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:01:49.178746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c82e2543-9f35-4691-a2df-25a65383a332 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:49.179426 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c82e2543-9f35-4691-a2df-25a65383a332 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:49.188026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c82e2543-9f35-4691-a2df-25a65383a332 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:49.188516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c82e2543-9f35-4691-a2df-25a65383a332 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:49.189300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c82e2543-9f35-4691-a2df-25a65383a332 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:49.189745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c82e2543-9f35-4691-a2df-25a65383a332 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:49.194156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:01:49.344088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c82e2543-9f35-4691-a2df-25a65383a332 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:49.363224 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c82e2543-9f35-4691-a2df-25a65383a332 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1698 microversion: 2.1 time: 0.189594 Jul 28 05:01:49.363821 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5258/7708] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:49 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1698 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:01:50.386253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-325d5030-172e-432e-872f-9da9fda777b2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:50.387040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-325d5030-172e-432e-872f-9da9fda777b2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:50.397320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-325d5030-172e-432e-872f-9da9fda777b2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:50.397784 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-325d5030-172e-432e-872f-9da9fda777b2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:50.398581 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-325d5030-172e-432e-872f-9da9fda777b2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:50.399027 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-325d5030-172e-432e-872f-9da9fda777b2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:50.576178 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-325d5030-172e-432e-872f-9da9fda777b2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:50.589035 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-325d5030-172e-432e-872f-9da9fda777b2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1698 microversion: 2.1 time: 0.206256 Jul 28 05:01:50.592805 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5259/7709] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:50 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1698 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:01:51.612860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2c42cfb0-a9b2-41b3-aaa7-82b554e49854 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:51.613665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2c42cfb0-a9b2-41b3-aaa7-82b554e49854 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:51.624915 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c42cfb0-a9b2-41b3-aaa7-82b554e49854 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:51.625398 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c42cfb0-a9b2-41b3-aaa7-82b554e49854 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:51.626222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c42cfb0-a9b2-41b3-aaa7-82b554e49854 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:51.626681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2c42cfb0-a9b2-41b3-aaa7-82b554e49854 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:51.787673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-2c42cfb0-a9b2-41b3-aaa7-82b554e49854 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:51.796844 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2c42cfb0-a9b2-41b3-aaa7-82b554e49854 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1698 microversion: 2.1 time: 0.187787 Jul 28 05:01:51.797334 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5260/7710] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:51 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1698 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:52.819949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-acdd9ccd-120b-4327-b944-57214d908765 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:52.820663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-acdd9ccd-120b-4327-b944-57214d908765 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:52.829549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acdd9ccd-120b-4327-b944-57214d908765 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:52.830510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acdd9ccd-120b-4327-b944-57214d908765 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:52.832016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acdd9ccd-120b-4327-b944-57214d908765 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:52.833114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-acdd9ccd-120b-4327-b944-57214d908765 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:52.982168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-acdd9ccd-120b-4327-b944-57214d908765 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:52.990829 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-acdd9ccd-120b-4327-b944-57214d908765 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1698 microversion: 2.1 time: 0.174852 Jul 28 05:01:52.991815 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5261/7711] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:52 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1698 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:54.014075 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d179e4ab-6d62-4969-ad07-37b5b2d7f1ab tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:54.014728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d179e4ab-6d62-4969-ad07-37b5b2d7f1ab tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:54.022254 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d179e4ab-6d62-4969-ad07-37b5b2d7f1ab tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:54.023284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d179e4ab-6d62-4969-ad07-37b5b2d7f1ab tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:54.024271 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d179e4ab-6d62-4969-ad07-37b5b2d7f1ab tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:54.024818 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d179e4ab-6d62-4969-ad07-37b5b2d7f1ab tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:54.180569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d179e4ab-6d62-4969-ad07-37b5b2d7f1ab tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:54.189266 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d179e4ab-6d62-4969-ad07-37b5b2d7f1ab tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1698 microversion: 2.1 time: 0.179234 Jul 28 05:01:54.190143 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5262/7712] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:54 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:55.210684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c05dcf3a-cad4-4472-9088-1ffd771e5223 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:55.211369 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c05dcf3a-cad4-4472-9088-1ffd771e5223 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:55.218700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c05dcf3a-cad4-4472-9088-1ffd771e5223 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:55.219170 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c05dcf3a-cad4-4472-9088-1ffd771e5223 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:55.220093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c05dcf3a-cad4-4472-9088-1ffd771e5223 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:55.220424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c05dcf3a-cad4-4472-9088-1ffd771e5223 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:55.366984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c05dcf3a-cad4-4472-9088-1ffd771e5223 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:55.376467 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c05dcf3a-cad4-4472-9088-1ffd771e5223 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1698 microversion: 2.1 time: 0.169764 Jul 28 05:01:55.377093 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5263/7713] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:55 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1698 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:56.399194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d151254e-49c9-4a4f-9b0e-d76d55211de6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:56.399833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d151254e-49c9-4a4f-9b0e-d76d55211de6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:56.406643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d151254e-49c9-4a4f-9b0e-d76d55211de6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:56.407135 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d151254e-49c9-4a4f-9b0e-d76d55211de6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:56.407907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d151254e-49c9-4a4f-9b0e-d76d55211de6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:56.408382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d151254e-49c9-4a4f-9b0e-d76d55211de6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:56.551940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d151254e-49c9-4a4f-9b0e-d76d55211de6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:56.562722 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d151254e-49c9-4a4f-9b0e-d76d55211de6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1680 microversion: 2.1 time: 0.167660 Jul 28 05:01:56.563302 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5264/7714] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:56 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:57.591950 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4ca67596-f3fd-4eae-a7bf-28b794b11fb5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:57.592705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4ca67596-f3fd-4eae-a7bf-28b794b11fb5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:57.600826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ca67596-f3fd-4eae-a7bf-28b794b11fb5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:57.601281 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ca67596-f3fd-4eae-a7bf-28b794b11fb5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:57.602068 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ca67596-f3fd-4eae-a7bf-28b794b11fb5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:57.602516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4ca67596-f3fd-4eae-a7bf-28b794b11fb5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:57.758756 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4ca67596-f3fd-4eae-a7bf-28b794b11fb5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:57.767232 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4ca67596-f3fd-4eae-a7bf-28b794b11fb5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1680 microversion: 2.1 time: 0.181514 Jul 28 05:01:57.767856 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5265/7715] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:57 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:01:58.792678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-be3c2c67-0459-42c4-8547-a7298c591397 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:01:58.793580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-be3c2c67-0459-42c4-8547-a7298c591397 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:58.801317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be3c2c67-0459-42c4-8547-a7298c591397 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:58.801782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be3c2c67-0459-42c4-8547-a7298c591397 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:58.802575 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be3c2c67-0459-42c4-8547-a7298c591397 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:58.803026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-be3c2c67-0459-42c4-8547-a7298c591397 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:58.953765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-be3c2c67-0459-42c4-8547-a7298c591397 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:01:58.961768 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-be3c2c67-0459-42c4-8547-a7298c591397 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1683 microversion: 2.1 time: 0.175803 Jul 28 05:01:58.962351 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5266/7716] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:01:58 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:01:58.982572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8884e37a-725c-4df2-9a7b-704366ed4c42 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:01:58.983173 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8884e37a-725c-4df2-9a7b-704366ed4c42 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:01:58.989619 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8884e37a-725c-4df2-9a7b-704366ed4c42 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:58.990074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8884e37a-725c-4df2-9a7b-704366ed4c42 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:58.990848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8884e37a-725c-4df2-9a7b-704366ed4c42 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:01:58.991292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8884e37a-725c-4df2-9a7b-704366ed4c42 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:01:59.033487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8884e37a-725c-4df2-9a7b-704366ed4c42 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126071) unshelve /opt/stack/nova/nova/compute/api.py:4575}} Jul 28 05:01:59.105162 n-d-826756-3 devstack@n-api.service[126071]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8884e37a-725c-4df2-9a7b-704366ed4c42 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [58eb8937-f41e-4d24-aae1-a3fc6fa1e472] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 05:02:00.114430 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [None req-8884e37a-725c-4df2-9a7b-704366ed4c42 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [58eb8937-f41e-4d24-aae1-a3fc6fa1e472] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 41904. Jul 28 05:02:00.118997 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8884e37a-725c-4df2-9a7b-704366ed4c42 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "POST /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8/action" status: 202 len: 0 microversion: 2.1 time: 1.140110 Jul 28 05:02:00.119652 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5267/7717] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 05:01:58 2022] POST /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8/action => generated 0 bytes in 1141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:02:00.129353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e64f8b5c-20f7-4c3e-92e7-e6a761331bc5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:00.130076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e64f8b5c-20f7-4c3e-92e7-e6a761331bc5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:00.137870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e64f8b5c-20f7-4c3e-92e7-e6a761331bc5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:00.137870 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e64f8b5c-20f7-4c3e-92e7-e6a761331bc5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:00.139454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e64f8b5c-20f7-4c3e-92e7-e6a761331bc5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:00.139816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e64f8b5c-20f7-4c3e-92e7-e6a761331bc5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:00.633781 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e64f8b5c-20f7-4c3e-92e7-e6a761331bc5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:00.642684 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e64f8b5c-20f7-4c3e-92e7-e6a761331bc5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1631 microversion: 2.1 time: 0.517665 Jul 28 05:02:00.643344 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5268/7718] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:00 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1631 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:02:00.647926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-7f10d787-1470-492a-b30a-f2ad645becc2 req-17da4d50-8952-4e00-8809-db2cc095c8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa725ad1-e549-4c72-800f-fbe622dfcbd8", "name": "network-vif-unplugged", "status": "completed", "tag": "40f077ac-b614-43da-b8e0-d9db2eaf9c3d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:02:00.658447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7f10d787-1470-492a-b30a-f2ad645becc2 req-17da4d50-8952-4e00-8809-db2cc095c8ac service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:00.658913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-7f10d787-1470-492a-b30a-f2ad645becc2 req-17da4d50-8952-4e00-8809-db2cc095c8ac service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:00.673698 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.compute.server_external_events [req-7f10d787-1470-492a-b30a-f2ad645becc2 req-17da4d50-8952-4e00-8809-db2cc095c8ac service nova] Unable to find a host for instance aa725ad1-e549-4c72-800f-fbe622dfcbd8. Dropping event network-vif-unplugged {{(pid=126071) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 05:02:00.674605 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-7f10d787-1470-492a-b30a-f2ad645becc2 req-17da4d50-8952-4e00-8809-db2cc095c8ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030243 Jul 28 05:02:00.675215 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5269/7719] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 05:02:01.667680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f324cee5-f96f-40e4-8088-9a4fdcce26cb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:01.668419 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f324cee5-f96f-40e4-8088-9a4fdcce26cb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:01.676194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f324cee5-f96f-40e4-8088-9a4fdcce26cb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:01.676680 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f324cee5-f96f-40e4-8088-9a4fdcce26cb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:01.677473 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f324cee5-f96f-40e4-8088-9a4fdcce26cb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:01.677920 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f324cee5-f96f-40e4-8088-9a4fdcce26cb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:01.815898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f324cee5-f96f-40e4-8088-9a4fdcce26cb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:01.823843 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f324cee5-f96f-40e4-8088-9a4fdcce26cb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.162334 Jul 28 05:02:01.824454 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5270/7720] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:01 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:02:02.847681 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3c7925f2-df07-42ac-8e49-d60843a21f43 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:02.848587 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3c7925f2-df07-42ac-8e49-d60843a21f43 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:02.856745 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c7925f2-df07-42ac-8e49-d60843a21f43 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:02.857533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c7925f2-df07-42ac-8e49-d60843a21f43 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:02.858627 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c7925f2-df07-42ac-8e49-d60843a21f43 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:02.859649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3c7925f2-df07-42ac-8e49-d60843a21f43 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:03.023114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3c7925f2-df07-42ac-8e49-d60843a21f43 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:03.031403 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3c7925f2-df07-42ac-8e49-d60843a21f43 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.188016 Jul 28 05:02:03.045713 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5271/7721] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:02 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:02:04.053546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ed0f06c9-eb8e-40ab-ba8e-1835560c69f3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:04.054188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ed0f06c9-eb8e-40ab-ba8e-1835560c69f3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:04.057011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:02:04.063865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed0f06c9-eb8e-40ab-ba8e-1835560c69f3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:04.064331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed0f06c9-eb8e-40ab-ba8e-1835560c69f3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:04.065195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed0f06c9-eb8e-40ab-ba8e-1835560c69f3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:04.065660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ed0f06c9-eb8e-40ab-ba8e-1835560c69f3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:04.214530 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ed0f06c9-eb8e-40ab-ba8e-1835560c69f3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:04.226677 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ed0f06c9-eb8e-40ab-ba8e-1835560c69f3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.177059 Jul 28 05:02:04.227280 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5272/7722] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:04 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:02:05.249817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9e7d06b9-8b52-49d1-ac6b-ec1f59084774 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:05.250540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9e7d06b9-8b52-49d1-ac6b-ec1f59084774 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:05.259631 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e7d06b9-8b52-49d1-ac6b-ec1f59084774 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:05.260094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e7d06b9-8b52-49d1-ac6b-ec1f59084774 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:05.260933 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e7d06b9-8b52-49d1-ac6b-ec1f59084774 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:05.261387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9e7d06b9-8b52-49d1-ac6b-ec1f59084774 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:05.412493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9e7d06b9-8b52-49d1-ac6b-ec1f59084774 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:05.424471 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9e7d06b9-8b52-49d1-ac6b-ec1f59084774 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.179443 Jul 28 05:02:05.434020 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5273/7723] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:05 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:02:06.451239 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-307f06d8-045b-4cfe-bfbb-a62da2c62327 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:06.452438 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-307f06d8-045b-4cfe-bfbb-a62da2c62327 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:06.464034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-307f06d8-045b-4cfe-bfbb-a62da2c62327 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:06.464953 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-307f06d8-045b-4cfe-bfbb-a62da2c62327 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:06.466469 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-307f06d8-045b-4cfe-bfbb-a62da2c62327 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:06.467288 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-307f06d8-045b-4cfe-bfbb-a62da2c62327 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:06.498797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:02:06.636158 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-307f06d8-045b-4cfe-bfbb-a62da2c62327 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:06.644363 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-307f06d8-045b-4cfe-bfbb-a62da2c62327 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.201005 Jul 28 05:02:06.644959 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5274/7724] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:06 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:02:07.666477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3d7a9531-8e1a-4a3a-a68e-b4efcaf178f9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:07.667649 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3d7a9531-8e1a-4a3a-a68e-b4efcaf178f9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:07.674909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d7a9531-8e1a-4a3a-a68e-b4efcaf178f9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:07.675414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d7a9531-8e1a-4a3a-a68e-b4efcaf178f9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:07.676404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d7a9531-8e1a-4a3a-a68e-b4efcaf178f9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:07.676864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3d7a9531-8e1a-4a3a-a68e-b4efcaf178f9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:07.848127 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3d7a9531-8e1a-4a3a-a68e-b4efcaf178f9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:07.856519 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3d7a9531-8e1a-4a3a-a68e-b4efcaf178f9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.194095 Jul 28 05:02:07.857110 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5275/7725] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:07 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:02:08.883196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-94fd6317-9124-4247-9efd-734f91ae7b6b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:08.884034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-94fd6317-9124-4247-9efd-734f91ae7b6b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:08.891257 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fd6317-9124-4247-9efd-734f91ae7b6b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:08.891723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fd6317-9124-4247-9efd-734f91ae7b6b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:08.893252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fd6317-9124-4247-9efd-734f91ae7b6b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:08.893708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-94fd6317-9124-4247-9efd-734f91ae7b6b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:09.061382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-94fd6317-9124-4247-9efd-734f91ae7b6b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:09.070217 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-94fd6317-9124-4247-9efd-734f91ae7b6b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.195833 Jul 28 05:02:09.072410 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5276/7726] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:08 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:02:10.096918 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e8c1178f-0095-4c59-bd91-a050a97a2199 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:10.098523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e8c1178f-0095-4c59-bd91-a050a97a2199 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:10.106853 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c1178f-0095-4c59-bd91-a050a97a2199 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:10.107320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c1178f-0095-4c59-bd91-a050a97a2199 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:10.108225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c1178f-0095-4c59-bd91-a050a97a2199 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:10.108717 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c1178f-0095-4c59-bd91-a050a97a2199 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:10.247550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e8c1178f-0095-4c59-bd91-a050a97a2199 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:10.255602 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e8c1178f-0095-4c59-bd91-a050a97a2199 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.162991 Jul 28 05:02:10.256162 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5277/7727] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:10 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:02:11.277598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6246a9ee-75d3-4d63-9e87-29b1f47cfe55 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:11.278351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6246a9ee-75d3-4d63-9e87-29b1f47cfe55 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:11.285731 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6246a9ee-75d3-4d63-9e87-29b1f47cfe55 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:11.286192 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6246a9ee-75d3-4d63-9e87-29b1f47cfe55 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:11.286976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6246a9ee-75d3-4d63-9e87-29b1f47cfe55 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:11.287422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6246a9ee-75d3-4d63-9e87-29b1f47cfe55 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:11.444813 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6246a9ee-75d3-4d63-9e87-29b1f47cfe55 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:11.454795 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6246a9ee-75d3-4d63-9e87-29b1f47cfe55 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.181147 Jul 28 05:02:11.455368 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5278/7728] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:11 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:02:12.479906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b4410356-fc0e-4704-b711-eef8d0240aac tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:12.480615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b4410356-fc0e-4704-b711-eef8d0240aac tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:12.490704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4410356-fc0e-4704-b711-eef8d0240aac tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:12.491330 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4410356-fc0e-4704-b711-eef8d0240aac tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:12.492523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4410356-fc0e-4704-b711-eef8d0240aac tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:12.493092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b4410356-fc0e-4704-b711-eef8d0240aac tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:12.640780 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b4410356-fc0e-4704-b711-eef8d0240aac tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:12.649292 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b4410356-fc0e-4704-b711-eef8d0240aac tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.176021 Jul 28 05:02:12.649842 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5279/7729] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:12 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:02:13.680149 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cafc4c1a-774a-4a7c-ae96-a8655054b884 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:13.681273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cafc4c1a-774a-4a7c-ae96-a8655054b884 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:13.690094 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cafc4c1a-774a-4a7c-ae96-a8655054b884 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:13.690558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cafc4c1a-774a-4a7c-ae96-a8655054b884 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:13.691359 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cafc4c1a-774a-4a7c-ae96-a8655054b884 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:13.691797 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cafc4c1a-774a-4a7c-ae96-a8655054b884 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:13.845879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cafc4c1a-774a-4a7c-ae96-a8655054b884 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:13.859430 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cafc4c1a-774a-4a7c-ae96-a8655054b884 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.185687 Jul 28 05:02:13.860314 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5280/7730] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:13 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:02:14.886318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a561911d-8e6f-4e71-a40b-2f61c55fc15e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:14.887026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a561911d-8e6f-4e71-a40b-2f61c55fc15e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:14.894313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a561911d-8e6f-4e71-a40b-2f61c55fc15e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:14.894787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a561911d-8e6f-4e71-a40b-2f61c55fc15e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:14.895572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a561911d-8e6f-4e71-a40b-2f61c55fc15e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:14.896037 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a561911d-8e6f-4e71-a40b-2f61c55fc15e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:15.047803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a561911d-8e6f-4e71-a40b-2f61c55fc15e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:15.056372 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a561911d-8e6f-4e71-a40b-2f61c55fc15e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.173903 Jul 28 05:02:15.056982 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5281/7731] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:14 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:02:16.079414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4876d24e-650f-4068-9001-dae8b6b2b662 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:16.080019 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4876d24e-650f-4068-9001-dae8b6b2b662 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:16.087640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4876d24e-650f-4068-9001-dae8b6b2b662 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:16.088114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4876d24e-650f-4068-9001-dae8b6b2b662 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:16.088919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4876d24e-650f-4068-9001-dae8b6b2b662 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:16.089374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4876d24e-650f-4068-9001-dae8b6b2b662 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:16.232057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4876d24e-650f-4068-9001-dae8b6b2b662 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:16.240688 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4876d24e-650f-4068-9001-dae8b6b2b662 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.165384 Jul 28 05:02:16.241287 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5282/7732] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:16 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:02:16.342461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-fa6cde2f-bc02-4f0d-9dc2-e7b9a6715a61 req-764dfda4-8aba-4040-8e0c-2a1bd1220eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa725ad1-e549-4c72-800f-fbe622dfcbd8", "name": "network-vif-plugged", "status": "completed", "tag": "40f077ac-b614-43da-b8e0-d9db2eaf9c3d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:02:16.354157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fa6cde2f-bc02-4f0d-9dc2-e7b9a6715a61 req-764dfda4-8aba-4040-8e0c-2a1bd1220eb3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:16.354615 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fa6cde2f-bc02-4f0d-9dc2-e7b9a6715a61 req-764dfda4-8aba-4040-8e0c-2a1bd1220eb3 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:16.367282 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-fa6cde2f-bc02-4f0d-9dc2-e7b9a6715a61 req-764dfda4-8aba-4040-8e0c-2a1bd1220eb3 service nova] Creating event network-vif-plugged:40f077ac-b614-43da-b8e0-d9db2eaf9c3d for instance aa725ad1-e549-4c72-800f-fbe622dfcbd8 on n-h2-826756-3 Jul 28 05:02:16.372675 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-fa6cde2f-bc02-4f0d-9dc2-e7b9a6715a61 req-764dfda4-8aba-4040-8e0c-2a1bd1220eb3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033954 Jul 28 05:02:16.373295 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5283/7733] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:02:17.264543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-68aae09e-f3e4-4476-b4b6-9322b4a1d660 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:17.265258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-68aae09e-f3e4-4476-b4b6-9322b4a1d660 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:17.272181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68aae09e-f3e4-4476-b4b6-9322b4a1d660 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:17.272671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68aae09e-f3e4-4476-b4b6-9322b4a1d660 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:17.273457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68aae09e-f3e4-4476-b4b6-9322b4a1d660 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:17.273906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68aae09e-f3e4-4476-b4b6-9322b4a1d660 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:17.426954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-68aae09e-f3e4-4476-b4b6-9322b4a1d660 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:17.438364 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-68aae09e-f3e4-4476-b4b6-9322b4a1d660 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.179192 Jul 28 05:02:17.438931 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5284/7734] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:17 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:02:18.466806 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f1cc69a5-3794-43fa-99df-fafcc576fbf6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:18.467531 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f1cc69a5-3794-43fa-99df-fafcc576fbf6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:18.476038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1cc69a5-3794-43fa-99df-fafcc576fbf6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:18.476592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1cc69a5-3794-43fa-99df-fafcc576fbf6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:18.477393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1cc69a5-3794-43fa-99df-fafcc576fbf6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:18.477846 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1cc69a5-3794-43fa-99df-fafcc576fbf6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:18.618656 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f1cc69a5-3794-43fa-99df-fafcc576fbf6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:18.626713 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f1cc69a5-3794-43fa-99df-fafcc576fbf6 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1689 microversion: 2.1 time: 0.164543 Jul 28 05:02:18.627294 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5285/7735] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:18 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:02:19.648251 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5133af8f-aa32-4835-a248-aa179b8c40dd tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:02:19.648957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5133af8f-aa32-4835-a248-aa179b8c40dd tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:02:19.656667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5133af8f-aa32-4835-a248-aa179b8c40dd tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:19.657130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5133af8f-aa32-4835-a248-aa179b8c40dd tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:19.657907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5133af8f-aa32-4835-a248-aa179b8c40dd tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:02:19.658352 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5133af8f-aa32-4835-a248-aa179b8c40dd tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:02:19.796383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5133af8f-aa32-4835-a248-aa179b8c40dd tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:02:19.804666 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5133af8f-aa32-4835-a248-aa179b8c40dd tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1676 microversion: 2.1 time: 0.160392 Jul 28 05:02:19.805252 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5286/7736] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:02:19 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:02:24.082028 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:02:24.082608 n-d-826756-3 devstack@n-api.service[126071]: Thu Jul 28 05:02:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 05:03:33.506715 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=29 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:03:33.507677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=70 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:03:33.511533 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-431ddc68-4e4c-47cf-941a-2e6767a4a9b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:03:33.512042 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-431ddc68-4e4c-47cf-941a-2e6767a4a9b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:03:33.519146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-431ddc68-4e4c-47cf-941a-2e6767a4a9b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:33.519611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-431ddc68-4e4c-47cf-941a-2e6767a4a9b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:33.520390 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-431ddc68-4e4c-47cf-941a-2e6767a4a9b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:33.520856 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-431ddc68-4e4c-47cf-941a-2e6767a4a9b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:33.547317 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-431ddc68-4e4c-47cf-941a-2e6767a4a9b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 05:03:33.633568 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-431ddc68-4e4c-47cf-941a-2e6767a4a9b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "DELETE /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 204 len: 0 microversion: 2.1 time: 0.128984 Jul 28 05:03:33.635391 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5287/7737] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 05:03:33 2022] DELETE /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:03:33.705214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6c904712-7f43-483e-a320-9fe06c37758d req-b55603cd-a991-40a0-9e74-96a285efa221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa725ad1-e549-4c72-800f-fbe622dfcbd8", "tag": "40f077ac-b614-43da-b8e0-d9db2eaf9c3d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:03:33.715689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6c904712-7f43-483e-a320-9fe06c37758d req-b55603cd-a991-40a0-9e74-96a285efa221 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:33.716141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6c904712-7f43-483e-a320-9fe06c37758d req-b55603cd-a991-40a0-9e74-96a285efa221 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:33.731823 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6c904712-7f43-483e-a320-9fe06c37758d req-b55603cd-a991-40a0-9e74-96a285efa221 service nova] Creating event network-changed:40f077ac-b614-43da-b8e0-d9db2eaf9c3d for instance aa725ad1-e549-4c72-800f-fbe622dfcbd8 on n-h2-826756-3 Jul 28 05:03:33.736966 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6c904712-7f43-483e-a320-9fe06c37758d req-b55603cd-a991-40a0-9e74-96a285efa221 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100381 Jul 28 05:03:33.737590 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5288/7738] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:03:33.742908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3703e520-b0a1-497b-b9d1-24b3d8dbfc4a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:03:33.743617 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3703e520-b0a1-497b-b9d1-24b3d8dbfc4a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:03:33.752194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3703e520-b0a1-497b-b9d1-24b3d8dbfc4a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:33.752683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3703e520-b0a1-497b-b9d1-24b3d8dbfc4a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:33.753475 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3703e520-b0a1-497b-b9d1-24b3d8dbfc4a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:33.753924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3703e520-b0a1-497b-b9d1-24b3d8dbfc4a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:33.929872 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3703e520-b0a1-497b-b9d1-24b3d8dbfc4a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:03:33.938413 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3703e520-b0a1-497b-b9d1-24b3d8dbfc4a tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1682 microversion: 2.1 time: 0.199496 Jul 28 05:03:33.939234 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5289/7739] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:03:33 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1682 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:03:34.962597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cbc714d0-523c-43e7-afd5-a8e66e561a16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:03:34.963292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cbc714d0-523c-43e7-afd5-a8e66e561a16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:03:34.972740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbc714d0-523c-43e7-afd5-a8e66e561a16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:34.973461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbc714d0-523c-43e7-afd5-a8e66e561a16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:34.975169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbc714d0-523c-43e7-afd5-a8e66e561a16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:34.975894 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cbc714d0-523c-43e7-afd5-a8e66e561a16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:35.126132 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cbc714d0-523c-43e7-afd5-a8e66e561a16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:03:35.136260 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cbc714d0-523c-43e7-afd5-a8e66e561a16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1682 microversion: 2.1 time: 0.178670 Jul 28 05:03:35.137203 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5290/7740] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:03:34 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:03:36.162104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-51a321b9-3ed5-4da1-ba5d-5a4326cc44da tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:03:36.162739 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-51a321b9-3ed5-4da1-ba5d-5a4326cc44da tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:03:36.170750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51a321b9-3ed5-4da1-ba5d-5a4326cc44da tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:36.171241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51a321b9-3ed5-4da1-ba5d-5a4326cc44da tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:36.172081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51a321b9-3ed5-4da1-ba5d-5a4326cc44da tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:36.172564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-51a321b9-3ed5-4da1-ba5d-5a4326cc44da tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:36.248221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-51a321b9-3ed5-4da1-ba5d-5a4326cc44da tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:03:36.263279 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-51a321b9-3ed5-4da1-ba5d-5a4326cc44da tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 200 len: 1614 microversion: 2.1 time: 0.104665 Jul 28 05:03:36.264394 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5291/7741] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:03:36 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 1614 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:03:36.273233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f8dd1e2a-0c14-4307-9e16-e2614f0cfdbd req-e50f1cdd-409c-476d-a758-3bd0c2648bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa725ad1-e549-4c72-800f-fbe622dfcbd8", "name": "network-vif-deleted", "tag": "40f077ac-b614-43da-b8e0-d9db2eaf9c3d"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:03:36.290926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f8dd1e2a-0c14-4307-9e16-e2614f0cfdbd req-e50f1cdd-409c-476d-a758-3bd0c2648bb8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:36.291743 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f8dd1e2a-0c14-4307-9e16-e2614f0cfdbd req-e50f1cdd-409c-476d-a758-3bd0c2648bb8 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:36.311855 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f8dd1e2a-0c14-4307-9e16-e2614f0cfdbd req-e50f1cdd-409c-476d-a758-3bd0c2648bb8 service nova] Creating event network-vif-deleted:40f077ac-b614-43da-b8e0-d9db2eaf9c3d for instance aa725ad1-e549-4c72-800f-fbe622dfcbd8 on n-h2-826756-3 Jul 28 05:03:36.321683 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f8dd1e2a-0c14-4307-9e16-e2614f0cfdbd req-e50f1cdd-409c-476d-a758-3bd0c2648bb8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054349 Jul 28 05:03:36.323392 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5292/7742] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:03:37.296554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0efee946-1862-4948-94ab-257f85d0b2fe tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:03:37.298532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0efee946-1862-4948-94ab-257f85d0b2fe tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: aa725ad1-e549-4c72-800f-fbe622dfcbd8] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:03:37.309601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0efee946-1862-4948-94ab-257f85d0b2fe tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:37.310258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0efee946-1862-4948-94ab-257f85d0b2fe tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:37.311580 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0efee946-1862-4948-94ab-257f85d0b2fe tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:37.312391 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0efee946-1862-4948-94ab-257f85d0b2fe tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:37.326240 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-0efee946-1862-4948-94ab-257f85d0b2fe tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] HTTP exception thrown: Instance aa725ad1-e549-4c72-800f-fbe622dfcbd8 could not be found. Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0efee946-1862-4948-94ab-257f85d0b2fe tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Request method failure captured: Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 HTTP/1.1 Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hej5pF3NoUG0PjUC2qy_7ucWfuEJt-aFfyUReiW9Y4qoRJCiK5IWlu4VSxFlvESjzOeS5-T1SXDceRvyCDFdC6BF70tkJoSY9Wu9hCg4lfd3dMmoX8bGXChZZvNIdi4nAXd8tlm1Yubjrn8vadM3NpHghRJVEEL-bhyzToift1hfYE Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 6e64d19a30d2478380930f9a28dff537 Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestShelveInstance-1846789331 Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6e64d19a30d2478380930f9a28dff537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e64d19a30d2478380930f9a28dff537"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6e64d19a30d2478380930f9a28dff537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e64d19a30d2478380930f9a28dff537"}]}] Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestShelveInstance-1846789331 Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 6e64d19a30d2478380930f9a28dff537 Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestShelveInstance-1846789331 Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestShelveInstance-1846789331-project Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 02ff7645527c4da6ade041db6d0024b0 Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestShelveInstance-1846789331-project Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance aa725ad1-e549-4c72-800f-fbe622dfcbd8 could not be found. Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': 'aa725ad1-e549-4c72-800f-fbe622dfcbd8'} Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa725ad1-e549-4c72-800f-fbe622dfcbd8 could not be found. Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa725ad1-e549-4c72-800f-fbe622dfcbd8 could not be found. Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:03:37.327919 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:03:37.332648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:03:37.332648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:03:37.332648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:03:37.332648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:03:37.332648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:03:37.332648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa725ad1-e549-4c72-800f-fbe622dfcbd8 could not be found. Jul 28 05:03:37.332648 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:03:37.332648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0efee946-1862-4948-94ab-257f85d0b2fe tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Returning 404 to user: Instance aa725ad1-e549-4c72-800f-fbe622dfcbd8 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:03:37.332648 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0efee946-1862-4948-94ab-257f85d0b2fe tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8" status: 404 len: 111 microversion: 2.1 time: 0.042530 Jul 28 05:03:37.332648 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5293/7743] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:03:37 2022] GET /compute/v2.1/servers/aa725ad1-e549-4c72-800f-fbe622dfcbd8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:03:37.465338 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:03:37.465986 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 05:03:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 05:03:37.502485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e9290626-97bc-4259-9e77-450dfc2374f7 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '.version_select at 0x7ffa678f1b80>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:03:37.533462 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e9290626-97bc-4259-9e77-450dfc2374f7 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1752476361" status: 202 len: 0 microversion: 2.1 time: 0.034955 Jul 28 05:03:37.534061 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5294/7744] 10.222.0.48 () {58 vars in 1254 bytes} [Thu Jul 28 05:03:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1752476361 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:03:37.557095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-df9b6213-1004-473b-b18e-52279b6a4291 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Action: 'create', calling method: .version_select at 0x7ffa67ac03a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1377352174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIozgv1RVXDE+ltgnHDZAWKQt0pP+MeJWzzr7ImiKPEwtw62vSaJtF7+8GgXzunuyizqvOa2sG9fKGN63sv6MzzL1uVqESeDPIA/jYYExDSV090Mn36YgLo80/34+8x07Q=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:03:37.573778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-df9b6213-1004-473b-b18e-52279b6a4291 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Getting quotas for project 6e64d19a30d2478380930f9a28dff537. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:03:37.578912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-df9b6213-1004-473b-b18e-52279b6a4291 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Getting quotas for user 02ff7645527c4da6ade041db6d0024b0 and project 6e64d19a30d2478380930f9a28dff537. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:03:37.605324 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-df9b6213-1004-473b-b18e-52279b6a4291 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.052153 Jul 28 05:03:37.605958 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5295/7745] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 05:03:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:03:54.979759 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:03:54.980564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:03:54.981040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:03:54.986140 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-470729971", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1377352174", "security_groups": [{"name": "tempest-secgroup-smoke-573344333"}], "networks": [{"uuid": "72241c34-8705-42f4-80ea-781a167b6838"}], "block_device_mapping_v2": [{"uuid": "95a147b1-b6be-46f6-8588-3e47ace460b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:03:55.118230 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] validate_networks() for [('72241c34-8705-42f4-80ea-781a167b6838', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:03:55.545526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:03:55.545991 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:03:55.546503 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:03:55.546900 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:03:55.547324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:03:55.557082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:55.557546 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:55.558349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:55.558801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:55.575913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Getting quotas for project 6e64d19a30d2478380930f9a28dff537. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:03:55.581686 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Getting quotas for user 02ff7645527c4da6ade041db6d0024b0 and project 6e64d19a30d2478380930f9a28dff537. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:03:55.645837 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:03:55.647998 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='95a147b1-b6be-46f6-8588-3e47ace460b4',volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 05:03:55.793204 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-2ebe8421-19cf-4eb7-a873-5ba6be361048 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.815841 Jul 28 05:03:55.793786 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5296/7746] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 05:03:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 05:03:55.804553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f290950f-7e54-40e8-946a-241cdc7e4cf1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:03:55.805183 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f290950f-7e54-40e8-946a-241cdc7e4cf1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:03:55.864804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f290950f-7e54-40e8-946a-241cdc7e4cf1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:03:55.872206 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f290950f-7e54-40e8-946a-241cdc7e4cf1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1088 microversion: 2.1 time: 0.071471 Jul 28 05:03:55.872833 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5297/7747] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:03:55 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:03:56.894635 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7ca2ce8f-b164-4d82-a966-4f29d47455cf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:03:56.895354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7ca2ce8f-b164-4d82-a966-4f29d47455cf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:03:56.902549 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ca2ce8f-b164-4d82-a966-4f29d47455cf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:56.903014 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ca2ce8f-b164-4d82-a966-4f29d47455cf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:56.903815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ca2ce8f-b164-4d82-a966-4f29d47455cf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:56.904260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7ca2ce8f-b164-4d82-a966-4f29d47455cf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:56.978732 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7ca2ce8f-b164-4d82-a966-4f29d47455cf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:03:56.987201 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7ca2ce8f-b164-4d82-a966-4f29d47455cf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1194 microversion: 2.1 time: 0.097341 Jul 28 05:03:56.988135 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5298/7748] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:03:56 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:03:58.008571 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-57457218-1190-4043-be00-536366c968a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:03:58.010198 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-57457218-1190-4043-be00-536366c968a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:03:58.017964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57457218-1190-4043-be00-536366c968a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:58.018435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57457218-1190-4043-be00-536366c968a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:58.019235 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57457218-1190-4043-be00-536366c968a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:58.019859 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-57457218-1190-4043-be00-536366c968a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:58.167062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-57457218-1190-4043-be00-536366c968a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:03:58.176847 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-57457218-1190-4043-be00-536366c968a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1271 microversion: 2.1 time: 0.172221 Jul 28 05:03:58.178612 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5299/7749] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:03:58 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1271 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:03:58.393748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-931d8d3f-cac9-4ad1-8bf6-fb26318f69d4 req-0696008d-523f-4401-af6d-03aed5b6dcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9979bb51-6e04-4f28-9e88-9ff0d11bb734", "tag": "271e55c4-4f54-4d1c-9383-c87da3b3d8e8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:03:58.409144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-931d8d3f-cac9-4ad1-8bf6-fb26318f69d4 req-0696008d-523f-4401-af6d-03aed5b6dcb6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:58.409664 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-931d8d3f-cac9-4ad1-8bf6-fb26318f69d4 req-0696008d-523f-4401-af6d-03aed5b6dcb6 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:58.425516 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-931d8d3f-cac9-4ad1-8bf6-fb26318f69d4 req-0696008d-523f-4401-af6d-03aed5b6dcb6 service nova] Creating event network-changed:271e55c4-4f54-4d1c-9383-c87da3b3d8e8 for instance 9979bb51-6e04-4f28-9e88-9ff0d11bb734 on n-h2-826756-3 Jul 28 05:03:58.437209 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-931d8d3f-cac9-4ad1-8bf6-fb26318f69d4 req-0696008d-523f-4401-af6d-03aed5b6dcb6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048995 Jul 28 05:03:58.437840 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5300/7750] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:03:59.203236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f694078a-d36d-4bfb-9c7f-a18bb3ad489b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:03:59.204812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f694078a-d36d-4bfb-9c7f-a18bb3ad489b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:03:59.211461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f694078a-d36d-4bfb-9c7f-a18bb3ad489b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:59.212010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f694078a-d36d-4bfb-9c7f-a18bb3ad489b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:59.213092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f694078a-d36d-4bfb-9c7f-a18bb3ad489b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:03:59.213465 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f694078a-d36d-4bfb-9c7f-a18bb3ad489b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:03:59.358154 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f694078a-d36d-4bfb-9c7f-a18bb3ad489b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:03:59.367935 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f694078a-d36d-4bfb-9c7f-a18bb3ad489b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1271 microversion: 2.1 time: 0.168909 Jul 28 05:03:59.380627 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5301/7751] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:03:59 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:04:00.390181 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bf0a4188-0f66-45fa-8db8-77bf60405d09 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:00.390854 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bf0a4188-0f66-45fa-8db8-77bf60405d09 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:00.398418 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf0a4188-0f66-45fa-8db8-77bf60405d09 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:00.398906 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf0a4188-0f66-45fa-8db8-77bf60405d09 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:00.399753 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf0a4188-0f66-45fa-8db8-77bf60405d09 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:00.400315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bf0a4188-0f66-45fa-8db8-77bf60405d09 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:00.536909 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bf0a4188-0f66-45fa-8db8-77bf60405d09 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:00.544937 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bf0a4188-0f66-45fa-8db8-77bf60405d09 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1271 microversion: 2.1 time: 0.158858 Jul 28 05:04:00.545520 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5302/7752] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:00 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:04:01.566829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0de9fbd2-a87d-4fa7-88fb-1f4749ef1d1c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:01.567550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0de9fbd2-a87d-4fa7-88fb-1f4749ef1d1c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:01.575074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0de9fbd2-a87d-4fa7-88fb-1f4749ef1d1c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:01.575543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0de9fbd2-a87d-4fa7-88fb-1f4749ef1d1c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:01.576380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0de9fbd2-a87d-4fa7-88fb-1f4749ef1d1c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:01.576817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0de9fbd2-a87d-4fa7-88fb-1f4749ef1d1c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:01.713877 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0de9fbd2-a87d-4fa7-88fb-1f4749ef1d1c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:01.722093 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0de9fbd2-a87d-4fa7-88fb-1f4749ef1d1c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1271 microversion: 2.1 time: 0.159404 Jul 28 05:04:01.722675 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5303/7753] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:01 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:04:02.743667 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d80b01de-b259-4ccb-9b79-c7c0c1b9dcbb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:02.744290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d80b01de-b259-4ccb-9b79-c7c0c1b9dcbb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:02.751804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d80b01de-b259-4ccb-9b79-c7c0c1b9dcbb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:02.752322 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d80b01de-b259-4ccb-9b79-c7c0c1b9dcbb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:02.753125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d80b01de-b259-4ccb-9b79-c7c0c1b9dcbb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:02.753577 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d80b01de-b259-4ccb-9b79-c7c0c1b9dcbb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:02.953679 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d80b01de-b259-4ccb-9b79-c7c0c1b9dcbb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:02.961710 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d80b01de-b259-4ccb-9b79-c7c0c1b9dcbb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1259 microversion: 2.1 time: 0.222114 Jul 28 05:04:02.962306 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5304/7754] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:02 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:04:03.988378 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-76989020-bd23-41f6-9be1-085f21127661 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:03.989118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-76989020-bd23-41f6-9be1-085f21127661 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:03.997264 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76989020-bd23-41f6-9be1-085f21127661 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:03.997782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76989020-bd23-41f6-9be1-085f21127661 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:03.998657 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76989020-bd23-41f6-9be1-085f21127661 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:03.999160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-76989020-bd23-41f6-9be1-085f21127661 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:04.149040 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-76989020-bd23-41f6-9be1-085f21127661 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:04.157378 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-76989020-bd23-41f6-9be1-085f21127661 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1259 microversion: 2.1 time: 0.175716 Jul 28 05:04:04.157964 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5305/7755] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:03 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:04:05.183843 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b8a82022-859a-43c3-804b-d447fc83529f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:05.184552 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b8a82022-859a-43c3-804b-d447fc83529f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:05.196540 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8a82022-859a-43c3-804b-d447fc83529f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:05.196993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8a82022-859a-43c3-804b-d447fc83529f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:05.197805 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8a82022-859a-43c3-804b-d447fc83529f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:05.198261 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8a82022-859a-43c3-804b-d447fc83529f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:05.351434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8a82022-859a-43c3-804b-d447fc83529f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:05.363408 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b8a82022-859a-43c3-804b-d447fc83529f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1259 microversion: 2.1 time: 0.187530 Jul 28 05:04:05.363966 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5306/7756] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:05 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:04:06.384800 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-beea12d3-2940-4884-83a3-6c46d58c8ff4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:06.385534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-beea12d3-2940-4884-83a3-6c46d58c8ff4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:06.387659 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:04:06.388454 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:04:06.395214 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-beea12d3-2940-4884-83a3-6c46d58c8ff4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:06.395683 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-beea12d3-2940-4884-83a3-6c46d58c8ff4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:06.396494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-beea12d3-2940-4884-83a3-6c46d58c8ff4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:06.396946 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-beea12d3-2940-4884-83a3-6c46d58c8ff4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:06.532902 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-beea12d3-2940-4884-83a3-6c46d58c8ff4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:06.544673 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-beea12d3-2940-4884-83a3-6c46d58c8ff4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1259 microversion: 2.1 time: 0.163510 Jul 28 05:04:06.545652 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5307/7757] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:06 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:04:07.574951 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9300d0a5-bce2-49e2-9935-f4496dd73336 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:07.575897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9300d0a5-bce2-49e2-9935-f4496dd73336 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:07.584413 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9300d0a5-bce2-49e2-9935-f4496dd73336 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:07.584911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9300d0a5-bce2-49e2-9935-f4496dd73336 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:07.585688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9300d0a5-bce2-49e2-9935-f4496dd73336 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:07.586137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9300d0a5-bce2-49e2-9935-f4496dd73336 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:07.737328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9300d0a5-bce2-49e2-9935-f4496dd73336 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:07.747093 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9300d0a5-bce2-49e2-9935-f4496dd73336 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1259 microversion: 2.1 time: 0.176944 Jul 28 05:04:07.747679 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5308/7758] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:07 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:04:08.773313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f428853e-3f11-4ea3-ad72-7c9c0b09a13f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:08.774410 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f428853e-3f11-4ea3-ad72-7c9c0b09a13f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:08.786143 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f428853e-3f11-4ea3-ad72-7c9c0b09a13f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:08.786912 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f428853e-3f11-4ea3-ad72-7c9c0b09a13f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:08.788185 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f428853e-3f11-4ea3-ad72-7c9c0b09a13f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:08.788934 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f428853e-3f11-4ea3-ad72-7c9c0b09a13f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:08.943726 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f428853e-3f11-4ea3-ad72-7c9c0b09a13f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:08.956651 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f428853e-3f11-4ea3-ad72-7c9c0b09a13f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1259 microversion: 2.1 time: 0.189829 Jul 28 05:04:08.957557 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5309/7759] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:08 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:04:09.984302 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7447aa8e-3d96-4928-9e6b-e2a3db9742f5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:09.985470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7447aa8e-3d96-4928-9e6b-e2a3db9742f5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:09.996005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7447aa8e-3d96-4928-9e6b-e2a3db9742f5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:09.996508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7447aa8e-3d96-4928-9e6b-e2a3db9742f5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:09.997299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7447aa8e-3d96-4928-9e6b-e2a3db9742f5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:09.997752 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7447aa8e-3d96-4928-9e6b-e2a3db9742f5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:10.138404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7447aa8e-3d96-4928-9e6b-e2a3db9742f5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:10.150152 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7447aa8e-3d96-4928-9e6b-e2a3db9742f5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1259 microversion: 2.1 time: 0.172241 Jul 28 05:04:10.150780 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5310/7760] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:09 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:04:11.179102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-56e935db-7325-4be1-a6b9-6af1b6791e4f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:11.179778 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-56e935db-7325-4be1-a6b9-6af1b6791e4f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:11.187612 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56e935db-7325-4be1-a6b9-6af1b6791e4f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:11.188080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56e935db-7325-4be1-a6b9-6af1b6791e4f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:11.188899 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56e935db-7325-4be1-a6b9-6af1b6791e4f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:11.189351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-56e935db-7325-4be1-a6b9-6af1b6791e4f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:11.344742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-56e935db-7325-4be1-a6b9-6af1b6791e4f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:11.353605 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-56e935db-7325-4be1-a6b9-6af1b6791e4f tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1259 microversion: 2.1 time: 0.180619 Jul 28 05:04:11.354203 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5311/7761] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:11 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:04:12.378958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-0c4f0e07-d346-470a-aabe-f6710a0de975 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:12.380070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-0c4f0e07-d346-470a-aabe-f6710a0de975 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:12.389005 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c4f0e07-d346-470a-aabe-f6710a0de975 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:12.389471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c4f0e07-d346-470a-aabe-f6710a0de975 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:12.390260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c4f0e07-d346-470a-aabe-f6710a0de975 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:12.390710 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-0c4f0e07-d346-470a-aabe-f6710a0de975 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:12.534146 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-0c4f0e07-d346-470a-aabe-f6710a0de975 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:12.542717 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-0c4f0e07-d346-470a-aabe-f6710a0de975 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1259 microversion: 2.1 time: 0.170417 Jul 28 05:04:12.543268 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5312/7762] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:12 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:04:13.006195 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-efdad2a9-e380-4268-a075-84a0de522cb6 req-ecf8a4d2-7c02-453d-a032-a93a5caff632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9979bb51-6e04-4f28-9e88-9ff0d11bb734", "name": "network-vif-plugged", "status": "completed", "tag": "271e55c4-4f54-4d1c-9383-c87da3b3d8e8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:04:13.016028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-efdad2a9-e380-4268-a075-84a0de522cb6 req-ecf8a4d2-7c02-453d-a032-a93a5caff632 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:13.016437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-efdad2a9-e380-4268-a075-84a0de522cb6 req-ecf8a4d2-7c02-453d-a032-a93a5caff632 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:13.027250 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-efdad2a9-e380-4268-a075-84a0de522cb6 req-ecf8a4d2-7c02-453d-a032-a93a5caff632 service nova] Creating event network-vif-plugged:271e55c4-4f54-4d1c-9383-c87da3b3d8e8 for instance 9979bb51-6e04-4f28-9e88-9ff0d11bb734 on n-h2-826756-3 Jul 28 05:04:13.032475 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-efdad2a9-e380-4268-a075-84a0de522cb6 req-ecf8a4d2-7c02-453d-a032-a93a5caff632 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102300 Jul 28 05:04:13.033346 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5313/7763] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:04:13.564908 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e806ca29-db64-4cf5-949e-e7302cdb18b9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:13.565613 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e806ca29-db64-4cf5-949e-e7302cdb18b9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:13.571924 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e806ca29-db64-4cf5-949e-e7302cdb18b9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:13.572412 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e806ca29-db64-4cf5-949e-e7302cdb18b9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:13.573241 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e806ca29-db64-4cf5-949e-e7302cdb18b9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:13.573688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e806ca29-db64-4cf5-949e-e7302cdb18b9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:13.725487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e806ca29-db64-4cf5-949e-e7302cdb18b9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:13.734269 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e806ca29-db64-4cf5-949e-e7302cdb18b9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1259 microversion: 2.1 time: 0.174615 Jul 28 05:04:13.734861 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5314/7764] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:13 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:04:14.755381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a32b7f5c-4652-4d09-92ae-70eb05814388 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:14.756101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a32b7f5c-4652-4d09-92ae-70eb05814388 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:14.763864 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a32b7f5c-4652-4d09-92ae-70eb05814388 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:14.764393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a32b7f5c-4652-4d09-92ae-70eb05814388 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:14.765188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a32b7f5c-4652-4d09-92ae-70eb05814388 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:14.765639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a32b7f5c-4652-4d09-92ae-70eb05814388 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:14.784981 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=100 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:04:14.911779 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a32b7f5c-4652-4d09-92ae-70eb05814388 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:14.920010 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a32b7f5c-4652-4d09-92ae-70eb05814388 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1259 microversion: 2.1 time: 0.168672 Jul 28 05:04:14.920641 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5315/7765] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:14 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:04:15.942052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44806add-5b21-4224-8b4c-3178cf1cbe2b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:15.942777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-44806add-5b21-4224-8b4c-3178cf1cbe2b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:15.950323 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44806add-5b21-4224-8b4c-3178cf1cbe2b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:15.950793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44806add-5b21-4224-8b4c-3178cf1cbe2b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:15.951585 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44806add-5b21-4224-8b4c-3178cf1cbe2b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:15.952041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44806add-5b21-4224-8b4c-3178cf1cbe2b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:16.087714 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44806add-5b21-4224-8b4c-3178cf1cbe2b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:16.095755 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-44806add-5b21-4224-8b4c-3178cf1cbe2b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1442 microversion: 2.1 time: 0.157851 Jul 28 05:04:16.096345 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5316/7766] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:15 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1442 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:04:16.116887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47c3dd6c-4f5f-4e51-b7d5-15eaedc382d4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:04:16.117556 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-47c3dd6c-4f5f-4e51-b7d5-15eaedc382d4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:04:16.123911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47c3dd6c-4f5f-4e51-b7d5-15eaedc382d4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:16.124387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47c3dd6c-4f5f-4e51-b7d5-15eaedc382d4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:16.125194 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47c3dd6c-4f5f-4e51-b7d5-15eaedc382d4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:16.125646 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47c3dd6c-4f5f-4e51-b7d5-15eaedc382d4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:16.261665 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-47c3dd6c-4f5f-4e51-b7d5-15eaedc382d4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:04:16.269996 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-47c3dd6c-4f5f-4e51-b7d5-15eaedc382d4 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1442 microversion: 2.1 time: 0.156986 Jul 28 05:04:16.270620 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5317/7767] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:04:16 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:04:18.018875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-8c956319-1d58-4e1b-957b-001346d9a359 req-e7aa5094-67d4-4508-980a-8aedc0c9c7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9979bb51-6e04-4f28-9e88-9ff0d11bb734", "tag": "271e55c4-4f54-4d1c-9383-c87da3b3d8e8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:04:18.029028 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8c956319-1d58-4e1b-957b-001346d9a359 req-e7aa5094-67d4-4508-980a-8aedc0c9c7d2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:04:18.029523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-8c956319-1d58-4e1b-957b-001346d9a359 req-e7aa5094-67d4-4508-980a-8aedc0c9c7d2 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:04:18.044701 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-8c956319-1d58-4e1b-957b-001346d9a359 req-e7aa5094-67d4-4508-980a-8aedc0c9c7d2 service nova] Creating event network-changed:271e55c4-4f54-4d1c-9383-c87da3b3d8e8 for instance 9979bb51-6e04-4f28-9e88-9ff0d11bb734 on n-h2-826756-3 Jul 28 05:04:18.051939 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-8c956319-1d58-4e1b-957b-001346d9a359 req-e7aa5094-67d4-4508-980a-8aedc0c9c7d2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152698 Jul 28 05:04:18.055898 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5318/7768] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:05:05.913662 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:05:05.914739 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 05:05:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 05:06:15.281378 n-d-826756-3 devstack@n-api.service[126071]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3383c6d1-bf1b-4640-b860-3d2b5f70fe2b] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 28 05:06:15.282214 n-d-826756-3 devstack@n-api.service[126071]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58ec63bc-5462-40de-8ca8-e5ce0d7dbc1c] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 05:06:15.282945 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:06:15.283692 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=16 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:06:15.347999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-61b8331e-1c72-49fe-b40a-feda42b5a5b5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:06:15.348678 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-61b8331e-1c72-49fe-b40a-feda42b5a5b5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:15.355468 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61b8331e-1c72-49fe-b40a-feda42b5a5b5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:15.355931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61b8331e-1c72-49fe-b40a-feda42b5a5b5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:15.356744 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61b8331e-1c72-49fe-b40a-feda42b5a5b5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:15.357193 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-61b8331e-1c72-49fe-b40a-feda42b5a5b5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:15.380389 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-61b8331e-1c72-49fe-b40a-feda42b5a5b5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lazy-loading 'flavor' on Instance uuid 9979bb51-6e04-4f28-9e88-9ff0d11bb734 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:06:15.458538 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-61b8331e-1c72-49fe-b40a-feda42b5a5b5 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "POST /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734/action" status: 202 len: 0 microversion: 2.1 time: 0.179937 Jul 28 05:06:15.459108 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5319/7769] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 05:06:15 2022] POST /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:06:15.468016 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1cae690b-1728-432a-8241-6b5919f6ac2c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:15.468561 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-1cae690b-1728-432a-8241-6b5919f6ac2c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:15.475479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cae690b-1728-432a-8241-6b5919f6ac2c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:15.476174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cae690b-1728-432a-8241-6b5919f6ac2c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:15.477062 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cae690b-1728-432a-8241-6b5919f6ac2c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:15.477521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-1cae690b-1728-432a-8241-6b5919f6ac2c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:15.629829 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-1cae690b-1728-432a-8241-6b5919f6ac2c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:15.638801 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1cae690b-1728-432a-8241-6b5919f6ac2c tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1566 microversion: 2.1 time: 0.175092 Jul 28 05:06:15.639375 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5320/7770] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:15 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:16.662772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ca4de176-c264-4fba-ae1b-0d3d52e5e8e2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:16.663498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ca4de176-c264-4fba-ae1b-0d3d52e5e8e2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:16.674570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca4de176-c264-4fba-ae1b-0d3d52e5e8e2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:16.675043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca4de176-c264-4fba-ae1b-0d3d52e5e8e2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:16.675979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca4de176-c264-4fba-ae1b-0d3d52e5e8e2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:16.676544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ca4de176-c264-4fba-ae1b-0d3d52e5e8e2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:16.681524 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] [58ec63bc-5462-40de-8ca8-e5ce0d7dbc1c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 42356. Jul 28 05:06:16.684627 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] [3383c6d1-bf1b-4640-b860-3d2b5f70fe2b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 42354. Jul 28 05:06:16.821206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ca4de176-c264-4fba-ae1b-0d3d52e5e8e2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:16.829550 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ca4de176-c264-4fba-ae1b-0d3d52e5e8e2 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1566 microversion: 2.1 time: 0.170789 Jul 28 05:06:16.830118 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5321/7771] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:16 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:17.852439 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b0fdcb99-d422-4e0f-a4f3-fd99f6875545 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:17.853506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b0fdcb99-d422-4e0f-a4f3-fd99f6875545 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:17.861755 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0fdcb99-d422-4e0f-a4f3-fd99f6875545 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:17.862318 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0fdcb99-d422-4e0f-a4f3-fd99f6875545 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:17.862993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0fdcb99-d422-4e0f-a4f3-fd99f6875545 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:17.863451 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b0fdcb99-d422-4e0f-a4f3-fd99f6875545 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:18.016160 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b0fdcb99-d422-4e0f-a4f3-fd99f6875545 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:18.024287 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b0fdcb99-d422-4e0f-a4f3-fd99f6875545 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1566 microversion: 2.1 time: 0.176654 Jul 28 05:06:18.024906 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5322/7772] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:17 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:19.046932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ada7734-6e46-4b6c-8e85-8e4c9000eeaf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:19.046932 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ada7734-6e46-4b6c-8e85-8e4c9000eeaf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:19.054237 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ada7734-6e46-4b6c-8e85-8e4c9000eeaf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:19.054711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ada7734-6e46-4b6c-8e85-8e4c9000eeaf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:19.055926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ada7734-6e46-4b6c-8e85-8e4c9000eeaf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:19.056422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ada7734-6e46-4b6c-8e85-8e4c9000eeaf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:19.194148 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ada7734-6e46-4b6c-8e85-8e4c9000eeaf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:19.202605 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ada7734-6e46-4b6c-8e85-8e4c9000eeaf tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1566 microversion: 2.1 time: 0.160800 Jul 28 05:06:19.203161 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5323/7773] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:19 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:20.229770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c7cb6842-9c95-4b00-ba06-bef71d1146df tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:20.230694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c7cb6842-9c95-4b00-ba06-bef71d1146df tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:20.241564 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7cb6842-9c95-4b00-ba06-bef71d1146df tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:20.242030 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7cb6842-9c95-4b00-ba06-bef71d1146df tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:20.242814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7cb6842-9c95-4b00-ba06-bef71d1146df tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:20.243252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c7cb6842-9c95-4b00-ba06-bef71d1146df tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:20.395725 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c7cb6842-9c95-4b00-ba06-bef71d1146df tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:20.404225 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c7cb6842-9c95-4b00-ba06-bef71d1146df tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1566 microversion: 2.1 time: 0.181815 Jul 28 05:06:20.404811 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5324/7774] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:20 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:21.428504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a8d45ca8-23b7-453e-a489-0cca9b34cd72 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:21.429353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a8d45ca8-23b7-453e-a489-0cca9b34cd72 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:21.438289 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8d45ca8-23b7-453e-a489-0cca9b34cd72 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:21.438748 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8d45ca8-23b7-453e-a489-0cca9b34cd72 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:21.439521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8d45ca8-23b7-453e-a489-0cca9b34cd72 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:21.439962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8d45ca8-23b7-453e-a489-0cca9b34cd72 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:21.575470 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a8d45ca8-23b7-453e-a489-0cca9b34cd72 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:21.583979 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a8d45ca8-23b7-453e-a489-0cca9b34cd72 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1566 microversion: 2.1 time: 0.161174 Jul 28 05:06:21.584591 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5325/7775] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:21 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:22.606499 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b8010d6c-2405-4e8a-9e91-b1930d480b03 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:22.607295 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b8010d6c-2405-4e8a-9e91-b1930d480b03 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:22.614516 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8010d6c-2405-4e8a-9e91-b1930d480b03 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:22.614976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8010d6c-2405-4e8a-9e91-b1930d480b03 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:22.615749 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8010d6c-2405-4e8a-9e91-b1930d480b03 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:22.616226 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b8010d6c-2405-4e8a-9e91-b1930d480b03 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:22.758643 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b8010d6c-2405-4e8a-9e91-b1930d480b03 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:22.769298 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b8010d6c-2405-4e8a-9e91-b1930d480b03 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1566 microversion: 2.1 time: 0.166809 Jul 28 05:06:22.770189 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5326/7776] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:22 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:23.799207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-50123e84-4848-4299-8a71-154be9b8650e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:23.799207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-50123e84-4848-4299-8a71-154be9b8650e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:23.806828 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50123e84-4848-4299-8a71-154be9b8650e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:23.807282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50123e84-4848-4299-8a71-154be9b8650e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:23.808104 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50123e84-4848-4299-8a71-154be9b8650e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:23.808574 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-50123e84-4848-4299-8a71-154be9b8650e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:23.956943 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-50123e84-4848-4299-8a71-154be9b8650e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:23.965177 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-50123e84-4848-4299-8a71-154be9b8650e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1566 microversion: 2.1 time: 0.171554 Jul 28 05:06:23.965758 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5327/7777] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:23 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:24.987355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-efeaac33-3354-4cd6-b358-aa3b0b5c5644 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:24.988105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-efeaac33-3354-4cd6-b358-aa3b0b5c5644 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:24.995636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efeaac33-3354-4cd6-b358-aa3b0b5c5644 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:24.996105 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efeaac33-3354-4cd6-b358-aa3b0b5c5644 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:24.996931 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efeaac33-3354-4cd6-b358-aa3b0b5c5644 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:24.997384 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-efeaac33-3354-4cd6-b358-aa3b0b5c5644 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:25.145814 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-efeaac33-3354-4cd6-b358-aa3b0b5c5644 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:25.155103 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-efeaac33-3354-4cd6-b358-aa3b0b5c5644 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1566 microversion: 2.1 time: 0.171770 Jul 28 05:06:25.155689 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5328/7778] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:24 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:26.176670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-533b8748-2b8d-4bf2-8abe-5641080c81a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:26.177339 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-533b8748-2b8d-4bf2-8abe-5641080c81a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:26.184844 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-533b8748-2b8d-4bf2-8abe-5641080c81a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:26.185307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-533b8748-2b8d-4bf2-8abe-5641080c81a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:26.186093 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-533b8748-2b8d-4bf2-8abe-5641080c81a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:26.186537 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-533b8748-2b8d-4bf2-8abe-5641080c81a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:26.653179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-533b8748-2b8d-4bf2-8abe-5641080c81a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:26.663106 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-533b8748-2b8d-4bf2-8abe-5641080c81a3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1566 microversion: 2.1 time: 0.490430 Jul 28 05:06:26.663106 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5329/7779] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:26 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1566 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:27.687691 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2fe96b4-0436-47fb-a195-297d8947b5fa tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:27.688404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d2fe96b4-0436-47fb-a195-297d8947b5fa tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:27.696006 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2fe96b4-0436-47fb-a195-297d8947b5fa tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:27.696534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2fe96b4-0436-47fb-a195-297d8947b5fa tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:27.697422 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2fe96b4-0436-47fb-a195-297d8947b5fa tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:27.697880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2fe96b4-0436-47fb-a195-297d8947b5fa tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:27.847220 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d2fe96b4-0436-47fb-a195-297d8947b5fa tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:27.859789 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d2fe96b4-0436-47fb-a195-297d8947b5fa tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1566 microversion: 2.1 time: 0.176079 Jul 28 05:06:27.860785 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5330/7780] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:27 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:28.886879 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e44719ce-f533-4a86-be0a-7806b85c3155 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:28.887597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e44719ce-f533-4a86-be0a-7806b85c3155 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:28.895131 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e44719ce-f533-4a86-be0a-7806b85c3155 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:28.895598 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e44719ce-f533-4a86-be0a-7806b85c3155 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:28.896383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e44719ce-f533-4a86-be0a-7806b85c3155 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:28.896869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e44719ce-f533-4a86-be0a-7806b85c3155 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:29.040730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e44719ce-f533-4a86-be0a-7806b85c3155 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:29.050098 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e44719ce-f533-4a86-be0a-7806b85c3155 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1566 microversion: 2.1 time: 0.167095 Jul 28 05:06:29.051556 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5331/7781] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:28 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:30.072095 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-19e82d04-16aa-43e1-8312-cd9a6270e54b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:30.072833 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-19e82d04-16aa-43e1-8312-cd9a6270e54b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:30.080512 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19e82d04-16aa-43e1-8312-cd9a6270e54b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:30.081123 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19e82d04-16aa-43e1-8312-cd9a6270e54b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:30.081975 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19e82d04-16aa-43e1-8312-cd9a6270e54b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:30.082430 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-19e82d04-16aa-43e1-8312-cd9a6270e54b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:30.231007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-19e82d04-16aa-43e1-8312-cd9a6270e54b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:30.240034 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-19e82d04-16aa-43e1-8312-cd9a6270e54b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1567 microversion: 2.1 time: 0.172295 Jul 28 05:06:30.240701 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5332/7782] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:30 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:30.261329 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cd6577c9-d19f-4749-bb87-5b42b19b8e19 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:06:30.261948 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cd6577c9-d19f-4749-bb87-5b42b19b8e19 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:30.268823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd6577c9-d19f-4749-bb87-5b42b19b8e19 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:30.269283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd6577c9-d19f-4749-bb87-5b42b19b8e19 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:30.270077 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd6577c9-d19f-4749-bb87-5b42b19b8e19 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:30.270523 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cd6577c9-d19f-4749-bb87-5b42b19b8e19 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:30.288097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:06:30.303670 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cd6577c9-d19f-4749-bb87-5b42b19b8e19 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126071) unshelve /opt/stack/nova/nova/compute/api.py:4575}} Jul 28 05:06:30.384221 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cd6577c9-d19f-4749-bb87-5b42b19b8e19 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "POST /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734/action" status: 202 len: 0 microversion: 2.1 time: 0.126541 Jul 28 05:06:30.385204 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5333/7783] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 05:06:30 2022] POST /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:06:30.394218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-54a4c778-b7e9-4264-afcd-bda38f89b310 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:30.394835 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-54a4c778-b7e9-4264-afcd-bda38f89b310 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:30.402011 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-54a4c778-b7e9-4264-afcd-bda38f89b310 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:30.402485 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-54a4c778-b7e9-4264-afcd-bda38f89b310 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:30.403285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-54a4c778-b7e9-4264-afcd-bda38f89b310 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:30.403822 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-54a4c778-b7e9-4264-afcd-bda38f89b310 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:30.551092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-54a4c778-b7e9-4264-afcd-bda38f89b310 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:30.559013 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-54a4c778-b7e9-4264-afcd-bda38f89b310 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1575 microversion: 2.1 time: 0.169557 Jul 28 05:06:30.559598 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5334/7784] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:30 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:06:31.580847 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-26226036-34eb-4731-9422-ddf35017aabb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:31.581480 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-26226036-34eb-4731-9422-ddf35017aabb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:31.588693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26226036-34eb-4731-9422-ddf35017aabb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:31.589156 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26226036-34eb-4731-9422-ddf35017aabb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:31.589949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26226036-34eb-4731-9422-ddf35017aabb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:31.590395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-26226036-34eb-4731-9422-ddf35017aabb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:31.736614 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-26226036-34eb-4731-9422-ddf35017aabb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:31.745841 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-26226036-34eb-4731-9422-ddf35017aabb tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1517 microversion: 2.1 time: 0.169102 Jul 28 05:06:31.746610 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5335/7785] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:31 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:06:31.751622 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-a2ccf639-a3a5-4653-97d0-768af814ab38 req-31dcb9ad-ff64-48f7-9102-f27bc39d7eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9979bb51-6e04-4f28-9e88-9ff0d11bb734", "name": "network-vif-unplugged", "status": "completed", "tag": "271e55c4-4f54-4d1c-9383-c87da3b3d8e8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:06:31.761374 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a2ccf639-a3a5-4653-97d0-768af814ab38 req-31dcb9ad-ff64-48f7-9102-f27bc39d7eaf service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:31.761826 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-a2ccf639-a3a5-4653-97d0-768af814ab38 req-31dcb9ad-ff64-48f7-9102-f27bc39d7eaf service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:31.773097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.compute.server_external_events [req-a2ccf639-a3a5-4653-97d0-768af814ab38 req-31dcb9ad-ff64-48f7-9102-f27bc39d7eaf service nova] Unable to find a host for instance 9979bb51-6e04-4f28-9e88-9ff0d11bb734. Dropping event network-vif-unplugged {{(pid=126071) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 05:06:31.773998 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-a2ccf639-a3a5-4653-97d0-768af814ab38 req-31dcb9ad-ff64-48f7-9102-f27bc39d7eaf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026275 Jul 28 05:06:31.774803 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5336/7786] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 05:06:32.768926 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dc6aec4c-f277-4664-96ff-472cfa6c3b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:32.769618 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dc6aec4c-f277-4664-96ff-472cfa6c3b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:32.777045 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc6aec4c-f277-4664-96ff-472cfa6c3b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:32.777504 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc6aec4c-f277-4664-96ff-472cfa6c3b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:32.778285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc6aec4c-f277-4664-96ff-472cfa6c3b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:32.778730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dc6aec4c-f277-4664-96ff-472cfa6c3b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:32.920277 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dc6aec4c-f277-4664-96ff-472cfa6c3b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:32.928640 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dc6aec4c-f277-4664-96ff-472cfa6c3b92 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1517 microversion: 2.1 time: 0.163868 Jul 28 05:06:32.929226 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5337/7787] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:32 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:33.950365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-202e26db-f0a8-4788-a1a0-125bae340e45 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:33.951057 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-202e26db-f0a8-4788-a1a0-125bae340e45 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:33.958320 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-202e26db-f0a8-4788-a1a0-125bae340e45 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:33.958771 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-202e26db-f0a8-4788-a1a0-125bae340e45 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:33.959588 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-202e26db-f0a8-4788-a1a0-125bae340e45 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:33.959979 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-202e26db-f0a8-4788-a1a0-125bae340e45 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:34.106471 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-202e26db-f0a8-4788-a1a0-125bae340e45 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:34.114844 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-202e26db-f0a8-4788-a1a0-125bae340e45 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1517 microversion: 2.1 time: 0.168422 Jul 28 05:06:34.115488 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5338/7788] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:33 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:35.139180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-197636b6-bc31-47c4-a5df-2f6457839c16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:35.139860 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-197636b6-bc31-47c4-a5df-2f6457839c16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:35.147411 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-197636b6-bc31-47c4-a5df-2f6457839c16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:35.147874 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-197636b6-bc31-47c4-a5df-2f6457839c16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:35.148772 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-197636b6-bc31-47c4-a5df-2f6457839c16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:35.149222 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-197636b6-bc31-47c4-a5df-2f6457839c16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:35.286578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-197636b6-bc31-47c4-a5df-2f6457839c16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:35.294662 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-197636b6-bc31-47c4-a5df-2f6457839c16 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1517 microversion: 2.1 time: 0.159713 Jul 28 05:06:35.295249 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5339/7789] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:35 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:36.316611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-91e17454-4a6c-41c1-a243-c7df18778dca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:36.317319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-91e17454-4a6c-41c1-a243-c7df18778dca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:36.325008 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91e17454-4a6c-41c1-a243-c7df18778dca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:36.325538 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91e17454-4a6c-41c1-a243-c7df18778dca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:36.326344 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91e17454-4a6c-41c1-a243-c7df18778dca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:36.326881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-91e17454-4a6c-41c1-a243-c7df18778dca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:36.467341 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-91e17454-4a6c-41c1-a243-c7df18778dca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:36.475948 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-91e17454-4a6c-41c1-a243-c7df18778dca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1573 microversion: 2.1 time: 0.163443 Jul 28 05:06:36.476541 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5340/7790] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:36 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:37.169510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-0b6b91b0-c4fb-48fc-b71e-b22cf806aa42 req-4e1a40e8-bc43-462d-aff2-0b753b828e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9979bb51-6e04-4f28-9e88-9ff0d11bb734", "tag": "271e55c4-4f54-4d1c-9383-c87da3b3d8e8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:06:37.182599 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0b6b91b0-c4fb-48fc-b71e-b22cf806aa42 req-4e1a40e8-bc43-462d-aff2-0b753b828e2d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:37.183225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-0b6b91b0-c4fb-48fc-b71e-b22cf806aa42 req-4e1a40e8-bc43-462d-aff2-0b753b828e2d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:37.201686 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-0b6b91b0-c4fb-48fc-b71e-b22cf806aa42 req-4e1a40e8-bc43-462d-aff2-0b753b828e2d service nova] Creating event network-changed:271e55c4-4f54-4d1c-9383-c87da3b3d8e8 for instance 9979bb51-6e04-4f28-9e88-9ff0d11bb734 on n-h1-826756-3 Jul 28 05:06:37.208180 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-0b6b91b0-c4fb-48fc-b71e-b22cf806aa42 req-4e1a40e8-bc43-462d-aff2-0b753b828e2d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046780 Jul 28 05:06:37.209144 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5341/7791] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:06:37.498815 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e07a10d9-80a8-4128-8cdd-5efa171e1bb1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:37.499521 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e07a10d9-80a8-4128-8cdd-5efa171e1bb1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:37.508201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e07a10d9-80a8-4128-8cdd-5efa171e1bb1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:37.508688 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e07a10d9-80a8-4128-8cdd-5efa171e1bb1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:37.510052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e07a10d9-80a8-4128-8cdd-5efa171e1bb1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:37.510052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e07a10d9-80a8-4128-8cdd-5efa171e1bb1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:37.644803 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e07a10d9-80a8-4128-8cdd-5efa171e1bb1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:37.653134 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e07a10d9-80a8-4128-8cdd-5efa171e1bb1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1573 microversion: 2.1 time: 0.159009 Jul 28 05:06:37.653731 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5342/7792] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:37 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:38.675248 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ab44c582-6a26-468c-a9f3-64dbe232c61e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:38.675881 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ab44c582-6a26-468c-a9f3-64dbe232c61e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:38.683502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab44c582-6a26-468c-a9f3-64dbe232c61e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:38.683976 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab44c582-6a26-468c-a9f3-64dbe232c61e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:38.684808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab44c582-6a26-468c-a9f3-64dbe232c61e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:38.685265 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ab44c582-6a26-468c-a9f3-64dbe232c61e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:38.830677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-ab44c582-6a26-468c-a9f3-64dbe232c61e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:38.838999 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ab44c582-6a26-468c-a9f3-64dbe232c61e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1573 microversion: 2.1 time: 0.167906 Jul 28 05:06:38.839555 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5343/7793] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:38 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:39.865404 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-22e0afb0-4760-48b4-80f7-4bd981c0a335 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:39.866554 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-22e0afb0-4760-48b4-80f7-4bd981c0a335 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:39.877394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22e0afb0-4760-48b4-80f7-4bd981c0a335 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:39.877845 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22e0afb0-4760-48b4-80f7-4bd981c0a335 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:39.878616 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22e0afb0-4760-48b4-80f7-4bd981c0a335 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:39.879052 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-22e0afb0-4760-48b4-80f7-4bd981c0a335 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:40.021494 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-22e0afb0-4760-48b4-80f7-4bd981c0a335 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:40.029766 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-22e0afb0-4760-48b4-80f7-4bd981c0a335 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1573 microversion: 2.1 time: 0.171231 Jul 28 05:06:40.030354 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5344/7794] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:39 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1573 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:41.051379 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-bb865236-8225-40d3-8440-1d6f55cee21e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:41.052022 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-bb865236-8225-40d3-8440-1d6f55cee21e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:41.059290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb865236-8225-40d3-8440-1d6f55cee21e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:41.059747 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb865236-8225-40d3-8440-1d6f55cee21e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:41.060558 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb865236-8225-40d3-8440-1d6f55cee21e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:41.060999 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-bb865236-8225-40d3-8440-1d6f55cee21e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:41.214824 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-bb865236-8225-40d3-8440-1d6f55cee21e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:41.223394 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-bb865236-8225-40d3-8440-1d6f55cee21e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1573 microversion: 2.1 time: 0.176301 Jul 28 05:06:41.223988 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5345/7795] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:41 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1573 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:06:42.249705 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e40c9abf-a23d-4d39-9958-cc688c2d7423 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:42.250863 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e40c9abf-a23d-4d39-9958-cc688c2d7423 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:42.258960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e40c9abf-a23d-4d39-9958-cc688c2d7423 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:42.259432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e40c9abf-a23d-4d39-9958-cc688c2d7423 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:42.260221 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e40c9abf-a23d-4d39-9958-cc688c2d7423 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:42.260704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e40c9abf-a23d-4d39-9958-cc688c2d7423 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:42.408179 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e40c9abf-a23d-4d39-9958-cc688c2d7423 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:42.416755 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e40c9abf-a23d-4d39-9958-cc688c2d7423 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1573 microversion: 2.1 time: 0.173825 Jul 28 05:06:42.417318 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5346/7796] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:42 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:43.442962 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a3e13511-d391-4ef6-81bc-7af27cf07e5b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:43.444116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a3e13511-d391-4ef6-81bc-7af27cf07e5b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:43.455508 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3e13511-d391-4ef6-81bc-7af27cf07e5b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:43.455978 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3e13511-d391-4ef6-81bc-7af27cf07e5b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:43.456875 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3e13511-d391-4ef6-81bc-7af27cf07e5b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:43.457336 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a3e13511-d391-4ef6-81bc-7af27cf07e5b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:43.595672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a3e13511-d391-4ef6-81bc-7af27cf07e5b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:43.609027 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a3e13511-d391-4ef6-81bc-7af27cf07e5b tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1573 microversion: 2.1 time: 0.172475 Jul 28 05:06:43.609818 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5347/7797] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:43 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:44.641543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9c0204d2-b5ee-4fb6-9cfc-91d86b16fdad tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:44.642712 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9c0204d2-b5ee-4fb6-9cfc-91d86b16fdad tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:44.650201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c0204d2-b5ee-4fb6-9cfc-91d86b16fdad tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:44.650660 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c0204d2-b5ee-4fb6-9cfc-91d86b16fdad tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:44.651432 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c0204d2-b5ee-4fb6-9cfc-91d86b16fdad tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:44.651880 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9c0204d2-b5ee-4fb6-9cfc-91d86b16fdad tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:44.799543 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9c0204d2-b5ee-4fb6-9cfc-91d86b16fdad tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:44.807732 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9c0204d2-b5ee-4fb6-9cfc-91d86b16fdad tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1573 microversion: 2.1 time: 0.172965 Jul 28 05:06:44.808321 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5348/7798] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:44 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:45.829783 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-f1938976-c6aa-4dfe-b626-9174e3307fca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:45.830490 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-f1938976-c6aa-4dfe-b626-9174e3307fca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:45.833353 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:06:45.839653 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1938976-c6aa-4dfe-b626-9174e3307fca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:45.840282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1938976-c6aa-4dfe-b626-9174e3307fca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:45.841102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1938976-c6aa-4dfe-b626-9174e3307fca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:45.841557 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-f1938976-c6aa-4dfe-b626-9174e3307fca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:45.984414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-f1938976-c6aa-4dfe-b626-9174e3307fca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:45.996383 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-f1938976-c6aa-4dfe-b626-9174e3307fca tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1573 microversion: 2.1 time: 0.170292 Jul 28 05:06:45.997455 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5349/7799] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:45 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:47.019967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-609ecac2-ce85-4afc-8967-151d4ce5eb52 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:47.020754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-609ecac2-ce85-4afc-8967-151d4ce5eb52 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:47.027449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-609ecac2-ce85-4afc-8967-151d4ce5eb52 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:47.027942 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-609ecac2-ce85-4afc-8967-151d4ce5eb52 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:47.028746 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-609ecac2-ce85-4afc-8967-151d4ce5eb52 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:47.029196 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-609ecac2-ce85-4afc-8967-151d4ce5eb52 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:47.048199 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:06:47.173395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-609ecac2-ce85-4afc-8967-151d4ce5eb52 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:47.181763 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-609ecac2-ce85-4afc-8967-151d4ce5eb52 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1573 microversion: 2.1 time: 0.166091 Jul 28 05:06:47.182456 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5350/7800] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:47 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:48.204036 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-3859d227-d6e0-4230-92c0-fa5415503441 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:48.204693 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-3859d227-d6e0-4230-92c0-fa5415503441 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:48.212213 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3859d227-d6e0-4230-92c0-fa5415503441 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:48.212709 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3859d227-d6e0-4230-92c0-fa5415503441 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:48.213497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3859d227-d6e0-4230-92c0-fa5415503441 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:48.213982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-3859d227-d6e0-4230-92c0-fa5415503441 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:48.390973 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-3859d227-d6e0-4230-92c0-fa5415503441 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:48.399715 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-3859d227-d6e0-4230-92c0-fa5415503441 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1573 microversion: 2.1 time: 0.199729 Jul 28 05:06:48.400341 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5351/7801] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:48 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1573 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:48.774371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-b40fa7d6-c648-4171-931d-b4a0b71dc5af req-aaa71ef7-4cb9-4db2-b31f-4554ff095e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9979bb51-6e04-4f28-9e88-9ff0d11bb734", "name": "network-vif-plugged", "status": "completed", "tag": "271e55c4-4f54-4d1c-9383-c87da3b3d8e8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:06:48.784885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b40fa7d6-c648-4171-931d-b4a0b71dc5af req-aaa71ef7-4cb9-4db2-b31f-4554ff095e22 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:48.785349 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-b40fa7d6-c648-4171-931d-b4a0b71dc5af req-aaa71ef7-4cb9-4db2-b31f-4554ff095e22 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:48.796965 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-b40fa7d6-c648-4171-931d-b4a0b71dc5af req-aaa71ef7-4cb9-4db2-b31f-4554ff095e22 service nova] Creating event network-vif-plugged:271e55c4-4f54-4d1c-9383-c87da3b3d8e8 for instance 9979bb51-6e04-4f28-9e88-9ff0d11bb734 on n-h1-826756-3 Jul 28 05:06:48.802200 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-b40fa7d6-c648-4171-931d-b4a0b71dc5af req-aaa71ef7-4cb9-4db2-b31f-4554ff095e22 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032175 Jul 28 05:06:48.802985 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5352/7802] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:06:49.426487 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c221e379-02bd-466c-8b34-659c18fb169e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:49.427207 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-c221e379-02bd-466c-8b34-659c18fb169e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:49.437831 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c221e379-02bd-466c-8b34-659c18fb169e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:49.438296 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c221e379-02bd-466c-8b34-659c18fb169e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:49.439083 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c221e379-02bd-466c-8b34-659c18fb169e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:49.439553 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-c221e379-02bd-466c-8b34-659c18fb169e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:49.581172 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-c221e379-02bd-466c-8b34-659c18fb169e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:49.593313 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c221e379-02bd-466c-8b34-659c18fb169e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1573 microversion: 2.1 time: 0.174213 Jul 28 05:06:49.594088 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5353/7803] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:49 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:50.616541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fd8e8ee7-d7f2-45f7-84c2-b40fcec28f69 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:06:50.617262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fd8e8ee7-d7f2-45f7-84c2-b40fcec28f69 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:06:50.624647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd8e8ee7-d7f2-45f7-84c2-b40fcec28f69 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:50.625116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd8e8ee7-d7f2-45f7-84c2-b40fcec28f69 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:50.625898 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd8e8ee7-d7f2-45f7-84c2-b40fcec28f69 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:06:50.626354 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fd8e8ee7-d7f2-45f7-84c2-b40fcec28f69 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:06:50.762994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fd8e8ee7-d7f2-45f7-84c2-b40fcec28f69 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:06:50.771508 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fd8e8ee7-d7f2-45f7-84c2-b40fcec28f69 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1560 microversion: 2.1 time: 0.159079 Jul 28 05:06:50.772121 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5354/7804] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:06:50 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:06:57.475479 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:06:57.476437 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 05:06:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 05:08:04.760434 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=11 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:08:04.761647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=22 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:08:04.766997 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-33bd71f5-3246-422c-9307-39ff30baebae tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:04.767506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-33bd71f5-3246-422c-9307-39ff30baebae tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:04.774573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33bd71f5-3246-422c-9307-39ff30baebae tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:04.775029 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33bd71f5-3246-422c-9307-39ff30baebae tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:04.775812 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33bd71f5-3246-422c-9307-39ff30baebae tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:04.776260 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-33bd71f5-3246-422c-9307-39ff30baebae tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:04.805315 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-33bd71f5-3246-422c-9307-39ff30baebae tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 05:08:04.888215 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-33bd71f5-3246-422c-9307-39ff30baebae tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 204 len: 0 microversion: 2.1 time: 0.129793 Jul 28 05:08:04.892651 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5355/7805] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 05:08:04 2022] DELETE /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:08:04.896913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-4abebde6-e936-448e-b68f-addeaccc593a req-f260195a-e27b-4038-b67f-c4a3b6548908 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9979bb51-6e04-4f28-9e88-9ff0d11bb734", "tag": "271e55c4-4f54-4d1c-9383-c87da3b3d8e8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:08:04.906283 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4abebde6-e936-448e-b68f-addeaccc593a req-f260195a-e27b-4038-b67f-c4a3b6548908 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:04.906883 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-4abebde6-e936-448e-b68f-addeaccc593a req-f260195a-e27b-4038-b67f-c4a3b6548908 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:04.919547 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-4abebde6-e936-448e-b68f-addeaccc593a req-f260195a-e27b-4038-b67f-c4a3b6548908 service nova] Creating event network-changed:271e55c4-4f54-4d1c-9383-c87da3b3d8e8 for instance 9979bb51-6e04-4f28-9e88-9ff0d11bb734 on n-h1-826756-3 Jul 28 05:08:04.924789 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-4abebde6-e936-448e-b68f-addeaccc593a req-f260195a-e27b-4038-b67f-c4a3b6548908 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034367 Jul 28 05:08:04.925653 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5356/7806] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:08:04.930694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7cfb49f8-7cd5-44eb-aea2-ba548f521f2e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:04.931402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7cfb49f8-7cd5-44eb-aea2-ba548f521f2e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:04.937736 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cfb49f8-7cd5-44eb-aea2-ba548f521f2e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:04.938274 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cfb49f8-7cd5-44eb-aea2-ba548f521f2e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:04.939043 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cfb49f8-7cd5-44eb-aea2-ba548f521f2e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:04.939484 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7cfb49f8-7cd5-44eb-aea2-ba548f521f2e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:05.078125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7cfb49f8-7cd5-44eb-aea2-ba548f521f2e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:05.088026 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7cfb49f8-7cd5-44eb-aea2-ba548f521f2e tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1566 microversion: 2.1 time: 0.161131 Jul 28 05:08:05.089098 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5357/7807] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:04 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:06.110722 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ffacba6-04a3-437e-92f8-8764cba09491 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:06.111417 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ffacba6-04a3-437e-92f8-8764cba09491 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:06.119051 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ffacba6-04a3-437e-92f8-8764cba09491 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:06.119513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ffacba6-04a3-437e-92f8-8764cba09491 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:06.120308 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ffacba6-04a3-437e-92f8-8764cba09491 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:06.120804 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ffacba6-04a3-437e-92f8-8764cba09491 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:06.259324 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ffacba6-04a3-437e-92f8-8764cba09491 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:06.267698 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ffacba6-04a3-437e-92f8-8764cba09491 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1566 microversion: 2.1 time: 0.161042 Jul 28 05:08:06.268288 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5358/7808] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:06 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:08:07.289663 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-b694a455-6c0e-4fcf-a0ea-23edaa7a10b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:07.290319 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-b694a455-6c0e-4fcf-a0ea-23edaa7a10b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:07.297674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b694a455-6c0e-4fcf-a0ea-23edaa7a10b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:07.298293 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b694a455-6c0e-4fcf-a0ea-23edaa7a10b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:07.299117 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b694a455-6c0e-4fcf-a0ea-23edaa7a10b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:07.299567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-b694a455-6c0e-4fcf-a0ea-23edaa7a10b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:07.373365 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-b694a455-6c0e-4fcf-a0ea-23edaa7a10b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:07.384041 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-b694a455-6c0e-4fcf-a0ea-23edaa7a10b3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1381 microversion: 2.1 time: 0.097904 Jul 28 05:08:07.384690 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5359/7809] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:07 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1381 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:07.389362 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-855703ee-6991-4016-b8bc-40a0587da77b req-d94e61eb-ff1f-442c-8d21-cb674531d994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9979bb51-6e04-4f28-9e88-9ff0d11bb734", "name": "network-vif-deleted", "tag": "271e55c4-4f54-4d1c-9383-c87da3b3d8e8"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:08:07.399592 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-855703ee-6991-4016-b8bc-40a0587da77b req-d94e61eb-ff1f-442c-8d21-cb674531d994 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:07.400049 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-855703ee-6991-4016-b8bc-40a0587da77b req-d94e61eb-ff1f-442c-8d21-cb674531d994 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:07.411271 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-855703ee-6991-4016-b8bc-40a0587da77b req-d94e61eb-ff1f-442c-8d21-cb674531d994 service nova] Creating event network-vif-deleted:271e55c4-4f54-4d1c-9383-c87da3b3d8e8 for instance 9979bb51-6e04-4f28-9e88-9ff0d11bb734 on n-h1-826756-3 Jul 28 05:08:07.416810 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-855703ee-6991-4016-b8bc-40a0587da77b req-d94e61eb-ff1f-442c-8d21-cb674531d994 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030852 Jul 28 05:08:07.417429 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5360/7810] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:08:08.408733 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e8c66e1a-905a-4ad4-b0f1-72023c7d60e3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:08.409402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e8c66e1a-905a-4ad4-b0f1-72023c7d60e3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:08.416777 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c66e1a-905a-4ad4-b0f1-72023c7d60e3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:08.417347 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c66e1a-905a-4ad4-b0f1-72023c7d60e3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:08.418206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c66e1a-905a-4ad4-b0f1-72023c7d60e3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:08.418721 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e8c66e1a-905a-4ad4-b0f1-72023c7d60e3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:08.485634 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e8c66e1a-905a-4ad4-b0f1-72023c7d60e3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:08.493886 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e8c66e1a-905a-4ad4-b0f1-72023c7d60e3 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1219 microversion: 2.1 time: 0.091396 Jul 28 05:08:08.494444 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5361/7811] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:08 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:09.515964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d01180b7-4b57-4e24-90ef-b20b3d28bcb9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:09.516723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d01180b7-4b57-4e24-90ef-b20b3d28bcb9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:09.523952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d01180b7-4b57-4e24-90ef-b20b3d28bcb9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:09.524447 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d01180b7-4b57-4e24-90ef-b20b3d28bcb9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:09.525286 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d01180b7-4b57-4e24-90ef-b20b3d28bcb9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:09.525740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d01180b7-4b57-4e24-90ef-b20b3d28bcb9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:09.588202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d01180b7-4b57-4e24-90ef-b20b3d28bcb9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:09.596561 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d01180b7-4b57-4e24-90ef-b20b3d28bcb9 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1219 microversion: 2.1 time: 0.084639 Jul 28 05:08:09.597153 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5362/7812] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:09 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:10.619351 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-4096b6ee-3419-4040-85e7-61b79ead00a1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:10.620070 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-4096b6ee-3419-4040-85e7-61b79ead00a1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:10.629416 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4096b6ee-3419-4040-85e7-61b79ead00a1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:10.629892 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4096b6ee-3419-4040-85e7-61b79ead00a1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:10.630700 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4096b6ee-3419-4040-85e7-61b79ead00a1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:10.631157 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-4096b6ee-3419-4040-85e7-61b79ead00a1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:10.699387 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-4096b6ee-3419-4040-85e7-61b79ead00a1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:10.707717 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-4096b6ee-3419-4040-85e7-61b79ead00a1 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1219 microversion: 2.1 time: 0.092428 Jul 28 05:08:10.708323 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5363/7813] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:10 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:11.729493 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a0582aba-0e06-4539-846c-c2b56e649a75 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:11.730161 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a0582aba-0e06-4539-846c-c2b56e649a75 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:11.737544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0582aba-0e06-4539-846c-c2b56e649a75 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:11.738004 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0582aba-0e06-4539-846c-c2b56e649a75 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:11.738782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0582aba-0e06-4539-846c-c2b56e649a75 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:11.739544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0582aba-0e06-4539-846c-c2b56e649a75 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:11.775519 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0582aba-0e06-4539-846c-c2b56e649a75 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:11.776015 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a0582aba-0e06-4539-846c-c2b56e649a75 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:11.776510 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.objects.instance [None req-a0582aba-0e06-4539-846c-c2b56e649a75 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lazy-loading 'fault' on Instance uuid 9979bb51-6e04-4f28-9e88-9ff0d11bb734 {{(pid=126071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 05:08:11.818817 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a0582aba-0e06-4539-846c-c2b56e649a75 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02ff7645527c4da6ade041db6d0024b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e64d19a30d2478380930f9a28dff537', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:11.827061 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a0582aba-0e06-4539-846c-c2b56e649a75 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 200 len: 1224 microversion: 2.1 time: 0.102251 Jul 28 05:08:11.827886 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5364/7814] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:11 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:12.850834 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-124d093c-741a-4ff5-84ee-cabfd6cbe231 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:12.851524 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-124d093c-741a-4ff5-84ee-cabfd6cbe231 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] [instance: 9979bb51-6e04-4f28-9e88-9ff0d11bb734] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:12.859648 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-124d093c-741a-4ff5-84ee-cabfd6cbe231 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:12.860152 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-124d093c-741a-4ff5-84ee-cabfd6cbe231 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:12.860980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-124d093c-741a-4ff5-84ee-cabfd6cbe231 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:12.861431 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-124d093c-741a-4ff5-84ee-cabfd6cbe231 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:12.875523 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-124d093c-741a-4ff5-84ee-cabfd6cbe231 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] HTTP exception thrown: Instance 9979bb51-6e04-4f28-9e88-9ff0d11bb734 could not be found. Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-124d093c-741a-4ff5-84ee-cabfd6cbe231 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Request method failure captured: Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 HTTP/1.1 Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hej5pF3NoUG0PjUC2qy_7ucWfuEJt-aFfyUReiW9Y4qoRJCiK5IWlu4VSxFlvESjzOeS5-T1SXDceRvyCDFdC6BF70tkJoSY9Wu9hCg4lfd3dMmoX8bGXChZZvNIdi4nAXd8tlm1Yubjrn8vadM3NpHghRJVEEL-bhyzToift1hfYE Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 6e64d19a30d2478380930f9a28dff537 Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestShelveInstance-1846789331 Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6e64d19a30d2478380930f9a28dff537"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e64d19a30d2478380930f9a28dff537"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6e64d19a30d2478380930f9a28dff537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6e64d19a30d2478380930f9a28dff537"}]}] Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestShelveInstance-1846789331 Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 6e64d19a30d2478380930f9a28dff537 Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestShelveInstance-1846789331 Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestShelveInstance-1846789331-project Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 02ff7645527c4da6ade041db6d0024b0 Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestShelveInstance-1846789331-project Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 9979bb51-6e04-4f28-9e88-9ff0d11bb734 could not be found. Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '9979bb51-6e04-4f28-9e88-9ff0d11bb734'} Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9979bb51-6e04-4f28-9e88-9ff0d11bb734 could not be found. Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9979bb51-6e04-4f28-9e88-9ff0d11bb734 could not be found. Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:08:12.877292 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:08:12.883097 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:08:12.883097 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:08:12.883097 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:08:12.883097 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:08:12.883097 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:08:12.883097 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9979bb51-6e04-4f28-9e88-9ff0d11bb734 could not be found. Jul 28 05:08:12.883097 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:08:12.883097 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-124d093c-741a-4ff5-84ee-cabfd6cbe231 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Returning 404 to user: Instance 9979bb51-6e04-4f28-9e88-9ff0d11bb734 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:08:12.883097 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-124d093c-741a-4ff5-84ee-cabfd6cbe231 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734" status: 404 len: 111 microversion: 2.1 time: 0.033977 Jul 28 05:08:12.883097 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5365/7815] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:12 2022] GET /compute/v2.1/servers/9979bb51-6e04-4f28-9e88-9ff0d11bb734 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 05:08:13.069201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5ae14628-44e1-46e6-ada1-095f137eca23 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] Calling method '.version_select at 0x7ffa678bbca0>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:13.094728 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5ae14628-44e1-46e6-ada1-095f137eca23 tempest-TestShelveInstance-1846789331 tempest-TestShelveInstance-1846789331-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1377352174" status: 202 len: 0 microversion: 2.1 time: 0.029310 Jul 28 05:08:13.095490 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5366/7816] 10.222.0.48 () {58 vars in 1254 bytes} [Thu Jul 28 05:08:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1377352174 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 05:08:25.926735 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:08:25.927324 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 05:08:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 05:08:30.457092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:08:30.458262 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:08:30.645381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-c5a8afc2-26eb-49c8-a73a-f1ec43d090e6 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Action: 'create', calling method: .version_select at 0x7ffa6798dc10>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1438325450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4uMFy5BmjG7aRs5268nhTbNroLyoTS4CzTaPJ3EF9aYGDIZA0wGjN8lwlyoUTKigUPDmhA42zUBLjpua5tz1Sebj7iD7s5mXQFuYkEVpug3fNseshzhqAk3+FDWg/diA=="}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:08:30.662578 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-c5a8afc2-26eb-49c8-a73a-f1ec43d090e6 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Getting quotas for project 7665169c9c32464ba3b8273275fc0751. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:08:30.668570 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-c5a8afc2-26eb-49c8-a73a-f1ec43d090e6 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Getting quotas for user 53023fb0a2264d18a217d5c5194eac4b and project 7665169c9c32464ba3b8273275fc0751. Resources: {'key_pairs'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:08:30.696603 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-c5a8afc2-26eb-49c8-a73a-f1ec43d090e6 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.241071 Jul 28 05:08:30.697756 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5367/7817] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jul 28 05:08:30 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:08:31.825757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1568142604", "imageRef": "5d43adf9-af92-4117-9ed9-35547daa1220", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1438325450", "security_groups": [{"name": "tempest-secgroup-smoke-543063684"}], "networks": [{"uuid": "56c7dcff-37a0-496c-ae58-6863fbb394b1"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:08:31.937728 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] validate_networks() for [('56c7dcff-37a0-496c-ae58-6863fbb394b1', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:08:32.477970 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:08:32.478628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:08:32.479113 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:08:32.479529 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:08:32.479952 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:08:32.489280 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:32.489742 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:32.490544 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:32.490986 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:32.510435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Getting quotas for project 7665169c9c32464ba3b8273275fc0751. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:08:32.516478 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Getting quotas for user 53023fb0a2264d18a217d5c5194eac4b and project 7665169c9c32464ba3b8273275fc0751. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:08:32.532116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:08:32.534560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5d43adf9-af92-4117-9ed9-35547daa1220',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 05:08:32.594735 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9feeb32a-055d-4a6f-9b4f-75c654e2b3fa tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.773552 Jul 28 05:08:32.596796 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5368/7818] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 05:08:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 05:08:32.608871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-816b441a-002b-4c25-b7ca-4b7219bd8c39 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:32.610081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-816b441a-002b-4c25-b7ca-4b7219bd8c39 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:32.684234 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-816b441a-002b-4c25-b7ca-4b7219bd8c39 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:32.694394 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-816b441a-002b-4c25-b7ca-4b7219bd8c39 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 200 len: 1249 microversion: 2.1 time: 0.090595 Jul 28 05:08:32.696339 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5369/7819] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:32 2022] GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:08:33.717032 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7d0f6b5e-09c9-4cad-9a9d-501e87484e6c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:33.718435 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7d0f6b5e-09c9-4cad-9a9d-501e87484e6c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:33.726930 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d0f6b5e-09c9-4cad-9a9d-501e87484e6c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:33.727393 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d0f6b5e-09c9-4cad-9a9d-501e87484e6c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:33.728202 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d0f6b5e-09c9-4cad-9a9d-501e87484e6c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:33.728689 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7d0f6b5e-09c9-4cad-9a9d-501e87484e6c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:33.796300 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7d0f6b5e-09c9-4cad-9a9d-501e87484e6c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:33.805303 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7d0f6b5e-09c9-4cad-9a9d-501e87484e6c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 200 len: 1301 microversion: 2.1 time: 0.092198 Jul 28 05:08:33.805910 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5370/7820] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:33 2022] GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 1301 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:34.831010 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-9bbdfa38-38c6-40ad-85f6-4edd0fca1495 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:34.831636 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-9bbdfa38-38c6-40ad-85f6-4edd0fca1495 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:34.842290 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bbdfa38-38c6-40ad-85f6-4edd0fca1495 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:34.842762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bbdfa38-38c6-40ad-85f6-4edd0fca1495 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:34.843579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bbdfa38-38c6-40ad-85f6-4edd0fca1495 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:34.844041 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-9bbdfa38-38c6-40ad-85f6-4edd0fca1495 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:35.075890 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-9bbdfa38-38c6-40ad-85f6-4edd0fca1495 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:35.086067 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-9bbdfa38-38c6-40ad-85f6-4edd0fca1495 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 200 len: 1374 microversion: 2.1 time: 0.259225 Jul 28 05:08:35.101337 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5371/7821] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:34 2022] GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 1374 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:35.750138 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6b176fb1-0120-4226-8dca-27feb7c13705 req-d2cc66e8-6391-4840-985e-02e446f4094d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a62e80-940f-4db2-9433-f813f792f470", "tag": "1775d0d3-f217-4c80-9cea-06fcd44b0ff0"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:08:35.761100 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6b176fb1-0120-4226-8dca-27feb7c13705 req-d2cc66e8-6391-4840-985e-02e446f4094d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:35.761601 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6b176fb1-0120-4226-8dca-27feb7c13705 req-d2cc66e8-6391-4840-985e-02e446f4094d service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:35.774050 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6b176fb1-0120-4226-8dca-27feb7c13705 req-d2cc66e8-6391-4840-985e-02e446f4094d service nova] Creating event network-changed:1775d0d3-f217-4c80-9cea-06fcd44b0ff0 for instance 75a62e80-940f-4db2-9433-f813f792f470 on n-h2-826756-3 Jul 28 05:08:35.779449 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6b176fb1-0120-4226-8dca-27feb7c13705 req-d2cc66e8-6391-4840-985e-02e446f4094d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118167 Jul 28 05:08:35.780326 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5372/7822] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:08:36.110560 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-37d17c57-77a1-4a6a-95fe-5536ad7da04b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:36.111299 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-37d17c57-77a1-4a6a-95fe-5536ad7da04b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:36.118848 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37d17c57-77a1-4a6a-95fe-5536ad7da04b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:36.119316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37d17c57-77a1-4a6a-95fe-5536ad7da04b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:36.120103 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37d17c57-77a1-4a6a-95fe-5536ad7da04b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:36.120584 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-37d17c57-77a1-4a6a-95fe-5536ad7da04b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:36.272536 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-37d17c57-77a1-4a6a-95fe-5536ad7da04b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:36.289061 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-37d17c57-77a1-4a6a-95fe-5536ad7da04b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 200 len: 1374 microversion: 2.1 time: 0.183165 Jul 28 05:08:36.289786 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5373/7823] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:36 2022] GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:37.311189 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5b6bedba-ef23-452e-8a52-0a4b7263b7bd tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:37.312380 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5b6bedba-ef23-452e-8a52-0a4b7263b7bd tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:37.322682 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b6bedba-ef23-452e-8a52-0a4b7263b7bd tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:37.323168 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b6bedba-ef23-452e-8a52-0a4b7263b7bd tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:37.323960 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b6bedba-ef23-452e-8a52-0a4b7263b7bd tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:37.324448 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5b6bedba-ef23-452e-8a52-0a4b7263b7bd tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:37.788707 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5b6bedba-ef23-452e-8a52-0a4b7263b7bd tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:37.797471 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5b6bedba-ef23-452e-8a52-0a4b7263b7bd tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 200 len: 1374 microversion: 2.1 time: 0.490483 Jul 28 05:08:37.798128 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5374/7824] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:37 2022] GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 1374 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:38.819082 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6a0063dc-772f-4e9c-8532-77d07e4d96cc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:38.819893 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6a0063dc-772f-4e9c-8532-77d07e4d96cc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:38.827338 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a0063dc-772f-4e9c-8532-77d07e4d96cc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:38.827788 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a0063dc-772f-4e9c-8532-77d07e4d96cc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:38.828609 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a0063dc-772f-4e9c-8532-77d07e4d96cc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:38.829065 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6a0063dc-772f-4e9c-8532-77d07e4d96cc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:38.961331 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6a0063dc-772f-4e9c-8532-77d07e4d96cc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:38.969492 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6a0063dc-772f-4e9c-8532-77d07e4d96cc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 200 len: 1374 microversion: 2.1 time: 0.154464 Jul 28 05:08:38.970193 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5375/7825] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:38 2022] GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:39.995059 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-da1ef4b6-8870-4bc9-a8a4-c82c9fb07659 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:39.995985 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-da1ef4b6-8870-4bc9-a8a4-c82c9fb07659 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:40.005630 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da1ef4b6-8870-4bc9-a8a4-c82c9fb07659 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:40.006118 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da1ef4b6-8870-4bc9-a8a4-c82c9fb07659 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:40.006907 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da1ef4b6-8870-4bc9-a8a4-c82c9fb07659 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:40.007358 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-da1ef4b6-8870-4bc9-a8a4-c82c9fb07659 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:40.151284 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-da1ef4b6-8870-4bc9-a8a4-c82c9fb07659 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:40.162429 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-da1ef4b6-8870-4bc9-a8a4-c82c9fb07659 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 200 len: 1374 microversion: 2.1 time: 0.173380 Jul 28 05:08:40.162429 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5376/7826] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:39 2022] GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:40.352594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-394de6b0-7aa7-419e-bb0c-230a77d4cd67 req-ebb9cba8-6e3d-40f1-8f67-288cf050b139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a62e80-940f-4db2-9433-f813f792f470", "name": "network-vif-plugged", "status": "completed", "tag": "1775d0d3-f217-4c80-9cea-06fcd44b0ff0"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:08:40.363191 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-394de6b0-7aa7-419e-bb0c-230a77d4cd67 req-ebb9cba8-6e3d-40f1-8f67-288cf050b139 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:40.363704 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-394de6b0-7aa7-419e-bb0c-230a77d4cd67 req-ebb9cba8-6e3d-40f1-8f67-288cf050b139 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:40.379431 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-394de6b0-7aa7-419e-bb0c-230a77d4cd67 req-ebb9cba8-6e3d-40f1-8f67-288cf050b139 service nova] Creating event network-vif-plugged:1775d0d3-f217-4c80-9cea-06fcd44b0ff0 for instance 75a62e80-940f-4db2-9433-f813f792f470 on n-h2-826756-3 Jul 28 05:08:40.385501 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-394de6b0-7aa7-419e-bb0c-230a77d4cd67 req-ebb9cba8-6e3d-40f1-8f67-288cf050b139 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036758 Jul 28 05:08:40.386308 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5377/7827] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:08:41.187236 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-5d69e394-235c-4db6-8741-248febb28c93 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:41.187913 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-5d69e394-235c-4db6-8741-248febb28c93 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:41.196479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d69e394-235c-4db6-8741-248febb28c93 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:41.196982 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d69e394-235c-4db6-8741-248febb28c93 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:41.197762 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d69e394-235c-4db6-8741-248febb28c93 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:41.198219 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-5d69e394-235c-4db6-8741-248febb28c93 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:41.351641 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-5d69e394-235c-4db6-8741-248febb28c93 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:41.361080 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-5d69e394-235c-4db6-8741-248febb28c93 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 200 len: 1374 microversion: 2.1 time: 0.177672 Jul 28 05:08:41.362403 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5378/7828] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:41 2022] GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:42.383092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-82371290-9a40-4c09-b73c-c3b3ffb26a7a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:42.383792 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-82371290-9a40-4c09-b73c-c3b3ffb26a7a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:42.391316 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82371290-9a40-4c09-b73c-c3b3ffb26a7a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:42.391809 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82371290-9a40-4c09-b73c-c3b3ffb26a7a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:42.392706 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82371290-9a40-4c09-b73c-c3b3ffb26a7a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:42.393163 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82371290-9a40-4c09-b73c-c3b3ffb26a7a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:42.503312 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:08:42.531233 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82371290-9a40-4c09-b73c-c3b3ffb26a7a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:42.534841 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-82371290-9a40-4c09-b73c-c3b3ffb26a7a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 200 len: 1558 microversion: 2.1 time: 0.155977 Jul 28 05:08:42.535437 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5379/7829] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:42 2022] GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:42.556757 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-44cacbc1-be2a-4f2d-9277-c53e7489ec07 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:08:42.557382 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-44cacbc1-be2a-4f2d-9277-c53e7489ec07 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:08:42.563967 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44cacbc1-be2a-4f2d-9277-c53e7489ec07 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:42.564457 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44cacbc1-be2a-4f2d-9277-c53e7489ec07 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:42.565255 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44cacbc1-be2a-4f2d-9277-c53e7489ec07 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:42.565708 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-44cacbc1-be2a-4f2d-9277-c53e7489ec07 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:42.689594 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=12 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:08:42.706885 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-44cacbc1-be2a-4f2d-9277-c53e7489ec07 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:08:42.715136 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-44cacbc1-be2a-4f2d-9277-c53e7489ec07 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 200 len: 1558 microversion: 2.1 time: 0.162366 Jul 28 05:08:42.715714 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5380/7830] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:08:42 2022] GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:08:44.708957 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-fb7b6544-23e1-45e6-824e-589e3807a655 req-d1161dc4-c38e-4653-a0f3-408dc64a9a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a62e80-940f-4db2-9433-f813f792f470", "tag": "1775d0d3-f217-4c80-9cea-06fcd44b0ff0"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:08:44.719408 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fb7b6544-23e1-45e6-824e-589e3807a655 req-d1161dc4-c38e-4653-a0f3-408dc64a9a1c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:08:44.719869 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-fb7b6544-23e1-45e6-824e-589e3807a655 req-d1161dc4-c38e-4653-a0f3-408dc64a9a1c service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:08:44.732191 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-fb7b6544-23e1-45e6-824e-589e3807a655 req-d1161dc4-c38e-4653-a0f3-408dc64a9a1c service nova] Creating event network-changed:1775d0d3-f217-4c80-9cea-06fcd44b0ff0 for instance 75a62e80-940f-4db2-9433-f813f792f470 on n-h2-826756-3 Jul 28 05:08:44.737567 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-fb7b6544-23e1-45e6-824e-589e3807a655 req-d1161dc4-c38e-4653-a0f3-408dc64a9a1c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032431 Jul 28 05:08:44.738179 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5381/7831] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:10:17.486772 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:10:17.487764 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 05:10:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 05:10:42.155224 n-d-826756-3 devstack@n-api.service[126071]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3383c6d1-bf1b-4640-b860-3d2b5f70fe2b] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 05:10:42.156601 n-d-826756-3 devstack@n-api.service[126071]: ERROR oslo.messaging._drivers.impl_rabbit [-] [58ec63bc-5462-40de-8ca8-e5ce0d7dbc1c] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 05:10:42.158129 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:10:42.158923 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=62 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:10:42.164644 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8e85e5e8-3239-4e22-a77b-9d8298675405 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1433253431"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:10:42.167053 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8e85e5e8-3239-4e22-a77b-9d8298675405 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:10:42.175023 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e85e5e8-3239-4e22-a77b-9d8298675405 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:10:42.175479 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e85e5e8-3239-4e22-a77b-9d8298675405 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:10:42.176250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e85e5e8-3239-4e22-a77b-9d8298675405 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:10:42.176740 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e85e5e8-3239-4e22-a77b-9d8298675405 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:10:42.513326 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8e85e5e8-3239-4e22-a77b-9d8298675405 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "POST /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470/action" status: 202 len: 0 microversion: 2.1 time: 0.361090 Jul 28 05:10:42.513960 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5382/7832] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 05:10:42 2022] POST /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 28 05:10:49.191625 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] [3383c6d1-bf1b-4640-b860-3d2b5f70fe2b] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 42776. Jul 28 05:10:49.193948 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] [58ec63bc-5462-40de-8ca8-e5ce0d7dbc1c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 42778. Jul 28 05:10:49.257250 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f25563c5-68bd-45ae-9ac7-6f6a1f6da672 req-a569b29d-8b8c-4a24-afa7-b63cf86c9b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a62e80-940f-4db2-9433-f813f792f470", "name": "network-vif-plugged", "status": "completed", "tag": "1775d0d3-f217-4c80-9cea-06fcd44b0ff0"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:10:49.271983 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f25563c5-68bd-45ae-9ac7-6f6a1f6da672 req-a569b29d-8b8c-4a24-afa7-b63cf86c9b01 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:10:49.272676 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f25563c5-68bd-45ae-9ac7-6f6a1f6da672 req-a569b29d-8b8c-4a24-afa7-b63cf86c9b01 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:10:49.285709 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f25563c5-68bd-45ae-9ac7-6f6a1f6da672 req-a569b29d-8b8c-4a24-afa7-b63cf86c9b01 service nova] Creating event network-vif-plugged:1775d0d3-f217-4c80-9cea-06fcd44b0ff0 for instance 75a62e80-940f-4db2-9433-f813f792f470 on n-h2-826756-3 Jul 28 05:10:49.292229 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f25563c5-68bd-45ae-9ac7-6f6a1f6da672 req-a569b29d-8b8c-4a24-afa7-b63cf86c9b01 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137901 Jul 28 05:10:49.293382 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5383/7833] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:10:56.120364 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-642232894", "imageRef": "0f84352c-ff84-485a-a5a5-18314e64ea30", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1438325450", "security_groups": [{"name": "tempest-secgroup-smoke-543063684"}], "networks": [{"uuid": "56c7dcff-37a0-496c-ae58-6863fbb394b1"}]}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:10:56.232392 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.network.neutron [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] validate_networks() for [('56c7dcff-37a0-496c-ae58-6863fbb394b1', None, None, None, None, None)] {{(pid=126071) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 05:10:56.633590 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Flavor limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 05:10:56.634018 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Image limits 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 05:10:56.634501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Flavor pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 05:10:56.634916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Image pref 0:0:0 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 05:10:56.635337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.virt.hardware [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 05:10:56.645081 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:10:56.645541 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:10:56.646340 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:10:56.646782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:10:56.664671 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Getting quotas for project 7665169c9c32464ba3b8273275fc0751. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 05:10:56.670569 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.quota [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Getting quotas for user 53023fb0a2264d18a217d5c5194eac4b and project 7665169c9c32464ba3b8273275fc0751. Resources: {'instances', 'ram', 'cores'} {{(pid=126071) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 05:10:56.684640 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Going to run 1 instances... {{(pid=126071) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 05:10:56.687092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0f84352c-ff84-485a-a5a5-18314e64ea30',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126071) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1853}} Jul 28 05:10:56.737053 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-68078360-9779-47f9-b3de-f5cb32d849ae tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.621938 Jul 28 05:10:56.737707 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5384/7834] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Jul 28 05:10:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 05:10:56.748823 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-213075f1-e019-4d1d-90cc-b5e3063f017f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:10:56.749446 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-213075f1-e019-4d1d-90cc-b5e3063f017f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:10:56.808787 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-213075f1-e019-4d1d-90cc-b5e3063f017f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:10:56.815892 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-213075f1-e019-4d1d-90cc-b5e3063f017f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1248 microversion: 2.1 time: 0.070907 Jul 28 05:10:56.816504 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5385/7835] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:10:56 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:10:57.837711 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-dfad0883-9c62-4b0e-9dd5-ae563bd23bad tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:10:57.838377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-dfad0883-9c62-4b0e-9dd5-ae563bd23bad tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:10:57.846674 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfad0883-9c62-4b0e-9dd5-ae563bd23bad tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:10:57.847128 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfad0883-9c62-4b0e-9dd5-ae563bd23bad tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:10:57.847910 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfad0883-9c62-4b0e-9dd5-ae563bd23bad tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:10:57.848343 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-dfad0883-9c62-4b0e-9dd5-ae563bd23bad tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:10:57.920606 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-dfad0883-9c62-4b0e-9dd5-ae563bd23bad tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:10:57.931878 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-dfad0883-9c62-4b0e-9dd5-ae563bd23bad tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1308 microversion: 2.1 time: 0.098623 Jul 28 05:10:57.941602 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5386/7836] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:10:57 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:10:58.954928 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-45cdcdc0-bbb6-49d7-aa2e-1bbb0fec8a1a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:10:58.956258 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-45cdcdc0-bbb6-49d7-aa2e-1bbb0fec8a1a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:10:58.962916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45cdcdc0-bbb6-49d7-aa2e-1bbb0fec8a1a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:10:58.963620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45cdcdc0-bbb6-49d7-aa2e-1bbb0fec8a1a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:10:58.964754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45cdcdc0-bbb6-49d7-aa2e-1bbb0fec8a1a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:10:58.965356 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-45cdcdc0-bbb6-49d7-aa2e-1bbb0fec8a1a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:10:59.192501 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-45cdcdc0-bbb6-49d7-aa2e-1bbb0fec8a1a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:10:59.202054 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-45cdcdc0-bbb6-49d7-aa2e-1bbb0fec8a1a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1373 microversion: 2.1 time: 0.252064 Jul 28 05:10:59.203569 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5387/7837] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:10:58 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1373 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:10:59.217206 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-678a114b-4b99-41d1-b515-f9beacb6c73b req-068e453f-d8ed-458d-b62d-df7f9da9b482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a62e80-940f-4db2-9433-f813f792f470", "name": "network-vif-unplugged", "status": "completed", "tag": "1775d0d3-f217-4c80-9cea-06fcd44b0ff0"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:10:59.233107 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-678a114b-4b99-41d1-b515-f9beacb6c73b req-068e453f-d8ed-458d-b62d-df7f9da9b482 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:10:59.233572 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-678a114b-4b99-41d1-b515-f9beacb6c73b req-068e453f-d8ed-458d-b62d-df7f9da9b482 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:10:59.249815 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-678a114b-4b99-41d1-b515-f9beacb6c73b req-068e453f-d8ed-458d-b62d-df7f9da9b482 service nova] Creating event network-vif-unplugged:1775d0d3-f217-4c80-9cea-06fcd44b0ff0 for instance 75a62e80-940f-4db2-9433-f813f792f470 on n-h2-826756-3 Jul 28 05:10:59.255972 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-678a114b-4b99-41d1-b515-f9beacb6c73b req-068e453f-d8ed-458d-b62d-df7f9da9b482 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050267 Jul 28 05:10:59.256623 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5388/7838] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:11:00.227816 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-975fc81c-c485-4872-96ae-49223e82933e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:11:00.228591 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-975fc81c-c485-4872-96ae-49223e82933e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:11:00.237424 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-975fc81c-c485-4872-96ae-49223e82933e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:00.238400 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-975fc81c-c485-4872-96ae-49223e82933e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:00.239583 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-975fc81c-c485-4872-96ae-49223e82933e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:00.240450 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-975fc81c-c485-4872-96ae-49223e82933e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:00.400332 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-975fc81c-c485-4872-96ae-49223e82933e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:11:00.409110 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-975fc81c-c485-4872-96ae-49223e82933e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1373 microversion: 2.1 time: 0.185915 Jul 28 05:11:00.409742 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5389/7839] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:11:00 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1373 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:11:01.431137 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-fffeff9a-5fd0-4c90-8d50-2fcd5323bc4c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:11:01.431838 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-fffeff9a-5fd0-4c90-8d50-2fcd5323bc4c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:11:01.439647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fffeff9a-5fd0-4c90-8d50-2fcd5323bc4c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:01.440147 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fffeff9a-5fd0-4c90-8d50-2fcd5323bc4c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:01.441050 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fffeff9a-5fd0-4c90-8d50-2fcd5323bc4c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:01.441579 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-fffeff9a-5fd0-4c90-8d50-2fcd5323bc4c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:01.599282 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-fffeff9a-5fd0-4c90-8d50-2fcd5323bc4c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:11:01.607772 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-fffeff9a-5fd0-4c90-8d50-2fcd5323bc4c tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1373 microversion: 2.1 time: 0.180702 Jul 28 05:11:01.608389 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5390/7840] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:11:01 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:11:02.632101 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a20cc85f-8d8b-4adc-9c73-07dbb71a3177 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:11:02.632871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a20cc85f-8d8b-4adc-9c73-07dbb71a3177 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:11:02.639965 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a20cc85f-8d8b-4adc-9c73-07dbb71a3177 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:02.640730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a20cc85f-8d8b-4adc-9c73-07dbb71a3177 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:02.641539 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a20cc85f-8d8b-4adc-9c73-07dbb71a3177 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:02.641994 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a20cc85f-8d8b-4adc-9c73-07dbb71a3177 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:02.785437 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a20cc85f-8d8b-4adc-9c73-07dbb71a3177 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:11:02.793594 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a20cc85f-8d8b-4adc-9c73-07dbb71a3177 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1373 microversion: 2.1 time: 0.165810 Jul 28 05:11:02.794401 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5391/7841] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:11:02 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:11:03.817528 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-82608abd-152b-4918-8f05-377e7aa40f1b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:11:03.819204 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-82608abd-152b-4918-8f05-377e7aa40f1b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:11:03.826993 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82608abd-152b-4918-8f05-377e7aa40f1b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:03.827958 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82608abd-152b-4918-8f05-377e7aa40f1b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:03.828628 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82608abd-152b-4918-8f05-377e7aa40f1b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:03.828984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-82608abd-152b-4918-8f05-377e7aa40f1b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:03.979326 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-82608abd-152b-4918-8f05-377e7aa40f1b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:11:03.988001 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-82608abd-152b-4918-8f05-377e7aa40f1b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1373 microversion: 2.1 time: 0.176888 Jul 28 05:11:03.988776 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5392/7842] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:11:03 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:11:05.010007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-d2fae2a0-e87c-40a6-83a1-f6bc4485113e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:11:05.010754 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-d2fae2a0-e87c-40a6-83a1-f6bc4485113e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:11:05.019751 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2fae2a0-e87c-40a6-83a1-f6bc4485113e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:05.020229 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2fae2a0-e87c-40a6-83a1-f6bc4485113e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:05.021096 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2fae2a0-e87c-40a6-83a1-f6bc4485113e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:05.021694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-d2fae2a0-e87c-40a6-83a1-f6bc4485113e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:05.193633 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-d2fae2a0-e87c-40a6-83a1-f6bc4485113e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:11:05.203351 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-d2fae2a0-e87c-40a6-83a1-f6bc4485113e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1373 microversion: 2.1 time: 0.197782 Jul 28 05:11:05.213718 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5393/7843] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:11:05 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:11:06.224980 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-86528fad-0049-4661-afe5-dd0d5bee36cb tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:11:06.225730 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-86528fad-0049-4661-afe5-dd0d5bee36cb tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:11:06.232238 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86528fad-0049-4661-afe5-dd0d5bee36cb tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:06.232723 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86528fad-0049-4661-afe5-dd0d5bee36cb tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:06.233498 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86528fad-0049-4661-afe5-dd0d5bee36cb tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:06.233940 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-86528fad-0049-4661-afe5-dd0d5bee36cb tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:06.423180 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-86528fad-0049-4661-afe5-dd0d5bee36cb tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:11:06.438819 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-86528fad-0049-4661-afe5-dd0d5bee36cb tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1373 microversion: 2.1 time: 0.218179 Jul 28 05:11:06.439860 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5394/7844] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:11:06 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1373 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:11:06.519394 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-ff931091-de1a-49ad-97cb-c2eb036924fc req-62043034-5b3c-4ac6-bfc3-0dea465eca53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4263d600-89b9-482a-afd6-349832f8815f", "tag": "7bb212ba-cf74-4639-827b-47a003071430"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:11:06.531423 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ff931091-de1a-49ad-97cb-c2eb036924fc req-62043034-5b3c-4ac6-bfc3-0dea465eca53 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:06.531886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-ff931091-de1a-49ad-97cb-c2eb036924fc req-62043034-5b3c-4ac6-bfc3-0dea465eca53 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:06.546367 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-ff931091-de1a-49ad-97cb-c2eb036924fc req-62043034-5b3c-4ac6-bfc3-0dea465eca53 service nova] Creating event network-changed:7bb212ba-cf74-4639-827b-47a003071430 for instance 4263d600-89b9-482a-afd6-349832f8815f on n-h1-826756-3 Jul 28 05:11:06.551758 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-ff931091-de1a-49ad-97cb-c2eb036924fc req-62043034-5b3c-4ac6-bfc3-0dea465eca53 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037560 Jul 28 05:11:06.552754 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5395/7845] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:11:07.462385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8e5bc722-706f-4f1a-9c46-e8ba58d97b9f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:11:07.463056 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8e5bc722-706f-4f1a-9c46-e8ba58d97b9f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:11:07.465385 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=2 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:11:07.466112 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell0:SELECT=8 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:11:07.474164 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e5bc722-706f-4f1a-9c46-e8ba58d97b9f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:07.474984 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e5bc722-706f-4f1a-9c46-e8ba58d97b9f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:07.475758 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e5bc722-706f-4f1a-9c46-e8ba58d97b9f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:07.476197 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8e5bc722-706f-4f1a-9c46-e8ba58d97b9f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:07.614511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8e5bc722-706f-4f1a-9c46-e8ba58d97b9f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:11:07.624385 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8e5bc722-706f-4f1a-9c46-e8ba58d97b9f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1373 microversion: 2.1 time: 0.166599 Jul 28 05:11:07.625043 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5396/7846] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:11:07 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:11:08.647409 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-169ac573-dd6c-4eab-8526-4dce30e70eb6 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:11:08.648273 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-169ac573-dd6c-4eab-8526-4dce30e70eb6 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:11:08.656873 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-169ac573-dd6c-4eab-8526-4dce30e70eb6 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:08.657444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-169ac573-dd6c-4eab-8526-4dce30e70eb6 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:08.658405 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-169ac573-dd6c-4eab-8526-4dce30e70eb6 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:08.658956 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-169ac573-dd6c-4eab-8526-4dce30e70eb6 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:08.808513 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-169ac573-dd6c-4eab-8526-4dce30e70eb6 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:11:08.816885 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-169ac573-dd6c-4eab-8526-4dce30e70eb6 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1373 microversion: 2.1 time: 0.174523 Jul 28 05:11:08.817479 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5397/7847] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:11:08 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:11:09.838793 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-989f27bd-dc82-47c7-84bd-bc177244d06f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:11:09.839509 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-989f27bd-dc82-47c7-84bd-bc177244d06f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:11:09.847639 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-989f27bd-dc82-47c7-84bd-bc177244d06f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:09.848102 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-989f27bd-dc82-47c7-84bd-bc177244d06f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:09.848938 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-989f27bd-dc82-47c7-84bd-bc177244d06f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:09.849761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-989f27bd-dc82-47c7-84bd-bc177244d06f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:10.003130 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-989f27bd-dc82-47c7-84bd-bc177244d06f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:11:10.011355 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-989f27bd-dc82-47c7-84bd-bc177244d06f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1373 microversion: 2.1 time: 0.176847 Jul 28 05:11:10.011957 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5398/7848] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:11:09 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:11:11.036801 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-123b2982-1b65-43d3-8b62-5f9604714f8a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:11:11.037886 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-123b2982-1b65-43d3-8b62-5f9604714f8a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:11:11.046782 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-123b2982-1b65-43d3-8b62-5f9604714f8a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:11.047253 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-123b2982-1b65-43d3-8b62-5f9604714f8a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:11.048116 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-123b2982-1b65-43d3-8b62-5f9604714f8a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:11.048603 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-123b2982-1b65-43d3-8b62-5f9604714f8a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:11.186865 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-123b2982-1b65-43d3-8b62-5f9604714f8a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:11:11.195436 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-123b2982-1b65-43d3-8b62-5f9604714f8a tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1373 microversion: 2.1 time: 0.165292 Jul 28 05:11:11.196025 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5399/7849] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:11:11 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:11:11.801684 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9c016797-3334-4a62-9cc9-556e9a7b09f1 req-6e99db90-5c0e-470d-936d-4ebd3a828c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4263d600-89b9-482a-afd6-349832f8815f", "name": "network-vif-plugged", "status": "completed", "tag": "7bb212ba-cf74-4639-827b-47a003071430"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:11:11.812672 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9c016797-3334-4a62-9cc9-556e9a7b09f1 req-6e99db90-5c0e-470d-936d-4ebd3a828c54 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:11.813141 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9c016797-3334-4a62-9cc9-556e9a7b09f1 req-6e99db90-5c0e-470d-936d-4ebd3a828c54 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:11.826160 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9c016797-3334-4a62-9cc9-556e9a7b09f1 req-6e99db90-5c0e-470d-936d-4ebd3a828c54 service nova] Creating event network-vif-plugged:7bb212ba-cf74-4639-827b-47a003071430 for instance 4263d600-89b9-482a-afd6-349832f8815f on n-h1-826756-3 Jul 28 05:11:11.831320 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9c016797-3334-4a62-9cc9-556e9a7b09f1 req-6e99db90-5c0e-470d-936d-4ebd3a828c54 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033502 Jul 28 05:11:11.832298 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5400/7850] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:11:12.217949 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cc2ec4a5-9103-49db-98f4-9da10c7610c2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:11:12.218661 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cc2ec4a5-9103-49db-98f4-9da10c7610c2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:11:12.221573 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:11:12.228088 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc2ec4a5-9103-49db-98f4-9da10c7610c2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:12.228597 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc2ec4a5-9103-49db-98f4-9da10c7610c2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:12.229395 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc2ec4a5-9103-49db-98f4-9da10c7610c2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:12.229842 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cc2ec4a5-9103-49db-98f4-9da10c7610c2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:12.233218 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:11:12.376851 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cc2ec4a5-9103-49db-98f4-9da10c7610c2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:11:12.384852 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cc2ec4a5-9103-49db-98f4-9da10c7610c2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1373 microversion: 2.1 time: 0.171332 Jul 28 05:11:12.385414 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5401/7851] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:11:12 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:11:13.407414 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-e6a9d18d-d240-422c-8044-894a9396df33 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:11:13.408111 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-e6a9d18d-d240-422c-8044-894a9396df33 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:11:13.415346 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6a9d18d-d240-422c-8044-894a9396df33 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:13.415808 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6a9d18d-d240-422c-8044-894a9396df33 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:13.416642 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6a9d18d-d240-422c-8044-894a9396df33 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:13.417074 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-e6a9d18d-d240-422c-8044-894a9396df33 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:13.558076 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-e6a9d18d-d240-422c-8044-894a9396df33 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:11:13.566283 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-e6a9d18d-d240-422c-8044-894a9396df33 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1557 microversion: 2.1 time: 0.163068 Jul 28 05:11:13.566854 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5402/7852] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:11:13 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:11:13.588388 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cb6d89c9-207b-45a6-9e17-6ed39ffcef6f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:11:13.589035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cb6d89c9-207b-45a6-9e17-6ed39ffcef6f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:11:13.595765 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb6d89c9-207b-45a6-9e17-6ed39ffcef6f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:13.596205 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb6d89c9-207b-45a6-9e17-6ed39ffcef6f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:13.597035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb6d89c9-207b-45a6-9e17-6ed39ffcef6f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:13.597481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cb6d89c9-207b-45a6-9e17-6ed39ffcef6f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:13.746526 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cb6d89c9-207b-45a6-9e17-6ed39ffcef6f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:11:13.759293 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cb6d89c9-207b-45a6-9e17-6ed39ffcef6f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1557 microversion: 2.1 time: 0.175811 Jul 28 05:11:13.760105 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5403/7853] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:11:13 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1557 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:11:15.431383 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-c2c3dfaa-5cde-4e18-a752-deb880600a96 req-e2750a4f-c664-419b-a8ac-807b21d0f901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4263d600-89b9-482a-afd6-349832f8815f", "tag": "7bb212ba-cf74-4639-827b-47a003071430"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:11:15.442301 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c2c3dfaa-5cde-4e18-a752-deb880600a96 req-e2750a4f-c664-419b-a8ac-807b21d0f901 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:11:15.442769 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-c2c3dfaa-5cde-4e18-a752-deb880600a96 req-e2750a4f-c664-419b-a8ac-807b21d0f901 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:11:15.454141 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-c2c3dfaa-5cde-4e18-a752-deb880600a96 req-e2750a4f-c664-419b-a8ac-807b21d0f901 service nova] Creating event network-changed:7bb212ba-cf74-4639-827b-47a003071430 for instance 4263d600-89b9-482a-afd6-349832f8815f on n-h1-826756-3 Jul 28 05:11:15.459373 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-c2c3dfaa-5cde-4e18-a752-deb880600a96 req-e2750a4f-c664-419b-a8ac-807b21d0f901 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031889 Jul 28 05:11:15.460378 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5404/7854] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:11:45.937460 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:11:45.938229 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 05:11:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 05:12:46.103440 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_api:SELECT=7 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:46.104279 n-d-826756-3 devstack@n-api.service[126071]: DEBUG dbcounter [-] [126071] Writing DB stats nova_cell1:SELECT=19 {{(pid=126071) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 05:12:46.108887 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6c35e08c-c2e9-4212-83e6-6d2d3b1470e1 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2024751969"}} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:12:46.111337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6c35e08c-c2e9-4212-83e6-6d2d3b1470e1 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:12:46.118662 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c35e08c-c2e9-4212-83e6-6d2d3b1470e1 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:12:46.119119 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c35e08c-c2e9-4212-83e6-6d2d3b1470e1 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:12:46.122144 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c35e08c-c2e9-4212-83e6-6d2d3b1470e1 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:12:46.122595 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6c35e08c-c2e9-4212-83e6-6d2d3b1470e1 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:12:46.322505 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6c35e08c-c2e9-4212-83e6-6d2d3b1470e1 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "POST /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f/action" status: 202 len: 0 microversion: 2.1 time: 0.221259 Jul 28 05:12:46.323069 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5405/7855] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Jul 28 05:12:46 2022] POST /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 28 05:12:52.222455 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-590b643d-92c3-4807-ab8b-3a53f81bbe5a req-d0c6990b-9ec4-4655-9854-88b3d2ca8049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4263d600-89b9-482a-afd6-349832f8815f", "name": "network-vif-plugged", "status": "completed", "tag": "7bb212ba-cf74-4639-827b-47a003071430"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:12:52.238476 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-590b643d-92c3-4807-ab8b-3a53f81bbe5a req-d0c6990b-9ec4-4655-9854-88b3d2ca8049 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:12:52.239652 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-590b643d-92c3-4807-ab8b-3a53f81bbe5a req-d0c6990b-9ec4-4655-9854-88b3d2ca8049 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:12:52.255553 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-590b643d-92c3-4807-ab8b-3a53f81bbe5a req-d0c6990b-9ec4-4655-9854-88b3d2ca8049 service nova] Creating event network-vif-plugged:7bb212ba-cf74-4639-827b-47a003071430 for instance 4263d600-89b9-482a-afd6-349832f8815f on n-h1-826756-3 Jul 28 05:12:52.261415 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-590b643d-92c3-4807-ab8b-3a53f81bbe5a req-d0c6990b-9ec4-4655-9854-88b3d2ca8049 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042988 Jul 28 05:12:52.262527 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5406/7856] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 05:13:00.150737 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-667a4c17-3261-4810-a179-82b568304b1f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:13:00.151449 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-667a4c17-3261-4810-a179-82b568304b1f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:13:00.159092 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-667a4c17-3261-4810-a179-82b568304b1f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:00.159532 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-667a4c17-3261-4810-a179-82b568304b1f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:00.160444 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-667a4c17-3261-4810-a179-82b568304b1f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:00.160897 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-667a4c17-3261-4810-a179-82b568304b1f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:00.192402 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-667a4c17-3261-4810-a179-82b568304b1f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 05:13:00.279657 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-667a4c17-3261-4810-a179-82b568304b1f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 204 len: 0 microversion: 2.1 time: 0.133122 Jul 28 05:13:00.284032 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5407/7857] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 05:13:00 2022] DELETE /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:00.342673 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-9e6c7145-cdae-4e72-a3d7-e00bda7a5965 req-ad4d19a5-7e1d-4db1-ad27-6d3d0e97a538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4263d600-89b9-482a-afd6-349832f8815f", "tag": "7bb212ba-cf74-4639-827b-47a003071430"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:13:00.353313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9e6c7145-cdae-4e72-a3d7-e00bda7a5965 req-ad4d19a5-7e1d-4db1-ad27-6d3d0e97a538 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:00.353770 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-9e6c7145-cdae-4e72-a3d7-e00bda7a5965 req-ad4d19a5-7e1d-4db1-ad27-6d3d0e97a538 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:00.365324 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-9e6c7145-cdae-4e72-a3d7-e00bda7a5965 req-ad4d19a5-7e1d-4db1-ad27-6d3d0e97a538 service nova] Creating event network-changed:7bb212ba-cf74-4639-827b-47a003071430 for instance 4263d600-89b9-482a-afd6-349832f8815f on n-h1-826756-3 Jul 28 05:13:00.370271 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-9e6c7145-cdae-4e72-a3d7-e00bda7a5965 req-ad4d19a5-7e1d-4db1-ad27-6d3d0e97a538 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088534 Jul 28 05:13:00.370868 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5408/7858] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:13:00.379307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-8ae481cd-77ef-495c-b703-3f2431acf9f2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:13:00.380034 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-8ae481cd-77ef-495c-b703-3f2431acf9f2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:13:00.386355 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ae481cd-77ef-495c-b703-3f2431acf9f2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:00.386911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ae481cd-77ef-495c-b703-3f2431acf9f2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:00.387604 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ae481cd-77ef-495c-b703-3f2431acf9f2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:00.388511 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-8ae481cd-77ef-495c-b703-3f2431acf9f2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:00.533420 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-8ae481cd-77ef-495c-b703-3f2431acf9f2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:13:00.541444 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-8ae481cd-77ef-495c-b703-3f2431acf9f2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1682 microversion: 2.1 time: 0.166504 Jul 28 05:13:00.542025 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5409/7859] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:13:00 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:01.563901 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-a8dabc0a-741c-4b1d-9de5-e8dab62785e0 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:13:01.566007 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-a8dabc0a-741c-4b1d-9de5-e8dab62785e0 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:13:01.573252 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8dabc0a-741c-4b1d-9de5-e8dab62785e0 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:01.573690 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8dabc0a-741c-4b1d-9de5-e8dab62785e0 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:01.574506 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8dabc0a-741c-4b1d-9de5-e8dab62785e0 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:01.574954 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-a8dabc0a-741c-4b1d-9de5-e8dab62785e0 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:01.715626 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-a8dabc0a-741c-4b1d-9de5-e8dab62785e0 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:13:01.723793 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-a8dabc0a-741c-4b1d-9de5-e8dab62785e0 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1682 microversion: 2.1 time: 0.164384 Jul 28 05:13:01.724775 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5410/7860] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:13:01 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:02.214647 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-6c1851cb-7b92-4c12-ab68-3ef8c2631d8d req-2d068ae7-6003-4db0-8bde-19ed647f9217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4263d600-89b9-482a-afd6-349832f8815f", "name": "network-vif-unplugged", "status": "completed", "tag": "7bb212ba-cf74-4639-827b-47a003071430"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:13:02.229534 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6c1851cb-7b92-4c12-ab68-3ef8c2631d8d req-2d068ae7-6003-4db0-8bde-19ed647f9217 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:02.230080 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-6c1851cb-7b92-4c12-ab68-3ef8c2631d8d req-2d068ae7-6003-4db0-8bde-19ed647f9217 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:02.242695 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-6c1851cb-7b92-4c12-ab68-3ef8c2631d8d req-2d068ae7-6003-4db0-8bde-19ed647f9217 service nova] Creating event network-vif-unplugged:7bb212ba-cf74-4639-827b-47a003071430 for instance 4263d600-89b9-482a-afd6-349832f8815f on n-h1-826756-3 Jul 28 05:13:02.248272 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-6c1851cb-7b92-4c12-ab68-3ef8c2631d8d req-2d068ae7-6003-4db0-8bde-19ed647f9217 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037388 Jul 28 05:13:02.249213 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5411/7861] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:13:02.749415 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-6d29ba9c-e44b-47ae-8478-79683c4208b2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:13:02.750125 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-6d29ba9c-e44b-47ae-8478-79683c4208b2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:13:02.758287 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d29ba9c-e44b-47ae-8478-79683c4208b2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:02.758761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d29ba9c-e44b-47ae-8478-79683c4208b2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:02.759550 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d29ba9c-e44b-47ae-8478-79683c4208b2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:02.760009 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-6d29ba9c-e44b-47ae-8478-79683c4208b2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:02.828285 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-6d29ba9c-e44b-47ae-8478-79683c4208b2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:13:02.837014 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-6d29ba9c-e44b-47ae-8478-79683c4208b2 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 200 len: 1496 microversion: 2.1 time: 0.094522 Jul 28 05:13:02.837612 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5412/7862] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:13:02 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 1496 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 05:13:02.842245 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-1074b000-43e5-4070-9efc-b8ef3d339af9 req-a0aedbc4-77fa-4af5-8a9b-aeb03ec80650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4263d600-89b9-482a-afd6-349832f8815f", "name": "network-vif-deleted", "tag": "7bb212ba-cf74-4639-827b-47a003071430"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:13:02.852517 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1074b000-43e5-4070-9efc-b8ef3d339af9 req-a0aedbc4-77fa-4af5-8a9b-aeb03ec80650 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:02.852974 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-1074b000-43e5-4070-9efc-b8ef3d339af9 req-a0aedbc4-77fa-4af5-8a9b-aeb03ec80650 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:02.865563 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-1074b000-43e5-4070-9efc-b8ef3d339af9 req-a0aedbc4-77fa-4af5-8a9b-aeb03ec80650 service nova] Creating event network-vif-deleted:7bb212ba-cf74-4639-827b-47a003071430 for instance 4263d600-89b9-482a-afd6-349832f8815f on n-h1-826756-3 Jul 28 05:13:02.871768 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-1074b000-43e5-4070-9efc-b8ef3d339af9 req-a0aedbc4-77fa-4af5-8a9b-aeb03ec80650 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032658 Jul 28 05:13:02.872677 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5413/7863] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:13:03.866225 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eacfb150-c777-4d37-aa10-fea9512bfb7e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:13:03.867328 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-eacfb150-c777-4d37-aa10-fea9512bfb7e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 4263d600-89b9-482a-afd6-349832f8815f] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:13:03.877911 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eacfb150-c777-4d37-aa10-fea9512bfb7e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:03.878381 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eacfb150-c777-4d37-aa10-fea9512bfb7e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:03.879174 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eacfb150-c777-4d37-aa10-fea9512bfb7e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:03.879620 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-eacfb150-c777-4d37-aa10-fea9512bfb7e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:03.893561 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-eacfb150-c777-4d37-aa10-fea9512bfb7e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] HTTP exception thrown: Instance 4263d600-89b9-482a-afd6-349832f8815f could not be found. Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eacfb150-c777-4d37-aa10-fea9512bfb7e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Request method failure captured: Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f HTTP/1.1 Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hnJEWK_h2zYLagW6SGNQ5WPhLbYpsnqF7LFLtXDKHsK2C2lnOSXZGrAqzxDDp5UvcWsz8pKMNtxnbiiIA3doJsaGXEC0fdpLcGvtKeadXZrJQR2YgELtnz_rWyYmTnXGPYFjN0ZsoGVqusWJu3C1IrHHTZ5O9lItTvrS30ek976ylI Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7665169c9c32464ba3b8273275fc0751 Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestSnapshotPattern-947196315 Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7665169c9c32464ba3b8273275fc0751"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7665169c9c32464ba3b8273275fc0751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7665169c9c32464ba3b8273275fc0751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7665169c9c32464ba3b8273275fc0751"}]}] Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestSnapshotPattern-947196315 Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7665169c9c32464ba3b8273275fc0751 Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestSnapshotPattern-947196315 Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestSnapshotPattern-947196315-project Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 53023fb0a2264d18a217d5c5194eac4b Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestSnapshotPattern-947196315-project Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 4263d600-89b9-482a-afd6-349832f8815f could not be found. Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '4263d600-89b9-482a-afd6-349832f8815f'} Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4263d600-89b9-482a-afd6-349832f8815f could not be found. Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4263d600-89b9-482a-afd6-349832f8815f could not be found. Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:13:03.895224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:13:03.900497 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:13:03.900497 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:13:03.900497 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:13:03.900497 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:13:03.900497 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:13:03.900497 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4263d600-89b9-482a-afd6-349832f8815f could not be found. Jul 28 05:13:03.900497 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:13:03.900497 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-eacfb150-c777-4d37-aa10-fea9512bfb7e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Returning 404 to user: Instance 4263d600-89b9-482a-afd6-349832f8815f could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:13:03.900497 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-eacfb150-c777-4d37-aa10-fea9512bfb7e tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f" status: 404 len: 111 microversion: 2.1 time: 0.039233 Jul 28 05:13:03.900497 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5414/7864] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:13:03 2022] GET /compute/v2.1/servers/4263d600-89b9-482a-afd6-349832f8815f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:13:05.307026 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-47938d1e-32b3-4fdc-bf61-fd83a6956efc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:13:05.307654 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-47938d1e-32b3-4fdc-bf61-fd83a6956efc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:13:05.315852 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47938d1e-32b3-4fdc-bf61-fd83a6956efc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:05.316307 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47938d1e-32b3-4fdc-bf61-fd83a6956efc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:05.317114 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47938d1e-32b3-4fdc-bf61-fd83a6956efc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:05.317567 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-47938d1e-32b3-4fdc-bf61-fd83a6956efc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:05.344477 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-47938d1e-32b3-4fdc-bf61-fd83a6956efc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Going to try to terminate instance {{(pid=126071) delete /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 05:13:05.433818 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-47938d1e-32b3-4fdc-bf61-fd83a6956efc tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "DELETE /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 204 len: 0 microversion: 2.1 time: 0.130334 Jul 28 05:13:05.437293 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5415/7865] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Jul 28 05:13:05 2022] DELETE /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 05:13:05.439658 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-f2ddbdf8-c8a0-47fa-a076-61433771961e req-3bd571c4-f6d1-4d88-aa5f-ec950d349371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75a62e80-940f-4db2-9433-f813f792f470", "tag": "1775d0d3-f217-4c80-9cea-06fcd44b0ff0"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:13:05.450937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f2ddbdf8-c8a0-47fa-a076-61433771961e req-3bd571c4-f6d1-4d88-aa5f-ec950d349371 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:05.450937 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-f2ddbdf8-c8a0-47fa-a076-61433771961e req-3bd571c4-f6d1-4d88-aa5f-ec950d349371 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:05.467790 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-f2ddbdf8-c8a0-47fa-a076-61433771961e req-3bd571c4-f6d1-4d88-aa5f-ec950d349371 service nova] Creating event network-changed:1775d0d3-f217-4c80-9cea-06fcd44b0ff0 for instance 75a62e80-940f-4db2-9433-f813f792f470 on n-h2-826756-3 Jul 28 05:13:05.473385 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-f2ddbdf8-c8a0-47fa-a076-61433771961e req-3bd571c4-f6d1-4d88-aa5f-ec950d349371 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037769 Jul 28 05:13:05.474754 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5416/7866] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:13:05.480169 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-72f1f40e-b2d1-48b4-8f25-44674480823f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:13:05.480916 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-72f1f40e-b2d1-48b4-8f25-44674480823f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:13:05.487735 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72f1f40e-b2d1-48b4-8f25-44674480823f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:05.488201 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72f1f40e-b2d1-48b4-8f25-44674480823f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:05.489035 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72f1f40e-b2d1-48b4-8f25-44674480823f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:05.489474 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-72f1f40e-b2d1-48b4-8f25-44674480823f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:05.635371 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-72f1f40e-b2d1-48b4-8f25-44674480823f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:13:05.644206 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-72f1f40e-b2d1-48b4-8f25-44674480823f tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 200 len: 1683 microversion: 2.1 time: 0.168142 Jul 28 05:13:05.644831 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5417/7867] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:13:05 2022] GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:06.668461 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-7a36fdc4-b91e-4c25-8f96-aa15dec7ca46 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:13:06.669184 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-7a36fdc4-b91e-4c25-8f96-aa15dec7ca46 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:13:06.677038 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a36fdc4-b91e-4c25-8f96-aa15dec7ca46 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:06.677502 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a36fdc4-b91e-4c25-8f96-aa15dec7ca46 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:06.678298 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a36fdc4-b91e-4c25-8f96-aa15dec7ca46 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:06.678750 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-7a36fdc4-b91e-4c25-8f96-aa15dec7ca46 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:06.825246 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-7a36fdc4-b91e-4c25-8f96-aa15dec7ca46 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:13:06.833548 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-7a36fdc4-b91e-4c25-8f96-aa15dec7ca46 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 200 len: 1683 microversion: 2.1 time: 0.170300 Jul 28 05:13:06.834138 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5418/7868] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:13:06 2022] GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:07.855696 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-cf569245-50ab-4243-bb91-99fa5c838a60 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:13:07.856481 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-cf569245-50ab-4243-bb91-99fa5c838a60 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:13:07.863871 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf569245-50ab-4243-bb91-99fa5c838a60 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:07.864337 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf569245-50ab-4243-bb91-99fa5c838a60 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:07.865188 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf569245-50ab-4243-bb91-99fa5c838a60 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:07.865611 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-cf569245-50ab-4243-bb91-99fa5c838a60 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:08.013677 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.policy [None req-cf569245-50ab-4243-bb91-99fa5c838a60 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53023fb0a2264d18a217d5c5194eac4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7665169c9c32464ba3b8273275fc0751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126071) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 05:13:08.022560 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-cf569245-50ab-4243-bb91-99fa5c838a60 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 200 len: 1683 microversion: 2.1 time: 0.170761 Jul 28 05:13:08.023193 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5419/7869] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:13:07 2022] GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 05:13:08.111964 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [req-cbf514e6-4707-4956-9310-f5c191eaeaf0 req-413cfaa2-6083-499e-8f7a-c41c88216f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75a62e80-940f-4db2-9433-f813f792f470", "name": "network-vif-deleted", "tag": "1775d0d3-f217-4c80-9cea-06fcd44b0ff0"}]} {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 05:13:08.124266 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cbf514e6-4707-4956-9310-f5c191eaeaf0 req-413cfaa2-6083-499e-8f7a-c41c88216f81 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:08.124761 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [req-cbf514e6-4707-4956-9310-f5c191eaeaf0 req-413cfaa2-6083-499e-8f7a-c41c88216f81 service nova] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:08.137207 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.compute.server_external_events [req-cbf514e6-4707-4956-9310-f5c191eaeaf0 req-413cfaa2-6083-499e-8f7a-c41c88216f81 service nova] Creating event network-vif-deleted:1775d0d3-f217-4c80-9cea-06fcd44b0ff0 for instance 75a62e80-940f-4db2-9433-f813f792f470 on n-h2-826756-3 Jul 28 05:13:08.142639 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [req-cbf514e6-4707-4956-9310-f5c191eaeaf0 req-413cfaa2-6083-499e-8f7a-c41c88216f81 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034657 Jul 28 05:13:08.143289 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5420/7870] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jul 28 05:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 05:13:09.053003 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ef59abc8-c77a-4c1f-8c40-849056df295b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:13:09.053694 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.compute.api [None req-ef59abc8-c77a-4c1f-8c40-849056df295b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] [instance: 75a62e80-940f-4db2-9433-f813f792f470] Fetching instance by UUID {{(pid=126071) get /opt/stack/nova/nova/compute/api.py:2966}} Jul 28 05:13:09.062596 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef59abc8-c77a-4c1f-8c40-849056df295b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:09.063313 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef59abc8-c77a-4c1f-8c40-849056df295b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:09.064377 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef59abc8-c77a-4c1f-8c40-849056df295b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 05:13:09.064861 n-d-826756-3 devstack@n-api.service[126071]: DEBUG oslo_concurrency.lockutils [None req-ef59abc8-c77a-4c1f-8c40-849056df295b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Lock "a8b3e198-f422-4bf1-ae6c-bd38905d4b84" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126071) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 05:13:09.079116 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.wsgi [None req-ef59abc8-c77a-4c1f-8c40-849056df295b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] HTTP exception thrown: Instance 75a62e80-940f-4db2-9433-f813f792f470 could not be found. Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ef59abc8-c77a-4c1f-8c40-849056df295b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Request method failure captured: Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: request: GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 HTTP/1.1 Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: Accept: application/json Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: Accept-Encoding: identity Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: Connection: close Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: Content-Length: 0 Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: Content-Type: application/json Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: Host: 10.222.0.48 Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: Openstack-System-Scope: None Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: User-Agent: python-urllib3/1.26.10 Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Auth-Token: gAAAAABi4hnJEWK_h2zYLagW6SGNQ5WPhLbYpsnqF7LFLtXDKHsK2C2lnOSXZGrAqzxDDp5UvcWsz8pKMNtxnbiiIA3doJsaGXEC0fdpLcGvtKeadXZrJQR2YgELtnz_rWyYmTnXGPYFjN0ZsoGVqusWJu3C1IrHHTZ5O9lItTvrS30ek976ylI Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Id: None Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Domain-Name: None Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Identity-Status: Confirmed Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Is-Admin-Project: True Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Id: default Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Domain-Name: Default Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Id: 7665169c9c32464ba3b8273275fc0751 Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Project-Name: tempest-TestSnapshotPattern-947196315 Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Role: reader,member Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Roles: reader,member Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7665169c9c32464ba3b8273275fc0751"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7665169c9c32464ba3b8273275fc0751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7665169c9c32464ba3b8273275fc0751"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7665169c9c32464ba3b8273275fc0751"}]}] Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant: tempest-TestSnapshotPattern-947196315 Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Id: 7665169c9c32464ba3b8273275fc0751 Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-Tenant-Name: tempest-TestSnapshotPattern-947196315 Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-User: tempest-TestSnapshotPattern-947196315-project Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Id: default Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-User-Domain-Name: Default Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-User-Id: 53023fb0a2264d18a217d5c5194eac4b Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: X-User-Name: tempest-TestSnapshotPattern-947196315-project Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: method: > Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: exception: Instance 75a62e80-940f-4db2-9433-f813f792f470 could not be found. Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: action_args: {'id': '75a62e80-940f-4db2-9433-f813f792f470'} Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2916, in _get_instance Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance_from_cell Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75a62e80-940f-4db2-9433-f813f792f470 could not be found. Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75a62e80-940f-4db2-9433-f813f792f470 could not be found. Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 05:13:09.080836 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:13:09.085224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 05:13:09.085224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 05:13:09.085224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 05:13:09.085224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 05:13:09.085224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 05:13:09.085224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75a62e80-940f-4db2-9433-f813f792f470 could not be found. Jul 28 05:13:09.085224 n-d-826756-3 devstack@n-api.service[126071]: ERROR nova.api.openstack.wsgi Jul 28 05:13:09.085224 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-ef59abc8-c77a-4c1f-8c40-849056df295b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Returning 404 to user: Instance 75a62e80-940f-4db2-9433-f813f792f470 could not be found. {{(pid=126071) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 05:13:09.085224 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-ef59abc8-c77a-4c1f-8c40-849056df295b tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470" status: 404 len: 111 microversion: 2.1 time: 0.038084 Jul 28 05:13:09.085224 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5421/7871] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Jul 28 05:13:09 2022] GET /compute/v2.1/servers/75a62e80-940f-4db2-9433-f813f792f470 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 05:13:09.257896 n-d-826756-3 devstack@n-api.service[126071]: DEBUG nova.api.openstack.wsgi [None req-1010d304-6208-454d-a4e7-14a285836e87 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] Calling method '.version_select at 0x7ffa66e13160>' {{(pid=126071) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 05:13:09.284259 n-d-826756-3 devstack@n-api.service[126071]: INFO nova.api.openstack.requestlog [None req-1010d304-6208-454d-a4e7-14a285836e87 tempest-TestSnapshotPattern-947196315 tempest-TestSnapshotPattern-947196315-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1438325450" status: 202 len: 0 microversion: 2.1 time: 0.030696 Jul 28 05:13:09.285024 n-d-826756-3 devstack@n-api.service[126071]: [pid: 126071|app: 0|req: 5422/7872] 10.222.0.48 () {58 vars in 1257 bytes} [Thu Jul 28 05:13:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1438325450 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 05:13:37.496514 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:13:37.497476 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 05:13:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 05:14:03.907121 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:14:03.907801 n-d-826756-3 devstack@n-api.service[126071]: Thu Jul 28 05:14:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 05:15:05.946857 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:15:05.947498 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 05:15:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 05:15:33.365414 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:15:33.366018 n-d-826756-3 devstack@n-api.service[126071]: Thu Jul 28 05:15:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 05:15:44.102304 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:15:44.102910 n-d-826756-3 devstack@n-api.service[126071]: Thu Jul 28 05:15:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 05:16:57.510182 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:16:57.510851 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 05:16:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 05:17:23.916474 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:17:23.917036 n-d-826756-3 devstack@n-api.service[126071]: Thu Jul 28 05:17:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 05:18:25.956615 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:18:25.957286 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 05:18:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 05:18:53.374668 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:18:53.374668 n-d-826756-3 devstack@n-api.service[126071]: Thu Jul 28 05:18:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 05:19:04.111545 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:19:04.113001 n-d-826756-3 devstack@n-api.service[126071]: Thu Jul 28 05:19:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 05:20:17.520776 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:20:17.521414 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 05:20:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!! Jul 28 05:20:43.928183 n-d-826756-3 devstack@n-api.service[126071]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:20:43.929194 n-d-826756-3 devstack@n-api.service[126071]: Thu Jul 28 05:20:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 05:21:45.966413 n-d-826756-3 devstack@n-api.service[126072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 05:21:45.967022 n-d-826756-3 devstack@n-api.service[126072]: Thu Jul 28 05:21:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-groups (ip 10.222.0.48) !!!